-- Logs begin at Thu 2022-08-25 11:49:39 UTC, end at Thu 2022-08-25 15:04:11 UTC. -- Aug 25 12:26:22.976730 n-d-852771-8 systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 12:26:22.985791 n-d-852771-8 devstack@n-api.service[106704]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 12:26:22.987752 n-d-852771-8 devstack@n-api.service[106704]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 12:26:22 2022] *** Aug 25 12:26:22.987752 n-d-852771-8 devstack@n-api.service[106704]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 12:26:22.987752 n-d-852771-8 devstack@n-api.service[106704]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 12:26:22.987752 n-d-852771-8 devstack@n-api.service[106704]: nodename: n-d-852771-8 Aug 25 12:26:22.987752 n-d-852771-8 devstack@n-api.service[106704]: machine: x86_64 Aug 25 12:26:22.987752 n-d-852771-8 devstack@n-api.service[106704]: clock source: unix Aug 25 12:26:22.987752 n-d-852771-8 devstack@n-api.service[106704]: pcre jit disabled Aug 25 12:26:22.987752 n-d-852771-8 devstack@n-api.service[106704]: detected number of CPU cores: 4 Aug 25 12:26:22.987752 n-d-852771-8 devstack@n-api.service[106704]: current working directory: / Aug 25 12:26:22.987752 n-d-852771-8 devstack@n-api.service[106704]: detected binary path: /usr/bin/uwsgi-core Aug 25 12:26:22.988661 n-d-852771-8 devstack@n-api.service[106704]: your processes number limit is 47680 Aug 25 12:26:22.988661 n-d-852771-8 devstack@n-api.service[106704]: your memory page size is 4096 bytes Aug 25 12:26:22.988661 n-d-852771-8 devstack@n-api.service[106704]: detected max file descriptor number: 2048 Aug 25 12:26:22.988661 n-d-852771-8 devstack@n-api.service[106704]: lock engine: pthread robust mutexes Aug 25 12:26:22.988661 n-d-852771-8 devstack@n-api.service[106704]: thunder lock: enabled Aug 25 12:26:22.988661 n-d-852771-8 devstack@n-api.service[106704]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 12:26:22.988661 n-d-852771-8 devstack@n-api.service[106704]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 12:26:23.028262 n-d-852771-8 devstack@n-api.service[106704]: Python main interpreter initialized at 0x55d798b919c0 Aug 25 12:26:23.028262 n-d-852771-8 devstack@n-api.service[106704]: python threads support enabled Aug 25 12:26:23.028262 n-d-852771-8 devstack@n-api.service[106704]: your server socket listen backlog is limited to 100 connections Aug 25 12:26:23.028262 n-d-852771-8 devstack@n-api.service[106704]: your mercy for graceful operations on workers is 90 seconds Aug 25 12:26:23.028669 n-d-852771-8 devstack@n-api.service[106704]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 12:26:23.028669 n-d-852771-8 devstack@n-api.service[106704]: *** Operational MODE: preforking *** Aug 25 12:26:23.028904 n-d-852771-8 devstack@n-api.service[106704]: *** uWSGI is running in multiple interpreter mode *** Aug 25 12:26:23.028904 n-d-852771-8 devstack@n-api.service[106704]: spawned uWSGI master process (pid: 106704) Aug 25 12:26:23.029113 n-d-852771-8 systemd[1]: Started Devstack devstack@n-api.service. Aug 25 12:26:23.033692 n-d-852771-8 devstack@n-api.service[106704]: spawned uWSGI worker 1 (pid: 106705, cores: 1) Aug 25 12:26:23.033692 n-d-852771-8 devstack@n-api.service[106704]: spawned uWSGI worker 2 (pid: 106706, cores: 1) Aug 25 12:26:23.033692 n-d-852771-8 devstack@n-api.service[106704]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 12:26:23.711806 n-d-852771-8 devstack@n-api.service[106705]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 12:26:23.716147 n-d-852771-8 devstack@n-api.service[106706]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 12:26:24.819212 n-d-852771-8 devstack@n-api.service[106705]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:26:24.819212 n-d-852771-8 devstack@n-api.service[106705]: from cryptography.utils import int_from_bytes Aug 25 12:26:24.819894 n-d-852771-8 devstack@n-api.service[106705]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:26:24.819894 n-d-852771-8 devstack@n-api.service[106705]: from cryptography.utils import int_from_bytes Aug 25 12:26:24.826265 n-d-852771-8 devstack@n-api.service[106706]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:26:24.826265 n-d-852771-8 devstack@n-api.service[106706]: from cryptography.utils import int_from_bytes Aug 25 12:26:24.826727 n-d-852771-8 devstack@n-api.service[106706]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:26:24.826727 n-d-852771-8 devstack@n-api.service[106706]: from cryptography.utils import int_from_bytes Aug 25 12:26:27.404020 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 12:26:27.404604 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 12:26:27.404804 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 12:26:27.405163 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 12:26:27.405424 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 12:26:27.405843 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.406171 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.406495 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.406819 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.407152 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.407465 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.407796 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.408116 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.408443 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.408702 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.409020 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.409345 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852771-8 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.409695 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.409895 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 12:26:27.410262 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.410350 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 12:26:27.410442 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.410612 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.410712 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 12:26:27.410917 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.411035 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 12:26:27.411332 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.411433 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 12:26:27.411550 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.411679 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.412001 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.412100 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.412329 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.412480 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.412654 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.412789 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.412988 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.413101 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.413394 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.413552 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.413714 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.413804 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.413962 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.414101 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.414293 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.414474 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.414563 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.414674 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.414869 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.415000 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.415198 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852771-8 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.415333 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.415524 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.415696 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852771-8 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.415838 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.416051 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.416170 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.416336 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.416461 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.416653 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.416769 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.417069 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.417155 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.417383 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.417475 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.417727 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.417932 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.418098 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.418246 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.418375 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.418748 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.418937 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.419217 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.419313 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.419487 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.419580 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.419808 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.419900 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.420128 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.420278 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.420455 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.420568 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.420768 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.420862 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.421077 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.421167 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.421397 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.421497 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.421728 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.421902 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852771-8 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.422037 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.422119 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.422268 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.422435 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.422578 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.422753 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.422898 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.423171 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.423264 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.423499 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.423613 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.423765 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.423858 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.424016 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.424104 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.424335 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.424430 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.424655 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.424744 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.424963 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.425125 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.425271 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.425370 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.425599 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.425702 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.425908 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.426045 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.426216 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.426317 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.426522 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.426609 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.426830 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.426921 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.427137 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.427223 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.427454 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.427550 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.427773 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.427866 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.428026 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.428117 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.428345 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.428493 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.428673 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.428838 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.428998 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.429086 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.429319 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.429527 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.429641 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.429735 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.429844 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.429981 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.430181 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.430301 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.430493 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.430613 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.430807 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.430931 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.431120 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.431902 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.432024 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.432214 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.432311 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.432402 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.432481 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.432557 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.432646 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.432751 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.432832 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.432949 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.433060 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.433141 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.433313 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.433409 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.433658 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.433755 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.433947 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.434636 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.434928 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.435073 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.435163 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.435430 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.435520 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.435763 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.435867 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.436065 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.436158 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.436371 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.436457 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.436679 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.436774 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.436988 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.437080 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.437296 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.437382 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.437624 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.437714 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.437936 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.438029 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.438243 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.438334 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.438605 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.438725 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.438849 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.438954 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.439165 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.439262 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.439510 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.439616 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.439789 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.439905 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.440097 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.440190 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.440406 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.440500 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.440716 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.440802 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.441036 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.441132 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.441347 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.441435 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.441680 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.441778 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.441996 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.442082 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.442301 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.442388 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.442609 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.442694 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.442920 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.443026 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.443226 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.443317 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.443533 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.443629 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.443844 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.443952 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.444144 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.444230 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.444451 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.444537 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.444846 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.444955 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.445066 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.445151 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.445372 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.445456 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.445700 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.445801 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.446004 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.446097 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.446309 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.446400 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.446613 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.446710 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.446920 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.447014 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.447228 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.447317 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.447530 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.447625 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.447845 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.447936 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.448165 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.448263 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.448476 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.448561 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.448782 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.448877 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.449092 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.449196 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.449402 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.449524 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.449856 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.450443 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.450715 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.451064 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.451171 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.451381 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.451651 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.451743 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.451954 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.452053 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.452289 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.452457 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.452606 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.452766 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.452923 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.453018 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.453237 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.453329 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.453569 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.453658 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.453888 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.454010 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.454196 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.454281 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.454507 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.454598 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.454823 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.454930 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.455184 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.455284 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.455447 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.455589 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.455764 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.455852 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.456078 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.456171 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.456386 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.456479 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.456694 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.456779 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.457020 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.457105 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:26:27.457750 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.457868 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.457960 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.458047 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.458134 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.458212 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.458351 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.458485 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.458662 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.458756 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.458987 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.459074 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.459313 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.459416 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.459627 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.459725 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.459934 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.460026 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.460244 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.460341 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.460566 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.460652 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.460881 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.460969 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.461197 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.461290 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.461532 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.461633 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.461854 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.461948 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.462176 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.462276 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.462494 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.462595 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.462803 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.462889 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.463114 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.463214 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.463426 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.463518 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.463735 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.463836 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.464072 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.464179 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.464387 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.464474 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.464699 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.464813 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.465017 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.465115 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.465354 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.466022 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.466205 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.466426 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.466526 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.466762 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.466847 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.467092 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.467177 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.467470 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.467578 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.467724 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.467809 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.468026 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.468109 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.468337 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.468436 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.468642 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.468732 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.469015 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.469125 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.469296 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.469445 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.469624 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.469804 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.469953 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.470037 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.470258 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.470345 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.470569 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.470661 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.470880 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.470967 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.471191 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.471278 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.471497 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.471585 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.471810 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.471895 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.472122 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.472215 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.472427 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.472517 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.472752 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.472842 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.473062 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.473149 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.473367 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.473463 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.473717 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.473888 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.474025 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.474121 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.474333 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.474418 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.474643 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.474738 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.474954 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.475039 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.475262 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.475346 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.475574 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.475668 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.475884 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.475970 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.476206 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.476298 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.476521 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.476620 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.476835 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.476921 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.477167 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.477252 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.477480 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.477618 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.477817 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.477902 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.478129 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.478214 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.478446 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.478533 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.478756 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.478842 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.479090 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.479190 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.479376 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.479510 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.479673 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.479760 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.479978 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.480063 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.480283 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.480379 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.480592 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.480677 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.480892 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.480984 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.481791 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.481901 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.482107 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.482292 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.482426 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.482605 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.482732 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.482915 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.483045 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.483242 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.483365 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.483554 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.483679 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.483861 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.484006 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.484169 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.484323 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.484475 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.484640 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.484818 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.484980 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.485127 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.485319 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.485470 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.485656 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.485832 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.485986 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.486159 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.486318 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.486483 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.486638 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.486797 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.486948 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.487114 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.487267 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.487426 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.487579 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.487746 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.487890 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.488059 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.488200 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.488371 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.488516 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.488693 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.488826 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.489007 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.489135 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.489327 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.489443 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.489660 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.489793 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.489985 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.490104 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.490296 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.490431 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.490617 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.490745 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.490921 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.491054 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.491236 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.491365 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.491575 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.491671 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.491909 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.491996 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.492228 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.492313 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.492549 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.492634 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.492862 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.492972 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.493176 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.493298 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.493485 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.493654 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.493819 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.493974 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.494133 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.494298 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.494445 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.494613 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.494766 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.494930 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.495078 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.495249 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.495396 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.495567 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.495707 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.495892 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.496030 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.496209 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.496340 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.496533 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.496701 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.496890 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.497214 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.497309 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.497543 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.497633 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.497875 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.497963 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.498184 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.498269 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.498503 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.498598 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.498817 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.498903 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.499141 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.499226 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.499453 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.499548 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.499765 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.499862 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.500076 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.500163 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.500384 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.500472 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.500693 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.500786 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.501008 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.501093 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.501321 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.501408 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.501657 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.501745 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.501972 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.502076 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.502279 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.502365 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.502592 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.502678 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.502902 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.503000 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.503207 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.503293 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.503512 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.503653 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.503824 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.503991 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.504135 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.504231 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.504444 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.504530 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.504770 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.504921 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.505130 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.505253 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.505393 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.505482 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.505734 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.505840 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.506041 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.506135 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.506351 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.506443 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.506657 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.506750 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.506965 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.507067 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.507272 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.507364 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.507586 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.507680 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.507901 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.508001 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.508208 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.508299 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.508522 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.508613 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.508837 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.508929 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.509143 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.509248 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.509459 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.509572 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.509794 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.509891 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.510102 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.510199 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.510411 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.510498 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.510725 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.510809 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.511036 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.511136 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.511353 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.511452 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.511663 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.511757 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.511973 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.512073 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.512391 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.512491 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.512719 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.512843 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.513032 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.513122 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.513344 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.513761 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.513938 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.514026 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.514243 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.514338 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.514557 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.514648 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.514874 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.514960 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.515214 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.515454 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.515540 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.515789 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.515884 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.516107 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.516221 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.516428 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.516522 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.516748 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.516836 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.517061 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.517148 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.517376 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.517472 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.517735 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.517866 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.518050 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.518139 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.518356 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.518450 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.518668 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.518755 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.518976 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.519072 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.519280 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.519370 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.519593 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.519717 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.519896 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.519991 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.520201 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.520295 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.520504 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.520591 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.520814 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.520910 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.521117 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.521204 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.521421 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.521537 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.521746 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.521845 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.522050 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.522344 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.522441 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.522656 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.522749 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.522969 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.523054 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.523275 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.523364 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.523595 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.523690 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.523906 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.523992 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.524211 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.524307 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.524516 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.524601 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.524822 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.524909 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.525165 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.525251 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.525471 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.525595 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.525805 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.525900 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.526116 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.526220 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.526434 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.526530 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.526745 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.526832 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.527052 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.527184 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.527358 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.527453 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.527674 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.527780 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.528514 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.528632 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.528817 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.528984 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.529123 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.529208 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.529429 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.529546 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.529760 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.529857 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.530074 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.530159 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.530388 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.530474 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.530698 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.530792 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.531005 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.531098 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.531310 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.531395 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.531615 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.531704 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.531918 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.532003 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.532225 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.532316 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.532532 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.532625 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.532836 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.532928 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.533139 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.533266 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.533450 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.533584 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.533781 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.533867 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.534084 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.534173 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.534395 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.534482 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.534698 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.534784 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.535014 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.535109 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.535318 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.535411 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.535624 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.535710 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.535930 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.536041 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.536238 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.536330 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.536546 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.536664 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.536851 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.537006 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.537164 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.537294 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.537478 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.537630 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.537806 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.537903 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.538111 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.538209 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.538421 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.538505 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.538723 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.538816 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.539028 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.539115 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.539337 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.539422 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.539646 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.539734 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.539954 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.540047 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.540254 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.540339 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.540562 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.540649 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.540866 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.540958 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.541172 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.541265 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.541475 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.541582 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.541804 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.541891 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.542106 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.542201 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.542408 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.542495 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.542712 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.542796 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.543014 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.543108 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.543318 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.543403 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.544198 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.544300 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.544526 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.544637 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.544900 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.545010 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.545153 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.545247 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.545464 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.545583 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.545954 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.546054 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.546134 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.546211 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.546416 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.546503 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.546729 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.546814 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.547054 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.547139 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.547374 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.547460 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.547681 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.547766 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.547992 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.548076 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.548299 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.548394 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.548601 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.548688 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.548922 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.549045 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.549218 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.549317 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.549572 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.549667 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.549852 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.550006 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.550156 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.550283 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.550461 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.550546 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.550769 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.550865 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.551079 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.551166 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.551394 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.551479 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.551704 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.551800 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.552015 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.552101 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.552316 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.552401 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.552626 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.552721 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.552940 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.553040 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.553246 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.553332 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.553581 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.553670 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.553895 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.553980 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.554208 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.554306 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.554523 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.554611 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.554837 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.554922 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.555149 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.555234 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.555455 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.555541 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.555761 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.555845 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.556151 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.556263 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.556387 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.556474 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.556691 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.556777 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.557001 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.557095 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.557312 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.557397 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.557640 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.557745 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.557952 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.558118 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.558262 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.558347 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.558576 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.558660 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.558882 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.558976 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.559387 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.559481 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.559704 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.559797 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.560019 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.560114 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.560326 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.560424 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.560639 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.560741 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.560946 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.561042 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.561262 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.561354 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.561594 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.561681 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.561902 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.561998 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.562218 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.562323 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.562535 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.562622 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.562847 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.562938 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.563163 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.563249 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.563479 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.563616 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.563788 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.563884 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.564106 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.564191 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.564417 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.564501 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.564718 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.564803 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.565022 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.565108 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.565325 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.565420 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.565664 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.565753 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.565966 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.566050 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.566288 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.566391 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.566706 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.566792 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.567018 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.567110 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.567328 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.567422 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.567643 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.567743 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.567961 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.568046 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.568283 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.568382 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.568602 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.568688 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.568911 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.568996 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.569265 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.569352 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.569589 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.569676 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.569906 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.570001 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.570222 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.570343 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.570539 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.570628 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.570859 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.570944 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.571170 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.571256 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.571484 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.571586 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.571789 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.571874 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.572095 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.572201 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.572403 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.572491 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.572717 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.572809 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.573026 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.573110 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.573354 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.573442 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.573795 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.573897 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.574104 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.574206 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.574412 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.574587 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.575264 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.575539 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.575628 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.575858 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.575944 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.576169 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.576261 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.576475 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.576561 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.576782 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.576871 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.577107 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.577195 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.577415 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.577566 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.577752 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.577840 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.578062 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.578148 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.578371 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.578466 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.578677 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.578764 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.578980 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.579067 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.579302 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.579401 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.579605 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.579692 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.579926 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.580012 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.580264 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.580374 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.580559 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.580653 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.580878 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.580965 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.581218 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.581324 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.581493 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.581642 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.581825 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.581960 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.582132 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.582288 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.582437 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.582618 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.582743 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.582927 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.583085 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.583238 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.583388 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.583553 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.583725 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.583861 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.584038 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.584160 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.584365 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.584490 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.584677 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.584798 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.585013 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.585101 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.585340 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.585425 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.585680 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.585783 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.586001 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.586088 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.586325 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.586418 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.586630 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.586725 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.586932 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.587026 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.587248 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.587333 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.587552 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.587647 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.587857 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.587950 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.588159 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.588248 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.588468 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.588566 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.588770 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.588855 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.589072 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.589158 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.589373 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.589459 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.589712 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.589798 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.590014 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.590110 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.590379 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.590960 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.591203 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.591279 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.591509 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.591594 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.591818 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.591904 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.592123 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.592209 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.592465 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.592551 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.592770 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.592864 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.593098 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.593185 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.593407 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.593537 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.593753 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.593840 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.594071 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.594168 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.594387 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.594483 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.594729 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.594845 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.595014 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.595101 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.595325 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.595422 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.595635 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.595723 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.595938 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.596025 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.596247 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.596342 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.596551 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.596644 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.596871 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.596981 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.597167 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.597264 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.597496 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.597742 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.597840 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.598072 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.598175 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.598388 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.598476 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.598703 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.598789 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.599017 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.599176 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.599326 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.599411 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.599639 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.599726 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.599951 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.600039 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.600263 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.600356 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.600575 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.600663 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.600888 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.600984 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.601207 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.601292 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.601555 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.601670 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.601872 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.601965 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.602196 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.602283 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.602515 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.602601 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.602833 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.602920 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.603147 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.603232 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.603458 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.603552 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.603780 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.603868 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.604101 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.604188 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.604406 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.604504 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.604722 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.604969 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.605071 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.605287 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.605388 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.605650 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.605753 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.606077 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.606203 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.606414 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.606740 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.607062 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.607378 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.607465 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.607696 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.608014 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.608195 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.608331 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.608666 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.608820 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.608993 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.609323 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.609409 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.609697 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.609990 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.610075 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.610334 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.610585 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.610673 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.610964 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.611329 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.611541 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.611633 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.611948 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.612045 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.612267 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.612569 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.612664 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.612894 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.613169 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.613257 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.613531 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.613817 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.613921 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.614160 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.614480 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.614637 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.614796 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.615118 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.615438 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.615654 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.615777 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.616118 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.616203 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.616443 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.616756 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.616843 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.617073 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.617354 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.617442 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.617921 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.618027 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.618262 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.618601 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.618693 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.618934 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.619205 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.619389 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.619576 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.619903 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.619988 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.620235 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.620487 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.620585 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.620844 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.621086 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.621173 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.621464 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.621828 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.621939 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.622154 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.622456 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.622560 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.622766 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.623046 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.623133 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.623384 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.623642 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.623923 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.624169 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.624305 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.624586 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.624822 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.624909 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.625229 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.625493 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.625602 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.625903 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.626160 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.626248 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.626512 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.626823 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.627169 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.627296 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.627557 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.627793 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.627882 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.627975 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.628087 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.628205 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.628404 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.628532 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.628717 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.628872 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.629026 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.629298 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.629469 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.629692 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.629821 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.629906 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.630063 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.630227 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.630376 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.630558 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.630689 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.630882 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.631000 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.631200 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.631318 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.631515 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.631615 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.632039 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.632135 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.632211 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.632286 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.632456 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.632557 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.632773 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.632862 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.633084 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.633178 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.633410 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.633497 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.633754 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.633854 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.634069 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.634157 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.634378 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.634467 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.634693 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.634784 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.635057 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.635189 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.635371 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.635458 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.635681 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.635767 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.636036 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.636136 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.636305 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.636393 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.636617 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.636703 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.636932 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.637027 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.637868 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.638031 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.638224 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.638356 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.638834 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.638938 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.639149 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.639236 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.639524 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.639710 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.639857 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.640055 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.640172 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.640387 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.640472 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.640733 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.640820 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.641080 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.641395 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.641488 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.641745 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.641861 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.642065 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.642181 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.642475 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.642594 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.642794 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.642906 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.643117 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.643231 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.643516 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.643706 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.643833 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.644049 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.644172 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.644382 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.644504 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.644728 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.644841 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.645060 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.645181 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.645371 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.645483 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.645710 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.645850 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.646350 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.647270 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.647270 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.647405 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.647535 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.647702 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.647789 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.648031 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.648136 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.648350 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.648437 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.648665 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.648753 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.649020 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.649116 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.649294 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.649391 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.649630 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.649721 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.649980 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.650265 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.650368 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.650580 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.650698 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.650894 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.651030 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.651208 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.651360 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.651532 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.651686 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.651881 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.652013 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.652207 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.652342 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.652531 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.652699 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.652977 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.653899 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.654072 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.654461 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.654584 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.654781 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.655145 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.655268 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.655417 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.655622 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.655736 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.656063 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.656177 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.656385 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.656695 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.656818 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.657132 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.657306 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.657449 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.657800 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.657985 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.658127 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.658444 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.658556 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.658769 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.658883 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.659098 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.659198 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.659414 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.659502 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.659745 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.659840 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.660059 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.660154 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.660390 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.660502 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.660734 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.660860 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.661149 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.661334 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.661463 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.661754 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.661845 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.662073 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.662161 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.662491 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.662583 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.662801 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.662892 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.663116 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.663204 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.663439 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.663526 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.663754 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.663857 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.664061 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.664149 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.664369 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.664455 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.664786 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.664900 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.664984 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.665188 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.665269 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.665364 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.665672 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.665983 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.666361 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.666603 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.666910 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.667217 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.667305 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.667606 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.667708 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.667820 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.667907 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.668126 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.668223 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.668458 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.668590 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.668805 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.668936 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.669279 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.669465 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.669580 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.669794 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.669893 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.670101 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.670193 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.670442 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.670712 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.670799 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.670996 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.671082 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.671397 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.671518 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.671743 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.671881 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.672071 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.672235 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.672384 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.672571 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.672709 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.672910 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.673034 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.673240 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.673359 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.673605 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.673696 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.674023 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.674117 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.674337 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.674661 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.674748 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.674976 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.675287 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.675374 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.675604 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.675906 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.675995 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.676241 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.676506 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.676618 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.676868 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.677158 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.677251 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.677334 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.677529 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.677706 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.677848 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.678168 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.678300 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.678486 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.678817 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.678903 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.679133 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.679449 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.679535 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.679762 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.680069 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.680168 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.680381 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.680689 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.680782 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.681167 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.681260 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.681350 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.681463 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.681643 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.681835 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.681963 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.682171 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.682293 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.682516 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.682622 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.682850 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.682943 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.683398 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.683492 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.683580 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.683661 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.683836 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.683923 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.684197 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.684310 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.684518 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.684732 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.684828 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.684916 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.685153 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.685241 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.685480 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.685631 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.685811 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.685907 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.686061 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 12:26:27.686148 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.686450 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.686782 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.687119 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.687483 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.687827 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.688112 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.688447 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.688809 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.689134 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.689492 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.689855 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.690179 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.690504 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.690826 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:26:27.691073 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 12:26:27.846032 n-d-852771-8 devstack@n-api.service[106705]: INFO dbcounter [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Registered counter for database nova_api Aug 25 12:26:27.847685 n-d-852771-8 devstack@n-api.service[106706]: INFO dbcounter [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Registered counter for database nova_api Aug 25 12:26:27.867001 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_db.sqlalchemy.engines [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:26:27.868799 n-d-852771-8 devstack@n-api.service[106706]: DEBUG oslo_db.sqlalchemy.engines [None req-78f77653-c313-4341-ae53-facea0d385ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:26:27.874085 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writer thread running {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:26:27.875942 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writer thread running {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:26:27.931981 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.context [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),638d90be-ffdb-4b61-b94a-775c50a724be(cell1) {{(pid=106705) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 12:26:27.933756 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.context [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),638d90be-ffdb-4b61-b94a-775c50a724be(cell1) {{(pid=106706) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 12:26:27.936480 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:26:27.936955 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:26:27.938189 n-d-852771-8 devstack@n-api.service[106706]: DEBUG oslo_concurrency.lockutils [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:26:27.938522 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:26:27.938673 n-d-852771-8 devstack@n-api.service[106706]: DEBUG oslo_concurrency.lockutils [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:26:27.939260 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:26:27.939706 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:26:27.940215 n-d-852771-8 devstack@n-api.service[106706]: DEBUG oslo_concurrency.lockutils [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:26:27.940955 n-d-852771-8 devstack@n-api.service[106706]: DEBUG oslo_concurrency.lockutils [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:26:27.941404 n-d-852771-8 devstack@n-api.service[106706]: DEBUG oslo_concurrency.lockutils [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:26:27.941686 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:26:27.943406 n-d-852771-8 devstack@n-api.service[106706]: DEBUG oslo_concurrency.lockutils [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:26:27.943676 n-d-852771-8 devstack@n-api.service[106705]: INFO dbcounter [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Registered counter for database nova_cell0 Aug 25 12:26:27.945402 n-d-852771-8 devstack@n-api.service[106706]: INFO dbcounter [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Registered counter for database nova_cell0 Aug 25 12:26:27.949403 n-d-852771-8 devstack@n-api.service[106705]: INFO dbcounter [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Registered counter for database nova_cell1 Aug 25 12:26:27.951525 n-d-852771-8 devstack@n-api.service[106706]: INFO dbcounter [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Registered counter for database nova_cell1 Aug 25 12:26:27.957953 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_db.sqlalchemy.engines [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:26:27.959486 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_db.sqlalchemy.engines [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:26:27.962875 n-d-852771-8 devstack@n-api.service[106706]: DEBUG oslo_db.sqlalchemy.engines [None req-78f77653-c313-4341-ae53-facea0d385ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:26:27.965044 n-d-852771-8 devstack@n-api.service[106706]: DEBUG oslo_db.sqlalchemy.engines [None req-78f77653-c313-4341-ae53-facea0d385ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:26:27.966055 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writer thread running {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:26:27.968633 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writer thread running {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:26:27.970578 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writer thread running {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:26:27.975807 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writer thread running {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:26:28.117481 n-d-852771-8 devstack@n-api.service[106705]: INFO dbcounter [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Registered counter for database nova_cell0 Aug 25 12:26:28.121214 n-d-852771-8 devstack@n-api.service[106706]: INFO dbcounter [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Registered counter for database nova_cell0 Aug 25 12:26:28.127437 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_db.sqlalchemy.engines [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:26:28.131001 n-d-852771-8 devstack@n-api.service[106706]: DEBUG oslo_db.sqlalchemy.engines [None req-78f77653-c313-4341-ae53-facea0d385ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:26:28.132600 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writer thread running {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:26:28.135512 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writer thread running {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:26:28.477280 n-d-852771-8 devstack@n-api.service[106706]: WARNING keystonemiddleware.auth_token [None req-78f77653-c313-4341-ae53-facea0d385ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:26:28.479661 n-d-852771-8 devstack@n-api.service[106705]: WARNING keystonemiddleware.auth_token [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:26:28.485629 n-d-852771-8 devstack@n-api.service[106706]: WARNING keystonemiddleware.auth_token [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:26:28.487801 n-d-852771-8 devstack@n-api.service[106705]: WARNING keystonemiddleware.auth_token [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:26:28.828740 n-d-852771-8 devstack@n-api.service[106706]: WARNING keystonemiddleware.auth_token [None req-78f77653-c313-4341-ae53-facea0d385ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:26:28.830819 n-d-852771-8 devstack@n-api.service[106705]: WARNING keystonemiddleware.auth_token [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:26:28.834656 n-d-852771-8 devstack@n-api.service[106706]: WARNING keystonemiddleware.auth_token [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:26:28.836704 n-d-852771-8 devstack@n-api.service[106705]: WARNING keystonemiddleware.auth_token [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:26:28.839867 n-d-852771-8 devstack@n-api.service[106706]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d798b919c0 pid: 106706 (default app) Aug 25 12:26:28.842601 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-78f77653-c313-4341-ae53-facea0d385ad None None] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:26:28.842745 n-d-852771-8 devstack@n-api.service[106705]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d798b919c0 pid: 106705 (default app) Aug 25 12:26:28.843800 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-78f77653-c313-4341-ae53-facea0d385ad None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001764 Aug 25 12:26:28.844204 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Thu Aug 25 12:26:28 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:27:49.373426 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:27:49.374681 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Aug 25 12:27:49.380525 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:27:49 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:27:49.393315 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writing DB stats nova_api:SELECT=3 {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:27:49.394615 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writing DB stats nova_cell0:SELECT=3 {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:27:49.395587 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writing DB stats nova_cell1:SELECT=3 {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:27:49.396748 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:27:50.316346 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-cdb08fab-a6f8-43d6-8b7e-ee3edc6ae53f admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:27:50.350124 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-cdb08fab-a6f8-43d6-8b7e-ee3edc6ae53f admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.968347 Aug 25 12:27:50.350900 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 2/3] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Aug 25 12:27:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:27:52.761392 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:27:52.762583 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-c120890e-1f73-47ee-ac82-170ba8c651dd None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 25 12:27:52.766251 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 2/4] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:27:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:27:53.248303 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-fd37d8d5-8c27-4982-b6aa-e748805d430b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "id": "c1"}} {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:27:53.299757 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-fd37d8d5-8c27-4982-b6aa-e748805d430b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.530457 Aug 25 12:27:53.301877 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 3/5] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Aug 25 12:27:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:27:53.315513 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writing DB stats nova_api:SELECT=3 {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:27:53.316400 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writing DB stats nova_cell1:SELECT=3 {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:27:53.317617 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writing DB stats nova_cell0:SELECT=3 {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:27:53.318704 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:27:53.531466 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-ba40aba6-563c-4d7a-a087-93ce79d2e891 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:27:53.596345 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-ba40aba6-563c-4d7a-a087-93ce79d2e891 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286294 Aug 25 12:27:53.596939 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 3/6] 10.222.0.70 () {64 vars in 1336 bytes} [Thu Aug 25 12:27:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:27:56.086864 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-fd37d8d5-8c27-4982-b6aa-e748805d430b admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:27:56.087822 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-fd37d8d5-8c27-4982-b6aa-e748805d430b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 25 12:27:56.088240 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 4/7] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:27:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:27:56.877490 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-4525e019-a64d-4b10-b78a-b52d833cd4dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:27:56.928760 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-4525e019-a64d-4b10-b78a-b52d833cd4dc admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.832899 Aug 25 12:27:56.929613 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 4/8] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Aug 25 12:27:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:27:56.941706 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-313c7b51-9731-4246-8cb0-8cd783057d01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:27:56.980404 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-313c7b51-9731-4246-8cb0-8cd783057d01 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042365 Aug 25 12:27:56.981296 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 5/9] 10.222.0.70 () {64 vars in 1336 bytes} [Thu Aug 25 12:27:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:27:59.763936 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-4525e019-a64d-4b10-b78a-b52d833cd4dc admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:27:59.764970 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-4525e019-a64d-4b10-b78a-b52d833cd4dc admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 25 12:27:59.766745 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:27:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:00.238047 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-ca154bbd-445d-46bc-ba41-521ac2ffbabf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "vcpus": 1, "name": "ds1G", "swap": 0, "ram": 1024}} {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:00.263053 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-ca154bbd-445d-46bc-ba41-521ac2ffbabf admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490426 Aug 25 12:28:00.271568 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 6/11] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Aug 25 12:27:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:28:00.280083 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-a250f8a7-cfc5-4267-862c-32c45a9c7f90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:00.309864 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-a250f8a7-cfc5-4267-862c-32c45a9c7f90 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036602 Aug 25 12:28:00.311679 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 6/12] 10.222.0.70 () {64 vars in 1336 bytes} [Thu Aug 25 12:28:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:28:02.838876 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-ca154bbd-445d-46bc-ba41-521ac2ffbabf admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:02.839928 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-ca154bbd-445d-46bc-ba41-521ac2ffbabf admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001916 Aug 25 12:28:02.840367 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 7/13] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:28:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:03.504404 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-c6d233d1-320c-48aa-86b3-c5fd78353faf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:03.535610 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-c6d233d1-320c-48aa-86b3-c5fd78353faf admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.676336 Aug 25 12:28:03.536877 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 7/14] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Aug 25 12:28:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:28:03.557621 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-d61a240c-4fea-40bb-8161-d791ece4a6a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:03.596505 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-d61a240c-4fea-40bb-8161-d791ece4a6a8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045717 Aug 25 12:28:03.597090 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 8/15] 10.222.0.70 () {64 vars in 1336 bytes} [Thu Aug 25 12:28:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:28:06.101240 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-c6d233d1-320c-48aa-86b3-c5fd78353faf admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:06.102964 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-c6d233d1-320c-48aa-86b3-c5fd78353faf admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Aug 25 12:28:06.103758 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 8/16] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:28:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:06.608224 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-7b3b0737-c454-4c45-9550-26d6a73cce2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "disk": 20}} {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:06.633494 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-7b3b0737-c454-4c45-9550-26d6a73cce2d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.522476 Aug 25 12:28:06.635548 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 9/17] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Aug 25 12:28:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:28:06.647858 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-fd4b7afa-0f9e-4463-9941-c9607b3fb170 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:06.705266 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-fd4b7afa-0f9e-4463-9941-c9607b3fb170 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060972 Aug 25 12:28:06.706545 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 9/18] 10.222.0.70 () {64 vars in 1336 bytes} [Thu Aug 25 12:28:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:28:09.256013 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-7b3b0737-c454-4c45-9550-26d6a73cce2d admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:09.258565 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-7b3b0737-c454-4c45-9550-26d6a73cce2d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Aug 25 12:28:09.272010 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 10/19] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:28:09 2022] GET /compute/v2.1 => generated 388 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:09.782329 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-593fcea4-eed7-4c0b-9d2e-afa9d5448f6a admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:09.812074 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-593fcea4-eed7-4c0b-9d2e-afa9d5448f6a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.544245 Aug 25 12:28:09.826568 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 10/20] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Aug 25 12:28:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:28:12.267821 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-7b3b0737-c454-4c45-9550-26d6a73cce2d admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:12.268898 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-7b3b0737-c454-4c45-9550-26d6a73cce2d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 25 12:28:12.269290 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 11/21] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:12.756113 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-738abef5-55b6-4a82-aaf8-8baba94de8b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "swap": 0}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:12.779368 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-738abef5-55b6-4a82-aaf8-8baba94de8b2 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.501129 Aug 25 12:28:12.780063 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 11/22] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Aug 25 12:28:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:28:12.795466 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-aa953b5e-40d9-491f-93c5-95a6212bcceb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:12.822175 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-aa953b5e-40d9-491f-93c5-95a6212bcceb admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030657 Aug 25 12:28:12.822767 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 12/23] 10.222.0.70 () {64 vars in 1333 bytes} [Thu Aug 25 12:28:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:28:15.423937 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-738abef5-55b6-4a82-aaf8-8baba94de8b2 admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:15.424957 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-738abef5-55b6-4a82-aaf8-8baba94de8b2 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 25 12:28:15.425750 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 12/24] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:28:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:15.915420 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-968d08cc-55c9-40cf-8d2a-b820020d4a2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "vcpus": 1, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:15.936753 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-968d08cc-55c9-40cf-8d2a-b820020d4a2c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.502787 Aug 25 12:28:15.937333 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 13/25] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Aug 25 12:28:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:28:15.949869 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-6d63f0ab-4eb3-4529-a1e6-343ea8c0db0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:15.976168 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-6d63f0ab-4eb3-4529-a1e6-343ea8c0db0e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030166 Aug 25 12:28:15.977518 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 13/26] 10.222.0.70 () {64 vars in 1333 bytes} [Thu Aug 25 12:28:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:28:18.412166 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-968d08cc-55c9-40cf-8d2a-b820020d4a2c admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:18.413177 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-968d08cc-55c9-40cf-8d2a-b820020d4a2c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 25 12:28:18.414178 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 14/27] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:28:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:18.868830 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-daec5a89-a22e-45b9-8039-606a5cf2c8ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:18.889305 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-daec5a89-a22e-45b9-8039-606a5cf2c8ae admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.468834 Aug 25 12:28:18.889887 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 14/28] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Aug 25 12:28:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:28:18.902789 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-7f729763-0042-4736-ba07-7b51bbf4d259 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:18.927490 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-7f729763-0042-4736-ba07-7b51bbf4d259 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029107 Aug 25 12:28:18.928263 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 15/29] 10.222.0.70 () {64 vars in 1333 bytes} [Thu Aug 25 12:28:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:28:21.313286 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-daec5a89-a22e-45b9-8039-606a5cf2c8ae admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:21.314979 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-daec5a89-a22e-45b9-8039-606a5cf2c8ae admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002098 Aug 25 12:28:21.315648 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 15/30] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:21.752408 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-f08db043-7637-40d8-9c4a-4c404a453a48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "swap": 0, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:21.760648 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:28:21.774247 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-f08db043-7637-40d8-9c4a-4c404a453a48 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.448914 Aug 25 12:28:21.782268 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 16/31] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Aug 25 12:28:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:28:21.787375 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-842a9cad-dd9c-46bb-a4d2-f101254251b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:21.820766 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-842a9cad-dd9c-46bb-a4d2-f101254251b5 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035833 Aug 25 12:28:21.821356 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 16/32] 10.222.0.70 () {64 vars in 1333 bytes} [Thu Aug 25 12:28:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:28:24.335261 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-f08db043-7637-40d8-9c4a-4c404a453a48 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:24.337447 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-f08db043-7637-40d8-9c4a-4c404a453a48 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002662 Aug 25 12:28:24.341823 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 17/33] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:24.811763 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-5ad06e55-24fb-4d78-9bc2-aebd53081043 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:24.839400 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-5ad06e55-24fb-4d78-9bc2-aebd53081043 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.495078 Aug 25 12:28:24.840096 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 17/34] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Aug 25 12:28:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:28:24.861679 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-c2d8bfe9-4057-4a55-a400-2ab52733a266 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:24.896542 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-c2d8bfe9-4057-4a55-a400-2ab52733a266 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045385 Aug 25 12:28:24.897141 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 18/35] 10.222.0.70 () {64 vars in 1333 bytes} [Thu Aug 25 12:28:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:28:48.026372 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-5ad06e55-24fb-4d78-9bc2-aebd53081043 admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:48.027729 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-5ad06e55-24fb-4d78-9bc2-aebd53081043 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002173 Aug 25 12:28:48.028141 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 18/36] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:28:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:48.040198 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:28:48.464662 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-adb5707b-2fd7-40cd-8fad-f70eab91e3d6 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:48.486029 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-adb5707b-2fd7-40cd-8fad-f70eab91e3d6 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.450902 Aug 25 12:28:48.486576 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 19/37] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Aug 25 12:28:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:28:49.581274 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-5ad06e55-24fb-4d78-9bc2-aebd53081043 admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:49.582337 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-5ad06e55-24fb-4d78-9bc2-aebd53081043 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 25 12:28:49.582746 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 19/38] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Aug 25 12:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:50.187808 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-6ea11f33-71c6-4a0a-b26d-ebc53aeae0b4 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:50.194372 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.wsgi [None req-6ea11f33-71c6-4a0a-b26d-ebc53aeae0b4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-6ea11f33-71c6-4a0a-b26d-ebc53aeae0b4 admin admin] Request method failure captured: Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: Accept: application/json Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: Accept-Encoding: gzip, deflate Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: Connection: keep-alive Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: Content-Length: 0 Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: Host: 10.222.0.70 Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: Openstack-Api-Version: compute 2.90 Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: Openstack-System-Scope: None Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: User-Agent: python-novaclient Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Auth-Token: gAAAAABjB2sB9Pe1UMmazge9eVqtZo9ZX_NtCqf5O1BBBfLvG1n7KQMBTzLFyoYoLyvP1RBDxG5704ux4xxXS-2bjxhL7msarWBrnxBJcSSP4CfkW6FS7GCpbZDKV_pK892qq-beXf3DQZUUVe2_tTCFi6aMJ79t9BWAduaJKqPHcMwfcWIyrKc Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Domain-Id: None Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Domain-Name: None Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Identity-Status: Confirmed Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Is-Admin-Project: True Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Domain-Id: default Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Domain-Name: Default Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Name: admin Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Role: member,admin,reader Aug 25 12:28:50.197796 n-d-852771-8 devstack@n-api.service[106706]: X-Roles: member,admin,reader Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6f37c641b533406d8bb607c10bd83bac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}] Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: X-Tenant: admin Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: X-Tenant-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: X-Tenant-Name: admin Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: X-User: admin Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: X-User-Domain-Id: default Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: X-User-Domain-Name: Default Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: X-User-Id: df1fbcb72a0a430d95e2807f38e8837e Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: X-User-Name: admin Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: method: > Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: exception: Flavor 42 could not be found. Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: action_args: {'id': '42'} Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:28:50.199506 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:50.200644 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:50.202077 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-6ea11f33-71c6-4a0a-b26d-ebc53aeae0b4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:28:50.203371 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-6ea11f33-71c6-4a0a-b26d-ebc53aeae0b4 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.445402 Aug 25 12:28:50.203371 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 20/39] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Aug 25 12:28:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 12:28:50.209040 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-980d3a0d-6a9e-47f7-8991-c1ce43d6717e admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:50.214003 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:28:50.234571 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-980d3a0d-6a9e-47f7-8991-c1ce43d6717e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028978 Aug 25 12:28:50.235158 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 20/40] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Aug 25 12:28:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:28:50.256697 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-62d360cc-eac2-4d4d-9c47-87fa7404dd6b admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:50.281754 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-62d360cc-eac2-4d4d-9c47-87fa7404dd6b admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028799 Aug 25 12:28:50.282333 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 21/41] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Aug 25 12:28:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:28:50.292742 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-11799d95-dab0-41fc-af23-16b3aaa14229 admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:50.299469 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.wsgi [None req-11799d95-dab0-41fc-af23-16b3aaa14229 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-11799d95-dab0-41fc-af23-16b3aaa14229 admin admin] Request method failure captured: Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: Accept: application/json Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: Accept-Encoding: gzip, deflate Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: Connection: keep-alive Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: Content-Length: 0 Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: Host: 10.222.0.70 Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: Openstack-Api-Version: compute 2.90 Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: Openstack-System-Scope: None Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: User-Agent: python-novaclient Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Auth-Token: gAAAAABjB2sB9Pe1UMmazge9eVqtZo9ZX_NtCqf5O1BBBfLvG1n7KQMBTzLFyoYoLyvP1RBDxG5704ux4xxXS-2bjxhL7msarWBrnxBJcSSP4CfkW6FS7GCpbZDKV_pK892qq-beXf3DQZUUVe2_tTCFi6aMJ79t9BWAduaJKqPHcMwfcWIyrKc Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Domain-Id: None Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Domain-Name: None Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Identity-Status: Confirmed Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Is-Admin-Project: True Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Domain-Id: default Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Domain-Name: Default Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Name: admin Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Role: member,admin,reader Aug 25 12:28:50.302804 n-d-852771-8 devstack@n-api.service[106705]: X-Roles: member,admin,reader Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6f37c641b533406d8bb607c10bd83bac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}] Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: X-Tenant: admin Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: X-Tenant-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: X-Tenant-Name: admin Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: X-User: admin Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: X-User-Domain-Id: default Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: X-User-Domain-Name: Default Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: X-User-Id: df1fbcb72a0a430d95e2807f38e8837e Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: X-User-Name: admin Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: method: > Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: exception: Flavor 42 could not be found. Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: action_args: {'id': '42'} Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:28:50.305319 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:50.306325 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:50.307594 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-11799d95-dab0-41fc-af23-16b3aaa14229 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:28:50.308921 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-11799d95-dab0-41fc-af23-16b3aaa14229 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015957 Aug 25 12:28:50.308921 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 21/42] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Aug 25 12:28:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:28:51.297309 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-62d360cc-eac2-4d4d-9c47-87fa7404dd6b admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:51.298415 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-62d360cc-eac2-4d4d-9c47-87fa7404dd6b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 25 12:28:51.298756 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 22/43] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Aug 25 12:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:51.846810 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-c59584c1-1f9a-4f83-abc3-a073e8842d7a admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:51.853120 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.wsgi [None req-c59584c1-1f9a-4f83-abc3-a073e8842d7a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-c59584c1-1f9a-4f83-abc3-a073e8842d7a admin admin] Request method failure captured: Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: Accept: application/json Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: Accept-Encoding: gzip, deflate Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: Connection: keep-alive Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: Content-Length: 0 Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: Host: 10.222.0.70 Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: Openstack-Api-Version: compute 2.90 Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: Openstack-System-Scope: None Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: User-Agent: python-novaclient Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Auth-Token: gAAAAABjB2sD75s4PyFBK9Z3YN6D97pzv_p6frx3pfGm-vuhodolNkvHvjP777aY5OL2UWUP3pn3hTCMA6GKMJJe_X9p9dyV1CvoEUrUH9GkVtjQW7qz_JCuQZVzRb8jVoCVsSxiepNDDhekT5nBh99QDr25-OUw9dWo_q-D2buXJS-JclstZvA Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Domain-Id: None Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Domain-Name: None Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Identity-Status: Confirmed Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Is-Admin-Project: True Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Domain-Id: default Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Domain-Name: Default Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Name: admin Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Role: member,admin,reader Aug 25 12:28:51.854738 n-d-852771-8 devstack@n-api.service[106705]: X-Roles: member,admin,reader Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6f37c641b533406d8bb607c10bd83bac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}] Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: X-Tenant: admin Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: X-Tenant-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: X-Tenant-Name: admin Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: X-User: admin Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: X-User-Domain-Id: default Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: X-User-Domain-Name: Default Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: X-User-Id: df1fbcb72a0a430d95e2807f38e8837e Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: X-User-Name: admin Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: method: > Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: exception: Flavor 84 could not be found. Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: action_args: {'id': '84'} Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:28:51.856084 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:51.857097 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:51.858497 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-c59584c1-1f9a-4f83-abc3-a073e8842d7a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:28:51.859796 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-c59584c1-1f9a-4f83-abc3-a073e8842d7a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.419863 Aug 25 12:28:51.859796 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 22/44] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Aug 25 12:28:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 12:28:51.866208 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-3be1d2f8-b36d-4091-ad57-89c6e0180587 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:51.881395 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-3be1d2f8-b36d-4091-ad57-89c6e0180587 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018882 Aug 25 12:28:51.881991 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 23/45] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Aug 25 12:28:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:28:51.891913 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-02d05d26-7a5d-4d38-bd26-83740677fc1e admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:51.908024 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-02d05d26-7a5d-4d38-bd26-83740677fc1e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019605 Aug 25 12:28:51.908596 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Aug 25 12:28:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:28:51.918919 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-d57b8c9a-cfd5-4034-bcb4-21c086dd4fdb admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:51.924319 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.wsgi [None req-d57b8c9a-cfd5-4034-bcb4-21c086dd4fdb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-d57b8c9a-cfd5-4034-bcb4-21c086dd4fdb admin admin] Request method failure captured: Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: Accept: application/json Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: Accept-Encoding: gzip, deflate Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: Connection: keep-alive Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: Content-Length: 0 Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: Host: 10.222.0.70 Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: Openstack-Api-Version: compute 2.90 Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: Openstack-System-Scope: None Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: User-Agent: python-novaclient Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Auth-Token: gAAAAABjB2sD75s4PyFBK9Z3YN6D97pzv_p6frx3pfGm-vuhodolNkvHvjP777aY5OL2UWUP3pn3hTCMA6GKMJJe_X9p9dyV1CvoEUrUH9GkVtjQW7qz_JCuQZVzRb8jVoCVsSxiepNDDhekT5nBh99QDr25-OUw9dWo_q-D2buXJS-JclstZvA Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Domain-Id: None Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Domain-Name: None Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Identity-Status: Confirmed Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Is-Admin-Project: True Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Domain-Id: default Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Domain-Name: Default Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Name: admin Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Role: member,admin,reader Aug 25 12:28:51.925856 n-d-852771-8 devstack@n-api.service[106706]: X-Roles: member,admin,reader Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6f37c641b533406d8bb607c10bd83bac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}] Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: X-Tenant: admin Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: X-Tenant-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: X-Tenant-Name: admin Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: X-User: admin Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: X-User-Domain-Id: default Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: X-User-Domain-Name: Default Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: X-User-Id: df1fbcb72a0a430d95e2807f38e8837e Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: X-User-Name: admin Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: method: > Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: exception: Flavor 84 could not be found. Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: action_args: {'id': '84'} Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:28:51.927368 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:51.928369 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:51.929926 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-d57b8c9a-cfd5-4034-bcb4-21c086dd4fdb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:28:51.931202 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-d57b8c9a-cfd5-4034-bcb4-21c086dd4fdb admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011863 Aug 25 12:28:51.931202 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 24/47] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Aug 25 12:28:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:28:52.919403 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-02d05d26-7a5d-4d38-bd26-83740677fc1e admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:52.920402 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-02d05d26-7a5d-4d38-bd26-83740677fc1e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 25 12:28:52.920798 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 24/48] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Aug 25 12:28:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:53.468740 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-1be5ddd4-f3cc-4cba-b575-695d54c1241f admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:53.474544 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.wsgi [None req-1be5ddd4-f3cc-4cba-b575-695d54c1241f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-1be5ddd4-f3cc-4cba-b575-695d54c1241f admin admin] Request method failure captured: Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: Accept: application/json Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: Accept-Encoding: gzip, deflate Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: Connection: keep-alive Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: Content-Length: 0 Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: Host: 10.222.0.70 Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: Openstack-Api-Version: compute 2.90 Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: Openstack-System-Scope: None Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: User-Agent: python-novaclient Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Auth-Token: gAAAAABjB2sEoV_fTdqMX-XBpaf9Kbjo3e6xlNnEcb-7XGaxHr_7JbHzvYLFNzopELZxpbOm920Q5s3P3kImbMtiCNjrGSlNbYBVzKPrMcId7c6B17Y3aojT3y4XYB8OAaJTNlghxc0UY6Ulh6P_qXuSpXvBhwTQGIpcWoG5N6xBpKSHFmb_0AM Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Domain-Id: None Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Domain-Name: None Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Identity-Status: Confirmed Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Is-Admin-Project: True Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Domain-Id: default Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Domain-Name: Default Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Project-Name: admin Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Role: member,admin,reader Aug 25 12:28:53.476999 n-d-852771-8 devstack@n-api.service[106706]: X-Roles: member,admin,reader Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6f37c641b533406d8bb607c10bd83bac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}] Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: X-Tenant: admin Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: X-Tenant-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: X-Tenant-Name: admin Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: X-User: admin Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: X-User-Domain-Id: default Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: X-User-Domain-Name: Default Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: X-User-Id: df1fbcb72a0a430d95e2807f38e8837e Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: X-User-Name: admin Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: method: > Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: exception: Flavor 451 could not be found. Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: action_args: {'id': '451'} Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:28:53.478592 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:53.479504 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: ERROR nova.api.openstack.wsgi Aug 25 12:28:53.480809 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-1be5ddd4-f3cc-4cba-b575-695d54c1241f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:28:53.482136 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-1be5ddd4-f3cc-4cba-b575-695d54c1241f admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.416502 Aug 25 12:28:53.482136 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 25/49] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Aug 25 12:28:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:28:53.488190 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-8824ff88-0c8a-4461-8ceb-66e0def26154 admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:53.504113 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-8824ff88-0c8a-4461-8ceb-66e0def26154 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019465 Aug 25 12:28:53.504652 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 25/50] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Aug 25 12:28:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:28:53.514569 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:53.529360 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018597 Aug 25 12:28:53.529961 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 26/51] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Aug 25 12:28:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:28:53.539980 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-7271c204-8e56-45f8-838f-09e1b3e3de09 admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:53.545429 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.wsgi [None req-7271c204-8e56-45f8-838f-09e1b3e3de09 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-7271c204-8e56-45f8-838f-09e1b3e3de09 admin admin] Request method failure captured: Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: Accept: application/json Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: Accept-Encoding: gzip, deflate Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: Connection: keep-alive Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: Content-Length: 0 Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: Host: 10.222.0.70 Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: Openstack-Api-Version: compute 2.90 Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: Openstack-System-Scope: None Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: User-Agent: python-novaclient Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Auth-Token: gAAAAABjB2sEoV_fTdqMX-XBpaf9Kbjo3e6xlNnEcb-7XGaxHr_7JbHzvYLFNzopELZxpbOm920Q5s3P3kImbMtiCNjrGSlNbYBVzKPrMcId7c6B17Y3aojT3y4XYB8OAaJTNlghxc0UY6Ulh6P_qXuSpXvBhwTQGIpcWoG5N6xBpKSHFmb_0AM Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Domain-Id: None Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Domain-Name: None Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Identity-Status: Confirmed Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Is-Admin-Project: True Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Domain-Id: default Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Domain-Name: Default Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Project-Name: admin Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Role: member,admin,reader Aug 25 12:28:53.546959 n-d-852771-8 devstack@n-api.service[106705]: X-Roles: member,admin,reader Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6f37c641b533406d8bb607c10bd83bac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6f37c641b533406d8bb607c10bd83bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f37c641b533406d8bb607c10bd83bac"}]}] Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: X-Tenant: admin Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: X-Tenant-Id: 6f37c641b533406d8bb607c10bd83bac Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: X-Tenant-Name: admin Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: X-User: admin Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: X-User-Domain-Id: default Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: X-User-Domain-Name: Default Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: X-User-Id: df1fbcb72a0a430d95e2807f38e8837e Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: X-User-Name: admin Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: method: > Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: exception: Flavor 451 could not be found. Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: action_args: {'id': '451'} Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:28:53.548477 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:53.549545 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: ERROR nova.api.openstack.wsgi Aug 25 12:28:53.551001 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-7271c204-8e56-45f8-838f-09e1b3e3de09 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:28:53.552230 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-7271c204-8e56-45f8-838f-09e1b3e3de09 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012691 Aug 25 12:28:53.552230 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 26/52] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Aug 25 12:28:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:28:54.529359 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:54.530399 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 25 12:28:54.530804 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 27/53] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Aug 25 12:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:55.129788 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-6626bce0-001b-426d-99d3-7b7611a8750b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:55.149058 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-6626bce0-001b-426d-99d3-7b7611a8750b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.473493 Aug 25 12:28:55.149641 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 27/54] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Aug 25 12:28:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:28:56.145381 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:56.146419 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 25 12:28:56.147437 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 28/55] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Aug 25 12:28:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:56.699531 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-d13a7788-ffd7-4942-b37c-5899e9161935 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:56.719246 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-d13a7788-ffd7-4942-b37c-5899e9161935 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.428654 Aug 25 12:28:56.719794 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 28/56] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Aug 25 12:28:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:28:57.713006 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:57.714052 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 25 12:28:57.714460 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 29/57] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Aug 25 12:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:58.243456 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-03669b07-a202-4018-adc7-7c06c68c9bc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:58.265072 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-03669b07-a202-4018-adc7-7c06c68c9bc5 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.412599 Aug 25 12:28:58.265732 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 29/58] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Aug 25 12:28:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:28:59.273579 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:59.274591 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 25 12:28:59.274992 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 30/59] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Aug 25 12:28:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:59.877611 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-ff82e7cd-2bf4-48bc-a39d-1aac0df3576b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:28:59.897923 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-ff82e7cd-2bf4-48bc-a39d-1aac0df3576b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.481465 Aug 25 12:28:59.898515 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 30/60] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Aug 25 12:28:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:29:00.892763 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:29:00.893781 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 25 12:29:00.894253 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 31/61] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Aug 25 12:29:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:29:01.469127 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-774964b6-043e-49c7-8475-fa28350d2d4d admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:29:01.492963 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-774964b6-043e-49c7-8475-fa28350d2d4d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.458650 Aug 25 12:29:01.493746 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 31/62] 10.222.0.70 () {60 vars in 1202 bytes} [Thu Aug 25 12:29:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:29:58.014100 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:29:58.015966 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-29e88507-9a3b-40bb-beed-d3f71527e277 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002903 Aug 25 12:29:58.016726 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 32/63] 10.222.0.70 () {54 vars in 931 bytes} [Thu Aug 25 12:29:58 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:29:58.039284 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:29:58.668605 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-c04ef1b1-22d0-4c08-a4f7-6c08f722ae49 admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:29:58.693211 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-c04ef1b1-22d0-4c08-a4f7-6c08f722ae49 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.666213 Aug 25 12:29:58.694023 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 32/64] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Aug 25 12:29:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:29:58.718450 n-d-852771-8 devstack@n-api.service[106706]: DEBUG dbcounter [-] [106706] Writing DB stats nova_api:SELECT=14 {{(pid=106706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:29:58.722636 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-7e253064-757e-4e47-b38d-757e614e21f1 admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:29:58.731966 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-7e253064-757e-4e47-b38d-757e614e21f1 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015021 Aug 25 12:29:58.732618 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 33/65] 10.222.0.70 () {60 vars in 1283 bytes} [Thu Aug 25 12:29:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:29:58.746363 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-b43de30e-4b9d-4151-a42b-96e4d518a1c4 admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:29:58.755556 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-b43de30e-4b9d-4151-a42b-96e4d518a1c4 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012591 Aug 25 12:29:58.756136 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 33/66] 10.222.0.70 () {60 vars in 1286 bytes} [Thu Aug 25 12:29:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:29:58.778211 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-164edc05-036c-4e44-bb9c-2b4b87a9a51e admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:29:58.793149 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-164edc05-036c-4e44-bb9c-2b4b87a9a51e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021644 Aug 25 12:29:58.794290 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 34/67] 10.222.0.70 () {60 vars in 1286 bytes} [Thu Aug 25 12:29:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:29:58.812899 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-627fe006-fc07-44d8-8fde-d1ecb2cde517 admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:29:58.822383 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-627fe006-fc07-44d8-8fde-d1ecb2cde517 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013059 Aug 25 12:29:58.823070 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 34/68] 10.222.0.70 () {60 vars in 1283 bytes} [Thu Aug 25 12:29:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:12.331286 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-164edc05-036c-4e44-bb9c-2b4b87a9a51e admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:12.332942 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-164edc05-036c-4e44-bb9c-2b4b87a9a51e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 Aug 25 12:36:12.333955 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 35/69] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Aug 25 12:36:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:12.626668 n-d-852771-8 devstack@n-api.service[106705]: DEBUG dbcounter [-] [106705] Writing DB stats nova_api:SELECT=6 {{(pid=106705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:12.918241 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-6597887c-8876-4b77-8c29-dfbaa2bddf83 admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:12.925631 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-6597887c-8876-4b77-8c29-dfbaa2bddf83 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:12.926476 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-6597887c-8876-4b77-8c29-dfbaa2bddf83 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:12.927248 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-6597887c-8876-4b77-8c29-dfbaa2bddf83 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:12.928606 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-6597887c-8876-4b77-8c29-dfbaa2bddf83 admin admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:12.929387 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-6597887c-8876-4b77-8c29-dfbaa2bddf83 admin admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:12.930156 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-6597887c-8876-4b77-8c29-dfbaa2bddf83 admin admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:13.013984 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-6597887c-8876-4b77-8c29-dfbaa2bddf83 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.389902 Aug 25 12:36:13.015089 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 35/70] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Aug 25 12:36:12 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:36:14.607757 n-d-852771-8 devstack@n-api.service[106706]: DEBUG nova.api.openstack.wsgi [None req-164edc05-036c-4e44-bb9c-2b4b87a9a51e admin admin] Calling method '>' {{(pid=106706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:14.609688 n-d-852771-8 devstack@n-api.service[106706]: INFO nova.api.openstack.requestlog [None req-164edc05-036c-4e44-bb9c-2b4b87a9a51e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002530 Aug 25 12:36:14.610475 n-d-852771-8 devstack@n-api.service[106706]: [pid: 106706|app: 0|req: 36/71] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Aug 25 12:36:14 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:14.980482 n-d-852771-8 devstack@n-api.service[106705]: DEBUG nova.api.openstack.wsgi [None req-d7101920-55b1-45f9-a05d-f271ed56295c admin admin] Calling method '>' {{(pid=106705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:14.984590 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-d7101920-55b1-45f9-a05d-f271ed56295c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:14.985167 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-d7101920-55b1-45f9-a05d-f271ed56295c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:14.985897 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-d7101920-55b1-45f9-a05d-f271ed56295c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:14.987333 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-d7101920-55b1-45f9-a05d-f271ed56295c admin admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:14.987923 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-d7101920-55b1-45f9-a05d-f271ed56295c admin admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:14.988482 n-d-852771-8 devstack@n-api.service[106705]: DEBUG oslo_concurrency.lockutils [None req-d7101920-55b1-45f9-a05d-f271ed56295c admin admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:15.016935 n-d-852771-8 devstack@n-api.service[106705]: INFO nova.api.openstack.requestlog [None req-d7101920-55b1-45f9-a05d-f271ed56295c admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.123440 Aug 25 12:36:15.019593 n-d-852771-8 devstack@n-api.service[106705]: [pid: 106705|app: 0|req: 36/72] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Aug 25 12:36:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:37:07.618043 n-d-852771-8 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 25 12:37:07.618956 n-d-852771-8 devstack@n-api.service[106704]: Thu Aug 25 12:37:07 2022 - graceful shutdown triggered... Aug 25 12:37:07.619718 n-d-852771-8 devstack@n-api.service[106705]: Gracefully killing worker 1 (pid: 106705)... Aug 25 12:37:07.620353 n-d-852771-8 devstack@n-api.service[106706]: Gracefully killing worker 2 (pid: 106706)... Aug 25 12:37:08.619672 n-d-852771-8 devstack@n-api.service[106704]: worker 1 buried after 1 seconds Aug 25 12:37:08.619672 n-d-852771-8 devstack@n-api.service[106704]: worker 2 buried after 1 seconds Aug 25 12:37:08.619672 n-d-852771-8 devstack@n-api.service[106704]: goodbye to uWSGI. Aug 25 12:37:08.621864 n-d-852771-8 systemd[1]: devstack@n-api.service: Succeeded. Aug 25 12:37:08.622835 n-d-852771-8 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 25 12:37:08.629030 n-d-852771-8 systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 12:37:08.652910 n-d-852771-8 devstack@n-api.service[129048]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 12:37:08 2022] *** Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: nodename: n-d-852771-8 Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: machine: x86_64 Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: clock source: unix Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: pcre jit disabled Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: detected number of CPU cores: 4 Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: current working directory: / Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: detected binary path: /usr/bin/uwsgi-core Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: your processes number limit is 47680 Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: your memory page size is 4096 bytes Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: detected max file descriptor number: 2048 Aug 25 12:37:08.669073 n-d-852771-8 devstack@n-api.service[129048]: lock engine: pthread robust mutexes Aug 25 12:37:08.671051 n-d-852771-8 devstack@n-api.service[129048]: thunder lock: enabled Aug 25 12:37:08.671051 n-d-852771-8 devstack@n-api.service[129048]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 12:37:08.671051 n-d-852771-8 devstack@n-api.service[129048]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 12:37:08.736780 n-d-852771-8 devstack@n-api.service[129048]: Python main interpreter initialized at 0x55c609bd89c0 Aug 25 12:37:08.736780 n-d-852771-8 devstack@n-api.service[129048]: python threads support enabled Aug 25 12:37:08.736780 n-d-852771-8 devstack@n-api.service[129048]: your server socket listen backlog is limited to 100 connections Aug 25 12:37:08.736780 n-d-852771-8 devstack@n-api.service[129048]: your mercy for graceful operations on workers is 90 seconds Aug 25 12:37:08.737685 n-d-852771-8 devstack@n-api.service[129048]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 12:37:08.737685 n-d-852771-8 devstack@n-api.service[129048]: *** Operational MODE: preforking *** Aug 25 12:37:08.737968 n-d-852771-8 devstack@n-api.service[129048]: *** uWSGI is running in multiple interpreter mode *** Aug 25 12:37:08.737968 n-d-852771-8 devstack@n-api.service[129048]: spawned uWSGI master process (pid: 129048) Aug 25 12:37:08.738162 n-d-852771-8 systemd[1]: Started Devstack devstack@n-api.service. Aug 25 12:37:08.739014 n-d-852771-8 devstack@n-api.service[129048]: spawned uWSGI worker 1 (pid: 129059, cores: 1) Aug 25 12:37:08.739550 n-d-852771-8 devstack@n-api.service[129048]: spawned uWSGI worker 2 (pid: 129060, cores: 1) Aug 25 12:37:08.739793 n-d-852771-8 devstack@n-api.service[129048]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 12:37:09.795338 n-d-852771-8 devstack@n-api.service[129059]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 12:37:10.019265 n-d-852771-8 devstack@n-api.service[129060]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 12:37:11.632942 n-d-852771-8 devstack@n-api.service[129059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:37:11.632942 n-d-852771-8 devstack@n-api.service[129059]: from cryptography.utils import int_from_bytes Aug 25 12:37:11.634013 n-d-852771-8 devstack@n-api.service[129059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:37:11.634013 n-d-852771-8 devstack@n-api.service[129059]: from cryptography.utils import int_from_bytes Aug 25 12:37:11.971608 n-d-852771-8 devstack@n-api.service[129060]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:37:11.971608 n-d-852771-8 devstack@n-api.service[129060]: from cryptography.utils import int_from_bytes Aug 25 12:37:11.972398 n-d-852771-8 devstack@n-api.service[129060]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:37:11.972398 n-d-852771-8 devstack@n-api.service[129060]: from cryptography.utils import int_from_bytes Aug 25 12:37:15.646073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 12:37:15.647034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 12:37:15.647850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 12:37:15.648907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 12:37:15.649468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 12:37:15.650147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.650995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.651931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.652786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.653957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.655904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.656764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.658226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.659209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.660087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.661042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.662042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852771-8 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.662987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.663908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.664825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.665799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.666733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.667663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.668561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.669659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.671353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.672033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.672728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.674595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.675570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.676242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.676930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.677635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.678543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.679442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.680299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852771-8 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.681004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.681712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.682224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.682775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.683449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.684098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.684782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.685742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.686438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.687170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.687837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.688469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.689209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.690051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.690654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.691238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.691842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.692410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.692979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.693462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.694116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.694748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.695328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.696144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.696737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.697214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.697874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.699709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.700437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.701011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.701620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.702211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.702795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.703968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.704584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.707475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.708126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.708707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.711708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.712315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.713027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.713884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.714506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.715115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.715772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.716374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.717181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.719230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.720649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.722169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.722796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.723377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.725609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.726668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.727267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.727743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.728322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.728917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.729576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.730176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.730763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.731349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.731950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.732560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.733164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.734032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.735751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.737922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.739947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.740614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.741192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.741778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.742399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.743003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.743594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.744179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.747150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.748889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.748889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.749574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.750197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.750812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.752138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.755631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.756573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.757625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.758133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.758746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.759618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.760444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.760911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.761681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.762273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.762841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.763398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.763970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.764544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.765115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.765708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.766269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.766894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.769061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.769777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.770382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.770970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.772451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.773584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 12:37:15.774808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 12:37:15.775106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.775106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.775763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.776888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 12:37:15.777284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.777645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 12:37:15.777933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.778189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 12:37:15.778488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.778766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.779068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.779318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.779731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.779910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.780482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.781094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.781687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.782305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.783426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.783604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.784032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.784243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.784510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.785046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.785236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.785669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.785865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852771-8 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.786285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.786467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.786808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.786976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.787382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.787566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.787964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.788206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.788533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.788753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.789147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.789350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.789790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.790036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.790396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.790770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.790987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.791327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.791567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.791879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.792148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.792468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.792835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.793087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.793624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.793795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.793996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.794290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.794469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.794699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.794976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.795271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.795438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.795702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.796047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.796241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.796765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.796945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.797334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852771-8 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.797592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.801234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.801545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.801880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.802136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.803238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.803526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.803526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.804056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.804441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.804679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.804913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.805401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.805719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.805957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.806200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.806460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.806460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.807116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.807359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.807748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.807989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.808220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.808450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.808692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.808944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.809183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.809424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.809695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.809937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.810177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.810404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.810643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.810883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.811116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.811443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.811689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.811935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.811935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.812393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.813895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.814120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.814331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.814331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.814711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.815006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.815369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.815604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.815828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.815983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.816205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.816361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.816528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.816528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.816955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.817167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.817321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.817677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.818120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.818341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.818557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.818557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.818964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.819202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.819368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.819615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.819773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.819939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.820159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.820421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.820579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.820731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.820878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.821029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.821318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.821609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.821763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.821763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.822267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.822423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.822678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.823145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.823493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.823755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.824270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.824829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.825033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.825500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.825870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.826175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.826461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.826772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.827024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.827356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.827539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.827963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.828177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.828567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.828749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.829137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.829321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.830340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.830530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.830704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.830861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.831027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.831366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.831531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.831992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.832163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.832538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.832753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.833111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.833339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.833725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.834197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.834523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.834761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.834932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.835436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.835615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.836026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.836191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.836582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.836757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.837148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.837322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.837756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.837941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.838338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.838525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.838924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.839085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.839494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.839681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.840028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.840196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.840661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.840836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.841194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.841372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.841853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.842044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.842456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.842644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.843071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.843262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.843650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.843816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.844395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.844584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.844795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.845686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.845894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.846511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.846798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.847133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.847396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.847969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.848146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.848551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.848726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.849161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.849333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.849764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.849922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.850359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.850584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.850968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.851097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.851545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.851718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.852145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.852324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.852715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.852878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.853313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.853500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.853960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.854137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.854581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.854764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.855105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.855282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.855667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.855837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.856241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.856465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.856823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.857074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.857389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.857708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.858004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.858236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.858579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.858828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.859143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.859427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.859767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.860009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.860419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.860640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.863108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.863332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.863332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.864926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.865184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.865650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.865843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.866279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.866451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:37:15.866873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.867069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.867479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.867663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.868084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.868252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.868708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.868890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.869287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.869458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.869954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.870144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.870494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.870683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.871060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.871228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.871643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.871831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.872154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.872339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.872495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.872929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.873093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.873483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.873758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.873949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.874118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.874502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.874705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.875081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.875325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.875650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.875894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.876247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.877058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.877368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.877689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.877988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.878293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.878558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.878890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.879134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.879491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.879655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.880218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.880415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.880781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.881039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.881346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.881651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.881947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.882289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.882527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.882937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.883119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.883530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.883713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.884153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.884321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.884631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.884792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.885106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.885338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.885692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.885954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.886282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.886570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.886897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.887155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.887516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.887699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.888097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.888334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.888731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.888964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.889345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.889664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.889958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.890174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.890570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.890741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.891167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.891413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.891765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.891936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.892951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.893118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.893465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.893720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.894096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.894307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.894491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.894722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.894937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.895178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.895369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.895569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.895918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.896182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.896665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.896870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.897091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.897690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.897944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.898374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.898885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.899303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.899482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.899709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.899863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.900285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.900622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.900802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.901172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.901344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.901795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.901986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.902562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.902723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.903166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.903647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.903816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.904274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.904459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.904802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.905000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.905154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.905306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.905483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.905791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.906009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.906323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.906520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.906836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.907016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.907323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.907484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.908942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.909202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.909480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.909790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.909997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.910217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.910532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.910706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.911032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.911293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.911523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.911857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.912035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.912405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.912569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.912953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.913130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.913448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.913643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.914028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.914212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.914593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.914752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.915175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.915354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.915749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.915910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.916362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.916525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.916932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.917094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.917492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.917734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.918024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.918194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.918594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.918827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.919033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.919252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.919539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.919765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.920072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.920302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.920576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.921022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.921314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.921658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.921835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.922088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.922269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.922669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.922842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.923159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.923456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.923862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.924303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.924968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.925352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.925586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.925863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.926025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.926334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.926560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.926813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.927182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.927402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.927744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.927979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.928538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.928821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.929088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.929296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.929779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.930001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.930366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.930607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.930995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.931181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.931746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.931937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.932307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.932500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.932886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.933056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.933500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.933700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.934126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.934314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.934757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.934925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.935332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.935502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.935919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.936074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.936506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.936711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.937087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.937635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.937816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.937961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.938282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.938438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.938634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.939854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.940273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.940790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.941002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.941414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.941629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.942002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.942226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.942578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.942739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.943115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.943266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.943711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.943874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.944302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.944458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.944878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.945012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.945473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.945678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.946058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.946195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.946631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.946796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.947241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.947392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.947830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.947989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.948406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.948560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.948983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.949167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.949599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.949759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.950204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.950416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.950785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.951004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.951306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.951502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.951851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.952014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.952295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.952487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.952823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.952977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.953422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.953642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.954019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.954161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.955180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.955345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.955887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.956719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.956874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.957284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.957430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.957901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.958091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.958507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.958666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.959087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.959247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.959664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.959824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.960235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.960441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.960814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.961021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.961406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.961676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.962137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.962291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.962725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.962861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.963221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.963436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.963775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.964228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.964385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.964830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.965050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.965470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.965721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.966057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.966208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.966584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.966757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.967135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.971932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.972206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.972409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.972409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.972751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.972903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.973052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.973249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.973449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.973664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.973877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.974063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.974246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.974393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.974537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.974694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.974844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.974994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.975142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.975142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.975379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.975527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.975679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.975679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.975940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.976073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.976218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.976372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.976517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.976517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.976765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.976910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.977051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.977487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.977701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.978076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.978228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.978653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.978828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.979255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.979413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.979835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.979985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.980499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.980667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.980986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.981169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.981587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.981823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.982172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.982403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.982750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.982964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.983292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.983451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.983865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.984042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.984440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.984654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.985006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.985172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.985544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.986396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.986795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.987187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.987391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.987764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.987967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.988489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.988656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.989158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.989560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.989805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.990164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.990385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.990745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.990971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.991353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.991538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.991963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.992214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.992598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.992841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.993221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.993403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.993836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.994145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.994403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.994693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.994986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.995286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.995533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.995889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.996115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.996475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.996647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.997046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.997676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.998182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.998387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.998801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.998997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.999376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.999708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:15.999960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.000310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.000558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.000920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.001109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.001533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.002620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.002835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.003008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.003184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.003328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.003531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.003702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.004094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.004332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.004814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.005046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.005387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.005675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.006031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.006259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.006646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.006836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.007248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.007435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.007850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.008032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.008415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.008588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.009002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.009216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.009636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.009826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.010247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.010419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.010769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.010965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.011112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.011443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.011608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.011862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.012071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.012277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.012632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.012798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.012969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.013247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.013420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.013820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.013986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.014395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.014652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.014964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.015209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.015426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.015626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.015829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.016132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.016356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.016547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.016750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.016942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.017994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.018408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.018636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.018845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.019035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.019300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.019505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.019798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.020014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.020207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.020596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.020801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.021008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.021234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.021472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.021959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.022182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.022417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.022665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.022927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.023211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.023423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.023897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.024113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.024312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.024553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.024812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.025025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.025237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.025463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.025694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.025905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.026066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.026268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.026571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.026752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.026985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.027212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.027388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.027606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.027776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.028113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.028399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.028768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.028942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.029097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.029398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.029622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.029913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.030079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.030389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.030596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.030759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.031053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.031235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.031618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.031793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.032120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.032336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.032546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.033377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.033656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.033869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.034085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.034291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.034520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.034737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.034973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.035184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.035395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.035604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.035848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.036027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.036198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.036518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.036682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.036923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.037436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.037650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.037867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.038097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.038387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.038679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.038863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.039233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.039402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.039573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.039837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.040027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.040310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.040469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.040623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.041053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.041236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.041585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.041829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.042185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.042356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.042696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.042952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.043121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.043273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.043522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.043809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.043992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.044249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.044460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.044760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.045056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.045292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.045662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.045904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.046283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.046474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.046808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.047196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.047416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.047787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.048026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.048435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.048732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.049022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.049232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.049479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.049733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.049895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.076656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.076656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.077145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.077369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.077611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.077864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.077864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.078286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.078475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.078475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.078475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.078956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.079138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.079366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.080237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.080237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.080636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.080835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.080835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.081219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.081420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.081420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.081711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.081832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.081949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.082074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.082298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.082426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.082426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.082700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.082900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.083095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.083296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.083296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.083582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.083763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.083763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.084191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.084431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.084762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.085016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.085016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.085451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.085650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.085650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.085965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.086191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.086426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.086660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.086868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.087071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.087071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.087472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.087472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.087472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.089203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.089425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.089425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.089892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.089892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.090541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.090802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.091058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.091280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.091490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.091749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.091749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.092349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.092582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.092841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.093093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.093316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.093577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.093796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.094012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.094237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.094443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.094675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.094915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.095217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.095970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.096220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.096493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.096712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.096927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.097145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.097371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.097614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.097614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.097614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.097614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.097614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.097614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.097614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.097614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.099210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.099210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.099210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.099210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.099210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.099210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.100610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.100830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.100830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.100830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.100830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.100830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.100830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.102088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.102297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.102297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.102297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.102875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.103054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.103054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.103054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.103510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.103744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.103744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.103744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.104212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.104390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.104390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.104390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.104390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.104975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.105153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.105317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.105484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.105484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.105827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.105989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.106731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.106873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.106873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.107131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.107262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.107262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.107864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.108055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.108055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.108055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.108055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.108055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.108055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.108055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.108055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.109672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.109672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.110056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.110246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.110246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.110576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.110795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.110989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.111190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.111382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.111571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.111752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.112213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.112512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.112881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.113148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.113486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.113819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.114445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.114662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.114983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.115298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.115541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.115915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.116108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.116553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.116698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.117188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.117383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.117807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.118309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.118540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.118866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.119007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.119458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.119666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.120027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.120224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.120588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.121039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.121231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.121413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.121789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.121979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.122438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.122633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.122997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.123190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.123571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.123764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.124134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.124332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.124704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.124919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.125231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.125417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.125782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.125963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.126583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.126810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.127075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.127272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.127655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.127852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.128240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.128622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.128868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.129202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.129483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.129886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.130101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.130461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.130689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.131036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.131263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.131602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.131824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.132166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.132393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.132773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.132998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.133352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.133568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.133910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.134166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.134487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.134919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.135165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.135408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.135790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.136018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.136234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.136597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.136913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.137155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.137553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.137843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.138086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.138457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.139187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.139503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.139731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.139969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.140373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.140587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.140816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.141023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.141234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.141578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.141809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.142701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.142951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.143268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.143991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.144223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.144554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.144790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.145077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.145292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.145618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.145971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.146097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.146577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.146736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.147110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.147237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.147714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.148373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.149181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.149812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.150398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.151008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.151781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.152641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.153000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.153601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.153737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.154171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.154299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.154747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.154906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.155338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.155477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.155923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.156063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.156489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.156636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.157051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.157166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.158336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.158737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.159451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.159793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.160181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.160496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.160771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.161082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.161377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.161676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.161972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.162174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.162578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.162753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.163300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.163453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.163737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.163867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.164251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.164512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.164762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.165139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.165345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.165778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.165954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.166372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.166531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.166957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.167081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.167620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.167819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.168126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.168397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.168677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.168981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.169200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.169586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.169763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.170178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.170318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.170750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.170890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.171359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.171509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.171938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.172461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.172610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.173012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.173240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.174228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.174820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.175013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.175406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.175731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.176019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.176320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.176614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.176874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.177190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.177465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.177818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.178090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.178395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.178687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.178894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.179206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.179400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.179746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.179929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.180340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.180530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.180920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.181110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.181547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.181742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.181981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.182139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.182341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.182673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.182815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.183075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.183290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.183481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.183857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.184019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.184303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.184453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.184743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.185019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.185166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.185382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.185607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.185928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.186413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.186586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.187091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.187227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.187680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.187931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.188210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.189762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.190110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.190110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.190363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.190716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.191134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.191457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 12:37:16.195409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.196461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.197125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.198107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.198655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.199238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.199815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.200390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.201009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.201677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.202281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.202856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.203396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.203913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.205855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.206440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.207093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.207678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.208283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.208874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.209454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.210108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.210662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.211211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.211777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.212340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.212933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.213457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.214028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.214574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.215140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.216150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.218801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.219432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.220105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.221789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.222229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.222805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.223342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.223944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.224505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.225092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.225738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.226371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.226869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.227448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.228191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.228605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.229284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.230070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.230628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.231567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.232146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.232692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.233218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.233805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.234348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.234904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.235481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.237456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.238298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.238928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.243875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.244559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.245141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.246299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.246609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.247126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.247761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.248325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.248984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.249493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.250166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.250743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.251346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.254190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.254984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.255859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.256976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.257737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.258278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.258908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.259528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.260104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.260676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.261253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.261991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.262459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.263120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.264018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.264767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.265500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.266210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.267542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.268129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.269191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.269681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.270713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.271502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.272138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.272796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.273996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.274934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.275849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.277203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.277989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.278856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.279429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.280005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.280583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.281162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.281788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.282421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.284762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.285370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.286225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.286824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.287419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.288005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.288563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.289176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.289815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.290261 n-d-852771-8 devstack@n-api.service[129059]: INFO dbcounter [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Registered counter for database nova_api Aug 25 12:37:16.290434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.290964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.291641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.292252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.292793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.293354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.294628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.295232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.295814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.296391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.296975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.297686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.298989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.300709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.301356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.301946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.302598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.303154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.303726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.304313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.304895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.305463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.306074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.306637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.307209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.307838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.309090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.309090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.309443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.310104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.310661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.311188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.311818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.312671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.313299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.313970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.316023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.316663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.317238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.317866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.318438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.319305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.319632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.320181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.320798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.321323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.321900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.322565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.323126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.323706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.324285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.324512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_db.sqlalchemy.engines [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:37:16.324892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.325597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.326154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.326728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.327379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.327959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.328547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.329106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.331490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.334572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.334572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.334572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.334572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.335096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.335502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.335727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writer thread running {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:37:16.336348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.336616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.337146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.341892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.341892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.341892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.341892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.341892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.341892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.342651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.342981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.343596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.344191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.344757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.345882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.347441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:37:16.347882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 12:37:16.457500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.context [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),638d90be-ffdb-4b61-b94a-775c50a724be(cell1) {{(pid=129059) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 12:37:16.466003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:16.466863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:16.471098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:16.472568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:16.473293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:16.477282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:16.481348 n-d-852771-8 devstack@n-api.service[129059]: INFO dbcounter [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Registered counter for database nova_cell0 Aug 25 12:37:16.490089 n-d-852771-8 devstack@n-api.service[129059]: INFO dbcounter [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Registered counter for database nova_cell1 Aug 25 12:37:16.503518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_db.sqlalchemy.engines [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:37:16.511962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_db.sqlalchemy.engines [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:37:16.513127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writer thread running {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:37:16.600453 n-d-852771-8 devstack@n-api.service[129060]: INFO dbcounter [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Registered counter for database nova_api Aug 25 12:37:16.634248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:37:16.646951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writer thread running {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:37:16.762379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.context [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),638d90be-ffdb-4b61-b94a-775c50a724be(cell1) {{(pid=129060) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 12:37:16.772377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:16.773572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:16.777242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:16.781576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:16.781576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:16.783574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writer thread running {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:37:16.785846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:16.790022 n-d-852771-8 devstack@n-api.service[129060]: INFO dbcounter [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Registered counter for database nova_cell0 Aug 25 12:37:16.800528 n-d-852771-8 devstack@n-api.service[129060]: INFO dbcounter [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Registered counter for database nova_cell1 Aug 25 12:37:16.801363 n-d-852771-8 devstack@n-api.service[129059]: INFO dbcounter [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Registered counter for database nova_cell0 Aug 25 12:37:16.815809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:37:16.819561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:37:16.820445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_db.sqlalchemy.engines [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:37:16.833335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writer thread running {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:37:16.834440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writer thread running {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:37:16.837926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writer thread running {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:37:17.165644 n-d-852771-8 devstack@n-api.service[129060]: INFO dbcounter [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Registered counter for database nova_cell0 Aug 25 12:37:17.176990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:37:17.187793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writer thread running {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:37:17.497205 n-d-852771-8 devstack@n-api.service[129059]: WARNING keystonemiddleware.auth_token [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:37:17.513229 n-d-852771-8 devstack@n-api.service[129059]: WARNING keystonemiddleware.auth_token [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:37:17.836982 n-d-852771-8 devstack@n-api.service[129060]: WARNING keystonemiddleware.auth_token [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:37:17.852762 n-d-852771-8 devstack@n-api.service[129060]: WARNING keystonemiddleware.auth_token [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:37:18.125975 n-d-852771-8 devstack@n-api.service[129059]: WARNING keystonemiddleware.auth_token [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:37:18.137707 n-d-852771-8 devstack@n-api.service[129059]: WARNING keystonemiddleware.auth_token [None req-743d3c5b-bcff-409b-9d90-605d7e2ad240 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:37:18.150507 n-d-852771-8 devstack@n-api.service[129059]: WSGI app 0 (mountpoint='') ready in 10 seconds on interpreter 0x55c609bd89c0 pid: 129059 (default app) Aug 25 12:37:18.586333 n-d-852771-8 devstack@n-api.service[129060]: WARNING keystonemiddleware.auth_token [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:37:18.599375 n-d-852771-8 devstack@n-api.service[129060]: WARNING keystonemiddleware.auth_token [None req-ac0dbb6f-7b3c-47f5-b282-6236d39c3280 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:37:18.610516 n-d-852771-8 devstack@n-api.service[129060]: WSGI app 0 (mountpoint='') ready in 10 seconds on interpreter 0x55c609bd89c0 pid: 129060 (default app) Aug 25 12:38:27.918045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:27.919670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:27.926764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:27.930754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:28.048465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:28.054606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:28.058992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:28.065644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:30.665600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-288247877", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:31.211690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b333a5ce-5c67-4f77-a82f-d6998aeddfc6 tempest-AZAdminNegativeTestJSON-1456596723 tempest-AZAdminNegativeTestJSON-1456596723-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:31.216155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b333a5ce-5c67-4f77-a82f-d6998aeddfc6 tempest-AZAdminNegativeTestJSON-1456596723 tempest-AZAdminNegativeTestJSON-1456596723-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '69f70c8cd7144094a21e7d142fddd204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0c26724a5448d39aee109f89f5fa03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b333a5ce-5c67-4f77-a82f-d6998aeddfc6 tempest-AZAdminNegativeTestJSON-1456596723 tempest-AZAdminNegativeTestJSON-1456596723-project] Request method failure captured: Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB20-5QWtv0JJKLnQemHJD1ayfSoEs-5hkeoJdXt0JkOUwHMik764yYuv1o6fgf3oAVv23HHN03ihPgQJ1YYmLGJQesfYE1nppYm0L-8qHswzHETundTUlzr-sKn0W7ERhVVI5Y8wvVY-shO-Du3fqmojTVMkEgMkhfsXAisvSX7AMdk Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 6f0c26724a5448d39aee109f89f5fa03 Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1456596723 Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:38:31.223374 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f0c26724a5448d39aee109f89f5fa03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6f0c26724a5448d39aee109f89f5fa03", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6f0c26724a5448d39aee109f89f5fa03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6f0c26724a5448d39aee109f89f5fa03"}]}] Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AZAdminNegativeTestJSON-1456596723 Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 6f0c26724a5448d39aee109f89f5fa03 Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1456596723 Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AZAdminNegativeTestJSON-1456596723-project Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 69f70c8cd7144094a21e7d142fddd204 Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AZAdminNegativeTestJSON-1456596723-project Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 25 12:38:31.225700 n-d-852771-8 devstack@n-api.service[129060]: action_args: {} Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:38:31.226867 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 25 12:38:31.228663 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:31.233109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b333a5ce-5c67-4f77-a82f-d6998aeddfc6 tempest-AZAdminNegativeTestJSON-1456596723 tempest-AZAdminNegativeTestJSON-1456596723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:31.236432 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b333a5ce-5c67-4f77-a82f-d6998aeddfc6 tempest-AZAdminNegativeTestJSON-1456596723 tempest-AZAdminNegativeTestJSON-1456596723-project] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 3.199709 Aug 25 12:38:31.238312 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1/1] 10.222.0.70 () {58 vars in 1185 bytes} [Thu Aug 25 12:38:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 3206 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:38:31.817149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Calling method '.version_select at 0x7f3a2bf06b80>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:31.839182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),638d90be-ffdb-4b61-b94a-775c50a724be(cell1) {{(pid=129060) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 25 12:38:31.840832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:31.842124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:31.843232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.905112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:31.906432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:31.907507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.936055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:31.937344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:31.938140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.951574 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-88924c57-dc7f-4c5b-a384-f05855aab16b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.710915 Aug 25 12:38:31.953081 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2/2] 10.222.0.70 () {60 vars in 1208 bytes} [Thu Aug 25 12:38:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:32.335943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:38:32.571564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9cbfebb8-50cc-41b6-8a89-9788939e4f80 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:32.586742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbfebb8-50cc-41b6-8a89-9788939e4f80 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:32.597267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbfebb8-50cc-41b6-8a89-9788939e4f80 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:32.599705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbfebb8-50cc-41b6-8a89-9788939e4f80 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:32.604103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbfebb8-50cc-41b6-8a89-9788939e4f80 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:32.608484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbfebb8-50cc-41b6-8a89-9788939e4f80 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:32.609924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbfebb8-50cc-41b6-8a89-9788939e4f80 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:32.730477 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9cbfebb8-50cc-41b6-8a89-9788939e4f80 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.775005 Aug 25 12:38:32.731702 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3/3] 10.222.0.70 () {58 vars in 1176 bytes} [Thu Aug 25 12:38:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:33.062751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:38:33.063904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:38:33.066499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:38:33.068122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:38:33.073614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:38:33.124716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:33.128887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:33.129792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:33.131743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:33.132980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:33.144017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:33.282727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Getting quotas for project f82cd279ba8840649f015c8c26589fab. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:38:33.308781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Getting quotas for user d2458b3cda9c4335a143357ade484548 and project f82cd279ba8840649f015c8c26589fab. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:38:33.358558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:38:33.363772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:38:33.607531 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0d23de5d-7ceb-42ff-92aa-51d1289f13d2 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.721910 Aug 25 12:38:33.622413 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1/4] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 5740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:38:33.811536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '.version_select at 0x7f3a2be8f8b0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:33.820535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:33.823875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:33.830545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:33.876377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:33.878028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:33.879102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:33.904572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:33.905580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:33.906774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:33.928093 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c26d4949-ee68-4f0e-8364-64c63cb8040b tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.187783 Aug 25 12:38:33.930105 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 4/5] 10.222.0.70 () {58 vars in 1167 bytes} [Thu Aug 25 12:38:32 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:33.948590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-367a4b0d-8964-46dc-88dd-435adef2e821 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1853134444"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:34.030880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-367a4b0d-8964-46dc-88dd-435adef2e821 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Generated uuid e662fc97-dc19-4c0d-80cb-40bba729cc96 for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:38:34.212835 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-367a4b0d-8964-46dc-88dd-435adef2e821 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.269445 Aug 25 12:38:34.215580 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 5/6] 10.222.0.70 () {62 vars in 1205 bytes} [Thu Aug 25 12:38:33 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:38:34.239482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f7e5600c-3b35-4151-91ac-cb83725954cc tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:34.244383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8752a275-e613-4b98-bc10-860254832128 tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-661693425", "id": 1672353527, "os-flavor-access:is_public": "False"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:34.245935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f7e5600c-3b35-4151-91ac-cb83725954cc tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:34.348658 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8752a275-e613-4b98-bc10-860254832128 tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.724269 Aug 25 12:38:34.355787 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2/7] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:38:33 2022] POST /compute/v2.1/flavors => generated 430 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:34.379929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-afadb3b8-651c-45b7-82a5-3c6695bc46c5 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-286581067"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:34.704234 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-afadb3b8-651c-45b7-82a5-3c6695bc46c5 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.344287 Aug 25 12:38:34.717696 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3/8] 10.222.0.70 () {62 vars in 1210 bytes} [Thu Aug 25 12:38:34 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:38:34.728399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-22d5b220-f957-4c65-bac4-8e79a8149858 tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7521dd05f8e94ded88c3e374554c52cf"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:36.522449 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-22d5b220-f957-4c65-bac4-8e79a8149858 tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1672353527/action" status: 200 len: 97 microversion: 2.1 time: 1.796389 Aug 25 12:38:36.534223 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 4/9] 10.222.0.70 () {60 vars in 1200 bytes} [Thu Aug 25 12:38:34 2022] POST /compute/v2.1/flavors/1672353527/action => generated 97 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:38:36.551494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-019c2237-6d1f-49d8-97db-ede7f9bc059b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:36.587755 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-019c2237-6d1f-49d8-97db-ede7f9bc059b tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.051486 Aug 25 12:38:36.597186 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 5/10] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Aug 25 12:38:36 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:38:36.916530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f7e5600c-3b35-4151-91ac-cb83725954cc tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:37.008829 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f7e5600c-3b35-4151-91ac-cb83725954cc tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1219 microversion: 2.1 time: 2.790068 Aug 25 12:38:37.010249 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 6/11] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:34 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1219 bytes in 2794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:37.029359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-409bc754-4edc-4304-9d53-e24582f3f084 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-8"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:37.075982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-409bc754-4edc-4304-9d53-e24582f3f084 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:37.080310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-409bc754-4edc-4304-9d53-e24582f3f084 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:37.085690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-409bc754-4edc-4304-9d53-e24582f3f084 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:37.242717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-230a7add-d4fd-4304-8837-358398e763d8 tempest-FlavorsAccessTestJSON-1025955456 tempest-FlavorsAccessTestJSON-1025955456-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:37.490264 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-230a7add-d4fd-4304-8837-358398e763d8 tempest-FlavorsAccessTestJSON-1025955456 tempest-FlavorsAccessTestJSON-1025955456-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.871498 Aug 25 12:38:37.490264 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:38:36 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:37.515930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2ed03372-e5b9-4334-b829-b6eec1aaac8d tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7521dd05f8e94ded88c3e374554c52cf"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:38.714444 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-409bc754-4edc-4304-9d53-e24582f3f084 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.698373 Aug 25 12:38:38.720157 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 7/13] 10.222.0.70 () {62 vars in 1232 bytes} [Thu Aug 25 12:38:37 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:38:38.742363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b42298a3-badd-4f64-aee8-6ab4f23c8fe8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:38.746622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b42298a3-badd-4f64-aee8-6ab4f23c8fe8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:38.776419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b42298a3-badd-4f64-aee8-6ab4f23c8fe8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:38.777685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b42298a3-badd-4f64-aee8-6ab4f23c8fe8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:38.778421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b42298a3-badd-4f64-aee8-6ab4f23c8fe8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:38.779728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b42298a3-badd-4f64-aee8-6ab4f23c8fe8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:38.789259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b42298a3-badd-4f64-aee8-6ab4f23c8fe8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:38.790098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b42298a3-badd-4f64-aee8-6ab4f23c8fe8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:38.941564 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2ed03372-e5b9-4334-b829-b6eec1aaac8d tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1672353527/action" status: 200 len: 21 microversion: 2.1 time: 1.437389 Aug 25 12:38:38.950079 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 7/14] 10.222.0.70 () {60 vars in 1200 bytes} [Thu Aug 25 12:38:37 2022] POST /compute/v2.1/flavors/1672353527/action => generated 21 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 12:38:39.171016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b42298a3-badd-4f64-aee8-6ab4f23c8fe8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:39.199234 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b42298a3-badd-4f64-aee8-6ab4f23c8fe8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1223 microversion: 2.1 time: 0.476249 Aug 25 12:38:39.200958 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 8/15] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:38 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1223 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:39.211405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da52187e-6fc4-4bb5-8804-ecbeea8fe673 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-8"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:39.250350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da52187e-6fc4-4bb5-8804-ecbeea8fe673 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:39.252555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da52187e-6fc4-4bb5-8804-ecbeea8fe673 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:39.254215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da52187e-6fc4-4bb5-8804-ecbeea8fe673 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:39.677682 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da52187e-6fc4-4bb5-8804-ecbeea8fe673 tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.474082 Aug 25 12:38:39.678835 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 9/16] 10.222.0.70 () {62 vars in 1232 bytes} [Thu Aug 25 12:38:39 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:38:39.703578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-11b5a259-2968-467e-a3ec-fa693f71e2a1 tempest-FlavorsAccessTestJSON-1025955456 tempest-FlavorsAccessTestJSON-1025955456-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:39.807986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b14f73b-c658-4eea-8aa1-2defe4489c5a tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Action: 'create', calling method: .version_select at 0x7f3a2b5f2670>, body: {"keypair": {"name": "tempest-keypair-1699976346", "type": "ssh", "user_id": "008169de549840aaa7fa12e270a62a4f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXU9mSIAqEpTC0a/evxfvOHD2g9U3k+yWxGc7r7nqRlVQo/aesuTTqD08fh1E6Spd1/SbUvpjHz1x2BXCmiqExwbxA3uA0p7nxZ2LTT4PIyvA2liFiPklbDQ3JhZ1ygRA=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:39.841015 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-11b5a259-2968-467e-a3ec-fa693f71e2a1 tempest-FlavorsAccessTestJSON-1025955456 tempest-FlavorsAccessTestJSON-1025955456-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.151358 Aug 25 12:38:39.850642 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 10/17] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:38:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:39.870977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a2796aa1-a776-4a92-b58f-d5bee07f922c tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:39.897057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-7b14f73b-c658-4eea-8aa1-2defe4489c5a tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Getting quotas for project 4992cc8d46ae4b989a77a8b94b1f8266. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:38:39.913149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-7b14f73b-c658-4eea-8aa1-2defe4489c5a tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Getting quotas for user eb9f357adf624cb782821127e52b0a4b and project 4992cc8d46ae4b989a77a8b94b1f8266. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:38:39.948203 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a2796aa1-a776-4a92-b58f-d5bee07f922c tempest-AggregatesAdminTestV241-384217305 tempest-AggregatesAdminTestV241-384217305-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.095185 Aug 25 12:38:39.949845 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 11/18] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Aug 25 12:38:39 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:39.967110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-59e72d5f-3e27-48bc-9224-b86400bd2d39 tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:40.052077 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b14f73b-c658-4eea-8aa1-2defe4489c5a tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 1.098571 Aug 25 12:38:40.053196 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 8/19] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Aug 25 12:38:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:38:40.055939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-59e72d5f-3e27-48bc-9224-b86400bd2d39 tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1672353527" status: 202 len: 0 microversion: 2.1 time: 0.101448 Aug 25 12:38:40.065484 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 12/20] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:38:39 2022] DELETE /compute/v2.1/flavors/1672353527 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:38:40.084116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9b0ee7ae-30b1-4e5c-ac2c-9cfd954090d1 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1197414095"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:40.092575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.aggregate [None req-9b0ee7ae-30b1-4e5c-ac2c-9cfd954090d1 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Generated uuid 19e3e6b7-778e-4680-94cd-44c3b2ad92d3 for aggregate {{(pid=129059) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:38:40.113249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0b8eca43-069c-4dbc-bb12-cb1b5538736e tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:40.226861 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9b0ee7ae-30b1-4e5c-ac2c-9cfd954090d1 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.158932 Aug 25 12:38:40.247193 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 9/21] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:38:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:40.265155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ae583fae-2b72-4432-b53b-7ecafb0ac507 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Action: 'create', calling method: .version_select at 0x7f3a2b654ca0>, body: {"keypair": {"name": "tempest-keypair-1768532974", "type": "ssh", "user_id": "008169de549840aaa7fa12e270a62a4f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3YT15He6s9d8xKosxfDJ/xmHbZN8UDuz7Kt12Fwom2iCYNZOtkrpGPxBPSGM1XPZK5H9S50RZuxbe2mSfcQOSwUieD4UqxW9eCZbEilnEeinlFjQd1paK3ESUqjE1VUA=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:40.287768 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0b8eca43-069c-4dbc-bb12-cb1b5538736e tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.215145 Aug 25 12:38:40.292018 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 13/22] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:38:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:40.322903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b3a11af6-3b22-4986-a772-82b4aadf904d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:40.324059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b3a11af6-3b22-4986-a772-82b4aadf904d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:40.331056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ae583fae-2b72-4432-b53b-7ecafb0ac507 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Getting quotas for project 4992cc8d46ae4b989a77a8b94b1f8266. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:38:40.351395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a11af6-3b22-4986-a772-82b4aadf904d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:40.355858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a11af6-3b22-4986-a772-82b4aadf904d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:40.356943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a11af6-3b22-4986-a772-82b4aadf904d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:40.359953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a11af6-3b22-4986-a772-82b4aadf904d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:40.361563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ae583fae-2b72-4432-b53b-7ecafb0ac507 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Getting quotas for user eb9f357adf624cb782821127e52b0a4b and project 4992cc8d46ae4b989a77a8b94b1f8266. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:38:40.362564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a11af6-3b22-4986-a772-82b4aadf904d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:40.366191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a11af6-3b22-4986-a772-82b4aadf904d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:40.554776 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ae583fae-2b72-4432-b53b-7ecafb0ac507 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.305127 Aug 25 12:38:40.556503 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 10/23] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Aug 25 12:38:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 308 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:38:40.581890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27733c3d-2329-4b97-9259-96bc1872de7c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:40.664735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27733c3d-2329-4b97-9259-96bc1872de7c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:40.666468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27733c3d-2329-4b97-9259-96bc1872de7c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:40.667684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27733c3d-2329-4b97-9259-96bc1872de7c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:40.740781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b3a11af6-3b22-4986-a772-82b4aadf904d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:40.783823 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b3a11af6-3b22-4986-a772-82b4aadf904d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1279 microversion: 2.1 time: 0.487020 Aug 25 12:38:40.805573 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 14/24] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:40 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1279 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:40.822403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3be2a944-7209-4c07-88e2-aba9c0d37105 tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1641039005", "id": 1126714759, "os-flavor-access:is_public": "False"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:40.998371 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3be2a944-7209-4c07-88e2-aba9c0d37105 tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.203216 Aug 25 12:38:41.023094 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 15/25] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:38:40 2022] POST /compute/v2.1/flavors => generated 431 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:41.034095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2556782d-d39b-4771-8da3-d6d3448130d6 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Calling method '.version_select at 0x7f3a2b442af0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:41.069402 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2556782d-d39b-4771-8da3-d6d3448130d6 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-1699976346?user_id=008169de549840aaa7fa12e270a62a4f" status: 200 len: 512 microversion: 2.10 time: 0.044477 Aug 25 12:38:41.070581 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 16/26] 10.222.0.70 () {60 vars in 1340 bytes} [Thu Aug 25 12:38:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1699976346?user_id=008169de549840aaa7fa12e270a62a4f => generated 512 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:38:41.080407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-825505f9-2f7c-4df0-8f5b-36d81e23c8fd tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:41.164468 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-825505f9-2f7c-4df0-8f5b-36d81e23c8fd tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1126714759/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.088377 Aug 25 12:38:41.174069 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 17/27] 10.222.0.70 () {58 vars in 1209 bytes} [Thu Aug 25 12:38:41 2022] GET /compute/v2.1/flavors/1126714759/os-flavor-access => generated 21 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:38:41.186940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-90e0ccd0-fbf7-46d3-a545-1a0660a689f9 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Action: 'create', calling method: .version_select at 0x7f3a2b4cb940>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1022772288", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJoO0cscC/B7Pvm5SZrxMuHFFZredAaU3Nl66HdhWKnpU17B3y6Lrk2rQKezozGTLd+hA1cosEwgh+r/9Yowm0M60Y63qqvqsehtCepkV1h+BGP8xvZtZlP5ySzUpYQ8A=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:41.285906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-90e0ccd0-fbf7-46d3-a545-1a0660a689f9 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Getting quotas for project 4992cc8d46ae4b989a77a8b94b1f8266. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:38:41.304479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-90e0ccd0-fbf7-46d3-a545-1a0660a689f9 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Getting quotas for user eb9f357adf624cb782821127e52b0a4b and project 4992cc8d46ae4b989a77a8b94b1f8266. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:38:41.398606 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-90e0ccd0-fbf7-46d3-a545-1a0660a689f9 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.229406 Aug 25 12:38:41.400562 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 18/28] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Aug 25 12:38:41 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 234 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:38:41.443900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-96d4a19a-2dbe-4fd9-a3fa-b93471800fca tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:41.528204 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-96d4a19a-2dbe-4fd9-a3fa-b93471800fca tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1126714759" status: 202 len: 0 microversion: 2.1 time: 0.123559 Aug 25 12:38:41.535052 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 19/29] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:38:41 2022] DELETE /compute/v2.1/flavors/1126714759 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:38:41.550466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-87b1f44b-88a5-4509-abac-4bd2be160276 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Calling method '.version_select at 0x7f3a2b442310>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:41.558145 n-d-852771-8 devstack@n-api.service[129060]: WARNING oslo_db.sqlalchemy.utils [None req-87b1f44b-88a5-4509-abac-4bd2be160276 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 12:38:41.573890 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-87b1f44b-88a5-4509-abac-4bd2be160276 tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] 10.222.0.70 "GET /compute/v2.1/os-keypairs?user_id=008169de549840aaa7fa12e270a62a4f" status: 200 len: 726 microversion: 2.10 time: 0.034153 Aug 25 12:38:41.575892 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 20/30] 10.222.0.70 () {60 vars in 1259 bytes} [Thu Aug 25 12:38:41 2022] GET /compute/v2.1/os-keypairs?user_id=008169de549840aaa7fa12e270a62a4f => generated 726 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:38:41.592423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8024a41d-98de-4ec5-94fb-343f8512b715 tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:41.682027 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8024a41d-98de-4ec5-94fb-343f8512b715 tempest-FlavorsAccessTestJSON-1259948313 tempest-FlavorsAccessTestJSON-1259948313-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.102717 Aug 25 12:38:41.683384 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 21/31] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:38:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:41.725735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-720e2b10-9426-4230-abd8-f91ffb52d68e tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Calling method '.version_select at 0x7f3a2b3e4670>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:41.803260 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-720e2b10-9426-4230-abd8-f91ffb52d68e tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1022772288" status: 204 len: 0 microversion: 2.10 time: 0.116738 Aug 25 12:38:41.805675 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 22/32] 10.222.0.70 () {60 vars in 1325 bytes} [Thu Aug 25 12:38:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1022772288 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:38:41.834495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a70026b-8d09-49e0-a323-36afbc8b8d2d tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Calling method '.version_select at 0x7f3a2b377ee0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:41.920180 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a70026b-8d09-49e0-a323-36afbc8b8d2d tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768532974?user_id=008169de549840aaa7fa12e270a62a4f" status: 204 len: 0 microversion: 2.10 time: 0.105326 Aug 25 12:38:41.928006 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 23/33] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 12:38:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768532974?user_id=008169de549840aaa7fa12e270a62a4f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 12:38:41.946394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e36819e-af4e-4b5e-aa7a-face710daf87 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:41.949621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3e36819e-af4e-4b5e-aa7a-face710daf87 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:41.978953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:DELETE=11 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:41.994671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e36819e-af4e-4b5e-aa7a-face710daf87 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:41.998682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e36819e-af4e-4b5e-aa7a-face710daf87 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:42.000907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e36819e-af4e-4b5e-aa7a-face710daf87 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:42.006581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e36819e-af4e-4b5e-aa7a-face710daf87 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:42.008185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e36819e-af4e-4b5e-aa7a-face710daf87 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:42.011727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e36819e-af4e-4b5e-aa7a-face710daf87 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:42.473543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3e36819e-af4e-4b5e-aa7a-face710daf87 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:42.504610 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3e36819e-af4e-4b5e-aa7a-face710daf87 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1277 microversion: 2.1 time: 0.576415 Aug 25 12:38:42.507356 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 24/34] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:41 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1277 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:42.560450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e37bfb98-1a65-4332-9a7a-c949b7671dbe tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] Calling method '.version_select at 0x7f3a2b3e4dc0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:42.665621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:42.739281 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e37bfb98-1a65-4332-9a7a-c949b7671dbe tempest-KeyPairsV210TestJSON-870959751 tempest-KeyPairsV210TestJSON-870959751-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699976346?user_id=008169de549840aaa7fa12e270a62a4f" status: 204 len: 0 microversion: 2.10 time: 0.197240 Aug 25 12:38:42.747859 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 25/35] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 12:38:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699976346?user_id=008169de549840aaa7fa12e270a62a4f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:38:43.224409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:43.552318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2440fb63-5ce0-4269-a35c-6dffdfd1d713 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:43.555183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2440fb63-5ce0-4269-a35c-6dffdfd1d713 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:43.608264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2440fb63-5ce0-4269-a35c-6dffdfd1d713 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:43.616996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2440fb63-5ce0-4269-a35c-6dffdfd1d713 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:43.618006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2440fb63-5ce0-4269-a35c-6dffdfd1d713 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:43.628603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2440fb63-5ce0-4269-a35c-6dffdfd1d713 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:43.629323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2440fb63-5ce0-4269-a35c-6dffdfd1d713 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:43.630201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2440fb63-5ce0-4269-a35c-6dffdfd1d713 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:43.781332 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-27733c3d-2329-4b97-9259-96bc1872de7c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 3.219324 Aug 25 12:38:43.782888 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 11/36] 10.222.0.70 () {60 vars in 1191 bytes} [Thu Aug 25 12:38:40 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 3223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:43.831025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1ae58d1-43b2-4d2f-b1f4-6c6e5f2c913f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:43.913652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1ae58d1-43b2-4d2f-b1f4-6c6e5f2c913f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:43.914391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1ae58d1-43b2-4d2f-b1f4-6c6e5f2c913f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:43.915139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1ae58d1-43b2-4d2f-b1f4-6c6e5f2c913f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:44.091551 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-e1ae58d1-43b2-4d2f-b1f4-6c6e5f2c913f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h2-852771-8. Aug 25 12:38:44.094226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2440fb63-5ce0-4269-a35c-6dffdfd1d713 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:44.165245 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2440fb63-5ce0-4269-a35c-6dffdfd1d713 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1277 microversion: 2.1 time: 0.622178 Aug 25 12:38:44.170142 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 26/37] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:43 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1277 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1ae58d1-43b2-4d2f-b1f4-6c6e5f2c913f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Request method failure captured: Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 39 Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21E3PNFqJayVHHWaAu8M2juxizrYL68WZIfy0xx8ufdvubABSUArlx63SfKifjMoCzPsGN32X7dFjk_0sIHdU0YLmMlGU3-WNvdRmhXkNzLaQ5ktJ_Fyq1jCEsWTux5fkRmDQqSB8KT7tZ4pQfGuu6VY3thUbRumQMpsXlupsX0YOI Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:38:44.187208 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72b01006125c41c5b5fe6eb06b0a784e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}] Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 48ddaf2829494246afcecfc46efbb229 Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: {"add_host": {"host": "n-h2-852771-8"}} Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:38:44.190058 n-d-852771-8 devstack@n-api.service[129059]: exception: Aggregate 2 already has host n-h2-852771-8. Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-852771-8'}}} Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:38:44.191368 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-852771-8-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi session.flush() Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 12:38:44.199892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 12:38:44.203350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:38:44.210728 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-852771-8-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 25, 12, 38, 44, 23574), 'updated_at': None, 'host': 'n-h2-852771-8', 'aggregate_id': 2}] Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:44.213984 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h2-852771-8. Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:44.216794 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h2-852771-8. Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:44.225359 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:44.228914 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h2-852771-8. Aug 25 12:38:44.228914 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:44.228914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1ae58d1-43b2-4d2f-b1f4-6c6e5f2c913f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Returning 409 to user: Aggregate 2 already has host n-h2-852771-8. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:44.228914 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e1ae58d1-43b2-4d2f-b1f4-6c6e5f2c913f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.388959 Aug 25 12:38:44.228914 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 12/38] 10.222.0.70 () {60 vars in 1191 bytes} [Thu Aug 25 12:38:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 410 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 25 12:38:44.229801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a49e9d72-935c-4451-9469-3c386f98d1f6 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-8"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:44.296862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a49e9d72-935c-4451-9469-3c386f98d1f6 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:44.297791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a49e9d72-935c-4451-9469-3c386f98d1f6 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:44.298425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a49e9d72-935c-4451-9469-3c386f98d1f6 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:44.943636 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a49e9d72-935c-4451-9469-3c386f98d1f6 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.722557 Aug 25 12:38:44.945411 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 27/39] 10.222.0.70 () {60 vars in 1191 bytes} [Thu Aug 25 12:38:44 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:44.976284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b77b1c4-951f-4090-9f77-6907d6c0ded4 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:45.166704 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b77b1c4-951f-4090-9f77-6907d6c0ded4 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.200683 Aug 25 12:38:45.181224 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 13/40] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:38:44 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:38:45.198275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad175215-00aa-4566-8511-abe2ae654ac1 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-423578379"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:45.229046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-ad175215-00aa-4566-8511-abe2ae654ac1 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Generated uuid 69683e2f-136e-47f2-91fd-9e364b78c50d for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:38:45.240677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-708b9b78-e24d-44e2-9ec8-63d1cd31734b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:45.255691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-708b9b78-e24d-44e2-9ec8-63d1cd31734b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:45.335398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-708b9b78-e24d-44e2-9ec8-63d1cd31734b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:45.342371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-708b9b78-e24d-44e2-9ec8-63d1cd31734b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:45.350810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-708b9b78-e24d-44e2-9ec8-63d1cd31734b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:45.354604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-708b9b78-e24d-44e2-9ec8-63d1cd31734b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:45.361834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-708b9b78-e24d-44e2-9ec8-63d1cd31734b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:45.363923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-708b9b78-e24d-44e2-9ec8-63d1cd31734b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:45.392561 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad175215-00aa-4566-8511-abe2ae654ac1 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.201445 Aug 25 12:38:45.412077 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 28/41] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:38:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:45.438313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0bd01b77-28a8-4b62-907b-ed26a9f7d122 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1815609631", "name": "tempest-test_aggregate-1464987615"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:45.635148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-0bd01b77-28a8-4b62-907b-ed26a9f7d122 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Generated uuid aa5064fa-e6bc-4c0a-b90a-77e8cf731546 for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:38:45.803494 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0bd01b77-28a8-4b62-907b-ed26a9f7d122 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.389212 Aug 25 12:38:45.819921 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 29/42] 10.222.0.70 () {60 vars in 1165 bytes} [Thu Aug 25 12:38:45 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:47.244425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3bc13ac-43ef-4a3d-930e-56415a508d2f tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-8"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:47.291580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a3bc13ac-43ef-4a3d-930e-56415a508d2f tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '28eef1b58df344b79769f6c579061706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ba0b250acd4f2eb07754b9d24bcbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3bc13ac-43ef-4a3d-930e-56415a508d2f tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Request method failure captured: Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 39 Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21AenB4N3avpWNEzM6luMXKT3HdMamcGkeUKNu8kHQOg2FMcT6i2spu2y6Cfw5kcyjegW6o7FLHcrgLc6u4vTcOYmwu7soJ97JfHJojTvIrb4VjrxwUpx7S0Uc_1-oAhMGEAwSRnUeh5AKNpwME08F71I7ZZCqN1v0E0d6Ji5k3hGs Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:38:47.310623 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d1ba0b250acd4f2eb07754b9d24bcbf6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}] Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 28eef1b58df344b79769f6c579061706 Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: {"add_host": {"host": "n-h2-852771-8"}} Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:38:47.316340 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-852771-8'}}} Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:38:47.318689 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 25 12:38:47.322122 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:47.334445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3bc13ac-43ef-4a3d-930e-56415a508d2f tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:47.367962 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a3bc13ac-43ef-4a3d-930e-56415a508d2f tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 1.540168 Aug 25 12:38:47.381890 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 30/43] 10.222.0.70 () {60 vars in 1191 bytes} [Thu Aug 25 12:38:45 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 1562 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:47.413743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-378a54cf-f308-42a8-8497-b1159e331ddd tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:47.510812 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-378a54cf-f308-42a8-8497-b1159e331ddd tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.126049 Aug 25 12:38:47.511708 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 31/44] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:38:47 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:48.839309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-244f555a-1f20-4b9e-86fd-47bb79e435c8 tempest-FlavorsV255TestJSON-2135579960 tempest-FlavorsV255TestJSON-2135579960-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-141482421", "id": 1291228242, "os-flavor-access:is_public": "True"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:48.988718 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-244f555a-1f20-4b9e-86fd-47bb79e435c8 tempest-FlavorsV255TestJSON-2135579960 tempest-FlavorsV255TestJSON-2135579960-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 1.475358 Aug 25 12:38:49.024060 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 32/45] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 12:38:47 2022] POST /compute/v2.1/flavors => generated 448 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:38:49.038225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-708b9b78-e24d-44e2-9ec8-63d1cd31734b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:49.097809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1a21e02c-ed80-46a2-832a-1526efc9c6d7 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:49.176697 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-708b9b78-e24d-44e2-9ec8-63d1cd31734b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 3.970900 Aug 25 12:38:49.180640 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 14/46] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:45 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 3976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:49.222760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d116251e-3e8d-400d-953c-818236d67267 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:49.291464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d116251e-3e8d-400d-953c-818236d67267 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:49.293079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d116251e-3e8d-400d-953c-818236d67267 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:49.294251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d116251e-3e8d-400d-953c-818236d67267 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:49.306896 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1a21e02c-ed80-46a2-832a-1526efc9c6d7 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.252300 Aug 25 12:38:49.312292 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 33/47] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:38:49 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:38:49.558582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=10,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:50.239388 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d116251e-3e8d-400d-953c-818236d67267 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 315 microversion: 2.1 time: 1.056529 Aug 25 12:38:50.265668 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 15/48] 10.222.0.70 () {60 vars in 1191 bytes} [Thu Aug 25 12:38:49 2022] POST /compute/v2.1/os-aggregates/4/action => generated 315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:50.287011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d829a29-fe89-4e5c-a097-5bd6887f816b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1617499680"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:50.311716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.aggregate [None req-5d829a29-fe89-4e5c-a097-5bd6887f816b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Generated uuid 7942c8fe-f736-4fdb-80af-7105a103265f for aggregate {{(pid=129059) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:38:50.424150 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5d829a29-fe89-4e5c-a097-5bd6887f816b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.164608 Aug 25 12:38:50.442250 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 16/49] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:38:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:50.469573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ccfa6109-8e04-4830-9e40-4ef2994fd00d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:50.474760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ccfa6109-8e04-4830-9e40-4ef2994fd00d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:50.483580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=14 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:50.522618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfa6109-8e04-4830-9e40-4ef2994fd00d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:50.529496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfa6109-8e04-4830-9e40-4ef2994fd00d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:50.541613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfa6109-8e04-4830-9e40-4ef2994fd00d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:50.551889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfa6109-8e04-4830-9e40-4ef2994fd00d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:50.566631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a394bd57-21ea-4619-a977-211b9312c6bc tempest-FlavorsV255TestJSON-685054256 tempest-FlavorsV255TestJSON-685054256-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:50.568338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfa6109-8e04-4830-9e40-4ef2994fd00d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:50.569358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfa6109-8e04-4830-9e40-4ef2994fd00d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:50.809575 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a394bd57-21ea-4619-a977-211b9312c6bc tempest-FlavorsV255TestJSON-685054256 tempest-FlavorsV255TestJSON-685054256-project] 10.222.0.70 "GET /compute/v2.1/flavors/1291228242" status: 200 len: 448 microversion: 2.55 time: 1.494977 Aug 25 12:38:50.810867 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 34/50] 10.222.0.70 () {60 vars in 1199 bytes} [Thu Aug 25 12:38:49 2022] GET /compute/v2.1/flavors/1291228242 => generated 448 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:38:50.890897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-22459970"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:50.991872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:50.992795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:51.001923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:51.041578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:51.047884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:51.049835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:51.105493 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-22459970 could not be found. Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Request method failure captured: Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 56 Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21E3PNFqJayVHHWaAu8M2juxizrYL68WZIfy0xx8ufdvubABSUArlx63SfKifjMoCzPsGN32X7dFjk_0sIHdU0YLmMlGU3-WNvdRmhXkNzLaQ5ktJ_Fyq1jCEsWTux5fkRmDQqSB8KT7tZ4pQfGuu6VY3thUbRumQMpsXlupsX0YOI Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:38:51.133901 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72b01006125c41c5b5fe6eb06b0a784e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}] Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 48ddaf2829494246afcecfc46efbb229 Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: {"add_host": {"host": "tempest-nonexist_host-22459970"}} Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:38:51.137147 n-d-852771-8 devstack@n-api.service[129060]: exception: Compute host tempest-nonexist_host-22459970 could not be found. Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-22459970'}}} Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-22459970' is not mapped to any cell Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:51.138518 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 25 12:38:51.140821 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-22459970 could not be found. Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-22459970 could not be found. Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:51.143644 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:51.148776 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:51.148776 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:51.148776 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:51.148776 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:51.148776 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:51.148776 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-22459970 could not be found. Aug 25 12:38:51.148776 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:51.151310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-22459970 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:51.154648 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb3e2566-5545-4b3c-b80e-be9d1d02958c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 109 microversion: 2.1 time: 0.322345 Aug 25 12:38:51.167820 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 35/51] 10.222.0.70 () {60 vars in 1191 bytes} [Thu Aug 25 12:38:50 2022] POST /compute/v2.1/os-aggregates/5/action => generated 109 bytes in 337 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:51.189826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-04031ffe-3d04-4f73-a09f-8479db9cec6c tempest-FlavorsV255TestJSON-2135579960 tempest-FlavorsV255TestJSON-2135579960-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2c4289d0>, body: {"flavor": {"description": "new"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:51.350972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:51.426669 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-04031ffe-3d04-4f73-a09f-8479db9cec6c tempest-FlavorsV255TestJSON-2135579960 tempest-FlavorsV255TestJSON-2135579960-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1291228242" status: 200 len: 449 microversion: 2.55 time: 0.256164 Aug 25 12:38:51.447540 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 36/52] 10.222.0.70 () {62 vars in 1219 bytes} [Thu Aug 25 12:38:51 2022] PUT /compute/v2.1/flavors/1291228242 => generated 449 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:38:52.465477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2103189990", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "availability_zone": "tempest-test_az-1815609631"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:52.664827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:52.666297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:52.667456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:52.670260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:52.671777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:52.672832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:52.998061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:38:53.552291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ccfa6109-8e04-4830-9e40-4ef2994fd00d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:53.578004 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ccfa6109-8e04-4830-9e40-4ef2994fd00d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 3.133788 Aug 25 12:38:53.580727 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 17/53] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:50 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 3138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:53.596595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63dfcef5-ca72-414e-9ff4-49ba32feedbd tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:53.728898 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-63dfcef5-ca72-414e-9ff4-49ba32feedbd tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.142278 Aug 25 12:38:53.741476 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 18/54] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:38:53 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:38:53.772822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-982f82a1-b3a9-4995-8b3e-fc4716d89e31 tempest-FlavorsV255TestJSON-685054256 tempest-FlavorsV255TestJSON-685054256-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:53.889372 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-982f82a1-b3a9-4995-8b3e-fc4716d89e31 tempest-FlavorsV255TestJSON-685054256 tempest-FlavorsV255TestJSON-685054256-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.139918 Aug 25 12:38:53.894686 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 19/55] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 12:38:53 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:53.913362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1c836733-9943-4538-abea-a2f77db7dd27 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1c836733-9943-4538-abea-a2f77db7dd27 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Request method failure captured: Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 283 Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21E3PNFqJayVHHWaAu8M2juxizrYL68WZIfy0xx8ufdvubABSUArlx63SfKifjMoCzPsGN32X7dFjk_0sIHdU0YLmMlGU3-WNvdRmhXkNzLaQ5ktJ_Fyq1jCEsWTux5fkRmDQqSB8KT7tZ4pQfGuu6VY3thUbRumQMpsXlupsX0YOI Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:38:53.922807 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:38:53.925314 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72b01006125c41c5b5fe6eb06b0a784e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}] Aug 25 12:38:53.925314 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:53.925314 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:53.925314 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:53.925314 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:53.925314 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:38:53.925314 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:38:53.925314 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 48ddaf2829494246afcecfc46efbb229 Aug 25 12:38:53.925314 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:53.925314 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:38:53.926417 n-d-852771-8 devstack@n-api.service[129059]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 25 12:38:53.926417 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:38:53.926417 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:38:53.926417 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 25 12:38:53.926417 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:53.926417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:53.926417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:38:53.926417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:38:53.926417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:38:53.926417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:53.927817 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:53.930643 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:53.933358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:38:53.933358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:38:53.933358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:38:53.933358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:53.951176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1c836733-9943-4538-abea-a2f77db7dd27 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:53.952767 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1c836733-9943-4538-abea-a2f77db7dd27 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.056256 Aug 25 12:38:53.958965 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 20/56] 10.222.0.70 () {60 vars in 1165 bytes} [Thu Aug 25 12:38:53 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:38:53.985245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e591c2c-7b09-45f5-a5f6-76a18864fad8 tempest-FlavorsV255TestJSON-685054256 tempest-FlavorsV255TestJSON-685054256-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:54.128833 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e591c2c-7b09-45f5-a5f6-76a18864fad8 tempest-FlavorsV255TestJSON-685054256 tempest-FlavorsV255TestJSON-685054256-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.163623 Aug 25 12:38:54.135811 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 21/57] 10.222.0.70 () {60 vars in 1166 bytes} [Thu Aug 25 12:38:53 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:54.149934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e79beee4-a4ce-4a96-87a2-2c0132feb6d9 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e79beee4-a4ce-4a96-87a2-2c0132feb6d9 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Request method failure captured: Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 27 Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21E3PNFqJayVHHWaAu8M2juxizrYL68WZIfy0xx8ufdvubABSUArlx63SfKifjMoCzPsGN32X7dFjk_0sIHdU0YLmMlGU3-WNvdRmhXkNzLaQ5ktJ_Fyq1jCEsWTux5fkRmDQqSB8KT7tZ4pQfGuu6VY3thUbRumQMpsXlupsX0YOI Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:38:54.181876 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72b01006125c41c5b5fe6eb06b0a784e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}] Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 48ddaf2829494246afcecfc46efbb229 Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: {"aggregate": {"name": ""}} Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:38:54.184351 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi '' Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:54.185660 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:38:54.187572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:54.194871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e79beee4-a4ce-4a96-87a2-2c0132feb6d9 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:54.198894 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e79beee4-a4ce-4a96-87a2-2c0132feb6d9 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.059433 Aug 25 12:38:54.210605 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 22/58] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:38:54 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:38:54.228899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8fb63556-752e-4dde-9ab7-65b66d700ec8 tempest-FlavorsV255TestJSON-2135579960 tempest-FlavorsV255TestJSON-2135579960-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:54.368993 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8fb63556-752e-4dde-9ab7-65b66d700ec8 tempest-FlavorsV255TestJSON-2135579960 tempest-FlavorsV255TestJSON-2135579960-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1291228242" status: 202 len: 0 microversion: 2.55 time: 0.155889 Aug 25 12:38:54.382416 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 23/59] 10.222.0.70 () {60 vars in 1202 bytes} [Thu Aug 25 12:38:54 2022] DELETE /compute/v2.1/flavors/1291228242 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:38:54.410584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2463d55f-8047-479a-9a75-fcf0fd694e04 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1953264407"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:54.431195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2463d55f-8047-479a-9a75-fcf0fd694e04 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '28eef1b58df344b79769f6c579061706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ba0b250acd4f2eb07754b9d24bcbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2463d55f-8047-479a-9a75-fcf0fd694e04 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Request method failure captured: Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 60 Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21AenB4N3avpWNEzM6luMXKT3HdMamcGkeUKNu8kHQOg2FMcT6i2spu2y6Cfw5kcyjegW6o7FLHcrgLc6u4vTcOYmwu7soJ97JfHJojTvIrb4VjrxwUpx7S0Uc_1-oAhMGEAwSRnUeh5AKNpwME08F71I7ZZCqN1v0E0d6Ji5k3hGs Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:38:54.454600 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d1ba0b250acd4f2eb07754b9d24bcbf6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}] Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 28eef1b58df344b79769f6c579061706 Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: {"aggregate": {"name": "tempest-test_aggregate-1953264407"}} Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:38:54.457583 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1953264407'}}} Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:38:54.459798 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:38:54.463616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 25 12:38:54.469810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:54.472296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2463d55f-8047-479a-9a75-fcf0fd694e04 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:54.482250 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2463d55f-8047-479a-9a75-fcf0fd694e04 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.097464 Aug 25 12:38:54.498886 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 24/60] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:38:54 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 116 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:54.521032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-11476a65-1dbd-4a4c-b859-42140bb63977 tempest-FlavorsV255TestJSON-2135579960 tempest-FlavorsV255TestJSON-2135579960-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:54.715473 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-11476a65-1dbd-4a4c-b859-42140bb63977 tempest-FlavorsV255TestJSON-2135579960 tempest-FlavorsV255TestJSON-2135579960-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.213989 Aug 25 12:38:54.716913 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 25/61] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 12:38:54 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:54.741548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-55f50796-dc61-47cd-b839-c3db0fb3ef6b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1726612223"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:54.765323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.aggregate [None req-55f50796-dc61-47cd-b839-c3db0fb3ef6b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Generated uuid 0ec87f73-ab4b-4377-85c1-e44a7eecca14 for aggregate {{(pid=129059) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:38:54.858407 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-55f50796-dc61-47cd-b839-c3db0fb3ef6b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.130791 Aug 25 12:38:54.868602 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 26/62] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:38:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:54.904504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e8526f82-8ac1-4010-81e6-b9678bff61dd tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:54.905803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e8526f82-8ac1-4010-81e6-b9678bff61dd tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:54.948330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8526f82-8ac1-4010-81e6-b9678bff61dd tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:54.949227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8526f82-8ac1-4010-81e6-b9678bff61dd tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:54.962012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8526f82-8ac1-4010-81e6-b9678bff61dd tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:54.984829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8526f82-8ac1-4010-81e6-b9678bff61dd tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:54.990005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8526f82-8ac1-4010-81e6-b9678bff61dd tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:54.990005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8526f82-8ac1-4010-81e6-b9678bff61dd tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.504112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:38:55.504961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:38:55.505903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:38:55.506625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:38:55.507395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:38:55.581552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:55.582686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:55.583399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.584916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:55.585760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:55.596632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.729855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Getting quotas for project 15549222652b470495c1febfc030c637. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:38:55.739469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Getting quotas for user e7f1a6e462af4936966f1d6b450aec72 and project 15549222652b470495c1febfc030c637. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:38:55.819383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:38:55.855861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:38:56.344486 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-40fd7c6b-93b1-4936-b336-ad46777c5a08 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.894820 Aug 25 12:38:56.354323 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 37/63] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:38:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:38:56.385169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7cc5a56b-506d-4a53-b0d1-d79c4f19c412 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1726612223"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:56.412633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-7cc5a56b-506d-4a53-b0d1-d79c4f19c412 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Generated uuid c258aba8-9268-459e-9607-df7b932d459e for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:38:56.472875 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-7cc5a56b-506d-4a53-b0d1-d79c4f19c412 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1726612223 already exists. Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7cc5a56b-506d-4a53-b0d1-d79c4f19c412 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Request method failure captured: Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 60 Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21E3PNFqJayVHHWaAu8M2juxizrYL68WZIfy0xx8ufdvubABSUArlx63SfKifjMoCzPsGN32X7dFjk_0sIHdU0YLmMlGU3-WNvdRmhXkNzLaQ5ktJ_Fyq1jCEsWTux5fkRmDQqSB8KT7tZ4pQfGuu6VY3thUbRumQMpsXlupsX0YOI Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:38:56.483389 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72b01006125c41c5b5fe6eb06b0a784e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}] Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 48ddaf2829494246afcecfc46efbb229 Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: {"aggregate": {"name": "tempest-test_aggregate-1726612223"}} Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:38:56.484678 n-d-852771-8 devstack@n-api.service[129060]: exception: Aggregate tempest-test_aggregate-1726612223 already exists. Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1726612223'}}} Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 25 12:38:56.485347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1726612223 already exists. Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:38:56.487486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1726612223 already exists. Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1726612223 already exists. Aug 25 12:38:56.502670 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.510314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7cc5a56b-506d-4a53-b0d1-d79c4f19c412 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1726612223 already exists. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:56.513625 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7cc5a56b-506d-4a53-b0d1-d79c4f19c412 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.156973 Aug 25 12:38:56.515238 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 38/64] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:38:56 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:38:56.556315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e8526f82-8ac1-4010-81e6-b9678bff61dd tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:56.557199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d01b1721-ab06-4c6b-a178-b40cbdd5223f tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:56.559823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d01b1721-ab06-4c6b-a178-b40cbdd5223f tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:56.617064 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e8526f82-8ac1-4010-81e6-b9678bff61dd tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 1.747231 Aug 25 12:38:56.618130 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 27/65] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:54 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:56.670195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-295574cc-933c-4a3b-9dd1-f34842a7f26e tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:56.768655 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-295574cc-933c-4a3b-9dd1-f34842a7f26e tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.137334 Aug 25 12:38:56.770156 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 28/66] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:38:56 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:38:56.800662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fd5188d1-a721-4ed0-bc64-3056fbfec330 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-685126583"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:56.809897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.aggregate [None req-fd5188d1-a721-4ed0-bc64-3056fbfec330 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Generated uuid cf34048a-5a54-448b-8f7d-8cef72d219c8 for aggregate {{(pid=129059) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:38:56.888541 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fd5188d1-a721-4ed0-bc64-3056fbfec330 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.108815 Aug 25 12:38:56.890458 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 29/67] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:38:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:56.915598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e26bb746-8588-4433-81df-87ace8ae232f tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:56.922767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e26bb746-8588-4433-81df-87ace8ae232f tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '28eef1b58df344b79769f6c579061706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ba0b250acd4f2eb07754b9d24bcbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e26bb746-8588-4433-81df-87ace8ae232f tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Request method failure captured: Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21AenB4N3avpWNEzM6luMXKT3HdMamcGkeUKNu8kHQOg2FMcT6i2spu2y6Cfw5kcyjegW6o7FLHcrgLc6u4vTcOYmwu7soJ97JfHJojTvIrb4VjrxwUpx7S0Uc_1-oAhMGEAwSRnUeh5AKNpwME08F71I7ZZCqN1v0E0d6Ji5k3hGs Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:38:56.931621 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d1ba0b250acd4f2eb07754b9d24bcbf6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}] Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 28eef1b58df344b79769f6c579061706 Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 25 12:38:56.933910 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7'} Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:38:56.935232 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.937061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e26bb746-8588-4433-81df-87ace8ae232f tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:56.940423 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e26bb746-8588-4433-81df-87ace8ae232f tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.035306 Aug 25 12:38:56.943482 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 30/68] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:38:56 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:56.973866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3eb3a521-7343-44dd-bf56-b0c4ac6f3940 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:57.068156 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3eb3a521-7343-44dd-bf56-b0c4ac6f3940 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.114420 Aug 25 12:38:57.072860 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 31/69] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:38:56 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:38:57.097018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2332c6f7-2534-4a05-b4d4-b3391ec505e4 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:57.143372 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-2332c6f7-2534-4a05-b4d4-b3391ec505e4 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2332c6f7-2534-4a05-b4d4-b3391ec505e4 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Request method failure captured: Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21E3PNFqJayVHHWaAu8M2juxizrYL68WZIfy0xx8ufdvubABSUArlx63SfKifjMoCzPsGN32X7dFjk_0sIHdU0YLmMlGU3-WNvdRmhXkNzLaQ5ktJ_Fyq1jCEsWTux5fkRmDQqSB8KT7tZ4pQfGuu6VY3thUbRumQMpsXlupsX0YOI Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:38:57.156087 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72b01006125c41c5b5fe6eb06b0a784e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}] Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 48ddaf2829494246afcecfc46efbb229 Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: exception: Aggregate -1 could not be found. Aug 25 12:38:57.158746 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '-1'} Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:38:57.160169 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.163108 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:57.171084 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:57.171084 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:57.171084 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:57.171084 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:57.171084 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 25 12:38:57.171084 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.171084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2332c6f7-2534-4a05-b4d4-b3391ec505e4 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:57.171084 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2332c6f7-2534-4a05-b4d4-b3391ec505e4 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.085769 Aug 25 12:38:57.171084 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 32/70] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:38:57 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 25 12:38:57.185005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2fcf1340-49a1-40a7-8613-3554842d9aca tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-521064458"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:57.198068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.aggregate [None req-2fcf1340-49a1-40a7-8613-3554842d9aca tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Generated uuid 24adf303-84fe-4c20-9179-999f744dc542 for aggregate {{(pid=129059) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:38:57.303930 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2fcf1340-49a1-40a7-8613-3554842d9aca tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.123429 Aug 25 12:38:57.319206 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 33/71] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:38:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:57.348113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9fdf7f9a-72b1-431e-9a6d-595dc67afced tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:57.354446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9fdf7f9a-72b1-431e-9a6d-595dc67afced tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '28eef1b58df344b79769f6c579061706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ba0b250acd4f2eb07754b9d24bcbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9fdf7f9a-72b1-431e-9a6d-595dc67afced tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Request method failure captured: Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21AenB4N3avpWNEzM6luMXKT3HdMamcGkeUKNu8kHQOg2FMcT6i2spu2y6Cfw5kcyjegW6o7FLHcrgLc6u4vTcOYmwu7soJ97JfHJojTvIrb4VjrxwUpx7S0Uc_1-oAhMGEAwSRnUeh5AKNpwME08F71I7ZZCqN1v0E0d6Ji5k3hGs Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:38:57.358746 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d1ba0b250acd4f2eb07754b9d24bcbf6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}] Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 28eef1b58df344b79769f6c579061706 Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 25 12:38:57.361247 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '8'} Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:38:57.363490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 25 12:38:57.365372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.373702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9fdf7f9a-72b1-431e-9a6d-595dc67afced tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:57.375585 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9fdf7f9a-72b1-431e-9a6d-595dc67afced tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] 10.222.0.70 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.053859 Aug 25 12:38:57.382320 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 34/72] 10.222.0.70 () {58 vars in 1149 bytes} [Thu Aug 25 12:38:57 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:57.404134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f2acea6d-b14c-40d3-9ffb-ec5dd0a3c683 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:57.440031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d01b1721-ab06-4c6b-a178-b40cbdd5223f tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:57.471262 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d01b1721-ab06-4c6b-a178-b40cbdd5223f tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1243 microversion: 2.1 time: 0.944292 Aug 25 12:38:57.485548 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 39/73] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:56 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1243 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:57.525063 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f2acea6d-b14c-40d3-9ffb-ec5dd0a3c683 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.134265 Aug 25 12:38:57.529588 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 35/74] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:38:57 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:38:57.548796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bd2e0f41-bb86-433d-85c5-ae2feff45361 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:57.582428 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-bd2e0f41-bb86-433d-85c5-ae2feff45361 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bd2e0f41-bb86-433d-85c5-ae2feff45361 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Request method failure captured: Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21E3PNFqJayVHHWaAu8M2juxizrYL68WZIfy0xx8ufdvubABSUArlx63SfKifjMoCzPsGN32X7dFjk_0sIHdU0YLmMlGU3-WNvdRmhXkNzLaQ5ktJ_Fyq1jCEsWTux5fkRmDQqSB8KT7tZ4pQfGuu6VY3thUbRumQMpsXlupsX0YOI Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:38:57.592427 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72b01006125c41c5b5fe6eb06b0a784e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}] Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 48ddaf2829494246afcecfc46efbb229 Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: exception: Aggregate -1 could not be found. Aug 25 12:38:57.595071 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '-1'} Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:57.597075 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 25 12:38:57.599298 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.603831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bd2e0f41-bb86-433d-85c5-ae2feff45361 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:57.603831 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bd2e0f41-bb86-433d-85c5-ae2feff45361 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.052432 Aug 25 12:38:57.608454 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 40/75] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:38:57 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:38:57.617334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25731660-6cd5-400f-8afb-e61ec4bfd825 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:57.622659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-25731660-6cd5-400f-8afb-e61ec4bfd825 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '28eef1b58df344b79769f6c579061706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ba0b250acd4f2eb07754b9d24bcbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25731660-6cd5-400f-8afb-e61ec4bfd825 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Request method failure captured: Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21AenB4N3avpWNEzM6luMXKT3HdMamcGkeUKNu8kHQOg2FMcT6i2spu2y6Cfw5kcyjegW6o7FLHcrgLc6u4vTcOYmwu7soJ97JfHJojTvIrb4VjrxwUpx7S0Uc_1-oAhMGEAwSRnUeh5AKNpwME08F71I7ZZCqN1v0E0d6Ji5k3hGs Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:38:57.626913 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d1ba0b250acd4f2eb07754b9d24bcbf6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}] Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 28eef1b58df344b79769f6c579061706 Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 25 12:38:57.630286 n-d-852771-8 devstack@n-api.service[129059]: action_args: {} Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:38:57.631462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 25 12:38:57.633417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:38:57.669399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74750a27-9a97-4765-8995-46b415239ea4 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:57.670697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74750a27-9a97-4765-8995-46b415239ea4 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:57.678178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25731660-6cd5-400f-8afb-e61ec4bfd825 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:57.684279 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-25731660-6cd5-400f-8afb-e61ec4bfd825 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.078116 Aug 25 12:38:57.691363 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 36/76] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:38:57 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 86 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:57.742114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74750a27-9a97-4765-8995-46b415239ea4 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:57.747588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74750a27-9a97-4765-8995-46b415239ea4 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:57.752219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74750a27-9a97-4765-8995-46b415239ea4 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:57.766640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74750a27-9a97-4765-8995-46b415239ea4 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:57.774111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74750a27-9a97-4765-8995-46b415239ea4 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:57.780158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74750a27-9a97-4765-8995-46b415239ea4 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:59.490589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d805e9fe-6ae1-4b2e-ae9b-e359a3ed550a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:59.544418 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d805e9fe-6ae1-4b2e-ae9b-e359a3ed550a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.627175 Aug 25 12:38:59.563813 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 37/77] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:38:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:59.594367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-452a7f4c-7306-45c9-9d5f-165d95a2732a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:59.596134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-452a7f4c-7306-45c9-9d5f-165d95a2732a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:00.588932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-452a7f4c-7306-45c9-9d5f-165d95a2732a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:00.648505 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-452a7f4c-7306-45c9-9d5f-165d95a2732a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1243 microversion: 2.1 time: 1.082424 Aug 25 12:39:00.672038 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 38/78] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:59 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1243 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:00.894624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74750a27-9a97-4765-8995-46b415239ea4 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:00.930491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=61 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:00.944147 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74750a27-9a97-4765-8995-46b415239ea4 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 3.291632 Aug 25 12:39:00.967402 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 41/79] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:57 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 3316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:02.587590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-902c05ef-a91c-4b6b-af90-d1802e5c133b tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1788862701", "id": 1629574775, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:02.681833 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-902c05ef-a91c-4b6b-af90-d1802e5c133b tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 2.007467 Aug 25 12:39:02.700597 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 39/80] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:39:00 2022] POST /compute/v2.1/flavors => generated 425 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:02.714790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ad609f2b-3fb3-4ddd-920f-643b21a236b0 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:02.721568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ad609f2b-3fb3-4ddd-920f-643b21a236b0 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:02.766468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad609f2b-3fb3-4ddd-920f-643b21a236b0 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:02.778776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad609f2b-3fb3-4ddd-920f-643b21a236b0 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:02.780169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad609f2b-3fb3-4ddd-920f-643b21a236b0 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:02.784126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad609f2b-3fb3-4ddd-920f-643b21a236b0 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:02.789554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad609f2b-3fb3-4ddd-920f-643b21a236b0 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:02.790887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad609f2b-3fb3-4ddd-920f-643b21a236b0 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:02.836322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-bad24eeb-0ddb-4180-bf9d-efe75edd1623 req-7895b3f9-1535-43da-a014-c174410f20f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd", "tag": "db57f661-a705-45c2-bfb7-3d957fb6747a"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:02.860705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=31 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:02.925080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-bad24eeb-0ddb-4180-bf9d-efe75edd1623 req-7895b3f9-1535-43da-a014-c174410f20f2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:02.926718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-bad24eeb-0ddb-4180-bf9d-efe75edd1623 req-7895b3f9-1535-43da-a014-c174410f20f2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:02.927835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-bad24eeb-0ddb-4180-bf9d-efe75edd1623 req-7895b3f9-1535-43da-a014-c174410f20f2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:02.976931 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-bad24eeb-0ddb-4180-bf9d-efe75edd1623 req-7895b3f9-1535-43da-a014-c174410f20f2 service nova] Creating event network-changed:db57f661-a705-45c2-bfb7-3d957fb6747a for instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd on n-h1-852771-8 Aug 25 12:39:02.978738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-bad24eeb-0ddb-4180-bf9d-efe75edd1623 req-7895b3f9-1535-43da-a014-c174410f20f2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:39:02.981472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-bad24eeb-0ddb-4180-bf9d-efe75edd1623 req-7895b3f9-1535-43da-a014-c174410f20f2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:39:02.984227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91f48d21-0749-423f-bc93-7cc2a4f00287 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:02.985398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91f48d21-0749-423f-bc93-7cc2a4f00287 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:02.987200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91f48d21-0749-423f-bc93-7cc2a4f00287 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:02.989434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91f48d21-0749-423f-bc93-7cc2a4f00287 None None] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:02.990597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91f48d21-0749-423f-bc93-7cc2a4f00287 None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:02.991589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91f48d21-0749-423f-bc93-7cc2a4f00287 None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:03.014306 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.compute.rpcapi [None req-91f48d21-0749-423f-bc93-7cc2a4f00287 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 25 12:39:03.019779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91f48d21-0749-423f-bc93-7cc2a4f00287 None None] Releasing lock "compute-rpcapi-router" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:39:03.022088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ad609f2b-3fb3-4ddd-920f-643b21a236b0 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:03.062931 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-91f48d21-0749-423f-bc93-7cc2a4f00287 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.755738 Aug 25 12:39:03.070986 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 42/81] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:39:03.073437 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ad609f2b-3fb3-4ddd-920f-643b21a236b0 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1297 microversion: 2.1 time: 0.364992 Aug 25 12:39:03.119170 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 40/82] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:02 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1297 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:03.123605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dedc2113-14a7-453a-a7c9-e59ccfaf7d7e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:03.129330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dedc2113-14a7-453a-a7c9-e59ccfaf7d7e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:03.137579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-30a0a67e-f277-4740-b3a4-704677bd499d tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:03.172647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dedc2113-14a7-453a-a7c9-e59ccfaf7d7e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:03.177608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dedc2113-14a7-453a-a7c9-e59ccfaf7d7e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:03.181940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dedc2113-14a7-453a-a7c9-e59ccfaf7d7e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:03.185201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dedc2113-14a7-453a-a7c9-e59ccfaf7d7e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:03.188953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dedc2113-14a7-453a-a7c9-e59ccfaf7d7e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:03.191291 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-30a0a67e-f277-4740-b3a4-704677bd499d tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.059648 Aug 25 12:39:03.193881 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 41/83] 10.222.0.70 () {58 vars in 1182 bytes} [Thu Aug 25 12:39:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:03.202079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dedc2113-14a7-453a-a7c9-e59ccfaf7d7e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:03.235461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c82623d4-c80c-4c29-b1c0-48bf4046dbfa tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1560629105", "id": 1072377812, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:03.344854 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c82623d4-c80c-4c29-b1c0-48bf4046dbfa tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.140476 Aug 25 12:39:03.363898 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 42/84] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:39:03 2022] POST /compute/v2.1/flavors => generated 425 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:03.383459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f386623b-abc6-4ac9-a78d-353c0244d73b tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:03.431065 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f386623b-abc6-4ac9-a78d-353c0244d73b tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.064858 Aug 25 12:39:03.465671 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 43/85] 10.222.0.70 () {58 vars in 1182 bytes} [Thu Aug 25 12:39:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:04.985727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dedc2113-14a7-453a-a7c9-e59ccfaf7d7e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:05.031163 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dedc2113-14a7-453a-a7c9-e59ccfaf7d7e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 1.954210 Aug 25 12:39:05.032265 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 43/86] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:03 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:05.070555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc66be65-8283-401f-9e25-1670fca81934 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Action: 'create', calling method: .version_select at 0x7f3a2b26d940>, body: {"keypair": {"name": "tempest-keypair-989566953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0Nleuq1JiECgz5t79vae49iLfxUqFlldIFjRky/qsICw5XC0UqubdYcywvJvNTslglae1KtbSquftGjx/zYbWViM8+UWMDhCZeW8aRi8acUFPQ5+NBNoaOCAx90Fd3BQ=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:05.184579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cc66be65-8283-401f-9e25-1670fca81934 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Getting quotas for project 88e943f7025e4663a3f3e10ea5857a08. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:39:05.227662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cc66be65-8283-401f-9e25-1670fca81934 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Getting quotas for user 708d03828d2744c7a386caf96df69865 and project 88e943f7025e4663a3f3e10ea5857a08. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:39:05.271731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-387e1ba3-c034-48d4-99d7-73f5415b1356 tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:05.285575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387e1ba3-c034-48d4-99d7-73f5415b1356 tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:05.297758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387e1ba3-c034-48d4-99d7-73f5415b1356 tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:05.302693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387e1ba3-c034-48d4-99d7-73f5415b1356 tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:05.304812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387e1ba3-c034-48d4-99d7-73f5415b1356 tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:05.306246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387e1ba3-c034-48d4-99d7-73f5415b1356 tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:05.316776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387e1ba3-c034-48d4-99d7-73f5415b1356 tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:05.363780 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc66be65-8283-401f-9e25-1670fca81934 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.323395 Aug 25 12:39:05.372506 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 44/87] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:39:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:05.408799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d672f8d9-0d78-462a-8136-4368214b76ba tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:05.429615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d672f8d9-0d78-462a-8136-4368214b76ba tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:05.479141 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-387e1ba3-c034-48d4-99d7-73f5415b1356 tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 2.010988 Aug 25 12:39:05.481170 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 44/88] 10.222.0.70 () {58 vars in 1164 bytes} [Thu Aug 25 12:39:03 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:05.487504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d672f8d9-0d78-462a-8136-4368214b76ba tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:05.489647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d672f8d9-0d78-462a-8136-4368214b76ba tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:05.493195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d672f8d9-0d78-462a-8136-4368214b76ba tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:05.509073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d672f8d9-0d78-462a-8136-4368214b76ba tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:05.511047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d672f8d9-0d78-462a-8136-4368214b76ba tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:05.515082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d672f8d9-0d78-462a-8136-4368214b76ba tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:05.520190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f5f1eddc-58d6-437f-8b39-bf02759d901b tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:05.528675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5f1eddc-58d6-437f-8b39-bf02759d901b tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:05.532711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5f1eddc-58d6-437f-8b39-bf02759d901b tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:05.535780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5f1eddc-58d6-437f-8b39-bf02759d901b tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:05.537904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5f1eddc-58d6-437f-8b39-bf02759d901b tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:05.542003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5f1eddc-58d6-437f-8b39-bf02759d901b tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:05.545430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5f1eddc-58d6-437f-8b39-bf02759d901b tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:05.703660 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f5f1eddc-58d6-437f-8b39-bf02759d901b tempest-AZAdminV2TestJSON-1297400864 tempest-AZAdminV2TestJSON-1297400864-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.200907 Aug 25 12:39:05.711981 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 45/89] 10.222.0.70 () {58 vars in 1185 bytes} [Thu Aug 25 12:39:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:06.071558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b47e0a28-db6f-4f7f-b2c8-d82ae5e29b7d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:06.073059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b47e0a28-db6f-4f7f-b2c8-d82ae5e29b7d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:06.125888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b47e0a28-db6f-4f7f-b2c8-d82ae5e29b7d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:06.130684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b47e0a28-db6f-4f7f-b2c8-d82ae5e29b7d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:06.138592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b47e0a28-db6f-4f7f-b2c8-d82ae5e29b7d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:06.147216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b47e0a28-db6f-4f7f-b2c8-d82ae5e29b7d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:06.154800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b47e0a28-db6f-4f7f-b2c8-d82ae5e29b7d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:06.162730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b47e0a28-db6f-4f7f-b2c8-d82ae5e29b7d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:06.528112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d672f8d9-0d78-462a-8136-4368214b76ba tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:06.570094 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d672f8d9-0d78-462a-8136-4368214b76ba tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1297 microversion: 2.1 time: 1.193276 Aug 25 12:39:06.596164 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 45/90] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:05 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1297 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:07.627117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d05f328-3d7b-4fda-8b62-28b5a33afbc8 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:07.635444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d05f328-3d7b-4fda-8b62-28b5a33afbc8 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:07.704101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d05f328-3d7b-4fda-8b62-28b5a33afbc8 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:07.705608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d05f328-3d7b-4fda-8b62-28b5a33afbc8 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:07.706906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d05f328-3d7b-4fda-8b62-28b5a33afbc8 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:07.709369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d05f328-3d7b-4fda-8b62-28b5a33afbc8 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:07.710523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d05f328-3d7b-4fda-8b62-28b5a33afbc8 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:07.711489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d05f328-3d7b-4fda-8b62-28b5a33afbc8 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:08.566263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b47e0a28-db6f-4f7f-b2c8-d82ae5e29b7d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:08.616499 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b47e0a28-db6f-4f7f-b2c8-d82ae5e29b7d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 2.551832 Aug 25 12:39:08.621500 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 46/91] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:06 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 2558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:09.290532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8d05f328-3d7b-4fda-8b62-28b5a33afbc8 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:09.348564 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d05f328-3d7b-4fda-8b62-28b5a33afbc8 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 1.726839 Aug 25 12:39:09.350494 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 46/92] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:07 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:09.660526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-477dde3c-4e3b-47b4-afd2-8b904d01d5a8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:09.661734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-477dde3c-4e3b-47b4-afd2-8b904d01d5a8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:09.698864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-477dde3c-4e3b-47b4-afd2-8b904d01d5a8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:09.709989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-477dde3c-4e3b-47b4-afd2-8b904d01d5a8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:09.711050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-477dde3c-4e3b-47b4-afd2-8b904d01d5a8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:09.712487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-477dde3c-4e3b-47b4-afd2-8b904d01d5a8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:09.713653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-477dde3c-4e3b-47b4-afd2-8b904d01d5a8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:09.714522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-477dde3c-4e3b-47b4-afd2-8b904d01d5a8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:10.399439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f5936b17-a85d-401e-9203-ec0d71224f4e tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:10.408255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f5936b17-a85d-401e-9203-ec0d71224f4e tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:10.416632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=4,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:10.464101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5936b17-a85d-401e-9203-ec0d71224f4e tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:10.475930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5936b17-a85d-401e-9203-ec0d71224f4e tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:10.477859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5936b17-a85d-401e-9203-ec0d71224f4e tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:10.479744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5936b17-a85d-401e-9203-ec0d71224f4e tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:10.489388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5936b17-a85d-401e-9203-ec0d71224f4e tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:10.494615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5936b17-a85d-401e-9203-ec0d71224f4e tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:10.634480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:11.021736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-477dde3c-4e3b-47b4-afd2-8b904d01d5a8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:11.063573 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-477dde3c-4e3b-47b4-afd2-8b904d01d5a8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 1.398527 Aug 25 12:39:11.065857 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 47/93] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:09 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:11.317705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f5936b17-a85d-401e-9203-ec0d71224f4e tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:11.347006 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f5936b17-a85d-401e-9203-ec0d71224f4e tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 0.959205 Aug 25 12:39:11.368136 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 47/94] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:10 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:12.121662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8adc4233-b629-48a0-b9b4-262674af9eb8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:12.123054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8adc4233-b629-48a0-b9b4-262674af9eb8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:12.162607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8adc4233-b629-48a0-b9b4-262674af9eb8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:12.169821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8adc4233-b629-48a0-b9b4-262674af9eb8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:12.171738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8adc4233-b629-48a0-b9b4-262674af9eb8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:12.179910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8adc4233-b629-48a0-b9b4-262674af9eb8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:12.185059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8adc4233-b629-48a0-b9b4-262674af9eb8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:12.185964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8adc4233-b629-48a0-b9b4-262674af9eb8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:12.397078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7580b455-d5b7-438a-8d2c-06ea3b1e74bb tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:12.399311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7580b455-d5b7-438a-8d2c-06ea3b1e74bb tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:12.440739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7580b455-d5b7-438a-8d2c-06ea3b1e74bb tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:12.457206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7580b455-d5b7-438a-8d2c-06ea3b1e74bb tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:12.460936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7580b455-d5b7-438a-8d2c-06ea3b1e74bb tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:12.465753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7580b455-d5b7-438a-8d2c-06ea3b1e74bb tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:12.469217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7580b455-d5b7-438a-8d2c-06ea3b1e74bb tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:12.472081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7580b455-d5b7-438a-8d2c-06ea3b1e74bb tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:13.010790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:13.069734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8adc4233-b629-48a0-b9b4-262674af9eb8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:13.089141 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8adc4233-b629-48a0-b9b4-262674af9eb8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 0.986212 Aug 25 12:39:13.101096 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 48/95] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:12 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:13.347277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7580b455-d5b7-438a-8d2c-06ea3b1e74bb tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:13.400550 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7580b455-d5b7-438a-8d2c-06ea3b1e74bb tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 1.005024 Aug 25 12:39:13.411118 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 48/96] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:12 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:14.139588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-54f76c7a-8939-4bc3-b632-cba4a775c1ab tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:14.143874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-54f76c7a-8939-4bc3-b632-cba4a775c1ab tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:14.175802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54f76c7a-8939-4bc3-b632-cba4a775c1ab tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:14.177571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54f76c7a-8939-4bc3-b632-cba4a775c1ab tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:14.179368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54f76c7a-8939-4bc3-b632-cba4a775c1ab tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:14.181982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54f76c7a-8939-4bc3-b632-cba4a775c1ab tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:14.183553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54f76c7a-8939-4bc3-b632-cba4a775c1ab tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:14.184936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54f76c7a-8939-4bc3-b632-cba4a775c1ab tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:14.543179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1746899591", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:14.790463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-54f76c7a-8939-4bc3-b632-cba4a775c1ab tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:14.825853 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-54f76c7a-8939-4bc3-b632-cba4a775c1ab tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 0.696869 Aug 25 12:39:14.838726 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 49/97] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:14 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:14.852997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b8a45ca8-60c5-437e-b243-9dae542ef61d tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:14.871690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b8a45ca8-60c5-437e-b243-9dae542ef61d tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:14.883978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:39:14.906989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a45ca8-60c5-437e-b243-9dae542ef61d tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:14.912407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a45ca8-60c5-437e-b243-9dae542ef61d tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:14.914964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a45ca8-60c5-437e-b243-9dae542ef61d tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:14.917497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a45ca8-60c5-437e-b243-9dae542ef61d tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:14.919253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a45ca8-60c5-437e-b243-9dae542ef61d tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:14.925005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a45ca8-60c5-437e-b243-9dae542ef61d tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:15.263975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=12 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:15.584205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:15.828569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b8a45ca8-60c5-437e-b243-9dae542ef61d tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:15.879821 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b8a45ca8-60c5-437e-b243-9dae542ef61d tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 1.033690 Aug 25 12:39:15.894272 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 50/98] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:14 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:16.077346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:39:16.079086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:39:16.086479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:39:16.092684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:39:16.106607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:39:16.157829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=82,nova_api:DELETE=11 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:16.208782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:16.215786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:16.218980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:16.226812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:16.229772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:16.231390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:16.338505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Getting quotas for project 5fbf78e11dac4679a21657e9964aeb9c. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:39:16.362257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Getting quotas for user d40770814e0045ba9c5b2e621ca0f397 and project 5fbf78e11dac4679a21657e9964aeb9c. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:39:16.472805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:39:16.483327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:39:16.624076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1bc942c4-e420-49d2-9992-af11a098478a req-16265cf5-c482-4dfc-82a7-ab85cfb56a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e6e07f-4dab-45e8-af60-0efb39bc4c77", "tag": "b21fb9d1-2200-4ccf-839c-c6b7f5e41f32"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:16.693971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1bc942c4-e420-49d2-9992-af11a098478a req-16265cf5-c482-4dfc-82a7-ab85cfb56a59 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:16.694854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1bc942c4-e420-49d2-9992-af11a098478a req-16265cf5-c482-4dfc-82a7-ab85cfb56a59 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:16.701078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1bc942c4-e420-49d2-9992-af11a098478a req-16265cf5-c482-4dfc-82a7-ab85cfb56a59 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:16.747026 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1bc942c4-e420-49d2-9992-af11a098478a req-16265cf5-c482-4dfc-82a7-ab85cfb56a59 service nova] Creating event network-changed:b21fb9d1-2200-4ccf-839c-c6b7f5e41f32 for instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 on n-h2-852771-8 Aug 25 12:39:16.761024 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1bc942c4-e420-49d2-9992-af11a098478a req-16265cf5-c482-4dfc-82a7-ab85cfb56a59 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.864184 Aug 25 12:39:16.766353 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 51/99] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:16.781676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-55f25b82-1a25-4bdc-ab77-685674c5e27e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:16.784360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-55f25b82-1a25-4bdc-ab77-685674c5e27e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:16.799606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55f25b82-1a25-4bdc-ab77-685674c5e27e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:16.802095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55f25b82-1a25-4bdc-ab77-685674c5e27e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:16.803929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55f25b82-1a25-4bdc-ab77-685674c5e27e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:16.806386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55f25b82-1a25-4bdc-ab77-685674c5e27e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:16.808537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55f25b82-1a25-4bdc-ab77-685674c5e27e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:16.810095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55f25b82-1a25-4bdc-ab77-685674c5e27e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:16.844158 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bc25dc7e-23d5-492d-b393-b9eb5a785d98 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.007786 Aug 25 12:39:16.847631 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 49/100] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:39:17.561831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-55f25b82-1a25-4bdc-ab77-685674c5e27e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:17.604504 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-55f25b82-1a25-4bdc-ab77-685674c5e27e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 0.834802 Aug 25 12:39:17.605679 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 52/101] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:16 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:17.632014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3fccf698-348b-4f80-bee1-1b9408546663 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:17.633361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3fccf698-348b-4f80-bee1-1b9408546663 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:17.711644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-90acbcc7-5a0a-4a20-bbe9-be47dc8cc126 tempest-FlavorsV261TestJSON-1849092164 tempest-FlavorsV261TestJSON-1849092164-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-809645518", "id": 261173368, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:17.876231 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-90acbcc7-5a0a-4a20-bbe9-be47dc8cc126 tempest-FlavorsV261TestJSON-1849092164 tempest-FlavorsV261TestJSON-1849092164-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 1.019025 Aug 25 12:39:17.893001 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 50/102] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 12:39:16 2022] POST /compute/v2.1/flavors => generated 464 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:39:17.912679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0665c1ec-c068-43b7-a3ab-c2025befe016 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:17.916170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0665c1ec-c068-43b7-a3ab-c2025befe016 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:17.941104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0665c1ec-c068-43b7-a3ab-c2025befe016 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:17.950202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0665c1ec-c068-43b7-a3ab-c2025befe016 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:17.951935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0665c1ec-c068-43b7-a3ab-c2025befe016 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:17.956331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0665c1ec-c068-43b7-a3ab-c2025befe016 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:17.958273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3fccf698-348b-4f80-bee1-1b9408546663 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:17.959806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0665c1ec-c068-43b7-a3ab-c2025befe016 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:17.969630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0665c1ec-c068-43b7-a3ab-c2025befe016 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:17.979493 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3fccf698-348b-4f80-bee1-1b9408546663 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1219 microversion: 2.1 time: 0.363651 Aug 25 12:39:17.992554 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 53/103] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:17 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1219 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:18.654524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0665c1ec-c068-43b7-a3ab-c2025befe016 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:18.689608 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0665c1ec-c068-43b7-a3ab-c2025befe016 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 0.789000 Aug 25 12:39:18.703411 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 51/104] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:17 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:18.739152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-718b1c28-f82e-4863-9769-eb69bbe0f33f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:18.741387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-718b1c28-f82e-4863-9769-eb69bbe0f33f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:18.755917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-718b1c28-f82e-4863-9769-eb69bbe0f33f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:18.757754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-718b1c28-f82e-4863-9769-eb69bbe0f33f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:18.759337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-718b1c28-f82e-4863-9769-eb69bbe0f33f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:18.761339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-718b1c28-f82e-4863-9769-eb69bbe0f33f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:18.763067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-718b1c28-f82e-4863-9769-eb69bbe0f33f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:18.764486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-718b1c28-f82e-4863-9769-eb69bbe0f33f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:19.175363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be7742d1-717e-4115-9b49-6b64d50bd60a tempest-FlavorsV261TestJSON-1882115174 tempest-FlavorsV261TestJSON-1882115174-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:19.260922 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-be7742d1-717e-4115-9b49-6b64d50bd60a tempest-FlavorsV261TestJSON-1882115174 tempest-FlavorsV261TestJSON-1882115174-project] 10.222.0.70 "GET /compute/v2.1/flavors/261173368" status: 200 len: 464 microversion: 2.61 time: 1.259687 Aug 25 12:39:19.264706 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 54/105] 10.222.0.70 () {60 vars in 1196 bytes} [Thu Aug 25 12:39:17 2022] GET /compute/v2.1/flavors/261173368 => generated 464 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:39:19.303202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8936bc16-ff55-4798-aeaa-4c7e43a28b44 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:19.312578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8936bc16-ff55-4798-aeaa-4c7e43a28b44 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:19.376132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8936bc16-ff55-4798-aeaa-4c7e43a28b44 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:19.385206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8936bc16-ff55-4798-aeaa-4c7e43a28b44 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:19.388461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8936bc16-ff55-4798-aeaa-4c7e43a28b44 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:19.397612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8936bc16-ff55-4798-aeaa-4c7e43a28b44 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:19.406924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8936bc16-ff55-4798-aeaa-4c7e43a28b44 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:19.413800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-718b1c28-f82e-4863-9769-eb69bbe0f33f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:19.416790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8936bc16-ff55-4798-aeaa-4c7e43a28b44 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:19.443607 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-718b1c28-f82e-4863-9769-eb69bbe0f33f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 0.709957 Aug 25 12:39:19.467687 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 52/106] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:18 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:19.485047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d9b841b5-21d2-4dc3-a8ad-95328535eb27 tempest-FlavorsV261TestJSON-1849092164 tempest-FlavorsV261TestJSON-1849092164-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2c3ff0d0>, body: {"flavor": {"description": "new"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:19.623403 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d9b841b5-21d2-4dc3-a8ad-95328535eb27 tempest-FlavorsV261TestJSON-1849092164 tempest-FlavorsV261TestJSON-1849092164-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/261173368" status: 200 len: 465 microversion: 2.61 time: 0.151149 Aug 25 12:39:19.643435 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 53/107] 10.222.0.70 () {62 vars in 1216 bytes} [Thu Aug 25 12:39:19 2022] PUT /compute/v2.1/flavors/261173368 => generated 465 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:39:19.656913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f7862733-fd11-4e02-a1e0-a75a6e7e0abb tempest-FlavorsV261TestJSON-1882115174 tempest-FlavorsV261TestJSON-1882115174-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:19.816755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8936bc16-ff55-4798-aeaa-4c7e43a28b44 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:19.832912 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f7862733-fd11-4e02-a1e0-a75a6e7e0abb tempest-FlavorsV261TestJSON-1882115174 tempest-FlavorsV261TestJSON-1882115174-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.186255 Aug 25 12:39:19.851055 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 54/108] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 12:39:19 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:39:19.886106 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8936bc16-ff55-4798-aeaa-4c7e43a28b44 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1215 microversion: 2.1 time: 0.611953 Aug 25 12:39:19.892707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54771eb2-a6e5-4438-bb70-0b9b66be0a05 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:19.894989 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 55/109] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:19 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1215 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:19.904659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-54771eb2-a6e5-4438-bb70-0b9b66be0a05 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:19.919192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-25558b5a-8ac2-41a9-97e0-0356a4734ad3 tempest-FlavorsV261TestJSON-1882115174 tempest-FlavorsV261TestJSON-1882115174-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:19.946803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54771eb2-a6e5-4438-bb70-0b9b66be0a05 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:19.947726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54771eb2-a6e5-4438-bb70-0b9b66be0a05 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:19.948519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54771eb2-a6e5-4438-bb70-0b9b66be0a05 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:19.953409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54771eb2-a6e5-4438-bb70-0b9b66be0a05 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:19.954880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54771eb2-a6e5-4438-bb70-0b9b66be0a05 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:19.962671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54771eb2-a6e5-4438-bb70-0b9b66be0a05 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:20.046828 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-25558b5a-8ac2-41a9-97e0-0356a4734ad3 tempest-FlavorsV261TestJSON-1882115174 tempest-FlavorsV261TestJSON-1882115174-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.143952 Aug 25 12:39:20.052384 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 56/110] 10.222.0.70 () {60 vars in 1166 bytes} [Thu Aug 25 12:39:19 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:39:20.101500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d1d2beca-f035-4f6c-86ba-0a52184a6c1c tempest-FlavorsV261TestJSON-1849092164 tempest-FlavorsV261TestJSON-1849092164-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:20.294701 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d1d2beca-f035-4f6c-86ba-0a52184a6c1c tempest-FlavorsV261TestJSON-1849092164 tempest-FlavorsV261TestJSON-1849092164-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/261173368" status: 202 len: 0 microversion: 2.61 time: 0.195341 Aug 25 12:39:20.298245 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 57/111] 10.222.0.70 () {60 vars in 1199 bytes} [Thu Aug 25 12:39:20 2022] DELETE /compute/v2.1/flavors/261173368 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:39:20.778673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Calling method '.version_select at 0x7f3a2b1705e0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:20.803758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:20.812921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:20.822963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:20.923142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:20.925809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:20.929905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:20.987851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:20.989781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:20.992275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:21.026489 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f5991135-3009-45a9-bee1-ff7c0b8284e7 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.722967 Aug 25 12:39:21.039405 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 58/112] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:39:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:21.074285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54771eb2-a6e5-4438-bb70-0b9b66be0a05 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:21.079651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-16809ad1-c7c7-480c-8889-915ff5bb5cf9 tempest-FlavorsV261TestJSON-1849092164 tempest-FlavorsV261TestJSON-1849092164-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:21.096744 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-54771eb2-a6e5-4438-bb70-0b9b66be0a05 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 1.241525 Aug 25 12:39:21.105354 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 55/113] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:19 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:21.127192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aaa45542-f2d1-4997-ba3b-00b04071b532 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:21.133364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aaa45542-f2d1-4997-ba3b-00b04071b532 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:21.159470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aaa45542-f2d1-4997-ba3b-00b04071b532 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:21.160715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aaa45542-f2d1-4997-ba3b-00b04071b532 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:21.161889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aaa45542-f2d1-4997-ba3b-00b04071b532 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:21.166168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aaa45542-f2d1-4997-ba3b-00b04071b532 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:21.170256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aaa45542-f2d1-4997-ba3b-00b04071b532 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:21.179379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aaa45542-f2d1-4997-ba3b-00b04071b532 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:21.191181 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-16809ad1-c7c7-480c-8889-915ff5bb5cf9 tempest-FlavorsV261TestJSON-1849092164 tempest-FlavorsV261TestJSON-1849092164-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6701 microversion: 2.61 time: 0.147164 Aug 25 12:39:21.192766 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 59/114] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 12:39:21 2022] GET /compute/v2.1/flavors/detail => generated 6701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:39:21.222984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5cbb047c-553e-4f27-a91b-103b1b5a246c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:21.225413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5cbb047c-553e-4f27-a91b-103b1b5a246c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:21.259481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cbb047c-553e-4f27-a91b-103b1b5a246c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:21.261811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cbb047c-553e-4f27-a91b-103b1b5a246c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:21.265803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cbb047c-553e-4f27-a91b-103b1b5a246c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:21.272601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cbb047c-553e-4f27-a91b-103b1b5a246c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:21.278619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cbb047c-553e-4f27-a91b-103b1b5a246c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:21.280410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cbb047c-553e-4f27-a91b-103b1b5a246c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:21.575100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5cbb047c-553e-4f27-a91b-103b1b5a246c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:21.602743 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5cbb047c-553e-4f27-a91b-103b1b5a246c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1289 microversion: 2.1 time: 0.403911 Aug 25 12:39:21.617779 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 60/115] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:21 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1289 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:21.646857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-940370155", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "1072377812", "adminPass": "***", "networks": [{"uuid": "d19abbf3-705b-4ea7-8f5f-7ac9cbebbe87"}], "security_groups": [{"name": "tempest-securitygroup--1950138099"}], "key_name": "tempest-keypair-989566953", "user_data": "}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:22.267087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aaa45542-f2d1-4997-ba3b-00b04071b532 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:22.294524 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aaa45542-f2d1-4997-ba3b-00b04071b532 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 1.187238 Aug 25 12:39:22.317549 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 56/116] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:21 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:22.317549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Calling method '.version_select at 0x7f3a2b0a6430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:22.344770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),638d90be-ffdb-4b61-b94a-775c50a724be(cell1) {{(pid=129059) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 25 12:39:22.346951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:22.348034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:22.348975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:22.409809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:22.411254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:22.412168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:22.490083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] validate_networks() for [('d19abbf3-705b-4ea7-8f5f-7ac9cbebbe87', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:39:22.533219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:22.534142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:22.534999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:22.553291 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-877bf0b1-7b11-4ecd-a7da-8d7791204e55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h2-852771-8/servers" status: 200 len: 196 microversion: 2.1 time: 0.248361 Aug 25 12:39:22.554435 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 57/117] 10.222.0.70 () {58 vars in 1212 bytes} [Thu Aug 25 12:39:22 2022] GET /compute/v2.1/os-hypervisors/n-h2-852771-8/servers => generated 196 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:22.581646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0887403-0c74-4e60-a71f-e2e06efd33e7 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:22.585919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b0887403-0c74-4e60-a71f-e2e06efd33e7 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:22.602284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0887403-0c74-4e60-a71f-e2e06efd33e7 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:22.603148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0887403-0c74-4e60-a71f-e2e06efd33e7 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:22.604228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0887403-0c74-4e60-a71f-e2e06efd33e7 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:22.606125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0887403-0c74-4e60-a71f-e2e06efd33e7 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:22.606951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0887403-0c74-4e60-a71f-e2e06efd33e7 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:22.607703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0887403-0c74-4e60-a71f-e2e06efd33e7 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:23.291114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b0887403-0c74-4e60-a71f-e2e06efd33e7 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:23.320094 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b0887403-0c74-4e60-a71f-e2e06efd33e7 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 0.763727 Aug 25 12:39:23.321092 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 58/118] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:22 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:23.329588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Calling method '.version_select at 0x7f3a2b047e50>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:23.352467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:23.353606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:23.354429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:23.426104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:23.430028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:23.431214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:23.488339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:23.489226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:23.490339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:23.514890 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-21521b22-48f2-4353-ad30-36a3f8e5af18 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.191796 Aug 25 12:39:23.516897 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 59/119] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:39:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:23.524559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0f494284-160f-426f-90ff-f2347fff3590 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:23.526109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0f494284-160f-426f-90ff-f2347fff3590 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:23.550580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f494284-160f-426f-90ff-f2347fff3590 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:23.551518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f494284-160f-426f-90ff-f2347fff3590 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:23.554643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f494284-160f-426f-90ff-f2347fff3590 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:23.556696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f494284-160f-426f-90ff-f2347fff3590 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:23.558830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f494284-160f-426f-90ff-f2347fff3590 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:23.559974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f494284-160f-426f-90ff-f2347fff3590 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:23.776366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0f494284-160f-426f-90ff-f2347fff3590 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:23.807425 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0f494284-160f-426f-90ff-f2347fff3590 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1277 microversion: 2.1 time: 0.288111 Aug 25 12:39:23.808637 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 60/120] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:23 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1277 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:23.821643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-955a6b59-8888-4fc0-ab10-42c2cc1e2225 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:23.823106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-955a6b59-8888-4fc0-ab10-42c2cc1e2225 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:23.839154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-955a6b59-8888-4fc0-ab10-42c2cc1e2225 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:23.840471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-955a6b59-8888-4fc0-ab10-42c2cc1e2225 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:23.841948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-955a6b59-8888-4fc0-ab10-42c2cc1e2225 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:23.846160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-955a6b59-8888-4fc0-ab10-42c2cc1e2225 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:23.849269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-955a6b59-8888-4fc0-ab10-42c2cc1e2225 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:23.850741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-955a6b59-8888-4fc0-ab10-42c2cc1e2225 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:24.583057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-955a6b59-8888-4fc0-ab10-42c2cc1e2225 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:24.605410 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-955a6b59-8888-4fc0-ab10-42c2cc1e2225 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 0.794484 Aug 25 12:39:24.606976 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 61/121] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:23 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:24.897765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:39:24.898665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:39:24.899766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:39:24.900600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:39:24.901345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:39:24.922545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:24.923323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:24.924588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:24.926585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:24.927413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:24.928224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:24.984331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Getting quotas for project 88e943f7025e4663a3f3e10ea5857a08. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:39:24.994789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Getting quotas for user 708d03828d2744c7a386caf96df69865 and project 88e943f7025e4663a3f3e10ea5857a08. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:39:25.021614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:39:25.027417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:39:25.142976 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-853bd86f-db1b-4b08-b455-888705e8aa34 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.524067 Aug 25 12:39:25.142976 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 61/122] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:39:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 3527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:39:25.153004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-56ba1b9c-878f-4a1e-aacb-32e52ee8df55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Calling method '.version_select at 0x7f3a2b1bec10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:25.157850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56ba1b9c-878f-4a1e-aacb-32e52ee8df55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:25.159119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56ba1b9c-878f-4a1e-aacb-32e52ee8df55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:25.160206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56ba1b9c-878f-4a1e-aacb-32e52ee8df55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:25.164568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-823eae64-343a-4b0a-ba1c-7425f2d7b551 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1239447384", "ram": 512, "vcpus": 1, "disk": 10, "id": 1472351083, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:25.206391 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-823eae64-343a-4b0a-ba1c-7425f2d7b551 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.596817 Aug 25 12:39:25.208395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56ba1b9c-878f-4a1e-aacb-32e52ee8df55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:25.209419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56ba1b9c-878f-4a1e-aacb-32e52ee8df55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:25.210362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56ba1b9c-878f-4a1e-aacb-32e52ee8df55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:25.217748 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 62/123] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:39:24 2022] POST /compute/v2.1/flavors => generated 416 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:25.224556 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-56ba1b9c-878f-4a1e-aacb-32e52ee8df55 tempest-HypervisorAdminUnderV252Test-1951333067 tempest-HypervisorAdminUnderV252Test-1951333067-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h2-852771-8/search" status: 200 len: 104 microversion: 2.1 time: 0.079069 Aug 25 12:39:25.225865 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 62/124] 10.222.0.70 () {58 vars in 1209 bytes} [Thu Aug 25 12:39:25 2022] GET /compute/v2.1/os-hypervisors/n-h2-852771-8/search => generated 104 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:25.244725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a104ce45-1b9e-4620-9acf-4c816cff8202 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:25.246341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a104ce45-1b9e-4620-9acf-4c816cff8202 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:25.257935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a104ce45-1b9e-4620-9acf-4c816cff8202 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:25.258758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a104ce45-1b9e-4620-9acf-4c816cff8202 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:25.259827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a104ce45-1b9e-4620-9acf-4c816cff8202 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:25.262657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a104ce45-1b9e-4620-9acf-4c816cff8202 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:25.264018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a104ce45-1b9e-4620-9acf-4c816cff8202 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:25.265082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a104ce45-1b9e-4620-9acf-4c816cff8202 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:25.482033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-022ed4f6-26d6-45c7-8f4a-ddcf6512bd4f req-76149aa9-83a0-4a77-9379-42094e267d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd", "name": "network-vif-plugged", "status": "completed", "tag": "db57f661-a705-45c2-bfb7-3d957fb6747a"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:25.519874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-022ed4f6-26d6-45c7-8f4a-ddcf6512bd4f req-76149aa9-83a0-4a77-9379-42094e267d4c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:25.521054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-022ed4f6-26d6-45c7-8f4a-ddcf6512bd4f req-76149aa9-83a0-4a77-9379-42094e267d4c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:25.527351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-022ed4f6-26d6-45c7-8f4a-ddcf6512bd4f req-76149aa9-83a0-4a77-9379-42094e267d4c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:25.559232 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-022ed4f6-26d6-45c7-8f4a-ddcf6512bd4f req-76149aa9-83a0-4a77-9379-42094e267d4c service nova] Creating event network-vif-plugged:db57f661-a705-45c2-bfb7-3d957fb6747a for instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd on n-h1-852771-8 Aug 25 12:39:25.571047 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-022ed4f6-26d6-45c7-8f4a-ddcf6512bd4f req-76149aa9-83a0-4a77-9379-42094e267d4c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.342350 Aug 25 12:39:25.574526 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 63/125] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:25.594647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a521b67-642e-40b3-8a26-0de058957d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:25.596462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7a521b67-642e-40b3-8a26-0de058957d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:25.620825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a521b67-642e-40b3-8a26-0de058957d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:25.624767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a521b67-642e-40b3-8a26-0de058957d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:25.626165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a521b67-642e-40b3-8a26-0de058957d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:25.631672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a521b67-642e-40b3-8a26-0de058957d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:25.636212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a521b67-642e-40b3-8a26-0de058957d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:25.647145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a521b67-642e-40b3-8a26-0de058957d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:26.103339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a104ce45-1b9e-4620-9acf-4c816cff8202 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:26.159056 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a104ce45-1b9e-4620-9acf-4c816cff8202 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 0.936449 Aug 25 12:39:26.174147 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 63/126] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:25 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:26.201949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee5958ef-0a74-4ce0-8d4c-6977a8459170 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:26.203194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee5958ef-0a74-4ce0-8d4c-6977a8459170 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:26.284734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:26.426963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:26.606744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ee5958ef-0a74-4ce0-8d4c-6977a8459170 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:26.633989 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee5958ef-0a74-4ce0-8d4c-6977a8459170 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1263 microversion: 2.1 time: 0.457099 Aug 25 12:39:26.635513 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 64/127] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:26 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1263 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:26.663299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e879777b-8873-4a98-bca5-aea7546cbc36 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:26.759263 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e879777b-8873-4a98-bca5-aea7546cbc36 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1472351083/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.121922 Aug 25 12:39:26.762789 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 65/128] 10.222.0.70 () {60 vars in 1224 bytes} [Thu Aug 25 12:39:26 2022] POST /compute/v2.1/flavors/1472351083/os-extra_specs => generated 66 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:26.773804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2d7d8d23-9b9a-439f-a659-a670c1050899 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:26.775501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2d7d8d23-9b9a-439f-a659-a670c1050899 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:26.792136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2d7d8d23-9b9a-439f-a659-a670c1050899 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:26.793650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2d7d8d23-9b9a-439f-a659-a670c1050899 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:26.795658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2d7d8d23-9b9a-439f-a659-a670c1050899 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:26.797455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2d7d8d23-9b9a-439f-a659-a670c1050899 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:26.798356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2d7d8d23-9b9a-439f-a659-a670c1050899 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:26.802104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2d7d8d23-9b9a-439f-a659-a670c1050899 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:26.879172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7a521b67-642e-40b3-8a26-0de058957d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:26.915065 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a521b67-642e-40b3-8a26-0de058957d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1319 microversion: 2.1 time: 1.335925 Aug 25 12:39:26.922351 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 64/129] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:25 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1319 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:27.837085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2d7d8d23-9b9a-439f-a659-a670c1050899 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:27.866199 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2d7d8d23-9b9a-439f-a659-a670c1050899 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1319 microversion: 2.1 time: 1.101120 Aug 25 12:39:27.885987 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 66/130] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:26 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1319 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:27.885987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-17198d28-78fc-4f91-84dc-fc5c7fbe0ab4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:27.885987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-17198d28-78fc-4f91-84dc-fc5c7fbe0ab4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:27.886601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85138b76-22e4-46ff-9ccf-fd7bf648780d tempest-FlavorsExtraSpecsTestJSON-594801548 tempest-FlavorsExtraSpecsTestJSON-594801548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:27.894781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17198d28-78fc-4f91-84dc-fc5c7fbe0ab4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:27.896144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17198d28-78fc-4f91-84dc-fc5c7fbe0ab4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:27.897194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17198d28-78fc-4f91-84dc-fc5c7fbe0ab4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:27.898797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17198d28-78fc-4f91-84dc-fc5c7fbe0ab4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:27.899943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17198d28-78fc-4f91-84dc-fc5c7fbe0ab4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:27.900944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17198d28-78fc-4f91-84dc-fc5c7fbe0ab4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:27.936860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:27.970295 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85138b76-22e4-46ff-9ccf-fd7bf648780d tempest-FlavorsExtraSpecsTestJSON-594801548 tempest-FlavorsExtraSpecsTestJSON-594801548-project] 10.222.0.70 "GET /compute/v2.1/flavors/1472351083/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 1.044074 Aug 25 12:39:27.981975 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 65/131] 10.222.0.70 () {58 vars in 1203 bytes} [Thu Aug 25 12:39:26 2022] GET /compute/v2.1/flavors/1472351083/os-extra_specs => generated 66 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:27.996937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-80b78621-5640-4db4-82e7-1c057d36a952 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:27.998592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-80b78621-5640-4db4-82e7-1c057d36a952 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:28.023390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b78621-5640-4db4-82e7-1c057d36a952 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:28.023390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b78621-5640-4db4-82e7-1c057d36a952 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:28.028059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b78621-5640-4db4-82e7-1c057d36a952 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:28.045269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b78621-5640-4db4-82e7-1c057d36a952 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:28.047833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b78621-5640-4db4-82e7-1c057d36a952 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:28.048623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b78621-5640-4db4-82e7-1c057d36a952 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:29.081678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-80b78621-5640-4db4-82e7-1c057d36a952 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:29.125053 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-80b78621-5640-4db4-82e7-1c057d36a952 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1337 microversion: 2.1 time: 1.140307 Aug 25 12:39:29.131313 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 66/132] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:27 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1337 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:29.150326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-05cf3e4a-f86b-4017-8d6f-2645b76ad8af tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:29.163302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-05cf3e4a-f86b-4017-8d6f-2645b76ad8af tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:29.183185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05cf3e4a-f86b-4017-8d6f-2645b76ad8af tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:29.184456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05cf3e4a-f86b-4017-8d6f-2645b76ad8af tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:29.186062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05cf3e4a-f86b-4017-8d6f-2645b76ad8af tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:29.189459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05cf3e4a-f86b-4017-8d6f-2645b76ad8af tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:29.190905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05cf3e4a-f86b-4017-8d6f-2645b76ad8af tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:29.192111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05cf3e4a-f86b-4017-8d6f-2645b76ad8af tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:29.566005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-17198d28-78fc-4f91-84dc-fc5c7fbe0ab4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:29.586205 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-17198d28-78fc-4f91-84dc-fc5c7fbe0ab4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 1.711884 Aug 25 12:39:29.587823 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 67/133] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:27 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:29.629902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e38f78bc-60d2-4c76-a0e0-e4141995b1f2 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:29.712238 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e38f78bc-60d2-4c76-a0e0-e4141995b1f2 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1472351083/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.104000 Aug 25 12:39:29.713824 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 68/134] 10.222.0.70 () {60 vars in 1224 bytes} [Thu Aug 25 12:39:29 2022] POST /compute/v2.1/flavors/1472351083/os-extra_specs => generated 66 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:29.733995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cfd08245-2e22-4c26-9308-aecf84eefeed tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:29.735475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cfd08245-2e22-4c26-9308-aecf84eefeed tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:29.759289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd08245-2e22-4c26-9308-aecf84eefeed tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:29.760447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd08245-2e22-4c26-9308-aecf84eefeed tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:29.762828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd08245-2e22-4c26-9308-aecf84eefeed tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:29.767858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd08245-2e22-4c26-9308-aecf84eefeed tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:29.769011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd08245-2e22-4c26-9308-aecf84eefeed tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:29.771615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd08245-2e22-4c26-9308-aecf84eefeed tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:29.919741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-05cf3e4a-f86b-4017-8d6f-2645b76ad8af tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:29.957161 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-05cf3e4a-f86b-4017-8d6f-2645b76ad8af tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1319 microversion: 2.1 time: 0.823708 Aug 25 12:39:29.959094 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 67/135] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:29 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1319 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:29.993991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4661f3a1-adc0-44bc-8855-5cb70041df76 req-9a0edf71-0537-4851-9808-8a66a2b972ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4818dfd-d48d-49e5-9f45-50ac516e6953", "tag": "71a8cbf9-6c9f-4173-bdd6-ac5255e58f2e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:30.020368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4661f3a1-adc0-44bc-8855-5cb70041df76 req-9a0edf71-0537-4851-9808-8a66a2b972ba service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:30.021976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4661f3a1-adc0-44bc-8855-5cb70041df76 req-9a0edf71-0537-4851-9808-8a66a2b972ba service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:30.023166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4661f3a1-adc0-44bc-8855-5cb70041df76 req-9a0edf71-0537-4851-9808-8a66a2b972ba service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:30.054148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:30.066124 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4661f3a1-adc0-44bc-8855-5cb70041df76 req-9a0edf71-0537-4851-9808-8a66a2b972ba service nova] Creating event network-changed:71a8cbf9-6c9f-4173-bdd6-ac5255e58f2e for instance a4818dfd-d48d-49e5-9f45-50ac516e6953 on n-h1-852771-8 Aug 25 12:39:30.078209 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4661f3a1-adc0-44bc-8855-5cb70041df76 req-9a0edf71-0537-4851-9808-8a66a2b972ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110351 Aug 25 12:39:30.079694 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 68/136] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:30.086910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-154d0a8e-f564-41fe-b85f-5cedb2309b16 tempest-FlavorsExtraSpecsTestJSON-594801548 tempest-FlavorsExtraSpecsTestJSON-594801548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:30.109691 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-154d0a8e-f564-41fe-b85f-5cedb2309b16 tempest-FlavorsExtraSpecsTestJSON-594801548 tempest-FlavorsExtraSpecsTestJSON-594801548-project] 10.222.0.70 "GET /compute/v2.1/flavors/1472351083/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.026999 Aug 25 12:39:30.120903 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 69/137] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 12:39:30 2022] GET /compute/v2.1/flavors/1472351083/os-extra_specs/hw:numa_nodes => generated 22 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:30.149796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c69969f3-84d1-4712-9668-357f9f86baf9 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:30.219109 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c69969f3-84d1-4712-9668-357f9f86baf9 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1472351083/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.095340 Aug 25 12:39:30.232712 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 70/138] 10.222.0.70 () {60 vars in 1224 bytes} [Thu Aug 25 12:39:30 2022] POST /compute/v2.1/flavors/1472351083/os-extra_specs => generated 66 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:30.245299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f5d98c6b-d751-41b3-a1b1-791fa8b32347 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:30.247296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f5d98c6b-d751-41b3-a1b1-791fa8b32347 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:30.275073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5d98c6b-d751-41b3-a1b1-791fa8b32347 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:30.276547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5d98c6b-d751-41b3-a1b1-791fa8b32347 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:30.279403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5d98c6b-d751-41b3-a1b1-791fa8b32347 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:30.282414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5d98c6b-d751-41b3-a1b1-791fa8b32347 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:30.286217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5d98c6b-d751-41b3-a1b1-791fa8b32347 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:30.287755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5d98c6b-d751-41b3-a1b1-791fa8b32347 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:30.359384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cfd08245-2e22-4c26-9308-aecf84eefeed tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:30.386463 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cfd08245-2e22-4c26-9308-aecf84eefeed tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1469 microversion: 2.1 time: 0.668444 Aug 25 12:39:30.387517 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 69/139] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:29 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1469 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:30.417693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21411cd8-ba67-4afd-b74f-69af8cde8085 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:30.443967 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-21411cd8-ba67-4afd-b74f-69af8cde8085 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1472351083/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043491 Aug 25 12:39:30.461142 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 70/140] 10.222.0.70 () {58 vars in 1203 bytes} [Thu Aug 25 12:39:30 2022] GET /compute/v2.1/flavors/1472351083/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:30.592194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f5d98c6b-d751-41b3-a1b1-791fa8b32347 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:30.616108 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f5d98c6b-d751-41b3-a1b1-791fa8b32347 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1343 microversion: 2.1 time: 0.381030 Aug 25 12:39:30.617419 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 71/141] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:30 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1343 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:30.637263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f3b2ef0b-1ce6-4041-a55d-f936751c14f9 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:30.739904 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f3b2ef0b-1ce6-4041-a55d-f936751c14f9 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1472351083/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.112350 Aug 25 12:39:30.741582 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 72/142] 10.222.0.70 () {60 vars in 1265 bytes} [Thu Aug 25 12:39:30 2022] PUT /compute/v2.1/flavors/1472351083/os-extra_specs/hw:numa_nodes => generated 22 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:30.965685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Calling method '.version_select at 0x7f3a2b442310>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:30.980431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:30.984505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:30.987865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.048097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:31.048973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:31.049792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.053061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:31.054039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:31.075999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:31.075999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:31.077038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.082202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:31.092114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:31.092569 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4915d9a8-25ae-4e03-b919-e0dc0b0f8bd7 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.348452 Aug 25 12:39:31.093442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.094584 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 73/143] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 12:39:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:39:31.097027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:31.098040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:31.104281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.107583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ae46fdf-0184-419b-9812-1a6960717542 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:31.109179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8ae46fdf-0184-419b-9812-1a6960717542 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:31.124992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae46fdf-0184-419b-9812-1a6960717542 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:31.126400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae46fdf-0184-419b-9812-1a6960717542 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:31.128228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae46fdf-0184-419b-9812-1a6960717542 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.130370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae46fdf-0184-419b-9812-1a6960717542 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:31.131683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae46fdf-0184-419b-9812-1a6960717542 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:31.132798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae46fdf-0184-419b-9812-1a6960717542 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.435789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:39:31.654838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8ae46fdf-0184-419b-9812-1a6960717542 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:31.691009 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8ae46fdf-0184-419b-9812-1a6960717542 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 0.593486 Aug 25 12:39:31.711243 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 74/144] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:31 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:31.729133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1d265e10-40c7-456e-a7f8-f849c1d075cd tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:31.747034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:31.756798 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1d265e10-40c7-456e-a7f8-f849c1d075cd tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1472351083/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039170 Aug 25 12:39:31.758661 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 75/145] 10.222.0.70 () {58 vars in 1203 bytes} [Thu Aug 25 12:39:31 2022] GET /compute/v2.1/flavors/1472351083/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:31.776760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f975ccc-b226-4976-8481-63751a8014d8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:31.785006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7f975ccc-b226-4976-8481-63751a8014d8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:31.825926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f975ccc-b226-4976-8481-63751a8014d8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:31.826948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f975ccc-b226-4976-8481-63751a8014d8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:31.827700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f975ccc-b226-4976-8481-63751a8014d8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.836850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f975ccc-b226-4976-8481-63751a8014d8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:31.839254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f975ccc-b226-4976-8481-63751a8014d8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:31.840063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f975ccc-b226-4976-8481-63751a8014d8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.876630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:39:31.878113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ac3c583-04b5-4248-9e91-ce175f45cee8 tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:39:31.880277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-129fb5f2-fe28-40c4-996e-5070655c1b2c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:31.881040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-129fb5f2-fe28-40c4-996e-5070655c1b2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:31.882820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-129fb5f2-fe28-40c4-996e-5070655c1b2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.884437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-129fb5f2-fe28-40c4-996e-5070655c1b2c None None] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:31.888011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-129fb5f2-fe28-40c4-996e-5070655c1b2c None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:31.889115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-129fb5f2-fe28-40c4-996e-5070655c1b2c None None] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:31.934617 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.compute.rpcapi [None req-129fb5f2-fe28-40c4-996e-5070655c1b2c None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 25 12:39:31.936905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-129fb5f2-fe28-40c4-996e-5070655c1b2c None None] Releasing lock "compute-rpcapi-router" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:39:32.084925 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-129fb5f2-fe28-40c4-996e-5070655c1b2c None None] 10.222.0.70 "DELETE /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 204 len: 0 microversion: 2.1 time: 1.620950 Aug 25 12:39:32.087097 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 71/146] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:39:30 2022] DELETE /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 0 bytes in 1625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:39:32.102685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4502c50b-c4f8-4241-abcc-606540a112d3 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Calling method '.version_select at 0x7f3a2afc09d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:32.119783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4502c50b-c4f8-4241-abcc-606540a112d3 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.120581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4502c50b-c4f8-4241-abcc-606540a112d3 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.121398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4502c50b-c4f8-4241-abcc-606540a112d3 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.170955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4502c50b-c4f8-4241-abcc-606540a112d3 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.171939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4502c50b-c4f8-4241-abcc-606540a112d3 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.172914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4502c50b-c4f8-4241-abcc-606540a112d3 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.188049 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4502c50b-c4f8-4241-abcc-606540a112d3 tempest-HypervisorAdminV228Test-781494214 tempest-HypervisorAdminV228Test-781494214-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.098390 Aug 25 12:39:32.200465 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 72/147] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Aug 25 12:39:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:39:32.222285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0a912a61-2f54-47bd-b755-74c69a68c036 req-6b100a87-0eda-47c1-8e40-8c1c4299ddd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e6e07f-4dab-45e8-af60-0efb39bc4c77", "name": "network-vif-plugged", "status": "completed", "tag": "b21fb9d1-2200-4ccf-839c-c6b7f5e41f32"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:32.245890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:32.277861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0a912a61-2f54-47bd-b755-74c69a68c036 req-6b100a87-0eda-47c1-8e40-8c1c4299ddd2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.279127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0a912a61-2f54-47bd-b755-74c69a68c036 req-6b100a87-0eda-47c1-8e40-8c1c4299ddd2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.279932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0a912a61-2f54-47bd-b755-74c69a68c036 req-6b100a87-0eda-47c1-8e40-8c1c4299ddd2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.309476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7f975ccc-b226-4976-8481-63751a8014d8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:32.352072 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7f975ccc-b226-4976-8481-63751a8014d8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1319 microversion: 2.1 time: 0.583919 Aug 25 12:39:32.353656 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 76/148] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:31 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1319 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:32.385113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f310ade-d2f6-4f03-9f51-c3633873b2e1 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:32.386834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f310ade-d2f6-4f03-9f51-c3633873b2e1 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:32.411030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f310ade-d2f6-4f03-9f51-c3633873b2e1 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.417877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f310ade-d2f6-4f03-9f51-c3633873b2e1 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.419144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f310ade-d2f6-4f03-9f51-c3633873b2e1 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.420796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f310ade-d2f6-4f03-9f51-c3633873b2e1 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.425244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f310ade-d2f6-4f03-9f51-c3633873b2e1 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.426745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f310ade-d2f6-4f03-9f51-c3633873b2e1 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.723171 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-0a912a61-2f54-47bd-b755-74c69a68c036 req-6b100a87-0eda-47c1-8e40-8c1c4299ddd2 service nova] Creating event network-vif-plugged:b21fb9d1-2200-4ccf-839c-c6b7f5e41f32 for instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 on n-h2-852771-8 Aug 25 12:39:32.737350 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0a912a61-2f54-47bd-b755-74c69a68c036 req-6b100a87-0eda-47c1-8e40-8c1c4299ddd2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.533573 Aug 25 12:39:32.743726 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 73/149] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:32.763627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bb183919-70fa-4da0-b9a3-be42d7c28bd6 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:32.844443 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bb183919-70fa-4da0-b9a3-be42d7c28bd6 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1472351083/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.093134 Aug 25 12:39:32.849927 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 74/150] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 12:39:32 2022] DELETE /compute/v2.1/flavors/1472351083/os-extra_specs/hw:numa_nodes => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:39:32.869347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7c85879b-fe6e-47a5-8f3f-0f7622267667 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:32.873771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7c85879b-fe6e-47a5-8f3f-0f7622267667 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:32.878566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f310ade-d2f6-4f03-9f51-c3633873b2e1 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:32.894377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c85879b-fe6e-47a5-8f3f-0f7622267667 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.895546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c85879b-fe6e-47a5-8f3f-0f7622267667 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.896689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c85879b-fe6e-47a5-8f3f-0f7622267667 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.898201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c85879b-fe6e-47a5-8f3f-0f7622267667 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.899203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c85879b-fe6e-47a5-8f3f-0f7622267667 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.900082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c85879b-fe6e-47a5-8f3f-0f7622267667 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.903272 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f310ade-d2f6-4f03-9f51-c3633873b2e1 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1411 microversion: 2.1 time: 0.546984 Aug 25 12:39:32.905975 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 77/151] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:32 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1411 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:32.916989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f51ffe34-4443-43d3-99f0-5786411c9f4c tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:32.921898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f51ffe34-4443-43d3-99f0-5786411c9f4c tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:32.936502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51ffe34-4443-43d3-99f0-5786411c9f4c tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.937906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51ffe34-4443-43d3-99f0-5786411c9f4c tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.941274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51ffe34-4443-43d3-99f0-5786411c9f4c tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.943111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51ffe34-4443-43d3-99f0-5786411c9f4c tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.945295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51ffe34-4443-43d3-99f0-5786411c9f4c tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.946956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51ffe34-4443-43d3-99f0-5786411c9f4c tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:33.537079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f51ffe34-4443-43d3-99f0-5786411c9f4c tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:33.566459 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f51ffe34-4443-43d3-99f0-5786411c9f4c tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 0.656137 Aug 25 12:39:33.567510 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 78/152] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:32 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:33.584695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7c85879b-fe6e-47a5-8f3f-0f7622267667 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:33.606758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-deedad11-02ba-4bd0-ae42-55f9cfbe74e3 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:33.617545 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7c85879b-fe6e-47a5-8f3f-0f7622267667 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1475 microversion: 2.1 time: 0.769293 Aug 25 12:39:33.624985 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 75/153] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:32 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1475 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:33.657184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7ecbbc68-e561-4b29-bd2d-e6c6eeb092da tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:33.661666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7ecbbc68-e561-4b29-bd2d-e6c6eeb092da tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:33.693500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ecbbc68-e561-4b29-bd2d-e6c6eeb092da tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:33.696717 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-deedad11-02ba-4bd0-ae42-55f9cfbe74e3 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1472351083/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.123400 Aug 25 12:39:33.699238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ecbbc68-e561-4b29-bd2d-e6c6eeb092da tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:33.704905 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 79/154] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 12:39:33 2022] DELETE /compute/v2.1/flavors/1472351083/os-extra_specs/hw:cpu_policy => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:39:33.710679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ecbbc68-e561-4b29-bd2d-e6c6eeb092da tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:33.712003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ecbbc68-e561-4b29-bd2d-e6c6eeb092da tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:33.712838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ecbbc68-e561-4b29-bd2d-e6c6eeb092da tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:33.713919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ecbbc68-e561-4b29-bd2d-e6c6eeb092da tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:33.721655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f7f4b704-09b8-4bbf-a75a-228e41386819 req-84c2d5ea-8abf-40c4-862f-ef197f475579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1", "tag": "9e1842f8-5750-448c-bb6f-eecb481a2c29"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:33.749098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f7f4b704-09b8-4bbf-a75a-228e41386819 req-84c2d5ea-8abf-40c4-862f-ef197f475579 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:33.750786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f7f4b704-09b8-4bbf-a75a-228e41386819 req-84c2d5ea-8abf-40c4-862f-ef197f475579 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:33.752670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f7f4b704-09b8-4bbf-a75a-228e41386819 req-84c2d5ea-8abf-40c4-862f-ef197f475579 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:33.781013 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f7f4b704-09b8-4bbf-a75a-228e41386819 req-84c2d5ea-8abf-40c4-862f-ef197f475579 service nova] Creating event network-changed:9e1842f8-5750-448c-bb6f-eecb481a2c29 for instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 on n-h2-852771-8 Aug 25 12:39:33.794096 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f7f4b704-09b8-4bbf-a75a-228e41386819 req-84c2d5ea-8abf-40c4-862f-ef197f475579 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082312 Aug 25 12:39:33.797396 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 80/155] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:33.818487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-af5bde40-62e1-499a-b640-ffc13475ec8b tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:33.841619 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-af5bde40-62e1-499a-b640-ffc13475ec8b tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1472351083/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.038763 Aug 25 12:39:33.855467 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 81/156] 10.222.0.70 () {58 vars in 1203 bytes} [Thu Aug 25 12:39:33 2022] GET /compute/v2.1/flavors/1472351083/os-extra_specs => generated 19 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:33.870623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9a4e08c-3970-484f-baec-0cdd63b263a6 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:33.928332 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9a4e08c-3970-484f-baec-0cdd63b263a6 tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1472351083" status: 202 len: 0 microversion: 2.1 time: 0.068909 Aug 25 12:39:33.930073 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 82/157] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:39:33 2022] DELETE /compute/v2.1/flavors/1472351083 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:39:33.946305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-848e27b6-fb6c-40b2-aec2-b704245952ab tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:34.014895 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-848e27b6-fb6c-40b2-aec2-b704245952ab tempest-FlavorsExtraSpecsTestJSON-125214642 tempest-FlavorsExtraSpecsTestJSON-125214642-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.077735 Aug 25 12:39:34.018004 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 83/158] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:39:33 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:34.029835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-71e904d5-2d09-4f9e-9454-82ec009f0486 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:34.031175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-71e904d5-2d09-4f9e-9454-82ec009f0486 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:34.060662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71e904d5-2d09-4f9e-9454-82ec009f0486 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:34.069707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71e904d5-2d09-4f9e-9454-82ec009f0486 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:34.070589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71e904d5-2d09-4f9e-9454-82ec009f0486 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:34.072399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71e904d5-2d09-4f9e-9454-82ec009f0486 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:34.073656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71e904d5-2d09-4f9e-9454-82ec009f0486 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:34.075523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71e904d5-2d09-4f9e-9454-82ec009f0486 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:34.480904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7ecbbc68-e561-4b29-bd2d-e6c6eeb092da tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:34.514970 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7ecbbc68-e561-4b29-bd2d-e6c6eeb092da tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1319 microversion: 2.1 time: 0.880569 Aug 25 12:39:34.524050 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 76/159] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:33 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1319 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:34.612059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-adeefe0d-e411-4ac9-b7a0-d8446795fa91 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:34.617687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-adeefe0d-e411-4ac9-b7a0-d8446795fa91 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:34.647753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adeefe0d-e411-4ac9-b7a0-d8446795fa91 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:34.652181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adeefe0d-e411-4ac9-b7a0-d8446795fa91 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:34.676541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adeefe0d-e411-4ac9-b7a0-d8446795fa91 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:34.679154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-71e904d5-2d09-4f9e-9454-82ec009f0486 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:34.681435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adeefe0d-e411-4ac9-b7a0-d8446795fa91 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:34.687767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adeefe0d-e411-4ac9-b7a0-d8446795fa91 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:34.690280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adeefe0d-e411-4ac9-b7a0-d8446795fa91 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:34.700689 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-71e904d5-2d09-4f9e-9454-82ec009f0486 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1411 microversion: 2.1 time: 0.681828 Aug 25 12:39:34.710490 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 84/160] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:34 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1411 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:34.739292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-db37ba1a-7d02-4c9b-b196-65598a498298 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:34.746173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-db37ba1a-7d02-4c9b-b196-65598a498298 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:34.777373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db37ba1a-7d02-4c9b-b196-65598a498298 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:34.778313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db37ba1a-7d02-4c9b-b196-65598a498298 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:34.784728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db37ba1a-7d02-4c9b-b196-65598a498298 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:34.787671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db37ba1a-7d02-4c9b-b196-65598a498298 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:34.794188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db37ba1a-7d02-4c9b-b196-65598a498298 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:34.795320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db37ba1a-7d02-4c9b-b196-65598a498298 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:34.948422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:35.008943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:35.442850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-adeefe0d-e411-4ac9-b7a0-d8446795fa91 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:35.466946 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-adeefe0d-e411-4ac9-b7a0-d8446795fa91 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1339 microversion: 2.1 time: 0.863466 Aug 25 12:39:35.480840 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 77/161] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:34 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1339 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:35.557553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25c6b885-6133-403e-809c-b2d0374c0d55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:35.559284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-25c6b885-6133-403e-809c-b2d0374c0d55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:35.576398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c6b885-6133-403e-809c-b2d0374c0d55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:35.578175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c6b885-6133-403e-809c-b2d0374c0d55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:35.579404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c6b885-6133-403e-809c-b2d0374c0d55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:35.581752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c6b885-6133-403e-809c-b2d0374c0d55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:35.587837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c6b885-6133-403e-809c-b2d0374c0d55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:35.589262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c6b885-6133-403e-809c-b2d0374c0d55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:35.828286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-db37ba1a-7d02-4c9b-b196-65598a498298 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:35.860775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-db37ba1a-7d02-4c9b-b196-65598a498298 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1475 microversion: 2.1 time: 1.147637 Aug 25 12:39:35.891188 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 85/162] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:34 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1475 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:35.915755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66cc6c06-4382-4f62-9cdf-70234f5d306e tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:35.928581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66cc6c06-4382-4f62-9cdf-70234f5d306e tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:35.966504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66cc6c06-4382-4f62-9cdf-70234f5d306e tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:35.967288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66cc6c06-4382-4f62-9cdf-70234f5d306e tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:35.968048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66cc6c06-4382-4f62-9cdf-70234f5d306e tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:35.969573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66cc6c06-4382-4f62-9cdf-70234f5d306e tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:35.989037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66cc6c06-4382-4f62-9cdf-70234f5d306e tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:35.989874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66cc6c06-4382-4f62-9cdf-70234f5d306e tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:36.617644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:36.746126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-25c6b885-6133-403e-809c-b2d0374c0d55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:36.779077 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-25c6b885-6133-403e-809c-b2d0374c0d55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1319 microversion: 2.1 time: 1.231953 Aug 25 12:39:36.784893 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 78/163] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:35 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1319 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:36.797771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ac1ebbb-beb7-4fe1-8673-6da28e6157cc tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:36.801188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ac1ebbb-beb7-4fe1-8673-6da28e6157cc tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:36.825160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac1ebbb-beb7-4fe1-8673-6da28e6157cc tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:36.827023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac1ebbb-beb7-4fe1-8673-6da28e6157cc tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:36.831162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac1ebbb-beb7-4fe1-8673-6da28e6157cc tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:36.833491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac1ebbb-beb7-4fe1-8673-6da28e6157cc tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:36.837342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac1ebbb-beb7-4fe1-8673-6da28e6157cc tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:36.840219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac1ebbb-beb7-4fe1-8673-6da28e6157cc tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:36.872712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-66cc6c06-4382-4f62-9cdf-70234f5d306e tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:36.892366 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66cc6c06-4382-4f62-9cdf-70234f5d306e tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1411 microversion: 2.1 time: 0.997532 Aug 25 12:39:36.905855 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 86/164] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:35 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1411 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:36.941348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6fe53d4b-8edf-43b9-9f94-25ce869308a9 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:36.942869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6fe53d4b-8edf-43b9-9f94-25ce869308a9 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:36.991572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fe53d4b-8edf-43b9-9f94-25ce869308a9 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:36.995870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fe53d4b-8edf-43b9-9f94-25ce869308a9 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:36.997052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fe53d4b-8edf-43b9-9f94-25ce869308a9 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:37.002233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fe53d4b-8edf-43b9-9f94-25ce869308a9 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:37.007414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fe53d4b-8edf-43b9-9f94-25ce869308a9 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:37.009932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fe53d4b-8edf-43b9-9f94-25ce869308a9 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:37.299910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6fe53d4b-8edf-43b9-9f94-25ce869308a9 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:37.329155 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6fe53d4b-8edf-43b9-9f94-25ce869308a9 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 200 len: 1433 microversion: 2.1 time: 0.399529 Aug 25 12:39:37.331778 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 87/165] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:36 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 1433 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:37.342665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f6cc489f-596c-465c-a8d8-a80c12c69e66 req-702dfdb2-9dd5-43b4-b562-3c91cb65892b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd", "name": "network-vif-deleted", "tag": "db57f661-a705-45c2-bfb7-3d957fb6747a"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:37.363654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f6cc489f-596c-465c-a8d8-a80c12c69e66 req-702dfdb2-9dd5-43b4-b562-3c91cb65892b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:37.364749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f6cc489f-596c-465c-a8d8-a80c12c69e66 req-702dfdb2-9dd5-43b4-b562-3c91cb65892b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:37.365728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f6cc489f-596c-465c-a8d8-a80c12c69e66 req-702dfdb2-9dd5-43b4-b562-3c91cb65892b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:37.392347 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f6cc489f-596c-465c-a8d8-a80c12c69e66 req-702dfdb2-9dd5-43b4-b562-3c91cb65892b service nova] Creating event network-vif-deleted:db57f661-a705-45c2-bfb7-3d957fb6747a for instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd on n-h1-852771-8 Aug 25 12:39:37.405769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1ac1ebbb-beb7-4fe1-8673-6da28e6157cc tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:37.413732 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f6cc489f-596c-465c-a8d8-a80c12c69e66 req-702dfdb2-9dd5-43b4-b562-3c91cb65892b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078948 Aug 25 12:39:37.415035 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 88/166] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:37.425816 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ac1ebbb-beb7-4fe1-8673-6da28e6157cc tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1489 microversion: 2.1 time: 0.637109 Aug 25 12:39:37.437546 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 79/167] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:36 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1489 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:37.504923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6993d34d-d790-48ce-a145-be3cc7a03cf3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:37.508003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6993d34d-d790-48ce-a145-be3cc7a03cf3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:37.535281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6993d34d-d790-48ce-a145-be3cc7a03cf3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:37.537659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6993d34d-d790-48ce-a145-be3cc7a03cf3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:37.538632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6993d34d-d790-48ce-a145-be3cc7a03cf3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:37.540865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6993d34d-d790-48ce-a145-be3cc7a03cf3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:37.541920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6993d34d-d790-48ce-a145-be3cc7a03cf3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:37.542954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6993d34d-d790-48ce-a145-be3cc7a03cf3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:37.954487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Calling method '.version_select at 0x7f3a2b1be4c0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:37.960065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:37.961347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:37.962513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:37.996875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:37.998148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:38.000174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:38.028254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:38.032560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:38.035072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:38.072207 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3880c7a-0a0a-408b-8cc7-1f3e1b9702a7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.654211 Aug 25 12:39:38.074220 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 89/168] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:39:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:38.092149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6af8405d-e4ce-4748-bd6a-9908a3a0993d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:38.093966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6af8405d-e4ce-4748-bd6a-9908a3a0993d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:38.108492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6af8405d-e4ce-4748-bd6a-9908a3a0993d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:38.109655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6af8405d-e4ce-4748-bd6a-9908a3a0993d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:38.110459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6af8405d-e4ce-4748-bd6a-9908a3a0993d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:38.113564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6af8405d-e4ce-4748-bd6a-9908a3a0993d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:38.130766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6af8405d-e4ce-4748-bd6a-9908a3a0993d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:38.131745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6af8405d-e4ce-4748-bd6a-9908a3a0993d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:38.624431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6af8405d-e4ce-4748-bd6a-9908a3a0993d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:38.657284 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6af8405d-e4ce-4748-bd6a-9908a3a0993d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1319 microversion: 2.1 time: 0.577065 Aug 25 12:39:38.659490 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 90/169] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:38 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1319 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:38.707359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eaa3b494-3034-4542-806b-c069155147c3 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:38.711028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eaa3b494-3034-4542-806b-c069155147c3 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:38.741021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa3b494-3034-4542-806b-c069155147c3 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:38.742307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa3b494-3034-4542-806b-c069155147c3 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:38.742973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa3b494-3034-4542-806b-c069155147c3 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:38.744057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa3b494-3034-4542-806b-c069155147c3 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:38.744896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa3b494-3034-4542-806b-c069155147c3 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:38.745732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa3b494-3034-4542-806b-c069155147c3 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.059163 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6993d34d-d790-48ce-a145-be3cc7a03cf3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1640 microversion: 2.1 time: 1.586891 Aug 25 12:39:39.074404 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 80/170] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:37 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1640 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:39.183335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eaa3b494-3034-4542-806b-c069155147c3 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:39.201486 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eaa3b494-3034-4542-806b-c069155147c3 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1411 microversion: 2.1 time: 0.519892 Aug 25 12:39:39.202707 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 91/171] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:38 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1411 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:39.213690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:39.215503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:39.243149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.243740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.244455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.245997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.247219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.248080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.291802 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] HTTP exception thrown: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Request method failure captured: Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd HTTP/1.1 Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB20-tKWaEqYR1ofLWZ8fPXA3qLf7wxe8IA_O_mjTKoWX6fJSDV6ycqwtoqStHstaaxRu3ZxDUf0Mkwe8o75RjVWIE8O3EGWjyc2t_j-f6aKC9lnRlT2bRw9D1oQu3f-_Y-3iXzFGSQ80Ejz4Ub2rkj58J7_jRnnObCOauzV1AQo62Gg Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:39:39.296940 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f82cd279ba8840649f015c8c26589fab", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}] Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d2458b3cda9c4335a143357ade484548 Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:39:39.299432 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd'} Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:39.300480 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:39:39.302141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:39.307552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Returning 404 to user: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:39.309392 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a41845f-6091-4ba7-aad9-32069d7051aa tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 404 len: 111 microversion: 2.1 time: 0.103879 Aug 25 12:39:39.310872 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 92/172] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:39 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:39.319754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-069cb92f-3216-44bb-90fe-f11f98593b8b req-da8e4c7d-87f9-4b99-baf8-67b060e2a732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4818dfd-d48d-49e5-9f45-50ac516e6953", "name": "network-vif-plugged", "status": "completed", "tag": "71a8cbf9-6c9f-4173-bdd6-ac5255e58f2e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:39.335868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-069cb92f-3216-44bb-90fe-f11f98593b8b req-da8e4c7d-87f9-4b99-baf8-67b060e2a732 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.336711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-069cb92f-3216-44bb-90fe-f11f98593b8b req-da8e4c7d-87f9-4b99-baf8-67b060e2a732 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.337432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-069cb92f-3216-44bb-90fe-f11f98593b8b req-da8e4c7d-87f9-4b99-baf8-67b060e2a732 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.369247 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-069cb92f-3216-44bb-90fe-f11f98593b8b req-da8e4c7d-87f9-4b99-baf8-67b060e2a732 service nova] Creating event network-vif-plugged:71a8cbf9-6c9f-4173-bdd6-ac5255e58f2e for instance a4818dfd-d48d-49e5-9f45-50ac516e6953 on n-h1-852771-8 Aug 25 12:39:39.384001 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-069cb92f-3216-44bb-90fe-f11f98593b8b req-da8e4c7d-87f9-4b99-baf8-67b060e2a732 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070354 Aug 25 12:39:39.388567 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 93/173] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:39.404013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8c108416-d452-44ae-86f6-a3c48d4c06e3 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:39.405971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8c108416-d452-44ae-86f6-a3c48d4c06e3 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:39.426536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c108416-d452-44ae-86f6-a3c48d4c06e3 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.427666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c108416-d452-44ae-86f6-a3c48d4c06e3 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.429148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c108416-d452-44ae-86f6-a3c48d4c06e3 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.431071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c108416-d452-44ae-86f6-a3c48d4c06e3 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.432248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c108416-d452-44ae-86f6-a3c48d4c06e3 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.433268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c108416-d452-44ae-86f6-a3c48d4c06e3 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.510262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8c108416-d452-44ae-86f6-a3c48d4c06e3 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:39:39.735883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:39.866864 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8c108416-d452-44ae-86f6-a3c48d4c06e3 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "DELETE /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 204 len: 0 microversion: 2.1 time: 0.474420 Aug 25 12:39:39.873443 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 94/174] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:39:39 2022] DELETE /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:39:39.882145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-28fe4b51-63bb-4c2b-bf2d-d0c5f1a36131 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:39.883931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-28fe4b51-63bb-4c2b-bf2d-d0c5f1a36131 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:39.895487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-42a25dff-5dc9-4841-a608-facfe0491178 tempest-HypervisorAdminNegativeUnderV252Test-1806280015 tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project] Calling method '.version_select at 0x7f3a2b01f4c0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:39.904139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-42a25dff-5dc9-4841-a608-facfe0491178 tempest-HypervisorAdminNegativeUnderV252Test-1806280015 tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1ecff91bf8d44ff88e8cf896ab59edb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36050b377042739957d31c4b9bcfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:39.905397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fe4b51-63bb-4c2b-bf2d-d0c5f1a36131 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.906459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fe4b51-63bb-4c2b-bf2d-d0c5f1a36131 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.910113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fe4b51-63bb-4c2b-bf2d-d0c5f1a36131 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.911792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fe4b51-63bb-4c2b-bf2d-d0c5f1a36131 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.913023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fe4b51-63bb-4c2b-bf2d-d0c5f1a36131 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.914025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fe4b51-63bb-4c2b-bf2d-d0c5f1a36131 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-42a25dff-5dc9-4841-a608-facfe0491178 tempest-HypervisorAdminNegativeUnderV252Test-1806280015 tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project] Request method failure captured: Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hypervisors/n-h2-852771-8/search HTTP/1.1 Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB22FKA5spW3Vk9c7boBIFflymxsO6O25xKeCAWRoD89yTezPEJ5VNALrts8nVUklIWmBs2DzQfGPZs83e10sYJSNdV0_QNbycxwyc6VHzaq-jLGgtyH1XB7Vb95FSn36NqD8eNEKgqLAI-Ptsdz5Unk7Ly6vgGh844GrVhce0XoD9bg Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: cc36050b377042739957d31c4b9bcfab Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1806280015 Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:39:39.914223 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc36050b377042739957d31c4b9bcfab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc36050b377042739957d31c4b9bcfab", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc36050b377042739957d31c4b9bcfab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc36050b377042739957d31c4b9bcfab"}]}] Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1806280015 Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: cc36050b377042739957d31c4b9bcfab Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1806280015 Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1ecff91bf8d44ff88e8cf896ab59edb9 Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 25 12:39:39.917134 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'n-h2-852771-8'} Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:39:39.919390 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 25 12:39:39.925008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:39.933544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-42a25dff-5dc9-4841-a608-facfe0491178 tempest-HypervisorAdminNegativeUnderV252Test-1806280015 tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:39.933544 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-42a25dff-5dc9-4841-a608-facfe0491178 tempest-HypervisorAdminNegativeUnderV252Test-1806280015 tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h2-852771-8/search" status: 403 len: 117 microversion: 2.1 time: 0.871400 Aug 25 12:39:39.935113 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 81/175] 10.222.0.70 () {58 vars in 1209 bytes} [Thu Aug 25 12:39:39 2022] GET /compute/v2.1/os-hypervisors/n-h2-852771-8/search => generated 117 bytes in 874 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:39.954218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3da3fc16-b87c-4c6e-a519-e4bb84e667fd tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:39.954218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3da3fc16-b87c-4c6e-a519-e4bb84e667fd tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:39.967992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3da3fc16-b87c-4c6e-a519-e4bb84e667fd tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.968982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3da3fc16-b87c-4c6e-a519-e4bb84e667fd tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.969754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3da3fc16-b87c-4c6e-a519-e4bb84e667fd tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.972136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3da3fc16-b87c-4c6e-a519-e4bb84e667fd tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.972832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3da3fc16-b87c-4c6e-a519-e4bb84e667fd tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.973466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3da3fc16-b87c-4c6e-a519-e4bb84e667fd tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:40.402224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-28fe4b51-63bb-4c2b-bf2d-d0c5f1a36131 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:40.414315 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-28fe4b51-63bb-4c2b-bf2d-d0c5f1a36131 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1319 microversion: 2.1 time: 0.543537 Aug 25 12:39:40.416130 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 95/176] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:39 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:40.427780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6526b4d4-fc18-4b13-9cfc-597feadff6b7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Calling method '.version_select at 0x7f3a2b07e550>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:40.432373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6526b4d4-fc18-4b13-9cfc-597feadff6b7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:40.433725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6526b4d4-fc18-4b13-9cfc-597feadff6b7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:40.434760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6526b4d4-fc18-4b13-9cfc-597feadff6b7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:40.445669 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-6526b4d4-fc18-4b13-9cfc-597feadff6b7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6526b4d4-fc18-4b13-9cfc-597feadff6b7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Request method failure captured: Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB22IR0SrWEzuk27beYhTiwauZVXdDsYC15unjjz3Bm1WBspgQjwhOJuvGXXfLAaxKCkGoJC5JFEs3GD3Uk9dBcHZx9VjHpfHD2lGvlsGG-PxTsklMnfjFcTNrsa30DgVqHst9i4m6caI30TnHLKJFx_YQOIT_2gu7ZyTzgMze2usrmU Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 12d28a364913435c90e9f1862a5c3cf8 Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1569306891 Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:39:40.449345 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/12d28a364913435c90e9f1862a5c3cf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_12d28a364913435c90e9f1862a5c3cf8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/12d28a364913435c90e9f1862a5c3cf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/12d28a364913435c90e9f1862a5c3cf8"}]}] Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1569306891 Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 12d28a364913435c90e9f1862a5c3cf8 Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1569306891 Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 145b15548d404aa7859378aaa2361e28 Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 25 12:39:40.451185 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:40.452223 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:40.455846 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:40.455846 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:40.455846 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:40.455846 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 25 12:39:40.455846 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:40.458578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3da3fc16-b87c-4c6e-a519-e4bb84e667fd tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:40.459255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6526b4d4-fc18-4b13-9cfc-597feadff6b7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:40.460570 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6526b4d4-fc18-4b13-9cfc-597feadff6b7 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.042375 Aug 25 12:39:40.461692 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 96/177] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 12:39:40 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:40.473152 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3da3fc16-b87c-4c6e-a519-e4bb84e667fd tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1495 microversion: 2.1 time: 0.535861 Aug 25 12:39:40.474310 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 82/178] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:39 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1495 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:40.475559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-11152185", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:40.489767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21cd5da0-537d-4aeb-b30c-509b4fd6d963 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:40.491508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-21cd5da0-537d-4aeb-b30c-509b4fd6d963 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:40.532247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21cd5da0-537d-4aeb-b30c-509b4fd6d963 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:40.533389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21cd5da0-537d-4aeb-b30c-509b4fd6d963 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:40.534257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21cd5da0-537d-4aeb-b30c-509b4fd6d963 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:40.540201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21cd5da0-537d-4aeb-b30c-509b4fd6d963 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:40.541111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21cd5da0-537d-4aeb-b30c-509b4fd6d963 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:40.541982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21cd5da0-537d-4aeb-b30c-509b4fd6d963 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:40.835920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:39:40.984747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-21cd5da0-537d-4aeb-b30c-509b4fd6d963 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:41.040505 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-21cd5da0-537d-4aeb-b30c-509b4fd6d963 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1411 microversion: 2.1 time: 0.563945 Aug 25 12:39:41.041680 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 83/179] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:40 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1411 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:41.065317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Calling method '.version_select at 0x7f3a2b0c6d30>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:41.073361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:41.074249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:41.075056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:41.126548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:41.128266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:41.135896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:41.199495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:41.202999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:41.204344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:41.240146 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87b14361-dc02-40f0-bfac-d9ef9d87f13c tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.193113 Aug 25 12:39:41.254665 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 84/180] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:39:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:41.266359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02babca6-262d-4eb9-ab12-b5fb86f628c9 tempest-HypervisorAdminNegativeUnderV252Test-1806280015 tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project] Calling method '.version_select at 0x7f3a2b01f700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:41.273355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-02babca6-262d-4eb9-ab12-b5fb86f628c9 tempest-HypervisorAdminNegativeUnderV252Test-1806280015 tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1ecff91bf8d44ff88e8cf896ab59edb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36050b377042739957d31c4b9bcfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02babca6-262d-4eb9-ab12-b5fb86f628c9 tempest-HypervisorAdminNegativeUnderV252Test-1806280015 tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project] Request method failure captured: Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB22FKA5spW3Vk9c7boBIFflymxsO6O25xKeCAWRoD89yTezPEJ5VNALrts8nVUklIWmBs2DzQfGPZs83e10sYJSNdV0_QNbycxwyc6VHzaq-jLGgtyH1XB7Vb95FSn36NqD8eNEKgqLAI-Ptsdz5Unk7Ly6vgGh844GrVhce0XoD9bg Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: cc36050b377042739957d31c4b9bcfab Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1806280015 Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:39:41.278181 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc36050b377042739957d31c4b9bcfab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc36050b377042739957d31c4b9bcfab", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc36050b377042739957d31c4b9bcfab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc36050b377042739957d31c4b9bcfab"}]}] Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1806280015 Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: cc36050b377042739957d31c4b9bcfab Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1806280015 Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1ecff91bf8d44ff88e8cf896ab59edb9 Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 25 12:39:41.281056 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '1'} Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:39:41.282478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 25 12:39:41.286619 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:41.294629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02babca6-262d-4eb9-ab12-b5fb86f628c9 tempest-HypervisorAdminNegativeUnderV252Test-1806280015 tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:41.296784 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-02babca6-262d-4eb9-ab12-b5fb86f628c9 tempest-HypervisorAdminNegativeUnderV252Test-1806280015 tempest-HypervisorAdminNegativeUnderV252Test-1806280015-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.040083 Aug 25 12:39:41.300248 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 85/181] 10.222.0.70 () {58 vars in 1176 bytes} [Thu Aug 25 12:39:41 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:41.318819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f1f88f35-3acc-4c1c-a88d-0758b86e23b5 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Calling method '.version_select at 0x7f3a2c011af0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:41.324076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1f88f35-3acc-4c1c-a88d-0758b86e23b5 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:41.325464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1f88f35-3acc-4c1c-a88d-0758b86e23b5 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:41.327671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1f88f35-3acc-4c1c-a88d-0758b86e23b5 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:41.348854 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-f1f88f35-3acc-4c1c-a88d-0758b86e23b5 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] HTTP exception thrown: No hypervisor matching 'aeadcded-dfc4-4184-9f31-600ba670186e' could be found. Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f1f88f35-3acc-4c1c-a88d-0758b86e23b5 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Request method failure captured: Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hypervisors/aeadcded-dfc4-4184-9f31-600ba670186e/servers HTTP/1.1 Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB22IR0SrWEzuk27beYhTiwauZVXdDsYC15unjjz3Bm1WBspgQjwhOJuvGXXfLAaxKCkGoJC5JFEs3GD3Uk9dBcHZx9VjHpfHD2lGvlsGG-PxTsklMnfjFcTNrsa30DgVqHst9i4m6caI30TnHLKJFx_YQOIT_2gu7ZyTzgMze2usrmU Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 12d28a364913435c90e9f1862a5c3cf8 Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1569306891 Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:39:41.352475 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/12d28a364913435c90e9f1862a5c3cf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_12d28a364913435c90e9f1862a5c3cf8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/12d28a364913435c90e9f1862a5c3cf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/12d28a364913435c90e9f1862a5c3cf8"}]}] Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1569306891 Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 12d28a364913435c90e9f1862a5c3cf8 Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1569306891 Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 145b15548d404aa7859378aaa2361e28 Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: exception: No hypervisor matching 'aeadcded-dfc4-4184-9f31-600ba670186e' could be found. Aug 25 12:39:41.354964 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'aeadcded-dfc4-4184-9f31-600ba670186e'} Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'aeadcded-dfc4-4184-9f31-600ba670186e' could be found. Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:41.356468 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:41.358781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:41.358781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:41.358781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:41.358781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:41.358781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'aeadcded-dfc4-4184-9f31-600ba670186e' could be found. Aug 25 12:39:41.358781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:41.366544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f1f88f35-3acc-4c1c-a88d-0758b86e23b5 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] Returning 404 to user: No hypervisor matching 'aeadcded-dfc4-4184-9f31-600ba670186e' could be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:41.369043 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f1f88f35-3acc-4c1c-a88d-0758b86e23b5 tempest-HypervisorAdminNegativeUnderV252Test-1569306891 tempest-HypervisorAdminNegativeUnderV252Test-1569306891-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/aeadcded-dfc4-4184-9f31-600ba670186e/servers" status: 404 len: 123 microversion: 2.1 time: 0.061030 Aug 25 12:39:41.371167 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 86/182] 10.222.0.70 () {58 vars in 1281 bytes} [Thu Aug 25 12:39:41 2022] GET /compute/v2.1/os-hypervisors/aeadcded-dfc4-4184-9f31-600ba670186e/servers => generated 123 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:41.460348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72d39788-425f-424d-924b-051004d824b1 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:41.470308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-72d39788-425f-424d-924b-051004d824b1 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:41.499919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72d39788-425f-424d-924b-051004d824b1 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:41.501126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72d39788-425f-424d-924b-051004d824b1 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:41.508619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72d39788-425f-424d-924b-051004d824b1 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:41.510621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72d39788-425f-424d-924b-051004d824b1 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:41.512291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72d39788-425f-424d-924b-051004d824b1 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:41.513357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72d39788-425f-424d-924b-051004d824b1 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:41.803630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:39:41.804493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:39:41.805322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:39:41.808497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:39:41.809434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:39:41.869201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:41.870776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:41.871693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:41.876053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:41.893698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:41.895139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:41.930160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:41.975693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Getting quotas for project f82cd279ba8840649f015c8c26589fab. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:39:41.985142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Getting quotas for user d2458b3cda9c4335a143357ade484548 and project f82cd279ba8840649f015c8c26589fab. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:39:42.039992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:39:42.047764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:39:42.201354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-72d39788-425f-424d-924b-051004d824b1 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:42.227311 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72d39788-425f-424d-924b-051004d824b1 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1319 microversion: 2.1 time: 0.777004 Aug 25 12:39:42.238071 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 87/183] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:41 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1319 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:39:42.255344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7d9c7b65-dd47-4d27-9903-03d467e95e52 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:42.260732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7d9c7b65-dd47-4d27-9903-03d467e95e52 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:42.293022 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9ffd2092-6f66-47f7-babc-82fcf83b3bec tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.827417 Aug 25 12:39:42.294523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d9c7b65-dd47-4d27-9903-03d467e95e52 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:42.295723 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 97/184] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:39:42.307738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d9c7b65-dd47-4d27-9903-03d467e95e52 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:42.315026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d9c7b65-dd47-4d27-9903-03d467e95e52 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:42.320320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0d2b4280-2153-4cce-8302-8e1b1d07a9e7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:42.321639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d9c7b65-dd47-4d27-9903-03d467e95e52 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:42.325251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0d2b4280-2153-4cce-8302-8e1b1d07a9e7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:42.325893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d9c7b65-dd47-4d27-9903-03d467e95e52 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:42.328326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d9c7b65-dd47-4d27-9903-03d467e95e52 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:42.368667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d2b4280-2153-4cce-8302-8e1b1d07a9e7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:42.372989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d2b4280-2153-4cce-8302-8e1b1d07a9e7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:42.376748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d2b4280-2153-4cce-8302-8e1b1d07a9e7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:42.379014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d2b4280-2153-4cce-8302-8e1b1d07a9e7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:42.382475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d2b4280-2153-4cce-8302-8e1b1d07a9e7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:42.398106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d2b4280-2153-4cce-8302-8e1b1d07a9e7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:43.110915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7d9c7b65-dd47-4d27-9903-03d467e95e52 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:43.117197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:43.164787 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7d9c7b65-dd47-4d27-9903-03d467e95e52 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1495 microversion: 2.1 time: 0.921322 Aug 25 12:39:43.168030 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 88/185] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:42 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1495 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:43.177840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-351ac4d0-5d01-4b17-9942-96cab00e0a8b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:43.190420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-351ac4d0-5d01-4b17-9942-96cab00e0a8b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:43.405821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-351ac4d0-5d01-4b17-9942-96cab00e0a8b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:43.442346 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-351ac4d0-5d01-4b17-9942-96cab00e0a8b tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1218 microversion: 2.1 time: 0.271094 Aug 25 12:39:43.448204 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 89/186] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:43 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1218 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:43.467566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3ff9aaf-7df6-4a65-afdc-ad16e09f5e0f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:43.472953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c3ff9aaf-7df6-4a65-afdc-ad16e09f5e0f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:43.505762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ff9aaf-7df6-4a65-afdc-ad16e09f5e0f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:43.506687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ff9aaf-7df6-4a65-afdc-ad16e09f5e0f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:43.507508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ff9aaf-7df6-4a65-afdc-ad16e09f5e0f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:43.518729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ff9aaf-7df6-4a65-afdc-ad16e09f5e0f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:43.520000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ff9aaf-7df6-4a65-afdc-ad16e09f5e0f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:43.521118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ff9aaf-7df6-4a65-afdc-ad16e09f5e0f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:43.569768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0d2b4280-2153-4cce-8302-8e1b1d07a9e7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:43.613974 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0d2b4280-2153-4cce-8302-8e1b1d07a9e7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1411 microversion: 2.1 time: 1.308925 Aug 25 12:39:43.617394 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 98/187] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:42 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1411 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:44.206075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fe354978-0b2e-42ed-8173-45c472a7962a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:44.209428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fe354978-0b2e-42ed-8173-45c472a7962a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:44.274371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe354978-0b2e-42ed-8173-45c472a7962a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:44.278677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe354978-0b2e-42ed-8173-45c472a7962a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:44.283347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe354978-0b2e-42ed-8173-45c472a7962a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:44.286825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe354978-0b2e-42ed-8173-45c472a7962a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:44.298691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe354978-0b2e-42ed-8173-45c472a7962a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:44.306190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe354978-0b2e-42ed-8173-45c472a7962a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:44.609277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3ff9aaf-7df6-4a65-afdc-ad16e09f5e0f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:44.647316 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3ff9aaf-7df6-4a65-afdc-ad16e09f5e0f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1468 microversion: 2.1 time: 1.190869 Aug 25 12:39:44.648661 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 90/188] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:43 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1468 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:44.673278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-97fcc8e5-6377-436a-85b6-962eba9929a8 req-51e33392-2083-429e-80a1-d664062fd9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e6e07f-4dab-45e8-af60-0efb39bc4c77", "name": "network-vif-deleted", "tag": "b21fb9d1-2200-4ccf-839c-c6b7f5e41f32"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:44.731005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-97fcc8e5-6377-436a-85b6-962eba9929a8 req-51e33392-2083-429e-80a1-d664062fd9b9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:44.734428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-97fcc8e5-6377-436a-85b6-962eba9929a8 req-51e33392-2083-429e-80a1-d664062fd9b9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:44.745124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-97fcc8e5-6377-436a-85b6-962eba9929a8 req-51e33392-2083-429e-80a1-d664062fd9b9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:44.811797 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-97fcc8e5-6377-436a-85b6-962eba9929a8 req-51e33392-2083-429e-80a1-d664062fd9b9 service nova] Creating event network-vif-deleted:b21fb9d1-2200-4ccf-839c-c6b7f5e41f32 for instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 on n-h2-852771-8 Aug 25 12:39:44.817393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fe354978-0b2e-42ed-8173-45c472a7962a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f1a6e462af4936966f1d6b450aec72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15549222652b470495c1febfc030c637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:44.853046 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fe354978-0b2e-42ed-8173-45c472a7962a tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 200 len: 1324 microversion: 2.1 time: 0.654137 Aug 25 12:39:44.867321 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 99/189] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:44 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 1324 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:44.883042 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-97fcc8e5-6377-436a-85b6-962eba9929a8 req-51e33392-2083-429e-80a1-d664062fd9b9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221096 Aug 25 12:39:44.887986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-18dc5023-832f-4f7b-bc79-d40d2ff353f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:44.889362 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 91/190] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:44.901017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-18dc5023-832f-4f7b-bc79-d40d2ff353f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:44.928281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18dc5023-832f-4f7b-bc79-d40d2ff353f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:44.929219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18dc5023-832f-4f7b-bc79-d40d2ff353f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:44.946180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18dc5023-832f-4f7b-bc79-d40d2ff353f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:44.954954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18dc5023-832f-4f7b-bc79-d40d2ff353f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:44.956225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-561101bf-d438-4c56-a4c0-520b5b83e500 req-bcdcb329-93e3-4a6e-8308-a48fd0091739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1", "name": "network-vif-plugged", "status": "completed", "tag": "9e1842f8-5750-448c-bb6f-eecb481a2c29"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:44.956515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18dc5023-832f-4f7b-bc79-d40d2ff353f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:44.957199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18dc5023-832f-4f7b-bc79-d40d2ff353f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:45.015164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-561101bf-d438-4c56-a4c0-520b5b83e500 req-bcdcb329-93e3-4a6e-8308-a48fd0091739 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:45.017138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-561101bf-d438-4c56-a4c0-520b5b83e500 req-bcdcb329-93e3-4a6e-8308-a48fd0091739 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:45.027145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-561101bf-d438-4c56-a4c0-520b5b83e500 req-bcdcb329-93e3-4a6e-8308-a48fd0091739 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:45.097334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-561101bf-d438-4c56-a4c0-520b5b83e500 req-bcdcb329-93e3-4a6e-8308-a48fd0091739 service nova] Creating event network-vif-plugged:9e1842f8-5750-448c-bb6f-eecb481a2c29 for instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 on n-h2-852771-8 Aug 25 12:39:45.115244 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-561101bf-d438-4c56-a4c0-520b5b83e500 req-bcdcb329-93e3-4a6e-8308-a48fd0091739 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220040 Aug 25 12:39:45.117251 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 92/191] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:45.132565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f95bfa6b-cd7d-49c6-ba37-a2926808716d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:45.135810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f95bfa6b-cd7d-49c6-ba37-a2926808716d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:45.169489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95bfa6b-cd7d-49c6-ba37-a2926808716d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:45.174597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95bfa6b-cd7d-49c6-ba37-a2926808716d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:45.175045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95bfa6b-cd7d-49c6-ba37-a2926808716d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:45.178956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95bfa6b-cd7d-49c6-ba37-a2926808716d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:45.183520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95bfa6b-cd7d-49c6-ba37-a2926808716d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:45.185462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95bfa6b-cd7d-49c6-ba37-a2926808716d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:45.311438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-18dc5023-832f-4f7b-bc79-d40d2ff353f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:45.347925 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-18dc5023-832f-4f7b-bc79-d40d2ff353f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1270 microversion: 2.1 time: 0.478071 Aug 25 12:39:45.380565 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 100/192] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:44 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1270 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:46.066650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f95bfa6b-cd7d-49c6-ba37-a2926808716d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:46.097746 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f95bfa6b-cd7d-49c6-ba37-a2926808716d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1411 microversion: 2.1 time: 0.973821 Aug 25 12:39:46.101440 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 93/193] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:45 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1411 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:46.136978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:46.142104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:46.171626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:46.172177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:46.183257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:46.185066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:46.186319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:46.187393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:46.251868 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] HTTP exception thrown: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Request method failure captured: Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 HTTP/1.1 Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB20_YxH35ek34PV3kZmhfWbZozh8fhQ3V_plLipo7JwWuc9cfHvAhs_Y8r8cpIFLdwmi9_zL7x2RFhDH3wQBAqUGg_MNPSqpqD0OkWWtyLjVukGs3ZB0IeTVjzTmElr8NnS08Y0TcHRKjXjiZuy3GsYrtUmQKrPRKl_iJ1mzKzUb-do Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 15549222652b470495c1febfc030c637 Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminTestJSON-103703989 Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:39:46.264565 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15549222652b470495c1febfc030c637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_15549222652b470495c1febfc030c637", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/15549222652b470495c1febfc030c637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15549222652b470495c1febfc030c637"}]}] Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminTestJSON-103703989 Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 15549222652b470495c1febfc030c637 Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-103703989 Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminTestJSON-103703989-project Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e7f1a6e462af4936966f1d6b450aec72 Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminTestJSON-103703989-project Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:39:46.267168 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '71e6e07f-4dab-45e8-af60-0efb39bc4c77'} Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:46.268622 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:39:46.274292 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:46.278805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Returning 404 to user: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:46.278805 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a8592fca-cfb0-4a56-9858-c073a1d4fdc4 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 404 len: 111 microversion: 2.1 time: 0.172768 Aug 25 12:39:46.280292 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 94/194] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:46 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:46.298303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4514c02-0be4-4ca7-a608-1a61853865f9 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:46.328244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4514c02-0be4-4ca7-a608-1a61853865f9 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:46.329353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4514c02-0be4-4ca7-a608-1a61853865f9 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:46.331604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4514c02-0be4-4ca7-a608-1a61853865f9 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:46.562152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1468726756", "block_migration": true, "disk_over_commit": false}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:46.572585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:46.591130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:46.593782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:46.598148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:46.601429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:46.603459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:46.609301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:46.914126 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4514c02-0be4-4ca7-a608-1a61853865f9 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 300 microversion: 2.1 time: 0.626173 Aug 25 12:39:46.933196 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 95/195] 10.222.0.70 () {60 vars in 1191 bytes} [Thu Aug 25 12:39:46 2022] POST /compute/v2.1/os-aggregates/4/action => generated 300 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:46.945603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b61060cb-4f70-46ed-b0e0-fb31ad3793f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:46.947106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b61060cb-4f70-46ed-b0e0-fb31ad3793f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:46.963457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61060cb-4f70-46ed-b0e0-fb31ad3793f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:46.964560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61060cb-4f70-46ed-b0e0-fb31ad3793f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:46.966656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61060cb-4f70-46ed-b0e0-fb31ad3793f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:46.969243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61060cb-4f70-46ed-b0e0-fb31ad3793f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:46.971454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61060cb-4f70-46ed-b0e0-fb31ad3793f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:46.972466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61060cb-4f70-46ed-b0e0-fb31ad3793f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:47.052339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lazy-loading 'flavor' on Instance uuid a4818dfd-d48d-49e5-9f45-50ac516e6953 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:39:47.289226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b61060cb-4f70-46ed-b0e0-fb31ad3793f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:47.291087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Going to try to live migrate instance to tempest-host-1468726756 {{(pid=129060) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:39:47.321812 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b61060cb-4f70-46ed-b0e0-fb31ad3793f1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1276 microversion: 2.1 time: 0.397401 Aug 25 12:39:47.322795 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 96/196] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:46 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1276 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:47.340835 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] HTTP exception thrown: Compute host tempest-host-1468726756 could not be found. Aug 25 12:39:47.350021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf745451-16f7-4c05-a4b2-11dfa4b8f1b8 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Request method failure captured: Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953/action HTTP/1.1 Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 107 Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21wBj2ybtGET7tt8S2V1IzgE8NkssFQdgCVpdo9HkaqsDr2NzSYHv6FmtiqEYVsgVLk08o7Enxy399Q7pP6vcS5TbKvm--hypsYj-NOwobNHMrR5VVW1PVzIvhJebf1Jb0-clcDUdjGcNtftwUTZLSev8BXQCD0_G4bg_P6D87ldFU Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 518b63e53b754f22bc59bbd87769cb7d Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-LiveMigrationNegativeTest-1993845365 Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:39:47.352648 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/518b63e53b754f22bc59bbd87769cb7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_518b63e53b754f22bc59bbd87769cb7d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/518b63e53b754f22bc59bbd87769cb7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/518b63e53b754f22bc59bbd87769cb7d"}]}] Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-LiveMigrationNegativeTest-1993845365 Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 518b63e53b754f22bc59bbd87769cb7d Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1993845365 Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-LiveMigrationNegativeTest-1993845365-project-admin Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 30341ea3ffbf47b48c4fc35169091315 Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-LiveMigrationNegativeTest-1993845365-project-admin Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: {"os-migrateLive": {"host": "tempest-host-1468726756", "block_migration": true, "disk_over_commit": false}} Aug 25 12:39:47.355301 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: exception: Compute host tempest-host-1468726756 could not be found. Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'a4818dfd-d48d-49e5-9f45-50ac516e6953', 'body': {'os-migrateLive': {'host': 'tempest-host-1468726756', 'block_migration': True, 'disk_over_commit': False}}} Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:39:47.356864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1468726756 could not be found. Aug 25 12:39:47.359378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1468726756 could not be found. Aug 25 12:39:47.361567 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1468726756 could not be found. Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Returning 400 to user: Compute host tempest-host-1468726756 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-be188017-fb0a-4513-9285-400d49dfac8f tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953/action" status: 400 len: 100 microversion: 2.1 time: 1.973540 Aug 25 12:39:47.363681 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 101/197] 10.222.0.70 () {60 vars in 1279 bytes} [Thu Aug 25 12:39:45 2022] POST /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953/action => generated 100 bytes in 1978 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:39:47.382412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8e7275e3-5d3c-40bb-977d-3eecf05735ec tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:47.383618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8e7275e3-5d3c-40bb-977d-3eecf05735ec tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:47.413050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e7275e3-5d3c-40bb-977d-3eecf05735ec tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:47.414066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e7275e3-5d3c-40bb-977d-3eecf05735ec tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:47.417540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e7275e3-5d3c-40bb-977d-3eecf05735ec tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:47.422490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e7275e3-5d3c-40bb-977d-3eecf05735ec tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:47.425809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e7275e3-5d3c-40bb-977d-3eecf05735ec tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:47.426985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e7275e3-5d3c-40bb-977d-3eecf05735ec tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:47.452030 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cf745451-16f7-4c05-a4b2-11dfa4b8f1b8 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.124168 Aug 25 12:39:47.453462 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 97/198] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:39:47 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:39:47.456208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf745451-16f7-4c05-a4b2-11dfa4b8f1b8 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:47.474947 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cf745451-16f7-4c05-a4b2-11dfa4b8f1b8 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.019608 Aug 25 12:39:47.479741 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 98/199] 10.222.0.70 () {56 vars in 886 bytes} [Thu Aug 25 12:39:47 2022] GET /compute/ => generated 377 bytes in 25 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 25 12:39:47.496953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d230d538-a9e1-4c3c-97da-17653180bd2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:47.498475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d230d538-a9e1-4c3c-97da-17653180bd2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:47.525783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d230d538-a9e1-4c3c-97da-17653180bd2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:47.530758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d230d538-a9e1-4c3c-97da-17653180bd2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:47.532026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d230d538-a9e1-4c3c-97da-17653180bd2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:47.533896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d230d538-a9e1-4c3c-97da-17653180bd2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:47.538784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d230d538-a9e1-4c3c-97da-17653180bd2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:47.539908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d230d538-a9e1-4c3c-97da-17653180bd2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:48.189922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8e7275e3-5d3c-40bb-977d-3eecf05735ec tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:48.228862 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8e7275e3-5d3c-40bb-977d-3eecf05735ec tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1389 microversion: 2.1 time: 0.855764 Aug 25 12:39:48.247343 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 102/200] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:47 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1389 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:48.320652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bdcab237-9abd-4407-9f2f-71e9d847f59d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1363664813"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:48.340473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-bdcab237-9abd-4407-9f2f-71e9d847f59d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Generated uuid 6aaa0e7c-669b-4391-8ac5-f8324ff9ed6d for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:39:48.452484 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bdcab237-9abd-4407-9f2f-71e9d847f59d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.185032 Aug 25 12:39:48.459665 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 103/201] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:39:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:48.485533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5f303e4-8d9c-4a07-ba50-b9111d730a48 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:48.487516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5f303e4-8d9c-4a07-ba50-b9111d730a48 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:48.505675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5f303e4-8d9c-4a07-ba50-b9111d730a48 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:48.507100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5f303e4-8d9c-4a07-ba50-b9111d730a48 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:48.508203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5f303e4-8d9c-4a07-ba50-b9111d730a48 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:48.515428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5f303e4-8d9c-4a07-ba50-b9111d730a48 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:48.519815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5f303e4-8d9c-4a07-ba50-b9111d730a48 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:48.521245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5f303e4-8d9c-4a07-ba50-b9111d730a48 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:49.099416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d230d538-a9e1-4c3c-97da-17653180bd2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:49.186941 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d230d538-a9e1-4c3c-97da-17653180bd2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1468 microversion: 2.1 time: 1.703573 Aug 25 12:39:49.186941 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 99/202] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:47 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1468 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:49.234991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ecfbd26c-43e8-4b8e-9178-27a292c2e67c tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:49.298144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecfbd26c-43e8-4b8e-9178-27a292c2e67c tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:49.300544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecfbd26c-43e8-4b8e-9178-27a292c2e67c tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:49.304036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecfbd26c-43e8-4b8e-9178-27a292c2e67c tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:49.700597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5f303e4-8d9c-4a07-ba50-b9111d730a48 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:49.706712 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ecfbd26c-43e8-4b8e-9178-27a292c2e67c tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.503619 Aug 25 12:39:49.721585 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 100/203] 10.222.0.70 () {60 vars in 1191 bytes} [Thu Aug 25 12:39:49 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:49.723061 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5f303e4-8d9c-4a07-ba50-b9111d730a48 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1318 microversion: 2.1 time: 1.258711 Aug 25 12:39:49.724540 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 104/204] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:48 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1318 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:49.748563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8236808-1989-414a-842f-b159b445c4a9 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:49.757436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8236808-1989-414a-842f-b159b445c4a9 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:49.766466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2127021693", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:49.806084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8236808-1989-414a-842f-b159b445c4a9 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:49.810010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8236808-1989-414a-842f-b159b445c4a9 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:49.818028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8236808-1989-414a-842f-b159b445c4a9 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:49.818975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8236808-1989-414a-842f-b159b445c4a9 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:49.819842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8236808-1989-414a-842f-b159b445c4a9 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:49.821058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8236808-1989-414a-842f-b159b445c4a9 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:49.943029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:39:51.558619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b8236808-1989-414a-842f-b159b445c4a9 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:51.591355 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8236808-1989-414a-842f-b159b445c4a9 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1588 microversion: 2.1 time: 1.865822 Aug 25 12:39:51.593438 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 101/205] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:49 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1588 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:51.612712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bc8febbf-fb98-43e5-a67b-e6083e46dbaa tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:51.636838 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bc8febbf-fb98-43e5-a67b-e6083e46dbaa tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.040907 Aug 25 12:39:51.638865 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 102/206] 10.222.0.70 () {58 vars in 1149 bytes} [Thu Aug 25 12:39:51 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:51.661341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a574f7f-c88c-4a37-94c1-3e7ec6fc0030 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:51.663052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a574f7f-c88c-4a37-94c1-3e7ec6fc0030 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:51.681579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a574f7f-c88c-4a37-94c1-3e7ec6fc0030 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:51.682514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a574f7f-c88c-4a37-94c1-3e7ec6fc0030 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:51.683362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a574f7f-c88c-4a37-94c1-3e7ec6fc0030 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:51.684737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a574f7f-c88c-4a37-94c1-3e7ec6fc0030 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:51.685887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a574f7f-c88c-4a37-94c1-3e7ec6fc0030 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:51.686697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a574f7f-c88c-4a37-94c1-3e7ec6fc0030 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:51.935078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:52.012851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:39:52.016617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:39:52.018938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:39:52.027217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:39:52.028633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:39:52.054661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:52.089262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:52.091033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:52.092126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:52.093967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:52.097010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:52.098777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:52.181195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Getting quotas for project 5fbf78e11dac4679a21657e9964aeb9c. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:39:52.194008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:52.209224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Getting quotas for user d40770814e0045ba9c5b2e621ca0f397 and project 5fbf78e11dac4679a21657e9964aeb9c. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:39:52.280886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:39:52.297586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:39:52.488673 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a8c90e5-66be-4b08-80b4-17b5f24215df tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.741053 Aug 25 12:39:52.502645 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 105/207] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:39:52.504734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ca7af58b-1cab-4b22-b1dc-b00b06b622c7 req-de150cf4-492f-4fc3-a9c7-5e514a6834b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625b4b65-d6ac-472e-9406-ab2c8ffb900a", "tag": "b9520f72-4afa-48e3-adfb-21cffb3d340b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:52.540223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ca7af58b-1cab-4b22-b1dc-b00b06b622c7 req-de150cf4-492f-4fc3-a9c7-5e514a6834b0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:52.541010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ca7af58b-1cab-4b22-b1dc-b00b06b622c7 req-de150cf4-492f-4fc3-a9c7-5e514a6834b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:52.542115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ca7af58b-1cab-4b22-b1dc-b00b06b622c7 req-de150cf4-492f-4fc3-a9c7-5e514a6834b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:52.616284 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ca7af58b-1cab-4b22-b1dc-b00b06b622c7 req-de150cf4-492f-4fc3-a9c7-5e514a6834b0 service nova] Creating event network-changed:b9520f72-4afa-48e3-adfb-21cffb3d340b for instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a on n-h1-852771-8 Aug 25 12:39:52.627732 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ca7af58b-1cab-4b22-b1dc-b00b06b622c7 req-de150cf4-492f-4fc3-a9c7-5e514a6834b0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133820 Aug 25 12:39:52.629043 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 106/208] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:52.639237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86f80957-3689-46b5-b32d-5a835cdba9db tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:52.640742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-86f80957-3689-46b5-b32d-5a835cdba9db tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:52.658825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86f80957-3689-46b5-b32d-5a835cdba9db tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:52.659902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86f80957-3689-46b5-b32d-5a835cdba9db tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:52.660487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86f80957-3689-46b5-b32d-5a835cdba9db tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:52.661861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86f80957-3689-46b5-b32d-5a835cdba9db tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:52.662838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86f80957-3689-46b5-b32d-5a835cdba9db tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:52.663846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86f80957-3689-46b5-b32d-5a835cdba9db tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:52.912697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a574f7f-c88c-4a37-94c1-3e7ec6fc0030 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:52.944630 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a574f7f-c88c-4a37-94c1-3e7ec6fc0030 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1318 microversion: 2.1 time: 1.288770 Aug 25 12:39:52.944630 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 103/209] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:51 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1318 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:52.953978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9b1798a1-a20b-4fb0-993c-54bbb6d6e9bd tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:52.982050 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-86f80957-3689-46b5-b32d-5a835cdba9db tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.350641 Aug 25 12:39:52.982906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b1798a1-a20b-4fb0-993c-54bbb6d6e9bd tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:52.983103 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 107/210] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 12:39:52 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1/os-interface => generated 284 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:52.983381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b1798a1-a20b-4fb0-993c-54bbb6d6e9bd tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:52.984393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b1798a1-a20b-4fb0-993c-54bbb6d6e9bd tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:53.003302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-820da9fb-cc06-4725-8480-d172478a1ec8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:53.004602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-820da9fb-cc06-4725-8480-d172478a1ec8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:53.399153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-820da9fb-cc06-4725-8480-d172478a1ec8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:53.418190 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9b1798a1-a20b-4fb0-993c-54bbb6d6e9bd tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.473938 Aug 25 12:39:53.421914 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 104/211] 10.222.0.70 () {60 vars in 1191 bytes} [Thu Aug 25 12:39:52 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:53.436218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:53.456816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b95a689c-c1bf-4144-8f1e-95ea4a04cc9c tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:53.469937 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-820da9fb-cc06-4725-8480-d172478a1ec8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1219 microversion: 2.1 time: 0.480028 Aug 25 12:39:53.496082 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 108/212] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:52 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1219 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:53.567714 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b95a689c-c1bf-4144-8f1e-95ea4a04cc9c tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.131900 Aug 25 12:39:53.571829 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 105/213] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:39:53 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:39:53.605018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08b8152a-6576-4373-b78e-11c2cfbd76c1 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1933587337"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:53.613608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-08b8152a-6576-4373-b78e-11c2cfbd76c1 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Generated uuid 5f6e0bc2-0c28-4acf-b8d0-0ef8e43b1148 for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:39:53.713722 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-08b8152a-6576-4373-b78e-11c2cfbd76c1 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.130195 Aug 25 12:39:53.716012 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 109/214] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:39:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:53.734268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-616dcadf-9ced-4bba-9ba8-54513557c374 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:53.780240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-616dcadf-9ced-4bba-9ba8-54513557c374 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:53.784855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-616dcadf-9ced-4bba-9ba8-54513557c374 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:53.787547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-616dcadf-9ced-4bba-9ba8-54513557c374 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:53.892158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=90,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=7,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:53.990578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dfceb05c-55b0-4554-9d8b-2bcc210433d1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:54.004757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dfceb05c-55b0-4554-9d8b-2bcc210433d1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:54.042910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfceb05c-55b0-4554-9d8b-2bcc210433d1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:54.054946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfceb05c-55b0-4554-9d8b-2bcc210433d1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:54.056160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfceb05c-55b0-4554-9d8b-2bcc210433d1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:54.058815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfceb05c-55b0-4554-9d8b-2bcc210433d1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:54.063075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfceb05c-55b0-4554-9d8b-2bcc210433d1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:54.069175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfceb05c-55b0-4554-9d8b-2bcc210433d1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:54.213161 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-616dcadf-9ced-4bba-9ba8-54513557c374 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.486439 Aug 25 12:39:54.214124 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 106/215] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:39:53 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:39:54.239256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b2c1fe13-7328-43d2-9baa-fb73c4e48194 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:54.266838 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b2c1fe13-7328-43d2-9baa-fb73c4e48194 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.035933 Aug 25 12:39:54.269316 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 107/216] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:39:54 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:39:54.292546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fd811b52-4a4b-4d6b-b3f6-3b3370845253 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:54.317766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd811b52-4a4b-4d6b-b3f6-3b3370845253 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:54.318966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd811b52-4a4b-4d6b-b3f6-3b3370845253 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:54.320260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd811b52-4a4b-4d6b-b3f6-3b3370845253 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:54.670523 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fd811b52-4a4b-4d6b-b3f6-3b3370845253 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.385124 Aug 25 12:39:54.690047 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 108/217] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:39:54 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:39:54.702923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f4ea75c-6953-4b19-9839-e0de544a9b2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:54.704219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f4ea75c-6953-4b19-9839-e0de544a9b2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:54.721878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f4ea75c-6953-4b19-9839-e0de544a9b2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:54.723368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f4ea75c-6953-4b19-9839-e0de544a9b2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:54.724255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f4ea75c-6953-4b19-9839-e0de544a9b2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:54.725837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f4ea75c-6953-4b19-9839-e0de544a9b2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:54.730846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f4ea75c-6953-4b19-9839-e0de544a9b2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:54.731723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f4ea75c-6953-4b19-9839-e0de544a9b2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:55.687407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2f4ea75c-6953-4b19-9839-e0de544a9b2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:55.719427 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f4ea75c-6953-4b19-9839-e0de544a9b2f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1215 microversion: 2.1 time: 1.027210 Aug 25 12:39:55.725692 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 109/218] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:54 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1215 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:55.765334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b20a16f7-107c-4ec2-b632-64f53b1ca387 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:55.843988 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b20a16f7-107c-4ec2-b632-64f53b1ca387 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.113902 Aug 25 12:39:55.846920 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 110/219] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:39:55 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:39:55.885159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dfceb05c-55b0-4554-9d8b-2bcc210433d1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:55.907029 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dfceb05c-55b0-4554-9d8b-2bcc210433d1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1318 microversion: 2.1 time: 1.931840 Aug 25 12:39:55.909588 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 110/220] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:53 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1318 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:55.924874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9798f86e-0c0e-480f-bfec-c4e2fd8072a3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1400923760"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:55.947989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-9798f86e-0c0e-480f-bfec-c4e2fd8072a3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Generated uuid ffb24e3d-bbf0-4d3c-91f5-e4b05ca38e43 for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:39:56.077433 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9798f86e-0c0e-480f-bfec-c4e2fd8072a3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.161492 Aug 25 12:39:56.079035 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 111/221] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:39:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:56.104557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a498dc5-a0b3-4ce5-b78e-65ecbe943077 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-8"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:56.181992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a498dc5-a0b3-4ce5-b78e-65ecbe943077 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:56.184688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a498dc5-a0b3-4ce5-b78e-65ecbe943077 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:56.189598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a498dc5-a0b3-4ce5-b78e-65ecbe943077 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:56.623281 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a498dc5-a0b3-4ce5-b78e-65ecbe943077 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.528691 Aug 25 12:39:56.644896 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 112/222] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:39:56 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:39:56.655848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f36807a1-2a4f-47fc-b981-74d42a2066f2 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-8"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:56.661627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e070d5bc-8bab-4363-9eb0-965c1090f94a tempest-InstanceUsageAuditLogTestJSON-462641186 tempest-InstanceUsageAuditLogTestJSON-462641186-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:56.694864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f36807a1-2a4f-47fc-b981-74d42a2066f2 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:56.697581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f36807a1-2a4f-47fc-b981-74d42a2066f2 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:56.698852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f36807a1-2a4f-47fc-b981-74d42a2066f2 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:56.734286 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e070d5bc-8bab-4363-9eb0-965c1090f94a tempest-InstanceUsageAuditLogTestJSON-462641186 tempest-InstanceUsageAuditLogTestJSON-462641186-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-25 12:39:55" status: 200 len: 318 microversion: 2.1 time: 0.884888 Aug 25 12:39:56.750825 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 111/223] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 12:39:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-25%2012%3A39%3A55 => generated 318 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:56.766383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1019d8c6-e770-4935-b8c1-96fff05f345f tempest-InstanceUsageAuditLogTestJSON-462641186 tempest-InstanceUsageAuditLogTestJSON-462641186-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:56.812074 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1019d8c6-e770-4935-b8c1-96fff05f345f tempest-InstanceUsageAuditLogTestJSON-462641186 tempest-InstanceUsageAuditLogTestJSON-462641186-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.054227 Aug 25 12:39:56.827828 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 112/224] 10.222.0.70 () {58 vars in 1185 bytes} [Thu Aug 25 12:39:56 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:56.844995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2a275535-5432-4d74-aefe-b5d45ac88706 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:56.848162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a275535-5432-4d74-aefe-b5d45ac88706 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:56.864870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a275535-5432-4d74-aefe-b5d45ac88706 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:56.866393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a275535-5432-4d74-aefe-b5d45ac88706 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:56.867777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a275535-5432-4d74-aefe-b5d45ac88706 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:56.869613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a275535-5432-4d74-aefe-b5d45ac88706 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:56.871509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a275535-5432-4d74-aefe-b5d45ac88706 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:56.872661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a275535-5432-4d74-aefe-b5d45ac88706 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:57.197927 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f36807a1-2a4f-47fc-b981-74d42a2066f2 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.548989 Aug 25 12:39:57.216837 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 113/225] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:39:56 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:57.231653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7b5f2263-c8cc-45aa-b15f-a4a72e7cf7e3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:57.241098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7b5f2263-c8cc-45aa-b15f-a4a72e7cf7e3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:57.274883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b5f2263-c8cc-45aa-b15f-a4a72e7cf7e3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:57.275787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b5f2263-c8cc-45aa-b15f-a4a72e7cf7e3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:57.276617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b5f2263-c8cc-45aa-b15f-a4a72e7cf7e3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:57.278013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b5f2263-c8cc-45aa-b15f-a4a72e7cf7e3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:57.278868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b5f2263-c8cc-45aa-b15f-a4a72e7cf7e3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:57.279858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b5f2263-c8cc-45aa-b15f-a4a72e7cf7e3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:57.312369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2a275535-5432-4d74-aefe-b5d45ac88706 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:57.361813 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2a275535-5432-4d74-aefe-b5d45ac88706 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1277 microversion: 2.1 time: 0.507446 Aug 25 12:39:57.363348 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 113/226] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:56 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1277 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:57.383800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ca29ea2-d0ab-40bd-88b8-8605877715ee tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:57.499902 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ca29ea2-d0ab-40bd-88b8-8605877715ee tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.134268 Aug 25 12:39:57.501001 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 114/227] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:39:57 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:39:57.550643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-70f90caa-cd06-4ee7-9955-ab3a2d1bc7f2 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1672606913"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:57.563062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.aggregate [None req-70f90caa-cd06-4ee7-9955-ab3a2d1bc7f2 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Generated uuid 27e592dc-f4a3-4a00-a6d2-72da3f0196f0 for aggregate {{(pid=129059) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:39:57.662062 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-70f90caa-cd06-4ee7-9955-ab3a2d1bc7f2 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.150253 Aug 25 12:39:57.664089 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 115/228] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:39:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:57.674537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee589bc6-aaf6-4678-8dc2-85765887730f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-382141740"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:57.682033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.aggregate [None req-ee589bc6-aaf6-4678-8dc2-85765887730f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Generated uuid 93d91d42-a0d0-4f2a-b003-cbd212570b96 for aggregate {{(pid=129059) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:39:57.798709 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee589bc6-aaf6-4678-8dc2-85765887730f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.131749 Aug 25 12:39:57.804733 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 116/229] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:39:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:57.821025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-65d181cf-53e3-4239-94e8-7c8646ed4af7 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:57.907192 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-65d181cf-53e3-4239-94e8-7c8646ed4af7 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.099816 Aug 25 12:39:57.914388 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 117/230] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:39:57 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:39:57.930229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f9f879f5-ec76-468c-9ea9-7ee14ef8bc63 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:57.952439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9f879f5-ec76-468c-9ea9-7ee14ef8bc63 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:57.953931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9f879f5-ec76-468c-9ea9-7ee14ef8bc63 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:57.955465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9f879f5-ec76-468c-9ea9-7ee14ef8bc63 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:58.171721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7b5f2263-c8cc-45aa-b15f-a4a72e7cf7e3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:58.215322 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7b5f2263-c8cc-45aa-b15f-a4a72e7cf7e3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1318 microversion: 2.1 time: 0.996059 Aug 25 12:39:58.247403 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 114/231] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:57 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1318 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:58.280929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6d0ff7ba-c128-4aa3-aa09-34f154a96c71 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:58.323342 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-6d0ff7ba-c128-4aa3-aa09-34f154a96c71 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6d0ff7ba-c128-4aa3-aa09-34f154a96c71 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Request method failure captured: Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21FUYYCEPjQpZbze4AMjHKRCHEMYn0GeU7QnLTMI-6H0ayxt8P8m8R8VdAHJA6w5Pu41Lq8DsaebHTY_gWXOb0BHvDcZUAWFu0tby5T5ZH8Hp7zfQEo4-xsngpiAUj6gj0mUDAqB3maY0m22al8Tv35TNDEv4A43txEfAZogL6T_wU Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a42ac5932fee44918605d9da6de95cf0 Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:39:58.354562 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a42ac5932fee44918605d9da6de95cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a42ac5932fee44918605d9da6de95cf0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a42ac5932fee44918605d9da6de95cf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a42ac5932fee44918605d9da6de95cf0"}]}] Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a42ac5932fee44918605d9da6de95cf0 Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AggregatesAdminTestJSON-716316455-project-admin Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1bc47e64739b4a34b719fd8beec60cbd Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AggregatesAdminTestJSON-716316455-project-admin Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: exception: Aggregate 12 could not be found. Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '12'} Aug 25 12:39:58.357141 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:58.358641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 25 12:39:58.360658 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.368725 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f9f879f5-ec76-468c-9ea9-7ee14ef8bc63 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.451813 Aug 25 12:39:58.370792 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 118/232] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:39:57 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:58.372931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6d0ff7ba-c128-4aa3-aa09-34f154a96c71 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:58.383523 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6d0ff7ba-c128-4aa3-aa09-34f154a96c71 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.112788 Aug 25 12:39:58.401815 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 115/233] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:39:58 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:39:58.422865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f32c0c0d-72a2-46f5-968e-e337d285e75d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:58.433242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-802780e8-f084-4897-9562-435be7f60192 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:58.482142 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f32c0c0d-72a2-46f5-968e-e337d285e75d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f32c0c0d-72a2-46f5-968e-e337d285e75d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Request method failure captured: Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21FUYYCEPjQpZbze4AMjHKRCHEMYn0GeU7QnLTMI-6H0ayxt8P8m8R8VdAHJA6w5Pu41Lq8DsaebHTY_gWXOb0BHvDcZUAWFu0tby5T5ZH8Hp7zfQEo4-xsngpiAUj6gj0mUDAqB3maY0m22al8Tv35TNDEv4A43txEfAZogL6T_wU Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a42ac5932fee44918605d9da6de95cf0 Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:39:58.492809 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a42ac5932fee44918605d9da6de95cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a42ac5932fee44918605d9da6de95cf0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a42ac5932fee44918605d9da6de95cf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a42ac5932fee44918605d9da6de95cf0"}]}] Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a42ac5932fee44918605d9da6de95cf0 Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AggregatesAdminTestJSON-716316455-project-admin Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1bc47e64739b4a34b719fd8beec60cbd Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AggregatesAdminTestJSON-716316455-project-admin Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: exception: Aggregate 12 could not be found. Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '12'} Aug 25 12:39:58.495285 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:39:58.497013 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:58.499148 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:58.507342 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:58.507342 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:58.507342 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:58.507342 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 25 12:39:58.507342 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.507342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f32c0c0d-72a2-46f5-968e-e337d285e75d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:58.507342 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f32c0c0d-72a2-46f5-968e-e337d285e75d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.092206 Aug 25 12:39:58.507342 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 116/234] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:39:58 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:39:58.514871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-802780e8-f084-4897-9562-435be7f60192 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '28eef1b58df344b79769f6c579061706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ba0b250acd4f2eb07754b9d24bcbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:58.515055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29d0ee1b-7c84-4d7a-ade8-842dd047898b tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-802780e8-f084-4897-9562-435be7f60192 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Request method failure captured: Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 42 Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21AenB4N3avpWNEzM6luMXKT3HdMamcGkeUKNu8kHQOg2FMcT6i2spu2y6Cfw5kcyjegW6o7FLHcrgLc6u4vTcOYmwu7soJ97JfHJojTvIrb4VjrxwUpx7S0Uc_1-oAhMGEAwSRnUeh5AKNpwME08F71I7ZZCqN1v0E0d6Ji5k3hGs Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:39:58.519598 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d1ba0b250acd4f2eb07754b9d24bcbf6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d1ba0b250acd4f2eb07754b9d24bcbf6"}]}] Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d1ba0b250acd4f2eb07754b9d24bcbf6 Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471 Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 28eef1b58df344b79769f6c579061706 Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1470635471-project Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: {"remove_host": {"host": "n-h2-852771-8"}} Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:39:58.521862 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-852771-8'}}} Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:39:58.523243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 25 12:39:58.525200 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:39:58.530267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-29d0ee1b-7c84-4d7a-ade8-842dd047898b tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:58.534453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-802780e8-f084-4897-9562-435be7f60192 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:58.544543 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-802780e8-f084-4897-9562-435be7f60192 tempest-AggregatesAdminNegativeTestJSON-1470635471 tempest-AggregatesAdminNegativeTestJSON-1470635471-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.151179 Aug 25 12:39:58.547504 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 119/235] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:39:58 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 158 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:58.550883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d0ee1b-7c84-4d7a-ade8-842dd047898b tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:58.557040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d0ee1b-7c84-4d7a-ade8-842dd047898b tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:58.567977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d0ee1b-7c84-4d7a-ade8-842dd047898b tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:58.572286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d0ee1b-7c84-4d7a-ade8-842dd047898b tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:58.576987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d0ee1b-7c84-4d7a-ade8-842dd047898b tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:58.588786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d0ee1b-7c84-4d7a-ade8-842dd047898b tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:58.600988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0d310b9-b5af-4721-b343-26e01232647e tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-410145966", "name": "tempest-test_aggregate-515837945"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:58.688421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.aggregate [None req-c0d310b9-b5af-4721-b343-26e01232647e tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Generated uuid d6cf0e1b-abea-4d16-8b18-68abef6ffc6e for aggregate {{(pid=129059) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:39:58.811074 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0d310b9-b5af-4721-b343-26e01232647e tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.257087 Aug 25 12:39:58.815673 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 120/236] 10.222.0.70 () {60 vars in 1165 bytes} [Thu Aug 25 12:39:58 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:58.828032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-439edcb4-24f1-442c-b32a-1c27541f5178 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:58.884661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-439edcb4-24f1-442c-b32a-1c27541f5178 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:58.885831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-439edcb4-24f1-442c-b32a-1c27541f5178 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:58.886967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-439edcb4-24f1-442c-b32a-1c27541f5178 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:59.150284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-29d0ee1b-7c84-4d7a-ade8-842dd047898b tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:59.180854 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29d0ee1b-7c84-4d7a-ade8-842dd047898b tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1277 microversion: 2.1 time: 0.681955 Aug 25 12:39:59.186437 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 117/237] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:58 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1277 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:59.202620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f5166dd1-babd-4563-9733-5a5343d53411 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:59.296704 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f5166dd1-babd-4563-9733-5a5343d53411 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.107937 Aug 25 12:39:59.302096 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 118/238] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:39:59 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:39:59.319153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-962796aa-6688-4b83-b898-035d46178888 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:59.331649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-962796aa-6688-4b83-b898-035d46178888 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:59.369382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-962796aa-6688-4b83-b898-035d46178888 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:59.375987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-962796aa-6688-4b83-b898-035d46178888 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:59.378693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-962796aa-6688-4b83-b898-035d46178888 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:59.386684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-962796aa-6688-4b83-b898-035d46178888 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:59.388858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-962796aa-6688-4b83-b898-035d46178888 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:59.388858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-962796aa-6688-4b83-b898-035d46178888 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:59.526398 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-439edcb4-24f1-442c-b32a-1c27541f5178 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.706871 Aug 25 12:39:59.544822 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 121/239] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:39:58 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:59.562585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-24cd0e0d-db4d-45be-a675-2314f4857688 req-7e2c73b1-39bb-4c22-9f56-1eb9ad6d4355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1", "tag": "9e1842f8-5750-448c-bb6f-eecb481a2c29"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:59.620414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-24cd0e0d-db4d-45be-a675-2314f4857688 req-7e2c73b1-39bb-4c22-9f56-1eb9ad6d4355 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:59.621383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-24cd0e0d-db4d-45be-a675-2314f4857688 req-7e2c73b1-39bb-4c22-9f56-1eb9ad6d4355 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:59.622271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-24cd0e0d-db4d-45be-a675-2314f4857688 req-7e2c73b1-39bb-4c22-9f56-1eb9ad6d4355 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:59.688758 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-24cd0e0d-db4d-45be-a675-2314f4857688 req-7e2c73b1-39bb-4c22-9f56-1eb9ad6d4355 service nova] Creating event network-changed:9e1842f8-5750-448c-bb6f-eecb481a2c29 for instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 on n-h2-852771-8 Aug 25 12:39:59.707477 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-24cd0e0d-db4d-45be-a675-2314f4857688 req-7e2c73b1-39bb-4c22-9f56-1eb9ad6d4355 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157828 Aug 25 12:39:59.709838 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 122/240] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:59.737303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b876e7e-1996-4330-8bf3-20818fd06fd8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:59.766409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6b876e7e-1996-4330-8bf3-20818fd06fd8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:59.797596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b876e7e-1996-4330-8bf3-20818fd06fd8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:59.800055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b876e7e-1996-4330-8bf3-20818fd06fd8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:59.802818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b876e7e-1996-4330-8bf3-20818fd06fd8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:59.804851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b876e7e-1996-4330-8bf3-20818fd06fd8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:59.807136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b876e7e-1996-4330-8bf3-20818fd06fd8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:59.808912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b876e7e-1996-4330-8bf3-20818fd06fd8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:00.422129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-962796aa-6688-4b83-b898-035d46178888 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:00.457757 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-962796aa-6688-4b83-b898-035d46178888 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 200 len: 1588 microversion: 2.1 time: 1.153212 Aug 25 12:40:00.471519 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 119/241] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:59 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 1588 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:00.487214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c53ae557-30fc-4f18-abec-1b7fa63f07c7 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:00.516025 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c53ae557-30fc-4f18-abec-1b7fa63f07c7 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c53ae557-30fc-4f18-abec-1b7fa63f07c7 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Request method failure captured: Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21FUYYCEPjQpZbze4AMjHKRCHEMYn0GeU7QnLTMI-6H0ayxt8P8m8R8VdAHJA6w5Pu41Lq8DsaebHTY_gWXOb0BHvDcZUAWFu0tby5T5ZH8Hp7zfQEo4-xsngpiAUj6gj0mUDAqB3maY0m22al8Tv35TNDEv4A43txEfAZogL6T_wU Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a42ac5932fee44918605d9da6de95cf0 Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:40:00.526507 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a42ac5932fee44918605d9da6de95cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a42ac5932fee44918605d9da6de95cf0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a42ac5932fee44918605d9da6de95cf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a42ac5932fee44918605d9da6de95cf0"}]}] Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a42ac5932fee44918605d9da6de95cf0 Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AggregatesAdminTestJSON-716316455-project-admin Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1bc47e64739b4a34b719fd8beec60cbd Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AggregatesAdminTestJSON-716316455-project-admin Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: exception: Aggregate 14 could not be found. Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '14'} Aug 25 12:40:00.529281 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:00.531221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 25 12:40:00.534119 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:00.538179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c53ae557-30fc-4f18-abec-1b7fa63f07c7 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:00.540113 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c53ae557-30fc-4f18-abec-1b7fa63f07c7 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.066337 Aug 25 12:40:00.555408 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 120/242] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:40:00 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:40:00.564656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e3e57a3d-cda8-4b4c-ae1d-4708832a295c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:00.662662 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e3e57a3d-cda8-4b4c-ae1d-4708832a295c tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.104931 Aug 25 12:40:00.676198 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 121/243] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:40:00 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:40:00.828529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6b876e7e-1996-4330-8bf3-20818fd06fd8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:00.863290 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6b876e7e-1996-4330-8bf3-20818fd06fd8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1318 microversion: 2.1 time: 1.146228 Aug 25 12:40:00.871813 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 123/244] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:59 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1318 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:00.892646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ae447cfe-77d1-45a1-9aac-590bef8e3b6b req-c6d14240-1758-4fc0-9d14-b3ef6274b792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625b4b65-d6ac-472e-9406-ab2c8ffb900a", "name": "network-vif-plugged", "status": "completed", "tag": "b9520f72-4afa-48e3-adfb-21cffb3d340b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:00.925268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ae447cfe-77d1-45a1-9aac-590bef8e3b6b req-c6d14240-1758-4fc0-9d14-b3ef6274b792 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:00.938955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ae447cfe-77d1-45a1-9aac-590bef8e3b6b req-c6d14240-1758-4fc0-9d14-b3ef6274b792 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:00.940427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ae447cfe-77d1-45a1-9aac-590bef8e3b6b req-c6d14240-1758-4fc0-9d14-b3ef6274b792 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:00.985206 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ae447cfe-77d1-45a1-9aac-590bef8e3b6b req-c6d14240-1758-4fc0-9d14-b3ef6274b792 service nova] Creating event network-vif-plugged:b9520f72-4afa-48e3-adfb-21cffb3d340b for instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a on n-h1-852771-8 Aug 25 12:40:01.011532 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ae447cfe-77d1-45a1-9aac-590bef8e3b6b req-c6d14240-1758-4fc0-9d14-b3ef6274b792 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137043 Aug 25 12:40:01.013061 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 124/245] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:01.028985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6719c9d1-ed7e-4957-ba71-d6a377c0eb54 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:01.034365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6719c9d1-ed7e-4957-ba71-d6a377c0eb54 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:01.064327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6719c9d1-ed7e-4957-ba71-d6a377c0eb54 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:01.065836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6719c9d1-ed7e-4957-ba71-d6a377c0eb54 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:01.067113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6719c9d1-ed7e-4957-ba71-d6a377c0eb54 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:01.068918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6719c9d1-ed7e-4957-ba71-d6a377c0eb54 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:01.072665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6719c9d1-ed7e-4957-ba71-d6a377c0eb54 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:01.075811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6719c9d1-ed7e-4957-ba71-d6a377c0eb54 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:01.306177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cf7867df-694b-4925-86ff-754678285b06 tempest-NetworksTest-1186334367 tempest-NetworksTest-1186334367-project-admin] Calling method '.version_select at 0x7f3a2af748b0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:02.144547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:02.713225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6719c9d1-ed7e-4957-ba71-d6a377c0eb54 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:02.745628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6719c9d1-ed7e-4957-ba71-d6a377c0eb54 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1319 microversion: 2.1 time: 1.718826 Aug 25 12:40:02.746715 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 125/246] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:01 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1319 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:02.758877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c232328c-2a90-413e-9463-cb8f8bad7767 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:02.777348 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cf7867df-694b-4925-86ff-754678285b06 tempest-NetworksTest-1186334367 tempest-NetworksTest-1186334367-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks" status: 200 len: 4023 microversion: 2.1 time: 2.093927 Aug 25 12:40:02.782087 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 122/247] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:40:00 2022] GET /compute/v2.1/os-networks => generated 4023 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:02.807339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ebc1acd-6693-4089-99da-9c9b5d19793f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1324048125"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:02.828973 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c232328c-2a90-413e-9463-cb8f8bad7767 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 25 12:40:02.830904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-3ebc1acd-6693-4089-99da-9c9b5d19793f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Generated uuid f4be3507-6029-4deb-8bfc-22b8492668cd for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c232328c-2a90-413e-9463-cb8f8bad7767 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Request method failure captured: Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21FUYYCEPjQpZbze4AMjHKRCHEMYn0GeU7QnLTMI-6H0ayxt8P8m8R8VdAHJA6w5Pu41Lq8DsaebHTY_gWXOb0BHvDcZUAWFu0tby5T5ZH8Hp7zfQEo4-xsngpiAUj6gj0mUDAqB3maY0m22al8Tv35TNDEv4A43txEfAZogL6T_wU Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: a42ac5932fee44918605d9da6de95cf0 Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:02.842765 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a42ac5932fee44918605d9da6de95cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a42ac5932fee44918605d9da6de95cf0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a42ac5932fee44918605d9da6de95cf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a42ac5932fee44918605d9da6de95cf0"}]}] Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: a42ac5932fee44918605d9da6de95cf0 Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-716316455 Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AggregatesAdminTestJSON-716316455-project-admin Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1bc47e64739b4a34b719fd8beec60cbd Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AggregatesAdminTestJSON-716316455-project-admin Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: exception: Aggregate 14 could not be found. Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '14'} Aug 25 12:40:02.845164 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:40:02.848769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:02.853534 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:02.860104 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:02.860104 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:02.860104 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:02.860104 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 25 12:40:02.860104 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:02.860104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c232328c-2a90-413e-9463-cb8f8bad7767 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:02.860104 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c232328c-2a90-413e-9463-cb8f8bad7767 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.096428 Aug 25 12:40:02.860104 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 126/248] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:40:02 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:40:02.862499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f0089caf-fcec-41bb-b6da-9f3a112b53e7 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:02.862499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f0089caf-fcec-41bb-b6da-9f3a112b53e7 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:02.882386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0089caf-fcec-41bb-b6da-9f3a112b53e7 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:02.883502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0089caf-fcec-41bb-b6da-9f3a112b53e7 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:02.884469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0089caf-fcec-41bb-b6da-9f3a112b53e7 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:02.890433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0089caf-fcec-41bb-b6da-9f3a112b53e7 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:02.893691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0089caf-fcec-41bb-b6da-9f3a112b53e7 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:02.895281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0089caf-fcec-41bb-b6da-9f3a112b53e7 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:02.915051 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3ebc1acd-6693-4089-99da-9c9b5d19793f tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.129568 Aug 25 12:40:02.916041 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 123/249] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:40:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:02.937392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1b1b7d1d-ec92-48a6-8f03-8c963b4a0d8f tempest-NetworksTest-1186334367 tempest-NetworksTest-1186334367-project-admin] Calling method '.version_select at 0x7f3a2b04c820>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:02.967355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:03.462152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:03.507995 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1b1b7d1d-ec92-48a6-8f03-8c963b4a0d8f tempest-NetworksTest-1186334367 tempest-NetworksTest-1186334367-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks/08e51fcb-b6e4-4dd9-a40f-e2e61213f366" status: 200 len: 652 microversion: 2.1 time: 0.587882 Aug 25 12:40:03.509182 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 124/250] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 12:40:02 2022] GET /compute/v2.1/os-networks/08e51fcb-b6e4-4dd9-a40f-e2e61213f366 => generated 652 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:03.523596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-80bbecdb-948f-4ebb-9f9c-02ee6b4d9824 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1370667247"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:03.536718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-80bbecdb-948f-4ebb-9f9c-02ee6b4d9824 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Generated uuid 256daecf-8b67-430c-892c-7b4d0f42701b for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:40:03.631016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f0089caf-fcec-41bb-b6da-9f3a112b53e7 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:03.651947 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-80bbecdb-948f-4ebb-9f9c-02ee6b4d9824 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.140711 Aug 25 12:40:03.657131 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 125/251] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:40:03 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:03.678805 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f0089caf-fcec-41bb-b6da-9f3a112b53e7 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1318 microversion: 2.1 time: 0.825313 Aug 25 12:40:03.681163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:03.699345 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 127/252] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:02 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1318 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:03.710763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:03.711461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:03.712397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:03.729673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e2549f07-f8be-472a-880e-8b3103da6892 tempest-NetworksTest-1186334367 tempest-NetworksTest-1186334367-project-admin] Calling method '.version_select at 0x7f3a2ae0edc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:03.732636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:03.741217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:03.744164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:03.796623 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.compute.aggregates [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 25 12:40:03.804424 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Request method failure captured: Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 42 Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21E3PNFqJayVHHWaAu8M2juxizrYL68WZIfy0xx8ufdvubABSUArlx63SfKifjMoCzPsGN32X7dFjk_0sIHdU0YLmMlGU3-WNvdRmhXkNzLaQ5ktJ_Fyq1jCEsWTux5fkRmDQqSB8KT7tZ4pQfGuu6VY3thUbRumQMpsXlupsX0YOI Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:40:03.809366 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72b01006125c41c5b5fe6eb06b0a784e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72b01006125c41c5b5fe6eb06b0a784e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72b01006125c41c5b5fe6eb06b0a784e"}]}] Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 72b01006125c41c5b5fe6eb06b0a784e Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413 Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 48ddaf2829494246afcecfc46efbb229 Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: {"remove_host": {"host": "nonexist_host"}} Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:03.812244 n-d-852771-8 devstack@n-api.service[129060]: exception: Cannot remove host nonexist_host in aggregate 15 Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 25 12:40:03.813695 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 25 12:40:03.826144 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:03.841759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:03.844040 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:03.844040 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:03.844040 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:03.844040 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:03.844040 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Aug 25 12:40:03.844040 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:03.844040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:03.844040 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-519f788e-de78-4c7d-9fc7-81bfb763d17b tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.152414 Aug 25 12:40:03.844040 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 126/253] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:40:03 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:40:03.849211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aeeeee50-040c-4b40-a08f-1162333d47d7 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:03.898287 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aeeeee50-040c-4b40-a08f-1162333d47d7 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.064247 Aug 25 12:40:03.899648 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 127/254] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:40:03 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:03.934487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c3b6a38-c553-4fab-a3cf-59f09fe19ae2 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:03.935752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1c3b6a38-c553-4fab-a3cf-59f09fe19ae2 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:03.965389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c3b6a38-c553-4fab-a3cf-59f09fe19ae2 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:03.966356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c3b6a38-c553-4fab-a3cf-59f09fe19ae2 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:03.967182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c3b6a38-c553-4fab-a3cf-59f09fe19ae2 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:03.968545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c3b6a38-c553-4fab-a3cf-59f09fe19ae2 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:03.969402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c3b6a38-c553-4fab-a3cf-59f09fe19ae2 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:03.970210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c3b6a38-c553-4fab-a3cf-59f09fe19ae2 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:04.384553 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e2549f07-f8be-472a-880e-8b3103da6892 tempest-NetworksTest-1186334367 tempest-NetworksTest-1186334367-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks" status: 200 len: 4023 microversion: 2.1 time: 0.683863 Aug 25 12:40:04.395789 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 128/255] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:40:03 2022] GET /compute/v2.1/os-networks => generated 4023 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:04.422939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6372487c-7c1a-4447-9017-e5d216fd6953 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:04.545156 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6372487c-7c1a-4447-9017-e5d216fd6953 tempest-AggregatesAdminNegativeTestJSON-1378199413 tempest-AggregatesAdminNegativeTestJSON-1378199413-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.157380 Aug 25 12:40:04.553452 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 129/256] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:40:04 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:40:04.648297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-334011dc-4b90-4399-8e0b-31ac745f84a5 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:04.808769 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-334011dc-4b90-4399-8e0b-31ac745f84a5 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.251109 Aug 25 12:40:04.811791 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 130/257] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:40:04 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:04.832052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7323e312-4f0f-4360-9d78-75395245923f req-f0df394e-80a0-47e8-b15e-99fb8eea3e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94869906-92c8-4f47-8bbe-740418482403", "tag": "a9951464-7c96-4193-8ea6-05975add11dd"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:04.880626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7323e312-4f0f-4360-9d78-75395245923f req-f0df394e-80a0-47e8-b15e-99fb8eea3e0b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:04.881497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7323e312-4f0f-4360-9d78-75395245923f req-f0df394e-80a0-47e8-b15e-99fb8eea3e0b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:04.885982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7323e312-4f0f-4360-9d78-75395245923f req-f0df394e-80a0-47e8-b15e-99fb8eea3e0b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:04.952180 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7323e312-4f0f-4360-9d78-75395245923f req-f0df394e-80a0-47e8-b15e-99fb8eea3e0b service nova] Creating event network-changed:a9951464-7c96-4193-8ea6-05975add11dd for instance 94869906-92c8-4f47-8bbe-740418482403 on n-h2-852771-8 Aug 25 12:40:04.973756 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7323e312-4f0f-4360-9d78-75395245923f req-f0df394e-80a0-47e8-b15e-99fb8eea3e0b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159246 Aug 25 12:40:04.984288 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 131/258] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:05.009375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8fadfb23-dcbe-4cf3-ba83-53f4dd944fd3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:05.011247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8fadfb23-dcbe-4cf3-ba83-53f4dd944fd3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:05.051651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fadfb23-dcbe-4cf3-ba83-53f4dd944fd3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:05.052539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fadfb23-dcbe-4cf3-ba83-53f4dd944fd3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:05.053350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fadfb23-dcbe-4cf3-ba83-53f4dd944fd3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:05.054902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fadfb23-dcbe-4cf3-ba83-53f4dd944fd3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:05.055565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fadfb23-dcbe-4cf3-ba83-53f4dd944fd3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:05.056425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fadfb23-dcbe-4cf3-ba83-53f4dd944fd3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:05.695401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1c3b6a38-c553-4fab-a3cf-59f09fe19ae2 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:05.721393 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1c3b6a38-c553-4fab-a3cf-59f09fe19ae2 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1319 microversion: 2.1 time: 1.807756 Aug 25 12:40:05.722797 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 128/259] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:03 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1319 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:05.752831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0796deb2-d191-4f93-b6e1-e9495ae1cd82 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:05.794325 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0796deb2-d191-4f93-b6e1-e9495ae1cd82 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.054732 Aug 25 12:40:05.809358 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 129/260] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:40:05 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:05.832038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-042ff5f9-8ecd-4bf0-8dee-43ad3f0569e3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:05.946696 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-042ff5f9-8ecd-4bf0-8dee-43ad3f0569e3 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.134794 Aug 25 12:40:05.957877 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 130/261] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:40:05 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:40:05.993925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81581810-4520-4e40-991f-f7957fabf54e tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-911474192", "availability_zone": "tempest-test_az-1058109876"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:06.029474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-81581810-4520-4e40-991f-f7957fabf54e tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Generated uuid 5d700c40-2d24-4931-a250-25a987e01bb3 for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:40:06.157112 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-81581810-4520-4e40-991f-f7957fabf54e tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.187591 Aug 25 12:40:06.163032 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 131/262] 10.222.0.70 () {60 vars in 1165 bytes} [Thu Aug 25 12:40:05 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:06.188905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2e42cce7-63bd-4d88-bc0d-e17bb509d39d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-911474192_new", "availability_zone": "tempest-test_az-1058109876_new"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:06.415739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10,nova_api:DELETE=7 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:06.489103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8fadfb23-dcbe-4cf3-ba83-53f4dd944fd3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:06.494294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e42cce7-63bd-4d88-bc0d-e17bb509d39d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:06.495339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e42cce7-63bd-4d88-bc0d-e17bb509d39d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:06.498696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e42cce7-63bd-4d88-bc0d-e17bb509d39d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:06.509274 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8fadfb23-dcbe-4cf3-ba83-53f4dd944fd3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1467 microversion: 2.1 time: 1.522415 Aug 25 12:40:06.522337 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 132/263] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:04 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1467 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:06.552399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:06.558948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0cd77486-aa17-4d5f-8bdf-0d717a88531c tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:06.564313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0cd77486-aa17-4d5f-8bdf-0d717a88531c tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:06.577639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd77486-aa17-4d5f-8bdf-0d717a88531c tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:06.578976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd77486-aa17-4d5f-8bdf-0d717a88531c tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:06.580800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd77486-aa17-4d5f-8bdf-0d717a88531c tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:06.583831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd77486-aa17-4d5f-8bdf-0d717a88531c tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:06.585179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd77486-aa17-4d5f-8bdf-0d717a88531c tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:06.586434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd77486-aa17-4d5f-8bdf-0d717a88531c tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:06.612453 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2e42cce7-63bd-4d88-bc0d-e17bb509d39d tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.435800 Aug 25 12:40:06.615874 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 132/264] 10.222.0.70 () {60 vars in 1173 bytes} [Thu Aug 25 12:40:06 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:06.665899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7cfcfb2-06e9-43dd-b2db-ad6adf232c25 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:06.694131 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b7cfcfb2-06e9-43dd-b2db-ad6adf232c25 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.066715 Aug 25 12:40:06.696084 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 133/265] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:40:06 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:06.716516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4fcb195b-ba45-4a7a-8513-bde92949c0ca tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:06.791632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:06.799629 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4fcb195b-ba45-4a7a-8513-bde92949c0ca tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.088264 Aug 25 12:40:06.808784 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 134/266] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:40:06 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:40:06.820640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-15949125-9879-42f7-b846-5612d4a61d05 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:06.834568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-15949125-9879-42f7-b846-5612d4a61d05 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:06.857445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15949125-9879-42f7-b846-5612d4a61d05 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:06.858972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15949125-9879-42f7-b846-5612d4a61d05 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:06.859831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15949125-9879-42f7-b846-5612d4a61d05 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:06.862376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15949125-9879-42f7-b846-5612d4a61d05 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:06.862609 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0cd77486-aa17-4d5f-8bdf-0d717a88531c tempest-DeleteServersAdminTestJSON-1108663786 tempest-DeleteServersAdminTestJSON-1108663786-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a/action" status: 202 len: 0 microversion: 2.1 time: 0.312263 Aug 25 12:40:06.863629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15949125-9879-42f7-b846-5612d4a61d05 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:06.864937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15949125-9879-42f7-b846-5612d4a61d05 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:06.865137 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 133/267] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:40:06 2022] POST /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:06.873813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec1401ff-8a3c-45bf-b36e-632a6527f1cd tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-509936792"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:06.884504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.aggregate [None req-ec1401ff-8a3c-45bf-b36e-632a6527f1cd tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Generated uuid 31203556-7801-4e28-904f-7e64584692f0 for aggregate {{(pid=129059) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:40:06.976389 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ec1401ff-8a3c-45bf-b36e-632a6527f1cd tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109545 Aug 25 12:40:06.977492 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 134/268] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 12:40:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:07.007137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:07.008369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:07.021964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:07.022885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:07.023700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:07.025108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:07.040170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:07.040170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:07.121768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:07.123761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:07.125305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:07.126502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lazy-loading 'fault' on Instance uuid 625b4b65-d6ac-472e-9406-ab2c8ffb900a {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:40:07.948305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-15949125-9879-42f7-b846-5612d4a61d05 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:07.974877 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-15949125-9879-42f7-b846-5612d4a61d05 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1319 microversion: 2.1 time: 1.163385 Aug 25 12:40:07.975968 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 135/269] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:06 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1319 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:07.999080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2fb506a8-b92a-4d1b-9c11-51c335294877 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:08.023418 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2fb506a8-b92a-4d1b-9c11-51c335294877 tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.045740 Aug 25 12:40:08.024492 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 136/270] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:40:07 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:08.054275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3eabdfd-2729-4ed3-bd6c-3f1e2d9a8c4a tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:08.110950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:08.118665 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a3eabdfd-2729-4ed3-bd6c-3f1e2d9a8c4a tempest-AggregatesAdminTestJSON-716316455 tempest-AggregatesAdminTestJSON-716316455-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.080574 Aug 25 12:40:08.133671 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 137/271] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:40:08 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 25 12:40:08.138436 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6dff7f02-f6c5-4b5a-ade3-9211e7841655 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1450 microversion: 2.1 time: 1.158870 Aug 25 12:40:08.139596 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 135/272] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:06 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1450 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:08.173193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:08.181258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:08.187018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ca3dbb3b-acb9-4f8b-a31e-4ca4b5e350d8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:08.190913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca3dbb3b-acb9-4f8b-a31e-4ca4b5e350d8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:08.199220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=82,nova_api:DELETE=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:08.218824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca3dbb3b-acb9-4f8b-a31e-4ca4b5e350d8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:08.219752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:08.223660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:08.224988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:08.228397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca3dbb3b-acb9-4f8b-a31e-4ca4b5e350d8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:08.229212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:08.229413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca3dbb3b-acb9-4f8b-a31e-4ca4b5e350d8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:08.230781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca3dbb3b-acb9-4f8b-a31e-4ca4b5e350d8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:08.231236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:08.231670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca3dbb3b-acb9-4f8b-a31e-4ca4b5e350d8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:08.232495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca3dbb3b-acb9-4f8b-a31e-4ca4b5e350d8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:08.233955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:08.305240 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] HTTP exception thrown: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Request method failure captured: Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 HTTP/1.1 Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB20_YxH35ek34PV3kZmhfWbZozh8fhQ3V_plLipo7JwWuc9cfHvAhs_Y8r8cpIFLdwmi9_zL7x2RFhDH3wQBAqUGg_MNPSqpqD0OkWWtyLjVukGs3ZB0IeTVjzTmElr8NnS08Y0TcHRKjXjiZuy3GsYrtUmQKrPRKl_iJ1mzKzUb-do Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 15549222652b470495c1febfc030c637 Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AggregatesAdminTestJSON-103703989 Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:08.317614 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15549222652b470495c1febfc030c637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_15549222652b470495c1febfc030c637", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/15549222652b470495c1febfc030c637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15549222652b470495c1febfc030c637"}]}] Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AggregatesAdminTestJSON-103703989 Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 15549222652b470495c1febfc030c637 Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-103703989 Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AggregatesAdminTestJSON-103703989-project Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e7f1a6e462af4936966f1d6b450aec72 Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AggregatesAdminTestJSON-103703989-project Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:40:08.323600 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '71e6e07f-4dab-45e8-af60-0efb39bc4c77'} Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:08.325081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:40:08.327438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:08.336650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Returning 404 to user: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:08.342676 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fc13b5dd-7465-4254-b45a-1d41e944c08b tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "DELETE /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 404 len: 111 microversion: 2.1 time: 0.203191 Aug 25 12:40:08.351455 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 138/273] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:40:08 2022] DELETE /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:08.365456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:08.367650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] [instance: 71e6e07f-4dab-45e8-af60-0efb39bc4c77] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:08.384189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca3dbb3b-acb9-4f8b-a31e-4ca4b5e350d8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:40:08.385122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:08.386427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:08.388532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:08.394823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:08.396045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:08.396870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:08.436446 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] HTTP exception thrown: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Request method failure captured: Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 HTTP/1.1 Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB20_YxH35ek34PV3kZmhfWbZozh8fhQ3V_plLipo7JwWuc9cfHvAhs_Y8r8cpIFLdwmi9_zL7x2RFhDH3wQBAqUGg_MNPSqpqD0OkWWtyLjVukGs3ZB0IeTVjzTmElr8NnS08Y0TcHRKjXjiZuy3GsYrtUmQKrPRKl_iJ1mzKzUb-do Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 15549222652b470495c1febfc030c637 Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AggregatesAdminTestJSON-103703989 Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:08.442313 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15549222652b470495c1febfc030c637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_15549222652b470495c1febfc030c637", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/15549222652b470495c1febfc030c637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15549222652b470495c1febfc030c637"}]}] Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AggregatesAdminTestJSON-103703989 Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 15549222652b470495c1febfc030c637 Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-103703989 Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AggregatesAdminTestJSON-103703989-project Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e7f1a6e462af4936966f1d6b450aec72 Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AggregatesAdminTestJSON-103703989-project Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:40:08.444275 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '71e6e07f-4dab-45e8-af60-0efb39bc4c77'} Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:08.444937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. Aug 25 12:40:08.446988 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:08.450950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] Returning 404 to user: Instance 71e6e07f-4dab-45e8-af60-0efb39bc4c77 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:08.462295 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b5c6aa38-2ea9-448d-8b0c-f2b70898d530 tempest-AggregatesAdminTestJSON-103703989 tempest-AggregatesAdminTestJSON-103703989-project] 10.222.0.70 "GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77" status: 404 len: 111 microversion: 2.1 time: 0.107950 Aug 25 12:40:08.464267 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 139/274] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:08 2022] GET /compute/v2.1/servers/71e6e07f-4dab-45e8-af60-0efb39bc4c77 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:08.898623 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ca3dbb3b-acb9-4f8b-a31e-4ca4b5e350d8 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "DELETE /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 204 len: 0 microversion: 2.1 time: 0.721272 Aug 25 12:40:08.900892 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 136/275] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:40:08 2022] DELETE /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:40:08.918751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:08.920928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:08.935405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:08.937413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:08.938868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:08.940763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:08.941616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:08.942469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:09.031835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f7a6dbd-c4c2-4eca-86f5-e13d45ff16a5 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:09.036639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f7a6dbd-c4c2-4eca-86f5-e13d45ff16a5 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:09.067039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f7a6dbd-c4c2-4eca-86f5-e13d45ff16a5 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:09.068858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f7a6dbd-c4c2-4eca-86f5-e13d45ff16a5 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:09.069949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f7a6dbd-c4c2-4eca-86f5-e13d45ff16a5 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:09.070636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:09.073230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:09.075836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:09.077429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lazy-loading 'fault' on Instance uuid 625b4b65-d6ac-472e-9406-ab2c8ffb900a {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:40:09.088214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f7a6dbd-c4c2-4eca-86f5-e13d45ff16a5 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:09.089357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f7a6dbd-c4c2-4eca-86f5-e13d45ff16a5 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:09.104480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f7a6dbd-c4c2-4eca-86f5-e13d45ff16a5 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:09.600800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:09.648586 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e9a1f347-0101-407f-9eec-b0d42ac0edb3 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1456 microversion: 2.1 time: 0.739394 Aug 25 12:40:09.658073 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 140/276] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:08 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1456 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:09.696401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2f7a6dbd-c4c2-4eca-86f5-e13d45ff16a5 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:09.714052 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f7a6dbd-c4c2-4eca-86f5-e13d45ff16a5 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1319 microversion: 2.1 time: 0.699928 Aug 25 12:40:09.716361 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 137/277] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:09 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1319 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:10.699068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:10.709329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:10.731191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:10.734933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:10.737748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:10.739418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:10.740123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:10.740763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:10.765370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0cb84e3e-8e01-4aeb-ac4b-eaaa6a6aaeaf tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:10.769075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0cb84e3e-8e01-4aeb-ac4b-eaaa6a6aaeaf tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:10.822218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cb84e3e-8e01-4aeb-ac4b-eaaa6a6aaeaf tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:10.822752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cb84e3e-8e01-4aeb-ac4b-eaaa6a6aaeaf tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:10.823577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cb84e3e-8e01-4aeb-ac4b-eaaa6a6aaeaf tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:10.825352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cb84e3e-8e01-4aeb-ac4b-eaaa6a6aaeaf tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:10.830821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cb84e3e-8e01-4aeb-ac4b-eaaa6a6aaeaf tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:10.831927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cb84e3e-8e01-4aeb-ac4b-eaaa6a6aaeaf tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:10.989201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:10.991466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:10.991466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:10.993261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lazy-loading 'fault' on Instance uuid 625b4b65-d6ac-472e-9406-ab2c8ffb900a {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:40:11.813054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0cb84e3e-8e01-4aeb-ac4b-eaaa6a6aaeaf tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:11.844195 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0cb84e3e-8e01-4aeb-ac4b-eaaa6a6aaeaf tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1319 microversion: 2.1 time: 1.087238 Aug 25 12:40:11.846035 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 138/278] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:10 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1319 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:11.959219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:11.984951 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29e5bdd1-3888-4b80-8b68-5bfeb22dd513 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1456 microversion: 2.1 time: 1.292076 Aug 25 12:40:11.994633 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 141/279] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:10 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1456 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:12.858612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-536a2b0e-0760-4c31-a96f-bf25f23fe857 req-569d6563-6ae4-4ef2-b3aa-6c1a99448220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625b4b65-d6ac-472e-9406-ab2c8ffb900a", "name": "network-vif-deleted", "tag": "b9520f72-4afa-48e3-adfb-21cffb3d340b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:12.896165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e50c12c1-cfa8-420a-868e-b3194edbd60a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:12.898767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e50c12c1-cfa8-420a-868e-b3194edbd60a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:12.928807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-536a2b0e-0760-4c31-a96f-bf25f23fe857 req-569d6563-6ae4-4ef2-b3aa-6c1a99448220 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:12.929418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-536a2b0e-0760-4c31-a96f-bf25f23fe857 req-569d6563-6ae4-4ef2-b3aa-6c1a99448220 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:12.932927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50c12c1-cfa8-420a-868e-b3194edbd60a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:12.933940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50c12c1-cfa8-420a-868e-b3194edbd60a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:12.934812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50c12c1-cfa8-420a-868e-b3194edbd60a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:12.936120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50c12c1-cfa8-420a-868e-b3194edbd60a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:12.937288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50c12c1-cfa8-420a-868e-b3194edbd60a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:12.940240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-536a2b0e-0760-4c31-a96f-bf25f23fe857 req-569d6563-6ae4-4ef2-b3aa-6c1a99448220 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:12.952647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50c12c1-cfa8-420a-868e-b3194edbd60a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:13.004775 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-536a2b0e-0760-4c31-a96f-bf25f23fe857 req-569d6563-6ae4-4ef2-b3aa-6c1a99448220 service nova] Creating event network-vif-deleted:b9520f72-4afa-48e3-adfb-21cffb3d340b for instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a on n-h1-852771-8 Aug 25 12:40:13.033702 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-536a2b0e-0760-4c31-a96f-bf25f23fe857 req-569d6563-6ae4-4ef2-b3aa-6c1a99448220 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184499 Aug 25 12:40:13.034769 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 139/280] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:13.091229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:13.093182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:13.119823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:13.121164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:13.122649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:13.124170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:13.125304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:13.126536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:13.289263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:13.290349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:13.291164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:13.291974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lazy-loading 'fault' on Instance uuid 625b4b65-d6ac-472e-9406-ab2c8ffb900a {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:40:13.476428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2458b3cda9c4335a143357ade484548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82cd279ba8840649f015c8c26589fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:13.509941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e50c12c1-cfa8-420a-868e-b3194edbd60a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:13.511260 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7be19c55-1078-4123-839d-cf50c94eab5d tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 200 len: 1286 microversion: 2.1 time: 0.460742 Aug 25 12:40:13.513763 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 140/281] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:13 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 1286 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:13.529044 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e50c12c1-cfa8-420a-868e-b3194edbd60a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1319 microversion: 2.1 time: 0.645477 Aug 25 12:40:13.531351 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 142/282] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:12 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:14.561733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:14.562853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:14.578725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:14.581961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7ef305e0-6261-435b-a7f0-e9d661b43d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:14.591343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7ef305e0-6261-435b-a7f0-e9d661b43d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:14.604687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:14.606156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:14.606904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:14.608217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:14.609118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:14.609944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:14.613742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ef305e0-6261-435b-a7f0-e9d661b43d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:14.614546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ef305e0-6261-435b-a7f0-e9d661b43d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:14.617681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ef305e0-6261-435b-a7f0-e9d661b43d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:14.618989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ef305e0-6261-435b-a7f0-e9d661b43d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:14.619929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ef305e0-6261-435b-a7f0-e9d661b43d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:14.621978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ef305e0-6261-435b-a7f0-e9d661b43d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:14.713030 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] HTTP exception thrown: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Request method failure captured: Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a HTTP/1.1 Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB20-tKWaEqYR1ofLWZ8fPXA3qLf7wxe8IA_O_mjTKoWX6fJSDV6ycqwtoqStHstaaxRu3ZxDUf0Mkwe8o75RjVWIE8O3EGWjyc2t_j-f6aKC9lnRlT2bRw9D1oQu3f-_Y-3iXzFGSQ80Ejz4Ub2rkj58J7_jRnnObCOauzV1AQo62Gg Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:14.716360 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f82cd279ba8840649f015c8c26589fab", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}] Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d2458b3cda9c4335a143357ade484548 Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:14.719307 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '625b4b65-d6ac-472e-9406-ab2c8ffb900a'} Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:14.721126 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:14.726401 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:14.731635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Returning 404 to user: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:14.731635 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6e79c96-2334-4292-b86b-08ce9804146e tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 404 len: 111 microversion: 2.1 time: 0.179750 Aug 25 12:40:14.731635 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 143/283] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:14 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:14.754143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:14.755700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:14.780608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:14.781466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:14.782325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:14.784153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:14.785152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:14.786819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:14.869782 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] HTTP exception thrown: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Request method failure captured: Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a HTTP/1.1 Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB20-tKWaEqYR1ofLWZ8fPXA3qLf7wxe8IA_O_mjTKoWX6fJSDV6ycqwtoqStHstaaxRu3ZxDUf0Mkwe8o75RjVWIE8O3EGWjyc2t_j-f6aKC9lnRlT2bRw9D1oQu3f-_Y-3iXzFGSQ80Ejz4Ub2rkj58J7_jRnnObCOauzV1AQo62Gg Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:14.889171 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f82cd279ba8840649f015c8c26589fab", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}] Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d2458b3cda9c4335a143357ade484548 Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:14.891801 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '625b4b65-d6ac-472e-9406-ab2c8ffb900a'} Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:14.893066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:14.895289 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:14.897316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Returning 404 to user: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:14.901580 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-390bb1a7-5370-4464-8298-a167fa8ce582 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "DELETE /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 404 len: 111 microversion: 2.1 time: 0.162149 Aug 25 12:40:14.912459 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 144/284] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:40:14 2022] DELETE /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:14.950537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:14.956115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: 625b4b65-d6ac-472e-9406-ab2c8ffb900a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:14.984540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:14.986442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:14.991114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:14.994063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:15.001387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:15.005110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:15.092429 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] HTTP exception thrown: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Request method failure captured: Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a HTTP/1.1 Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB20-tKWaEqYR1ofLWZ8fPXA3qLf7wxe8IA_O_mjTKoWX6fJSDV6ycqwtoqStHstaaxRu3ZxDUf0Mkwe8o75RjVWIE8O3EGWjyc2t_j-f6aKC9lnRlT2bRw9D1oQu3f-_Y-3iXzFGSQ80Ejz4Ub2rkj58J7_jRnnObCOauzV1AQo62Gg Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:15.096028 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f82cd279ba8840649f015c8c26589fab", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}] Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d2458b3cda9c4335a143357ade484548 Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:15.098471 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '625b4b65-d6ac-472e-9406-ab2c8ffb900a'} Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:15.099693 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. Aug 25 12:40:15.102198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.104196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Returning 404 to user: Instance 625b4b65-d6ac-472e-9406-ab2c8ffb900a could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:15.112648 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-19613a14-2891-4043-9bdc-d7a18dbc57ba tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a" status: 404 len: 111 microversion: 2.1 time: 0.193449 Aug 25 12:40:15.121079 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 145/285] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:14 2022] GET /compute/v2.1/servers/625b4b65-d6ac-472e-9406-ab2c8ffb900a => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:15.137267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:15.138131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:15.160107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:15.170693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:15.175426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:15.180581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:15.185870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:15.187192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:15.229639 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] HTTP exception thrown: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Request method failure captured: Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd HTTP/1.1 Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB20-tKWaEqYR1ofLWZ8fPXA3qLf7wxe8IA_O_mjTKoWX6fJSDV6ycqwtoqStHstaaxRu3ZxDUf0Mkwe8o75RjVWIE8O3EGWjyc2t_j-f6aKC9lnRlT2bRw9D1oQu3f-_Y-3iXzFGSQ80Ejz4Ub2rkj58J7_jRnnObCOauzV1AQo62Gg Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:15.234763 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f82cd279ba8840649f015c8c26589fab", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}] Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d2458b3cda9c4335a143357ade484548 Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:40:15.237850 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd'} Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:15.239053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:40:15.241136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.247433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Returning 404 to user: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:15.254302 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-11aa45f2-29b2-4106-b3f8-32520c718af1 tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 404 len: 111 microversion: 2.1 time: 0.124370 Aug 25 12:40:15.254302 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 146/286] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:40:15 2022] DELETE /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:15.282845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:15.285614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] [instance: b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:15.311519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:15.312278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:15.312951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:15.323435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:15.325092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:15.325872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:15.408307 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] HTTP exception thrown: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Request method failure captured: Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd HTTP/1.1 Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB20-tKWaEqYR1ofLWZ8fPXA3qLf7wxe8IA_O_mjTKoWX6fJSDV6ycqwtoqStHstaaxRu3ZxDUf0Mkwe8o75RjVWIE8O3EGWjyc2t_j-f6aKC9lnRlT2bRw9D1oQu3f-_Y-3iXzFGSQ80Ejz4Ub2rkj58J7_jRnnObCOauzV1AQo62Gg Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:15.413206 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f82cd279ba8840649f015c8c26589fab", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f82cd279ba8840649f015c8c26589fab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f82cd279ba8840649f015c8c26589fab"}]}] Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f82cd279ba8840649f015c8c26589fab Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-310567637 Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d2458b3cda9c4335a143357ade484548 Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersAdminTestJSON-310567637-project Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:40:15.415905 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd'} Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:15.417221 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. Aug 25 12:40:15.419679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:15.422459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] Returning 404 to user: Instance b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:15.422459 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f219ea09-1d03-4e9a-809a-78f16a93024f tempest-DeleteServersAdminTestJSON-310567637 tempest-DeleteServersAdminTestJSON-310567637-project] 10.222.0.70 "GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd" status: 404 len: 111 microversion: 2.1 time: 0.154175 Aug 25 12:40:15.422459 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 147/287] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:15 2022] GET /compute/v2.1/servers/b8db66b8-3bb5-42a8-bd28-6dd1a37b78cd => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:15.583166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7ef305e0-6261-435b-a7f0-e9d661b43d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:15.608749 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7ef305e0-6261-435b-a7f0-e9d661b43d4a tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1319 microversion: 2.1 time: 1.038067 Aug 25 12:40:15.615025 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 141/288] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:14 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1319 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:16.687526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b1486a7-d83b-4207-ab8c-37e638402e38 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:16.687526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b1486a7-d83b-4207-ab8c-37e638402e38 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:16.703539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b1486a7-d83b-4207-ab8c-37e638402e38 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:16.719737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b1486a7-d83b-4207-ab8c-37e638402e38 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:16.723314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b1486a7-d83b-4207-ab8c-37e638402e38 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:16.726466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b1486a7-d83b-4207-ab8c-37e638402e38 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:16.727915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b1486a7-d83b-4207-ab8c-37e638402e38 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:16.733625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b1486a7-d83b-4207-ab8c-37e638402e38 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:16.761884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-e0ceb2df-2d17-4426-8a46-ee6474f2db67 req-e9559fb4-9540-45f0-bf0a-b4df20ba3714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94869906-92c8-4f47-8bbe-740418482403", "name": "network-vif-plugged", "status": "completed", "tag": "a9951464-7c96-4193-8ea6-05975add11dd"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:16.834820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e0ceb2df-2d17-4426-8a46-ee6474f2db67 req-e9559fb4-9540-45f0-bf0a-b4df20ba3714 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:16.840107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e0ceb2df-2d17-4426-8a46-ee6474f2db67 req-e9559fb4-9540-45f0-bf0a-b4df20ba3714 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:16.841430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e0ceb2df-2d17-4426-8a46-ee6474f2db67 req-e9559fb4-9540-45f0-bf0a-b4df20ba3714 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:16.902678 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-e0ceb2df-2d17-4426-8a46-ee6474f2db67 req-e9559fb4-9540-45f0-bf0a-b4df20ba3714 service nova] Creating event network-vif-plugged:a9951464-7c96-4193-8ea6-05975add11dd for instance 94869906-92c8-4f47-8bbe-740418482403 on n-h2-852771-8 Aug 25 12:40:16.924675 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-e0ceb2df-2d17-4426-8a46-ee6474f2db67 req-e9559fb4-9540-45f0-bf0a-b4df20ba3714 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172108 Aug 25 12:40:16.930606 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 142/289] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:17.742996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b1486a7-d83b-4207-ab8c-37e638402e38 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:17.770253 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b1486a7-d83b-4207-ab8c-37e638402e38 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1319 microversion: 2.1 time: 1.117327 Aug 25 12:40:17.777106 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 148/290] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:16 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1319 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:18.855662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e7c7a845-4033-45d2-8979-635897f31400 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:18.856689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e7c7a845-4033-45d2-8979-635897f31400 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:18.869964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7c7a845-4033-45d2-8979-635897f31400 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:18.871764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7c7a845-4033-45d2-8979-635897f31400 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:18.873632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7c7a845-4033-45d2-8979-635897f31400 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:18.893223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7c7a845-4033-45d2-8979-635897f31400 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:18.896592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7c7a845-4033-45d2-8979-635897f31400 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:18.897446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7c7a845-4033-45d2-8979-635897f31400 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:19.078140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e646f174-3e01-482a-930c-872e88c39b9e tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890 tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:19.089194 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-e646f174-3e01-482a-930c-872e88c39b9e tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890 tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e646f174-3e01-482a-930c-872e88c39b9e tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890 tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890-project-admin] Request method failure captured: Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB22xXJ5WpfoyTUPpfL__TdDaHExhN7hRuGeBMgROT9ZoXTY13p0gqD0yczc_RRxufoPdtuKwAwIdes-q99HfoJrFhZZ9b1miXte8GlWCTiB7SkQBaH8R0obtf4rnTNMdl0fHbnx4UYhvvPfz-htjhLW69jtZPUNgEW_F2jme1m9OW-Q Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 611b38f79b8b43bb82c5025e217e613c Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890 Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:19.111377 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611b38f79b8b43bb82c5025e217e613c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611b38f79b8b43bb82c5025e217e613c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611b38f79b8b43bb82c5025e217e613c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611b38f79b8b43bb82c5025e217e613c"}]}] Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890 Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 611b38f79b8b43bb82c5025e217e613c Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890 Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890-project-admin Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 235d7947604a48bcb30ce9e30956702c Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890-project-admin Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:40:19.116146 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid timestamp for date invalid_time Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'invalid_time'} Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:19.117838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e646f174-3e01-482a-930c-872e88c39b9e tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890 tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:19.137428 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e646f174-3e01-482a-930c-872e88c39b9e tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890 tempest-InstanceUsageAuditLogNegativeTestJSON-1162546890-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 1.327900 Aug 25 12:40:19.141860 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 143/291] 10.222.0.70 () {58 vars in 1224 bytes} [Thu Aug 25 12:40:17 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 1338 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:40:19.602936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e7c7a845-4033-45d2-8979-635897f31400 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:19.626068 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e7c7a845-4033-45d2-8979-635897f31400 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1319 microversion: 2.1 time: 0.791076 Aug 25 12:40:19.634206 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 149/292] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:18 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1319 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:20.675253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d815e425-10c4-4d4c-a2f5-3b9d99eb6c56 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:20.676323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d815e425-10c4-4d4c-a2f5-3b9d99eb6c56 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:20.692338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e083aa4-2dbe-4325-bf57-66478a1dccc3 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:20.702169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e083aa4-2dbe-4325-bf57-66478a1dccc3 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ac649729995841c9b57d94e873f49e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d0d088ce475a8da8349700a1f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e083aa4-2dbe-4325-bf57-66478a1dccc3 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project] Request method failure captured: Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB22setKqwj9sZcG5N56CWhh6u6QCwi5hSnTmiotZpkQUshDUhkGvY1EXRiISEuQR1KaPKzbBVHdRw-e-flocIxJSHlFeRIhbLVLNqIbFu8ICCJ_z49XaYg0EVJ-zEBnDFA-o3kZoKhAZnX3sUdFgZYdmevuUvl0FP5q3isU_7HUIvPA Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5473d0d088ce475a8da8349700a1f829 Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:40:20.712900 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d0d088ce475a8da8349700a1f829"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5473d0d088ce475a8da8349700a1f829", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5473d0d088ce475a8da8349700a1f829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d0d088ce475a8da8349700a1f829"}]}] Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5473d0d088ce475a8da8349700a1f829 Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: ac649729995841c9b57d94e873f49e87 Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:40:20.715320 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: action_args: {} Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:20.716543 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:20.722519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e083aa4-2dbe-4325-bf57-66478a1dccc3 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:20.730715 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6e083aa4-2dbe-4325-bf57-66478a1dccc3 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 1.576471 Aug 25 12:40:20.730983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d815e425-10c4-4d4c-a2f5-3b9d99eb6c56 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:20.730983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d815e425-10c4-4d4c-a2f5-3b9d99eb6c56 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:20.730983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d815e425-10c4-4d4c-a2f5-3b9d99eb6c56 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:20.730983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d815e425-10c4-4d4c-a2f5-3b9d99eb6c56 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:20.731870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d815e425-10c4-4d4c-a2f5-3b9d99eb6c56 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:20.731870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d815e425-10c4-4d4c-a2f5-3b9d99eb6c56 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:20.734868 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 144/293] 10.222.0.70 () {58 vars in 1185 bytes} [Thu Aug 25 12:40:19 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 1597 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:20.758428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3b9e81ee-bcf3-49b4-a5bc-7110a92813df tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:20.763520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3b9e81ee-bcf3-49b4-a5bc-7110a92813df tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ac649729995841c9b57d94e873f49e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d0d088ce475a8da8349700a1f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3b9e81ee-bcf3-49b4-a5bc-7110a92813df tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project] Request method failure captured: Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-25%2012:40:20 HTTP/1.1 Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB22setKqwj9sZcG5N56CWhh6u6QCwi5hSnTmiotZpkQUshDUhkGvY1EXRiISEuQR1KaPKzbBVHdRw-e-flocIxJSHlFeRIhbLVLNqIbFu8ICCJ_z49XaYg0EVJ-zEBnDFA-o3kZoKhAZnX3sUdFgZYdmevuUvl0FP5q3isU_7HUIvPA Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5473d0d088ce475a8da8349700a1f829 Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:40:20.772203 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d0d088ce475a8da8349700a1f829"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5473d0d088ce475a8da8349700a1f829", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5473d0d088ce475a8da8349700a1f829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d0d088ce475a8da8349700a1f829"}]}] Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5473d0d088ce475a8da8349700a1f829 Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: ac649729995841c9b57d94e873f49e87 Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:40:20.775506 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '2022-08-25 12:40:20'} Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:20.776940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 25 12:40:20.779749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:20.793238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3b9e81ee-bcf3-49b4-a5bc-7110a92813df tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:20.795375 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3b9e81ee-bcf3-49b4-a5bc-7110a92813df tempest-InstanceUsageAuditLogNegativeTestJSON-85759611 tempest-InstanceUsageAuditLogNegativeTestJSON-85759611-project] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-25 12:40:20" status: 403 len: 128 microversion: 2.1 time: 0.057766 Aug 25 12:40:20.797543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 145/294] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 12:40:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-25%2012%3A40%3A20 => generated 128 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:21.440253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d815e425-10c4-4d4c-a2f5-3b9d99eb6c56 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:21.474687 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d815e425-10c4-4d4c-a2f5-3b9d99eb6c56 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1468 microversion: 2.1 time: 0.806214 Aug 25 12:40:21.487015 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 150/295] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:20 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1468 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:21.556518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c7ade885-61de-4932-9644-c67401df78c3 tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:21.560296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c7ade885-61de-4932-9644-c67401df78c3 tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:21.581029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ade885-61de-4932-9644-c67401df78c3 tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:21.583052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ade885-61de-4932-9644-c67401df78c3 tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:21.592857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ade885-61de-4932-9644-c67401df78c3 tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:21.592857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ade885-61de-4932-9644-c67401df78c3 tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:21.592857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ade885-61de-4932-9644-c67401df78c3 tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:21.592857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ade885-61de-4932-9644-c67401df78c3 tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:21.682597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-c7ade885-61de-4932-9644-c67401df78c3 tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lazy-loading 'flavor' on Instance uuid 94869906-92c8-4f47-8bbe-740418482403 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:40:22.206528 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c7ade885-61de-4932-9644-c67401df78c3 tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403/action" status: 202 len: 0 microversion: 2.1 time: 0.660841 Aug 25 12:40:22.207707 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 146/296] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:40:21 2022] POST /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:22.249658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5ed7138d-77ea-4587-9c73-28b118327257 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:22.256248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5ed7138d-77ea-4587-9c73-28b118327257 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:22.287108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ed7138d-77ea-4587-9c73-28b118327257 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:22.290657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ed7138d-77ea-4587-9c73-28b118327257 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:22.297778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ed7138d-77ea-4587-9c73-28b118327257 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:22.306537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ed7138d-77ea-4587-9c73-28b118327257 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:22.312182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ed7138d-77ea-4587-9c73-28b118327257 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:22.314966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ed7138d-77ea-4587-9c73-28b118327257 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:23.463821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5ed7138d-77ea-4587-9c73-28b118327257 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:23.502821 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5ed7138d-77ea-4587-9c73-28b118327257 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1476 microversion: 2.1 time: 1.280847 Aug 25 12:40:23.504859 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 151/297] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:22 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1476 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:24.554579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-78451739-87bf-4688-9f5e-452332037bd8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:24.555865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-78451739-87bf-4688-9f5e-452332037bd8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:24.586766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78451739-87bf-4688-9f5e-452332037bd8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:24.588262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78451739-87bf-4688-9f5e-452332037bd8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:24.589287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78451739-87bf-4688-9f5e-452332037bd8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:24.592240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78451739-87bf-4688-9f5e-452332037bd8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:24.593278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78451739-87bf-4688-9f5e-452332037bd8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:24.594183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78451739-87bf-4688-9f5e-452332037bd8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:25.456138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eab424d8-8aaf-4a09-89b1-2a429db9dbcd tempest-QuotaClassesAdmin257Test-1621124645 tempest-QuotaClassesAdmin257Test-1621124645-project-admin] Calling method '.version_select at 0x7f3a2adc6dc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:25.523394 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eab424d8-8aaf-4a09-89b1-2a429db9dbcd tempest-QuotaClassesAdmin257Test-1621124645 tempest-QuotaClassesAdmin257Test-1621124645-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 1.052322 Aug 25 12:40:25.525650 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 147/298] 10.222.0.70 () {60 vars in 1226 bytes} [Thu Aug 25 12:40:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:40:25.575115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-78451739-87bf-4688-9f5e-452332037bd8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:25.604349 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-78451739-87bf-4688-9f5e-452332037bd8 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1459 microversion: 2.1 time: 1.058951 Aug 25 12:40:25.624634 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 152/299] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:24 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1459 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:25.651296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-001bb605-d4ad-4040-8eed-e665abafc436 tempest-QuotaClassesAdmin257Test-1621124645 tempest-QuotaClassesAdmin257Test-1621124645-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2af6e4c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:26.243062 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-001bb605-d4ad-4040-8eed-e665abafc436 tempest-QuotaClassesAdmin257Test-1621124645 tempest-QuotaClassesAdmin257Test-1621124645-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.611339 Aug 25 12:40:26.247235 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 153/300] 10.222.0.70 () {62 vars in 1247 bytes} [Thu Aug 25 12:40:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:40:26.264695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3cd2b0f9-c08a-4b13-8a93-4b9c8f1717fd tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:26.272423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3cd2b0f9-c08a-4b13-8a93-4b9c8f1717fd tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:26.300089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd2b0f9-c08a-4b13-8a93-4b9c8f1717fd tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:26.305846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd2b0f9-c08a-4b13-8a93-4b9c8f1717fd tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:26.308052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd2b0f9-c08a-4b13-8a93-4b9c8f1717fd tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:26.311681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd2b0f9-c08a-4b13-8a93-4b9c8f1717fd tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:26.312983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd2b0f9-c08a-4b13-8a93-4b9c8f1717fd tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:26.313375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd2b0f9-c08a-4b13-8a93-4b9c8f1717fd tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:26.381372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e954dfd5-7f41-4726-bf83-fa781cd9ef2c tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-319387025", "id": 1245882714, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:26.467419 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e954dfd5-7f41-4726-bf83-fa781cd9ef2c tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.939701 Aug 25 12:40:26.473819 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 148/301] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:25 2022] POST /compute/v2.1/flavors => generated 429 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:26.497259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0488690e-9a09-4b7f-b0a3-0393f33cfee5 tempest-QuotaClassesAdmin257Test-1621124645 tempest-QuotaClassesAdmin257Test-1621124645-project-admin] Calling method '.version_select at 0x7f3a2ae5d9d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:26.551744 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0488690e-9a09-4b7f-b0a3-0393f33cfee5 tempest-QuotaClassesAdmin257Test-1621124645 tempest-QuotaClassesAdmin257Test-1621124645-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.075497 Aug 25 12:40:26.568517 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 149/302] 10.222.0.70 () {60 vars in 1226 bytes} [Thu Aug 25 12:40:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:40:26.600524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8aca107c-cffe-4cfd-8cfe-b2659637a103 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:26.697925 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8aca107c-cffe-4cfd-8cfe-b2659637a103 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1245882714" status: 202 len: 0 microversion: 2.1 time: 0.127094 Aug 25 12:40:26.702062 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 150/303] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:40:26 2022] DELETE /compute/v2.1/flavors/1245882714 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:26.751262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-372b2497-24bf-441e-b668-7b55ea2e12c7 tempest-QuotaClassesAdmin257Test-1621124645 tempest-QuotaClassesAdmin257Test-1621124645-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2ae0e9d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:26.975831 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-372b2497-24bf-441e-b668-7b55ea2e12c7 tempest-QuotaClassesAdmin257Test-1621124645 tempest-QuotaClassesAdmin257Test-1621124645-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.264326 Aug 25 12:40:26.977748 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 151/304] 10.222.0.70 () {62 vars in 1247 bytes} [Thu Aug 25 12:40:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:40:26.996704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7feeb43-f988-4939-b54e-b3458697bd90 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:27.124035 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a7feeb43-f988-4939-b54e-b3458697bd90 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.143992 Aug 25 12:40:27.125442 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 152/305] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:26 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:27.186845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-82384082-aa57-4ea5-8975-c19e80de5946 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1991513905", "id": 1825266825, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:27.247680 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-82384082-aa57-4ea5-8975-c19e80de5946 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.069586 Aug 25 12:40:27.260879 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 153/306] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:27 2022] POST /compute/v2.1/flavors => generated 417 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:40:27.279511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3302cd4c-a738-4d93-8209-4facc922e433 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:27.381702 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3302cd4c-a738-4d93-8209-4facc922e433 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6228 microversion: 2.1 time: 0.115652 Aug 25 12:40:27.393558 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 154/307] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:27 2022] GET /compute/v2.1/flavors/detail => generated 6228 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:27.432082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ebb89729-d0e8-4d6b-8058-42bc21c5176b tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:27.509759 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ebb89729-d0e8-4d6b-8058-42bc21c5176b tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1825266825" status: 202 len: 0 microversion: 2.1 time: 0.093221 Aug 25 12:40:27.514848 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 155/308] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:40:27 2022] DELETE /compute/v2.1/flavors/1825266825 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:40:27.543244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a0db5b54-57e6-417c-8e1e-d5e4eb01d513 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:27.655854 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a0db5b54-57e6-417c-8e1e-d5e4eb01d513 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.131186 Aug 25 12:40:27.663522 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 156/309] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:27 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:27.710350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff2f20d0-736a-4934-9517-ce159358193f tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-931567294", "id": 887601895, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:27.822435 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff2f20d0-736a-4934-9517-ce159358193f tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.102935 Aug 25 12:40:27.835160 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 157/310] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:27 2022] POST /compute/v2.1/flavors => generated 425 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:40:27.885598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3d06a21c-01f6-497c-993d-fbecf6d20454 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:27.966797 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3d06a21c-01f6-497c-993d-fbecf6d20454 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/887601895" status: 202 len: 0 microversion: 2.1 time: 0.108304 Aug 25 12:40:27.968752 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 158/311] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 12:40:27 2022] DELETE /compute/v2.1/flavors/887601895 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:40:28.001200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-46fcbc5e-7bc6-4119-abe4-9cc4d52719ef tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:28.131303 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-46fcbc5e-7bc6-4119-abe4-9cc4d52719ef tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.153728 Aug 25 12:40:28.132801 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 159/312] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:27 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:28.181973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-29a0e099-531e-481b-b8b2-d2edc6070e64 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-567083667", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:28.245391 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-29a0e099-531e-481b-b8b2-d2edc6070e64 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.071872 Aug 25 12:40:28.257566 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 160/313] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:28 2022] POST /compute/v2.1/flavors => generated 506 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:28.272213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d8258655-81f7-4f92-af46-9647872566e4 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:28.349083 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d8258655-81f7-4f92-af46-9647872566e4 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/72f40976-ff6e-4cc3-bbfa-c2db8a794e24" status: 202 len: 0 microversion: 2.1 time: 0.084291 Aug 25 12:40:28.350647 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 161/314] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:40:28 2022] DELETE /compute/v2.1/flavors/72f40976-ff6e-4cc3-bbfa-c2db8a794e24 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:28.367680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-afb3cbf6-d050-4593-903b-c6a821bc02ed tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:28.479624 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-afb3cbf6-d050-4593-903b-c6a821bc02ed tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.121962 Aug 25 12:40:28.481189 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 162/315] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:28 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:28.521119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2cd60272-a3ef-45a7-a18f-b527767c2b93 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2011325693", "id": "c8d34b5c-4c50-4964-b83c-7538748fc4b2", "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:28.587316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=8,nova_api:INSERT=5,nova_api:DELETE=12 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:28.591747 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2cd60272-a3ef-45a7-a18f-b527767c2b93 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.078409 Aug 25 12:40:28.593732 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 163/316] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:28 2022] POST /compute/v2.1/flavors => generated 507 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:28.618893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6616a02f-7ae6-4dad-91f2-e036124c5874 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:28.639330 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3cd2b0f9-c08a-4b13-8a93-4b9c8f1717fd tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1610 microversion: 2.1 time: 2.388129 Aug 25 12:40:28.662310 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 154/317] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:26 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1610 bytes in 2401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:28.687284 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6616a02f-7ae6-4dad-91f2-e036124c5874 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/c8d34b5c-4c50-4964-b83c-7538748fc4b2" status: 202 len: 0 microversion: 2.1 time: 0.077303 Aug 25 12:40:28.687612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c0c18359-d658-4365-97f7-2b2cbc5ab5fa tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:28.692556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 164/318] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:40:28 2022] DELETE /compute/v2.1/flavors/c8d34b5c-4c50-4964-b83c-7538748fc4b2 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:40:28.698722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0c18359-d658-4365-97f7-2b2cbc5ab5fa tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:28.699975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0c18359-d658-4365-97f7-2b2cbc5ab5fa tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:28.701090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0c18359-d658-4365-97f7-2b2cbc5ab5fa tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:28.703132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0c18359-d658-4365-97f7-2b2cbc5ab5fa tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:28.704248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0c18359-d658-4365-97f7-2b2cbc5ab5fa tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:28.705897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0c18359-d658-4365-97f7-2b2cbc5ab5fa tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:28.710139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-971d7847-ad47-4d4a-81d5-f62912796eef tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:28.775992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=9,nova_api:DELETE=4,nova_api:INSERT=7 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:28.795214 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-971d7847-ad47-4d4a-81d5-f62912796eef tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.095473 Aug 25 12:40:28.803810 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c0c18359-d658-4365-97f7-2b2cbc5ab5fa tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.125362 Aug 25 12:40:28.818308 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 165/320] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:28 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:28.818720 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 155/320] 10.222.0.70 () {58 vars in 1176 bytes} [Thu Aug 25 12:40:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:40:28.830125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852771-8", "block_migration": true, "disk_over_commit": false}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:28.852251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4af050e1-b422-4996-9543-46db61c0f0fe tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1569619728", "id": 1939188915, "os-flavor-access:is_public": "True"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:28.854418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:28.885125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:28.892169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:28.893831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:28.895809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:28.897206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:28.906488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:28.935395 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4af050e1-b422-4996-9543-46db61c0f0fe tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.092330 Aug 25 12:40:28.941336 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 156/321] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:28 2022] POST /compute/v2.1/flavors => generated 414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:28.965973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2de9ec45-4bd2-4079-a15d-b9d8613c205e tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:29.002973 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2de9ec45-4bd2-4079-a15d-b9d8613c205e tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1939188915" status: 200 len: 414 microversion: 2.1 time: 0.046325 Aug 25 12:40:29.006068 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 157/322] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 12:40:28 2022] GET /compute/v2.1/flavors/1939188915 => generated 414 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:40:29.070367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:30.106033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97d0471c-5b39-4a13-8bec-e32d7b075e24 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:30.247703 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-97d0471c-5b39-4a13-8bec-e32d7b075e24 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 1.228406 Aug 25 12:40:30.248814 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 158/323] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:29 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:30.287954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c8ee30f2-4ac5-4dbf-b94d-32ea5d22c205 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:30.400280 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c8ee30f2-4ac5-4dbf-b94d-32ea5d22c205 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1939188915" status: 202 len: 0 microversion: 2.1 time: 0.116637 Aug 25 12:40:30.402094 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 159/324] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:40:30 2022] DELETE /compute/v2.1/flavors/1939188915 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:40:30.422054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e0aa2ec4-ec4f-4d63-8268-c3acd98efe91 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:30.479397 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e0aa2ec4-ec4f-4d63-8268-c3acd98efe91 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.069269 Aug 25 12:40:30.481333 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 160/325] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:30 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:30.527600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-629ac119-3500-4662-aa5e-0fa921481868 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1468482852", "id": 2021744732, "os-flavor-access:is_public": "False"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:30.621341 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-629ac119-3500-4662-aa5e-0fa921481868 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.100724 Aug 25 12:40:30.636989 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 161/326] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:30 2022] POST /compute/v2.1/flavors => generated 430 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:30.668363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ca03dcc-a65b-4e9d-b218-74d69595e596 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "2021744732"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:30.703463 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-4ca03dcc-a65b-4e9d-b218-74d69595e596 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] HTTP exception thrown: Flavor 2021744732 could not be found. Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ca03dcc-a65b-4e9d-b218-74d69595e596 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] Request method failure captured: Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 107 Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB22zvcmtwmkMjNZRWO74-NfwntM0FSnbVj8RkTbzm6D4c2Oph01pWpUgQ17gycjmcgHyxz652qyZKyEuLaEknViT7ylGbeMRPb4AnNA9aHqHcA_3atb2njw0oB3v8g2PLS-f9yhXTwvmBwft6bdULMJxNZhMZN2ppxQYAmo0JnIp3HY Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 9b6d358af202446280fd889a419bffc5 Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FlavorsAdminTestJSON-2033916429 Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:30.710646 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9b6d358af202446280fd889a419bffc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9b6d358af202446280fd889a419bffc5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9b6d358af202446280fd889a419bffc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9b6d358af202446280fd889a419bffc5"}]}] Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FlavorsAdminTestJSON-2033916429 Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 9b6d358af202446280fd889a419bffc5 Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2033916429 Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FlavorsAdminTestJSON-2033916429-project Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 7d3d17327b684c03abfc65d8b9b0f961 Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FlavorsAdminTestJSON-2033916429-project Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "test", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "2021744732"}} Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:30.712687 n-d-852771-8 devstack@n-api.service[129060]: exception: Flavor 2021744732 could not be found. Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '2021744732'}}} Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2021744732 could not be found. Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:30.714280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2021744732 could not be found. Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:30.724712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:30.727899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:30.727899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:30.727899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:30.727899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2021744732 could not be found. Aug 25 12:40:30.727899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:30.727899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ca03dcc-a65b-4e9d-b218-74d69595e596 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] Returning 400 to user: Flavor 2021744732 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:30.727899 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ca03dcc-a65b-4e9d-b218-74d69595e596 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.072414 Aug 25 12:40:30.727899 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 162/327] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:30 2022] POST /compute/v2.1/servers => generated 81 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:40:30.743256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9cbae37f-bd4d-46b3-84ca-d4d17566c6f2 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:30.798668 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9cbae37f-bd4d-46b3-84ca-d4d17566c6f2 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/2021744732" status: 202 len: 0 microversion: 2.1 time: 0.072786 Aug 25 12:40:30.804935 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 163/328] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:40:30 2022] DELETE /compute/v2.1/flavors/2021744732 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:30.824260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2c87575f-d26c-4623-9cac-98f9a34cf8cb tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:30.895565 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2c87575f-d26c-4623-9cac-98f9a34cf8cb tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.084098 Aug 25 12:40:30.897478 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 164/329] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:30 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:30.948255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c2d3c7ac-412a-4995-a94a-eb8f6cd8003f tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1686774939", "id": 186310305, "os-flavor-access:is_public": "False"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:31.014362 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c2d3c7ac-412a-4995-a94a-eb8f6cd8003f tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.081178 Aug 25 12:40:31.016037 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 165/330] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:30 2022] POST /compute/v2.1/flavors => generated 412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:40:31.044379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d389510-283f-45d3-a759-080432e5de51 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-922338332", "id": 704308577, "os-flavor-access:is_public": "True"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:31.104053 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5d389510-283f-45d3-a759-080432e5de51 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.073843 Aug 25 12:40:31.105203 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 166/331] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:31 2022] POST /compute/v2.1/flavors => generated 410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:31.108935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Lazy-loading 'flavor' on Instance uuid 94869906-92c8-4f47-8bbe-740418482403 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:40:31.146431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e830e3d4-1d1e-4800-952b-9a3c063101d8 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:31.162953 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 94869906-92c8-4f47-8bbe-740418482403 while it is in vm_state suspended Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Request method failure captured: Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403/action HTTP/1.1 Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 97 Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21wBj2ybtGET7tt8S2V1IzgE8NkssFQdgCVpdo9HkaqsDr2NzSYHv6FmtiqEYVsgVLk08o7Enxy399Q7pP6vcS5TbKvm--hypsYj-NOwobNHMrR5VVW1PVzIvhJebf1Jb0-clcDUdjGcNtftwUTZLSev8BXQCD0_G4bg_P6D87ldFU Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 518b63e53b754f22bc59bbd87769cb7d Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-LiveMigrationNegativeTest-1993845365 Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:31.169010 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/518b63e53b754f22bc59bbd87769cb7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_518b63e53b754f22bc59bbd87769cb7d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/518b63e53b754f22bc59bbd87769cb7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/518b63e53b754f22bc59bbd87769cb7d"}]}] Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-LiveMigrationNegativeTest-1993845365 Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 518b63e53b754f22bc59bbd87769cb7d Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1993845365 Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-LiveMigrationNegativeTest-1993845365-project-admin Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 30341ea3ffbf47b48c4fc35169091315 Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-LiveMigrationNegativeTest-1993845365-project-admin Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: {"os-migrateLive": {"host": "n-h1-852771-8", "block_migration": true, "disk_over_commit": false}} Aug 25 12:40:31.171868 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: exception: Cannot 'os-migrateLive' instance 94869906-92c8-4f47-8bbe-740418482403 while it is in vm_state suspended Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '94869906-92c8-4f47-8bbe-740418482403', 'body': {'os-migrateLive': {'host': 'n-h1-852771-8', 'block_migration': True, 'disk_over_commit': False}}} Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 25 12:40:31.174255 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 94869906-92c8-4f47-8bbe-740418482403 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:31.178320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 94869906-92c8-4f47-8bbe-740418482403 while it is in vm_state suspended Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 94869906-92c8-4f47-8bbe-740418482403 while it is in vm_state suspended Aug 25 12:40:31.183014 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:31.185840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 94869906-92c8-4f47-8bbe-740418482403 while it is in vm_state suspended {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:31.185840 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8ee122a2-05df-4af4-8806-6df4717bc35e tempest-LiveMigrationNegativeTest-1993845365 tempest-LiveMigrationNegativeTest-1993845365-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403/action" status: 409 len: 155 microversion: 2.1 time: 2.351859 Aug 25 12:40:31.194527 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 166/332] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:40:28 2022] POST /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403/action => generated 155 bytes in 2374 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 25 12:40:31.204175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0ed17f63-8a0e-4ab6-a615-159d9e7ae384 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:31.206085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ed17f63-8a0e-4ab6-a615-159d9e7ae384 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:31.218065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ed17f63-8a0e-4ab6-a615-159d9e7ae384 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:31.219132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ed17f63-8a0e-4ab6-a615-159d9e7ae384 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:31.220088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ed17f63-8a0e-4ab6-a615-159d9e7ae384 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:31.222738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ed17f63-8a0e-4ab6-a615-159d9e7ae384 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:31.223529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ed17f63-8a0e-4ab6-a615-159d9e7ae384 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:31.225206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ed17f63-8a0e-4ab6-a615-159d9e7ae384 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:31.232812 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e830e3d4-1d1e-4800-952b-9a3c063101d8 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.102519 Aug 25 12:40:31.235189 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 167/333] 10.222.0.70 () {58 vars in 1169 bytes} [Thu Aug 25 12:40:31 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:31.263346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-408f1d82-50a3-407e-ac06-839dbe375ad5 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:31.305909 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-408f1d82-50a3-407e-ac06-839dbe375ad5 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.055060 Aug 25 12:40:31.313455 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 168/334] 10.222.0.70 () {58 vars in 1177 bytes} [Thu Aug 25 12:40:31 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:31.323443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ed17f63-8a0e-4ab6-a615-159d9e7ae384 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:40:31.336275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22d21256-d8f0-409d-8730-6a756a988348 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:31.390545 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22d21256-d8f0-409d-8730-6a756a988348 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.059245 Aug 25 12:40:31.400312 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 169/335] 10.222.0.70 () {58 vars in 1171 bytes} [Thu Aug 25 12:40:31 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:40:31.427149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e7db201-7eb7-46e0-8f95-b9d290d9d5ae tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:31.467512 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3e7db201-7eb7-46e0-8f95-b9d290d9d5ae tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.052917 Aug 25 12:40:31.472094 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 170/336] 10.222.0.70 () {58 vars in 1169 bytes} [Thu Aug 25 12:40:31 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:40:31.496080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9bba734f-863d-4c6f-87bf-39a07d2cb102 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:31.632827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9bba734f-863d-4c6f-87bf-39a07d2cb102 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6221 microversion: 2.1 time: 0.145680 Aug 25 12:40:31.649552 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 171/337] 10.222.0.70 () {58 vars in 1169 bytes} [Thu Aug 25 12:40:31 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6221 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:31.674560 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0ed17f63-8a0e-4ab6-a615-159d9e7ae384 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "DELETE /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 204 len: 0 microversion: 2.1 time: 0.475449 Aug 25 12:40:31.682328 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 167/338] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:40:31 2022] DELETE /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:40:31.686590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e68ca0f7-f814-478f-bebe-0bbf09ffbd4b tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:31.693460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c308ba7b-9d3c-4bab-9bcc-118890bea735 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:31.704849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c308ba7b-9d3c-4bab-9bcc-118890bea735 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:31.735518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c308ba7b-9d3c-4bab-9bcc-118890bea735 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:31.737103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c308ba7b-9d3c-4bab-9bcc-118890bea735 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:31.745782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c308ba7b-9d3c-4bab-9bcc-118890bea735 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:31.747452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c308ba7b-9d3c-4bab-9bcc-118890bea735 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:31.748414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c308ba7b-9d3c-4bab-9bcc-118890bea735 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:31.749276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c308ba7b-9d3c-4bab-9bcc-118890bea735 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:31.781020 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e68ca0f7-f814-478f-bebe-0bbf09ffbd4b tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6221 microversion: 2.1 time: 0.100577 Aug 25 12:40:31.785263 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 172/339] 10.222.0.70 () {58 vars in 1175 bytes} [Thu Aug 25 12:40:31 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:31.820202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f9672469-96d0-4088-8f83-c1555953d1c4 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:31.935912 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f9672469-96d0-4088-8f83-c1555953d1c4 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6221 microversion: 2.1 time: 0.117477 Aug 25 12:40:31.941947 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 173/340] 10.222.0.70 () {58 vars in 1173 bytes} [Thu Aug 25 12:40:31 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6221 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:31.982789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7d9d162f-8f1e-4339-9910-67104b4ad02f tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:32.103451 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7d9d162f-8f1e-4339-9910-67104b4ad02f tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6221 microversion: 2.1 time: 0.133003 Aug 25 12:40:32.110470 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 174/341] 10.222.0.70 () {58 vars in 1169 bytes} [Thu Aug 25 12:40:31 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6221 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:32.156453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4848a7c-6b6a-4b5b-b1da-4239acbf7938 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:32.214626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c308ba7b-9d3c-4bab-9bcc-118890bea735 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:32.216974 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e4848a7c-6b6a-4b5b-b1da-4239acbf7938 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/704308577" status: 202 len: 0 microversion: 2.1 time: 0.074802 Aug 25 12:40:32.224238 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 175/342] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 12:40:32 2022] DELETE /compute/v2.1/flavors/704308577 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:40:32.232050 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c308ba7b-9d3c-4bab-9bcc-118890bea735 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1465 microversion: 2.1 time: 0.546171 Aug 25 12:40:32.233928 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 168/343] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:31 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1465 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:32.241299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ef514d4-22ae-4b89-a46a-b82d515e80c9 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:32.302203 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3ef514d4-22ae-4b89-a46a-b82d515e80c9 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.072847 Aug 25 12:40:32.304060 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 176/344] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:32 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:32.344562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e945e0db-c36e-4bc8-b039-2efa42297d81 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:32.400075 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e945e0db-c36e-4bc8-b039-2efa42297d81 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/186310305" status: 202 len: 0 microversion: 2.1 time: 0.065876 Aug 25 12:40:32.403214 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 169/345] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 12:40:32 2022] DELETE /compute/v2.1/flavors/186310305 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:32.418781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c5a5b94-66ad-4934-82db-690396e09f4e tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:32.518518 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1c5a5b94-66ad-4934-82db-690396e09f4e tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.109547 Aug 25 12:40:32.519908 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 177/346] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:32 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:32.571240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26145bcb-718a-4389-adbc-594ba153f37a tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1083295703", "id": 1424354661, "os-flavor-access:is_public": "False"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:32.641050 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-26145bcb-718a-4389-adbc-594ba153f37a tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.079460 Aug 25 12:40:32.652220 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 170/347] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:32 2022] POST /compute/v2.1/flavors => generated 415 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:32.667705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-96f40469-dd4f-4680-9a6c-80b62d9ab234 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:32.730926 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-96f40469-dd4f-4680-9a6c-80b62d9ab234 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.070085 Aug 25 12:40:32.747640 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 178/348] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:32 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:32.770674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f516d5b0-989b-47e3-b1c4-d612b3c05c49 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:32.839209 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f516d5b0-989b-47e3-b1c4-d612b3c05c49 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.074106 Aug 25 12:40:32.847187 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 171/349] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:32 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:32.874308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a28e5e99-215e-4ec4-8cc0-fd22d8488757 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:32.918053 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a28e5e99-215e-4ec4-8cc0-fd22d8488757 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1424354661" status: 202 len: 0 microversion: 2.1 time: 0.047143 Aug 25 12:40:32.919042 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 179/350] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:40:32 2022] DELETE /compute/v2.1/flavors/1424354661 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:40:32.936378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3cf8d60-c25b-4a66-a7e1-f518453028ce tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:33.020329 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3cf8d60-c25b-4a66-a7e1-f518453028ce tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.093286 Aug 25 12:40:33.021812 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 172/351] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:32 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:33.076792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9d248ff5-f5b6-4ad8-8b8d-63af7924d769 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-951425752", "id": 606471646, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:33.134148 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9d248ff5-f5b6-4ad8-8b8d-63af7924d769 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.070640 Aug 25 12:40:33.136181 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 173/352] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:33 2022] POST /compute/v2.1/flavors => generated 410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:40:33.165708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e63d8e8d-191e-43a7-940d-efa7de0ce074 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:33.251021 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e63d8e8d-191e-43a7-940d-efa7de0ce074 tempest-FlavorsAdminTestJSON-2033916429 tempest-FlavorsAdminTestJSON-2033916429-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.099802 Aug 25 12:40:33.262466 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 174/353] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:33 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:33.292107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9f8a25b5-a797-413f-9739-bb0e8413ed57 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:33.345383 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9f8a25b5-a797-413f-9739-bb0e8413ed57 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/606471646" status: 202 len: 0 microversion: 2.1 time: 0.064151 Aug 25 12:40:33.347640 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 175/354] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 12:40:33 2022] DELETE /compute/v2.1/flavors/606471646 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:40:33.358080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-97c44c1e-76df-451f-a6a6-0499ec5bdb55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:33.359664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-97c44c1e-76df-451f-a6a6-0499ec5bdb55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:33.371945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97c44c1e-76df-451f-a6a6-0499ec5bdb55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:33.372725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97c44c1e-76df-451f-a6a6-0499ec5bdb55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:33.374127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97c44c1e-76df-451f-a6a6-0499ec5bdb55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:33.376328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97c44c1e-76df-451f-a6a6-0499ec5bdb55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:33.377156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97c44c1e-76df-451f-a6a6-0499ec5bdb55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:33.378542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97c44c1e-76df-451f-a6a6-0499ec5bdb55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:33.648287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-97c44c1e-76df-451f-a6a6-0499ec5bdb55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:33.666075 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-97c44c1e-76df-451f-a6a6-0499ec5bdb55 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1465 microversion: 2.1 time: 0.316158 Aug 25 12:40:33.678498 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 176/355] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:33 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1465 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:33.690988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-913813e8-441b-40dd-a3a1-d877a657b490 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:33.739277 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-913813e8-441b-40dd-a3a1-d877a657b490 tempest-FlavorsAdminTestJSON-476664496 tempest-FlavorsAdminTestJSON-476664496-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.056223 Aug 25 12:40:33.739719 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 177/356] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:33 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:34.183812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-65e7b719-f898-457a-b8f2-d9c24811b0fc tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1537357077", "id": 1827108796, "os-flavor-access:is_public": "False"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:34.266392 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-65e7b719-f898-457a-b8f2-d9c24811b0fc tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 1.318397 Aug 25 12:40:34.269374 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 180/357] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:32 2022] POST /compute/v2.1/flavors => generated 439 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:34.309470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-67548194-d53e-40be-8a76-780f9b8d2679 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4cec1dba3985429fb86df4afcba15d86"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:34.714910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c11573a8-7af0-4cc8-a231-a8b1b6a69425 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:34.716300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c11573a8-7af0-4cc8-a231-a8b1b6a69425 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:34.743904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11573a8-7af0-4cc8-a231-a8b1b6a69425 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:34.745141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11573a8-7af0-4cc8-a231-a8b1b6a69425 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:34.748518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11573a8-7af0-4cc8-a231-a8b1b6a69425 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:34.750232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11573a8-7af0-4cc8-a231-a8b1b6a69425 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:34.756526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11573a8-7af0-4cc8-a231-a8b1b6a69425 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:34.764797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11573a8-7af0-4cc8-a231-a8b1b6a69425 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:35.329965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c11573a8-7af0-4cc8-a231-a8b1b6a69425 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:35.362118 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c11573a8-7af0-4cc8-a231-a8b1b6a69425 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1465 microversion: 2.1 time: 0.655998 Aug 25 12:40:35.364178 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 181/358] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:34 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1465 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:40:36.235531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=23,nova_cell0:UPDATE=7 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:36.679603 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-67548194-d53e-40be-8a76-780f9b8d2679 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1827108796/action" status: 200 len: 97 microversion: 2.1 time: 2.388418 Aug 25 12:40:36.692417 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 178/359] 10.222.0.70 () {60 vars in 1200 bytes} [Thu Aug 25 12:40:34 2022] POST /compute/v2.1/flavors/1827108796/action => generated 97 bytes in 2408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:40:36.716193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-4f56ecb8-d467-42af-9454-dbd912117a18 req-c6577e04-8bc3-420b-a895-bcd9d1e030b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94869906-92c8-4f47-8bbe-740418482403", "name": "network-vif-deleted", "tag": "a9951464-7c96-4193-8ea6-05975add11dd"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:36.758014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4f56ecb8-d467-42af-9454-dbd912117a18 req-c6577e04-8bc3-420b-a895-bcd9d1e030b0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:36.762156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4f56ecb8-d467-42af-9454-dbd912117a18 req-c6577e04-8bc3-420b-a895-bcd9d1e030b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:36.763756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4f56ecb8-d467-42af-9454-dbd912117a18 req-c6577e04-8bc3-420b-a895-bcd9d1e030b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:36.863456 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-4f56ecb8-d467-42af-9454-dbd912117a18 req-c6577e04-8bc3-420b-a895-bcd9d1e030b0 service nova] Creating event network-vif-deleted:a9951464-7c96-4193-8ea6-05975add11dd for instance 94869906-92c8-4f47-8bbe-740418482403 on n-h2-852771-8 Aug 25 12:40:36.900147 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-4f56ecb8-d467-42af-9454-dbd912117a18 req-c6577e04-8bc3-420b-a895-bcd9d1e030b0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197960 Aug 25 12:40:36.904457 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 179/360] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:36.929226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:36.931988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:36.949869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:36.959868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:36.962724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:36.965056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:36.967410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:36.968704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:36.971160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:37.062009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:37.063397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:37.065000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:37.066415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lazy-loading 'fault' on Instance uuid 94869906-92c8-4f47-8bbe-740418482403 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:40:37.355280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7561c7bf-079d-48eb-90db-53abf1669f33 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Calling method '.version_select at 0x7f3a2b0fe5e0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:37.373835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7561c7bf-079d-48eb-90db-53abf1669f33 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:37.380555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7561c7bf-079d-48eb-90db-53abf1669f33 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:37.381226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7561c7bf-079d-48eb-90db-53abf1669f33 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:37.385091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7561c7bf-079d-48eb-90db-53abf1669f33 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:37.386213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7561c7bf-079d-48eb-90db-53abf1669f33 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:37.387065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7561c7bf-079d-48eb-90db-53abf1669f33 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:37.399698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:37.426849 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d2794925-c09d-4729-96cc-e87c6157fc8f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 200 len: 1309 microversion: 2.1 time: 0.519134 Aug 25 12:40:37.436305 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 180/361] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:36 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 1309 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:37.448074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f9c2457-a8a0-44a9-a4c5-e184cc723fcd tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4cec1dba3985429fb86df4afcba15d86"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:37.489795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=88 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:37.557430 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7561c7bf-079d-48eb-90db-53abf1669f33 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 2.179774 Aug 25 12:40:37.578710 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 182/362] 10.222.0.70 () {58 vars in 1128 bytes} [Thu Aug 25 12:40:35 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:38.210520 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-2f9c2457-a8a0-44a9-a4c5-e184cc723fcd tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project 4cec1dba3985429fb86df4afcba15d86 combination. Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f9c2457-a8a0-44a9-a4c5-e184cc723fcd tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Request method failure captured: Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/flavors/1827108796/action HTTP/1.1 Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 67 Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB228PNRHahKdCh0LuXV-NRSPmvKCE7oenL05Vkc_2R56n0B3ov71C4LVu3q1HsbNrYDnWIKv5SK11UlaoqCh2ig3KwMYnZe0XUfrVriGHLtg1u8zf8sK8_FZZ-SU0QoF4nfaYG9cMOGVL0OjdVv1-rNluLVI-EHF1hUIdi4mtK9gdR8 Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f450a460dfdb4446aa5b12d4a0b8fd6a Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-515995969 Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:38.236527 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f450a460dfdb4446aa5b12d4a0b8fd6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f450a460dfdb4446aa5b12d4a0b8fd6a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f450a460dfdb4446aa5b12d4a0b8fd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f450a460dfdb4446aa5b12d4a0b8fd6a"}]}] Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-515995969 Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f450a460dfdb4446aa5b12d4a0b8fd6a Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-515995969 Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 79d25a26e5c14ef4827bf13707c6f626 Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: {"addTenantAccess": {"tenant": "4cec1dba3985429fb86df4afcba15d86"}} Aug 25 12:40:38.238751 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: exception: Flavor access already exists for flavor 33 and project 4cec1dba3985429fb86df4afcba15d86 combination. Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '1827108796', 'body': {'addTenantAccess': {'tenant': '4cec1dba3985429fb86df4afcba15d86'}}} Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:40:38.240605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '33-4cec1dba3985429fb86df4afcba15d86' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi session.flush() Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 12:40:38.244757 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 12:40:38.248895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:40:38.254671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '33-4cec1dba3985429fb86df4afcba15d86' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 25, 12, 40, 38, 198889), 'updated_at': None, 'flavor_id': 33, 'project_id': '4cec1dba3985429fb86df4afcba15d86'}] Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:38.260233 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 33 and project 4cec1dba3985429fb86df4afcba15d86 combination. Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:38.262804 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 33 and project 4cec1dba3985429fb86df4afcba15d86 combination. Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:38.266222 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:38.270602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 33 and project 4cec1dba3985429fb86df4afcba15d86 combination. Aug 25 12:40:38.270602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.270602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f9c2457-a8a0-44a9-a4c5-e184cc723fcd tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project 4cec1dba3985429fb86df4afcba15d86 combination. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:38.270602 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f9c2457-a8a0-44a9-a4c5-e184cc723fcd tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1827108796/action" status: 409 len: 152 microversion: 2.1 time: 0.815174 Aug 25 12:40:38.270602 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 181/363] 10.222.0.70 () {60 vars in 1200 bytes} [Thu Aug 25 12:40:37 2022] POST /compute/v2.1/flavors/1827108796/action => generated 152 bytes in 822 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:40:38.290216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-db10c341-e7c8-4333-b73f-d2a8594b7957 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4cec1dba3985429fb86df4afcba15d86"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:38.464560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d7e8888-367a-4c5c-af4d-fd4afde99aac tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Calling method '.version_select at 0x7f3a2b04cc10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:38.489864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8d7e8888-367a-4c5c-af4d-fd4afde99aac tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'b0e6d349764b40098ba88a3cff6a59df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf1e7857fb94c3e8a7599fffc1f3259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d7e8888-367a-4c5c-af4d-fd4afde99aac tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Request method failure captured: Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB22-xTZ5HJ6AjhSNX8mySNwRjM-EIYHJ91oR2gHp4JePOXbwajWeu-Rc0sHajuufZ-3quK6SpBGSYscTPjha7PtOgEhGP7BoVaPdI_GsJCM3lPdxD_ntO2PgqocXdqkol8AckPvSy7JMMLjnJvupb2SDibkSlN0VT220fsgu7gt6e40 Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:38.493778 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0bf1e7857fb94c3e8a7599fffc1f3259", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}] Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b0e6d349764b40098ba88a3cff6a59df Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: action_args: {} Aug 25 12:40:38.496544 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:38.498324 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 25 12:40:38.500612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.503630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d7e8888-367a-4c5c-af4d-fd4afde99aac tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:38.503630 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d7e8888-367a-4c5c-af4d-fd4afde99aac tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.920233 Aug 25 12:40:38.503932 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 183/364] 10.222.0.70 () {58 vars in 1128 bytes} [Thu Aug 25 12:40:37 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 924 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:38.539563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:38.540710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: 94869906-92c8-4f47-8bbe-740418482403] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:38.566356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:38.568285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:38.569712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:38.571636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:38.572885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:38.573964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:38.641180 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] HTTP exception thrown: Instance 94869906-92c8-4f47-8bbe-740418482403 could not be found. Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Request method failure captured: Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 HTTP/1.1 Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21qx3CMaDcRgjuOVoHpOrN5gPUJ3KQSjGQuLv7II2OFGgqABVlOxYGaU_KeCS2OAZO3v6W6i7B6s4B2XfqN-pJ2vYn7Rfp7YeY9_7bgUvYV0HBpPD1HVPrwylXfPUjKQgxfcZRx91STgJ-Mv7iAT2x8hBx7Sunh2nnTdO18xVzdPsg Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5fbf78e11dac4679a21657e9964aeb9c Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-LiveMigrationNegativeTest-532363896 Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:38.659193 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5fbf78e11dac4679a21657e9964aeb9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5fbf78e11dac4679a21657e9964aeb9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5fbf78e11dac4679a21657e9964aeb9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5fbf78e11dac4679a21657e9964aeb9c"}]}] Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-LiveMigrationNegativeTest-532363896 Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5fbf78e11dac4679a21657e9964aeb9c Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-532363896 Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-LiveMigrationNegativeTest-532363896-project Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d40770814e0045ba9c5b2e621ca0f397 Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-LiveMigrationNegativeTest-532363896-project Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 94869906-92c8-4f47-8bbe-740418482403 could not be found. Aug 25 12:40:38.661858 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '94869906-92c8-4f47-8bbe-740418482403'} Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94869906-92c8-4f47-8bbe-740418482403 could not be found. Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:38.663438 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94869906-92c8-4f47-8bbe-740418482403 could not be found. Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94869906-92c8-4f47-8bbe-740418482403 could not be found. Aug 25 12:40:38.668022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.672789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Returning 404 to user: Instance 94869906-92c8-4f47-8bbe-740418482403 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:38.685794 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2ee38ab2-8b79-4c22-b24a-4dbde42266ec tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403" status: 404 len: 111 microversion: 2.1 time: 0.154131 Aug 25 12:40:38.696698 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 184/365] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:38 2022] GET /compute/v2.1/servers/94869906-92c8-4f47-8bbe-740418482403 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:38.709885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-58959824-8747-4e5e-9b19-513026f99a11 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Calling method '.version_select at 0x7f3a2b0feaf0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:38.714589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-58959824-8747-4e5e-9b19-513026f99a11 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'b0e6d349764b40098ba88a3cff6a59df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf1e7857fb94c3e8a7599fffc1f3259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-58959824-8747-4e5e-9b19-513026f99a11 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Request method failure captured: Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-hosts/n-d-852771-8/reboot HTTP/1.1 Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB22-xTZ5HJ6AjhSNX8mySNwRjM-EIYHJ91oR2gHp4JePOXbwajWeu-Rc0sHajuufZ-3quK6SpBGSYscTPjha7PtOgEhGP7BoVaPdI_GsJCM3lPdxD_ntO2PgqocXdqkol8AckPvSy7JMMLjnJvupb2SDibkSlN0VT220fsgu7gt6e40 Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:38.724688 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0bf1e7857fb94c3e8a7599fffc1f3259", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}] Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b0e6d349764b40098ba88a3cff6a59df Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'n-d-852771-8'} Aug 25 12:40:38.728559 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:38.730507 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 25 12:40:38.734187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.746283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-58959824-8747-4e5e-9b19-513026f99a11 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:38.748590 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-58959824-8747-4e5e-9b19-513026f99a11 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-852771-8/reboot" status: 403 len: 111 microversion: 2.1 time: 0.049726 Aug 25 12:40:38.749634 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 185/366] 10.222.0.70 () {58 vars in 1188 bytes} [Thu Aug 25 12:40:38 2022] GET /compute/v2.1/os-hosts/n-d-852771-8/reboot => generated 111 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:38.769317 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-db10c341-e7c8-4333-b73f-d2a8594b7957 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1827108796/action" status: 200 len: 21 microversion: 2.1 time: 0.500934 Aug 25 12:40:38.779508 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 182/367] 10.222.0.70 () {60 vars in 1200 bytes} [Thu Aug 25 12:40:38 2022] POST /compute/v2.1/flavors/1827108796/action => generated 21 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:40:38.782910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-38e69180-a722-40b0-8c35-4cb02b09a44c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:38.794073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b087d09f-09cf-4e78-88bd-e22b591ce7c9 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Calling method '.version_select at 0x7f3a2ac6f820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:38.800438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-38e69180-a722-40b0-8c35-4cb02b09a44c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:38.829403 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b087d09f-09cf-4e78-88bd-e22b591ce7c9 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:38.832980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38e69180-a722-40b0-8c35-4cb02b09a44c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b087d09f-09cf-4e78-88bd-e22b591ce7c9 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Request method failure captured: Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23ChgE2RwWquiqEc_Sq4fCnw5xCZgb3VMexz4OgTMxD-_A08vonWoVqjzvNCuzuTB5PU2gm5EMW0mNL3u4X25tspihR-Hg9AFYEdb8Rh1VtNGaQWF00qPR9JF2TXrlXPEIs7HE7lm0dFqsJdexL0uIvsZ8HyZNmCqPlqDBWx7Rw_J0 Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:38.841437 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b064c8f71aa7473783d23debcc577e49", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}] Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3fe14d472de14c0f9519bceef4bb89bd Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'nonexistent_hostname'} Aug 25 12:40:38.843980 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:40:38.845884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 25 12:40:38.848029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:38.850337 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:38.853734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38e69180-a722-40b0-8c35-4cb02b09a44c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:38.853734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38e69180-a722-40b0-8c35-4cb02b09a44c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:38.853734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38e69180-a722-40b0-8c35-4cb02b09a44c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:38.853734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38e69180-a722-40b0-8c35-4cb02b09a44c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:38.854375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38e69180-a722-40b0-8c35-4cb02b09a44c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:38.854526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b087d09f-09cf-4e78-88bd-e22b591ce7c9 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:38.855884 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b087d09f-09cf-4e78-88bd-e22b591ce7c9 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.071117 Aug 25 12:40:38.860753 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 183/368] 10.222.0.70 () {58 vars in 1212 bytes} [Thu Aug 25 12:40:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:40:38.889344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2e8e4d34-f161-4eba-9855-c90d52b5de16 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:38.963790 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2e8e4d34-f161-4eba-9855-c90d52b5de16 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1827108796" status: 202 len: 0 microversion: 2.1 time: 0.095902 Aug 25 12:40:38.965011 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 184/369] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:40:38 2022] DELETE /compute/v2.1/flavors/1827108796 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:38.985378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f57ca646-4b6d-4129-a339-e768ca615dc8 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Calling method '.version_select at 0x7f3a2ad2a3a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:38.998833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f57ca646-4b6d-4129-a339-e768ca615dc8 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'b0e6d349764b40098ba88a3cff6a59df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf1e7857fb94c3e8a7599fffc1f3259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f57ca646-4b6d-4129-a339-e768ca615dc8 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Request method failure captured: Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hosts/n-d-852771-8 HTTP/1.1 Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB22-xTZ5HJ6AjhSNX8mySNwRjM-EIYHJ91oR2gHp4JePOXbwajWeu-Rc0sHajuufZ-3quK6SpBGSYscTPjha7PtOgEhGP7BoVaPdI_GsJCM3lPdxD_ntO2PgqocXdqkol8AckPvSy7JMMLjnJvupb2SDibkSlN0VT220fsgu7gt6e40 Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:40:39.003110 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0bf1e7857fb94c3e8a7599fffc1f3259", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}] Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b0e6d349764b40098ba88a3cff6a59df Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'n-d-852771-8'} Aug 25 12:40:39.005613 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:39.007279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 25 12:40:39.009624 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.013124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f57ca646-4b6d-4129-a339-e768ca615dc8 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:39.024061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-38e69180-a722-40b0-8c35-4cb02b09a44c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:40:39.026416 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f57ca646-4b6d-4129-a339-e768ca615dc8 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-852771-8" status: 403 len: 109 microversion: 2.1 time: 0.058886 Aug 25 12:40:39.027945 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 185/370] 10.222.0.70 () {58 vars in 1167 bytes} [Thu Aug 25 12:40:38 2022] GET /compute/v2.1/os-hosts/n-d-852771-8 => generated 109 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:39.040963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-73de4775-2259-45e9-97a2-a174a5ca33f9 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:39.129626 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-73de4775-2259-45e9-97a2-a174a5ca33f9 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.099267 Aug 25 12:40:39.131685 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 186/371] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:39 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:39.154981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89d9f156-0ffe-40f0-9db4-9688808e8b89 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Calling method '.version_select at 0x7f3a2ada9550>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:39.186395 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-89d9f156-0ffe-40f0-9db4-9688808e8b89 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89d9f156-0ffe-40f0-9db4-9688808e8b89 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Request method failure captured: Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23ChgE2RwWquiqEc_Sq4fCnw5xCZgb3VMexz4OgTMxD-_A08vonWoVqjzvNCuzuTB5PU2gm5EMW0mNL3u4X25tspihR-Hg9AFYEdb8Rh1VtNGaQWF00qPR9JF2TXrlXPEIs7HE7lm0dFqsJdexL0uIvsZ8HyZNmCqPlqDBWx7Rw_J0 Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:39.200537 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b064c8f71aa7473783d23debcc577e49", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}] Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3fe14d472de14c0f9519bceef4bb89bd Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'nonexistent_hostname'} Aug 25 12:40:39.203367 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.206065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.208816 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.215784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89d9f156-0ffe-40f0-9db4-9688808e8b89 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:39.218651 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89d9f156-0ffe-40f0-9db4-9688808e8b89 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.083627 Aug 25 12:40:39.239479 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 187/372] 10.222.0.70 () {58 vars in 1191 bytes} [Thu Aug 25 12:40:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:40:39.263999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c91fbe9-fb07-4005-86b2-f29777778381 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1127630897", "id": 694482807, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:39.381810 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3c91fbe9-fb07-4005-86b2-f29777778381 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.135009 Aug 25 12:40:39.388594 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 188/373] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:39 2022] POST /compute/v2.1/flavors => generated 435 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:39.404089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2c15dbb6-e549-4166-b34f-8037f5199bbd tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Calling method '.version_select at 0x7f3a2ad2a670>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:39.415660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2c15dbb6-e549-4166-b34f-8037f5199bbd tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'b0e6d349764b40098ba88a3cff6a59df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf1e7857fb94c3e8a7599fffc1f3259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2c15dbb6-e549-4166-b34f-8037f5199bbd tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Request method failure captured: Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hosts/n-d-852771-8/shutdown HTTP/1.1 Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB22-xTZ5HJ6AjhSNX8mySNwRjM-EIYHJ91oR2gHp4JePOXbwajWeu-Rc0sHajuufZ-3quK6SpBGSYscTPjha7PtOgEhGP7BoVaPdI_GsJCM3lPdxD_ntO2PgqocXdqkol8AckPvSy7JMMLjnJvupb2SDibkSlN0VT220fsgu7gt6e40 Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:40:39.422317 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0bf1e7857fb94c3e8a7599fffc1f3259", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}] Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b0e6d349764b40098ba88a3cff6a59df Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'n-d-852771-8'} Aug 25 12:40:39.424914 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:39.426781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 25 12:40:39.429459 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.432296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2c15dbb6-e549-4166-b34f-8037f5199bbd tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:39.441654 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2c15dbb6-e549-4166-b34f-8037f5199bbd tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-852771-8/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.048276 Aug 25 12:40:39.445960 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 189/374] 10.222.0.70 () {58 vars in 1194 bytes} [Thu Aug 25 12:40:39 2022] GET /compute/v2.1/os-hosts/n-d-852771-8/shutdown => generated 113 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:39.448177 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-38e69180-a722-40b0-8c35-4cb02b09a44c tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 204 len: 0 microversion: 2.1 time: 0.696295 Aug 25 12:40:39.456914 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 186/375] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:40:38 2022] DELETE /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:40:39.469844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16ff4984-a91d-48c4-8eee-569e1801948e tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:39.497715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e60ba7bc-e28e-41b9-b385-df7f0444fe7a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Calling method '.version_select at 0x7f3a2b0feb80>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:39.507597 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-16ff4984-a91d-48c4-8eee-569e1801948e tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16ff4984-a91d-48c4-8eee-569e1801948e tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Request method failure captured: Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/flavors/694482807/os-flavor-access HTTP/1.1 Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB228PNRHahKdCh0LuXV-NRSPmvKCE7oenL05Vkc_2R56n0B3ov71C4LVu3q1HsbNrYDnWIKv5SK11UlaoqCh2ig3KwMYnZe0XUfrVriGHLtg1u8zf8sK8_FZZ-SU0QoF4nfaYG9cMOGVL0OjdVv1-rNluLVI-EHF1hUIdi4mtK9gdR8 Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f450a460dfdb4446aa5b12d4a0b8fd6a Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-515995969 Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:39.515314 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f450a460dfdb4446aa5b12d4a0b8fd6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f450a460dfdb4446aa5b12d4a0b8fd6a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f450a460dfdb4446aa5b12d4a0b8fd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f450a460dfdb4446aa5b12d4a0b8fd6a"}]}] Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-515995969 Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f450a460dfdb4446aa5b12d4a0b8fd6a Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-515995969 Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 79d25a26e5c14ef4827bf13707c6f626 Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: exception: Access list not available for public flavors. Aug 25 12:40:39.519341 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'flavor_id': '694482807'} Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 25 12:40:39.522535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.530217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16ff4984-a91d-48c4-8eee-569e1801948e tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:39.530217 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-16ff4984-a91d-48c4-8eee-569e1801948e tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/694482807/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.075364 Aug 25 12:40:39.530217 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 190/376] 10.222.0.70 () {58 vars in 1206 bytes} [Thu Aug 25 12:40:39 2022] GET /compute/v2.1/flavors/694482807/os-flavor-access => generated 91 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:40:39.531857 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-e60ba7bc-e28e-41b9-b385-df7f0444fe7a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e60ba7bc-e28e-41b9-b385-df7f0444fe7a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Request method failure captured: Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23ChgE2RwWquiqEc_Sq4fCnw5xCZgb3VMexz4OgTMxD-_A08vonWoVqjzvNCuzuTB5PU2gm5EMW0mNL3u4X25tspihR-Hg9AFYEdb8Rh1VtNGaQWF00qPR9JF2TXrlXPEIs7HE7lm0dFqsJdexL0uIvsZ8HyZNmCqPlqDBWx7Rw_J0 Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:40:39.536485 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b064c8f71aa7473783d23debcc577e49", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}] Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 3fe14d472de14c0f9519bceef4bb89bd Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'nonexistent_hostname'} Aug 25 12:40:39.539317 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:40:39.547635 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 25 12:40:39.550762 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.553061 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.554458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-862a25cb-f44f-4560-be80-b63b7f572b13 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:39.554607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e60ba7bc-e28e-41b9-b385-df7f0444fe7a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:39.554607 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e60ba7bc-e28e-41b9-b385-df7f0444fe7a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.079554 Aug 25 12:40:39.554893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-862a25cb-f44f-4560-be80-b63b7f572b13 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:39.555040 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 187/377] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 12:40:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:40:39.560299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862a25cb-f44f-4560-be80-b63b7f572b13 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:39.560299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862a25cb-f44f-4560-be80-b63b7f572b13 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:39.560299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862a25cb-f44f-4560-be80-b63b7f572b13 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:39.560299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862a25cb-f44f-4560-be80-b63b7f572b13 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:39.561036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862a25cb-f44f-4560-be80-b63b7f572b13 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:39.562138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862a25cb-f44f-4560-be80-b63b7f572b13 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:39.577435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86e75958-2dac-4826-9c23-169c2fca2633 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:39.585418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5,nova_api:DELETE=12,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:39.692034 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-86e75958-2dac-4826-9c23-169c2fca2633 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/694482807" status: 202 len: 0 microversion: 2.1 time: 0.147007 Aug 25 12:40:39.694110 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 188/378] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 12:40:39 2022] DELETE /compute/v2.1/flavors/694482807 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:39.713066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cff98563-7bee-4dde-93db-94cab7ede00c tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Calling method '.version_select at 0x7f3a2aec9040>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:39.718374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cff98563-7bee-4dde-93db-94cab7ede00c tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'b0e6d349764b40098ba88a3cff6a59df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf1e7857fb94c3e8a7599fffc1f3259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cff98563-7bee-4dde-93db-94cab7ede00c tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Request method failure captured: Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-hosts/n-d-852771-8/startup HTTP/1.1 Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB22-xTZ5HJ6AjhSNX8mySNwRjM-EIYHJ91oR2gHp4JePOXbwajWeu-Rc0sHajuufZ-3quK6SpBGSYscTPjha7PtOgEhGP7BoVaPdI_GsJCM3lPdxD_ntO2PgqocXdqkol8AckPvSy7JMMLjnJvupb2SDibkSlN0VT220fsgu7gt6e40 Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:39.722819 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0bf1e7857fb94c3e8a7599fffc1f3259", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}] Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b0e6d349764b40098ba88a3cff6a59df Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'n-d-852771-8'} Aug 25 12:40:39.725207 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:39.727216 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 25 12:40:39.729931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.735685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cff98563-7bee-4dde-93db-94cab7ede00c tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:39.735685 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cff98563-7bee-4dde-93db-94cab7ede00c tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-852771-8/startup" status: 403 len: 110 microversion: 2.1 time: 0.027208 Aug 25 12:40:39.735685 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 189/379] 10.222.0.70 () {58 vars in 1191 bytes} [Thu Aug 25 12:40:39 2022] GET /compute/v2.1/os-hosts/n-d-852771-8/startup => generated 110 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:39.738608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae7dbae7-2ec8-413b-a45e-60f1423c54d4 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:39.792057 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ae7dbae7-2ec8-413b-a45e-60f1423c54d4 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.060555 Aug 25 12:40:39.793764 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 190/380] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:39 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:39.806646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3cb05c6-6134-4daa-95ed-237686946195 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Calling method '.version_select at 0x7f3a2af1b3a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:39.834052 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a3cb05c6-6134-4daa-95ed-237686946195 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3cb05c6-6134-4daa-95ed-237686946195 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Request method failure captured: Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23ChgE2RwWquiqEc_Sq4fCnw5xCZgb3VMexz4OgTMxD-_A08vonWoVqjzvNCuzuTB5PU2gm5EMW0mNL3u4X25tspihR-Hg9AFYEdb8Rh1VtNGaQWF00qPR9JF2TXrlXPEIs7HE7lm0dFqsJdexL0uIvsZ8HyZNmCqPlqDBWx7Rw_J0 Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:40:39.838672 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b064c8f71aa7473783d23debcc577e49", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}] Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 3fe14d472de14c0f9519bceef4bb89bd Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'nonexistent_hostname'} Aug 25 12:40:39.841437 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:40:39.846444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 25 12:40:39.848634 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3cb05c6-6134-4daa-95ed-237686946195 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:39.851066 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a3cb05c6-6134-4daa-95ed-237686946195 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.054628 Aug 25 12:40:39.854371 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 191/381] 10.222.0.70 () {58 vars in 1215 bytes} [Thu Aug 25 12:40:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:40:39.879341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-72c69e48-64dd-4ea5-90f4-171f40e435bf tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-467099598", "id": 1419417051, "os-flavor-access:is_public": "False"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:39.941471 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-72c69e48-64dd-4ea5-90f4-171f40e435bf tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.077402 Aug 25 12:40:39.942869 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 192/382] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:39 2022] POST /compute/v2.1/flavors => generated 438 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:39.953913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3002219f-3d22-40d1-a745-9a253c2a5437 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2aec9040>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3002219f-3d22-40d1-a745-9a253c2a5437 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Request method failure captured: Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: request: PUT /compute/v2.1/os-hosts/n-d-852771-8 HTTP/1.1 Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 51 Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23ChgE2RwWquiqEc_Sq4fCnw5xCZgb3VMexz4OgTMxD-_A08vonWoVqjzvNCuzuTB5PU2gm5EMW0mNL3u4X25tspihR-Hg9AFYEdb8Rh1VtNGaQWF00qPR9JF2TXrlXPEIs7HE7lm0dFqsJdexL0uIvsZ8HyZNmCqPlqDBWx7Rw_J0 Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:40:40.094362 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b064c8f71aa7473783d23debcc577e49", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}] Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 3fe14d472de14c0f9519bceef4bb89bd Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: {"status": "enable", "maintenance_mode": "invalid"} Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:40:40.096860 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'n-d-852771-8', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'disable', Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'Enable', Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'Disable', Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance: Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'invalid' Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:40.098660 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:40.101496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:40.112079 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:40.112079 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:40:40.112079 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:40:40.112079 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:40:40.112079 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:40.115278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3002219f-3d22-40d1-a745-9a253c2a5437 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:40.117960 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3002219f-3d22-40d1-a745-9a253c2a5437 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-852771-8" status: 400 len: 199 microversion: 2.1 time: 0.172796 Aug 25 12:40:40.121908 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 193/383] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 12:40:39 2022] PUT /compute/v2.1/os-hosts/n-d-852771-8 => generated 199 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:40:41.247689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-862a25cb-f44f-4560-be80-b63b7f572b13 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:41.305482 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-862a25cb-f44f-4560-be80-b63b7f572b13 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1474 microversion: 2.1 time: 1.777917 Aug 25 12:40:41.310642 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 191/384] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:39 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1474 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:41.323849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87bd109a-845d-44da-b5e4-e7bdedfd7a7e tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2bf66af0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87bd109a-845d-44da-b5e4-e7bdedfd7a7e tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Request method failure captured: Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/os-hosts/n-d-852771-8 HTTP/1.1 Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 51 Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23ChgE2RwWquiqEc_Sq4fCnw5xCZgb3VMexz4OgTMxD-_A08vonWoVqjzvNCuzuTB5PU2gm5EMW0mNL3u4X25tspihR-Hg9AFYEdb8Rh1VtNGaQWF00qPR9JF2TXrlXPEIs7HE7lm0dFqsJdexL0uIvsZ8HyZNmCqPlqDBWx7Rw_J0 Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:41.335009 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b064c8f71aa7473783d23debcc577e49", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}] Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3fe14d472de14c0f9519bceef4bb89bd Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: {"status": "invalid", "maintenance_mode": "enable"} Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:40:41.337577 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'n-d-852771-8', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'disable', Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'Enable', Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'Disable', Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance: Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'invalid' Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.338795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.346126 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:41.351007 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:41.351007 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:40:41.351007 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:40:41.351007 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:40:41.351007 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.356024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87bd109a-845d-44da-b5e4-e7bdedfd7a7e tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:41.358103 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87bd109a-845d-44da-b5e4-e7bdedfd7a7e tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-852771-8" status: 400 len: 189 microversion: 2.1 time: 0.045083 Aug 25 12:40:41.360457 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 192/385] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 12:40:41 2022] PUT /compute/v2.1/os-hosts/n-d-852771-8 => generated 189 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:40:41.381589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c288d530-515c-47ee-ad24-27a516b6f168 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Action: 'update', calling method: .version_select at 0x7f3a2ac6f820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:41.392232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c288d530-515c-47ee-ad24-27a516b6f168 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'b0e6d349764b40098ba88a3cff6a59df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf1e7857fb94c3e8a7599fffc1f3259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c288d530-515c-47ee-ad24-27a516b6f168 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Request method failure captured: Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/os-hosts/n-d-852771-8 HTTP/1.1 Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 50 Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB22-xTZ5HJ6AjhSNX8mySNwRjM-EIYHJ91oR2gHp4JePOXbwajWeu-Rc0sHajuufZ-3quK6SpBGSYscTPjha7PtOgEhGP7BoVaPdI_GsJCM3lPdxD_ntO2PgqocXdqkol8AckPvSy7JMMLjnJvupb2SDibkSlN0VT220fsgu7gt6e40 Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:40:41.398269 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0bf1e7857fb94c3e8a7599fffc1f3259", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0bf1e7857fb94c3e8a7599fffc1f3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bf1e7857fb94c3e8a7599fffc1f3259"}]}] Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0bf1e7857fb94c3e8a7599fffc1f3259 Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1952157025 Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b0e6d349764b40098ba88a3cff6a59df Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1952157025-project Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: {"status": "enable", "maintenance_mode": "enable"} Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 25 12:40:41.400667 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'n-d-852771-8', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:41.403187 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 25 12:40:41.408616 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.412504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c288d530-515c-47ee-ad24-27a516b6f168 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:41.412504 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c288d530-515c-47ee-ad24-27a516b6f168 tempest-HostsAdminNegativeTestJSON-1952157025 tempest-HostsAdminNegativeTestJSON-1952157025-project] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-852771-8" status: 403 len: 111 microversion: 2.1 time: 0.038173 Aug 25 12:40:41.412504 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 193/386] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 12:40:41 2022] PUT /compute/v2.1/os-hosts/n-d-852771-8 => generated 111 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:41.445486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-71069c8c-abd2-4375-afd7-f0bb499b1542 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2ad2a1f0>, body: {"status": null, "maintenance_mode": null} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-71069c8c-abd2-4375-afd7-f0bb499b1542 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Request method failure captured: Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/os-hosts/n-d-852771-8 HTTP/1.1 Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 42 Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23ChgE2RwWquiqEc_Sq4fCnw5xCZgb3VMexz4OgTMxD-_A08vonWoVqjzvNCuzuTB5PU2gm5EMW0mNL3u4X25tspihR-Hg9AFYEdb8Rh1VtNGaQWF00qPR9JF2TXrlXPEIs7HE7lm0dFqsJdexL0uIvsZ8HyZNmCqPlqDBWx7Rw_J0 Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:41.460400 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b064c8f71aa7473783d23debcc577e49", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}] Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3fe14d472de14c0f9519bceef4bb89bd Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: {"status": null, "maintenance_mode": null} Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 25 12:40:41.463191 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'n-d-852771-8', 'body': {'status': None, 'maintenance_mode': None}} Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'disable', Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'Enable', Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'Disable', Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance: Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi None Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:41.468655 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:41.472733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:41.477047 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:40:41.477047 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:40:41.477047 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 25 12:40:41.477047 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.477047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-71069c8c-abd2-4375-afd7-f0bb499b1542 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:41.479557 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-71069c8c-abd2-4375-afd7-f0bb499b1542 tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-852771-8" status: 400 len: 127 microversion: 2.1 time: 0.045840 Aug 25 12:40:41.483821 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 194/387] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 12:40:41 2022] PUT /compute/v2.1/os-hosts/n-d-852771-8 => generated 127 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:40:41.513254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c75f9c09-b5ee-449a-9f15-b65d53f50d9a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2adc6310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:41.526737 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.hosts [None req-c75f9c09-b5ee-449a-9f15-b65d53f50d9a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Enabling host nonexistent_hostname. Aug 25 12:40:41.570768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9a8c1ad6-6d3b-4419-aba1-992872419c90 tempest-FlavorsAccessNegativeTestJSON-705329087 tempest-FlavorsAccessNegativeTestJSON-705329087-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4cec1dba3985429fb86df4afcba15d86"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:41.577561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9a8c1ad6-6d3b-4419-aba1-992872419c90 tempest-FlavorsAccessNegativeTestJSON-705329087 tempest-FlavorsAccessNegativeTestJSON-705329087-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '43e8c4b892424aebb2b8bb48109d4b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cec1dba3985429fb86df4afcba15d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:41.587497 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c75f9c09-b5ee-449a-9f15-b65d53f50d9a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9a8c1ad6-6d3b-4419-aba1-992872419c90 tempest-FlavorsAccessNegativeTestJSON-705329087 tempest-FlavorsAccessNegativeTestJSON-705329087-project] Request method failure captured: Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/flavors/1419417051/action HTTP/1.1 Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 67 Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB223SUjSygykE8Syb3DkboRty8h0z6L5kCoRgNklLTHX-NLq2wWwLRNIsGLvWUc6MMJ-LFwhVkiBKNl4iSjP6R_iWcnrxDmCB-RbSEsQLDuAp7I1QIR4wMA55pqSsJDnVktVDE2UDTCZEzK_GVqBLw94mqtK7XM1Ws_sW4ygdUPNV0Y Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 4cec1dba3985429fb86df4afcba15d86 Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-705329087 Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:41.597952 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4cec1dba3985429fb86df4afcba15d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4cec1dba3985429fb86df4afcba15d86", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4cec1dba3985429fb86df4afcba15d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4cec1dba3985429fb86df4afcba15d86"}]}] Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-705329087 Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 4cec1dba3985429fb86df4afcba15d86 Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-705329087 Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FlavorsAccessNegativeTestJSON-705329087-project Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 43e8c4b892424aebb2b8bb48109d4b5a Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-705329087-project Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: {"addTenantAccess": {"tenant": "4cec1dba3985429fb86df4afcba15d86"}} Aug 25 12:40:41.601250 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '1419417051', 'body': {'addTenantAccess': {'tenant': '4cec1dba3985429fb86df4afcba15d86'}}} Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:41.605427 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 25 12:40:41.610334 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.617816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9a8c1ad6-6d3b-4419-aba1-992872419c90 tempest-FlavorsAccessNegativeTestJSON-705329087 tempest-FlavorsAccessNegativeTestJSON-705329087-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c75f9c09-b5ee-449a-9f15-b65d53f50d9a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Request method failure captured: Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 50 Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23ChgE2RwWquiqEc_Sq4fCnw5xCZgb3VMexz4OgTMxD-_A08vonWoVqjzvNCuzuTB5PU2gm5EMW0mNL3u4X25tspihR-Hg9AFYEdb8Rh1VtNGaQWF00qPR9JF2TXrlXPEIs7HE7lm0dFqsJdexL0uIvsZ8HyZNmCqPlqDBWx7Rw_J0 Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:41.618141 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b064c8f71aa7473783d23debcc577e49", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b064c8f71aa7473783d23debcc577e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b064c8f71aa7473783d23debcc577e49"}]}] Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b064c8f71aa7473783d23debcc577e49 Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1645155983 Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3fe14d472de14c0f9519bceef4bb89bd Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1645155983-project-admin Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: {"status": "enable", "maintenance_mode": "enable"} Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:41.622967 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:40:41.626470 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:41.631803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:40:41.636358 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:41.639989 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9a8c1ad6-6d3b-4419-aba1-992872419c90 tempest-FlavorsAccessNegativeTestJSON-705329087 tempest-FlavorsAccessNegativeTestJSON-705329087-project] 10.222.0.70 "POST /compute/v2.1/flavors/1419417051/action" status: 403 len: 130 microversion: 2.1 time: 1.476652 Aug 25 12:40:41.639989 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 194/388] 10.222.0.70 () {60 vars in 1200 bytes} [Thu Aug 25 12:40:40 2022] POST /compute/v2.1/flavors/1419417051/action => generated 130 bytes in 1479 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:41.640517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c75f9c09-b5ee-449a-9f15-b65d53f50d9a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:41.640517 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c75f9c09-b5ee-449a-9f15-b65d53f50d9a tempest-HostsAdminNegativeTestJSON-1645155983 tempest-HostsAdminNegativeTestJSON-1645155983-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.108825 Aug 25 12:40:41.640517 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 195/389] 10.222.0.70 () {60 vars in 1211 bytes} [Thu Aug 25 12:40:41 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:40:41.648924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19678e5b-203f-4885-a223-eb8f08f5870f tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:41.720642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=13,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:41.742042 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19678e5b-203f-4885-a223-eb8f08f5870f tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1419417051" status: 202 len: 0 microversion: 2.1 time: 0.117104 Aug 25 12:40:41.745672 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 196/390] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:40:41 2022] DELETE /compute/v2.1/flavors/1419417051 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:41.770933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ec0b048-e3ad-452e-b4a1-2ebcb511bc41 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:41.869174 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ec0b048-e3ad-452e-b4a1-2ebcb511bc41 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.100351 Aug 25 12:40:41.870525 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 197/391] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:41 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:41.932430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89edbaff-2a06-4970-acf2-ab21c81a3b32 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-504929115", "id": 25471744, "os-flavor-access:is_public": "False"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:42.016599 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89edbaff-2a06-4970-acf2-ab21c81a3b32 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.092151 Aug 25 12:40:42.032685 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 198/392] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:41 2022] POST /compute/v2.1/flavors => generated 432 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:40:42.055449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee93423d-5bfc-4fef-8796-8ebd84d3efb3 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4cec1dba3985429fb86df4afcba15d86"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:42.293187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3e1d713-427e-4cb8-af5a-a88ced6ba4a3 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:42.309994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3e1d713-427e-4cb8-af5a-a88ced6ba4a3 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:42.312635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3e1d713-427e-4cb8-af5a-a88ced6ba4a3 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:42.315952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3e1d713-427e-4cb8-af5a-a88ced6ba4a3 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:42.318794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3e1d713-427e-4cb8-af5a-a88ced6ba4a3 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:42.320250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3e1d713-427e-4cb8-af5a-a88ced6ba4a3 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:42.321870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3e1d713-427e-4cb8-af5a-a88ced6ba4a3 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:42.447139 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a3e1d713-427e-4cb8-af5a-a88ced6ba4a3 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.810873 Aug 25 12:40:42.458318 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 195/393] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:40:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:42.506193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-01606762-acfb-4526-91b2-7495d5310ef9 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:42.510438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-01606762-acfb-4526-91b2-7495d5310ef9 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:42.540484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01606762-acfb-4526-91b2-7495d5310ef9 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:42.541205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01606762-acfb-4526-91b2-7495d5310ef9 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:42.544728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01606762-acfb-4526-91b2-7495d5310ef9 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:42.556168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01606762-acfb-4526-91b2-7495d5310ef9 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:42.557827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01606762-acfb-4526-91b2-7495d5310ef9 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:42.559019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01606762-acfb-4526-91b2-7495d5310ef9 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:43.137381 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee93423d-5bfc-4fef-8796-8ebd84d3efb3 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/25471744/action" status: 200 len: 95 microversion: 2.1 time: 1.090529 Aug 25 12:40:43.143098 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 199/394] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:40:42 2022] POST /compute/v2.1/flavors/25471744/action => generated 95 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:40:43.168378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cae3b3ce-455c-475e-bd6d-f4a3325abead tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:43.181793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cae3b3ce-455c-475e-bd6d-f4a3325abead tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:43.183406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cae3b3ce-455c-475e-bd6d-f4a3325abead tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:43.184614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cae3b3ce-455c-475e-bd6d-f4a3325abead tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:43.187933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cae3b3ce-455c-475e-bd6d-f4a3325abead tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:43.190541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cae3b3ce-455c-475e-bd6d-f4a3325abead tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:43.192086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cae3b3ce-455c-475e-bd6d-f4a3325abead tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:43.272477 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cae3b3ce-455c-475e-bd6d-f4a3325abead tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-852771-8" status: 200 len: 578 microversion: 2.1 time: 0.119173 Aug 25 12:40:43.276427 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 200/395] 10.222.0.70 () {58 vars in 1172 bytes} [Thu Aug 25 12:40:43 2022] GET /compute/v2.1/os-services?host=n-d-852771-8 => generated 578 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:43.320542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4edb1613-097a-4d8a-b5c9-528eae30b4dc tempest-FlavorsAccessNegativeTestJSON-705329087 tempest-FlavorsAccessNegativeTestJSON-705329087-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4cec1dba3985429fb86df4afcba15d86"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:43.339208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4edb1613-097a-4d8a-b5c9-528eae30b4dc tempest-FlavorsAccessNegativeTestJSON-705329087 tempest-FlavorsAccessNegativeTestJSON-705329087-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '43e8c4b892424aebb2b8bb48109d4b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cec1dba3985429fb86df4afcba15d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4edb1613-097a-4d8a-b5c9-528eae30b4dc tempest-FlavorsAccessNegativeTestJSON-705329087 tempest-FlavorsAccessNegativeTestJSON-705329087-project] Request method failure captured: Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/flavors/25471744/action HTTP/1.1 Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 70 Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB223SUjSygykE8Syb3DkboRty8h0z6L5kCoRgNklLTHX-NLq2wWwLRNIsGLvWUc6MMJ-LFwhVkiBKNl4iSjP6R_iWcnrxDmCB-RbSEsQLDuAp7I1QIR4wMA55pqSsJDnVktVDE2UDTCZEzK_GVqBLw94mqtK7XM1Ws_sW4ygdUPNV0Y Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 4cec1dba3985429fb86df4afcba15d86 Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-705329087 Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:40:43.352341 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4cec1dba3985429fb86df4afcba15d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4cec1dba3985429fb86df4afcba15d86", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4cec1dba3985429fb86df4afcba15d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4cec1dba3985429fb86df4afcba15d86"}]}] Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-705329087 Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 4cec1dba3985429fb86df4afcba15d86 Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-705329087 Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FlavorsAccessNegativeTestJSON-705329087-project Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 43e8c4b892424aebb2b8bb48109d4b5a Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-705329087-project Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: {"removeTenantAccess": {"tenant": "4cec1dba3985429fb86df4afcba15d86"}} Aug 25 12:40:43.354867 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '25471744', 'body': {'removeTenantAccess': {'tenant': '4cec1dba3985429fb86df4afcba15d86'}}} Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can( Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:43.356663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 25 12:40:43.360670 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:43.363527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4edb1613-097a-4d8a-b5c9-528eae30b4dc tempest-FlavorsAccessNegativeTestJSON-705329087 tempest-FlavorsAccessNegativeTestJSON-705329087-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:43.363527 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4edb1613-097a-4d8a-b5c9-528eae30b4dc tempest-FlavorsAccessNegativeTestJSON-705329087 tempest-FlavorsAccessNegativeTestJSON-705329087-project] 10.222.0.70 "POST /compute/v2.1/flavors/25471744/action" status: 403 len: 133 microversion: 2.1 time: 0.076713 Aug 25 12:40:43.363527 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 201/396] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:40:43 2022] POST /compute/v2.1/flavors/25471744/action => generated 133 bytes in 82 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:43.379439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-01606762-acfb-4526-91b2-7495d5310ef9 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:43.380713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-23667d25-e8c5-4877-8c45-ddce9fdbe315 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:43.391996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23667d25-e8c5-4877-8c45-ddce9fdbe315 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:43.407646 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-01606762-acfb-4526-91b2-7495d5310ef9 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1474 microversion: 2.1 time: 0.938245 Aug 25 12:40:43.408747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23667d25-e8c5-4877-8c45-ddce9fdbe315 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:43.409372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23667d25-e8c5-4877-8c45-ddce9fdbe315 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:43.410882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23667d25-e8c5-4877-8c45-ddce9fdbe315 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:43.412007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23667d25-e8c5-4877-8c45-ddce9fdbe315 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:43.414324 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 196/397] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:42 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1474 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:43.417656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23667d25-e8c5-4877-8c45-ddce9fdbe315 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:43.424138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63f186ce-4c07-4ff9-bacb-0f0d35d4f095 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4cec1dba3985429fb86df4afcba15d86"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:43.497124 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-23667d25-e8c5-4877-8c45-ddce9fdbe315 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.128455 Aug 25 12:40:43.503486 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 202/398] 10.222.0.70 () {58 vars in 1176 bytes} [Thu Aug 25 12:40:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:43.535367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0daa891e-c429-4bad-b17f-bd3055c81b25 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:43.543297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0daa891e-c429-4bad-b17f-bd3055c81b25 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:43.544889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0daa891e-c429-4bad-b17f-bd3055c81b25 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:43.546123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0daa891e-c429-4bad-b17f-bd3055c81b25 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:43.550594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0daa891e-c429-4bad-b17f-bd3055c81b25 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:43.552825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0daa891e-c429-4bad-b17f-bd3055c81b25 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:43.554321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0daa891e-c429-4bad-b17f-bd3055c81b25 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:43.664610 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0daa891e-c429-4bad-b17f-bd3055c81b25 tempest-ServicesAdminTestJSON-2031177456 tempest-ServicesAdminTestJSON-2031177456-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.135455 Aug 25 12:40:43.666262 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 203/399] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:40:43 2022] GET /compute/v2.1/os-services => generated 944 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:44.126302 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-63f186ce-4c07-4ff9-bacb-0f0d35d4f095 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/25471744/action" status: 200 len: 21 microversion: 2.1 time: 0.707232 Aug 25 12:40:44.128466 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 197/400] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 12:40:43 2022] POST /compute/v2.1/flavors/25471744/action => generated 21 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:40:44.147410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63950a82-7846-4716-b5bd-15620ed1f881 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:44.243967 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-63950a82-7846-4716-b5bd-15620ed1f881 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/25471744" status: 202 len: 0 microversion: 2.1 time: 0.099963 Aug 25 12:40:44.245768 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 204/401] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:40:44 2022] DELETE /compute/v2.1/flavors/25471744 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:44.262129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a6743da5-6717-4367-8601-497243a6f9f2 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:44.372658 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a6743da5-6717-4367-8601-497243a6f9f2 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.116877 Aug 25 12:40:44.381531 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 198/402] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:44 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:44.444287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-162a2ae0-83e8-435b-8e95-0f3c8d08383f tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-856722989", "id": 7441798, "os-flavor-access:is_public": "False"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:44.484311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-36f7c0e6-4413-4d30-86fb-9b8c7bb87dff tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:44.490851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-36f7c0e6-4413-4d30-86fb-9b8c7bb87dff tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:44.531382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36f7c0e6-4413-4d30-86fb-9b8c7bb87dff tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:44.538723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36f7c0e6-4413-4d30-86fb-9b8c7bb87dff tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:44.541404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36f7c0e6-4413-4d30-86fb-9b8c7bb87dff tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:44.552484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36f7c0e6-4413-4d30-86fb-9b8c7bb87dff tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:44.553253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36f7c0e6-4413-4d30-86fb-9b8c7bb87dff tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:44.560088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36f7c0e6-4413-4d30-86fb-9b8c7bb87dff tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:44.572274 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-162a2ae0-83e8-435b-8e95-0f3c8d08383f tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.134094 Aug 25 12:40:44.583542 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 205/403] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:44 2022] POST /compute/v2.1/flavors => generated 429 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:44.620692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf63f2a6-29db-48d7-aa17-f5b8be725bcf tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0b5c196d0c3e49b7af4940dbad389e07"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:45.461133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-36f7c0e6-4413-4d30-86fb-9b8c7bb87dff tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:45.491616 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-36f7c0e6-4413-4d30-86fb-9b8c7bb87dff tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1474 microversion: 2.1 time: 1.031814 Aug 25 12:40:45.512709 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 199/404] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:44 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1474 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:45.629960 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-bf63f2a6-29db-48d7-aa17-f5b8be725bcf tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] HTTP exception thrown: Flavor access not found for 37 / 0b5c196d0c3e49b7af4940dbad389e07 combination. Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf63f2a6-29db-48d7-aa17-f5b8be725bcf tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Request method failure captured: Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/flavors/7441798/action HTTP/1.1 Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 70 Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB228PNRHahKdCh0LuXV-NRSPmvKCE7oenL05Vkc_2R56n0B3ov71C4LVu3q1HsbNrYDnWIKv5SK11UlaoqCh2ig3KwMYnZe0XUfrVriGHLtg1u8zf8sK8_FZZ-SU0QoF4nfaYG9cMOGVL0OjdVv1-rNluLVI-EHF1hUIdi4mtK9gdR8 Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f450a460dfdb4446aa5b12d4a0b8fd6a Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-515995969 Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:40:45.642818 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f450a460dfdb4446aa5b12d4a0b8fd6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f450a460dfdb4446aa5b12d4a0b8fd6a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f450a460dfdb4446aa5b12d4a0b8fd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f450a460dfdb4446aa5b12d4a0b8fd6a"}]}] Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-515995969 Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f450a460dfdb4446aa5b12d4a0b8fd6a Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-515995969 Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 79d25a26e5c14ef4827bf13707c6f626 Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: {"removeTenantAccess": {"tenant": "0b5c196d0c3e49b7af4940dbad389e07"}} Aug 25 12:40:45.645977 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: exception: Flavor access not found for 37 / 0b5c196d0c3e49b7af4940dbad389e07 combination. Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7441798', 'body': {'removeTenantAccess': {'tenant': '0b5c196d0c3e49b7af4940dbad389e07'}}} Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 25 12:40:45.647017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / 0b5c196d0c3e49b7af4940dbad389e07 combination. Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / 0b5c196d0c3e49b7af4940dbad389e07 combination. Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:45.649340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:45.652304 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:45.652304 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:45.652304 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:45.652304 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:45.652304 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / 0b5c196d0c3e49b7af4940dbad389e07 combination. Aug 25 12:40:45.652304 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:40:45.664123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf63f2a6-29db-48d7-aa17-f5b8be725bcf tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Returning 404 to user: Flavor access not found for 37 / 0b5c196d0c3e49b7af4940dbad389e07 combination. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:45.675563 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bf63f2a6-29db-48d7-aa17-f5b8be725bcf tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/7441798/action" status: 404 len: 124 microversion: 2.1 time: 1.061790 Aug 25 12:40:45.677081 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 206/405] 10.222.0.70 () {60 vars in 1191 bytes} [Thu Aug 25 12:40:44 2022] POST /compute/v2.1/flavors/7441798/action => generated 124 bytes in 1079 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:45.693768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aa7ccebb-0a5a-4a4b-8b1c-cb85e2acf8da tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:45.769875 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aa7ccebb-0a5a-4a4b-8b1c-cb85e2acf8da tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/7441798" status: 202 len: 0 microversion: 2.1 time: 0.083538 Aug 25 12:40:45.771286 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 200/406] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:40:45 2022] DELETE /compute/v2.1/flavors/7441798 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:40:45.793355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c23b0c01-af93-4930-99ff-d1738250f727 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:45.920082 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c23b0c01-af93-4930-99ff-d1738250f727 tempest-FlavorsAccessNegativeTestJSON-515995969 tempest-FlavorsAccessNegativeTestJSON-515995969-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.137548 Aug 25 12:40:45.967751 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 207/407] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:40:45 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:46.535261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c94e6b9a-763b-4dd0-9401-fcc694f2281d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:46.536424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c94e6b9a-763b-4dd0-9401-fcc694f2281d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:46.581056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c94e6b9a-763b-4dd0-9401-fcc694f2281d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:46.584708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c94e6b9a-763b-4dd0-9401-fcc694f2281d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:46.584708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c94e6b9a-763b-4dd0-9401-fcc694f2281d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:46.584708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c94e6b9a-763b-4dd0-9401-fcc694f2281d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:46.584708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c94e6b9a-763b-4dd0-9401-fcc694f2281d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:46.585797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c94e6b9a-763b-4dd0-9401-fcc694f2281d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:46.947777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c94e6b9a-763b-4dd0-9401-fcc694f2281d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:46.983858 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c94e6b9a-763b-4dd0-9401-fcc694f2281d tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1432 microversion: 2.1 time: 0.442680 Aug 25 12:40:46.991030 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 201/408] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:46 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1432 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:48.033029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-292c2a24-0a46-4dc5-9726-0761e09166fa tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:48.039482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-292c2a24-0a46-4dc5-9726-0761e09166fa tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:48.069874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-292c2a24-0a46-4dc5-9726-0761e09166fa tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:48.083567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-292c2a24-0a46-4dc5-9726-0761e09166fa tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:48.086515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-292c2a24-0a46-4dc5-9726-0761e09166fa tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:48.092331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-292c2a24-0a46-4dc5-9726-0761e09166fa tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:48.102691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-292c2a24-0a46-4dc5-9726-0761e09166fa tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:48.107691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-292c2a24-0a46-4dc5-9726-0761e09166fa tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:48.444725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-943ef045-c4c1-439e-89cf-c26812f10c15 req-57253d1d-5c7c-4df6-bcb9-2868067576e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4818dfd-d48d-49e5-9f45-50ac516e6953", "name": "network-vif-deleted", "tag": "71a8cbf9-6c9f-4173-bdd6-ac5255e58f2e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:48.489713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-292c2a24-0a46-4dc5-9726-0761e09166fa tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:48.507070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-943ef045-c4c1-439e-89cf-c26812f10c15 req-57253d1d-5c7c-4df6-bcb9-2868067576e2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:48.513770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-943ef045-c4c1-439e-89cf-c26812f10c15 req-57253d1d-5c7c-4df6-bcb9-2868067576e2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:48.520822 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-292c2a24-0a46-4dc5-9726-0761e09166fa tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1432 microversion: 2.1 time: 0.496354 Aug 25 12:40:48.523100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-943ef045-c4c1-439e-89cf-c26812f10c15 req-57253d1d-5c7c-4df6-bcb9-2868067576e2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:48.540556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 208/409] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:48 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1432 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:48.588284 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-943ef045-c4c1-439e-89cf-c26812f10c15 req-57253d1d-5c7c-4df6-bcb9-2868067576e2 service nova] Creating event network-vif-deleted:71a8cbf9-6c9f-4173-bdd6-ac5255e58f2e for instance a4818dfd-d48d-49e5-9f45-50ac516e6953 on n-h1-852771-8 Aug 25 12:40:48.616606 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-943ef045-c4c1-439e-89cf-c26812f10c15 req-57253d1d-5c7c-4df6-bcb9-2868067576e2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180447 Aug 25 12:40:48.622985 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 202/410] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:49.591255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:49.596989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:49.627889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:49.631341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:49.653325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:49.670614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:49.671982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:49.673173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:49.813872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:49.818202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:49.821895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:49.825930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lazy-loading 'fault' on Instance uuid a4818dfd-d48d-49e5-9f45-50ac516e6953 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:40:50.488017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd40770814e0045ba9c5b2e621ca0f397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbf78e11dac4679a21657e9964aeb9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:50.514068 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b7cff907-1714-42b7-ae95-17c38bcd217f tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 200 len: 1309 microversion: 2.1 time: 0.934532 Aug 25 12:40:50.519855 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 209/411] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:49 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 1309 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:51.557342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:51.579793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] [instance: a4818dfd-d48d-49e5-9f45-50ac516e6953] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:51.609625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:51.631803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:51.655139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:51.657204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:51.661304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:51.665270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:51.770457 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] HTTP exception thrown: Instance a4818dfd-d48d-49e5-9f45-50ac516e6953 could not be found. Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Request method failure captured: Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 HTTP/1.1 Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21qx3CMaDcRgjuOVoHpOrN5gPUJ3KQSjGQuLv7II2OFGgqABVlOxYGaU_KeCS2OAZO3v6W6i7B6s4B2XfqN-pJ2vYn7Rfp7YeY9_7bgUvYV0HBpPD1HVPrwylXfPUjKQgxfcZRx91STgJ-Mv7iAT2x8hBx7Sunh2nnTdO18xVzdPsg Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5fbf78e11dac4679a21657e9964aeb9c Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-LiveMigrationNegativeTest-532363896 Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:40:51.782903 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5fbf78e11dac4679a21657e9964aeb9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5fbf78e11dac4679a21657e9964aeb9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5fbf78e11dac4679a21657e9964aeb9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5fbf78e11dac4679a21657e9964aeb9c"}]}] Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-LiveMigrationNegativeTest-532363896 Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5fbf78e11dac4679a21657e9964aeb9c Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-532363896 Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-LiveMigrationNegativeTest-532363896-project Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d40770814e0045ba9c5b2e621ca0f397 Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-LiveMigrationNegativeTest-532363896-project Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance a4818dfd-d48d-49e5-9f45-50ac516e6953 could not be found. Aug 25 12:40:51.788918 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'a4818dfd-d48d-49e5-9f45-50ac516e6953'} Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4818dfd-d48d-49e5-9f45-50ac516e6953 could not be found. Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:51.791160 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4818dfd-d48d-49e5-9f45-50ac516e6953 could not be found. Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4818dfd-d48d-49e5-9f45-50ac516e6953 could not be found. Aug 25 12:40:51.796206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:40:51.804589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] Returning 404 to user: Instance a4818dfd-d48d-49e5-9f45-50ac516e6953 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:51.804589 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e4a655d6-5c6c-4ea8-9bd4-cbffef520409 tempest-LiveMigrationNegativeTest-532363896 tempest-LiveMigrationNegativeTest-532363896-project] 10.222.0.70 "GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953" status: 404 len: 111 microversion: 2.1 time: 0.247533 Aug 25 12:40:51.815750 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 203/412] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:51 2022] GET /compute/v2.1/servers/a4818dfd-d48d-49e5-9f45-50ac516e6953 => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:40:53.603328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:53.816519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Calling method '.version_select at 0x7f3a2adc6670>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:53.854446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:53.856484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:53.871849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:53.981150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:53.982172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:53.985483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:54.098748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:54.100142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:54.101841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:54.138494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:54.140016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:54.145016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:54.218391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:54.219799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:54.222063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:54.301140 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-256d3052-9112-4361-b96c-570419dfd0ba tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 1.849018 Aug 25 12:40:54.305455 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 210/413] 10.222.0.70 () {60 vars in 1243 bytes} [Thu Aug 25 12:40:52 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:40:54.359513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Calling method '.version_select at 0x7f3a2b130700>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:54.368936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:54.381065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:54.403370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:54.417140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:54.461492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:54.465979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:54.476134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:54.728404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:54.730897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:54.742977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:54.808475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:54.809604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:54.810431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:54.866906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:54.868261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:54.869375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:54.914122 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-414f9145-5446-4dc7-88cf-11873ccd66e3 tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.562203 Aug 25 12:40:54.916745 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 204/414] 10.222.0.70 () {60 vars in 1222 bytes} [Thu Aug 25 12:40:54 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:40:54.937412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3112de89-d362-480a-84a2-c75ff1a60d4e tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Calling method '.version_select at 0x7f3a2ac6f280>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:54.964360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3112de89-d362-480a-84a2-c75ff1a60d4e tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:54.965643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3112de89-d362-480a-84a2-c75ff1a60d4e tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:54.966622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3112de89-d362-480a-84a2-c75ff1a60d4e tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:55.028547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3112de89-d362-480a-84a2-c75ff1a60d4e tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:55.029933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3112de89-d362-480a-84a2-c75ff1a60d4e tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:55.030925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3112de89-d362-480a-84a2-c75ff1a60d4e tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:55.046400 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3112de89-d362-480a-84a2-c75ff1a60d4e tempest-HypervisorAdminV253TestBase-1686956810 tempest-HypervisorAdminV253TestBase-1686956810-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/03445f8a-b6ec-4cee-b916-6a2597baa79c" status: 200 len: 792 microversion: 2.53 time: 0.127261 Aug 25 12:40:55.048560 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 211/415] 10.222.0.70 () {60 vars in 1298 bytes} [Thu Aug 25 12:40:54 2022] GET /compute/v2.1/os-hypervisors/03445f8a-b6ec-4cee-b916-6a2597baa79c => generated 792 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:41:03.098820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-873e0ae7-34aa-4f88-8e60-d40627572a25 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:03.103550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-873e0ae7-34aa-4f88-8e60-d40627572a25 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:03.155697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-873e0ae7-34aa-4f88-8e60-d40627572a25 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:03.161242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-873e0ae7-34aa-4f88-8e60-d40627572a25 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:03.165636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-873e0ae7-34aa-4f88-8e60-d40627572a25 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:03.168311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-873e0ae7-34aa-4f88-8e60-d40627572a25 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:03.170459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-873e0ae7-34aa-4f88-8e60-d40627572a25 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:03.173350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-873e0ae7-34aa-4f88-8e60-d40627572a25 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:03.308804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-873e0ae7-34aa-4f88-8e60-d40627572a25 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:41:03.792873 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-873e0ae7-34aa-4f88-8e60-d40627572a25 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 204 len: 0 microversion: 2.1 time: 0.700547 Aug 25 12:41:03.809561 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 205/416] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:41:03 2022] DELETE /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:41:04.733103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1894230695", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "1629574775", "adminPass": "***", "networks": [{"uuid": "d19abbf3-705b-4ea7-8f5f-7ac9cbebbe87"}], "security_groups": [{"name": "tempest-securitygroup--1950138099"}], "key_name": "tempest-keypair-989566953", "user_data": "}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:05.043940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:05.626349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] validate_networks() for [('d19abbf3-705b-4ea7-8f5f-7ac9cbebbe87', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:41:09.190012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a54f064b-10c6-4af8-9064-c3eec6b25089 req-96843d68-740f-4308-8a6d-f3e10279650f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1", "name": "network-vif-deleted", "tag": "9e1842f8-5750-448c-bb6f-eecb481a2c29"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:09.229803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a54f064b-10c6-4af8-9064-c3eec6b25089 req-96843d68-740f-4308-8a6d-f3e10279650f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:09.238090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a54f064b-10c6-4af8-9064-c3eec6b25089 req-96843d68-740f-4308-8a6d-f3e10279650f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:09.239310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a54f064b-10c6-4af8-9064-c3eec6b25089 req-96843d68-740f-4308-8a6d-f3e10279650f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:09.258146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:09.311287 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a54f064b-10c6-4af8-9064-c3eec6b25089 req-96843d68-740f-4308-8a6d-f3e10279650f service nova] Creating event network-vif-deleted:9e1842f8-5750-448c-bb6f-eecb481a2c29 for instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 on n-h2-852771-8 Aug 25 12:41:09.335920 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a54f064b-10c6-4af8-9064-c3eec6b25089 req-96843d68-740f-4308-8a6d-f3e10279650f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154229 Aug 25 12:41:09.343839 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 206/417] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:41:10.490084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:41:10.490923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:41:10.491790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:41:10.492758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:41:10.493540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:41:10.560749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:10.567696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:10.575411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:10.579443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:10.583759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:10.585407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:10.668751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Getting quotas for project 88e943f7025e4663a3f3e10ea5857a08. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:10.697496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Getting quotas for user 708d03828d2744c7a386caf96df69865 and project 88e943f7025e4663a3f3e10ea5857a08. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:10.759840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:41:10.774704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:41:11.009162 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-90e1900c-6c49-4a59-96b8-cffbbf90439d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.289463 Aug 25 12:41:11.011056 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 212/418] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:41:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 6293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:41:11.064013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-067deaa9-a23b-40fe-b3ae-1f164975adc0 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:11.077213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-067deaa9-a23b-40fe-b3ae-1f164975adc0 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:11.093408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=7,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:11.846832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-067deaa9-a23b-40fe-b3ae-1f164975adc0 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:11.881193 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-067deaa9-a23b-40fe-b3ae-1f164975adc0 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1264 microversion: 2.1 time: 0.841021 Aug 25 12:41:11.897360 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 207/419] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:11 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1264 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:13.641552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-818de18f-cbb9-4f5a-911f-c39896e804cd tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Calling method '.version_select at 0x7f3a2ada9ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:13.647303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-818de18f-cbb9-4f5a-911f-c39896e804cd tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'bbc6d1c515cb4a5b81e97bc7c1e67081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79bed5871824ad9899167bc3786c1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-818de18f-cbb9-4f5a-911f-c39896e804cd tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Request method failure captured: Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23hgapQBR33wnjWFQxpN1-8mDRdS-mrZ4XzxKvA7EIGtSdnAesQTd4oujfrVpIs_Mo7HuxcjpckOQFCMM_cD62JmDqKD9vEMdW5Z8OWHMCWQ0Fl94TFrcBKYZXP3R3BKRWjh8HtQsLDfhqrl_nTAgcGj-oVHS7ulyj8YDSkZtubjb0 Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f79bed5871824ad9899167bc3786c1e2 Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:41:13.663743 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f79bed5871824ad9899167bc3786c1e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f79bed5871824ad9899167bc3786c1e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f79bed5871824ad9899167bc3786c1e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f79bed5871824ad9899167bc3786c1e2"}]}] Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f79bed5871824ad9899167bc3786c1e2 Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HypervisorAdminNegativeTestJSON-409183127-project Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bbc6d1c515cb4a5b81e97bc7c1e67081 Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-409183127-project Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: action_args: {} Aug 25 12:41:13.668100 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:41:13.669838 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 25 12:41:13.675795 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:13.684938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-818de18f-cbb9-4f5a-911f-c39896e804cd tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:13.684938 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-818de18f-cbb9-4f5a-911f-c39896e804cd tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 2.272712 Aug 25 12:41:13.684938 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 213/420] 10.222.0.70 () {58 vars in 1167 bytes} [Thu Aug 25 12:41:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 2277 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:13.709911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8c6277f9-51e0-41e9-a091-8ab3456bee0a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:13.711352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8c6277f9-51e0-41e9-a091-8ab3456bee0a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:13.730612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:13.737123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c6277f9-51e0-41e9-a091-8ab3456bee0a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:13.737984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c6277f9-51e0-41e9-a091-8ab3456bee0a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:13.738793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c6277f9-51e0-41e9-a091-8ab3456bee0a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:13.740234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c6277f9-51e0-41e9-a091-8ab3456bee0a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:13.748320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c6277f9-51e0-41e9-a091-8ab3456bee0a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:13.749273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c6277f9-51e0-41e9-a091-8ab3456bee0a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.044425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2b04c550>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:14.063526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.069553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.075737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.113596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.116717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.122522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.157611 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] HTTP exception thrown: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Request method failure captured: Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: request: PUT /compute/v2.1/os-services/412a3265-187c-482d-9bd9-674b7d226078 HTTP/1.1 Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 56 Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23o0AoSSYWLaluQgTOcxPA0WGKZIIr6RFQMHjnX1bQea7ykLVBhRwXbc2TX-7RfO2FlNI_PMaA0tvk_Vhw7kcGJDziMmOewC2m_OVHaTN18Np565lFqlap-jzk8jCfSdV7HXeD0zSU5MC7UyOj0SIAuwwdBLGLX-DIcRfWFRxWJaQU Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.53 Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c29dbec86bcd4aba9a66ef3ee93f9731 Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-661681497 Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:41:14.166488 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c29dbec86bcd4aba9a66ef3ee93f9731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c29dbec86bcd4aba9a66ef3ee93f9731", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c29dbec86bcd4aba9a66ef3ee93f9731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c29dbec86bcd4aba9a66ef3ee93f9731"}]}] Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-661681497 Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c29dbec86bcd4aba9a66ef3ee93f9731 Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-661681497 Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bec36d75e1824941a68fdbab93b6a385 Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:41:14.169282 n-d-852771-8 devstack@n-api.service[129060]: exception: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '412a3265-187c-482d-9bd9-674b7d226078', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.170981 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:14.174969 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:14.177966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:14.177966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.177966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.182390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Returning 404 to user: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:14.192655 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-05e1423a-29d2-4f0d-b1fc-317f3e48a8d9 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/412a3265-187c-482d-9bd9-674b7d226078" status: 404 len: 110 microversion: 2.53 time: 1.651409 Aug 25 12:41:14.198227 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 208/421] 10.222.0.70 () {62 vars in 1309 bytes} [Thu Aug 25 12:41:12 2022] PUT /compute/v2.1/os-services/412a3265-187c-482d-9bd9-674b7d226078 => generated 110 bytes in 1666 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:41:14.217833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9206dbae-b2e3-46b7-9857-5c1eabec51a5 tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Calling method '.version_select at 0x7f3a2ae46550>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:14.223407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9206dbae-b2e3-46b7-9857-5c1eabec51a5 tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'bbc6d1c515cb4a5b81e97bc7c1e67081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79bed5871824ad9899167bc3786c1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9206dbae-b2e3-46b7-9857-5c1eabec51a5 tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Request method failure captured: Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23hgapQBR33wnjWFQxpN1-8mDRdS-mrZ4XzxKvA7EIGtSdnAesQTd4oujfrVpIs_Mo7HuxcjpckOQFCMM_cD62JmDqKD9vEMdW5Z8OWHMCWQ0Fl94TFrcBKYZXP3R3BKRWjh8HtQsLDfhqrl_nTAgcGj-oVHS7ulyj8YDSkZtubjb0 Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f79bed5871824ad9899167bc3786c1e2 Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:41:14.228089 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f79bed5871824ad9899167bc3786c1e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f79bed5871824ad9899167bc3786c1e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f79bed5871824ad9899167bc3786c1e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f79bed5871824ad9899167bc3786c1e2"}]}] Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f79bed5871824ad9899167bc3786c1e2 Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-HypervisorAdminNegativeTestJSON-409183127-project Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bbc6d1c515cb4a5b81e97bc7c1e67081 Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-409183127-project Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: action_args: {} Aug 25 12:41:14.231470 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:41:14.233336 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 25 12:41:14.235683 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.240943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9206dbae-b2e3-46b7-9857-5c1eabec51a5 tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:14.242659 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9206dbae-b2e3-46b7-9857-5c1eabec51a5 tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.041910 Aug 25 12:41:14.255276 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 209/422] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:41:14 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:14.258883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2b04cc10>, body: {"status": "disabled"} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:14.268895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.270570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.271425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.283311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.284115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.285051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.298312 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] HTTP exception thrown: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Request method failure captured: Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: request: PUT /compute/v2.1/os-services/412a3265-187c-482d-9bd9-674b7d226078 HTTP/1.1 Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 22 Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23o0AoSSYWLaluQgTOcxPA0WGKZIIr6RFQMHjnX1bQea7ykLVBhRwXbc2TX-7RfO2FlNI_PMaA0tvk_Vhw7kcGJDziMmOewC2m_OVHaTN18Np565lFqlap-jzk8jCfSdV7HXeD0zSU5MC7UyOj0SIAuwwdBLGLX-DIcRfWFRxWJaQU Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.53 Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c29dbec86bcd4aba9a66ef3ee93f9731 Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-661681497 Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:41:14.304929 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c29dbec86bcd4aba9a66ef3ee93f9731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c29dbec86bcd4aba9a66ef3ee93f9731", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c29dbec86bcd4aba9a66ef3ee93f9731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c29dbec86bcd4aba9a66ef3ee93f9731"}]}] Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-661681497 Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c29dbec86bcd4aba9a66ef3ee93f9731 Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-661681497 Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bec36d75e1824941a68fdbab93b6a385 Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: {"status": "disabled"} Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: exception: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.307635 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '412a3265-187c-482d-9bd9-674b7d226078', 'body': {'status': 'disabled'}} Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.309212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:14.311546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:14.317103 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.317103 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.317103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Returning 404 to user: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:14.317103 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f6664e46-17cf-42ff-9f1b-4432d0af41bf tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/412a3265-187c-482d-9bd9-674b7d226078" status: 404 len: 110 microversion: 2.53 time: 0.060988 Aug 25 12:41:14.317103 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 210/423] 10.222.0.70 () {62 vars in 1309 bytes} [Thu Aug 25 12:41:14 2022] PUT /compute/v2.1/os-services/412a3265-187c-482d-9bd9-674b7d226078 => generated 110 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:41:14.328699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-453f5c27-a337-4d7b-8866-6db3f55156ce tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Calling method '.version_select at 0x7f3a2af1bb80>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:14.335399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-453f5c27-a337-4d7b-8866-6db3f55156ce tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'bbc6d1c515cb4a5b81e97bc7c1e67081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79bed5871824ad9899167bc3786c1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-453f5c27-a337-4d7b-8866-6db3f55156ce tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Request method failure captured: Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23hgapQBR33wnjWFQxpN1-8mDRdS-mrZ4XzxKvA7EIGtSdnAesQTd4oujfrVpIs_Mo7HuxcjpckOQFCMM_cD62JmDqKD9vEMdW5Z8OWHMCWQ0Fl94TFrcBKYZXP3R3BKRWjh8HtQsLDfhqrl_nTAgcGj-oVHS7ulyj8YDSkZtubjb0 Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f79bed5871824ad9899167bc3786c1e2 Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:41:14.339129 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f79bed5871824ad9899167bc3786c1e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f79bed5871824ad9899167bc3786c1e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f79bed5871824ad9899167bc3786c1e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f79bed5871824ad9899167bc3786c1e2"}]}] Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f79bed5871824ad9899167bc3786c1e2 Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-HypervisorAdminNegativeTestJSON-409183127-project Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bbc6d1c515cb4a5b81e97bc7c1e67081 Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-409183127-project Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: action_args: {} Aug 25 12:41:14.341873 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:41:14.343594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 25 12:41:14.347618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.357806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-453f5c27-a337-4d7b-8866-6db3f55156ce tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:14.357806 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-453f5c27-a337-4d7b-8866-6db3f55156ce tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.039671 Aug 25 12:41:14.359899 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 211/424] 10.222.0.70 () {58 vars in 1179 bytes} [Thu Aug 25 12:41:14 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:14.368012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2add6040>, body: {"status": "enabled"} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:14.387093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8c6277f9-51e0-41e9-a091-8ab3456bee0a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:14.399245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.414494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.415448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.422045 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8c6277f9-51e0-41e9-a091-8ab3456bee0a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1260 microversion: 2.1 time: 0.737657 Aug 25 12:41:14.438843 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 214/425] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:13 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1260 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:14.459664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.463332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.467560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] HTTP exception thrown: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Request method failure captured: Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: request: PUT /compute/v2.1/os-services/412a3265-187c-482d-9bd9-674b7d226078 HTTP/1.1 Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 21 Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23o0AoSSYWLaluQgTOcxPA0WGKZIIr6RFQMHjnX1bQea7ykLVBhRwXbc2TX-7RfO2FlNI_PMaA0tvk_Vhw7kcGJDziMmOewC2m_OVHaTN18Np565lFqlap-jzk8jCfSdV7HXeD0zSU5MC7UyOj0SIAuwwdBLGLX-DIcRfWFRxWJaQU Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.53 Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c29dbec86bcd4aba9a66ef3ee93f9731 Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-661681497 Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:41:14.497552 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c29dbec86bcd4aba9a66ef3ee93f9731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c29dbec86bcd4aba9a66ef3ee93f9731", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c29dbec86bcd4aba9a66ef3ee93f9731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c29dbec86bcd4aba9a66ef3ee93f9731"}]}] Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-661681497 Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c29dbec86bcd4aba9a66ef3ee93f9731 Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-661681497 Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bec36d75e1824941a68fdbab93b6a385 Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: {"status": "enabled"} Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: exception: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.500278 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '412a3265-187c-482d-9bd9-674b7d226078', 'body': {'status': 'enabled'}} Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.503466 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:14.512486 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:14.518372 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. Aug 25 12:41:14.518372 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:14.518372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Returning 404 to user: Service 412a3265-187c-482d-9bd9-674b7d226078 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:14.518372 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4622413d-fa46-448e-a19b-23675b177a8f tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/412a3265-187c-482d-9bd9-674b7d226078" status: 404 len: 110 microversion: 2.53 time: 0.137497 Aug 25 12:41:14.518372 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 212/426] 10.222.0.70 () {62 vars in 1309 bytes} [Thu Aug 25 12:41:14 2022] PUT /compute/v2.1/os-services/412a3265-187c-482d-9bd9-674b7d226078 => generated 110 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:41:14.518372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-35b1cdc5-1cb7-4942-a6b2-4b507492b447 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:14.523345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35b1cdc5-1cb7-4942-a6b2-4b507492b447 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.524245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35b1cdc5-1cb7-4942-a6b2-4b507492b447 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.525049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35b1cdc5-1cb7-4942-a6b2-4b507492b447 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.526585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35b1cdc5-1cb7-4942-a6b2-4b507492b447 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.527986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35b1cdc5-1cb7-4942-a6b2-4b507492b447 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.528793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35b1cdc5-1cb7-4942-a6b2-4b507492b447 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.598263 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-35b1cdc5-1cb7-4942-a6b2-4b507492b447 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.088520 Aug 25 12:41:14.614850 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 213/427] 10.222.0.70 () {60 vars in 1178 bytes} [Thu Aug 25 12:41:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:14.623393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e1dc2733-25f5-4a6a-94cd-e2d7a2677275 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:14.630386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1dc2733-25f5-4a6a-94cd-e2d7a2677275 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.631724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1dc2733-25f5-4a6a-94cd-e2d7a2677275 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.632847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1dc2733-25f5-4a6a-94cd-e2d7a2677275 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.634654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1dc2733-25f5-4a6a-94cd-e2d7a2677275 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.636845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1dc2733-25f5-4a6a-94cd-e2d7a2677275 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.638042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1dc2733-25f5-4a6a-94cd-e2d7a2677275 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.720975 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e1dc2733-25f5-4a6a-94cd-e2d7a2677275 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.104001 Aug 25 12:41:14.738309 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 214/428] 10.222.0.70 () {60 vars in 1211 bytes} [Thu Aug 25 12:41:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:14.769075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-60d002b8-2796-4a08-9a43-d138d47e66d1 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:14.787650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60d002b8-2796-4a08-9a43-d138d47e66d1 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.789120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60d002b8-2796-4a08-9a43-d138d47e66d1 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.791527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60d002b8-2796-4a08-9a43-d138d47e66d1 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.793744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60d002b8-2796-4a08-9a43-d138d47e66d1 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.795061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60d002b8-2796-4a08-9a43-d138d47e66d1 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.796211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60d002b8-2796-4a08-9a43-d138d47e66d1 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.862790 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-60d002b8-2796-4a08-9a43-d138d47e66d1 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.121048 Aug 25 12:41:14.866529 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 215/429] 10.222.0.70 () {60 vars in 1178 bytes} [Thu Aug 25 12:41:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:14.910454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e78781a7-a6fc-4079-9d99-7010f0e87fac tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:14.922573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e78781a7-a6fc-4079-9d99-7010f0e87fac tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.930957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e78781a7-a6fc-4079-9d99-7010f0e87fac tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.932213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e78781a7-a6fc-4079-9d99-7010f0e87fac tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:14.936341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e78781a7-a6fc-4079-9d99-7010f0e87fac tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:14.938220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e78781a7-a6fc-4079-9d99-7010f0e87fac tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:14.940539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e78781a7-a6fc-4079-9d99-7010f0e87fac tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:15.062005 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e78781a7-a6fc-4079-9d99-7010f0e87fac tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-852771-8&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.170915 Aug 25 12:41:15.076003 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 216/430] 10.222.0.70 () {60 vars in 1235 bytes} [Thu Aug 25 12:41:14 2022] GET /compute/v2.1/os-services?host=n-d-852771-8&binary=xxx => generated 16 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:15.088093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-84280a41-2ac8-48cb-9f30-156c2738a249 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:15.094788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84280a41-2ac8-48cb-9f30-156c2738a249 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:15.095654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84280a41-2ac8-48cb-9f30-156c2738a249 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:15.097049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84280a41-2ac8-48cb-9f30-156c2738a249 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:15.098508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84280a41-2ac8-48cb-9f30-156c2738a249 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:15.099338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84280a41-2ac8-48cb-9f30-156c2738a249 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:15.100107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84280a41-2ac8-48cb-9f30-156c2738a249 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:15.186841 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-84280a41-2ac8-48cb-9f30-156c2738a249 tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.095647 Aug 25 12:41:15.206583 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 217/431] 10.222.0.70 () {60 vars in 1178 bytes} [Thu Aug 25 12:41:15 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:15.221283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b512af1-78a4-4dc7-8ea7-3eb05a8b950e tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:15.266580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b512af1-78a4-4dc7-8ea7-3eb05a8b950e tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:15.274604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b512af1-78a4-4dc7-8ea7-3eb05a8b950e tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:15.281282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b512af1-78a4-4dc7-8ea7-3eb05a8b950e tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:15.283569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b512af1-78a4-4dc7-8ea7-3eb05a8b950e tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:15.299415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b512af1-78a4-4dc7-8ea7-3eb05a8b950e tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:15.300882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b512af1-78a4-4dc7-8ea7-3eb05a8b950e tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:15.446842 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b512af1-78a4-4dc7-8ea7-3eb05a8b950e tempest-ServicesAdminNegativeV253TestJSON-661681497 tempest-ServicesAdminNegativeV253TestJSON-661681497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.234126 Aug 25 12:41:15.462082 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 218/432] 10.222.0.70 () {60 vars in 1239 bytes} [Thu Aug 25 12:41:15 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:41:15.483049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-374f41e7-6560-4a79-9fa7-aadbd6d3d4a5 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:15.484273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-374f41e7-6560-4a79-9fa7-aadbd6d3d4a5 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:15.518989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-374f41e7-6560-4a79-9fa7-aadbd6d3d4a5 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:15.529458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-374f41e7-6560-4a79-9fa7-aadbd6d3d4a5 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:15.535998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-374f41e7-6560-4a79-9fa7-aadbd6d3d4a5 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:15.537736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-374f41e7-6560-4a79-9fa7-aadbd6d3d4a5 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:15.548249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-374f41e7-6560-4a79-9fa7-aadbd6d3d4a5 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:15.549261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-374f41e7-6560-4a79-9fa7-aadbd6d3d4a5 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:15.862423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-374f41e7-6560-4a79-9fa7-aadbd6d3d4a5 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:15.890424 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-374f41e7-6560-4a79-9fa7-aadbd6d3d4a5 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1322 microversion: 2.1 time: 0.417105 Aug 25 12:41:15.891775 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 219/433] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:15 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:15.935072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Calling method '.version_select at 0x7f3a2ac6f790>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:15.956919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:15.965208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:15.967281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:16.012221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:16.015266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:16.017348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:16.053769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:16.054755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:16.056244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:16.077796 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7994b414-90b5-4c58-b739-eadd80a061b1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.634594 Aug 25 12:41:16.079253 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 215/434] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:41:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:16.093472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54ef9c13-75f8-4a29-9d07-1a6fff9fa20d tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Calling method '.version_select at 0x7f3a2ac6f820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:16.097106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54ef9c13-75f8-4a29-9d07-1a6fff9fa20d tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'bbc6d1c515cb4a5b81e97bc7c1e67081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79bed5871824ad9899167bc3786c1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54ef9c13-75f8-4a29-9d07-1a6fff9fa20d tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Request method failure captured: Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23hgapQBR33wnjWFQxpN1-8mDRdS-mrZ4XzxKvA7EIGtSdnAesQTd4oujfrVpIs_Mo7HuxcjpckOQFCMM_cD62JmDqKD9vEMdW5Z8OWHMCWQ0Fl94TFrcBKYZXP3R3BKRWjh8HtQsLDfhqrl_nTAgcGj-oVHS7ulyj8YDSkZtubjb0 Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f79bed5871824ad9899167bc3786c1e2 Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:41:16.099413 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f79bed5871824ad9899167bc3786c1e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f79bed5871824ad9899167bc3786c1e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f79bed5871824ad9899167bc3786c1e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f79bed5871824ad9899167bc3786c1e2"}]}] Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f79bed5871824ad9899167bc3786c1e2 Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HypervisorAdminNegativeTestJSON-409183127-project Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bbc6d1c515cb4a5b81e97bc7c1e67081 Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-409183127-project Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '1'} Aug 25 12:41:16.102154 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:41:16.103834 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 25 12:41:16.113455 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.115821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54ef9c13-75f8-4a29-9d07-1a6fff9fa20d tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:16.115821 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-54ef9c13-75f8-4a29-9d07-1a6fff9fa20d tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.015480 Aug 25 12:41:16.115821 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 216/435] 10.222.0.70 () {58 vars in 1173 bytes} [Thu Aug 25 12:41:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:16.122642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a81071f7-7e77-41b2-886d-44fa50990ea5 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Calling method '.version_select at 0x7f3a2ae2bd30>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:16.126748 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a81071f7-7e77-41b2-886d-44fa50990ea5 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] HTTP exception thrown: Hypervisor with ID 'd4d154ba-4b25-4c45-9cc3-508be36f172a' could not be found. Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a81071f7-7e77-41b2-886d-44fa50990ea5 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Request method failure captured: Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hypervisors/d4d154ba-4b25-4c45-9cc3-508be36f172a/uptime HTTP/1.1 Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23nrI9OmgQj9xQ9QdLeA3VyZS4fckUL44AL0DjMSr4C-6WbEW9AIJN-WCtLRU9dynFNCmkiq14qjUCV_ZpmbqQlY6eVBtN2tfK5yk4Hx2xbTuO_OQaO5vCxHgQKafen6pK6c0AiZn72-Xx09q0Ql8BhHcg4L0sX7UmJEyItN9D9XIM Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: fef99d5d6ca542888e3660563c257a20 Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1296731588 Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:41:16.137845 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fef99d5d6ca542888e3660563c257a20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fef99d5d6ca542888e3660563c257a20", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fef99d5d6ca542888e3660563c257a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fef99d5d6ca542888e3660563c257a20"}]}] Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1296731588 Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: fef99d5d6ca542888e3660563c257a20 Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1296731588 Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 4d433ecbc239453393920fda1bf39391 Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: exception: Hypervisor with ID 'd4d154ba-4b25-4c45-9cc3-508be36f172a' could not be found. Aug 25 12:41:16.140700 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'd4d154ba-4b25-4c45-9cc3-508be36f172a'} Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd4d154ba-4b25-4c45-9cc3-508be36f172a' Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 25 12:41:16.142341 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd4d154ba-4b25-4c45-9cc3-508be36f172a' could not be found. Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.145229 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.153945 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.153945 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:16.153945 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:16.153945 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:16.153945 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:16.153945 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd4d154ba-4b25-4c45-9cc3-508be36f172a' could not be found. Aug 25 12:41:16.153945 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.155838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a81071f7-7e77-41b2-886d-44fa50990ea5 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Returning 404 to user: Hypervisor with ID 'd4d154ba-4b25-4c45-9cc3-508be36f172a' could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:16.159110 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a81071f7-7e77-41b2-886d-44fa50990ea5 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/d4d154ba-4b25-4c45-9cc3-508be36f172a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.043539 Aug 25 12:41:16.161152 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 217/436] 10.222.0.70 () {58 vars in 1278 bytes} [Thu Aug 25 12:41:16 2022] GET /compute/v2.1/os-hypervisors/d4d154ba-4b25-4c45-9cc3-508be36f172a/uptime => generated 123 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:41:16.178609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Calling method '.version_select at 0x7f3a2ae2bd30>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:16.182648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:16.183666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:16.184782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:16.215947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:16.217142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:16.218190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:16.240115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:16.241027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:16.241958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:16.257435 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ba901b73-a717-40c4-9be2-836414cf7ec1 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.086547 Aug 25 12:41:16.259165 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 218/437] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:41:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:16.278219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7358f4fd-e991-4907-b9d5-fd8320a4dd58 tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Calling method '.version_select at 0x7f3a2af2c3a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:16.285327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7358f4fd-e991-4907-b9d5-fd8320a4dd58 tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'bbc6d1c515cb4a5b81e97bc7c1e67081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79bed5871824ad9899167bc3786c1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7358f4fd-e991-4907-b9d5-fd8320a4dd58 tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Request method failure captured: Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23hgapQBR33wnjWFQxpN1-8mDRdS-mrZ4XzxKvA7EIGtSdnAesQTd4oujfrVpIs_Mo7HuxcjpckOQFCMM_cD62JmDqKD9vEMdW5Z8OWHMCWQ0Fl94TFrcBKYZXP3R3BKRWjh8HtQsLDfhqrl_nTAgcGj-oVHS7ulyj8YDSkZtubjb0 Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f79bed5871824ad9899167bc3786c1e2 Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:41:16.288566 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f79bed5871824ad9899167bc3786c1e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f79bed5871824ad9899167bc3786c1e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f79bed5871824ad9899167bc3786c1e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f79bed5871824ad9899167bc3786c1e2"}]}] Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f79bed5871824ad9899167bc3786c1e2 Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-409183127 Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HypervisorAdminNegativeTestJSON-409183127-project Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bbc6d1c515cb4a5b81e97bc7c1e67081 Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-409183127-project Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '1'} Aug 25 12:41:16.291217 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:41:16.293931 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 25 12:41:16.298352 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.303021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7358f4fd-e991-4907-b9d5-fd8320a4dd58 tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:16.303021 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7358f4fd-e991-4907-b9d5-fd8320a4dd58 tempest-HypervisorAdminNegativeTestJSON-409183127 tempest-HypervisorAdminNegativeTestJSON-409183127-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.022135 Aug 25 12:41:16.305149 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 219/438] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:41:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:41:16.333176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb605bde-ed84-4e37-a3af-aca8170ea6a2 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Calling method '.version_select at 0x7f3a2ad2a820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:16.343334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-fb605bde-ed84-4e37-a3af-aca8170ea6a2 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] HTTP exception thrown: Hypervisor with ID '7a85d5f3-ce69-4230-b80c-8f77630650bb' could not be found. Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb605bde-ed84-4e37-a3af-aca8170ea6a2 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Request method failure captured: Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-hypervisors/7a85d5f3-ce69-4230-b80c-8f77630650bb HTTP/1.1 Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23nrI9OmgQj9xQ9QdLeA3VyZS4fckUL44AL0DjMSr4C-6WbEW9AIJN-WCtLRU9dynFNCmkiq14qjUCV_ZpmbqQlY6eVBtN2tfK5yk4Hx2xbTuO_OQaO5vCxHgQKafen6pK6c0AiZn72-Xx09q0Ql8BhHcg4L0sX7UmJEyItN9D9XIM Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: fef99d5d6ca542888e3660563c257a20 Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1296731588 Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:41:16.351166 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fef99d5d6ca542888e3660563c257a20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fef99d5d6ca542888e3660563c257a20", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fef99d5d6ca542888e3660563c257a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fef99d5d6ca542888e3660563c257a20"}]}] Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1296731588 Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: fef99d5d6ca542888e3660563c257a20 Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1296731588 Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 4d433ecbc239453393920fda1bf39391 Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: exception: Hypervisor with ID '7a85d5f3-ce69-4230-b80c-8f77630650bb' could not be found. Aug 25 12:41:16.354049 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7a85d5f3-ce69-4230-b80c-8f77630650bb'} Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7a85d5f3-ce69-4230-b80c-8f77630650bb' Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 25 12:41:16.355597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:41:16.359958 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7a85d5f3-ce69-4230-b80c-8f77630650bb' could not be found. Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7a85d5f3-ce69-4230-b80c-8f77630650bb' could not be found. Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb605bde-ed84-4e37-a3af-aca8170ea6a2 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] Returning 404 to user: Hypervisor with ID '7a85d5f3-ce69-4230-b80c-8f77630650bb' could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb605bde-ed84-4e37-a3af-aca8170ea6a2 tempest-HypervisorAdminNegativeTestJSON-1296731588 tempest-HypervisorAdminNegativeTestJSON-1296731588-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/7a85d5f3-ce69-4230-b80c-8f77630650bb" status: 404 len: 123 microversion: 2.1 time: 0.040575 Aug 25 12:41:16.362221 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 220/439] 10.222.0.70 () {58 vars in 1257 bytes} [Thu Aug 25 12:41:16 2022] GET /compute/v2.1/os-hypervisors/7a85d5f3-ce69-4230-b80c-8f77630650bb => generated 123 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:16.941412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e753e68-608f-4283-b1c8-b1b34ecf0abb tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:16.942687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e753e68-608f-4283-b1c8-b1b34ecf0abb tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:16.981922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e753e68-608f-4283-b1c8-b1b34ecf0abb tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:16.983016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e753e68-608f-4283-b1c8-b1b34ecf0abb tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:16.983858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e753e68-608f-4283-b1c8-b1b34ecf0abb tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:16.985671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e753e68-608f-4283-b1c8-b1b34ecf0abb tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:16.986131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e753e68-608f-4283-b1c8-b1b34ecf0abb tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:16.987491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e753e68-608f-4283-b1c8-b1b34ecf0abb tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:17.304942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bcfd6049-8666-4d5e-983a-917c40d94e6b tempest-ServicesAdminNegativeV253TestJSON-903549064 tempest-ServicesAdminNegativeV253TestJSON-903549064-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:17.323865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bcfd6049-8666-4d5e-983a-917c40d94e6b tempest-ServicesAdminNegativeV253TestJSON-903549064 tempest-ServicesAdminNegativeV253TestJSON-903549064-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3081ea10b62f4966a1d1e804eccb7d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139a085d483447e2afd64a933465f202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bcfd6049-8666-4d5e-983a-917c40d94e6b tempest-ServicesAdminNegativeV253TestJSON-903549064 tempest-ServicesAdminNegativeV253TestJSON-903549064-project] Request method failure captured: Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23hu2Gb-pzOKlEu7ZS2BOgYTuRdu-ivqQglX9VqxSq11A-E6fMzMc6hK1zwgCh3MOsiQokW8G8wBT3K8xp0m3ovyQ24DXd1TaS-pdUjmYMmVvQNhqGcQ_AAbCPvHmvXCOV2aUXmCWBcOo_B3jPZtLQ6uKmtc1mO_TovaiBthUr7W4M Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.53 Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 139a085d483447e2afd64a933465f202 Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-903549064 Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:41:17.347597 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/139a085d483447e2afd64a933465f202"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_139a085d483447e2afd64a933465f202", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/139a085d483447e2afd64a933465f202"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/139a085d483447e2afd64a933465f202"}]}] Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-903549064 Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 139a085d483447e2afd64a933465f202 Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-903549064 Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServicesAdminNegativeV253TestJSON-903549064-project Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 3081ea10b62f4966a1d1e804eccb7d8e Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-903549064-project Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:41:17.350324 n-d-852771-8 devstack@n-api.service[129060]: action_args: {} Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:41:17.351413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:41:17.354362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:17.358075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bcfd6049-8666-4d5e-983a-917c40d94e6b tempest-ServicesAdminNegativeV253TestJSON-903549064 tempest-ServicesAdminNegativeV253TestJSON-903549064-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:17.358075 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bcfd6049-8666-4d5e-983a-917c40d94e6b tempest-ServicesAdminNegativeV253TestJSON-903549064 tempest-ServicesAdminNegativeV253TestJSON-903549064-project] 10.222.0.70 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 1.455856 Aug 25 12:41:17.359091 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 220/440] 10.222.0.70 () {60 vars in 1178 bytes} [Thu Aug 25 12:41:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 1466 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:41:17.716124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e753e68-608f-4283-b1c8-b1b34ecf0abb tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:17.743402 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e753e68-608f-4283-b1c8-b1b34ecf0abb tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1390 microversion: 2.1 time: 0.810313 Aug 25 12:41:17.747957 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 221/441] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:16 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1390 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:41:18.793008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-11df965f-ddeb-475f-8c65-361f666ac695 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:18.793992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-11df965f-ddeb-475f-8c65-361f666ac695 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:18.841811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11df965f-ddeb-475f-8c65-361f666ac695 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:18.843356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11df965f-ddeb-475f-8c65-361f666ac695 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:18.845651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11df965f-ddeb-475f-8c65-361f666ac695 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:18.851179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11df965f-ddeb-475f-8c65-361f666ac695 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:18.853966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11df965f-ddeb-475f-8c65-361f666ac695 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:18.857988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11df965f-ddeb-475f-8c65-361f666ac695 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:19.685120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-11df965f-ddeb-475f-8c65-361f666ac695 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:19.713986 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-11df965f-ddeb-475f-8c65-361f666ac695 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1390 microversion: 2.1 time: 0.933186 Aug 25 12:41:19.719673 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 221/442] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:18 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1390 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:20.480841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-697288082", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:20.634430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:20.692973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:41:20.738076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:20.953292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Calling method '.version_select at 0x7f3a2add6e50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:20.966538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:20.969111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:20.979310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:21.088002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:21.091790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:21.096865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:21.151657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:21.154973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:21.159363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:21.182287 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb1440f2-6d28-4a9a-9560-f372eb710404 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.454550 Aug 25 12:41:21.185944 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 222/443] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:41:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:21.195713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0bd1f657-14a8-4763-a807-c0a67e46fd20 req-84b0c463-fda3-425e-833d-789ec6580279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb9e5d2-e61f-42fd-8f76-e550cac1dc45", "tag": "02429e48-79b9-400c-bb52-5d4e7617d606"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:21.225053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0bd1f657-14a8-4763-a807-c0a67e46fd20 req-84b0c463-fda3-425e-833d-789ec6580279 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:21.226608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0bd1f657-14a8-4763-a807-c0a67e46fd20 req-84b0c463-fda3-425e-833d-789ec6580279 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:21.227925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0bd1f657-14a8-4763-a807-c0a67e46fd20 req-84b0c463-fda3-425e-833d-789ec6580279 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:21.263152 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0bd1f657-14a8-4763-a807-c0a67e46fd20 req-84b0c463-fda3-425e-833d-789ec6580279 service nova] Creating event network-changed:02429e48-79b9-400c-bb52-5d4e7617d606 for instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 on n-h1-852771-8 Aug 25 12:41:21.278849 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0bd1f657-14a8-4763-a807-c0a67e46fd20 req-84b0c463-fda3-425e-833d-789ec6580279 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089190 Aug 25 12:41:21.281698 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 223/444] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:21.300331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-befa4624-417d-4c7d-8e4b-e2b3eb8b04af tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:21.305711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-befa4624-417d-4c7d-8e4b-e2b3eb8b04af tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:21.326328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befa4624-417d-4c7d-8e4b-e2b3eb8b04af tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:21.328969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befa4624-417d-4c7d-8e4b-e2b3eb8b04af tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:21.331684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befa4624-417d-4c7d-8e4b-e2b3eb8b04af tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:21.335860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befa4624-417d-4c7d-8e4b-e2b3eb8b04af tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:21.337373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befa4624-417d-4c7d-8e4b-e2b3eb8b04af tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:21.338593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befa4624-417d-4c7d-8e4b-e2b3eb8b04af tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:21.866753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:22.014171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:41:22.015945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:41:22.068235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:41:22.076814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:41:22.089307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:41:22.155201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:22.164342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:22.166780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:22.170370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:22.172720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:22.177327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:22.264914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Getting quotas for project d8d7847b3b9b4c30ac6b74c42c71d0bb. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:22.276200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Getting quotas for user 2cbb89f012724d20891f91b2cb20e2af and project d8d7847b3b9b4c30ac6b74c42c71d0bb. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:22.302193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:41:22.306757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:41:22.324374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-befa4624-417d-4c7d-8e4b-e2b3eb8b04af tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:22.368046 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-befa4624-417d-4c7d-8e4b-e2b3eb8b04af tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1390 microversion: 2.1 time: 1.078188 Aug 25 12:41:22.411264 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 224/445] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:21 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1390 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:22.430243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Calling method '.version_select at 0x7f3a2ae365e0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:22.435101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:22.435994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:22.436767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:22.472157 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-483ab91e-8835-43ad-a1cd-2d8cb4ab08f5 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.505581 Aug 25 12:41:22.474139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:22.474393 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 222/446] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:41:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:41:22.479055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:22.484070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:22.573480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:22.574379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:22.575851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:22.599023 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f33f860f-b945-4735-9676-d3cde0e98062 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.185492 Aug 25 12:41:22.602106 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 225/447] 10.222.0.70 () {58 vars in 1167 bytes} [Thu Aug 25 12:41:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:22.628977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6237ebb2-499b-4e69-9047-c738b1e3e347 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:22.631539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6237ebb2-499b-4e69-9047-c738b1e3e347 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:23.146027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6237ebb2-499b-4e69-9047-c738b1e3e347 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:23.176240 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6237ebb2-499b-4e69-9047-c738b1e3e347 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1213 microversion: 2.1 time: 0.570565 Aug 25 12:41:23.177297 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 226/448] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:22 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1213 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:23.228720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Calling method '.version_select at 0x7f3a2ae0b310>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:23.232997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:23.244136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:23.246307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4ebcd027-79f5-4d16-9c25-15ff551fafcb tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2ada9820>, body: {"quota_set": {"ram": "5120"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:23.251528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:23.351899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:23.364305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:23.376047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:23.415955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:23.421646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:23.423149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:23.451708 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f6f53e5-145e-4c36-8214-752fa885636f tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.252949 Aug 25 12:41:23.454866 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 227/449] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:41:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:23.492067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b46ee8ac-10fd-4932-af40-721b8aa89872 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:23.500107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b46ee8ac-10fd-4932-af40-721b8aa89872 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:23.524263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b46ee8ac-10fd-4932-af40-721b8aa89872 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:23.538761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b46ee8ac-10fd-4932-af40-721b8aa89872 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:23.542635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b46ee8ac-10fd-4932-af40-721b8aa89872 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:23.544678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b46ee8ac-10fd-4932-af40-721b8aa89872 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:23.547795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b46ee8ac-10fd-4932-af40-721b8aa89872 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:23.559505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b46ee8ac-10fd-4932-af40-721b8aa89872 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:24.282968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b46ee8ac-10fd-4932-af40-721b8aa89872 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:24.286898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ebcd027-79f5-4d16-9c25-15ff551fafcb tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:24.291969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ebcd027-79f5-4d16-9c25-15ff551fafcb tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:24.293231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ebcd027-79f5-4d16-9c25-15ff551fafcb tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:24.299621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ebcd027-79f5-4d16-9c25-15ff551fafcb tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:24.301978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ebcd027-79f5-4d16-9c25-15ff551fafcb tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:24.307021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ebcd027-79f5-4d16-9c25-15ff551fafcb tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:24.321380 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b46ee8ac-10fd-4932-af40-721b8aa89872 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1390 microversion: 2.1 time: 0.856521 Aug 25 12:41:24.340824 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 228/450] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:23 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1390 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:24.374252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-982008c8-2ac7-4e6b-8698-e42575b5541b tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Calling method '.version_select at 0x7f3a2ae46ca0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:24.384808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982008c8-2ac7-4e6b-8698-e42575b5541b tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:24.388620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982008c8-2ac7-4e6b-8698-e42575b5541b tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:24.389955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982008c8-2ac7-4e6b-8698-e42575b5541b tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:24.467978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982008c8-2ac7-4e6b-8698-e42575b5541b tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:24.474477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982008c8-2ac7-4e6b-8698-e42575b5541b tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:24.475287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982008c8-2ac7-4e6b-8698-e42575b5541b tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:24.499724 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-982008c8-2ac7-4e6b-8698-e42575b5541b tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.148329 Aug 25 12:41:24.508484 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 229/451] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:41:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:24.527814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a8ca4e32-4ece-43fc-ab4b-ca6a1477250c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:24.530829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a8ca4e32-4ece-43fc-ab4b-ca6a1477250c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:24.606224 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4ebcd027-79f5-4d16-9c25-15ff551fafcb tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/fa42f8d1fc044fb4aa010bc2ff4fab82" status: 200 len: 148 microversion: 2.57 time: 2.129635 Aug 25 12:41:24.608384 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 223/452] 10.222.0.70 () {62 vars in 1303 bytes} [Thu Aug 25 12:41:22 2022] PUT /compute/v2.1/os-quota-sets/fa42f8d1fc044fb4aa010bc2ff4fab82 => generated 148 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:41:24.635476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-66f1e15b-a413-4f4e-9eb5-df0af06a08ae tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Calling method '.version_select at 0x7f3a2b0a63a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:24.656487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66f1e15b-a413-4f4e-9eb5-df0af06a08ae tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:24.664680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66f1e15b-a413-4f4e-9eb5-df0af06a08ae tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:24.666190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66f1e15b-a413-4f4e-9eb5-df0af06a08ae tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:24.774137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a8ca4e32-4ece-43fc-ab4b-ca6a1477250c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:24.811376 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-66f1e15b-a413-4f4e-9eb5-df0af06a08ae tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.198132 Aug 25 12:41:24.816840 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 224/453] 10.222.0.70 () {58 vars in 1179 bytes} [Thu Aug 25 12:41:24 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:24.829169 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a8ca4e32-4ece-43fc-ab4b-ca6a1477250c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1213 microversion: 2.1 time: 0.318397 Aug 25 12:41:24.844389 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 230/454] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:24 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1213 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:24.869010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bb863539-2a12-47a5-8f1f-116339ff514c tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Calling method '.version_select at 0x7f3a2ac6f820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:24.912415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Calling method '.version_select at 0x7f3a2ae0ba60>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:24.917298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:24.923469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:24.929855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:24.995896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:24.997917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:25.010610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:25.072791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:25.076050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:25.077439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:25.118271 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c1ee403-0b27-4fba-a936-572c454312fc tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.256155 Aug 25 12:41:25.120886 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 231/455] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:41:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:25.164744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-89401221-c1cb-4192-a68c-490d26be9383 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Calling method '.version_select at 0x7f3a2ae0b820>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:25.187787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89401221-c1cb-4192-a68c-490d26be9383 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:25.192777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89401221-c1cb-4192-a68c-490d26be9383 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:25.212974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89401221-c1cb-4192-a68c-490d26be9383 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:25.327366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89401221-c1cb-4192-a68c-490d26be9383 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:25.330006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89401221-c1cb-4192-a68c-490d26be9383 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:25.332110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89401221-c1cb-4192-a68c-490d26be9383 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:25.345490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=18 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:25.380765 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-89401221-c1cb-4192-a68c-490d26be9383 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.249090 Aug 25 12:41:25.384048 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 232/456] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:41:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:25.414772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2977e6b-6f4a-4d87-bc17-9d02753ad710 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:25.417657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b2977e6b-6f4a-4d87-bc17-9d02753ad710 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:25.453188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2977e6b-6f4a-4d87-bc17-9d02753ad710 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:25.457212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2977e6b-6f4a-4d87-bc17-9d02753ad710 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:25.458481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2977e6b-6f4a-4d87-bc17-9d02753ad710 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:25.464501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2977e6b-6f4a-4d87-bc17-9d02753ad710 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:25.468684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2977e6b-6f4a-4d87-bc17-9d02753ad710 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:25.470073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2977e6b-6f4a-4d87-bc17-9d02753ad710 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:26.520922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b2977e6b-6f4a-4d87-bc17-9d02753ad710 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:26.598258 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2977e6b-6f4a-4d87-bc17-9d02753ad710 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1390 microversion: 2.1 time: 1.193394 Aug 25 12:41:26.602610 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 233/457] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:25 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1390 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:26.634821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a4fc0ea-3b4b-4e12-9eee-000208b94e63 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Calling method '.version_select at 0x7f3a2b04c790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:26.653219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a4fc0ea-3b4b-4e12-9eee-000208b94e63 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:26.656946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a4fc0ea-3b4b-4e12-9eee-000208b94e63 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:26.661913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a4fc0ea-3b4b-4e12-9eee-000208b94e63 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:26.698470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a4fc0ea-3b4b-4e12-9eee-000208b94e63 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:26.700902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a4fc0ea-3b4b-4e12-9eee-000208b94e63 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:26.702874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a4fc0ea-3b4b-4e12-9eee-000208b94e63 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:26.726559 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a4fc0ea-3b4b-4e12-9eee-000208b94e63 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.116445 Aug 25 12:41:26.728442 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 234/458] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:41:26 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:26.748021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c0d223ad-3f42-43af-bf54-e0fd179b27ec tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:26.753720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c0d223ad-3f42-43af-bf54-e0fd179b27ec tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:26.771026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0d223ad-3f42-43af-bf54-e0fd179b27ec tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:26.772645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0d223ad-3f42-43af-bf54-e0fd179b27ec tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:26.774679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0d223ad-3f42-43af-bf54-e0fd179b27ec tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:26.776612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0d223ad-3f42-43af-bf54-e0fd179b27ec tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:26.778232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0d223ad-3f42-43af-bf54-e0fd179b27ec tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:26.780127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0d223ad-3f42-43af-bf54-e0fd179b27ec tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:26.949336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb863539-2a12-47a5-8f1f-116339ff514c tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:26.950262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb863539-2a12-47a5-8f1f-116339ff514c tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:26.951227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb863539-2a12-47a5-8f1f-116339ff514c tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:26.955975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb863539-2a12-47a5-8f1f-116339ff514c tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:26.956901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb863539-2a12-47a5-8f1f-116339ff514c tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:26.957715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb863539-2a12-47a5-8f1f-116339ff514c tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:27.023224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c0d223ad-3f42-43af-bf54-e0fd179b27ec tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:27.029756 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bb863539-2a12-47a5-8f1f-116339ff514c tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/fa42f8d1fc044fb4aa010bc2ff4fab82/detail" status: 200 len: 463 microversion: 2.57 time: 2.210692 Aug 25 12:41:27.031050 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 225/459] 10.222.0.70 () {60 vars in 1304 bytes} [Thu Aug 25 12:41:24 2022] GET /compute/v2.1/os-quota-sets/fa42f8d1fc044fb4aa010bc2ff4fab82/detail => generated 463 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:41:27.039971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Calling method '.version_select at 0x7f3a2ac8fd30>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:27.043714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:27.044721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:27.045679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:27.069707 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c0d223ad-3f42-43af-bf54-e0fd179b27ec tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1271 microversion: 2.1 time: 0.315466 Aug 25 12:41:27.081442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:27.082257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:27.082930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:27.091563 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 235/460] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:26 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1271 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:27.135659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:27.138273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:27.139952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:27.216024 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3dc231e2-c30f-4052-94f9-93b3e27ed172 tempest-HypervisorAdminTestJSON-1172654792 tempest-HypervisorAdminTestJSON-1172654792-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.182481 Aug 25 12:41:27.219253 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 226/461] 10.222.0.70 () {58 vars in 1173 bytes} [Thu Aug 25 12:41:27 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:27.673656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-de730410-23ae-48cb-bd5f-c3fc4d84810d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:27.677893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-de730410-23ae-48cb-bd5f-c3fc4d84810d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:27.688994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de730410-23ae-48cb-bd5f-c3fc4d84810d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:27.691260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de730410-23ae-48cb-bd5f-c3fc4d84810d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:27.692412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de730410-23ae-48cb-bd5f-c3fc4d84810d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:27.693939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de730410-23ae-48cb-bd5f-c3fc4d84810d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:27.695069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de730410-23ae-48cb-bd5f-c3fc4d84810d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:27.697041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de730410-23ae-48cb-bd5f-c3fc4d84810d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:28.136481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-de730410-23ae-48cb-bd5f-c3fc4d84810d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:28.191765 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-de730410-23ae-48cb-bd5f-c3fc4d84810d tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1390 microversion: 2.1 time: 0.539319 Aug 25 12:41:28.212592 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 236/462] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:27 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1390 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:28.242908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b9b8122-7170-41e3-a5dd-84248b0ac79f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:28.244979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5b9b8122-7170-41e3-a5dd-84248b0ac79f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:28.261745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b9b8122-7170-41e3-a5dd-84248b0ac79f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:28.263415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b9b8122-7170-41e3-a5dd-84248b0ac79f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:28.264583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b9b8122-7170-41e3-a5dd-84248b0ac79f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:28.267278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b9b8122-7170-41e3-a5dd-84248b0ac79f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:28.270450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b9b8122-7170-41e3-a5dd-84248b0ac79f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:28.272998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b9b8122-7170-41e3-a5dd-84248b0ac79f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:28.333376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:28.487178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b9b8122-7170-41e3-a5dd-84248b0ac79f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:28.518677 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b9b8122-7170-41e3-a5dd-84248b0ac79f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1271 microversion: 2.1 time: 0.290034 Aug 25 12:41:28.524151 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 237/463] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:28 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:28.539150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2add6d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:29.101659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1094569894", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a8823b91-974d-48ac-9e76-e7cbde8ff3bd"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:29.236009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] validate_networks() for [('a8823b91-974d-48ac-9e76-e7cbde8ff3bd', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:41:30.492173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:30.493022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:30.498714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:30.505691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:30.507249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:30.509052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:30.789236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:30.790777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:30.792373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:30.794259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:30.795393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:30.801334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.124886 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c5db52c-959c-49a1-af1f-e6ea8f58af6e tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/fa42f8d1fc044fb4aa010bc2ff4fab82?user_id=34717e2149c74920b2ee82df8fd8434e" status: 200 len: 148 microversion: 2.57 time: 2.598287 Aug 25 12:41:31.129461 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 238/464] 10.222.0.70 () {62 vars in 1384 bytes} [Thu Aug 25 12:41:28 2022] PUT /compute/v2.1/os-quota-sets/fa42f8d1fc044fb4aa010bc2ff4fab82?user_id=34717e2149c74920b2ee82df8fd8434e => generated 148 bytes in 2604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:41:31.139263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ef186bb9-38fc-4da0-a4e3-005be49c56ad tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:31.140977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ef186bb9-38fc-4da0-a4e3-005be49c56ad tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:31.156773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:31.162477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef186bb9-38fc-4da0-a4e3-005be49c56ad tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.163998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef186bb9-38fc-4da0-a4e3-005be49c56ad tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.165449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef186bb9-38fc-4da0-a4e3-005be49c56ad tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.167246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef186bb9-38fc-4da0-a4e3-005be49c56ad tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.168646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef186bb9-38fc-4da0-a4e3-005be49c56ad tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.169802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef186bb9-38fc-4da0-a4e3-005be49c56ad tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.884771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:41:31.885719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:41:31.886496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:41:31.887028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:41:31.887807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:41:31.919480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ef186bb9-38fc-4da0-a4e3-005be49c56ad tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:31.936952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.938231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.938708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.941003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.942121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.942665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.976077 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ef186bb9-38fc-4da0-a4e3-005be49c56ad tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1390 microversion: 2.1 time: 0.844023 Aug 25 12:41:31.994247 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 239/465] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:31 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1390 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:32.012169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ef87dc68-18bf-45f3-b41e-1ee6242249e3 req-66b58c9f-40ce-4b49-884a-b1aeb8f4898b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb9e5d2-e61f-42fd-8f76-e550cac1dc45", "name": "network-vif-plugged", "status": "completed", "tag": "02429e48-79b9-400c-bb52-5d4e7617d606"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:32.022699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Getting quotas for project c899e2a1474d4eb28b598f50e93312f8. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:32.048844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ef87dc68-18bf-45f3-b41e-1ee6242249e3 req-66b58c9f-40ce-4b49-884a-b1aeb8f4898b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:32.050366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ef87dc68-18bf-45f3-b41e-1ee6242249e3 req-66b58c9f-40ce-4b49-884a-b1aeb8f4898b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:32.051225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ef87dc68-18bf-45f3-b41e-1ee6242249e3 req-66b58c9f-40ce-4b49-884a-b1aeb8f4898b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:32.052424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Getting quotas for user b46ef01072a84a81b862baf3ea2387dd and project c899e2a1474d4eb28b598f50e93312f8. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:32.095128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:41:32.100005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:41:32.104286 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ef87dc68-18bf-45f3-b41e-1ee6242249e3 req-66b58c9f-40ce-4b49-884a-b1aeb8f4898b service nova] Creating event network-vif-plugged:02429e48-79b9-400c-bb52-5d4e7617d606 for instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 on n-h1-852771-8 Aug 25 12:41:32.126231 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ef87dc68-18bf-45f3-b41e-1ee6242249e3 req-66b58c9f-40ce-4b49-884a-b1aeb8f4898b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129861 Aug 25 12:41:32.128471 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 240/466] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:32.144392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-27f19a38-bc1b-45bd-a158-4baddedb384a tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:32.155318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-27f19a38-bc1b-45bd-a158-4baddedb384a tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:32.170316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27f19a38-bc1b-45bd-a158-4baddedb384a tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:32.175779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27f19a38-bc1b-45bd-a158-4baddedb384a tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:32.179607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27f19a38-bc1b-45bd-a158-4baddedb384a tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:32.185548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27f19a38-bc1b-45bd-a158-4baddedb384a tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:32.186804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27f19a38-bc1b-45bd-a158-4baddedb384a tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:32.188967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27f19a38-bc1b-45bd-a158-4baddedb384a tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:32.301470 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-94aff68b-f60a-4a18-acfb-d893b7549f34 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.221926 Aug 25 12:41:32.310779 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 227/467] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 12:41:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4236 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:41:32.684151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-27f19a38-bc1b-45bd-a158-4baddedb384a tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:32.702388 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-27f19a38-bc1b-45bd-a158-4baddedb384a tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1313 microversion: 2.1 time: 0.571931 Aug 25 12:41:32.703963 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 241/468] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:32 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:32.714453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6fe332e9-87dd-494a-9bba-db1bceb4f702 tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] Calling method '.version_select at 0x7f3a2ad875e0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:33.246295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-864773451", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:33.497340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:41:34.476926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:41:34.476926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:41:34.478256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:41:34.479932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:41:34.481090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:41:34.524720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:34.528734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:34.530056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:34.533190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:34.538052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:34.538916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:34.625732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:34.656267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for user aad1bc68cede45a7b1ab7cbda0d8208e and project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:34.739144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:41:34.744407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:41:34.981906 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-767deda8-eb93-4555-9447-b1f2d890a492 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.655688 Aug 25 12:41:34.985821 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 228/469] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:41:35.013102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:35.016885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:35.048295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:35.051773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:35.054475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:35.059282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:35.063892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:35.066199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:35.122687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=45 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:35.309166 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6fe332e9-87dd-494a-9bba-db1bceb4f702 tempest-QuotasAdminTestV257-1306479862 tempest-QuotasAdminTestV257-1306479862-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/fa42f8d1fc044fb4aa010bc2ff4fab82?user_id=34717e2149c74920b2ee82df8fd8434e" status: 200 len: 190 microversion: 2.57 time: 2.597962 Aug 25 12:41:35.315560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 242/470] 10.222.0.70 () {60 vars in 1364 bytes} [Thu Aug 25 12:41:32 2022] GET /compute/v2.1/os-quota-sets/fa42f8d1fc044fb4aa010bc2ff4fab82?user_id=34717e2149c74920b2ee82df8fd8434e => generated 190 bytes in 2610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:41:35.342525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab974582-de0d-4ad1-b525-ac8fd199fe54 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:35.344099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ab974582-de0d-4ad1-b525-ac8fd199fe54 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:35.376838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab974582-de0d-4ad1-b525-ac8fd199fe54 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:35.380705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab974582-de0d-4ad1-b525-ac8fd199fe54 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:35.383818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab974582-de0d-4ad1-b525-ac8fd199fe54 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:35.390382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab974582-de0d-4ad1-b525-ac8fd199fe54 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:35.395023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab974582-de0d-4ad1-b525-ac8fd199fe54 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:35.397485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab974582-de0d-4ad1-b525-ac8fd199fe54 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:35.557287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:35.593921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:35.599822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:35.611277 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1e9bf755-469d-498c-8bf6-d6cf0640f056 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1258 microversion: 2.25 time: 0.617062 Aug 25 12:41:35.618502 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 229/471] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:34 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1258 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:35.667737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-273e47f0-e2a1-4517-990b-a6cff914c8e6 req-25945048-765c-45c8-988b-33dab059ec10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6960e563-92b0-4f14-b569-ce3e44fcb8ee", "tag": "5891f8b4-7f71-476e-ab73-ebd17e79c4c3"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:35.756434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-273e47f0-e2a1-4517-990b-a6cff914c8e6 req-25945048-765c-45c8-988b-33dab059ec10 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:35.756773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-273e47f0-e2a1-4517-990b-a6cff914c8e6 req-25945048-765c-45c8-988b-33dab059ec10 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:35.757538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-273e47f0-e2a1-4517-990b-a6cff914c8e6 req-25945048-765c-45c8-988b-33dab059ec10 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:35.840391 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-273e47f0-e2a1-4517-990b-a6cff914c8e6 req-25945048-765c-45c8-988b-33dab059ec10 service nova] Creating event network-changed:5891f8b4-7f71-476e-ab73-ebd17e79c4c3 for instance 6960e563-92b0-4f14-b569-ce3e44fcb8ee on n-h2-852771-8 Aug 25 12:41:35.864642 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-273e47f0-e2a1-4517-990b-a6cff914c8e6 req-25945048-765c-45c8-988b-33dab059ec10 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240106 Aug 25 12:41:35.870406 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 230/472] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:35.882464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-39ce241d-db7d-45fa-b73e-0824351bf70e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:35.898406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-39ce241d-db7d-45fa-b73e-0824351bf70e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:35.926838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39ce241d-db7d-45fa-b73e-0824351bf70e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:35.930450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39ce241d-db7d-45fa-b73e-0824351bf70e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:35.935871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39ce241d-db7d-45fa-b73e-0824351bf70e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:35.938181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39ce241d-db7d-45fa-b73e-0824351bf70e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:35.943475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39ce241d-db7d-45fa-b73e-0824351bf70e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:35.946015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39ce241d-db7d-45fa-b73e-0824351bf70e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:36.339997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ab974582-de0d-4ad1-b525-ac8fd199fe54 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:36.390812 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ab974582-de0d-4ad1-b525-ac8fd199fe54 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1589 microversion: 2.1 time: 1.069398 Aug 25 12:41:36.392138 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 243/473] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:35 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1589 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:36.451972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-39ce241d-db7d-45fa-b73e-0824351bf70e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:36.473747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63447dc5-f2e6-4be0-8f40-97df20b32289 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:36.477108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-63447dc5-f2e6-4be0-8f40-97df20b32289 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:36.487887 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-39ce241d-db7d-45fa-b73e-0824351bf70e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1313 microversion: 2.1 time: 0.612100 Aug 25 12:41:36.492611 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 231/474] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:35 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:36.515008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ea2eab4b-562d-4133-83c1-5d806fe8afb7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:36.518543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ea2eab4b-562d-4133-83c1-5d806fe8afb7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:36.556567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2eab4b-562d-4133-83c1-5d806fe8afb7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:36.559662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2eab4b-562d-4133-83c1-5d806fe8afb7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:36.561854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2eab4b-562d-4133-83c1-5d806fe8afb7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:36.567301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2eab4b-562d-4133-83c1-5d806fe8afb7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:36.570547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2eab4b-562d-4133-83c1-5d806fe8afb7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:36.573248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2eab4b-562d-4133-83c1-5d806fe8afb7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:36.745069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63447dc5-f2e6-4be0-8f40-97df20b32289 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:36.771297 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-63447dc5-f2e6-4be0-8f40-97df20b32289 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1212 microversion: 2.1 time: 0.331003 Aug 25 12:41:36.789383 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 244/475] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:36 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1212 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:36.841496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:36.849773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:36.895000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:36.896813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:36.900292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:36.902609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:36.905891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:36.909934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:36.980606 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ea2eab4b-562d-4133-83c1-5d806fe8afb7 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.484699 Aug 25 12:41:36.994276 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 232/476] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 12:41:36 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45/os-interface => generated 284 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:37.277276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:37.337832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:37.364680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:37.384031 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b7b5e8f-2663-469f-b202-3e52fa33fd44 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1320 microversion: 2.25 time: 0.557811 Aug 25 12:41:37.390275 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 245/477] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:36 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1320 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:37.553834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec4a6b6c-e23d-4ab5-9fa0-a210150d0e27 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:37.557711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ec4a6b6c-e23d-4ab5-9fa0-a210150d0e27 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:37.615037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec4a6b6c-e23d-4ab5-9fa0-a210150d0e27 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:37.630323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec4a6b6c-e23d-4ab5-9fa0-a210150d0e27 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:37.634978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec4a6b6c-e23d-4ab5-9fa0-a210150d0e27 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:37.637154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec4a6b6c-e23d-4ab5-9fa0-a210150d0e27 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:37.669724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec4a6b6c-e23d-4ab5-9fa0-a210150d0e27 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:37.673673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec4a6b6c-e23d-4ab5-9fa0-a210150d0e27 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:37.828063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9791f5ff-faeb-4827-ae0f-b54ba2ee1f86 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:37.832723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9791f5ff-faeb-4827-ae0f-b54ba2ee1f86 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:37.869577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9791f5ff-faeb-4827-ae0f-b54ba2ee1f86 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:37.874496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9791f5ff-faeb-4827-ae0f-b54ba2ee1f86 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:37.878915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9791f5ff-faeb-4827-ae0f-b54ba2ee1f86 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:37.881398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9791f5ff-faeb-4827-ae0f-b54ba2ee1f86 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:37.883324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9791f5ff-faeb-4827-ae0f-b54ba2ee1f86 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:37.893357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9791f5ff-faeb-4827-ae0f-b54ba2ee1f86 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:38.235312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9791f5ff-faeb-4827-ae0f-b54ba2ee1f86 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:38.287102 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9791f5ff-faeb-4827-ae0f-b54ba2ee1f86 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1208 microversion: 2.1 time: 0.447729 Aug 25 12:41:38.293183 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 246/478] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:37 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1208 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:41:38.451707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:38.465786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:38.481825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:38.490892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:38.493899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:38.499965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:38.501952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:38.505583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:38.919112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:38.937982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:38.955760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:38.956891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ec4a6b6c-e23d-4ab5-9fa0-a210150d0e27 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:38.958541 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5778f997-141d-428f-b686-9388d7ca0cbe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1320 microversion: 2.25 time: 0.521971 Aug 25 12:41:38.959638 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 247/479] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:38 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1320 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:39.018164 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ec4a6b6c-e23d-4ab5-9fa0-a210150d0e27 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1313 microversion: 2.1 time: 1.488620 Aug 25 12:41:39.020918 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 233/480] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:37 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1313 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:39.344288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1acdc05d-8fd2-4f1e-ab61-2b40de8e96f3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:39.350876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1acdc05d-8fd2-4f1e-ab61-2b40de8e96f3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:39.378890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1acdc05d-8fd2-4f1e-ab61-2b40de8e96f3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:39.384973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1acdc05d-8fd2-4f1e-ab61-2b40de8e96f3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:39.387147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1acdc05d-8fd2-4f1e-ab61-2b40de8e96f3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:39.397175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1acdc05d-8fd2-4f1e-ab61-2b40de8e96f3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:39.403655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1acdc05d-8fd2-4f1e-ab61-2b40de8e96f3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:39.410054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1acdc05d-8fd2-4f1e-ab61-2b40de8e96f3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:40.039614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1acdc05d-8fd2-4f1e-ab61-2b40de8e96f3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:40.070718 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1acdc05d-8fd2-4f1e-ab61-2b40de8e96f3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1270 microversion: 2.1 time: 0.735764 Aug 25 12:41:40.081224 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 248/481] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:39 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1270 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:40.098319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:40.099936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:40.126558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:40.128453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:40.129635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:40.131458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:40.138735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:40.140081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:40.277289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0e4b73e4-d11e-4fbf-aca9-85330dc5c7e4 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2ab73790>, body: {"quota_set": {"ram": "5120"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:40.460800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e4b73e4-d11e-4fbf-aca9-85330dc5c7e4 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:40.461672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e4b73e4-d11e-4fbf-aca9-85330dc5c7e4 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:40.462437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e4b73e4-d11e-4fbf-aca9-85330dc5c7e4 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:40.463966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e4b73e4-d11e-4fbf-aca9-85330dc5c7e4 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:40.465160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e4b73e4-d11e-4fbf-aca9-85330dc5c7e4 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:40.466384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e4b73e4-d11e-4fbf-aca9-85330dc5c7e4 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:40.551878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:40.732677 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0e4b73e4-d11e-4fbf-aca9-85330dc5c7e4 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/419a215f959d48c1aa973982150829f3" status: 200 len: 240 microversion: 2.36 time: 1.124398 Aug 25 12:41:40.738760 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 234/482] 10.222.0.70 () {62 vars in 1303 bytes} [Thu Aug 25 12:41:39 2022] PUT /compute/v2.1/os-quota-sets/419a215f959d48c1aa973982150829f3 => generated 240 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:41:40.759731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54068680-7496-4af2-8baf-73fe7cd95b9e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:40.760974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-54068680-7496-4af2-8baf-73fe7cd95b9e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:40.790921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54068680-7496-4af2-8baf-73fe7cd95b9e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:40.791867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54068680-7496-4af2-8baf-73fe7cd95b9e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:40.792587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54068680-7496-4af2-8baf-73fe7cd95b9e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:40.793935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54068680-7496-4af2-8baf-73fe7cd95b9e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:40.794684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54068680-7496-4af2-8baf-73fe7cd95b9e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:40.795493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54068680-7496-4af2-8baf-73fe7cd95b9e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:40.899412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=5 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:40.933855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:41.003488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:41.009569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:41.021563 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-acdf781f-4572-4cb0-823b-d3c73cbe4b92 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1320 microversion: 2.25 time: 0.932150 Aug 25 12:41:41.024124 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 249/483] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:40 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1320 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:41.047248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f3ba373-5ee5-4666-a91f-4e4598f3313f tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Calling method '.version_select at 0x7f3a2add6c10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:41.592309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54068680-7496-4af2-8baf-73fe7cd95b9e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:41.621135 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-54068680-7496-4af2-8baf-73fe7cd95b9e tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1313 microversion: 2.1 time: 0.880077 Aug 25 12:41:41.641689 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 235/484] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:40 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1313 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:41.662931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8a991b4a-2ac8-427f-81ac-dd239e93b189 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:41.664123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8a991b4a-2ac8-427f-81ac-dd239e93b189 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:41.712761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a991b4a-2ac8-427f-81ac-dd239e93b189 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:41.713616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a991b4a-2ac8-427f-81ac-dd239e93b189 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:41.714376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a991b4a-2ac8-427f-81ac-dd239e93b189 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:41.715674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a991b4a-2ac8-427f-81ac-dd239e93b189 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:41.716497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a991b4a-2ac8-427f-81ac-dd239e93b189 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:41.717264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a991b4a-2ac8-427f-81ac-dd239e93b189 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:41.735256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f3ba373-5ee5-4666-a91f-4e4598f3313f tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:41.736111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f3ba373-5ee5-4666-a91f-4e4598f3313f tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:41.737371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f3ba373-5ee5-4666-a91f-4e4598f3313f tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:41.743600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f3ba373-5ee5-4666-a91f-4e4598f3313f tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:41.744346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f3ba373-5ee5-4666-a91f-4e4598f3313f tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:41.749646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f3ba373-5ee5-4666-a91f-4e4598f3313f tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:41.868743 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0f3ba373-5ee5-4666-a91f-4e4598f3313f tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/419a215f959d48c1aa973982150829f3/detail" status: 200 len: 672 microversion: 2.36 time: 0.842230 Aug 25 12:41:41.870118 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 250/485] 10.222.0.70 () {60 vars in 1304 bytes} [Thu Aug 25 12:41:41 2022] GET /compute/v2.1/os-quota-sets/419a215f959d48c1aa973982150829f3/detail => generated 672 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:41:42.052455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8a991b4a-2ac8-427f-81ac-dd239e93b189 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:42.089101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:42.092198 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8a991b4a-2ac8-427f-81ac-dd239e93b189 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1270 microversion: 2.1 time: 0.442009 Aug 25 12:41:42.107702 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 236/486] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:41 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1270 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:42.109881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:42.162886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:42.166734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:42.171121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:42.173433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:42.175560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:42.178054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:42.695728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-36c47e6b-4815-44de-83d9-0e4a9c33b71c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:42.697016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-36c47e6b-4815-44de-83d9-0e4a9c33b71c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:42.730476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c47e6b-4815-44de-83d9-0e4a9c33b71c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:42.731414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c47e6b-4815-44de-83d9-0e4a9c33b71c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:42.732175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c47e6b-4815-44de-83d9-0e4a9c33b71c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:42.733428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c47e6b-4815-44de-83d9-0e4a9c33b71c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:42.743072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c47e6b-4815-44de-83d9-0e4a9c33b71c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:42.748058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c47e6b-4815-44de-83d9-0e4a9c33b71c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:43.222790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:43.260051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:43.281879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:43.286422 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-286b71d6-baf3-42bf-9503-e2fe81786569 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1362 microversion: 2.25 time: 1.211497 Aug 25 12:41:43.290177 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 251/487] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:42 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1362 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:41:43.301565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2ad4eee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:43.383425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-36c47e6b-4815-44de-83d9-0e4a9c33b71c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:43.403485 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-36c47e6b-4815-44de-83d9-0e4a9c33b71c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1313 microversion: 2.1 time: 0.726461 Aug 25 12:41:43.405463 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 237/488] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:42 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:43.813591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:43.814445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:43.821641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:43.824160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:43.826358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:43.826975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:43.897762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d25c2382-31c4-4d3e-b0cc-6f464250c26d tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Calling method '.version_select at 0x7f3a2ab94ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:43.944410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:43.945356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:43.946256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:43.947669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:43.948532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:43.949252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:44.094163 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d25c2382-31c4-4d3e-b0cc-6f464250c26d tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864" status: 200 len: 371 microversion: 2.1 time: 0.686207 Aug 25 12:41:44.098377 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 238/489] 10.222.0.70 () {58 vars in 1242 bytes} [Thu Aug 25 12:41:43 2022] GET /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 => generated 371 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:44.128370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf435850-6c18-4787-8019-0f28f77c3feb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:44.130984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cf435850-6c18-4787-8019-0f28f77c3feb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:44.157455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf435850-6c18-4787-8019-0f28f77c3feb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:44.162661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf435850-6c18-4787-8019-0f28f77c3feb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:44.164553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf435850-6c18-4787-8019-0f28f77c3feb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:44.175351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf435850-6c18-4787-8019-0f28f77c3feb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:44.177471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf435850-6c18-4787-8019-0f28f77c3feb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:44.178927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf435850-6c18-4787-8019-0f28f77c3feb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:44.241941 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c58e5958-b0b8-49b0-bf9a-acf38bf0b272 tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/419a215f959d48c1aa973982150829f3?user_id=f8afc7dbff1f41cfbb4b6f726717445f" status: 200 len: 240 microversion: 2.36 time: 0.948596 Aug 25 12:41:44.243603 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 252/490] 10.222.0.70 () {62 vars in 1384 bytes} [Thu Aug 25 12:41:43 2022] PUT /compute/v2.1/os-quota-sets/419a215f959d48c1aa973982150829f3?user_id=f8afc7dbff1f41cfbb4b6f726717445f => generated 240 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:41:44.273831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab6d2c02-c443-4741-8a66-f95ca66e3f05 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:44.282182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ab6d2c02-c443-4741-8a66-f95ca66e3f05 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:44.326571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab6d2c02-c443-4741-8a66-f95ca66e3f05 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:44.326571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab6d2c02-c443-4741-8a66-f95ca66e3f05 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:44.326571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab6d2c02-c443-4741-8a66-f95ca66e3f05 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:44.338968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab6d2c02-c443-4741-8a66-f95ca66e3f05 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:44.339978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab6d2c02-c443-4741-8a66-f95ca66e3f05 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:44.340843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab6d2c02-c443-4741-8a66-f95ca66e3f05 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:44.435028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cf435850-6c18-4787-8019-0f28f77c3feb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:44.474226 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cf435850-6c18-4787-8019-0f28f77c3feb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1270 microversion: 2.1 time: 0.361828 Aug 25 12:41:44.481198 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 239/491] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:44 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1270 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:44.491343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-44a5d61c-8505-4695-a740-7ded1b05fea3 req-5e3475ae-dbb0-4b6e-af32-8e5b1784c178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb9e5d2-e61f-42fd-8f76-e550cac1dc45", "tag": "02429e48-79b9-400c-bb52-5d4e7617d606"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:44.536243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-44a5d61c-8505-4695-a740-7ded1b05fea3 req-5e3475ae-dbb0-4b6e-af32-8e5b1784c178 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:44.537163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-44a5d61c-8505-4695-a740-7ded1b05fea3 req-5e3475ae-dbb0-4b6e-af32-8e5b1784c178 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:44.538306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-44a5d61c-8505-4695-a740-7ded1b05fea3 req-5e3475ae-dbb0-4b6e-af32-8e5b1784c178 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:44.586901 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-44a5d61c-8505-4695-a740-7ded1b05fea3 req-5e3475ae-dbb0-4b6e-af32-8e5b1784c178 service nova] Creating event network-changed:02429e48-79b9-400c-bb52-5d4e7617d606 for instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 on n-h1-852771-8 Aug 25 12:41:44.610762 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-44a5d61c-8505-4695-a740-7ded1b05fea3 req-5e3475ae-dbb0-4b6e-af32-8e5b1784c178 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132595 Aug 25 12:41:44.612831 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 240/492] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:44.640605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0dd82872-40cd-41e9-97e6-c05c83053917 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2ab945e0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:44.899441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dd82872-40cd-41e9-97e6-c05c83053917 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:44.902735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dd82872-40cd-41e9-97e6-c05c83053917 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:44.904073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dd82872-40cd-41e9-97e6-c05c83053917 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:44.907176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dd82872-40cd-41e9-97e6-c05c83053917 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:44.910577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dd82872-40cd-41e9-97e6-c05c83053917 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:44.915462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dd82872-40cd-41e9-97e6-c05c83053917 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:45.013370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ab6d2c02-c443-4741-8a66-f95ca66e3f05 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:45.073358 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ab6d2c02-c443-4741-8a66-f95ca66e3f05 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1589 microversion: 2.1 time: 0.827690 Aug 25 12:41:45.116183 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 253/493] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:44 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1589 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:45.131830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-242a882a-3513-43b8-9efe-41f56570e66f tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] Calling method '.version_select at 0x7f3a2af1bee0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:45.325213 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0dd82872-40cd-41e9-97e6-c05c83053917 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864" status: 200 len: 328 microversion: 2.1 time: 0.705044 Aug 25 12:41:45.326538 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 241/494] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 12:41:44 2022] PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 => generated 328 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:45.355622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:45.364662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:45.388778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:45.389969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:45.390950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:45.392578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:45.393779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:45.394721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:45.917260 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-242a882a-3513-43b8-9efe-41f56570e66f tempest-QuotasAdminTestV236-1240914902 tempest-QuotasAdminTestV236-1240914902-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/419a215f959d48c1aa973982150829f3?user_id=f8afc7dbff1f41cfbb4b6f726717445f" status: 200 len: 282 microversion: 2.36 time: 0.790210 Aug 25 12:41:45.921608 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 254/495] 10.222.0.70 () {60 vars in 1364 bytes} [Thu Aug 25 12:41:45 2022] GET /compute/v2.1/os-quota-sets/419a215f959d48c1aa973982150829f3?user_id=f8afc7dbff1f41cfbb4b6f726717445f => generated 282 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:41:45.956851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97a9f01f-25c1-4d26-a115-4da73b4f430c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:45.958017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-97a9f01f-25c1-4d26-a115-4da73b4f430c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:45.999776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a9f01f-25c1-4d26-a115-4da73b4f430c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:46.000476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a9f01f-25c1-4d26-a115-4da73b4f430c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:46.001314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a9f01f-25c1-4d26-a115-4da73b4f430c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:46.008737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a9f01f-25c1-4d26-a115-4da73b4f430c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:46.009363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a9f01f-25c1-4d26-a115-4da73b4f430c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:46.009873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a9f01f-25c1-4d26-a115-4da73b4f430c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:46.815941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:46.882681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:46.904467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:46.909454 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-306edb38-8c1e-4657-b15f-efcda7267a14 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1362 microversion: 2.25 time: 1.561336 Aug 25 12:41:46.913194 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 242/496] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:45 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1362 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:46.935538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0fd84d77-ede2-452c-93bd-65be33c8eeab req-d52992ba-c342-4b3e-ad82-5bdd6a7fd0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6960e563-92b0-4f14-b569-ce3e44fcb8ee", "name": "network-vif-plugged", "status": "completed", "tag": "5891f8b4-7f71-476e-ab73-ebd17e79c4c3"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:47.024845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0fd84d77-ede2-452c-93bd-65be33c8eeab req-d52992ba-c342-4b3e-ad82-5bdd6a7fd0ba service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:47.025949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0fd84d77-ede2-452c-93bd-65be33c8eeab req-d52992ba-c342-4b3e-ad82-5bdd6a7fd0ba service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:47.026997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0fd84d77-ede2-452c-93bd-65be33c8eeab req-d52992ba-c342-4b3e-ad82-5bdd6a7fd0ba service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:47.100244 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-0fd84d77-ede2-452c-93bd-65be33c8eeab req-d52992ba-c342-4b3e-ad82-5bdd6a7fd0ba service nova] Creating event network-vif-plugged:5891f8b4-7f71-476e-ab73-ebd17e79c4c3 for instance 6960e563-92b0-4f14-b569-ce3e44fcb8ee on n-h2-852771-8 Aug 25 12:41:47.123669 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0fd84d77-ede2-452c-93bd-65be33c8eeab req-d52992ba-c342-4b3e-ad82-5bdd6a7fd0ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205393 Aug 25 12:41:47.137848 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 243/497] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:47.163189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-97a9f01f-25c1-4d26-a115-4da73b4f430c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:47.173723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1d5cb9f9-7ae8-4d36-ac6a-a9d8033f090c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:47.175674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1d5cb9f9-7ae8-4d36-ac6a-a9d8033f090c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:47.219664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d5cb9f9-7ae8-4d36-ac6a-a9d8033f090c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:47.222329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d5cb9f9-7ae8-4d36-ac6a-a9d8033f090c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:47.223469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d5cb9f9-7ae8-4d36-ac6a-a9d8033f090c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:47.224457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d5cb9f9-7ae8-4d36-ac6a-a9d8033f090c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:47.225212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d5cb9f9-7ae8-4d36-ac6a-a9d8033f090c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:47.231747 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-97a9f01f-25c1-4d26-a115-4da73b4f430c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1313 microversion: 2.1 time: 1.307887 Aug 25 12:41:47.244659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d5cb9f9-7ae8-4d36-ac6a-a9d8033f090c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:47.254647 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 255/498] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:45 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1313 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:47.687007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1d5cb9f9-7ae8-4d36-ac6a-a9d8033f090c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:47.718691 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1d5cb9f9-7ae8-4d36-ac6a-a9d8033f090c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1270 microversion: 2.1 time: 0.578050 Aug 25 12:41:47.757915 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 244/499] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:47 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1270 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:47.974855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:47.977832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:48.030317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:48.035187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:48.039119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:48.044388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:48.061610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:48.063487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:48.434116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-682342715", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:48.670479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:41:48.762362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:48.827653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:48.843200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:48.852332 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a1f2dc75-df3b-4524-953e-b81da14438e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1362 microversion: 2.25 time: 0.891955 Aug 25 12:41:48.853909 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 245/500] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:47 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1362 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:48.896888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bee1b461-342a-48bb-bf37-3e9af899613f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:48.901054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bee1b461-342a-48bb-bf37-3e9af899613f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:48.949204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bee1b461-342a-48bb-bf37-3e9af899613f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:48.950738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bee1b461-342a-48bb-bf37-3e9af899613f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:48.954774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bee1b461-342a-48bb-bf37-3e9af899613f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:48.958394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bee1b461-342a-48bb-bf37-3e9af899613f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:48.963731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bee1b461-342a-48bb-bf37-3e9af899613f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:48.964944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bee1b461-342a-48bb-bf37-3e9af899613f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:49.525097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:41:49.528564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:41:49.529952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:41:49.530768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:41:49.531542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:41:49.554316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:49.555885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:49.557131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:49.559408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:49.560813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:49.563263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:49.567149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bee1b461-342a-48bb-bf37-3e9af899613f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:49.598509 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bee1b461-342a-48bb-bf37-3e9af899613f tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1313 microversion: 2.1 time: 0.743154 Aug 25 12:41:49.600853 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 246/501] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:48 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1313 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:49.610685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Getting quotas for project 2f7c5b88d1454502a8d0005683747864. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:49.613914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-62bdc2e5-fe02-4d74-a26a-7b92e068f9a7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:49.615884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-62bdc2e5-fe02-4d74-a26a-7b92e068f9a7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:49.628882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Getting quotas for user 24b29c1762a5462eabc24eaa80891e30 and project 2f7c5b88d1454502a8d0005683747864. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:49.629320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62bdc2e5-fe02-4d74-a26a-7b92e068f9a7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:49.630568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62bdc2e5-fe02-4d74-a26a-7b92e068f9a7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:49.631992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62bdc2e5-fe02-4d74-a26a-7b92e068f9a7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:49.633622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62bdc2e5-fe02-4d74-a26a-7b92e068f9a7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:49.635327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62bdc2e5-fe02-4d74-a26a-7b92e068f9a7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:49.636429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62bdc2e5-fe02-4d74-a26a-7b92e068f9a7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:49.681527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.utils [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] cores quota exceeded for 2f7c5b88d1454502a8d0005683747864, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129060) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 25 12:41:49.683578 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Request method failure captured: Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 144 Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB24ERpI1ycb2j7ff4zF0W-mldJyEjuTpo1bVH7XoP7w4H1vvpzD-iMt6Z3Lkb_aW4xe1TresR32U24l8shkIVOgdt7X_VtClVHOORo5I72Wocf9GsgIHt56dntY95YGsgoAEyTbgDm3gKnV6YPArebgPQ55ZB4g3EzB6VXRMzzTe1ss Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 2f7c5b88d1454502a8d0005683747864 Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:41:49.700226 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f7c5b88d1454502a8d0005683747864"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f7c5b88d1454502a8d0005683747864", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f7c5b88d1454502a8d0005683747864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f7c5b88d1454502a8d0005683747864"}]}] Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 2f7c5b88d1454502a8d0005683747864 Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-QuotasAdminNegativeTest-1241346773-project Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 24b29c1762a5462eabc24eaa80891e30 Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-QuotasAdminNegativeTest-1241346773-project Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-682342715", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} Aug 25 12:41:49.702687 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-682342715', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452'}}} Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 25 12:41:49.704409 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:49.710255 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:49.718831 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:49.724505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:49.724505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:49.724505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:49.724505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:49.724505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 25 12:41:49.724505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:49.724505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:49.724505 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-763750e6-4c5b-43e9-9004-fe7ddc896f28 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.458773 Aug 25 12:41:49.724505 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 256/502] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:41:47 2022] POST /compute/v2.1/servers => generated 111 bytes in 2462 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:49.758727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d3e3f88-070a-48ad-a3ea-67d98086ef2c tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2ad87a60>, body: {"quota_set": {"cores": 20}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:50.303161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-62bdc2e5-fe02-4d74-a26a-7b92e068f9a7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:50.352665 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-62bdc2e5-fe02-4d74-a26a-7b92e068f9a7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1312 microversion: 2.1 time: 0.748739 Aug 25 12:41:50.368907 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 247/503] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:49 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1312 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:50.400966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:50.402988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:50.419729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:50.429664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:50.430867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:50.435479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d3e3f88-070a-48ad-a3ea-67d98086ef2c tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:50.436952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d3e3f88-070a-48ad-a3ea-67d98086ef2c tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:50.438586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d3e3f88-070a-48ad-a3ea-67d98086ef2c tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:50.440254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:50.440979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d3e3f88-070a-48ad-a3ea-67d98086ef2c tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:50.441644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:50.443436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d3e3f88-070a-48ad-a3ea-67d98086ef2c tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:50.443795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:50.445143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d3e3f88-070a-48ad-a3ea-67d98086ef2c tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:50.646933 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d3e3f88-070a-48ad-a3ea-67d98086ef2c tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864" status: 200 len: 329 microversion: 2.1 time: 0.909859 Aug 25 12:41:50.681791 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 257/504] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 12:41:49 2022] PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 => generated 329 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:50.707802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8c457b14-4116-44e7-992c-537a62ee9eb7 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:50.712341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8c457b14-4116-44e7-992c-537a62ee9eb7 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:50.742315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c457b14-4116-44e7-992c-537a62ee9eb7 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:50.743597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c457b14-4116-44e7-992c-537a62ee9eb7 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:50.744521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c457b14-4116-44e7-992c-537a62ee9eb7 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:50.748051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c457b14-4116-44e7-992c-537a62ee9eb7 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:50.748051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c457b14-4116-44e7-992c-537a62ee9eb7 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:50.748051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c457b14-4116-44e7-992c-537a62ee9eb7 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:51.416494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:51.460559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:51.466243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:51.470168 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee2d560b-8663-48c2-8085-6b371a189b3f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1362 microversion: 2.25 time: 1.098754 Aug 25 12:41:51.472659 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 248/505] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:50 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1362 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:51.482078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f6190f1d-604b-406a-8e63-bfdfeb44846c tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Calling method '.version_select at 0x7f3a2ab7f8b0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:51.491292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8c457b14-4116-44e7-992c-537a62ee9eb7 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:51.516262 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8c457b14-4116-44e7-992c-537a62ee9eb7 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1313 microversion: 2.1 time: 0.832331 Aug 25 12:41:51.523100 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 258/506] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:50 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1313 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:51.539509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-417bcd40-f52d-4f8a-b458-6aacba7de49f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:51.545205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-417bcd40-f52d-4f8a-b458-6aacba7de49f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:51.571869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417bcd40-f52d-4f8a-b458-6aacba7de49f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:51.573483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417bcd40-f52d-4f8a-b458-6aacba7de49f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:51.574450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417bcd40-f52d-4f8a-b458-6aacba7de49f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:51.578712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417bcd40-f52d-4f8a-b458-6aacba7de49f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:51.580131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417bcd40-f52d-4f8a-b458-6aacba7de49f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:51.582171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417bcd40-f52d-4f8a-b458-6aacba7de49f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:52.113377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-417bcd40-f52d-4f8a-b458-6aacba7de49f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:52.144424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:52.153805 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-417bcd40-f52d-4f8a-b458-6aacba7de49f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1312 microversion: 2.1 time: 0.624926 Aug 25 12:41:52.157451 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 259/507] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:51 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1312 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:52.171386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-e1304ae1-15ad-424d-9ccf-96ee07a64962 req-5ff6bd46-3b75-4d2c-bbe0-a9ac93aea5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0176f06a-ee98-45ab-b392-b9b46a8e82cd", "tag": "ffaaa691-b79c-4ca1-bdce-2e197228d565"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:52.207487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:52.220981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e1304ae1-15ad-424d-9ccf-96ee07a64962 req-5ff6bd46-3b75-4d2c-bbe0-a9ac93aea5d6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:52.221773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e1304ae1-15ad-424d-9ccf-96ee07a64962 req-5ff6bd46-3b75-4d2c-bbe0-a9ac93aea5d6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:52.222573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e1304ae1-15ad-424d-9ccf-96ee07a64962 req-5ff6bd46-3b75-4d2c-bbe0-a9ac93aea5d6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:52.286734 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-e1304ae1-15ad-424d-9ccf-96ee07a64962 req-5ff6bd46-3b75-4d2c-bbe0-a9ac93aea5d6 service nova] Creating event network-changed:ffaaa691-b79c-4ca1-bdce-2e197228d565 for instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd on n-h1-852771-8 Aug 25 12:41:52.302212 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-e1304ae1-15ad-424d-9ccf-96ee07a64962 req-5ff6bd46-3b75-4d2c-bbe0-a9ac93aea5d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140982 Aug 25 12:41:52.303719 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 260/508] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:52.308886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=47 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:52.338658 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f6190f1d-604b-406a-8e63-bfdfeb44846c tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864" status: 200 len: 371 microversion: 2.1 time: 0.862912 Aug 25 12:41:52.340441 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 249/509] 10.222.0.70 () {58 vars in 1242 bytes} [Thu Aug 25 12:41:51 2022] GET /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 => generated 371 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:52.363021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5fc65a3a-7531-483b-bf5c-7262217bfef3 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2addc940>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:52.526353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:52.529116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:52.558209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:52.563344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:52.567113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:52.568814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:52.573191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:52.574631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:52.602679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=55 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:52.628689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fc65a3a-7531-483b-bf5c-7262217bfef3 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:52.633210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fc65a3a-7531-483b-bf5c-7262217bfef3 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:52.634104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fc65a3a-7531-483b-bf5c-7262217bfef3 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:52.644893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fc65a3a-7531-483b-bf5c-7262217bfef3 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:52.647293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fc65a3a-7531-483b-bf5c-7262217bfef3 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:52.648488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fc65a3a-7531-483b-bf5c-7262217bfef3 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:52.810449 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5fc65a3a-7531-483b-bf5c-7262217bfef3 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864" status: 200 len: 328 microversion: 2.1 time: 0.456623 Aug 25 12:41:52.826126 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 261/510] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 12:41:52 2022] PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 => generated 328 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:52.828503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86056b38-5d49-4a64-bdb3-6d05b0df6ca8 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:52.837408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-86056b38-5d49-4a64-bdb3-6d05b0df6ca8 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:52.844936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86056b38-5d49-4a64-bdb3-6d05b0df6ca8 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:52.845994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86056b38-5d49-4a64-bdb3-6d05b0df6ca8 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:52.847043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86056b38-5d49-4a64-bdb3-6d05b0df6ca8 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:52.848597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86056b38-5d49-4a64-bdb3-6d05b0df6ca8 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:52.849556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86056b38-5d49-4a64-bdb3-6d05b0df6ca8 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:52.850546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86056b38-5d49-4a64-bdb3-6d05b0df6ca8 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:53.219591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:53.248014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:53.255107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:53.269967 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8b63cf0d-3959-4d77-ab7d-4b7f25ef0876 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1362 microversion: 2.25 time: 0.753050 Aug 25 12:41:53.277670 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 250/511] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:52 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1362 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:53.321405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-66fdfdcd-924d-4bad-82f6-f8aa91b31b84 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:53.323453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-66fdfdcd-924d-4bad-82f6-f8aa91b31b84 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:53.339017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fdfdcd-924d-4bad-82f6-f8aa91b31b84 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:53.340583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fdfdcd-924d-4bad-82f6-f8aa91b31b84 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:53.343656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fdfdcd-924d-4bad-82f6-f8aa91b31b84 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:53.345292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fdfdcd-924d-4bad-82f6-f8aa91b31b84 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:53.346406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fdfdcd-924d-4bad-82f6-f8aa91b31b84 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:53.347682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fdfdcd-924d-4bad-82f6-f8aa91b31b84 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:53.417256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:53.710585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-86056b38-5d49-4a64-bdb3-6d05b0df6ca8 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:53.731539 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-86056b38-5d49-4a64-bdb3-6d05b0df6ca8 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1463 microversion: 2.1 time: 0.917641 Aug 25 12:41:53.747198 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 262/512] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:52 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1463 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:53.792012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1070005552", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:53.828418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-66fdfdcd-924d-4bad-82f6-f8aa91b31b84 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:53.846747 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-66fdfdcd-924d-4bad-82f6-f8aa91b31b84 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1312 microversion: 2.1 time: 0.566843 Aug 25 12:41:53.849478 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 251/513] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:53 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1312 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:54.000727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:41:54.387466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19daf236-6461-4560-83dc-f08efae84714 tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Calling method '.version_select at 0x7f3a2ab88ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:54.409696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19daf236-6461-4560-83dc-f08efae84714 tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:54.411498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19daf236-6461-4560-83dc-f08efae84714 tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:54.411955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19daf236-6461-4560-83dc-f08efae84714 tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:54.453072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=15 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:54.478783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19daf236-6461-4560-83dc-f08efae84714 tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:54.479878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19daf236-6461-4560-83dc-f08efae84714 tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:54.480861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19daf236-6461-4560-83dc-f08efae84714 tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:54.522107 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19daf236-6461-4560-83dc-f08efae84714 tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/d8d7847b3b9b4c30ac6b74c42c71d0bb?start=2022-08-24T12%3A41%3A53.766944&end=2022-08-26T12%3A41%3A53.766944" status: 200 len: 694 microversion: 2.1 time: 0.670420 Aug 25 12:41:54.523897 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 252/514] 10.222.0.70 () {58 vars in 1412 bytes} [Thu Aug 25 12:41:53 2022] GET /compute/v2.1/os-simple-tenant-usage/d8d7847b3b9b4c30ac6b74c42c71d0bb?start=2022-08-24T12%3A41%3A53.766944&end=2022-08-26T12%3A41%3A53.766944 => generated 694 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:54.536768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:54.538757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:54.570648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:54.574155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:54.577825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:54.582966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:54.584268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:54.586740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:54.654849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:41:54.657577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:41:54.657577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:41:54.657577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:41:54.659920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:41:54.679416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:54.680582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:54.681499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:54.683345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:54.684333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:54.685342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:54.732820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Getting quotas for project 2f7c5b88d1454502a8d0005683747864. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:54.745997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Getting quotas for user 24b29c1762a5462eabc24eaa80891e30 and project 2f7c5b88d1454502a8d0005683747864. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:54.809024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.utils [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] instances quota exceeded for 2f7c5b88d1454502a8d0005683747864, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129060) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 25 12:41:54.810631 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Request method failure captured: Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 145 Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB24ERpI1ycb2j7ff4zF0W-mldJyEjuTpo1bVH7XoP7w4H1vvpzD-iMt6Z3Lkb_aW4xe1TresR32U24l8shkIVOgdt7X_VtClVHOORo5I72Wocf9GsgIHt56dntY95YGsgoAEyTbgDm3gKnV6YPArebgPQ55ZB4g3EzB6VXRMzzTe1ss Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 2f7c5b88d1454502a8d0005683747864 Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:41:54.817182 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f7c5b88d1454502a8d0005683747864"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f7c5b88d1454502a8d0005683747864", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f7c5b88d1454502a8d0005683747864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f7c5b88d1454502a8d0005683747864"}]}] Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 2f7c5b88d1454502a8d0005683747864 Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-QuotasAdminNegativeTest-1241346773-project Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 24b29c1762a5462eabc24eaa80891e30 Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-QuotasAdminNegativeTest-1241346773-project Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1070005552", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} Aug 25 12:41:54.820183 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1070005552', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452'}}} Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 25 12:41:54.821020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:54.823917 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:54.828240 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:54.837960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:54.837960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:54.837960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:54.837960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:54.837960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 25 12:41:54.837960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:41:54.837960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:54.837960 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-de30560d-e206-49fc-990c-3b1d37f8aae3 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.062776 Aug 25 12:41:54.837960 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 263/515] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:41:53 2022] POST /compute/v2.1/servers => generated 119 bytes in 1080 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:54.863751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85108bee-94ba-489a-9917-a89eeb159cb2 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '.version_select at 0x7f3a2ad87700>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:54.916280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85108bee-94ba-489a-9917-a89eeb159cb2 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:54.917443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85108bee-94ba-489a-9917-a89eeb159cb2 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:54.918298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85108bee-94ba-489a-9917-a89eeb159cb2 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:54.992381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85108bee-94ba-489a-9917-a89eeb159cb2 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:54.992988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85108bee-94ba-489a-9917-a89eeb159cb2 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:54.993797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85108bee-94ba-489a-9917-a89eeb159cb2 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:55.081548 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85108bee-94ba-489a-9917-a89eeb159cb2 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/d8d7847b3b9b4c30ac6b74c42c71d0bb?start=2022-08-24T12%3A41%3A53.766944&end=2022-08-26T12%3A41%3A53.766944" status: 200 len: 690 microversion: 2.1 time: 0.247894 Aug 25 12:41:55.086131 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 264/516] 10.222.0.70 () {58 vars in 1412 bytes} [Thu Aug 25 12:41:54 2022] GET /compute/v2.1/os-simple-tenant-usage/d8d7847b3b9b4c30ac6b74c42c71d0bb?start=2022-08-24T12%3A41%3A53.766944&end=2022-08-26T12%3A41%3A53.766944 => generated 690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:55.099512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-948d8d30-9428-461b-b60f-a0ef04ad8f7a tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2ae36a60>, body: {"quota_set": {"instances": 10}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:55.109067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:55.156923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:55.168932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:55.176914 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e04cbf18-5404-4613-b454-944d389a57d6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1362 microversion: 2.25 time: 0.645601 Aug 25 12:41:55.183446 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 253/517] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:54 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1362 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:55.208110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4418f55c-f0a5-47d1-aa76-803e97f1a093 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:55.223842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4418f55c-f0a5-47d1-aa76-803e97f1a093 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:55.291572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4418f55c-f0a5-47d1-aa76-803e97f1a093 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:55.292494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4418f55c-f0a5-47d1-aa76-803e97f1a093 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:55.293320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4418f55c-f0a5-47d1-aa76-803e97f1a093 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:55.295041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4418f55c-f0a5-47d1-aa76-803e97f1a093 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:55.295928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4418f55c-f0a5-47d1-aa76-803e97f1a093 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:55.296844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4418f55c-f0a5-47d1-aa76-803e97f1a093 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:56.290968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-948d8d30-9428-461b-b60f-a0ef04ad8f7a tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:56.292868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-948d8d30-9428-461b-b60f-a0ef04ad8f7a tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:56.293973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-948d8d30-9428-461b-b60f-a0ef04ad8f7a tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:56.295822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-948d8d30-9428-461b-b60f-a0ef04ad8f7a tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:56.297281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-948d8d30-9428-461b-b60f-a0ef04ad8f7a tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:56.300176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-948d8d30-9428-461b-b60f-a0ef04ad8f7a tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:56.464066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4418f55c-f0a5-47d1-aa76-803e97f1a093 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:56.471877 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-948d8d30-9428-461b-b60f-a0ef04ad8f7a tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864" status: 200 len: 329 microversion: 2.1 time: 1.382633 Aug 25 12:41:56.474461 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 265/518] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 12:41:55 2022] PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 => generated 329 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:56.501327 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4418f55c-f0a5-47d1-aa76-803e97f1a093 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1312 microversion: 2.1 time: 1.315816 Aug 25 12:41:56.504238 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 254/519] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:55 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1312 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:56.506111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ddf90ca-5cf5-449b-a4cb-f748606c236c tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Calling method '.version_select at 0x7f3a2ad87c10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:56.522216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a547307a-d0ad-48bc-8b9f-424dccc21afb req-2f7c160e-a8c9-4ad8-934c-71d5506e55bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e481324-3e50-472a-857d-d015400b2260", "tag": "3ab10696-8912-459d-b019-6b94e0f42269"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:56.543311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ddf90ca-5cf5-449b-a4cb-f748606c236c tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:56.547375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ddf90ca-5cf5-449b-a4cb-f748606c236c tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:56.551706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ddf90ca-5cf5-449b-a4cb-f748606c236c tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:56.565931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a547307a-d0ad-48bc-8b9f-424dccc21afb req-2f7c160e-a8c9-4ad8-934c-71d5506e55bb service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:56.567609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a547307a-d0ad-48bc-8b9f-424dccc21afb req-2f7c160e-a8c9-4ad8-934c-71d5506e55bb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:56.568533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a547307a-d0ad-48bc-8b9f-424dccc21afb req-2f7c160e-a8c9-4ad8-934c-71d5506e55bb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:56.599301 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a547307a-d0ad-48bc-8b9f-424dccc21afb req-2f7c160e-a8c9-4ad8-934c-71d5506e55bb service nova] Creating event network-changed:3ab10696-8912-459d-b019-6b94e0f42269 for instance 3e481324-3e50-472a-857d-d015400b2260 on n-h2-852771-8 Aug 25 12:41:56.611572 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a547307a-d0ad-48bc-8b9f-424dccc21afb req-2f7c160e-a8c9-4ad8-934c-71d5506e55bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099056 Aug 25 12:41:56.613989 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 255/520] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:56.623615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ddf90ca-5cf5-449b-a4cb-f748606c236c tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:56.624242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ddf90ca-5cf5-449b-a4cb-f748606c236c tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:56.624845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ddf90ca-5cf5-449b-a4cb-f748606c236c tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:56.636797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:56.640125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:56.670287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:56.672445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:56.674767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:56.678406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:56.682067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:56.684271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:56.740766 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ddf90ca-5cf5-449b-a4cb-f748606c236c tempest-TenantUsagesTestJSON-1740074662 tempest-TenantUsagesTestJSON-1740074662-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-24T12%3A41%3A53.766944&end=2022-08-26T12%3A41%3A53.766944&detailed=1" status: 200 len: 4574 microversion: 2.1 time: 0.248825 Aug 25 12:41:56.740766 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 266/521] 10.222.0.70 () {58 vars in 1335 bytes} [Thu Aug 25 12:41:56 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-24T12%3A41%3A53.766944&end=2022-08-26T12%3A41%3A53.766944&detailed=1 => generated 4574 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:57.242252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:57.277888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:57.280516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:57.282820 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-09fbbcb6-6477-40ec-835f-a9201ed1f9c0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1362 microversion: 2.25 time: 0.665403 Aug 25 12:41:57.284124 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 256/522] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:56 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1362 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:57.302372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f3ae283b-c9a9-4867-99a3-57d342079900 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Calling method '.version_select at 0x7f3a2ac11790>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:57.367666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d1b88b76-be91-4fe3-8844-817db5f6c874 tempest-SecurityGroupsTestAdminJSON-459227331 tempest-SecurityGroupsTestAdminJSON-459227331-project] Action: 'create', calling method: .version_select at 0x7f3a2acf34c0>, body: {"security_group": {"name": "tempest-securitygroup-1860476231", "description": "tempest-description-1761286249"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:57.874913 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f3ae283b-c9a9-4867-99a3-57d342079900 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864" status: 200 len: 371 microversion: 2.1 time: 0.579599 Aug 25 12:41:57.876411 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 257/523] 10.222.0.70 () {58 vars in 1242 bytes} [Thu Aug 25 12:41:57 2022] GET /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 => generated 371 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:57.901201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fdd3a3f4-1569-40a6-80c9-d65bb693e50b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:57.903263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fdd3a3f4-1569-40a6-80c9-d65bb693e50b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:57.919053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd3a3f4-1569-40a6-80c9-d65bb693e50b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:57.920749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd3a3f4-1569-40a6-80c9-d65bb693e50b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:57.922875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd3a3f4-1569-40a6-80c9-d65bb693e50b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:57.926059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd3a3f4-1569-40a6-80c9-d65bb693e50b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:57.927598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd3a3f4-1569-40a6-80c9-d65bb693e50b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:57.929299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd3a3f4-1569-40a6-80c9-d65bb693e50b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:58.036677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fdd3a3f4-1569-40a6-80c9-d65bb693e50b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:41:58.422317 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fdd3a3f4-1569-40a6-80c9-d65bb693e50b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 204 len: 0 microversion: 2.1 time: 0.540331 Aug 25 12:41:58.423896 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 258/524] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:41:57 2022] DELETE /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:41:58.445356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86d12638-2048-466a-b7a6-025f3f506313 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:58.469622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-86d12638-2048-466a-b7a6-025f3f506313 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:58.496207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d12638-2048-466a-b7a6-025f3f506313 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:58.497263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d12638-2048-466a-b7a6-025f3f506313 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:58.498099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d12638-2048-466a-b7a6-025f3f506313 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:58.499656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d12638-2048-466a-b7a6-025f3f506313 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:58.500595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d12638-2048-466a-b7a6-025f3f506313 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:58.504698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d12638-2048-466a-b7a6-025f3f506313 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:59.020040 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d1b88b76-be91-4fe3-8844-817db5f6c874 tempest-SecurityGroupsTestAdminJSON-459227331 tempest-SecurityGroupsTestAdminJSON-459227331-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.278266 Aug 25 12:41:59.021562 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 267/525] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:41:56 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:59.041675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-44f70174-bd56-40d5-a62c-32eade6078d5 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2b130550>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:59.244730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86d12638-2048-466a-b7a6-025f3f506313 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:59.274687 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-86d12638-2048-466a-b7a6-025f3f506313 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1312 microversion: 2.1 time: 0.845389 Aug 25 12:41:59.279664 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 259/526] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:58 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1312 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:59.301042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:59.303334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:59.359759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:59.360442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:59.361228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:59.362655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:59.373203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:59.379082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:59.974855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44f70174-bd56-40d5-a62c-32eade6078d5 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:59.976539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44f70174-bd56-40d5-a62c-32eade6078d5 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:59.977831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44f70174-bd56-40d5-a62c-32eade6078d5 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:59.980145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44f70174-bd56-40d5-a62c-32eade6078d5 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:59.981387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44f70174-bd56-40d5-a62c-32eade6078d5 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:59.982948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44f70174-bd56-40d5-a62c-32eade6078d5 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:00.213551 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-44f70174-bd56-40d5-a62c-32eade6078d5 tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864" status: 200 len: 325 microversion: 2.1 time: 1.190046 Aug 25 12:42:00.228012 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 268/527] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 12:41:59 2022] PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 => generated 325 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:00.254817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ffd404b-cee1-47e3-9ab5-7344558f6da0 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:00.264914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4ffd404b-cee1-47e3-9ab5-7344558f6da0 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:00.297040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ffd404b-cee1-47e3-9ab5-7344558f6da0 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:00.301694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ffd404b-cee1-47e3-9ab5-7344558f6da0 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:00.306156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ffd404b-cee1-47e3-9ab5-7344558f6da0 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:00.313206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ffd404b-cee1-47e3-9ab5-7344558f6da0 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:00.317041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ffd404b-cee1-47e3-9ab5-7344558f6da0 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:00.318652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ffd404b-cee1-47e3-9ab5-7344558f6da0 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:00.403397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:00.450133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:00.453730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:00.465786 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9cf7e131-269d-4b14-b262-10610473960b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1362 microversion: 2.25 time: 1.180603 Aug 25 12:42:00.479255 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 260/528] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:59 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1362 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:00.553240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b64347bb-f167-4860-8acb-a876203a1edf tempest-SecurityGroupsTestAdminJSON-459227331 tempest-SecurityGroupsTestAdminJSON-459227331-project] Action: 'create', calling method: .version_select at 0x7f3a2aba9e50>, body: {"security_group": {"name": "tempest-securitygroup-722988546", "description": "tempest-description-835801086"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:01.831468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4ffd404b-cee1-47e3-9ab5-7344558f6da0 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:01.850424 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ffd404b-cee1-47e3-9ab5-7344558f6da0 tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1469 microversion: 2.1 time: 1.615914 Aug 25 12:42:01.869720 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 269/529] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:00 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1469 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:01.886039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1ba3ce2c-f9cf-45dc-9c87-9134e67ae697 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:01.888196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1ba3ce2c-f9cf-45dc-9c87-9134e67ae697 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:01.906178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ba3ce2c-f9cf-45dc-9c87-9134e67ae697 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:01.913871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ba3ce2c-f9cf-45dc-9c87-9134e67ae697 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:01.914974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ba3ce2c-f9cf-45dc-9c87-9134e67ae697 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:01.916560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ba3ce2c-f9cf-45dc-9c87-9134e67ae697 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:01.917809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ba3ce2c-f9cf-45dc-9c87-9134e67ae697 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:01.922703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ba3ce2c-f9cf-45dc-9c87-9134e67ae697 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:02.523691 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b64347bb-f167-4860-8acb-a876203a1edf tempest-SecurityGroupsTestAdminJSON-459227331 tempest-SecurityGroupsTestAdminJSON-459227331-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.014913 Aug 25 12:42:02.527102 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 261/530] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:42:00 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:02.542575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1966921749", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:02.701596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:42:02.801884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1ba3ce2c-f9cf-45dc-9c87-9134e67ae697 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:02.840617 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1ba3ce2c-f9cf-45dc-9c87-9134e67ae697 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1312 microversion: 2.1 time: 0.966594 Aug 25 12:42:02.854768 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 270/531] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:01 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1312 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:02.882232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:02.884411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:02.902906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:02.905425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:02.907060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:02.909194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:02.910743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:02.911908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:03.679058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:42:03.696608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:42:03.697106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:42:03.701007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:42:03.702675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:42:03.749567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:03.750730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:03.751470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:03.752728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:03.753592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:03.754375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:03.774942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:03.812638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Getting quotas for project 2f7c5b88d1454502a8d0005683747864. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:03.825071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:03.829305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:03.832566 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-154a8aeb-15a9-44e0-8583-46ebbaa54c0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1362 microversion: 2.25 time: 0.971341 Aug 25 12:42:03.832915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Getting quotas for user 24b29c1762a5462eabc24eaa80891e30 and project 2f7c5b88d1454502a8d0005683747864. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:03.834825 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 271/532] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:02 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1362 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:03.898512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.utils [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] ram quota exceeded for 2f7c5b88d1454502a8d0005683747864, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129059) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 25 12:42:03.899951 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Request method failure captured: Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 145 Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB24ERpI1ycb2j7ff4zF0W-mldJyEjuTpo1bVH7XoP7w4H1vvpzD-iMt6Z3Lkb_aW4xe1TresR32U24l8shkIVOgdt7X_VtClVHOORo5I72Wocf9GsgIHt56dntY95YGsgoAEyTbgDm3gKnV6YPArebgPQ55ZB4g3EzB6VXRMzzTe1ss Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 2f7c5b88d1454502a8d0005683747864 Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:42:03.908266 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f7c5b88d1454502a8d0005683747864"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f7c5b88d1454502a8d0005683747864", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f7c5b88d1454502a8d0005683747864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f7c5b88d1454502a8d0005683747864"}]}] Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 2f7c5b88d1454502a8d0005683747864 Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-QuotasAdminNegativeTest-1241346773-project Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 24b29c1762a5462eabc24eaa80891e30 Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-QuotasAdminNegativeTest-1241346773-project Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1966921749", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} Aug 25 12:42:03.912299 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1966921749', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452'}}} Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 25 12:42:03.914107 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:03.916463 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:03.919175 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:03.921399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:03.921399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:03.921399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:03.921399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:03.921399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 25 12:42:03.921399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:03.925590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:03.926539 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2f6b117-568b-4e8c-b183-7dfba3c13f23 tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.392816 Aug 25 12:42:03.928384 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 262/533] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:42:02 2022] POST /compute/v2.1/servers => generated 110 bytes in 1397 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:03.941838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:03.944300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:03.979164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:03.981159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:03.984601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:03.992212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:03.995364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:03.997960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:04.109725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:04.112257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:04.113422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:04.114819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lazy-loading 'fault' on Instance uuid 6960e563-92b0-4f14-b569-ce3e44fcb8ee {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:42:04.245067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbb89f012724d20891f91b2cb20e2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d7847b3b9b4c30ac6b74c42c71d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:04.261044 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-367050d9-a5e5-434b-986a-d06e9861bd5c tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 200 len: 1303 microversion: 2.1 time: 0.327910 Aug 25 12:42:04.266685 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 263/534] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:03 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 1303 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:04.281454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-32328933-bd3e-4d9d-a3d6-d9e6751eac8e req-5a1e5b2f-25e5-4c5a-9df4-843973b7c8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6960e563-92b0-4f14-b569-ce3e44fcb8ee", "name": "network-vif-deleted", "tag": "5891f8b4-7f71-476e-ab73-ebd17e79c4c3"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:04.331414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:04.342774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-32328933-bd3e-4d9d-a3d6-d9e6751eac8e req-5a1e5b2f-25e5-4c5a-9df4-843973b7c8f5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:04.346811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-32328933-bd3e-4d9d-a3d6-d9e6751eac8e req-5a1e5b2f-25e5-4c5a-9df4-843973b7c8f5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:04.348081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-32328933-bd3e-4d9d-a3d6-d9e6751eac8e req-5a1e5b2f-25e5-4c5a-9df4-843973b7c8f5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:04.385163 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-32328933-bd3e-4d9d-a3d6-d9e6751eac8e req-5a1e5b2f-25e5-4c5a-9df4-843973b7c8f5 service nova] Creating event network-vif-deleted:5891f8b4-7f71-476e-ab73-ebd17e79c4c3 for instance 6960e563-92b0-4f14-b569-ce3e44fcb8ee on n-h2-852771-8 Aug 25 12:42:04.401433 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-32328933-bd3e-4d9d-a3d6-d9e6751eac8e req-5a1e5b2f-25e5-4c5a-9df4-843973b7c8f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134997 Aug 25 12:42:04.402724 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 264/535] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:04.427302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-aaef02aa-9e4e-40d6-a16e-21c288e2af92 req-53cff102-c3fc-472d-9bf1-1d9e31f5281e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0176f06a-ee98-45ab-b392-b9b46a8e82cd", "name": "network-vif-plugged", "status": "completed", "tag": "ffaaa691-b79c-4ca1-bdce-2e197228d565"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:04.458479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aaef02aa-9e4e-40d6-a16e-21c288e2af92 req-53cff102-c3fc-472d-9bf1-1d9e31f5281e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:04.459612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aaef02aa-9e4e-40d6-a16e-21c288e2af92 req-53cff102-c3fc-472d-9bf1-1d9e31f5281e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:04.461340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aaef02aa-9e4e-40d6-a16e-21c288e2af92 req-53cff102-c3fc-472d-9bf1-1d9e31f5281e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:04.486713 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-aaef02aa-9e4e-40d6-a16e-21c288e2af92 req-53cff102-c3fc-472d-9bf1-1d9e31f5281e service nova] Creating event network-vif-plugged:ffaaa691-b79c-4ca1-bdce-2e197228d565 for instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd on n-h1-852771-8 Aug 25 12:42:04.499935 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-aaef02aa-9e4e-40d6-a16e-21c288e2af92 req-53cff102-c3fc-472d-9bf1-1d9e31f5281e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093102 Aug 25 12:42:04.501123 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 265/536] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:04.514848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8551b21c-27d8-4d7b-a083-ef5979709e05 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:04.519664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8551b21c-27d8-4d7b-a083-ef5979709e05 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:04.535768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8551b21c-27d8-4d7b-a083-ef5979709e05 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:04.536855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8551b21c-27d8-4d7b-a083-ef5979709e05 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:04.539708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8551b21c-27d8-4d7b-a083-ef5979709e05 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:04.552371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8551b21c-27d8-4d7b-a083-ef5979709e05 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:04.556326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8551b21c-27d8-4d7b-a083-ef5979709e05 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:04.557339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8551b21c-27d8-4d7b-a083-ef5979709e05 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:04.728793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0974cae9-99bd-40e6-9251-f31b29ec02a2 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Action: 'create', calling method: .version_select at 0x7f3a2af1bc10>, body: {"security_group": {"name": "tempest-securitygroup-1718628174", "description": "tempest-description-1739867898"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:05.135188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8551b21c-27d8-4d7b-a083-ef5979709e05 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:05.155782 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8551b21c-27d8-4d7b-a083-ef5979709e05 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1312 microversion: 2.1 time: 0.652122 Aug 25 12:42:05.168413 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 266/537] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:04 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1312 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:05.197632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d768e517-abb1-45f1-8f3c-7865eb3b2e6b tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2aad9430>, body: {"quota_set": {"ram": 51200}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:05.604430 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0974cae9-99bd-40e6-9251-f31b29ec02a2 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.766221 Aug 25 12:42:05.606587 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 272/538] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:42:03 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:05.630851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:05.632078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:05.681619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:05.683837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:05.685062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:05.686714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:05.692970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:05.694197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:06.100427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d768e517-abb1-45f1-8f3c-7865eb3b2e6b tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:06.101331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d768e517-abb1-45f1-8f3c-7865eb3b2e6b tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:06.102212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d768e517-abb1-45f1-8f3c-7865eb3b2e6b tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:06.103521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d768e517-abb1-45f1-8f3c-7865eb3b2e6b tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:06.104311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d768e517-abb1-45f1-8f3c-7865eb3b2e6b tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:06.105219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d768e517-abb1-45f1-8f3c-7865eb3b2e6b tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:06.238713 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d768e517-abb1-45f1-8f3c-7865eb3b2e6b tempest-QuotasAdminNegativeTest-66632852 tempest-QuotasAdminNegativeTest-66632852-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864" status: 200 len: 329 microversion: 2.1 time: 1.055009 Aug 25 12:42:06.255296 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 267/539] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 12:42:05 2022] PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 => generated 329 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:06.569063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99b3331d-b01e-4a1b-bded-d0e806e2e19a tempest-FloatingIPDetailsNegativeTestJSON-429611663 tempest-FloatingIPDetailsNegativeTestJSON-429611663-project] Calling method '.version_select at 0x7f3a2abc1dc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:06.735382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:06.749004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-99b3331d-b01e-4a1b-bded-d0e806e2e19a tempest-FloatingIPDetailsNegativeTestJSON-429611663 tempest-FloatingIPDetailsNegativeTestJSON-429611663-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a610fe32-1294-4b93-ba4a-5234400164f3 could not be found", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:42:06.751788 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-99b3331d-b01e-4a1b-bded-d0e806e2e19a tempest-FloatingIPDetailsNegativeTestJSON-429611663 tempest-FloatingIPDetailsNegativeTestJSON-429611663-project] HTTP exception thrown: Floating IP not found for ID a610fe32-1294-4b93-ba4a-5234400164f3 Aug 25 12:42:06.753992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:06.758974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:06.761748 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6ae3d899-a69f-4be5-b4ea-6eda73847c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1362 microversion: 2.25 time: 1.153191 Aug 25 12:42:06.764792 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 273/540] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:05 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1362 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:06.784558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:06.786517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] [instance: 6960e563-92b0-4f14-b569-ce3e44fcb8ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99b3331d-b01e-4a1b-bded-d0e806e2e19a tempest-FloatingIPDetailsNegativeTestJSON-429611663 tempest-FloatingIPDetailsNegativeTestJSON-429611663-project] Request method failure captured: Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-floating-ips/a610fe32-1294-4b93-ba4a-5234400164f3 HTTP/1.1 Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB24cT5FThYHyY1ATM9WND47Ql0hMJ40Jy6-OLt05CZKNlgmL2T7I-9R-XG_S4HbBnFzq3RsU371ca7S_mufC2SRt0DE1t8R_wesQm6CIg4axabaikba-MrCb5jjQZe9vxFws4Cz1nokzyuMlyuFRT2qqiJj79kThRvB-gsCDXWN6Ol4 Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3b949e44210d476ea1c8c5340e6f544d Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-429611663 Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:42:06.802101 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b949e44210d476ea1c8c5340e6f544d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b949e44210d476ea1c8c5340e6f544d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b949e44210d476ea1c8c5340e6f544d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b949e44210d476ea1c8c5340e6f544d"}]}] Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-429611663 Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3b949e44210d476ea1c8c5340e6f544d Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-429611663 Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-429611663-project Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 7705ddd334c84ecb966b7109791a323a Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-429611663-project Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: exception: Floating IP not found for ID a610fe32-1294-4b93-ba4a-5234400164f3 Aug 25 12:42:06.804637 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'a610fe32-1294-4b93-ba4a-5234400164f3'} Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:42:06.806151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a610fe32-1294-4b93-ba4a-5234400164f3 could not be found Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8921387-0a8f-4419-9deb-f0f16b4b220f'] Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a610fe32-1294-4b93-ba4a-5234400164f3. Aug 25 12:42:06.808422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a610fe32-1294-4b93-ba4a-5234400164f3 Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:06.817769 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:06.824385 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:06.824385 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a610fe32-1294-4b93-ba4a-5234400164f3 Aug 25 12:42:06.824385 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.824385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99b3331d-b01e-4a1b-bded-d0e806e2e19a tempest-FloatingIPDetailsNegativeTestJSON-429611663 tempest-FloatingIPDetailsNegativeTestJSON-429611663-project] Returning 404 to user: Floating IP not found for ID a610fe32-1294-4b93-ba4a-5234400164f3 {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:06.825357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:06.825617 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-99b3331d-b01e-4a1b-bded-d0e806e2e19a tempest-FloatingIPDetailsNegativeTestJSON-429611663 tempest-FloatingIPDetailsNegativeTestJSON-429611663-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/a610fe32-1294-4b93-ba4a-5234400164f3" status: 404 len: 111 microversion: 2.1 time: 0.576093 Aug 25 12:42:06.825805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:06.825805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:06.825805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:06.825805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:06.826672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:06.828662 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 268/541] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:42:06 2022] GET /compute/v2.1/os-floating-ips/a610fe32-1294-4b93-ba4a-5234400164f3 => generated 111 bytes in 588 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:06.839579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aa080872-7cb7-457d-a0f9-33e25e5a5f3c tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Action: 'create', calling method: .version_select at 0x7f3a2aa35e50>, body: {"security_group": {"name": "tempest-securitygroup-476407400", "description": "tempest-description-160915221"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:06.867873 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] HTTP exception thrown: Instance 6960e563-92b0-4f14-b569-ce3e44fcb8ee could not be found. Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Request method failure captured: Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee HTTP/1.1 Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23lg1GcqET4-wRnNu3574naaTpXRo6AJCDjmWnW30UfqaxTKGqHRYn2fm5Du0zvc6kdgjgU7AF_lIuk4gzpvsOX1dahPU_-UxkmHdC85aSKO8in5cstnXT8CThpJL-ZAVnQ8AnT3mf6dAM9m6LokZGyLekCAM-yVq7Md0aSApC7aak Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d8d7847b3b9b4c30ac6b74c42c71d0bb Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TenantUsagesTestJSON-1183764609 Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:42:06.873323 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8d7847b3b9b4c30ac6b74c42c71d0bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d8d7847b3b9b4c30ac6b74c42c71d0bb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d8d7847b3b9b4c30ac6b74c42c71d0bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8d7847b3b9b4c30ac6b74c42c71d0bb"}]}] Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TenantUsagesTestJSON-1183764609 Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d8d7847b3b9b4c30ac6b74c42c71d0bb Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1183764609 Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TenantUsagesTestJSON-1183764609-project Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2cbb89f012724d20891f91b2cb20e2af Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TenantUsagesTestJSON-1183764609-project Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 6960e563-92b0-4f14-b569-ce3e44fcb8ee could not be found. Aug 25 12:42:06.875956 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '6960e563-92b0-4f14-b569-ce3e44fcb8ee'} Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6960e563-92b0-4f14-b569-ce3e44fcb8ee could not be found. Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:06.878011 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6960e563-92b0-4f14-b569-ce3e44fcb8ee could not be found. Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6960e563-92b0-4f14-b569-ce3e44fcb8ee could not be found. Aug 25 12:42:06.880293 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:06.890356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] Returning 404 to user: Instance 6960e563-92b0-4f14-b569-ce3e44fcb8ee could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:06.891509 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a841d0a-c97b-4b58-a2f3-6160bca69d0b tempest-TenantUsagesTestJSON-1183764609 tempest-TenantUsagesTestJSON-1183764609-project] 10.222.0.70 "GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee" status: 404 len: 111 microversion: 2.1 time: 0.122794 Aug 25 12:42:06.893679 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 274/542] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:06 2022] GET /compute/v2.1/servers/6960e563-92b0-4f14-b569-ce3e44fcb8ee => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:06.903492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4a34b267-6839-47dd-aa01-c246217bad40 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:06.905724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4a34b267-6839-47dd-aa01-c246217bad40 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:06.924789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a34b267-6839-47dd-aa01-c246217bad40 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:06.926420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a34b267-6839-47dd-aa01-c246217bad40 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:06.927726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a34b267-6839-47dd-aa01-c246217bad40 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:06.930083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a34b267-6839-47dd-aa01-c246217bad40 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:06.931350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a34b267-6839-47dd-aa01-c246217bad40 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:06.932494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a34b267-6839-47dd-aa01-c246217bad40 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:07.647289 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aa080872-7cb7-457d-a0f9-33e25e5a5f3c tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.815638 Aug 25 12:42:07.648452 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 269/543] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:42:06 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:07.682193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-827bfd21-741c-4319-8af5-da449890704a tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Action: 'update', calling method: .version_select at 0x7f3a2aa6bca0>, body: {"quota_set": {"ram": 0}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:07.693369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-827bfd21-741c-4319-8af5-da449890704a tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '24b29c1762a5462eabc24eaa80891e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7c5b88d1454502a8d0005683747864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-827bfd21-741c-4319-8af5-da449890704a tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Request method failure captured: Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 HTTP/1.1 Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 25 Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB24ERpI1ycb2j7ff4zF0W-mldJyEjuTpo1bVH7XoP7w4H1vvpzD-iMt6Z3Lkb_aW4xe1TresR32U24l8shkIVOgdt7X_VtClVHOORo5I72Wocf9GsgIHt56dntY95YGsgoAEyTbgDm3gKnV6YPArebgPQ55ZB4g3EzB6VXRMzzTe1ss Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 2f7c5b88d1454502a8d0005683747864 Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:42:07.713672 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f7c5b88d1454502a8d0005683747864"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f7c5b88d1454502a8d0005683747864", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f7c5b88d1454502a8d0005683747864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f7c5b88d1454502a8d0005683747864"}]}] Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 2f7c5b88d1454502a8d0005683747864 Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1241346773 Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-QuotasAdminNegativeTest-1241346773-project Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 24b29c1762a5462eabc24eaa80891e30 Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-QuotasAdminNegativeTest-1241346773-project Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: {"quota_set": {"ram": 0}} Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 25 12:42:07.716968 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '2f7c5b88d1454502a8d0005683747864', 'body': {'quota_set': {'ram': 0}}} Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:07.718855 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:07.721873 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:07.725874 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:07.725874 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:07.725874 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:42:07.725874 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:42:07.725874 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 25 12:42:07.725874 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:07.725874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-827bfd21-741c-4319-8af5-da449890704a tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:07.725874 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-827bfd21-741c-4319-8af5-da449890704a tempest-QuotasAdminNegativeTest-1241346773 tempest-QuotasAdminNegativeTest-1241346773-project] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864" status: 403 len: 116 microversion: 2.1 time: 0.057659 Aug 25 12:42:07.725874 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 270/544] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 12:42:07 2022] PUT /compute/v2.1/os-quota-sets/2f7c5b88d1454502a8d0005683747864 => generated 116 bytes in 74 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:07.753841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-906ade58-2b9e-44e2-a2f0-c11f34f04221 req-8f11f538-4a0f-4229-a8a2-2c766288ea0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e481324-3e50-472a-857d-d015400b2260", "name": "network-vif-plugged", "status": "completed", "tag": "3ab10696-8912-459d-b019-6b94e0f42269"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:07.771606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4a34b267-6839-47dd-aa01-c246217bad40 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:07.801417 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4a34b267-6839-47dd-aa01-c246217bad40 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1312 microversion: 2.1 time: 0.903322 Aug 25 12:42:07.818388 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 275/545] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:06 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1312 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:07.818588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-906ade58-2b9e-44e2-a2f0-c11f34f04221 req-8f11f538-4a0f-4229-a8a2-2c766288ea0e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:07.818588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-906ade58-2b9e-44e2-a2f0-c11f34f04221 req-8f11f538-4a0f-4229-a8a2-2c766288ea0e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:07.818588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-906ade58-2b9e-44e2-a2f0-c11f34f04221 req-8f11f538-4a0f-4229-a8a2-2c766288ea0e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:07.836552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-78469ea6-f56f-4d09-b4c5-14f4671507d4 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Calling method '.version_select at 0x7f3a2acc7790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:07.872379 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-906ade58-2b9e-44e2-a2f0-c11f34f04221 req-8f11f538-4a0f-4229-a8a2-2c766288ea0e service nova] Creating event network-vif-plugged:3ab10696-8912-459d-b019-6b94e0f42269 for instance 3e481324-3e50-472a-857d-d015400b2260 on n-h2-852771-8 Aug 25 12:42:07.883394 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-906ade58-2b9e-44e2-a2f0-c11f34f04221 req-8f11f538-4a0f-4229-a8a2-2c766288ea0e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156563 Aug 25 12:42:07.884872 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 271/546] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:07.907408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:07.908208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:07.931961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:07.932941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:07.935241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:07.937195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:07.937731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:07.938205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:08.826370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:08.866217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:08.874974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:08.892088 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4ee89e4c-73ad-4e54-baee-3094b560e039 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1559 microversion: 2.25 time: 1.004786 Aug 25 12:42:08.894672 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 272/547] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:07 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1559 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:08.905546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f9573035-b5b2-47c3-a1f7-84831ea36a3e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:08.911017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f9573035-b5b2-47c3-a1f7-84831ea36a3e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:08.935661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9573035-b5b2-47c3-a1f7-84831ea36a3e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:08.937193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9573035-b5b2-47c3-a1f7-84831ea36a3e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:08.938566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9573035-b5b2-47c3-a1f7-84831ea36a3e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:08.941933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9573035-b5b2-47c3-a1f7-84831ea36a3e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:08.943210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9573035-b5b2-47c3-a1f7-84831ea36a3e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:08.944358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9573035-b5b2-47c3-a1f7-84831ea36a3e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:10.024624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=23 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:10.183618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=29 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:10.492164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f9573035-b5b2-47c3-a1f7-84831ea36a3e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:10.523005 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f9573035-b5b2-47c3-a1f7-84831ea36a3e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1312 microversion: 2.1 time: 1.625978 Aug 25 12:42:10.551245 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 273/548] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:08 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1312 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:11.358384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-75791961-f451-4a85-bdf4-647f979b8784 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:11.360156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-75791961-f451-4a85-bdf4-647f979b8784 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:11.387835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75791961-f451-4a85-bdf4-647f979b8784 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:11.389171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75791961-f451-4a85-bdf4-647f979b8784 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:11.390745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75791961-f451-4a85-bdf4-647f979b8784 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:11.393361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75791961-f451-4a85-bdf4-647f979b8784 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:11.394380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75791961-f451-4a85-bdf4-647f979b8784 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:11.395475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75791961-f451-4a85-bdf4-647f979b8784 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:12.125108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-75791961-f451-4a85-bdf4-647f979b8784 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid 0176f06a-ee98-45ab-b392-b9b46a8e82cd {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:42:12.426532 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-75791961-f451-4a85-bdf4-647f979b8784 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 2052 microversion: 2.25 time: 1.872321 Aug 25 12:42:12.429048 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 274/549] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:10 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 2052 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:12.447746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-76c213d6-8f9b-4f22-ae3c-5c308aac3580 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:12.450095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-76c213d6-8f9b-4f22-ae3c-5c308aac3580 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:12.481205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-76c213d6-8f9b-4f22-ae3c-5c308aac3580 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:12.482560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-76c213d6-8f9b-4f22-ae3c-5c308aac3580 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:12.483685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-76c213d6-8f9b-4f22-ae3c-5c308aac3580 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:12.485649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-76c213d6-8f9b-4f22-ae3c-5c308aac3580 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:12.488714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-76c213d6-8f9b-4f22-ae3c-5c308aac3580 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:12.500346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-76c213d6-8f9b-4f22-ae3c-5c308aac3580 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:12.582474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:12.829735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-78469ea6-f56f-4d09-b4c5-14f4671507d4 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c4f0e6d-9222-4981-8a29-2076714a1fdd does not exist", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:42:12.833046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.security_group_api [None req-78469ea6-f56f-4d09-b4c5-14f4671507d4 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Neutron security group 5c4f0e6d-9222-4981-8a29-2076714a1fdd not found {{(pid=129060) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:42:12.834498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.compute.security_groups [None req-78469ea6-f56f-4d09-b4c5-14f4671507d4 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Security Group ID 5c4f0e6d-9222-4981-8a29-2076714a1fdd does not exist {{(pid=129060) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 25 12:42:13.217988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-78469ea6-f56f-4d09-b4c5-14f4671507d4 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c4f0e6d-9222-4981-8a29-2076714a1fdd does not exist", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:42:13.219503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.security_group_api [None req-78469ea6-f56f-4d09-b4c5-14f4671507d4 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Neutron security group 5c4f0e6d-9222-4981-8a29-2076714a1fdd not found {{(pid=129060) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:42:13.222230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.compute.security_groups [None req-78469ea6-f56f-4d09-b4c5-14f4671507d4 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Security Group ID 5c4f0e6d-9222-4981-8a29-2076714a1fdd does not exist {{(pid=129060) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 25 12:42:13.512809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-76c213d6-8f9b-4f22-ae3c-5c308aac3580 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:13.562697 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-76c213d6-8f9b-4f22-ae3c-5c308aac3580 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1462 microversion: 2.1 time: 1.131597 Aug 25 12:42:13.567206 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 275/550] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:12 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1462 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:13.576671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aba6d885-7ff7-4e10-b457-eeb39cc9fac3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:13.578005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aba6d885-7ff7-4e10-b457-eeb39cc9fac3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:13.602833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aba6d885-7ff7-4e10-b457-eeb39cc9fac3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:13.603983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aba6d885-7ff7-4e10-b457-eeb39cc9fac3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:13.604915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aba6d885-7ff7-4e10-b457-eeb39cc9fac3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:13.606899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aba6d885-7ff7-4e10-b457-eeb39cc9fac3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:13.607787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aba6d885-7ff7-4e10-b457-eeb39cc9fac3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:13.608617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aba6d885-7ff7-4e10-b457-eeb39cc9fac3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:14.201606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-aba6d885-7ff7-4e10-b457-eeb39cc9fac3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid 0176f06a-ee98-45ab-b392-b9b46a8e82cd {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:42:14.238719 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aba6d885-7ff7-4e10-b457-eeb39cc9fac3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 2052 microversion: 2.25 time: 0.667986 Aug 25 12:42:14.240268 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 276/551] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:13 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 2052 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:14.942665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-98388ce9-9c4d-4441-bdd5-fc58ed3945ed tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:14.946511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-98388ce9-9c4d-4441-bdd5-fc58ed3945ed tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:14.960826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98388ce9-9c4d-4441-bdd5-fc58ed3945ed tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:14.962106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98388ce9-9c4d-4441-bdd5-fc58ed3945ed tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:14.962902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98388ce9-9c4d-4441-bdd5-fc58ed3945ed tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:14.964091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98388ce9-9c4d-4441-bdd5-fc58ed3945ed tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:14.968583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98388ce9-9c4d-4441-bdd5-fc58ed3945ed tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:14.969910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98388ce9-9c4d-4441-bdd5-fc58ed3945ed tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:16.053056 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-98388ce9-9c4d-4441-bdd5-fc58ed3945ed tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1613 microversion: 2.1 time: 1.810190 Aug 25 12:42:16.058953 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 277/552] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:14 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1613 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:16.123084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=5 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:16.225917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=17 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:16.352888 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-78469ea6-f56f-4d09-b4c5-14f4671507d4 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] 10.222.0.70 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9167 microversion: 2.1 time: 8.529396 Aug 25 12:42:16.357411 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 276/553] 10.222.0.70 () {58 vars in 1191 bytes} [Thu Aug 25 12:42:07 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9167 bytes in 8536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:16.391632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-044c78a0-ab98-41e9-b374-883ebc9a2ad9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:16.400393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-044c78a0-ab98-41e9-b374-883ebc9a2ad9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:16.402916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-044c78a0-ab98-41e9-b374-883ebc9a2ad9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:16.404156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-044c78a0-ab98-41e9-b374-883ebc9a2ad9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:16.407661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-044c78a0-ab98-41e9-b374-883ebc9a2ad9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:16.413151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-044c78a0-ab98-41e9-b374-883ebc9a2ad9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:16.414494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-044c78a0-ab98-41e9-b374-883ebc9a2ad9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:16.483834 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-044c78a0-ab98-41e9-b374-883ebc9a2ad9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.116056 Aug 25 12:42:16.485429 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 277/554] 10.222.0.70 () {60 vars in 1217 bytes} [Thu Aug 25 12:42:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:42:16.507099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:16.510953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:16.527610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:16.529462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:16.532468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:16.535116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:16.541132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:16.542353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:16.784234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3d9afd4814084dbb981915bda2561dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003da7f4157a4743b31f0b5faaab9e91', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:16.788725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] [instance: 3e481324-3e50-472a-857d-d015400b2260] flavor_id is None. Assuming migration. {{(pid=129060) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 25 12:42:16.790573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] [instance: 3e481324-3e50-472a-857d-d015400b2260] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129060) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 12:42:17.080258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1356339107", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:17.370235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:42:17.461265 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f2a53c36-2d04-434b-a51f-72a787c9dc75 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260/action" status: 202 len: 0 microversion: 2.1 time: 0.968262 Aug 25 12:42:17.463916 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 278/555] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:42:16 2022] POST /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260/action => generated 0 bytes in 978 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:17.495572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-404bf3aa-8852-4cc0-bf5a-8c52a122c222 tempest-SecurityGroupsTestAdminJSON-459227331 tempest-SecurityGroupsTestAdminJSON-459227331-project] Calling method '.version_select at 0x7f3a2acadaf0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:18.341892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:42:18.342980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:42:18.345272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:42:18.347236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:42:18.350357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:42:18.389191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:18.389562 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-404bf3aa-8852-4cc0-bf5a-8c52a122c222 tempest-SecurityGroupsTestAdminJSON-459227331 tempest-SecurityGroupsTestAdminJSON-459227331-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.916012 Aug 25 12:42:18.390974 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 279/556] 10.222.0.70 () {58 vars in 1191 bytes} [Thu Aug 25 12:42:17 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:18.396401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:18.398496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:18.404016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:18.407045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:18.409825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:18.410930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852771-8", "block_migration": "auto"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:18.416714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:18.432886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:18.434326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:18.435547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:18.437426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:18.438649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:18.440657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:18.483700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Getting quotas for project 8d958566e47b4a5aa726773893d68aa0. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:18.514780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Getting quotas for user 026fb8558b1443f3a895bb91a4b603dc and project 8d958566e47b4a5aa726773893d68aa0. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:18.530618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'flavor' on Instance uuid 0176f06a-ee98-45ab-b392-b9b46a8e82cd {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:42:18.592482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Going to try to live migrate instance to n-h2-852771-8 {{(pid=129060) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:42:18.610119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:42:18.621116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:42:18.833002 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b9f692a-1d53-4e9a-a5c5-aa9038985aaa tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.768235 Aug 25 12:42:18.837749 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 278/557] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:42:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:42:18.848186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-598fd489-5dc8-4609-96b6-99822930ad75 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:18.849546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-598fd489-5dc8-4609-96b6-99822930ad75 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:18.896890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-598fd489-5dc8-4609-96b6-99822930ad75 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:18.898002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-598fd489-5dc8-4609-96b6-99822930ad75 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:18.900636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-598fd489-5dc8-4609-96b6-99822930ad75 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:18.903102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-598fd489-5dc8-4609-96b6-99822930ad75 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:18.904559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-598fd489-5dc8-4609-96b6-99822930ad75 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:18.916295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-598fd489-5dc8-4609-96b6-99822930ad75 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:20.406253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-598fd489-5dc8-4609-96b6-99822930ad75 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:20.430757 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-598fd489-5dc8-4609-96b6-99822930ad75 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1471 microversion: 2.1 time: 1.591132 Aug 25 12:42:20.432428 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 279/558] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:18 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1471 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:21.259546 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fd4ac242-af43-4bc5-8d31-639b9474096b tempest-TenantUsagesNegativeTestJSON-2092589831 tempest-TenantUsagesNegativeTestJSON-2092589831-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-24T12%3A42%3A17.630173&end=2022-08-26T12%3A42%3A17.630173" status: 404 len: 112 microversion: - time: 0.824087 Aug 25 12:42:21.261924 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 280/559] 10.222.0.70 () {58 vars in 1316 bytes} [Thu Aug 25 12:42:20 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-24T12%3A42%3A17.630173&end=2022-08-26T12%3A42%3A17.630173 => generated 112 bytes in 828 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 12:42:21.286109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e4ca96e5-d920-470f-9837-450ad9ad7d23 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Calling method '.version_select at 0x7f3a2aa6b1f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:21.746459 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e4ca96e5-d920-470f-9837-450ad9ad7d23 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/9b7ac146-f943-4804-bf21-71f3c4e00bc8" status: 202 len: 0 microversion: 2.1 time: 0.481606 Aug 25 12:42:21.747787 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 281/560] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:42:21 2022] DELETE /compute/v2.1/os-security-groups/9b7ac146-f943-4804-bf21-71f3c4e00bc8 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:21.771427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4938e9a0-0526-45fc-9118-58b1b0cc3a6f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:21.783109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4938e9a0-0526-45fc-9118-58b1b0cc3a6f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:21.810285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4938e9a0-0526-45fc-9118-58b1b0cc3a6f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:21.822845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4938e9a0-0526-45fc-9118-58b1b0cc3a6f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:21.824162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4938e9a0-0526-45fc-9118-58b1b0cc3a6f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:21.825997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4938e9a0-0526-45fc-9118-58b1b0cc3a6f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:21.827271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4938e9a0-0526-45fc-9118-58b1b0cc3a6f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:21.828428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4938e9a0-0526-45fc-9118-58b1b0cc3a6f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:22.064610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4938e9a0-0526-45fc-9118-58b1b0cc3a6f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:22.091142 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4938e9a0-0526-45fc-9118-58b1b0cc3a6f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1275 microversion: 2.1 time: 0.339034 Aug 25 12:42:22.131307 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 282/561] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:21 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1275 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:22.582136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1245766506", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:22.733907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:42:23.569382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:42:23.571226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:42:23.572854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:42:23.574030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:42:23.582364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:42:23.615194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:23.616163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:23.616932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:23.618880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:23.619431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:23.619919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:23.687662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Getting quotas for project e2700209d0c94f789c1b01cf7b38c6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:23.700862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Getting quotas for user 150efb14f73347c7aa81255bba9f12ca and project e2700209d0c94f789c1b01cf7b38c6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:23.738345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:42:23.745309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:42:23.767862 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-839d14be-d882-4f8c-98db-ddb93d601674 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd/action" status: 202 len: 0 microversion: 2.25 time: 5.373865 Aug 25 12:42:23.775144 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 280/562] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 12:42:18 2022] POST /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd/action => generated 0 bytes in 5378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:42:23.784017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70f9e32f-29f7-4c5e-ae40-80e4fdb2bf30 tempest-TenantUsagesNegativeTestJSON-2092589831 tempest-TenantUsagesNegativeTestJSON-2092589831-project-admin] Calling method '.version_select at 0x7f3a2ab83670>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:23.805540 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-70f9e32f-29f7-4c5e-ae40-80e4fdb2bf30 tempest-TenantUsagesNegativeTestJSON-2092589831 tempest-TenantUsagesNegativeTestJSON-2092589831-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70f9e32f-29f7-4c5e-ae40-80e4fdb2bf30 tempest-TenantUsagesNegativeTestJSON-2092589831 tempest-TenantUsagesNegativeTestJSON-2092589831-project-admin] Request method failure captured: Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-simple-tenant-usage/d4e1de867c18430e87a85dd305ce43fd?start=2022-08-26T12%3A42%3A17.630173&end=2022-08-24T12%3A42%3A17.630173 HTTP/1.1 Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB24pFMchtQq_UIzZ7afIr33APiSaA3ITRcGcqNmIb97uZsEiRX0nZsx5BXlEe3YddR9SdnhY_GA_36gdAXKLSL3B8QtlocuTCr26W4E3zwrj6U845LWiaXqiM0yUoKa7KAbGfPHTMYgBhmsthiUiiM9aL9i7CEvXxYVMekdarWBTlhU Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 991918223d624db09d045748f9f6b8b5 Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2092589831 Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:42:23.813892 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991918223d624db09d045748f9f6b8b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_991918223d624db09d045748f9f6b8b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/991918223d624db09d045748f9f6b8b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991918223d624db09d045748f9f6b8b5"}]}] Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2092589831 Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 991918223d624db09d045748f9f6b8b5 Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2092589831 Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TenantUsagesNegativeTestJSON-2092589831-project-admin Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d603684e07744b098ca2d9ce032d961b Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2092589831-project-admin Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid start time. The start time cannot occur after the end time. Aug 25 12:42:23.816366 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'd4e1de867c18430e87a85dd305ce43fd'} Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 25 12:42:23.817326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 25 12:42:23.819795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:23.819795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:23.819795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:23.819795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:23.819795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:23.819795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:23.819795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:23.819795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:23.819795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 25 12:42:23.819795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:23.824638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70f9e32f-29f7-4c5e-ae40-80e4fdb2bf30 tempest-TenantUsagesNegativeTestJSON-2092589831 tempest-TenantUsagesNegativeTestJSON-2092589831-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:23.829179 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70f9e32f-29f7-4c5e-ae40-80e4fdb2bf30 tempest-TenantUsagesNegativeTestJSON-2092589831 tempest-TenantUsagesNegativeTestJSON-2092589831-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/d4e1de867c18430e87a85dd305ce43fd?start=2022-08-26T12%3A42%3A17.630173&end=2022-08-24T12%3A42%3A17.630173" status: 400 len: 111 microversion: 2.1 time: 0.054235 Aug 25 12:42:23.841241 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 281/563] 10.222.0.70 () {58 vars in 1412 bytes} [Thu Aug 25 12:42:23 2022] GET /compute/v2.1/os-simple-tenant-usage/d4e1de867c18430e87a85dd305ce43fd?start=2022-08-26T12%3A42%3A17.630173&end=2022-08-24T12%3A42%3A17.630173 => generated 111 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:42:23.855416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2d96f8ff-2ac9-4469-8bcc-ca1ed779b2c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:23.859843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2d96f8ff-2ac9-4469-8bcc-ca1ed779b2c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:23.868752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:23.882909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d96f8ff-2ac9-4469-8bcc-ca1ed779b2c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:23.884526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d96f8ff-2ac9-4469-8bcc-ca1ed779b2c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:23.885564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d96f8ff-2ac9-4469-8bcc-ca1ed779b2c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:23.887366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d96f8ff-2ac9-4469-8bcc-ca1ed779b2c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:23.889965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d96f8ff-2ac9-4469-8bcc-ca1ed779b2c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:23.891157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d96f8ff-2ac9-4469-8bcc-ca1ed779b2c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:23.926330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:23.952118 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-134fb449-2c90-4111-8b22-16f55d608a4a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.817769 Aug 25 12:42:23.954028 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 283/564] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:42:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:42:24.007959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a93f13f8-0195-48fa-afb7-f0781758a572 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] Calling method '.version_select at 0x7f3a2aa6b160>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:24.742547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2d96f8ff-2ac9-4469-8bcc-ca1ed779b2c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:24.762028 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2d96f8ff-2ac9-4469-8bcc-ca1ed779b2c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1471 microversion: 2.1 time: 0.918218 Aug 25 12:42:24.779130 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 282/565] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:23 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1471 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:24.809046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f480f171-d9c1-4293-80e4-3cb7a8773134 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:24.811021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f480f171-d9c1-4293-80e4-3cb7a8773134 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:24.826225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f480f171-d9c1-4293-80e4-3cb7a8773134 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:24.828062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f480f171-d9c1-4293-80e4-3cb7a8773134 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:24.829879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f480f171-d9c1-4293-80e4-3cb7a8773134 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:24.832433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f480f171-d9c1-4293-80e4-3cb7a8773134 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:24.834181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f480f171-d9c1-4293-80e4-3cb7a8773134 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:24.835387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f480f171-d9c1-4293-80e4-3cb7a8773134 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:25.051997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f480f171-d9c1-4293-80e4-3cb7a8773134 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:25.089407 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f480f171-d9c1-4293-80e4-3cb7a8773134 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1281 microversion: 2.1 time: 0.306806 Aug 25 12:42:25.098688 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 283/566] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:24 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1281 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:25.123915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:25.125633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:25.154630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:25.155611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:25.156431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:25.157774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:25.159066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:25.170456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:25.776682 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a93f13f8-0195-48fa-afb7-f0781758a572 tempest-SecurityGroupsTestAdminJSON-1359675753 tempest-SecurityGroupsTestAdminJSON-1359675753-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/239ccbd3-3876-4869-8457-361f6b5b9cdd" status: 202 len: 0 microversion: 2.1 time: 1.787692 Aug 25 12:42:25.792797 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 284/567] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:42:23 2022] DELETE /compute/v2.1/os-security-groups/239ccbd3-3876-4869-8457-361f6b5b9cdd => generated 0 bytes in 1794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:25.852040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:25.892378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:25.897639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:25.900194 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b36aa97-3aeb-44b3-93de-61a37688ce03 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1569 microversion: 2.25 time: 0.799026 Aug 25 12:42:25.902158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 284/568] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:25 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1569 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:25.926470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1010215484", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:26.094643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:42:26.428960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:26.489756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4b74583b-7d66-4fa7-958c-568cfbc0afae tempest-TenantUsagesNegativeTestJSON-1071076878 tempest-TenantUsagesNegativeTestJSON-1071076878-project] Calling method '.version_select at 0x7f3a2a9c3b80>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:26.498844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4b74583b-7d66-4fa7-958c-568cfbc0afae tempest-TenantUsagesNegativeTestJSON-1071076878 tempest-TenantUsagesNegativeTestJSON-1071076878-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '814a4f804b0a49e98834379f295e7d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e1de867c18430e87a85dd305ce43fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4b74583b-7d66-4fa7-958c-568cfbc0afae tempest-TenantUsagesNegativeTestJSON-1071076878 tempest-TenantUsagesNegativeTestJSON-1071076878-project] Request method failure captured: Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-24T12%3A42%3A17.630173&end=2022-08-26T12%3A42%3A17.630173&detailed=1 HTTP/1.1 Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB24nG-pNv2bomDDbCXOViLKlT_rtPhC037RvyOYmwdSX9k0TKw1OShWZD9tmFcPOWKVkVf7n1GkXzPN4lS2F3Ne1iZOvGutJE7ocWTq8mgy1f8FgHgibAMUIgHTl-Do02qzL9JILbBNx7qVE9eR1H2H7PCfM9KMGjYVpaA90ARFGKXA Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d4e1de867c18430e87a85dd305ce43fd Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1071076878 Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:42:26.504926 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d4e1de867c18430e87a85dd305ce43fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d4e1de867c18430e87a85dd305ce43fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d4e1de867c18430e87a85dd305ce43fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d4e1de867c18430e87a85dd305ce43fd"}]}] Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1071076878 Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d4e1de867c18430e87a85dd305ce43fd Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1071076878 Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TenantUsagesNegativeTestJSON-1071076878-project Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 814a4f804b0a49e98834379f295e7d6a Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1071076878-project Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: action_args: {} Aug 25 12:42:26.507575 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:42:26.509694 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:42:26.513343 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:42:26.518677 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 25 12:42:26.518677 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:42:26.518677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4b74583b-7d66-4fa7-958c-568cfbc0afae tempest-TenantUsagesNegativeTestJSON-1071076878 tempest-TenantUsagesNegativeTestJSON-1071076878-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:26.518677 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4b74583b-7d66-4fa7-958c-568cfbc0afae tempest-TenantUsagesNegativeTestJSON-1071076878 tempest-TenantUsagesNegativeTestJSON-1071076878-project] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-24T12%3A42%3A17.630173&end=2022-08-26T12%3A42%3A17.630173&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.708131 Aug 25 12:42:26.518677 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 285/569] 10.222.0.70 () {58 vars in 1335 bytes} [Thu Aug 25 12:42:25 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-24T12%3A42%3A17.630173&end=2022-08-26T12%3A42%3A17.630173&detailed=1 => generated 123 bytes in 721 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:26.533585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-417d7545-84a6-42a2-b5b8-ba460263fb01 tempest-SecurityGroupsTestAdminJSON-459227331 tempest-SecurityGroupsTestAdminJSON-459227331-project] Calling method '.version_select at 0x7f3a2a9e3f70>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:27.309349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:42:27.313019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:42:27.318864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:42:27.321411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:42:27.323513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:42:27.362374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:27.364098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:27.365283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:27.369391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:27.371393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:27.375132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:27.420816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Getting quotas for project e2700209d0c94f789c1b01cf7b38c6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:27.432520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Getting quotas for user 150efb14f73347c7aa81255bba9f12ca and project e2700209d0c94f789c1b01cf7b38c6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:27.465665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:42:27.471715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:42:27.572978 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-01c7e094-de81-4822-9940-80b0b78f01a3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.667590 Aug 25 12:42:27.586418 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 285/570] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:42:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:42:27.612185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a417b565-f05b-40df-9ae1-814dceb9c7e0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:27.619277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a417b565-f05b-40df-9ae1-814dceb9c7e0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:27.651019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a417b565-f05b-40df-9ae1-814dceb9c7e0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:27.660607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a417b565-f05b-40df-9ae1-814dceb9c7e0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:27.666770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a417b565-f05b-40df-9ae1-814dceb9c7e0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:27.668237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a417b565-f05b-40df-9ae1-814dceb9c7e0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:27.669171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a417b565-f05b-40df-9ae1-814dceb9c7e0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:27.678369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a417b565-f05b-40df-9ae1-814dceb9c7e0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:27.752842 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-417d7545-84a6-42a2-b5b8-ba460263fb01 tempest-SecurityGroupsTestAdminJSON-459227331 tempest-SecurityGroupsTestAdminJSON-459227331-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/b7ec5876-c3d9-40fb-8db7-a941f1bee9a9" status: 202 len: 0 microversion: 2.1 time: 1.234774 Aug 25 12:42:27.753914 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 286/571] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:42:26 2022] DELETE /compute/v2.1/os-security-groups/b7ec5876-c3d9-40fb-8db7-a941f1bee9a9 => generated 0 bytes in 1238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:27.769744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54a8979c-c94c-4fc9-8d80-9076d5b0c81c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:27.773182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-54a8979c-c94c-4fc9-8d80-9076d5b0c81c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:27.829118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54a8979c-c94c-4fc9-8d80-9076d5b0c81c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:27.830149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54a8979c-c94c-4fc9-8d80-9076d5b0c81c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:27.830958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54a8979c-c94c-4fc9-8d80-9076d5b0c81c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:27.832655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54a8979c-c94c-4fc9-8d80-9076d5b0c81c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:27.833818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54a8979c-c94c-4fc9-8d80-9076d5b0c81c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:27.835859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54a8979c-c94c-4fc9-8d80-9076d5b0c81c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:28.644955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54a8979c-c94c-4fc9-8d80-9076d5b0c81c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:28.673090 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-54a8979c-c94c-4fc9-8d80-9076d5b0c81c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1323 microversion: 2.1 time: 0.916985 Aug 25 12:42:28.689313 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 287/572] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:27 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1323 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:28.689313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:28.689313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:28.699085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:28.700427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:28.701776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:28.703636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:28.704953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:28.706811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:28.740348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a417b565-f05b-40df-9ae1-814dceb9c7e0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:28.774195 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a417b565-f05b-40df-9ae1-814dceb9c7e0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1476 microversion: 2.1 time: 1.185482 Aug 25 12:42:28.779778 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 286/573] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:27 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1476 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:28.820698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2919d0f2-bae3-4844-a575-d6f179305a89 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:28.824788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2919d0f2-bae3-4844-a575-d6f179305a89 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:28.848738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2919d0f2-bae3-4844-a575-d6f179305a89 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:28.849706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2919d0f2-bae3-4844-a575-d6f179305a89 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:28.850587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2919d0f2-bae3-4844-a575-d6f179305a89 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:28.851808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2919d0f2-bae3-4844-a575-d6f179305a89 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:28.852622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2919d0f2-bae3-4844-a575-d6f179305a89 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:28.856630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2919d0f2-bae3-4844-a575-d6f179305a89 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:29.107773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2919d0f2-bae3-4844-a575-d6f179305a89 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:29.135787 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2919d0f2-bae3-4844-a575-d6f179305a89 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1218 microversion: 2.1 time: 0.335578 Aug 25 12:42:29.137804 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 287/574] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:28 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1218 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:29.162043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b1f36a39-4ab2-4815-b12e-6c17fd275109 tempest-SecurityGroupsTestAdminJSON-459227331 tempest-SecurityGroupsTestAdminJSON-459227331-project] Calling method '.version_select at 0x7f3a2aac73a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:29.584826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:29.612569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:29.629904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:29.632338 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-65e08e00-9dfd-4d5e-929a-8e2bbc49ca8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1569 microversion: 2.25 time: 0.955188 Aug 25 12:42:29.633476 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 288/575] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:28 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1569 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:29.671619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-909e2d34-14d6-4fa5-8831-bf925d19a031 req-ee557576-8d75-40d7-bae2-21f4c0182098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0176f06a-ee98-45ab-b392-b9b46a8e82cd", "name": "network-vif-unplugged", "status": "completed", "tag": "ffaaa691-b79c-4ca1-bdce-2e197228d565"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:29.736750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-909e2d34-14d6-4fa5-8831-bf925d19a031 req-ee557576-8d75-40d7-bae2-21f4c0182098 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:29.737753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-909e2d34-14d6-4fa5-8831-bf925d19a031 req-ee557576-8d75-40d7-bae2-21f4c0182098 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:29.739942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-909e2d34-14d6-4fa5-8831-bf925d19a031 req-ee557576-8d75-40d7-bae2-21f4c0182098 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:29.771607 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-909e2d34-14d6-4fa5-8831-bf925d19a031 req-ee557576-8d75-40d7-bae2-21f4c0182098 service nova] Creating event network-vif-unplugged:ffaaa691-b79c-4ca1-bdce-2e197228d565 for instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd on n-h1-852771-8 Aug 25 12:42:29.803505 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-909e2d34-14d6-4fa5-8831-bf925d19a031 req-ee557576-8d75-40d7-bae2-21f4c0182098 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153234 Aug 25 12:42:29.805497 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 289/576] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:29.843851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d3b38add-e427-43c7-9459-d09e0ad7d037 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:29.847471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d3b38add-e427-43c7-9459-d09e0ad7d037 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:29.880964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3b38add-e427-43c7-9459-d09e0ad7d037 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:29.884749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3b38add-e427-43c7-9459-d09e0ad7d037 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:29.885664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3b38add-e427-43c7-9459-d09e0ad7d037 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:29.887374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3b38add-e427-43c7-9459-d09e0ad7d037 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:29.888509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3b38add-e427-43c7-9459-d09e0ad7d037 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:29.889109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3b38add-e427-43c7-9459-d09e0ad7d037 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:30.997824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d3b38add-e427-43c7-9459-d09e0ad7d037 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:31.024630 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d3b38add-e427-43c7-9459-d09e0ad7d037 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1323 microversion: 2.1 time: 1.211422 Aug 25 12:42:31.041602 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 290/577] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:29 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1323 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:31.047036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-60df4665-abad-4ce1-bbe6-e52a330a8f91 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:31.056837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-60df4665-abad-4ce1-bbe6-e52a330a8f91 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:31.075220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60df4665-abad-4ce1-bbe6-e52a330a8f91 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:31.076429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60df4665-abad-4ce1-bbe6-e52a330a8f91 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:31.077814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60df4665-abad-4ce1-bbe6-e52a330a8f91 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:31.079631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60df4665-abad-4ce1-bbe6-e52a330a8f91 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:31.081672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60df4665-abad-4ce1-bbe6-e52a330a8f91 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:31.083248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60df4665-abad-4ce1-bbe6-e52a330a8f91 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:31.215987 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b1f36a39-4ab2-4815-b12e-6c17fd275109 tempest-SecurityGroupsTestAdminJSON-459227331 tempest-SecurityGroupsTestAdminJSON-459227331-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/9747f602-0fa2-4d33-a3ca-065e309cd67a" status: 202 len: 0 microversion: 2.1 time: 2.074501 Aug 25 12:42:31.217410 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 288/578] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:42:29 2022] DELETE /compute/v2.1/os-security-groups/9747f602-0fa2-4d33-a3ca-065e309cd67a => generated 0 bytes in 2078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:31.234550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-04b5d4e9-6842-4a61-9678-7789ac2d0c3e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:31.235864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-04b5d4e9-6842-4a61-9678-7789ac2d0c3e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:31.267631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04b5d4e9-6842-4a61-9678-7789ac2d0c3e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:31.269756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04b5d4e9-6842-4a61-9678-7789ac2d0c3e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:31.271697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04b5d4e9-6842-4a61-9678-7789ac2d0c3e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:31.274776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04b5d4e9-6842-4a61-9678-7789ac2d0c3e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:31.276835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04b5d4e9-6842-4a61-9678-7789ac2d0c3e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:31.278075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04b5d4e9-6842-4a61-9678-7789ac2d0c3e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:31.813259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-04b5d4e9-6842-4a61-9678-7789ac2d0c3e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:31.856643 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-04b5d4e9-6842-4a61-9678-7789ac2d0c3e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1272 microversion: 2.1 time: 0.635225 Aug 25 12:42:31.859618 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 289/579] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:31 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1272 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:31.882601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-afe6f9a4-0b1e-48fd-9d78-d98a8407ef39 req-d0f76b1c-7d76-49e5-90a4-a2136f677cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae972bd4-4dd0-4101-afd1-23fc3ac44d16", "tag": "387ff4ec-dec0-443c-87c7-324cdae33e70"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:31.918589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-afe6f9a4-0b1e-48fd-9d78-d98a8407ef39 req-d0f76b1c-7d76-49e5-90a4-a2136f677cbe service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:31.919777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-afe6f9a4-0b1e-48fd-9d78-d98a8407ef39 req-d0f76b1c-7d76-49e5-90a4-a2136f677cbe service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:31.921767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-afe6f9a4-0b1e-48fd-9d78-d98a8407ef39 req-d0f76b1c-7d76-49e5-90a4-a2136f677cbe service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:31.955184 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-afe6f9a4-0b1e-48fd-9d78-d98a8407ef39 req-d0f76b1c-7d76-49e5-90a4-a2136f677cbe service nova] Creating event network-changed:387ff4ec-dec0-443c-87c7-324cdae33e70 for instance ae972bd4-4dd0-4101-afd1-23fc3ac44d16 on n-h2-852771-8 Aug 25 12:42:31.977700 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-afe6f9a4-0b1e-48fd-9d78-d98a8407ef39 req-d0f76b1c-7d76-49e5-90a4-a2136f677cbe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111523 Aug 25 12:42:31.979107 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 290/580] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:32.012737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:32.024848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:32.078018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:32.078018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:32.078018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:32.078018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:32.091559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:32.092852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:32.439121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60df4665-abad-4ce1-bbe6-e52a330a8f91 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:32.467183 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-60df4665-abad-4ce1-bbe6-e52a330a8f91 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1476 microversion: 2.1 time: 1.433948 Aug 25 12:42:32.469727 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 291/581] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:31 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1476 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:32.481728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3ed4d3b5-c211-4380-8629-3bfdf3660479 req-c464504d-348c-4a57-8f4a-0442262d9e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0176f06a-ee98-45ab-b392-b9b46a8e82cd", "tag": "ffaaa691-b79c-4ca1-bdce-2e197228d565"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:32.518601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3ed4d3b5-c211-4380-8629-3bfdf3660479 req-c464504d-348c-4a57-8f4a-0442262d9e31 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:32.518601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3ed4d3b5-c211-4380-8629-3bfdf3660479 req-c464504d-348c-4a57-8f4a-0442262d9e31 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:32.520373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3ed4d3b5-c211-4380-8629-3bfdf3660479 req-c464504d-348c-4a57-8f4a-0442262d9e31 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:32.553010 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3ed4d3b5-c211-4380-8629-3bfdf3660479 req-c464504d-348c-4a57-8f4a-0442262d9e31 service nova] Creating event network-changed:ffaaa691-b79c-4ca1-bdce-2e197228d565 for instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd on n-h1-852771-8 Aug 25 12:42:32.581958 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3ed4d3b5-c211-4380-8629-3bfdf3660479 req-c464504d-348c-4a57-8f4a-0442262d9e31 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092356 Aug 25 12:42:32.584321 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 292/582] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:32.608678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8c346f60-e04f-4c03-9952-11cf4cac04e8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:32.612356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8c346f60-e04f-4c03-9952-11cf4cac04e8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:32.628786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c346f60-e04f-4c03-9952-11cf4cac04e8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:32.631680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c346f60-e04f-4c03-9952-11cf4cac04e8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:32.632960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c346f60-e04f-4c03-9952-11cf4cac04e8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:32.635138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c346f60-e04f-4c03-9952-11cf4cac04e8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:32.636481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c346f60-e04f-4c03-9952-11cf4cac04e8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:32.639881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c346f60-e04f-4c03-9952-11cf4cac04e8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:33.271876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:33.323636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:33.332642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:33.335052 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f5cdec7-77a9-456e-a768-a1fe0b020dae tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1569 microversion: 2.25 time: 1.353379 Aug 25 12:42:33.358041 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 291/583] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:31 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1569 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:33.386205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e81caa52-6e88-45d6-a00b-a2c6d6a2c79c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:33.387296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e81caa52-6e88-45d6-a00b-a2c6d6a2c79c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:33.402616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e81caa52-6e88-45d6-a00b-a2c6d6a2c79c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:33.403483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e81caa52-6e88-45d6-a00b-a2c6d6a2c79c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:33.404320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e81caa52-6e88-45d6-a00b-a2c6d6a2c79c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:33.405757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e81caa52-6e88-45d6-a00b-a2c6d6a2c79c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:33.406627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e81caa52-6e88-45d6-a00b-a2c6d6a2c79c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:33.407687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e81caa52-6e88-45d6-a00b-a2c6d6a2c79c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:33.635721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:33.721547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=12 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:33.807508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e81caa52-6e88-45d6-a00b-a2c6d6a2c79c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:33.867223 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e81caa52-6e88-45d6-a00b-a2c6d6a2c79c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1272 microversion: 2.1 time: 0.501600 Aug 25 12:42:33.868617 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 292/584] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:33 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1272 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:33.890449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-34e3c577-6825-400c-b1ab-3d9622cf7b6d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:33.892548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-34e3c577-6825-400c-b1ab-3d9622cf7b6d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:33.923064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34e3c577-6825-400c-b1ab-3d9622cf7b6d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:33.923921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34e3c577-6825-400c-b1ab-3d9622cf7b6d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:33.928977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34e3c577-6825-400c-b1ab-3d9622cf7b6d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:33.934200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34e3c577-6825-400c-b1ab-3d9622cf7b6d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:33.934978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34e3c577-6825-400c-b1ab-3d9622cf7b6d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:33.941291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34e3c577-6825-400c-b1ab-3d9622cf7b6d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:33.998253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8c346f60-e04f-4c03-9952-11cf4cac04e8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:34.020087 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8c346f60-e04f-4c03-9952-11cf4cac04e8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1323 microversion: 2.1 time: 1.430004 Aug 25 12:42:34.041385 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 293/585] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:32 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1323 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:34.399738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:34.405380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:34.457301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:34.462262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:34.467999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:34.473263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:34.474287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:34.475991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:35.028558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-34e3c577-6825-400c-b1ab-3d9622cf7b6d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:35.071401 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-34e3c577-6825-400c-b1ab-3d9622cf7b6d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1476 microversion: 2.1 time: 1.197982 Aug 25 12:42:35.073863 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 293/586] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:33 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1476 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:35.095010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47ad09c1-b309-46e4-b7c8-64f51ad277ce tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:35.104674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-47ad09c1-b309-46e4-b7c8-64f51ad277ce tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:35.129664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ad09c1-b309-46e4-b7c8-64f51ad277ce tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:35.133617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ad09c1-b309-46e4-b7c8-64f51ad277ce tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:35.137418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ad09c1-b309-46e4-b7c8-64f51ad277ce tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:35.142551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ad09c1-b309-46e4-b7c8-64f51ad277ce tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:35.145037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ad09c1-b309-46e4-b7c8-64f51ad277ce tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:35.146428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ad09c1-b309-46e4-b7c8-64f51ad277ce tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:35.563036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-47ad09c1-b309-46e4-b7c8-64f51ad277ce tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:35.607614 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47ad09c1-b309-46e4-b7c8-64f51ad277ce tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1272 microversion: 2.1 time: 0.531135 Aug 25 12:42:35.614076 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 294/587] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:35 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1272 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:35.631663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-15bc22cf-79dd-4044-9ed8-e32f34e81898 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:35.645073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-15bc22cf-79dd-4044-9ed8-e32f34e81898 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:35.683051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15bc22cf-79dd-4044-9ed8-e32f34e81898 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:35.688120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15bc22cf-79dd-4044-9ed8-e32f34e81898 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:35.688856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:35.690879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15bc22cf-79dd-4044-9ed8-e32f34e81898 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:35.695695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15bc22cf-79dd-4044-9ed8-e32f34e81898 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:35.696626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15bc22cf-79dd-4044-9ed8-e32f34e81898 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:35.702879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15bc22cf-79dd-4044-9ed8-e32f34e81898 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:35.716224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:35.722921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:35.734719 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a5da70e8-7fc9-4289-95c2-01d8c40e854e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1569 microversion: 2.25 time: 1.348532 Aug 25 12:42:35.736424 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 294/588] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:34 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1569 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:36.126291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4aa002ea-9684-4d8a-ab8a-645457a2e517 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:36.139545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4aa002ea-9684-4d8a-ab8a-645457a2e517 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:36.157370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:36.182578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aa002ea-9684-4d8a-ab8a-645457a2e517 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:36.183898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aa002ea-9684-4d8a-ab8a-645457a2e517 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:36.184999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aa002ea-9684-4d8a-ab8a-645457a2e517 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:36.186668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aa002ea-9684-4d8a-ab8a-645457a2e517 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:36.192598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aa002ea-9684-4d8a-ab8a-645457a2e517 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:36.194099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aa002ea-9684-4d8a-ab8a-645457a2e517 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:36.446526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-15bc22cf-79dd-4044-9ed8-e32f34e81898 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:36.475209 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-15bc22cf-79dd-4044-9ed8-e32f34e81898 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1323 microversion: 2.1 time: 0.859029 Aug 25 12:42:36.482862 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 295/589] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:35 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1323 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:36.663369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-064e5910-d1a0-4688-9117-60b8f7ea6ade tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:36.667579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-064e5910-d1a0-4688-9117-60b8f7ea6ade tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:36.693020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064e5910-d1a0-4688-9117-60b8f7ea6ade tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:36.699777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064e5910-d1a0-4688-9117-60b8f7ea6ade tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:36.700627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064e5910-d1a0-4688-9117-60b8f7ea6ade tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:36.702109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064e5910-d1a0-4688-9117-60b8f7ea6ade tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:36.703190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064e5910-d1a0-4688-9117-60b8f7ea6ade tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:36.704364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064e5910-d1a0-4688-9117-60b8f7ea6ade tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:36.975735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4aa002ea-9684-4d8a-ab8a-645457a2e517 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:37.013802 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4aa002ea-9684-4d8a-ab8a-645457a2e517 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1476 microversion: 2.1 time: 0.899011 Aug 25 12:42:37.019587 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 295/590] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:36 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1476 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:42:37.030086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.030832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:37.076808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:37.077873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:37.078740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:37.080124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:37.090203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:37.091252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:37.396019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:37.451465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:37.847732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-064e5910-d1a0-4688-9117-60b8f7ea6ade tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:37.874603 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-064e5910-d1a0-4688-9117-60b8f7ea6ade tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1314 microversion: 2.1 time: 1.216263 Aug 25 12:42:37.906487 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 296/591] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:36 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1314 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:37.918666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97944104-37bf-4fb3-b956-c003106a1849 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.919566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-97944104-37bf-4fb3-b956-c003106a1849 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:37.931888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97944104-37bf-4fb3-b956-c003106a1849 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:37.932753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97944104-37bf-4fb3-b956-c003106a1849 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:37.933623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97944104-37bf-4fb3-b956-c003106a1849 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:37.935778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97944104-37bf-4fb3-b956-c003106a1849 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:37.936912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97944104-37bf-4fb3-b956-c003106a1849 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:37.938141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97944104-37bf-4fb3-b956-c003106a1849 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:38.086093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:38.105538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:38.108660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:38.111458 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f41b0337-361d-4f19-95e0-8f4f193eba0c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1569 microversion: 2.25 time: 1.090204 Aug 25 12:42:38.114743 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 296/592] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:37 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1569 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:38.126637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d1ca9e8f-1e32-48dc-84f8-06d838834c7d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:38.128833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d1ca9e8f-1e32-48dc-84f8-06d838834c7d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:38.139596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1ca9e8f-1e32-48dc-84f8-06d838834c7d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:38.140592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1ca9e8f-1e32-48dc-84f8-06d838834c7d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:38.141272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1ca9e8f-1e32-48dc-84f8-06d838834c7d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:38.142420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1ca9e8f-1e32-48dc-84f8-06d838834c7d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:38.143536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1ca9e8f-1e32-48dc-84f8-06d838834c7d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:38.144588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1ca9e8f-1e32-48dc-84f8-06d838834c7d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:38.998098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d1ca9e8f-1e32-48dc-84f8-06d838834c7d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:39.019117 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d1ca9e8f-1e32-48dc-84f8-06d838834c7d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1476 microversion: 2.1 time: 0.899284 Aug 25 12:42:39.039318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-97944104-37bf-4fb3-b956-c003106a1849 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:39.045988 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 297/593] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:38 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1476 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:39.074958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e4bee5d-e28e-431d-ab78-74baa156f224 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:39.078997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5e4bee5d-e28e-431d-ab78-74baa156f224 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:39.082514 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-97944104-37bf-4fb3-b956-c003106a1849 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1323 microversion: 2.1 time: 1.173926 Aug 25 12:42:39.084681 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 297/594] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:37 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1323 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:39.114137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e4bee5d-e28e-431d-ab78-74baa156f224 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:39.119737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e4bee5d-e28e-431d-ab78-74baa156f224 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:39.121084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e4bee5d-e28e-431d-ab78-74baa156f224 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:39.128917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e4bee5d-e28e-431d-ab78-74baa156f224 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:39.142781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e4bee5d-e28e-431d-ab78-74baa156f224 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:39.144665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e4bee5d-e28e-431d-ab78-74baa156f224 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:39.158158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:39.160870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:39.188753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:39.190233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:39.191431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:39.193184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:39.201446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:39.202413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:40.117303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5e4bee5d-e28e-431d-ab78-74baa156f224 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:40.136545 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5e4bee5d-e28e-431d-ab78-74baa156f224 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1314 microversion: 2.1 time: 1.087636 Aug 25 12:42:40.138105 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 298/595] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:39 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:40.151438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-67729c30-20da-473a-ab07-e40d17d99903 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:40.153592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-67729c30-20da-473a-ab07-e40d17d99903 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:40.171039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67729c30-20da-473a-ab07-e40d17d99903 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:40.172583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67729c30-20da-473a-ab07-e40d17d99903 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:40.173865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67729c30-20da-473a-ab07-e40d17d99903 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:40.176748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:40.186749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67729c30-20da-473a-ab07-e40d17d99903 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:40.191101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67729c30-20da-473a-ab07-e40d17d99903 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:40.192442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67729c30-20da-473a-ab07-e40d17d99903 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:40.220267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:40.234353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:40.238675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:40.239301 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-861fd228-6c1a-4178-badf-7975e4a0a9c6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1569 microversion: 2.25 time: 1.085861 Aug 25 12:42:40.255043 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 298/596] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:39 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1569 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:40.285144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad92ad73-33b1-4bc4-9655-130d137114f0 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:40.286536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad92ad73-33b1-4bc4-9655-130d137114f0 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:40.298575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad92ad73-33b1-4bc4-9655-130d137114f0 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:40.299695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad92ad73-33b1-4bc4-9655-130d137114f0 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:40.300534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad92ad73-33b1-4bc4-9655-130d137114f0 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:40.301879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad92ad73-33b1-4bc4-9655-130d137114f0 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:40.302993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad92ad73-33b1-4bc4-9655-130d137114f0 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:40.303791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad92ad73-33b1-4bc4-9655-130d137114f0 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:41.014960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ad92ad73-33b1-4bc4-9655-130d137114f0 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:41.061089 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad92ad73-33b1-4bc4-9655-130d137114f0 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1323 microversion: 2.1 time: 0.803697 Aug 25 12:42:41.062100 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 299/597] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:40 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1323 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:41.083848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-049fd398-a0e8-4ed9-9850-8738843a1175 req-884eb2fc-2447-4fb9-a5f2-a7c8845fa689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42add69-b14a-4dd1-a7ce-8c6c162b4e1a", "tag": "0a60e19f-de52-46f3-aca2-8d097515612b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:41.132531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-049fd398-a0e8-4ed9-9850-8738843a1175 req-884eb2fc-2447-4fb9-a5f2-a7c8845fa689 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:41.133421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-049fd398-a0e8-4ed9-9850-8738843a1175 req-884eb2fc-2447-4fb9-a5f2-a7c8845fa689 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:41.134269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-049fd398-a0e8-4ed9-9850-8738843a1175 req-884eb2fc-2447-4fb9-a5f2-a7c8845fa689 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:41.176055 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-049fd398-a0e8-4ed9-9850-8738843a1175 req-884eb2fc-2447-4fb9-a5f2-a7c8845fa689 service nova] Creating event network-changed:0a60e19f-de52-46f3-aca2-8d097515612b for instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a on n-h1-852771-8 Aug 25 12:42:41.192268 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-049fd398-a0e8-4ed9-9850-8738843a1175 req-884eb2fc-2447-4fb9-a5f2-a7c8845fa689 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124851 Aug 25 12:42:41.197945 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 300/598] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:41.221787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0dad27ef-9674-4e25-ac55-da3196d4318a req-126c5860-78a1-4887-9afd-cea9f007e829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae972bd4-4dd0-4101-afd1-23fc3ac44d16", "name": "network-vif-plugged", "status": "completed", "tag": "387ff4ec-dec0-443c-87c7-324cdae33e70"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:41.271163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0dad27ef-9674-4e25-ac55-da3196d4318a req-126c5860-78a1-4887-9afd-cea9f007e829 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:41.272903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0dad27ef-9674-4e25-ac55-da3196d4318a req-126c5860-78a1-4887-9afd-cea9f007e829 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:41.274169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0dad27ef-9674-4e25-ac55-da3196d4318a req-126c5860-78a1-4887-9afd-cea9f007e829 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:41.303989 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0dad27ef-9674-4e25-ac55-da3196d4318a req-126c5860-78a1-4887-9afd-cea9f007e829 service nova] Creating event network-vif-plugged:387ff4ec-dec0-443c-87c7-324cdae33e70 for instance ae972bd4-4dd0-4101-afd1-23fc3ac44d16 on n-h2-852771-8 Aug 25 12:42:41.320273 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0dad27ef-9674-4e25-ac55-da3196d4318a req-126c5860-78a1-4887-9afd-cea9f007e829 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119666 Aug 25 12:42:41.322950 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 301/599] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:41.340236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e1f4bfb3-700d-4bc8-956d-9acaad452059 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:41.343881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e1f4bfb3-700d-4bc8-956d-9acaad452059 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:41.362811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1f4bfb3-700d-4bc8-956d-9acaad452059 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:41.364562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1f4bfb3-700d-4bc8-956d-9acaad452059 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:41.365861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1f4bfb3-700d-4bc8-956d-9acaad452059 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:41.369173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1f4bfb3-700d-4bc8-956d-9acaad452059 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:41.371911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1f4bfb3-700d-4bc8-956d-9acaad452059 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:41.374284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1f4bfb3-700d-4bc8-956d-9acaad452059 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:41.418026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:41.764852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-67729c30-20da-473a-ab07-e40d17d99903 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:41.813605 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-67729c30-20da-473a-ab07-e40d17d99903 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1476 microversion: 2.1 time: 1.670422 Aug 25 12:42:41.821368 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 299/600] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:40 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1476 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:41.849467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:41.853778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:41.874546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:41.876697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:41.876697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:41.879382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:41.880321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:41.881360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:42.480133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e1f4bfb3-700d-4bc8-956d-9acaad452059 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:42.520698 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e1f4bfb3-700d-4bc8-956d-9acaad452059 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1314 microversion: 2.1 time: 1.193318 Aug 25 12:42:42.524918 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 302/601] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:41 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1314 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:42.544380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-92a06e8b-3fe6-4fd6-baf7-15d3be5a774c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:42.547632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-92a06e8b-3fe6-4fd6-baf7-15d3be5a774c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:42.567429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92a06e8b-3fe6-4fd6-baf7-15d3be5a774c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:42.568578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92a06e8b-3fe6-4fd6-baf7-15d3be5a774c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:42.569882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92a06e8b-3fe6-4fd6-baf7-15d3be5a774c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:42.571771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92a06e8b-3fe6-4fd6-baf7-15d3be5a774c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:42.572833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92a06e8b-3fe6-4fd6-baf7-15d3be5a774c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:42.574875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92a06e8b-3fe6-4fd6-baf7-15d3be5a774c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:42.642634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:42.661689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:42.675213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:42.678811 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e5328fa8-cd76-4eed-b5c9-98fbb3e791b1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1569 microversion: 2.25 time: 0.854917 Aug 25 12:42:42.680777 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 300/602] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:41 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1569 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:42.873406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e4ff7eb6-0686-4394-a462-6c71b092e25b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:42.876828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e4ff7eb6-0686-4394-a462-6c71b092e25b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:42.897094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4ff7eb6-0686-4394-a462-6c71b092e25b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:42.899428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4ff7eb6-0686-4394-a462-6c71b092e25b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:42.899993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4ff7eb6-0686-4394-a462-6c71b092e25b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:42.900874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4ff7eb6-0686-4394-a462-6c71b092e25b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:42.901365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4ff7eb6-0686-4394-a462-6c71b092e25b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:42.902436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4ff7eb6-0686-4394-a462-6c71b092e25b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:42.917980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-92a06e8b-3fe6-4fd6-baf7-15d3be5a774c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:42.973590 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-92a06e8b-3fe6-4fd6-baf7-15d3be5a774c tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1323 microversion: 2.1 time: 0.443053 Aug 25 12:42:42.976189 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 303/603] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:42 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:43.352709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1139596621", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:43.495221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:42:43.877223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e4ff7eb6-0686-4394-a462-6c71b092e25b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:43.899900 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e4ff7eb6-0686-4394-a462-6c71b092e25b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1476 microversion: 2.1 time: 1.037713 Aug 25 12:42:43.901955 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 301/604] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:42 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1476 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:42:43.917341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c3ff1a56-cb75-4ea7-9efd-e794b5dd8e8f req-c130f5aa-a12f-45a3-8201-9d234a8de843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61538c72-db7a-4901-b6c2-e695417c9d49", "tag": "98a9d4d6-6958-4c41-acfd-dbed7d9ed258"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:43.941341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c3ff1a56-cb75-4ea7-9efd-e794b5dd8e8f req-c130f5aa-a12f-45a3-8201-9d234a8de843 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:43.942953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c3ff1a56-cb75-4ea7-9efd-e794b5dd8e8f req-c130f5aa-a12f-45a3-8201-9d234a8de843 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:43.944280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c3ff1a56-cb75-4ea7-9efd-e794b5dd8e8f req-c130f5aa-a12f-45a3-8201-9d234a8de843 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:43.977604 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c3ff1a56-cb75-4ea7-9efd-e794b5dd8e8f req-c130f5aa-a12f-45a3-8201-9d234a8de843 service nova] Creating event network-changed:98a9d4d6-6958-4c41-acfd-dbed7d9ed258 for instance 61538c72-db7a-4901-b6c2-e695417c9d49 on n-h2-852771-8 Aug 25 12:42:43.991442 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c3ff1a56-cb75-4ea7-9efd-e794b5dd8e8f req-c130f5aa-a12f-45a3-8201-9d234a8de843 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086463 Aug 25 12:42:43.993846 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 302/605] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:44.011426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-91cf7430-c7d4-470a-91d3-a9f2457227f7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:44.013222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-91cf7430-c7d4-470a-91d3-a9f2457227f7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:44.030246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91cf7430-c7d4-470a-91d3-a9f2457227f7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:44.032772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91cf7430-c7d4-470a-91d3-a9f2457227f7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:44.034936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91cf7430-c7d4-470a-91d3-a9f2457227f7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:44.039294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91cf7430-c7d4-470a-91d3-a9f2457227f7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:44.040480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91cf7430-c7d4-470a-91d3-a9f2457227f7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:44.041795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91cf7430-c7d4-470a-91d3-a9f2457227f7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:45.682007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:42:45.685130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:42:45.686641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:42:45.692517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:42:45.697437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:42:45.719288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:45.720758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:45.722504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:45.726410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:45.727821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:45.729075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:45.789078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Getting quotas for project d33ffb23724e4333a2a0bc502c7f8854. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:45.806386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Getting quotas for user 9c85f30678174c6b99732ef70898b803 and project d33ffb23724e4333a2a0bc502c7f8854. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:45.857930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:42:45.870986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:42:45.991674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-91cf7430-c7d4-470a-91d3-a9f2457227f7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:45.998949 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9e9c3444-23c5-4a6d-ae37-85e399c9c107 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.019209 Aug 25 12:42:46.004744 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 304/606] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:42:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:42:46.025875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:46.030880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:46.052990 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-91cf7430-c7d4-470a-91d3-a9f2457227f7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1314 microversion: 2.1 time: 2.056084 Aug 25 12:42:46.075935 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 303/607] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:43 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1314 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:46.086922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:46.089352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:46.094849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:46.100513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e76a1df-d610-40d1-8607-388ba2d91ab2 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:46.100836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:46.102580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e76a1df-d610-40d1-8607-388ba2d91ab2 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:46.109733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:46.110566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:46.132838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e76a1df-d610-40d1-8607-388ba2d91ab2 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:46.146163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e76a1df-d610-40d1-8607-388ba2d91ab2 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:46.147665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e76a1df-d610-40d1-8607-388ba2d91ab2 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:46.149785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e76a1df-d610-40d1-8607-388ba2d91ab2 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:46.158367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e76a1df-d610-40d1-8607-388ba2d91ab2 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:46.160037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e76a1df-d610-40d1-8607-388ba2d91ab2 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:47.679250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:47.712547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:47.724557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:47.727486 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b344aa8-a3eb-4a50-a771-46227ae50a35 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1569 microversion: 2.25 time: 1.720046 Aug 25 12:42:47.745832 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 305/608] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:46 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1569 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:47.754508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63e3e8e3-c468-45b0-9673-a125c172d20f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:47.762581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-63e3e8e3-c468-45b0-9673-a125c172d20f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:47.785174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63e3e8e3-c468-45b0-9673-a125c172d20f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:47.793057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63e3e8e3-c468-45b0-9673-a125c172d20f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:47.798318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63e3e8e3-c468-45b0-9673-a125c172d20f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:47.800948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63e3e8e3-c468-45b0-9673-a125c172d20f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:47.806428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63e3e8e3-c468-45b0-9673-a125c172d20f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:47.810834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63e3e8e3-c468-45b0-9673-a125c172d20f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.059088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e76a1df-d610-40d1-8607-388ba2d91ab2 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:48.124943 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e76a1df-d610-40d1-8607-388ba2d91ab2 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1473 microversion: 2.1 time: 2.046648 Aug 25 12:42:48.125961 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 304/609] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:46 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1473 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:48.170313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c6979264-d627-4060-98d6-1b9f91cbce3f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:48.171801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c6979264-d627-4060-98d6-1b9f91cbce3f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:48.218747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6979264-d627-4060-98d6-1b9f91cbce3f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.228254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6979264-d627-4060-98d6-1b9f91cbce3f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.229738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6979264-d627-4060-98d6-1b9f91cbce3f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.232836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6979264-d627-4060-98d6-1b9f91cbce3f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.238885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6979264-d627-4060-98d6-1b9f91cbce3f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.240701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6979264-d627-4060-98d6-1b9f91cbce3f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.666384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c6979264-d627-4060-98d6-1b9f91cbce3f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:48.694671 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c6979264-d627-4060-98d6-1b9f91cbce3f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1218 microversion: 2.1 time: 0.537806 Aug 25 12:42:48.696139 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 305/610] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:48 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1218 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:48.724462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02024751-b31b-4294-9708-b51284236db2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:48.727036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-02024751-b31b-4294-9708-b51284236db2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:48.749709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02024751-b31b-4294-9708-b51284236db2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.751437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02024751-b31b-4294-9708-b51284236db2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.754208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02024751-b31b-4294-9708-b51284236db2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.756141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02024751-b31b-4294-9708-b51284236db2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.757703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02024751-b31b-4294-9708-b51284236db2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.759168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02024751-b31b-4294-9708-b51284236db2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.941490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63e3e8e3-c468-45b0-9673-a125c172d20f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:48.973814 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-63e3e8e3-c468-45b0-9673-a125c172d20f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1475 microversion: 2.1 time: 1.227802 Aug 25 12:42:48.976360 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 306/611] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:47 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1475 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:49.007721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:49.014431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:49.055557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:49.056820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:49.057861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:49.060994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:49.068102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:49.073776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:49.246719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Request method failure captured: Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16/diagnostics HTTP/1.1 Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB24i1yvvVH8M7LURVCiXB1dq3e50b-OtSEmCsk4HnVeo6N6eGdSPTRoYlk5Cn1RNul7M7ETuBlf6LG5Ec9nXtfb6xg9OTXIAdxOvnbZhjEKk2mqhgS-eLQ0MtNgwFVwwEhX13zcXemTmo4krkXXMXlj8Lg2TZxZil5cDM1x81F0QaqM Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 8d958566e47b4a5aa726773893d68aa0 Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1996364344 Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:42:49.262585 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d958566e47b4a5aa726773893d68aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8d958566e47b4a5aa726773893d68aa0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8d958566e47b4a5aa726773893d68aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d958566e47b4a5aa726773893d68aa0"}]}] Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1996364344 Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 8d958566e47b4a5aa726773893d68aa0 Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1996364344 Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerDiagnosticsNegativeTest-1996364344-project Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 026fb8558b1443f3a895bb91a4b603dc Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1996364344-project Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:42:49.265718 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': 'ae972bd4-4dd0-4101-afd1-23fc3ac44d16'} Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:42:49.267014 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 25 12:42:49.270345 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:42:49.276202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:49.281790 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-63b63647-42dc-4383-ab51-7399fb4234ed tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.296110 Aug 25 12:42:49.283263 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 307/612] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:42:48 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16/diagnostics => generated 117 bytes in 306 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:49.295276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:49.296833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:49.312641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:49.313806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:49.315755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:49.317675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:49.319025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:49.320320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.483821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-02024751-b31b-4294-9708-b51284236db2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:50.540764 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-02024751-b31b-4294-9708-b51284236db2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1314 microversion: 2.1 time: 1.841275 Aug 25 12:42:50.565556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 306/613] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:48 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1314 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:50.591275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-592d757c-5c60-44df-ab9b-da75d19bec5d tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:50.594230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-592d757c-5c60-44df-ab9b-da75d19bec5d tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:50.656939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-592d757c-5c60-44df-ab9b-da75d19bec5d tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.657385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-592d757c-5c60-44df-ab9b-da75d19bec5d tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.658234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-592d757c-5c60-44df-ab9b-da75d19bec5d tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.661083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-592d757c-5c60-44df-ab9b-da75d19bec5d tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.678310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-592d757c-5c60-44df-ab9b-da75d19bec5d tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.681925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-592d757c-5c60-44df-ab9b-da75d19bec5d tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.740396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:50.772307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:50.775497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:50.777960 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0edce217-9c02-47dd-9400-882d7e0fad38 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1569 microversion: 2.25 time: 1.490213 Aug 25 12:42:50.794080 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 308/614] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:49 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1569 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:50.797863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-592d757c-5c60-44df-ab9b-da75d19bec5d tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:42:50.804350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d8fccc5-ecb8-468b-963b-f5687e19ec56 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:50.805353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d8fccc5-ecb8-468b-963b-f5687e19ec56 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:50.844102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d8fccc5-ecb8-468b-963b-f5687e19ec56 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.845016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d8fccc5-ecb8-468b-963b-f5687e19ec56 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.846258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d8fccc5-ecb8-468b-963b-f5687e19ec56 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.847267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d8fccc5-ecb8-468b-963b-f5687e19ec56 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.848168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d8fccc5-ecb8-468b-963b-f5687e19ec56 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.848959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d8fccc5-ecb8-468b-963b-f5687e19ec56 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:51.091692 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-592d757c-5c60-44df-ab9b-da75d19bec5d tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 204 len: 0 microversion: 2.1 time: 0.522392 Aug 25 12:42:51.096229 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 307/615] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:42:50 2022] DELETE /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:42:51.114974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a5aed104-65f8-4a76-a3c2-b6fe539d5358 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:51.119532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a5aed104-65f8-4a76-a3c2-b6fe539d5358 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:51.126521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d8fccc5-ecb8-468b-963b-f5687e19ec56 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:51.146678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5aed104-65f8-4a76-a3c2-b6fe539d5358 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:51.148087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5aed104-65f8-4a76-a3c2-b6fe539d5358 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:51.149246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5aed104-65f8-4a76-a3c2-b6fe539d5358 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:51.151811 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d8fccc5-ecb8-468b-963b-f5687e19ec56 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1280 microversion: 2.1 time: 0.355735 Aug 25 12:42:51.153279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5aed104-65f8-4a76-a3c2-b6fe539d5358 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:51.156538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5aed104-65f8-4a76-a3c2-b6fe539d5358 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:51.157275 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 309/616] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:50 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1280 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:51.158401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5aed104-65f8-4a76-a3c2-b6fe539d5358 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:51.175370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-80b35aa3-871d-459c-a6de-44ba94f3253f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:51.176813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-80b35aa3-871d-459c-a6de-44ba94f3253f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:51.200457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b35aa3-871d-459c-a6de-44ba94f3253f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:51.201165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b35aa3-871d-459c-a6de-44ba94f3253f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:51.201987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b35aa3-871d-459c-a6de-44ba94f3253f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:51.203243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b35aa3-871d-459c-a6de-44ba94f3253f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:51.206677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b35aa3-871d-459c-a6de-44ba94f3253f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:51.217573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80b35aa3-871d-459c-a6de-44ba94f3253f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:52.183784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-80b35aa3-871d-459c-a6de-44ba94f3253f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:52.213675 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-80b35aa3-871d-459c-a6de-44ba94f3253f tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1479 microversion: 2.1 time: 1.054241 Aug 25 12:42:52.219450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 310/617] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:51 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1479 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:52.233973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1a826f4d-a1a7-4cde-aa5b-c06304e88c8f req-024d21a2-4dbe-47b4-88e0-a26478c85e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e481324-3e50-472a-857d-d015400b2260", "name": "network-vif-unplugged", "status": "completed", "tag": "3ab10696-8912-459d-b019-6b94e0f42269"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:52.257681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a826f4d-a1a7-4cde-aa5b-c06304e88c8f req-024d21a2-4dbe-47b4-88e0-a26478c85e2b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:52.258836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a826f4d-a1a7-4cde-aa5b-c06304e88c8f req-024d21a2-4dbe-47b4-88e0-a26478c85e2b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:52.276632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a826f4d-a1a7-4cde-aa5b-c06304e88c8f req-024d21a2-4dbe-47b4-88e0-a26478c85e2b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:52.293245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5aed104-65f8-4a76-a3c2-b6fe539d5358 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:52.331060 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1a826f4d-a1a7-4cde-aa5b-c06304e88c8f req-024d21a2-4dbe-47b4-88e0-a26478c85e2b service nova] Creating event network-vif-unplugged:3ab10696-8912-459d-b019-6b94e0f42269 for instance 3e481324-3e50-472a-857d-d015400b2260 on n-h1-852771-8 Aug 25 12:42:52.331654 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a5aed104-65f8-4a76-a3c2-b6fe539d5358 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1475 microversion: 2.1 time: 1.231588 Aug 25 12:42:52.333361 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 308/618] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:51 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1475 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:52.355156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89b1a1b4-1494-499a-b442-c4199c2852eb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:52.355882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89b1a1b4-1494-499a-b442-c4199c2852eb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:52.373428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-1a826f4d-a1a7-4cde-aa5b-c06304e88c8f req-024d21a2-4dbe-47b4-88e0-a26478c85e2b service nova] Instance 3e481324-3e50-472a-857d-d015400b2260 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:42:52.376973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1a1b4-1494-499a-b442-c4199c2852eb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:52.378540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1a1b4-1494-499a-b442-c4199c2852eb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:52.379360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1a1b4-1494-499a-b442-c4199c2852eb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:52.380742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1a1b4-1494-499a-b442-c4199c2852eb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:52.398112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1a1b4-1494-499a-b442-c4199c2852eb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:52.398822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1a1b4-1494-499a-b442-c4199c2852eb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:52.416073 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1a826f4d-a1a7-4cde-aa5b-c06304e88c8f req-024d21a2-4dbe-47b4-88e0-a26478c85e2b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.193333 Aug 25 12:42:52.418086 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 311/619] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:52.438690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:52.441366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:52.468587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:52.470084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:52.472712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:52.474524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:52.475763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:52.479950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:53.540495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:53.574151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:53.578635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:53.582255 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8f0a78cd-066e-439c-ac5b-e65db360c9a0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1569 microversion: 2.25 time: 1.161003 Aug 25 12:42:53.583700 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 312/620] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:52 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1569 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:53.594260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1a9f5b6a-3579-4db3-a301-5cfa1b9ee427 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:53.596429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1a9f5b6a-3579-4db3-a301-5cfa1b9ee427 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:53.628086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a9f5b6a-3579-4db3-a301-5cfa1b9ee427 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:53.629059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a9f5b6a-3579-4db3-a301-5cfa1b9ee427 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:53.641359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a9f5b6a-3579-4db3-a301-5cfa1b9ee427 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:53.643413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a9f5b6a-3579-4db3-a301-5cfa1b9ee427 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:53.644014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a9f5b6a-3579-4db3-a301-5cfa1b9ee427 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:53.644691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a9f5b6a-3579-4db3-a301-5cfa1b9ee427 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:54.010706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89b1a1b4-1494-499a-b442-c4199c2852eb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:54.051870 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89b1a1b4-1494-499a-b442-c4199c2852eb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1314 microversion: 2.1 time: 1.716146 Aug 25 12:42:54.073565 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 309/621] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:52 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1314 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:54.073565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1ebd55e-e110-4d1a-adb4-fa94a12e2bd8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:54.073565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b1ebd55e-e110-4d1a-adb4-fa94a12e2bd8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:54.078691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1ebd55e-e110-4d1a-adb4-fa94a12e2bd8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:54.079586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1ebd55e-e110-4d1a-adb4-fa94a12e2bd8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:54.080734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1ebd55e-e110-4d1a-adb4-fa94a12e2bd8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:54.082739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1ebd55e-e110-4d1a-adb4-fa94a12e2bd8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:54.084338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1ebd55e-e110-4d1a-adb4-fa94a12e2bd8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:54.085675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1ebd55e-e110-4d1a-adb4-fa94a12e2bd8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:54.367287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1a9f5b6a-3579-4db3-a301-5cfa1b9ee427 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:54.398670 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1a9f5b6a-3579-4db3-a301-5cfa1b9ee427 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1280 microversion: 2.1 time: 0.807038 Aug 25 12:42:54.426107 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 313/622] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:53 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1280 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:54.457442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47441830-1ecc-4462-9a40-2e0a08ee1ecb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:54.459346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-47441830-1ecc-4462-9a40-2e0a08ee1ecb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:54.479838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:54.483713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47441830-1ecc-4462-9a40-2e0a08ee1ecb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:54.484375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47441830-1ecc-4462-9a40-2e0a08ee1ecb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:54.485843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47441830-1ecc-4462-9a40-2e0a08ee1ecb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:54.489638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47441830-1ecc-4462-9a40-2e0a08ee1ecb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:54.491039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47441830-1ecc-4462-9a40-2e0a08ee1ecb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:54.491833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47441830-1ecc-4462-9a40-2e0a08ee1ecb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:55.466940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b1ebd55e-e110-4d1a-adb4-fa94a12e2bd8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:55.513848 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b1ebd55e-e110-4d1a-adb4-fa94a12e2bd8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1479 microversion: 2.1 time: 1.454098 Aug 25 12:42:55.519683 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 310/623] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:54 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1479 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:55.534618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-353d8165-98fb-4ed8-8496-3c7e58268f26 req-75a10b13-0a90-4c87-81a0-4db1562bb686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42add69-b14a-4dd1-a7ce-8c6c162b4e1a", "name": "network-vif-plugged", "status": "completed", "tag": "0a60e19f-de52-46f3-aca2-8d097515612b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:55.598719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-353d8165-98fb-4ed8-8496-3c7e58268f26 req-75a10b13-0a90-4c87-81a0-4db1562bb686 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:55.600177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-353d8165-98fb-4ed8-8496-3c7e58268f26 req-75a10b13-0a90-4c87-81a0-4db1562bb686 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:55.603165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-353d8165-98fb-4ed8-8496-3c7e58268f26 req-75a10b13-0a90-4c87-81a0-4db1562bb686 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:55.681360 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-353d8165-98fb-4ed8-8496-3c7e58268f26 req-75a10b13-0a90-4c87-81a0-4db1562bb686 service nova] Creating event network-vif-plugged:0a60e19f-de52-46f3-aca2-8d097515612b for instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a on n-h1-852771-8 Aug 25 12:42:55.729859 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-353d8165-98fb-4ed8-8496-3c7e58268f26 req-75a10b13-0a90-4c87-81a0-4db1562bb686 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207481 Aug 25 12:42:55.732168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-47441830-1ecc-4462-9a40-2e0a08ee1ecb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:55.744090 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 311/624] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:55.773686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:55.814746 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47441830-1ecc-4462-9a40-2e0a08ee1ecb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1475 microversion: 2.1 time: 1.386073 Aug 25 12:42:55.817336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:55.824978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:55.860737 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 314/625] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:54 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1475 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:55.865656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:55.870791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:55.875329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:55.890456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:55.892943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:55.906121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:55.915281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:55.924976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-98078d77-0db7-4eea-9cca-de3826bb2fb9 req-b3df7844-aa13-4887-be49-13ad9b0c86f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e481324-3e50-472a-857d-d015400b2260", "tag": "3ab10696-8912-459d-b019-6b94e0f42269"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:56.023694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-98078d77-0db7-4eea-9cca-de3826bb2fb9 req-b3df7844-aa13-4887-be49-13ad9b0c86f9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:56.033374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-98078d77-0db7-4eea-9cca-de3826bb2fb9 req-b3df7844-aa13-4887-be49-13ad9b0c86f9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:56.034514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-98078d77-0db7-4eea-9cca-de3826bb2fb9 req-b3df7844-aa13-4887-be49-13ad9b0c86f9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:56.152254 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-98078d77-0db7-4eea-9cca-de3826bb2fb9 req-b3df7844-aa13-4887-be49-13ad9b0c86f9 service nova] Creating event network-changed:3ab10696-8912-459d-b019-6b94e0f42269 for instance 3e481324-3e50-472a-857d-d015400b2260 on n-h1-852771-8 Aug 25 12:42:56.186386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-98078d77-0db7-4eea-9cca-de3826bb2fb9 req-b3df7844-aa13-4887-be49-13ad9b0c86f9 service nova] Instance 3e481324-3e50-472a-857d-d015400b2260 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:42:56.262311 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-98078d77-0db7-4eea-9cca-de3826bb2fb9 req-b3df7844-aa13-4887-be49-13ad9b0c86f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389785 Aug 25 12:42:56.268897 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 315/626] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:56.301129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6047aae8-5f95-45d1-a9f2-e1821aee104b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:56.308578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6047aae8-5f95-45d1-a9f2-e1821aee104b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:56.350657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6047aae8-5f95-45d1-a9f2-e1821aee104b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:56.356323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6047aae8-5f95-45d1-a9f2-e1821aee104b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:56.358321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6047aae8-5f95-45d1-a9f2-e1821aee104b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:56.363166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6047aae8-5f95-45d1-a9f2-e1821aee104b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:56.371704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6047aae8-5f95-45d1-a9f2-e1821aee104b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:56.383567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6047aae8-5f95-45d1-a9f2-e1821aee104b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:58.142023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:58.175327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:58.183586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:58.191764 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b366d5d-0fa6-4433-b0b2-21fa45466321 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1559 microversion: 2.25 time: 2.436202 Aug 25 12:42:58.193021 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 312/627] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:55 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1559 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:58.232276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e44c96eb-83b3-47ae-8bc3-944ac7d1438c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:58.234393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e44c96eb-83b3-47ae-8bc3-944ac7d1438c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:58.256296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e44c96eb-83b3-47ae-8bc3-944ac7d1438c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:58.257217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e44c96eb-83b3-47ae-8bc3-944ac7d1438c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:58.258130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e44c96eb-83b3-47ae-8bc3-944ac7d1438c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:58.259815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e44c96eb-83b3-47ae-8bc3-944ac7d1438c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:58.271260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e44c96eb-83b3-47ae-8bc3-944ac7d1438c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:58.272178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e44c96eb-83b3-47ae-8bc3-944ac7d1438c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:58.303371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6047aae8-5f95-45d1-a9f2-e1821aee104b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:58.357542 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6047aae8-5f95-45d1-a9f2-e1821aee104b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1314 microversion: 2.1 time: 2.080602 Aug 25 12:42:58.372408 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 316/628] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:56 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1314 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:58.404848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:58.411448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:58.450550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:58.456111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:58.457149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:58.459547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:58.467016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:58.473601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:58.623143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:58.624037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:58.624978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:58.625900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lazy-loading 'fault' on Instance uuid ae972bd4-4dd0-4101-afd1-23fc3ac44d16 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:42:58.917863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026fb8558b1443f3a895bb91a4b603dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d958566e47b4a5aa726773893d68aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:58.974416 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a6d7bab-8454-4bbe-9ba8-b78fbe62140e tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 200 len: 1313 microversion: 2.1 time: 0.598305 Aug 25 12:42:58.981731 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 317/629] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:58 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:59.254459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1333637852", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "94927505-3265-4f82-8562-0d8ecd51bf76"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:59.485151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e44c96eb-83b3-47ae-8bc3-944ac7d1438c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:59.494795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] validate_networks() for [('94927505-3265-4f82-8562-0d8ecd51bf76', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:42:59.524908 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e44c96eb-83b3-47ae-8bc3-944ac7d1438c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1322 microversion: 2.1 time: 1.308885 Aug 25 12:42:59.526638 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 313/630] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:58 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1322 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:59.547409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b6cd312-9933-434e-9713-fb67981dcd31 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:59.554216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b6cd312-9933-434e-9713-fb67981dcd31 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:59.579022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b6cd312-9933-434e-9713-fb67981dcd31 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:59.581665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b6cd312-9933-434e-9713-fb67981dcd31 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:59.584257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b6cd312-9933-434e-9713-fb67981dcd31 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:59.588707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b6cd312-9933-434e-9713-fb67981dcd31 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:59.592083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b6cd312-9933-434e-9713-fb67981dcd31 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:59.597408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b6cd312-9933-434e-9713-fb67981dcd31 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:00.543994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b6cd312-9933-434e-9713-fb67981dcd31 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:00.573480 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b6cd312-9933-434e-9713-fb67981dcd31 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1475 microversion: 2.1 time: 1.042696 Aug 25 12:43:00.578842 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 314/631] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:59 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1475 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:00.592406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-36e0d8cc-1ac0-4233-943c-4922c825f738 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:00.594022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-36e0d8cc-1ac0-4233-943c-4922c825f738 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:00.609592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36e0d8cc-1ac0-4233-943c-4922c825f738 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:00.611715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36e0d8cc-1ac0-4233-943c-4922c825f738 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:00.613179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36e0d8cc-1ac0-4233-943c-4922c825f738 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:00.615018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36e0d8cc-1ac0-4233-943c-4922c825f738 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:00.616342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36e0d8cc-1ac0-4233-943c-4922c825f738 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:00.625865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36e0d8cc-1ac0-4233-943c-4922c825f738 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:00.699972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-36e0d8cc-1ac0-4233-943c-4922c825f738 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:43:00.707828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:00.963347 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-36e0d8cc-1ac0-4233-943c-4922c825f738 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 204 len: 0 microversion: 2.1 time: 0.379684 Aug 25 12:43:00.964807 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 315/632] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:00 2022] DELETE /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:01.014027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2907912b-a7f5-41e2-b2b1-873ceb1a1a0e req-2ebfa6ae-8184-478b-9fc4-068c22b3570c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae972bd4-4dd0-4101-afd1-23fc3ac44d16", "name": "network-vif-unplugged", "status": "completed", "tag": "387ff4ec-dec0-443c-87c7-324cdae33e70"}, {"server_uuid": "61538c72-db7a-4901-b6c2-e695417c9d49", "name": "network-vif-plugged", "status": "completed", "tag": "98a9d4d6-6958-4c41-acfd-dbed7d9ed258"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:01.090239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2907912b-a7f5-41e2-b2b1-873ceb1a1a0e req-2ebfa6ae-8184-478b-9fc4-068c22b3570c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:01.091710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2907912b-a7f5-41e2-b2b1-873ceb1a1a0e req-2ebfa6ae-8184-478b-9fc4-068c22b3570c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:01.093462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2907912b-a7f5-41e2-b2b1-873ceb1a1a0e req-2ebfa6ae-8184-478b-9fc4-068c22b3570c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:01.133450 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2907912b-a7f5-41e2-b2b1-873ceb1a1a0e req-2ebfa6ae-8184-478b-9fc4-068c22b3570c service nova] Creating event network-vif-unplugged:387ff4ec-dec0-443c-87c7-324cdae33e70 for instance ae972bd4-4dd0-4101-afd1-23fc3ac44d16 on n-h2-852771-8 Aug 25 12:43:01.136485 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2907912b-a7f5-41e2-b2b1-873ceb1a1a0e req-2ebfa6ae-8184-478b-9fc4-068c22b3570c service nova] Creating event network-vif-plugged:98a9d4d6-6958-4c41-acfd-dbed7d9ed258 for instance 61538c72-db7a-4901-b6c2-e695417c9d49 on n-h2-852771-8 Aug 25 12:43:01.157688 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2907912b-a7f5-41e2-b2b1-873ceb1a1a0e req-2ebfa6ae-8184-478b-9fc4-068c22b3570c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.189983 Aug 25 12:43:01.159921 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 316/633] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:01.172844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-103f827e-e69a-4fd4-bc51-a07df601a970 req-20151513-5d04-4780-9c5f-b35ca4ef671d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae972bd4-4dd0-4101-afd1-23fc3ac44d16", "name": "network-vif-deleted", "tag": "387ff4ec-dec0-443c-87c7-324cdae33e70"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:01.198830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-103f827e-e69a-4fd4-bc51-a07df601a970 req-20151513-5d04-4780-9c5f-b35ca4ef671d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:01.199831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-103f827e-e69a-4fd4-bc51-a07df601a970 req-20151513-5d04-4780-9c5f-b35ca4ef671d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:01.200742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-103f827e-e69a-4fd4-bc51-a07df601a970 req-20151513-5d04-4780-9c5f-b35ca4ef671d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:01.229351 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-103f827e-e69a-4fd4-bc51-a07df601a970 req-20151513-5d04-4780-9c5f-b35ca4ef671d service nova] Creating event network-vif-deleted:387ff4ec-dec0-443c-87c7-324cdae33e70 for instance ae972bd4-4dd0-4101-afd1-23fc3ac44d16 on n-h2-852771-8 Aug 25 12:43:01.240984 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-103f827e-e69a-4fd4-bc51-a07df601a970 req-20151513-5d04-4780-9c5f-b35ca4ef671d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078197 Aug 25 12:43:01.243452 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 317/634] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:01.262783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-50404489-6a20-41f9-be04-9ed7efaa3f6e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '.version_select at 0x7f3a2a9f0040>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:01.274106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50404489-6a20-41f9-be04-9ed7efaa3f6e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:01.275472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50404489-6a20-41f9-be04-9ed7efaa3f6e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:01.276869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50404489-6a20-41f9-be04-9ed7efaa3f6e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:01.333494 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-50404489-6a20-41f9-be04-9ed7efaa3f6e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 865 microversion: 2.25 time: 0.087821 Aug 25 12:43:01.334904 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 318/635] 10.222.0.70 () {60 vars in 1184 bytes} [Thu Aug 25 12:43:01 2022] GET /compute/v2.1/os-migrations => generated 865 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:43:01.346682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ca92eef3-5b20-4f3a-8739-841355a29460 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:01.347879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca92eef3-5b20-4f3a-8739-841355a29460 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:01.371596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca92eef3-5b20-4f3a-8739-841355a29460 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:01.372334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca92eef3-5b20-4f3a-8739-841355a29460 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:01.373137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca92eef3-5b20-4f3a-8739-841355a29460 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:01.374593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca92eef3-5b20-4f3a-8739-841355a29460 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:01.375445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca92eef3-5b20-4f3a-8739-841355a29460 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:01.380140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca92eef3-5b20-4f3a-8739-841355a29460 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:02.149722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:43:02.151743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:43:02.153111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:43:02.154560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:43:02.155737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:43:02.179173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:02.180459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:02.181607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:02.184012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:02.185572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:02.187112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:02.230483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Getting quotas for project da51872cc1924bb99ee10d4a28cfb2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:02.239583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Getting quotas for user 2db6a11f66554018ba91a5fabb891492 and project da51872cc1924bb99ee10d4a28cfb2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:02.248943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ca92eef3-5b20-4f3a-8739-841355a29460 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:02.272691 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ca92eef3-5b20-4f3a-8739-841355a29460 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1314 microversion: 2.1 time: 0.935936 Aug 25 12:43:02.274308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:43:02.278076 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 319/636] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:01 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1314 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:02.280066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:43:02.308679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:02.311130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] [instance: ae972bd4-4dd0-4101-afd1-23fc3ac44d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:02.336157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:02.337009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:02.339250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:02.340433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:02.342446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:02.343413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:02.388119 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] HTTP exception thrown: Instance ae972bd4-4dd0-4101-afd1-23fc3ac44d16 could not be found. Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Request method failure captured: Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 HTTP/1.1 Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB24i1yvvVH8M7LURVCiXB1dq3e50b-OtSEmCsk4HnVeo6N6eGdSPTRoYlk5Cn1RNul7M7ETuBlf6LG5Ec9nXtfb6xg9OTXIAdxOvnbZhjEKk2mqhgS-eLQ0MtNgwFVwwEhX13zcXemTmo4krkXXMXlj8Lg2TZxZil5cDM1x81F0QaqM Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 8d958566e47b4a5aa726773893d68aa0 Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1996364344 Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:43:02.401074 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d958566e47b4a5aa726773893d68aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8d958566e47b4a5aa726773893d68aa0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8d958566e47b4a5aa726773893d68aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d958566e47b4a5aa726773893d68aa0"}]}] Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1996364344 Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 8d958566e47b4a5aa726773893d68aa0 Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1996364344 Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerDiagnosticsNegativeTest-1996364344-project Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 026fb8558b1443f3a895bb91a4b603dc Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1996364344-project Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ae972bd4-4dd0-4101-afd1-23fc3ac44d16 could not be found. Aug 25 12:43:02.404092 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ae972bd4-4dd0-4101-afd1-23fc3ac44d16'} Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae972bd4-4dd0-4101-afd1-23fc3ac44d16 could not be found. Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:02.405708 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae972bd4-4dd0-4101-afd1-23fc3ac44d16 could not be found. Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae972bd4-4dd0-4101-afd1-23fc3ac44d16 could not be found. Aug 25 12:43:02.408355 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:02.413399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] Returning 404 to user: Instance ae972bd4-4dd0-4101-afd1-23fc3ac44d16 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:02.415243 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c1eccb66-b389-48c7-a9fd-1ce1e794dfa8 tempest-ServerDiagnosticsNegativeTest-1996364344 tempest-ServerDiagnosticsNegativeTest-1996364344-project] 10.222.0.70 "GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16" status: 404 len: 111 microversion: 2.1 time: 0.122915 Aug 25 12:43:02.436063 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-320512b1-d2e0-471f-a6a2-58ccd704a451 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.450415 Aug 25 12:43:02.447853 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 318/637] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:42:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:43:02.448334 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 320/638] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:02 2022] GET /compute/v2.1/servers/ae972bd4-4dd0-4101-afd1-23fc3ac44d16 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:02.461429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59d2aced-1207-49dc-9bc1-78e45f37db82 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:02.462683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59d2aced-1207-49dc-9bc1-78e45f37db82 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:02.465867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b95c2884-4471-47d2-9df1-b5c075966d7c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:02.466631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b95c2884-4471-47d2-9df1-b5c075966d7c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:02.489004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59d2aced-1207-49dc-9bc1-78e45f37db82 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:02.490657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59d2aced-1207-49dc-9bc1-78e45f37db82 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:02.492032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59d2aced-1207-49dc-9bc1-78e45f37db82 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:02.495648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59d2aced-1207-49dc-9bc1-78e45f37db82 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:02.497197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59d2aced-1207-49dc-9bc1-78e45f37db82 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:02.498632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59d2aced-1207-49dc-9bc1-78e45f37db82 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:02.507109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b95c2884-4471-47d2-9df1-b5c075966d7c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:02.507325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b95c2884-4471-47d2-9df1-b5c075966d7c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:02.509129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b95c2884-4471-47d2-9df1-b5c075966d7c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:02.511288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b95c2884-4471-47d2-9df1-b5c075966d7c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:02.512629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b95c2884-4471-47d2-9df1-b5c075966d7c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:02.515949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b95c2884-4471-47d2-9df1-b5c075966d7c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:03.626130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-59d2aced-1207-49dc-9bc1-78e45f37db82 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:03.707295 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59d2aced-1207-49dc-9bc1-78e45f37db82 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1714 microversion: 2.1 time: 1.246383 Aug 25 12:43:03.719261 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 321/639] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:02 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1714 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:03.764962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7644063a-a826-4cca-8beb-da930dfd7217 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:03.769551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7644063a-a826-4cca-8beb-da930dfd7217 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:03.816302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7644063a-a826-4cca-8beb-da930dfd7217 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:03.821364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7644063a-a826-4cca-8beb-da930dfd7217 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:03.823744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7644063a-a826-4cca-8beb-da930dfd7217 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:03.826566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7644063a-a826-4cca-8beb-da930dfd7217 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:03.834253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7644063a-a826-4cca-8beb-da930dfd7217 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:03.840395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7644063a-a826-4cca-8beb-da930dfd7217 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:03.897935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b95c2884-4471-47d2-9df1-b5c075966d7c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:03.964008 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b95c2884-4471-47d2-9df1-b5c075966d7c tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1322 microversion: 2.1 time: 1.516046 Aug 25 12:43:03.973848 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 319/640] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:02 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1322 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:04.024547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-414ed89a-8435-426a-b8cf-566a9c6bb314 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:04.038062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-414ed89a-8435-426a-b8cf-566a9c6bb314 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:04.078776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414ed89a-8435-426a-b8cf-566a9c6bb314 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.085272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414ed89a-8435-426a-b8cf-566a9c6bb314 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.086702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414ed89a-8435-426a-b8cf-566a9c6bb314 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:04.088551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414ed89a-8435-426a-b8cf-566a9c6bb314 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.089412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414ed89a-8435-426a-b8cf-566a9c6bb314 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.090302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414ed89a-8435-426a-b8cf-566a9c6bb314 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:04.504981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-7644063a-a826-4cca-8beb-da930dfd7217 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid 0176f06a-ee98-45ab-b392-b9b46a8e82cd {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:04.574688 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7644063a-a826-4cca-8beb-da930dfd7217 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 2052 microversion: 2.25 time: 0.845133 Aug 25 12:43:04.575816 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 322/641] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:03 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 2052 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:04.642090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b68d5b1-4e6b-465b-aedb-a733383a9c05 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:04.648738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b68d5b1-4e6b-465b-aedb-a733383a9c05 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:04.703568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b68d5b1-4e6b-465b-aedb-a733383a9c05 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.705087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b68d5b1-4e6b-465b-aedb-a733383a9c05 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.716104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b68d5b1-4e6b-465b-aedb-a733383a9c05 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:04.719534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b68d5b1-4e6b-465b-aedb-a733383a9c05 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.727034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b68d5b1-4e6b-465b-aedb-a733383a9c05 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.730746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b68d5b1-4e6b-465b-aedb-a733383a9c05 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:05.236499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b68d5b1-4e6b-465b-aedb-a733383a9c05 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:05.266927 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b68d5b1-4e6b-465b-aedb-a733383a9c05 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1212 microversion: 2.1 time: 0.656439 Aug 25 12:43:05.275368 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 323/642] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:04 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1212 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:05.284769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b968808f-b6c1-49fe-800e-d5c765cd2c19 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:05.299268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b968808f-b6c1-49fe-800e-d5c765cd2c19 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:05.329051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b968808f-b6c1-49fe-800e-d5c765cd2c19 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:05.330827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b968808f-b6c1-49fe-800e-d5c765cd2c19 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:05.338071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b968808f-b6c1-49fe-800e-d5c765cd2c19 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:05.339788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b968808f-b6c1-49fe-800e-d5c765cd2c19 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:05.342565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b968808f-b6c1-49fe-800e-d5c765cd2c19 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:05.343486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b968808f-b6c1-49fe-800e-d5c765cd2c19 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:05.883626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-414ed89a-8435-426a-b8cf-566a9c6bb314 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:05.917435 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-414ed89a-8435-426a-b8cf-566a9c6bb314 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1470 microversion: 2.1 time: 1.939287 Aug 25 12:43:05.918422 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 320/643] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:03 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1470 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:05.943759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8e03a286-1011-4bef-8639-206b2acdd889 req-c3c75377-66d1-40e2-8a4d-e0d3e49d3c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df", "tag": "771cb51b-76f0-4d20-9727-718bae6c921a"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:05.979800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8e03a286-1011-4bef-8639-206b2acdd889 req-c3c75377-66d1-40e2-8a4d-e0d3e49d3c0d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:05.991180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8e03a286-1011-4bef-8639-206b2acdd889 req-c3c75377-66d1-40e2-8a4d-e0d3e49d3c0d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:05.992334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8e03a286-1011-4bef-8639-206b2acdd889 req-c3c75377-66d1-40e2-8a4d-e0d3e49d3c0d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:06.038364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:06.053373 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8e03a286-1011-4bef-8639-206b2acdd889 req-c3c75377-66d1-40e2-8a4d-e0d3e49d3c0d service nova] Creating event network-changed:771cb51b-76f0-4d20-9727-718bae6c921a for instance 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df on n-h1-852771-8 Aug 25 12:43:06.080941 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8e03a286-1011-4bef-8639-206b2acdd889 req-c3c75377-66d1-40e2-8a4d-e0d3e49d3c0d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147141 Aug 25 12:43:06.083903 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 321/644] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:06.094062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f3089e9-ae9a-4589-940b-84aa78eb6a70 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:06.096894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f3089e9-ae9a-4589-940b-84aa78eb6a70 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:06.112231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f3089e9-ae9a-4589-940b-84aa78eb6a70 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:06.113454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f3089e9-ae9a-4589-940b-84aa78eb6a70 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:06.114610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f3089e9-ae9a-4589-940b-84aa78eb6a70 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:06.116272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f3089e9-ae9a-4589-940b-84aa78eb6a70 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:06.117428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f3089e9-ae9a-4589-940b-84aa78eb6a70 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:06.118596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f3089e9-ae9a-4589-940b-84aa78eb6a70 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:07.033766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b968808f-b6c1-49fe-800e-d5c765cd2c19 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:07.061809 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b968808f-b6c1-49fe-800e-d5c765cd2c19 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1464 microversion: 2.1 time: 1.784061 Aug 25 12:43:07.064821 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 324/645] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:05 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1464 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:07.080635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-977727838", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a8823b91-974d-48ac-9e76-e7cbde8ff3bd"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:07.124092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:07.246220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] validate_networks() for [('a8823b91-974d-48ac-9e76-e7cbde8ff3bd', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:43:07.623012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f3089e9-ae9a-4589-940b-84aa78eb6a70 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:07.668528 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f3089e9-ae9a-4589-940b-84aa78eb6a70 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1714 microversion: 2.1 time: 1.582323 Aug 25 12:43:07.673406 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 322/646] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:06 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1714 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:07.713305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c27b8f58-3e90-41c7-bdc3-54b42b38ddc7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:07.714716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c27b8f58-3e90-41c7-bdc3-54b42b38ddc7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:07.732960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c27b8f58-3e90-41c7-bdc3-54b42b38ddc7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:07.737664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c27b8f58-3e90-41c7-bdc3-54b42b38ddc7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:07.738841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c27b8f58-3e90-41c7-bdc3-54b42b38ddc7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:07.743729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c27b8f58-3e90-41c7-bdc3-54b42b38ddc7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:07.745415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c27b8f58-3e90-41c7-bdc3-54b42b38ddc7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:07.746880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c27b8f58-3e90-41c7-bdc3-54b42b38ddc7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:08.846567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c27b8f58-3e90-41c7-bdc3-54b42b38ddc7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:08.866099 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c27b8f58-3e90-41c7-bdc3-54b42b38ddc7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1322 microversion: 2.1 time: 1.189983 Aug 25 12:43:08.879319 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 323/647] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:07 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1322 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:08.895926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-32decc45-2bef-4b7d-9e58-9f64846a0933 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:08.900817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-32decc45-2bef-4b7d-9e58-9f64846a0933 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:08.920362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32decc45-2bef-4b7d-9e58-9f64846a0933 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:08.921424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32decc45-2bef-4b7d-9e58-9f64846a0933 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:08.923499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32decc45-2bef-4b7d-9e58-9f64846a0933 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:08.926622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32decc45-2bef-4b7d-9e58-9f64846a0933 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:08.928013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32decc45-2bef-4b7d-9e58-9f64846a0933 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:08.929573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32decc45-2bef-4b7d-9e58-9f64846a0933 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:09.134860 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-32decc45-2bef-4b7d-9e58-9f64846a0933 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260/action" status: 204 len: 0 microversion: 2.1 time: 0.262377 Aug 25 12:43:09.136410 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 324/648] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:43:08 2022] POST /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260/action => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:09.176184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6023b7c-5e9e-4615-ac7c-e70ec6fb0d88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:09.177046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c6023b7c-5e9e-4615-ac7c-e70ec6fb0d88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:09.208685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6023b7c-5e9e-4615-ac7c-e70ec6fb0d88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:09.212715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6023b7c-5e9e-4615-ac7c-e70ec6fb0d88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:09.214070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6023b7c-5e9e-4615-ac7c-e70ec6fb0d88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:09.216145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6023b7c-5e9e-4615-ac7c-e70ec6fb0d88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:09.217406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6023b7c-5e9e-4615-ac7c-e70ec6fb0d88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:09.218512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6023b7c-5e9e-4615-ac7c-e70ec6fb0d88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:10.111634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:43:10.112714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:43:10.113300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:43:10.114378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:43:10.115431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:43:10.141875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c6023b7c-5e9e-4615-ac7c-e70ec6fb0d88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:10.147247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:10.148172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:10.149200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:10.151069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:10.152069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:10.153242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:10.180032 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6023b7c-5e9e-4615-ac7c-e70ec6fb0d88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1308 microversion: 2.1 time: 1.028339 Aug 25 12:43:10.192786 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 325/649] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:09 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1308 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:10.194625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Getting quotas for project c899e2a1474d4eb28b598f50e93312f8. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:10.214874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Getting quotas for user b46ef01072a84a81b862baf3ea2387dd and project c899e2a1474d4eb28b598f50e93312f8. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:10.225880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-afe8a4bd-69c3-4399-b4bb-479d7cfd00d8 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:10.242100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-afe8a4bd-69c3-4399-b4bb-479d7cfd00d8 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:10.281149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afe8a4bd-69c3-4399-b4bb-479d7cfd00d8 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:10.285243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afe8a4bd-69c3-4399-b4bb-479d7cfd00d8 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:10.287688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afe8a4bd-69c3-4399-b4bb-479d7cfd00d8 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:10.301777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afe8a4bd-69c3-4399-b4bb-479d7cfd00d8 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:10.307809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afe8a4bd-69c3-4399-b4bb-479d7cfd00d8 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:10.310099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afe8a4bd-69c3-4399-b4bb-479d7cfd00d8 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:10.319871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:43:10.343547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:43:10.623622 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2abaebbb-272a-49ec-8903-0e6c8a19b456 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.552357 Aug 25 12:43:10.624883 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 325/650] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 12:43:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3559 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:43:10.648401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-fe443bed-c87f-458f-aea9-700c49088178 req-f86ff8b7-6a8a-48fd-a01f-d40c15cbb186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e481324-3e50-472a-857d-d015400b2260", "name": "network-vif-plugged", "status": "completed", "tag": "3ab10696-8912-459d-b019-6b94e0f42269"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:10.706626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fe443bed-c87f-458f-aea9-700c49088178 req-f86ff8b7-6a8a-48fd-a01f-d40c15cbb186 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:10.707879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fe443bed-c87f-458f-aea9-700c49088178 req-f86ff8b7-6a8a-48fd-a01f-d40c15cbb186 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:10.708983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fe443bed-c87f-458f-aea9-700c49088178 req-f86ff8b7-6a8a-48fd-a01f-d40c15cbb186 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:10.769165 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-fe443bed-c87f-458f-aea9-700c49088178 req-f86ff8b7-6a8a-48fd-a01f-d40c15cbb186 service nova] Creating event network-vif-plugged:3ab10696-8912-459d-b019-6b94e0f42269 for instance 3e481324-3e50-472a-857d-d015400b2260 on n-h1-852771-8 Aug 25 12:43:10.796480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-fe443bed-c87f-458f-aea9-700c49088178 req-f86ff8b7-6a8a-48fd-a01f-d40c15cbb186 service nova] Instance 3e481324-3e50-472a-857d-d015400b2260 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:43:10.844351 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-fe443bed-c87f-458f-aea9-700c49088178 req-f86ff8b7-6a8a-48fd-a01f-d40c15cbb186 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202517 Aug 25 12:43:10.848442 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 326/651] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:10.865270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:10.868850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:10.917710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:10.921205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:10.925015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:10.926975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:10.928226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:10.929313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:11.058285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-afe8a4bd-69c3-4399-b4bb-479d7cfd00d8 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:11.089363 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-afe8a4bd-69c3-4399-b4bb-479d7cfd00d8 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1463 microversion: 2.1 time: 0.890086 Aug 25 12:43:11.094621 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 326/652] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:10 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1463 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:11.118417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:11.119362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a47503c3-889c-4e82-9d33-19cb5ecab333 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:11.121921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:11.123202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:11.126790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lazy-loading 'fault' on Instance uuid 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:11.127139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a47503c3-889c-4e82-9d33-19cb5ecab333 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:11.163897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a47503c3-889c-4e82-9d33-19cb5ecab333 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:11.166073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a47503c3-889c-4e82-9d33-19cb5ecab333 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:11.167143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a47503c3-889c-4e82-9d33-19cb5ecab333 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:11.168848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a47503c3-889c-4e82-9d33-19cb5ecab333 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:11.169972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a47503c3-889c-4e82-9d33-19cb5ecab333 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:11.171180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a47503c3-889c-4e82-9d33-19cb5ecab333 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:11.412293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d03828d2744c7a386caf96df69865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e943f7025e4663a3f3e10ea5857a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:11.449442 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c62b0a6a-55e2-4a40-a6a4-c0afa09a4e62 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 200 len: 1354 microversion: 2.1 time: 0.598420 Aug 25 12:43:11.479247 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 327/653] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:10 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 1354 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:11.864314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a47503c3-889c-4e82-9d33-19cb5ecab333 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:11.887111 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a47503c3-889c-4e82-9d33-19cb5ecab333 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1470 microversion: 2.1 time: 0.789752 Aug 25 12:43:11.890766 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 327/654] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:11 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1470 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:11.903764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-930bdc8c-c429-49d9-9452-ef1f97c6ed8d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:11.907933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-930bdc8c-c429-49d9-9452-ef1f97c6ed8d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:11.924312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-930bdc8c-c429-49d9-9452-ef1f97c6ed8d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:11.925785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-930bdc8c-c429-49d9-9452-ef1f97c6ed8d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:11.927336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-930bdc8c-c429-49d9-9452-ef1f97c6ed8d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:11.929152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-930bdc8c-c429-49d9-9452-ef1f97c6ed8d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:11.931709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-930bdc8c-c429-49d9-9452-ef1f97c6ed8d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:11.932830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-930bdc8c-c429-49d9-9452-ef1f97c6ed8d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:12.209211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:12.253767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:12.420804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f2b892fa-f9cc-435e-8434-aad5262eedd3 tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] Calling method '.version_select at 0x7f3a2aa259d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:12.604082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-930bdc8c-c429-49d9-9452-ef1f97c6ed8d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:12.632416 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-930bdc8c-c429-49d9-9452-ef1f97c6ed8d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1322 microversion: 2.1 time: 0.737740 Aug 25 12:43:12.633915 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 328/655] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:11 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1322 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:12.669028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ae841ef0-e1d4-4bca-a501-272bf9adb341 req-56f2dd61-7e07-4afe-b5e8-5dadb5d59543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb9e5d2-e61f-42fd-8f76-e550cac1dc45", "name": "network-vif-deleted", "tag": "02429e48-79b9-400c-bb52-5d4e7617d606"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:12.720680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ae841ef0-e1d4-4bca-a501-272bf9adb341 req-56f2dd61-7e07-4afe-b5e8-5dadb5d59543 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:12.726763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ae841ef0-e1d4-4bca-a501-272bf9adb341 req-56f2dd61-7e07-4afe-b5e8-5dadb5d59543 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:12.741090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ae841ef0-e1d4-4bca-a501-272bf9adb341 req-56f2dd61-7e07-4afe-b5e8-5dadb5d59543 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:12.812231 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ae841ef0-e1d4-4bca-a501-272bf9adb341 req-56f2dd61-7e07-4afe-b5e8-5dadb5d59543 service nova] Creating event network-vif-deleted:02429e48-79b9-400c-bb52-5d4e7617d606 for instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 on n-h1-852771-8 Aug 25 12:43:12.832766 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f2b892fa-f9cc-435e-8434-aad5262eedd3 tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.344068 Aug 25 12:43:12.835867 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ae841ef0-e1d4-4bca-a501-272bf9adb341 req-56f2dd61-7e07-4afe-b5e8-5dadb5d59543 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199318 Aug 25 12:43:12.837605 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 329/656] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:12.852508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:12.863954 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 328/657] 10.222.0.70 () {58 vars in 1149 bytes} [Thu Aug 25 12:43:11 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:12.868294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:12.887810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d71d5d0b-9426-4052-aa59-8043b235bd6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:12.890737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d71d5d0b-9426-4052-aa59-8043b235bd6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:12.908348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d71d5d0b-9426-4052-aa59-8043b235bd6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:12.909262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d71d5d0b-9426-4052-aa59-8043b235bd6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:12.910556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d71d5d0b-9426-4052-aa59-8043b235bd6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:12.911581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d71d5d0b-9426-4052-aa59-8043b235bd6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:12.912085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:12.912461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d71d5d0b-9426-4052-aa59-8043b235bd6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:12.912833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:12.913799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:12.915422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d71d5d0b-9426-4052-aa59-8043b235bd6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:12.923266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:12.924044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:12.924917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:13.583082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:13.690317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:13.703421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:13.709147 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eb864ac4-9cde-4fda-96f6-091d32d57237 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1265 microversion: 2.25 time: 0.867897 Aug 25 12:43:13.716267 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 330/658] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:12 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1265 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:13.753293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d71d5d0b-9426-4052-aa59-8043b235bd6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:13.761225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1881891275", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c42add69-b14a-4dd1-a7ce-8c6c162b4e1a"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:13.818838 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d71d5d0b-9426-4052-aa59-8043b235bd6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1308 microversion: 2.1 time: 0.951328 Aug 25 12:43:13.826159 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 329/659] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:12 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1308 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:13.850679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:13.852550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:13.883746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:13.885698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:13.889383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:13.890747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:13.893264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:13.894338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:14.003980 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] HTTP exception thrown: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Request method failure captured: Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 HTTP/1.1 Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21IHkxn2iZHpsWmqHgn-q2raqHSEdacPNJDhQDTY8BUe5mJYgJ2DTIWAh94OAtjZdAWlseBLzv-N_6-sZc7UcKLCT-XwwzxOOHKRbNEE2wqoYNixMFXGwApahFzh9VlnU42TshD1-myOGqefLLJwHbdLzFf-hC3qJ8w64tIvkSL7dM Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:43:14.042267 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_88e943f7025e4663a3f3e10ea5857a08", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}] Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 708d03828d2744c7a386caf96df69865 Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:14.045186 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '2bb9e5d2-e61f-42fd-8f76-e550cac1dc45'} Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:14.046776 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:14.051261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:14.062925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Returning 404 to user: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:14.067458 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df5eb2ee-b347-4fb2-9291-9d72f48c829c tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 404 len: 111 microversion: 2.1 time: 0.238699 Aug 25 12:43:14.069294 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 330/660] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:13 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:14.083623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3a4f1987-2c88-4893-8563-817655573978 tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] Action: 'create', calling method: .version_select at 0x7f3a2a997700>, body: {"pool": "non_exist_pool"} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:14.129284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:43:14.296641 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-3a4f1987-2c88-4893-8563-817655573978 tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] HTTP exception thrown: Floating IP pool not found. Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3a4f1987-2c88-4893-8563-817655573978 tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] Request method failure captured: Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 26 Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB25daB5jkiwSWsDlPDxxKlwep7fFkX_Bzbin4qbSEP194mFn5vgiUfjdndip8iIDwkC_vjd8xYAsZxp6u3qlOAtnvhRBcXNMpL-jEVHaKrbkNu9u3f3MVACT4LPWEoWBFgV93k4Xt5AUf_dzgNux5d_8ba3MJv46Wbgtxrs9hn9Gigo Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 62fa98307b264a7db4e8ed79ff1eaaea Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-454386704 Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:43:14.303075 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/62fa98307b264a7db4e8ed79ff1eaaea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_62fa98307b264a7db4e8ed79ff1eaaea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/62fa98307b264a7db4e8ed79ff1eaaea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/62fa98307b264a7db4e8ed79ff1eaaea"}]}] Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-454386704 Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 62fa98307b264a7db4e8ed79ff1eaaea Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-454386704 Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPsNegativeTestJSON-454386704-project Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bed0b8b8edbe48aba099b4cb4d38e0f6 Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-454386704-project Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: {"pool": "non_exist_pool"} Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: exception: Floating IP pool not found. Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 25 12:43:14.306045 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:14.308267 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3a4f1987-2c88-4893-8563-817655573978 tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] Returning 404 to user: Floating IP pool not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:14.310118 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3a4f1987-2c88-4893-8563-817655573978 tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.234631 Aug 25 12:43:14.321271 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 331/661] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 12:43:14 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:43:14.374644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-85147321-3629-4187-a534-9df0b98b30cf tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:14.383629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-85147321-3629-4187-a534-9df0b98b30cf tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:14.431902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85147321-3629-4187-a534-9df0b98b30cf tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:14.432835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85147321-3629-4187-a534-9df0b98b30cf tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:14.435786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85147321-3629-4187-a534-9df0b98b30cf tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:14.447193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85147321-3629-4187-a534-9df0b98b30cf tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:14.448580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85147321-3629-4187-a534-9df0b98b30cf tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:14.453577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85147321-3629-4187-a534-9df0b98b30cf tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:15.171084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-85147321-3629-4187-a534-9df0b98b30cf tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:15.205318 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-85147321-3629-4187-a534-9df0b98b30cf tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1470 microversion: 2.1 time: 0.875758 Aug 25 12:43:15.227472 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 332/662] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:14 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1470 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:15.252184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e61205e8-afef-45c3-9f99-72e918fe5d2f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:15.257889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e61205e8-afef-45c3-9f99-72e918fe5d2f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:15.287479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e61205e8-afef-45c3-9f99-72e918fe5d2f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:15.288828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e61205e8-afef-45c3-9f99-72e918fe5d2f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:15.290005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e61205e8-afef-45c3-9f99-72e918fe5d2f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:15.291892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e61205e8-afef-45c3-9f99-72e918fe5d2f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:15.293716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e61205e8-afef-45c3-9f99-72e918fe5d2f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:15.294853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e61205e8-afef-45c3-9f99-72e918fe5d2f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:15.484845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:43:15.485843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:43:15.486684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:43:15.487467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:43:15.488682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:43:15.549256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:15.556825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:15.568908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:15.585991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:15.587291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:15.590645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:15.729952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Getting quotas for project e2700209d0c94f789c1b01cf7b38c6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:15.743214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Getting quotas for user 150efb14f73347c7aa81255bba9f12ca and project e2700209d0c94f789c1b01cf7b38c6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:15.792724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:43:15.811130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:43:15.954957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e61205e8-afef-45c3-9f99-72e918fe5d2f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:15.979187 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e61205e8-afef-45c3-9f99-72e918fe5d2f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1322 microversion: 2.1 time: 0.748994 Aug 25 12:43:16.014130 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7f7b6be8-1986-4d8d-820c-fda89a25eaf5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.294987 Aug 25 12:43:16.016152 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 331/663] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:43:16.029475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:16.031310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:16.033299 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 333/664] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:15 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1322 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:16.042690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14ad0589-55b3-4acd-bac1-e98e5a5bff3b tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] Calling method '.version_select at 0x7f3a2ab7fdc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:16.049636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:16.050720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:16.052126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:16.053736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:16.055062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:16.055935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:16.089007 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] HTTP exception thrown: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Request method failure captured: Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 HTTP/1.1 Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21IHkxn2iZHpsWmqHgn-q2raqHSEdacPNJDhQDTY8BUe5mJYgJ2DTIWAh94OAtjZdAWlseBLzv-N_6-sZc7UcKLCT-XwwzxOOHKRbNEE2wqoYNixMFXGwApahFzh9VlnU42TshD1-myOGqefLLJwHbdLzFf-hC3qJ8w64tIvkSL7dM Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:43:16.093294 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_88e943f7025e4663a3f3e10ea5857a08", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}] Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 708d03828d2744c7a386caf96df69865 Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:16.097167 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1'} Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:16.098801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:16.104517 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.118102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Returning 404 to user: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:16.124748 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f432d228-a454-4c78-ab38-640acecd29b2 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 404 len: 111 microversion: 2.1 time: 0.104652 Aug 25 12:43:16.134392 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 332/665] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:16 2022] DELETE /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:16.146898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:16.149195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:16.164592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:16.166159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:16.167732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:16.170247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:16.171569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:16.173252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:16.196544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-14ad0589-55b3-4acd-bac1-e98e5a5bff3b tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834 could not be found", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:43:16.197830 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-14ad0589-55b3-4acd-bac1-e98e5a5bff3b tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] HTTP exception thrown: Floating IP not found for ID 69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834 Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14ad0589-55b3-4acd-bac1-e98e5a5bff3b tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] Request method failure captured: Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-floating-ips/69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834 HTTP/1.1 Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB25daB5jkiwSWsDlPDxxKlwep7fFkX_Bzbin4qbSEP194mFn5vgiUfjdndip8iIDwkC_vjd8xYAsZxp6u3qlOAtnvhRBcXNMpL-jEVHaKrbkNu9u3f3MVACT4LPWEoWBFgV93k4Xt5AUf_dzgNux5d_8ba3MJv46Wbgtxrs9hn9Gigo Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 62fa98307b264a7db4e8ed79ff1eaaea Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-454386704 Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:43:16.201624 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/62fa98307b264a7db4e8ed79ff1eaaea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_62fa98307b264a7db4e8ed79ff1eaaea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/62fa98307b264a7db4e8ed79ff1eaaea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/62fa98307b264a7db4e8ed79ff1eaaea"}]}] Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-454386704 Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 62fa98307b264a7db4e8ed79ff1eaaea Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-454386704 Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPsNegativeTestJSON-454386704-project Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bed0b8b8edbe48aba099b4cb4d38e0f6 Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-454386704-project Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: exception: Floating IP not found for ID 69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834 Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834'} Aug 25 12:43:16.204188 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:43:16.206983 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834 could not be found Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de5eb6ab-d59c-4733-8c8e-6816b0b3b656'] Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834. Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:16.212237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834 Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:16.218375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:16.227562 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834 Aug 25 12:43:16.227562 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.227562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14ad0589-55b3-4acd-bac1-e98e5a5bff3b tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] Returning 404 to user: Floating IP not found for ID 69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834 {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:16.227562 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-14ad0589-55b3-4acd-bac1-e98e5a5bff3b tempest-FloatingIPsNegativeTestJSON-454386704 tempest-FloatingIPsNegativeTestJSON-454386704-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834" status: 404 len: 111 microversion: 2.1 time: 0.169147 Aug 25 12:43:16.227562 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 334/666] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 12:43:16 2022] DELETE /compute/v2.1/os-floating-ips/69d3b7ab-0ef7-4a56-8f8a-2de8e9e1b834 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:16.229638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ae551a0-80f7-4d16-a37f-f6b510604dd1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:16.247104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5ae551a0-80f7-4d16-a37f-f6b510604dd1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:16.291640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ae551a0-80f7-4d16-a37f-f6b510604dd1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:16.299384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ae551a0-80f7-4d16-a37f-f6b510604dd1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:16.317682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ae551a0-80f7-4d16-a37f-f6b510604dd1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:16.319968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ae551a0-80f7-4d16-a37f-f6b510604dd1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:16.321463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ae551a0-80f7-4d16-a37f-f6b510604dd1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:16.322950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ae551a0-80f7-4d16-a37f-f6b510604dd1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:16.658366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:16.711309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:16.733911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:16.746570 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-93871d97-8d89-4016-9bfe-d8a6fd854434 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1319 microversion: 2.25 time: 0.599835 Aug 25 12:43:16.748086 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 333/667] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:16 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:16.758322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ed936f6d-aa2d-4076-9e31-090a6d9e0e0c req-a5d359f5-e81f-44c8-8ab6-30a93fe8ea32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e66bf9-46f4-4037-8c41-400415f86c72", "tag": "82892c88-98b1-47a2-94ef-50fbcccb4ce1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:16.808479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ed936f6d-aa2d-4076-9e31-090a6d9e0e0c req-a5d359f5-e81f-44c8-8ab6-30a93fe8ea32 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:16.814103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ed936f6d-aa2d-4076-9e31-090a6d9e0e0c req-a5d359f5-e81f-44c8-8ab6-30a93fe8ea32 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:16.817496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ed936f6d-aa2d-4076-9e31-090a6d9e0e0c req-a5d359f5-e81f-44c8-8ab6-30a93fe8ea32 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:16.890552 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ed936f6d-aa2d-4076-9e31-090a6d9e0e0c req-a5d359f5-e81f-44c8-8ab6-30a93fe8ea32 service nova] Creating event network-changed:82892c88-98b1-47a2-94ef-50fbcccb4ce1 for instance 40e66bf9-46f4-4037-8c41-400415f86c72 on n-h2-852771-8 Aug 25 12:43:16.913882 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ed936f6d-aa2d-4076-9e31-090a6d9e0e0c req-a5d359f5-e81f-44c8-8ab6-30a93fe8ea32 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163316 Aug 25 12:43:16.918967 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 334/668] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:16.942738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6ad815f-98da-4a6b-8b3e-90bb0da2339f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:16.944187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d6ad815f-98da-4a6b-8b3e-90bb0da2339f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:17.245838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d6ad815f-98da-4a6b-8b3e-90bb0da2339f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:17.264802 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d6ad815f-98da-4a6b-8b3e-90bb0da2339f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1214 microversion: 2.1 time: 0.343427 Aug 25 12:43:17.276460 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 335/669] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:16 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:17.283186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:17.295103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:17.319601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:17.320595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:17.322110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:17.326779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:17.328022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:17.333123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:17.388775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] HTTP exception thrown: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Request method failure captured: Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 HTTP/1.1 Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21IHkxn2iZHpsWmqHgn-q2raqHSEdacPNJDhQDTY8BUe5mJYgJ2DTIWAh94OAtjZdAWlseBLzv-N_6-sZc7UcKLCT-XwwzxOOHKRbNEE2wqoYNixMFXGwApahFzh9VlnU42TshD1-myOGqefLLJwHbdLzFf-hC3qJ8w64tIvkSL7dM Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:43:17.404258 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_88e943f7025e4663a3f3e10ea5857a08", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}] Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 708d03828d2744c7a386caf96df69865 Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:17.406893 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1'} Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:17.408698 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:17.411949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:17.418334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Returning 404 to user: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:17.419402 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fe01359d-0b90-4a04-af8f-2e7e2108e46a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 404 len: 111 microversion: 2.1 time: 0.139219 Aug 25 12:43:17.426431 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 336/670] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:17 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:17.437344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e949a2f-b69e-4ab0-81a7-e64788a3bcfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:17.439789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5e949a2f-b69e-4ab0-81a7-e64788a3bcfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:17.452083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e949a2f-b69e-4ab0-81a7-e64788a3bcfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:17.455537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e949a2f-b69e-4ab0-81a7-e64788a3bcfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:17.457199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e949a2f-b69e-4ab0-81a7-e64788a3bcfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:17.459385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e949a2f-b69e-4ab0-81a7-e64788a3bcfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:17.460608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e949a2f-b69e-4ab0-81a7-e64788a3bcfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:17.461775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e949a2f-b69e-4ab0-81a7-e64788a3bcfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:17.499680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5ae551a0-80f7-4d16-a37f-f6b510604dd1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:17.525999 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ae551a0-80f7-4d16-a37f-f6b510604dd1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1308 microversion: 2.1 time: 1.317299 Aug 25 12:43:17.528499 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 335/671] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:16 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1308 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:17.552782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9573085b-69c3-4ae7-9b10-363041053e26 req-81bb4941-5729-415f-aeb4-fc87a62d7cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df", "name": "network-vif-plugged", "status": "completed", "tag": "771cb51b-76f0-4d20-9727-718bae6c921a"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:17.586081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9573085b-69c3-4ae7-9b10-363041053e26 req-81bb4941-5729-415f-aeb4-fc87a62d7cec service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:17.587079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9573085b-69c3-4ae7-9b10-363041053e26 req-81bb4941-5729-415f-aeb4-fc87a62d7cec service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:17.587889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9573085b-69c3-4ae7-9b10-363041053e26 req-81bb4941-5729-415f-aeb4-fc87a62d7cec service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:17.619617 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9573085b-69c3-4ae7-9b10-363041053e26 req-81bb4941-5729-415f-aeb4-fc87a62d7cec service nova] Creating event network-vif-plugged:771cb51b-76f0-4d20-9727-718bae6c921a for instance 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df on n-h1-852771-8 Aug 25 12:43:17.635308 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9573085b-69c3-4ae7-9b10-363041053e26 req-81bb4941-5729-415f-aeb4-fc87a62d7cec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099544 Aug 25 12:43:17.640557 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 336/672] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:18.096122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2134607415", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": "none"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:18.300481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:43:18.301283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:43:18.302091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:43:18.302956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:43:18.303880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:43:18.327828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:18.329861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:18.331269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:18.332811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:18.334485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:18.335974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:18.417675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Getting quotas for project bd319f78a4944076a4d9df0f894f1764. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:18.435895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Getting quotas for user f22b3eeabc634b3e8855f855f5b310f9 and project bd319f78a4944076a4d9df0f894f1764. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:18.524783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:43:18.540762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5e949a2f-b69e-4ab0-81a7-e64788a3bcfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:18.549833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:43:18.592412 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5e949a2f-b69e-4ab0-81a7-e64788a3bcfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1470 microversion: 2.1 time: 1.162693 Aug 25 12:43:18.602611 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 337/673] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:17 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1470 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:18.624420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e08ce8f-a7b5-442a-9273-fc348e468a2d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:18.625964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3e08ce8f-a7b5-442a-9273-fc348e468a2d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:18.656509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e08ce8f-a7b5-442a-9273-fc348e468a2d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:18.661175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e08ce8f-a7b5-442a-9273-fc348e468a2d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:18.662462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e08ce8f-a7b5-442a-9273-fc348e468a2d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:18.671553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e08ce8f-a7b5-442a-9273-fc348e468a2d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:18.674297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e08ce8f-a7b5-442a-9273-fc348e468a2d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:18.676382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e08ce8f-a7b5-442a-9273-fc348e468a2d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:18.802134 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ffbba147-1e8d-479f-96d3-9fa9e89809be tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.153011 Aug 25 12:43:18.806315 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 337/674] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 12:43:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:43:18.824897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2e9fc75e-7c3d-475d-9d86-45ea1e87492a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '.version_select at 0x7f3a2aa25d30>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:18.919930 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2e9fc75e-7c3d-475d-9d86-45ea1e87492a tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989566953" status: 202 len: 0 microversion: 2.1 time: 0.103973 Aug 25 12:43:18.925596 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 338/675] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 12:43:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989566953 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:43:18.943982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:18.964277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:19.031166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:19.036360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:19.037434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:19.039094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:19.042311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:19.047638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:20.311840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3e08ce8f-a7b5-442a-9273-fc348e468a2d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:20.328213 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3e08ce8f-a7b5-442a-9273-fc348e468a2d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1322 microversion: 2.1 time: 1.723033 Aug 25 12:43:20.345827 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 338/676] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:18 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1322 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:20.367238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2e93ae66-9417-448b-ba2b-e5e6c303367e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:20.368937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2e93ae66-9417-448b-ba2b-e5e6c303367e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:20.382994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e93ae66-9417-448b-ba2b-e5e6c303367e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:20.383940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e93ae66-9417-448b-ba2b-e5e6c303367e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:20.384766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e93ae66-9417-448b-ba2b-e5e6c303367e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:20.386083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e93ae66-9417-448b-ba2b-e5e6c303367e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:20.387390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e93ae66-9417-448b-ba2b-e5e6c303367e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:20.388290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e93ae66-9417-448b-ba2b-e5e6c303367e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:20.593499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2e93ae66-9417-448b-ba2b-e5e6c303367e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:20.624431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:20.630744 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2e93ae66-9417-448b-ba2b-e5e6c303367e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1274 microversion: 2.1 time: 0.282024 Aug 25 12:43:20.631520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:20.632312 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 339/677] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:20 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1274 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:20.670229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:20.674310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-65599353-1bec-44bd-b943-5e1498d22b1d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:20.676002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-65599353-1bec-44bd-b943-5e1498d22b1d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:20.677622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:20.685853 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-95debed0-97b8-4714-a308-2bd24c4e775f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1361 microversion: 2.25 time: 1.756937 Aug 25 12:43:20.691770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65599353-1bec-44bd-b943-5e1498d22b1d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:20.692094 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 339/678] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:18 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1361 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:20.693191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65599353-1bec-44bd-b943-5e1498d22b1d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:20.694256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65599353-1bec-44bd-b943-5e1498d22b1d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:20.695752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65599353-1bec-44bd-b943-5e1498d22b1d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:20.696811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65599353-1bec-44bd-b943-5e1498d22b1d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:20.697877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65599353-1bec-44bd-b943-5e1498d22b1d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:20.703592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:20.709536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:20.731992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:20.732940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:20.733971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:20.735599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:20.736592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:20.737533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:21.160327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:21.181465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-65599353-1bec-44bd-b943-5e1498d22b1d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:21.190703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:21.193837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:21.209399 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-65599353-1bec-44bd-b943-5e1498d22b1d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1308 microversion: 2.1 time: 0.574158 Aug 25 12:43:21.210532 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 340/679] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:20 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1308 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:21.212329 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5c029650-95db-4578-96b0-7bef8d7c465e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "PUT /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1363 microversion: 2.75 time: 0.518144 Aug 25 12:43:21.214516 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 340/680] 10.222.0.70 () {62 vars in 1297 bytes} [Thu Aug 25 12:43:20 2022] PUT /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1363 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:21.222801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5654d408-20e4-441c-9d76-3996138a8ff4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:21.224627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5654d408-20e4-441c-9d76-3996138a8ff4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:21.252640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5654d408-20e4-441c-9d76-3996138a8ff4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:21.259083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5654d408-20e4-441c-9d76-3996138a8ff4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:21.264037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5654d408-20e4-441c-9d76-3996138a8ff4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:21.266061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5654d408-20e4-441c-9d76-3996138a8ff4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:21.267258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5654d408-20e4-441c-9d76-3996138a8ff4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:21.268237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5654d408-20e4-441c-9d76-3996138a8ff4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:21.268758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:21.271302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:21.288621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:21.291020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:21.292087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:21.293774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:21.295062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:21.301117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:21.318961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:21.560153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:21.579298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:21.582958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:21.593579 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-02ee96df-ca41-4cc1-8da5-73f1f54e7021 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1363 microversion: 2.75 time: 0.335953 Aug 25 12:43:21.609552 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 341/681] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:21 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:21.609552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd435bd4-17ab-44d3-b974-1629be2f0ed7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:21.609552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bd435bd4-17ab-44d3-b974-1629be2f0ed7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:21.620295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd435bd4-17ab-44d3-b974-1629be2f0ed7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:21.621253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd435bd4-17ab-44d3-b974-1629be2f0ed7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:21.621997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd435bd4-17ab-44d3-b974-1629be2f0ed7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:21.623749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd435bd4-17ab-44d3-b974-1629be2f0ed7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:21.624589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd435bd4-17ab-44d3-b974-1629be2f0ed7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:21.626284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd435bd4-17ab-44d3-b974-1629be2f0ed7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:21.902692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5654d408-20e4-441c-9d76-3996138a8ff4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:21.958958 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5654d408-20e4-441c-9d76-3996138a8ff4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1462 microversion: 2.1 time: 0.746300 Aug 25 12:43:21.963218 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 341/682] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:21 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1462 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:21.986129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c14af338-52f2-4c56-b001-d690c2eb9be0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:21.988316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c14af338-52f2-4c56-b001-d690c2eb9be0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:22.018877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14af338-52f2-4c56-b001-d690c2eb9be0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:22.019273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14af338-52f2-4c56-b001-d690c2eb9be0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:22.023377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14af338-52f2-4c56-b001-d690c2eb9be0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:22.026650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14af338-52f2-4c56-b001-d690c2eb9be0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:22.029370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14af338-52f2-4c56-b001-d690c2eb9be0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:22.030361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14af338-52f2-4c56-b001-d690c2eb9be0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:22.102172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bd435bd4-17ab-44d3-b974-1629be2f0ed7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:22.143797 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bd435bd4-17ab-44d3-b974-1629be2f0ed7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1471 microversion: 2.1 time: 0.542152 Aug 25 12:43:22.145587 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 342/683] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:21 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1471 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:22.163537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:22.164973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:22.178002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:22.178931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:22.180057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:22.182703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:22.183328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:22.184052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:22.349880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c14af338-52f2-4c56-b001-d690c2eb9be0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:22.371724 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c14af338-52f2-4c56-b001-d690c2eb9be0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1272 microversion: 2.1 time: 0.405934 Aug 25 12:43:22.402536 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 342/684] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:21 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1272 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:22.412902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f91f27a-a1fe-44b8-a033-a51dbe87ce4e tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:22.420273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7f91f27a-a1fe-44b8-a033-a51dbe87ce4e tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:22.437498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f91f27a-a1fe-44b8-a033-a51dbe87ce4e tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:22.439336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f91f27a-a1fe-44b8-a033-a51dbe87ce4e tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:22.440938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f91f27a-a1fe-44b8-a033-a51dbe87ce4e tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:22.443977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f91f27a-a1fe-44b8-a033-a51dbe87ce4e tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:22.446520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f91f27a-a1fe-44b8-a033-a51dbe87ce4e tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:22.447360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f91f27a-a1fe-44b8-a033-a51dbe87ce4e tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:22.952740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:23.010744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:23.022300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:23.024967 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e84ee0c9-44a2-4ac9-928d-d5bd1e4f8976 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1361 microversion: 2.25 time: 0.874917 Aug 25 12:43:23.042418 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 343/685] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:22 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1361 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:23.234563 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7f91f27a-a1fe-44b8-a033-a51dbe87ce4e tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1613 microversion: 2.1 time: 0.829425 Aug 25 12:43:23.265922 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 343/686] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:22 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1613 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:23.294134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a9f5004-1da0-4ff6-bed0-39de09b1f560 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:23.295360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2a9f5004-1da0-4ff6-bed0-39de09b1f560 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:23.315658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a9f5004-1da0-4ff6-bed0-39de09b1f560 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:23.316928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a9f5004-1da0-4ff6-bed0-39de09b1f560 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:23.319889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a9f5004-1da0-4ff6-bed0-39de09b1f560 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:23.319889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a9f5004-1da0-4ff6-bed0-39de09b1f560 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:23.321206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a9f5004-1da0-4ff6-bed0-39de09b1f560 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:23.322133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a9f5004-1da0-4ff6-bed0-39de09b1f560 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:23.576141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b60d1eeb-2412-4e96-8eca-5f29f3597be2 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:23.578009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b60d1eeb-2412-4e96-8eca-5f29f3597be2 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] [instance: 4015445d-efaf-4f59-8aa0-a648b7699c99] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:23.596669 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b60d1eeb-2412-4e96-8eca-5f29f3597be2 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] HTTP exception thrown: Instance 4015445d-efaf-4f59-8aa0-a648b7699c99 could not be found. Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b60d1eeb-2412-4e96-8eca-5f29f3597be2 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Request method failure captured: Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/4015445d-efaf-4f59-8aa0-a648b7699c99/action HTTP/1.1 Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 15 Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB25Cw7KN3_j7EN1sf3YYpHjTR_PovmHZWKiFuZ3dDM8_jlE2sOJjlwnmFoLBzylmZjLiex6dutxWZIJ-3GxfuNURvN1hfEambF0vtqaiVVNvBLznRd3CMDp27ZT9qPFpuhZXfenM8tLS1fkgvljjCH9gcmCX6LkI7RU1dEpVQZ_6rGg Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 89deae1918ae49f0919cb7b8ec6861eb Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:43:23.600867 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89deae1918ae49f0919cb7b8ec6861eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89deae1918ae49f0919cb7b8ec6861eb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89deae1918ae49f0919cb7b8ec6861eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89deae1918ae49f0919cb7b8ec6861eb"}]}] Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 89deae1918ae49f0919cb7b8ec6861eb Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersAdminNegativeTestJSON-752917378-project-admin Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: d96f6e5d9f044ba4a28338d925fb1eb3 Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersAdminNegativeTestJSON-752917378-project-admin Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: {"migrate": {}} Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:43:23.603984 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 4015445d-efaf-4f59-8aa0-a648b7699c99 could not be found. Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '4015445d-efaf-4f59-8aa0-a648b7699c99', 'body': {'migrate': {}}} Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4015445d-efaf-4f59-8aa0-a648b7699c99 could not be found. Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:23.606323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4015445d-efaf-4f59-8aa0-a648b7699c99 could not be found. Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4015445d-efaf-4f59-8aa0-a648b7699c99 could not be found. Aug 25 12:43:23.608957 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:23.611669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b60d1eeb-2412-4e96-8eca-5f29f3597be2 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Returning 404 to user: Instance 4015445d-efaf-4f59-8aa0-a648b7699c99 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:23.611669 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b60d1eeb-2412-4e96-8eca-5f29f3597be2 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/4015445d-efaf-4f59-8aa0-a648b7699c99/action" status: 404 len: 111 microversion: 2.1 time: 0.573227 Aug 25 12:43:23.634166 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 344/687] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:43:23 2022] POST /compute/v2.1/servers/4015445d-efaf-4f59-8aa0-a648b7699c99/action => generated 111 bytes in 594 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:23.646513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:23.648450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:23.686484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:23.688057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:23.689216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:23.691326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:23.697027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:23.698256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:24.023990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:24.089054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:24.092899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:24.115285 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2a9d4fa-1996-4ac4-abb6-8e9c328b2c0d tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1419 microversion: 2.75 time: 0.478762 Aug 25 12:43:24.134076 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 345/688] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:23 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1419 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:24.171837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-aacb048a-4d2c-48fd-b206-5d409b379f8f req-a48556f6-2d2d-4890-a2e7-5a7a7c692f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f461f436-381b-4331-ac39-4a67d4a3efdc", "tag": "9f7b0b98-e0c1-4023-95f8-2759fe8df08d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:24.193602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aacb048a-4d2c-48fd-b206-5d409b379f8f req-a48556f6-2d2d-4890-a2e7-5a7a7c692f85 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:24.194329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aacb048a-4d2c-48fd-b206-5d409b379f8f req-a48556f6-2d2d-4890-a2e7-5a7a7c692f85 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:24.195114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aacb048a-4d2c-48fd-b206-5d409b379f8f req-a48556f6-2d2d-4890-a2e7-5a7a7c692f85 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:24.221500 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-aacb048a-4d2c-48fd-b206-5d409b379f8f req-a48556f6-2d2d-4890-a2e7-5a7a7c692f85 service nova] Creating event network-changed:9f7b0b98-e0c1-4023-95f8-2759fe8df08d for instance f461f436-381b-4331-ac39-4a67d4a3efdc on n-h1-852771-8 Aug 25 12:43:24.232254 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-aacb048a-4d2c-48fd-b206-5d409b379f8f req-a48556f6-2d2d-4890-a2e7-5a7a7c692f85 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095802 Aug 25 12:43:24.236277 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 346/689] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:24.256222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-368c7ec1-f30a-47d3-bfb3-902d75cafd69 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '.version_select at 0x7f3a2a94bd30>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:24.264909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-368c7ec1-f30a-47d3-bfb3-902d75cafd69 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:24.265904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-368c7ec1-f30a-47d3-bfb3-902d75cafd69 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:24.266880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-368c7ec1-f30a-47d3-bfb3-902d75cafd69 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:24.287198 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-368c7ec1-f30a-47d3-bfb3-902d75cafd69 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.047781 Aug 25 12:43:24.292179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a9f5004-1da0-4ff6-bed0-39de09b1f560 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:24.298473 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 347/690] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:43:24 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:24.334553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c746359a-e4a8-43b6-b9e3-d8f43633a52d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:24.335944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c746359a-e4a8-43b6-b9e3-d8f43633a52d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:24.337651 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a9f5004-1da0-4ff6-bed0-39de09b1f560 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1308 microversion: 2.1 time: 1.075920 Aug 25 12:43:24.338584 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 344/691] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:23 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1308 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:24.352434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1200680193", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:24.374935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c746359a-e4a8-43b6-b9e3-d8f43633a52d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:24.375919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c746359a-e4a8-43b6-b9e3-d8f43633a52d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:24.377024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c746359a-e4a8-43b6-b9e3-d8f43633a52d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:24.378469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c746359a-e4a8-43b6-b9e3-d8f43633a52d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:24.379346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c746359a-e4a8-43b6-b9e3-d8f43633a52d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:24.386981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c746359a-e4a8-43b6-b9e3-d8f43633a52d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:24.559677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:43:24.653316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c746359a-e4a8-43b6-b9e3-d8f43633a52d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:24.674739 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c746359a-e4a8-43b6-b9e3-d8f43633a52d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1272 microversion: 2.1 time: 0.372162 Aug 25 12:43:24.685200 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 348/692] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:24 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1272 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:24.697015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:24.699075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:24.718820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:24.726051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:24.727346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:24.729221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:24.730683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:24.731488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:25.439754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:25.475645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:25.489607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:25.492273 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d0abafa2-b092-4108-891f-2909faaf1026 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1361 microversion: 2.25 time: 0.804732 Aug 25 12:43:25.493803 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 349/693] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:24 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1361 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:25.517489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1458508101", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:25.662952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:25.686081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:43:25.698497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:43:25.708792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:43:25.710261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:43:25.714474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:43:25.716614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:43:25.722883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:25.758448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:25.759575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:25.760548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:25.762617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:25.763723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:25.764742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:25.828029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Getting quotas for project d33ffb23724e4333a2a0bc502c7f8854. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:25.847336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Getting quotas for user 9c85f30678174c6b99732ef70898b803 and project d33ffb23724e4333a2a0bc502c7f8854. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:25.884843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:43:25.895718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:43:26.111135 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-148ef39e-206b-4b63-b2f7-1a0864f7259f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.769643 Aug 25 12:43:26.114586 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 345/694] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:43:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:43:26.127693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-89da2966-5adb-4cfc-babc-a5f50ec46da9 tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:26.181251 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-89da2966-5adb-4cfc-babc-a5f50ec46da9 tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1072377812" status: 202 len: 0 microversion: 2.1 time: 0.059963 Aug 25 12:43:26.190935 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 346/695] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:43:26 2022] DELETE /compute/v2.1/flavors/1072377812 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:43:26.215299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:26.222613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:26.258729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:26.264674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:26.269064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:26.270882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:26.273600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:26.276747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:26.781099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:26.810542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:43:26.811440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:43:26.812145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:43:26.823209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:26.826606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:26.830164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:43:26.831509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:43:26.862862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:26.870679 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d2df338-a10c-47b1-a75d-1d2eb614a292 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1417 microversion: 2.75 time: 0.677634 Aug 25 12:43:26.883720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:26.885828 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 347/696] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:26 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1417 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:26.898746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:26.902850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:26.909797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2d5ff5a8-a320-4791-ba0c-a26ca5746a88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:26.911283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:26.912366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:26.923563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2d5ff5a8-a320-4791-ba0c-a26ca5746a88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:26.961727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d5ff5a8-a320-4791-ba0c-a26ca5746a88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:26.963623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d5ff5a8-a320-4791-ba0c-a26ca5746a88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:26.963623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d5ff5a8-a320-4791-ba0c-a26ca5746a88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:26.964788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d5ff5a8-a320-4791-ba0c-a26ca5746a88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:26.965742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d5ff5a8-a320-4791-ba0c-a26ca5746a88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:26.966499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d5ff5a8-a320-4791-ba0c-a26ca5746a88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:27.014672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:27.027404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for user aad1bc68cede45a7b1ab7cbda0d8208e and project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:27.074458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:43:27.093555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:43:27.266832 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2a053e6b-e3d2-4c70-b79a-6f2c0d9aacee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.767343 Aug 25 12:43:27.271621 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 350/697] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:43:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:43:27.298594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bfc03502-d72f-4363-89cb-3a9784dd024c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:27.298916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bfc03502-d72f-4363-89cb-3a9784dd024c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:27.330294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc03502-d72f-4363-89cb-3a9784dd024c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:27.332253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc03502-d72f-4363-89cb-3a9784dd024c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:27.333319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc03502-d72f-4363-89cb-3a9784dd024c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:27.336936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc03502-d72f-4363-89cb-3a9784dd024c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:27.340188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc03502-d72f-4363-89cb-3a9784dd024c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:27.341350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc03502-d72f-4363-89cb-3a9784dd024c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:28.347879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2d5ff5a8-a320-4791-ba0c-a26ca5746a88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:28.372520 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2d5ff5a8-a320-4791-ba0c-a26ca5746a88 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1308 microversion: 2.1 time: 1.484338 Aug 25 12:43:28.381946 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 348/698] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:26 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1308 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:28.389397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ca5384a-730b-41d7-9e0b-275fc091f618 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:28.394889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8ca5384a-730b-41d7-9e0b-275fc091f618 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:28.435092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ca5384a-730b-41d7-9e0b-275fc091f618 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:28.438930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ca5384a-730b-41d7-9e0b-275fc091f618 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:28.440321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ca5384a-730b-41d7-9e0b-275fc091f618 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:28.441825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ca5384a-730b-41d7-9e0b-275fc091f618 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:28.442789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ca5384a-730b-41d7-9e0b-275fc091f618 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:28.443697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ca5384a-730b-41d7-9e0b-275fc091f618 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:28.605866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bfc03502-d72f-4363-89cb-3a9784dd024c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:28.655791 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bfc03502-d72f-4363-89cb-3a9784dd024c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1314 microversion: 2.1 time: 1.380681 Aug 25 12:43:28.670885 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 351/699] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:27 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1314 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:28.702864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-83de0312-8797-464b-951c-1cc4d353870a tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:28.794053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8ca5384a-730b-41d7-9e0b-275fc091f618 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:28.807702 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-83de0312-8797-464b-951c-1cc4d353870a tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.134638 Aug 25 12:43:28.809735 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 352/700] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:43:28 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:28.819275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:28.819555 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8ca5384a-730b-41d7-9e0b-275fc091f618 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1218 microversion: 2.1 time: 0.435361 Aug 25 12:43:28.820411 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 349/701] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:28 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1218 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:28.821218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:28.832316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:28.846494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:28.854625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:28.856108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:28.857877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:28.862941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-13c98ce4-a3e0-44b2-b766-4d1efb4dad18 req-ea89a722-5b98-4f06-b989-3b610b1c2fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e66bf9-46f4-4037-8c41-400415f86c72", "name": "network-vif-plugged", "status": "completed", "tag": "82892c88-98b1-47a2-94ef-50fbcccb4ce1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:28.863442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:28.864831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:28.909326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-13c98ce4-a3e0-44b2-b766-4d1efb4dad18 req-ea89a722-5b98-4f06-b989-3b610b1c2fdd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:28.910861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-13c98ce4-a3e0-44b2-b766-4d1efb4dad18 req-ea89a722-5b98-4f06-b989-3b610b1c2fdd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:28.912811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-13c98ce4-a3e0-44b2-b766-4d1efb4dad18 req-ea89a722-5b98-4f06-b989-3b610b1c2fdd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:28.971702 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-13c98ce4-a3e0-44b2-b766-4d1efb4dad18 req-ea89a722-5b98-4f06-b989-3b610b1c2fdd service nova] Creating event network-vif-plugged:82892c88-98b1-47a2-94ef-50fbcccb4ce1 for instance 40e66bf9-46f4-4037-8c41-400415f86c72 on n-h2-852771-8 Aug 25 12:43:28.983712 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-13c98ce4-a3e0-44b2-b766-4d1efb4dad18 req-ea89a722-5b98-4f06-b989-3b610b1c2fdd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134618 Aug 25 12:43:29.012245 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 350/702] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:29.040633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c193dfdb-4318-4121-b36f-20d2a5ae9349 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:29.041399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c193dfdb-4318-4121-b36f-20d2a5ae9349 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:29.083093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c193dfdb-4318-4121-b36f-20d2a5ae9349 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.084242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c193dfdb-4318-4121-b36f-20d2a5ae9349 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.085129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c193dfdb-4318-4121-b36f-20d2a5ae9349 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:29.093008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c193dfdb-4318-4121-b36f-20d2a5ae9349 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.094545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c193dfdb-4318-4121-b36f-20d2a5ae9349 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.095751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c193dfdb-4318-4121-b36f-20d2a5ae9349 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:29.431646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c193dfdb-4318-4121-b36f-20d2a5ae9349 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:29.451204 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c193dfdb-4318-4121-b36f-20d2a5ae9349 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1217 microversion: 2.1 time: 0.433336 Aug 25 12:43:29.452433 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 351/703] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:29 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1217 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:29.488092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:29.489420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:29.501238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.502336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.502516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:29.503126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:29.510824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.514734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.518487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:29.527027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:29.530768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:29.533711 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f3fced2a-2ec1-460b-a0f5-434333110781 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1361 microversion: 2.25 time: 0.721667 Aug 25 12:43:29.535433 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 353/704] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:28 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1361 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:29.544659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-be695cc8-16d6-4657-b3cc-07fa8da03304 req-2863fdc5-35bc-476d-a6b5-7adc2c64f63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc10fef-7fca-46a1-adcc-686bd3e01141", "tag": "2399eef2-2d67-486b-95a6-6c78c0e665f5"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:29.588178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-be695cc8-16d6-4657-b3cc-07fa8da03304 req-2863fdc5-35bc-476d-a6b5-7adc2c64f63f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.589474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-be695cc8-16d6-4657-b3cc-07fa8da03304 req-2863fdc5-35bc-476d-a6b5-7adc2c64f63f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.598483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-be695cc8-16d6-4657-b3cc-07fa8da03304 req-2863fdc5-35bc-476d-a6b5-7adc2c64f63f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:29.632552 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-be695cc8-16d6-4657-b3cc-07fa8da03304 req-2863fdc5-35bc-476d-a6b5-7adc2c64f63f service nova] Creating event network-changed:2399eef2-2d67-486b-95a6-6c78c0e665f5 for instance bfc10fef-7fca-46a1-adcc-686bd3e01141 on n-h1-852771-8 Aug 25 12:43:29.646921 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-be695cc8-16d6-4657-b3cc-07fa8da03304 req-2863fdc5-35bc-476d-a6b5-7adc2c64f63f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109039 Aug 25 12:43:29.648012 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 354/705] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:29.672878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b3be2f1e-a25f-4f6c-a4dd-605e11ae56dc tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:29.719573 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b3be2f1e-a25f-4f6c-a4dd-605e11ae56dc tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1629574775" status: 202 len: 0 microversion: 2.1 time: 0.068411 Aug 25 12:43:29.720340 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 355/706] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:43:29 2022] DELETE /compute/v2.1/flavors/1629574775 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:43:29.737804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ad9afa50-d32e-46c3-9d19-b80ed286744d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:29.740841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ad9afa50-d32e-46c3-9d19-b80ed286744d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:29.756653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:29.760170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9afa50-d32e-46c3-9d19-b80ed286744d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.763155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9afa50-d32e-46c3-9d19-b80ed286744d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.763662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9afa50-d32e-46c3-9d19-b80ed286744d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:29.768581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9afa50-d32e-46c3-9d19-b80ed286744d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.769167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9afa50-d32e-46c3-9d19-b80ed286744d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.769756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9afa50-d32e-46c3-9d19-b80ed286744d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:29.772702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:29.775499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:29.784729 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5cf5e80c-00c2-4c07-8a48-5a83310679bf tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1438 microversion: 2.75 time: 0.313003 Aug 25 12:43:29.785883 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 352/707] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:29 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1438 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:29.794298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-53f0dfcb-f766-4fc1-91ac-bd5a96270e26 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:29.798535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-53f0dfcb-f766-4fc1-91ac-bd5a96270e26 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:29.816462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f0dfcb-f766-4fc1-91ac-bd5a96270e26 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.817039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f0dfcb-f766-4fc1-91ac-bd5a96270e26 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.817917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f0dfcb-f766-4fc1-91ac-bd5a96270e26 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:29.820241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f0dfcb-f766-4fc1-91ac-bd5a96270e26 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.821496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f0dfcb-f766-4fc1-91ac-bd5a96270e26 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.822483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f0dfcb-f766-4fc1-91ac-bd5a96270e26 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:30.395288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-53f0dfcb-f766-4fc1-91ac-bd5a96270e26 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:30.412156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ad9afa50-d32e-46c3-9d19-b80ed286744d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:30.422973 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-53f0dfcb-f766-4fc1-91ac-bd5a96270e26 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1314 microversion: 2.1 time: 0.632325 Aug 25 12:43:30.424935 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 353/708] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:29 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:30.434101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac261e4c-18c5-42bd-a1b1-7ccf7d10d3ae tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:30.456389 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ad9afa50-d32e-46c3-9d19-b80ed286744d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1308 microversion: 2.1 time: 0.733039 Aug 25 12:43:30.475327 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 356/709] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:29 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1308 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:30.497473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:30.503274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:30.517826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:30.520981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:30.533552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:30.536139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:30.539234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:30.540498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:30.563673 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ac261e4c-18c5-42bd-a1b1-7ccf7d10d3ae tempest-ServersWithSpecificFlavorTestJSON-874245409 tempest-ServersWithSpecificFlavorTestJSON-874245409-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.136329 Aug 25 12:43:30.565284 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 354/710] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:43:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:30.575599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-889f1b5b-0b3d-4b1b-a13d-5171af1a5269 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:30.577158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-889f1b5b-0b3d-4b1b-a13d-5171af1a5269 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:30.591058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889f1b5b-0b3d-4b1b-a13d-5171af1a5269 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:30.592545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889f1b5b-0b3d-4b1b-a13d-5171af1a5269 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:30.593689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889f1b5b-0b3d-4b1b-a13d-5171af1a5269 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:30.595817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889f1b5b-0b3d-4b1b-a13d-5171af1a5269 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:30.596930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889f1b5b-0b3d-4b1b-a13d-5171af1a5269 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:30.598045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889f1b5b-0b3d-4b1b-a13d-5171af1a5269 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:30.938183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:43:30.944756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:43:30.949362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:43:30.950532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:43:30.958824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:43:31.189760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:31.205552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.206700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.207643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.209249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.210337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.211216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.317714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-889f1b5b-0b3d-4b1b-a13d-5171af1a5269 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:31.350438 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-889f1b5b-0b3d-4b1b-a13d-5171af1a5269 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1280 microversion: 2.1 time: 0.781140 Aug 25 12:43:31.354525 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 355/711] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:30 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1280 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:31.370973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f1c6f95a-686d-4aed-82f3-1487f46a2dd5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:31.376357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f1c6f95a-686d-4aed-82f3-1487f46a2dd5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:31.394510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1c6f95a-686d-4aed-82f3-1487f46a2dd5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.395574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1c6f95a-686d-4aed-82f3-1487f46a2dd5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.396876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1c6f95a-686d-4aed-82f3-1487f46a2dd5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.398404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1c6f95a-686d-4aed-82f3-1487f46a2dd5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.399167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1c6f95a-686d-4aed-82f3-1487f46a2dd5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.400888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1c6f95a-686d-4aed-82f3-1487f46a2dd5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.477794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:31.497293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:31.515166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:31.539695 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-862acc4b-ef31-40f2-858a-b16044d214fb tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "POST /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23/action" status: 202 len: 1495 microversion: 2.75 time: 1.062062 Aug 25 12:43:31.540997 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 357/712] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 12:43:30 2022] POST /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23/action => generated 1495 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 25 12:43:31.560689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f1c6f95a-686d-4aed-82f3-1487f46a2dd5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:31.566430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:31.573849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:31.591471 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f1c6f95a-686d-4aed-82f3-1487f46a2dd5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1271 microversion: 2.1 time: 0.234231 Aug 25 12:43:31.591822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.592478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.602163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.602401 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 356/713] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:31 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:31.602571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.602571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.602571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.605538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:31.606402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:31.623455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.631477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.633103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.635987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.637903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.639368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.687320 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] HTTP exception thrown: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Request method failure captured: Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 HTTP/1.1 Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21IHkxn2iZHpsWmqHgn-q2raqHSEdacPNJDhQDTY8BUe5mJYgJ2DTIWAh94OAtjZdAWlseBLzv-N_6-sZc7UcKLCT-XwwzxOOHKRbNEE2wqoYNixMFXGwApahFzh9VlnU42TshD1-myOGqefLLJwHbdLzFf-hC3qJ8w64tIvkSL7dM Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:43:31.691352 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_88e943f7025e4663a3f3e10ea5857a08", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}] Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 708d03828d2744c7a386caf96df69865 Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:31.694836 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '2bb9e5d2-e61f-42fd-8f76-e550cac1dc45'} Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:31.699795 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:31.702170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:31.706285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Returning 404 to user: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:31.706285 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a3a37df3-fe2d-4f27-810a-0bcde69152ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 404 len: 111 microversion: 2.1 time: 0.096253 Aug 25 12:43:31.706285 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 357/714] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:31 2022] DELETE /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:31.706285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43c93f07-8614-40a3-b9a8-72e6a2ba1c76 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:31.706285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43c93f07-8614-40a3-b9a8-72e6a2ba1c76 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:31.717820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43c93f07-8614-40a3-b9a8-72e6a2ba1c76 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.719486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43c93f07-8614-40a3-b9a8-72e6a2ba1c76 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.720040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43c93f07-8614-40a3-b9a8-72e6a2ba1c76 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.721815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43c93f07-8614-40a3-b9a8-72e6a2ba1c76 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.722704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43c93f07-8614-40a3-b9a8-72e6a2ba1c76 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.723506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43c93f07-8614-40a3-b9a8-72e6a2ba1c76 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:32.135507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:32.169762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:32.178258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:32.182123 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-911bc134-e9a9-43e7-9156-2de080ac4c9c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1361 microversion: 2.25 time: 0.631970 Aug 25 12:43:32.219080 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 358/715] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:31 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1361 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:32.231437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f5a4673b-570c-4fbc-bd75-07e5dda7023b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:32.232712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f5a4673b-570c-4fbc-bd75-07e5dda7023b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:32.246738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a4673b-570c-4fbc-bd75-07e5dda7023b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:32.248302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a4673b-570c-4fbc-bd75-07e5dda7023b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:32.249249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a4673b-570c-4fbc-bd75-07e5dda7023b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:32.252163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a4673b-570c-4fbc-bd75-07e5dda7023b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:32.253669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a4673b-570c-4fbc-bd75-07e5dda7023b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:32.254956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a4673b-570c-4fbc-bd75-07e5dda7023b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:32.515534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43c93f07-8614-40a3-b9a8-72e6a2ba1c76 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:32.546105 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43c93f07-8614-40a3-b9a8-72e6a2ba1c76 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1314 microversion: 2.1 time: 0.847893 Aug 25 12:43:32.549968 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 358/716] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:31 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:32.573491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:32.576945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:32.593095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:32.595132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:32.596040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:32.597453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:32.598287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:32.599358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:32.915651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:32.935788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:32.941050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:32.986583 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-980a2af7-5cfa-404c-b4ec-c85d615cc9e0 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.431458 Aug 25 12:43:32.988851 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 359/717] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:32 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:32.998524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:33.015210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:33.043345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:33.044855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:33.046492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:33.051138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:33.052355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:33.053604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:33.087929 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] HTTP exception thrown: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Request method failure captured: Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 HTTP/1.1 Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB21IHkxn2iZHpsWmqHgn-q2raqHSEdacPNJDhQDTY8BUe5mJYgJ2DTIWAh94OAtjZdAWlseBLzv-N_6-sZc7UcKLCT-XwwzxOOHKRbNEE2wqoYNixMFXGwApahFzh9VlnU42TshD1-myOGqefLLJwHbdLzFf-hC3qJ8w64tIvkSL7dM Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:43:33.091869 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_88e943f7025e4663a3f3e10ea5857a08", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}] Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 708d03828d2744c7a386caf96df69865 Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:33.098200 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '2bb9e5d2-e61f-42fd-8f76-e550cac1dc45'} Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:33.102001 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. Aug 25 12:43:33.115692 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:43:33.118684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Returning 404 to user: Instance 2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:33.120440 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7bd0dc99-3194-491c-a854-6fad5fce9e81 tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45" status: 404 len: 111 microversion: 2.1 time: 0.129004 Aug 25 12:43:33.128214 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 360/718] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:32 2022] GET /compute/v2.1/servers/2bb9e5d2-e61f-42fd-8f76-e550cac1dc45 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:33.141300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3c5964ee-e39e-4133-8737-bc2b432a1658 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:33.142728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3c5964ee-e39e-4133-8737-bc2b432a1658 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:33.159336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c5964ee-e39e-4133-8737-bc2b432a1658 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:33.160527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c5964ee-e39e-4133-8737-bc2b432a1658 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:33.161899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c5964ee-e39e-4133-8737-bc2b432a1658 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:33.163571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c5964ee-e39e-4133-8737-bc2b432a1658 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:33.165491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c5964ee-e39e-4133-8737-bc2b432a1658 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:33.166699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c5964ee-e39e-4133-8737-bc2b432a1658 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:33.381155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3c5964ee-e39e-4133-8737-bc2b432a1658 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:33.402577 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3c5964ee-e39e-4133-8737-bc2b432a1658 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1280 microversion: 2.1 time: 0.274307 Aug 25 12:43:33.418219 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 361/719] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:33 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1280 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:33.458349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52f61651-4c1e-4788-97ef-32ffdecc924a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:33.460035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-52f61651-4c1e-4788-97ef-32ffdecc924a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:33.473980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f61651-4c1e-4788-97ef-32ffdecc924a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:33.475524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f61651-4c1e-4788-97ef-32ffdecc924a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:33.475815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f61651-4c1e-4788-97ef-32ffdecc924a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:33.477417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f61651-4c1e-4788-97ef-32ffdecc924a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:33.478248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f61651-4c1e-4788-97ef-32ffdecc924a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:33.479050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f61651-4c1e-4788-97ef-32ffdecc924a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:33.532500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f5a4673b-570c-4fbc-bd75-07e5dda7023b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:33.558252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:33.570594 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f5a4673b-570c-4fbc-bd75-07e5dda7023b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1308 microversion: 2.1 time: 1.349021 Aug 25 12:43:33.572112 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 359/720] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:32 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1308 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:33.596936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:33.599523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:33.667237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:33.668301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:33.669104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:33.670399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:33.671172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:33.672253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:33.710796 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] HTTP exception thrown: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Request method failure captured: Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 HTTP/1.1 Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21IHkxn2iZHpsWmqHgn-q2raqHSEdacPNJDhQDTY8BUe5mJYgJ2DTIWAh94OAtjZdAWlseBLzv-N_6-sZc7UcKLCT-XwwzxOOHKRbNEE2wqoYNixMFXGwApahFzh9VlnU42TshD1-myOGqefLLJwHbdLzFf-hC3qJ8w64tIvkSL7dM Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:43:33.718439 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_88e943f7025e4663a3f3e10ea5857a08", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}] Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 708d03828d2744c7a386caf96df69865 Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:33.721415 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1'} Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:33.722960 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:33.725087 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:33.732152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Returning 404 to user: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:33.732152 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0d9845ea-e143-4c41-8b5b-b607672374ef tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 404 len: 111 microversion: 2.1 time: 0.147142 Aug 25 12:43:33.737774 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 360/721] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:33 2022] DELETE /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:33.763597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:33.764919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:33.790438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:33.790988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:33.791892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:33.793500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:33.794704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:33.797446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:34.333194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-52f61651-4c1e-4788-97ef-32ffdecc924a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:34.363052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:34.369194 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-52f61651-4c1e-4788-97ef-32ffdecc924a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1313 microversion: 2.1 time: 0.949178 Aug 25 12:43:34.370176 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 362/722] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:33 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:34.383136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-89dbb233-032f-4993-8ff5-eed48292d6de req-5f61950e-561c-4835-a682-a3766a2e7273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f461f436-381b-4331-ac39-4a67d4a3efdc", "name": "network-vif-plugged", "status": "completed", "tag": "9f7b0b98-e0c1-4023-95f8-2759fe8df08d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:34.412283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-89dbb233-032f-4993-8ff5-eed48292d6de req-5f61950e-561c-4835-a682-a3766a2e7273 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:34.414270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-89dbb233-032f-4993-8ff5-eed48292d6de req-5f61950e-561c-4835-a682-a3766a2e7273 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:34.416817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-89dbb233-032f-4993-8ff5-eed48292d6de req-5f61950e-561c-4835-a682-a3766a2e7273 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:34.457189 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-89dbb233-032f-4993-8ff5-eed48292d6de req-5f61950e-561c-4835-a682-a3766a2e7273 service nova] Creating event network-vif-plugged:9f7b0b98-e0c1-4023-95f8-2759fe8df08d for instance f461f436-381b-4331-ac39-4a67d4a3efdc on n-h1-852771-8 Aug 25 12:43:34.472429 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-89dbb233-032f-4993-8ff5-eed48292d6de req-5f61950e-561c-4835-a682-a3766a2e7273 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098410 Aug 25 12:43:34.475073 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 363/723] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:34.491231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-db031877-870c-47e6-a42d-2e3370131c24 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:34.493604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-db031877-870c-47e6-a42d-2e3370131c24 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:34.510687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db031877-870c-47e6-a42d-2e3370131c24 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:34.512280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db031877-870c-47e6-a42d-2e3370131c24 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:34.513465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db031877-870c-47e6-a42d-2e3370131c24 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:34.516079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db031877-870c-47e6-a42d-2e3370131c24 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:34.518185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db031877-870c-47e6-a42d-2e3370131c24 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:34.519528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db031877-870c-47e6-a42d-2e3370131c24 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:34.627635 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 12:43:34.627936 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 12:43:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 (ip 10.222.0.70) !!! Aug 25 12:43:35.218076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:35.261751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:35.267356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:35.271476 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ae10840b-8c4a-4aa7-b5f8-338c950e858f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1361 microversion: 2.25 time: 1.528778 Aug 25 12:43:35.273371 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 361/724] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:33 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1361 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:35.285971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:35.287509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] [instance: 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:35.310751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.311410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.312115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.314124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.316745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.318074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.351527 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] HTTP exception thrown: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Request method failure captured: Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 HTTP/1.1 Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB21IHkxn2iZHpsWmqHgn-q2raqHSEdacPNJDhQDTY8BUe5mJYgJ2DTIWAh94OAtjZdAWlseBLzv-N_6-sZc7UcKLCT-XwwzxOOHKRbNEE2wqoYNixMFXGwApahFzh9VlnU42TshD1-myOGqefLLJwHbdLzFf-hC3qJ8w64tIvkSL7dM Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:43:35.355153 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_88e943f7025e4663a3f3e10ea5857a08", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/88e943f7025e4663a3f3e10ea5857a08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88e943f7025e4663a3f3e10ea5857a08"}]}] Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 88e943f7025e4663a3f3e10ea5857a08 Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237 Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 708d03828d2744c7a386caf96df69865 Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-287570237-project Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:35.358103 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1'} Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:35.360309 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. Aug 25 12:43:35.362969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.366934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] Returning 404 to user: Instance 7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:35.368969 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8ce95525-5d47-4410-a9e1-405c9b66b3ac tempest-ServersWithSpecificFlavorTestJSON-287570237 tempest-ServersWithSpecificFlavorTestJSON-287570237-project] 10.222.0.70 "GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1" status: 404 len: 111 microversion: 2.1 time: 0.093501 Aug 25 12:43:35.370477 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 362/725] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:35 2022] GET /compute/v2.1/servers/7ed0da3e-d10e-4e54-9f42-a64b0b60c0e1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:35.380736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:35.384409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:35.396574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.398004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.399236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.400988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.402271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.403448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.602375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-db031877-870c-47e6-a42d-2e3370131c24 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:35.654377 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-db031877-870c-47e6-a42d-2e3370131c24 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1314 microversion: 2.1 time: 1.145275 Aug 25 12:43:35.656947 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 364/726] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:34 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1314 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:35.675536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:35.695624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:35.706143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-173c6b07-fdac-4732-ad52-81cd1c29cb8e tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:35.709838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:35.725450 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d05e7d71-5e3a-4978-9f91-fd16e5ba861b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.352674 Aug 25 12:43:35.727457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-173c6b07-fdac-4732-ad52-81cd1c29cb8e tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:35.758044 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 363/727] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:35 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:35.767381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-173c6b07-fdac-4732-ad52-81cd1c29cb8e tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.774788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-173c6b07-fdac-4732-ad52-81cd1c29cb8e tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.777469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-173c6b07-fdac-4732-ad52-81cd1c29cb8e tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.784970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-173c6b07-fdac-4732-ad52-81cd1c29cb8e tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.788482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-173c6b07-fdac-4732-ad52-81cd1c29cb8e tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.791952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d87a905c-7e62-4642-aa59-e47168847c38 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:35.792283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-173c6b07-fdac-4732-ad52-81cd1c29cb8e tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.793973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d87a905c-7e62-4642-aa59-e47168847c38 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:35.795347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:35.816388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d87a905c-7e62-4642-aa59-e47168847c38 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.818573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d87a905c-7e62-4642-aa59-e47168847c38 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.819634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d87a905c-7e62-4642-aa59-e47168847c38 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.828506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d87a905c-7e62-4642-aa59-e47168847c38 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.829896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d87a905c-7e62-4642-aa59-e47168847c38 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.831010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d87a905c-7e62-4642-aa59-e47168847c38 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.946075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=14 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:36.946443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:37.046130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=18 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:37.441595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d87a905c-7e62-4642-aa59-e47168847c38 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:37.474923 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d87a905c-7e62-4642-aa59-e47168847c38 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1488 microversion: 2.1 time: 1.711012 Aug 25 12:43:37.489623 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 364/728] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:35 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1488 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:37.509549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e3c43816-9ee6-43db-88aa-e91d8fb5b023 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:37.512994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e3c43816-9ee6-43db-88aa-e91d8fb5b023 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:37.534223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-173c6b07-fdac-4732-ad52-81cd1c29cb8e tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:37.546876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c43816-9ee6-43db-88aa-e91d8fb5b023 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:37.548030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c43816-9ee6-43db-88aa-e91d8fb5b023 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:37.548687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c43816-9ee6-43db-88aa-e91d8fb5b023 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:37.549809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c43816-9ee6-43db-88aa-e91d8fb5b023 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:37.550421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c43816-9ee6-43db-88aa-e91d8fb5b023 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:37.551155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c43816-9ee6-43db-88aa-e91d8fb5b023 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:37.570305 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-173c6b07-fdac-4732-ad52-81cd1c29cb8e tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1322 microversion: 2.1 time: 1.909590 Aug 25 12:43:37.571936 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 365/729] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:35 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1322 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:37.582151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:37.591287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:37.617641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:37.622641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:37.623912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:37.633024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:37.634326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:37.635382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:38.396942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:38.430607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:38.434631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:38.449699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70ea7675-8851-4e2c-a0a3-9a87c7e1531e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1558 microversion: 2.25 time: 0.875399 Aug 25 12:43:38.453991 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 366/730] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:37 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1558 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:38.457111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e3c43816-9ee6-43db-88aa-e91d8fb5b023 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:38.478215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-41b2871a-ac57-41aa-ab62-73a91439529d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:38.479585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-41b2871a-ac57-41aa-ab62-73a91439529d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:38.492117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41b2871a-ac57-41aa-ab62-73a91439529d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:38.494537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41b2871a-ac57-41aa-ab62-73a91439529d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:38.496196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41b2871a-ac57-41aa-ab62-73a91439529d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:38.497999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41b2871a-ac57-41aa-ab62-73a91439529d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:38.499152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41b2871a-ac57-41aa-ab62-73a91439529d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:38.500678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41b2871a-ac57-41aa-ab62-73a91439529d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:38.552092 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e3c43816-9ee6-43db-88aa-e91d8fb5b023 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1313 microversion: 2.1 time: 1.062450 Aug 25 12:43:38.555356 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 365/731] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:37 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1313 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:38.607728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:38.627638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:38.685205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:38.686516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:38.688196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:38.693129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:38.694540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:38.699328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.164796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:39.192295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:39.197340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:39.216322 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0bf36100-af26-45be-aa8d-4aca58553cd6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.650559 Aug 25 12:43:39.218678 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 366/732] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:38 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:39.232725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02f1a165-f09f-4de8-ba45-3333f5c317e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:39.236194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-02f1a165-f09f-4de8-ba45-3333f5c317e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:39.273455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f1a165-f09f-4de8-ba45-3333f5c317e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.275079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f1a165-f09f-4de8-ba45-3333f5c317e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.277168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f1a165-f09f-4de8-ba45-3333f5c317e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.279120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f1a165-f09f-4de8-ba45-3333f5c317e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.281915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f1a165-f09f-4de8-ba45-3333f5c317e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.283173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f1a165-f09f-4de8-ba45-3333f5c317e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.538979 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-02f1a165-f09f-4de8-ba45-3333f5c317e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72/action" status: 202 len: 0 microversion: 2.1 time: 0.317050 Aug 25 12:43:39.540594 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 367/733] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:43:39 2022] POST /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:43:39.558047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ca7f1a65-74fb-4da3-8b42-8f52ee74e6a0 req-d78276cc-5ccf-455e-9772-478abdbaec2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d546d68-7705-4b98-a1e4-f516be4139c9", "tag": "72572e80-1880-4512-a8b4-c77e931a7bbc"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:39.601334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ca7f1a65-74fb-4da3-8b42-8f52ee74e6a0 req-d78276cc-5ccf-455e-9772-478abdbaec2b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.603152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ca7f1a65-74fb-4da3-8b42-8f52ee74e6a0 req-d78276cc-5ccf-455e-9772-478abdbaec2b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.607323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ca7f1a65-74fb-4da3-8b42-8f52ee74e6a0 req-d78276cc-5ccf-455e-9772-478abdbaec2b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.623530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-41b2871a-ac57-41aa-ab62-73a91439529d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:39.651559 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ca7f1a65-74fb-4da3-8b42-8f52ee74e6a0 req-d78276cc-5ccf-455e-9772-478abdbaec2b service nova] Creating event network-changed:72572e80-1880-4512-a8b4-c77e931a7bbc for instance 6d546d68-7705-4b98-a1e4-f516be4139c9 on n-h2-852771-8 Aug 25 12:43:39.668305 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-41b2871a-ac57-41aa-ab62-73a91439529d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1314 microversion: 2.1 time: 1.208081 Aug 25 12:43:39.669421 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 367/734] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:38 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1314 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:39.694098 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ca7f1a65-74fb-4da3-8b42-8f52ee74e6a0 req-d78276cc-5ccf-455e-9772-478abdbaec2b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150592 Aug 25 12:43:39.696328 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 368/735] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:39.709015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-250a4cac-3395-478c-be65-5750a93a6339 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:39.710098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-250a4cac-3395-478c-be65-5750a93a6339 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:39.711123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3059b25b-b4e0-4852-862a-3aa842d2384a tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:39.712291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3059b25b-b4e0-4852-862a-3aa842d2384a tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:39.726475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-250a4cac-3395-478c-be65-5750a93a6339 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.728949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-250a4cac-3395-478c-be65-5750a93a6339 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.730525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-250a4cac-3395-478c-be65-5750a93a6339 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.732294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3059b25b-b4e0-4852-862a-3aa842d2384a tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.733236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3059b25b-b4e0-4852-862a-3aa842d2384a tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.733899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-250a4cac-3395-478c-be65-5750a93a6339 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.734806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3059b25b-b4e0-4852-862a-3aa842d2384a tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.735931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-250a4cac-3395-478c-be65-5750a93a6339 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.737463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3059b25b-b4e0-4852-862a-3aa842d2384a tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.738750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3059b25b-b4e0-4852-862a-3aa842d2384a tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.740430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3059b25b-b4e0-4852-862a-3aa842d2384a tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.740962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-250a4cac-3395-478c-be65-5750a93a6339 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:40.538863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-250a4cac-3395-478c-be65-5750a93a6339 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:40.558079 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-250a4cac-3395-478c-be65-5750a93a6339 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1322 microversion: 2.1 time: 0.859253 Aug 25 12:43:40.562808 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 369/736] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:39 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1322 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:40.582158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3e6e113e-995e-493b-8aff-b2157ca357f5 req-13668e9b-f0eb-488f-b466-b4c3f2b0a2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc10fef-7fca-46a1-adcc-686bd3e01141", "name": "network-vif-plugged", "status": "completed", "tag": "2399eef2-2d67-486b-95a6-6c78c0e665f5"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:40.584909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-3059b25b-b4e0-4852-862a-3aa842d2384a tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid f461f436-381b-4331-ac39-4a67d4a3efdc {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:40.604223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e6e113e-995e-493b-8aff-b2157ca357f5 req-13668e9b-f0eb-488f-b466-b4c3f2b0a2f3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:40.606455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e6e113e-995e-493b-8aff-b2157ca357f5 req-13668e9b-f0eb-488f-b466-b4c3f2b0a2f3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:40.608262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e6e113e-995e-493b-8aff-b2157ca357f5 req-13668e9b-f0eb-488f-b466-b4c3f2b0a2f3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:40.639977 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3e6e113e-995e-493b-8aff-b2157ca357f5 req-13668e9b-f0eb-488f-b466-b4c3f2b0a2f3 service nova] Creating event network-vif-plugged:2399eef2-2d67-486b-95a6-6c78c0e665f5 for instance bfc10fef-7fca-46a1-adcc-686bd3e01141 on n-h1-852771-8 Aug 25 12:43:40.656930 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3e6e113e-995e-493b-8aff-b2157ca357f5 req-13668e9b-f0eb-488f-b466-b4c3f2b0a2f3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085772 Aug 25 12:43:40.667078 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 370/737] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:40.677915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b61b8ea3-9d40-49c7-b8a6-17c4289aaaf6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:40.679738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b61b8ea3-9d40-49c7-b8a6-17c4289aaaf6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:40.695138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61b8ea3-9d40-49c7-b8a6-17c4289aaaf6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:40.695964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61b8ea3-9d40-49c7-b8a6-17c4289aaaf6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:40.696731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61b8ea3-9d40-49c7-b8a6-17c4289aaaf6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:40.700572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61b8ea3-9d40-49c7-b8a6-17c4289aaaf6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:40.700572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61b8ea3-9d40-49c7-b8a6-17c4289aaaf6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:40.700572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b61b8ea3-9d40-49c7-b8a6-17c4289aaaf6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:40.744985 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3059b25b-b4e0-4852-862a-3aa842d2384a tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 2050 microversion: 2.25 time: 1.046628 Aug 25 12:43:40.761551 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 368/738] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:39 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 2050 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:40.768700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c33b279-7ca5-4ace-bbc9-3f6d89b17d32 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:40.772027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9c33b279-7ca5-4ace-bbc9-3f6d89b17d32 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:40.793111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c33b279-7ca5-4ace-bbc9-3f6d89b17d32 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:40.795700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c33b279-7ca5-4ace-bbc9-3f6d89b17d32 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:40.797727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c33b279-7ca5-4ace-bbc9-3f6d89b17d32 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:40.800843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c33b279-7ca5-4ace-bbc9-3f6d89b17d32 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:40.802212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c33b279-7ca5-4ace-bbc9-3f6d89b17d32 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:40.803822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c33b279-7ca5-4ace-bbc9-3f6d89b17d32 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.307191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b61b8ea3-9d40-49c7-b8a6-17c4289aaaf6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:41.323374 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b61b8ea3-9d40-49c7-b8a6-17c4289aaaf6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1493 microversion: 2.1 time: 0.653507 Aug 25 12:43:41.324558 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 371/739] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:40 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1493 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:41.335275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:41.336569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:41.349184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9c33b279-7ca5-4ace-bbc9-3f6d89b17d32 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:41.352534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.354939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.355909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.357341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.358346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.359262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.369881 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c33b279-7ca5-4ace-bbc9-3f6d89b17d32 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1313 microversion: 2.1 time: 0.612878 Aug 25 12:43:41.371088 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 369/740] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:40 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:41.389690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4f0d95e1-8d28-492d-a6f2-f95256800814 req-fadbbdce-9c21-4b42-b8ef-a10ddf5e5314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe666709-aa48-4785-8e47-ac9011592ddc", "tag": "dde49cc7-dbaf-4c67-b244-a03554f3fb0c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:41.419413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4f0d95e1-8d28-492d-a6f2-f95256800814 req-fadbbdce-9c21-4b42-b8ef-a10ddf5e5314 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.420410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4f0d95e1-8d28-492d-a6f2-f95256800814 req-fadbbdce-9c21-4b42-b8ef-a10ddf5e5314 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.421465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4f0d95e1-8d28-492d-a6f2-f95256800814 req-fadbbdce-9c21-4b42-b8ef-a10ddf5e5314 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.445981 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4f0d95e1-8d28-492d-a6f2-f95256800814 req-fadbbdce-9c21-4b42-b8ef-a10ddf5e5314 service nova] Creating event network-changed:dde49cc7-dbaf-4c67-b244-a03554f3fb0c for instance fe666709-aa48-4785-8e47-ac9011592ddc on n-h2-852771-8 Aug 25 12:43:41.456100 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4f0d95e1-8d28-492d-a6f2-f95256800814 req-fadbbdce-9c21-4b42-b8ef-a10ddf5e5314 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082408 Aug 25 12:43:41.457343 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 370/741] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:41.470779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-650514e5-0703-407f-8bbc-11310176b602 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:41.472438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-650514e5-0703-407f-8bbc-11310176b602 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:41.485047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-650514e5-0703-407f-8bbc-11310176b602 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.486018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-650514e5-0703-407f-8bbc-11310176b602 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.486783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-650514e5-0703-407f-8bbc-11310176b602 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.488499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-650514e5-0703-407f-8bbc-11310176b602 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.489724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-650514e5-0703-407f-8bbc-11310176b602 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.490818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-650514e5-0703-407f-8bbc-11310176b602 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.552998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:41.574575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:41.579340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:41.608300 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e9d30e98-5597-4569-ac31-3da9e5ed252e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.280891 Aug 25 12:43:41.616144 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 372/742] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:41 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:41.632646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dafd28ba-c8c5-4977-bc4b-a1393025606e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:41.634663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dafd28ba-c8c5-4977-bc4b-a1393025606e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:41.649732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dafd28ba-c8c5-4977-bc4b-a1393025606e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.651062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dafd28ba-c8c5-4977-bc4b-a1393025606e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.652192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dafd28ba-c8c5-4977-bc4b-a1393025606e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.653854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dafd28ba-c8c5-4977-bc4b-a1393025606e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.655274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dafd28ba-c8c5-4977-bc4b-a1393025606e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.656985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dafd28ba-c8c5-4977-bc4b-a1393025606e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.129322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-650514e5-0703-407f-8bbc-11310176b602 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:42.176454 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-650514e5-0703-407f-8bbc-11310176b602 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1314 microversion: 2.1 time: 0.715959 Aug 25 12:43:42.186922 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 371/743] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:41 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:42.213449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f155f110-b0dc-483f-86aa-dded6de4620e tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Calling method '.version_select at 0x7f3a2aa179d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:42.295688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-dafd28ba-c8c5-4977-bc4b-a1393025606e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid f461f436-381b-4331-ac39-4a67d4a3efdc {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:42.342783 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f155f110-b0dc-483f-86aa-dded6de4620e tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309" status: 200 len: 637 microversion: 2.1 time: 0.148602 Aug 25 12:43:42.364785 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dafd28ba-c8c5-4977-bc4b-a1393025606e tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 2050 microversion: 2.25 time: 0.748900 Aug 25 12:43:42.366369 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 372/744] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:42 2022] GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309 => generated 637 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:42.367778 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 373/745] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:41 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 2050 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:42.382593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-26e83f8a-fa44-49b5-85fe-4bb547b8bce7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:42.384550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-26e83f8a-fa44-49b5-85fe-4bb547b8bce7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:42.385428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e57fc0d0-fe4e-4288-81fa-475eb0f8674e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:42.389486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e57fc0d0-fe4e-4288-81fa-475eb0f8674e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:42.415721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57fc0d0-fe4e-4288-81fa-475eb0f8674e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.416547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57fc0d0-fe4e-4288-81fa-475eb0f8674e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.417373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57fc0d0-fe4e-4288-81fa-475eb0f8674e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.418729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57fc0d0-fe4e-4288-81fa-475eb0f8674e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.419581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57fc0d0-fe4e-4288-81fa-475eb0f8674e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.425967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e83f8a-fa44-49b5-85fe-4bb547b8bce7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.427029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57fc0d0-fe4e-4288-81fa-475eb0f8674e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.427798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e83f8a-fa44-49b5-85fe-4bb547b8bce7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.430409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e83f8a-fa44-49b5-85fe-4bb547b8bce7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.431923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e83f8a-fa44-49b5-85fe-4bb547b8bce7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.433063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e83f8a-fa44-49b5-85fe-4bb547b8bce7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.435475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e83f8a-fa44-49b5-85fe-4bb547b8bce7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:43.703979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-26e83f8a-fa44-49b5-85fe-4bb547b8bce7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:43.725635 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-26e83f8a-fa44-49b5-85fe-4bb547b8bce7 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1322 microversion: 2.1 time: 1.354356 Aug 25 12:43:43.745818 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 373/746] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:42 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1322 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:43.753878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e57fc0d0-fe4e-4288-81fa-475eb0f8674e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:43.755984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-abbf392d-f091-4061-8b8d-221bcd21a2f7 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Action: 'update_all', calling method: .version_select at 0x7f3a2aa17e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:43.774469 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e57fc0d0-fe4e-4288-81fa-475eb0f8674e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1493 microversion: 2.1 time: 1.404499 Aug 25 12:43:43.794101 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 374/747] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:42 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1493 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:43.821469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d764131d-fd96-44a2-8d33-b237a8898823 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:43.840657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d764131d-fd96-44a2-8d33-b237a8898823 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:43.841911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d764131d-fd96-44a2-8d33-b237a8898823 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:43.842894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d764131d-fd96-44a2-8d33-b237a8898823 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:43.844536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d764131d-fd96-44a2-8d33-b237a8898823 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:43.847404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d764131d-fd96-44a2-8d33-b237a8898823 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:43.848458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d764131d-fd96-44a2-8d33-b237a8898823 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:43.881028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-abbf392d-f091-4061-8b8d-221bcd21a2f7 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:43.902069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-abbf392d-f091-4061-8b8d-221bcd21a2f7 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for user 75d70fceee054b11aa1e8626e71e77e1 and project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:43.926719 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d764131d-fd96-44a2-8d33-b237a8898823 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.130562 Aug 25 12:43:43.929972 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 375/748] 10.222.0.70 () {60 vars in 1217 bytes} [Thu Aug 25 12:43:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:43:43.954785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a659bbe-123b-4df9-a6c2-cf2aca2f3b8c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:43.958327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a659bbe-123b-4df9-a6c2-cf2aca2f3b8c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:43.970559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a659bbe-123b-4df9-a6c2-cf2aca2f3b8c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:43.972093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a659bbe-123b-4df9-a6c2-cf2aca2f3b8c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:43.973196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a659bbe-123b-4df9-a6c2-cf2aca2f3b8c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:43.975096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a659bbe-123b-4df9-a6c2-cf2aca2f3b8c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:43.976402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a659bbe-123b-4df9-a6c2-cf2aca2f3b8c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:43.977470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a659bbe-123b-4df9-a6c2-cf2aca2f3b8c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:44.847071 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-abbf392d-f091-4061-8b8d-221bcd21a2f7 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 61 microversion: 2.1 time: 1.102094 Aug 25 12:43:44.848416 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 374/749] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:43:43 2022] PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 61 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:44.857797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:44.862025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:44.892327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:44.896269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:44.897325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:44.902956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:44.904221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:44.911717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:44.923224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a659bbe-123b-4df9-a6c2-cf2aca2f3b8c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:44.957812 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a659bbe-123b-4df9-a6c2-cf2aca2f3b8c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1313 microversion: 2.1 time: 1.018041 Aug 25 12:43:44.991149 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 376/750] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:43 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1313 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:45.004391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0791ba52-b1d0-4060-9b92-10357f4f6101 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:45.005258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0791ba52-b1d0-4060-9b92-10357f4f6101 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:45.015880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0791ba52-b1d0-4060-9b92-10357f4f6101 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:45.016690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0791ba52-b1d0-4060-9b92-10357f4f6101 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:45.017475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0791ba52-b1d0-4060-9b92-10357f4f6101 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:45.018786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0791ba52-b1d0-4060-9b92-10357f4f6101 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:45.027320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0791ba52-b1d0-4060-9b92-10357f4f6101 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:45.030062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0791ba52-b1d0-4060-9b92-10357f4f6101 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:45.172424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:45.217847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:45.227066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:45.240990 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ee3d40a6-1f4c-4574-91a6-52010bb8f27e tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.389470 Aug 25 12:43:45.243569 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 375/751] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:44 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:45.275575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e92c635-787b-4562-ac28-678ad2734c36 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:45.277278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3e92c635-787b-4562-ac28-678ad2734c36 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:45.295369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e92c635-787b-4562-ac28-678ad2734c36 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:45.299695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e92c635-787b-4562-ac28-678ad2734c36 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:45.302310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e92c635-787b-4562-ac28-678ad2734c36 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:45.305270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e92c635-787b-4562-ac28-678ad2734c36 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:45.308825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e92c635-787b-4562-ac28-678ad2734c36 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:45.311338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e92c635-787b-4562-ac28-678ad2734c36 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:45.552414 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3e92c635-787b-4562-ac28-678ad2734c36 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc/action" status: 202 len: 0 microversion: 2.25 time: 0.305258 Aug 25 12:43:45.562489 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 376/752] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 12:43:45 2022] POST /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:45.588734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-651beded-7446-44a3-8de4-687ac605c7b3 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:45.594634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-651beded-7446-44a3-8de4-687ac605c7b3 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:45.625947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-651beded-7446-44a3-8de4-687ac605c7b3 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:45.627540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-651beded-7446-44a3-8de4-687ac605c7b3 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:45.628867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-651beded-7446-44a3-8de4-687ac605c7b3 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:45.634018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-651beded-7446-44a3-8de4-687ac605c7b3 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:45.636556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-651beded-7446-44a3-8de4-687ac605c7b3 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:45.638030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-651beded-7446-44a3-8de4-687ac605c7b3 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:45.860315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0791ba52-b1d0-4060-9b92-10357f4f6101 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:45.891935 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0791ba52-b1d0-4060-9b92-10357f4f6101 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1463 microversion: 2.1 time: 0.898765 Aug 25 12:43:45.893959 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 377/753] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:44 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1463 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:45.914485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-712b07f9-bd73-41f5-bf3b-6e1aa7fe7b7f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:45.916108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-712b07f9-bd73-41f5-bf3b-6e1aa7fe7b7f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:45.948587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-712b07f9-bd73-41f5-bf3b-6e1aa7fe7b7f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:45.951074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-712b07f9-bd73-41f5-bf3b-6e1aa7fe7b7f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:45.957609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-712b07f9-bd73-41f5-bf3b-6e1aa7fe7b7f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:45.963302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-712b07f9-bd73-41f5-bf3b-6e1aa7fe7b7f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:45.964720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-712b07f9-bd73-41f5-bf3b-6e1aa7fe7b7f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:45.965917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-712b07f9-bd73-41f5-bf3b-6e1aa7fe7b7f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:46.044717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:46.417004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-651beded-7446-44a3-8de4-687ac605c7b3 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:46.428965 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-651beded-7446-44a3-8de4-687ac605c7b3 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1322 microversion: 2.1 time: 0.861164 Aug 25 12:43:46.430591 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 377/754] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:45 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1322 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:46.441098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8f93d454-8c20-4d83-839b-e9b549b8d5a6 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Calling method '.version_select at 0x7f3a2ad87430>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:46.548760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-712b07f9-bd73-41f5-bf3b-6e1aa7fe7b7f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:46.578633 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-712b07f9-bd73-41f5-bf3b-6e1aa7fe7b7f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 200 len: 1473 microversion: 2.1 time: 0.682592 Aug 25 12:43:46.605575 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 378/755] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:45 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 1473 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:46.642042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f3ef530-8037-4f9c-935e-0842623e5ff4 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:46.644064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f3ef530-8037-4f9c-935e-0842623e5ff4 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:46.672233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f3ef530-8037-4f9c-935e-0842623e5ff4 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:46.673773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f3ef530-8037-4f9c-935e-0842623e5ff4 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:46.674761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f3ef530-8037-4f9c-935e-0842623e5ff4 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:46.680803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f3ef530-8037-4f9c-935e-0842623e5ff4 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:46.681962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f3ef530-8037-4f9c-935e-0842623e5ff4 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:46.682901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f3ef530-8037-4f9c-935e-0842623e5ff4 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.099336 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8f93d454-8c20-4d83-839b-e9b549b8d5a6 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "DELETE /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.666055 Aug 25 12:43:47.100993 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 378/756] 10.222.0.70 () {58 vars in 1296 bytes} [Thu Aug 25 12:43:46 2022] DELETE /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata/os_version => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:47.113047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ab6f46fc-2a1f-427b-9c8b-dabe95465945 req-80f02f71-7f00-4580-bb92-c50a1b3d103c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d546d68-7705-4b98-a1e4-f516be4139c9", "name": "network-vif-plugged", "status": "completed", "tag": "72572e80-1880-4512-a8b4-c77e931a7bbc"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:47.137737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ab6f46fc-2a1f-427b-9c8b-dabe95465945 req-80f02f71-7f00-4580-bb92-c50a1b3d103c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.139135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ab6f46fc-2a1f-427b-9c8b-dabe95465945 req-80f02f71-7f00-4580-bb92-c50a1b3d103c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.139996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ab6f46fc-2a1f-427b-9c8b-dabe95465945 req-80f02f71-7f00-4580-bb92-c50a1b3d103c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.164285 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ab6f46fc-2a1f-427b-9c8b-dabe95465945 req-80f02f71-7f00-4580-bb92-c50a1b3d103c service nova] Creating event network-vif-plugged:72572e80-1880-4512-a8b4-c77e931a7bbc for instance 6d546d68-7705-4b98-a1e4-f516be4139c9 on n-h2-852771-8 Aug 25 12:43:47.179537 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ab6f46fc-2a1f-427b-9c8b-dabe95465945 req-80f02f71-7f00-4580-bb92-c50a1b3d103c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075898 Aug 25 12:43:47.180656 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 379/757] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:47.356031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-6f3ef530-8037-4f9c-935e-0842623e5ff4 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid f461f436-381b-4331-ac39-4a67d4a3efdc {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:47.385772 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f3ef530-8037-4f9c-935e-0842623e5ff4 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 2035 microversion: 2.25 time: 0.772265 Aug 25 12:43:47.387300 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 379/758] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:46 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 2035 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:47.398028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1160412f-0ee2-4fa2-9ba5-10a4ebdc700a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:47.400628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1160412f-0ee2-4fa2-9ba5-10a4ebdc700a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:47.416693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1160412f-0ee2-4fa2-9ba5-10a4ebdc700a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.417908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1160412f-0ee2-4fa2-9ba5-10a4ebdc700a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.418965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1160412f-0ee2-4fa2-9ba5-10a4ebdc700a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.420596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1160412f-0ee2-4fa2-9ba5-10a4ebdc700a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.421887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1160412f-0ee2-4fa2-9ba5-10a4ebdc700a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.422965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1160412f-0ee2-4fa2-9ba5-10a4ebdc700a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.677956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-78543eae-1584-487a-adcd-73828fbdad2c tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:47.688179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-78543eae-1584-487a-adcd-73828fbdad2c tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Searching by: {'deleted': False, 'project_id': '921bfddb84ac4975bbc9da12be19abde'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:43:47.699459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78543eae-1584-487a-adcd-73828fbdad2c tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.700302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78543eae-1584-487a-adcd-73828fbdad2c tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.707457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78543eae-1584-487a-adcd-73828fbdad2c tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.709608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78543eae-1584-487a-adcd-73828fbdad2c tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.710480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78543eae-1584-487a-adcd-73828fbdad2c tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.711293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78543eae-1584-487a-adcd-73828fbdad2c tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.732168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1160412f-0ee2-4fa2-9ba5-10a4ebdc700a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:47.771310 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1160412f-0ee2-4fa2-9ba5-10a4ebdc700a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1313 microversion: 2.1 time: 0.381642 Aug 25 12:43:47.773660 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 380/759] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:47 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:47.785437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:47.788118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:47.808161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.811015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.812737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.814227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.815039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.815816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.894686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:47.901988 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-78543eae-1584-487a-adcd-73828fbdad2c tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.718821 Aug 25 12:43:47.903142 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 380/760] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:43:47 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:47.913095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43aebac0-d758-45b4-a342-5f5ccc47da6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1093500181"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:47.917654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43aebac0-d758-45b4-a342-5f5ccc47da6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:47.940682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43aebac0-d758-45b4-a342-5f5ccc47da6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.942558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43aebac0-d758-45b4-a342-5f5ccc47da6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.942966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43aebac0-d758-45b4-a342-5f5ccc47da6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.944417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43aebac0-d758-45b4-a342-5f5ccc47da6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.945326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43aebac0-d758-45b4-a342-5f5ccc47da6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.946162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43aebac0-d758-45b4-a342-5f5ccc47da6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.974902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:48.007447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:48.015356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:48.031659 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-091542f4-eeec-4d22-bd3b-566d1f30d77a tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.254475 Aug 25 12:43:48.033639 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 381/761] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:47 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:48.046451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-da36e0a8-c975-4664-a72e-8f7f335868aa tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Calling method '.version_select at 0x7f3a2a8919d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:48.145269 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-da36e0a8-c975-4664-a72e-8f7f335868aa tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 37 microversion: 2.1 time: 0.108659 Aug 25 12:43:48.146950 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 382/762] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:43:48 2022] GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 37 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:48.158922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852771-8", "block_migration": "auto"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:48.165437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:48.180620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:48.182446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:48.183557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:48.185142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:48.187362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:48.189530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:48.248559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'flavor' on Instance uuid f461f436-381b-4331-ac39-4a67d4a3efdc {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:48.316474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Going to try to live migrate instance to n-h2-852771-8 {{(pid=129059) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:43:48.555881 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43aebac0-d758-45b4-a342-5f5ccc47da6d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72/action" status: 202 len: 0 microversion: 2.1 time: 0.650299 Aug 25 12:43:48.557562 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 381/763] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:43:47 2022] POST /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:43:48.573238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-334bd360-dc8b-496e-86f5-4b3e7a8b6be8 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:48.574668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-334bd360-dc8b-496e-86f5-4b3e7a8b6be8 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:48.597272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-334bd360-dc8b-496e-86f5-4b3e7a8b6be8 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:48.603553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-334bd360-dc8b-496e-86f5-4b3e7a8b6be8 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:48.615383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-334bd360-dc8b-496e-86f5-4b3e7a8b6be8 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:48.617760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-334bd360-dc8b-496e-86f5-4b3e7a8b6be8 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:48.638100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-334bd360-dc8b-496e-86f5-4b3e7a8b6be8 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:48.639163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-334bd360-dc8b-496e-86f5-4b3e7a8b6be8 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:48.740549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:49.178677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-334bd360-dc8b-496e-86f5-4b3e7a8b6be8 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:49.195991 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-334bd360-dc8b-496e-86f5-4b3e7a8b6be8 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1322 microversion: 2.1 time: 0.635730 Aug 25 12:43:49.197963 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 382/764] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:48 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1322 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:49.208774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:49.222536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Searching by: {'deleted': False} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:43:49.235342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:49.236206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:49.236979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:49.238799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:49.239645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:49.240421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:49.498852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:43:49.824792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:49.824792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:49.824792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:50.527032 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fc244edd-4744-459a-a06f-6f2964111866 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17359 microversion: 2.1 time: 1.325236 Aug 25 12:43:50.541555 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 383/765] 10.222.0.70 () {58 vars in 1171 bytes} [Thu Aug 25 12:43:49 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17359 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:43:50.541555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3178387e-c016-4b87-87a0-5d07baa0dd88 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Action: 'update_all', calling method: .version_select at 0x7f3a2aa171f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:50.661240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-3178387e-c016-4b87-87a0-5d07baa0dd88 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:50.672300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-3178387e-c016-4b87-87a0-5d07baa0dd88 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for user 75d70fceee054b11aa1e8626e71e77e1 and project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:51.215714 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3178387e-c016-4b87-87a0-5d07baa0dd88 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 61 microversion: 2.1 time: 0.685136 Aug 25 12:43:51.216703 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 384/766] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:43:50 2022] PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 61 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:51.235579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a4403a58-1423-4360-bc59-160cc5960367 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2aa66040>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:51.335658 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a4403a58-1423-4360-bc59-160cc5960367 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.110748 Aug 25 12:43:51.336907 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 385/767] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:51 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:51.344920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-963cd2f8-4a73-4995-8b21-8d648d926e63 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:51.346102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-963cd2f8-4a73-4995-8b21-8d648d926e63 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:51.359317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963cd2f8-4a73-4995-8b21-8d648d926e63 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:51.360962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963cd2f8-4a73-4995-8b21-8d648d926e63 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:51.361650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963cd2f8-4a73-4995-8b21-8d648d926e63 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:51.362983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963cd2f8-4a73-4995-8b21-8d648d926e63 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:51.363850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963cd2f8-4a73-4995-8b21-8d648d926e63 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:51.364599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963cd2f8-4a73-4995-8b21-8d648d926e63 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:51.800582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-963cd2f8-4a73-4995-8b21-8d648d926e63 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:51.815628 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-963cd2f8-4a73-4995-8b21-8d648d926e63 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1313 microversion: 2.1 time: 0.477206 Aug 25 12:43:51.816956 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 386/768] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:51 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:51.826180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:51.827977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:51.857716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:51.859686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:51.860545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:51.861907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:51.862660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:51.863260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.049716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:52.084108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:52.090687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:52.131560 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-36acdf00-821e-495e-988f-01d093581867 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc/action" status: 202 len: 0 microversion: 2.25 time: 3.981568 Aug 25 12:43:52.133021 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 383/769] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 12:43:48 2022] POST /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc/action => generated 0 bytes in 3985 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:52.158463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c5806d85-81a7-4f25-a4e5-f6f96e78139f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:52.159978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c5806d85-81a7-4f25-a4e5-f6f96e78139f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:52.164419 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dc131423-6d38-4013-9d47-df49264f98e4 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.345326 Aug 25 12:43:52.166123 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 387/770] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:51 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:52.188690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-83c4f706-19e1-4bf5-910a-0671e61fca85 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:52.228147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5806d85-81a7-4f25-a4e5-f6f96e78139f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:52.229193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5806d85-81a7-4f25-a4e5-f6f96e78139f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:52.230403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-83c4f706-19e1-4bf5-910a-0671e61fca85 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Searching by: {'deleted': False, 'project_id': '921bfddb84ac4975bbc9da12be19abde'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:43:52.234362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5806d85-81a7-4f25-a4e5-f6f96e78139f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.236219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5806d85-81a7-4f25-a4e5-f6f96e78139f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:52.237398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5806d85-81a7-4f25-a4e5-f6f96e78139f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:52.240660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5806d85-81a7-4f25-a4e5-f6f96e78139f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.252556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83c4f706-19e1-4bf5-910a-0671e61fca85 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:52.253878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83c4f706-19e1-4bf5-910a-0671e61fca85 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:52.257953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83c4f706-19e1-4bf5-910a-0671e61fca85 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.263389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83c4f706-19e1-4bf5-910a-0671e61fca85 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:52.269965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83c4f706-19e1-4bf5-910a-0671e61fca85 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:52.271275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83c4f706-19e1-4bf5-910a-0671e61fca85 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.400260 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-83c4f706-19e1-4bf5-910a-0671e61fca85 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?tenant_id=e2700209d0c94f789c1b01cf7b38c6e0" status: 200 len: 15 microversion: 2.1 time: 0.231950 Aug 25 12:43:52.401619 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 388/771] 10.222.0.70 () {58 vars in 1231 bytes} [Thu Aug 25 12:43:52 2022] GET /compute/v2.1/servers/detail?tenant_id=e2700209d0c94f789c1b01cf7b38c6e0 => generated 15 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:52.413119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12677a81-9370-4e4f-9415-18cc86a60520 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Calling method '.version_select at 0x7f3a2ae46ee0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:52.520888 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12677a81-9370-4e4f-9415-18cc86a60520 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.112251 Aug 25 12:43:52.522633 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 389/772] 10.222.0.70 () {58 vars in 1290 bytes} [Thu Aug 25 12:43:52 2022] GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata/os_distro => generated 33 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:52.534328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:52.536542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:52.559138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:52.562031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:52.563289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.566083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:52.568810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:52.570346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.830642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c5806d85-81a7-4f25-a4e5-f6f96e78139f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:52.854131 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c5806d85-81a7-4f25-a4e5-f6f96e78139f tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1472 microversion: 2.1 time: 0.718705 Aug 25 12:43:52.856487 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 384/773] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:52 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1472 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:52.870156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0342dd6c-144b-4156-a683-448dccef5b92 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a887430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:52.988350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:52.992945 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0342dd6c-144b-4156-a683-448dccef5b92 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.132252 Aug 25 12:43:52.995937 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 385/774] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:52 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:53.010508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:53.024852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:53.027648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Searching by: {'tenant_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'deleted': False} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:43:53.028085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:53.032246 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-93cb0fc9-b81e-4ea3-9213-6f5343988e8a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1568 microversion: 2.25 time: 0.505865 Aug 25 12:43:53.048038 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 390/775] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:52 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1568 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:53.067938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:53.068729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c8a9733-24a8-4e11-84c4-a77d776d43dd tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Action: 'update_all', calling method: .version_select at 0x7f3a2ad4e310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:53.074933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:53.080479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:53.082882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:53.085909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:53.087446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:53.188779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-1c8a9733-24a8-4e11-84c4-a77d776d43dd tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:53.198710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-1c8a9733-24a8-4e11-84c4-a77d776d43dd tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for user 75d70fceee054b11aa1e8626e71e77e1 and project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:53.356845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:43:53.575533 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1c8a9733-24a8-4e11-84c4-a77d776d43dd tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 61 microversion: 2.1 time: 0.525584 Aug 25 12:43:53.584150 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 391/776] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:43:53 2022] PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 61 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:53.594162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e9ac1ebd-8ae5-47ca-8ca5-454adb79ee06 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:53.595854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e9ac1ebd-8ae5-47ca-8ca5-454adb79ee06 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:53.609478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ac1ebd-8ae5-47ca-8ca5-454adb79ee06 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:53.610773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ac1ebd-8ae5-47ca-8ca5-454adb79ee06 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:53.611439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ac1ebd-8ae5-47ca-8ca5-454adb79ee06 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:53.612814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ac1ebd-8ae5-47ca-8ca5-454adb79ee06 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:53.613741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ac1ebd-8ae5-47ca-8ca5-454adb79ee06 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:53.614552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ac1ebd-8ae5-47ca-8ca5-454adb79ee06 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:53.686887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:53.688099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:53.689748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:54.028452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e9ac1ebd-8ae5-47ca-8ca5-454adb79ee06 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:54.034926 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-be4e917a-9b83-4180-a669-e7d2cdf239ad tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e2700209d0c94f789c1b01cf7b38c6e0" status: 200 len: 4826 microversion: 2.1 time: 1.035668 Aug 25 12:43:54.037463 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 386/777] 10.222.0.70 () {58 vars in 1257 bytes} [Thu Aug 25 12:43:52 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e2700209d0c94f789c1b01cf7b38c6e0 => generated 4826 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:54.047284 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e9ac1ebd-8ae5-47ca-8ca5-454adb79ee06 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1313 microversion: 2.1 time: 0.459768 Aug 25 12:43:54.053734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-82054e57-51bd-412c-9155-eb2cea675027 req-3d5aaa3f-5071-439a-9e41-7fb09522f21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe666709-aa48-4785-8e47-ac9011592ddc", "name": "network-vif-plugged", "status": "completed", "tag": "dde49cc7-dbaf-4c67-b244-a03554f3fb0c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:54.063890 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 392/778] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:53 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:54.096203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-82054e57-51bd-412c-9155-eb2cea675027 req-3d5aaa3f-5071-439a-9e41-7fb09522f21b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:54.097703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-82054e57-51bd-412c-9155-eb2cea675027 req-3d5aaa3f-5071-439a-9e41-7fb09522f21b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:54.098511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-82054e57-51bd-412c-9155-eb2cea675027 req-3d5aaa3f-5071-439a-9e41-7fb09522f21b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:54.102090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a32c9fab-44ac-4f17-9175-aa2c23385302 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:54.103603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a32c9fab-44ac-4f17-9175-aa2c23385302 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:54.116577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a32c9fab-44ac-4f17-9175-aa2c23385302 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:54.118098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a32c9fab-44ac-4f17-9175-aa2c23385302 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:54.119142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a32c9fab-44ac-4f17-9175-aa2c23385302 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:54.120463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a32c9fab-44ac-4f17-9175-aa2c23385302 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:54.121422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a32c9fab-44ac-4f17-9175-aa2c23385302 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:54.122372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a32c9fab-44ac-4f17-9175-aa2c23385302 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:54.122629 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-82054e57-51bd-412c-9155-eb2cea675027 req-3d5aaa3f-5071-439a-9e41-7fb09522f21b service nova] Creating event network-vif-plugged:dde49cc7-dbaf-4c67-b244-a03554f3fb0c for instance fe666709-aa48-4785-8e47-ac9011592ddc on n-h2-852771-8 Aug 25 12:43:54.135342 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-82054e57-51bd-412c-9155-eb2cea675027 req-3d5aaa3f-5071-439a-9e41-7fb09522f21b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094466 Aug 25 12:43:54.137050 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 387/779] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:54.148036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:54.149586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:54.163001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:54.164096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:54.164974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:54.166721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:54.167713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:54.168593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:54.182592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-a32c9fab-44ac-4f17-9175-aa2c23385302 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lazy-loading 'flavor' on Instance uuid 6d546d68-7705-4b98-a1e4-f516be4139c9 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:54.404056 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a32c9fab-44ac-4f17-9175-aa2c23385302 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9/action" status: 202 len: 0 microversion: 2.1 time: 0.337662 Aug 25 12:43:54.410436 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 393/780] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:43:54 2022] POST /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:43:54.443884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8b95f9b3-3861-4de7-8238-f1d79800bb95 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Calling method '.version_select at 0x7f3a2add6c10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:54.594265 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8b95f9b3-3861-4de7-8238-f1d79800bb95 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 61 microversion: 2.1 time: 0.180236 Aug 25 12:43:54.595465 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 394/781] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:43:54 2022] GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 61 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:54.620549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0e5a50cf-ee36-4ada-88ef-6807ae69ee8c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2ab83c10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:54.763130 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0e5a50cf-ee36-4ada-88ef-6807ae69ee8c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.165887 Aug 25 12:43:54.777560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 395/782] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:54 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:54.777909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:54.779231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:54.799827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:54.802492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:54.804618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:54.806943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:54.808075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:54.813327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:55.157293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:55.180133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:55.184131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:55.196396 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bc019919-4ba3-45c8-969c-852d5fba2032 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 1.056935 Aug 25 12:43:55.207492 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 388/783] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:54 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:55.208149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ff6abc0-6c31-4cff-92f9-93e9af528004 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:55.222263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ff6abc0-6c31-4cff-92f9-93e9af528004 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Searching by: {'tenant_id': '921bfddb84ac4975bbc9da12be19abde', 'deleted': False} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:43:55.234452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ff6abc0-6c31-4cff-92f9-93e9af528004 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:55.234452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ff6abc0-6c31-4cff-92f9-93e9af528004 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:55.234452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ff6abc0-6c31-4cff-92f9-93e9af528004 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:55.236587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ff6abc0-6c31-4cff-92f9-93e9af528004 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:55.245831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ff6abc0-6c31-4cff-92f9-93e9af528004 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:55.245831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ff6abc0-6c31-4cff-92f9-93e9af528004 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:55.303097 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ff6abc0-6c31-4cff-92f9-93e9af528004 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=921bfddb84ac4975bbc9da12be19abde" status: 200 len: 15 microversion: 2.1 time: 0.102872 Aug 25 12:43:55.304824 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 389/784] 10.222.0.70 () {58 vars in 1257 bytes} [Thu Aug 25 12:43:55 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=921bfddb84ac4975bbc9da12be19abde => generated 15 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:55.314556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d3a53a1-de15-4ec3-8a66-125881b1655d tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:55.316203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d3a53a1-de15-4ec3-8a66-125881b1655d tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:55.326490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:55.330316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a53a1-de15-4ec3-8a66-125881b1655d tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:55.331365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a53a1-de15-4ec3-8a66-125881b1655d tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:55.332935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a53a1-de15-4ec3-8a66-125881b1655d tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:55.334130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a53a1-de15-4ec3-8a66-125881b1655d tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:55.335107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a53a1-de15-4ec3-8a66-125881b1655d tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:55.336279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a53a1-de15-4ec3-8a66-125881b1655d tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:55.769262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:55.787937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:55.790599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:55.794151 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3ab4ad8d-b506-44bd-9b33-8218524f2ff2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1568 microversion: 2.25 time: 1.024728 Aug 25 12:43:55.809562 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 396/785] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:54 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1568 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:55.809562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c908cd8c-3b1d-40e1-9dbc-5932d47b92d1 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Action: 'update_all', calling method: .version_select at 0x7f3a2acc7ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:55.923091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c908cd8c-3b1d-40e1-9dbc-5932d47b92d1 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:55.937267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c908cd8c-3b1d-40e1-9dbc-5932d47b92d1 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for user 75d70fceee054b11aa1e8626e71e77e1 and project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:56.347236 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c908cd8c-3b1d-40e1-9dbc-5932d47b92d1 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 61 microversion: 2.1 time: 0.548891 Aug 25 12:43:56.348526 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 397/786] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:43:55 2022] PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 61 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:56.360605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b1c26cdd-a514-4ac2-8b2f-f0b2b1b71edb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:56.362003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b1c26cdd-a514-4ac2-8b2f-f0b2b1b71edb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:56.373313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1c26cdd-a514-4ac2-8b2f-f0b2b1b71edb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:56.374976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1c26cdd-a514-4ac2-8b2f-f0b2b1b71edb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:56.375831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1c26cdd-a514-4ac2-8b2f-f0b2b1b71edb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:56.377426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1c26cdd-a514-4ac2-8b2f-f0b2b1b71edb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:56.378731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1c26cdd-a514-4ac2-8b2f-f0b2b1b71edb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:56.379739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1c26cdd-a514-4ac2-8b2f-f0b2b1b71edb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:56.574528 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d3a53a1-de15-4ec3-8a66-125881b1655d tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1631 microversion: 2.1 time: 1.267029 Aug 25 12:43:56.606519 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 390/787] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:55 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1631 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:56.629346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4a3f88a6-9190-4883-bdf5-974163f1a50a tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:56.656723 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4a3f88a6-9190-4883-bdf5-974163f1a50a tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.045928 Aug 25 12:43:56.658407 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 391/788] 10.222.0.70 () {58 vars in 1189 bytes} [Thu Aug 25 12:43:56 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:56.668772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cc4e25c3-ce9d-4a72-a894-0da67f887dbe tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2aba9310>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:56.822406 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cc4e25c3-ce9d-4a72-a894-0da67f887dbe tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.161012 Aug 25 12:43:56.826913 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 392/789] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:56 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:56.847904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:56.852468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:56.865733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:56.867025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:56.867754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:56.869597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:56.870664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:56.871368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:57.087600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:57.109924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:57.146917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:57.152494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b1c26cdd-a514-4ac2-8b2f-f0b2b1b71edb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:57.166662 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-15756258-bf10-4469-8931-4b0e31321003 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.336828 Aug 25 12:43:57.169106 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 393/790] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:56 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:57.188491 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b1c26cdd-a514-4ac2-8b2f-f0b2b1b71edb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1313 microversion: 2.1 time: 0.836541 Aug 25 12:43:57.199714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2875e90c-4918-4ceb-8401-5fde12aed464 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Action: 'update_all', calling method: .version_select at 0x7f3a2a887b80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:57.203439 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 398/791] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:56 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1313 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:57.228746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-01d96dd2-f503-4a57-ab3a-1dd77fef46b0 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:57.234455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-01d96dd2-f503-4a57-ab3a-1dd77fef46b0 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:57.246773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01d96dd2-f503-4a57-ab3a-1dd77fef46b0 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:57.248128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01d96dd2-f503-4a57-ab3a-1dd77fef46b0 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:57.250073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01d96dd2-f503-4a57-ab3a-1dd77fef46b0 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:57.253121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01d96dd2-f503-4a57-ab3a-1dd77fef46b0 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:57.254491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01d96dd2-f503-4a57-ab3a-1dd77fef46b0 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:57.255668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01d96dd2-f503-4a57-ab3a-1dd77fef46b0 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:57.378583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2875e90c-4918-4ceb-8401-5fde12aed464 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:57.390636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2875e90c-4918-4ceb-8401-5fde12aed464 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for user 75d70fceee054b11aa1e8626e71e77e1 and project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:57.512529 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-01d96dd2-f503-4a57-ab3a-1dd77fef46b0 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.292386 Aug 25 12:43:57.513790 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 399/792] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:43:57 2022] POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:43:57.529566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:57.530917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:57.542984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:57.543942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:57.544669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:57.546060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:57.546792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:57.547595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:58.159826 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2875e90c-4918-4ceb-8401-5fde12aed464 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 64 microversion: 2.1 time: 0.985979 Aug 25 12:43:58.162484 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 394/793] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:43:57 2022] PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 64 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:58.175849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:58.196481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:58.208981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:43:58.244347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:58.245105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:58.245639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:58.249639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:58.250261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:58.251106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:58.319772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:58.367649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:58.372190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:58.378121 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-df6c6d56-2898-4fd6-bbb9-f6df219bf6a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1568 microversion: 2.25 time: 0.856597 Aug 25 12:43:58.379198 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 400/794] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:57 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1568 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:58.435521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cef085f0-0339-4acb-8b63-c6c7201de89e tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:58.438619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cef085f0-0339-4acb-8b63-c6c7201de89e tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:58.464296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cef085f0-0339-4acb-8b63-c6c7201de89e tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:58.467985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cef085f0-0339-4acb-8b63-c6c7201de89e tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:58.469424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cef085f0-0339-4acb-8b63-c6c7201de89e tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:58.472518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cef085f0-0339-4acb-8b63-c6c7201de89e tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:58.475249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cef085f0-0339-4acb-8b63-c6c7201de89e tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:58.476088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cef085f0-0339-4acb-8b63-c6c7201de89e tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:58.618271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:43:58.814635 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-200ec5ba-8569-410f-be68-dccb055f43e6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.649418 Aug 25 12:43:58.815952 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 395/795] 10.222.0.70 () {58 vars in 1150 bytes} [Thu Aug 25 12:43:58 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:58.850328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0a0d79e-4b46-416f-82d2-12ec344344d7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a8e9040>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:59.022738 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0a0d79e-4b46-416f-82d2-12ec344344d7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.202976 Aug 25 12:43:59.047334 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 396/796] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:58 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:59.089026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d37f6e57-ea9d-4c01-bd5c-33a900ca233a req-bd04b81f-8120-4c3e-9906-00fe963dd33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f461f436-381b-4331-ac39-4a67d4a3efdc", "name": "network-vif-unplugged", "status": "completed", "tag": "9f7b0b98-e0c1-4023-95f8-2759fe8df08d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:59.148444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d37f6e57-ea9d-4c01-bd5c-33a900ca233a req-bd04b81f-8120-4c3e-9906-00fe963dd33b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:59.148735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d37f6e57-ea9d-4c01-bd5c-33a900ca233a req-bd04b81f-8120-4c3e-9906-00fe963dd33b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:59.150030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d37f6e57-ea9d-4c01-bd5c-33a900ca233a req-bd04b81f-8120-4c3e-9906-00fe963dd33b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:59.213965 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d37f6e57-ea9d-4c01-bd5c-33a900ca233a req-bd04b81f-8120-4c3e-9906-00fe963dd33b service nova] Creating event network-vif-unplugged:9f7b0b98-e0c1-4023-95f8-2759fe8df08d for instance f461f436-381b-4331-ac39-4a67d4a3efdc on n-h1-852771-8 Aug 25 12:43:59.239234 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d37f6e57-ea9d-4c01-bd5c-33a900ca233a req-bd04b81f-8120-4c3e-9906-00fe963dd33b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.188498 Aug 25 12:43:59.240387 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 397/797] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:59.261989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e7cdd9ae-f2fd-4d19-96f5-ef6d755bb7e3 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Calling method '.version_select at 0x7f3a2a8bb820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:59.302242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cef085f0-0339-4acb-8b63-c6c7201de89e tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1614 microversion: 2.1 time: 0.886505 Aug 25 12:43:59.303310 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 401/798] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:58 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1614 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:59.355058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:59.361498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:59.393915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:59.400227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:59.401459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:59.403166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:59.404440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:59.406184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:59.460522 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e7cdd9ae-f2fd-4d19-96f5-ef6d755bb7e3 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 64 microversion: 2.1 time: 0.205130 Aug 25 12:43:59.466396 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 398/799] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:43:59 2022] GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 64 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:59.487351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1145eea-f3ca-4683-8ca7-d0f465cf3ae3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:59.490364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b1145eea-f3ca-4683-8ca7-d0f465cf3ae3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:59.523325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1145eea-f3ca-4683-8ca7-d0f465cf3ae3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:59.524336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1145eea-f3ca-4683-8ca7-d0f465cf3ae3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:59.525257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1145eea-f3ca-4683-8ca7-d0f465cf3ae3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:59.526910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1145eea-f3ca-4683-8ca7-d0f465cf3ae3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:59.527823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1145eea-f3ca-4683-8ca7-d0f465cf3ae3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:59.528593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1145eea-f3ca-4683-8ca7-d0f465cf3ae3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:59.575944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:59.601452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:59.614498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:59.628723 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bd74b202-93d1-48e1-9496-bd22e8d76afe tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.289444 Aug 25 12:43:59.630251 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 402/800] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:59 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:59.640612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-461272df-17e8-4a57-be89-a401c2af9b98 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:59.645353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-461272df-17e8-4a57-be89-a401c2af9b98 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:59.688211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-461272df-17e8-4a57-be89-a401c2af9b98 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:59.689575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-461272df-17e8-4a57-be89-a401c2af9b98 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:59.690703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-461272df-17e8-4a57-be89-a401c2af9b98 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:59.692257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-461272df-17e8-4a57-be89-a401c2af9b98 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:59.693339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-461272df-17e8-4a57-be89-a401c2af9b98 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:59.694353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-461272df-17e8-4a57-be89-a401c2af9b98 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:59.702416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:59.923062 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-461272df-17e8-4a57-be89-a401c2af9b98 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.279258 Aug 25 12:43:59.931706 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 403/801] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:43:59 2022] POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:43:59.945851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-468b9970-e159-4189-8afc-dcf3955d4b1d req-a8a30b47-b77d-4edf-b822-f48129df9561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e66bf9-46f4-4037-8c41-400415f86c72", "name": "network-vif-plugged", "status": "completed", "tag": "82892c88-98b1-47a2-94ef-50fbcccb4ce1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:59.980704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-468b9970-e159-4189-8afc-dcf3955d4b1d req-a8a30b47-b77d-4edf-b822-f48129df9561 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:59.984391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-468b9970-e159-4189-8afc-dcf3955d4b1d req-a8a30b47-b77d-4edf-b822-f48129df9561 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:59.984878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-468b9970-e159-4189-8afc-dcf3955d4b1d req-a8a30b47-b77d-4edf-b822-f48129df9561 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:00.026038 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-468b9970-e159-4189-8afc-dcf3955d4b1d req-a8a30b47-b77d-4edf-b822-f48129df9561 service nova] Creating event network-vif-plugged:82892c88-98b1-47a2-94ef-50fbcccb4ce1 for instance 40e66bf9-46f4-4037-8c41-400415f86c72 on n-h2-852771-8 Aug 25 12:44:00.040251 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-468b9970-e159-4189-8afc-dcf3955d4b1d req-a8a30b47-b77d-4edf-b822-f48129df9561 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106607 Aug 25 12:44:00.042196 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 404/802] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:00.057779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:00.059180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:00.097934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:00.099075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:00.099769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:00.100925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:00.101754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:00.102501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:00.128665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b1145eea-f3ca-4683-8ca7-d0f465cf3ae3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:00.151419 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b1145eea-f3ca-4683-8ca7-d0f465cf3ae3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1463 microversion: 2.1 time: 0.680116 Aug 25 12:44:00.153131 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 399/803] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:59 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1463 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:00.165161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:00.166486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:00.185470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:00.186928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:00.187778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:00.190502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:00.193012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:00.193012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:00.246318 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] HTTP exception thrown: Cannot 'migrate' instance 6d546d68-7705-4b98-a1e4-f516be4139c9 while it is in vm_state suspended Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Request method failure captured: Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9/action HTTP/1.1 Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 15 Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Cw7KN3_j7EN1sf3YYpHjTR_PovmHZWKiFuZ3dDM8_jlE2sOJjlwnmFoLBzylmZjLiex6dutxWZIJ-3GxfuNURvN1hfEambF0vtqaiVVNvBLznRd3CMDp27ZT9qPFpuhZXfenM8tLS1fkgvljjCH9gcmCX6LkI7RU1dEpVQZ_6rGg Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 89deae1918ae49f0919cb7b8ec6861eb Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:44:00.250983 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89deae1918ae49f0919cb7b8ec6861eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89deae1918ae49f0919cb7b8ec6861eb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89deae1918ae49f0919cb7b8ec6861eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89deae1918ae49f0919cb7b8ec6861eb"}]}] Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 89deae1918ae49f0919cb7b8ec6861eb Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersAdminNegativeTestJSON-752917378-project-admin Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d96f6e5d9f044ba4a28338d925fb1eb3 Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersAdminNegativeTestJSON-752917378-project-admin Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: {"migrate": {}} Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:44:00.253984 n-d-852771-8 devstack@n-api.service[129060]: exception: Cannot 'migrate' instance 6d546d68-7705-4b98-a1e4-f516be4139c9 while it is in vm_state suspended Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '6d546d68-7705-4b98-a1e4-f516be4139c9', 'body': {'migrate': {}}} Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d546d68-7705-4b98-a1e4-f516be4139c9 in vm_state suspended. Cannot resize while the instance is in this state. Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:00.255747 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 6d546d68-7705-4b98-a1e4-f516be4139c9 while it is in vm_state suspended Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:00.258952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:00.261353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:00.261353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:00.261353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 6d546d68-7705-4b98-a1e4-f516be4139c9 while it is in vm_state suspended Aug 25 12:44:00.261353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:00.261353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Returning 409 to user: Cannot 'migrate' instance 6d546d68-7705-4b98-a1e4-f516be4139c9 while it is in vm_state suspended {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:00.261353 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-14f6f9d8-6c53-44f1-a674-37606dfc5da5 tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9/action" status: 409 len: 148 microversion: 2.1 time: 0.210287 Aug 25 12:44:00.261353 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 405/804] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:44:00 2022] POST /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9/action => generated 148 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:44:00.267360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-136df34a-a6e6-484a-8dc3-190011a6eac6 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Action: 'update_all', calling method: .version_select at 0x7f3a2acc7040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:00.494675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-136df34a-a6e6-484a-8dc3-190011a6eac6 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:00.508250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-136df34a-a6e6-484a-8dc3-190011a6eac6 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for user 75d70fceee054b11aa1e8626e71e77e1 and project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:00.906249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:00.911037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:00.948380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:00.957169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:00.972123 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-be090181-668c-481c-83fe-fefbc56843b6 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1568 microversion: 2.25 time: 0.816955 Aug 25 12:44:00.973893 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 400/805] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:00 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1568 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:00.994520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10bcf4f2-24aa-4bd7-9cb8-624bdf69da18 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:00.996116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-10bcf4f2-24aa-4bd7-9cb8-624bdf69da18 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:01.023939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10bcf4f2-24aa-4bd7-9cb8-624bdf69da18 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:01.025217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10bcf4f2-24aa-4bd7-9cb8-624bdf69da18 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:01.026091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10bcf4f2-24aa-4bd7-9cb8-624bdf69da18 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:01.027760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10bcf4f2-24aa-4bd7-9cb8-624bdf69da18 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:01.028873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10bcf4f2-24aa-4bd7-9cb8-624bdf69da18 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:01.029638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10bcf4f2-24aa-4bd7-9cb8-624bdf69da18 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:01.421052 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-136df34a-a6e6-484a-8dc3-190011a6eac6 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 61 microversion: 2.1 time: 1.162519 Aug 25 12:44:01.424961 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 406/806] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:44:00 2022] PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 61 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:44:01.440786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fdbad154-b7b0-45cb-831e-36e686fb72e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2aa52790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:01.593958 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fdbad154-b7b0-45cb-831e-36e686fb72e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.163320 Aug 25 12:44:01.606450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 407/807] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:01 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:01.617455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:01.624416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:01.636393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:01.637492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:01.638276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:01.640634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:01.641480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:01.642282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:01.863857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:01.879723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Old instance type m1.heat2, new instance type m1.heat {{(pid=129060) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 12:44:01.896436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:44:01.897643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:44:01.898860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:44:01.899666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:44:01.900619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:44:01.949379 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-10bcf4f2-24aa-4bd7-9cb8-624bdf69da18 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1614 microversion: 2.1 time: 0.960751 Aug 25 12:44:01.962506 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 401/808] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:00 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1614 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:01.999507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf5af7a8-beeb-4902-90a3-bc24fa40cc8b tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf5af7a8-beeb-4902-90a3-bc24fa40cc8b tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Request method failure captured: Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df/action HTTP/1.1 Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 39 Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB25Cw7KN3_j7EN1sf3YYpHjTR_PovmHZWKiFuZ3dDM8_jlE2sOJjlwnmFoLBzylmZjLiex6dutxWZIJ-3GxfuNURvN1hfEambF0vtqaiVVNvBLznRd3CMDp27ZT9qPFpuhZXfenM8tLS1fkgvljjCH9gcmCX6LkI7RU1dEpVQZ_6rGg Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 89deae1918ae49f0919cb7b8ec6861eb Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:44:02.018251 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89deae1918ae49f0919cb7b8ec6861eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89deae1918ae49f0919cb7b8ec6861eb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89deae1918ae49f0919cb7b8ec6861eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89deae1918ae49f0919cb7b8ec6861eb"}]}] Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 89deae1918ae49f0919cb7b8ec6861eb Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersAdminNegativeTestJSON-752917378-project-admin Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: d96f6e5d9f044ba4a28338d925fb1eb3 Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersAdminNegativeTestJSON-752917378-project-admin Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: {"os-resetState": {"state": "invalid"}} Aug 25 12:44:02.021333 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'invalid' Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:02.023449 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:44:02.027029 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 25 12:44:02.036852 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:02.038631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf5af7a8-beeb-4902-90a3-bc24fa40cc8b tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:02.040435 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cf5af7a8-beeb-4902-90a3-bc24fa40cc8b tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df/action" status: 400 len: 144 microversion: 2.1 time: 0.076115 Aug 25 12:44:02.041987 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 402/809] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:44:01 2022] POST /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df/action => generated 144 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:44:02.068590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:02.070268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:02.091459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:02.093745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:02.095039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:02.096797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:02.099849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:02.101678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:02.257617 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c958ad7-73d8-4f1c-92b7-1fef42bb4388 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc/action" status: 202 len: 0 microversion: 2.1 time: 0.648965 Aug 25 12:44:02.264766 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 408/810] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:44:01 2022] POST /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:44:02.273535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-65f9c060-ce23-47af-8f7a-f3d3236326e8 req-b5dde0d7-e01c-4439-b7f0-339550b06473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f461f436-381b-4331-ac39-4a67d4a3efdc", "tag": "9f7b0b98-e0c1-4023-95f8-2759fe8df08d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:02.297196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:02.297997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-65f9c060-ce23-47af-8f7a-f3d3236326e8 req-b5dde0d7-e01c-4439-b7f0-339550b06473 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:02.298916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-65f9c060-ce23-47af-8f7a-f3d3236326e8 req-b5dde0d7-e01c-4439-b7f0-339550b06473 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:02.300363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-65f9c060-ce23-47af-8f7a-f3d3236326e8 req-b5dde0d7-e01c-4439-b7f0-339550b06473 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:02.324222 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-65f9c060-ce23-47af-8f7a-f3d3236326e8 req-b5dde0d7-e01c-4439-b7f0-339550b06473 service nova] Creating event network-changed:9f7b0b98-e0c1-4023-95f8-2759fe8df08d for instance f461f436-381b-4331-ac39-4a67d4a3efdc on n-h1-852771-8 Aug 25 12:44:02.326417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:02.331606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:02.334550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:02.339781 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-65f9c060-ce23-47af-8f7a-f3d3236326e8 req-b5dde0d7-e01c-4439-b7f0-339550b06473 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071993 Aug 25 12:44:02.341992 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 409/811] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:02.349464 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d68c57e7-a2ac-40b8-8cfd-648da86bc0a6 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.304744 Aug 25 12:44:02.352158 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 403/812] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:02 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:02.354306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0eb6df38-659a-41fd-84c4-11ad6d179c43 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Action: 'update', calling method: .version_select at 0x7f3a2ab075e0>, body: {"meta": {"os_version": "alt"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:02.367927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5fc45d9-3483-4011-99d4-418022adc830 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:02.369927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b5fc45d9-3483-4011-99d4-418022adc830 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:02.404094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5fc45d9-3483-4011-99d4-418022adc830 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:02.418720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5fc45d9-3483-4011-99d4-418022adc830 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:02.419683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5fc45d9-3483-4011-99d4-418022adc830 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:02.421255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5fc45d9-3483-4011-99d4-418022adc830 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:02.422945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5fc45d9-3483-4011-99d4-418022adc830 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:02.423786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5fc45d9-3483-4011-99d4-418022adc830 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:02.529285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-0eb6df38-659a-41fd-84c4-11ad6d179c43 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:02.551456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-0eb6df38-659a-41fd-84c4-11ad6d179c43 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for user 75d70fceee054b11aa1e8626e71e77e1 and project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:03.006429 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b5fc45d9-3483-4011-99d4-418022adc830 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1614 microversion: 2.1 time: 0.651509 Aug 25 12:44:03.018154 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 404/813] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:02 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1614 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:03.049042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:03.051951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:03.072084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:03.073627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:03.075669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:03.078468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:03.079795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:03.081339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:03.319158 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0eb6df38-659a-41fd-84c4-11ad6d179c43 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.973844 Aug 25 12:44:03.332077 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 410/814] 10.222.0.70 () {60 vars in 1313 bytes} [Thu Aug 25 12:44:02 2022] PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata/os_version => generated 31 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:44:03.359346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c092a45-2ec8-4cb4-8fcc-902fc3a4509a tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c092a45-2ec8-4cb4-8fcc-902fc3a4509a tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Request method failure captured: Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df/action HTTP/1.1 Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 31 Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Cw7KN3_j7EN1sf3YYpHjTR_PovmHZWKiFuZ3dDM8_jlE2sOJjlwnmFoLBzylmZjLiex6dutxWZIJ-3GxfuNURvN1hfEambF0vtqaiVVNvBLznRd3CMDp27ZT9qPFpuhZXfenM8tLS1fkgvljjCH9gcmCX6LkI7RU1dEpVQZ_6rGg Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 89deae1918ae49f0919cb7b8ec6861eb Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:44:03.366092 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89deae1918ae49f0919cb7b8ec6861eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89deae1918ae49f0919cb7b8ec6861eb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89deae1918ae49f0919cb7b8ec6861eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89deae1918ae49f0919cb7b8ec6861eb"}]}] Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 89deae1918ae49f0919cb7b8ec6861eb Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersAdminNegativeTestJSON-752917378-project-admin Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d96f6e5d9f044ba4a28338d925fb1eb3 Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersAdminNegativeTestJSON-752917378-project-admin Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: {"os-resetState": {"state": 1}} Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:44:03.370523 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df', 'body': {'os-resetState': {'state': 1}}} Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 1 Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:03.372271 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 25 12:44:03.375854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:03.380706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c092a45-2ec8-4cb4-8fcc-902fc3a4509a tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:03.380706 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c092a45-2ec8-4cb4-8fcc-902fc3a4509a tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df/action" status: 400 len: 120 microversion: 2.1 time: 0.034796 Aug 25 12:44:03.399238 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 411/815] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:44:03 2022] POST /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df/action => generated 120 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:44:03.442237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4dbb08a4-5750-46f6-b0a7-b2c6d7952460 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:03.445145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4dbb08a4-5750-46f6-b0a7-b2c6d7952460 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:03.478848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4dbb08a4-5750-46f6-b0a7-b2c6d7952460 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:03.480351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4dbb08a4-5750-46f6-b0a7-b2c6d7952460 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:03.481085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4dbb08a4-5750-46f6-b0a7-b2c6d7952460 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:03.485575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4dbb08a4-5750-46f6-b0a7-b2c6d7952460 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:03.487850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4dbb08a4-5750-46f6-b0a7-b2c6d7952460 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:03.491206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4dbb08a4-5750-46f6-b0a7-b2c6d7952460 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:03.562522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:03.587728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:03.591121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:03.595814 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-216f2839-6ec2-4b6d-b056-26541425dab4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1568 microversion: 2.25 time: 0.571901 Aug 25 12:44:03.597807 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 405/816] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:03 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1568 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:03.625626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dbeada9b-bcac-4ce2-bddd-286c0fd9bbd6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a997310>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:03.789711 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dbeada9b-bcac-4ce2-bddd-286c0fd9bbd6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.188241 Aug 25 12:44:03.792738 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 406/817] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:03 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:03.802428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-31e47b14-cc47-4c1d-af5b-41aec61207f3 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:03.815948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-31e47b14-cc47-4c1d-af5b-41aec61207f3 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Searching by: {'host': 'n-h1-852771-8', 'deleted': False} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:44:03.831953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31e47b14-cc47-4c1d-af5b-41aec61207f3 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:03.833434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31e47b14-cc47-4c1d-af5b-41aec61207f3 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:03.834722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31e47b14-cc47-4c1d-af5b-41aec61207f3 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:03.836569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31e47b14-cc47-4c1d-af5b-41aec61207f3 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:03.837992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31e47b14-cc47-4c1d-af5b-41aec61207f3 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:03.839250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31e47b14-cc47-4c1d-af5b-41aec61207f3 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:03.902894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4dbb08a4-5750-46f6-b0a7-b2c6d7952460 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:03.926888 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4dbb08a4-5750-46f6-b0a7-b2c6d7952460 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1472 microversion: 2.1 time: 0.523769 Aug 25 12:44:03.941684 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 412/818] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:03 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1472 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:03.941684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5600d7f2-f008-4b69-82f4-325bec8ca59d tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Calling method '.version_select at 0x7f3a2ad873a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:04.121208 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5600d7f2-f008-4b69-82f4-325bec8ca59d tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 58 microversion: 2.1 time: 0.187808 Aug 25 12:44:04.126476 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 413/819] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:44:03 2022] GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 58 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:44:04.139463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-31e47b14-cc47-4c1d-af5b-41aec61207f3 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:44:04.152652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f16bf1e1-a268-44d2-85d5-92d73099981a tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:04.168354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f16bf1e1-a268-44d2-85d5-92d73099981a tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Failed to fetch instance by id 999 {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 12:44:04.169697 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f16bf1e1-a268-44d2-85d5-92d73099981a tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f16bf1e1-a268-44d2-85d5-92d73099981a tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Request method failure captured: Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 37 Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Cw7KN3_j7EN1sf3YYpHjTR_PovmHZWKiFuZ3dDM8_jlE2sOJjlwnmFoLBzylmZjLiex6dutxWZIJ-3GxfuNURvN1hfEambF0vtqaiVVNvBLznRd3CMDp27ZT9qPFpuhZXfenM8tLS1fkgvljjCH9gcmCX6LkI7RU1dEpVQZ_6rGg Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 89deae1918ae49f0919cb7b8ec6861eb Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:44:04.191545 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89deae1918ae49f0919cb7b8ec6861eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89deae1918ae49f0919cb7b8ec6861eb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89deae1918ae49f0919cb7b8ec6861eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89deae1918ae49f0919cb7b8ec6861eb"}]}] Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 89deae1918ae49f0919cb7b8ec6861eb Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-752917378 Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersAdminNegativeTestJSON-752917378-project-admin Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d96f6e5d9f044ba4a28338d925fb1eb3 Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersAdminNegativeTestJSON-752917378-project-admin Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: {"os-resetState": {"state": "error"}} Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:44:04.194575 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 999 could not be found. Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:44:04.196384 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f16bf1e1-a268-44d2-85d5-92d73099981a tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:04.199263 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f16bf1e1-a268-44d2-85d5-92d73099981a tempest-ServersAdminNegativeTestJSON-752917378 tempest-ServersAdminNegativeTestJSON-752917378-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.065763 Aug 25 12:44:04.201255 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 414/820] 10.222.0.70 () {60 vars in 1179 bytes} [Thu Aug 25 12:44:04 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:44:04.245029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:04.246592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:04.299877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:04.300523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:04.301377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:04.330139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:04.331647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:04.331858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:04.483391 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-31e47b14-cc47-4c1d-af5b-41aec61207f3 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers?host=n-h1-852771-8&all_tenants=1" status: 200 len: 1658 microversion: 2.1 time: 0.687693 Aug 25 12:44:04.500178 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 407/821] 10.222.0.70 () {58 vars in 1190 bytes} [Thu Aug 25 12:44:03 2022] GET /compute/v2.1/servers?host=n-h1-852771-8&all_tenants=1 => generated 1658 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:04.510593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0a0d34dc-b56c-4e5d-8a1b-0d350e770943 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Action: 'update_all', calling method: .version_select at 0x7f3a2a8d3dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:04.532695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:04.584185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:04.598454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:04.627958 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fc56ec51-f911-425c-817b-a3dcd7332181 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1447 microversion: 2.75 time: 0.419746 Aug 25 12:44:04.630158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 415/822] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:04 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1447 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:04.650899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7d01588-184a-47c0-a62a-e3577d31f3a1 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:04.660154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b7d01588-184a-47c0-a62a-e3577d31f3a1 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:04.671534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:04.690640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7d01588-184a-47c0-a62a-e3577d31f3a1 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:04.694714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7d01588-184a-47c0-a62a-e3577d31f3a1 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:04.696762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7d01588-184a-47c0-a62a-e3577d31f3a1 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:04.704802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7d01588-184a-47c0-a62a-e3577d31f3a1 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:04.707412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7d01588-184a-47c0-a62a-e3577d31f3a1 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:04.708753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7d01588-184a-47c0-a62a-e3577d31f3a1 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:04.729418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0a0d34dc-b56c-4e5d-8a1b-0d350e770943 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:04.745591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0a0d34dc-b56c-4e5d-8a1b-0d350e770943 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for user 75d70fceee054b11aa1e8626e71e77e1 and project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:04.964120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b7d01588-184a-47c0-a62a-e3577d31f3a1 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:44:05.352243 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b7d01588-184a-47c0-a62a-e3577d31f3a1 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 204 len: 0 microversion: 2.1 time: 0.718744 Aug 25 12:44:05.353331 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 416/823] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:44:04 2022] DELETE /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:05.384764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-35d4f179-29af-4689-b0a1-6189d25e6cab tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:05.418794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-35d4f179-29af-4689-b0a1-6189d25e6cab tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:44:05.453401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d4f179-29af-4689-b0a1-6189d25e6cab tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:05.454274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d4f179-29af-4689-b0a1-6189d25e6cab tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:05.455095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d4f179-29af-4689-b0a1-6189d25e6cab tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:05.462718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d4f179-29af-4689-b0a1-6189d25e6cab tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:05.463815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d4f179-29af-4689-b0a1-6189d25e6cab tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:05.464648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d4f179-29af-4689-b0a1-6189d25e6cab tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:05.789473 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-35d4f179-29af-4689-b0a1-6189d25e6cab tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.418826 Aug 25 12:44:05.790859 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 417/824] 10.222.0.70 () {58 vars in 1196 bytes} [Thu Aug 25 12:44:05 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:44:05.802707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:05.804841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:05.834275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:05.835715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:05.837111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:05.839763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:05.848259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:05.850141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:06.001341 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0a0d34dc-b56c-4e5d-8a1b-0d350e770943 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 61 microversion: 2.1 time: 1.498499 Aug 25 12:44:06.003831 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 408/825] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:44:04 2022] PUT /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 61 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:44:06.024905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-57b42dc0-ebe1-49ce-a581-158827b30e4c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a873d30>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:06.200817 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-57b42dc0-ebe1-49ce-a581-158827b30e4c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.191446 Aug 25 12:44:06.204575 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 409/826] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:06 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:06.216532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b7d2a46b-9443-44f5-8e45-665e78079af4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:06.218848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b7d2a46b-9443-44f5-8e45-665e78079af4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:06.244403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7d2a46b-9443-44f5-8e45-665e78079af4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:06.247187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7d2a46b-9443-44f5-8e45-665e78079af4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:06.249557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7d2a46b-9443-44f5-8e45-665e78079af4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:06.252202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7d2a46b-9443-44f5-8e45-665e78079af4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:06.254133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7d2a46b-9443-44f5-8e45-665e78079af4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:06.255386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7d2a46b-9443-44f5-8e45-665e78079af4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:06.632444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b7d2a46b-9443-44f5-8e45-665e78079af4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:06.666196 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b7d2a46b-9443-44f5-8e45-665e78079af4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1472 microversion: 2.1 time: 0.455168 Aug 25 12:44:06.687199 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 410/827] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:06 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1472 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:06.713303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4ce96053-2afe-4b2e-92a9-201b7aeb8c70 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:06.721191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4ce96053-2afe-4b2e-92a9-201b7aeb8c70 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:06.750234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ce96053-2afe-4b2e-92a9-201b7aeb8c70 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:06.751700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ce96053-2afe-4b2e-92a9-201b7aeb8c70 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:06.752909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ce96053-2afe-4b2e-92a9-201b7aeb8c70 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:06.760323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ce96053-2afe-4b2e-92a9-201b7aeb8c70 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:06.761150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ce96053-2afe-4b2e-92a9-201b7aeb8c70 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:06.762024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ce96053-2afe-4b2e-92a9-201b7aeb8c70 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:06.782073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:06.822352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:06.830471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:06.837185 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a12af50-b1e3-4e9a-bbbc-c96f3389545f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1568 microversion: 2.25 time: 1.044075 Aug 25 12:44:06.840620 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 418/828] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:05 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1568 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:06.853770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:06.867886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:06.891985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:06.893972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:06.895184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:06.897263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:06.898610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:06.899710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:07.104311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:07.150427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:07.154889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:07.207687 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74017937-03dc-4e85-af3f-34e8a5583b18 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1453 microversion: 2.75 time: 0.360713 Aug 25 12:44:07.211158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 419/829] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:06 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1453 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:07.228054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0dcb73cc-0305-45ec-b7aa-141f60e7d4ea tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:07.235946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0dcb73cc-0305-45ec-b7aa-141f60e7d4ea tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:07.250965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0dcb73cc-0305-45ec-b7aa-141f60e7d4ea tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:07.252816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0dcb73cc-0305-45ec-b7aa-141f60e7d4ea tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:07.254332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0dcb73cc-0305-45ec-b7aa-141f60e7d4ea tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:07.256062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0dcb73cc-0305-45ec-b7aa-141f60e7d4ea tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:07.258310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0dcb73cc-0305-45ec-b7aa-141f60e7d4ea tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:07.259742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0dcb73cc-0305-45ec-b7aa-141f60e7d4ea tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:07.374596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4ce96053-2afe-4b2e-92a9-201b7aeb8c70 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:07.394564 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4ce96053-2afe-4b2e-92a9-201b7aeb8c70 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1469 microversion: 2.1 time: 0.704397 Aug 25 12:44:07.396716 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 411/830] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:06 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1469 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:07.422261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d752e6e0-1427-4201-99ee-d7f05c3f8b5b tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Action: 'create', calling method: .version_select at 0x7f3a2a887940>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:07.512436 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0dcb73cc-0305-45ec-b7aa-141f60e7d4ea tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.297621 Aug 25 12:44:07.518949 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 420/831] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:44:07 2022] POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:44:07.533540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7129dc79-4c14-4f1d-b4c8-69096a8441f0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2ae36f70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:07.571540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d752e6e0-1427-4201-99ee-d7f05c3f8b5b tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:07.586761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d752e6e0-1427-4201-99ee-d7f05c3f8b5b tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Getting quotas for user 75d70fceee054b11aa1e8626e71e77e1 and project 6c6a7cb412774afe9049b759df06954a. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:07.737106 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7129dc79-4c14-4f1d-b4c8-69096a8441f0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.221435 Aug 25 12:44:07.738240 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 421/832] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:07 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:07.748820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:07.756338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:07.790090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:07.791319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:07.797224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:07.809199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:07.819149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:07.819149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:08.365742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:44:08.365742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:44:08.365742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:44:08.365742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:44:08.365742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:44:08.377066 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d752e6e0-1427-4201-99ee-d7f05c3f8b5b tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "POST /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 85 microversion: 2.1 time: 0.975376 Aug 25 12:44:08.385209 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 412/833] 10.222.0.70 () {60 vars in 1281 bytes} [Thu Aug 25 12:44:07 2022] POST /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 85 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:44:08.401702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:08.411006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f3b70d1-141b-4d47-b33a-b039c70a8050 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:08.412268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f3b70d1-141b-4d47-b33a-b039c70a8050 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:08.432699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3b70d1-141b-4d47-b33a-b039c70a8050 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:08.437485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3b70d1-141b-4d47-b33a-b039c70a8050 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:08.437485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3b70d1-141b-4d47-b33a-b039c70a8050 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:08.437485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3b70d1-141b-4d47-b33a-b039c70a8050 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:08.437485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3b70d1-141b-4d47-b33a-b039c70a8050 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:08.442760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3b70d1-141b-4d47-b33a-b039c70a8050 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:08.620614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:08.654031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:08.655796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:08.658627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:08.661944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:08.663374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:08.664703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:08.745784 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-424f1910-8498-4016-af07-bbdaae5e9038 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action" status: 202 len: 1067 microversion: 2.1 time: 1.005445 Aug 25 12:44:08.751071 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 422/834] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:44:07 2022] POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action => generated 1067 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 25 12:44:08.771508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:08.773335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:08.790138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:08.791998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:08.794478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:08.797333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:08.798976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:08.800381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:09.052190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2f3b70d1-141b-4d47-b33a-b039c70a8050 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:09.074702 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f3b70d1-141b-4d47-b33a-b039c70a8050 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1472 microversion: 2.1 time: 0.694660 Aug 25 12:44:09.077245 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 413/835] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:08 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1472 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:09.134450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:09.135908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:09.169105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:09.170567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:09.175993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:09.180238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:09.181007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:09.184576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:09.339821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:09.369089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:09.380938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:09.386736 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e2f537b7-dadb-4fe1-b885-78b32c78b83c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1568 microversion: 2.25 time: 0.629872 Aug 25 12:44:09.431822 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 423/836] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:08 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1568 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:09.459005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efec2f58-a9d2-499e-b7a2-e21007c89c46 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] Calling method '.version_select at 0x7f3a2a7a3790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:09.507005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:09.533246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:09.536960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:09.552512 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d70c0f8a-92d5-48f8-91af-84df6866b058 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1453 microversion: 2.75 time: 0.472604 Aug 25 12:44:09.554447 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 414/837] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:09 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1453 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:09.564990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03ac2d08-c510-4476-b712-64789825e131 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:09.569027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-03ac2d08-c510-4476-b712-64789825e131 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:09.595780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03ac2d08-c510-4476-b712-64789825e131 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:09.599757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03ac2d08-c510-4476-b712-64789825e131 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:09.604258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03ac2d08-c510-4476-b712-64789825e131 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:09.607138 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-efec2f58-a9d2-499e-b7a2-e21007c89c46 tempest-ImagesMetadataTestJSON-1213414537 tempest-ImagesMetadataTestJSON-1213414537-project] 10.222.0.70 "GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata" status: 200 len: 85 microversion: 2.1 time: 0.172844 Aug 25 12:44:09.610993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03ac2d08-c510-4476-b712-64789825e131 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:09.611669 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 424/838] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:44:09 2022] GET /compute/v2.1/images/f7f06d66-08a8-436a-83a4-4d6b3aa83309/metadata => generated 85 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:44:09.612714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03ac2d08-c510-4476-b712-64789825e131 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:09.614512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03ac2d08-c510-4476-b712-64789825e131 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:09.652400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-20bacbf7-7c62-400b-9c0f-44ea9135a5a0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2afa3a60>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:10.099000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03ac2d08-c510-4476-b712-64789825e131 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:10.127152 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-03ac2d08-c510-4476-b712-64789825e131 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1469 microversion: 2.1 time: 0.570420 Aug 25 12:44:10.136372 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 415/839] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:09 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1469 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:10.179319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-212377f3-75b0-4b36-a4b0-82b795219242 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:10.183146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-212377f3-75b0-4b36-a4b0-82b795219242 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:10.208695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-212377f3-75b0-4b36-a4b0-82b795219242 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:10.210722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-212377f3-75b0-4b36-a4b0-82b795219242 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:10.213347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-212377f3-75b0-4b36-a4b0-82b795219242 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:10.219122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-212377f3-75b0-4b36-a4b0-82b795219242 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:10.220727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-212377f3-75b0-4b36-a4b0-82b795219242 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:10.225382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-212377f3-75b0-4b36-a4b0-82b795219242 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:11.034393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-212377f3-75b0-4b36-a4b0-82b795219242 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:11.063820 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-212377f3-75b0-4b36-a4b0-82b795219242 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1471 microversion: 2.1 time: 0.922526 Aug 25 12:44:11.067363 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 416/840] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:10 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1471 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:11.088625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb2724b8-a142-4966-abec-6783eb58e782 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:11.098093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fb2724b8-a142-4966-abec-6783eb58e782 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:11.120388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb2724b8-a142-4966-abec-6783eb58e782 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:11.122786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb2724b8-a142-4966-abec-6783eb58e782 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:11.124217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb2724b8-a142-4966-abec-6783eb58e782 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:11.125590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb2724b8-a142-4966-abec-6783eb58e782 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:11.128827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb2724b8-a142-4966-abec-6783eb58e782 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:11.129713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb2724b8-a142-4966-abec-6783eb58e782 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:11.640342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fb2724b8-a142-4966-abec-6783eb58e782 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:11.675093 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb2724b8-a142-4966-abec-6783eb58e782 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1472 microversion: 2.1 time: 0.606040 Aug 25 12:44:11.686642 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 417/841] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:11 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1472 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:11.728938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:11.730387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:11.797983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:11.798852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:11.799888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:11.801546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:11.802340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:11.803102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:12.089974 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-20bacbf7-7c62-400b-9c0f-44ea9135a5a0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 2.470846 Aug 25 12:44:12.093101 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 425/842] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:09 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 2481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:12.128181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:12.131552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:12.168908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:12.169415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:12.189241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:12.190637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:12.191565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:12.192031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:12.574774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=26 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:12.845879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:12.887132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:12.892401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:12.917177 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-48318029-1772-4d5d-9f56-b31c553e7dba tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1453 microversion: 2.75 time: 0.816994 Aug 25 12:44:12.938584 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 426/843] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:12 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1453 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:12.974326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:12.976052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:12.989846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:12.991497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:12.992744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:12.995704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:12.997594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:12.999433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:13.121880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:13.124346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:13.126529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:13.128119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lazy-loading 'fault' on Instance uuid 6d546d68-7705-4b98-a1e4-f516be4139c9 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:13.320459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:13.360716 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a1a4d23e-9153-4498-8669-02f35fb85044 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 200 len: 1312 microversion: 2.1 time: 0.415317 Aug 25 12:44:13.382078 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 427/844] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:12 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 1312 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:13.390269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:13.414014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-076e90ce-31e6-4ef7-99ef-1b5bc946fedf tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:13.416503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-076e90ce-31e6-4ef7-99ef-1b5bc946fedf tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:13.430763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:13.442371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:13.444688 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-485affab-1382-40a9-b4e3-f109cec22501 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1568 microversion: 2.25 time: 1.752840 Aug 25 12:44:13.447593 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 418/845] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:11 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1568 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:13.482739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-076e90ce-31e6-4ef7-99ef-1b5bc946fedf tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:13.486713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-076e90ce-31e6-4ef7-99ef-1b5bc946fedf tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:13.491809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-076e90ce-31e6-4ef7-99ef-1b5bc946fedf tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:13.493671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-076e90ce-31e6-4ef7-99ef-1b5bc946fedf tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:13.501322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-076e90ce-31e6-4ef7-99ef-1b5bc946fedf tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:13.509806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-076e90ce-31e6-4ef7-99ef-1b5bc946fedf tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:13.925465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:14.316366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-076e90ce-31e6-4ef7-99ef-1b5bc946fedf tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:14.347649 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-076e90ce-31e6-4ef7-99ef-1b5bc946fedf tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1471 microversion: 2.1 time: 0.962378 Aug 25 12:44:14.349698 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 428/846] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:13 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1471 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:14.363976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5fdc12ef-2b48-4bcf-96b9-48c010100772 req-46ea0c14-b0b6-4a74-aaf8-d3896e24aace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d546d68-7705-4b98-a1e4-f516be4139c9", "name": "network-vif-deleted", "tag": "72572e80-1880-4512-a8b4-c77e931a7bbc"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:14.391696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5fdc12ef-2b48-4bcf-96b9-48c010100772 req-46ea0c14-b0b6-4a74-aaf8-d3896e24aace service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:14.393244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5fdc12ef-2b48-4bcf-96b9-48c010100772 req-46ea0c14-b0b6-4a74-aaf8-d3896e24aace service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:14.394521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5fdc12ef-2b48-4bcf-96b9-48c010100772 req-46ea0c14-b0b6-4a74-aaf8-d3896e24aace service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:14.439745 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5fdc12ef-2b48-4bcf-96b9-48c010100772 req-46ea0c14-b0b6-4a74-aaf8-d3896e24aace service nova] Creating event network-vif-deleted:72572e80-1880-4512-a8b4-c77e931a7bbc for instance 6d546d68-7705-4b98-a1e4-f516be4139c9 on n-h2-852771-8 Aug 25 12:44:14.456122 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5fdc12ef-2b48-4bcf-96b9-48c010100772 req-46ea0c14-b0b6-4a74-aaf8-d3896e24aace service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103811 Aug 25 12:44:14.470685 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 429/847] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:14.502273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb2f4c19-a4d7-4c52-8836-82d72a1212ea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:14.507183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb2f4c19-a4d7-4c52-8836-82d72a1212ea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:14.509860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c68001e1-9658-40a8-9c4a-8c5fb7dbc0b8 tempest-FlavorMetadataValidation-1809676843 tempest-FlavorMetadataValidation-1809676843-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-274007328", "id": 132622786, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:14.563665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb2f4c19-a4d7-4c52-8836-82d72a1212ea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:14.568162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb2f4c19-a4d7-4c52-8836-82d72a1212ea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:14.575477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb2f4c19-a4d7-4c52-8836-82d72a1212ea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:14.582902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb2f4c19-a4d7-4c52-8836-82d72a1212ea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:14.587967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb2f4c19-a4d7-4c52-8836-82d72a1212ea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:14.591181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb2f4c19-a4d7-4c52-8836-82d72a1212ea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:14.658189 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c68001e1-9658-40a8-9c4a-8c5fb7dbc0b8 tempest-FlavorMetadataValidation-1809676843 tempest-FlavorMetadataValidation-1809676843-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 1.207990 Aug 25 12:44:14.662953 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 419/848] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 12:44:13 2022] POST /compute/v2.1/flavors => generated 467 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:44:14.684929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-51e51345-7297-46de-a83b-fbb7ca288564 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a887d30>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:14.843235 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-51e51345-7297-46de-a83b-fbb7ca288564 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.177818 Aug 25 12:44:14.850765 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 420/849] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:14 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:14.887860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:14.889689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:14.919037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:14.923267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:14.924443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:14.929852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:14.935705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:14.936624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:15.176919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:15.210726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:15.218891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:15.246054 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0203899d-26e0-4275-97d5-aef1f8fcc739 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1438 microversion: 2.75 time: 0.377209 Aug 25 12:44:15.247118 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 421/850] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:14 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1438 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:15.265766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:15.267437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 6d546d68-7705-4b98-a1e4-f516be4139c9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:15.285035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:15.286418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:15.287716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:15.289436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:15.293170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:15.295827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:15.305197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cb2f4c19-a4d7-4c52-8836-82d72a1212ea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:15.339470 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] HTTP exception thrown: Instance 6d546d68-7705-4b98-a1e4-f516be4139c9 could not be found. Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Request method failure captured: Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 HTTP/1.1 Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB25AUDdrRzbvauO9SAob80mBUcYQBcDW6hGdmqM-VtV6TNJJRQocfTlcLi1T80u978IWPL0mYDkAKI1dy-wcJfyd3aLvuKMWcMo5dx93s8CEmrXjpGwOLNBWsUhytEMilFqZNsRSp2liop2tKysSFTs3mzqn1JIMqM6UpXBNJ9aDrK0 Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d33ffb23724e4333a2a0bc502c7f8854 Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1826019730 Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:44:15.344240 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d33ffb23724e4333a2a0bc502c7f8854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d33ffb23724e4333a2a0bc502c7f8854", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d33ffb23724e4333a2a0bc502c7f8854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d33ffb23724e4333a2a0bc502c7f8854"}]}] Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1826019730 Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d33ffb23724e4333a2a0bc502c7f8854 Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1826019730 Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersAdminNegativeTestJSON-1826019730-project Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 9c85f30678174c6b99732ef70898b803 Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1826019730-project Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 6d546d68-7705-4b98-a1e4-f516be4139c9 could not be found. Aug 25 12:44:15.347369 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '6d546d68-7705-4b98-a1e4-f516be4139c9'} Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d546d68-7705-4b98-a1e4-f516be4139c9 could not be found. Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:15.350155 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d546d68-7705-4b98-a1e4-f516be4139c9 could not be found. Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d546d68-7705-4b98-a1e4-f516be4139c9 could not be found. Aug 25 12:44:15.353124 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:15.355570 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb2f4c19-a4d7-4c52-8836-82d72a1212ea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 0.869857 Aug 25 12:44:15.358623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Returning 404 to user: Instance 6d546d68-7705-4b98-a1e4-f516be4139c9 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:15.360627 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a8756efd-10be-4536-aa78-688fe0f1445a tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9" status: 404 len: 111 microversion: 2.1 time: 0.104827 Aug 25 12:44:15.362662 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 422/851] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:15 2022] GET /compute/v2.1/servers/6d546d68-7705-4b98-a1e4-f516be4139c9 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:15.364089 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 430/852] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:14 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:15.397551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:15.398465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a717a32-8068-4190-a483-936f5b04280c tempest-FlavorMetadataValidation-1809676843 tempest-FlavorMetadataValidation-1809676843-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:15.402769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:15.437708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:15.439553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:15.441633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:15.444052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:15.445688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:15.447067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:15.900458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:15.902633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:15.943814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:15.947437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:15.952330 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-88290ca0-e9f8-4b02-8602-eee2fd6ca1d8 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1543 microversion: 2.25 time: 0.587083 Aug 25 12:44:15.954457 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 423/853] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:15 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1543 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:16.024641 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a717a32-8068-4190-a483-936f5b04280c tempest-FlavorMetadataValidation-1809676843 tempest-FlavorMetadataValidation-1809676843-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/132622786/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.655546 Aug 25 12:44:16.026552 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 431/854] 10.222.0.70 () {62 vars in 1262 bytes} [Thu Aug 25 12:44:15 2022] POST /compute/v2.1/flavors/132622786/os-extra_specs => generated 62 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:16.042769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cd2a47bb-0ea7-4e44-8371-299ba44a50a2 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:16.044197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cd2a47bb-0ea7-4e44-8371-299ba44a50a2 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:16.062794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2a47bb-0ea7-4e44-8371-299ba44a50a2 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.064408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2a47bb-0ea7-4e44-8371-299ba44a50a2 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.069458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2a47bb-0ea7-4e44-8371-299ba44a50a2 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.071884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2a47bb-0ea7-4e44-8371-299ba44a50a2 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.074343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2a47bb-0ea7-4e44-8371-299ba44a50a2 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.075373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2a47bb-0ea7-4e44-8371-299ba44a50a2 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.221393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cd2a47bb-0ea7-4e44-8371-299ba44a50a2 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:44:16.553717 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cd2a47bb-0ea7-4e44-8371-299ba44a50a2 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 204 len: 0 microversion: 2.1 time: 0.522675 Aug 25 12:44:16.555299 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 432/855] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:44:16 2022] DELETE /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:16.571875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6de8428-7cc7-4d1c-91f4-0a6f694df2db tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:16.571875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c6de8428-7cc7-4d1c-91f4-0a6f694df2db tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:16.583083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6de8428-7cc7-4d1c-91f4-0a6f694df2db tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.584082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6de8428-7cc7-4d1c-91f4-0a6f694df2db tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.584905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6de8428-7cc7-4d1c-91f4-0a6f694df2db tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.586525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6de8428-7cc7-4d1c-91f4-0a6f694df2db tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.587395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6de8428-7cc7-4d1c-91f4-0a6f694df2db tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.588172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6de8428-7cc7-4d1c-91f4-0a6f694df2db tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.696482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:16.706879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:16.725709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.728127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.729803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.739475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.741411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.742706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.950522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c6de8428-7cc7-4d1c-91f4-0a6f694df2db tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:16.991104 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6de8428-7cc7-4d1c-91f4-0a6f694df2db tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1471 microversion: 2.1 time: 0.433438 Aug 25 12:44:16.995512 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 433/856] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:16 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:17.020143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70fa79cc-a7ff-4291-8955-576f31ed4f4e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a6c6790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:17.044021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:17.078942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:44:17.080171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:44:17.081598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:44:17.083427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:44:17.085020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:44:17.177596 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70fa79cc-a7ff-4291-8955-576f31ed4f4e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.176986 Aug 25 12:44:17.187236 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 434/857] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:16 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:17.200458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-361a070f-c707-4ca7-aba7-a98aab82b2fa tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '.version_select at 0x7f3a2a6c6820>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:17.215564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-361a070f-c707-4ca7-aba7-a98aab82b2fa tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:17.225542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-361a070f-c707-4ca7-aba7-a98aab82b2fa tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:17.229724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-361a070f-c707-4ca7-aba7-a98aab82b2fa tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:17.270705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:17.290236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:17.298359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:17.302784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:17.305968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:17.307078 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-361a070f-c707-4ca7-aba7-a98aab82b2fa tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.115567 Aug 25 12:44:17.307805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:17.310997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:17.312564 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 435/858] 10.222.0.70 () {60 vars in 1184 bytes} [Thu Aug 25 12:44:17 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:17.349898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f5989e8f-5eb3-4f11-add7-f28bb69abcd7 tempest-FlavorMetadataValidation-1809676843 tempest-FlavorMetadataValidation-1809676843-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:17.424148 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f5989e8f-5eb3-4f11-add7-f28bb69abcd7 tempest-FlavorMetadataValidation-1809676843 tempest-FlavorMetadataValidation-1809676843-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/132622786" status: 202 len: 0 microversion: 2.86 time: 0.105283 Aug 25 12:44:17.434422 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 436/859] 10.222.0.70 () {60 vars in 1199 bytes} [Thu Aug 25 12:44:17 2022] DELETE /compute/v2.1/flavors/132622786 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:17.455992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f3d0257b-d8d4-4005-9dd7-67d6a12d2f0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:17.461023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f3d0257b-d8d4-4005-9dd7-67d6a12d2f0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:17.506756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d0257b-d8d4-4005-9dd7-67d6a12d2f0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:17.511961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d0257b-d8d4-4005-9dd7-67d6a12d2f0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:17.518444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d0257b-d8d4-4005-9dd7-67d6a12d2f0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:17.524266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d0257b-d8d4-4005-9dd7-67d6a12d2f0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:17.526953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d0257b-d8d4-4005-9dd7-67d6a12d2f0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:17.532196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d0257b-d8d4-4005-9dd7-67d6a12d2f0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:17.619127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=14 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:17.712010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:17.784700 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5f493ea4-48cf-41ea-996d-960d8f785883 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23/action" status: 202 len: 1942 microversion: 2.75 time: 1.827475 Aug 25 12:44:17.786335 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 424/860] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 12:44:15 2022] POST /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23/action => generated 1942 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 25 12:44:17.805658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-46dcc5df-60e2-47b8-96b5-66ea3d5d7934 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:17.809329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-46dcc5df-60e2-47b8-96b5-66ea3d5d7934 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:17.832450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46dcc5df-60e2-47b8-96b5-66ea3d5d7934 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:17.834733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46dcc5df-60e2-47b8-96b5-66ea3d5d7934 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:17.835966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46dcc5df-60e2-47b8-96b5-66ea3d5d7934 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:17.838210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46dcc5df-60e2-47b8-96b5-66ea3d5d7934 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:17.839522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46dcc5df-60e2-47b8-96b5-66ea3d5d7934 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:17.840243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46dcc5df-60e2-47b8-96b5-66ea3d5d7934 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:18.353456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f3d0257b-d8d4-4005-9dd7-67d6a12d2f0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:18.402750 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f3d0257b-d8d4-4005-9dd7-67d6a12d2f0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 0.964414 Aug 25 12:44:18.403940 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 437/861] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:17 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:18.414481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b51bef4-60d3-4ab1-979d-719d5f340ce7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:18.431385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b51bef4-60d3-4ab1-979d-719d5f340ce7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:18.464698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b51bef4-60d3-4ab1-979d-719d5f340ce7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:18.467890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b51bef4-60d3-4ab1-979d-719d5f340ce7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:18.474953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b51bef4-60d3-4ab1-979d-719d5f340ce7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:18.476308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b51bef4-60d3-4ab1-979d-719d5f340ce7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:18.477538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b51bef4-60d3-4ab1-979d-719d5f340ce7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:18.482627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b51bef4-60d3-4ab1-979d-719d5f340ce7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:18.525152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-46dcc5df-60e2-47b8-96b5-66ea3d5d7934 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:18.547191 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-46dcc5df-60e2-47b8-96b5-66ea3d5d7934 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1477 microversion: 2.1 time: 0.757529 Aug 25 12:44:18.549937 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 425/862] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:17 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1477 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:18.571817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-644e843e-7c37-4957-ba71-319f25fedc32 tempest-FlavorMetadataValidation-1809676843 tempest-FlavorMetadataValidation-1809676843-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:18.633629 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-644e843e-7c37-4957-ba71-319f25fedc32 tempest-FlavorMetadataValidation-1809676843 tempest-FlavorMetadataValidation-1809676843-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.078786 Aug 25 12:44:18.634560 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 426/863] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 12:44:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:18.680656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9b0d5bca-7a4f-4e00-bb02-1cf73479622e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:18.681469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9b0d5bca-7a4f-4e00-bb02-1cf73479622e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:18.720008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b0d5bca-7a4f-4e00-bb02-1cf73479622e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:18.721197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b0d5bca-7a4f-4e00-bb02-1cf73479622e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:18.722080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b0d5bca-7a4f-4e00-bb02-1cf73479622e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:18.723534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b0d5bca-7a4f-4e00-bb02-1cf73479622e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:18.730565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b0d5bca-7a4f-4e00-bb02-1cf73479622e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:18.731360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b0d5bca-7a4f-4e00-bb02-1cf73479622e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:19.020719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-9b0d5bca-7a4f-4e00-bb02-1cf73479622e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:19.082130 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9b0d5bca-7a4f-4e00-bb02-1cf73479622e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.442289 Aug 25 12:44:19.083204 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 427/864] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:18 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:19.093416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-4b51bef4-60d3-4ab1-979d-719d5f340ce7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid f461f436-381b-4331-ac39-4a67d4a3efdc {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:19.172766 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b51bef4-60d3-4ab1-979d-719d5f340ce7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 2035 microversion: 2.25 time: 0.766141 Aug 25 12:44:19.173860 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 438/865] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:18 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 2035 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:19.184396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e2c10ec-774d-45dd-be0a-f5003348b4e1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:19.185812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4e2c10ec-774d-45dd-be0a-f5003348b4e1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:19.226483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e2c10ec-774d-45dd-be0a-f5003348b4e1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:19.227602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e2c10ec-774d-45dd-be0a-f5003348b4e1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:19.229595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e2c10ec-774d-45dd-be0a-f5003348b4e1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:19.235796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e2c10ec-774d-45dd-be0a-f5003348b4e1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:19.236429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e2c10ec-774d-45dd-be0a-f5003348b4e1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:19.237055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e2c10ec-774d-45dd-be0a-f5003348b4e1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:19.730674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e2c10ec-774d-45dd-be0a-f5003348b4e1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:19.776536 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e2c10ec-774d-45dd-be0a-f5003348b4e1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1471 microversion: 2.1 time: 0.593803 Aug 25 12:44:19.778544 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 439/866] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:19 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1471 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:19.819258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-222db588-e68c-4496-b49f-ba4bce17f00b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a6570d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:20.019159 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-222db588-e68c-4496-b49f-ba4bce17f00b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.237153 Aug 25 12:44:20.034999 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 440/867] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:19 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:20.057152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fe92fba5-da13-468f-85a0-f37f27fd7f0f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Action: 'create', calling method: .version_select at 0x7f3a2a657dc0>, body: {"keypair": {"name": "tempest-keypair-1690300445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc32xb78OmzhQhET1z8oYlP0sFIOzskQo38WSDR4HFi0QHmMmVqUje3ITH0apumBwgAqmBsey6D8iJxRprxdew2OM60ZSaxIuZceQN7EI5GOj6S9Fe+r+v4+gc8k/oKoA=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:20.180361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a08a71a0-3332-401c-a834-db1c114cf141 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Action: 'create', calling method: .version_select at 0x7f3a2ac8f4c0>, body: {"keypair": {"name": "tempest-keypair-1396914475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6wbA9tzO97TQhtWxUsHi0ZLjViYSwQU1uqk7Iip8xQe9PV8nmgzjQSKiMvHUJ8EHEeLIjabGWiYsSGdssprRy7AD6BXXe3S6VXUJ6lEYTG8gsVwaKMtGVLEcwk8ZWTmg=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:20.209654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-fe92fba5-da13-468f-85a0-f37f27fd7f0f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Getting quotas for project c899e2a1474d4eb28b598f50e93312f8. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:20.233377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-fe92fba5-da13-468f-85a0-f37f27fd7f0f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Getting quotas for user b46ef01072a84a81b862baf3ea2387dd and project c899e2a1474d4eb28b598f50e93312f8. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:20.248244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a08a71a0-3332-401c-a834-db1c114cf141 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:20.252847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:20.281430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a08a71a0-3332-401c-a834-db1c114cf141 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for user fb47836fe36a49648969687cc77affe7 and project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:20.326469 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fe92fba5-da13-468f-85a0-f37f27fd7f0f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.288327 Aug 25 12:44:20.328173 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 441/868] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Aug 25 12:44:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 292 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:44:20.336593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9fc070d2-c5fe-4a61-825c-6a32b57abf6b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:20.338045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9fc070d2-c5fe-4a61-825c-6a32b57abf6b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:20.353879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fc070d2-c5fe-4a61-825c-6a32b57abf6b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:20.354826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fc070d2-c5fe-4a61-825c-6a32b57abf6b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:20.356062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fc070d2-c5fe-4a61-825c-6a32b57abf6b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:20.357677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fc070d2-c5fe-4a61-825c-6a32b57abf6b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:20.359595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fc070d2-c5fe-4a61-825c-6a32b57abf6b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:20.361361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fc070d2-c5fe-4a61-825c-6a32b57abf6b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:20.416933 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a08a71a0-3332-401c-a834-db1c114cf141 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.326986 Aug 25 12:44:20.427392 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 428/869] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:44:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:20.446610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03e99ecc-3b95-4fb1-b7f6-ed16d100b5cb tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:20.450297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-03e99ecc-3b95-4fb1-b7f6-ed16d100b5cb tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:20.492206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03e99ecc-3b95-4fb1-b7f6-ed16d100b5cb tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:20.493178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03e99ecc-3b95-4fb1-b7f6-ed16d100b5cb tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:20.494043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03e99ecc-3b95-4fb1-b7f6-ed16d100b5cb tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:20.495333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03e99ecc-3b95-4fb1-b7f6-ed16d100b5cb tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:20.506584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03e99ecc-3b95-4fb1-b7f6-ed16d100b5cb tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:20.508828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03e99ecc-3b95-4fb1-b7f6-ed16d100b5cb tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:20.853372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03e99ecc-3b95-4fb1-b7f6-ed16d100b5cb tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:20.925445 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-03e99ecc-3b95-4fb1-b7f6-ed16d100b5cb tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1435 microversion: 2.1 time: 0.488685 Aug 25 12:44:20.934408 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 429/870] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:20 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1435 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:20.967484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5f8c9752-4098-4c51-9ec6-baf202c93c4d tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:20.969206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5f8c9752-4098-4c51-9ec6-baf202c93c4d tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:20.982816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f8c9752-4098-4c51-9ec6-baf202c93c4d tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:20.984449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f8c9752-4098-4c51-9ec6-baf202c93c4d tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:20.985658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f8c9752-4098-4c51-9ec6-baf202c93c4d tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:20.987310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f8c9752-4098-4c51-9ec6-baf202c93c4d tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:20.988447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f8c9752-4098-4c51-9ec6-baf202c93c4d tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:20.990037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f8c9752-4098-4c51-9ec6-baf202c93c4d tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:21.081978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9fc070d2-c5fe-4a61-825c-6a32b57abf6b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:21.163915 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9fc070d2-c5fe-4a61-825c-6a32b57abf6b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 0.833186 Aug 25 12:44:21.164974 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 442/871] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:20 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:21.390627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-5f8c9752-4098-4c51-9ec6-baf202c93c4d tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:21.437576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-93bcf922-5208-401f-bade-6c6a6137b7b3 req-2da2cdf8-cb46-4c3f-8e41-b70d24d57516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df", "name": "network-vif-deleted", "tag": "771cb51b-76f0-4d20-9727-718bae6c921a"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:21.517901 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5f8c9752-4098-4c51-9ec6-baf202c93c4d tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.577414 Aug 25 12:44:21.521681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-93bcf922-5208-401f-bade-6c6a6137b7b3 req-2da2cdf8-cb46-4c3f-8e41-b70d24d57516 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:21.522738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-93bcf922-5208-401f-bade-6c6a6137b7b3 req-2da2cdf8-cb46-4c3f-8e41-b70d24d57516 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:21.523533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-93bcf922-5208-401f-bade-6c6a6137b7b3 req-2da2cdf8-cb46-4c3f-8e41-b70d24d57516 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:21.570159 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 430/872] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:20 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:21.609865 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-93bcf922-5208-401f-bade-6c6a6137b7b3 req-2da2cdf8-cb46-4c3f-8e41-b70d24d57516 service nova] Creating event network-vif-deleted:771cb51b-76f0-4d20-9727-718bae6c921a for instance 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df on n-h1-852771-8 Aug 25 12:44:21.614878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d18219ce-6659-4b76-962d-671f087364ad tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Calling method '.version_select at 0x7f3a2ad2a430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:21.680128 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-93bcf922-5208-401f-bade-6c6a6137b7b3 req-2da2cdf8-cb46-4c3f-8e41-b70d24d57516 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.495988 Aug 25 12:44:21.683834 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d18219ce-6659-4b76-962d-671f087364ad tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-1396914475" status: 200 len: 497 microversion: 2.1 time: 0.111678 Aug 25 12:44:21.688498 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 443/873] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:21.708407 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 431/874] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 12:44:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1396914475 => generated 497 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:21.731285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2bef2c94-161b-4d56-bed9-083cbda9260f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:21.735157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2bef2c94-161b-4d56-bed9-083cbda9260f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:21.735944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a5270eea-a127-451f-a731-5e0f3c95e64f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2aa6d040>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:21.788082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2bef2c94-161b-4d56-bed9-083cbda9260f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:21.790373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2bef2c94-161b-4d56-bed9-083cbda9260f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:21.793224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2bef2c94-161b-4d56-bed9-083cbda9260f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:21.803862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2bef2c94-161b-4d56-bed9-083cbda9260f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:21.805422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2bef2c94-161b-4d56-bed9-083cbda9260f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:21.807486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2bef2c94-161b-4d56-bed9-083cbda9260f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:21.891931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:21.986251 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a5270eea-a127-451f-a731-5e0f3c95e64f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.275190 Aug 25 12:44:21.993418 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 432/875] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:21 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:22.011971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b7d5f0be-49d1-40f7-9e99-6e9dfc919054 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Calling method '.version_select at 0x7f3a2ab949d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:22.070309 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b7d5f0be-49d1-40f7-9e99-6e9dfc919054 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396914475" status: 202 len: 0 microversion: 2.1 time: 0.072565 Aug 25 12:44:22.073007 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 433/876] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 12:44:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396914475 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:44:22.109169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:22.120375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:22.160598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:22.161563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:22.162638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:22.163990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:22.164863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:22.166036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:22.236856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:22.238820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:22.240091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:22.241324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lazy-loading 'fault' on Instance uuid 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:22.623891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c85f30678174c6b99732ef70898b803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ffb23724e4333a2a0bc502c7f8854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:22.640330 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f81691f3-2964-495a-b3fd-74789635d58d tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 200 len: 1312 microversion: 2.1 time: 0.564857 Aug 25 12:44:22.641419 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 434/877] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:22 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 1312 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:22.695797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-198a7e0e-9cf2-419f-b2d6-78e49353bbd9 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Action: 'create', calling method: .version_select at 0x7f3a2a997310>, body: {"keypair": {"name": "tempest-keypair-172799342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMACza+6ZmrU/kl/rtUuUBJLeuMbHlGQtij/clmCs21CEXo59Uw87awLmZBt44OUMX+4RrMlRFyEhafUO6JLvp4J/VbDU0k7xTFdJ/85YQiNOy6tCHLAU2xId3jBfKZHVA=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:22.777683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-198a7e0e-9cf2-419f-b2d6-78e49353bbd9 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:22.818581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-198a7e0e-9cf2-419f-b2d6-78e49353bbd9 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for user fb47836fe36a49648969687cc77affe7 and project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:22.860759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2bef2c94-161b-4d56-bed9-083cbda9260f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:22.883598 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2bef2c94-161b-4d56-bed9-083cbda9260f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1477 microversion: 2.1 time: 1.190546 Aug 25 12:44:22.889594 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 444/878] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:21 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1477 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:22.913818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c601037b-eafd-4b55-8d2f-3ed1aaebbc46 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:22.922597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c601037b-eafd-4b55-8d2f-3ed1aaebbc46 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:22.936710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c601037b-eafd-4b55-8d2f-3ed1aaebbc46 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:22.950120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c601037b-eafd-4b55-8d2f-3ed1aaebbc46 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:22.952203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c601037b-eafd-4b55-8d2f-3ed1aaebbc46 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:22.953899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c601037b-eafd-4b55-8d2f-3ed1aaebbc46 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:22.957609 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-198a7e0e-9cf2-419f-b2d6-78e49353bbd9 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.295389 Aug 25 12:44:22.959069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c601037b-eafd-4b55-8d2f-3ed1aaebbc46 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:22.960199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c601037b-eafd-4b55-8d2f-3ed1aaebbc46 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:22.969583 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 435/879] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:44:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:22.994788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bcf53d40-73ef-421f-b0fa-0921d73a6f1a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:23.002297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bcf53d40-73ef-421f-b0fa-0921d73a6f1a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:23.043260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcf53d40-73ef-421f-b0fa-0921d73a6f1a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:23.044359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcf53d40-73ef-421f-b0fa-0921d73a6f1a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:23.046574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcf53d40-73ef-421f-b0fa-0921d73a6f1a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:23.066297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcf53d40-73ef-421f-b0fa-0921d73a6f1a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:23.066847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcf53d40-73ef-421f-b0fa-0921d73a6f1a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:23.067090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcf53d40-73ef-421f-b0fa-0921d73a6f1a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:23.416772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-bcf53d40-73ef-421f-b0fa-0921d73a6f1a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:23.485132 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bcf53d40-73ef-421f-b0fa-0921d73a6f1a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.520722 Aug 25 12:44:23.501611 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 436/880] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:22 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:23.517603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef323ed8-4754-4d62-9eef-9a87aa4622a6 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Calling method '.version_select at 0x7f3a2a9c31f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:23.579165 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef323ed8-4754-4d62-9eef-9a87aa4622a6 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-172799342" status: 202 len: 0 microversion: 2.1 time: 0.084541 Aug 25 12:44:23.580297 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 437/881] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 12:44:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-172799342 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:44:23.613000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-976944fa-c3de-45e8-bd71-5b816cc1b859 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a5fb040>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:23.804907 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-976944fa-c3de-45e8-bd71-5b816cc1b859 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.222578 Aug 25 12:44:23.806375 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 438/882] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:23 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:23.839121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-77fae697-bed7-4109-a6c2-69836971391d req-7135f689-e202-4dd5-93ce-47bd8dbe0f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42add69-b14a-4dd1-a7ce-8c6c162b4e1a", "name": "network-vif-unplugged", "status": "completed", "tag": "0a60e19f-de52-46f3-aca2-8d097515612b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:23.870459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-77fae697-bed7-4109-a6c2-69836971391d req-7135f689-e202-4dd5-93ce-47bd8dbe0f6e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:23.871851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-77fae697-bed7-4109-a6c2-69836971391d req-7135f689-e202-4dd5-93ce-47bd8dbe0f6e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:23.873627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-77fae697-bed7-4109-a6c2-69836971391d req-7135f689-e202-4dd5-93ce-47bd8dbe0f6e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:23.905291 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-77fae697-bed7-4109-a6c2-69836971391d req-7135f689-e202-4dd5-93ce-47bd8dbe0f6e service nova] Creating event network-vif-unplugged:0a60e19f-de52-46f3-aca2-8d097515612b for instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a on n-h1-852771-8 Aug 25 12:44:23.916739 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-77fae697-bed7-4109-a6c2-69836971391d req-7135f689-e202-4dd5-93ce-47bd8dbe0f6e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090858 Aug 25 12:44:23.926406 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 439/883] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:23.940271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f8e03b1a-3e69-4834-b02c-2380ed4c9d2d tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Action: 'create', calling method: .version_select at 0x7f3a2a5fb790>, body: {"keypair": {"name": "tempest-keypair-1333566385", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:23.943140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c601037b-eafd-4b55-8d2f-3ed1aaebbc46 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:23.976134 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c601037b-eafd-4b55-8d2f-3ed1aaebbc46 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 1.084141 Aug 25 12:44:23.977327 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 445/884] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:22 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:24.005535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:24.007090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] [instance: 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:24.026260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f8e03b1a-3e69-4834-b02c-2380ed4c9d2d tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:24.040984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:24.043269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:24.045934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:24.047398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:24.050668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:24.054254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:24.063707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f8e03b1a-3e69-4834-b02c-2380ed4c9d2d tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for user fb47836fe36a49648969687cc77affe7 and project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:24.184176 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] HTTP exception thrown: Instance 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df could not be found. Aug 25 12:44:24.191541 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f8e03b1a-3e69-4834-b02c-2380ed4c9d2d tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.262559 Aug 25 12:44:24.195853 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 440/885] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:44:23 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Request method failure captured: Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df HTTP/1.1 Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25AUDdrRzbvauO9SAob80mBUcYQBcDW6hGdmqM-VtV6TNJJRQocfTlcLi1T80u978IWPL0mYDkAKI1dy-wcJfyd3aLvuKMWcMo5dx93s8CEmrXjpGwOLNBWsUhytEMilFqZNsRSp2liop2tKysSFTs3mzqn1JIMqM6UpXBNJ9aDrK0 Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d33ffb23724e4333a2a0bc502c7f8854 Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1826019730 Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:44:24.197014 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d33ffb23724e4333a2a0bc502c7f8854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d33ffb23724e4333a2a0bc502c7f8854", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d33ffb23724e4333a2a0bc502c7f8854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d33ffb23724e4333a2a0bc502c7f8854"}]}] Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1826019730 Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d33ffb23724e4333a2a0bc502c7f8854 Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1826019730 Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersAdminNegativeTestJSON-1826019730-project Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 9c85f30678174c6b99732ef70898b803 Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1826019730-project Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df could not be found. Aug 25 12:44:24.199718 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df'} Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df could not be found. Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:24.203248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df could not be found. Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df could not be found. Aug 25 12:44:24.210362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:24.213676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] Returning 404 to user: Instance 4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:24.213676 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29c7d141-81e8-4329-902e-9264985dcf48 tempest-ServersAdminNegativeTestJSON-1826019730 tempest-ServersAdminNegativeTestJSON-1826019730-project] 10.222.0.70 "GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df" status: 404 len: 111 microversion: 2.1 time: 0.221672 Aug 25 12:44:24.213676 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 446/886] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:23 2022] GET /compute/v2.1/servers/4f3a0ae2-5efe-4a93-9b3e-cc14cd3181df => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:24.237087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-517cd57a-2d03-4f8b-b46f-5a0c0b1c046f tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Calling method '.version_select at 0x7f3a2a6c63a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:24.249781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7fd2f9fc-2825-4775-ac55-796be84551f4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:24.251738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7fd2f9fc-2825-4775-ac55-796be84551f4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:24.273011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fd2f9fc-2825-4775-ac55-796be84551f4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:24.286730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fd2f9fc-2825-4775-ac55-796be84551f4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:24.287512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fd2f9fc-2825-4775-ac55-796be84551f4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:24.294342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fd2f9fc-2825-4775-ac55-796be84551f4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:24.295587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fd2f9fc-2825-4775-ac55-796be84551f4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:24.296477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fd2f9fc-2825-4775-ac55-796be84551f4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:24.317383 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-517cd57a-2d03-4f8b-b46f-5a0c0b1c046f tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333566385" status: 202 len: 0 microversion: 2.1 time: 0.100036 Aug 25 12:44:24.318790 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 447/887] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 12:44:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333566385 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:44:24.361153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a3dee7d-c908-4a95-8f2b-523c452a2d48 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Action: 'create', calling method: .version_select at 0x7f3a2a6b4b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1227595365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLx3VM4rDUn+WMJ2i9aZ9sXicfHBduCekLU3PdmO54t1FDyFfa75YiVuoeyc+Yt8MycA+oyl5Hff5qdR6JNEWX/H7KgRe6fmmuY6lrO4vq5Lx64lcgNZhiVjA7w5ydGeTw=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:24.407319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2,nova_api:DELETE=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:24.441323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7a3dee7d-c908-4a95-8f2b-523c452a2d48 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:24.457746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7a3dee7d-c908-4a95-8f2b-523c452a2d48 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for user fb47836fe36a49648969687cc77affe7 and project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:24.547493 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a3dee7d-c908-4a95-8f2b-523c452a2d48 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.211234 Aug 25 12:44:24.552954 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 448/888] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:44:24 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:44:24.565041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fda393e1-bf8b-40da-8e21-6fbcfa84855a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:24.566409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fda393e1-bf8b-40da-8e21-6fbcfa84855a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:24.586178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fda393e1-bf8b-40da-8e21-6fbcfa84855a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:24.587346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fda393e1-bf8b-40da-8e21-6fbcfa84855a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:24.588300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fda393e1-bf8b-40da-8e21-6fbcfa84855a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:24.590330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fda393e1-bf8b-40da-8e21-6fbcfa84855a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:24.595829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fda393e1-bf8b-40da-8e21-6fbcfa84855a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:24.595829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fda393e1-bf8b-40da-8e21-6fbcfa84855a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:25.054335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7fd2f9fc-2825-4775-ac55-796be84551f4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:25.081736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-fda393e1-bf8b-40da-8e21-6fbcfa84855a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:25.088158 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7fd2f9fc-2825-4775-ac55-796be84551f4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1477 microversion: 2.1 time: 0.879846 Aug 25 12:44:25.096259 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 441/889] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:24 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1477 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:25.110961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-65984113-a062-4757-88c8-04abeadf3b1b tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Action: 'create', calling method: .version_select at 0x7f3a2a891c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2098733852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiVmgHfZ3Xq0lNLmCUz0/iPviYMYDx1SY8S+s7mAWX6EbcBxOs+zC2GWBHcMeLOVkDTJovX5FoENVKliY1EJ7jUo59LpiDa+FlozOdjHsXpDnVWJBFc6Kj1TQpyyuutyw=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:25.202120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-65984113-a062-4757-88c8-04abeadf3b1b tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:25.213095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-65984113-a062-4757-88c8-04abeadf3b1b tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for user fb47836fe36a49648969687cc77affe7 and project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:25.246760 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fda393e1-bf8b-40da-8e21-6fbcfa84855a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.691618 Aug 25 12:44:25.266396 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 449/890] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:24 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:25.315374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c593fe65-225e-44a3-bcea-16bdd8ae4e7b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a6c6700>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:25.329914 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-65984113-a062-4757-88c8-04abeadf3b1b tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.230964 Aug 25 12:44:25.333564 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 442/891] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:44:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:25.347614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2fd5594d-2a52-4a05-a6da-add8ffb91c7b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:25.360942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2fd5594d-2a52-4a05-a6da-add8ffb91c7b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:25.391518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd5594d-2a52-4a05-a6da-add8ffb91c7b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:25.393564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd5594d-2a52-4a05-a6da-add8ffb91c7b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:25.399509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd5594d-2a52-4a05-a6da-add8ffb91c7b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:25.403060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd5594d-2a52-4a05-a6da-add8ffb91c7b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:25.405300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd5594d-2a52-4a05-a6da-add8ffb91c7b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:25.407386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd5594d-2a52-4a05-a6da-add8ffb91c7b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:25.499147 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c593fe65-225e-44a3-bcea-16bdd8ae4e7b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.220649 Aug 25 12:44:25.504713 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 450/892] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:25 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:25.527755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-32a0bab4-f512-40a9-a9a8-995d79b0a22e tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Action: 'create', calling method: .version_select at 0x7f3a2a6571f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-483893645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNwZqpSQOIVJr7rdT4PnBc7Jg124RxPcDupSNLCi89OIwQol2V7BWd0Cj9s7R1i+uvvX5bpePif1mAme1MBA1KK305LgTCShtc9R5Zw9bHXN4xsvlKYvRPPPGjFSYo/xg=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:25.599666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-32a0bab4-f512-40a9-a9a8-995d79b0a22e tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:25.627737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-32a0bab4-f512-40a9-a9a8-995d79b0a22e tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Getting quotas for user fb47836fe36a49648969687cc77affe7 and project 4752e645bd4046559a3f715840a06768. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:25.746315 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-32a0bab4-f512-40a9-a9a8-995d79b0a22e tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.239192 Aug 25 12:44:25.748356 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 451/893] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:44:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:25.769101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-133d1b0e-3da1-4427-bf84-3d76fd82c473 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Calling method '.version_select at 0x7f3a2aadaa60>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:25.789371 n-d-852771-8 devstack@n-api.service[129060]: WARNING oslo_db.sqlalchemy.utils [None req-133d1b0e-3da1-4427-bf84-3d76fd82c473 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 12:44:25.819172 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-133d1b0e-3da1-4427-bf84-3d76fd82c473 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.055189 Aug 25 12:44:25.822017 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 452/894] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:44:25 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:25.841726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fb2c3d1d-e3be-40d7-bb80-ecc704aebcd1 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Calling method '.version_select at 0x7f3a2a6b4790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:25.952381 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fb2c3d1d-e3be-40d7-bb80-ecc704aebcd1 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-483893645" status: 202 len: 0 microversion: 2.1 time: 0.118903 Aug 25 12:44:25.953918 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 453/895] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 12:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-483893645 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:44:25.954420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2fd5594d-2a52-4a05-a6da-add8ffb91c7b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:25.968050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a035f171-4469-4560-8d23-7d3aba4f7095 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Calling method '.version_select at 0x7f3a2a614310>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:26.000593 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2fd5594d-2a52-4a05-a6da-add8ffb91c7b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 0.647184 Aug 25 12:44:26.013599 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 443/896] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:25 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:26.068022 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a035f171-4469-4560-8d23-7d3aba4f7095 tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2098733852" status: 202 len: 0 microversion: 2.1 time: 0.104659 Aug 25 12:44:26.070983 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 454/897] 10.222.0.70 () {58 vars in 1278 bytes} [Thu Aug 25 12:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2098733852 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:44:26.087688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd42a983-270e-4705-b80a-a519dc45880a tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] Calling method '.version_select at 0x7f3a2a5fb430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:26.151149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7cca7395-d424-495f-8a07-9b66c61a03bb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:26.155399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7cca7395-d424-495f-8a07-9b66c61a03bb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:26.167709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cca7395-d424-495f-8a07-9b66c61a03bb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:26.169037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cca7395-d424-495f-8a07-9b66c61a03bb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:26.184699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cca7395-d424-495f-8a07-9b66c61a03bb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:26.184699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cca7395-d424-495f-8a07-9b66c61a03bb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:26.184699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cca7395-d424-495f-8a07-9b66c61a03bb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:26.184699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cca7395-d424-495f-8a07-9b66c61a03bb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:26.215756 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bd42a983-270e-4705-b80a-a519dc45880a tempest-KeyPairsV2TestJSON-1174172417 tempest-KeyPairsV2TestJSON-1174172417-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1227595365" status: 202 len: 0 microversion: 2.1 time: 0.136802 Aug 25 12:44:26.219626 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 444/898] 10.222.0.70 () {58 vars in 1278 bytes} [Thu Aug 25 12:44:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1227595365 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:44:26.340123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3b72a14e-3827-4402-bb43-b8f0fcb73d1b tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:26.344008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3b72a14e-3827-4402-bb43-b8f0fcb73d1b tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:26.360370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b72a14e-3827-4402-bb43-b8f0fcb73d1b tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:26.361816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b72a14e-3827-4402-bb43-b8f0fcb73d1b tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:26.362664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b72a14e-3827-4402-bb43-b8f0fcb73d1b tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:26.364402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b72a14e-3827-4402-bb43-b8f0fcb73d1b tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:26.365255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b72a14e-3827-4402-bb43-b8f0fcb73d1b tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:26.366084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b72a14e-3827-4402-bb43-b8f0fcb73d1b tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:26.639993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-3b72a14e-3827-4402-bb43-b8f0fcb73d1b tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:26.730597 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3b72a14e-3827-4402-bb43-b8f0fcb73d1b tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.397622 Aug 25 12:44:26.737218 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 445/899] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:26 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:26.771282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72af4b52-641b-470b-a22a-b62cedff0800 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a5fb790>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:27.000501 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72af4b52-641b-470b-a22a-b62cedff0800 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.253430 Aug 25 12:44:27.005034 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 446/900] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:26 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:27.055864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-74a6e115-a8c1-4469-bada-b2d21e5b5945 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:27.064241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-74a6e115-a8c1-4469-bada-b2d21e5b5945 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:27.112416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74a6e115-a8c1-4469-bada-b2d21e5b5945 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:27.115856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74a6e115-a8c1-4469-bada-b2d21e5b5945 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:27.117386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74a6e115-a8c1-4469-bada-b2d21e5b5945 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:27.123196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74a6e115-a8c1-4469-bada-b2d21e5b5945 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:27.125733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74a6e115-a8c1-4469-bada-b2d21e5b5945 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:27.129627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74a6e115-a8c1-4469-bada-b2d21e5b5945 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:27.245569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7cca7395-d424-495f-8a07-9b66c61a03bb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:27.336528 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7cca7395-d424-495f-8a07-9b66c61a03bb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1477 microversion: 2.1 time: 1.193552 Aug 25 12:44:27.370063 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 455/901] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:26 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1477 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:27.647632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-74a6e115-a8c1-4469-bada-b2d21e5b5945 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:27.686078 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-74a6e115-a8c1-4469-bada-b2d21e5b5945 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 0.639100 Aug 25 12:44:27.704223 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 447/902] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:27 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:27.804121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85049481-b148-4abf-98d6-a330846d84bd tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:27.807645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85049481-b148-4abf-98d6-a330846d84bd tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:27.852094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85049481-b148-4abf-98d6-a330846d84bd tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:27.856197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85049481-b148-4abf-98d6-a330846d84bd tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:27.867503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85049481-b148-4abf-98d6-a330846d84bd tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:27.870473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85049481-b148-4abf-98d6-a330846d84bd tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:27.871688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85049481-b148-4abf-98d6-a330846d84bd tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:27.874027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85049481-b148-4abf-98d6-a330846d84bd tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:28.028679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e55bf9ec-d848-493f-991d-15f9fd3e91ad tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2b08f8b0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:28.226072 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e55bf9ec-d848-493f-991d-15f9fd3e91ad tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.204747 Aug 25 12:44:28.242230 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 448/903] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:28 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:44:28.283829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-512319859", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a8823b91-974d-48ac-9e76-e7cbde8ff3bd"}], "security_groups": [{"name": "tempest-securitygroup--2037058321"}], "key_name": "tempest-keypair-1690300445", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:28.313976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-85049481-b148-4abf-98d6-a330846d84bd tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:28.458947 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85049481-b148-4abf-98d6-a330846d84bd tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.666324 Aug 25 12:44:28.464454 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 456/904] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:27 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:28.496936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f2e45d71-10fd-45dd-88f5-2ac470f25cfe tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:28.504562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f2e45d71-10fd-45dd-88f5-2ac470f25cfe tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:28.536805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2e45d71-10fd-45dd-88f5-2ac470f25cfe tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:28.539595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2e45d71-10fd-45dd-88f5-2ac470f25cfe tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:28.540584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2e45d71-10fd-45dd-88f5-2ac470f25cfe tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:28.546587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2e45d71-10fd-45dd-88f5-2ac470f25cfe tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:28.547561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2e45d71-10fd-45dd-88f5-2ac470f25cfe tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:28.548381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2e45d71-10fd-45dd-88f5-2ac470f25cfe tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:29.297790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] validate_networks() for [('a8823b91-974d-48ac-9e76-e7cbde8ff3bd', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:44:29.540685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f2e45d71-10fd-45dd-88f5-2ac470f25cfe tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:29.587650 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f2e45d71-10fd-45dd-88f5-2ac470f25cfe tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1477 microversion: 2.1 time: 1.119882 Aug 25 12:44:29.595703 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 457/905] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:28 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1477 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:29.602710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-868f46be-27f7-418f-b6e6-1f440807d9a8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:29.610771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-868f46be-27f7-418f-b6e6-1f440807d9a8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:29.635999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-868f46be-27f7-418f-b6e6-1f440807d9a8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:29.637293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-868f46be-27f7-418f-b6e6-1f440807d9a8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:29.638862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-868f46be-27f7-418f-b6e6-1f440807d9a8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:29.643590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-868f46be-27f7-418f-b6e6-1f440807d9a8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:29.646411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-868f46be-27f7-418f-b6e6-1f440807d9a8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:29.647505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-868f46be-27f7-418f-b6e6-1f440807d9a8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:30.471047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-868f46be-27f7-418f-b6e6-1f440807d9a8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:30.491325 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-868f46be-27f7-418f-b6e6-1f440807d9a8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 0.892819 Aug 25 12:44:30.493827 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 458/906] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:29 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:30.522141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-56247cfd-fb9f-4ae3-b6b9-370867e11544 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a614ee0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:30.705286 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-56247cfd-fb9f-4ae3-b6b9-370867e11544 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1412 microversion: 2.1 time: 0.206607 Aug 25 12:44:30.707549 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 459/907] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:30 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1412 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:30.728090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-14cef8af-3dc8-4bca-8f4d-5b074c100c59 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:30.736881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-14cef8af-3dc8-4bca-8f4d-5b074c100c59 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:30.758283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14cef8af-3dc8-4bca-8f4d-5b074c100c59 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:30.763965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14cef8af-3dc8-4bca-8f4d-5b074c100c59 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:30.766463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14cef8af-3dc8-4bca-8f4d-5b074c100c59 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:30.769240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14cef8af-3dc8-4bca-8f4d-5b074c100c59 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:30.770595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14cef8af-3dc8-4bca-8f4d-5b074c100c59 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:30.774329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14cef8af-3dc8-4bca-8f4d-5b074c100c59 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:31.102993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-14cef8af-3dc8-4bca-8f4d-5b074c100c59 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:31.183500 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-14cef8af-3dc8-4bca-8f4d-5b074c100c59 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.465714 Aug 25 12:44:31.190086 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 460/908] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:30 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:31.203097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:44:31.204029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:44:31.204909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:44:31.206234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:44:31.207304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:44:31.263986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:31.266921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:31.268367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:31.273363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:31.277039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:31.285118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:31.361643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Getting quotas for project c899e2a1474d4eb28b598f50e93312f8. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:31.380288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Getting quotas for user b46ef01072a84a81b862baf3ea2387dd and project c899e2a1474d4eb28b598f50e93312f8. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:31.436967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:44:31.441727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:44:31.588677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:31.710243 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2fd9d721-e540-4e10-a5d3-6eae3c39539c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 3.461436 Aug 25 12:44:31.712719 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 449/909] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 12:44:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 3470 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:44:31.730236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-05721d59-1cf0-464f-9169-f784e23fbb33 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-305030538", "ram": 512, "vcpus": 1, "disk": 10, "id": 82501771, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:31.734377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0a66207d-3c70-4b93-82c2-5b70579503b2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:31.736439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0a66207d-3c70-4b93-82c2-5b70579503b2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:31.765207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a66207d-3c70-4b93-82c2-5b70579503b2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:31.769307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a66207d-3c70-4b93-82c2-5b70579503b2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:31.774579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a66207d-3c70-4b93-82c2-5b70579503b2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:31.780235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a66207d-3c70-4b93-82c2-5b70579503b2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:31.787991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a66207d-3c70-4b93-82c2-5b70579503b2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:31.790187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a66207d-3c70-4b93-82c2-5b70579503b2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:31.865722 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-05721d59-1cf0-464f-9169-f784e23fbb33 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.669487 Aug 25 12:44:31.869664 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 461/910] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:44:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:31.894641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6da0a421-5190-42e8-a87c-d866b0cc41f7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:31.895848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6da0a421-5190-42e8-a87c-d866b0cc41f7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:31.924179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da0a421-5190-42e8-a87c-d866b0cc41f7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:31.932110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da0a421-5190-42e8-a87c-d866b0cc41f7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:31.933599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da0a421-5190-42e8-a87c-d866b0cc41f7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:31.935593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da0a421-5190-42e8-a87c-d866b0cc41f7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:31.936842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da0a421-5190-42e8-a87c-d866b0cc41f7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:31.937995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da0a421-5190-42e8-a87c-d866b0cc41f7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:32.361999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0a66207d-3c70-4b93-82c2-5b70579503b2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:32.381253 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0a66207d-3c70-4b93-82c2-5b70579503b2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1477 microversion: 2.1 time: 0.664669 Aug 25 12:44:32.383391 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 450/911] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:31 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1477 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:32.462752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6da0a421-5190-42e8-a87c-d866b0cc41f7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:32.485243 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6da0a421-5190-42e8-a87c-d866b0cc41f7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 0.612181 Aug 25 12:44:32.512942 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 462/912] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:31 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:32.531291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d187f14d-e19e-44a3-bb88-dbc30d210544 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:32.532446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d187f14d-e19e-44a3-bb88-dbc30d210544 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:32.678988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d187f14d-e19e-44a3-bb88-dbc30d210544 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:32.699080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d187f14d-e19e-44a3-bb88-dbc30d210544 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:32.704229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d187f14d-e19e-44a3-bb88-dbc30d210544 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:32.706816 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d187f14d-e19e-44a3-bb88-dbc30d210544 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1285 microversion: 2.25 time: 0.192431 Aug 25 12:44:32.708076 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 463/913] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:32 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:32.729799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8c65781a-2eab-4514-b15a-b5aa4ba320e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a6c6430>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:32.829737 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8c65781a-2eab-4514-b15a-b5aa4ba320e8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1421 microversion: 2.1 time: 0.119801 Aug 25 12:44:32.849363 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 464/914] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:32 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1421 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:32.853693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0b3daf74-354a-4b88-b420-39f7370b9e5c req-9e15f364-be8f-41b3-af5b-94772ad29c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42add69-b14a-4dd1-a7ce-8c6c162b4e1a", "name": "network-vif-plugged", "status": "completed", "tag": "0a60e19f-de52-46f3-aca2-8d097515612b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:32.884145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0b3daf74-354a-4b88-b420-39f7370b9e5c req-9e15f364-be8f-41b3-af5b-94772ad29c61 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:32.885388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0b3daf74-354a-4b88-b420-39f7370b9e5c req-9e15f364-be8f-41b3-af5b-94772ad29c61 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:32.886472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0b3daf74-354a-4b88-b420-39f7370b9e5c req-9e15f364-be8f-41b3-af5b-94772ad29c61 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:32.911939 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-0b3daf74-354a-4b88-b420-39f7370b9e5c req-9e15f364-be8f-41b3-af5b-94772ad29c61 service nova] Creating event network-vif-plugged:0a60e19f-de52-46f3-aca2-8d097515612b for instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a on n-h1-852771-8 Aug 25 12:44:32.922211 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0b3daf74-354a-4b88-b420-39f7370b9e5c req-9e15f364-be8f-41b3-af5b-94772ad29c61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.536162 Aug 25 12:44:32.926783 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 451/915] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:32.949709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c04d7583-abcf-430b-a90f-3a91e72ee74a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:32.952691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c04d7583-abcf-430b-a90f-3a91e72ee74a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:32.970095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c04d7583-abcf-430b-a90f-3a91e72ee74a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:32.982327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c04d7583-abcf-430b-a90f-3a91e72ee74a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:32.984507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c04d7583-abcf-430b-a90f-3a91e72ee74a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:32.986465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c04d7583-abcf-430b-a90f-3a91e72ee74a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:32.989110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c04d7583-abcf-430b-a90f-3a91e72ee74a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:32.990482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c04d7583-abcf-430b-a90f-3a91e72ee74a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:33.052292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:33.177780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-c04d7583-abcf-430b-a90f-3a91e72ee74a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:33.244276 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c04d7583-abcf-430b-a90f-3a91e72ee74a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.300845 Aug 25 12:44:33.260749 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 452/916] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:32 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:33.291716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2130b7aa-1f0d-44de-a75d-bf95ed63eb8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2aad95e0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:33.441199 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2130b7aa-1f0d-44de-a75d-bf95ed63eb8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 200 len: 1421 microversion: 2.1 time: 0.174288 Aug 25 12:44:33.442336 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 453/917] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:44:33 2022] GET /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 1421 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:33.469489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-abb0996a-7c95-4705-afc7-36ab2d4ccd04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:33.473030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-abb0996a-7c95-4705-afc7-36ab2d4ccd04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:33.498835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abb0996a-7c95-4705-afc7-36ab2d4ccd04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:33.499805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abb0996a-7c95-4705-afc7-36ab2d4ccd04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:33.502582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abb0996a-7c95-4705-afc7-36ab2d4ccd04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:33.504496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abb0996a-7c95-4705-afc7-36ab2d4ccd04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:33.506353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abb0996a-7c95-4705-afc7-36ab2d4ccd04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:33.507328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abb0996a-7c95-4705-afc7-36ab2d4ccd04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:33.576960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ab1fc26-1eb5-4383-a127-8b67e24a7299 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:33.608777 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-3ab1fc26-1eb5-4383-a127-8b67e24a7299 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] HTTP exception thrown: Flavor 82501771 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ab1fc26-1eb5-4383-a127-8b67e24a7299 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Request method failure captured: Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/flavors/82501771/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB26qp6yfzAbHIfH9CoSlGW4kbG3bnq97qXlFi0XsKpjmC7Ep1DyswcU_mep55Gdh9R3djS4Gj3m3pv93mq_eCWoxa5nOfJpx0qsl5nYIar0IpKgXJAbLvhmhTvUqb4o33-41H_FTKFPbLDaz_-qeqJjLmEhqFI__DzXbVqGE9G_3LEw Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3a03bff3e45441798269ca853dd7845f Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:44:33.614890 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a03bff3e45441798269ca853dd7845f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a03bff3e45441798269ca853dd7845f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a03bff3e45441798269ca853dd7845f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a03bff3e45441798269ca853dd7845f"}]}] Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3a03bff3e45441798269ca853dd7845f Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: ca3b35335bac4d54a9e63c445ffb5cdf Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:44:33.618246 n-d-852771-8 devstack@n-api.service[129060]: exception: Flavor 82501771 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'flavor_id': '82501771', 'id': 'hw:cpu_thread_policy'} Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 82501771 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:33.620423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:33.625585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:33.625585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:33.625585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:33.625585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:33.625585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:33.625585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 82501771 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:44:33.625585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:33.641677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ab1fc26-1eb5-4383-a127-8b67e24a7299 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Returning 404 to user: Flavor 82501771 has no extra specs with key hw:cpu_thread_policy. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:33.671403 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3ab1fc26-1eb5-4383-a127-8b67e24a7299 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] 10.222.0.70 "GET /compute/v2.1/flavors/82501771/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.820042 Aug 25 12:44:33.672402 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 465/918] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:44:32 2022] GET /compute/v2.1/flavors/82501771/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 822 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:33.685205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-521874ed-550d-4adb-a137-d6faefde9f37 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a6c69d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:33.911376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-abb0996a-7c95-4705-afc7-36ab2d4ccd04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:33.931403 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-abb0996a-7c95-4705-afc7-36ab2d4ccd04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1477 microversion: 2.1 time: 0.480800 Aug 25 12:44:33.946630 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 454/919] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:33 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1477 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:33.970855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63fb10de-6569-4ad9-98b5-5593376343c8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:33.972478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-63fb10de-6569-4ad9-98b5-5593376343c8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:33.989253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63fb10de-6569-4ad9-98b5-5593376343c8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:33.990758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63fb10de-6569-4ad9-98b5-5593376343c8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:33.991941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63fb10de-6569-4ad9-98b5-5593376343c8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:33.994699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63fb10de-6569-4ad9-98b5-5593376343c8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:33.995938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63fb10de-6569-4ad9-98b5-5593376343c8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:33.997591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63fb10de-6569-4ad9-98b5-5593376343c8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:34.428156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-63fb10de-6569-4ad9-98b5-5593376343c8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:34.464179 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-63fb10de-6569-4ad9-98b5-5593376343c8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 0.513693 Aug 25 12:44:34.506278 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 455/920] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:33 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:34.521772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72aea4dd-564b-4956-9082-ded9c503053d tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:34.532924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-72aea4dd-564b-4956-9082-ded9c503053d tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'ca3b35335bac4d54a9e63c445ffb5cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a03bff3e45441798269ca853dd7845f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72aea4dd-564b-4956-9082-ded9c503053d tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Request method failure captured: Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/flavors/82501771/os-extra_specs HTTP/1.1 Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 66 Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB26qp6yfzAbHIfH9CoSlGW4kbG3bnq97qXlFi0XsKpjmC7Ep1DyswcU_mep55Gdh9R3djS4Gj3m3pv93mq_eCWoxa5nOfJpx0qsl5nYIar0IpKgXJAbLvhmhTvUqb4o33-41H_FTKFPbLDaz_-qeqJjLmEhqFI__DzXbVqGE9G_3LEw Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3a03bff3e45441798269ca853dd7845f Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:44:34.538868 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a03bff3e45441798269ca853dd7845f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a03bff3e45441798269ca853dd7845f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a03bff3e45441798269ca853dd7845f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a03bff3e45441798269ca853dd7845f"}]}] Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3a03bff3e45441798269ca853dd7845f Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: ca3b35335bac4d54a9e63c445ffb5cdf Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 25 12:44:34.542613 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'flavor_id': '82501771', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:44:34.546839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 25 12:44:34.553400 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:34.560680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72aea4dd-564b-4956-9082-ded9c503053d tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:34.560680 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72aea4dd-564b-4956-9082-ded9c503053d tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] 10.222.0.70 "POST /compute/v2.1/flavors/82501771/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.049650 Aug 25 12:44:34.562832 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 456/921] 10.222.0.70 () {60 vars in 1218 bytes} [Thu Aug 25 12:44:34 2022] POST /compute/v2.1/flavors/82501771/os-extra_specs => generated 124 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:34.574660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:34.577969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:34.598668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:34.600956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:34.602489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:34.604665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:34.605172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:34.607056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:34.826541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:34.850484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:34.855594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:34.859769 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-14499226-e3aa-48fd-85b4-4fd090dbe1c1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1337 microversion: 2.25 time: 0.294573 Aug 25 12:44:34.862155 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 457/922] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:34 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1337 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:34.873281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fde920ed-82f5-428d-8731-24d623dd0cef tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:34.875428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fde920ed-82f5-428d-8731-24d623dd0cef tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:34.916887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde920ed-82f5-428d-8731-24d623dd0cef tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:34.921871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde920ed-82f5-428d-8731-24d623dd0cef tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:34.922867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde920ed-82f5-428d-8731-24d623dd0cef tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:34.924686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde920ed-82f5-428d-8731-24d623dd0cef tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:34.926306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde920ed-82f5-428d-8731-24d623dd0cef tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:34.927508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde920ed-82f5-428d-8731-24d623dd0cef tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.157298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-fde920ed-82f5-428d-8731-24d623dd0cef tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:35.213755 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fde920ed-82f5-428d-8731-24d623dd0cef tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.348511 Aug 25 12:44:35.218416 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 458/923] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:34 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:35.230949 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-521874ed-550d-4adb-a137-d6faefde9f37 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 204 len: 0 microversion: 2.1 time: 1.556103 Aug 25 12:44:35.240774 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 466/924] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:33 2022] DELETE /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 0 bytes in 1561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:35.254432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5413fff3-c07f-49e1-a428-9ecbbcf531a6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:35.256196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5413fff3-c07f-49e1-a428-9ecbbcf531a6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:35.269652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5413fff3-c07f-49e1-a428-9ecbbcf531a6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:35.271080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5413fff3-c07f-49e1-a428-9ecbbcf531a6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:35.272350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ecfd0c34-fa35-45ae-9951-ce3d4d944e1f tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:35.273001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5413fff3-c07f-49e1-a428-9ecbbcf531a6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.274855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5413fff3-c07f-49e1-a428-9ecbbcf531a6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:35.276140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5413fff3-c07f-49e1-a428-9ecbbcf531a6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:35.277393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5413fff3-c07f-49e1-a428-9ecbbcf531a6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.371124 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ecfd0c34-fa35-45ae-9951-ce3d4d944e1f tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/82501771/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.127768 Aug 25 12:44:35.374667 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 459/925] 10.222.0.70 () {60 vars in 1218 bytes} [Thu Aug 25 12:44:35 2022] POST /compute/v2.1/flavors/82501771/os-extra_specs => generated 66 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:44:35.390458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7df30a53-f40b-4913-a001-163c4e3b58df tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:35.393197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7df30a53-f40b-4913-a001-163c4e3b58df tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:35.413609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7df30a53-f40b-4913-a001-163c4e3b58df tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:35.415666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7df30a53-f40b-4913-a001-163c4e3b58df tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:35.416818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7df30a53-f40b-4913-a001-163c4e3b58df tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.418441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7df30a53-f40b-4913-a001-163c4e3b58df tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:35.421334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7df30a53-f40b-4913-a001-163c4e3b58df tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:35.433234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7df30a53-f40b-4913-a001-163c4e3b58df tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.531964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7df30a53-f40b-4913-a001-163c4e3b58df tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:44:35.633604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5413fff3-c07f-49e1-a428-9ecbbcf531a6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:35.686054 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5413fff3-c07f-49e1-a428-9ecbbcf531a6 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1477 microversion: 2.1 time: 0.429858 Aug 25 12:44:35.687107 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 467/926] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:35 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:35.707758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75fb03cc-6df9-4ed2-b0f2-1ff150aee2b2 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:35.711537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-75fb03cc-6df9-4ed2-b0f2-1ff150aee2b2 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'ca3b35335bac4d54a9e63c445ffb5cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a03bff3e45441798269ca853dd7845f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75fb03cc-6df9-4ed2-b0f2-1ff150aee2b2 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Request method failure captured: Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB26qp6yfzAbHIfH9CoSlGW4kbG3bnq97qXlFi0XsKpjmC7Ep1DyswcU_mep55Gdh9R3djS4Gj3m3pv93mq_eCWoxa5nOfJpx0qsl5nYIar0IpKgXJAbLvhmhTvUqb4o33-41H_FTKFPbLDaz_-qeqJjLmEhqFI__DzXbVqGE9G_3LEw Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3a03bff3e45441798269ca853dd7845f Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:44:35.718985 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a03bff3e45441798269ca853dd7845f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a03bff3e45441798269ca853dd7845f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a03bff3e45441798269ca853dd7845f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a03bff3e45441798269ca853dd7845f"}]}] Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3a03bff3e45441798269ca853dd7845f Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: ca3b35335bac4d54a9e63c445ffb5cdf Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:44:35.722271 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'flavor_id': '82501771', 'id': 'hw:numa_nodes'} Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:44:35.723869 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 25 12:44:35.726830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:35.740626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75fb03cc-6df9-4ed2-b0f2-1ff150aee2b2 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:35.741977 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-75fb03cc-6df9-4ed2-b0f2-1ff150aee2b2 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] 10.222.0.70 "DELETE /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.052911 Aug 25 12:44:35.743242 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 468/927] 10.222.0.70 () {58 vars in 1242 bytes} [Thu Aug 25 12:44:35 2022] DELETE /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes => generated 124 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:35.762607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eae4d10c-e681-4bc1-b7ce-e30e940dfbda tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:35.764710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eae4d10c-e681-4bc1-b7ce-e30e940dfbda tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:35.768907 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7df30a53-f40b-4913-a001-163c4e3b58df tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 204 len: 0 microversion: 2.1 time: 0.390407 Aug 25 12:44:35.770607 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 460/928] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:44:35 2022] DELETE /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:35.784924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eae4d10c-e681-4bc1-b7ce-e30e940dfbda tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:35.786394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eae4d10c-e681-4bc1-b7ce-e30e940dfbda tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:35.787515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eae4d10c-e681-4bc1-b7ce-e30e940dfbda tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.790433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eae4d10c-e681-4bc1-b7ce-e30e940dfbda tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:35.791473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eae4d10c-e681-4bc1-b7ce-e30e940dfbda tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:35.792140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eae4d10c-e681-4bc1-b7ce-e30e940dfbda tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.802192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3b5d79c1-c29a-4125-aee3-dafaf5900118 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:35.896327 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3b5d79c1-c29a-4125-aee3-dafaf5900118 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/82501771/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.114151 Aug 25 12:44:35.912917 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 461/929] 10.222.0.70 () {60 vars in 1218 bytes} [Thu Aug 25 12:44:35 2022] POST /compute/v2.1/flavors/82501771/os-extra_specs => generated 66 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:44:35.923672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:35.925662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:35.941260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:35.942561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:35.943663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.945313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:35.946511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:35.947497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:36.135350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:36.151945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:36.155251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:36.157296 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-90afe465-1a0d-4238-9f8a-edf9d1f137f7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1343 microversion: 2.25 time: 0.242209 Aug 25 12:44:36.158972 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 462/930] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:35 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1343 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:36.174995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63daf773-91fc-4f45-8a45-b08500da0292 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:36.185333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-63daf773-91fc-4f45-8a45-b08500da0292 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'ca3b35335bac4d54a9e63c445ffb5cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a03bff3e45441798269ca853dd7845f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63daf773-91fc-4f45-8a45-b08500da0292 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Request method failure captured: Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 22 Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB26qp6yfzAbHIfH9CoSlGW4kbG3bnq97qXlFi0XsKpjmC7Ep1DyswcU_mep55Gdh9R3djS4Gj3m3pv93mq_eCWoxa5nOfJpx0qsl5nYIar0IpKgXJAbLvhmhTvUqb4o33-41H_FTKFPbLDaz_-qeqJjLmEhqFI__DzXbVqGE9G_3LEw Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3a03bff3e45441798269ca853dd7845f Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:44:36.190426 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a03bff3e45441798269ca853dd7845f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a03bff3e45441798269ca853dd7845f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a03bff3e45441798269ca853dd7845f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a03bff3e45441798269ca853dd7845f"}]}] Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3a03bff3e45441798269ca853dd7845f Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: ca3b35335bac4d54a9e63c445ffb5cdf Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: {"hw:numa_nodes": "1"} Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:44:36.193301 n-d-852771-8 devstack@n-api.service[129059]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'flavor_id': '82501771', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:44:36.194993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 25 12:44:36.198173 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.202264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63daf773-91fc-4f45-8a45-b08500da0292 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:36.203506 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-63daf773-91fc-4f45-8a45-b08500da0292 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466 tempest-FlavorsExtraSpecsNegativeTestJSON-778567466-project] 10.222.0.70 "PUT /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.042740 Aug 25 12:44:36.204857 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 463/931] 10.222.0.70 () {60 vars in 1259 bytes} [Thu Aug 25 12:44:36 2022] PUT /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes => generated 124 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:36.212494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1099839773", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "94927505-3265-4f82-8562-0d8ecd51bf76"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:36.269709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eae4d10c-e681-4bc1-b7ce-e30e940dfbda tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:36.284011 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eae4d10c-e681-4bc1-b7ce-e30e940dfbda tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 0.538156 Aug 25 12:44:36.285468 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 469/932] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:35 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:36.292165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e2b7017-199e-4383-9334-2ae36a2810d8 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:36.313908 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-5e2b7017-199e-4383-9334-2ae36a2810d8 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] HTTP exception thrown: Flavor 82501771 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e2b7017-199e-4383-9334-2ae36a2810d8 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Request method failure captured: Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/flavors/82501771/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB26tJvSwCU7RyUkAKwEDrF2jrDFNABhkbn5WjUMQ-8VMYx-TpsLh0RkWFy80DRbe_VKxCdd2y5GXCYYoZNiYsgdvtH8p1WdE6zIl6GT4xAiiEP6vC0U_Yr42O53WYC2EUSFici8HuOGwhwagboQGUxlrD7Z8Zae-xJSNx0tVRkwORhA Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 92320bb12fcd4b78918392a0dd353c54 Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:44:36.317946 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/92320bb12fcd4b78918392a0dd353c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_92320bb12fcd4b78918392a0dd353c54", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/92320bb12fcd4b78918392a0dd353c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/92320bb12fcd4b78918392a0dd353c54"}]}] Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 92320bb12fcd4b78918392a0dd353c54 Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d591a13f0bee402a9617e0e9683ea4e2 Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:44:36.320615 n-d-852771-8 devstack@n-api.service[129060]: exception: Flavor 82501771 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'flavor_id': '82501771', 'id': 'hw:cpu_thread_policy'} Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 82501771 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:36.321413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.328735 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:36.328735 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:36.328735 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:36.328735 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:36.328735 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:36.328735 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 82501771 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:44:36.328735 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.328735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e2b7017-199e-4383-9334-2ae36a2810d8 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Returning 404 to user: Flavor 82501771 has no extra specs with key hw:cpu_thread_policy. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:36.328735 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5e2b7017-199e-4383-9334-2ae36a2810d8 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/82501771/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.036991 Aug 25 12:44:36.328735 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 470/933] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 12:44:36 2022] DELETE /compute/v2.1/flavors/82501771/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:36.336599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47273dd8-0052-480a-ac19-e62fe7628879 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:36.346503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] validate_networks() for [('94927505-3265-4f82-8562-0d8ecd51bf76', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:44:36.350174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-47273dd8-0052-480a-ac19-e62fe7628879 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:36.376525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47273dd8-0052-480a-ac19-e62fe7628879 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:36.377298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47273dd8-0052-480a-ac19-e62fe7628879 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:36.378289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47273dd8-0052-480a-ac19-e62fe7628879 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:36.379181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47273dd8-0052-480a-ac19-e62fe7628879 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:36.380176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47273dd8-0052-480a-ac19-e62fe7628879 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:36.380779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47273dd8-0052-480a-ac19-e62fe7628879 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:36.613424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-47273dd8-0052-480a-ac19-e62fe7628879 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:36.682304 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47273dd8-0052-480a-ac19-e62fe7628879 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.353490 Aug 25 12:44:36.699608 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 471/934] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:36 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:36.726227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10fe1a30-df0d-46b7-b133-ddc9068b7e05 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:36.738989 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-10fe1a30-df0d-46b7-b133-ddc9068b7e05 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10fe1a30-df0d-46b7-b133-ddc9068b7e05 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Request method failure captured: Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: request: PUT /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 27 Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB26tJvSwCU7RyUkAKwEDrF2jrDFNABhkbn5WjUMQ-8VMYx-TpsLh0RkWFy80DRbe_VKxCdd2y5GXCYYoZNiYsgdvtH8p1WdE6zIl6GT4xAiiEP6vC0U_Yr42O53WYC2EUSFici8HuOGwhwagboQGUxlrD7Z8Zae-xJSNx0tVRkwORhA Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 92320bb12fcd4b78918392a0dd353c54 Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:44:36.743037 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/92320bb12fcd4b78918392a0dd353c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_92320bb12fcd4b78918392a0dd353c54", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/92320bb12fcd4b78918392a0dd353c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/92320bb12fcd4b78918392a0dd353c54"}]}] Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 92320bb12fcd4b78918392a0dd353c54 Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d591a13f0bee402a9617e0e9683ea4e2 Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: {"hw:cpu_policy": "shared"} Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:44:36.750226 n-d-852771-8 devstack@n-api.service[129060]: exception: Request body and URI mismatch Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'flavor_id': '82501771', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:36.751976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:36.756406 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:36.756406 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:36.756406 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 25 12:44:36.756406 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:36.756406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10fe1a30-df0d-46b7-b133-ddc9068b7e05 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:36.758662 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-10fe1a30-df0d-46b7-b133-ddc9068b7e05 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.055865 Aug 25 12:44:36.759943 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 472/935] 10.222.0.70 () {60 vars in 1259 bytes} [Thu Aug 25 12:44:36 2022] PUT /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes => generated 73 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:44:36.782857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4aa59771-aaed-4b58-9f69-dd0b86a9ea87 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:36.785017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4aa59771-aaed-4b58-9f69-dd0b86a9ea87 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:36.813130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aa59771-aaed-4b58-9f69-dd0b86a9ea87 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:36.814827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aa59771-aaed-4b58-9f69-dd0b86a9ea87 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:36.816107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aa59771-aaed-4b58-9f69-dd0b86a9ea87 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:36.824368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aa59771-aaed-4b58-9f69-dd0b86a9ea87 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:36.826226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aa59771-aaed-4b58-9f69-dd0b86a9ea87 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:36.828771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aa59771-aaed-4b58-9f69-dd0b86a9ea87 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:37.372710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4aa59771-aaed-4b58-9f69-dd0b86a9ea87 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:37.394257 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4aa59771-aaed-4b58-9f69-dd0b86a9ea87 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1463 microversion: 2.1 time: 0.632578 Aug 25 12:44:37.396893 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 473/936] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:36 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1463 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:37.409993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5eed3c64-e5f9-4dea-b5b7-fc0b5f57e45c tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5eed3c64-e5f9-4dea-b5b7-fc0b5f57e45c tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Request method failure captured: Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: request: PUT /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 49 Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB26tJvSwCU7RyUkAKwEDrF2jrDFNABhkbn5WjUMQ-8VMYx-TpsLh0RkWFy80DRbe_VKxCdd2y5GXCYYoZNiYsgdvtH8p1WdE6zIl6GT4xAiiEP6vC0U_Yr42O53WYC2EUSFici8HuOGwhwagboQGUxlrD7Z8Zae-xJSNx0tVRkwORhA Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 92320bb12fcd4b78918392a0dd353c54 Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:44:37.420657 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/92320bb12fcd4b78918392a0dd353c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_92320bb12fcd4b78918392a0dd353c54", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/92320bb12fcd4b78918392a0dd353c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/92320bb12fcd4b78918392a0dd353c54"}]}] Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 92320bb12fcd4b78918392a0dd353c54 Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d591a13f0bee402a9617e0e9683ea4e2 Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 25 12:44:37.423750 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'flavor_id': '82501771', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance: Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 25 12:44:37.425170 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:37.427820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:37.437999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:37.437999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:37.437999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:44:37.437999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:44:37.437999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 25 12:44:37.437999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:37.437999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5eed3c64-e5f9-4dea-b5b7-fc0b5f57e45c tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:37.440228 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5eed3c64-e5f9-4dea-b5b7-fc0b5f57e45c tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.037176 Aug 25 12:44:37.441817 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 474/937] 10.222.0.70 () {60 vars in 1259 bytes} [Thu Aug 25 12:44:37 2022] PUT /compute/v2.1/flavors/82501771/os-extra_specs/hw:numa_nodes => generated 117 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:44:37.454604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:37.456455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:37.471833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:37.473299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:37.475392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:37.477304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:37.478691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:37.479872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:37.492838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:44:37.495336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:44:37.496479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:44:37.507548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:44:37.509126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:44:37.537209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:37.538558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:37.540440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:37.545787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:37.548294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:37.551252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:37.600196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Getting quotas for project da51872cc1924bb99ee10d4a28cfb2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:37.612895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Getting quotas for user 2db6a11f66554018ba91a5fabb891492 and project da51872cc1924bb99ee10d4a28cfb2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:37.644588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:44:37.650248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:44:37.676086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:37.692468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:37.696351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:37.699169 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-809f2009-15a3-4d1d-a86b-104f4027f7a2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1343 microversion: 2.25 time: 0.254059 Aug 25 12:44:37.714588 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 475/938] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:37 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1343 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:37.751566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0306a95e-9c07-4e6f-a079-f1d6d94beaea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:37.753306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0306a95e-9c07-4e6f-a079-f1d6d94beaea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:37.768035 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e85495ce-6d01-4590-a584-4cdd00142a13 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560849 Aug 25 12:44:37.780785 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 464/939] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:44:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:44:37.780785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89e736e1-f2ba-4e81-9186-8e5db1012f92 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:37.782355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89e736e1-f2ba-4e81-9186-8e5db1012f92 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:37.785656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0306a95e-9c07-4e6f-a079-f1d6d94beaea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:37.786596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0306a95e-9c07-4e6f-a079-f1d6d94beaea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:37.787432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0306a95e-9c07-4e6f-a079-f1d6d94beaea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:37.788437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0306a95e-9c07-4e6f-a079-f1d6d94beaea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:37.789381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0306a95e-9c07-4e6f-a079-f1d6d94beaea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:37.790474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0306a95e-9c07-4e6f-a079-f1d6d94beaea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:37.796526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e736e1-f2ba-4e81-9186-8e5db1012f92 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:37.797466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e736e1-f2ba-4e81-9186-8e5db1012f92 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:37.798428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e736e1-f2ba-4e81-9186-8e5db1012f92 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:37.799865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e736e1-f2ba-4e81-9186-8e5db1012f92 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:37.800841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e736e1-f2ba-4e81-9186-8e5db1012f92 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:37.801733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e736e1-f2ba-4e81-9186-8e5db1012f92 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:38.316851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89e736e1-f2ba-4e81-9186-8e5db1012f92 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:38.352719 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89e736e1-f2ba-4e81-9186-8e5db1012f92 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1463 microversion: 2.1 time: 0.572538 Aug 25 12:44:38.354383 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 465/940] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:37 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1463 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:38.404082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d6b1b7d8-1340-411f-816c-8580c71280d5 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:38.489367 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d6b1b7d8-1340-411f-816c-8580c71280d5 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/82501771" status: 202 len: 0 microversion: 2.1 time: 0.117696 Aug 25 12:44:38.492207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0306a95e-9c07-4e6f-a079-f1d6d94beaea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:38.498612 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 466/941] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:44:38 2022] DELETE /compute/v2.1/flavors/82501771 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:44:38.520245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-db6441b1-ab2d-4dc6-af72-170cb97c3db3 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:38.538739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-db6441b1-ab2d-4dc6-af72-170cb97c3db3 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:38.545414 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0306a95e-9c07-4e6f-a079-f1d6d94beaea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 0.826599 Aug 25 12:44:38.547350 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 476/942] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:37 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:38.558937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-76d5b6df-a102-4d2c-afce-6384434f35f5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:38.562149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6441b1-ab2d-4dc6-af72-170cb97c3db3 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:38.563049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6441b1-ab2d-4dc6-af72-170cb97c3db3 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:38.563848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6441b1-ab2d-4dc6-af72-170cb97c3db3 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:38.564504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-76d5b6df-a102-4d2c-afce-6384434f35f5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:38.565149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6441b1-ab2d-4dc6-af72-170cb97c3db3 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:38.566049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6441b1-ab2d-4dc6-af72-170cb97c3db3 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:38.566843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6441b1-ab2d-4dc6-af72-170cb97c3db3 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:38.990862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-76d5b6df-a102-4d2c-afce-6384434f35f5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:39.030839 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-76d5b6df-a102-4d2c-afce-6384434f35f5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1208 microversion: 2.1 time: 0.479567 Aug 25 12:44:39.032603 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 477/943] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:38 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1208 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:39.037281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-db6441b1-ab2d-4dc6-af72-170cb97c3db3 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:39.064552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ccceb17a-660c-4dc0-ae5d-62db0e3b8117 req-2b1809e7-251d-46b8-b147-a6bd1013d28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e66bf9-46f4-4037-8c41-400415f86c72", "name": "network-vif-unplugged", "status": "completed", "tag": "82892c88-98b1-47a2-94ef-50fbcccb4ce1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:39.120304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ccceb17a-660c-4dc0-ae5d-62db0e3b8117 req-2b1809e7-251d-46b8-b147-a6bd1013d28d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:39.122712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ccceb17a-660c-4dc0-ae5d-62db0e3b8117 req-2b1809e7-251d-46b8-b147-a6bd1013d28d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:39.123167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ccceb17a-660c-4dc0-ae5d-62db0e3b8117 req-2b1809e7-251d-46b8-b147-a6bd1013d28d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:39.163829 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-db6441b1-ab2d-4dc6-af72-170cb97c3db3 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.658603 Aug 25 12:44:39.180746 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 467/944] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:38 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:39.205786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:39.213012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:39.235741 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ccceb17a-660c-4dc0-ae5d-62db0e3b8117 req-2b1809e7-251d-46b8-b147-a6bd1013d28d service nova] Creating event network-vif-unplugged:82892c88-98b1-47a2-94ef-50fbcccb4ce1 for instance 40e66bf9-46f4-4037-8c41-400415f86c72 on n-h2-852771-8 Aug 25 12:44:39.238179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:39.241147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:39.242998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:39.245025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:39.246267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:39.249471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:39.258929 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ccceb17a-660c-4dc0-ae5d-62db0e3b8117 req-2b1809e7-251d-46b8-b147-a6bd1013d28d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.223305 Aug 25 12:44:39.267693 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 478/945] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:39.278707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8abdb06-b796-4eb4-b16b-1b4b66fa9e79 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:39.336929 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e8abdb06-b796-4eb4-b16b-1b4b66fa9e79 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501 tempest-FlavorsExtraSpecsNegativeTestJSON-137285501-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064776 Aug 25 12:44:39.338886 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 479/946] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:44:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:39.364377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:39.374838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:39.433158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:39.434894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:39.447408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:39.451964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:39.453452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:39.454854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:39.466059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:39.559074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:44:39.561014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:44:39.562052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:44:39.563041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:44:39.563820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:44:39.775571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:39.814272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:39.815314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:39.816143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:39.817490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:39.818651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:39.819602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:39.942249 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-669b857f-ae10-409c-9d61-e761dc740f04 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action" status: 202 len: 1067 microversion: 2.1 time: 0.745899 Aug 25 12:44:39.957552 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 468/947] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:44:39 2022] POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action => generated 1067 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 25 12:44:39.973618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ab608173-1ae2-424b-a7ef-b3994a9c7b9d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:39.973618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ab608173-1ae2-424b-a7ef-b3994a9c7b9d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:39.988851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab608173-1ae2-424b-a7ef-b3994a9c7b9d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:39.996233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab608173-1ae2-424b-a7ef-b3994a9c7b9d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:39.997293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab608173-1ae2-424b-a7ef-b3994a9c7b9d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:39.998769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab608173-1ae2-424b-a7ef-b3994a9c7b9d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:39.999651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab608173-1ae2-424b-a7ef-b3994a9c7b9d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:40.000475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab608173-1ae2-424b-a7ef-b3994a9c7b9d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:41.086400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:41.115796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:41.124930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:41.132838 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d054370a-825d-4b51-b98a-f52cc06a9f98 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 1.790776 Aug 25 12:44:41.136118 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 480/948] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:39 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:41.147624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75a243b2-528c-4ecc-9b4d-94ed54d7f2d3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:41.163052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-75a243b2-528c-4ecc-9b4d-94ed54d7f2d3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:41.191896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75a243b2-528c-4ecc-9b4d-94ed54d7f2d3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:41.194403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75a243b2-528c-4ecc-9b4d-94ed54d7f2d3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:41.198631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75a243b2-528c-4ecc-9b4d-94ed54d7f2d3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:41.201059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75a243b2-528c-4ecc-9b4d-94ed54d7f2d3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:41.210760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75a243b2-528c-4ecc-9b4d-94ed54d7f2d3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:41.212197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75a243b2-528c-4ecc-9b4d-94ed54d7f2d3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:41.698704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ab608173-1ae2-424b-a7ef-b3994a9c7b9d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:41.750243 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ab608173-1ae2-424b-a7ef-b3994a9c7b9d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1477 microversion: 2.1 time: 1.788739 Aug 25 12:44:41.755743 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 469/949] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:39 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1477 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:41.781343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e56ef151-e7d9-4aad-b123-7d06b3c68b96 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:41.791746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e56ef151-e7d9-4aad-b123-7d06b3c68b96 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:41.826409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e56ef151-e7d9-4aad-b123-7d06b3c68b96 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:41.827438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e56ef151-e7d9-4aad-b123-7d06b3c68b96 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:41.828241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e56ef151-e7d9-4aad-b123-7d06b3c68b96 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:41.829839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e56ef151-e7d9-4aad-b123-7d06b3c68b96 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:41.831557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e56ef151-e7d9-4aad-b123-7d06b3c68b96 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:41.831557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e56ef151-e7d9-4aad-b123-7d06b3c68b96 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:42.292295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e56ef151-e7d9-4aad-b123-7d06b3c68b96 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:42.301815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:42.358294 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e56ef151-e7d9-4aad-b123-7d06b3c68b96 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1266 microversion: 2.1 time: 0.589389 Aug 25 12:44:42.374436 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 470/950] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:41 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1266 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:42.424865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d057d4c-4ff9-4b71-8fc0-7fa72716bfce tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:42.434410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8d057d4c-4ff9-4b71-8fc0-7fa72716bfce tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:42.459183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d057d4c-4ff9-4b71-8fc0-7fa72716bfce tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:42.462067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d057d4c-4ff9-4b71-8fc0-7fa72716bfce tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:42.466241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d057d4c-4ff9-4b71-8fc0-7fa72716bfce tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:42.472327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d057d4c-4ff9-4b71-8fc0-7fa72716bfce tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:42.477151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d057d4c-4ff9-4b71-8fc0-7fa72716bfce tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:42.483988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d057d4c-4ff9-4b71-8fc0-7fa72716bfce tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:42.549036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-75a243b2-528c-4ecc-9b4d-94ed54d7f2d3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:42.582930 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-75a243b2-528c-4ecc-9b4d-94ed54d7f2d3 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1472 microversion: 2.1 time: 1.441492 Aug 25 12:44:42.602841 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 481/951] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:41 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1472 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:42.646409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-de3c1fa5-a5cf-4c3a-b79e-c0addcb63019 req-38dbf3cb-a099-4285-b432-9509343f74ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe666709-aa48-4785-8e47-ac9011592ddc", "name": "network-vif-unplugged", "status": "completed", "tag": "dde49cc7-dbaf-4c67-b244-a03554f3fb0c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:42.678011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-de3c1fa5-a5cf-4c3a-b79e-c0addcb63019 req-38dbf3cb-a099-4285-b432-9509343f74ea service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:42.679228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-de3c1fa5-a5cf-4c3a-b79e-c0addcb63019 req-38dbf3cb-a099-4285-b432-9509343f74ea service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:42.680099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-de3c1fa5-a5cf-4c3a-b79e-c0addcb63019 req-38dbf3cb-a099-4285-b432-9509343f74ea service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:42.724570 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-de3c1fa5-a5cf-4c3a-b79e-c0addcb63019 req-38dbf3cb-a099-4285-b432-9509343f74ea service nova] Creating event network-vif-unplugged:dde49cc7-dbaf-4c67-b244-a03554f3fb0c for instance fe666709-aa48-4785-8e47-ac9011592ddc on n-h1-852771-8 Aug 25 12:44:42.751514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-de3c1fa5-a5cf-4c3a-b79e-c0addcb63019 req-38dbf3cb-a099-4285-b432-9509343f74ea service nova] Instance fe666709-aa48-4785-8e47-ac9011592ddc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:44:42.807036 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-de3c1fa5-a5cf-4c3a-b79e-c0addcb63019 req-38dbf3cb-a099-4285-b432-9509343f74ea service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.194159 Aug 25 12:44:42.817978 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 482/952] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:42.844820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:42.848133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:42.874602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:42.876581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:42.885008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:42.886699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:42.887744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:42.896555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:43.178483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-8d057d4c-4ff9-4b71-8fc0-7fa72716bfce tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:43.271325 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d057d4c-4ff9-4b71-8fc0-7fa72716bfce tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1929 microversion: 2.75 time: 0.872677 Aug 25 12:44:43.280442 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 471/953] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:42 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1929 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:43.313209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14887bab-7a74-4f8c-92b0-479d5d001b77 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:43.317318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-14887bab-7a74-4f8c-92b0-479d5d001b77 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:43.357735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14887bab-7a74-4f8c-92b0-479d5d001b77 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:43.359144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14887bab-7a74-4f8c-92b0-479d5d001b77 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:43.360014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14887bab-7a74-4f8c-92b0-479d5d001b77 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:43.361778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14887bab-7a74-4f8c-92b0-479d5d001b77 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:43.373845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14887bab-7a74-4f8c-92b0-479d5d001b77 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:43.375270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14887bab-7a74-4f8c-92b0-479d5d001b77 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:44.913347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:44.976669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:44.989824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:44.992787 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ab7a69e3-0d13-4134-9d3a-e4f9cb00f043 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 2.172616 Aug 25 12:44:45.006746 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 483/954] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:42 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:45.280128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-14887bab-7a74-4f8c-92b0-479d5d001b77 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:45.315355 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-14887bab-7a74-4f8c-92b0-479d5d001b77 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1476 microversion: 2.1 time: 2.032276 Aug 25 12:44:45.322461 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 472/955] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:43 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1476 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:45.343752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c307ecc5-6597-41a8-8dcc-9165a002074d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:45.345180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c307ecc5-6597-41a8-8dcc-9165a002074d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:45.374807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c307ecc5-6597-41a8-8dcc-9165a002074d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:45.375864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c307ecc5-6597-41a8-8dcc-9165a002074d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:45.376665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c307ecc5-6597-41a8-8dcc-9165a002074d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:45.378092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c307ecc5-6597-41a8-8dcc-9165a002074d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:45.379119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c307ecc5-6597-41a8-8dcc-9165a002074d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:45.379744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c307ecc5-6597-41a8-8dcc-9165a002074d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:45.589849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f9b42587-e70d-4178-b700-39bbf4dfc27b req-fdd9c472-6daa-41bd-b994-f8b3144e76dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e66bf9-46f4-4037-8c41-400415f86c72", "name": "network-vif-deleted", "tag": "82892c88-98b1-47a2-94ef-50fbcccb4ce1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:45.639054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f9b42587-e70d-4178-b700-39bbf4dfc27b req-fdd9c472-6daa-41bd-b994-f8b3144e76dd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:45.640134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f9b42587-e70d-4178-b700-39bbf4dfc27b req-fdd9c472-6daa-41bd-b994-f8b3144e76dd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:45.641002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f9b42587-e70d-4178-b700-39bbf4dfc27b req-fdd9c472-6daa-41bd-b994-f8b3144e76dd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:45.715678 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f9b42587-e70d-4178-b700-39bbf4dfc27b req-fdd9c472-6daa-41bd-b994-f8b3144e76dd service nova] Creating event network-vif-deleted:82892c88-98b1-47a2-94ef-50fbcccb4ce1 for instance 40e66bf9-46f4-4037-8c41-400415f86c72 on n-h2-852771-8 Aug 25 12:44:45.741940 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f9b42587-e70d-4178-b700-39bbf4dfc27b req-fdd9c472-6daa-41bd-b994-f8b3144e76dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.732172 Aug 25 12:44:45.745628 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 484/956] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:45.765482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-20aa78dc-300a-478f-88dd-3d732d8df83a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:45.776119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-20aa78dc-300a-478f-88dd-3d732d8df83a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:45.802085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c307ecc5-6597-41a8-8dcc-9165a002074d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:45.833606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20aa78dc-300a-478f-88dd-3d732d8df83a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:45.833951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20aa78dc-300a-478f-88dd-3d732d8df83a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:45.834720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20aa78dc-300a-478f-88dd-3d732d8df83a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:45.836293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20aa78dc-300a-478f-88dd-3d732d8df83a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:45.837028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20aa78dc-300a-478f-88dd-3d732d8df83a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:45.843935 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c307ecc5-6597-41a8-8dcc-9165a002074d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1266 microversion: 2.1 time: 0.516042 Aug 25 12:44:45.859229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20aa78dc-300a-478f-88dd-3d732d8df83a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:45.875775 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 473/957] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:45 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1266 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:45.889566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-30769787-4326-4cba-88e1-677478d64994 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:45.891178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-30769787-4326-4cba-88e1-677478d64994 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:45.906055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30769787-4326-4cba-88e1-677478d64994 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:45.907430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30769787-4326-4cba-88e1-677478d64994 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:45.908799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30769787-4326-4cba-88e1-677478d64994 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:45.910437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30769787-4326-4cba-88e1-677478d64994 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:45.911565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30769787-4326-4cba-88e1-677478d64994 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:45.912623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30769787-4326-4cba-88e1-677478d64994 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:46.186580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-30769787-4326-4cba-88e1-677478d64994 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:46.259293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:46.262986 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-30769787-4326-4cba-88e1-677478d64994 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1935 microversion: 2.75 time: 0.384308 Aug 25 12:44:46.264808 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 474/958] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:45 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1935 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:46.273965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:46.283581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:46.320611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:46.321632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:46.322381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:46.323857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:46.325404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:46.327899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:46.868337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-20aa78dc-300a-478f-88dd-3d732d8df83a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:46.901827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-20aa78dc-300a-478f-88dd-3d732d8df83a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1472 microversion: 2.1 time: 1.146002 Aug 25 12:44:46.918176 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 485/959] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:45 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1472 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:46.928307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-863dde5f-7586-4c5b-8e7c-7f99d91ecdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:46.929489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-863dde5f-7586-4c5b-8e7c-7f99d91ecdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:46.945865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:46.954212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-863dde5f-7586-4c5b-8e7c-7f99d91ecdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:46.955124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-863dde5f-7586-4c5b-8e7c-7f99d91ecdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:46.955929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-863dde5f-7586-4c5b-8e7c-7f99d91ecdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:46.957584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-863dde5f-7586-4c5b-8e7c-7f99d91ecdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:46.958409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-863dde5f-7586-4c5b-8e7c-7f99d91ecdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:46.959199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-863dde5f-7586-4c5b-8e7c-7f99d91ecdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:47.064683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:47.099894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:47.109158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:47.111582 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6bde0bc9-e345-4c8d-bf55-01c986766051 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.844469 Aug 25 12:44:47.122896 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 475/960] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:46 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:47.133938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8300d4d7-c14c-4696-87e0-93ff7ccfcff0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:47.135203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8300d4d7-c14c-4696-87e0-93ff7ccfcff0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:47.171604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8300d4d7-c14c-4696-87e0-93ff7ccfcff0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:47.172948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8300d4d7-c14c-4696-87e0-93ff7ccfcff0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:47.176028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8300d4d7-c14c-4696-87e0-93ff7ccfcff0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:47.177767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8300d4d7-c14c-4696-87e0-93ff7ccfcff0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:47.181949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8300d4d7-c14c-4696-87e0-93ff7ccfcff0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:47.183001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8300d4d7-c14c-4696-87e0-93ff7ccfcff0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:47.578262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:47.634063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=28 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:48.094238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-863dde5f-7586-4c5b-8e7c-7f99d91ecdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:48.118183 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-863dde5f-7586-4c5b-8e7c-7f99d91ecdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1476 microversion: 2.1 time: 1.196452 Aug 25 12:44:48.123213 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 486/961] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:46 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1476 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:48.139736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6a280214-4b87-4bb9-b175-242d85ceac8e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:48.140850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6a280214-4b87-4bb9-b175-242d85ceac8e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:48.165787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a280214-4b87-4bb9-b175-242d85ceac8e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:48.168913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a280214-4b87-4bb9-b175-242d85ceac8e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:48.170254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a280214-4b87-4bb9-b175-242d85ceac8e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:48.171638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a280214-4b87-4bb9-b175-242d85ceac8e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:48.172767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a280214-4b87-4bb9-b175-242d85ceac8e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:48.173495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a280214-4b87-4bb9-b175-242d85ceac8e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:48.275285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8300d4d7-c14c-4696-87e0-93ff7ccfcff0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:48.297054 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8300d4d7-c14c-4696-87e0-93ff7ccfcff0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 1.172159 Aug 25 12:44:48.312956 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 476/962] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:47 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:48.312956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-afc3dd90-ab76-45e2-a799-a969d9d1ab94 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:48.312956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-afc3dd90-ab76-45e2-a799-a969d9d1ab94 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:48.329088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc3dd90-ab76-45e2-a799-a969d9d1ab94 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:48.330697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc3dd90-ab76-45e2-a799-a969d9d1ab94 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:48.331940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc3dd90-ab76-45e2-a799-a969d9d1ab94 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:48.333411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc3dd90-ab76-45e2-a799-a969d9d1ab94 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:48.334453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc3dd90-ab76-45e2-a799-a969d9d1ab94 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:48.335670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc3dd90-ab76-45e2-a799-a969d9d1ab94 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:48.528693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-6a280214-4b87-4bb9-b175-242d85ceac8e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:48.584810 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6a280214-4b87-4bb9-b175-242d85ceac8e tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1935 microversion: 2.75 time: 0.459158 Aug 25 12:44:48.588881 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 487/963] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:48 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1935 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:48.602352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-200bd8c9-5470-43d3-ab70-b5229dc069ae req-8aea0029-0cbc-45d6-a7e6-c7d50d2c1fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe666709-aa48-4785-8e47-ac9011592ddc", "tag": "dde49cc7-dbaf-4c67-b244-a03554f3fb0c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:48.634450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-200bd8c9-5470-43d3-ab70-b5229dc069ae req-8aea0029-0cbc-45d6-a7e6-c7d50d2c1fe9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:48.635796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-200bd8c9-5470-43d3-ab70-b5229dc069ae req-8aea0029-0cbc-45d6-a7e6-c7d50d2c1fe9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:48.638205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-200bd8c9-5470-43d3-ab70-b5229dc069ae req-8aea0029-0cbc-45d6-a7e6-c7d50d2c1fe9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:48.666432 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-200bd8c9-5470-43d3-ab70-b5229dc069ae req-8aea0029-0cbc-45d6-a7e6-c7d50d2c1fe9 service nova] Creating event network-changed:dde49cc7-dbaf-4c67-b244-a03554f3fb0c for instance fe666709-aa48-4785-8e47-ac9011592ddc on n-h1-852771-8 Aug 25 12:44:48.687568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-200bd8c9-5470-43d3-ab70-b5229dc069ae req-8aea0029-0cbc-45d6-a7e6-c7d50d2c1fe9 service nova] Instance fe666709-aa48-4785-8e47-ac9011592ddc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:44:48.715549 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-200bd8c9-5470-43d3-ab70-b5229dc069ae req-8aea0029-0cbc-45d6-a7e6-c7d50d2c1fe9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122268 Aug 25 12:44:48.717129 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 488/964] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:48.728353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:48.729751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:48.743027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:48.744876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:48.745739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:48.747669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:48.748392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:48.749047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:49.018673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=16 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:49.092138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-afc3dd90-ab76-45e2-a799-a969d9d1ab94 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:49.115000 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-afc3dd90-ab76-45e2-a799-a969d9d1ab94 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1472 microversion: 2.1 time: 0.814226 Aug 25 12:44:49.117208 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 477/965] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:48 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1472 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:49.128728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-72b49d49-8a48-4ce1-8c2e-2bfd047b07b0 req-2a4c3797-cfeb-418c-a8c2-182ca8d01c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18924dfe-fc9e-47d4-b4be-c249990c5455", "tag": "c1a94bed-79da-44e9-a740-36d602c0c193"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:49.165985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-72b49d49-8a48-4ce1-8c2e-2bfd047b07b0 req-2a4c3797-cfeb-418c-a8c2-182ca8d01c3c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:49.167030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-72b49d49-8a48-4ce1-8c2e-2bfd047b07b0 req-2a4c3797-cfeb-418c-a8c2-182ca8d01c3c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:49.168005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-72b49d49-8a48-4ce1-8c2e-2bfd047b07b0 req-2a4c3797-cfeb-418c-a8c2-182ca8d01c3c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:49.196493 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-72b49d49-8a48-4ce1-8c2e-2bfd047b07b0 req-2a4c3797-cfeb-418c-a8c2-182ca8d01c3c service nova] Creating event network-changed:c1a94bed-79da-44e9-a740-36d602c0c193 for instance 18924dfe-fc9e-47d4-b4be-c249990c5455 on n-h1-852771-8 Aug 25 12:44:49.206905 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-72b49d49-8a48-4ce1-8c2e-2bfd047b07b0 req-2a4c3797-cfeb-418c-a8c2-182ca8d01c3c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085459 Aug 25 12:44:49.208862 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 478/966] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:49.220352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-66fa5c10-04de-4b48-bdde-543b3ca10787 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:49.222116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-66fa5c10-04de-4b48-bdde-543b3ca10787 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:49.235906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fa5c10-04de-4b48-bdde-543b3ca10787 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:49.236803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fa5c10-04de-4b48-bdde-543b3ca10787 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:49.237627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fa5c10-04de-4b48-bdde-543b3ca10787 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:49.238955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fa5c10-04de-4b48-bdde-543b3ca10787 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:49.239759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fa5c10-04de-4b48-bdde-543b3ca10787 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:49.240518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66fa5c10-04de-4b48-bdde-543b3ca10787 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:49.283001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:49.318692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:49.323078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:49.328483 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a6e0346b-f23c-44e8-b989-8c278a2fa289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.608119 Aug 25 12:44:49.342031 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 489/967] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:48 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:49.356725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d074bc49-4c34-47c7-b4d7-7d2fa91c192c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:49.359882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d074bc49-4c34-47c7-b4d7-7d2fa91c192c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:49.373657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d074bc49-4c34-47c7-b4d7-7d2fa91c192c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:49.375075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d074bc49-4c34-47c7-b4d7-7d2fa91c192c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:49.376001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d074bc49-4c34-47c7-b4d7-7d2fa91c192c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:49.377377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d074bc49-4c34-47c7-b4d7-7d2fa91c192c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:49.378700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d074bc49-4c34-47c7-b4d7-7d2fa91c192c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:49.379518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d074bc49-4c34-47c7-b4d7-7d2fa91c192c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:49.700926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-66fa5c10-04de-4b48-bdde-543b3ca10787 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:49.748152 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-66fa5c10-04de-4b48-bdde-543b3ca10787 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1474 microversion: 2.1 time: 0.535087 Aug 25 12:44:49.750709 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 479/968] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:49 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1474 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:49.764013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-830b7ed0-c6ab-4164-b5ed-7295df44db0a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:49.766078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-830b7ed0-c6ab-4164-b5ed-7295df44db0a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:49.782644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-830b7ed0-c6ab-4164-b5ed-7295df44db0a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:49.784289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-830b7ed0-c6ab-4164-b5ed-7295df44db0a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:49.785810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-830b7ed0-c6ab-4164-b5ed-7295df44db0a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:49.787153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-830b7ed0-c6ab-4164-b5ed-7295df44db0a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:49.787991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-830b7ed0-c6ab-4164-b5ed-7295df44db0a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:49.789317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-830b7ed0-c6ab-4164-b5ed-7295df44db0a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:49.809429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d074bc49-4c34-47c7-b4d7-7d2fa91c192c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:49.831146 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d074bc49-4c34-47c7-b4d7-7d2fa91c192c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 0.485324 Aug 25 12:44:49.846671 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 490/969] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:49 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:49.966955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-830b7ed0-c6ab-4164-b5ed-7295df44db0a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:50.002710 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-830b7ed0-c6ab-4164-b5ed-7295df44db0a tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1935 microversion: 2.75 time: 0.249497 Aug 25 12:44:50.024871 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 480/970] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:49 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1935 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:50.162114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc99305d-32a5-4faa-a5f1-546834e48300 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:50.165478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc99305d-32a5-4faa-a5f1-546834e48300 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:50.183542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc99305d-32a5-4faa-a5f1-546834e48300 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:50.185701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc99305d-32a5-4faa-a5f1-546834e48300 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:50.188898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc99305d-32a5-4faa-a5f1-546834e48300 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:50.190953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc99305d-32a5-4faa-a5f1-546834e48300 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:50.193173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc99305d-32a5-4faa-a5f1-546834e48300 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:50.194345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc99305d-32a5-4faa-a5f1-546834e48300 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:50.368821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:50.372716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:50.391126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:50.392284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:50.395117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:50.396930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:50.398129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:50.399505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:50.724515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc99305d-32a5-4faa-a5f1-546834e48300 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:50.755574 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc99305d-32a5-4faa-a5f1-546834e48300 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1472 microversion: 2.1 time: 0.603544 Aug 25 12:44:50.757468 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 491/971] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:50 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1472 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:50.795409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a9b40dea-45df-4ef7-965d-f8fcfa471e14 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:50.797375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a9b40dea-45df-4ef7-965d-f8fcfa471e14 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:50.814375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:50.814841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9b40dea-45df-4ef7-965d-f8fcfa471e14 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:50.815855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9b40dea-45df-4ef7-965d-f8fcfa471e14 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:50.816891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9b40dea-45df-4ef7-965d-f8fcfa471e14 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:50.818362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9b40dea-45df-4ef7-965d-f8fcfa471e14 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:50.819321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9b40dea-45df-4ef7-965d-f8fcfa471e14 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:50.820389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9b40dea-45df-4ef7-965d-f8fcfa471e14 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:50.833903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:50.836258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:50.838074 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e364f008-7f19-4d39-ae1c-9dc25083f91a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.480933 Aug 25 12:44:50.856347 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 481/972] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:50 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:50.878014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-53317c62-377a-493f-b0f1-f099958da353 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:50.879909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-53317c62-377a-493f-b0f1-f099958da353 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:50.895028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53317c62-377a-493f-b0f1-f099958da353 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:50.896238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53317c62-377a-493f-b0f1-f099958da353 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:50.897204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53317c62-377a-493f-b0f1-f099958da353 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:50.898604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53317c62-377a-493f-b0f1-f099958da353 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:50.899758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53317c62-377a-493f-b0f1-f099958da353 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:50.900817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53317c62-377a-493f-b0f1-f099958da353 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:51.256781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a9b40dea-45df-4ef7-965d-f8fcfa471e14 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:51.272846 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a9b40dea-45df-4ef7-965d-f8fcfa471e14 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1474 microversion: 2.1 time: 0.490422 Aug 25 12:44:51.274885 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 492/973] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:50 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1474 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:51.300730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-53317c62-377a-493f-b0f1-f099958da353 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:51.311227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f725c34-eba5-432e-bed6-7b6f502dbce5 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:51.312977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f725c34-eba5-432e-bed6-7b6f502dbce5 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:51.319865 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-53317c62-377a-493f-b0f1-f099958da353 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 0.449791 Aug 25 12:44:51.327669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f725c34-eba5-432e-bed6-7b6f502dbce5 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:51.328998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f725c34-eba5-432e-bed6-7b6f502dbce5 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:51.329223 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 482/974] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:50 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:44:51.330290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f725c34-eba5-432e-bed6-7b6f502dbce5 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:51.331870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f725c34-eba5-432e-bed6-7b6f502dbce5 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:51.334120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f725c34-eba5-432e-bed6-7b6f502dbce5 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:51.335556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f725c34-eba5-432e-bed6-7b6f502dbce5 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:51.489544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-2f725c34-eba5-432e-bed6-7b6f502dbce5 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] Lazy-loading 'services' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:51.548692 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f725c34-eba5-432e-bed6-7b6f502dbce5 tempest-ServersAdmin275Test-723593882 tempest-ServersAdmin275Test-723593882-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1920 microversion: 2.75 time: 0.256305 Aug 25 12:44:51.550317 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 493/975] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:51 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1920 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:51.600294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eb57a45f-2cf5-4e9b-a765-acb9d677d3a3 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:51.602856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb57a45f-2cf5-4e9b-a765-acb9d677d3a3 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:51.617050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb57a45f-2cf5-4e9b-a765-acb9d677d3a3 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:51.618785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb57a45f-2cf5-4e9b-a765-acb9d677d3a3 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:51.620080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb57a45f-2cf5-4e9b-a765-acb9d677d3a3 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:51.622361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb57a45f-2cf5-4e9b-a765-acb9d677d3a3 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:51.623654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb57a45f-2cf5-4e9b-a765-acb9d677d3a3 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:51.624991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb57a45f-2cf5-4e9b-a765-acb9d677d3a3 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:51.703412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb57a45f-2cf5-4e9b-a765-acb9d677d3a3 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:44:51.797787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-db6ec820-c4fb-43b6-9f7b-b3627aebe17f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:51.799449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-db6ec820-c4fb-43b6-9f7b-b3627aebe17f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:51.838215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db6ec820-c4fb-43b6-9f7b-b3627aebe17f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:51.840694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db6ec820-c4fb-43b6-9f7b-b3627aebe17f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:51.844721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db6ec820-c4fb-43b6-9f7b-b3627aebe17f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:51.850094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db6ec820-c4fb-43b6-9f7b-b3627aebe17f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:51.852544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db6ec820-c4fb-43b6-9f7b-b3627aebe17f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:51.854186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db6ec820-c4fb-43b6-9f7b-b3627aebe17f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:51.952108 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eb57a45f-2cf5-4e9b-a765-acb9d677d3a3 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "DELETE /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 204 len: 0 microversion: 2.75 time: 0.358710 Aug 25 12:44:51.962256 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 483/976] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:44:51 2022] DELETE /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 12:44:51.990665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:51.994502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:52.010547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:52.012678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:52.013663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:52.015059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:52.016341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:52.017776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:52.595408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:52.609157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-db6ec820-c4fb-43b6-9f7b-b3627aebe17f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:52.629185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:52.634717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:52.643179 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6e2d7714-a43e-4163-a605-979571687325 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.678419 Aug 25 12:44:52.644253 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 484/977] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:51 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:52.662408 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-db6ec820-c4fb-43b6-9f7b-b3627aebe17f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1472 microversion: 2.1 time: 0.871219 Aug 25 12:44:52.667037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:52.668662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:52.669101 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 494/978] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:51 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1472 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:52.690731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eee242af-c8de-42e3-8c16-de3cab49c691 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:52.692394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eee242af-c8de-42e3-8c16-de3cab49c691 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:52.697663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:52.698208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:52.698670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:52.701389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:52.702422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:52.703303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:52.721567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee242af-c8de-42e3-8c16-de3cab49c691 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:52.722355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee242af-c8de-42e3-8c16-de3cab49c691 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:52.723135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee242af-c8de-42e3-8c16-de3cab49c691 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:52.724918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee242af-c8de-42e3-8c16-de3cab49c691 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:52.725594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee242af-c8de-42e3-8c16-de3cab49c691 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:52.726055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee242af-c8de-42e3-8c16-de3cab49c691 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:52.763989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:53.042336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:53.079825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:53.084239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:53.139940 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9b427d22-bf14-478f-a9ef-9f2078c4c186 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1444 microversion: 2.75 time: 0.493703 Aug 25 12:44:53.152570 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 485/979] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:52 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1444 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:53.175397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b7040ea1-c531-430b-b537-ade15add3618 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:53.182869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b7040ea1-c531-430b-b537-ade15add3618 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:53.214155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7040ea1-c531-430b-b537-ade15add3618 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.216524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7040ea1-c531-430b-b537-ade15add3618 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.217487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7040ea1-c531-430b-b537-ade15add3618 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.222204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7040ea1-c531-430b-b537-ade15add3618 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.223389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7040ea1-c531-430b-b537-ade15add3618 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.224227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7040ea1-c531-430b-b537-ade15add3618 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.228535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eee242af-c8de-42e3-8c16-de3cab49c691 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:53.264375 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eee242af-c8de-42e3-8c16-de3cab49c691 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1471 microversion: 2.1 time: 0.585939 Aug 25 12:44:53.269289 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 495/980] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:52 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1471 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:53.688106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-183e8ec1-be4d-4bea-afce-05df65bf1a56 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Calling method '.version_select at 0x7f3a2aaf8c10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:53.702190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183e8ec1-be4d-4bea-afce-05df65bf1a56 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.704204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183e8ec1-be4d-4bea-afce-05df65bf1a56 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.709025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183e8ec1-be4d-4bea-afce-05df65bf1a56 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.713982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183e8ec1-be4d-4bea-afce-05df65bf1a56 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.715117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183e8ec1-be4d-4bea-afce-05df65bf1a56 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.715946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183e8ec1-be4d-4bea-afce-05df65bf1a56 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.782967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b7040ea1-c531-430b-b537-ade15add3618 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:53.787696 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-183e8ec1-be4d-4bea-afce-05df65bf1a56 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.494699 Aug 25 12:44:53.802357 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b7040ea1-c531-430b-b537-ade15add3618 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 0.647780 Aug 25 12:44:53.814093 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 496/981] 10.222.0.70 () {58 vars in 1128 bytes} [Thu Aug 25 12:44:53 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:53.824993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d31106e-5ab2-405d-bb88-024fafbe65d1 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:53.826195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d31106e-5ab2-405d-bb88-024fafbe65d1 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:53.834074 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 486/982] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:53 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:53.837399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d31106e-5ab2-405d-bb88-024fafbe65d1 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.837981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d31106e-5ab2-405d-bb88-024fafbe65d1 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.838543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d31106e-5ab2-405d-bb88-024fafbe65d1 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.839359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d31106e-5ab2-405d-bb88-024fafbe65d1 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.840135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d31106e-5ab2-405d-bb88-024fafbe65d1 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.841574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d31106e-5ab2-405d-bb88-024fafbe65d1 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.843960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8498d8f-7350-4942-81e8-64170ab97661 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:53.845699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a8498d8f-7350-4942-81e8-64170ab97661 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:53.880975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8498d8f-7350-4942-81e8-64170ab97661 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.882413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8498d8f-7350-4942-81e8-64170ab97661 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.885404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8498d8f-7350-4942-81e8-64170ab97661 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.890456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8498d8f-7350-4942-81e8-64170ab97661 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.891888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8498d8f-7350-4942-81e8-64170ab97661 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.896752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8498d8f-7350-4942-81e8-64170ab97661 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.947409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:54.006726 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d31106e-5ab2-405d-bb88-024fafbe65d1 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc/action" status: 204 len: 0 microversion: 2.1 time: 0.189864 Aug 25 12:44:54.009740 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 497/983] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:44:53 2022] POST /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc/action => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:54.023731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:54.024860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:54.042229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:54.042229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:54.043950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:54.045570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:54.046856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:54.049684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:54.484979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a8498d8f-7350-4942-81e8-64170ab97661 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:54.514680 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a8498d8f-7350-4942-81e8-64170ab97661 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1472 microversion: 2.1 time: 0.676889 Aug 25 12:44:54.516768 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 487/984] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:53 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1472 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:54.530058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3a35df21-4394-4b87-992f-a4eb15123e00 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Calling method '.version_select at 0x7f3a2a5871f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:54.549599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a35df21-4394-4b87-992f-a4eb15123e00 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:54.550647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a35df21-4394-4b87-992f-a4eb15123e00 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:54.551456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a35df21-4394-4b87-992f-a4eb15123e00 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:54.553555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a35df21-4394-4b87-992f-a4eb15123e00 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:54.554419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a35df21-4394-4b87-992f-a4eb15123e00 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:54.555231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a35df21-4394-4b87-992f-a4eb15123e00 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:54.630886 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3a35df21-4394-4b87-992f-a4eb15123e00 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.110172 Aug 25 12:44:54.641969 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 488/985] 10.222.0.70 () {58 vars in 1139 bytes} [Thu Aug 25 12:44:54 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:54.666461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a64960b1-99c0-4e28-b86b-f6f356b24f52 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:54.667716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a64960b1-99c0-4e28-b86b-f6f356b24f52 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:54.696082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:54.705818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a64960b1-99c0-4e28-b86b-f6f356b24f52 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:54.705818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a64960b1-99c0-4e28-b86b-f6f356b24f52 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:54.713005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a64960b1-99c0-4e28-b86b-f6f356b24f52 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:54.714671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a64960b1-99c0-4e28-b86b-f6f356b24f52 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:54.719865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:54.721247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a64960b1-99c0-4e28-b86b-f6f356b24f52 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:54.722639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a64960b1-99c0-4e28-b86b-f6f356b24f52 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:54.724661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:54.728011 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42cc6029-c8e6-402b-8d1f-bb3c6586dca5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.713794 Aug 25 12:44:54.730881 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 498/986] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:54 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:54.742809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:54.744662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:54.763067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:54.764570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:54.765827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:54.768161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:54.769560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:54.771351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.295933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:55.314614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:55.319865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:55.329734 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-110506b1-a60a-44ba-a6ba-f57fe044953b tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1444 microversion: 2.75 time: 0.596545 Aug 25 12:44:55.331120 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 499/987] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:54 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1444 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:55.339386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e961ceb-ac56-4664-9a10-dc362cf37d86 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Calling method '.version_select at 0x7f3a2a6b4e50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:55.356656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e961ceb-ac56-4664-9a10-dc362cf37d86 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.358234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e961ceb-ac56-4664-9a10-dc362cf37d86 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.359622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e961ceb-ac56-4664-9a10-dc362cf37d86 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.361753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e961ceb-ac56-4664-9a10-dc362cf37d86 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.363444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e961ceb-ac56-4664-9a10-dc362cf37d86 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.364541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e961ceb-ac56-4664-9a10-dc362cf37d86 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.423357 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e961ceb-ac56-4664-9a10-dc362cf37d86 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.089961 Aug 25 12:44:55.430599 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 500/988] 10.222.0.70 () {58 vars in 1145 bytes} [Thu Aug 25 12:44:55 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:44:55.434128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-168f917a-ed54-4f88-8964-0dc53f850581 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:55.436295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-168f917a-ed54-4f88-8964-0dc53f850581 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:55.447990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168f917a-ed54-4f88-8964-0dc53f850581 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.449678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168f917a-ed54-4f88-8964-0dc53f850581 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.450729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168f917a-ed54-4f88-8964-0dc53f850581 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.452255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168f917a-ed54-4f88-8964-0dc53f850581 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.453258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168f917a-ed54-4f88-8964-0dc53f850581 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.454226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168f917a-ed54-4f88-8964-0dc53f850581 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.456527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a64960b1-99c0-4e28-b86b-f6f356b24f52 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:55.479307 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a64960b1-99c0-4e28-b86b-f6f356b24f52 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1471 microversion: 2.1 time: 0.835482 Aug 25 12:44:55.480626 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 489/989] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:54 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1471 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:55.499999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16b8f982-8081-421f-8907-043a528fb612 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Calling method '.version_select at 0x7f3a2ab73790>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:55.508549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b8f982-8081-421f-8907-043a528fb612 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.510676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b8f982-8081-421f-8907-043a528fb612 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.512973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b8f982-8081-421f-8907-043a528fb612 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.514585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b8f982-8081-421f-8907-043a528fb612 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.515456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b8f982-8081-421f-8907-043a528fb612 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.516238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b8f982-8081-421f-8907-043a528fb612 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.566856 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-16b8f982-8081-421f-8907-043a528fb612 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.084313 Aug 25 12:44:55.569781 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 490/990] 10.222.0.70 () {58 vars in 1128 bytes} [Thu Aug 25 12:44:55 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:55.581032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b5609ca-5263-43d3-8694-b0860d2909c5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:55.582570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b5609ca-5263-43d3-8694-b0860d2909c5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:55.595297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5609ca-5263-43d3-8694-b0860d2909c5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.596195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5609ca-5263-43d3-8694-b0860d2909c5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.597269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5609ca-5263-43d3-8694-b0860d2909c5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.599042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5609ca-5263-43d3-8694-b0860d2909c5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.600255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5609ca-5263-43d3-8694-b0860d2909c5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.601311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5609ca-5263-43d3-8694-b0860d2909c5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.941238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-168f917a-ed54-4f88-8964-0dc53f850581 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:55.975549 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-168f917a-ed54-4f88-8964-0dc53f850581 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 0.545150 Aug 25 12:44:55.990333 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 501/991] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:55 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:56.039149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-840b3a81-b15f-4295-a4a0-2e257ff2c167 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Calling method '.version_select at 0x7f3a2a6b4ca0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:56.062152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-840b3a81-b15f-4295-a4a0-2e257ff2c167 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.063602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-840b3a81-b15f-4295-a4a0-2e257ff2c167 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.068906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-840b3a81-b15f-4295-a4a0-2e257ff2c167 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.070998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-840b3a81-b15f-4295-a4a0-2e257ff2c167 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.072208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-840b3a81-b15f-4295-a4a0-2e257ff2c167 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.078035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-840b3a81-b15f-4295-a4a0-2e257ff2c167 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.191598 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-840b3a81-b15f-4295-a4a0-2e257ff2c167 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.198879 Aug 25 12:44:56.193665 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 502/992] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 12:44:55 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:56.203665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:56.205673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:56.219658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.221667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.223160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.225049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.226301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.227436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.236279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b5609ca-5263-43d3-8694-b0860d2909c5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:56.263520 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b5609ca-5263-43d3-8694-b0860d2909c5 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1472 microversion: 2.1 time: 0.689131 Aug 25 12:44:56.274651 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 491/993] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:55 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1472 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:56.298508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-edbff2f4-0642-4be7-b2cb-2d863ad78a45 req-c0d35917-d895-4886-8945-5e7a583f6e18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "305f349d-9b1a-4ad8-996a-e0da7d1cefd2", "tag": "2e9adcd5-fb4f-40dc-8678-e173de267b62"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:56.338251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-edbff2f4-0642-4be7-b2cb-2d863ad78a45 req-c0d35917-d895-4886-8945-5e7a583f6e18 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.340155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-edbff2f4-0642-4be7-b2cb-2d863ad78a45 req-c0d35917-d895-4886-8945-5e7a583f6e18 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.345362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-edbff2f4-0642-4be7-b2cb-2d863ad78a45 req-c0d35917-d895-4886-8945-5e7a583f6e18 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.389354 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-edbff2f4-0642-4be7-b2cb-2d863ad78a45 req-c0d35917-d895-4886-8945-5e7a583f6e18 service nova] Creating event network-changed:2e9adcd5-fb4f-40dc-8678-e173de267b62 for instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 on n-h1-852771-8 Aug 25 12:44:56.399601 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-edbff2f4-0642-4be7-b2cb-2d863ad78a45 req-c0d35917-d895-4886-8945-5e7a583f6e18 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122132 Aug 25 12:44:56.401593 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 492/994] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:56.412781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd0126f9-5218-4d46-a620-37541b4008e9 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Calling method '.version_select at 0x7f3a2a587160>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:56.421564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd0126f9-5218-4d46-a620-37541b4008e9 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.423057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd0126f9-5218-4d46-a620-37541b4008e9 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.424183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd0126f9-5218-4d46-a620-37541b4008e9 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.426060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd0126f9-5218-4d46-a620-37541b4008e9 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.427258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd0126f9-5218-4d46-a620-37541b4008e9 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.428360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd0126f9-5218-4d46-a620-37541b4008e9 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.487280 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bd0126f9-5218-4d46-a620-37541b4008e9 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.082581 Aug 25 12:44:56.489191 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 493/995] 10.222.0.70 () {58 vars in 1128 bytes} [Thu Aug 25 12:44:56 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:56.503275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:56.505298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:56.536902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.538364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.542129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.547269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.548477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.552266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.698277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.704454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.705866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.707064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lazy-loading 'fault' on Instance uuid 09689d0e-3306-4d78-be3a-f3d61f888e23 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:56.805459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:56.847889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:56.852516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:56.856163 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e8f1a5c3-1230-44d1-9d26-597dc806f44a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.659232 Aug 25 12:44:56.858264 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 503/996] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:56 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:56.871710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a6208629-59b8-474a-b383-f88cd935cb06 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Calling method '.version_select at 0x7f3a2a614310>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:56.891677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6208629-59b8-474a-b383-f88cd935cb06 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.893097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6208629-59b8-474a-b383-f88cd935cb06 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.894567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6208629-59b8-474a-b383-f88cd935cb06 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.906547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:56.925636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6208629-59b8-474a-b383-f88cd935cb06 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:56.927183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6208629-59b8-474a-b383-f88cd935cb06 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:56.927450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6208629-59b8-474a-b383-f88cd935cb06 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:56.941856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:56.951951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f22b3eeabc634b3e8855f855f5b310f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd319f78a4944076a4d9df0f894f1764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:56.973700 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-726b35d2-b196-440a-9935-a8a6be9224f8 tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 200 len: 1449 microversion: 2.75 time: 0.482007 Aug 25 12:44:56.975249 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 494/997] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:56 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 1449 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:56.990204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25916a40-f329-400f-aedf-3dd019ab61b8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:56.991385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-25916a40-f329-400f-aedf-3dd019ab61b8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:57.008461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25916a40-f329-400f-aedf-3dd019ab61b8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.010295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25916a40-f329-400f-aedf-3dd019ab61b8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.011130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25916a40-f329-400f-aedf-3dd019ab61b8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.014073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25916a40-f329-400f-aedf-3dd019ab61b8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.014073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25916a40-f329-400f-aedf-3dd019ab61b8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.014486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25916a40-f329-400f-aedf-3dd019ab61b8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.024880 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a6208629-59b8-474a-b383-f88cd935cb06 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-h2-852771-8" status: 200 len: 729 microversion: 2.1 time: 0.163667 Aug 25 12:44:57.038269 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 504/998] 10.222.0.70 () {58 vars in 1170 bytes} [Thu Aug 25 12:44:56 2022] GET /compute/v2.1/os-hosts/n-h2-852771-8 => generated 729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:57.053073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-828cbcb0-7986-4c1f-b62f-258bb4694691 req-75956b19-6f75-49d4-9621-a610e6331311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe666709-aa48-4785-8e47-ac9011592ddc", "name": "network-vif-plugged", "status": "completed", "tag": "dde49cc7-dbaf-4c67-b244-a03554f3fb0c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:57.079388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-828cbcb0-7986-4c1f-b62f-258bb4694691 req-75956b19-6f75-49d4-9621-a610e6331311 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.080950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-828cbcb0-7986-4c1f-b62f-258bb4694691 req-75956b19-6f75-49d4-9621-a610e6331311 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.082096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-828cbcb0-7986-4c1f-b62f-258bb4694691 req-75956b19-6f75-49d4-9621-a610e6331311 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.112213 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-828cbcb0-7986-4c1f-b62f-258bb4694691 req-75956b19-6f75-49d4-9621-a610e6331311 service nova] Creating event network-vif-plugged:dde49cc7-dbaf-4c67-b244-a03554f3fb0c for instance fe666709-aa48-4785-8e47-ac9011592ddc on n-h1-852771-8 Aug 25 12:44:57.129575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-828cbcb0-7986-4c1f-b62f-258bb4694691 req-75956b19-6f75-49d4-9621-a610e6331311 service nova] Instance fe666709-aa48-4785-8e47-ac9011592ddc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:44:57.154988 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-828cbcb0-7986-4c1f-b62f-258bb4694691 req-75956b19-6f75-49d4-9621-a610e6331311 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113369 Aug 25 12:44:57.157058 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 505/999] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:57.170258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-41c2d6de-04cf-4472-94ca-040837d954a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:57.171643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-41c2d6de-04cf-4472-94ca-040837d954a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:57.185801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41c2d6de-04cf-4472-94ca-040837d954a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.186974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41c2d6de-04cf-4472-94ca-040837d954a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.187800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41c2d6de-04cf-4472-94ca-040837d954a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.191345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41c2d6de-04cf-4472-94ca-040837d954a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.192306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41c2d6de-04cf-4472-94ca-040837d954a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.193123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41c2d6de-04cf-4472-94ca-040837d954a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.557183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-25916a40-f329-400f-aedf-3dd019ab61b8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:57.591054 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-25916a40-f329-400f-aedf-3dd019ab61b8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1471 microversion: 2.1 time: 0.612619 Aug 25 12:44:57.601556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 495/1000] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:56 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1471 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:57.609558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6320d432-afd8-403b-8b71-830b566850b6 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Calling method '.version_select at 0x7f3a2a5e01f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:57.641407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6320d432-afd8-403b-8b71-830b566850b6 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.642550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6320d432-afd8-403b-8b71-830b566850b6 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.643862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6320d432-afd8-403b-8b71-830b566850b6 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.666598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-41c2d6de-04cf-4472-94ca-040837d954a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:57.694846 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-41c2d6de-04cf-4472-94ca-040837d954a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 0.534243 Aug 25 12:44:57.725559 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 506/1001] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:57 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:57.733037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6320d432-afd8-403b-8b71-830b566850b6 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.734064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6320d432-afd8-403b-8b71-830b566850b6 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.735051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6320d432-afd8-403b-8b71-830b566850b6 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.746954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4909641f-c39d-4e25-b9bf-18885f3c6cd1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:57.746954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4909641f-c39d-4e25-b9bf-18885f3c6cd1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:57.768011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4909641f-c39d-4e25-b9bf-18885f3c6cd1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.768900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4909641f-c39d-4e25-b9bf-18885f3c6cd1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.769632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4909641f-c39d-4e25-b9bf-18885f3c6cd1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.771026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4909641f-c39d-4e25-b9bf-18885f3c6cd1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.771974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4909641f-c39d-4e25-b9bf-18885f3c6cd1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.772646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4909641f-c39d-4e25-b9bf-18885f3c6cd1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.848979 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6320d432-afd8-403b-8b71-830b566850b6 tempest-HostsAdminTestJSON-282613912 tempest-HostsAdminTestJSON-282613912-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-h1-852771-8" status: 200 len: 860 microversion: 2.1 time: 0.250863 Aug 25 12:44:57.852193 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 496/1002] 10.222.0.70 () {58 vars in 1170 bytes} [Thu Aug 25 12:44:57 2022] GET /compute/v2.1/os-hosts/n-h1-852771-8 => generated 860 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:57.913917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:57.920155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:57.939119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.940362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.943742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.945352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.947222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.951369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:58.399835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4909641f-c39d-4e25-b9bf-18885f3c6cd1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:58.426707 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4909641f-c39d-4e25-b9bf-18885f3c6cd1 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1472 microversion: 2.1 time: 0.699267 Aug 25 12:44:58.439377 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 507/1003] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:57 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1472 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:58.458121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:58.459866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] [instance: 09689d0e-3306-4d78-be3a-f3d61f888e23] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:58.498792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:58.502400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:58.510790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:58.513260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:58.514159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:58.514941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:58.572504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:58.573351 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] HTTP exception thrown: Instance 09689d0e-3306-4d78-be3a-f3d61f888e23 could not be found. Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Request method failure captured: Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 HTTP/1.1 Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25h6krwkl3q8uD4zioN1Nvp6VzXsUIkI1Eyz7OxsMMzo2p-ZMPFJzQOz3wje8Ho5vYr-yg9st2RM9boH9lkOxl3qCbTmMoxDTYyAnBuq1HNR9MnelSKSirasuyfxNbZ9ldiHb6-QncqzrqQ2lS4sDZ7ZbYM0WK-PGyzK07xoRMB8XM Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.75 Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: bd319f78a4944076a4d9df0f894f1764 Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersAdmin275Test-794282777 Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:44:58.576503 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bd319f78a4944076a4d9df0f894f1764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bd319f78a4944076a4d9df0f894f1764", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bd319f78a4944076a4d9df0f894f1764"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bd319f78a4944076a4d9df0f894f1764"}]}] Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersAdmin275Test-794282777 Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: bd319f78a4944076a4d9df0f894f1764 Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersAdmin275Test-794282777 Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersAdmin275Test-794282777-project Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: f22b3eeabc634b3e8855f855f5b310f9 Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersAdmin275Test-794282777-project Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 09689d0e-3306-4d78-be3a-f3d61f888e23 could not be found. Aug 25 12:44:58.579567 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '09689d0e-3306-4d78-be3a-f3d61f888e23'} Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09689d0e-3306-4d78-be3a-f3d61f888e23 could not be found. Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:58.581008 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09689d0e-3306-4d78-be3a-f3d61f888e23 could not be found. Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09689d0e-3306-4d78-be3a-f3d61f888e23 could not be found. Aug 25 12:44:58.583464 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:44:58.590770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] Returning 404 to user: Instance 09689d0e-3306-4d78-be3a-f3d61f888e23 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:58.590770 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a4613d76-45a7-415d-8bbc-c69a270ac1fa tempest-ServersAdmin275Test-794282777 tempest-ServersAdmin275Test-794282777-project] 10.222.0.70 "GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23" status: 404 len: 111 microversion: 2.75 time: 0.142116 Aug 25 12:44:58.590770 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 508/1004] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:58 2022] GET /compute/v2.1/servers/09689d0e-3306-4d78-be3a-f3d61f888e23 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:44:58.610370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:58.614935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:58.617746 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b935119-78f6-43a7-b28a-4b530be3792e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.719116 Aug 25 12:44:58.629549 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 497/1005] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:57 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:58.640065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7e33f2a2-d539-4096-bda6-4f0b9933f226 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:58.641475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7e33f2a2-d539-4096-bda6-4f0b9933f226 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:58.668526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e33f2a2-d539-4096-bda6-4f0b9933f226 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:58.669370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e33f2a2-d539-4096-bda6-4f0b9933f226 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:58.670234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e33f2a2-d539-4096-bda6-4f0b9933f226 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:58.671598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e33f2a2-d539-4096-bda6-4f0b9933f226 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:58.672467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e33f2a2-d539-4096-bda6-4f0b9933f226 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:58.673223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e33f2a2-d539-4096-bda6-4f0b9933f226 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:58.743284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0814f05f-5251-4c3d-9fe7-8347728cb417 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:58.744547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0814f05f-5251-4c3d-9fe7-8347728cb417 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:58.786103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0814f05f-5251-4c3d-9fe7-8347728cb417 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:58.787632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0814f05f-5251-4c3d-9fe7-8347728cb417 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:58.788900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0814f05f-5251-4c3d-9fe7-8347728cb417 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:58.790349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0814f05f-5251-4c3d-9fe7-8347728cb417 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:58.791227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0814f05f-5251-4c3d-9fe7-8347728cb417 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:58.792025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0814f05f-5251-4c3d-9fe7-8347728cb417 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:59.685098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7e33f2a2-d539-4096-bda6-4f0b9933f226 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:59.720718 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7e33f2a2-d539-4096-bda6-4f0b9933f226 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1471 microversion: 2.1 time: 1.088100 Aug 25 12:44:59.722285 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 509/1006] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:58 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1471 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:59.737048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6a159d91-d1a5-4fe8-adb7-d6031acc67b9 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:59.749437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6a159d91-d1a5-4fe8-adb7-d6031acc67b9 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:59.785045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a159d91-d1a5-4fe8-adb7-d6031acc67b9 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:59.791237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a159d91-d1a5-4fe8-adb7-d6031acc67b9 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:59.799012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a159d91-d1a5-4fe8-adb7-d6031acc67b9 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:59.801070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a159d91-d1a5-4fe8-adb7-d6031acc67b9 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:59.804014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a159d91-d1a5-4fe8-adb7-d6031acc67b9 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:59.806402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a159d91-d1a5-4fe8-adb7-d6031acc67b9 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:59.833285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0814f05f-5251-4c3d-9fe7-8347728cb417 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:59.864558 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0814f05f-5251-4c3d-9fe7-8347728cb417 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 1.133655 Aug 25 12:44:59.874507 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 498/1007] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:58 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:44:59.907499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:59.917190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:59.943305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:59.944140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:59.944938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:59.946203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:59.947010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:59.947762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:00.441618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:00.471939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:00.486035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:00.488228 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-99bf3c11-73c7-4120-87db-13c4873b2f30 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.597122 Aug 25 12:45:00.488748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6a159d91-d1a5-4fe8-adb7-d6031acc67b9 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:00.489215 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 499/1008] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:59 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:45:00.521869 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6a159d91-d1a5-4fe8-adb7-d6031acc67b9 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1478 microversion: 2.1 time: 0.789410 Aug 25 12:45:00.531911 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 510/1009] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:59 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1478 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:00.773736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b58a9e2b-447d-4619-a976-c2dac28ab589 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:00.779152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b58a9e2b-447d-4619-a976-c2dac28ab589 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:00.809288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58a9e2b-447d-4619-a976-c2dac28ab589 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:00.810620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58a9e2b-447d-4619-a976-c2dac28ab589 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:00.811989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58a9e2b-447d-4619-a976-c2dac28ab589 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:00.813773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58a9e2b-447d-4619-a976-c2dac28ab589 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:00.815053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58a9e2b-447d-4619-a976-c2dac28ab589 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:00.816936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58a9e2b-447d-4619-a976-c2dac28ab589 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:00.916399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-281847a3-f147-4c21-b8ca-ba16012fe6b5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:00.923446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-281847a3-f147-4c21-b8ca-ba16012fe6b5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:00.984950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-281847a3-f147-4c21-b8ca-ba16012fe6b5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:00.988277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-281847a3-f147-4c21-b8ca-ba16012fe6b5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:00.989180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-281847a3-f147-4c21-b8ca-ba16012fe6b5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:00.990153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-281847a3-f147-4c21-b8ca-ba16012fe6b5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:00.991382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-281847a3-f147-4c21-b8ca-ba16012fe6b5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:00.992221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-281847a3-f147-4c21-b8ca-ba16012fe6b5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:01.173631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b58a9e2b-447d-4619-a976-c2dac28ab589 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:01.194754 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b58a9e2b-447d-4619-a976-c2dac28ab589 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1471 microversion: 2.1 time: 0.429151 Aug 25 12:45:01.201699 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 500/1010] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:00 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1471 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:01.441412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-281847a3-f147-4c21-b8ca-ba16012fe6b5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:01.461348 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-281847a3-f147-4c21-b8ca-ba16012fe6b5 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 0.551772 Aug 25 12:45:01.465660 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 511/1011] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:00 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:01.540363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:01.545035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:01.578978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-07b76ba9-3cc0-4bf2-9e37-f7f1309f10ca tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:01.584122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-07b76ba9-3cc0-4bf2-9e37-f7f1309f10ca tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:01.590251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:01.591589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:01.592933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:01.594396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:01.595318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:01.596137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:01.608846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07b76ba9-3cc0-4bf2-9e37-f7f1309f10ca tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:01.610288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07b76ba9-3cc0-4bf2-9e37-f7f1309f10ca tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:01.613108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07b76ba9-3cc0-4bf2-9e37-f7f1309f10ca tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:01.614936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07b76ba9-3cc0-4bf2-9e37-f7f1309f10ca tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:01.618464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07b76ba9-3cc0-4bf2-9e37-f7f1309f10ca tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:01.620028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07b76ba9-3cc0-4bf2-9e37-f7f1309f10ca tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:02.360111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-07b76ba9-3cc0-4bf2-9e37-f7f1309f10ca tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:02.408617 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-07b76ba9-3cc0-4bf2-9e37-f7f1309f10ca tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1478 microversion: 2.1 time: 0.843410 Aug 25 12:45:02.423104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:02.434401 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 512/1012] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:01 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1478 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:45:02.441947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:02.446396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:02.449544 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5dc3f946-87a0-482c-a908-dc3abef52c02 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.917346 Aug 25 12:45:02.451129 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 501/1013] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:01 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:45:02.454176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d22f2840-91c2-4a2a-8715-4cf132a31e04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:02.456377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d22f2840-91c2-4a2a-8715-4cf132a31e04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:02.489564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d22f2840-91c2-4a2a-8715-4cf132a31e04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:02.491509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d22f2840-91c2-4a2a-8715-4cf132a31e04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:02.492369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d22f2840-91c2-4a2a-8715-4cf132a31e04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:02.496859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d22f2840-91c2-4a2a-8715-4cf132a31e04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:02.498416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d22f2840-91c2-4a2a-8715-4cf132a31e04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:02.504494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d22f2840-91c2-4a2a-8715-4cf132a31e04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:02.514756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fc9a6333-228e-420c-8ce6-1980a57afea4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:02.516463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fc9a6333-228e-420c-8ce6-1980a57afea4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:02.532254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc9a6333-228e-420c-8ce6-1980a57afea4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:02.533932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc9a6333-228e-420c-8ce6-1980a57afea4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:02.535085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc9a6333-228e-420c-8ce6-1980a57afea4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:02.536758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc9a6333-228e-420c-8ce6-1980a57afea4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:02.538355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc9a6333-228e-420c-8ce6-1980a57afea4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:02.539545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc9a6333-228e-420c-8ce6-1980a57afea4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:03.167155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d22f2840-91c2-4a2a-8715-4cf132a31e04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:03.215481 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d22f2840-91c2-4a2a-8715-4cf132a31e04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1471 microversion: 2.1 time: 0.778747 Aug 25 12:45:03.244390 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 513/1014] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:02 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1471 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:03.265480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f7c2d180-645f-42b3-b3a9-457adb0822dd req-93244a8a-a993-48f8-8780-cb9d45be424c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42add69-b14a-4dd1-a7ce-8c6c162b4e1a", "name": "network-vif-unplugged", "status": "completed", "tag": "0a60e19f-de52-46f3-aca2-8d097515612b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:03.278761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc9a6333-228e-420c-8ce6-1980a57afea4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:03.290628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f7c2d180-645f-42b3-b3a9-457adb0822dd req-93244a8a-a993-48f8-8780-cb9d45be424c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:03.292035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f7c2d180-645f-42b3-b3a9-457adb0822dd req-93244a8a-a993-48f8-8780-cb9d45be424c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:03.293250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f7c2d180-645f-42b3-b3a9-457adb0822dd req-93244a8a-a993-48f8-8780-cb9d45be424c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:03.322761 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f7c2d180-645f-42b3-b3a9-457adb0822dd req-93244a8a-a993-48f8-8780-cb9d45be424c service nova] Creating event network-vif-unplugged:0a60e19f-de52-46f3-aca2-8d097515612b for instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a on n-h1-852771-8 Aug 25 12:45:03.337281 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f7c2d180-645f-42b3-b3a9-457adb0822dd req-93244a8a-a993-48f8-8780-cb9d45be424c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087974 Aug 25 12:45:03.338980 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fc9a6333-228e-420c-8ce6-1980a57afea4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 0.834725 Aug 25 12:45:03.341362 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 514/1015] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:03.341918 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 502/1016] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:02 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:03.471821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b017595-22ad-4c8c-8de7-814333c06304 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:03.474680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3b017595-22ad-4c8c-8de7-814333c06304 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:03.504218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:03.506957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:03.511120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b017595-22ad-4c8c-8de7-814333c06304 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:03.512181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b017595-22ad-4c8c-8de7-814333c06304 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:03.512958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b017595-22ad-4c8c-8de7-814333c06304 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:03.526960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b017595-22ad-4c8c-8de7-814333c06304 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:03.527944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b017595-22ad-4c8c-8de7-814333c06304 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:03.530759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b017595-22ad-4c8c-8de7-814333c06304 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:03.609537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:03.611280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.050s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:03.612607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:03.615506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:03.617717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:03.618847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:04.222861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:04.260745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:04.266047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:04.269233 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9603b23a-d56d-49a3-833d-2476eb379dc1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.778294 Aug 25 12:45:04.271282 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 503/1017] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:03 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:45:04.284648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-92cc424d-1916-4ff1-8161-18b9a4ecb442 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:04.286477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-92cc424d-1916-4ff1-8161-18b9a4ecb442 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:04.313604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92cc424d-1916-4ff1-8161-18b9a4ecb442 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:04.315159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92cc424d-1916-4ff1-8161-18b9a4ecb442 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:04.322770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92cc424d-1916-4ff1-8161-18b9a4ecb442 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:04.330517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92cc424d-1916-4ff1-8161-18b9a4ecb442 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:04.331996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92cc424d-1916-4ff1-8161-18b9a4ecb442 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:04.334291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92cc424d-1916-4ff1-8161-18b9a4ecb442 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:04.392348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:04.429078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3b017595-22ad-4c8c-8de7-814333c06304 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:04.486204 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3b017595-22ad-4c8c-8de7-814333c06304 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1478 microversion: 2.1 time: 1.013486 Aug 25 12:45:04.497975 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 515/1018] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:03 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1478 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:04.531462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aeed8f4b-6456-4184-a6db-4256376c3510 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:04.532694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-aeed8f4b-6456-4184-a6db-4256376c3510 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:04.564737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeed8f4b-6456-4184-a6db-4256376c3510 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:04.568388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeed8f4b-6456-4184-a6db-4256376c3510 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:04.573245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeed8f4b-6456-4184-a6db-4256376c3510 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:04.580028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeed8f4b-6456-4184-a6db-4256376c3510 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:04.587630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeed8f4b-6456-4184-a6db-4256376c3510 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:04.588461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeed8f4b-6456-4184-a6db-4256376c3510 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:04.715183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:05.020452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-92cc424d-1916-4ff1-8161-18b9a4ecb442 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:05.050665 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-92cc424d-1916-4ff1-8161-18b9a4ecb442 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1471 microversion: 2.1 time: 0.775794 Aug 25 12:45:05.051206 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 504/1019] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:04 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1471 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:05.265088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-aeed8f4b-6456-4184-a6db-4256376c3510 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:05.300267 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aeed8f4b-6456-4184-a6db-4256376c3510 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 0.795293 Aug 25 12:45:05.301889 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 516/1020] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:04 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:05.330911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:05.335449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:05.363271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:05.372155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:05.373303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:05.374720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:05.375694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:05.376508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:05.542695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-68a98f5d-1624-4f37-b342-02a041f24c45 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:05.544135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-68a98f5d-1624-4f37-b342-02a041f24c45 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:05.573745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a98f5d-1624-4f37-b342-02a041f24c45 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:05.574720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a98f5d-1624-4f37-b342-02a041f24c45 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:05.576355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a98f5d-1624-4f37-b342-02a041f24c45 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:05.578126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a98f5d-1624-4f37-b342-02a041f24c45 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:05.591066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a98f5d-1624-4f37-b342-02a041f24c45 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:05.591884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a98f5d-1624-4f37-b342-02a041f24c45 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:06.127529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:06.146346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:06.187098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:06.194634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:06.204691 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-828302fd-3383-4e56-8818-8da9a21315df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.874291 Aug 25 12:45:06.220318 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 505/1021] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:05 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:45:06.243420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ec894538-e5d9-4a0b-87af-e09f80e9eb39 req-8e572d9c-c232-42c2-8d8f-0155e51d0dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18924dfe-fc9e-47d4-b4be-c249990c5455", "name": "network-vif-plugged", "status": "completed", "tag": "c1a94bed-79da-44e9-a740-36d602c0c193"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:06.264140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec894538-e5d9-4a0b-87af-e09f80e9eb39 req-8e572d9c-c232-42c2-8d8f-0155e51d0dcd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:06.265073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec894538-e5d9-4a0b-87af-e09f80e9eb39 req-8e572d9c-c232-42c2-8d8f-0155e51d0dcd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:06.265958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec894538-e5d9-4a0b-87af-e09f80e9eb39 req-8e572d9c-c232-42c2-8d8f-0155e51d0dcd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:06.295705 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ec894538-e5d9-4a0b-87af-e09f80e9eb39 req-8e572d9c-c232-42c2-8d8f-0155e51d0dcd service nova] Creating event network-vif-plugged:c1a94bed-79da-44e9-a740-36d602c0c193 for instance 18924dfe-fc9e-47d4-b4be-c249990c5455 on n-h1-852771-8 Aug 25 12:45:06.309704 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ec894538-e5d9-4a0b-87af-e09f80e9eb39 req-8e572d9c-c232-42c2-8d8f-0155e51d0dcd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086694 Aug 25 12:45:06.316262 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 506/1022] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:06.345633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e8f86bd7-f359-4e28-9153-57c12804a972 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:06.345984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-68a98f5d-1624-4f37-b342-02a041f24c45 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:06.346963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e8f86bd7-f359-4e28-9153-57c12804a972 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:06.375960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8f86bd7-f359-4e28-9153-57c12804a972 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:06.376953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8f86bd7-f359-4e28-9153-57c12804a972 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:06.377869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8f86bd7-f359-4e28-9153-57c12804a972 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:06.380250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8f86bd7-f359-4e28-9153-57c12804a972 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:06.381786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8f86bd7-f359-4e28-9153-57c12804a972 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:06.382625 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-68a98f5d-1624-4f37-b342-02a041f24c45 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1478 microversion: 2.1 time: 0.840101 Aug 25 12:45:06.383912 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 517/1023] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:05 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1478 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:45:06.389127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8f86bd7-f359-4e28-9153-57c12804a972 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:06.404132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-94d26ec0-00d7-4178-bd3f-a472563d7c8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:06.405277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-94d26ec0-00d7-4178-bd3f-a472563d7c8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:06.430680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94d26ec0-00d7-4178-bd3f-a472563d7c8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:06.431457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94d26ec0-00d7-4178-bd3f-a472563d7c8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:06.432002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94d26ec0-00d7-4178-bd3f-a472563d7c8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:06.438408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94d26ec0-00d7-4178-bd3f-a472563d7c8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:06.439328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94d26ec0-00d7-4178-bd3f-a472563d7c8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:06.440089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94d26ec0-00d7-4178-bd3f-a472563d7c8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:06.489848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:07.329438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e8f86bd7-f359-4e28-9153-57c12804a972 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:07.369001 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e8f86bd7-f359-4e28-9153-57c12804a972 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1463 microversion: 2.1 time: 1.045309 Aug 25 12:45:07.373669 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 507/1024] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:06 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1463 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:07.394621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:07.398260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:07.428721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:07.431286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:07.432974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:07.435335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:07.436913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:07.438998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:07.450165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-94d26ec0-00d7-4178-bd3f-a472563d7c8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:07.529610 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-94d26ec0-00d7-4178-bd3f-a472563d7c8f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 1.127945 Aug 25 12:45:07.535450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 518/1025] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:06 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:07.546242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fbe83c0e-7bcd-4338-a3ce-923cf97139df tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:07.548726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fbe83c0e-7bcd-4338-a3ce-923cf97139df tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:07.562524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe83c0e-7bcd-4338-a3ce-923cf97139df tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:07.581991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe83c0e-7bcd-4338-a3ce-923cf97139df tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:07.587381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe83c0e-7bcd-4338-a3ce-923cf97139df tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:07.594672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe83c0e-7bcd-4338-a3ce-923cf97139df tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:07.596200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe83c0e-7bcd-4338-a3ce-923cf97139df tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:07.599758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe83c0e-7bcd-4338-a3ce-923cf97139df tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:08.238302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fbe83c0e-7bcd-4338-a3ce-923cf97139df tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:08.250159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:08.284972 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fbe83c0e-7bcd-4338-a3ce-923cf97139df tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1463 microversion: 2.1 time: 0.747243 Aug 25 12:45:08.286221 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 519/1026] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:07 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1463 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:08.314867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:08.317201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-311e94b8-4a19-4194-ab12-a14686564d6f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:08.319647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:08.324136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-311e94b8-4a19-4194-ab12-a14686564d6f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:08.326463 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-270f10a9-c237-4b07-9bbb-864385c82bf2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.948239 Aug 25 12:45:08.333377 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 508/1027] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:07 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:45:08.337773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-311e94b8-4a19-4194-ab12-a14686564d6f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:08.339092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-311e94b8-4a19-4194-ab12-a14686564d6f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:08.341105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-311e94b8-4a19-4194-ab12-a14686564d6f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:08.342778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-311e94b8-4a19-4194-ab12-a14686564d6f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:08.345012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-311e94b8-4a19-4194-ab12-a14686564d6f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:08.346079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-311e94b8-4a19-4194-ab12-a14686564d6f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:08.349246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6bccad86-afef-4193-a0e3-0f83f853b1b2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'create', calling method: .version_select at 0x7f3a2a5e0280>, body: {"keypair": {"name": "tempest-keypair-1319400392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBuJnFJLfHmHkcY8UI695VXJVchm+m8IZJabGB022L2TH8QVuGYa934GXUwZWcGsQGCXaze6wjfxUTOnidHc6cnbUYbYwg2pDhkXuS5HIYTPkcOWIlBMuGzrXpx4NmnVA=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:08.406160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-6bccad86-afef-4193-a0e3-0f83f853b1b2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:45:08.476470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-6bccad86-afef-4193-a0e3-0f83f853b1b2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for user aad1bc68cede45a7b1ab7cbda0d8208e and project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:45:08.528302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:08.599704 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6bccad86-afef-4193-a0e3-0f83f853b1b2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.263029 Aug 25 12:45:08.606891 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 509/1028] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:45:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:08.647967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f0b5ef75-80cd-412f-86c6-021894889332 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:08.650167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f0b5ef75-80cd-412f-86c6-021894889332 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:08.682587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0b5ef75-80cd-412f-86c6-021894889332 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:08.691360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0b5ef75-80cd-412f-86c6-021894889332 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:08.694623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0b5ef75-80cd-412f-86c6-021894889332 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:08.698115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0b5ef75-80cd-412f-86c6-021894889332 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:08.704034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0b5ef75-80cd-412f-86c6-021894889332 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:08.707957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0b5ef75-80cd-412f-86c6-021894889332 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:08.813892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-311e94b8-4a19-4194-ab12-a14686564d6f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:08.859830 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-311e94b8-4a19-4194-ab12-a14686564d6f tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1478 microversion: 2.1 time: 0.571478 Aug 25 12:45:08.860636 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 520/1029] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:08 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1478 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:09.032816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-db57c949-be07-4ab2-a474-2681bf8371d1 req-c8222d7d-d4d5-4580-9c86-84af18e0a908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42add69-b14a-4dd1-a7ce-8c6c162b4e1a", "name": "network-vif-plugged", "status": "completed", "tag": "0a60e19f-de52-46f3-aca2-8d097515612b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:09.086980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-db57c949-be07-4ab2-a474-2681bf8371d1 req-c8222d7d-d4d5-4580-9c86-84af18e0a908 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:09.087868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-db57c949-be07-4ab2-a474-2681bf8371d1 req-c8222d7d-d4d5-4580-9c86-84af18e0a908 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:09.098679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-db57c949-be07-4ab2-a474-2681bf8371d1 req-c8222d7d-d4d5-4580-9c86-84af18e0a908 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:09.127493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f0b5ef75-80cd-412f-86c6-021894889332 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:09.151226 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-db57c949-be07-4ab2-a474-2681bf8371d1 req-c8222d7d-d4d5-4580-9c86-84af18e0a908 service nova] Creating event network-vif-plugged:0a60e19f-de52-46f3-aca2-8d097515612b for instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a on n-h1-852771-8 Aug 25 12:45:09.163689 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f0b5ef75-80cd-412f-86c6-021894889332 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 0.551644 Aug 25 12:45:09.182333 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 510/1030] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:08 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:09.202422 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-db57c949-be07-4ab2-a474-2681bf8371d1 req-c8222d7d-d4d5-4580-9c86-84af18e0a908 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182057 Aug 25 12:45:09.203543 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 521/1031] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:45:09.381612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:09.383479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:09.397103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:09.398624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:09.399307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:09.400684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:09.401448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:09.402614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:09.680685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:09.703349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:09.707523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:09.709841 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-264e69c8-9abf-4635-96a6-f664e42b0480 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 0.336564 Aug 25 12:45:09.718824 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 511/1032] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:09 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:45:09.916393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-457d63a7-6c79-4d62-8739-d7d7f7dd7908 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:09.921850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-457d63a7-6c79-4d62-8739-d7d7f7dd7908 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:09.951936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-457d63a7-6c79-4d62-8739-d7d7f7dd7908 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:09.953297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-457d63a7-6c79-4d62-8739-d7d7f7dd7908 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:09.955424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-457d63a7-6c79-4d62-8739-d7d7f7dd7908 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:09.957493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-457d63a7-6c79-4d62-8739-d7d7f7dd7908 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:09.958770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-457d63a7-6c79-4d62-8739-d7d7f7dd7908 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:09.959865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-457d63a7-6c79-4d62-8739-d7d7f7dd7908 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:10.235794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8f7de1d8-6978-4336-9fd9-f5d8b7009f0c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:10.237843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8f7de1d8-6978-4336-9fd9-f5d8b7009f0c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:10.267704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f7de1d8-6978-4336-9fd9-f5d8b7009f0c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:10.270689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f7de1d8-6978-4336-9fd9-f5d8b7009f0c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:10.272652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f7de1d8-6978-4336-9fd9-f5d8b7009f0c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:10.280921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f7de1d8-6978-4336-9fd9-f5d8b7009f0c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:10.283612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f7de1d8-6978-4336-9fd9-f5d8b7009f0c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:10.284945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f7de1d8-6978-4336-9fd9-f5d8b7009f0c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:10.687492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-457d63a7-6c79-4d62-8739-d7d7f7dd7908 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:10.706983 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-457d63a7-6c79-4d62-8739-d7d7f7dd7908 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1478 microversion: 2.1 time: 0.807513 Aug 25 12:45:10.709299 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 522/1033] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:09 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1478 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:10.785230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:10.787238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:10.808403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:10.810107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:10.811452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:10.819673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:10.821017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:10.822658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:11.083345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8f7de1d8-6978-4336-9fd9-f5d8b7009f0c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:11.144182 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8f7de1d8-6978-4336-9fd9-f5d8b7009f0c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 0.929873 Aug 25 12:45:11.145974 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 512/1034] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:10 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:11.732496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:11.769986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-80bd2c3e-8bf7-4645-9c96-773a04ec66fb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:11.770289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:11.773043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:11.777339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-80bd2c3e-8bf7-4645-9c96-773a04ec66fb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:11.777901 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a4d12a52-7e25-4b68-a4ad-d649160ec7e9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1411 microversion: 2.25 time: 1.025170 Aug 25 12:45:11.811532 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 523/1035] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:10 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1411 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:45:11.818522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80bd2c3e-8bf7-4645-9c96-773a04ec66fb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:11.820194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80bd2c3e-8bf7-4645-9c96-773a04ec66fb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:11.821301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80bd2c3e-8bf7-4645-9c96-773a04ec66fb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:11.823807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80bd2c3e-8bf7-4645-9c96-773a04ec66fb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:11.825296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80bd2c3e-8bf7-4645-9c96-773a04ec66fb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:11.826618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80bd2c3e-8bf7-4645-9c96-773a04ec66fb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:12.196806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-88cfebe7-1bb8-4531-957c-e62ff3f9600e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:12.202252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-88cfebe7-1bb8-4531-957c-e62ff3f9600e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:12.240668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88cfebe7-1bb8-4531-957c-e62ff3f9600e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:12.241886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88cfebe7-1bb8-4531-957c-e62ff3f9600e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:12.247599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88cfebe7-1bb8-4531-957c-e62ff3f9600e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:12.249154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88cfebe7-1bb8-4531-957c-e62ff3f9600e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:12.251590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88cfebe7-1bb8-4531-957c-e62ff3f9600e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:12.255128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88cfebe7-1bb8-4531-957c-e62ff3f9600e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:13.231111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-88cfebe7-1bb8-4531-957c-e62ff3f9600e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:13.276003 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-88cfebe7-1bb8-4531-957c-e62ff3f9600e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 1.095801 Aug 25 12:45:13.277718 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 524/1036] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:12 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:45:13.298465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:13.300095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:13.331316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:13.332913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:13.342127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-80bd2c3e-8bf7-4645-9c96-773a04ec66fb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:13.352173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:13.360320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:13.363930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:13.365299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:13.385107 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-80bd2c3e-8bf7-4645-9c96-773a04ec66fb tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1478 microversion: 2.1 time: 1.638470 Aug 25 12:45:13.388367 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 513/1037] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:11 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1478 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:45:14.028233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:14.069810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:14.081178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:14.087662 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d9814c05-dd08-433a-ad8d-67c7740fae1f tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1607 microversion: 2.25 time: 0.803955 Aug 25 12:45:14.091816 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 525/1038] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:13 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1607 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:45:14.267370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-09f4a952-194c-45ac-ad11-42354928bbb7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:14.270453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-09f4a952-194c-45ac-ad11-42354928bbb7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:14.308733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09f4a952-194c-45ac-ad11-42354928bbb7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:14.316321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09f4a952-194c-45ac-ad11-42354928bbb7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:14.318760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09f4a952-194c-45ac-ad11-42354928bbb7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:14.323044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09f4a952-194c-45ac-ad11-42354928bbb7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:14.327736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09f4a952-194c-45ac-ad11-42354928bbb7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:14.337937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09f4a952-194c-45ac-ad11-42354928bbb7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:14.435160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1793056867", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "becad70a-0897-494e-9d10-47a8ce731ab5"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:14.630744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] validate_networks() for [('becad70a-0897-494e-9d10-47a8ce731ab5', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:45:14.754283 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-09f4a952-194c-45ac-ad11-42354928bbb7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.494294 Aug 25 12:45:14.756747 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 526/1039] 10.222.0.70 () {60 vars in 1316 bytes} [Thu Aug 25 12:45:14 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-interface => generated 284 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:45:14.777554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-51a82bd8-15ce-4022-905f-69960d0c51e7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:14.789398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-51a82bd8-15ce-4022-905f-69960d0c51e7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:14.815763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51a82bd8-15ce-4022-905f-69960d0c51e7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:14.817479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51a82bd8-15ce-4022-905f-69960d0c51e7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:14.818658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51a82bd8-15ce-4022-905f-69960d0c51e7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:14.820621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51a82bd8-15ce-4022-905f-69960d0c51e7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:14.821839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51a82bd8-15ce-4022-905f-69960d0c51e7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:14.822962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51a82bd8-15ce-4022-905f-69960d0c51e7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:15.846690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-51a82bd8-15ce-4022-905f-69960d0c51e7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:15.910698 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-51a82bd8-15ce-4022-905f-69960d0c51e7 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 1.151330 Aug 25 12:45:15.925599 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 527/1040] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:14 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:15.961395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-36961e64-5bd6-4fae-9211-849ed063c5e2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:15.962776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-36961e64-5bd6-4fae-9211-849ed063c5e2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:16.017986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36961e64-5bd6-4fae-9211-849ed063c5e2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:16.021736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36961e64-5bd6-4fae-9211-849ed063c5e2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:16.038424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36961e64-5bd6-4fae-9211-849ed063c5e2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:16.042604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36961e64-5bd6-4fae-9211-849ed063c5e2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:16.044373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36961e64-5bd6-4fae-9211-849ed063c5e2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:16.045869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36961e64-5bd6-4fae-9211-849ed063c5e2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:17.369215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:45:17.373359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:45:17.382078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:45:17.384685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:45:17.390544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:45:17.426210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:17.427750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:17.429108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:17.445793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:17.449093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:17.453727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:17.551530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Getting quotas for project d9b53238616049c9ba5ed9107622c14a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:45:17.571617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Getting quotas for user bd404aa3c4074752949817aaeee9e560 and project d9b53238616049c9ba5ed9107622c14a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:45:17.609791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Going to run 3 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:45:17.616646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: d524fb40-c835-4a9f-beee-3b638cd73037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:45:17.758199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-36961e64-5bd6-4fae-9211-849ed063c5e2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:17.796941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 6580b463-1d84-41b9-b153-d64546089c5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=d524fb40-c835-4a9f-beee-3b638cd73037,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:45:17.833561 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-36961e64-5bd6-4fae-9211-849ed063c5e2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1463 microversion: 2.1 time: 1.906198 Aug 25 12:45:17.839024 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 528/1041] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:15 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1463 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:17.864655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10a87f50-75ce-47ba-9fdd-1701fbd0ea45 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:17.877851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-10a87f50-75ce-47ba-9fdd-1701fbd0ea45 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:17.905605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:17.912941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10a87f50-75ce-47ba-9fdd-1701fbd0ea45 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:17.917454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10a87f50-75ce-47ba-9fdd-1701fbd0ea45 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:17.921220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10a87f50-75ce-47ba-9fdd-1701fbd0ea45 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:17.925397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10a87f50-75ce-47ba-9fdd-1701fbd0ea45 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:17.939693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10a87f50-75ce-47ba-9fdd-1701fbd0ea45 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:17.941132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10a87f50-75ce-47ba-9fdd-1701fbd0ea45 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:17.995755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=6580b463-1d84-41b9-b153-d64546089c5f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:45:18.240593 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ae9005a-975c-4324-bc6e-4847d7992f1b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.846268 Aug 25 12:45:18.255303 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 514/1042] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:45:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:45:18.269817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d16fd744-ea22-475b-9d75-b600cc954927 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:18.290736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d16fd744-ea22-475b-9d75-b600cc954927 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:18.350763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d16fd744-ea22-475b-9d75-b600cc954927 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:18.351758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d16fd744-ea22-475b-9d75-b600cc954927 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:18.352578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d16fd744-ea22-475b-9d75-b600cc954927 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:18.354297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d16fd744-ea22-475b-9d75-b600cc954927 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:18.356387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d16fd744-ea22-475b-9d75-b600cc954927 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:18.357919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d16fd744-ea22-475b-9d75-b600cc954927 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:18.750128 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d16fd744-ea22-475b-9d75-b600cc954927 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.500521 Aug 25 12:45:18.756618 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 515/1043] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:45:18 2022] POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:45:18.771408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0ab67697-204d-4a32-8526-f6675b845936 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:18.794271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ab67697-204d-4a32-8526-f6675b845936 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:18.801652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ab67697-204d-4a32-8526-f6675b845936 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Searching by: {'deleted': False, 'project_id': 'd9b53238616049c9ba5ed9107622c14a'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:45:18.877830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab67697-204d-4a32-8526-f6675b845936 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:18.878571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab67697-204d-4a32-8526-f6675b845936 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:18.880405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab67697-204d-4a32-8526-f6675b845936 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:18.882231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab67697-204d-4a32-8526-f6675b845936 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:18.883074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab67697-204d-4a32-8526-f6675b845936 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:18.884316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab67697-204d-4a32-8526-f6675b845936 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:19.154901 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0ab67697-204d-4a32-8526-f6675b845936 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.393394 Aug 25 12:45:19.158162 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 516/1044] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 12:45:18 2022] GET /compute/v2.1/servers => generated 1018 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:19.196559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-719436ec-0ad1-41ff-863f-dbd48be660ab tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '.version_select at 0x7f3a2a59ae50>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:19.221578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-719436ec-0ad1-41ff-863f-dbd48be660ab tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:19.222436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-719436ec-0ad1-41ff-863f-dbd48be660ab tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:19.223258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-719436ec-0ad1-41ff-863f-dbd48be660ab tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:19.261221 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-719436ec-0ad1-41ff-863f-dbd48be660ab tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.099031 Aug 25 12:45:19.263112 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 517/1045] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:45:19 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:19.314512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:19.319283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:19.342010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:19.343462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:19.344770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:19.346609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:19.348256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:19.349616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:19.467958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:19.468963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:19.478192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:19.479104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lazy-loading 'fault' on Instance uuid c42add69-b14a-4dd1-a7ce-8c6c162b4e1a {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:45:19.770975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-10a87f50-75ce-47ba-9fdd-1701fbd0ea45 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:19.818208 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-10a87f50-75ce-47ba-9fdd-1701fbd0ea45 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 1.973366 Aug 25 12:45:19.825822 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 529/1046] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:17 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:19.856881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b657fe6b-dbf2-44c2-8114-7c1fd26710d6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:19.859217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b657fe6b-dbf2-44c2-8114-7c1fd26710d6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:20.194860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b657fe6b-dbf2-44c2-8114-7c1fd26710d6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:20.249651 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b657fe6b-dbf2-44c2-8114-7c1fd26710d6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1223 microversion: 2.1 time: 0.412025 Aug 25 12:45:20.263968 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 530/1047] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:19 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1223 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:20.318591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a37ef3cc-02d3-4d1f-9d3f-0c2330a460cf tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:20.353657 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a37ef3cc-02d3-4d1f-9d3f-0c2330a460cf tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.087327 Aug 25 12:45:20.370501 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 531/1048] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:45:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:20.408727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce0948c2-62f3-4531-9f50-aa8c9fae660d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1821891187", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:20.492428 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce0948c2-62f3-4531-9f50-aa8c9fae660d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.116826 Aug 25 12:45:20.502657 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 532/1049] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Aug 25 12:45:20 2022] POST /compute/v2.1/flavors => generated 499 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:20.518978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bf4ca902-9e1b-4ae8-ac85-2323318b0ab2 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:20.544863 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bf4ca902-9e1b-4ae8-ac85-2323318b0ab2 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034241 Aug 25 12:45:20.546975 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 533/1050] 10.222.0.70 () {58 vars in 1182 bytes} [Thu Aug 25 12:45:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:45:20.708540 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-873717f3-bab0-4965-be5d-11e6999476ca tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1597 microversion: 2.1 time: 1.440342 Aug 25 12:45:20.714629 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 518/1051] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:19 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1597 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:20.766041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3a6aded2-8c46-4069-8eec-e76a18580208 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:20.775106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3a6aded2-8c46-4069-8eec-e76a18580208 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:20.798420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6aded2-8c46-4069-8eec-e76a18580208 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:20.801569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6aded2-8c46-4069-8eec-e76a18580208 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:20.802853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6aded2-8c46-4069-8eec-e76a18580208 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:20.807069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6aded2-8c46-4069-8eec-e76a18580208 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:20.811270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6aded2-8c46-4069-8eec-e76a18580208 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:20.813497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6aded2-8c46-4069-8eec-e76a18580208 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:20.863350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-43d6c5ab-cb1d-47a1-b9bd-73099b830f1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:20.868139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-43d6c5ab-cb1d-47a1-b9bd-73099b830f1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:20.904945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43d6c5ab-cb1d-47a1-b9bd-73099b830f1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:20.908415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43d6c5ab-cb1d-47a1-b9bd-73099b830f1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:20.912760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43d6c5ab-cb1d-47a1-b9bd-73099b830f1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:20.919759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43d6c5ab-cb1d-47a1-b9bd-73099b830f1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:20.922361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43d6c5ab-cb1d-47a1-b9bd-73099b830f1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:20.924583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43d6c5ab-cb1d-47a1-b9bd-73099b830f1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:21.239850 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3a6aded2-8c46-4069-8eec-e76a18580208 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.482852 Aug 25 12:45:21.251459 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 534/1052] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:45:20 2022] POST /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:45:21.263708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-116785059", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "5b5fd978-458b-4555-ac25-baa5e8b8d4e2"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:21.526813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:45:22.217036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-43d6c5ab-cb1d-47a1-b9bd-73099b830f1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:22.286697 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-43d6c5ab-cb1d-47a1-b9bd-73099b830f1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 1.429614 Aug 25 12:45:22.329256 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 519/1053] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:20 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:22.347895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de39d877-1055-41f0-88c5-41a3b2615774 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:22.353020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-de39d877-1055-41f0-88c5-41a3b2615774 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:22.393922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de39d877-1055-41f0-88c5-41a3b2615774 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:22.396446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de39d877-1055-41f0-88c5-41a3b2615774 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:22.404699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de39d877-1055-41f0-88c5-41a3b2615774 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:22.407032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de39d877-1055-41f0-88c5-41a3b2615774 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:22.413771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de39d877-1055-41f0-88c5-41a3b2615774 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:22.421988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de39d877-1055-41f0-88c5-41a3b2615774 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:24.102595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:45:24.106600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:45:24.110921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:45:24.114233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:45:24.117331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:45:24.160164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:24.161710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:24.173338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:24.226372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:24.266782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:24.267809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:24.438484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:45:24.461272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for user aad1bc68cede45a7b1ab7cbda0d8208e and project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:45:24.526955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:45:24.540203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:45:24.806124 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-de39d877-1055-41f0-88c5-41a3b2615774 tempest-ServersAdminTestJSON-845889392 tempest-ServersAdminTestJSON-845889392-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1614 microversion: 2.1 time: 2.463266 Aug 25 12:45:24.826324 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 520/1054] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:22 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1614 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:24.852606 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7142466e-9aec-4192-82e2-8577eadc11a2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.596837 Aug 25 12:45:24.858407 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 535/1055] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:45:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:45:24.866620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-30bdc5eb-d43f-4e89-9822-4e41d83c071a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:24.888786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-30bdc5eb-d43f-4e89-9822-4e41d83c071a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:24.895470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d789ab5f-b9f2-4b63-936c-f5fe5dc50d0b req-b9834ac7-10bd-4db8-bc48-911261edfda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305f349d-9b1a-4ad8-996a-e0da7d1cefd2", "name": "network-vif-plugged", "status": "completed", "tag": "2e9adcd5-fb4f-40dc-8678-e173de267b62"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:24.909938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bdc5eb-d43f-4e89-9822-4e41d83c071a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:24.911321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bdc5eb-d43f-4e89-9822-4e41d83c071a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:24.913261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bdc5eb-d43f-4e89-9822-4e41d83c071a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:24.916189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bdc5eb-d43f-4e89-9822-4e41d83c071a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:24.919319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bdc5eb-d43f-4e89-9822-4e41d83c071a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:24.920397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bdc5eb-d43f-4e89-9822-4e41d83c071a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:24.994296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d789ab5f-b9f2-4b63-936c-f5fe5dc50d0b req-b9834ac7-10bd-4db8-bc48-911261edfda2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:25.001887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d789ab5f-b9f2-4b63-936c-f5fe5dc50d0b req-b9834ac7-10bd-4db8-bc48-911261edfda2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:25.012289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d789ab5f-b9f2-4b63-936c-f5fe5dc50d0b req-b9834ac7-10bd-4db8-bc48-911261edfda2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:25.159712 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d789ab5f-b9f2-4b63-936c-f5fe5dc50d0b req-b9834ac7-10bd-4db8-bc48-911261edfda2 service nova] Creating event network-vif-plugged:2e9adcd5-fb4f-40dc-8678-e173de267b62 for instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 on n-h1-852771-8 Aug 25 12:45:25.220102 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d789ab5f-b9f2-4b63-936c-f5fe5dc50d0b req-b9834ac7-10bd-4db8-bc48-911261edfda2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354389 Aug 25 12:45:25.230264 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 536/1056] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:25.287661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2749d2b7-945c-49bf-a65a-a0ee10fc92d6 req-2910ad2b-33bf-4628-9424-976c33197964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18924dfe-fc9e-47d4-b4be-c249990c5455", "tag": "c1a94bed-79da-44e9-a740-36d602c0c193"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:25.426363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2749d2b7-945c-49bf-a65a-a0ee10fc92d6 req-2910ad2b-33bf-4628-9424-976c33197964 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:25.437329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2749d2b7-945c-49bf-a65a-a0ee10fc92d6 req-2910ad2b-33bf-4628-9424-976c33197964 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:25.439688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2749d2b7-945c-49bf-a65a-a0ee10fc92d6 req-2910ad2b-33bf-4628-9424-976c33197964 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:25.502191 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2749d2b7-945c-49bf-a65a-a0ee10fc92d6 req-2910ad2b-33bf-4628-9424-976c33197964 service nova] Creating event network-changed:c1a94bed-79da-44e9-a740-36d602c0c193 for instance 18924dfe-fc9e-47d4-b4be-c249990c5455 on n-h1-852771-8 Aug 25 12:45:25.527762 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2749d2b7-945c-49bf-a65a-a0ee10fc92d6 req-2910ad2b-33bf-4628-9424-976c33197964 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288380 Aug 25 12:45:25.533058 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 537/1057] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:25.572196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-64426c68-cd9c-47ae-8bd7-ee29d7e95679 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:25.578509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-64426c68-cd9c-47ae-8bd7-ee29d7e95679 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:25.580168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-30bdc5eb-d43f-4e89-9822-4e41d83c071a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:25.611426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64426c68-cd9c-47ae-8bd7-ee29d7e95679 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:25.612673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64426c68-cd9c-47ae-8bd7-ee29d7e95679 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:25.613722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64426c68-cd9c-47ae-8bd7-ee29d7e95679 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:25.615749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64426c68-cd9c-47ae-8bd7-ee29d7e95679 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:25.621305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64426c68-cd9c-47ae-8bd7-ee29d7e95679 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:25.622207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64426c68-cd9c-47ae-8bd7-ee29d7e95679 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:25.631844 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-30bdc5eb-d43f-4e89-9822-4e41d83c071a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1283 microversion: 2.1 time: 0.773156 Aug 25 12:45:25.646834 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 521/1058] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:24 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1283 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:25.677320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed6d3513-b36b-40fb-a4a8-6c2d89e1880b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:25.690540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ed6d3513-b36b-40fb-a4a8-6c2d89e1880b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:25.720509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6d3513-b36b-40fb-a4a8-6c2d89e1880b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:25.721343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6d3513-b36b-40fb-a4a8-6c2d89e1880b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:25.733672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6d3513-b36b-40fb-a4a8-6c2d89e1880b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:25.735007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6d3513-b36b-40fb-a4a8-6c2d89e1880b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:25.736126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6d3513-b36b-40fb-a4a8-6c2d89e1880b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:25.737103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6d3513-b36b-40fb-a4a8-6c2d89e1880b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:25.861312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ed6d3513-b36b-40fb-a4a8-6c2d89e1880b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:45:25.878900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:26.211051 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ed6d3513-b36b-40fb-a4a8-6c2d89e1880b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 204 len: 0 microversion: 2.1 time: 0.562002 Aug 25 12:45:26.212573 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 522/1059] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:45:25 2022] DELETE /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:45:26.238377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3247911c-fc46-4ffe-bacc-e32c03486c8a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:26.240373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3247911c-fc46-4ffe-bacc-e32c03486c8a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:27.220251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3247911c-fc46-4ffe-bacc-e32c03486c8a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:27.254976 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3247911c-fc46-4ffe-bacc-e32c03486c8a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1278 microversion: 2.1 time: 1.039900 Aug 25 12:45:27.256965 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 523/1060] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:26 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1278 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:27.266642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed7a3823-1d9d-40e9-a104-3d536b758ee0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:27.269005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ed7a3823-1d9d-40e9-a104-3d536b758ee0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:27.283133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed7a3823-1d9d-40e9-a104-3d536b758ee0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:27.284499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed7a3823-1d9d-40e9-a104-3d536b758ee0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:27.285740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed7a3823-1d9d-40e9-a104-3d536b758ee0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:27.287397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed7a3823-1d9d-40e9-a104-3d536b758ee0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:27.289281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed7a3823-1d9d-40e9-a104-3d536b758ee0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:27.290758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed7a3823-1d9d-40e9-a104-3d536b758ee0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:28.645704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-64426c68-cd9c-47ae-8bd7-ee29d7e95679 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:28.707851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:28.723857 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-64426c68-cd9c-47ae-8bd7-ee29d7e95679 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1308 microversion: 2.1 time: 3.185158 Aug 25 12:45:28.730964 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 538/1061] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:25 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1308 bytes in 3197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:28.755018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86fec871-5987-462c-8477-777a6a8c83c1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:28.756756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-86fec871-5987-462c-8477-777a6a8c83c1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:28.780011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86fec871-5987-462c-8477-777a6a8c83c1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:28.781585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86fec871-5987-462c-8477-777a6a8c83c1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:28.782987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86fec871-5987-462c-8477-777a6a8c83c1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:28.784849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86fec871-5987-462c-8477-777a6a8c83c1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:28.786133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86fec871-5987-462c-8477-777a6a8c83c1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:28.787218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86fec871-5987-462c-8477-777a6a8c83c1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:28.967392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:29.038597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-86fec871-5987-462c-8477-777a6a8c83c1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:29.067243 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-86fec871-5987-462c-8477-777a6a8c83c1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1281 microversion: 2.1 time: 0.332031 Aug 25 12:45:29.070590 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 539/1062] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:28 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1281 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:29.083391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b62ad195-4f3c-4d6a-88dd-e0ea6989e9dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:29.085008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b62ad195-4f3c-4d6a-88dd-e0ea6989e9dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:29.111508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b62ad195-4f3c-4d6a-88dd-e0ea6989e9dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.113691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b62ad195-4f3c-4d6a-88dd-e0ea6989e9dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.127623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b62ad195-4f3c-4d6a-88dd-e0ea6989e9dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.129154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b62ad195-4f3c-4d6a-88dd-e0ea6989e9dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.130076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b62ad195-4f3c-4d6a-88dd-e0ea6989e9dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.130879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b62ad195-4f3c-4d6a-88dd-e0ea6989e9dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.270673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ed7a3823-1d9d-40e9-a104-3d536b758ee0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:29.302805 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ed7a3823-1d9d-40e9-a104-3d536b758ee0 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1469 microversion: 2.1 time: 2.042721 Aug 25 12:45:29.304770 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 524/1063] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:27 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1469 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:29.777104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a1773bf6-fe73-4c9c-b04e-2ecda7255c6e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:29.779577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a1773bf6-fe73-4c9c-b04e-2ecda7255c6e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:29.814867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1773bf6-fe73-4c9c-b04e-2ecda7255c6e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.817585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1773bf6-fe73-4c9c-b04e-2ecda7255c6e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.820292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1773bf6-fe73-4c9c-b04e-2ecda7255c6e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.824335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1773bf6-fe73-4c9c-b04e-2ecda7255c6e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.827076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1773bf6-fe73-4c9c-b04e-2ecda7255c6e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.831291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1773bf6-fe73-4c9c-b04e-2ecda7255c6e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.852447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b62ad195-4f3c-4d6a-88dd-e0ea6989e9dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:29.882278 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b62ad195-4f3c-4d6a-88dd-e0ea6989e9dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1336 microversion: 2.1 time: 0.809325 Aug 25 12:45:29.895280 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 540/1064] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:29 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1336 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:30.118119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2d09b18f-2b3b-4a4d-8d73-56b97463d901 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:30.119882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2d09b18f-2b3b-4a4d-8d73-56b97463d901 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:30.156704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d09b18f-2b3b-4a4d-8d73-56b97463d901 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:30.158180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d09b18f-2b3b-4a4d-8d73-56b97463d901 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:30.158819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d09b18f-2b3b-4a4d-8d73-56b97463d901 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:30.176218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d09b18f-2b3b-4a4d-8d73-56b97463d901 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:30.177408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d09b18f-2b3b-4a4d-8d73-56b97463d901 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:30.178381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2d09b18f-2b3b-4a4d-8d73-56b97463d901 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:30.957948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2d09b18f-2b3b-4a4d-8d73-56b97463d901 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:31.020729 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2d09b18f-2b3b-4a4d-8d73-56b97463d901 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1281 microversion: 2.1 time: 0.906435 Aug 25 12:45:31.026452 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 541/1065] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:30 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1281 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:31.043696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fcfe35ae-4dff-4c2f-a215-d999bcb7bef2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:31.048047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fcfe35ae-4dff-4c2f-a215-d999bcb7bef2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:31.074835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcfe35ae-4dff-4c2f-a215-d999bcb7bef2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:31.079393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcfe35ae-4dff-4c2f-a215-d999bcb7bef2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:31.099274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcfe35ae-4dff-4c2f-a215-d999bcb7bef2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:31.108703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcfe35ae-4dff-4c2f-a215-d999bcb7bef2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:31.111243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcfe35ae-4dff-4c2f-a215-d999bcb7bef2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:31.112761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcfe35ae-4dff-4c2f-a215-d999bcb7bef2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:31.479762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1773bf6-fe73-4c9c-b04e-2ecda7255c6e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:31.596390 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a1773bf6-fe73-4c9c-b04e-2ecda7255c6e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1487 microversion: 2.1 time: 1.815643 Aug 25 12:45:31.606305 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 525/1066] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:29 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1487 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:45:31.647320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bfab8e75-49bb-415c-af2f-795e70f4d986 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:31.649151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bfab8e75-49bb-415c-af2f-795e70f4d986 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:31.698016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfab8e75-49bb-415c-af2f-795e70f4d986 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:31.702054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfab8e75-49bb-415c-af2f-795e70f4d986 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:31.717304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfab8e75-49bb-415c-af2f-795e70f4d986 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:31.724302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfab8e75-49bb-415c-af2f-795e70f4d986 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:31.726302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfab8e75-49bb-415c-af2f-795e70f4d986 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:31.727502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfab8e75-49bb-415c-af2f-795e70f4d986 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:32.175014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bfab8e75-49bb-415c-af2f-795e70f4d986 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:32.235732 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bfab8e75-49bb-415c-af2f-795e70f4d986 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1336 microversion: 2.1 time: 0.624066 Aug 25 12:45:32.240942 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 526/1067] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:31 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1336 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:32.268682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-78eea895-5c5f-4130-aef1-010eb8430878 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:32.303337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78eea895-5c5f-4130-aef1-010eb8430878 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:32.304336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78eea895-5c5f-4130-aef1-010eb8430878 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:32.305190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78eea895-5c5f-4130-aef1-010eb8430878 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:32.550574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-78eea895-5c5f-4130-aef1-010eb8430878 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Going to try to stop instance {{(pid=129059) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 12:45:32.758786 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-78eea895-5c5f-4130-aef1-010eb8430878 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2/action" status: 202 len: 0 microversion: 2.1 time: 0.509980 Aug 25 12:45:32.770058 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 527/1068] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:45:32 2022] POST /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:45:32.785042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-233674a9-ce39-4be0-ba20-3ae7a442f775 req-7fc593fd-1298-4b50-936d-f5d04a86541b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc10fef-7fca-46a1-adcc-686bd3e01141", "name": "network-vif-unplugged", "status": "completed", "tag": "2399eef2-2d67-486b-95a6-6c78c0e665f5"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:32.835183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-233674a9-ce39-4be0-ba20-3ae7a442f775 req-7fc593fd-1298-4b50-936d-f5d04a86541b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:32.839333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-233674a9-ce39-4be0-ba20-3ae7a442f775 req-7fc593fd-1298-4b50-936d-f5d04a86541b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:32.855906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-233674a9-ce39-4be0-ba20-3ae7a442f775 req-7fc593fd-1298-4b50-936d-f5d04a86541b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:32.898937 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-233674a9-ce39-4be0-ba20-3ae7a442f775 req-7fc593fd-1298-4b50-936d-f5d04a86541b service nova] Creating event network-vif-unplugged:2399eef2-2d67-486b-95a6-6c78c0e665f5 for instance bfc10fef-7fca-46a1-adcc-686bd3e01141 on n-h1-852771-8 Aug 25 12:45:32.919641 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-233674a9-ce39-4be0-ba20-3ae7a442f775 req-7fc593fd-1298-4b50-936d-f5d04a86541b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146652 Aug 25 12:45:32.922916 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 528/1069] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:32.962914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-61d2fd1f-3e3b-456d-87cc-f15699947ce6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:32.972603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-61d2fd1f-3e3b-456d-87cc-f15699947ce6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:33.025669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61d2fd1f-3e3b-456d-87cc-f15699947ce6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:33.033094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61d2fd1f-3e3b-456d-87cc-f15699947ce6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:33.034149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61d2fd1f-3e3b-456d-87cc-f15699947ce6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:33.035569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61d2fd1f-3e3b-456d-87cc-f15699947ce6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:33.036447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61d2fd1f-3e3b-456d-87cc-f15699947ce6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:33.037287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61d2fd1f-3e3b-456d-87cc-f15699947ce6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:33.583567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fcfe35ae-4dff-4c2f-a215-d999bcb7bef2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:33.586711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-61d2fd1f-3e3b-456d-87cc-f15699947ce6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:33.615189 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-61d2fd1f-3e3b-456d-87cc-f15699947ce6 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1281 microversion: 2.1 time: 0.689497 Aug 25 12:45:33.625146 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 529/1070] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:32 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1281 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:33.645672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f4ff4d20-e9a8-4127-9621-4c7bcce82c2b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:33.647124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f4ff4d20-e9a8-4127-9621-4c7bcce82c2b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:33.654386 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fcfe35ae-4dff-4c2f-a215-d999bcb7bef2 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 200 len: 1469 microversion: 2.1 time: 2.597126 Aug 25 12:45:33.670786 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 542/1071] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:31 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 1469 bytes in 2643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:33.676130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4ff4d20-e9a8-4127-9621-4c7bcce82c2b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:33.677040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4ff4d20-e9a8-4127-9621-4c7bcce82c2b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:33.688481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4ff4d20-e9a8-4127-9621-4c7bcce82c2b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:33.694742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4ff4d20-e9a8-4127-9621-4c7bcce82c2b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:33.695894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4ff4d20-e9a8-4127-9621-4c7bcce82c2b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:33.696777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4ff4d20-e9a8-4127-9621-4c7bcce82c2b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:33.704650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5015493-95ea-4621-9ea0-3c6c28507170 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:33.706665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5015493-95ea-4621-9ea0-3c6c28507170 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:33.768544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5015493-95ea-4621-9ea0-3c6c28507170 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:33.781864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5015493-95ea-4621-9ea0-3c6c28507170 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:33.784501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5015493-95ea-4621-9ea0-3c6c28507170 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:33.792663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5015493-95ea-4621-9ea0-3c6c28507170 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:33.796106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5015493-95ea-4621-9ea0-3c6c28507170 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:33.802830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5015493-95ea-4621-9ea0-3c6c28507170 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:34.352195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:34.505217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:35.934273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5015493-95ea-4621-9ea0-3c6c28507170 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:35.975914 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5015493-95ea-4621-9ea0-3c6c28507170 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 2.302137 Aug 25 12:45:35.977050 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 543/1072] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:33 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 2305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:36.006178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-6928776c-7249-4de0-a99e-45c9abddcce4 req-9472a980-a986-4cde-8d58-b36cbde417ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc10fef-7fca-46a1-adcc-686bd3e01141", "name": "network-vif-deleted", "tag": "2399eef2-2d67-486b-95a6-6c78c0e665f5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:36.050970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6928776c-7249-4de0-a99e-45c9abddcce4 req-9472a980-a986-4cde-8d58-b36cbde417ac service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:36.052571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6928776c-7249-4de0-a99e-45c9abddcce4 req-9472a980-a986-4cde-8d58-b36cbde417ac service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:36.058912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6928776c-7249-4de0-a99e-45c9abddcce4 req-9472a980-a986-4cde-8d58-b36cbde417ac service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:36.107939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-6928776c-7249-4de0-a99e-45c9abddcce4 req-9472a980-a986-4cde-8d58-b36cbde417ac service nova] Creating event network-vif-deleted:2399eef2-2d67-486b-95a6-6c78c0e665f5 for instance bfc10fef-7fca-46a1-adcc-686bd3e01141 on n-h1-852771-8 Aug 25 12:45:36.121139 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-6928776c-7249-4de0-a99e-45c9abddcce4 req-9472a980-a986-4cde-8d58-b36cbde417ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136991 Aug 25 12:45:36.126095 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 544/1073] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:36.162469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9fe9b9b7-3ed0-4777-a50d-a98ae3062f18 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:36.164481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9fe9b9b7-3ed0-4777-a50d-a98ae3062f18 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:36.201079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fe9b9b7-3ed0-4777-a50d-a98ae3062f18 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:36.204091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fe9b9b7-3ed0-4777-a50d-a98ae3062f18 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:36.207738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fe9b9b7-3ed0-4777-a50d-a98ae3062f18 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:36.212318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fe9b9b7-3ed0-4777-a50d-a98ae3062f18 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:36.214602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fe9b9b7-3ed0-4777-a50d-a98ae3062f18 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:36.218053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fe9b9b7-3ed0-4777-a50d-a98ae3062f18 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:37.254770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=12 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:37.306313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f4ff4d20-e9a8-4127-9621-4c7bcce82c2b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:37.339984 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f4ff4d20-e9a8-4127-9621-4c7bcce82c2b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1497 microversion: 2.1 time: 3.712234 Aug 25 12:45:37.341707 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 530/1074] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:33 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1497 bytes in 3716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:37.401022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:37.403381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: bfc10fef-7fca-46a1-adcc-686bd3e01141] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:37.435667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:37.436813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:37.438790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:37.440713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:37.442059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:37.443233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:37.485071 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] HTTP exception thrown: Instance bfc10fef-7fca-46a1-adcc-686bd3e01141 could not be found. Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Request method failure captured: Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 HTTP/1.1 Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB24noX5B1QSIodGxilif_VmOI5467B-8Ul3pnHX6A6sHrvSK5Vz8D3-v3xlSHmR8a6jkzPfS-_MvT_48xAHi6KgoceCUDXGDigk-67enlBoclSY8RDbMDdNjjHAQjAhcWcxnsILGYjlJmWxTAEqE2SBIEf4q57eP0vF4Qq90OdeQzME Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: e2700209d0c94f789c1b01cf7b38c6e0 Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersAdminTestJSON-1166298758 Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:45:37.498485 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e2700209d0c94f789c1b01cf7b38c6e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e2700209d0c94f789c1b01cf7b38c6e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e2700209d0c94f789c1b01cf7b38c6e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e2700209d0c94f789c1b01cf7b38c6e0"}]}] Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersAdminTestJSON-1166298758 Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: e2700209d0c94f789c1b01cf7b38c6e0 Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersAdminTestJSON-1166298758 Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersAdminTestJSON-1166298758-project Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 150efb14f73347c7aa81255bba9f12ca Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersAdminTestJSON-1166298758-project Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance bfc10fef-7fca-46a1-adcc-686bd3e01141 could not be found. Aug 25 12:45:37.501792 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'bfc10fef-7fca-46a1-adcc-686bd3e01141'} Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc10fef-7fca-46a1-adcc-686bd3e01141 could not be found. Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:45:37.503605 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc10fef-7fca-46a1-adcc-686bd3e01141 could not be found. Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc10fef-7fca-46a1-adcc-686bd3e01141 could not be found. Aug 25 12:45:37.506583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:45:37.512016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Returning 404 to user: Instance bfc10fef-7fca-46a1-adcc-686bd3e01141 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:45:37.516968 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-572a8ed6-5ccb-45be-8a16-291c11780e7a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141" status: 404 len: 111 microversion: 2.1 time: 0.128271 Aug 25 12:45:37.518981 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 531/1075] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:37 2022] GET /compute/v2.1/servers/bfc10fef-7fca-46a1-adcc-686bd3e01141 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:45:37.546633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2cbe81be-bb90-4cdb-9448-c6109c60373b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:37.548316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2cbe81be-bb90-4cdb-9448-c6109c60373b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:37.569230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbe81be-bb90-4cdb-9448-c6109c60373b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:37.573936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbe81be-bb90-4cdb-9448-c6109c60373b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:37.585863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbe81be-bb90-4cdb-9448-c6109c60373b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:37.587756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbe81be-bb90-4cdb-9448-c6109c60373b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:37.589662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbe81be-bb90-4cdb-9448-c6109c60373b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:37.592266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbe81be-bb90-4cdb-9448-c6109c60373b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:38.028303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9fe9b9b7-3ed0-4777-a50d-a98ae3062f18 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:38.058853 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9fe9b9b7-3ed0-4777-a50d-a98ae3062f18 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1323 microversion: 2.1 time: 1.926585 Aug 25 12:45:38.067572 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 545/1076] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:36 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1323 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:38.093647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5336446d-12b3-4b11-b90d-98eb7bc4581a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:38.094531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5336446d-12b3-4b11-b90d-98eb7bc4581a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:38.107766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5336446d-12b3-4b11-b90d-98eb7bc4581a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:38.108652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5336446d-12b3-4b11-b90d-98eb7bc4581a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:38.109469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5336446d-12b3-4b11-b90d-98eb7bc4581a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:38.110924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5336446d-12b3-4b11-b90d-98eb7bc4581a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:38.111717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5336446d-12b3-4b11-b90d-98eb7bc4581a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:38.112515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5336446d-12b3-4b11-b90d-98eb7bc4581a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:38.224903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5336446d-12b3-4b11-b90d-98eb7bc4581a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:45:38.550523 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5336446d-12b3-4b11-b90d-98eb7bc4581a tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "DELETE /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 204 len: 0 microversion: 2.1 time: 0.478382 Aug 25 12:45:38.551802 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 546/1077] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:45:38 2022] DELETE /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:45:38.580015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c82a67b2-e4a3-4d96-b831-e1c248636467 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:38.582246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c82a67b2-e4a3-4d96-b831-e1c248636467 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:38.613499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c82a67b2-e4a3-4d96-b831-e1c248636467 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:38.616108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c82a67b2-e4a3-4d96-b831-e1c248636467 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:38.620264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c82a67b2-e4a3-4d96-b831-e1c248636467 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:38.622887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c82a67b2-e4a3-4d96-b831-e1c248636467 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:38.627351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c82a67b2-e4a3-4d96-b831-e1c248636467 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:38.633297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c82a67b2-e4a3-4d96-b831-e1c248636467 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:38.940590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2cbe81be-bb90-4cdb-9448-c6109c60373b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:38.984368 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2cbe81be-bb90-4cdb-9448-c6109c60373b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 1.461906 Aug 25 12:45:38.985693 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 532/1078] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:37 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:39.015856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a08d973c-05cf-4b35-a760-ddf08ba28930 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:39.016968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a08d973c-05cf-4b35-a760-ddf08ba28930 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:39.042981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:39.046064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a08d973c-05cf-4b35-a760-ddf08ba28930 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:39.046944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a08d973c-05cf-4b35-a760-ddf08ba28930 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:39.047781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a08d973c-05cf-4b35-a760-ddf08ba28930 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:39.062329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a08d973c-05cf-4b35-a760-ddf08ba28930 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:39.063220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a08d973c-05cf-4b35-a760-ddf08ba28930 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:39.064060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a08d973c-05cf-4b35-a760-ddf08ba28930 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:40.407991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c82a67b2-e4a3-4d96-b831-e1c248636467 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:40.472765 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c82a67b2-e4a3-4d96-b831-e1c248636467 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1497 microversion: 2.1 time: 1.916879 Aug 25 12:45:40.492265 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 547/1079] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:38 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1497 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:40.526399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a08d973c-05cf-4b35-a760-ddf08ba28930 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:40.551331 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a08d973c-05cf-4b35-a760-ddf08ba28930 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1470 microversion: 2.1 time: 1.563955 Aug 25 12:45:40.554418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c37335f1-2dc3-4058-af99-0bc3aa4aaf61 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:40.556248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c37335f1-2dc3-4058-af99-0bc3aa4aaf61 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:40.567912 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 533/1080] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:38 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1470 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:40.577783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c37335f1-2dc3-4058-af99-0bc3aa4aaf61 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:40.579441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c37335f1-2dc3-4058-af99-0bc3aa4aaf61 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:40.582120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c37335f1-2dc3-4058-af99-0bc3aa4aaf61 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:40.584586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c37335f1-2dc3-4058-af99-0bc3aa4aaf61 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:40.585991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c37335f1-2dc3-4058-af99-0bc3aa4aaf61 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:40.587382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c37335f1-2dc3-4058-af99-0bc3aa4aaf61 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:40.600368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e691bbdb-8dfc-4565-9d4c-638876857bb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:40.601961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e691bbdb-8dfc-4565-9d4c-638876857bb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:40.615851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e691bbdb-8dfc-4565-9d4c-638876857bb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:40.617083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e691bbdb-8dfc-4565-9d4c-638876857bb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:40.618283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e691bbdb-8dfc-4565-9d4c-638876857bb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:40.620499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e691bbdb-8dfc-4565-9d4c-638876857bb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:40.621691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e691bbdb-8dfc-4565-9d4c-638876857bb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:40.623332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e691bbdb-8dfc-4565-9d4c-638876857bb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.180434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c37335f1-2dc3-4058-af99-0bc3aa4aaf61 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:42.231412 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c37335f1-2dc3-4058-af99-0bc3aa4aaf61 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1323 microversion: 2.1 time: 1.712343 Aug 25 12:45:42.238611 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 548/1081] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:40 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1323 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:42.264198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df5e72ed-5f27-4ad2-87e0-80e66ffb6605 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:42.268229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-df5e72ed-5f27-4ad2-87e0-80e66ffb6605 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:42.282838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5e72ed-5f27-4ad2-87e0-80e66ffb6605 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.284103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5e72ed-5f27-4ad2-87e0-80e66ffb6605 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.285237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5e72ed-5f27-4ad2-87e0-80e66ffb6605 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.287029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5e72ed-5f27-4ad2-87e0-80e66ffb6605 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.288228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5e72ed-5f27-4ad2-87e0-80e66ffb6605 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.289288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5e72ed-5f27-4ad2-87e0-80e66ffb6605 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.405301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e691bbdb-8dfc-4565-9d4c-638876857bb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:42.434944 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e691bbdb-8dfc-4565-9d4c-638876857bb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 1.864881 Aug 25 12:45:42.464676 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 534/1082] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:40 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:42.493435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7a57fd12-4bf7-4e11-8ab8-b8e1a332503e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:42.495362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7a57fd12-4bf7-4e11-8ab8-b8e1a332503e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:42.516422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a57fd12-4bf7-4e11-8ab8-b8e1a332503e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.518911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a57fd12-4bf7-4e11-8ab8-b8e1a332503e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.522133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a57fd12-4bf7-4e11-8ab8-b8e1a332503e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.534118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a57fd12-4bf7-4e11-8ab8-b8e1a332503e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.535064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a57fd12-4bf7-4e11-8ab8-b8e1a332503e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.536035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a57fd12-4bf7-4e11-8ab8-b8e1a332503e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:43.406808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df5e72ed-5f27-4ad2-87e0-80e66ffb6605 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:43.422446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7a57fd12-4bf7-4e11-8ab8-b8e1a332503e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:43.428633 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-df5e72ed-5f27-4ad2-87e0-80e66ffb6605 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1497 microversion: 2.1 time: 1.187819 Aug 25 12:45:43.429970 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 549/1083] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:42 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1497 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:43.438097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f8405149-c25c-4028-8852-13c056dc8ba7 req-97d393c0-0936-429b-be43-f5f7c567a81e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6580b463-1d84-41b9-b153-d64546089c5f", "tag": "db5e26b9-fe95-4b5d-b561-6b24894513d7"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:43.456429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f8405149-c25c-4028-8852-13c056dc8ba7 req-97d393c0-0936-429b-be43-f5f7c567a81e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:43.457225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f8405149-c25c-4028-8852-13c056dc8ba7 req-97d393c0-0936-429b-be43-f5f7c567a81e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:43.457968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f8405149-c25c-4028-8852-13c056dc8ba7 req-97d393c0-0936-429b-be43-f5f7c567a81e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:43.489184 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f8405149-c25c-4028-8852-13c056dc8ba7 req-97d393c0-0936-429b-be43-f5f7c567a81e service nova] Creating event network-changed:db5e26b9-fe95-4b5d-b561-6b24894513d7 for instance 6580b463-1d84-41b9-b153-d64546089c5f on n-h2-852771-8 Aug 25 12:45:43.512378 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f8405149-c25c-4028-8852-13c056dc8ba7 req-97d393c0-0936-429b-be43-f5f7c567a81e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078852 Aug 25 12:45:43.514146 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 550/1084] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:43.514580 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7a57fd12-4bf7-4e11-8ab8-b8e1a332503e tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1470 microversion: 2.1 time: 1.042509 Aug 25 12:45:43.515413 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 535/1085] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:42 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1470 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:43.525688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-26509312-9c82-4032-a2b3-12ed0df54523 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:43.527660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-26509312-9c82-4032-a2b3-12ed0df54523 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:43.540963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26509312-9c82-4032-a2b3-12ed0df54523 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:43.542957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26509312-9c82-4032-a2b3-12ed0df54523 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:43.544239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26509312-9c82-4032-a2b3-12ed0df54523 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:43.546168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26509312-9c82-4032-a2b3-12ed0df54523 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:43.547330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26509312-9c82-4032-a2b3-12ed0df54523 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:43.548488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26509312-9c82-4032-a2b3-12ed0df54523 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:43.550414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ae72d4a-e83a-4abe-9fdd-45f14aa2450d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:43.551530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ae72d4a-e83a-4abe-9fdd-45f14aa2450d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:43.565019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae72d4a-e83a-4abe-9fdd-45f14aa2450d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:43.566294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae72d4a-e83a-4abe-9fdd-45f14aa2450d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:43.567424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae72d4a-e83a-4abe-9fdd-45f14aa2450d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:43.569414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae72d4a-e83a-4abe-9fdd-45f14aa2450d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:43.570618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae72d4a-e83a-4abe-9fdd-45f14aa2450d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:43.572609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ae72d4a-e83a-4abe-9fdd-45f14aa2450d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:44.904620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-26509312-9c82-4032-a2b3-12ed0df54523 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:44.911898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1ae72d4a-e83a-4abe-9fdd-45f14aa2450d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:44.959414 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ae72d4a-e83a-4abe-9fdd-45f14aa2450d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 1.424648 Aug 25 12:45:44.960616 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 536/1086] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:43 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:45.003724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-117176de-1bc5-4529-8166-4025c45a6584 req-1bece6cc-0f4a-4e3c-b961-b3f75a5b40d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3155f7-5f48-47a9-a5a6-6ec064e160de", "tag": "5363dc13-2a91-4fbd-a4fa-f1335cb952e4"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:45.013139 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-26509312-9c82-4032-a2b3-12ed0df54523 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1323 microversion: 2.1 time: 1.489867 Aug 25 12:45:45.037550 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 551/1087] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:43 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1323 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:45.058377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-117176de-1bc5-4529-8166-4025c45a6584 req-1bece6cc-0f4a-4e3c-b961-b3f75a5b40d2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:45.058377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-117176de-1bc5-4529-8166-4025c45a6584 req-1bece6cc-0f4a-4e3c-b961-b3f75a5b40d2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:45.058377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-117176de-1bc5-4529-8166-4025c45a6584 req-1bece6cc-0f4a-4e3c-b961-b3f75a5b40d2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:45.059234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-725217f8-2865-42dd-a146-08dfff9215f4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:45.059234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-725217f8-2865-42dd-a146-08dfff9215f4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:45.085744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-725217f8-2865-42dd-a146-08dfff9215f4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:45.090460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-725217f8-2865-42dd-a146-08dfff9215f4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:45.091950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-725217f8-2865-42dd-a146-08dfff9215f4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:45.099258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-725217f8-2865-42dd-a146-08dfff9215f4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:45.105754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-725217f8-2865-42dd-a146-08dfff9215f4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:45.107493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-725217f8-2865-42dd-a146-08dfff9215f4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:45.115456 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-117176de-1bc5-4529-8166-4025c45a6584 req-1bece6cc-0f4a-4e3c-b961-b3f75a5b40d2 service nova] Creating event network-changed:5363dc13-2a91-4fbd-a4fa-f1335cb952e4 for instance ca3155f7-5f48-47a9-a5a6-6ec064e160de on n-h2-852771-8 Aug 25 12:45:45.191972 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-117176de-1bc5-4529-8166-4025c45a6584 req-1bece6cc-0f4a-4e3c-b961-b3f75a5b40d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214767 Aug 25 12:45:45.193106 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 537/1088] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:45.260073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6ece60d4-4fe6-4c40-bd7e-5a8ab8a7254c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:45.268470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6ece60d4-4fe6-4c40-bd7e-5a8ab8a7254c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:45.311260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ece60d4-4fe6-4c40-bd7e-5a8ab8a7254c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:45.321188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ece60d4-4fe6-4c40-bd7e-5a8ab8a7254c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:45.323909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ece60d4-4fe6-4c40-bd7e-5a8ab8a7254c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:45.325602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ece60d4-4fe6-4c40-bd7e-5a8ab8a7254c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:45.326574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ece60d4-4fe6-4c40-bd7e-5a8ab8a7254c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:45.327594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ece60d4-4fe6-4c40-bd7e-5a8ab8a7254c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:45.949717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6ece60d4-4fe6-4c40-bd7e-5a8ab8a7254c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:45.988279 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6ece60d4-4fe6-4c40-bd7e-5a8ab8a7254c tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1428 microversion: 2.1 time: 0.773802 Aug 25 12:45:45.999301 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 538/1089] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:45 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1428 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:46.016841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-81d15bc3-6d69-4c7b-9449-6985a4cb75f4 req-c6b202f0-fd5c-4fb9-b020-f378ce4af0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d524fb40-c835-4a9f-beee-3b638cd73037", "tag": "66d6910d-3fc1-4f06-bf3c-9eb54101d598"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:46.061067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-81d15bc3-6d69-4c7b-9449-6985a4cb75f4 req-c6b202f0-fd5c-4fb9-b020-f378ce4af0b7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:46.062620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-81d15bc3-6d69-4c7b-9449-6985a4cb75f4 req-c6b202f0-fd5c-4fb9-b020-f378ce4af0b7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:46.063880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-81d15bc3-6d69-4c7b-9449-6985a4cb75f4 req-c6b202f0-fd5c-4fb9-b020-f378ce4af0b7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:46.125800 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-81d15bc3-6d69-4c7b-9449-6985a4cb75f4 req-c6b202f0-fd5c-4fb9-b020-f378ce4af0b7 service nova] Creating event network-changed:66d6910d-3fc1-4f06-bf3c-9eb54101d598 for instance d524fb40-c835-4a9f-beee-3b638cd73037 on n-h2-852771-8 Aug 25 12:45:46.156883 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-81d15bc3-6d69-4c7b-9449-6985a4cb75f4 req-c6b202f0-fd5c-4fb9-b020-f378ce4af0b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154415 Aug 25 12:45:46.164128 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 539/1090] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:46.188193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b7b7b8be-b2ff-4e49-9331-83a16da8abff tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:46.193685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b7b7b8be-b2ff-4e49-9331-83a16da8abff tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:46.225474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7b7b8be-b2ff-4e49-9331-83a16da8abff tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:46.231727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7b7b8be-b2ff-4e49-9331-83a16da8abff tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:46.232602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7b7b8be-b2ff-4e49-9331-83a16da8abff tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:46.236924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7b7b8be-b2ff-4e49-9331-83a16da8abff tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:46.240337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7b7b8be-b2ff-4e49-9331-83a16da8abff tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:46.243204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7b7b8be-b2ff-4e49-9331-83a16da8abff tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:46.355404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:47.168727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-725217f8-2865-42dd-a146-08dfff9215f4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:47.195293 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-725217f8-2865-42dd-a146-08dfff9215f4 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1497 microversion: 2.1 time: 2.167447 Aug 25 12:45:47.203914 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 552/1091] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:45 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1497 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:47.224965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-edab8c50-3785-4359-9b11-dc454ca16b77 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:47.233617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-edab8c50-3785-4359-9b11-dc454ca16b77 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:47.257501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-edab8c50-3785-4359-9b11-dc454ca16b77 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:47.267402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-edab8c50-3785-4359-9b11-dc454ca16b77 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:47.270227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-edab8c50-3785-4359-9b11-dc454ca16b77 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:47.272074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-edab8c50-3785-4359-9b11-dc454ca16b77 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:47.275295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-edab8c50-3785-4359-9b11-dc454ca16b77 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:47.280750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-edab8c50-3785-4359-9b11-dc454ca16b77 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:48.939102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b7b7b8be-b2ff-4e49-9331-83a16da8abff tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:49.037039 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b7b7b8be-b2ff-4e49-9331-83a16da8abff tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 2.867911 Aug 25 12:45:49.042584 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 540/1092] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:46 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 2877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:49.078433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:49.082150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:49.104337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:49.106356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:49.107787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:49.111726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:49.114263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:49.115980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:49.288589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:49.297928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:49.298798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:49.299634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lazy-loading 'fault' on Instance uuid 61538c72-db7a-4901-b6c2-e695417c9d49 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:45:49.363962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-edab8c50-3785-4359-9b11-dc454ca16b77 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:49.421436 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-edab8c50-3785-4359-9b11-dc454ca16b77 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1323 microversion: 2.1 time: 2.214583 Aug 25 12:45:49.425568 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 553/1093] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:47 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1323 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:49.455373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:49.486473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8859f06-4272-4c51-bb85-bbe245b441a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:49.489090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e8859f06-4272-4c51-bb85-bbe245b441a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:49.490503 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-97bd98ac-d953-4eee-b28a-7df55a990257 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 200 len: 1304 microversion: 2.1 time: 0.442933 Aug 25 12:45:49.518558 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 541/1094] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:49 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 1304 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:49.524724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:49.529727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8859f06-4272-4c51-bb85-bbe245b441a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:49.531126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8859f06-4272-4c51-bb85-bbe245b441a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:49.537032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8859f06-4272-4c51-bb85-bbe245b441a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:49.539195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8859f06-4272-4c51-bb85-bbe245b441a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:49.549299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8859f06-4272-4c51-bb85-bbe245b441a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:49.550714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8859f06-4272-4c51-bb85-bbe245b441a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:49.557916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f2ed183f-d85e-4e19-ab29-ee54f4dc1937 req-e8b0fd25-d530-4889-b614-135e82fe16df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2714be3e-3fdc-42c0-8b91-775c6adb6ea2", "tag": "f903dae0-0844-4573-8208-c708b6962e10"}, {"server_uuid": "61538c72-db7a-4901-b6c2-e695417c9d49", "name": "network-vif-deleted", "tag": "98a9d4d6-6958-4c41-acfd-dbed7d9ed258"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:49.579178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f2ed183f-d85e-4e19-ab29-ee54f4dc1937 req-e8b0fd25-d530-4889-b614-135e82fe16df service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:49.580335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f2ed183f-d85e-4e19-ab29-ee54f4dc1937 req-e8b0fd25-d530-4889-b614-135e82fe16df service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:49.581402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f2ed183f-d85e-4e19-ab29-ee54f4dc1937 req-e8b0fd25-d530-4889-b614-135e82fe16df service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:49.663404 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f2ed183f-d85e-4e19-ab29-ee54f4dc1937 req-e8b0fd25-d530-4889-b614-135e82fe16df service nova] Creating event network-changed:f903dae0-0844-4573-8208-c708b6962e10 for instance 2714be3e-3fdc-42c0-8b91-775c6adb6ea2 on n-h1-852771-8 Aug 25 12:45:49.664963 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f2ed183f-d85e-4e19-ab29-ee54f4dc1937 req-e8b0fd25-d530-4889-b614-135e82fe16df service nova] Creating event network-vif-deleted:98a9d4d6-6958-4c41-acfd-dbed7d9ed258 for instance 61538c72-db7a-4901-b6c2-e695417c9d49 on n-h2-852771-8 Aug 25 12:45:49.702517 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f2ed183f-d85e-4e19-ab29-ee54f4dc1937 req-e8b0fd25-d530-4889-b614-135e82fe16df service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.166744 Aug 25 12:45:49.704410 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 542/1095] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:50.087186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-50a7c304-9c5d-400a-95e0-713a50264537 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:50.090197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-50a7c304-9c5d-400a-95e0-713a50264537 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:50.117487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a7c304-9c5d-400a-95e0-713a50264537 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:50.121223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a7c304-9c5d-400a-95e0-713a50264537 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:50.122485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a7c304-9c5d-400a-95e0-713a50264537 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:50.128446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a7c304-9c5d-400a-95e0-713a50264537 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:50.130099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a7c304-9c5d-400a-95e0-713a50264537 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:50.130958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a7c304-9c5d-400a-95e0-713a50264537 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.285742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e8859f06-4272-4c51-bb85-bbe245b441a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:51.315769 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e8859f06-4272-4c51-bb85-bbe245b441a1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1497 microversion: 2.1 time: 1.879496 Aug 25 12:45:51.316694 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 554/1096] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:49 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1497 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:51.334532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6af8bef-027b-44cc-b98e-5afe3b85ef22 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:51.338491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c6af8bef-027b-44cc-b98e-5afe3b85ef22 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:51.366531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6af8bef-027b-44cc-b98e-5afe3b85ef22 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.370251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6af8bef-027b-44cc-b98e-5afe3b85ef22 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.370251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6af8bef-027b-44cc-b98e-5afe3b85ef22 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.370617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6af8bef-027b-44cc-b98e-5afe3b85ef22 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.371498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6af8bef-027b-44cc-b98e-5afe3b85ef22 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.372647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6af8bef-027b-44cc-b98e-5afe3b85ef22 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.434433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:51.655335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-50a7c304-9c5d-400a-95e0-713a50264537 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:51.736934 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-50a7c304-9c5d-400a-95e0-713a50264537 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 1.658295 Aug 25 12:45:51.740461 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 543/1097] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:50 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:51.777610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:51.779315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: 61538c72-db7a-4901-b6c2-e695417c9d49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:51.792224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.793579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.794813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.796469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.797771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.798840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.833196 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] HTTP exception thrown: Instance 61538c72-db7a-4901-b6c2-e695417c9d49 could not be found. Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Request method failure captured: Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 HTTP/1.1 Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB24noX5B1QSIodGxilif_VmOI5467B-8Ul3pnHX6A6sHrvSK5Vz8D3-v3xlSHmR8a6jkzPfS-_MvT_48xAHi6KgoceCUDXGDigk-67enlBoclSY8RDbMDdNjjHAQjAhcWcxnsILGYjlJmWxTAEqE2SBIEf4q57eP0vF4Qq90OdeQzME Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: e2700209d0c94f789c1b01cf7b38c6e0 Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersAdminTestJSON-1166298758 Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:45:51.840137 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e2700209d0c94f789c1b01cf7b38c6e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e2700209d0c94f789c1b01cf7b38c6e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e2700209d0c94f789c1b01cf7b38c6e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e2700209d0c94f789c1b01cf7b38c6e0"}]}] Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersAdminTestJSON-1166298758 Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: e2700209d0c94f789c1b01cf7b38c6e0 Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersAdminTestJSON-1166298758 Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersAdminTestJSON-1166298758-project Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 150efb14f73347c7aa81255bba9f12ca Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersAdminTestJSON-1166298758-project Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 61538c72-db7a-4901-b6c2-e695417c9d49 could not be found. Aug 25 12:45:51.843654 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '61538c72-db7a-4901-b6c2-e695417c9d49'} Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61538c72-db7a-4901-b6c2-e695417c9d49 could not be found. Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:45:51.845328 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61538c72-db7a-4901-b6c2-e695417c9d49 could not be found. Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61538c72-db7a-4901-b6c2-e695417c9d49 could not be found. Aug 25 12:45:51.849800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:45:51.851548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Returning 404 to user: Instance 61538c72-db7a-4901-b6c2-e695417c9d49 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:45:51.854874 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5375529a-07ed-4e6d-a4a7-2763ad579eb7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49" status: 404 len: 111 microversion: 2.1 time: 0.099152 Aug 25 12:45:51.856871 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 544/1098] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:51 2022] GET /compute/v2.1/servers/61538c72-db7a-4901-b6c2-e695417c9d49 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:45:51.871117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee4e5612-71e6-4839-bbd2-bffe2733efa4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:51.872500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee4e5612-71e6-4839-bbd2-bffe2733efa4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:51.885997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee4e5612-71e6-4839-bbd2-bffe2733efa4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.888459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee4e5612-71e6-4839-bbd2-bffe2733efa4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.889708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee4e5612-71e6-4839-bbd2-bffe2733efa4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.891433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee4e5612-71e6-4839-bbd2-bffe2733efa4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.892609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee4e5612-71e6-4839-bbd2-bffe2733efa4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.893744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee4e5612-71e6-4839-bbd2-bffe2733efa4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.955843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee4e5612-71e6-4839-bbd2-bffe2733efa4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:45:52.226210 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee4e5612-71e6-4839-bbd2-bffe2733efa4 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 204 len: 0 microversion: 2.1 time: 0.356207 Aug 25 12:45:52.229910 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 545/1099] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:45:51 2022] DELETE /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:45:52.251401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-579a71ea-c206-43f5-9a98-64276dd0533d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:52.253243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-579a71ea-c206-43f5-9a98-64276dd0533d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:52.266597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-579a71ea-c206-43f5-9a98-64276dd0533d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:52.267581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-579a71ea-c206-43f5-9a98-64276dd0533d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:52.268398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-579a71ea-c206-43f5-9a98-64276dd0533d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:52.270420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-579a71ea-c206-43f5-9a98-64276dd0533d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:52.271570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-579a71ea-c206-43f5-9a98-64276dd0533d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:52.272502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-579a71ea-c206-43f5-9a98-64276dd0533d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:52.538015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c6af8bef-027b-44cc-b98e-5afe3b85ef22 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:52.559968 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6af8bef-027b-44cc-b98e-5afe3b85ef22 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1323 microversion: 2.1 time: 1.238968 Aug 25 12:45:52.576885 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 555/1100] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:51 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1323 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:52.612848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da110af9-6d09-4a69-a0ba-64e4234579d3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:52.618115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da110af9-6d09-4a69-a0ba-64e4234579d3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:52.650796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da110af9-6d09-4a69-a0ba-64e4234579d3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:52.656507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da110af9-6d09-4a69-a0ba-64e4234579d3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:52.658109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da110af9-6d09-4a69-a0ba-64e4234579d3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:52.659924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da110af9-6d09-4a69-a0ba-64e4234579d3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:52.661100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da110af9-6d09-4a69-a0ba-64e4234579d3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:52.662429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da110af9-6d09-4a69-a0ba-64e4234579d3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:53.303587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-579a71ea-c206-43f5-9a98-64276dd0533d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:53.333457 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-579a71ea-c206-43f5-9a98-64276dd0533d tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1469 microversion: 2.1 time: 1.096299 Aug 25 12:45:53.334389 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 546/1101] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:52 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1469 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:45:53.352051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed741c9d-9909-4d99-a421-3892f03c94e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:53.353063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ed741c9d-9909-4d99-a421-3892f03c94e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:53.426864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed741c9d-9909-4d99-a421-3892f03c94e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:53.427628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed741c9d-9909-4d99-a421-3892f03c94e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:53.428655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed741c9d-9909-4d99-a421-3892f03c94e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:53.430297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed741c9d-9909-4d99-a421-3892f03c94e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:53.432005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed741c9d-9909-4d99-a421-3892f03c94e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:53.438927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed741c9d-9909-4d99-a421-3892f03c94e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:54.050222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da110af9-6d09-4a69-a0ba-64e4234579d3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:54.077494 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da110af9-6d09-4a69-a0ba-64e4234579d3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1497 microversion: 2.1 time: 1.497529 Aug 25 12:45:54.079011 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 556/1102] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:52 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1497 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:54.093361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-befc89b4-7449-4d1e-8613-2c219eb6182f tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:54.095342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-befc89b4-7449-4d1e-8613-2c219eb6182f tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:54.110743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befc89b4-7449-4d1e-8613-2c219eb6182f tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:54.112485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befc89b4-7449-4d1e-8613-2c219eb6182f tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:54.113348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befc89b4-7449-4d1e-8613-2c219eb6182f tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:54.114682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befc89b4-7449-4d1e-8613-2c219eb6182f tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:54.115729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befc89b4-7449-4d1e-8613-2c219eb6182f tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:54.116542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-befc89b4-7449-4d1e-8613-2c219eb6182f tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:54.332260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ed741c9d-9909-4d99-a421-3892f03c94e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:54.358858 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ed741c9d-9909-4d99-a421-3892f03c94e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 1.013005 Aug 25 12:45:54.373977 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 547/1103] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:53 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:54.389153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f66d65ee-13b7-4c2f-a17e-c125777cf83b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:54.390971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f66d65ee-13b7-4c2f-a17e-c125777cf83b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:54.420426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f66d65ee-13b7-4c2f-a17e-c125777cf83b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:54.421444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f66d65ee-13b7-4c2f-a17e-c125777cf83b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:54.422297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f66d65ee-13b7-4c2f-a17e-c125777cf83b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:54.424974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f66d65ee-13b7-4c2f-a17e-c125777cf83b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:54.426450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f66d65ee-13b7-4c2f-a17e-c125777cf83b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:54.427682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f66d65ee-13b7-4c2f-a17e-c125777cf83b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:55.755517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-befc89b4-7449-4d1e-8613-2c219eb6182f tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:55.787093 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-befc89b4-7449-4d1e-8613-2c219eb6182f tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1323 microversion: 2.1 time: 1.703800 Aug 25 12:45:55.791187 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 557/1104] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:54 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1323 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:55.811227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-afa26cbb-3d1d-481f-abec-f5f322745eed tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:55.816432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-afa26cbb-3d1d-481f-abec-f5f322745eed tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:55.841455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa26cbb-3d1d-481f-abec-f5f322745eed tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:55.843047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa26cbb-3d1d-481f-abec-f5f322745eed tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:55.844518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa26cbb-3d1d-481f-abec-f5f322745eed tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:55.846844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa26cbb-3d1d-481f-abec-f5f322745eed tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:55.848186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa26cbb-3d1d-481f-abec-f5f322745eed tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:55.849562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa26cbb-3d1d-481f-abec-f5f322745eed tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:56.411961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f66d65ee-13b7-4c2f-a17e-c125777cf83b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:56.440086 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f66d65ee-13b7-4c2f-a17e-c125777cf83b tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1469 microversion: 2.1 time: 2.056477 Aug 25 12:45:56.443786 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 548/1105] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:54 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1469 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:56.456924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d1f37ada-4966-461c-83e4-b28e0e55d23e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:56.459533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d1f37ada-4966-461c-83e4-b28e0e55d23e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:56.481084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1f37ada-4966-461c-83e4-b28e0e55d23e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:56.483278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1f37ada-4966-461c-83e4-b28e0e55d23e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:56.485733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1f37ada-4966-461c-83e4-b28e0e55d23e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:56.489703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1f37ada-4966-461c-83e4-b28e0e55d23e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:56.496034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1f37ada-4966-461c-83e4-b28e0e55d23e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:56.499058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1f37ada-4966-461c-83e4-b28e0e55d23e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:57.435166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-afa26cbb-3d1d-481f-abec-f5f322745eed tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:57.558679 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-afa26cbb-3d1d-481f-abec-f5f322745eed tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1497 microversion: 2.1 time: 1.751789 Aug 25 12:45:57.563293 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 558/1106] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:55 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1497 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:57.618843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8ead240-7859-4754-9d86-a6bd3c3c9f70 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:57.621341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e8ead240-7859-4754-9d86-a6bd3c3c9f70 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:57.638981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ead240-7859-4754-9d86-a6bd3c3c9f70 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:57.642599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ead240-7859-4754-9d86-a6bd3c3c9f70 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:57.644250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ead240-7859-4754-9d86-a6bd3c3c9f70 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:57.646220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ead240-7859-4754-9d86-a6bd3c3c9f70 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:57.647443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ead240-7859-4754-9d86-a6bd3c3c9f70 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:57.648743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ead240-7859-4754-9d86-a6bd3c3c9f70 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:57.834225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d1f37ada-4966-461c-83e4-b28e0e55d23e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:57.855181 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d1f37ada-4966-461c-83e4-b28e0e55d23e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 1.408164 Aug 25 12:45:57.856254 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 549/1107] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:56 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:57.882120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ede64b07-045a-4451-903f-5de724847733 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:57.883434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ede64b07-045a-4451-903f-5de724847733 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:57.896118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede64b07-045a-4451-903f-5de724847733 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:57.897063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede64b07-045a-4451-903f-5de724847733 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:57.897974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede64b07-045a-4451-903f-5de724847733 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:57.899931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede64b07-045a-4451-903f-5de724847733 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:57.901111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede64b07-045a-4451-903f-5de724847733 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:57.901704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede64b07-045a-4451-903f-5de724847733 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:01.144148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ede64b07-045a-4451-903f-5de724847733 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150efb14f73347c7aa81255bba9f12ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2700209d0c94f789c1b01cf7b38c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:01.183919 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ede64b07-045a-4451-903f-5de724847733 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 200 len: 1469 microversion: 2.1 time: 3.319787 Aug 25 12:46:01.187608 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 550/1108] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:57 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 1469 bytes in 3331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:01.209579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04c12606-7b65-403f-a8df-1d3c37066b4f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:01.211037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-04c12606-7b65-403f-a8df-1d3c37066b4f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:01.236608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04c12606-7b65-403f-a8df-1d3c37066b4f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:01.240714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04c12606-7b65-403f-a8df-1d3c37066b4f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:01.249605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04c12606-7b65-403f-a8df-1d3c37066b4f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:01.251703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04c12606-7b65-403f-a8df-1d3c37066b4f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:01.253107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04c12606-7b65-403f-a8df-1d3c37066b4f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:01.254341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04c12606-7b65-403f-a8df-1d3c37066b4f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:01.332100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e8ead240-7859-4754-9d86-a6bd3c3c9f70 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:01.364467 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e8ead240-7859-4754-9d86-a6bd3c3c9f70 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1323 microversion: 2.1 time: 3.794513 Aug 25 12:46:01.377104 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 559/1109] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:57 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1323 bytes in 3810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:01.406482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86930ba1-f40c-4a26-bafc-e92b8f520e0d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:01.409883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-86930ba1-f40c-4a26-bafc-e92b8f520e0d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:01.445227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86930ba1-f40c-4a26-bafc-e92b8f520e0d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:01.455442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86930ba1-f40c-4a26-bafc-e92b8f520e0d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:01.469710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86930ba1-f40c-4a26-bafc-e92b8f520e0d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:01.475575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86930ba1-f40c-4a26-bafc-e92b8f520e0d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:01.478568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86930ba1-f40c-4a26-bafc-e92b8f520e0d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:01.480179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86930ba1-f40c-4a26-bafc-e92b8f520e0d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:02.667792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-04c12606-7b65-403f-a8df-1d3c37066b4f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:02.718821 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-04c12606-7b65-403f-a8df-1d3c37066b4f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 200 len: 1474 microversion: 2.1 time: 1.527735 Aug 25 12:46:02.729573 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 551/1110] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:01 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 1474 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:02.758030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-531aacb4-4d9d-4173-8804-6bb21e15638e req-492d4d48-bc25-42b0-8934-c00b869da4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42add69-b14a-4dd1-a7ce-8c6c162b4e1a", "name": "network-vif-deleted", "tag": "0a60e19f-de52-46f3-aca2-8d097515612b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:02.773223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-86930ba1-f40c-4a26-bafc-e92b8f520e0d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:02.812287 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-86930ba1-f40c-4a26-bafc-e92b8f520e0d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 1.431714 Aug 25 12:46:02.814021 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 560/1111] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:01 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:02.841868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-531aacb4-4d9d-4173-8804-6bb21e15638e req-492d4d48-bc25-42b0-8934-c00b869da4e1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:02.845219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-531aacb4-4d9d-4173-8804-6bb21e15638e req-492d4d48-bc25-42b0-8934-c00b869da4e1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:02.851896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-531aacb4-4d9d-4173-8804-6bb21e15638e req-492d4d48-bc25-42b0-8934-c00b869da4e1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:02.940944 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-531aacb4-4d9d-4173-8804-6bb21e15638e req-492d4d48-bc25-42b0-8934-c00b869da4e1 service nova] Creating event network-vif-deleted:0a60e19f-de52-46f3-aca2-8d097515612b for instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a on n-h1-852771-8 Aug 25 12:46:02.959929 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-531aacb4-4d9d-4173-8804-6bb21e15638e req-492d4d48-bc25-42b0-8934-c00b869da4e1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221078 Aug 25 12:46:02.961615 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 552/1112] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:02.990947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:02.996751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] [instance: c42add69-b14a-4dd1-a7ce-8c6c162b4e1a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:03.019486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:03.024799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:03.030383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:03.032183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:03.033380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:03.034248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:03.096100 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] HTTP exception thrown: Instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a could not be found. Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Request method failure captured: Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a HTTP/1.1 Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB24noX5B1QSIodGxilif_VmOI5467B-8Ul3pnHX6A6sHrvSK5Vz8D3-v3xlSHmR8a6jkzPfS-_MvT_48xAHi6KgoceCUDXGDigk-67enlBoclSY8RDbMDdNjjHAQjAhcWcxnsILGYjlJmWxTAEqE2SBIEf4q57eP0vF4Qq90OdeQzME Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: e2700209d0c94f789c1b01cf7b38c6e0 Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersAdminTestJSON-1166298758 Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:46:03.099512 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e2700209d0c94f789c1b01cf7b38c6e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e2700209d0c94f789c1b01cf7b38c6e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e2700209d0c94f789c1b01cf7b38c6e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e2700209d0c94f789c1b01cf7b38c6e0"}]}] Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersAdminTestJSON-1166298758 Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: e2700209d0c94f789c1b01cf7b38c6e0 Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersAdminTestJSON-1166298758 Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersAdminTestJSON-1166298758-project Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 150efb14f73347c7aa81255bba9f12ca Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersAdminTestJSON-1166298758-project Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a could not be found. Aug 25 12:46:03.104764 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'c42add69-b14a-4dd1-a7ce-8c6c162b4e1a'} Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a could not be found. Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:03.106429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a could not be found. Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a could not be found. Aug 25 12:46:03.109150 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:03.120550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] Returning 404 to user: Instance c42add69-b14a-4dd1-a7ce-8c6c162b4e1a could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:03.122952 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1bfe453c-2d27-43ca-9cf7-0fecccb9aaa7 tempest-ServersAdminTestJSON-1166298758 tempest-ServersAdminTestJSON-1166298758-project] 10.222.0.70 "GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a" status: 404 len: 111 microversion: 2.1 time: 0.156262 Aug 25 12:46:03.124416 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 553/1113] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:02 2022] GET /compute/v2.1/servers/c42add69-b14a-4dd1-a7ce-8c6c162b4e1a => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:46:03.144866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-da997875-a8e1-49d3-992d-e394e4de0377 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:03.166599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-da997875-a8e1-49d3-992d-e394e4de0377 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:03.209632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da997875-a8e1-49d3-992d-e394e4de0377 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:03.215562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da997875-a8e1-49d3-992d-e394e4de0377 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:03.216759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da997875-a8e1-49d3-992d-e394e4de0377 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:03.218270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da997875-a8e1-49d3-992d-e394e4de0377 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:03.228383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da997875-a8e1-49d3-992d-e394e4de0377 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:03.228773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da997875-a8e1-49d3-992d-e394e4de0377 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:03.473153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f4b92399-6c9a-496d-8b29-acf585d7c4ae tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Action: 'create', calling method: .version_select at 0x7f3a2a614d30>, body: {"keypair": {"name": "tempest-keypair-705601256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89Qhoa+voj+NcYNoyogholYVQlaMofTQnbzrUD9vDT4ArtGySro6ZPXURshynPoC91xrG5l1qzJGNyaPW9awxDOqFI18mYL/8R4vFh8rsShzMC0cnWTl1HdSmxiPMqkQ=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:03.558069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f4b92399-6c9a-496d-8b29-acf585d7c4ae tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Getting quotas for project ea75680120684ccaae1b8c82e42b7c38. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:46:03.584641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f4b92399-6c9a-496d-8b29-acf585d7c4ae tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Getting quotas for user 624fc054f45b48579ba7c47af4185e91 and project ea75680120684ccaae1b8c82e42b7c38. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:46:03.728618 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f4b92399-6c9a-496d-8b29-acf585d7c4ae tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.906655 Aug 25 12:46:03.729989 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 561/1114] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:46:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:04.015239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bdd5e503-bae4-4491-bbd8-b1630faa2547 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Action: 'create', calling method: .version_select at 0x7f3a2a52fa60>, body: {"pool": null} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:04.062645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-da997875-a8e1-49d3-992d-e394e4de0377 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:04.097264 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-da997875-a8e1-49d3-992d-e394e4de0377 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1323 microversion: 2.1 time: 0.970204 Aug 25 12:46:04.104224 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 554/1115] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:03 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1323 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:04.153546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-060bbe62-a33f-4bf0-b4cb-2f393c0991bd tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-533198921"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:04.168878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-060bbe62-a33f-4bf0-b4cb-2f393c0991bd tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:04.194660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-060bbe62-a33f-4bf0-b4cb-2f393c0991bd tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:04.197240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-060bbe62-a33f-4bf0-b4cb-2f393c0991bd tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:04.205455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-060bbe62-a33f-4bf0-b4cb-2f393c0991bd tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:04.207982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-060bbe62-a33f-4bf0-b4cb-2f393c0991bd tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:04.209484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-060bbe62-a33f-4bf0-b4cb-2f393c0991bd tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:04.213364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-060bbe62-a33f-4bf0-b4cb-2f393c0991bd tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:05.260411 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-060bbe62-a33f-4bf0-b4cb-2f393c0991bd tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2/action" status: 202 len: 0 microversion: 2.1 time: 1.148912 Aug 25 12:46:05.268978 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 555/1116] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:46:04 2022] POST /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2/action => generated 0 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:46:05.295979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d47310d3-b9db-4691-bc0f-09ad6e655361 req-26d3faaa-6b26-4f56-bf3f-581e441a3926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6580b463-1d84-41b9-b153-d64546089c5f", "name": "network-vif-plugged", "status": "completed", "tag": "db5e26b9-fe95-4b5d-b561-6b24894513d7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:05.362695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d47310d3-b9db-4691-bc0f-09ad6e655361 req-26d3faaa-6b26-4f56-bf3f-581e441a3926 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:05.365260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d47310d3-b9db-4691-bc0f-09ad6e655361 req-26d3faaa-6b26-4f56-bf3f-581e441a3926 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:05.367115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d47310d3-b9db-4691-bc0f-09ad6e655361 req-26d3faaa-6b26-4f56-bf3f-581e441a3926 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:05.422052 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d47310d3-b9db-4691-bc0f-09ad6e655361 req-26d3faaa-6b26-4f56-bf3f-581e441a3926 service nova] Creating event network-vif-plugged:db5e26b9-fe95-4b5d-b561-6b24894513d7 for instance 6580b463-1d84-41b9-b153-d64546089c5f on n-h2-852771-8 Aug 25 12:46:05.443966 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d47310d3-b9db-4691-bc0f-09ad6e655361 req-26d3faaa-6b26-4f56-bf3f-581e441a3926 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169056 Aug 25 12:46:05.450381 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 556/1117] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:05.474412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-409e70b4-7dd6-4c81-8136-38fcafd6b7c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:05.480023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-409e70b4-7dd6-4c81-8136-38fcafd6b7c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:05.505608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-409e70b4-7dd6-4c81-8136-38fcafd6b7c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:05.507290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-409e70b4-7dd6-4c81-8136-38fcafd6b7c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:05.521207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-409e70b4-7dd6-4c81-8136-38fcafd6b7c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:05.531326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-409e70b4-7dd6-4c81-8136-38fcafd6b7c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:05.535587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-409e70b4-7dd6-4c81-8136-38fcafd6b7c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:05.537680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-409e70b4-7dd6-4c81-8136-38fcafd6b7c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:05.567294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:07.639589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-409e70b4-7dd6-4c81-8136-38fcafd6b7c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:07.688799 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-409e70b4-7dd6-4c81-8136-38fcafd6b7c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 2.233838 Aug 25 12:46:07.691234 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 557/1118] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:05 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 2240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:07.714275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9048c222-bc4e-44b6-9aa0-b8f01a0ab57d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:07.719500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9048c222-bc4e-44b6-9aa0-b8f01a0ab57d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:07.749111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9048c222-bc4e-44b6-9aa0-b8f01a0ab57d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:07.756996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9048c222-bc4e-44b6-9aa0-b8f01a0ab57d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:07.758306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9048c222-bc4e-44b6-9aa0-b8f01a0ab57d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:07.760048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9048c222-bc4e-44b6-9aa0-b8f01a0ab57d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:07.760817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9048c222-bc4e-44b6-9aa0-b8f01a0ab57d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:07.761651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9048c222-bc4e-44b6-9aa0-b8f01a0ab57d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:09.111060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9048c222-bc4e-44b6-9aa0-b8f01a0ab57d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:09.132038 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9048c222-bc4e-44b6-9aa0-b8f01a0ab57d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1323 microversion: 2.1 time: 1.438385 Aug 25 12:46:09.134096 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 558/1119] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:07 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1323 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:09.143266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-134dbbb6-61f2-4edb-8b3a-071ed1807ee0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a5e81f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:09.297789 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-134dbbb6-61f2-4edb-8b3a-071ed1807ee0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 0.160859 Aug 25 12:46:09.314242 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 559/1120] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:09 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:09.326756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ec2af764-0a21-4bfb-a004-e9722d47515d req-75425c3a-e691-4693-9a4e-316e77e9acef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2714be3e-3fdc-42c0-8b91-775c6adb6ea2", "name": "network-vif-plugged", "status": "completed", "tag": "f903dae0-0844-4573-8208-c708b6962e10"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:09.348802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:09.352561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec2af764-0a21-4bfb-a004-e9722d47515d req-75425c3a-e691-4693-9a4e-316e77e9acef service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:09.353482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec2af764-0a21-4bfb-a004-e9722d47515d req-75425c3a-e691-4693-9a4e-316e77e9acef service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:09.354322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec2af764-0a21-4bfb-a004-e9722d47515d req-75425c3a-e691-4693-9a4e-316e77e9acef service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:09.380720 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ec2af764-0a21-4bfb-a004-e9722d47515d req-75425c3a-e691-4693-9a4e-316e77e9acef service nova] Creating event network-vif-plugged:f903dae0-0844-4573-8208-c708b6962e10 for instance 2714be3e-3fdc-42c0-8b91-775c6adb6ea2 on n-h1-852771-8 Aug 25 12:46:09.392600 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ec2af764-0a21-4bfb-a004-e9722d47515d req-75425c3a-e691-4693-9a4e-316e77e9acef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076406 Aug 25 12:46:09.394379 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 560/1121] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:09.422245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-836c78ef-1b94-43c5-92c2-2e91a298fe41 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:09.424896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-836c78ef-1b94-43c5-92c2-2e91a298fe41 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:09.442660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-836c78ef-1b94-43c5-92c2-2e91a298fe41 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:09.444261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-836c78ef-1b94-43c5-92c2-2e91a298fe41 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:09.445353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-836c78ef-1b94-43c5-92c2-2e91a298fe41 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:09.447713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-836c78ef-1b94-43c5-92c2-2e91a298fe41 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:09.448879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-836c78ef-1b94-43c5-92c2-2e91a298fe41 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:09.451237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-836c78ef-1b94-43c5-92c2-2e91a298fe41 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:10.462716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-836c78ef-1b94-43c5-92c2-2e91a298fe41 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:10.490880 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-836c78ef-1b94-43c5-92c2-2e91a298fe41 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 1.093517 Aug 25 12:46:10.495335 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 561/1122] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:09 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:10.532886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d30b8c61-47fc-4e18-8d40-aeb51bf14a46 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:10.537804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d30b8c61-47fc-4e18-8d40-aeb51bf14a46 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:10.568990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d30b8c61-47fc-4e18-8d40-aeb51bf14a46 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:10.574960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d30b8c61-47fc-4e18-8d40-aeb51bf14a46 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:10.581774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d30b8c61-47fc-4e18-8d40-aeb51bf14a46 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:10.585164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d30b8c61-47fc-4e18-8d40-aeb51bf14a46 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:10.589392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d30b8c61-47fc-4e18-8d40-aeb51bf14a46 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:10.590240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d30b8c61-47fc-4e18-8d40-aeb51bf14a46 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:11.292789 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bdd5e503-bae4-4491-bbd8-b1630faa2547 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.558595 Aug 25 12:46:11.306524 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 562/1123] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 12:46:03 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:11.329778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8b7405c8-192d-4e01-a012-a92b5b96b275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a780af0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:11.426215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d30b8c61-47fc-4e18-8d40-aeb51bf14a46 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:11.452492 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d30b8c61-47fc-4e18-8d40-aeb51bf14a46 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1323 microversion: 2.1 time: 0.952779 Aug 25 12:46:11.471351 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 562/1124] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:10 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1323 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:11.509356 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8b7405c8-192d-4e01-a012-a92b5b96b275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 0.193802 Aug 25 12:46:11.512118 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 563/1125] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:11 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:11.516788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-133489a9-b13f-41d3-8a84-1bf57d654114 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Calling method '.version_select at 0x7f3a2a486040>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:11.556772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b6257fb-0134-4af9-bca9-b869a26cacd2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:11.573575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b6257fb-0134-4af9-bca9-b869a26cacd2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:11.609399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b6257fb-0134-4af9-bca9-b869a26cacd2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:11.610981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b6257fb-0134-4af9-bca9-b869a26cacd2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:11.612259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b6257fb-0134-4af9-bca9-b869a26cacd2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:11.613926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b6257fb-0134-4af9-bca9-b869a26cacd2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:11.615934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b6257fb-0134-4af9-bca9-b869a26cacd2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:11.617158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b6257fb-0134-4af9-bca9-b869a26cacd2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:12.354654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b6257fb-0134-4af9-bca9-b869a26cacd2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:12.427905 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b6257fb-0134-4af9-bca9-b869a26cacd2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 0.864126 Aug 25 12:46:12.434553 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 564/1126] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:11 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:12.469588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-e9b669b4-1c6c-4fe2-aa03-1e614f81487b req-d3b3e799-8c6f-43ee-a5c5-adfc82daf495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3155f7-5f48-47a9-a5a6-6ec064e160de", "name": "network-vif-plugged", "status": "completed", "tag": "5363dc13-2a91-4fbd-a4fa-f1335cb952e4"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:12.483466 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-133489a9-b13f-41d3-8a84-1bf57d654114 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/0a7a7af9-164e-4f9d-aae2-85946656bc51" status: 200 len: 141 microversion: 2.1 time: 1.009030 Aug 25 12:46:12.484476 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 563/1127] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:46:11 2022] GET /compute/v2.1/os-floating-ips/0a7a7af9-164e-4f9d-aae2-85946656bc51 => generated 141 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:12.514680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-445e6706-551c-44cd-bc55-116f5994e56e tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Calling method '.version_select at 0x7f3a2a3ef1f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:12.521066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e9b669b4-1c6c-4fe2-aa03-1e614f81487b req-d3b3e799-8c6f-43ee-a5c5-adfc82daf495 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:12.528593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e9b669b4-1c6c-4fe2-aa03-1e614f81487b req-d3b3e799-8c6f-43ee-a5c5-adfc82daf495 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:12.529570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e9b669b4-1c6c-4fe2-aa03-1e614f81487b req-d3b3e799-8c6f-43ee-a5c5-adfc82daf495 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:12.611290 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-e9b669b4-1c6c-4fe2-aa03-1e614f81487b req-d3b3e799-8c6f-43ee-a5c5-adfc82daf495 service nova] Creating event network-vif-plugged:5363dc13-2a91-4fbd-a4fa-f1335cb952e4 for instance ca3155f7-5f48-47a9-a5a6-6ec064e160de on n-h2-852771-8 Aug 25 12:46:12.638778 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-e9b669b4-1c6c-4fe2-aa03-1e614f81487b req-d3b3e799-8c6f-43ee-a5c5-adfc82daf495 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196936 Aug 25 12:46:12.642068 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 565/1128] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:12.678831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1d167389-5092-4c7c-8b3f-ace76de32812 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:12.680866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1d167389-5092-4c7c-8b3f-ace76de32812 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:12.716332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d167389-5092-4c7c-8b3f-ace76de32812 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:12.718018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d167389-5092-4c7c-8b3f-ace76de32812 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:12.719826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d167389-5092-4c7c-8b3f-ace76de32812 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:12.722547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d167389-5092-4c7c-8b3f-ace76de32812 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:12.724252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d167389-5092-4c7c-8b3f-ace76de32812 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:12.727483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d167389-5092-4c7c-8b3f-ace76de32812 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:13.624679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:13.791738 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-445e6706-551c-44cd-bc55-116f5994e56e tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 1.287250 Aug 25 12:46:13.794132 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 564/1129] 10.222.0.70 () {58 vars in 1149 bytes} [Thu Aug 25 12:46:12 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:13.811001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ae51cba6-60e0-49de-917f-39879b96e877 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a5494c0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:13.840564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d167389-5092-4c7c-8b3f-ace76de32812 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:13.870126 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1d167389-5092-4c7c-8b3f-ace76de32812 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 200 len: 1517 microversion: 2.1 time: 1.216508 Aug 25 12:46:13.874786 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 566/1130] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:12 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 1517 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:14.043859 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ae51cba6-60e0-49de-917f-39879b96e877 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 0.247014 Aug 25 12:46:14.054348 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 565/1131] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:13 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:14.064284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a6417b4d-94c9-4ecb-9315-40b2509f774a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:14.065380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a6417b4d-94c9-4ecb-9315-40b2509f774a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:14.094547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6417b4d-94c9-4ecb-9315-40b2509f774a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:14.095411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6417b4d-94c9-4ecb-9315-40b2509f774a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:14.096451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6417b4d-94c9-4ecb-9315-40b2509f774a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:14.097784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6417b4d-94c9-4ecb-9315-40b2509f774a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:14.098595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6417b4d-94c9-4ecb-9315-40b2509f774a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:14.099363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6417b4d-94c9-4ecb-9315-40b2509f774a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:14.527620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a6417b4d-94c9-4ecb-9315-40b2509f774a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:14.534111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29de3ccb-5dbe-4074-81c9-28271e817ccf tempest-FlavorsV2NegativeTest-895137365 tempest-FlavorsV2NegativeTest-895137365-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:14.553364 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a6417b4d-94c9-4ecb-9315-40b2509f774a tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1378 microversion: 2.1 time: 0.495976 Aug 25 12:46:14.555944 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 566/1132] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:14 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1378 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:14.562793 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29de3ccb-5dbe-4074-81c9-28271e817ccf tempest-FlavorsV2NegativeTest-895137365 tempest-FlavorsV2NegativeTest-895137365-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.685036 Aug 25 12:46:14.566601 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 567/1133] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:46:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:14.568185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fc33cf86-314d-458a-bd21-681c0210a6ed tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Calling method '.version_select at 0x7f3a2a447820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:14.583709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-375690605", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "ebb8dfc1-c19f-4e9a-a493-27a2bf61338f"}], "security_groups": [{"name": "tempest-securitygroup--252167046"}], "key_name": "tempest-keypair-705601256", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:16.712230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] validate_networks() for [('ebb8dfc1-c19f-4e9a-a493-27a2bf61338f', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:46:18.382262 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fc33cf86-314d-458a-bd21-681c0210a6ed tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/0a7a7af9-164e-4f9d-aae2-85946656bc51" status: 202 len: 0 microversion: 2.1 time: 3.823803 Aug 25 12:46:18.393653 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 567/1134] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 12:46:14 2022] DELETE /compute/v2.1/os-floating-ips/0a7a7af9-164e-4f9d-aae2-85946656bc51 => generated 0 bytes in 3837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:46:18.410911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4dbf1a0a-c57a-4a06-974d-c64b4acd36cd tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:18.412746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4dbf1a0a-c57a-4a06-974d-c64b4acd36cd tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 6580b463-1d84-41b9-b153-d64546089c5f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:18.466920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4dbf1a0a-c57a-4a06-974d-c64b4acd36cd tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:18.474801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4dbf1a0a-c57a-4a06-974d-c64b4acd36cd tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:18.479411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4dbf1a0a-c57a-4a06-974d-c64b4acd36cd tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:18.481480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4dbf1a0a-c57a-4a06-974d-c64b4acd36cd tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:18.483873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4dbf1a0a-c57a-4a06-974d-c64b4acd36cd tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:18.486708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4dbf1a0a-c57a-4a06-974d-c64b4acd36cd tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:19.144636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4dbf1a0a-c57a-4a06-974d-c64b4acd36cd tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:19.171244 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4dbf1a0a-c57a-4a06-974d-c64b4acd36cd tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/6580b463-1d84-41b9-b153-d64546089c5f" status: 200 len: 1516 microversion: 2.1 time: 0.774645 Aug 25 12:46:19.184848 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 568/1135] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:18 2022] GET /compute/v2.1/servers/6580b463-1d84-41b9-b153-d64546089c5f => generated 1516 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:19.498271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2147317429", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a8cc8d52-dd00-486a-beb8-ce1dce750174"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:19.688537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] validate_networks() for [('a8cc8d52-dd00-486a-beb8-ce1dce750174', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:46:19.697428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:46:19.700101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:46:19.701668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:46:19.705311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:46:19.706984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:46:19.718423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:19.739995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:19.742954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:19.744907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:19.749217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:19.752350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:19.753772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:19.824917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Getting quotas for project ea75680120684ccaae1b8c82e42b7c38. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:46:19.838336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Getting quotas for user 624fc054f45b48579ba7c47af4185e91 and project ea75680120684ccaae1b8c82e42b7c38. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:46:19.866180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:46:19.871907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:46:20.058969 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f5da0acc-d2ed-4eb8-be3c-be6c02c31f79 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.490040 Aug 25 12:46:20.063618 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 568/1136] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:46:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 5496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:46:20.081937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2962ade1-d744-4162-840a-d3e01643c0be req-d4fbba3e-f5c9-4ae6-8b2f-e3928ed2738a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d524fb40-c835-4a9f-beee-3b638cd73037", "name": "network-vif-plugged", "status": "completed", "tag": "66d6910d-3fc1-4f06-bf3c-9eb54101d598"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:20.102770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2962ade1-d744-4162-840a-d3e01643c0be req-d4fbba3e-f5c9-4ae6-8b2f-e3928ed2738a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.104149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2962ade1-d744-4162-840a-d3e01643c0be req-d4fbba3e-f5c9-4ae6-8b2f-e3928ed2738a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.108925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2962ade1-d744-4162-840a-d3e01643c0be req-d4fbba3e-f5c9-4ae6-8b2f-e3928ed2738a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.155890 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2962ade1-d744-4162-840a-d3e01643c0be req-d4fbba3e-f5c9-4ae6-8b2f-e3928ed2738a service nova] Creating event network-vif-plugged:66d6910d-3fc1-4f06-bf3c-9eb54101d598 for instance d524fb40-c835-4a9f-beee-3b638cd73037 on n-h2-852771-8 Aug 25 12:46:20.183719 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2962ade1-d744-4162-840a-d3e01643c0be req-d4fbba3e-f5c9-4ae6-8b2f-e3928ed2738a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107449 Aug 25 12:46:20.185758 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 569/1137] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:20.200287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2501f0d8-58f9-497f-a565-9cc913353ebe tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a657280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:20.404821 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2501f0d8-58f9-497f-a565-9cc913353ebe tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 0.215045 Aug 25 12:46:20.413896 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 570/1138] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:20 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:20.437010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6f8fc7e-36f9-4186-8d33-d17897783898 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:20.441218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b6f8fc7e-36f9-4186-8d33-d17897783898 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:20.484156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f8fc7e-36f9-4186-8d33-d17897783898 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.488106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f8fc7e-36f9-4186-8d33-d17897783898 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.488942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f8fc7e-36f9-4186-8d33-d17897783898 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.490388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f8fc7e-36f9-4186-8d33-d17897783898 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.493920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f8fc7e-36f9-4186-8d33-d17897783898 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.495904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f8fc7e-36f9-4186-8d33-d17897783898 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:21.502809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b6f8fc7e-36f9-4186-8d33-d17897783898 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:21.521721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=59 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:21.558085 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b6f8fc7e-36f9-4186-8d33-d17897783898 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1528 microversion: 2.1 time: 1.138265 Aug 25 12:46:21.560899 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 571/1139] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:20 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1528 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:21.574637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-950e7a3d-c91c-409b-bdee-0273bd8e3277 tempest-FlavorsV2NegativeTest-895137365 tempest-FlavorsV2NegativeTest-895137365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-348300038", "imageRef": "23090236-eef4-4b6c-80c2-95aed1268b0e", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:21.905400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-950e7a3d-c91c-409b-bdee-0273bd8e3277 tempest-FlavorsV2NegativeTest-895137365 tempest-FlavorsV2NegativeTest-895137365-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:46:21.962649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:46:21.964932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:46:21.966547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:46:21.968127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:46:21.969265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:46:21.992051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:21.994255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:21.996203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:21.998430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:22.005315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:22.007095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:22.075696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Getting quotas for project 5473d51e2cf040a3ae656d7e987feec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:46:22.103278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Getting quotas for user 81b5d1940fe64714bd9ba7d2009004fd and project 5473d51e2cf040a3ae656d7e987feec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:46:22.146346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:46:22.152556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:46:22.328960 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eb3b89b6-7120-4bf6-9c74-cf1951b19ce2 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.141072 Aug 25 12:46:22.331950 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 569/1140] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:46:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:46:22.356876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54d9c78d-552f-4424-a9f2-bc370e32aba7 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Action: 'create', calling method: .version_select at 0x7f3a2a3ef9d0>, body: {"pool": null} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:23.332527 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-950e7a3d-c91c-409b-bdee-0273bd8e3277 tempest-FlavorsV2NegativeTest-895137365 tempest-FlavorsV2NegativeTest-895137365-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-950e7a3d-c91c-409b-bdee-0273bd8e3277 tempest-FlavorsV2NegativeTest-895137365 tempest-FlavorsV2NegativeTest-895137365-project] Request method failure captured: Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 142 Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB28UoWO9dT1xZIeutTJ3Uu_0qHyOUxYEclMrAuNK4kXOdF_qZY8tTpVd58OMAekCxF5955EMq-g8ldrVYSiXybdjdLhryAqQQRPvLvqUkFiDERqGzUisanurvX_nafGFRzAIyJB1xFI4Ivq5IcTgIzSO0eO57bKtJntG_fu6C9yko3Y Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 882195b8db1c40fcbc0d718720719ba2 Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FlavorsV2NegativeTest-895137365 Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:46:23.347871 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/882195b8db1c40fcbc0d718720719ba2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_882195b8db1c40fcbc0d718720719ba2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/882195b8db1c40fcbc0d718720719ba2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/882195b8db1c40fcbc0d718720719ba2"}]}] Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FlavorsV2NegativeTest-895137365 Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 882195b8db1c40fcbc0d718720719ba2 Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-895137365 Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FlavorsV2NegativeTest-895137365-project Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 7aee81af664f4fcfb4d34b7b0c16b3be Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FlavorsV2NegativeTest-895137365-project Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-348300038", "imageRef": "23090236-eef4-4b6c-80c2-95aed1268b0e", "flavorRef": "452"}} Aug 25 12:46:23.351144 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: exception: Flavor's memory is too small for requested image. Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-348300038', 'imageRef': '23090236-eef4-4b6c-80c2-95aed1268b0e', 'flavorRef': '452'}}} Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:23.353413 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:23.356215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:23.364612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:23.364612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:23.364612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:23.364612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:23.364612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 25 12:46:23.364612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:23.364612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-950e7a3d-c91c-409b-bdee-0273bd8e3277 tempest-FlavorsV2NegativeTest-895137365 tempest-FlavorsV2NegativeTest-895137365-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:23.376417 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-950e7a3d-c91c-409b-bdee-0273bd8e3277 tempest-FlavorsV2NegativeTest-895137365 tempest-FlavorsV2NegativeTest-895137365-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.813165 Aug 25 12:46:23.391754 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 572/1141] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:46:21 2022] POST /compute/v2.1/servers => generated 93 bytes in 1822 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:46:23.419938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e11ce6c8-3577-4f93-a862-8173131d02ec tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:23.429176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e11ce6c8-3577-4f93-a862-8173131d02ec tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: d524fb40-c835-4a9f-beee-3b638cd73037] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:23.475216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11ce6c8-3577-4f93-a862-8173131d02ec tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:23.477705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11ce6c8-3577-4f93-a862-8173131d02ec tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:23.478226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11ce6c8-3577-4f93-a862-8173131d02ec tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:23.484470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11ce6c8-3577-4f93-a862-8173131d02ec tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:23.519050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11ce6c8-3577-4f93-a862-8173131d02ec tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:23.522341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11ce6c8-3577-4f93-a862-8173131d02ec tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:24.888850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e11ce6c8-3577-4f93-a862-8173131d02ec tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:24.965621 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e11ce6c8-3577-4f93-a862-8173131d02ec tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037" status: 200 len: 1516 microversion: 2.1 time: 1.569524 Aug 25 12:46:24.975402 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 573/1142] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:23 2022] GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037 => generated 1516 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:24.987904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6efa27fa-94e2-4d7c-8358-87dda5f62c18 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:24.989625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6efa27fa-94e2-4d7c-8358-87dda5f62c18 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:25.024219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6efa27fa-94e2-4d7c-8358-87dda5f62c18 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:25.029923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6efa27fa-94e2-4d7c-8358-87dda5f62c18 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:25.031642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6efa27fa-94e2-4d7c-8358-87dda5f62c18 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:25.036153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6efa27fa-94e2-4d7c-8358-87dda5f62c18 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:25.037885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6efa27fa-94e2-4d7c-8358-87dda5f62c18 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:25.043298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6efa27fa-94e2-4d7c-8358-87dda5f62c18 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:25.378260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6efa27fa-94e2-4d7c-8358-87dda5f62c18 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:25.416642 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6efa27fa-94e2-4d7c-8358-87dda5f62c18 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1298 microversion: 2.1 time: 0.438485 Aug 25 12:46:25.433890 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 574/1143] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:24 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1298 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:25.450941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b8e9700e-d13a-4a40-9808-ec0be21d4110 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a5751f0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:25.622626 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b8e9700e-d13a-4a40-9808-ec0be21d4110 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 0.184802 Aug 25 12:46:25.625462 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 575/1144] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:25 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:25.638154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ab71996-b0b2-4ffe-b1eb-620da8573950 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:25.639480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3ab71996-b0b2-4ffe-b1eb-620da8573950 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:25.692174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab71996-b0b2-4ffe-b1eb-620da8573950 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:25.693923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab71996-b0b2-4ffe-b1eb-620da8573950 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:25.694797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab71996-b0b2-4ffe-b1eb-620da8573950 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:25.697032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab71996-b0b2-4ffe-b1eb-620da8573950 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:25.699219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab71996-b0b2-4ffe-b1eb-620da8573950 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:25.699219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ab71996-b0b2-4ffe-b1eb-620da8573950 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:26.618242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3ab71996-b0b2-4ffe-b1eb-620da8573950 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:26.676375 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3ab71996-b0b2-4ffe-b1eb-620da8573950 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1528 microversion: 2.1 time: 1.049072 Aug 25 12:46:26.677861 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 576/1145] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:25 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1528 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:26.696548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-7ec4668e-28c5-4654-a4f1-a0051519a0bb req-cbdc5b25-311d-4889-8e4b-d24e90e17112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305f349d-9b1a-4ad8-996a-e0da7d1cefd2", "name": "network-vif-plugged", "status": "completed", "tag": "2e9adcd5-fb4f-40dc-8678-e173de267b62"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:26.726109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7ec4668e-28c5-4654-a4f1-a0051519a0bb req-cbdc5b25-311d-4889-8e4b-d24e90e17112 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:26.734865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7ec4668e-28c5-4654-a4f1-a0051519a0bb req-cbdc5b25-311d-4889-8e4b-d24e90e17112 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:26.743170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7ec4668e-28c5-4654-a4f1-a0051519a0bb req-cbdc5b25-311d-4889-8e4b-d24e90e17112 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:26.796915 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-7ec4668e-28c5-4654-a4f1-a0051519a0bb req-cbdc5b25-311d-4889-8e4b-d24e90e17112 service nova] Creating event network-vif-plugged:2e9adcd5-fb4f-40dc-8678-e173de267b62 for instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 on n-h1-852771-8 Aug 25 12:46:26.828856 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-7ec4668e-28c5-4654-a4f1-a0051519a0bb req-cbdc5b25-311d-4889-8e4b-d24e90e17112 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140233 Aug 25 12:46:26.830032 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 577/1146] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:26.861501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e5c7ff0-b6ef-456f-96db-d7810b77fb25 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:26.865539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4e5c7ff0-b6ef-456f-96db-d7810b77fb25 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:26.898293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e5c7ff0-b6ef-456f-96db-d7810b77fb25 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:26.899417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e5c7ff0-b6ef-456f-96db-d7810b77fb25 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:26.904877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e5c7ff0-b6ef-456f-96db-d7810b77fb25 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:26.908987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e5c7ff0-b6ef-456f-96db-d7810b77fb25 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:26.909920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e5c7ff0-b6ef-456f-96db-d7810b77fb25 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:26.910739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e5c7ff0-b6ef-456f-96db-d7810b77fb25 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:27.196506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e5c7ff0-b6ef-456f-96db-d7810b77fb25 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:27.235680 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e5c7ff0-b6ef-456f-96db-d7810b77fb25 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1269 microversion: 2.1 time: 0.390267 Aug 25 12:46:27.237002 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 578/1147] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:26 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1269 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:27.260564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-73fcc38a-6bb7-4962-a4d0-222514ecef6c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:27.271081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-73fcc38a-6bb7-4962-a4d0-222514ecef6c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: d524fb40-c835-4a9f-beee-3b638cd73037] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:27.285313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73fcc38a-6bb7-4962-a4d0-222514ecef6c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:27.286064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73fcc38a-6bb7-4962-a4d0-222514ecef6c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:27.287737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73fcc38a-6bb7-4962-a4d0-222514ecef6c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:27.289683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73fcc38a-6bb7-4962-a4d0-222514ecef6c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:27.290988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73fcc38a-6bb7-4962-a4d0-222514ecef6c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:27.292029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73fcc38a-6bb7-4962-a4d0-222514ecef6c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:27.364826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-73fcc38a-6bb7-4962-a4d0-222514ecef6c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: d524fb40-c835-4a9f-beee-3b638cd73037] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:46:27.627762 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-73fcc38a-6bb7-4962-a4d0-222514ecef6c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037" status: 204 len: 0 microversion: 2.1 time: 0.388213 Aug 25 12:46:27.630045 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 579/1148] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:27 2022] DELETE /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:46:27.680292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f17913f-966e-4fa2-8160-b2b950c45597 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:27.681890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3f17913f-966e-4fa2-8160-b2b950c45597 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:27.709321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f17913f-966e-4fa2-8160-b2b950c45597 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:27.710645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f17913f-966e-4fa2-8160-b2b950c45597 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:27.712147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f17913f-966e-4fa2-8160-b2b950c45597 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:27.713856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f17913f-966e-4fa2-8160-b2b950c45597 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:27.714712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f17913f-966e-4fa2-8160-b2b950c45597 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:27.715550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f17913f-966e-4fa2-8160-b2b950c45597 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:27.946936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f17913f-966e-4fa2-8160-b2b950c45597 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:27.979541 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f17913f-966e-4fa2-8160-b2b950c45597 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1298 microversion: 2.1 time: 0.347342 Aug 25 12:46:27.984668 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 580/1149] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:27 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1298 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:28.008642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9598001e-9411-4bbd-8bfc-faf182719efe tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a6c6430>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:28.201854 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9598001e-9411-4bbd-8bfc-faf182719efe tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 0.213142 Aug 25 12:46:28.207158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 581/1150] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:27 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:28.219394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e364247c-ebeb-40fb-9c08-290017c284e5 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:28.316948 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e364247c-ebeb-40fb-9c08-290017c284e5 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/5b5fd978-458b-4555-ac25-baa5e8b8d4e2" status: 202 len: 0 microversion: 2.1 time: 0.106220 Aug 25 12:46:28.323716 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 582/1151] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:28 2022] DELETE /compute/v2.1/flavors/5b5fd978-458b-4555-ac25-baa5e8b8d4e2 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:46:28.338728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-59c24ef9-a521-41da-95a4-f4dc67e921a9 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:28.340995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-59c24ef9-a521-41da-95a4-f4dc67e921a9 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: d524fb40-c835-4a9f-beee-3b638cd73037] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:28.361249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c24ef9-a521-41da-95a4-f4dc67e921a9 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:28.364630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c24ef9-a521-41da-95a4-f4dc67e921a9 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:28.366235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c24ef9-a521-41da-95a4-f4dc67e921a9 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:28.368212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c24ef9-a521-41da-95a4-f4dc67e921a9 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:28.370835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c24ef9-a521-41da-95a4-f4dc67e921a9 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:28.372891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c24ef9-a521-41da-95a4-f4dc67e921a9 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:29.796440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:29.856579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:29.890059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-59c24ef9-a521-41da-95a4-f4dc67e921a9 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:29.917642 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-59c24ef9-a521-41da-95a4-f4dc67e921a9 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037" status: 200 len: 1522 microversion: 2.1 time: 1.591091 Aug 25 12:46:29.924830 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 583/1152] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:28 2022] GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037 => generated 1522 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:29.936830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-924250d1-1f2a-439f-bf21-086a79f6054f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:29.958052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-924250d1-1f2a-439f-bf21-086a79f6054f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:29.994005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-924250d1-1f2a-439f-bf21-086a79f6054f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:29.994897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-924250d1-1f2a-439f-bf21-086a79f6054f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:29.995791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-924250d1-1f2a-439f-bf21-086a79f6054f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:30.000894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-924250d1-1f2a-439f-bf21-086a79f6054f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:30.002526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-924250d1-1f2a-439f-bf21-086a79f6054f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:30.003755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-924250d1-1f2a-439f-bf21-086a79f6054f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:30.517051 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-54d9c78d-552f-4424-a9f2-bc370e32aba7 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.177238 Aug 25 12:46:30.520699 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 570/1153] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 12:46:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:30.530948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-35a01384-db68-46b2-aa75-269c6dc6b138 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:30.588371 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-35a01384-db68-46b2-aa75-269c6dc6b138 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064639 Aug 25 12:46:30.591127 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 571/1154] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:46:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:30.601912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0eaf427-a2e3-4073-8890-0323c3b3f2f4 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:30.604384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b0eaf427-a2e3-4073-8890-0323c3b3f2f4 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:30.635399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0eaf427-a2e3-4073-8890-0323c3b3f2f4 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:30.636630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0eaf427-a2e3-4073-8890-0323c3b3f2f4 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:30.637337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0eaf427-a2e3-4073-8890-0323c3b3f2f4 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:30.638910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0eaf427-a2e3-4073-8890-0323c3b3f2f4 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:30.640687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0eaf427-a2e3-4073-8890-0323c3b3f2f4 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:30.642082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0eaf427-a2e3-4073-8890-0323c3b3f2f4 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:31.862925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-924250d1-1f2a-439f-bf21-086a79f6054f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:31.904102 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-924250d1-1f2a-439f-bf21-086a79f6054f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1311 microversion: 2.1 time: 1.976640 Aug 25 12:46:31.918124 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 584/1155] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:29 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1311 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:31.965042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2d32ef1-d924-4b9f-80bc-b3433ea2792f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a7a33a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:32.047010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:32.118583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b0eaf427-a2e3-4073-8890-0323c3b3f2f4 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:32.136200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:32.146772 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b0eaf427-a2e3-4073-8890-0323c3b3f2f4 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1365 microversion: 2.1 time: 1.553411 Aug 25 12:46:32.148688 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 572/1156] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:30 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1365 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:32.183018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-92a27877-3bbc-4cd3-996a-433986829598 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Calling method '.version_select at 0x7f3a2a465940>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:33.525430 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2d32ef1-d924-4b9f-80bc-b3433ea2792f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 1.604483 Aug 25 12:46:33.535772 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 585/1157] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:31 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:34.182098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:34.198017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:34.248360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:34.253235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:34.256862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:34.263313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:34.265305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:34.270273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:34.419414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:34.438480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Old instance type tempest-test_resize_flavor_-1821891187, new instance type m1.heat {{(pid=129060) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 12:46:34.486300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:46:34.487904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:46:34.489679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:46:34.491981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:46:34.499086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:46:34.790371 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eed6997e-4f56-4ee2-b671-35f0f948c088 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de/action" status: 202 len: 0 microversion: 2.1 time: 1.235481 Aug 25 12:46:34.791396 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 586/1158] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:46:33 2022] POST /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de/action => generated 0 bytes in 1239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:46:34.799787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:34.801691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: d524fb40-c835-4a9f-beee-3b638cd73037] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:34.840804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:34.842194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:34.843298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:34.844986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:34.846644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:34.848185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:35.039961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:35.042373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:35.044125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:35.045731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lazy-loading 'fault' on Instance uuid d524fb40-c835-4a9f-beee-3b638cd73037 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:46:35.286673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:35.329601 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70efcfa2-217e-448a-821d-6fb7ea3b295b tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037" status: 200 len: 1313 microversion: 2.1 time: 0.536289 Aug 25 12:46:35.345904 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 587/1159] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:34 2022] GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037 => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:35.367392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d54c0958-a572-447c-837a-007c4556218b req-fc3a5265-8b40-4dce-ac40-d1a2645865cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8744baf7-d42a-4d3d-8ac3-0f1a36739d16", "tag": "a9b376a9-bd63-44ff-bfa3-b06ca15ece4f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:35.420059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d54c0958-a572-447c-837a-007c4556218b req-fc3a5265-8b40-4dce-ac40-d1a2645865cf service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:35.420938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d54c0958-a572-447c-837a-007c4556218b req-fc3a5265-8b40-4dce-ac40-d1a2645865cf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:35.421823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d54c0958-a572-447c-837a-007c4556218b req-fc3a5265-8b40-4dce-ac40-d1a2645865cf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:35.479735 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d54c0958-a572-447c-837a-007c4556218b req-fc3a5265-8b40-4dce-ac40-d1a2645865cf service nova] Creating event network-changed:a9b376a9-bd63-44ff-bfa3-b06ca15ece4f for instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 on n-h1-852771-8 Aug 25 12:46:35.507145 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d54c0958-a572-447c-837a-007c4556218b req-fc3a5265-8b40-4dce-ac40-d1a2645865cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159315 Aug 25 12:46:35.509807 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 588/1160] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:35.536678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1ea9e405-e906-4dcb-b5b9-16fea4571edc req-fc51e9e2-d879-4535-b194-1ce646d0f74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d524fb40-c835-4a9f-beee-3b638cd73037", "name": "network-vif-unplugged", "status": "completed", "tag": "66d6910d-3fc1-4f06-bf3c-9eb54101d598"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:35.566558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1ea9e405-e906-4dcb-b5b9-16fea4571edc req-fc51e9e2-d879-4535-b194-1ce646d0f74e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:35.567417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1ea9e405-e906-4dcb-b5b9-16fea4571edc req-fc51e9e2-d879-4535-b194-1ce646d0f74e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:35.568465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1ea9e405-e906-4dcb-b5b9-16fea4571edc req-fc51e9e2-d879-4535-b194-1ce646d0f74e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:35.597799 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1ea9e405-e906-4dcb-b5b9-16fea4571edc req-fc51e9e2-d879-4535-b194-1ce646d0f74e service nova] Creating event network-vif-unplugged:66d6910d-3fc1-4f06-bf3c-9eb54101d598 for instance d524fb40-c835-4a9f-beee-3b638cd73037 on n-h2-852771-8 Aug 25 12:46:35.611257 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1ea9e405-e906-4dcb-b5b9-16fea4571edc req-fc51e9e2-d879-4535-b194-1ce646d0f74e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094143 Aug 25 12:46:35.613801 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 589/1161] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:35.625656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e85b4fc0-cc28-4a0e-87bb-0d138524ce4c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:35.628925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e85b4fc0-cc28-4a0e-87bb-0d138524ce4c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:35.645213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e85b4fc0-cc28-4a0e-87bb-0d138524ce4c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:35.646781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e85b4fc0-cc28-4a0e-87bb-0d138524ce4c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:35.648166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e85b4fc0-cc28-4a0e-87bb-0d138524ce4c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:35.649220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e85b4fc0-cc28-4a0e-87bb-0d138524ce4c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:35.651126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e85b4fc0-cc28-4a0e-87bb-0d138524ce4c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:35.652421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e85b4fc0-cc28-4a0e-87bb-0d138524ce4c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:36.394435 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-92a27877-3bbc-4cd3-996a-433986829598 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/782f9020-9432-42c9-94cf-f21142ebf2ff" status: 202 len: 0 microversion: 2.1 time: 4.241343 Aug 25 12:46:36.395802 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 573/1162] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 12:46:32 2022] DELETE /compute/v2.1/os-floating-ips/782f9020-9432-42c9-94cf-f21142ebf2ff => generated 0 bytes in 4246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:46:36.420959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-58bf06d3-8706-4d97-85bf-21bc6c01adbc tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:36.422310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-58bf06d3-8706-4d97-85bf-21bc6c01adbc tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:36.454617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58bf06d3-8706-4d97-85bf-21bc6c01adbc tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:36.455580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58bf06d3-8706-4d97-85bf-21bc6c01adbc tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:36.461284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58bf06d3-8706-4d97-85bf-21bc6c01adbc tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:36.462896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58bf06d3-8706-4d97-85bf-21bc6c01adbc tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:36.463828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58bf06d3-8706-4d97-85bf-21bc6c01adbc tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:36.464695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58bf06d3-8706-4d97-85bf-21bc6c01adbc tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:36.485895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=45 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:36.560197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e85b4fc0-cc28-4a0e-87bb-0d138524ce4c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:36.597591 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e85b4fc0-cc28-4a0e-87bb-0d138524ce4c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1311 microversion: 2.1 time: 0.980999 Aug 25 12:46:36.598640 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 590/1163] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:35 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1311 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:36.691474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d3b68e6b-a440-4ba4-aa9e-3f05f5e33efa tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:36.697701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d3b68e6b-a440-4ba4-aa9e-3f05f5e33efa tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:36.732747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b68e6b-a440-4ba4-aa9e-3f05f5e33efa tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:36.733598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b68e6b-a440-4ba4-aa9e-3f05f5e33efa tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:36.734408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b68e6b-a440-4ba4-aa9e-3f05f5e33efa tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:36.735780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b68e6b-a440-4ba4-aa9e-3f05f5e33efa tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:36.736782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b68e6b-a440-4ba4-aa9e-3f05f5e33efa tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:36.737475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b68e6b-a440-4ba4-aa9e-3f05f5e33efa tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:37.318932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-58bf06d3-8706-4d97-85bf-21bc6c01adbc tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid 18924dfe-fc9e-47d4-b4be-c249990c5455 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:46:37.407010 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-58bf06d3-8706-4d97-85bf-21bc6c01adbc tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 2344 microversion: 2.25 time: 1.002609 Aug 25 12:46:37.413147 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 574/1164] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:46:36 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 2344 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:46:37.427549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d3b68e6b-a440-4ba4-aa9e-3f05f5e33efa tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:37.459849 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d3b68e6b-a440-4ba4-aa9e-3f05f5e33efa tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1365 microversion: 2.1 time: 0.822156 Aug 25 12:46:37.473558 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 591/1165] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:36 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1365 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:37.474509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2a1afa30-b022-44e0-a597-1c84f37ec266 req-5117b7f0-984a-4a7f-a226-37f40b47f81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d524fb40-c835-4a9f-beee-3b638cd73037", "name": "network-vif-deleted", "tag": "66d6910d-3fc1-4f06-bf3c-9eb54101d598"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:37.485727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-51dace15-19b6-44a3-8a97-5f04f8a6e3ce tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2ac11430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:37.498204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a1afa30-b022-44e0-a597-1c84f37ec266 req-5117b7f0-984a-4a7f-a226-37f40b47f81c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:37.499688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a1afa30-b022-44e0-a597-1c84f37ec266 req-5117b7f0-984a-4a7f-a226-37f40b47f81c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:37.500995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a1afa30-b022-44e0-a597-1c84f37ec266 req-5117b7f0-984a-4a7f-a226-37f40b47f81c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:37.539474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:37.563280 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2a1afa30-b022-44e0-a597-1c84f37ec266 req-5117b7f0-984a-4a7f-a226-37f40b47f81c service nova] Creating event network-vif-deleted:66d6910d-3fc1-4f06-bf3c-9eb54101d598 for instance d524fb40-c835-4a9f-beee-3b638cd73037 on n-h2-852771-8 Aug 25 12:46:37.575627 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2a1afa30-b022-44e0-a597-1c84f37ec266 req-5117b7f0-984a-4a7f-a226-37f40b47f81c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109148 Aug 25 12:46:37.577922 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 592/1166] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:37.592686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-933e3c32-19b7-4996-bba0-90c067b2c044 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a5413a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:37.653109 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-51dace15-19b6-44a3-8a97-5f04f8a6e3ce tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b8b3aa55-797f-4a9c-9ed1-61942f435a3b" status: 200 len: 661 microversion: 2.1 time: 0.205770 Aug 25 12:46:37.655751 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 575/1167] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:37 2022] GET /compute/v2.1/images/b8b3aa55-797f-4a9c-9ed1-61942f435a3b => generated 661 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:37.685306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7fbeecd5-d113-4223-975e-231cdbf463c2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:37.694049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7fbeecd5-d113-4223-975e-231cdbf463c2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:37.717500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fbeecd5-d113-4223-975e-231cdbf463c2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:37.718969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fbeecd5-d113-4223-975e-231cdbf463c2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:37.720670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fbeecd5-d113-4223-975e-231cdbf463c2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:37.722756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fbeecd5-d113-4223-975e-231cdbf463c2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:37.724077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fbeecd5-d113-4223-975e-231cdbf463c2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:37.725690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fbeecd5-d113-4223-975e-231cdbf463c2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:37.745018 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-933e3c32-19b7-4996-bba0-90c067b2c044 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 0.163860 Aug 25 12:46:37.747016 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 593/1168] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:37 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:37.758526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:37.760608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: d524fb40-c835-4a9f-beee-3b638cd73037] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:37.777990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:37.780350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:37.781642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:37.784483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:37.785737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:37.786912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:37.824870 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] HTTP exception thrown: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Request method failure captured: Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037 HTTP/1.1 Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB27YHx56U_zE9WKoMp1BtBYiu2I7qyj5x8tHNbmuMgjqiJUZFy1vpPngaY0CAddcDIaijSfEjhbHyjO2QRRzWVBS1YMXJXcUTcVtdcuw1PcZwmkFO64O-FctlSmhiUMbfU__fa8l9QJ9MtP_Sfs6gKj5soZpbvmtmf-vAnF0EJ5ucL8 Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:46:37.830498 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9b53238616049c9ba5ed9107622c14a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}] Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd404aa3c4074752949817aaeee9e560 Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:46:37.833229 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'd524fb40-c835-4a9f-beee-3b638cd73037'} Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:37.836399 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:46:37.842022 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:37.848146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Returning 404 to user: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:37.850409 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-86c199cd-1dcb-44ff-b01f-5d239373d05e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037" status: 404 len: 111 microversion: 2.1 time: 0.100760 Aug 25 12:46:37.854653 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 594/1169] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:37 2022] GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:46:37.864396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7584657-d1ba-4532-85a1-b1b92ad861f5 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Calling method '.version_select at 0x7f3a2a6c6a60>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:37.995374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-a7584657-d1ba-4532-85a1-b1b92ad861f5 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 782f9020-9432-42c9-94cf-f21142ebf2ff could not be found", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:46:37.997306 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a7584657-d1ba-4532-85a1-b1b92ad861f5 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] HTTP exception thrown: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7584657-d1ba-4532-85a1-b1b92ad861f5 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Request method failure captured: Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-floating-ips/782f9020-9432-42c9-94cf-f21142ebf2ff HTTP/1.1 Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB28K13dZ4A1dQH9uR5VFAVWvU0Z44LS6q9yIiQLWObvU3PRx-GUfX0Nw9Uc7ZpbXE_LnWbwXylf-4U-yvbW43qbe6WD3bcjgvfyAYs1iAqNL4H5DA-Nie0w-rhEtGPoLpTgZ_HzjGUVEEixbpCqEoTOirtIEmbKMAzjnj7qRzcbifeg Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 2312c9258c454a08b32d37a278d7b77f Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FloatingIPsTestJSON-1909424203 Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:46:38.007735 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2312c9258c454a08b32d37a278d7b77f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2312c9258c454a08b32d37a278d7b77f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2312c9258c454a08b32d37a278d7b77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2312c9258c454a08b32d37a278d7b77f"}]}] Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FloatingIPsTestJSON-1909424203 Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 2312c9258c454a08b32d37a278d7b77f Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1909424203 Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FloatingIPsTestJSON-1909424203-project Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c1948b9eab20432a94c42088ea9e7d4b Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FloatingIPsTestJSON-1909424203-project Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: exception: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '782f9020-9432-42c9-94cf-f21142ebf2ff'} Aug 25 12:46:38.010576 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:46:38.012505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 782f9020-9432-42c9-94cf-f21142ebf2ff could not be found Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa4d4c20-6db5-4851-96dc-77fdf434e393'] Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff. Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:38.018002 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:38.023329 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:38.030081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff Aug 25 12:46:38.030081 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.031512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7584657-d1ba-4532-85a1-b1b92ad861f5 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Returning 404 to user: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:38.034261 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a7584657-d1ba-4532-85a1-b1b92ad861f5 tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/782f9020-9432-42c9-94cf-f21142ebf2ff" status: 404 len: 111 microversion: 2.1 time: 0.177053 Aug 25 12:46:38.038116 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 595/1170] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:46:37 2022] GET /compute/v2.1/os-floating-ips/782f9020-9432-42c9-94cf-f21142ebf2ff => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:46:38.056613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c77b28d-99be-41ad-b82a-a810f91e6503 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:38.067449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c77b28d-99be-41ad-b82a-a810f91e6503 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:38.069058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c77b28d-99be-41ad-b82a-a810f91e6503 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:38.070542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c77b28d-99be-41ad-b82a-a810f91e6503 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:38.072817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c77b28d-99be-41ad-b82a-a810f91e6503 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:38.074702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c77b28d-99be-41ad-b82a-a810f91e6503 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:38.076078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c77b28d-99be-41ad-b82a-a810f91e6503 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:38.123159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7fbeecd5-d113-4223-975e-231cdbf463c2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:38.137050 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c77b28d-99be-41ad-b82a-a810f91e6503 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.090440 Aug 25 12:46:38.139038 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 596/1171] 10.222.0.70 () {60 vars in 1217 bytes} [Thu Aug 25 12:46:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:46:38.142691 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7fbeecd5-d113-4223-975e-231cdbf463c2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1537 microversion: 2.1 time: 0.484792 Aug 25 12:46:38.157616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cf204bc0-6b0c-40af-b35f-6253ded35fc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:38.157616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cf204bc0-6b0c-40af-b35f-6253ded35fc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:38.159772 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 576/1172] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:37 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1537 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:38.181021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8fa77a0-97c5-402c-bd0c-885da781d5c5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a549820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:38.185816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf204bc0-6b0c-40af-b35f-6253ded35fc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:38.188964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf204bc0-6b0c-40af-b35f-6253ded35fc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:38.216303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf204bc0-6b0c-40af-b35f-6253ded35fc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:38.223432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf204bc0-6b0c-40af-b35f-6253ded35fc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:38.225761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf204bc0-6b0c-40af-b35f-6253ded35fc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:38.235261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf204bc0-6b0c-40af-b35f-6253ded35fc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:38.325666 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8fa77a0-97c5-402c-bd0c-885da781d5c5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b8b3aa55-797f-4a9c-9ed1-61942f435a3b" status: 200 len: 661 microversion: 2.1 time: 0.161956 Aug 25 12:46:38.329204 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 577/1173] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:38 2022] GET /compute/v2.1/images/b8b3aa55-797f-4a9c-9ed1-61942f435a3b => generated 661 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:38.339524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5f088015-8f63-45d2-b600-03f5e1794d2c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:38.364432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5f088015-8f63-45d2-b600-03f5e1794d2c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:38.372703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5f088015-8f63-45d2-b600-03f5e1794d2c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'd9b53238616049c9ba5ed9107622c14a'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:46:38.385225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f088015-8f63-45d2-b600-03f5e1794d2c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:38.387027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f088015-8f63-45d2-b600-03f5e1794d2c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:38.388258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f088015-8f63-45d2-b600-03f5e1794d2c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:38.390019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f088015-8f63-45d2-b600-03f5e1794d2c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:38.391259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f088015-8f63-45d2-b600-03f5e1794d2c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:38.392371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f088015-8f63-45d2-b600-03f5e1794d2c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:38.718345 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5f088015-8f63-45d2-b600-03f5e1794d2c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.386744 Aug 25 12:46:38.719863 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 578/1174] 10.222.0.70 () {58 vars in 1230 bytes} [Thu Aug 25 12:46:38 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:46:38.750999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21ecbf33-e1de-4786-839c-864cb3f4ae5b tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Calling method '.version_select at 0x7f3a2a591790>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:38.876781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-21ecbf33-e1de-4786-839c-864cb3f4ae5b tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 782f9020-9432-42c9-94cf-f21142ebf2ff could not be found", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:46:38.878151 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-21ecbf33-e1de-4786-839c-864cb3f4ae5b tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] HTTP exception thrown: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21ecbf33-e1de-4786-839c-864cb3f4ae5b tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Request method failure captured: Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-floating-ips/782f9020-9432-42c9-94cf-f21142ebf2ff HTTP/1.1 Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB28K13dZ4A1dQH9uR5VFAVWvU0Z44LS6q9yIiQLWObvU3PRx-GUfX0Nw9Uc7ZpbXE_LnWbwXylf-4U-yvbW43qbe6WD3bcjgvfyAYs1iAqNL4H5DA-Nie0w-rhEtGPoLpTgZ_HzjGUVEEixbpCqEoTOirtIEmbKMAzjnj7qRzcbifeg Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 2312c9258c454a08b32d37a278d7b77f Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPsTestJSON-1909424203 Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:46:38.882347 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2312c9258c454a08b32d37a278d7b77f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2312c9258c454a08b32d37a278d7b77f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2312c9258c454a08b32d37a278d7b77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2312c9258c454a08b32d37a278d7b77f"}]}] Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPsTestJSON-1909424203 Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 2312c9258c454a08b32d37a278d7b77f Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1909424203 Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPsTestJSON-1909424203-project Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: c1948b9eab20432a94c42088ea9e7d4b Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPsTestJSON-1909424203-project Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: exception: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '782f9020-9432-42c9-94cf-f21142ebf2ff'} Aug 25 12:46:38.884538 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:46:38.886172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 782f9020-9432-42c9-94cf-f21142ebf2ff could not be found Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29acaa4-0325-4da5-98f8-d48a3773625b'] Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff. Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:38.890396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:38.896948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:38.899583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff Aug 25 12:46:38.899583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.899583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21ecbf33-e1de-4786-839c-864cb3f4ae5b tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] Returning 404 to user: Floating IP not found for ID 782f9020-9432-42c9-94cf-f21142ebf2ff {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:38.899583 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-21ecbf33-e1de-4786-839c-864cb3f4ae5b tempest-FloatingIPsTestJSON-1909424203 tempest-FloatingIPsTestJSON-1909424203-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/782f9020-9432-42c9-94cf-f21142ebf2ff" status: 404 len: 111 microversion: 2.1 time: 0.163671 Aug 25 12:46:38.899583 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 579/1175] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 12:46:38 2022] DELETE /compute/v2.1/os-floating-ips/782f9020-9432-42c9-94cf-f21142ebf2ff => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:46:38.909149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cf204bc0-6b0c-40af-b35f-6253ded35fc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:38.922608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e024d626-830e-49cd-b742-91de47f08b61 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:38.924613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e024d626-830e-49cd-b742-91de47f08b61 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:38.933182 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cf204bc0-6b0c-40af-b35f-6253ded35fc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1311 microversion: 2.1 time: 0.792000 Aug 25 12:46:38.943429 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 597/1176] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:38 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1311 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:38.958030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8fe20551-1df0-493d-97bd-4d230edd8aad tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8fe20551-1df0-493d-97bd-4d230edd8aad tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Request method failure captured: Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB27YHx56U_zE9WKoMp1BtBYiu2I7qyj5x8tHNbmuMgjqiJUZFy1vpPngaY0CAddcDIaijSfEjhbHyjO2QRRzWVBS1YMXJXcUTcVtdcuw1PcZwmkFO64O-FctlSmhiUMbfU__fa8l9QJ9MtP_Sfs6gKj5soZpbvmtmf-vAnF0EJ5ucL8 Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:46:38.967092 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9b53238616049c9ba5ed9107622c14a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}] Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd404aa3c4074752949817aaeee9e560 Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 25 12:46:38.970049 n-d-852771-8 devstack@n-api.service[129060]: action_args: {} Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:38.971738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:38.975354 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:38.978620 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:46:38.978620 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:46:38.978620 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 25 12:46:38.978620 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:38.982122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8fe20551-1df0-493d-97bd-4d230edd8aad tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:38.984172 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8fe20551-1df0-493d-97bd-4d230edd8aad tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.036734 Aug 25 12:46:38.986170 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 598/1177] 10.222.0.70 () {58 vars in 1182 bytes} [Thu Aug 25 12:46:38 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:46:38.994147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e024d626-830e-49cd-b742-91de47f08b61 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:38.998249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9ac6cb6b-2355-4eac-bcb2-955d979f685b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a49cee0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:38.998843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e024d626-830e-49cd-b742-91de47f08b61 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:38.999860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e024d626-830e-49cd-b742-91de47f08b61 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.002092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e024d626-830e-49cd-b742-91de47f08b61 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.005692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e024d626-830e-49cd-b742-91de47f08b61 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.009226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e024d626-830e-49cd-b742-91de47f08b61 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.131519 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9ac6cb6b-2355-4eac-bcb2-955d979f685b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 0.142211 Aug 25 12:46:39.137927 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 599/1178] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:38 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:39.178428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:39.206974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:39.208585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Searching by: {'deleted': False, 'project_id': 'd9b53238616049c9ba5ed9107622c14a'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:46:39.241228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.243204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.247457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.250848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.253251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.256800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.582482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e024d626-830e-49cd-b742-91de47f08b61 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:39.635870 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e024d626-830e-49cd-b742-91de47f08b61 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1365 microversion: 2.1 time: 0.735821 Aug 25 12:46:39.646258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:46:39.660172 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 580/1179] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:38 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1365 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:39.699382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c732e8a-1fce-4ac5-8a52-d970a0f8450b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:39.701570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9c732e8a-1fce-4ac5-8a52-d970a0f8450b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:39.714275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:39.717997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c732e8a-1fce-4ac5-8a52-d970a0f8450b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.719926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c732e8a-1fce-4ac5-8a52-d970a0f8450b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.722396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c732e8a-1fce-4ac5-8a52-d970a0f8450b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.724762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c732e8a-1fce-4ac5-8a52-d970a0f8450b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.726295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c732e8a-1fce-4ac5-8a52-d970a0f8450b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.727552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c732e8a-1fce-4ac5-8a52-d970a0f8450b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:40.028449 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-06739171-cf48-42b2-aa6a-0b83f6a4be23 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.888248 Aug 25 12:46:40.035283 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 600/1180] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 12:46:39 2022] GET /compute/v2.1/servers => generated 683 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:40.059617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1baf3369-d81f-4ecd-8185-a3dfe050dda0 req-978f59fa-410f-4ee2-bcbb-5974dd01f252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8502f6-2eab-49d4-a303-7b9d9304c303", "tag": "23419627-d97d-478d-b65c-05fe9cf12679"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:40.081216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1baf3369-d81f-4ecd-8185-a3dfe050dda0 req-978f59fa-410f-4ee2-bcbb-5974dd01f252 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:40.082456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1baf3369-d81f-4ecd-8185-a3dfe050dda0 req-978f59fa-410f-4ee2-bcbb-5974dd01f252 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:40.083258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1baf3369-d81f-4ecd-8185-a3dfe050dda0 req-978f59fa-410f-4ee2-bcbb-5974dd01f252 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:40.126181 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1baf3369-d81f-4ecd-8185-a3dfe050dda0 req-978f59fa-410f-4ee2-bcbb-5974dd01f252 service nova] Creating event network-changed:23419627-d97d-478d-b65c-05fe9cf12679 for instance 4f8502f6-2eab-49d4-a303-7b9d9304c303 on n-h1-852771-8 Aug 25 12:46:40.147694 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1baf3369-d81f-4ecd-8185-a3dfe050dda0 req-978f59fa-410f-4ee2-bcbb-5974dd01f252 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096921 Aug 25 12:46:40.150290 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 601/1181] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:40.203463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b25466e-190f-466c-94a2-ccd6775621b4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:40.204893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3b25466e-190f-466c-94a2-ccd6775621b4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:40.235433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b25466e-190f-466c-94a2-ccd6775621b4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:40.236779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b25466e-190f-466c-94a2-ccd6775621b4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:40.237853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b25466e-190f-466c-94a2-ccd6775621b4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:40.239199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b25466e-190f-466c-94a2-ccd6775621b4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:40.240108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b25466e-190f-466c-94a2-ccd6775621b4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:40.255883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b25466e-190f-466c-94a2-ccd6775621b4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:41.097841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9c732e8a-1fce-4ac5-8a52-d970a0f8450b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:41.120828 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c732e8a-1fce-4ac5-8a52-d970a0f8450b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1537 microversion: 2.1 time: 1.444778 Aug 25 12:46:41.133861 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 581/1182] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:39 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1537 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:41.163340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:41.175186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:41.176692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.servers [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Removing options 'limit' from query {{(pid=129059) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 25 12:46:41.178568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Searching by: {'deleted': False, 'project_id': 'd9b53238616049c9ba5ed9107622c14a'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:46:41.192111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:41.193422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:41.194531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:41.196630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:41.197878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:41.198988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:41.264269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:46:41.482736 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ae8a52ae-42cf-4607-8c58-f3f60fa052b1 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.329814 Aug 25 12:46:41.484730 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 582/1183] 10.222.0.70 () {58 vars in 1144 bytes} [Thu Aug 25 12:46:41 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:41.500968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19904d5e-9293-4a3f-b0a0-efec9bc60cb3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a549790>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:41.572996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3b25466e-190f-466c-94a2-ccd6775621b4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:41.605424 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3b25466e-190f-466c-94a2-ccd6775621b4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1311 microversion: 2.1 time: 1.438597 Aug 25 12:46:41.614901 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 602/1184] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:40 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1311 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:41.630520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-133316ee-0ee4-4dc7-bd7b-2010d5a2b966 req-aa21b924-52ac-40ef-9ce0-18168583b194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8744baf7-d42a-4d3d-8ac3-0f1a36739d16", "name": "network-vif-plugged", "status": "completed", "tag": "a9b376a9-bd63-44ff-bfa3-b06ca15ece4f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:41.677691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-133316ee-0ee4-4dc7-bd7b-2010d5a2b966 req-aa21b924-52ac-40ef-9ce0-18168583b194 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:41.679106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-133316ee-0ee4-4dc7-bd7b-2010d5a2b966 req-aa21b924-52ac-40ef-9ce0-18168583b194 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:41.680225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-133316ee-0ee4-4dc7-bd7b-2010d5a2b966 req-aa21b924-52ac-40ef-9ce0-18168583b194 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:41.742750 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19904d5e-9293-4a3f-b0a0-efec9bc60cb3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 0.254675 Aug 25 12:46:41.743879 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 583/1185] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:41 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:41.745423 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-133316ee-0ee4-4dc7-bd7b-2010d5a2b966 req-aa21b924-52ac-40ef-9ce0-18168583b194 service nova] Creating event network-vif-plugged:a9b376a9-bd63-44ff-bfa3-b06ca15ece4f for instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 on n-h1-852771-8 Aug 25 12:46:41.755411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4f7edc34-eb7c-4096-91a0-473545c078a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:41.764505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4f7edc34-eb7c-4096-91a0-473545c078a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:41.768373 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-133316ee-0ee4-4dc7-bd7b-2010d5a2b966 req-aa21b924-52ac-40ef-9ce0-18168583b194 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150631 Aug 25 12:46:41.776864 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 603/1186] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:41.792228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f7edc34-eb7c-4096-91a0-473545c078a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:41.796437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b1648806-381a-4387-b797-1411e63160f5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a4e0c10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:41.806703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f7edc34-eb7c-4096-91a0-473545c078a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:41.807565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f7edc34-eb7c-4096-91a0-473545c078a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:41.809803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f7edc34-eb7c-4096-91a0-473545c078a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:41.811119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f7edc34-eb7c-4096-91a0-473545c078a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:41.812271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f7edc34-eb7c-4096-91a0-473545c078a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:41.981318 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b1648806-381a-4387-b797-1411e63160f5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/086c6619-469c-44a9-b986-a901be27a772" status: 200 len: 660 microversion: 2.1 time: 0.190918 Aug 25 12:46:41.989584 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 604/1187] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:41 2022] GET /compute/v2.1/images/086c6619-469c-44a9-b986-a901be27a772 => generated 660 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:42.001609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2bfec0b-1c41-4e11-a8a6-30044b6a33ad tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2bfec0b-1c41-4e11-a8a6-30044b6a33ad tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Request method failure captured: Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB27YHx56U_zE9WKoMp1BtBYiu2I7qyj5x8tHNbmuMgjqiJUZFy1vpPngaY0CAddcDIaijSfEjhbHyjO2QRRzWVBS1YMXJXcUTcVtdcuw1PcZwmkFO64O-FctlSmhiUMbfU__fa8l9QJ9MtP_Sfs6gKj5soZpbvmtmf-vAnF0EJ5ucL8 Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:46:42.027481 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9b53238616049c9ba5ed9107622c14a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}] Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd404aa3c4074752949817aaeee9e560 Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 25 12:46:42.030193 n-d-852771-8 devstack@n-api.service[129060]: action_args: {} Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi '-1' Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:42.031601 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.039058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:42.049258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:42.049258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:42.049258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:46:42.049258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:46:42.049258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 25 12:46:42.049258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.049258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2bfec0b-1c41-4e11-a8a6-30044b6a33ad tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:42.049258 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e2bfec0b-1c41-4e11-a8a6-30044b6a33ad tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.039815 Aug 25 12:46:42.049258 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 605/1188] 10.222.0.70 () {58 vars in 1142 bytes} [Thu Aug 25 12:46:41 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:46:42.051485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9f144cc-626d-4164-a768-4b6214d1d385 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a507820>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:42.169847 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9f144cc-626d-4164-a768-4b6214d1d385 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/086c6619-469c-44a9-b986-a901be27a772" status: 200 len: 660 microversion: 2.1 time: 0.133638 Aug 25 12:46:42.171200 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 606/1189] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:42 2022] GET /compute/v2.1/images/086c6619-469c-44a9-b986-a901be27a772 => generated 660 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:42.200097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d193914a-2d5c-43c8-8a80-ecf523535e1a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d193914a-2d5c-43c8-8a80-ecf523535e1a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Request method failure captured: Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB27YHx56U_zE9WKoMp1BtBYiu2I7qyj5x8tHNbmuMgjqiJUZFy1vpPngaY0CAddcDIaijSfEjhbHyjO2QRRzWVBS1YMXJXcUTcVtdcuw1PcZwmkFO64O-FctlSmhiUMbfU__fa8l9QJ9MtP_Sfs6gKj5soZpbvmtmf-vAnF0EJ5ucL8 Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:46:42.220740 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9b53238616049c9ba5ed9107622c14a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}] Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd404aa3c4074752949817aaeee9e560 Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 25 12:46:42.223396 n-d-852771-8 devstack@n-api.service[129060]: action_args: {} Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'testing' Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:42.224960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.228010 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:42.239219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:42.239219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:42.239219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:46:42.239219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:46:42.239219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 25 12:46:42.239219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:46:42.239219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d193914a-2d5c-43c8-8a80-ecf523535e1a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:42.239219 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d193914a-2d5c-43c8-8a80-ecf523535e1a tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.041622 Aug 25 12:46:42.239219 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 607/1190] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:46:42 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:46:42.255951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75644c7f-9272-4839-88b2-768806f549a5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:42.258344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-75644c7f-9272-4839-88b2-768806f549a5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:42.275791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75644c7f-9272-4839-88b2-768806f549a5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:42.276722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75644c7f-9272-4839-88b2-768806f549a5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:42.277786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75644c7f-9272-4839-88b2-768806f549a5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:42.279601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75644c7f-9272-4839-88b2-768806f549a5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:42.280505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75644c7f-9272-4839-88b2-768806f549a5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:42.281641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75644c7f-9272-4839-88b2-768806f549a5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:43.606466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4f7edc34-eb7c-4096-91a0-473545c078a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:43.630741 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4f7edc34-eb7c-4096-91a0-473545c078a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1365 microversion: 2.1 time: 1.883434 Aug 25 12:46:43.638582 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 584/1191] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:41 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1365 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:43.664004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef177afa-a58b-4574-846a-ea809871e899 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:43.703827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ef177afa-a58b-4574-846a-ea809871e899 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:43.705354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ef177afa-a58b-4574-846a-ea809871e899 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'd9b53238616049c9ba5ed9107622c14a'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:46:43.739451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.servers [None req-ef177afa-a58b-4574-846a-ea809871e899 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Flavor 'non_existing_flavor' could not be found {{(pid=129059) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 25 12:46:43.744647 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef177afa-a58b-4574-846a-ea809871e899 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.103549 Aug 25 12:46:43.754087 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 585/1192] 10.222.0.70 () {58 vars in 1178 bytes} [Thu Aug 25 12:46:43 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:46:43.786326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b49cde04-d1c5-4c7e-ae69-a2c5678d6c66 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:43.787547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b49cde04-d1c5-4c7e-ae69-a2c5678d6c66 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:43.805954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-75644c7f-9272-4839-88b2-768806f549a5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:43.844665 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-75644c7f-9272-4839-88b2-768806f549a5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1537 microversion: 2.1 time: 1.607115 Aug 25 12:46:43.874758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b49cde04-d1c5-4c7e-ae69-a2c5678d6c66 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:43.875790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b49cde04-d1c5-4c7e-ae69-a2c5678d6c66 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:43.877004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b49cde04-d1c5-4c7e-ae69-a2c5678d6c66 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:43.880359 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 608/1193] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:42 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1537 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:43.883372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b49cde04-d1c5-4c7e-ae69-a2c5678d6c66 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:43.884326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b49cde04-d1c5-4c7e-ae69-a2c5678d6c66 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:43.885147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b49cde04-d1c5-4c7e-ae69-a2c5678d6c66 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:43.896776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5613a3dc-f2ea-4557-8513-6b25b67a0d23 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a49c670>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:44.515048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b49cde04-d1c5-4c7e-ae69-a2c5678d6c66 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:44.574528 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b49cde04-d1c5-4c7e-ae69-a2c5678d6c66 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1311 microversion: 2.1 time: 0.814877 Aug 25 12:46:44.581012 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 586/1194] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:43 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1311 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:44.612053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a4b6cbfc-94f2-4d92-b678-a533b8eea27e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:44.635276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a4b6cbfc-94f2-4d92-b678-a533b8eea27e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:44.682119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a4b6cbfc-94f2-4d92-b678-a533b8eea27e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'd9b53238616049c9ba5ed9107622c14a'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:46:44.708151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4b6cbfc-94f2-4d92-b678-a533b8eea27e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:44.714547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4b6cbfc-94f2-4d92-b678-a533b8eea27e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:44.724782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4b6cbfc-94f2-4d92-b678-a533b8eea27e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:44.726471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4b6cbfc-94f2-4d92-b678-a533b8eea27e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:44.727308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4b6cbfc-94f2-4d92-b678-a533b8eea27e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:44.728210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4b6cbfc-94f2-4d92-b678-a533b8eea27e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:44.911270 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5613a3dc-f2ea-4557-8513-6b25b67a0d23 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 1.020546 Aug 25 12:46:44.915749 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 609/1195] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:43 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:44.971917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6985e6bb-d99c-4179-a79c-50d495cbb089 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a507940>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:45.130095 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6985e6bb-d99c-4179-a79c-50d495cbb089 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/5a990369-4bda-4504-8ae6-231cb061ae7f" status: 200 len: 661 microversion: 2.1 time: 0.206961 Aug 25 12:46:45.159279 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 610/1196] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:44 2022] GET /compute/v2.1/images/5a990369-4bda-4504-8ae6-231cb061ae7f => generated 661 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:45.176097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c1da380-ac33-432d-8094-72ccfb026bdc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:45.185852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c1da380-ac33-432d-8094-72ccfb026bdc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:45.234392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c1da380-ac33-432d-8094-72ccfb026bdc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:45.236232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c1da380-ac33-432d-8094-72ccfb026bdc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:45.237567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c1da380-ac33-432d-8094-72ccfb026bdc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:45.242832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c1da380-ac33-432d-8094-72ccfb026bdc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:45.258842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c1da380-ac33-432d-8094-72ccfb026bdc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:45.261990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c1da380-ac33-432d-8094-72ccfb026bdc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:45.811072 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a4b6cbfc-94f2-4d92-b678-a533b8eea27e tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 1.227718 Aug 25 12:46:45.818350 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 587/1197] 10.222.0.70 () {58 vars in 1174 bytes} [Thu Aug 25 12:46:44 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:46:45.852667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7c1da380-ac33-432d-8094-72ccfb026bdc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:45.870728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7a55929e-d944-4a5e-b35a-292df3411e08 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:45.871974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7a55929e-d944-4a5e-b35a-292df3411e08 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:45.904467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a55929e-d944-4a5e-b35a-292df3411e08 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:45.905393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a55929e-d944-4a5e-b35a-292df3411e08 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:45.906218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a55929e-d944-4a5e-b35a-292df3411e08 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:45.907800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a55929e-d944-4a5e-b35a-292df3411e08 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:45.908681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a55929e-d944-4a5e-b35a-292df3411e08 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:45.909476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a55929e-d944-4a5e-b35a-292df3411e08 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:45.962700 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c1da380-ac33-432d-8094-72ccfb026bdc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1365 microversion: 2.1 time: 0.770221 Aug 25 12:46:45.974114 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 611/1198] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:45 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1365 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:46.038260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2bccba4f-ee09-440f-9c45-bf0718447037 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a49c820>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:46.319954 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2bccba4f-ee09-440f-9c45-bf0718447037 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/5a990369-4bda-4504-8ae6-231cb061ae7f" status: 200 len: 661 microversion: 2.1 time: 0.319401 Aug 25 12:46:46.325489 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 612/1199] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:45 2022] GET /compute/v2.1/images/5a990369-4bda-4504-8ae6-231cb061ae7f => generated 661 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:46.355216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ba2c313-f4df-4d4e-84ab-8f3a726548c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:46.359351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3ba2c313-f4df-4d4e-84ab-8f3a726548c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:46.436761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ba2c313-f4df-4d4e-84ab-8f3a726548c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:46.437756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ba2c313-f4df-4d4e-84ab-8f3a726548c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:46.440180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ba2c313-f4df-4d4e-84ab-8f3a726548c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:46.442368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ba2c313-f4df-4d4e-84ab-8f3a726548c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:46.443327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ba2c313-f4df-4d4e-84ab-8f3a726548c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:46.448572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ba2c313-f4df-4d4e-84ab-8f3a726548c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:46.706714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7a55929e-d944-4a5e-b35a-292df3411e08 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:46.762261 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7a55929e-d944-4a5e-b35a-292df3411e08 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1542 microversion: 2.1 time: 0.939090 Aug 25 12:46:46.766594 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 588/1200] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:45 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1542 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:46.796769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c4c84f65-ddc3-4409-8e74-9636efbed887 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:46.826068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c4c84f65-ddc3-4409-8e74-9636efbed887 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:46.831660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c4c84f65-ddc3-4409-8e74-9636efbed887 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'd9b53238616049c9ba5ed9107622c14a'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:46:46.862023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4c84f65-ddc3-4409-8e74-9636efbed887 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:46.868923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4c84f65-ddc3-4409-8e74-9636efbed887 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:46.870234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4c84f65-ddc3-4409-8e74-9636efbed887 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:46.875173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4c84f65-ddc3-4409-8e74-9636efbed887 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:46.878770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4c84f65-ddc3-4409-8e74-9636efbed887 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:46.881575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4c84f65-ddc3-4409-8e74-9636efbed887 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:47.005626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3ba2c313-f4df-4d4e-84ab-8f3a726548c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:47.037962 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3ba2c313-f4df-4d4e-84ab-8f3a726548c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1493 microversion: 2.1 time: 0.708516 Aug 25 12:46:47.044681 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 613/1201] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:46 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1493 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:47.060755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0d56ae80-327f-40cd-a54d-d98919c6d377 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a5b93a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:47.217269 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0d56ae80-327f-40cd-a54d-d98919c6d377 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1411 microversion: 2.1 time: 0.169800 Aug 25 12:46:47.218782 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 614/1202] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:47 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1411 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:47.229354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-124006538", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:47.325719 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c4c84f65-ddc3-4409-8e74-9636efbed887 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.553760 Aug 25 12:46:47.327121 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 589/1203] 10.222.0.70 () {58 vars in 1184 bytes} [Thu Aug 25 12:46:46 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:46:47.345095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-041834b6-10f5-4d53-b581-d827404d4c71 req-dcb182ff-ad4f-406a-924b-edb3af72907a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8502f6-2eab-49d4-a303-7b9d9304c303", "name": "network-vif-plugged", "status": "completed", "tag": "23419627-d97d-478d-b65c-05fe9cf12679"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:47.374933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:46:47.396534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-041834b6-10f5-4d53-b581-d827404d4c71 req-dcb182ff-ad4f-406a-924b-edb3af72907a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:47.397392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-041834b6-10f5-4d53-b581-d827404d4c71 req-dcb182ff-ad4f-406a-924b-edb3af72907a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:47.398258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-041834b6-10f5-4d53-b581-d827404d4c71 req-dcb182ff-ad4f-406a-924b-edb3af72907a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:47.463668 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-041834b6-10f5-4d53-b581-d827404d4c71 req-dcb182ff-ad4f-406a-924b-edb3af72907a service nova] Creating event network-vif-plugged:23419627-d97d-478d-b65c-05fe9cf12679 for instance 4f8502f6-2eab-49d4-a303-7b9d9304c303 on n-h1-852771-8 Aug 25 12:46:47.482507 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-041834b6-10f5-4d53-b581-d827404d4c71 req-dcb182ff-ad4f-406a-924b-edb3af72907a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153106 Aug 25 12:46:47.492232 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 590/1204] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:47.511973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-65bf201f-548e-4f50-bc66-8613e72903fd tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:47.519471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-65bf201f-548e-4f50-bc66-8613e72903fd tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:47.562760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65bf201f-548e-4f50-bc66-8613e72903fd tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:47.563577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65bf201f-548e-4f50-bc66-8613e72903fd tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:47.572721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65bf201f-548e-4f50-bc66-8613e72903fd tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:47.574675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65bf201f-548e-4f50-bc66-8613e72903fd tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:47.575562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65bf201f-548e-4f50-bc66-8613e72903fd tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:47.576363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65bf201f-548e-4f50-bc66-8613e72903fd tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:48.209646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:46:48.213010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:46:48.214104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:46:48.216028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:46:48.220351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:46:48.268626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-65bf201f-548e-4f50-bc66-8613e72903fd tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:48.273080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:48.276671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:48.282399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:48.284227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:48.291316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:48.294908 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-65bf201f-548e-4f50-bc66-8613e72903fd tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1365 microversion: 2.1 time: 0.800598 Aug 25 12:46:48.296469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:48.297417 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 591/1205] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:47 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1365 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:48.423539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Getting quotas for project 8ceae811fb184dba9e2231232124bcd1. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:46:48.433339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:48.452873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Getting quotas for user 884fb1087aae4f87b047879b060d1e21 and project 8ceae811fb184dba9e2231232124bcd1. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:46:48.509649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:46:48.510439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:46:48.795611 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6bb16199-ef9f-4ed7-be9a-fd1038caa222 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574583 Aug 25 12:46:48.797282 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 615/1206] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:46:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:46:48.815012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:48.838364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:48.843522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Searching by: {'deleted': False, 'project_id': 'd9b53238616049c9ba5ed9107622c14a'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:46:48.865058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:48.867157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:48.870259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:48.872885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:48.878764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:48.886641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:48.922163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d0436d2-8728-4a64-ad66-f13ed09fa120 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:48.923793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5d0436d2-8728-4a64-ad66-f13ed09fa120 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:48.959683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0436d2-8728-4a64-ad66-f13ed09fa120 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:48.964269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0436d2-8728-4a64-ad66-f13ed09fa120 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:48.965754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0436d2-8728-4a64-ad66-f13ed09fa120 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:48.967853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0436d2-8728-4a64-ad66-f13ed09fa120 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:48.969282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0436d2-8728-4a64-ad66-f13ed09fa120 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:48.977003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0436d2-8728-4a64-ad66-f13ed09fa120 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:49.030246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:46:49.358677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:49.380623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:49.383220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:49.385612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:49.470040 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5d0436d2-8728-4a64-ad66-f13ed09fa120 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1644 microversion: 2.1 time: 1.168454 Aug 25 12:46:49.482167 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 592/1207] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:48 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1644 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:49.504484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f9121eb4-dec6-4bfb-8f36-a678a9b95692 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:49.505697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f9121eb4-dec6-4bfb-8f36-a678a9b95692 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:49.524680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9121eb4-dec6-4bfb-8f36-a678a9b95692 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:49.525626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9121eb4-dec6-4bfb-8f36-a678a9b95692 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:49.527461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9121eb4-dec6-4bfb-8f36-a678a9b95692 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:49.528071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9121eb4-dec6-4bfb-8f36-a678a9b95692 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:49.529353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9121eb4-dec6-4bfb-8f36-a678a9b95692 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:49.530154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9121eb4-dec6-4bfb-8f36-a678a9b95692 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:49.859932 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6640555d-46ae-4c48-8f43-fde43dc3a2fe tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 1.059250 Aug 25 12:46:49.860938 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 616/1208] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:46:48 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:49.916061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eeacf581-134d-4ec7-b6b8-eb72b636d02e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea7856ef-1ff3-4836-9e5f-e125204aa007", "device": "/dev/xvdb"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:49.941582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eeacf581-134d-4ec7-b6b8-eb72b636d02e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:49.985953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeacf581-134d-4ec7-b6b8-eb72b636d02e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:49.988593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeacf581-134d-4ec7-b6b8-eb72b636d02e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:49.991824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeacf581-134d-4ec7-b6b8-eb72b636d02e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:49.998510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeacf581-134d-4ec7-b6b8-eb72b636d02e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:50.001972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeacf581-134d-4ec7-b6b8-eb72b636d02e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:50.005294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeacf581-134d-4ec7-b6b8-eb72b636d02e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:50.113187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f9121eb4-dec6-4bfb-8f36-a678a9b95692 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:50.168099 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f9121eb4-dec6-4bfb-8f36-a678a9b95692 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1542 microversion: 2.1 time: 0.670528 Aug 25 12:46:50.177117 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 593/1209] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:49 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1542 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:50.190536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b61a65f1-9237-40ed-bc09-d16858552d8e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a549700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:50.360376 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b61a65f1-9237-40ed-bc09-d16858552d8e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1420 microversion: 2.1 time: 0.180140 Aug 25 12:46:50.361991 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 594/1210] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:50 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:50.380454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-212426495", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:50.559793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:46:51.190109 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eeacf581-134d-4ec7-b6b8-eb72b636d02e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "POST /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.308240 Aug 25 12:46:51.202953 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 617/1211] 10.222.0.70 () {62 vars in 1364 bytes} [Thu Aug 25 12:46:49 2022] POST /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments => generated 194 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:46:51.213334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b3f58512-fd6d-43c2-8de1-95ee5aa4cc14 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:51.217428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b3f58512-fd6d-43c2-8de1-95ee5aa4cc14 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:51.235188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:46:51.235188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:46:51.235866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:46:51.236583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:46:51.237331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:46:51.249777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3f58512-fd6d-43c2-8de1-95ee5aa4cc14 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:51.251519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3f58512-fd6d-43c2-8de1-95ee5aa4cc14 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:51.252897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3f58512-fd6d-43c2-8de1-95ee5aa4cc14 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:51.254990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3f58512-fd6d-43c2-8de1-95ee5aa4cc14 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:51.256332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3f58512-fd6d-43c2-8de1-95ee5aa4cc14 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:51.259701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3f58512-fd6d-43c2-8de1-95ee5aa4cc14 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:51.286824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:51.287655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:51.288409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:51.290956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:51.292572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:51.293918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:51.351242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Getting quotas for project 8ceae811fb184dba9e2231232124bcd1. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:46:51.364147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Getting quotas for user 884fb1087aae4f87b047879b060d1e21 and project 8ceae811fb184dba9e2231232124bcd1. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:46:51.420635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:46:51.426773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:46:51.541340 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2851e447-5382-4b06-8bd9-8379483e7719 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176745 Aug 25 12:46:51.543761 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 595/1212] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:46:51.553669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1f2d769a-b576-4dcb-9dd4-b54896aaf063 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:51.556023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1f2d769a-b576-4dcb-9dd4-b54896aaf063 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:51.569850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2d769a-b576-4dcb-9dd4-b54896aaf063 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:51.572107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2d769a-b576-4dcb-9dd4-b54896aaf063 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:51.573466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2d769a-b576-4dcb-9dd4-b54896aaf063 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:51.574976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2d769a-b576-4dcb-9dd4-b54896aaf063 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:51.576013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2d769a-b576-4dcb-9dd4-b54896aaf063 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:51.577089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2d769a-b576-4dcb-9dd4-b54896aaf063 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:51.801785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b3f58512-fd6d-43c2-8de1-95ee5aa4cc14 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:51.840391 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b3f58512-fd6d-43c2-8de1-95ee5aa4cc14 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1555 microversion: 2.1 time: 0.634918 Aug 25 12:46:51.846164 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 618/1213] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:51 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1555 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:51.874733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fdf6e2dc-0c19-4bae-8c9a-0d3f055aeef2 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:51.906221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fdf6e2dc-0c19-4bae-8c9a-0d3f055aeef2 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:51.926181 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fdf6e2dc-0c19-4bae-8c9a-0d3f055aeef2 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.072410 Aug 25 12:46:51.953894 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 619/1214] 10.222.0.70 () {58 vars in 1178 bytes} [Thu Aug 25 12:46:51 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:46:51.991610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efbe090f-0037-4dc4-ae5e-0274d8591dde tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a2f6280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:52.083359 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1f2d769a-b576-4dcb-9dd4-b54896aaf063 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1644 microversion: 2.1 time: 0.536711 Aug 25 12:46:52.094035 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 596/1215] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:51 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1644 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:52.117567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d58cbc7a-420b-4f9f-84ee-c2761818c33c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:52.118819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d58cbc7a-420b-4f9f-84ee-c2761818c33c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:52.148514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d58cbc7a-420b-4f9f-84ee-c2761818c33c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:52.150774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d58cbc7a-420b-4f9f-84ee-c2761818c33c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:52.151608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d58cbc7a-420b-4f9f-84ee-c2761818c33c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:52.155296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d58cbc7a-420b-4f9f-84ee-c2761818c33c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:52.156201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d58cbc7a-420b-4f9f-84ee-c2761818c33c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:52.167087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d58cbc7a-420b-4f9f-84ee-c2761818c33c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:52.211475 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-efbe090f-0037-4dc4-ae5e-0274d8591dde tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 200 len: 1420 microversion: 2.1 time: 0.255041 Aug 25 12:46:52.231476 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 620/1216] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:46:51 2022] GET /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:52.248302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f193754d-4e33-4e74-b665-04de23817643 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:52.250362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f193754d-4e33-4e74-b665-04de23817643 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:52.467510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f193754d-4e33-4e74-b665-04de23817643 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:52.502168 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f193754d-4e33-4e74-b665-04de23817643 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1217 microversion: 2.1 time: 0.267828 Aug 25 12:46:52.512123 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 621/1217] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:52 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1217 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:52.535935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:52.553104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:52.555761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Searching by: {'deleted': False, 'project_id': 'd9b53238616049c9ba5ed9107622c14a'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:46:52.588144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:52.589057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:52.589904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:52.591411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:52.592290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:52.593084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:52.788879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:46:52.899578 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a4e5592-65cc-42c3-91d3-f1e72c178f1c tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.385388 Aug 25 12:46:52.901051 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 622/1218] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 12:46:52 2022] GET /compute/v2.1/servers => generated 683 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:52.918536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5ecf5cbc-7e22-4851-88e1-ecc154041b34 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:52.924164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5ecf5cbc-7e22-4851-88e1-ecc154041b34 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:52.942303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ecf5cbc-7e22-4851-88e1-ecc154041b34 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:52.945818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ecf5cbc-7e22-4851-88e1-ecc154041b34 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:52.947195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ecf5cbc-7e22-4851-88e1-ecc154041b34 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:52.948901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ecf5cbc-7e22-4851-88e1-ecc154041b34 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:52.951061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ecf5cbc-7e22-4851-88e1-ecc154041b34 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:52.954261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ecf5cbc-7e22-4851-88e1-ecc154041b34 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:53.058727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d58cbc7a-420b-4f9f-84ee-c2761818c33c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:53.090799 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d58cbc7a-420b-4f9f-84ee-c2761818c33c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1542 microversion: 2.1 time: 0.994667 Aug 25 12:46:53.092701 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 597/1219] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:52 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1542 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:53.111087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dc0885ee-04c5-4216-bfd1-526d92de5040 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:53.133569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc0885ee-04c5-4216-bfd1-526d92de5040 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:53.133569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc0885ee-04c5-4216-bfd1-526d92de5040 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:53.138585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc0885ee-04c5-4216-bfd1-526d92de5040 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:53.140125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc0885ee-04c5-4216-bfd1-526d92de5040 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:53.141004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc0885ee-04c5-4216-bfd1-526d92de5040 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:53.149931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc0885ee-04c5-4216-bfd1-526d92de5040 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:53.338999 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5ecf5cbc-7e22-4851-88e1-ecc154041b34 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.435764 Aug 25 12:46:53.340333 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 623/1220] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 12:46:52 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-interface => generated 284 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:53.350553 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dc0885ee-04c5-4216-bfd1-526d92de5040 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.245226 Aug 25 12:46:53.352127 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 598/1221] 10.222.0.70 () {58 vars in 1176 bytes} [Thu Aug 25 12:46:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:53.374089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2cf1cc75-76de-42a4-b22b-cc86d44c22eb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a30e040>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:53.401539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:53.402531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: d524fb40-c835-4a9f-beee-3b638cd73037] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:53.441011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:53.443115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:53.447839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:53.451238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:53.455233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:53.458605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:53.523598 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] HTTP exception thrown: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Request method failure captured: Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037 HTTP/1.1 Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB27YHx56U_zE9WKoMp1BtBYiu2I7qyj5x8tHNbmuMgjqiJUZFy1vpPngaY0CAddcDIaijSfEjhbHyjO2QRRzWVBS1YMXJXcUTcVtdcuw1PcZwmkFO64O-FctlSmhiUMbfU__fa8l9QJ9MtP_Sfs6gKj5soZpbvmtmf-vAnF0EJ5ucL8 Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:46:53.529975 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9b53238616049c9ba5ed9107622c14a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}] Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd404aa3c4074752949817aaeee9e560 Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:46:53.532935 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'd524fb40-c835-4a9f-beee-3b638cd73037'} Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:53.535099 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:46:53.538362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:46:53.546015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Returning 404 to user: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:53.548441 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bd46e553-79f6-4b46-bc55-fea69aa3ceca tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037" status: 404 len: 111 microversion: 2.1 time: 0.193537 Aug 25 12:46:53.556376 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 599/1222] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:53 2022] DELETE /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:46:53.575145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852771-8", "block_migration": true, "disk_over_commit": false}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:53.591416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:53.613254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:53.626552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:53.628255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:53.630270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:53.632400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:53.633849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:53.829015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lazy-loading 'flavor' on Instance uuid 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:46:53.916957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:53.941402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Going to try to live migrate instance to n-h2-852771-8 {{(pid=129059) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:46:55.510510 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2cf1cc75-76de-42a4-b22b-cc86d44c22eb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 204 len: 0 microversion: 2.1 time: 2.167951 Aug 25 12:46:55.511988 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 624/1223] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:53 2022] DELETE /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 0 bytes in 2171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:46:55.521529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42eedb5d-286a-4234-9072-08fa73c878da tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:55.535567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42eedb5d-286a-4234-9072-08fa73c878da tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:55.553217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42eedb5d-286a-4234-9072-08fa73c878da tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:55.565790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42eedb5d-286a-4234-9072-08fa73c878da tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:55.566964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42eedb5d-286a-4234-9072-08fa73c878da tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:55.568824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42eedb5d-286a-4234-9072-08fa73c878da tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:55.570787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42eedb5d-286a-4234-9072-08fa73c878da tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:55.572005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42eedb5d-286a-4234-9072-08fa73c878da tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:55.938437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-42eedb5d-286a-4234-9072-08fa73c878da tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:55.973708 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42eedb5d-286a-4234-9072-08fa73c878da tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1277 microversion: 2.1 time: 0.459524 Aug 25 12:46:55.990136 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 625/1224] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:55 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1277 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:56.015846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b92afc94-f4ce-45a0-bfd1-42af55393cb7 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:56.017624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b92afc94-f4ce-45a0-bfd1-42af55393cb7 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 6580b463-1d84-41b9-b153-d64546089c5f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:56.036554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92afc94-f4ce-45a0-bfd1-42af55393cb7 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:56.040195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92afc94-f4ce-45a0-bfd1-42af55393cb7 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:56.042942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92afc94-f4ce-45a0-bfd1-42af55393cb7 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:56.046032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92afc94-f4ce-45a0-bfd1-42af55393cb7 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:56.048850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92afc94-f4ce-45a0-bfd1-42af55393cb7 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:56.050375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92afc94-f4ce-45a0-bfd1-42af55393cb7 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:56.129950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:56.147344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b92afc94-f4ce-45a0-bfd1-42af55393cb7 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 6580b463-1d84-41b9-b153-d64546089c5f] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:46:56.530354 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b92afc94-f4ce-45a0-bfd1-42af55393cb7 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6580b463-1d84-41b9-b153-d64546089c5f" status: 204 len: 0 microversion: 2.1 time: 0.534711 Aug 25 12:46:56.531908 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 626/1225] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:55 2022] DELETE /compute/v2.1/servers/6580b463-1d84-41b9-b153-d64546089c5f => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:46:56.549738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9b0125c8-d05b-47f8-a63b-7ca5b35a571b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:56.551450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9b0125c8-d05b-47f8-a63b-7ca5b35a571b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:56.583036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b0125c8-d05b-47f8-a63b-7ca5b35a571b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:56.584343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b0125c8-d05b-47f8-a63b-7ca5b35a571b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:56.587029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b0125c8-d05b-47f8-a63b-7ca5b35a571b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:56.589541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b0125c8-d05b-47f8-a63b-7ca5b35a571b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:56.590418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b0125c8-d05b-47f8-a63b-7ca5b35a571b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:56.591255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b0125c8-d05b-47f8-a63b-7ca5b35a571b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:57.425997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9b0125c8-d05b-47f8-a63b-7ca5b35a571b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:57.455216 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9b0125c8-d05b-47f8-a63b-7ca5b35a571b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1541 microversion: 2.1 time: 0.920804 Aug 25 12:46:57.474475 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 627/1226] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:56 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1541 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:57.495880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b89462bf-ea35-4f34-805b-7be0c4598dab req-1a4cfc14-a624-463e-aceb-f573d93fa4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305f349d-9b1a-4ad8-996a-e0da7d1cefd2", "name": "network-vif-unplugged", "status": "completed", "tag": "2e9adcd5-fb4f-40dc-8678-e173de267b62"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:57.516867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b89462bf-ea35-4f34-805b-7be0c4598dab req-1a4cfc14-a624-463e-aceb-f573d93fa4fd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:57.518783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b89462bf-ea35-4f34-805b-7be0c4598dab req-1a4cfc14-a624-463e-aceb-f573d93fa4fd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:57.520126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b89462bf-ea35-4f34-805b-7be0c4598dab req-1a4cfc14-a624-463e-aceb-f573d93fa4fd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:57.544860 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b89462bf-ea35-4f34-805b-7be0c4598dab req-1a4cfc14-a624-463e-aceb-f573d93fa4fd service nova] Creating event network-vif-unplugged:2e9adcd5-fb4f-40dc-8678-e173de267b62 for instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 on n-h1-852771-8 Aug 25 12:46:57.559399 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b89462bf-ea35-4f34-805b-7be0c4598dab req-1a4cfc14-a624-463e-aceb-f573d93fa4fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080393 Aug 25 12:46:57.562117 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 628/1227] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:57.575703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5adb862d-73b1-48d1-b6b4-32aa988b9f50 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:57.579231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5adb862d-73b1-48d1-b6b4-32aa988b9f50 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:57.597636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5adb862d-73b1-48d1-b6b4-32aa988b9f50 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:57.599785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5adb862d-73b1-48d1-b6b4-32aa988b9f50 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:57.602646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5adb862d-73b1-48d1-b6b4-32aa988b9f50 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:57.606182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5adb862d-73b1-48d1-b6b4-32aa988b9f50 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:57.607920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5adb862d-73b1-48d1-b6b4-32aa988b9f50 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:57.609270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5adb862d-73b1-48d1-b6b4-32aa988b9f50 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:57.722641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5adb862d-73b1-48d1-b6b4-32aa988b9f50 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:46:58.000471 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5adb862d-73b1-48d1-b6b4-32aa988b9f50 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 204 len: 0 microversion: 2.1 time: 0.433308 Aug 25 12:46:58.003404 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 629/1228] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:57 2022] DELETE /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:46:58.028745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10392564-2556-4830-954e-11d5c900c365 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:58.031199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-10392564-2556-4830-954e-11d5c900c365 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:58.068229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10392564-2556-4830-954e-11d5c900c365 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:58.070979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10392564-2556-4830-954e-11d5c900c365 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:58.076358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10392564-2556-4830-954e-11d5c900c365 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:58.078844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10392564-2556-4830-954e-11d5c900c365 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:58.083532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10392564-2556-4830-954e-11d5c900c365 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:58.085868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10392564-2556-4830-954e-11d5c900c365 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:58.229977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-10392564-2556-4830-954e-11d5c900c365 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:46:58.449779 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6c32b520-9a1d-4959-a630-27d37f16d84a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16/action" status: 202 len: 0 microversion: 2.1 time: 4.890446 Aug 25 12:46:58.451844 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 600/1229] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:46:53 2022] POST /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16/action => generated 0 bytes in 4894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:46:58.468509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02f05f03-59e9-425f-aa19-238cf0b8209e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:58.470728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-02f05f03-59e9-425f-aa19-238cf0b8209e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:58.509437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f05f03-59e9-425f-aa19-238cf0b8209e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:58.510915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f05f03-59e9-425f-aa19-238cf0b8209e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:58.512108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f05f03-59e9-425f-aa19-238cf0b8209e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:58.514967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f05f03-59e9-425f-aa19-238cf0b8209e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:58.516259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f05f03-59e9-425f-aa19-238cf0b8209e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:58.517384 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-10392564-2556-4830-954e-11d5c900c365 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 204 len: 0 microversion: 2.1 time: 0.501246 Aug 25 12:46:58.518047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02f05f03-59e9-425f-aa19-238cf0b8209e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:58.518507 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 630/1230] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:58 2022] DELETE /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:46:58.539260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-916070933", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "94927505-3265-4f82-8562-0d8ecd51bf76"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:58.748367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] validate_networks() for [('94927505-3265-4f82-8562-0d8ecd51bf76', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:46:58.863343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-02f05f03-59e9-425f-aa19-238cf0b8209e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:58.888711 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-02f05f03-59e9-425f-aa19-238cf0b8209e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1275 microversion: 2.1 time: 0.435040 Aug 25 12:46:58.889762 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 601/1231] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:58 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1275 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:58.909413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-976ead59-e50f-46f6-8308-a9ed09625ae9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:58.910548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-976ead59-e50f-46f6-8308-a9ed09625ae9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:58.934918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-976ead59-e50f-46f6-8308-a9ed09625ae9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:58.935828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-976ead59-e50f-46f6-8308-a9ed09625ae9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:58.936647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-976ead59-e50f-46f6-8308-a9ed09625ae9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:58.938066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-976ead59-e50f-46f6-8308-a9ed09625ae9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:58.938927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-976ead59-e50f-46f6-8308-a9ed09625ae9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:58.939672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-976ead59-e50f-46f6-8308-a9ed09625ae9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:59.730870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-976ead59-e50f-46f6-8308-a9ed09625ae9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:59.791037 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-976ead59-e50f-46f6-8308-a9ed09625ae9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 0.899258 Aug 25 12:46:59.796863 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 602/1232] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:58 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:59.826420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ccfb3a33-3f37-430f-af93-97ada3234d42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:59.826420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ccfb3a33-3f37-430f-af93-97ada3234d42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:59.861004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfb3a33-3f37-430f-af93-97ada3234d42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:59.865008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfb3a33-3f37-430f-af93-97ada3234d42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:59.868107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfb3a33-3f37-430f-af93-97ada3234d42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:59.869828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfb3a33-3f37-430f-af93-97ada3234d42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:59.874529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfb3a33-3f37-430f-af93-97ada3234d42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:59.883356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccfb3a33-3f37-430f-af93-97ada3234d42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:00.712549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ccfb3a33-3f37-430f-af93-97ada3234d42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:00.738877 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ccfb3a33-3f37-430f-af93-97ada3234d42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1473 microversion: 2.1 time: 0.938191 Aug 25 12:47:00.755162 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 603/1233] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:59 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1473 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:00.765128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:00.766789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: d524fb40-c835-4a9f-beee-3b638cd73037] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:00.779745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:00.781107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:00.782639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:00.784352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:00.785710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:00.786946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:00.814440 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] HTTP exception thrown: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Request method failure captured: Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037 HTTP/1.1 Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB27YHx56U_zE9WKoMp1BtBYiu2I7qyj5x8tHNbmuMgjqiJUZFy1vpPngaY0CAddcDIaijSfEjhbHyjO2QRRzWVBS1YMXJXcUTcVtdcuw1PcZwmkFO64O-FctlSmhiUMbfU__fa8l9QJ9MtP_Sfs6gKj5soZpbvmtmf-vAnF0EJ5ucL8 Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:47:00.817778 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9b53238616049c9ba5ed9107622c14a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}] Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd404aa3c4074752949817aaeee9e560 Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:47:00.820497 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'd524fb40-c835-4a9f-beee-3b638cd73037'} Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:47:00.822055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. Aug 25 12:47:00.824409 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:00.831260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Returning 404 to user: Instance d524fb40-c835-4a9f-beee-3b638cd73037 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:47:00.837563 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a39405f8-9c84-4b72-b15f-0c6b55467182 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037" status: 404 len: 111 microversion: 2.1 time: 0.073167 Aug 25 12:47:00.837563 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 604/1234] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:00 2022] GET /compute/v2.1/servers/d524fb40-c835-4a9f-beee-3b638cd73037 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:47:00.859129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-108a883e-fb20-400d-8c3b-93eebf5a3ee5 req-1b4161d2-cca4-4089-8fef-f0dde56ea83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3155f7-5f48-47a9-a5a6-6ec064e160de", "name": "network-vif-unplugged", "status": "completed", "tag": "5363dc13-2a91-4fbd-a4fa-f1335cb952e4"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:00.891030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-108a883e-fb20-400d-8c3b-93eebf5a3ee5 req-1b4161d2-cca4-4089-8fef-f0dde56ea83e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:00.892034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-108a883e-fb20-400d-8c3b-93eebf5a3ee5 req-1b4161d2-cca4-4089-8fef-f0dde56ea83e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:00.893835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-108a883e-fb20-400d-8c3b-93eebf5a3ee5 req-1b4161d2-cca4-4089-8fef-f0dde56ea83e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:00.937267 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-108a883e-fb20-400d-8c3b-93eebf5a3ee5 req-1b4161d2-cca4-4089-8fef-f0dde56ea83e service nova] Creating event network-vif-unplugged:5363dc13-2a91-4fbd-a4fa-f1335cb952e4 for instance ca3155f7-5f48-47a9-a5a6-6ec064e160de on n-h2-852771-8 Aug 25 12:47:00.956945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-108a883e-fb20-400d-8c3b-93eebf5a3ee5 req-1b4161d2-cca4-4089-8fef-f0dde56ea83e service nova] Instance ca3155f7-5f48-47a9-a5a6-6ec064e160de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:47:00.981491 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-108a883e-fb20-400d-8c3b-93eebf5a3ee5 req-1b4161d2-cca4-4089-8fef-f0dde56ea83e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142663 Aug 25 12:47:00.989827 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 605/1235] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:01.005578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44f97a7d-8cd6-4e30-9880-118e5e20cad6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:01.007164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44f97a7d-8cd6-4e30-9880-118e5e20cad6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:01.029199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44f97a7d-8cd6-4e30-9880-118e5e20cad6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:01.033652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44f97a7d-8cd6-4e30-9880-118e5e20cad6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:01.034624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44f97a7d-8cd6-4e30-9880-118e5e20cad6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:01.038848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44f97a7d-8cd6-4e30-9880-118e5e20cad6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:01.039763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44f97a7d-8cd6-4e30-9880-118e5e20cad6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:01.040593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44f97a7d-8cd6-4e30-9880-118e5e20cad6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:01.041133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:47:01.043094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:47:01.044626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:47:01.048807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:47:01.053634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:47:01.111624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:01.113606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:01.120122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:01.133484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:01.135840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:01.138633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:01.180355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=11 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:01.207341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Getting quotas for project da51872cc1924bb99ee10d4a28cfb2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:47:01.220429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Getting quotas for user 2db6a11f66554018ba91a5fabb891492 and project da51872cc1924bb99ee10d4a28cfb2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:47:01.251702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:47:01.260490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:47:01.349186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44f97a7d-8cd6-4e30-9880-118e5e20cad6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:01.389306 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44f97a7d-8cd6-4e30-9880-118e5e20cad6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1275 microversion: 2.1 time: 0.396504 Aug 25 12:47:01.406332 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 606/1236] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:00 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1275 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:01.426134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-be8c1487-c619-4a12-b91a-872795ff8f0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:01.427467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-be8c1487-c619-4a12-b91a-872795ff8f0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:01.438016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:01.439058 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f4be0340-61c9-418b-8429-c193a99de073 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.917730 Aug 25 12:47:01.441408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8c1487-c619-4a12-b91a-872795ff8f0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:01.442267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8c1487-c619-4a12-b91a-872795ff8f0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:01.443058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8c1487-c619-4a12-b91a-872795ff8f0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:01.445636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8c1487-c619-4a12-b91a-872795ff8f0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:01.446092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8c1487-c619-4a12-b91a-872795ff8f0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:01.446554 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 631/1237] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:47:01.446733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8c1487-c619-4a12-b91a-872795ff8f0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:01.480418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-96ae4cff-0c04-44df-86dc-ce48cb290920 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:01.486294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-96ae4cff-0c04-44df-86dc-ce48cb290920 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 6580b463-1d84-41b9-b153-d64546089c5f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:01.513036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96ae4cff-0c04-44df-86dc-ce48cb290920 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:01.515175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96ae4cff-0c04-44df-86dc-ce48cb290920 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:01.516023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96ae4cff-0c04-44df-86dc-ce48cb290920 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:01.522866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96ae4cff-0c04-44df-86dc-ce48cb290920 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:01.523785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96ae4cff-0c04-44df-86dc-ce48cb290920 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:01.525167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96ae4cff-0c04-44df-86dc-ce48cb290920 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:01.994804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-be8c1487-c619-4a12-b91a-872795ff8f0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:02.037914 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-be8c1487-c619-4a12-b91a-872795ff8f0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 0.629200 Aug 25 12:47:02.050133 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 607/1238] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:01 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:02.068226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f4659d7c-cec3-4793-929c-81833a5e8929 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:02.078972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f4659d7c-cec3-4793-929c-81833a5e8929 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:02.380034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f4659d7c-cec3-4793-929c-81833a5e8929 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:02.429394 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f4659d7c-cec3-4793-929c-81833a5e8929 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1207 microversion: 2.1 time: 0.376270 Aug 25 12:47:02.435326 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 608/1239] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:02 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1207 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:02.459034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ad12453f-5560-4963-a927-58804a448543 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:02.465132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ad12453f-5560-4963-a927-58804a448543 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:02.501582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad12453f-5560-4963-a927-58804a448543 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:02.505695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad12453f-5560-4963-a927-58804a448543 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:02.508376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad12453f-5560-4963-a927-58804a448543 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:02.512106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad12453f-5560-4963-a927-58804a448543 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:02.516079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad12453f-5560-4963-a927-58804a448543 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:02.520577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad12453f-5560-4963-a927-58804a448543 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:03.193872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=12 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:03.895527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-96ae4cff-0c04-44df-86dc-ce48cb290920 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd404aa3c4074752949817aaeee9e560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b53238616049c9ba5ed9107622c14a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:03.958822 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-96ae4cff-0c04-44df-86dc-ce48cb290920 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/6580b463-1d84-41b9-b153-d64546089c5f" status: 200 len: 1522 microversion: 2.1 time: 2.509862 Aug 25 12:47:03.960553 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 632/1240] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:01 2022] GET /compute/v2.1/servers/6580b463-1d84-41b9-b153-d64546089c5f => generated 1522 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:04.059929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-15cf273c-4741-42db-ab5b-25e9fd8b8919 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:04.060918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-15cf273c-4741-42db-ab5b-25e9fd8b8919 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:04.077914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15cf273c-4741-42db-ab5b-25e9fd8b8919 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:04.079250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15cf273c-4741-42db-ab5b-25e9fd8b8919 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:04.080602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15cf273c-4741-42db-ab5b-25e9fd8b8919 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:04.083281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15cf273c-4741-42db-ab5b-25e9fd8b8919 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:04.086818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15cf273c-4741-42db-ab5b-25e9fd8b8919 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:04.088359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-15cf273c-4741-42db-ab5b-25e9fd8b8919 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:05.572784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-15cf273c-4741-42db-ab5b-25e9fd8b8919 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:05.642427 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-15cf273c-4741-42db-ab5b-25e9fd8b8919 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1275 microversion: 2.1 time: 1.605798 Aug 25 12:47:05.675350 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 633/1241] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:03 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1275 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:05.710704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-75af12de-c3fd-4a4d-a28e-4b51e2985e1b req-7e4de2c3-c7ba-4944-8317-3b199b325687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6580b463-1d84-41b9-b153-d64546089c5f", "name": "network-vif-unplugged", "status": "completed", "tag": "db5e26b9-fe95-4b5d-b561-6b24894513d7"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:05.786059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-75af12de-c3fd-4a4d-a28e-4b51e2985e1b req-7e4de2c3-c7ba-4944-8317-3b199b325687 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:05.788513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-75af12de-c3fd-4a4d-a28e-4b51e2985e1b req-7e4de2c3-c7ba-4944-8317-3b199b325687 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:05.792980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-75af12de-c3fd-4a4d-a28e-4b51e2985e1b req-7e4de2c3-c7ba-4944-8317-3b199b325687 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:05.858613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ad12453f-5560-4963-a927-58804a448543 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:05.872399 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-75af12de-c3fd-4a4d-a28e-4b51e2985e1b req-7e4de2c3-c7ba-4944-8317-3b199b325687 service nova] Creating event network-vif-unplugged:db5e26b9-fe95-4b5d-b561-6b24894513d7 for instance 6580b463-1d84-41b9-b153-d64546089c5f on n-h2-852771-8 Aug 25 12:47:05.895820 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-75af12de-c3fd-4a4d-a28e-4b51e2985e1b req-7e4de2c3-c7ba-4944-8317-3b199b325687 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.217387 Aug 25 12:47:05.900519 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 634/1242] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:05.908504 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ad12453f-5560-4963-a927-58804a448543 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1473 microversion: 2.1 time: 3.469274 Aug 25 12:47:05.913893 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 609/1243] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:02 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1473 bytes in 3478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:05.925069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-67973170-2751-4a3e-87da-407ec6bb3672 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:05.929357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-67973170-2751-4a3e-87da-407ec6bb3672 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:05.952319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8ee9244-1817-42f2-aa89-a1413b9b4e87 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:05.955477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a8ee9244-1817-42f2-aa89-a1413b9b4e87 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:05.962395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67973170-2751-4a3e-87da-407ec6bb3672 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:05.965687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67973170-2751-4a3e-87da-407ec6bb3672 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:05.967475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67973170-2751-4a3e-87da-407ec6bb3672 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:05.971816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67973170-2751-4a3e-87da-407ec6bb3672 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:05.978677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67973170-2751-4a3e-87da-407ec6bb3672 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:05.980318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67973170-2751-4a3e-87da-407ec6bb3672 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:06.008187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8ee9244-1817-42f2-aa89-a1413b9b4e87 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:06.020640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8ee9244-1817-42f2-aa89-a1413b9b4e87 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:06.021590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8ee9244-1817-42f2-aa89-a1413b9b4e87 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:06.024080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8ee9244-1817-42f2-aa89-a1413b9b4e87 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:06.024970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8ee9244-1817-42f2-aa89-a1413b9b4e87 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:06.038134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8ee9244-1817-42f2-aa89-a1413b9b4e87 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:06.668781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a8ee9244-1817-42f2-aa89-a1413b9b4e87 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:06.706966 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a8ee9244-1817-42f2-aa89-a1413b9b4e87 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1277 microversion: 2.1 time: 0.790453 Aug 25 12:47:06.711524 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 610/1244] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:05 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1277 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:06.738435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a8372e57-a1f4-4350-be12-e2231b3414b9 req-7e6d2fba-4d5d-4083-86dc-5d083c4b72e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6580b463-1d84-41b9-b153-d64546089c5f", "name": "network-vif-deleted", "tag": "db5e26b9-fe95-4b5d-b561-6b24894513d7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:06.777583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a8372e57-a1f4-4350-be12-e2231b3414b9 req-7e6d2fba-4d5d-4083-86dc-5d083c4b72e6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:06.789008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a8372e57-a1f4-4350-be12-e2231b3414b9 req-7e6d2fba-4d5d-4083-86dc-5d083c4b72e6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:06.790688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a8372e57-a1f4-4350-be12-e2231b3414b9 req-7e6d2fba-4d5d-4083-86dc-5d083c4b72e6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:06.872228 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a8372e57-a1f4-4350-be12-e2231b3414b9 req-7e6d2fba-4d5d-4083-86dc-5d083c4b72e6 service nova] Creating event network-vif-deleted:db5e26b9-fe95-4b5d-b561-6b24894513d7 for instance 6580b463-1d84-41b9-b153-d64546089c5f on n-h2-852771-8 Aug 25 12:47:06.912564 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a8372e57-a1f4-4350-be12-e2231b3414b9 req-7e6d2fba-4d5d-4083-86dc-5d083c4b72e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187789 Aug 25 12:47:06.912564 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 611/1245] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:06.969779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:06.978343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 6580b463-1d84-41b9-b153-d64546089c5f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:07.010339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:07.014450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:07.015684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:07.022498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:07.024264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:07.028372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:07.093072 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] HTTP exception thrown: Instance 6580b463-1d84-41b9-b153-d64546089c5f could not be found. Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Request method failure captured: Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/6580b463-1d84-41b9-b153-d64546089c5f HTTP/1.1 Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB27YHx56U_zE9WKoMp1BtBYiu2I7qyj5x8tHNbmuMgjqiJUZFy1vpPngaY0CAddcDIaijSfEjhbHyjO2QRRzWVBS1YMXJXcUTcVtdcuw1PcZwmkFO64O-FctlSmhiUMbfU__fa8l9QJ9MtP_Sfs6gKj5soZpbvmtmf-vAnF0EJ5ucL8 Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:47:07.106114 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9b53238616049c9ba5ed9107622c14a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}] Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd404aa3c4074752949817aaeee9e560 Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 6580b463-1d84-41b9-b153-d64546089c5f could not be found. Aug 25 12:47:07.109104 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '6580b463-1d84-41b9-b153-d64546089c5f'} Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6580b463-1d84-41b9-b153-d64546089c5f could not be found. Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:47:07.110850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6580b463-1d84-41b9-b153-d64546089c5f could not be found. Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6580b463-1d84-41b9-b153-d64546089c5f could not be found. Aug 25 12:47:07.113530 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:07.117762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Returning 404 to user: Instance 6580b463-1d84-41b9-b153-d64546089c5f could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:47:07.119744 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa3897ee-630b-4aaf-82ea-f6be12ef532d tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/6580b463-1d84-41b9-b153-d64546089c5f" status: 404 len: 111 microversion: 2.1 time: 0.197812 Aug 25 12:47:07.129893 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 612/1246] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:06 2022] GET /compute/v2.1/servers/6580b463-1d84-41b9-b153-d64546089c5f => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:47:07.367922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-67973170-2751-4a3e-87da-407ec6bb3672 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:07.406086 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-67973170-2751-4a3e-87da-407ec6bb3672 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 1.494174 Aug 25 12:47:07.407789 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 635/1247] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:05 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:07.424952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b727fa6b-6434-440d-a6f4-e673f8ff5e66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:07.431403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b727fa6b-6434-440d-a6f4-e673f8ff5e66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:07.458827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b727fa6b-6434-440d-a6f4-e673f8ff5e66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:07.466670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b727fa6b-6434-440d-a6f4-e673f8ff5e66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:07.467769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b727fa6b-6434-440d-a6f4-e673f8ff5e66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:07.469311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b727fa6b-6434-440d-a6f4-e673f8ff5e66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:07.470459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b727fa6b-6434-440d-a6f4-e673f8ff5e66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:07.475460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b727fa6b-6434-440d-a6f4-e673f8ff5e66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:07.775980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1007234376", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:08.071950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:47:08.409179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b727fa6b-6434-440d-a6f4-e673f8ff5e66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:08.468120 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b727fa6b-6434-440d-a6f4-e673f8ff5e66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1317 microversion: 2.1 time: 1.051557 Aug 25 12:47:08.475333 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 636/1248] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:07 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1317 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:08.493934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9d37eef8-4fa0-45fb-a19c-7655e24c08aa req-d866dbb1-acd3-4fda-bd9f-62a879786e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2714be3e-3fdc-42c0-8b91-775c6adb6ea2", "name": "network-vif-deleted", "tag": "f903dae0-0844-4573-8208-c708b6962e10"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:08.522172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9d37eef8-4fa0-45fb-a19c-7655e24c08aa req-d866dbb1-acd3-4fda-bd9f-62a879786e85 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:08.524495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9d37eef8-4fa0-45fb-a19c-7655e24c08aa req-d866dbb1-acd3-4fda-bd9f-62a879786e85 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:08.526119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9d37eef8-4fa0-45fb-a19c-7655e24c08aa req-d866dbb1-acd3-4fda-bd9f-62a879786e85 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:08.587462 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9d37eef8-4fa0-45fb-a19c-7655e24c08aa req-d866dbb1-acd3-4fda-bd9f-62a879786e85 service nova] Creating event network-vif-deleted:f903dae0-0844-4573-8208-c708b6962e10 for instance 2714be3e-3fdc-42c0-8b91-775c6adb6ea2 on n-h1-852771-8 Aug 25 12:47:08.608387 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9d37eef8-4fa0-45fb-a19c-7655e24c08aa req-d866dbb1-acd3-4fda-bd9f-62a879786e85 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130218 Aug 25 12:47:08.617579 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 637/1249] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:08.641294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-966589c5-e6df-4e12-a4d8-30ce402ebeb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:08.646415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-966589c5-e6df-4e12-a4d8-30ce402ebeb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:08.676648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-966589c5-e6df-4e12-a4d8-30ce402ebeb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:08.677874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-966589c5-e6df-4e12-a4d8-30ce402ebeb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:08.683385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-966589c5-e6df-4e12-a4d8-30ce402ebeb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:08.686809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-966589c5-e6df-4e12-a4d8-30ce402ebeb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:08.691227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-966589c5-e6df-4e12-a4d8-30ce402ebeb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:08.696481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-966589c5-e6df-4e12-a4d8-30ce402ebeb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.191239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:47:09.192082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:47:09.192711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:47:09.193439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:47:09.194871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:47:09.229565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.230434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.231393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.233874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.235366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.236813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.285655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Getting quotas for project 9d4312a6d6044d23a16429fcda142b0e. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:47:09.304985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Getting quotas for user ff2960e821954604ac0d3153d9853a9f and project 9d4312a6d6044d23a16429fcda142b0e. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:47:09.333038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:47:09.338536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:47:09.507322 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dddddd8f-1025-4cff-b2ee-2e9d8978bdb5 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.369474 Aug 25 12:47:09.509276 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 613/1250] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:47:09.535449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:09.538182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] [instance: 2714be3e-3fdc-42c0-8b91-775c6adb6ea2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:09.590377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.593466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.594957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.596923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.598240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.599303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.690785 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] HTTP exception thrown: Instance 2714be3e-3fdc-42c0-8b91-775c6adb6ea2 could not be found. Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Request method failure captured: Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 HTTP/1.1 Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB27YHx56U_zE9WKoMp1BtBYiu2I7qyj5x8tHNbmuMgjqiJUZFy1vpPngaY0CAddcDIaijSfEjhbHyjO2QRRzWVBS1YMXJXcUTcVtdcuw1PcZwmkFO64O-FctlSmhiUMbfU__fa8l9QJ9MtP_Sfs6gKj5soZpbvmtmf-vAnF0EJ5ucL8 Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:47:09.717572 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9b53238616049c9ba5ed9107622c14a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9b53238616049c9ba5ed9107622c14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9b53238616049c9ba5ed9107622c14a"}]}] Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d9b53238616049c9ba5ed9107622c14a Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-840360411 Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd404aa3c4074752949817aaeee9e560 Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ListServersNegativeTestJSON-840360411-project Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 2714be3e-3fdc-42c0-8b91-775c6adb6ea2 could not be found. Aug 25 12:47:09.720607 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '2714be3e-3fdc-42c0-8b91-775c6adb6ea2'} Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2714be3e-3fdc-42c0-8b91-775c6adb6ea2 could not be found. Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:47:09.722756 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2714be3e-3fdc-42c0-8b91-775c6adb6ea2 could not be found. Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2714be3e-3fdc-42c0-8b91-775c6adb6ea2 could not be found. Aug 25 12:47:09.727526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:09.731934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-966589c5-e6df-4e12-a4d8-30ce402ebeb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:09.733972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] Returning 404 to user: Instance 2714be3e-3fdc-42c0-8b91-775c6adb6ea2 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:47:09.735740 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c0e7ddd-1a9a-418f-a347-06a679a51412 tempest-ListServersNegativeTestJSON-840360411 tempest-ListServersNegativeTestJSON-840360411-project] 10.222.0.70 "GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2" status: 404 len: 111 microversion: 2.1 time: 0.223413 Aug 25 12:47:09.746158 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 614/1251] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:09 2022] GET /compute/v2.1/servers/2714be3e-3fdc-42c0-8b91-775c6adb6ea2 => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:47:09.759858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c39233db-4857-4160-b3fa-da593804caf9 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:09.760764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c39233db-4857-4160-b3fa-da593804caf9 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:09.768319 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-966589c5-e6df-4e12-a4d8-30ce402ebeb7 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1470 microversion: 2.1 time: 1.147459 Aug 25 12:47:09.770818 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 638/1252] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:08 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1470 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:09.787063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c39233db-4857-4160-b3fa-da593804caf9 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.790017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-65ad9fa9-7559-4d39-bc4e-0bb077161156 req-3feab50d-3769-4392-9b40-a4795eebf896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2714be3e-3fdc-42c0-8b91-775c6adb6ea2", "name": "network-vif-unplugged", "status": "completed", "tag": "f903dae0-0844-4573-8208-c708b6962e10"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:09.790598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c39233db-4857-4160-b3fa-da593804caf9 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.792692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c39233db-4857-4160-b3fa-da593804caf9 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.795221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c39233db-4857-4160-b3fa-da593804caf9 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.799952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c39233db-4857-4160-b3fa-da593804caf9 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.804137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c39233db-4857-4160-b3fa-da593804caf9 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.822643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-65ad9fa9-7559-4d39-bc4e-0bb077161156 req-3feab50d-3769-4392-9b40-a4795eebf896 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.823490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-65ad9fa9-7559-4d39-bc4e-0bb077161156 req-3feab50d-3769-4392-9b40-a4795eebf896 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.824291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-65ad9fa9-7559-4d39-bc4e-0bb077161156 req-3feab50d-3769-4392-9b40-a4795eebf896 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.868300 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-65ad9fa9-7559-4d39-bc4e-0bb077161156 req-3feab50d-3769-4392-9b40-a4795eebf896 service nova] Creating event network-vif-unplugged:f903dae0-0844-4573-8208-c708b6962e10 for instance 2714be3e-3fdc-42c0-8b91-775c6adb6ea2 on n-h1-852771-8 Aug 25 12:47:09.890705 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-65ad9fa9-7559-4d39-bc4e-0bb077161156 req-3feab50d-3769-4392-9b40-a4795eebf896 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117575 Aug 25 12:47:09.903162 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 639/1253] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:09.914734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-84424742-c393-4047-b31e-7e94ad2522aa tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:09.916118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-84424742-c393-4047-b31e-7e94ad2522aa tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:09.947889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84424742-c393-4047-b31e-7e94ad2522aa tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.947889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84424742-c393-4047-b31e-7e94ad2522aa tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.947889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84424742-c393-4047-b31e-7e94ad2522aa tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.948642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84424742-c393-4047-b31e-7e94ad2522aa tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.949546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84424742-c393-4047-b31e-7e94ad2522aa tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.950353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84424742-c393-4047-b31e-7e94ad2522aa tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:10.277635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c39233db-4857-4160-b3fa-da593804caf9 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:10.323461 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c39233db-4857-4160-b3fa-da593804caf9 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1265 microversion: 2.1 time: 0.575107 Aug 25 12:47:10.332934 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 615/1254] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:09 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1265 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:10.351885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ed6128ca-3a7c-44c2-8627-f9231424ba2e req-8fefb8a5-6f43-4f8f-a838-f4757295ddb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8502f6-2eab-49d4-a303-7b9d9304c303", "tag": "23419627-d97d-478d-b65c-05fe9cf12679"}, {"server_uuid": "305f349d-9b1a-4ad8-996a-e0da7d1cefd2", "name": "network-vif-deleted", "tag": "2e9adcd5-fb4f-40dc-8678-e173de267b62"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:10.385116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:10.407419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ed6128ca-3a7c-44c2-8627-f9231424ba2e req-8fefb8a5-6f43-4f8f-a838-f4757295ddb4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:10.408641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ed6128ca-3a7c-44c2-8627-f9231424ba2e req-8fefb8a5-6f43-4f8f-a838-f4757295ddb4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:10.410883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ed6128ca-3a7c-44c2-8627-f9231424ba2e req-8fefb8a5-6f43-4f8f-a838-f4757295ddb4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:10.447911 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ed6128ca-3a7c-44c2-8627-f9231424ba2e req-8fefb8a5-6f43-4f8f-a838-f4757295ddb4 service nova] Creating event network-changed:23419627-d97d-478d-b65c-05fe9cf12679 for instance 4f8502f6-2eab-49d4-a303-7b9d9304c303 on n-h1-852771-8 Aug 25 12:47:10.449307 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ed6128ca-3a7c-44c2-8627-f9231424ba2e req-8fefb8a5-6f43-4f8f-a838-f4757295ddb4 service nova] Creating event network-vif-deleted:2e9adcd5-fb4f-40dc-8678-e173de267b62 for instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 on n-h1-852771-8 Aug 25 12:47:10.472881 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ed6128ca-3a7c-44c2-8627-f9231424ba2e req-8fefb8a5-6f43-4f8f-a838-f4757295ddb4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.136317 Aug 25 12:47:10.487434 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 616/1255] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:10.498852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-98d2d023-a6a7-41ab-924c-4f652b867b07 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:10.510149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-98d2d023-a6a7-41ab-924c-4f652b867b07 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:10.715275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-98d2d023-a6a7-41ab-924c-4f652b867b07 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:10.757830 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-98d2d023-a6a7-41ab-924c-4f652b867b07 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1217 microversion: 2.1 time: 0.265740 Aug 25 12:47:10.759377 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 617/1256] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:10 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1217 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:10.771419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-262f18d7-ed93-4e63-b82e-4ca0a5a8cff8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:10.775050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-262f18d7-ed93-4e63-b82e-4ca0a5a8cff8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:10.807044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-262f18d7-ed93-4e63-b82e-4ca0a5a8cff8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:10.808299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-262f18d7-ed93-4e63-b82e-4ca0a5a8cff8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:10.810209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-262f18d7-ed93-4e63-b82e-4ca0a5a8cff8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:10.815090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-262f18d7-ed93-4e63-b82e-4ca0a5a8cff8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:10.816842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-262f18d7-ed93-4e63-b82e-4ca0a5a8cff8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:10.820172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-262f18d7-ed93-4e63-b82e-4ca0a5a8cff8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:10.948347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-84424742-c393-4047-b31e-7e94ad2522aa tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:10.970968 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-84424742-c393-4047-b31e-7e94ad2522aa tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 1.065535 Aug 25 12:47:10.972524 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 640/1257] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:09 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:10.984470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:10.987906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:11.015509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.017689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.018610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.020315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.021208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.022282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.116677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:11.190745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.192101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.193192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.194926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.195827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.196901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.198392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:11.241074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=16 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:11.272318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'cores', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:47:11.290918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for user aad1bc68cede45a7b1ab7cbda0d8208e and project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'cores', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:47:11.325097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:11.361304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-262f18d7-ed93-4e63-b82e-4ca0a5a8cff8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:11.432468 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-262f18d7-ed93-4e63-b82e-4ca0a5a8cff8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1317 microversion: 2.1 time: 0.665267 Aug 25 12:47:11.435867 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 618/1258] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:10 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:11.450035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2afbc092-22e0-4a5f-9b9d-70a06c21f822 req-866a82b3-73d4-4005-968e-fe20646dc7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8744baf7-d42a-4d3d-8ac3-0f1a36739d16", "name": "network-vif-unplugged", "status": "completed", "tag": "a9b376a9-bd63-44ff-bfa3-b06ca15ece4f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:11.478210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2afbc092-22e0-4a5f-9b9d-70a06c21f822 req-866a82b3-73d4-4005-968e-fe20646dc7be service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.480783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2afbc092-22e0-4a5f-9b9d-70a06c21f822 req-866a82b3-73d4-4005-968e-fe20646dc7be service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.482401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2afbc092-22e0-4a5f-9b9d-70a06c21f822 req-866a82b3-73d4-4005-968e-fe20646dc7be service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.526099 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2afbc092-22e0-4a5f-9b9d-70a06c21f822 req-866a82b3-73d4-4005-968e-fe20646dc7be service nova] Creating event network-vif-unplugged:a9b376a9-bd63-44ff-bfa3-b06ca15ece4f for instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 on n-h1-852771-8 Aug 25 12:47:11.544272 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2afbc092-22e0-4a5f-9b9d-70a06c21f822 req-866a82b3-73d4-4005-968e-fe20646dc7be service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103795 Aug 25 12:47:11.547039 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 619/1259] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:11.573127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4db95683-0586-4205-8b0a-6f86113a263b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:11.583086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4db95683-0586-4205-8b0a-6f86113a263b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:11.602554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4db95683-0586-4205-8b0a-6f86113a263b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.606788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4db95683-0586-4205-8b0a-6f86113a263b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.608167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4db95683-0586-4205-8b0a-6f86113a263b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.610313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4db95683-0586-4205-8b0a-6f86113a263b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.612488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4db95683-0586-4205-8b0a-6f86113a263b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.613989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4db95683-0586-4205-8b0a-6f86113a263b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.746610 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8bcb19ac-0ecd-4e87-9aca-f8f8871f8ab2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de/action" status: 202 len: 0 microversion: 2.1 time: 0.771172 Aug 25 12:47:11.753414 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 641/1260] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:47:10 2022] POST /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:47:11.781252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad0e80f9-a155-47c8-b843-0ea5a0f67f43 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:11.782898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad0e80f9-a155-47c8-b843-0ea5a0f67f43 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:11.810674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad0e80f9-a155-47c8-b843-0ea5a0f67f43 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.813112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad0e80f9-a155-47c8-b843-0ea5a0f67f43 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.815589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad0e80f9-a155-47c8-b843-0ea5a0f67f43 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.819381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad0e80f9-a155-47c8-b843-0ea5a0f67f43 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.823555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad0e80f9-a155-47c8-b843-0ea5a0f67f43 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.825126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad0e80f9-a155-47c8-b843-0ea5a0f67f43 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.877319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4db95683-0586-4205-8b0a-6f86113a263b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:11.903290 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4db95683-0586-4205-8b0a-6f86113a263b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1265 microversion: 2.1 time: 0.353478 Aug 25 12:47:11.910017 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 620/1261] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:11 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1265 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:11.926392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e18361d-0fc0-4dbe-9b4c-ee199d08d75f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:11.927725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e18361d-0fc0-4dbe-9b4c-ee199d08d75f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:11.955354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e18361d-0fc0-4dbe-9b4c-ee199d08d75f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.956337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e18361d-0fc0-4dbe-9b4c-ee199d08d75f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.956821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e18361d-0fc0-4dbe-9b4c-ee199d08d75f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.958476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e18361d-0fc0-4dbe-9b4c-ee199d08d75f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.959971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e18361d-0fc0-4dbe-9b4c-ee199d08d75f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.960866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e18361d-0fc0-4dbe-9b4c-ee199d08d75f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:12.158391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e18361d-0fc0-4dbe-9b4c-ee199d08d75f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:12.181407 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e18361d-0fc0-4dbe-9b4c-ee199d08d75f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1269 microversion: 2.1 time: 0.269552 Aug 25 12:47:12.183264 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 621/1262] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:11 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1269 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:12.196693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6a2a1916-f403-41b3-a1f2-20102996352b req-97078417-13d9-41e7-a50e-61cf43ef3fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3155f7-5f48-47a9-a5a6-6ec064e160de", "name": "network-vif-plugged", "status": "completed", "tag": "5363dc13-2a91-4fbd-a4fa-f1335cb952e4"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:12.231022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a2a1916-f403-41b3-a1f2-20102996352b req-97078417-13d9-41e7-a50e-61cf43ef3fa8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:12.232571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a2a1916-f403-41b3-a1f2-20102996352b req-97078417-13d9-41e7-a50e-61cf43ef3fa8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:12.233928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a2a1916-f403-41b3-a1f2-20102996352b req-97078417-13d9-41e7-a50e-61cf43ef3fa8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:12.263117 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6a2a1916-f403-41b3-a1f2-20102996352b req-97078417-13d9-41e7-a50e-61cf43ef3fa8 service nova] Creating event network-vif-plugged:5363dc13-2a91-4fbd-a4fa-f1335cb952e4 for instance ca3155f7-5f48-47a9-a5a6-6ec064e160de on n-h2-852771-8 Aug 25 12:47:12.275257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:12.279614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-6a2a1916-f403-41b3-a1f2-20102996352b req-97078417-13d9-41e7-a50e-61cf43ef3fa8 service nova] Instance ca3155f7-5f48-47a9-a5a6-6ec064e160de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:47:12.292659 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6a2a1916-f403-41b3-a1f2-20102996352b req-97078417-13d9-41e7-a50e-61cf43ef3fa8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106797 Aug 25 12:47:12.294342 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 622/1263] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:12.308613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-92c21657-56ba-4208-8cc2-dcf7154e3edd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:12.309890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-92c21657-56ba-4208-8cc2-dcf7154e3edd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:12.324452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c21657-56ba-4208-8cc2-dcf7154e3edd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:12.327258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c21657-56ba-4208-8cc2-dcf7154e3edd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:12.328477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c21657-56ba-4208-8cc2-dcf7154e3edd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:12.330320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c21657-56ba-4208-8cc2-dcf7154e3edd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:12.332982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c21657-56ba-4208-8cc2-dcf7154e3edd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:12.334490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c21657-56ba-4208-8cc2-dcf7154e3edd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:13.542148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ad0e80f9-a155-47c8-b843-0ea5a0f67f43 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:13.560101 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad0e80f9-a155-47c8-b843-0ea5a0f67f43 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1469 microversion: 2.1 time: 1.791323 Aug 25 12:47:13.575384 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 642/1264] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:11 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1469 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:13.596425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8bbe1a86-3ea0-40ac-bd83-296ca37eb74c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:13.598133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8bbe1a86-3ea0-40ac-bd83-296ca37eb74c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:13.610956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bbe1a86-3ea0-40ac-bd83-296ca37eb74c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:13.612097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bbe1a86-3ea0-40ac-bd83-296ca37eb74c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:13.613050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bbe1a86-3ea0-40ac-bd83-296ca37eb74c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:13.614772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bbe1a86-3ea0-40ac-bd83-296ca37eb74c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:13.616337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bbe1a86-3ea0-40ac-bd83-296ca37eb74c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:13.617258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bbe1a86-3ea0-40ac-bd83-296ca37eb74c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:13.978523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-92c21657-56ba-4208-8cc2-dcf7154e3edd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:13.999400 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-92c21657-56ba-4208-8cc2-dcf7154e3edd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 1.701778 Aug 25 12:47:14.000420 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 623/1265] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:12 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:14.012278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-526f6197-9931-4716-945d-e90212282c3b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:14.014819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-526f6197-9931-4716-945d-e90212282c3b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:14.042016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526f6197-9931-4716-945d-e90212282c3b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:14.042841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526f6197-9931-4716-945d-e90212282c3b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:14.043908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526f6197-9931-4716-945d-e90212282c3b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:14.045239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526f6197-9931-4716-945d-e90212282c3b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:14.046160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526f6197-9931-4716-945d-e90212282c3b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:14.046861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526f6197-9931-4716-945d-e90212282c3b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:14.422537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8bbe1a86-3ea0-40ac-bd83-296ca37eb74c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:14.480598 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8bbe1a86-3ea0-40ac-bd83-296ca37eb74c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1317 microversion: 2.1 time: 0.911345 Aug 25 12:47:14.497643 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 643/1266] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:13 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1317 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:14.507172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c43a155a-9b4d-4554-9f0a-dbed0f21a91e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:14.508475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c43a155a-9b4d-4554-9f0a-dbed0f21a91e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:14.525770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c43a155a-9b4d-4554-9f0a-dbed0f21a91e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:14.528322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c43a155a-9b4d-4554-9f0a-dbed0f21a91e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:14.529194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c43a155a-9b4d-4554-9f0a-dbed0f21a91e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:14.530856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c43a155a-9b4d-4554-9f0a-dbed0f21a91e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:14.531761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c43a155a-9b4d-4554-9f0a-dbed0f21a91e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:14.532814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c43a155a-9b4d-4554-9f0a-dbed0f21a91e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:14.673332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-526f6197-9931-4716-945d-e90212282c3b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:14.689852 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-526f6197-9931-4716-945d-e90212282c3b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1307 microversion: 2.1 time: 0.687071 Aug 25 12:47:14.690836 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 624/1267] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:14 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1307 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:14.714754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-bc15da00-a7fa-461f-b56a-74e29b9e0479 req-84a5645d-47d1-499b-8c6e-12a66615f7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01013692-8e62-49a8-81b9-7f7cdd4a5a55", "tag": "73f30782-4779-447f-ba20-d60dfbdf553d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:14.739066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-bc15da00-a7fa-461f-b56a-74e29b9e0479 req-84a5645d-47d1-499b-8c6e-12a66615f7b5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:14.740474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-bc15da00-a7fa-461f-b56a-74e29b9e0479 req-84a5645d-47d1-499b-8c6e-12a66615f7b5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:14.741754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c43a155a-9b4d-4554-9f0a-dbed0f21a91e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:14.742790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-bc15da00-a7fa-461f-b56a-74e29b9e0479 req-84a5645d-47d1-499b-8c6e-12a66615f7b5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:14.764089 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c43a155a-9b4d-4554-9f0a-dbed0f21a91e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1275 microversion: 2.1 time: 0.264296 Aug 25 12:47:14.766028 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 644/1268] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:14 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1275 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:14.767984 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-bc15da00-a7fa-461f-b56a-74e29b9e0479 req-84a5645d-47d1-499b-8c6e-12a66615f7b5 service nova] Creating event network-changed:73f30782-4779-447f-ba20-d60dfbdf553d for instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 on n-h2-852771-8 Aug 25 12:47:14.776849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-759373d0-b66c-4324-9260-93ee321f05d4 req-7ef5d195-4e0f-468f-9f2f-931f9c43a94b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8744baf7-d42a-4d3d-8ac3-0f1a36739d16", "tag": "a9b376a9-bd63-44ff-bfa3-b06ca15ece4f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:14.783064 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-bc15da00-a7fa-461f-b56a-74e29b9e0479 req-84a5645d-47d1-499b-8c6e-12a66615f7b5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089338 Aug 25 12:47:14.784152 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 625/1269] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:14.802169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d5fcc0f3-e0ef-4113-8e05-805d5f13843b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:14.803726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-759373d0-b66c-4324-9260-93ee321f05d4 req-7ef5d195-4e0f-468f-9f2f-931f9c43a94b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:14.804537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-759373d0-b66c-4324-9260-93ee321f05d4 req-7ef5d195-4e0f-468f-9f2f-931f9c43a94b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:14.805261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d5fcc0f3-e0ef-4113-8e05-805d5f13843b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:14.805463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-759373d0-b66c-4324-9260-93ee321f05d4 req-7ef5d195-4e0f-468f-9f2f-931f9c43a94b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:14.821943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5fcc0f3-e0ef-4113-8e05-805d5f13843b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:14.823230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5fcc0f3-e0ef-4113-8e05-805d5f13843b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:14.824266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5fcc0f3-e0ef-4113-8e05-805d5f13843b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:14.826546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5fcc0f3-e0ef-4113-8e05-805d5f13843b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:14.827755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5fcc0f3-e0ef-4113-8e05-805d5f13843b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:14.829164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5fcc0f3-e0ef-4113-8e05-805d5f13843b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:14.830559 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-759373d0-b66c-4324-9260-93ee321f05d4 req-7ef5d195-4e0f-468f-9f2f-931f9c43a94b service nova] Creating event network-changed:a9b376a9-bd63-44ff-bfa3-b06ca15ece4f for instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 on n-h1-852771-8 Aug 25 12:47:14.852907 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-759373d0-b66c-4324-9260-93ee321f05d4 req-7ef5d195-4e0f-468f-9f2f-931f9c43a94b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084575 Aug 25 12:47:14.855024 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 645/1270] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:15.042367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a448a0ad-0b25-4652-9ec7-44cc356ba1df tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:15.044190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a448a0ad-0b25-4652-9ec7-44cc356ba1df tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:15.058331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a448a0ad-0b25-4652-9ec7-44cc356ba1df tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:15.059457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a448a0ad-0b25-4652-9ec7-44cc356ba1df tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:15.059457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a448a0ad-0b25-4652-9ec7-44cc356ba1df tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:15.060976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a448a0ad-0b25-4652-9ec7-44cc356ba1df tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:15.061832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a448a0ad-0b25-4652-9ec7-44cc356ba1df tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:15.063292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a448a0ad-0b25-4652-9ec7-44cc356ba1df tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:15.769825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d5fcc0f3-e0ef-4113-8e05-805d5f13843b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:15.784371 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d5fcc0f3-e0ef-4113-8e05-805d5f13843b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1469 microversion: 2.1 time: 0.993373 Aug 25 12:47:15.786052 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 626/1271] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:14 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1469 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:15.822141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-745f94a9-1770-49a5-a6c9-80e17f10e15c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:15.824027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-745f94a9-1770-49a5-a6c9-80e17f10e15c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:15.840830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-745f94a9-1770-49a5-a6c9-80e17f10e15c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:15.841921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-745f94a9-1770-49a5-a6c9-80e17f10e15c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:15.842927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-745f94a9-1770-49a5-a6c9-80e17f10e15c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:15.844501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-745f94a9-1770-49a5-a6c9-80e17f10e15c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:15.845364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-745f94a9-1770-49a5-a6c9-80e17f10e15c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:15.846119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-745f94a9-1770-49a5-a6c9-80e17f10e15c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:16.217964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a448a0ad-0b25-4652-9ec7-44cc356ba1df tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:16.293049 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a448a0ad-0b25-4652-9ec7-44cc356ba1df tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 1.255302 Aug 25 12:47:16.297077 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 646/1272] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:15 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:16.315478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-186b94ef-c26e-4f64-9b29-4dccc5854139 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:16.317267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-186b94ef-c26e-4f64-9b29-4dccc5854139 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:16.339452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-186b94ef-c26e-4f64-9b29-4dccc5854139 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:16.341204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-186b94ef-c26e-4f64-9b29-4dccc5854139 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:16.342714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-186b94ef-c26e-4f64-9b29-4dccc5854139 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:16.344594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-186b94ef-c26e-4f64-9b29-4dccc5854139 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:16.346241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-186b94ef-c26e-4f64-9b29-4dccc5854139 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:16.348446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-186b94ef-c26e-4f64-9b29-4dccc5854139 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:16.884113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-745f94a9-1770-49a5-a6c9-80e17f10e15c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:16.904677 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-745f94a9-1770-49a5-a6c9-80e17f10e15c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1317 microversion: 2.1 time: 1.102632 Aug 25 12:47:16.906232 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 627/1273] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:15 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1317 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:16.918740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ea81e027-5972-478b-9e81-6b9ff45019ba tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:16.920393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ea81e027-5972-478b-9e81-6b9ff45019ba tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:16.934213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea81e027-5972-478b-9e81-6b9ff45019ba tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:16.935338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea81e027-5972-478b-9e81-6b9ff45019ba tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:16.936329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea81e027-5972-478b-9e81-6b9ff45019ba tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:16.937790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea81e027-5972-478b-9e81-6b9ff45019ba tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:16.940037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea81e027-5972-478b-9e81-6b9ff45019ba tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:16.940037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea81e027-5972-478b-9e81-6b9ff45019ba tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:17.281232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ea81e027-5972-478b-9e81-6b9ff45019ba tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:17.301767 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ea81e027-5972-478b-9e81-6b9ff45019ba tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1275 microversion: 2.1 time: 0.390982 Aug 25 12:47:17.303811 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 628/1274] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:16 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1275 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:17.442286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-186b94ef-c26e-4f64-9b29-4dccc5854139 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:17.467106 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-186b94ef-c26e-4f64-9b29-4dccc5854139 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1307 microversion: 2.1 time: 1.163419 Aug 25 12:47:17.472452 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 647/1275] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:16 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1307 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:17.515938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8013ea19-0602-411e-82da-d4ccd87c60e8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:17.519487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8013ea19-0602-411e-82da-d4ccd87c60e8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:17.537220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8013ea19-0602-411e-82da-d4ccd87c60e8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:17.539880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8013ea19-0602-411e-82da-d4ccd87c60e8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:17.543612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8013ea19-0602-411e-82da-d4ccd87c60e8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:17.545789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8013ea19-0602-411e-82da-d4ccd87c60e8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:17.548926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8013ea19-0602-411e-82da-d4ccd87c60e8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:17.550513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8013ea19-0602-411e-82da-d4ccd87c60e8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:17.678464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0b73a90-a7ef-4423-9763-92afa810e6a9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:17.680569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d0b73a90-a7ef-4423-9763-92afa810e6a9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:17.698785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b73a90-a7ef-4423-9763-92afa810e6a9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:17.700035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b73a90-a7ef-4423-9763-92afa810e6a9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:17.700855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b73a90-a7ef-4423-9763-92afa810e6a9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:17.702213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b73a90-a7ef-4423-9763-92afa810e6a9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:17.702970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b73a90-a7ef-4423-9763-92afa810e6a9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:17.704088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b73a90-a7ef-4423-9763-92afa810e6a9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:19.262294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:19.276072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8013ea19-0602-411e-82da-d4ccd87c60e8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:19.296936 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8013ea19-0602-411e-82da-d4ccd87c60e8 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1469 microversion: 2.1 time: 1.791277 Aug 25 12:47:19.298592 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 648/1276] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:17 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1469 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:19.312131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4905abec-8cc1-447b-81dd-97d3e79d4762 req-e5222341-2f55-4cd0-8f9f-58882beaa405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd7cd1ff-cdb0-439f-803d-62483f38f5b6", "tag": "d6657196-f96f-4269-b16f-0022040bbd1e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:19.332420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4905abec-8cc1-447b-81dd-97d3e79d4762 req-e5222341-2f55-4cd0-8f9f-58882beaa405 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:19.333260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4905abec-8cc1-447b-81dd-97d3e79d4762 req-e5222341-2f55-4cd0-8f9f-58882beaa405 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:19.334304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4905abec-8cc1-447b-81dd-97d3e79d4762 req-e5222341-2f55-4cd0-8f9f-58882beaa405 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:19.339775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-d0b73a90-a7ef-4423-9763-92afa810e6a9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid 18924dfe-fc9e-47d4-b4be-c249990c5455 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:47:19.363616 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4905abec-8cc1-447b-81dd-97d3e79d4762 req-e5222341-2f55-4cd0-8f9f-58882beaa405 service nova] Creating event network-changed:d6657196-f96f-4269-b16f-0022040bbd1e for instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 on n-h2-852771-8 Aug 25 12:47:19.374148 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4905abec-8cc1-447b-81dd-97d3e79d4762 req-e5222341-2f55-4cd0-8f9f-58882beaa405 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072871 Aug 25 12:47:19.375284 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d0b73a90-a7ef-4423-9763-92afa810e6a9 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 2422 microversion: 2.25 time: 2.068567 Aug 25 12:47:19.375673 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 649/1277] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:19.388203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2623c337-4b37-417b-977a-023fbbdb67c8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:19.389315 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 629/1278] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:47:17 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 2422 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:47:19.391162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2623c337-4b37-417b-977a-023fbbdb67c8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:19.418365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f3f235c1-05dd-41b2-8090-f430fa210730 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:19.419986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f3f235c1-05dd-41b2-8090-f430fa210730 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:19.436185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3f235c1-05dd-41b2-8090-f430fa210730 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:19.437759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3f235c1-05dd-41b2-8090-f430fa210730 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:19.439114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3f235c1-05dd-41b2-8090-f430fa210730 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:19.439631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2623c337-4b37-417b-977a-023fbbdb67c8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:19.440662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2623c337-4b37-417b-977a-023fbbdb67c8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:19.442335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2623c337-4b37-417b-977a-023fbbdb67c8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:19.442567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3f235c1-05dd-41b2-8090-f430fa210730 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:19.444015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3f235c1-05dd-41b2-8090-f430fa210730 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:19.445322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3f235c1-05dd-41b2-8090-f430fa210730 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:19.447771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2623c337-4b37-417b-977a-023fbbdb67c8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:19.448859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2623c337-4b37-417b-977a-023fbbdb67c8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:19.450095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2623c337-4b37-417b-977a-023fbbdb67c8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:20.222326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2623c337-4b37-417b-977a-023fbbdb67c8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:20.230215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3f235c1-05dd-41b2-8090-f430fa210730 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:20.239334 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2623c337-4b37-417b-977a-023fbbdb67c8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 0.861194 Aug 25 12:47:20.253554 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 650/1279] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:19 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:20.253886 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f3f235c1-05dd-41b2-8090-f430fa210730 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1317 microversion: 2.1 time: 0.852665 Aug 25 12:47:20.254384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae3fe6fc-454f-4d14-a475-632d7570b063 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:20.269563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ae3fe6fc-454f-4d14-a475-632d7570b063 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:20.269563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae3fe6fc-454f-4d14-a475-632d7570b063 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:20.270264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae3fe6fc-454f-4d14-a475-632d7570b063 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:20.270792 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 630/1280] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:19 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1317 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:20.274398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae3fe6fc-454f-4d14-a475-632d7570b063 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:20.276548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae3fe6fc-454f-4d14-a475-632d7570b063 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:20.277636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae3fe6fc-454f-4d14-a475-632d7570b063 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:20.278788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae3fe6fc-454f-4d14-a475-632d7570b063 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:20.288359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-50c6a4ee-e461-480d-b753-b2d277e22248 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:20.288877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-50c6a4ee-e461-480d-b753-b2d277e22248 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:20.305661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50c6a4ee-e461-480d-b753-b2d277e22248 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:20.306607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50c6a4ee-e461-480d-b753-b2d277e22248 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:20.310305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50c6a4ee-e461-480d-b753-b2d277e22248 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:20.312893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50c6a4ee-e461-480d-b753-b2d277e22248 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:20.314330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50c6a4ee-e461-480d-b753-b2d277e22248 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:20.315564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50c6a4ee-e461-480d-b753-b2d277e22248 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:20.477437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ae3fe6fc-454f-4d14-a475-632d7570b063 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:20.498143 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ae3fe6fc-454f-4d14-a475-632d7570b063 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1275 microversion: 2.1 time: 0.250026 Aug 25 12:47:20.502842 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 651/1281] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:20 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:20.529173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852771-8", "block_migration": "auto"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:20.549267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:20.598523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:20.601275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:20.602494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:20.604052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:20.605311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:20.606504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:20.703720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'flavor' on Instance uuid 18924dfe-fc9e-47d4-b4be-c249990c5455 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:47:20.753931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:20.760591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Going to try to live migrate instance to n-h2-852771-8 {{(pid=129060) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:47:20.910208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-50c6a4ee-e461-480d-b753-b2d277e22248 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:20.949409 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-50c6a4ee-e461-480d-b753-b2d277e22248 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1307 microversion: 2.1 time: 0.668849 Aug 25 12:47:20.954253 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 631/1282] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:20 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1307 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:20.976541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9e403f0f-46d2-4f18-ab4c-635064224227 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:20.981025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9e403f0f-46d2-4f18-ab4c-635064224227 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:21.016883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e403f0f-46d2-4f18-ab4c-635064224227 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:21.018893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e403f0f-46d2-4f18-ab4c-635064224227 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:21.019732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e403f0f-46d2-4f18-ab4c-635064224227 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:21.021128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e403f0f-46d2-4f18-ab4c-635064224227 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:21.022295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e403f0f-46d2-4f18-ab4c-635064224227 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:21.023159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e403f0f-46d2-4f18-ab4c-635064224227 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:21.220664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:21.392756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9e403f0f-46d2-4f18-ab4c-635064224227 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:21.409805 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9e403f0f-46d2-4f18-ab4c-635064224227 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1469 microversion: 2.1 time: 0.450872 Aug 25 12:47:21.427049 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 632/1283] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:20 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1469 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:21.448081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-368d459c-a540-4a1b-bb0b-514adf8ecdcd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:21.449481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-368d459c-a540-4a1b-bb0b-514adf8ecdcd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:21.461132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-368d459c-a540-4a1b-bb0b-514adf8ecdcd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:21.462251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-368d459c-a540-4a1b-bb0b-514adf8ecdcd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:21.462985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-368d459c-a540-4a1b-bb0b-514adf8ecdcd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:21.464259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-368d459c-a540-4a1b-bb0b-514adf8ecdcd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:21.465093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-368d459c-a540-4a1b-bb0b-514adf8ecdcd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:21.466123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-368d459c-a540-4a1b-bb0b-514adf8ecdcd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:21.890474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-368d459c-a540-4a1b-bb0b-514adf8ecdcd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:21.925561 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-368d459c-a540-4a1b-bb0b-514adf8ecdcd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 0.495422 Aug 25 12:47:21.927188 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 633/1284] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:21 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:21.939357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8dfbda6-c8e1-4985-8ec0-fcc66468d91d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:21.941438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a8dfbda6-c8e1-4985-8ec0-fcc66468d91d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:21.958592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8dfbda6-c8e1-4985-8ec0-fcc66468d91d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:21.962683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8dfbda6-c8e1-4985-8ec0-fcc66468d91d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:21.964811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8dfbda6-c8e1-4985-8ec0-fcc66468d91d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:21.967772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8dfbda6-c8e1-4985-8ec0-fcc66468d91d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:21.969328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8dfbda6-c8e1-4985-8ec0-fcc66468d91d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:21.970733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8dfbda6-c8e1-4985-8ec0-fcc66468d91d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:22.697013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a8dfbda6-c8e1-4985-8ec0-fcc66468d91d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:22.739087 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a8dfbda6-c8e1-4985-8ec0-fcc66468d91d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1317 microversion: 2.1 time: 0.809324 Aug 25 12:47:22.740890 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 634/1285] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:21 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:22.760060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-295af9d3-fb2f-454c-a68c-9390a7558ee2 req-3251b5a6-a2b8-465a-a744-fd3a38ade97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7381daf9-37a3-47df-823d-69f8fc28e831", "tag": "a900949c-2275-4a57-b36f-a047eb00804e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:22.789807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-295af9d3-fb2f-454c-a68c-9390a7558ee2 req-3251b5a6-a2b8-465a-a744-fd3a38ade97a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:22.790668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-295af9d3-fb2f-454c-a68c-9390a7558ee2 req-3251b5a6-a2b8-465a-a744-fd3a38ade97a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:22.791147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-295af9d3-fb2f-454c-a68c-9390a7558ee2 req-3251b5a6-a2b8-465a-a744-fd3a38ade97a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:22.830181 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-295af9d3-fb2f-454c-a68c-9390a7558ee2 req-3251b5a6-a2b8-465a-a744-fd3a38ade97a service nova] Creating event network-changed:a900949c-2275-4a57-b36f-a047eb00804e for instance 7381daf9-37a3-47df-823d-69f8fc28e831 on n-h1-852771-8 Aug 25 12:47:22.846580 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-295af9d3-fb2f-454c-a68c-9390a7558ee2 req-3251b5a6-a2b8-465a-a744-fd3a38ade97a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098585 Aug 25 12:47:22.850264 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 635/1286] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:22.863073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-29b6faa0-4dc0-4375-91b7-b1167308d5b9 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:22.864816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-29b6faa0-4dc0-4375-91b7-b1167308d5b9 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:22.881587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b6faa0-4dc0-4375-91b7-b1167308d5b9 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:22.882845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b6faa0-4dc0-4375-91b7-b1167308d5b9 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:22.884018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b6faa0-4dc0-4375-91b7-b1167308d5b9 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:22.885857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b6faa0-4dc0-4375-91b7-b1167308d5b9 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:22.887204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b6faa0-4dc0-4375-91b7-b1167308d5b9 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:22.888403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b6faa0-4dc0-4375-91b7-b1167308d5b9 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:23.631674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-29b6faa0-4dc0-4375-91b7-b1167308d5b9 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:23.686224 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-29b6faa0-4dc0-4375-91b7-b1167308d5b9 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1317 microversion: 2.1 time: 0.827158 Aug 25 12:47:23.689496 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 636/1287] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:22 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1317 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:23.707167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bafae476-5250-4c55-98f0-8483f3f78f8d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:23.711267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bafae476-5250-4c55-98f0-8483f3f78f8d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:23.730913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bafae476-5250-4c55-98f0-8483f3f78f8d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:23.732013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bafae476-5250-4c55-98f0-8483f3f78f8d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:23.732946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bafae476-5250-4c55-98f0-8483f3f78f8d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:23.734677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bafae476-5250-4c55-98f0-8483f3f78f8d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:23.737593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bafae476-5250-4c55-98f0-8483f3f78f8d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:23.738983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bafae476-5250-4c55-98f0-8483f3f78f8d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:24.518124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bafae476-5250-4c55-98f0-8483f3f78f8d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:24.549046 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bafae476-5250-4c55-98f0-8483f3f78f8d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1307 microversion: 2.1 time: 0.855570 Aug 25 12:47:24.557612 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 637/1288] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:23 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1307 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:24.587405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3989f120-24da-48c4-90b8-de2350bd7bfe tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:24.588980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3989f120-24da-48c4-90b8-de2350bd7bfe tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:24.603355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3989f120-24da-48c4-90b8-de2350bd7bfe tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:24.604286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3989f120-24da-48c4-90b8-de2350bd7bfe tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:24.605250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3989f120-24da-48c4-90b8-de2350bd7bfe tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:24.606702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3989f120-24da-48c4-90b8-de2350bd7bfe tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:24.607603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3989f120-24da-48c4-90b8-de2350bd7bfe tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:24.608426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3989f120-24da-48c4-90b8-de2350bd7bfe tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:25.738905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3989f120-24da-48c4-90b8-de2350bd7bfe tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:25.767563 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3989f120-24da-48c4-90b8-de2350bd7bfe tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1469 microversion: 2.1 time: 1.194823 Aug 25 12:47:25.782009 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 638/1289] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:24 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1469 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:25.792348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-be3b1028-0d7a-439e-b177-324b2172d60c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:25.795089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-be3b1028-0d7a-439e-b177-324b2172d60c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:25.825307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be3b1028-0d7a-439e-b177-324b2172d60c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:25.829100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be3b1028-0d7a-439e-b177-324b2172d60c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:25.831956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be3b1028-0d7a-439e-b177-324b2172d60c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:25.836392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be3b1028-0d7a-439e-b177-324b2172d60c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:25.839301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be3b1028-0d7a-439e-b177-324b2172d60c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:25.841927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be3b1028-0d7a-439e-b177-324b2172d60c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:26.670067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-be3b1028-0d7a-439e-b177-324b2172d60c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:26.757559 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-be3b1028-0d7a-439e-b177-324b2172d60c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 0.959170 Aug 25 12:47:26.757559 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 639/1290] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:25 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:26.768121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d7db72cf-e043-402c-b94d-3e5ae9994ec2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:26.776726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d7db72cf-e043-402c-b94d-3e5ae9994ec2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:26.825736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7db72cf-e043-402c-b94d-3e5ae9994ec2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:26.826984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7db72cf-e043-402c-b94d-3e5ae9994ec2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:26.827827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7db72cf-e043-402c-b94d-3e5ae9994ec2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:26.829234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7db72cf-e043-402c-b94d-3e5ae9994ec2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:26.830148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7db72cf-e043-402c-b94d-3e5ae9994ec2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:26.830952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7db72cf-e043-402c-b94d-3e5ae9994ec2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:26.921485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:28.354930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d7db72cf-e043-402c-b94d-3e5ae9994ec2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:28.382873 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d7db72cf-e043-402c-b94d-3e5ae9994ec2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1317 microversion: 2.1 time: 1.635313 Aug 25 12:47:28.387065 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 640/1291] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:26 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1317 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:28.417188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a305f21f-61a6-4ec3-9c46-e295b1c4d154 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:28.419354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a305f21f-61a6-4ec3-9c46-e295b1c4d154 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:28.442146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a305f21f-61a6-4ec3-9c46-e295b1c4d154 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:28.443662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a305f21f-61a6-4ec3-9c46-e295b1c4d154 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:28.444479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a305f21f-61a6-4ec3-9c46-e295b1c4d154 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:28.445849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a305f21f-61a6-4ec3-9c46-e295b1c4d154 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:28.446695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a305f21f-61a6-4ec3-9c46-e295b1c4d154 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:28.447479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a305f21f-61a6-4ec3-9c46-e295b1c4d154 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.067291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a305f21f-61a6-4ec3-9c46-e295b1c4d154 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:29.096268 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a305f21f-61a6-4ec3-9c46-e295b1c4d154 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1317 microversion: 2.1 time: 0.696480 Aug 25 12:47:29.106469 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 641/1292] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:28 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:29.121076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7cdcfcf3-357e-494e-abfa-2f6d281a2f01 req-a7bc89c1-917c-43ef-8421-fab381569378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb0cfcc-71e4-4326-b8d9-dcf129be2a48", "tag": "3e258a14-cb05-447b-b747-9cbe36ed9fc5"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:29.167072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7cdcfcf3-357e-494e-abfa-2f6d281a2f01 req-a7bc89c1-917c-43ef-8421-fab381569378 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:29.176492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7cdcfcf3-357e-494e-abfa-2f6d281a2f01 req-a7bc89c1-917c-43ef-8421-fab381569378 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:29.178546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7cdcfcf3-357e-494e-abfa-2f6d281a2f01 req-a7bc89c1-917c-43ef-8421-fab381569378 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.232502 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7cdcfcf3-357e-494e-abfa-2f6d281a2f01 req-a7bc89c1-917c-43ef-8421-fab381569378 service nova] Creating event network-changed:3e258a14-cb05-447b-b747-9cbe36ed9fc5 for instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 on n-h1-852771-8 Aug 25 12:47:29.246881 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7cdcfcf3-357e-494e-abfa-2f6d281a2f01 req-a7bc89c1-917c-43ef-8421-fab381569378 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137380 Aug 25 12:47:29.254445 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 642/1293] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:29.272011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-09a47fa7-7dcd-4022-be64-ddad282abaf3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:29.282649 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-882c13a4-9175-4fdf-9c3b-0da7b30316a5 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/action" status: 202 len: 0 microversion: 2.25 time: 8.776003 Aug 25 12:47:29.284772 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 652/1294] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 12:47:20 2022] POST /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/action => generated 0 bytes in 8780 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:47:29.293548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-09a47fa7-7dcd-4022-be64-ddad282abaf3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:29.305726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f322db2-94ec-4fb4-aa80-702f5f079468 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:29.307594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f322db2-94ec-4fb4-aa80-702f5f079468 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:29.308480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09a47fa7-7dcd-4022-be64-ddad282abaf3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:29.309759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09a47fa7-7dcd-4022-be64-ddad282abaf3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:29.310885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09a47fa7-7dcd-4022-be64-ddad282abaf3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.312514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09a47fa7-7dcd-4022-be64-ddad282abaf3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:29.313771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09a47fa7-7dcd-4022-be64-ddad282abaf3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:29.324378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09a47fa7-7dcd-4022-be64-ddad282abaf3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.331380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f322db2-94ec-4fb4-aa80-702f5f079468 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:29.332723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f322db2-94ec-4fb4-aa80-702f5f079468 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:29.334830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f322db2-94ec-4fb4-aa80-702f5f079468 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.339424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f322db2-94ec-4fb4-aa80-702f5f079468 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:29.342016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f322db2-94ec-4fb4-aa80-702f5f079468 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:29.345172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f322db2-94ec-4fb4-aa80-702f5f079468 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.819188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f322db2-94ec-4fb4-aa80-702f5f079468 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:29.837418 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f322db2-94ec-4fb4-aa80-702f5f079468 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1535 microversion: 2.1 time: 0.548419 Aug 25 12:47:29.843457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-09a47fa7-7dcd-4022-be64-ddad282abaf3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:29.848150 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 653/1295] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:29 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1535 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:29.859532 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-09a47fa7-7dcd-4022-be64-ddad282abaf3 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1307 microversion: 2.1 time: 0.601625 Aug 25 12:47:29.860374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-623b3cb7-ae97-414a-bd87-c9338335ff73 req-b6b465e1-7d89-4f52-9f0a-68b9a51d915b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01013692-8e62-49a8-81b9-7f7cdd4a5a55", "name": "network-vif-plugged", "status": "completed", "tag": "73f30782-4779-447f-ba20-d60dfbdf553d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:29.860587 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 643/1296] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:29 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1307 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:29.871023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-33d64083-ee62-4053-9494-0c31287d9804 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:29.877865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-33d64083-ee62-4053-9494-0c31287d9804 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:29.886195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d64083-ee62-4053-9494-0c31287d9804 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:29.887121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d64083-ee62-4053-9494-0c31287d9804 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:29.888221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d64083-ee62-4053-9494-0c31287d9804 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.889952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d64083-ee62-4053-9494-0c31287d9804 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:29.891096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d64083-ee62-4053-9494-0c31287d9804 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:29.892193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d64083-ee62-4053-9494-0c31287d9804 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.896074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-623b3cb7-ae97-414a-bd87-c9338335ff73 req-b6b465e1-7d89-4f52-9f0a-68b9a51d915b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:29.897948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-623b3cb7-ae97-414a-bd87-c9338335ff73 req-b6b465e1-7d89-4f52-9f0a-68b9a51d915b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:29.898344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-623b3cb7-ae97-414a-bd87-c9338335ff73 req-b6b465e1-7d89-4f52-9f0a-68b9a51d915b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.923502 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-623b3cb7-ae97-414a-bd87-c9338335ff73 req-b6b465e1-7d89-4f52-9f0a-68b9a51d915b service nova] Creating event network-vif-plugged:73f30782-4779-447f-ba20-d60dfbdf553d for instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 on n-h2-852771-8 Aug 25 12:47:29.933979 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-623b3cb7-ae97-414a-bd87-c9338335ff73 req-b6b465e1-7d89-4f52-9f0a-68b9a51d915b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081809 Aug 25 12:47:29.935509 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 654/1297] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:29.951557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:29.952953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:29.965594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:29.966537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:29.967728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.969572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:29.970492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:29.971253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:29.981197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:30.228557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-33d64083-ee62-4053-9494-0c31287d9804 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:30.246610 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-33d64083-ee62-4053-9494-0c31287d9804 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 0.383994 Aug 25 12:47:30.248628 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 644/1298] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:29 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:30.260262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f1af6b8f-9911-4ce8-a630-3ea89c4c84a1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:30.262002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f1af6b8f-9911-4ce8-a630-3ea89c4c84a1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:30.275053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1af6b8f-9911-4ce8-a630-3ea89c4c84a1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:30.276497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1af6b8f-9911-4ce8-a630-3ea89c4c84a1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:30.277725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1af6b8f-9911-4ce8-a630-3ea89c4c84a1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:30.277939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:30.280016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1af6b8f-9911-4ce8-a630-3ea89c4c84a1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:30.281304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1af6b8f-9911-4ce8-a630-3ea89c4c84a1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:30.282828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1af6b8f-9911-4ce8-a630-3ea89c4c84a1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:30.291170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:30.294868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:30.296800 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-251292e0-85f2-48dd-b239-c4a36c8f19a3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.354365 Aug 25 12:47:30.297744 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 655/1299] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:47:29 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:47:30.308902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8539e65a-9909-4f80-b138-be40aed5da71 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:30.310822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8539e65a-9909-4f80-b138-be40aed5da71 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:30.336756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8539e65a-9909-4f80-b138-be40aed5da71 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:30.339036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8539e65a-9909-4f80-b138-be40aed5da71 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:30.340356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8539e65a-9909-4f80-b138-be40aed5da71 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:30.342189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8539e65a-9909-4f80-b138-be40aed5da71 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:30.343093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8539e65a-9909-4f80-b138-be40aed5da71 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:30.344439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8539e65a-9909-4f80-b138-be40aed5da71 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:30.717245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f1af6b8f-9911-4ce8-a630-3ea89c4c84a1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:30.734553 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f1af6b8f-9911-4ce8-a630-3ea89c4c84a1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1317 microversion: 2.1 time: 0.482756 Aug 25 12:47:30.736349 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 645/1300] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:30 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:30.753742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8539e65a-9909-4f80-b138-be40aed5da71 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:30.772493 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8539e65a-9909-4f80-b138-be40aed5da71 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1317 microversion: 2.1 time: 0.471376 Aug 25 12:47:30.773978 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 656/1301] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:30 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:30.892925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2a8ccf94-9f7f-4480-aad5-e1922169ca99 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:30.894008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a8ccf94-9f7f-4480-aad5-e1922169ca99 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:30.901698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7fb5694d-5bdf-4e72-bdc9-34cdec0b3247 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:30.902932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7fb5694d-5bdf-4e72-bdc9-34cdec0b3247 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:30.906468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8ccf94-9f7f-4480-aad5-e1922169ca99 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:30.907666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8ccf94-9f7f-4480-aad5-e1922169ca99 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:30.908486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8ccf94-9f7f-4480-aad5-e1922169ca99 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:30.910485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8ccf94-9f7f-4480-aad5-e1922169ca99 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:30.912314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8ccf94-9f7f-4480-aad5-e1922169ca99 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:30.913352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8ccf94-9f7f-4480-aad5-e1922169ca99 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:30.916337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb5694d-5bdf-4e72-bdc9-34cdec0b3247 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:30.917663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb5694d-5bdf-4e72-bdc9-34cdec0b3247 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:30.918790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb5694d-5bdf-4e72-bdc9-34cdec0b3247 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:30.920363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb5694d-5bdf-4e72-bdc9-34cdec0b3247 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:30.921216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb5694d-5bdf-4e72-bdc9-34cdec0b3247 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:30.922292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb5694d-5bdf-4e72-bdc9-34cdec0b3247 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:31.387367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7fb5694d-5bdf-4e72-bdc9-34cdec0b3247 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:31.394078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2a8ccf94-9f7f-4480-aad5-e1922169ca99 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:31.435061 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7fb5694d-5bdf-4e72-bdc9-34cdec0b3247 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1307 microversion: 2.1 time: 0.542291 Aug 25 12:47:31.436260 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2a8ccf94-9f7f-4480-aad5-e1922169ca99 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1535 microversion: 2.1 time: 0.553715 Aug 25 12:47:31.438539 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 657/1302] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:30 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1307 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:47:31.440070 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 646/1303] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:30 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1535 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:31.451586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70a2f5ea-56ef-44f1-a78e-3c32aaed43e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:31.452948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70a2f5ea-56ef-44f1-a78e-3c32aaed43e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:31.483289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:31.484364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:31.484881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a2f5ea-56ef-44f1-a78e-3c32aaed43e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:31.486307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a2f5ea-56ef-44f1-a78e-3c32aaed43e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:31.488760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a2f5ea-56ef-44f1-a78e-3c32aaed43e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:31.490817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a2f5ea-56ef-44f1-a78e-3c32aaed43e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:31.492573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a2f5ea-56ef-44f1-a78e-3c32aaed43e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:31.493469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a2f5ea-56ef-44f1-a78e-3c32aaed43e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:31.515514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:31.516259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:31.516946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:31.518162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:31.529955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:31.530660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:32.115626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70a2f5ea-56ef-44f1-a78e-3c32aaed43e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:32.135517 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70a2f5ea-56ef-44f1-a78e-3c32aaed43e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1503 microversion: 2.1 time: 0.694024 Aug 25 12:47:32.137871 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 658/1304] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:31 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1503 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:32.146831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:32.167079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cae61a3a-20ad-486d-8201-abb17734468c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:32.175276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cae61a3a-20ad-486d-8201-abb17734468c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:32.176061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:32.182211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:32.184327 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5c31feca-5ad5-4c41-a0bc-09810f7b0031 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.728402 Aug 25 12:47:32.189153 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 647/1305] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:47:31 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:47:32.189675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae61a3a-20ad-486d-8201-abb17734468c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:32.190580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae61a3a-20ad-486d-8201-abb17734468c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:32.191404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae61a3a-20ad-486d-8201-abb17734468c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:32.192822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae61a3a-20ad-486d-8201-abb17734468c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:32.193713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae61a3a-20ad-486d-8201-abb17734468c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:32.194929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae61a3a-20ad-486d-8201-abb17734468c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:32.201025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a78ef808-2912-4038-80a9-53ea4a4f0bae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:32.207648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a78ef808-2912-4038-80a9-53ea4a4f0bae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:32.233879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a78ef808-2912-4038-80a9-53ea4a4f0bae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:32.234989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a78ef808-2912-4038-80a9-53ea4a4f0bae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:32.235900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a78ef808-2912-4038-80a9-53ea4a4f0bae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:32.237460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a78ef808-2912-4038-80a9-53ea4a4f0bae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:32.238538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a78ef808-2912-4038-80a9-53ea4a4f0bae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:32.239388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a78ef808-2912-4038-80a9-53ea4a4f0bae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:32.925998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cae61a3a-20ad-486d-8201-abb17734468c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:32.951751 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cae61a3a-20ad-486d-8201-abb17734468c tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1317 microversion: 2.1 time: 0.810262 Aug 25 12:47:32.953231 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 659/1306] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:32 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1317 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:32.967333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0a9a06db-c26b-4685-a3f4-1f1d4cda6b8d req-5ace802b-fe61-4ef4-ac09-7e1613a0e4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3155f7-5f48-47a9-a5a6-6ec064e160de", "name": "network-vif-unplugged", "status": "completed", "tag": "5363dc13-2a91-4fbd-a4fa-f1335cb952e4"}, {"server_uuid": "7381daf9-37a3-47df-823d-69f8fc28e831", "name": "network-vif-plugged", "status": "completed", "tag": "a900949c-2275-4a57-b36f-a047eb00804e"}, {"server_uuid": "fd7cd1ff-cdb0-439f-803d-62483f38f5b6", "name": "network-vif-plugged", "status": "completed", "tag": "d6657196-f96f-4269-b16f-0022040bbd1e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:33.003003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0a9a06db-c26b-4685-a3f4-1f1d4cda6b8d req-5ace802b-fe61-4ef4-ac09-7e1613a0e4a9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:33.005040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0a9a06db-c26b-4685-a3f4-1f1d4cda6b8d req-5ace802b-fe61-4ef4-ac09-7e1613a0e4a9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:33.008955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0a9a06db-c26b-4685-a3f4-1f1d4cda6b8d req-5ace802b-fe61-4ef4-ac09-7e1613a0e4a9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:33.058455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a78ef808-2912-4038-80a9-53ea4a4f0bae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:33.062133 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0a9a06db-c26b-4685-a3f4-1f1d4cda6b8d req-5ace802b-fe61-4ef4-ac09-7e1613a0e4a9 service nova] Creating event network-vif-unplugged:5363dc13-2a91-4fbd-a4fa-f1335cb952e4 for instance ca3155f7-5f48-47a9-a5a6-6ec064e160de on n-h2-852771-8 Aug 25 12:47:33.063545 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0a9a06db-c26b-4685-a3f4-1f1d4cda6b8d req-5ace802b-fe61-4ef4-ac09-7e1613a0e4a9 service nova] Creating event network-vif-plugged:a900949c-2275-4a57-b36f-a047eb00804e for instance 7381daf9-37a3-47df-823d-69f8fc28e831 on n-h1-852771-8 Aug 25 12:47:33.064415 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0a9a06db-c26b-4685-a3f4-1f1d4cda6b8d req-5ace802b-fe61-4ef4-ac09-7e1613a0e4a9 service nova] Creating event network-vif-plugged:d6657196-f96f-4269-b16f-0022040bbd1e for instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 on n-h2-852771-8 Aug 25 12:47:33.081258 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a78ef808-2912-4038-80a9-53ea4a4f0bae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1317 microversion: 2.1 time: 0.892908 Aug 25 12:47:33.101983 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 648/1307] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:32 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1317 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:33.103778 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0a9a06db-c26b-4685-a3f4-1f1d4cda6b8d req-5ace802b-fe61-4ef4-ac09-7e1613a0e4a9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.147317 Aug 25 12:47:33.118506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-67d660f4-d198-4cf2-b5ac-b9ec89357c22 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:33.119673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-67d660f4-d198-4cf2-b5ac-b9ec89357c22 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:33.122574 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 660/1308] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:33.159984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d660f4-d198-4cf2-b5ac-b9ec89357c22 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:33.160944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d660f4-d198-4cf2-b5ac-b9ec89357c22 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:33.163598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d660f4-d198-4cf2-b5ac-b9ec89357c22 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:33.177995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d660f4-d198-4cf2-b5ac-b9ec89357c22 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:33.184416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d660f4-d198-4cf2-b5ac-b9ec89357c22 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:33.185568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d660f4-d198-4cf2-b5ac-b9ec89357c22 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:33.203606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12c43020-efc2-4f88-925a-d33c240d5b93 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:33.204989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12c43020-efc2-4f88-925a-d33c240d5b93 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:33.250442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c43020-efc2-4f88-925a-d33c240d5b93 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:33.252440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c43020-efc2-4f88-925a-d33c240d5b93 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:33.254834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c43020-efc2-4f88-925a-d33c240d5b93 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:33.259591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c43020-efc2-4f88-925a-d33c240d5b93 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:33.261003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c43020-efc2-4f88-925a-d33c240d5b93 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:33.263579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c43020-efc2-4f88-925a-d33c240d5b93 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:33.949270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-67d660f4-d198-4cf2-b5ac-b9ec89357c22 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:33.966616 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-67d660f4-d198-4cf2-b5ac-b9ec89357c22 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1528 microversion: 2.1 time: 0.862177 Aug 25 12:47:33.978621 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 649/1309] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:33 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1528 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:34.008913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-017631e1-5afd-4d9e-9fe6-4d408b841d03 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:34.010652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-017631e1-5afd-4d9e-9fe6-4d408b841d03 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:34.024847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017631e1-5afd-4d9e-9fe6-4d408b841d03 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:34.026607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017631e1-5afd-4d9e-9fe6-4d408b841d03 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:34.031302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12c43020-efc2-4f88-925a-d33c240d5b93 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:34.035125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017631e1-5afd-4d9e-9fe6-4d408b841d03 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:34.036129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017631e1-5afd-4d9e-9fe6-4d408b841d03 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:34.037605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017631e1-5afd-4d9e-9fe6-4d408b841d03 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:34.038406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017631e1-5afd-4d9e-9fe6-4d408b841d03 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:34.080112 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12c43020-efc2-4f88-925a-d33c240d5b93 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1307 microversion: 2.1 time: 0.948866 Aug 25 12:47:34.081581 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 661/1310] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:33 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1307 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:34.146588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:34.149833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:34.176138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:34.177121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:34.178300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:34.179391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:34.180291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:34.182205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:34.553933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-017631e1-5afd-4d9e-9fe6-4d408b841d03 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:34.587443 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-017631e1-5afd-4d9e-9fe6-4d408b841d03 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1493 microversion: 2.1 time: 0.585812 Aug 25 12:47:34.589062 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 650/1311] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:33 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1493 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:34.602230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1cb82e0f-35c9-46f1-8e18-8e691ae41cc4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:34.603508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1cb82e0f-35c9-46f1-8e18-8e691ae41cc4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:34.622202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cb82e0f-35c9-46f1-8e18-8e691ae41cc4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:34.623104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cb82e0f-35c9-46f1-8e18-8e691ae41cc4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:34.624360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cb82e0f-35c9-46f1-8e18-8e691ae41cc4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:34.642301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cb82e0f-35c9-46f1-8e18-8e691ae41cc4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:34.643339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cb82e0f-35c9-46f1-8e18-8e691ae41cc4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:34.644173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cb82e0f-35c9-46f1-8e18-8e691ae41cc4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:34.730931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:34.762823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:34.768746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:34.773341 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c1b8b1b5-db5f-47b5-b927-afc957c15217 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.642115 Aug 25 12:47:34.776679 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 662/1312] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:47:34 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:47:34.791324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-baa3064f-10ca-4180-a8d1-647ee5edccfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:34.793076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-baa3064f-10ca-4180-a8d1-647ee5edccfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:34.810822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa3064f-10ca-4180-a8d1-647ee5edccfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:34.813272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa3064f-10ca-4180-a8d1-647ee5edccfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:34.817274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa3064f-10ca-4180-a8d1-647ee5edccfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:34.820604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa3064f-10ca-4180-a8d1-647ee5edccfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:34.823011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa3064f-10ca-4180-a8d1-647ee5edccfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:34.825470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa3064f-10ca-4180-a8d1-647ee5edccfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:35.134553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1cb82e0f-35c9-46f1-8e18-8e691ae41cc4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:35.151325 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1cb82e0f-35c9-46f1-8e18-8e691ae41cc4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1317 microversion: 2.1 time: 0.559398 Aug 25 12:47:35.152785 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 651/1313] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:34 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:35.163795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-53355f81-e8e7-411c-9e00-cae5fffbc277 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:35.166169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-53355f81-e8e7-411c-9e00-cae5fffbc277 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:35.181152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53355f81-e8e7-411c-9e00-cae5fffbc277 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:35.182473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53355f81-e8e7-411c-9e00-cae5fffbc277 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:35.183549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53355f81-e8e7-411c-9e00-cae5fffbc277 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:35.185177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53355f81-e8e7-411c-9e00-cae5fffbc277 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:35.186326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53355f81-e8e7-411c-9e00-cae5fffbc277 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:35.187366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53355f81-e8e7-411c-9e00-cae5fffbc277 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:35.333070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-baa3064f-10ca-4180-a8d1-647ee5edccfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:35.364116 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-baa3064f-10ca-4180-a8d1-647ee5edccfb tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1528 microversion: 2.1 time: 0.584544 Aug 25 12:47:35.390083 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 663/1314] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:34 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1528 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:35.404444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c08a85ba-6410-4c15-b099-df65469ca0a3 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '.version_select at 0x7f3a2a3608b0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:35.423224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c08a85ba-6410-4c15-b099-df65469ca0a3 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:35.424473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c08a85ba-6410-4c15-b099-df65469ca0a3 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:35.433484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c08a85ba-6410-4c15-b099-df65469ca0a3 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:35.496403 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c08a85ba-6410-4c15-b099-df65469ca0a3 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 2725 microversion: 2.1 time: 0.103600 Aug 25 12:47:35.514168 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 664/1315] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:47:35 2022] GET /compute/v2.1/os-migrations => generated 2725 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:35.547824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f120ffc1-4e1e-4d28-998b-e799eb1d5b6a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:35.556933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f120ffc1-4e1e-4d28-998b-e799eb1d5b6a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:35.600611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f120ffc1-4e1e-4d28-998b-e799eb1d5b6a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:35.604620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f120ffc1-4e1e-4d28-998b-e799eb1d5b6a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:35.610420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f120ffc1-4e1e-4d28-998b-e799eb1d5b6a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:35.619018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f120ffc1-4e1e-4d28-998b-e799eb1d5b6a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:35.620619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f120ffc1-4e1e-4d28-998b-e799eb1d5b6a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:35.625455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f120ffc1-4e1e-4d28-998b-e799eb1d5b6a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:35.762433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-53355f81-e8e7-411c-9e00-cae5fffbc277 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:35.813154 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-53355f81-e8e7-411c-9e00-cae5fffbc277 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1317 microversion: 2.1 time: 0.653036 Aug 25 12:47:35.815270 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 652/1316] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:35 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:36.214551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f120ffc1-4e1e-4d28-998b-e799eb1d5b6a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:36.243364 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f120ffc1-4e1e-4d28-998b-e799eb1d5b6a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1307 microversion: 2.1 time: 0.726935 Aug 25 12:47:36.244491 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 665/1317] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:35 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1307 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:36.256522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-800b5cc4-9f95-4856-9565-a224a48580e1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:36.257709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-800b5cc4-9f95-4856-9565-a224a48580e1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:36.284823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-800b5cc4-9f95-4856-9565-a224a48580e1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:36.285756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-800b5cc4-9f95-4856-9565-a224a48580e1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:36.286799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-800b5cc4-9f95-4856-9565-a224a48580e1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:36.288213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-800b5cc4-9f95-4856-9565-a224a48580e1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:36.289158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-800b5cc4-9f95-4856-9565-a224a48580e1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:36.296327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-800b5cc4-9f95-4856-9565-a224a48580e1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:36.525121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dbab7645-3ccb-4c68-bc61-2cb1e0f633ae tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:36.540327 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-dbab7645-3ccb-4c68-bc61-2cb1e0f633ae tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] HTTP exception thrown: Flavor 5b5fd978-458b-4555-ac25-baa5e8b8d4e2 could not be found. Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dbab7645-3ccb-4c68-bc61-2cb1e0f633ae tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Request method failure captured: Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/flavors/5b5fd978-458b-4555-ac25-baa5e8b8d4e2 HTTP/1.1 Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB235P920x2Hu9baJUnqc05lgNIE42IFVflVMEFwPdXedH9lkSPOJyLbCgrwPT-lbu8xpSeqM0A1qhjep6J7vdZ2N37-Bx0AY_j22UaPXgNMym3hMU1YKjoPq3JeQOjFTd06rCdCc1bAeL1xjBORhrLgRyz1e5hGQkEunbqSwWDAMn1A Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 003da7f4157a4743b31f0b5faaab9e91 Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-MigrationsAdminTest-577323606 Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:47:36.546025 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/003da7f4157a4743b31f0b5faaab9e91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_003da7f4157a4743b31f0b5faaab9e91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/003da7f4157a4743b31f0b5faaab9e91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/003da7f4157a4743b31f0b5faaab9e91"}]}] Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-MigrationsAdminTest-577323606 Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 003da7f4157a4743b31f0b5faaab9e91 Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-MigrationsAdminTest-577323606 Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-MigrationsAdminTest-577323606-project-admin Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3d9afd4814084dbb981915bda2561dab Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-MigrationsAdminTest-577323606-project-admin Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: exception: Flavor 5b5fd978-458b-4555-ac25-baa5e8b8d4e2 could not be found. Aug 25 12:47:36.549369 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '5b5fd978-458b-4555-ac25-baa5e8b8d4e2'} Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5b5fd978-458b-4555-ac25-baa5e8b8d4e2 could not be found. Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:36.550259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 5b5fd978-458b-4555-ac25-baa5e8b8d4e2 could not be found. Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5b5fd978-458b-4555-ac25-baa5e8b8d4e2 could not be found. Aug 25 12:47:36.553839 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:47:36.559678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dbab7645-3ccb-4c68-bc61-2cb1e0f633ae tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Returning 404 to user: Flavor 5b5fd978-458b-4555-ac25-baa5e8b8d4e2 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:47:36.562030 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dbab7645-3ccb-4c68-bc61-2cb1e0f633ae tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/5b5fd978-458b-4555-ac25-baa5e8b8d4e2" status: 404 len: 109 microversion: 2.1 time: 0.742167 Aug 25 12:47:36.571365 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 653/1318] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:47:35 2022] DELETE /compute/v2.1/flavors/5b5fd978-458b-4555-ac25-baa5e8b8d4e2 => generated 109 bytes in 755 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:47:36.584709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:36.586709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:36.604217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:36.607767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:36.611216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:36.613814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:36.615911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:36.637052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:36.756472 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-800b5cc4-9f95-4856-9565-a224a48580e1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1644 microversion: 2.1 time: 0.509156 Aug 25 12:47:36.765643 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 666/1319] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:36 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1644 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:36.771628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bef315ae-ec9c-49aa-8243-160ab9489184 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:36.777032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bef315ae-ec9c-49aa-8243-160ab9489184 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:36.828455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bef315ae-ec9c-49aa-8243-160ab9489184 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:36.832834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bef315ae-ec9c-49aa-8243-160ab9489184 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:36.837730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bef315ae-ec9c-49aa-8243-160ab9489184 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:36.839501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bef315ae-ec9c-49aa-8243-160ab9489184 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:36.843712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bef315ae-ec9c-49aa-8243-160ab9489184 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:36.845156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bef315ae-ec9c-49aa-8243-160ab9489184 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:37.342595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bef315ae-ec9c-49aa-8243-160ab9489184 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:37.367025 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bef315ae-ec9c-49aa-8243-160ab9489184 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1467 microversion: 2.1 time: 0.606326 Aug 25 12:47:37.367362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:37.398238 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 667/1320] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:36 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1467 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:37.405391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:37.415885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:37.423470 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c8a20007-f389-45db-9fba-4ea5120eabc5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.849299 Aug 25 12:47:37.425785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43cd648f-adc4-466b-be7d-fef04034ced2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:37.431021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43cd648f-adc4-466b-be7d-fef04034ced2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:37.436682 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 654/1321] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:47:36 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:47:37.487418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1664617169", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:37.500238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43cd648f-adc4-466b-be7d-fef04034ced2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:37.502427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43cd648f-adc4-466b-be7d-fef04034ced2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:37.504749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43cd648f-adc4-466b-be7d-fef04034ced2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:37.508686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43cd648f-adc4-466b-be7d-fef04034ced2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:37.510845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43cd648f-adc4-466b-be7d-fef04034ced2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:37.512015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43cd648f-adc4-466b-be7d-fef04034ced2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:37.669410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:47:38.369332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43cd648f-adc4-466b-be7d-fef04034ced2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:38.410373 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43cd648f-adc4-466b-be7d-fef04034ced2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1317 microversion: 2.1 time: 1.009306 Aug 25 12:47:38.428357 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 668/1322] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:37 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1317 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:38.456608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1078335220", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a8cc8d52-dd00-486a-beb8-ce1dce750174"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:38.589721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] validate_networks() for [('a8cc8d52-dd00-486a-beb8-ce1dce750174', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:47:39.588811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:47:39.589963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:47:39.591027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:47:39.595397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:47:39.597445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:47:39.636115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:39.638297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:39.639651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:39.641861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:39.643634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:39.645241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:39.695297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:47:39.707217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Getting quotas for user aad1bc68cede45a7b1ab7cbda0d8208e and project ff9affc0d6e64775b2dfd65eceb7f223. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:47:39.744689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:47:39.751545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:47:39.897028 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-962169b8-5b33-44ff-9b89-9a55c8e4f6b3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.440798 Aug 25 12:47:39.919148 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 655/1323] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:47:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:47:39.928729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6c39b14b-0e57-4faa-be4a-a43260119f7c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:39.940955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6c39b14b-0e57-4faa-be4a-a43260119f7c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:39.955988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c39b14b-0e57-4faa-be4a-a43260119f7c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:39.956723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c39b14b-0e57-4faa-be4a-a43260119f7c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:39.957534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c39b14b-0e57-4faa-be4a-a43260119f7c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:39.968290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c39b14b-0e57-4faa-be4a-a43260119f7c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:39.971572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c39b14b-0e57-4faa-be4a-a43260119f7c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:39.980897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c39b14b-0e57-4faa-be4a-a43260119f7c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:41.321448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:47:41.323495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:47:41.326062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:47:41.330832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:47:41.332710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:47:41.359689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:41.361896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:41.363335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:41.365835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:41.367164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:41.368420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:41.391387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6c39b14b-0e57-4faa-be4a-a43260119f7c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:41.426060 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6c39b14b-0e57-4faa-be4a-a43260119f7c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1487 microversion: 2.1 time: 1.504790 Aug 25 12:47:41.429069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Getting quotas for project 5473d51e2cf040a3ae656d7e987feec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:47:41.434140 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 656/1324] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:39 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1487 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:41.444894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Getting quotas for user 81b5d1940fe64714bd9ba7d2009004fd and project 5473d51e2cf040a3ae656d7e987feec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:47:41.465426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-061040b8-22c3-4594-b402-d102eac8a8e6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:41.467812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-061040b8-22c3-4594-b402-d102eac8a8e6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:41.490299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:41.491475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:41.497956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:47:41.500537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-061040b8-22c3-4594-b402-d102eac8a8e6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:41.507055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-061040b8-22c3-4594-b402-d102eac8a8e6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:41.511633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-061040b8-22c3-4594-b402-d102eac8a8e6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:41.512803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:47:41.519924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-061040b8-22c3-4594-b402-d102eac8a8e6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:41.522050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-061040b8-22c3-4594-b402-d102eac8a8e6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:41.528482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-061040b8-22c3-4594-b402-d102eac8a8e6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:41.779840 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a649ae22-6e7e-4d0c-87da-f4a5a088ccf7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.338633 Aug 25 12:47:41.781643 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 669/1325] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:47:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:47:41.792941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a743cd0f-3d83-403d-9e47-0ba5dcf98189 req-558fa4e8-81fe-4877-9189-d4b597874b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3155f7-5f48-47a9-a5a6-6ec064e160de", "name": "network-vif-plugged", "status": "completed", "tag": "5363dc13-2a91-4fbd-a4fa-f1335cb952e4"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:41.817034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a743cd0f-3d83-403d-9e47-0ba5dcf98189 req-558fa4e8-81fe-4877-9189-d4b597874b13 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:41.817892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a743cd0f-3d83-403d-9e47-0ba5dcf98189 req-558fa4e8-81fe-4877-9189-d4b597874b13 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:41.819088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a743cd0f-3d83-403d-9e47-0ba5dcf98189 req-558fa4e8-81fe-4877-9189-d4b597874b13 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:41.844569 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a743cd0f-3d83-403d-9e47-0ba5dcf98189 req-558fa4e8-81fe-4877-9189-d4b597874b13 service nova] Creating event network-vif-plugged:5363dc13-2a91-4fbd-a4fa-f1335cb952e4 for instance ca3155f7-5f48-47a9-a5a6-6ec064e160de on n-h2-852771-8 Aug 25 12:47:41.857902 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a743cd0f-3d83-403d-9e47-0ba5dcf98189 req-558fa4e8-81fe-4877-9189-d4b597874b13 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073017 Aug 25 12:47:41.860119 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 670/1326] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:41.873723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:41.876272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:41.893638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:41.895444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:41.899510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:41.901499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:41.903447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:41.904711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:42.491652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-061040b8-22c3-4594-b402-d102eac8a8e6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:42.528990 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-061040b8-22c3-4594-b402-d102eac8a8e6 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55" status: 200 len: 1467 microversion: 2.1 time: 1.092472 Aug 25 12:47:42.533665 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 657/1327] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:41 2022] GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55 => generated 1467 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:42.562632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16e33f32-557d-4363-94a5-3a2ff3d8b6d1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:42.574573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-16e33f32-557d-4363-94a5-3a2ff3d8b6d1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:42.608982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16e33f32-557d-4363-94a5-3a2ff3d8b6d1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:42.616412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16e33f32-557d-4363-94a5-3a2ff3d8b6d1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:42.617949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16e33f32-557d-4363-94a5-3a2ff3d8b6d1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:42.623993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16e33f32-557d-4363-94a5-3a2ff3d8b6d1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:42.626356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16e33f32-557d-4363-94a5-3a2ff3d8b6d1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:42.628068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16e33f32-557d-4363-94a5-3a2ff3d8b6d1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:42.728152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:42.750555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:42.754494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:42.758663 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fc7b2e54-abf5-4372-94e9-4d538d442c17 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.894584 Aug 25 12:47:42.776062 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 671/1328] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:47:41 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:47:42.806722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be2c3276-de70-4580-a783-d16d92bb1841 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:42.808568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be2c3276-de70-4580-a783-d16d92bb1841 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:42.824216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be2c3276-de70-4580-a783-d16d92bb1841 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:42.825913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be2c3276-de70-4580-a783-d16d92bb1841 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:42.828266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be2c3276-de70-4580-a783-d16d92bb1841 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:42.830629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be2c3276-de70-4580-a783-d16d92bb1841 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:42.832321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be2c3276-de70-4580-a783-d16d92bb1841 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:42.834836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be2c3276-de70-4580-a783-d16d92bb1841 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:43.170479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-be2c3276-de70-4580-a783-d16d92bb1841 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:43.214524 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-be2c3276-de70-4580-a783-d16d92bb1841 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1265 microversion: 2.1 time: 0.435268 Aug 25 12:47:43.218709 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 672/1329] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:42 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1265 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:43.231603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-32a5b3ca-5931-4cef-aab2-ec6ea9c6d63a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:43.233370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-32a5b3ca-5931-4cef-aab2-ec6ea9c6d63a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:43.257498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32a5b3ca-5931-4cef-aab2-ec6ea9c6d63a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:43.265414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32a5b3ca-5931-4cef-aab2-ec6ea9c6d63a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:43.266943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32a5b3ca-5931-4cef-aab2-ec6ea9c6d63a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:43.271600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32a5b3ca-5931-4cef-aab2-ec6ea9c6d63a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:43.273090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32a5b3ca-5931-4cef-aab2-ec6ea9c6d63a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:43.274200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32a5b3ca-5931-4cef-aab2-ec6ea9c6d63a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:43.430582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16e33f32-557d-4363-94a5-3a2ff3d8b6d1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:43.430953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-32a5b3ca-5931-4cef-aab2-ec6ea9c6d63a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lazy-loading 'flavor' on Instance uuid 7381daf9-37a3-47df-823d-69f8fc28e831 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:47:43.486732 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-16e33f32-557d-4363-94a5-3a2ff3d8b6d1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1317 microversion: 2.1 time: 0.943370 Aug 25 12:47:43.491724 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 658/1330] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:42 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1317 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:43.537699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ce41aa74-41b8-482e-8be9-47c10e22eb57 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:43.539982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ce41aa74-41b8-482e-8be9-47c10e22eb57 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:43.594327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce41aa74-41b8-482e-8be9-47c10e22eb57 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:43.597930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce41aa74-41b8-482e-8be9-47c10e22eb57 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:43.599507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce41aa74-41b8-482e-8be9-47c10e22eb57 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:43.603298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce41aa74-41b8-482e-8be9-47c10e22eb57 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:43.608751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce41aa74-41b8-482e-8be9-47c10e22eb57 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:43.611697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce41aa74-41b8-482e-8be9-47c10e22eb57 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:43.761727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:43.893764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:43.951795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ce41aa74-41b8-482e-8be9-47c10e22eb57 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:43.968618 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-32a5b3ca-5931-4cef-aab2-ec6ea9c6d63a tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831/action" status: 202 len: 0 microversion: 2.1 time: 0.746414 Aug 25 12:47:43.973243 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ce41aa74-41b8-482e-8be9-47c10e22eb57 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1215 microversion: 2.1 time: 0.474561 Aug 25 12:47:43.977415 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 659/1331] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:43 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1215 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:43.991736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-98c65a5e-7256-487f-adb0-a4b1aa535751 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1190387652"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:43.992607 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 673/1332] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:47:43 2022] POST /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:47:43.999226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-98c65a5e-7256-487f-adb0-a4b1aa535751 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:44.015989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98c65a5e-7256-487f-adb0-a4b1aa535751 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:44.026628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98c65a5e-7256-487f-adb0-a4b1aa535751 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:44.038670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98c65a5e-7256-487f-adb0-a4b1aa535751 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:44.040835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98c65a5e-7256-487f-adb0-a4b1aa535751 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:44.042183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98c65a5e-7256-487f-adb0-a4b1aa535751 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:44.042911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:44.043705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98c65a5e-7256-487f-adb0-a4b1aa535751 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:44.046570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:44.078853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:44.082414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:44.083945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:44.085883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:44.087606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:44.088766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:45.283476 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-98c65a5e-7256-487f-adb0-a4b1aa535751 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "POST /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55/action" status: 202 len: 0 microversion: 2.1 time: 1.296048 Aug 25 12:47:45.298091 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 660/1333] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:47:43 2022] POST /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55/action => generated 0 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:47:45.311890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-33e2c361-362c-4d13-880d-e8dde1072592 req-fed5ef8e-8978-40ea-8ad3-0776e720adab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb0cfcc-71e4-4326-b8d9-dcf129be2a48", "name": "network-vif-plugged", "status": "completed", "tag": "3e258a14-cb05-447b-b747-9cbe36ed9fc5"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:45.327250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:45.353814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-33e2c361-362c-4d13-880d-e8dde1072592 req-fed5ef8e-8978-40ea-8ad3-0776e720adab service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:45.361058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-33e2c361-362c-4d13-880d-e8dde1072592 req-fed5ef8e-8978-40ea-8ad3-0776e720adab service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:45.362623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-33e2c361-362c-4d13-880d-e8dde1072592 req-fed5ef8e-8978-40ea-8ad3-0776e720adab service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:45.397903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:45.409813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:45.425391 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f7faefa-ce92-482c-bf08-2a4d1ffaf779 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 1.430157 Aug 25 12:47:45.442078 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 674/1334] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:47:43 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:47:45.449941 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-33e2c361-362c-4d13-880d-e8dde1072592 req-fed5ef8e-8978-40ea-8ad3-0776e720adab service nova] Creating event network-vif-plugged:3e258a14-cb05-447b-b747-9cbe36ed9fc5 for instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 on n-h1-852771-8 Aug 25 12:47:45.463096 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-33e2c361-362c-4d13-880d-e8dde1072592 req-fed5ef8e-8978-40ea-8ad3-0776e720adab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161770 Aug 25 12:47:45.464304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-68e27afc-db63-4865-953c-889790d7d12c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:45.471219 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 661/1335] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:45.472056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-68e27afc-db63-4865-953c-889790d7d12c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:45.502159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-07c00058-ede0-4fd8-97c5-bc7bf835bb47 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:45.507560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-07c00058-ede0-4fd8-97c5-bc7bf835bb47 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:45.517857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e27afc-db63-4865-953c-889790d7d12c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:45.524152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e27afc-db63-4865-953c-889790d7d12c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:45.525358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e27afc-db63-4865-953c-889790d7d12c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:45.527210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e27afc-db63-4865-953c-889790d7d12c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:45.528302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e27afc-db63-4865-953c-889790d7d12c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:45.538037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e27afc-db63-4865-953c-889790d7d12c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:45.550621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07c00058-ede0-4fd8-97c5-bc7bf835bb47 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:45.555159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07c00058-ede0-4fd8-97c5-bc7bf835bb47 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:45.556857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07c00058-ede0-4fd8-97c5-bc7bf835bb47 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:45.559537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07c00058-ede0-4fd8-97c5-bc7bf835bb47 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:45.561219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07c00058-ede0-4fd8-97c5-bc7bf835bb47 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:45.563171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07c00058-ede0-4fd8-97c5-bc7bf835bb47 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:46.236856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-07c00058-ede0-4fd8-97c5-bc7bf835bb47 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:46.277399 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-07c00058-ede0-4fd8-97c5-bc7bf835bb47 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1271 microversion: 2.1 time: 0.803275 Aug 25 12:47:46.308263 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 662/1336] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:45 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1271 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:46.339683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0021d33c-260f-4992-b669-f936db92dc9e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:46.342401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0021d33c-260f-4992-b669-f936db92dc9e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:46.372411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0021d33c-260f-4992-b669-f936db92dc9e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:46.379079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0021d33c-260f-4992-b669-f936db92dc9e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:46.380709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0021d33c-260f-4992-b669-f936db92dc9e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:46.382533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0021d33c-260f-4992-b669-f936db92dc9e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:46.387153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0021d33c-260f-4992-b669-f936db92dc9e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:46.399074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0021d33c-260f-4992-b669-f936db92dc9e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:47.820547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0021d33c-260f-4992-b669-f936db92dc9e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:47.831227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-68e27afc-db63-4865-953c-889790d7d12c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:47.841378 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0021d33c-260f-4992-b669-f936db92dc9e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1317 microversion: 2.1 time: 1.531565 Aug 25 12:47:47.851116 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 663/1337] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:46 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1317 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:47.866779 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-68e27afc-db63-4865-953c-889790d7d12c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1495 microversion: 2.1 time: 2.421297 Aug 25 12:47:47.874625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-726cc548-27d2-47b9-9ed6-ee4d76206fa8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:47.875837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-726cc548-27d2-47b9-9ed6-ee4d76206fa8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:47.900648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726cc548-27d2-47b9-9ed6-ee4d76206fa8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:47.905377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726cc548-27d2-47b9-9ed6-ee4d76206fa8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:47.906027 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 675/1338] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:45 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1495 bytes in 2462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:47.910172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726cc548-27d2-47b9-9ed6-ee4d76206fa8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:47.921263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e34ba8e5-eff9-42e0-b0c1-27ec8772a337 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a657f70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:47.924598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726cc548-27d2-47b9-9ed6-ee4d76206fa8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:47.935137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726cc548-27d2-47b9-9ed6-ee4d76206fa8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:47.936315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-726cc548-27d2-47b9-9ed6-ee4d76206fa8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:48.107516 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e34ba8e5-eff9-42e0-b0c1-27ec8772a337 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1455 microversion: 2.1 time: 0.195637 Aug 25 12:47:48.116030 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 676/1339] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:47:47 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1455 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:48.143578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:48.151213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:48.180728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:48.181569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:48.182300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:48.183468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:48.184199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:48.185057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:48.485947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-726cc548-27d2-47b9-9ed6-ee4d76206fa8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:48.503656 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-726cc548-27d2-47b9-9ed6-ee4d76206fa8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1269 microversion: 2.1 time: 0.649653 Aug 25 12:47:48.507512 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 664/1340] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:47 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1269 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:48.521092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b914b391-7763-4b3e-9694-ab2b14c7a03e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:48.523139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b914b391-7763-4b3e-9694-ab2b14c7a03e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:48.540401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b914b391-7763-4b3e-9694-ab2b14c7a03e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:48.547247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b914b391-7763-4b3e-9694-ab2b14c7a03e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:48.548835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b914b391-7763-4b3e-9694-ab2b14c7a03e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:48.550834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b914b391-7763-4b3e-9694-ab2b14c7a03e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:48.558875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b914b391-7763-4b3e-9694-ab2b14c7a03e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:48.564721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b914b391-7763-4b3e-9694-ab2b14c7a03e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:49.491111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b914b391-7763-4b3e-9694-ab2b14c7a03e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:49.511260 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b914b391-7763-4b3e-9694-ab2b14c7a03e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1313 microversion: 2.1 time: 1.001105 Aug 25 12:47:49.522894 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 665/1341] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:48 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1313 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:49.567018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:49.653372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:49.668508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:49.678704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:49.687446 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-de417f14-7935-4765-9af7-57a36ddb9100 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 1.566087 Aug 25 12:47:49.690057 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 677/1342] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:47:48 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:47:49.706276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d9ed2d1e-a592-4286-a0d4-19fa976fb5e2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:49.708973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d9ed2d1e-a592-4286-a0d4-19fa976fb5e2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:49.733120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9ed2d1e-a592-4286-a0d4-19fa976fb5e2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:49.734033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9ed2d1e-a592-4286-a0d4-19fa976fb5e2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:49.735333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9ed2d1e-a592-4286-a0d4-19fa976fb5e2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:49.737368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9ed2d1e-a592-4286-a0d4-19fa976fb5e2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:49.739273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9ed2d1e-a592-4286-a0d4-19fa976fb5e2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:49.739561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-408681592", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "096edbd3-dfc5-4a3b-9811-91226cff297d"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:49.740994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9ed2d1e-a592-4286-a0d4-19fa976fb5e2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:49.781673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:49.917922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] validate_networks() for [('096edbd3-dfc5-4a3b-9811-91226cff297d', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:47:51.211410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d9ed2d1e-a592-4286-a0d4-19fa976fb5e2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:51.230495 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d9ed2d1e-a592-4286-a0d4-19fa976fb5e2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1466 microversion: 2.1 time: 1.537748 Aug 25 12:47:51.232965 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 678/1343] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:49 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1466 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:51.244737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-071df112-af63-4696-9b67-3300086a7210 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:51.246609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-071df112-af63-4696-9b67-3300086a7210 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:51.268246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-071df112-af63-4696-9b67-3300086a7210 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:51.273802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-071df112-af63-4696-9b67-3300086a7210 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:51.275170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-071df112-af63-4696-9b67-3300086a7210 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:51.276943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-071df112-af63-4696-9b67-3300086a7210 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:51.278237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-071df112-af63-4696-9b67-3300086a7210 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:51.279498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-071df112-af63-4696-9b67-3300086a7210 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:51.400157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:51.468367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:52.344406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-071df112-af63-4696-9b67-3300086a7210 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:52.379531 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-071df112-af63-4696-9b67-3300086a7210 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 200 len: 1478 microversion: 2.1 time: 1.137760 Aug 25 12:47:52.382020 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 679/1344] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:51 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 1478 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:52.391239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7b0391d9-53b1-4958-8012-d5fdf1533b9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2b130700>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:52.552253 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7b0391d9-53b1-4958-8012-d5fdf1533b9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1455 microversion: 2.1 time: 0.166837 Aug 25 12:47:52.567082 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 680/1345] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:47:52 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1455 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:52.579444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12e6d7b4-3a8d-4a44-b439-8df635372ce0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:52.580813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12e6d7b4-3a8d-4a44-b439-8df635372ce0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:52.601064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12e6d7b4-3a8d-4a44-b439-8df635372ce0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:52.602566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12e6d7b4-3a8d-4a44-b439-8df635372ce0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:52.603428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12e6d7b4-3a8d-4a44-b439-8df635372ce0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:52.604945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12e6d7b4-3a8d-4a44-b439-8df635372ce0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:52.606157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12e6d7b4-3a8d-4a44-b439-8df635372ce0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:52.607123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12e6d7b4-3a8d-4a44-b439-8df635372ce0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:53.483836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:47:53.485873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:47:53.490420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:47:53.492863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:47:53.503202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12e6d7b4-3a8d-4a44-b439-8df635372ce0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:53.511352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:47:53.590173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:53.591450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:53.592573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:53.607363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:53.608651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:53.609374 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12e6d7b4-3a8d-4a44-b439-8df635372ce0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1311 microversion: 2.1 time: 1.037240 Aug 25 12:47:53.609749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:53.619906 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 681/1346] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:52 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1311 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:53.650983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9829698-38c1-4a7f-8f0a-e49dca6921ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:53.653398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b9829698-38c1-4a7f-8f0a-e49dca6921ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:53.695788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Getting quotas for project 8413d7bad4404fdb97547c08ca0a0fc6. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:47:53.708633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9829698-38c1-4a7f-8f0a-e49dca6921ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:53.710047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9829698-38c1-4a7f-8f0a-e49dca6921ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:53.711065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9829698-38c1-4a7f-8f0a-e49dca6921ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:53.712903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9829698-38c1-4a7f-8f0a-e49dca6921ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:53.715354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Getting quotas for user e369e0cffa1642968966435504164d17 and project 8413d7bad4404fdb97547c08ca0a0fc6. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:47:53.720310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9829698-38c1-4a7f-8f0a-e49dca6921ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:53.721912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9829698-38c1-4a7f-8f0a-e49dca6921ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:53.761313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:47:53.769631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:47:53.957276 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-724916be-2205-436d-8a8b-8ef6aa62a259 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.428546 Aug 25 12:47:53.959665 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 666/1347] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:47:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:47:53.975102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:53.976777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:53.991491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:53.992634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:53.993856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:53.996155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:53.996817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:53.998723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:54.863058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b9829698-38c1-4a7f-8f0a-e49dca6921ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:54.910730 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9829698-38c1-4a7f-8f0a-e49dca6921ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1313 microversion: 2.1 time: 1.283706 Aug 25 12:47:54.929798 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 682/1348] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:53 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1313 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:54.946306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1862999920", "metadata": {"image_type": "test"}}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:54.952928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:54.977359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:54.978493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:54.979736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:54.981400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:54.982884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:54.988798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:55.142636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Getting quotas for project 9d4312a6d6044d23a16429fcda142b0e. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:47:55.172643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Getting quotas for user ff2960e821954604ac0d3153d9853a9f and project 9d4312a6d6044d23a16429fcda142b0e. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:47:55.784817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:55.829329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:55.842136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:55.847851 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9e87c2f9-1f59-421c-8fb0-6d129ab64836 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 1.882506 Aug 25 12:47:55.860989 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 667/1349] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:47:53 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:47:55.916675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7f7780e5-3e8e-4b48-8726-2771005646af tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-114812546"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:55.928080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7f7780e5-3e8e-4b48-8726-2771005646af tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:55.958451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f7780e5-3e8e-4b48-8726-2771005646af tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:55.960205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f7780e5-3e8e-4b48-8726-2771005646af tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:55.962131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f7780e5-3e8e-4b48-8726-2771005646af tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:55.971220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f7780e5-3e8e-4b48-8726-2771005646af tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:55.977189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f7780e5-3e8e-4b48-8726-2771005646af tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:55.978748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f7780e5-3e8e-4b48-8726-2771005646af tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:56.218095 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b82b6312-32a7-46eb-9542-6bcc91fcdb34 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "POST /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48/action" status: 202 len: 0 microversion: 2.1 time: 1.291447 Aug 25 12:47:56.232912 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 683/1350] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:47:54 2022] POST /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48/action => generated 0 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:47:56.276875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70354698-c553-4f1f-941c-35f6f7a23abe tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a6c69d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:56.821198 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70354698-c553-4f1f-941c-35f6f7a23abe tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1455 microversion: 2.1 time: 0.577391 Aug 25 12:47:56.828319 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 684/1351] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:47:56 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1455 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:56.851721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-870566fe-7a38-4a49-a09e-59b091e6e2db req-6b7b2a64-6cc8-45b8-b600-c91743ff099c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2408cea4-7716-49a5-a824-c5c508608abd", "tag": "54770f9e-bb74-47fc-b419-3406ae7bf420"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:56.922321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-870566fe-7a38-4a49-a09e-59b091e6e2db req-6b7b2a64-6cc8-45b8-b600-c91743ff099c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:56.924016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-870566fe-7a38-4a49-a09e-59b091e6e2db req-6b7b2a64-6cc8-45b8-b600-c91743ff099c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:56.925233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-870566fe-7a38-4a49-a09e-59b091e6e2db req-6b7b2a64-6cc8-45b8-b600-c91743ff099c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:57.019187 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7f7780e5-3e8e-4b48-8726-2771005646af tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831/action" status: 202 len: 0 microversion: 2.1 time: 1.147482 Aug 25 12:47:57.033243 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 668/1352] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:47:55 2022] POST /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831/action => generated 0 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:47:57.038227 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-870566fe-7a38-4a49-a09e-59b091e6e2db req-6b7b2a64-6cc8-45b8-b600-c91743ff099c service nova] Creating event network-changed:54770f9e-bb74-47fc-b419-3406ae7bf420 for instance 2408cea4-7716-49a5-a824-c5c508608abd on n-h1-852771-8 Aug 25 12:47:57.059834 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-870566fe-7a38-4a49-a09e-59b091e6e2db req-6b7b2a64-6cc8-45b8-b600-c91743ff099c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228316 Aug 25 12:47:57.061029 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 685/1353] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:57.076177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-388eda8c-96e9-449c-8bf9-3d97c6a88d01 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:57.078254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-388eda8c-96e9-449c-8bf9-3d97c6a88d01 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:57.082185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-296c6fd5-b6fa-4ddb-8f47-cdd4dd97324c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:57.100869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-296c6fd5-b6fa-4ddb-8f47-cdd4dd97324c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:57.131675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388eda8c-96e9-449c-8bf9-3d97c6a88d01 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:57.135583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388eda8c-96e9-449c-8bf9-3d97c6a88d01 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:57.138592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388eda8c-96e9-449c-8bf9-3d97c6a88d01 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:57.144428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388eda8c-96e9-449c-8bf9-3d97c6a88d01 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:57.149447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388eda8c-96e9-449c-8bf9-3d97c6a88d01 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:57.152837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388eda8c-96e9-449c-8bf9-3d97c6a88d01 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:57.169152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296c6fd5-b6fa-4ddb-8f47-cdd4dd97324c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:57.174182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296c6fd5-b6fa-4ddb-8f47-cdd4dd97324c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:57.182257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296c6fd5-b6fa-4ddb-8f47-cdd4dd97324c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:57.184259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296c6fd5-b6fa-4ddb-8f47-cdd4dd97324c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:57.195455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296c6fd5-b6fa-4ddb-8f47-cdd4dd97324c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:57.196635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296c6fd5-b6fa-4ddb-8f47-cdd4dd97324c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:57.862258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-296c6fd5-b6fa-4ddb-8f47-cdd4dd97324c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:57.897670 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-296c6fd5-b6fa-4ddb-8f47-cdd4dd97324c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1268 microversion: 2.1 time: 0.859716 Aug 25 12:47:57.905895 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 669/1354] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:57 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1268 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:57.941027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e4c2ffa2-b331-4dc6-81e2-62a4f7c5f2f9 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:57.948439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e4c2ffa2-b331-4dc6-81e2-62a4f7c5f2f9 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:57.984664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4c2ffa2-b331-4dc6-81e2-62a4f7c5f2f9 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:57.985719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4c2ffa2-b331-4dc6-81e2-62a4f7c5f2f9 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:57.986585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4c2ffa2-b331-4dc6-81e2-62a4f7c5f2f9 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:57.988306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4c2ffa2-b331-4dc6-81e2-62a4f7c5f2f9 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:57.990102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4c2ffa2-b331-4dc6-81e2-62a4f7c5f2f9 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:57.996857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4c2ffa2-b331-4dc6-81e2-62a4f7c5f2f9 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:58.165709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-388eda8c-96e9-449c-8bf9-3d97c6a88d01 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:58.228768 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-388eda8c-96e9-449c-8bf9-3d97c6a88d01 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1311 microversion: 2.1 time: 1.165118 Aug 25 12:47:58.230429 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 686/1355] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:57 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1311 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:58.252003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-687406e4-1609-45c0-8274-a563e943c934 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a6b4ee0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:58.468266 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-687406e4-1609-45c0-8274-a563e943c934 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.235396 Aug 25 12:47:58.471237 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 687/1356] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:47:58 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:58.485245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:58.487014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:58.508292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:58.510497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:58.512599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:58.514255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:58.515066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:58.516708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:58.789441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e4c2ffa2-b331-4dc6-81e2-62a4f7c5f2f9 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:58.816623 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e4c2ffa2-b331-4dc6-81e2-62a4f7c5f2f9 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1313 microversion: 2.1 time: 0.907769 Aug 25 12:47:58.839458 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 670/1357] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:57 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1313 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:58.865407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef65ad99-6078-4a22-a3d2-b305b33ff3ff tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a4e4310>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:58.989758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:59.011668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:59.015490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:59.019713 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9aefca27-6b56-4223-aeca-f01bcc5634eb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.545156 Aug 25 12:47:59.019936 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef65ad99-6078-4a22-a3d2-b305b33ff3ff tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 200 len: 1437 microversion: 2.1 time: 0.178602 Aug 25 12:47:59.021544 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 671/1358] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:47:58 2022] GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 1437 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:59.037166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-61f6929a-5442-4390-bce1-1f53cee344b2 req-9abcf2d6-fe47-437b-9aa1-79db39f9a691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01013692-8e62-49a8-81b9-7f7cdd4a5a55", "name": "network-vif-plugged", "status": "completed", "tag": "73f30782-4779-447f-ba20-d60dfbdf553d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:59.037464 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 688/1359] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:47:58 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:47:59.050246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c99dbd1d-4682-4063-b814-2d43ca3bd49d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a6dbc10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:59.086644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-61f6929a-5442-4390-bce1-1f53cee344b2 req-9abcf2d6-fe47-437b-9aa1-79db39f9a691 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:59.087540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-61f6929a-5442-4390-bce1-1f53cee344b2 req-9abcf2d6-fe47-437b-9aa1-79db39f9a691 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:59.092575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-61f6929a-5442-4390-bce1-1f53cee344b2 req-9abcf2d6-fe47-437b-9aa1-79db39f9a691 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:59.146113 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-61f6929a-5442-4390-bce1-1f53cee344b2 req-9abcf2d6-fe47-437b-9aa1-79db39f9a691 service nova] Creating event network-vif-plugged:73f30782-4779-447f-ba20-d60dfbdf553d for instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 on n-h2-852771-8 Aug 25 12:47:59.172321 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-61f6929a-5442-4390-bce1-1f53cee344b2 req-9abcf2d6-fe47-437b-9aa1-79db39f9a691 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141414 Aug 25 12:47:59.177690 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 672/1360] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:59.191544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d78f054d-e01c-42d2-96ed-40e251e26f43 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:59.192980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d78f054d-e01c-42d2-96ed-40e251e26f43 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:59.211852 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c99dbd1d-4682-4063-b814-2d43ca3bd49d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1455 microversion: 2.1 time: 0.174628 Aug 25 12:47:59.224408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d78f054d-e01c-42d2-96ed-40e251e26f43 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:59.225374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d78f054d-e01c-42d2-96ed-40e251e26f43 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:59.233068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d78f054d-e01c-42d2-96ed-40e251e26f43 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:59.234995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d78f054d-e01c-42d2-96ed-40e251e26f43 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:59.236257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d78f054d-e01c-42d2-96ed-40e251e26f43 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:59.237343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d78f054d-e01c-42d2-96ed-40e251e26f43 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:59.260133 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 689/1361] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:47:59 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1455 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:59.286987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-749bfbd8-13ef-436d-9c8c-4eca4fe2f689 req-6273f419-8afb-4238-987b-431686c9a666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9992927-34a0-45d7-97a6-640fcc718291", "tag": "be3062fa-b4a6-420c-a93f-db51f1259214"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:59.344000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-749bfbd8-13ef-436d-9c8c-4eca4fe2f689 req-6273f419-8afb-4238-987b-431686c9a666 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:59.345663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-749bfbd8-13ef-436d-9c8c-4eca4fe2f689 req-6273f419-8afb-4238-987b-431686c9a666 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:59.346846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-749bfbd8-13ef-436d-9c8c-4eca4fe2f689 req-6273f419-8afb-4238-987b-431686c9a666 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:59.389107 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-749bfbd8-13ef-436d-9c8c-4eca4fe2f689 req-6273f419-8afb-4238-987b-431686c9a666 service nova] Creating event network-changed:be3062fa-b4a6-420c-a93f-db51f1259214 for instance c9992927-34a0-45d7-97a6-640fcc718291 on n-h1-852771-8 Aug 25 12:47:59.423612 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-749bfbd8-13ef-436d-9c8c-4eca4fe2f689 req-6273f419-8afb-4238-987b-431686c9a666 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160740 Aug 25 12:47:59.425218 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 690/1362] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:59.450942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-53f43c8b-3ebb-4b50-9de1-71288c8eddee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:59.454154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-53f43c8b-3ebb-4b50-9de1-71288c8eddee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:59.472318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f43c8b-3ebb-4b50-9de1-71288c8eddee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:59.474225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f43c8b-3ebb-4b50-9de1-71288c8eddee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:59.475486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f43c8b-3ebb-4b50-9de1-71288c8eddee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:59.477246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f43c8b-3ebb-4b50-9de1-71288c8eddee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:59.478906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f43c8b-3ebb-4b50-9de1-71288c8eddee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:59.480731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53f43c8b-3ebb-4b50-9de1-71288c8eddee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:59.556261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d78f054d-e01c-42d2-96ed-40e251e26f43 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:59.578646 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d78f054d-e01c-42d2-96ed-40e251e26f43 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1274 microversion: 2.1 time: 0.397903 Aug 25 12:47:59.615716 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 673/1363] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:59 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1274 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:59.628132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-efe80e82-5fd3-44e8-bcad-7b8592d341e7 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a5531f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:59.769554 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-efe80e82-5fd3-44e8-bcad-7b8592d341e7 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.151755 Aug 25 12:47:59.783685 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 674/1364] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:47:59 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:59.893828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-53f43c8b-3ebb-4b50-9de1-71288c8eddee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:59.902822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b012713c-f85b-4701-b16e-fe339dad31c0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:59.903995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b012713c-f85b-4701-b16e-fe339dad31c0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:59.933526 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-53f43c8b-3ebb-4b50-9de1-71288c8eddee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1311 microversion: 2.1 time: 0.504719 Aug 25 12:47:59.950738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b012713c-f85b-4701-b16e-fe339dad31c0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:59.951279 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 691/1365] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:59 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1311 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:59.952638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b012713c-f85b-4701-b16e-fe339dad31c0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:59.953458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b012713c-f85b-4701-b16e-fe339dad31c0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:59.965997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b012713c-f85b-4701-b16e-fe339dad31c0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:59.967240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b012713c-f85b-4701-b16e-fe339dad31c0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:59.968218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b012713c-f85b-4701-b16e-fe339dad31c0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:00.393590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6a8cc472-d7e2-416e-8428-5dad1e8d87d1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a6db0d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:00.410274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b012713c-f85b-4701-b16e-fe339dad31c0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:00.432712 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b012713c-f85b-4701-b16e-fe339dad31c0 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1313 microversion: 2.1 time: 0.553219 Aug 25 12:48:00.433873 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 675/1366] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:59 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:00.448071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:00.449158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:00.463012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:00.463012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:00.463535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:00.465117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:00.466319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:00.467268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:00.574354 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6a8cc472-d7e2-416e-8428-5dad1e8d87d1 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 200 len: 1437 microversion: 2.1 time: 0.529564 Aug 25 12:48:00.575485 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 692/1367] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:00 2022] GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 1437 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:00.606547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-32597575-29f0-4b4b-a364-037236398d42 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a52fb80>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:00.810375 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-32597575-29f0-4b4b-a364-037236398d42 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1455 microversion: 2.1 time: 0.223566 Aug 25 12:48:00.826042 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 693/1368] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:00 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1455 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:00.837846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c8fa94fc-a4f0-4499-9795-775a6ec7779a tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:00.839459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c8fa94fc-a4f0-4499-9795-775a6ec7779a tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:00.862540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8fa94fc-a4f0-4499-9795-775a6ec7779a tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:00.863972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8fa94fc-a4f0-4499-9795-775a6ec7779a tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:00.865188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8fa94fc-a4f0-4499-9795-775a6ec7779a tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:00.867072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8fa94fc-a4f0-4499-9795-775a6ec7779a tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:00.868325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8fa94fc-a4f0-4499-9795-775a6ec7779a tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:00.869404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8fa94fc-a4f0-4499-9795-775a6ec7779a tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:00.879501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:00.914019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:00.929212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:00.932482 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-37cd1639-4805-4a68-8e1a-83128e1f0709 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.496688 Aug 25 12:48:00.937120 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 676/1369] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:00 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:00.951767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3d1cc475-78f8-42dd-a8e4-18431f72c728 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a4ebf70>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:01.120012 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3d1cc475-78f8-42dd-a8e4-18431f72c728 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.178814 Aug 25 12:48:01.124566 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 677/1370] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:00 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:01.151358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1e408d2c-5251-4006-b83e-2e1f24801001 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:01.153119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1e408d2c-5251-4006-b83e-2e1f24801001 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:01.177010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e408d2c-5251-4006-b83e-2e1f24801001 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:01.177885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e408d2c-5251-4006-b83e-2e1f24801001 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:01.178611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e408d2c-5251-4006-b83e-2e1f24801001 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:01.179825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e408d2c-5251-4006-b83e-2e1f24801001 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:01.180725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e408d2c-5251-4006-b83e-2e1f24801001 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:01.187547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e408d2c-5251-4006-b83e-2e1f24801001 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:01.287663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:01.434050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c8fa94fc-a4f0-4499-9795-775a6ec7779a tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:01.460790 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c8fa94fc-a4f0-4499-9795-775a6ec7779a tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1316 microversion: 2.1 time: 0.632278 Aug 25 12:48:01.474156 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 694/1371] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:00 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:01.499676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bc0ad917-18c6-4a1d-869a-f01d3f0d84e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:01.501447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bc0ad917-18c6-4a1d-869a-f01d3f0d84e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:01.529529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0ad917-18c6-4a1d-869a-f01d3f0d84e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:01.530978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0ad917-18c6-4a1d-869a-f01d3f0d84e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:01.531871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0ad917-18c6-4a1d-869a-f01d3f0d84e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:01.533103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0ad917-18c6-4a1d-869a-f01d3f0d84e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:01.533841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0ad917-18c6-4a1d-869a-f01d3f0d84e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:01.535023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0ad917-18c6-4a1d-869a-f01d3f0d84e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:01.904116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1e408d2c-5251-4006-b83e-2e1f24801001 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:01.936968 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1e408d2c-5251-4006-b83e-2e1f24801001 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1311 microversion: 2.1 time: 0.809998 Aug 25 12:48:01.957224 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 678/1372] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:01 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1311 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:01.968325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-35fe7b9b-6f06-43d2-9a45-69c7e74fa9fe tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a4273a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:02.149204 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-35fe7b9b-6f06-43d2-9a45-69c7e74fa9fe tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 200 len: 1437 microversion: 2.1 time: 0.207765 Aug 25 12:48:02.150559 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 679/1373] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:01 2022] GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 1437 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:02.168690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4035fb5c-48a5-42c0-ba91-00ab9649aef3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a4e4ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:02.177123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bc0ad917-18c6-4a1d-869a-f01d3f0d84e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:02.201048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:02.219251 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bc0ad917-18c6-4a1d-869a-f01d3f0d84e3 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1313 microversion: 2.1 time: 0.743010 Aug 25 12:48:02.221879 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 695/1374] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:01 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1313 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:02.249685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:02.250982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:02.281064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:02.282322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:02.283057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:02.290163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:02.291050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:02.291802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:02.308010 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4035fb5c-48a5-42c0-ba91-00ab9649aef3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1455 microversion: 2.1 time: 0.155527 Aug 25 12:48:02.309221 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 680/1375] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:02 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:02.327764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2646f779-6d9c-437a-9943-07c2c4c09ba2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a4eb280>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:02.483458 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2646f779-6d9c-437a-9943-07c2c4c09ba2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.167088 Aug 25 12:48:02.499177 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 681/1376] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:02 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:02.529131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0134532-ae69-420e-8647-e2c4a2eae7a9 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:02.532018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b0134532-ae69-420e-8647-e2c4a2eae7a9 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:02.556316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0134532-ae69-420e-8647-e2c4a2eae7a9 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:02.560560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0134532-ae69-420e-8647-e2c4a2eae7a9 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:02.561745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0134532-ae69-420e-8647-e2c4a2eae7a9 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:02.570864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0134532-ae69-420e-8647-e2c4a2eae7a9 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:02.577777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0134532-ae69-420e-8647-e2c4a2eae7a9 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:02.578911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0134532-ae69-420e-8647-e2c4a2eae7a9 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:02.925940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:02.956533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:02.975359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:02.978192 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c0ca3126-f5c6-4030-b928-16994260d0bd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.751020 Aug 25 12:48:02.982861 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 696/1377] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:02 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:03.011214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-59007159-aec8-4af4-b9cb-11a76b8b821f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:03.013470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-59007159-aec8-4af4-b9cb-11a76b8b821f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:03.052959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59007159-aec8-4af4-b9cb-11a76b8b821f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:03.057971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59007159-aec8-4af4-b9cb-11a76b8b821f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:03.059590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59007159-aec8-4af4-b9cb-11a76b8b821f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:03.063345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59007159-aec8-4af4-b9cb-11a76b8b821f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:03.069666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59007159-aec8-4af4-b9cb-11a76b8b821f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:03.070430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59007159-aec8-4af4-b9cb-11a76b8b821f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:03.624911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b0134532-ae69-420e-8647-e2c4a2eae7a9 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:03.661212 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b0134532-ae69-420e-8647-e2c4a2eae7a9 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1316 microversion: 2.1 time: 1.158372 Aug 25 12:48:03.663155 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 682/1378] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:02 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1316 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:03.686672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8659de6b-9931-447d-a383-9d9eb5655a3f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a4eb430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:03.715615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:03.722738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-59007159-aec8-4af4-b9cb-11a76b8b821f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:03.743073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:03.775021 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-59007159-aec8-4af4-b9cb-11a76b8b821f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1311 microversion: 2.1 time: 0.773510 Aug 25 12:48:03.789766 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 697/1379] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:02 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1311 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:48:03.815955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6716626d-19ef-4ee3-98a2-6040154303d4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:03.822480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6716626d-19ef-4ee3-98a2-6040154303d4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:03.842157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6716626d-19ef-4ee3-98a2-6040154303d4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:03.843293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6716626d-19ef-4ee3-98a2-6040154303d4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:03.844300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6716626d-19ef-4ee3-98a2-6040154303d4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:03.845796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6716626d-19ef-4ee3-98a2-6040154303d4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:03.846915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6716626d-19ef-4ee3-98a2-6040154303d4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:03.847891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6716626d-19ef-4ee3-98a2-6040154303d4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:03.864954 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8659de6b-9931-447d-a383-9d9eb5655a3f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 200 len: 1437 microversion: 2.1 time: 0.197021 Aug 25 12:48:03.866536 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 683/1380] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:03 2022] GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 1437 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:03.877765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0073701-3065-4a68-bfbe-df07ac6ed7c1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a28edc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:04.064384 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d0073701-3065-4a68-bfbe-df07ac6ed7c1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1455 microversion: 2.1 time: 0.190308 Aug 25 12:48:04.070274 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 684/1381] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:03 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1455 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:04.095667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9f05010e-1359-4377-92f8-9142a74a8d65 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a1f3160>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:04.274900 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9f05010e-1359-4377-92f8-9142a74a8d65 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.202617 Aug 25 12:48:04.296907 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 685/1382] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:04 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:04.316753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:04.318261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:04.363262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:04.365237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:04.366221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:04.367788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:04.368808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:04.369776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:05.234486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:05.277137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:05.288252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:05.302405 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-571bd390-5cb6-4509-a8f2-3b8dfd15104b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 1.002461 Aug 25 12:48:05.304858 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 686/1383] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:04 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:05.331381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3e1aab95-112f-4411-8f4d-1647209efa07 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:05.336597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3e1aab95-112f-4411-8f4d-1647209efa07 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:05.375459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e1aab95-112f-4411-8f4d-1647209efa07 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:05.387920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e1aab95-112f-4411-8f4d-1647209efa07 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:05.388757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e1aab95-112f-4411-8f4d-1647209efa07 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:05.390181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e1aab95-112f-4411-8f4d-1647209efa07 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:05.394597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e1aab95-112f-4411-8f4d-1647209efa07 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:05.396988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e1aab95-112f-4411-8f4d-1647209efa07 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:05.924254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6716626d-19ef-4ee3-98a2-6040154303d4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:05.954996 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6716626d-19ef-4ee3-98a2-6040154303d4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1313 microversion: 2.1 time: 2.163255 Aug 25 12:48:05.956039 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 698/1384] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:03 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1313 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:05.978355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8e0b58bf-da5e-477c-ac2d-bad72a6fec02 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:05.979550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8e0b58bf-da5e-477c-ac2d-bad72a6fec02 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:06.002723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b58bf-da5e-477c-ac2d-bad72a6fec02 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:06.003665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b58bf-da5e-477c-ac2d-bad72a6fec02 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:06.005153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b58bf-da5e-477c-ac2d-bad72a6fec02 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:06.006618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b58bf-da5e-477c-ac2d-bad72a6fec02 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:06.007486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b58bf-da5e-477c-ac2d-bad72a6fec02 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:06.008306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b58bf-da5e-477c-ac2d-bad72a6fec02 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:06.204080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3e1aab95-112f-4411-8f4d-1647209efa07 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:06.226361 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3e1aab95-112f-4411-8f4d-1647209efa07 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1316 microversion: 2.1 time: 0.918916 Aug 25 12:48:06.232490 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 687/1385] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:05 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1316 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:06.239552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9f902e02-21bf-4e5f-aa1d-35cb697292d8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a59a940>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:06.394638 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9f902e02-21bf-4e5f-aa1d-35cb697292d8 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 200 len: 1437 microversion: 2.1 time: 0.163772 Aug 25 12:48:06.397100 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 688/1386] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:06 2022] GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 1437 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:06.424275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7bb55301-07b0-4878-8512-c5f7240e9a55 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a2a3670>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:06.606070 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7bb55301-07b0-4878-8512-c5f7240e9a55 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1455 microversion: 2.1 time: 0.197308 Aug 25 12:48:06.607793 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 689/1387] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:06 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1455 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:06.644510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-11bcb0df-9b46-4129-8385-5219f68b28d1 req-87482f3f-a931-426a-b5e9-2ba2684dff98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be43090-1175-4a7d-9223-f5ab4aa9644e", "tag": "08fdd51a-068b-41f6-acaf-5fb7677d3600"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:06.698466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-11bcb0df-9b46-4129-8385-5219f68b28d1 req-87482f3f-a931-426a-b5e9-2ba2684dff98 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:06.704248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-11bcb0df-9b46-4129-8385-5219f68b28d1 req-87482f3f-a931-426a-b5e9-2ba2684dff98 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:06.710676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-11bcb0df-9b46-4129-8385-5219f68b28d1 req-87482f3f-a931-426a-b5e9-2ba2684dff98 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:06.777644 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-11bcb0df-9b46-4129-8385-5219f68b28d1 req-87482f3f-a931-426a-b5e9-2ba2684dff98 service nova] Creating event network-changed:08fdd51a-068b-41f6-acaf-5fb7677d3600 for instance 7be43090-1175-4a7d-9223-f5ab4aa9644e on n-h2-852771-8 Aug 25 12:48:06.812970 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-11bcb0df-9b46-4129-8385-5219f68b28d1 req-87482f3f-a931-426a-b5e9-2ba2684dff98 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198758 Aug 25 12:48:06.816130 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 690/1388] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:06.835036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-92fea662-0519-4cdf-92a9-e52291ee339c tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a41e550>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:07.016139 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-92fea662-0519-4cdf-92a9-e52291ee339c tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.194062 Aug 25 12:48:07.018322 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 691/1389] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:06 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:07.031643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:07.035107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:07.054004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:07.055482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:07.056660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:07.059405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:07.060636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:07.061867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:07.230775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8e0b58bf-da5e-477c-ac2d-bad72a6fec02 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:07.261772 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8e0b58bf-da5e-477c-ac2d-bad72a6fec02 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1311 microversion: 2.1 time: 1.303778 Aug 25 12:48:07.271573 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 699/1390] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:05 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1311 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:07.295877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b3eb418e-1541-442d-adcf-92487cae0d79 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:07.297598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b3eb418e-1541-442d-adcf-92487cae0d79 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:07.323046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3eb418e-1541-442d-adcf-92487cae0d79 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:07.324437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3eb418e-1541-442d-adcf-92487cae0d79 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:07.325678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3eb418e-1541-442d-adcf-92487cae0d79 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:07.327397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3eb418e-1541-442d-adcf-92487cae0d79 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:07.328761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3eb418e-1541-442d-adcf-92487cae0d79 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:07.329450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3eb418e-1541-442d-adcf-92487cae0d79 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:07.923130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:07.968065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:07.972035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:07.976720 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a16591a5-ed0e-49fc-a5f0-5f95423dfcee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.954671 Aug 25 12:48:07.978330 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 692/1391] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:07 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:08.024453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b3eb418e-1541-442d-adcf-92487cae0d79 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:08.045396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c7df2fae-0bd6-41a7-b7a1-4afcec5b10b3 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:08.045943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c7df2fae-0bd6-41a7-b7a1-4afcec5b10b3 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:08.057210 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b3eb418e-1541-442d-adcf-92487cae0d79 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1313 microversion: 2.1 time: 0.783391 Aug 25 12:48:08.057837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7df2fae-0bd6-41a7-b7a1-4afcec5b10b3 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:08.058632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7df2fae-0bd6-41a7-b7a1-4afcec5b10b3 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:08.059398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7df2fae-0bd6-41a7-b7a1-4afcec5b10b3 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:08.061030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7df2fae-0bd6-41a7-b7a1-4afcec5b10b3 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:08.061896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7df2fae-0bd6-41a7-b7a1-4afcec5b10b3 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:08.062683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7df2fae-0bd6-41a7-b7a1-4afcec5b10b3 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:08.077623 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 700/1392] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:07 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:08.111464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29536f98-49d4-44a9-a623-a0b1fa56d240 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a49cc10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:08.274393 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29536f98-49d4-44a9-a623-a0b1fa56d240 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 200 len: 1437 microversion: 2.1 time: 0.191342 Aug 25 12:48:08.277737 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 701/1393] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:08 2022] GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 1437 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:08.290994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-7808598d-cab6-4ff2-bbf5-f64107d2b4e2 req-a0780358-bbc5-49a4-8df9-4c195009d6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb0cfcc-71e4-4326-b8d9-dcf129be2a48", "name": "network-vif-plugged", "status": "completed", "tag": "3e258a14-cb05-447b-b747-9cbe36ed9fc5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:08.318979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7808598d-cab6-4ff2-bbf5-f64107d2b4e2 req-a0780358-bbc5-49a4-8df9-4c195009d6fb service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:08.319838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7808598d-cab6-4ff2-bbf5-f64107d2b4e2 req-a0780358-bbc5-49a4-8df9-4c195009d6fb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:08.320614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7808598d-cab6-4ff2-bbf5-f64107d2b4e2 req-a0780358-bbc5-49a4-8df9-4c195009d6fb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:08.350190 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-7808598d-cab6-4ff2-bbf5-f64107d2b4e2 req-a0780358-bbc5-49a4-8df9-4c195009d6fb service nova] Creating event network-vif-plugged:3e258a14-cb05-447b-b747-9cbe36ed9fc5 for instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 on n-h1-852771-8 Aug 25 12:48:08.361477 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-7808598d-cab6-4ff2-bbf5-f64107d2b4e2 req-a0780358-bbc5-49a4-8df9-4c195009d6fb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080889 Aug 25 12:48:08.362634 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 702/1394] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:08.375187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-20ad1c52-7b00-4fb8-b704-2eb9cdecb032 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a6571f0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:08.475275 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-20ad1c52-7b00-4fb8-b704-2eb9cdecb032 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1455 microversion: 2.1 time: 0.109637 Aug 25 12:48:08.489767 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 703/1395] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:08 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:08.489767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c36c8f44-4690-496f-9ab0-10881f816dc3 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2ab83dc0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:08.583777 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c36c8f44-4690-496f-9ab0-10881f816dc3 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.104200 Aug 25 12:48:08.597458 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 704/1396] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:08 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:08.607460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0f631f8a-6e64-4ab7-bf3c-6bdcceb970d4 req-39614b1b-adfe-475d-b78b-90afcb0665a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18924dfe-fc9e-47d4-b4be-c249990c5455", "name": "network-vif-unplugged", "status": "completed", "tag": "c1a94bed-79da-44e9-a740-36d602c0c193"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:08.627837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0f631f8a-6e64-4ab7-bf3c-6bdcceb970d4 req-39614b1b-adfe-475d-b78b-90afcb0665a9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:08.632983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0f631f8a-6e64-4ab7-bf3c-6bdcceb970d4 req-39614b1b-adfe-475d-b78b-90afcb0665a9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:08.632983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0f631f8a-6e64-4ab7-bf3c-6bdcceb970d4 req-39614b1b-adfe-475d-b78b-90afcb0665a9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:08.662323 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0f631f8a-6e64-4ab7-bf3c-6bdcceb970d4 req-39614b1b-adfe-475d-b78b-90afcb0665a9 service nova] Creating event network-vif-unplugged:c1a94bed-79da-44e9-a740-36d602c0c193 for instance 18924dfe-fc9e-47d4-b4be-c249990c5455 on n-h1-852771-8 Aug 25 12:48:08.674209 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0f631f8a-6e64-4ab7-bf3c-6bdcceb970d4 req-39614b1b-adfe-475d-b78b-90afcb0665a9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073062 Aug 25 12:48:08.676080 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 705/1397] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:08.688439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f936f94-0655-4eb7-92e7-6619539628e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:08.690953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f936f94-0655-4eb7-92e7-6619539628e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:08.704825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f936f94-0655-4eb7-92e7-6619539628e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:08.705958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f936f94-0655-4eb7-92e7-6619539628e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:08.706902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f936f94-0655-4eb7-92e7-6619539628e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:08.709035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f936f94-0655-4eb7-92e7-6619539628e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:08.710564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f936f94-0655-4eb7-92e7-6619539628e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:08.711560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f936f94-0655-4eb7-92e7-6619539628e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:09.215646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c7df2fae-0bd6-41a7-b7a1-4afcec5b10b3 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:09.244030 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c7df2fae-0bd6-41a7-b7a1-4afcec5b10b3 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1316 microversion: 2.1 time: 1.209502 Aug 25 12:48:09.249331 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 693/1398] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:08 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1316 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:09.260227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:09.262968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:09.279687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:09.280692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:09.281635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:09.283634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:09.285000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:09.286750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:09.472067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2f936f94-0655-4eb7-92e7-6619539628e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:09.501609 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f936f94-0655-4eb7-92e7-6619539628e4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1311 microversion: 2.1 time: 0.822462 Aug 25 12:48:09.509855 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 706/1399] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:08 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1311 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:09.565430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea337881-76fa-4e41-9315-cc3ad1831ecd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:09.566516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ea337881-76fa-4e41-9315-cc3ad1831ecd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:09.614268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea337881-76fa-4e41-9315-cc3ad1831ecd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:09.616626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea337881-76fa-4e41-9315-cc3ad1831ecd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:09.617498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea337881-76fa-4e41-9315-cc3ad1831ecd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:09.619183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea337881-76fa-4e41-9315-cc3ad1831ecd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:09.624053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea337881-76fa-4e41-9315-cc3ad1831ecd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:09.624877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea337881-76fa-4e41-9315-cc3ad1831ecd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:09.944167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:09.985251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:09.989476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:09.992871 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df8d76aa-2e00-4b29-838a-13876c4bc40e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.741246 Aug 25 12:48:09.996562 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 694/1400] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:09 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:10.009673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b6b78e76-716d-4155-b0af-11512cb80e1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a486550>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:10.156237 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b6b78e76-716d-4155-b0af-11512cb80e1b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 200 len: 1437 microversion: 2.1 time: 0.156249 Aug 25 12:48:10.159165 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 695/1401] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:09 2022] GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 1437 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:10.170484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ece4c85-e5f4-49a6-8c3d-899fe529fc65 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2aa25430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:10.294203 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8ece4c85-e5f4-49a6-8c3d-899fe529fc65 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1455 microversion: 2.1 time: 0.131924 Aug 25 12:48:10.297277 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 696/1402] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:10 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:10.308169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d8a5178c-b4cc-4c36-b565-afae8c29f1ea tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a4659d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:10.372417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ea337881-76fa-4e41-9315-cc3ad1831ecd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:10.398225 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ea337881-76fa-4e41-9315-cc3ad1831ecd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1313 microversion: 2.1 time: 0.884392 Aug 25 12:48:10.401285 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 707/1403] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:09 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1313 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:10.416124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ecc510f-5832-4b3f-849d-1446cb2c22a5 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:10.418675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ecc510f-5832-4b3f-849d-1446cb2c22a5 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:10.475903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ecc510f-5832-4b3f-849d-1446cb2c22a5 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:10.486644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ecc510f-5832-4b3f-849d-1446cb2c22a5 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:10.490759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ecc510f-5832-4b3f-849d-1446cb2c22a5 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:10.502786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ecc510f-5832-4b3f-849d-1446cb2c22a5 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:10.509680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ecc510f-5832-4b3f-849d-1446cb2c22a5 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:10.510993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ecc510f-5832-4b3f-849d-1446cb2c22a5 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:10.512130 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d8a5178c-b4cc-4c36-b565-afae8c29f1ea tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.210767 Aug 25 12:48:10.533296 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 697/1404] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:10 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:10.570390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6d2a2ca3-fddf-4ae5-b527-76a6344ed80d req-f325db17-1d7d-4136-bb99-07c2c669bfbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7381daf9-37a3-47df-823d-69f8fc28e831", "name": "network-vif-plugged", "status": "completed", "tag": "a900949c-2275-4a57-b36f-a047eb00804e"}, {"server_uuid": "2408cea4-7716-49a5-a824-c5c508608abd", "name": "network-vif-plugged", "status": "completed", "tag": "54770f9e-bb74-47fc-b419-3406ae7bf420"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:10.639857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6d2a2ca3-fddf-4ae5-b527-76a6344ed80d req-f325db17-1d7d-4136-bb99-07c2c669bfbf service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:10.648006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6d2a2ca3-fddf-4ae5-b527-76a6344ed80d req-f325db17-1d7d-4136-bb99-07c2c669bfbf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:10.656379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6d2a2ca3-fddf-4ae5-b527-76a6344ed80d req-f325db17-1d7d-4136-bb99-07c2c669bfbf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:10.760199 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6d2a2ca3-fddf-4ae5-b527-76a6344ed80d req-f325db17-1d7d-4136-bb99-07c2c669bfbf service nova] Creating event network-vif-plugged:a900949c-2275-4a57-b36f-a047eb00804e for instance 7381daf9-37a3-47df-823d-69f8fc28e831 on n-h1-852771-8 Aug 25 12:48:10.765316 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6d2a2ca3-fddf-4ae5-b527-76a6344ed80d req-f325db17-1d7d-4136-bb99-07c2c669bfbf service nova] Creating event network-vif-plugged:54770f9e-bb74-47fc-b419-3406ae7bf420 for instance 2408cea4-7716-49a5-a824-c5c508608abd on n-h1-852771-8 Aug 25 12:48:10.807511 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6d2a2ca3-fddf-4ae5-b527-76a6344ed80d req-f325db17-1d7d-4136-bb99-07c2c669bfbf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.262706 Aug 25 12:48:10.815446 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 698/1405] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:10.836523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04138de8-f7a2-47d3-9dbc-71086f2a04d6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:10.841275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-04138de8-f7a2-47d3-9dbc-71086f2a04d6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:10.865029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04138de8-f7a2-47d3-9dbc-71086f2a04d6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:10.876826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04138de8-f7a2-47d3-9dbc-71086f2a04d6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:10.878186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04138de8-f7a2-47d3-9dbc-71086f2a04d6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:10.883420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04138de8-f7a2-47d3-9dbc-71086f2a04d6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:10.887763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04138de8-f7a2-47d3-9dbc-71086f2a04d6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:10.888969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04138de8-f7a2-47d3-9dbc-71086f2a04d6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:11.740514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2ecc510f-5832-4b3f-849d-1446cb2c22a5 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:11.772951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-04138de8-f7a2-47d3-9dbc-71086f2a04d6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:11.785995 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2ecc510f-5832-4b3f-849d-1446cb2c22a5 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1316 microversion: 2.1 time: 1.363632 Aug 25 12:48:11.810081 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 708/1406] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:10 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1316 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:11.843373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2956fd7c-73aa-4ffa-b0c4-4ec1ea231809 req-e257ca0f-a25a-4104-a544-1b2ef9e41c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18924dfe-fc9e-47d4-b4be-c249990c5455", "tag": "c1a94bed-79da-44e9-a740-36d602c0c193"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:11.849219 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-04138de8-f7a2-47d3-9dbc-71086f2a04d6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1311 microversion: 2.1 time: 1.027898 Aug 25 12:48:11.855588 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 699/1407] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:10 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1311 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:11.905895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:11.914375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:11.918743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:11.925770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2956fd7c-73aa-4ffa-b0c4-4ec1ea231809 req-e257ca0f-a25a-4104-a544-1b2ef9e41c5f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:11.930812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:11.949154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2956fd7c-73aa-4ffa-b0c4-4ec1ea231809 req-e257ca0f-a25a-4104-a544-1b2ef9e41c5f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:11.950244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2956fd7c-73aa-4ffa-b0c4-4ec1ea231809 req-e257ca0f-a25a-4104-a544-1b2ef9e41c5f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:11.984888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:11.999604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:12.011780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:12.015597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:12.021881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:12.023901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:12.039821 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2956fd7c-73aa-4ffa-b0c4-4ec1ea231809 req-e257ca0f-a25a-4104-a544-1b2ef9e41c5f service nova] Creating event network-changed:c1a94bed-79da-44e9-a740-36d602c0c193 for instance 18924dfe-fc9e-47d4-b4be-c249990c5455 on n-h1-852771-8 Aug 25 12:48:12.063705 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2956fd7c-73aa-4ffa-b0c4-4ec1ea231809 req-e257ca0f-a25a-4104-a544-1b2ef9e41c5f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240125 Aug 25 12:48:12.065341 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 709/1408] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:12.087578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-46b41308-94bd-4bf5-89f0-60c4416f5d0d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a780280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:12.801950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:12.843860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:12.856427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:12.859702 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e7e94b2-c557-45f7-9b7a-dda168933d77 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 1.001722 Aug 25 12:48:12.863125 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 700/1409] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:11 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:12.882466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0abf0afd-4d4a-4069-9bcc-c7071e9cade0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a553ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:21.547490 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-46b41308-94bd-4bf5-89f0-60c4416f5d0d tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 200 len: 1437 microversion: 2.1 time: 9.476090 Aug 25 12:48:21.577912 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 710/1410] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:12 2022] GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 1437 bytes in 9512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:21.587287 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0abf0afd-4d4a-4069-9bcc-c7071e9cade0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1464 microversion: 2.1 time: 8.719381 Aug 25 12:48:21.592053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0cb0326b-7005-46ad-9dbb-e6909e90caea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:21.592814 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 701/1411] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:12 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1464 bytes in 8728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:21.610670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0cb0326b-7005-46ad-9dbb-e6909e90caea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:21.615040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3d073a03-b634-427c-90cb-58502101f281 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a486160>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:21.633627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cb0326b-7005-46ad-9dbb-e6909e90caea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:21.636651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cb0326b-7005-46ad-9dbb-e6909e90caea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:21.643683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cb0326b-7005-46ad-9dbb-e6909e90caea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:21.643683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cb0326b-7005-46ad-9dbb-e6909e90caea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:21.643683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cb0326b-7005-46ad-9dbb-e6909e90caea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:21.643683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cb0326b-7005-46ad-9dbb-e6909e90caea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:22.028272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0cb0326b-7005-46ad-9dbb-e6909e90caea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:22.039872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:22.051504 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0cb0326b-7005-46ad-9dbb-e6909e90caea tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1463 microversion: 2.1 time: 0.470069 Aug 25 12:48:22.053100 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 711/1412] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:21 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1463 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:22.075237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fb4d45c5-69ad-40fc-b4b0-f6329cb7ac27 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:22.076741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fb4d45c5-69ad-40fc-b4b0-f6329cb7ac27 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:22.100703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb4d45c5-69ad-40fc-b4b0-f6329cb7ac27 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:22.102032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb4d45c5-69ad-40fc-b4b0-f6329cb7ac27 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:22.103126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb4d45c5-69ad-40fc-b4b0-f6329cb7ac27 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:22.104871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb4d45c5-69ad-40fc-b4b0-f6329cb7ac27 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:22.106201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb4d45c5-69ad-40fc-b4b0-f6329cb7ac27 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:22.107372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb4d45c5-69ad-40fc-b4b0-f6329cb7ac27 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:22.484849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fb4d45c5-69ad-40fc-b4b0-f6329cb7ac27 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:22.510230 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fb4d45c5-69ad-40fc-b4b0-f6329cb7ac27 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1316 microversion: 2.1 time: 0.454453 Aug 25 12:48:22.511745 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 712/1413] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:22 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:22.522320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7752cfed-9799-4048-8d5f-1fee8a2da971 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:22.524095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7752cfed-9799-4048-8d5f-1fee8a2da971 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:22.544799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7752cfed-9799-4048-8d5f-1fee8a2da971 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:22.546778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7752cfed-9799-4048-8d5f-1fee8a2da971 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:22.550719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7752cfed-9799-4048-8d5f-1fee8a2da971 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:22.553544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7752cfed-9799-4048-8d5f-1fee8a2da971 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:22.557368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7752cfed-9799-4048-8d5f-1fee8a2da971 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:22.558807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7752cfed-9799-4048-8d5f-1fee8a2da971 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:22.838156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=55 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:23.131653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7752cfed-9799-4048-8d5f-1fee8a2da971 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:23.154064 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7752cfed-9799-4048-8d5f-1fee8a2da971 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1311 microversion: 2.1 time: 0.639750 Aug 25 12:48:23.173948 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 713/1414] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:22 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1311 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:23.190353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:23.192274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:23.208605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:23.210181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:23.211354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:23.213065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:23.214344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:23.215703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:23.708692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:23.756996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:23.767731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:23.777838 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-379dad6b-09d7-427f-8bdf-ee632f7fd3f3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1814 microversion: 2.25 time: 0.599047 Aug 25 12:48:23.779523 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 714/1415] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:23 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1814 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:23.807061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-68dcaf1e-c2a4-450b-ace1-649557aa0aa5 req-5385b029-e4eb-42ad-9c6b-1e314253a40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9992927-34a0-45d7-97a6-640fcc718291", "name": "network-vif-plugged", "status": "completed", "tag": "be3062fa-b4a6-420c-a93f-db51f1259214"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:23.857259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-68dcaf1e-c2a4-450b-ace1-649557aa0aa5 req-5385b029-e4eb-42ad-9c6b-1e314253a40f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:23.862328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-68dcaf1e-c2a4-450b-ace1-649557aa0aa5 req-5385b029-e4eb-42ad-9c6b-1e314253a40f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:23.869205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-68dcaf1e-c2a4-450b-ace1-649557aa0aa5 req-5385b029-e4eb-42ad-9c6b-1e314253a40f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:23.930162 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-68dcaf1e-c2a4-450b-ace1-649557aa0aa5 req-5385b029-e4eb-42ad-9c6b-1e314253a40f service nova] Creating event network-vif-plugged:be3062fa-b4a6-420c-a93f-db51f1259214 for instance c9992927-34a0-45d7-97a6-640fcc718291 on n-h1-852771-8 Aug 25 12:48:23.955477 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-68dcaf1e-c2a4-450b-ace1-649557aa0aa5 req-5385b029-e4eb-42ad-9c6b-1e314253a40f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172013 Aug 25 12:48:23.961809 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 715/1416] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:23.991983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-939baea5-4940-4f58-a4ac-74d6ee472e91 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f824f713-4d07-4123-8af7-269a2b7ad808"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:24.009054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-939baea5-4940-4f58-a4ac-74d6ee472e91 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:24.074261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939baea5-4940-4f58-a4ac-74d6ee472e91 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:24.083836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939baea5-4940-4f58-a4ac-74d6ee472e91 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:24.090056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939baea5-4940-4f58-a4ac-74d6ee472e91 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:24.099411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939baea5-4940-4f58-a4ac-74d6ee472e91 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:24.104273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939baea5-4940-4f58-a4ac-74d6ee472e91 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:24.111501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939baea5-4940-4f58-a4ac-74d6ee472e91 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:25.540957 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-939baea5-4940-4f58-a4ac-74d6ee472e91 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "POST /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.573630 Aug 25 12:48:25.544270 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 716/1417] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 12:48:23 2022] POST /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments => generated 194 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:25.580284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7b9e65c-75df-44ba-9a08-4e025a8ad22f tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2ac47b80>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:34.036328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=13 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:34.073804 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3d073a03-b634-427c-90cb-58502101f281 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 12.478458 Aug 25 12:48:34.098256 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 702/1418] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:21 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 12504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:34.118660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e45f485b-944c-4fb1-ba60-bd0108c2b95f tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:34.122883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e45f485b-944c-4fb1-ba60-bd0108c2b95f tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:34.154954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45f485b-944c-4fb1-ba60-bd0108c2b95f tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.156456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45f485b-944c-4fb1-ba60-bd0108c2b95f tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.158201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45f485b-944c-4fb1-ba60-bd0108c2b95f tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:34.161370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45f485b-944c-4fb1-ba60-bd0108c2b95f tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.162879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45f485b-944c-4fb1-ba60-bd0108c2b95f tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.164151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45f485b-944c-4fb1-ba60-bd0108c2b95f tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:34.352867 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a7b9e65c-75df-44ba-9a08-4e025a8ad22f tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 200 len: 1464 microversion: 2.1 time: 8.803418 Aug 25 12:48:34.365078 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 717/1419] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:25 2022] GET /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 1464 bytes in 8820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:34.384212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-907c7fa3-a639-49ef-bf45-884c2b249214 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2aa52160>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:34.510384 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-907c7fa3-a639-49ef-bf45-884c2b249214 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 200 len: 1446 microversion: 2.1 time: 0.135886 Aug 25 12:48:34.512361 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 718/1420] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:34 2022] GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:34.523070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-87be2a5a-fdff-4b6a-b39a-75e62d1bc820 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:34.525130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-87be2a5a-fdff-4b6a-b39a-75e62d1bc820 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:34.540619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87be2a5a-fdff-4b6a-b39a-75e62d1bc820 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.542037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87be2a5a-fdff-4b6a-b39a-75e62d1bc820 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.543169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87be2a5a-fdff-4b6a-b39a-75e62d1bc820 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:34.545236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87be2a5a-fdff-4b6a-b39a-75e62d1bc820 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.546699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87be2a5a-fdff-4b6a-b39a-75e62d1bc820 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.547777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87be2a5a-fdff-4b6a-b39a-75e62d1bc820 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:34.558197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:34.652424 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e45f485b-944c-4fb1-ba60-bd0108c2b95f tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1614 microversion: 2.1 time: 0.549199 Aug 25 12:48:34.671165 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 703/1421] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:34 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1614 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:34.695332 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 12:48:34.695760 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 12:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e (ip 10.222.0.70) !!! Aug 25 12:48:34.716073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-904a5461-3f47-4028-849b-4c71035155ec tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:34.732452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-904a5461-3f47-4028-849b-4c71035155ec tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:34.746181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-904a5461-3f47-4028-849b-4c71035155ec tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.747600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-904a5461-3f47-4028-849b-4c71035155ec tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.748694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-904a5461-3f47-4028-849b-4c71035155ec tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:34.750396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-904a5461-3f47-4028-849b-4c71035155ec tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.751570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-904a5461-3f47-4028-849b-4c71035155ec tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.752596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-904a5461-3f47-4028-849b-4c71035155ec tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:35.056846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-87be2a5a-fdff-4b6a-b39a-75e62d1bc820 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.088719 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-87be2a5a-fdff-4b6a-b39a-75e62d1bc820 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1316 microversion: 2.1 time: 0.570098 Aug 25 12:48:35.117622 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 719/1422] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:34 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1316 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:35.132254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:35.134187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:35.147434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:35.148718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:35.149871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:35.151519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:35.152725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:35.153875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:35.413218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-904a5461-3f47-4028-849b-4c71035155ec tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.467916 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-904a5461-3f47-4028-849b-4c71035155ec tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1493 microversion: 2.1 time: 0.767927 Aug 25 12:48:35.478397 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 704/1423] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:34 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1493 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:35.515529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-57f6b051-56b3-4ce5-b7e1-5e99c3e7804f req-7ddbdba7-7105-4203-b7a1-bd4274034d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be43090-1175-4a7d-9223-f5ab4aa9644e", "name": "network-vif-plugged", "status": "completed", "tag": "08fdd51a-068b-41f6-acaf-5fb7677d3600"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:35.571432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.588127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-57f6b051-56b3-4ce5-b7e1-5e99c3e7804f req-7ddbdba7-7105-4203-b7a1-bd4274034d86 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:35.590125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-57f6b051-56b3-4ce5-b7e1-5e99c3e7804f req-7ddbdba7-7105-4203-b7a1-bd4274034d86 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:35.592809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-57f6b051-56b3-4ce5-b7e1-5e99c3e7804f req-7ddbdba7-7105-4203-b7a1-bd4274034d86 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:35.651446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.664959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.670954 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-acbee943-aeb5-40fb-8e03-1be0dd8de3c5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1804 microversion: 2.25 time: 0.548037 Aug 25 12:48:35.672024 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 720/1424] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:35 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1804 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:35.673009 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-57f6b051-56b3-4ce5-b7e1-5e99c3e7804f req-7ddbdba7-7105-4203-b7a1-bd4274034d86 service nova] Creating event network-vif-plugged:08fdd51a-068b-41f6-acaf-5fb7677d3600 for instance 7be43090-1175-4a7d-9223-f5ab4aa9644e on n-h2-852771-8 Aug 25 12:48:35.692158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e43afe2b-9092-4790-8831-a452b857ebd5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:35.694034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e43afe2b-9092-4790-8831-a452b857ebd5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:35.697981 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-57f6b051-56b3-4ce5-b7e1-5e99c3e7804f req-7ddbdba7-7105-4203-b7a1-bd4274034d86 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215756 Aug 25 12:48:35.705493 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 705/1425] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:35.743293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1aa03bb7-d16b-4127-888b-28bf9e8ded80 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a549820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:35.744806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e43afe2b-9092-4790-8831-a452b857ebd5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:35.752328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e43afe2b-9092-4790-8831-a452b857ebd5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:35.753886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e43afe2b-9092-4790-8831-a452b857ebd5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:35.755350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e43afe2b-9092-4790-8831-a452b857ebd5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:35.756247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e43afe2b-9092-4790-8831-a452b857ebd5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:35.757037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e43afe2b-9092-4790-8831-a452b857ebd5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:35.929015 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1aa03bb7-d16b-4127-888b-28bf9e8ded80 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 200 len: 1446 microversion: 2.1 time: 0.208694 Aug 25 12:48:35.930153 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 706/1426] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:35 2022] GET /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 1446 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:35.960425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:35.961953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:35.979571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:35.980474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:35.981305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:35.982697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:35.983558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:35.984446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:36.239474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3d9afd4814084dbb981915bda2561dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003da7f4157a4743b31f0b5faaab9e91', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:36.240844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] flavor_id is None. Assuming migration. {{(pid=129059) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 25 12:48:36.241969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129059) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 12:48:36.308946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e43afe2b-9092-4790-8831-a452b857ebd5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:36.341859 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e43afe2b-9092-4790-8831-a452b857ebd5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55" status: 200 len: 1467 microversion: 2.1 time: 0.661525 Aug 25 12:48:36.342937 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 721/1427] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:35 2022] GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55 => generated 1467 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:36.358277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d07a33f9-1ac1-4360-9d64-88e1db031d31 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a6db5e0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:36.692160 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d07a33f9-1ac1-4360-9d64-88e1db031d31 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.346191 Aug 25 12:48:36.696260 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 722/1428] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:36 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:36.714608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3988459d-cbba-4c1f-a9df-75961ab3c667 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:36.719043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3988459d-cbba-4c1f-a9df-75961ab3c667 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:36.745380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3988459d-cbba-4c1f-a9df-75961ab3c667 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:36.752340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3988459d-cbba-4c1f-a9df-75961ab3c667 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:36.754892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3988459d-cbba-4c1f-a9df-75961ab3c667 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:36.761447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3988459d-cbba-4c1f-a9df-75961ab3c667 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:36.762404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3988459d-cbba-4c1f-a9df-75961ab3c667 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:36.763219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3988459d-cbba-4c1f-a9df-75961ab3c667 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:37.128019 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3988459d-cbba-4c1f-a9df-75961ab3c667 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1644 microversion: 2.1 time: 0.429262 Aug 25 12:48:37.143803 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 723/1429] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:36 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1644 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:37.181141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea8de56b-6b0c-4a27-8062-64b5d58ec455 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '.version_select at 0x7f3a2ab83dc0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:37.188938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea8de56b-6b0c-4a27-8062-64b5d58ec455 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:37.189892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea8de56b-6b0c-4a27-8062-64b5d58ec455 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:37.191658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea8de56b-6b0c-4a27-8062-64b5d58ec455 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:37.221433 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ea8de56b-6b0c-4a27-8062-64b5d58ec455 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 2961 microversion: 2.25 time: 0.075032 Aug 25 12:48:37.229607 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 724/1430] 10.222.0.70 () {60 vars in 1184 bytes} [Thu Aug 25 12:48:37 2022] GET /compute/v2.1/os-migrations => generated 2961 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:37.237591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47e9c8a7-93f6-4c9e-a9b9-58d773fa4d79 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a585f70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:37.316641 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bf3f9531-2d9e-456b-a0c5-65a4bd55ff2d tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd/action" status: 202 len: 0 microversion: 2.1 time: 1.366679 Aug 25 12:48:37.321888 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 707/1431] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:48:35 2022] POST /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd/action => generated 0 bytes in 1391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:37.343509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52ffde21-ed75-490e-be9f-3ca3e5965ca6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:37.345364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52ffde21-ed75-490e-be9f-3ca3e5965ca6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:37.390314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ffde21-ed75-490e-be9f-3ca3e5965ca6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:37.399595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ffde21-ed75-490e-be9f-3ca3e5965ca6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:37.403346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ffde21-ed75-490e-be9f-3ca3e5965ca6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:37.405109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ffde21-ed75-490e-be9f-3ca3e5965ca6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:37.408357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ffde21-ed75-490e-be9f-3ca3e5965ca6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:37.409412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ffde21-ed75-490e-be9f-3ca3e5965ca6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:38.772643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52ffde21-ed75-490e-be9f-3ca3e5965ca6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:38.807224 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52ffde21-ed75-490e-be9f-3ca3e5965ca6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1316 microversion: 2.1 time: 1.479677 Aug 25 12:48:38.809209 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 708/1432] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:37 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1316 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:38.842512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ff71a4a-560b-4200-a6b2-c66598bbdfa3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1770866602"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:38.858922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5ff71a4a-560b-4200-a6b2-c66598bbdfa3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:38.897894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ff71a4a-560b-4200-a6b2-c66598bbdfa3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:38.902552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ff71a4a-560b-4200-a6b2-c66598bbdfa3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:38.904557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ff71a4a-560b-4200-a6b2-c66598bbdfa3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:38.913242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ff71a4a-560b-4200-a6b2-c66598bbdfa3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:38.914289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ff71a4a-560b-4200-a6b2-c66598bbdfa3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:38.915736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ff71a4a-560b-4200-a6b2-c66598bbdfa3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:39.436913 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47e9c8a7-93f6-4c9e-a9b9-58d773fa4d79 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 204 len: 0 microversion: 2.1 time: 2.211668 Aug 25 12:48:39.440021 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 725/1433] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:37 2022] DELETE /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 0 bytes in 2216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:48:39.456775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-94245f8e-07e3-40d1-be67-c774c060c942 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:39.461433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-94245f8e-07e3-40d1-be67-c774c060c942 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:39.518561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94245f8e-07e3-40d1-be67-c774c060c942 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:39.527478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94245f8e-07e3-40d1-be67-c774c060c942 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:39.529958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94245f8e-07e3-40d1-be67-c774c060c942 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:39.535934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94245f8e-07e3-40d1-be67-c774c060c942 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:39.551875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94245f8e-07e3-40d1-be67-c774c060c942 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:39.571347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94245f8e-07e3-40d1-be67-c774c060c942 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:40.099121 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ff71a4a-560b-4200-a6b2-c66598bbdfa3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "POST /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6/action" status: 202 len: 0 microversion: 2.1 time: 1.284365 Aug 25 12:48:40.118413 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 709/1434] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:48:38 2022] POST /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6/action => generated 0 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:48:40.131034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7071060f-3741-4ba8-9532-419042eeaeb3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:40.132789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7071060f-3741-4ba8-9532-419042eeaeb3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:40.150278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7071060f-3741-4ba8-9532-419042eeaeb3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:40.152402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7071060f-3741-4ba8-9532-419042eeaeb3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:40.153420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7071060f-3741-4ba8-9532-419042eeaeb3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:40.155346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7071060f-3741-4ba8-9532-419042eeaeb3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:40.156772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7071060f-3741-4ba8-9532-419042eeaeb3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:40.159149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7071060f-3741-4ba8-9532-419042eeaeb3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:40.421380 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-94245f8e-07e3-40d1-be67-c774c060c942 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1644 microversion: 2.1 time: 0.978081 Aug 25 12:48:40.427605 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 726/1435] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:39 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1644 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:40.449600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d638406e-6c5c-4e38-8d83-516b90b58130 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:40.455637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d638406e-6c5c-4e38-8d83-516b90b58130 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:40.484214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d638406e-6c5c-4e38-8d83-516b90b58130 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:40.485835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d638406e-6c5c-4e38-8d83-516b90b58130 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:40.489161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d638406e-6c5c-4e38-8d83-516b90b58130 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:40.490999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d638406e-6c5c-4e38-8d83-516b90b58130 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:40.492336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d638406e-6c5c-4e38-8d83-516b90b58130 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:40.493592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d638406e-6c5c-4e38-8d83-516b90b58130 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:40.783207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-7071060f-3741-4ba8-9532-419042eeaeb3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid 18924dfe-fc9e-47d4-b4be-c249990c5455 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:48:40.833899 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7071060f-3741-4ba8-9532-419042eeaeb3 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 2422 microversion: 2.25 time: 0.712964 Aug 25 12:48:40.837565 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 710/1436] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:40 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 2422 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:40.843674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d124084e-4ec8-4854-a5b0-e930923a1bc2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a553ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:40.955183 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d124084e-4ec8-4854-a5b0-e930923a1bc2 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.117940 Aug 25 12:48:40.957048 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 711/1437] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:40 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:40.991867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2cfae483-f7f0-4fde-b18e-dc1a800baddd req-b9114c6f-b0e9-40a4-bfc1-47f49899adf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01013692-8e62-49a8-81b9-7f7cdd4a5a55", "name": "network-vif-unplugged", "status": "completed", "tag": "73f30782-4779-447f-ba20-d60dfbdf553d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:41.012582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2cfae483-f7f0-4fde-b18e-dc1a800baddd req-b9114c6f-b0e9-40a4-bfc1-47f49899adf5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.013394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2cfae483-f7f0-4fde-b18e-dc1a800baddd req-b9114c6f-b0e9-40a4-bfc1-47f49899adf5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.033630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2cfae483-f7f0-4fde-b18e-dc1a800baddd req-b9114c6f-b0e9-40a4-bfc1-47f49899adf5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.074891 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2cfae483-f7f0-4fde-b18e-dc1a800baddd req-b9114c6f-b0e9-40a4-bfc1-47f49899adf5 service nova] Creating event network-vif-unplugged:73f30782-4779-447f-ba20-d60dfbdf553d for instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 on n-h2-852771-8 Aug 25 12:48:41.088127 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2cfae483-f7f0-4fde-b18e-dc1a800baddd req-b9114c6f-b0e9-40a4-bfc1-47f49899adf5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104374 Aug 25 12:48:41.089834 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 712/1438] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:41.104174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8176b557-4ce2-4749-b68d-f25497af616c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:41.107509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8176b557-4ce2-4749-b68d-f25497af616c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:41.127144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8176b557-4ce2-4749-b68d-f25497af616c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.129921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8176b557-4ce2-4749-b68d-f25497af616c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.131396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8176b557-4ce2-4749-b68d-f25497af616c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.133246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8176b557-4ce2-4749-b68d-f25497af616c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.134781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8176b557-4ce2-4749-b68d-f25497af616c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.137301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8176b557-4ce2-4749-b68d-f25497af616c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.152556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d638406e-6c5c-4e38-8d83-516b90b58130 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:41.167385 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d638406e-6c5c-4e38-8d83-516b90b58130 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1472 microversion: 2.1 time: 0.734372 Aug 25 12:48:41.169424 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 727/1439] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:40 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1472 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:41.181200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a4382c71-419c-402a-9598-fcaa0813c42d tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:41.183406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a4382c71-419c-402a-9598-fcaa0813c42d tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:41.199527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4382c71-419c-402a-9598-fcaa0813c42d tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.200871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4382c71-419c-402a-9598-fcaa0813c42d tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.202521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4382c71-419c-402a-9598-fcaa0813c42d tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.204408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4382c71-419c-402a-9598-fcaa0813c42d tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.205709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4382c71-419c-402a-9598-fcaa0813c42d tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.206955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4382c71-419c-402a-9598-fcaa0813c42d tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.236851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8176b557-4ce2-4749-b68d-f25497af616c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:48:41.500648 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8176b557-4ce2-4749-b68d-f25497af616c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 204 len: 0 microversion: 2.1 time: 0.406783 Aug 25 12:48:41.507717 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 713/1440] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:48:41 2022] DELETE /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:48:41.520411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5f98ce18-41f8-4bab-b575-a42ca97d8ab2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a4e43a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:41.649234 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5f98ce18-41f8-4bab-b575-a42ca97d8ab2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1455 microversion: 2.1 time: 0.138754 Aug 25 12:48:41.651233 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 714/1441] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:41 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:41.662036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-126499ed-fdae-4b54-8e8a-f6cc355e38c5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:41.679999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126499ed-fdae-4b54-8e8a-f6cc355e38c5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.687795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126499ed-fdae-4b54-8e8a-f6cc355e38c5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.688980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126499ed-fdae-4b54-8e8a-f6cc355e38c5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.691460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126499ed-fdae-4b54-8e8a-f6cc355e38c5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.692440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126499ed-fdae-4b54-8e8a-f6cc355e38c5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.693243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126499ed-fdae-4b54-8e8a-f6cc355e38c5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.751656 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-126499ed-fdae-4b54-8e8a-f6cc355e38c5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.098634 Aug 25 12:48:41.754157 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 715/1442] 10.222.0.70 () {58 vars in 1176 bytes} [Thu Aug 25 12:48:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:41.762628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6892451d-cd5a-40d6-b191-8f1bebc6907d tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:41.764377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6892451d-cd5a-40d6-b191-8f1bebc6907d tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:41.783177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6892451d-cd5a-40d6-b191-8f1bebc6907d tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.783177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6892451d-cd5a-40d6-b191-8f1bebc6907d tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.783177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6892451d-cd5a-40d6-b191-8f1bebc6907d tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.789730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6892451d-cd5a-40d6-b191-8f1bebc6907d tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.791094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6892451d-cd5a-40d6-b191-8f1bebc6907d tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.792152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6892451d-cd5a-40d6-b191-8f1bebc6907d tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.822666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a4382c71-419c-402a-9598-fcaa0813c42d tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:41.853937 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a4382c71-419c-402a-9598-fcaa0813c42d tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1504 microversion: 2.1 time: 0.679852 Aug 25 12:48:41.861645 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 728/1443] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:41 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1504 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:41.883597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-184567565", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "94927505-3265-4f82-8562-0d8ecd51bf76"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:42.058903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] validate_networks() for [('94927505-3265-4f82-8562-0d8ecd51bf76', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:48:42.495814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-6892451d-cd5a-40d6-b191-8f1bebc6907d tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid 18924dfe-fc9e-47d4-b4be-c249990c5455 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:48:42.531684 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6892451d-cd5a-40d6-b191-8f1bebc6907d tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 2422 microversion: 2.25 time: 0.776054 Aug 25 12:48:42.546321 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 716/1444] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:41 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 2422 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:42.583288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-51bbb99c-2846-4238-9d27-7c3778ba0162 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:42.585327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-51bbb99c-2846-4238-9d27-7c3778ba0162 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:42.598902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bbb99c-2846-4238-9d27-7c3778ba0162 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:42.600129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bbb99c-2846-4238-9d27-7c3778ba0162 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:42.613664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bbb99c-2846-4238-9d27-7c3778ba0162 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:42.625447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bbb99c-2846-4238-9d27-7c3778ba0162 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:42.626645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bbb99c-2846-4238-9d27-7c3778ba0162 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:42.627487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bbb99c-2846-4238-9d27-7c3778ba0162 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:42.865306 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-51bbb99c-2846-4238-9d27-7c3778ba0162 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291/action" status: 202 len: 0 microversion: 2.1 time: 0.313771 Aug 25 12:48:42.871844 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 717/1445] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:48:42 2022] POST /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:42.889564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5c71ca60-deb3-4dbc-a7ad-511fd72b9639 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:42.892203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5c71ca60-deb3-4dbc-a7ad-511fd72b9639 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:42.904654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c71ca60-deb3-4dbc-a7ad-511fd72b9639 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:42.905781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c71ca60-deb3-4dbc-a7ad-511fd72b9639 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:42.906543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c71ca60-deb3-4dbc-a7ad-511fd72b9639 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:42.908863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c71ca60-deb3-4dbc-a7ad-511fd72b9639 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:42.909989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c71ca60-deb3-4dbc-a7ad-511fd72b9639 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:42.910874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c71ca60-deb3-4dbc-a7ad-511fd72b9639 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:42.919543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:42.965148 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5c71ca60-deb3-4dbc-a7ad-511fd72b9639 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e/ips" status: 200 len: 108 microversion: 2.1 time: 0.091808 Aug 25 12:48:42.979371 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 718/1446] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 12:48:42 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e/ips => generated 108 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:42.988670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-748ff19d-79b3-4817-b40f-8d7d867bc5a8 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a5e5430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:43.161814 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-748ff19d-79b3-4817-b40f-8d7d867bc5a8 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.177471 Aug 25 12:48:43.179409 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 719/1447] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:42 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:43.199909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed404d25-45e5-4437-b0ac-623144c73b4b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:43.201138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ed404d25-45e5-4437-b0ac-623144c73b4b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:43.236328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed404d25-45e5-4437-b0ac-623144c73b4b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:43.237906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed404d25-45e5-4437-b0ac-623144c73b4b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:43.238798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed404d25-45e5-4437-b0ac-623144c73b4b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:43.249055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed404d25-45e5-4437-b0ac-623144c73b4b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:43.250150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed404d25-45e5-4437-b0ac-623144c73b4b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:43.251611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed404d25-45e5-4437-b0ac-623144c73b4b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:43.537733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:48:43.538668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:48:43.539198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:48:43.539943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:48:43.540705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:48:43.566303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:43.568411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:43.569949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:43.571929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:43.573418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:43.574787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:43.619717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Getting quotas for project da51872cc1924bb99ee10d4a28cfb2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:48:43.631524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Getting quotas for user 2db6a11f66554018ba91a5fabb891492 and project da51872cc1924bb99ee10d4a28cfb2a1. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:48:43.692651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:48:43.702172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:48:43.741880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ed404d25-45e5-4437-b0ac-623144c73b4b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:43.763385 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ed404d25-45e5-4437-b0ac-623144c73b4b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1472 microversion: 2.1 time: 0.576624 Aug 25 12:48:43.769306 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 720/1448] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:43 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1472 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:43.794196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cff7d8bc-ddae-4983-9f98-f7b97ca65f5e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a1f3f70>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:43.842382 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dea13fd6-7846-4b90-95d1-e6f1758dcf72 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.977694 Aug 25 12:48:43.844552 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 729/1449] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:48:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:48:43.856608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0e56a4a1-e39f-488a-b6ea-dfb1af90127c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:43.858828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0e56a4a1-e39f-488a-b6ea-dfb1af90127c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:43.873665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0e56a4a1-e39f-488a-b6ea-dfb1af90127c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:43.875047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0e56a4a1-e39f-488a-b6ea-dfb1af90127c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:43.876355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0e56a4a1-e39f-488a-b6ea-dfb1af90127c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:43.879703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0e56a4a1-e39f-488a-b6ea-dfb1af90127c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:43.881675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0e56a4a1-e39f-488a-b6ea-dfb1af90127c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:43.883042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0e56a4a1-e39f-488a-b6ea-dfb1af90127c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:44.005292 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cff7d8bc-ddae-4983-9f98-f7b97ca65f5e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1455 microversion: 2.1 time: 0.232990 Aug 25 12:48:44.020192 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 721/1450] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:43 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1455 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:44.056370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-69cffa2f-e48a-4793-95ad-9dc677dc89c7 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:44.058169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-69cffa2f-e48a-4793-95ad-9dc677dc89c7 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:44.092995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cffa2f-e48a-4793-95ad-9dc677dc89c7 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:44.094122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cffa2f-e48a-4793-95ad-9dc677dc89c7 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:44.095159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cffa2f-e48a-4793-95ad-9dc677dc89c7 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:44.099297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cffa2f-e48a-4793-95ad-9dc677dc89c7 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:44.105729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cffa2f-e48a-4793-95ad-9dc677dc89c7 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:44.106788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cffa2f-e48a-4793-95ad-9dc677dc89c7 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:44.228662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-0e56a4a1-e39f-488a-b6ea-dfb1af90127c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lazy-loading 'services' on Instance uuid 18924dfe-fc9e-47d4-b4be-c249990c5455 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:48:44.807941 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0e56a4a1-e39f-488a-b6ea-dfb1af90127c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "DELETE /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments/ea7856ef-1ff3-4836-9e5f-e125204aa007" status: 202 len: 0 microversion: 2.25 time: 0.952433 Aug 25 12:48:44.809222 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 730/1451] 10.222.0.70 () {60 vars in 1457 bytes} [Thu Aug 25 12:48:43 2022] DELETE /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments/ea7856ef-1ff3-4836-9e5f-e125204aa007 => generated 0 bytes in 964 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:48:44.865641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1444a989-472d-4ced-a63e-51dab6952164 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:44.872537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1444a989-472d-4ced-a63e-51dab6952164 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:44.913298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1444a989-472d-4ced-a63e-51dab6952164 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:44.917050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1444a989-472d-4ced-a63e-51dab6952164 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:44.924092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1444a989-472d-4ced-a63e-51dab6952164 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:44.927745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1444a989-472d-4ced-a63e-51dab6952164 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:44.934650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1444a989-472d-4ced-a63e-51dab6952164 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:44.950307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1444a989-472d-4ced-a63e-51dab6952164 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:45.134538 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1444a989-472d-4ced-a63e-51dab6952164 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e/ips" status: 200 len: 108 microversion: 2.1 time: 0.303543 Aug 25 12:48:45.153813 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 731/1452] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 12:48:44 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e/ips => generated 108 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:45.166269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f8bf9c34-6d62-452d-bb83-6c3f7cb8de3f req-52a09359-4e71-478e-b7c1-046e8c7673db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7381daf9-37a3-47df-823d-69f8fc28e831", "name": "network-vif-unplugged", "status": "completed", "tag": "a900949c-2275-4a57-b36f-a047eb00804e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:45.207768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f8bf9c34-6d62-452d-bb83-6c3f7cb8de3f req-52a09359-4e71-478e-b7c1-046e8c7673db service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:45.209458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f8bf9c34-6d62-452d-bb83-6c3f7cb8de3f req-52a09359-4e71-478e-b7c1-046e8c7673db service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:45.210462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f8bf9c34-6d62-452d-bb83-6c3f7cb8de3f req-52a09359-4e71-478e-b7c1-046e8c7673db service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:45.224247 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-69cffa2f-e48a-4793-95ad-9dc677dc89c7 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1629 microversion: 2.1 time: 1.202128 Aug 25 12:48:45.248139 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 722/1453] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:44 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1629 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:45.265164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-322957c2-5035-4933-a6d5-eef802f0b607 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:45.266449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-322957c2-5035-4933-a6d5-eef802f0b607 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:45.315615 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f8bf9c34-6d62-452d-bb83-6c3f7cb8de3f req-52a09359-4e71-478e-b7c1-046e8c7673db service nova] Creating event network-vif-unplugged:a900949c-2275-4a57-b36f-a047eb00804e for instance 7381daf9-37a3-47df-823d-69f8fc28e831 on n-h1-852771-8 Aug 25 12:48:45.351999 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f8bf9c34-6d62-452d-bb83-6c3f7cb8de3f req-52a09359-4e71-478e-b7c1-046e8c7673db service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.207645 Aug 25 12:48:45.355192 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 732/1454] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:45.391293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fb71bcf1-de8c-4673-a21e-fbb48a0473ff tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a585c10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:45.697116 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fb71bcf1-de8c-4673-a21e-fbb48a0473ff tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.334173 Aug 25 12:48:45.700936 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 733/1455] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:45 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:45.732915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d390136f-56e5-46e2-9ccc-f3276af6e6ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:45.735738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d390136f-56e5-46e2-9ccc-f3276af6e6ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:45.791050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d390136f-56e5-46e2-9ccc-f3276af6e6ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:45.794391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d390136f-56e5-46e2-9ccc-f3276af6e6ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:45.811112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d390136f-56e5-46e2-9ccc-f3276af6e6ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:45.818976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d390136f-56e5-46e2-9ccc-f3276af6e6ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:45.822160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d390136f-56e5-46e2-9ccc-f3276af6e6ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:45.827479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d390136f-56e5-46e2-9ccc-f3276af6e6ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:45.926599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-322957c2-5035-4933-a6d5-eef802f0b607 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:45.967177 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-322957c2-5035-4933-a6d5-eef802f0b607 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1207 microversion: 2.1 time: 0.716810 Aug 25 12:48:45.968823 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 723/1456] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:45 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1207 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:45.997597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8456e914-699e-4fc3-9f35-c4a4e7a1a4c7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:46.023853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8456e914-699e-4fc3-9f35-c4a4e7a1a4c7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:46.056705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8456e914-699e-4fc3-9f35-c4a4e7a1a4c7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:46.058148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8456e914-699e-4fc3-9f35-c4a4e7a1a4c7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:46.059490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8456e914-699e-4fc3-9f35-c4a4e7a1a4c7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:46.061276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8456e914-699e-4fc3-9f35-c4a4e7a1a4c7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:46.072276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8456e914-699e-4fc3-9f35-c4a4e7a1a4c7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:46.074373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8456e914-699e-4fc3-9f35-c4a4e7a1a4c7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:46.238573 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8456e914-699e-4fc3-9f35-c4a4e7a1a4c7 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.261663 Aug 25 12:48:46.244609 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 724/1457] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 12:48:45 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments => generated 197 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:48:46.267724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86060926-0107-4a61-a858-b39410c50a28 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a5e53a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:46.482140 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-86060926-0107-4a61-a858-b39410c50a28 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1455 microversion: 2.1 time: 0.234818 Aug 25 12:48:46.499078 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 725/1458] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:46 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1455 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:46.538198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b1b76d7-1316-45f7-8398-7e4531d52b3e tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:46.547526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b1b76d7-1316-45f7-8398-7e4531d52b3e tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:46.633255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b1b76d7-1316-45f7-8398-7e4531d52b3e tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:46.639380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b1b76d7-1316-45f7-8398-7e4531d52b3e tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:46.643352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b1b76d7-1316-45f7-8398-7e4531d52b3e tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:46.649601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b1b76d7-1316-45f7-8398-7e4531d52b3e tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:46.653205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b1b76d7-1316-45f7-8398-7e4531d52b3e tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:46.656096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b1b76d7-1316-45f7-8398-7e4531d52b3e tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:46.865612 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b1b76d7-1316-45f7-8398-7e4531d52b3e tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e/ips/tempest-ServerAddressesTestJSON-577438314-network" status: 200 len: 93 microversion: 2.1 time: 0.351232 Aug 25 12:48:46.867394 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 726/1459] 10.222.0.70 () {58 vars in 1398 bytes} [Thu Aug 25 12:48:46 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e/ips/tempest-ServerAddressesTestJSON-577438314-network => generated 93 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:48:46.877968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852771-8", "block_migration": true, "disk_over_commit": false}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:46.898495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:46.935869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:46.941753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:46.944484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:46.946389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:46.947139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d390136f-56e5-46e2-9ccc-f3276af6e6ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:46.949687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:46.950498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:46.976693 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d390136f-56e5-46e2-9ccc-f3276af6e6ae tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1472 microversion: 2.1 time: 1.266179 Aug 25 12:48:46.979317 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 734/1460] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:45 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1472 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:47.026563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6aee461-da85-4173-ad44-e4f6f4187c38 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a3609d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:47.146644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lazy-loading 'flavor' on Instance uuid c9992927-34a0-45d7-97a6-640fcc718291 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:48:47.250632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Going to try to live migrate instance to n-h2-852771-8 {{(pid=129059) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:48:47.259116 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6aee461-da85-4173-ad44-e4f6f4187c38 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1424 microversion: 2.1 time: 0.274426 Aug 25 12:48:47.261461 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 735/1461] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:46 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1424 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:47.306999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-584b052c-0a37-4216-a398-99166f8e9429 req-980eebdf-c269-4586-b9f3-8cbe9ef9b0dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7381daf9-37a3-47df-823d-69f8fc28e831", "name": "network-vif-deleted", "tag": "a900949c-2275-4a57-b36f-a047eb00804e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:47.350461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-584b052c-0a37-4216-a398-99166f8e9429 req-980eebdf-c269-4586-b9f3-8cbe9ef9b0dc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:47.352729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-584b052c-0a37-4216-a398-99166f8e9429 req-980eebdf-c269-4586-b9f3-8cbe9ef9b0dc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:47.353027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-584b052c-0a37-4216-a398-99166f8e9429 req-980eebdf-c269-4586-b9f3-8cbe9ef9b0dc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:47.406701 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-584b052c-0a37-4216-a398-99166f8e9429 req-980eebdf-c269-4586-b9f3-8cbe9ef9b0dc service nova] Creating event network-vif-deleted:a900949c-2275-4a57-b36f-a047eb00804e for instance 7381daf9-37a3-47df-823d-69f8fc28e831 on n-h1-852771-8 Aug 25 12:48:47.424127 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-584b052c-0a37-4216-a398-99166f8e9429 req-980eebdf-c269-4586-b9f3-8cbe9ef9b0dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159138 Aug 25 12:48:47.435760 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 736/1462] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:47.448450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb42432d-68e5-4210-bed6-465a8db8ca42 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:47.451352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb42432d-68e5-4210-bed6-465a8db8ca42 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:47.470249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb42432d-68e5-4210-bed6-465a8db8ca42 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:47.474208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb42432d-68e5-4210-bed6-465a8db8ca42 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:47.475604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb42432d-68e5-4210-bed6-465a8db8ca42 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:47.477805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb42432d-68e5-4210-bed6-465a8db8ca42 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:47.481334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb42432d-68e5-4210-bed6-465a8db8ca42 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:47.483765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb42432d-68e5-4210-bed6-465a8db8ca42 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:47.560746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb42432d-68e5-4210-bed6-465a8db8ca42 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:48:47.951335 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb42432d-68e5-4210-bed6-465a8db8ca42 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 204 len: 0 microversion: 2.1 time: 0.511864 Aug 25 12:48:47.956345 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 737/1463] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:48:47 2022] DELETE /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:48:48.011815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4fcfc1a3-b8fb-4861-8404-96d93b7ec0bb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:48.016017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4fcfc1a3-b8fb-4861-8404-96d93b7ec0bb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:48.056761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfc1a3-b8fb-4861-8404-96d93b7ec0bb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:48.057718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfc1a3-b8fb-4861-8404-96d93b7ec0bb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:48.065780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfc1a3-b8fb-4861-8404-96d93b7ec0bb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:48.069224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfc1a3-b8fb-4861-8404-96d93b7ec0bb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:48.070161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfc1a3-b8fb-4861-8404-96d93b7ec0bb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:48.070998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfc1a3-b8fb-4861-8404-96d93b7ec0bb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:48.569128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4fcfc1a3-b8fb-4861-8404-96d93b7ec0bb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:48.623056 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4fcfc1a3-b8fb-4861-8404-96d93b7ec0bb tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1267 microversion: 2.1 time: 0.653080 Aug 25 12:48:48.630619 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 738/1464] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:47 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1267 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:48.663122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-49ac8ac7-cfb3-4632-93bd-f780e95df16b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:48.678268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-49ac8ac7-cfb3-4632-93bd-f780e95df16b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:48.709246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49ac8ac7-cfb3-4632-93bd-f780e95df16b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:48.712570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49ac8ac7-cfb3-4632-93bd-f780e95df16b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:48.713698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49ac8ac7-cfb3-4632-93bd-f780e95df16b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:48.715052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49ac8ac7-cfb3-4632-93bd-f780e95df16b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:48.715909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49ac8ac7-cfb3-4632-93bd-f780e95df16b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:48.716716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49ac8ac7-cfb3-4632-93bd-f780e95df16b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:48.883899 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-49ac8ac7-cfb3-4632-93bd-f780e95df16b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.247732 Aug 25 12:48:48.891128 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 739/1465] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 12:48:48 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments => generated 197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:48:49.495216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "263eae79-888f-48ea-b2aa-bd3c3dfe3267"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:49.511746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:49.533550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:49.535823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:49.537103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:49.538771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:49.540131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:49.542028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:49.594833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:49.918182 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] HTTP exception thrown: Volume 263eae79-888f-48ea-b2aa-bd3c3dfe3267 could not be found. Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Request method failure captured: Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: request: PUT /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments/f824f713-4d07-4123-8af7-269a2b7ad808 HTTP/1.1 Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 74 Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB28HrQtzxB6ibht-eYss1V-ajgO6mMiQIU97PDUIEcd_k6rU6wyj-DsxCFJchE_aYSXCUwoHLE1Y5F0ZQVxehtw_sEOlHZe-NPlgZblaQ6JaEuEfDrMk0UVoQLcNELlVEGfa6McPIAkP55omGmP1x_CQyVZFkjSS9DnS9FeTXW0jXR0 Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 2bbf3e5194b045198961dd8e7b2d5645 Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesAdminNegativeTest-329682094 Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 12:48:49.943324 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2bbf3e5194b045198961dd8e7b2d5645"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2bbf3e5194b045198961dd8e7b2d5645", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2bbf3e5194b045198961dd8e7b2d5645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2bbf3e5194b045198961dd8e7b2d5645"}]}] Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesAdminNegativeTest-329682094 Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 2bbf3e5194b045198961dd8e7b2d5645 Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-329682094 Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesAdminNegativeTest-329682094-project-admin Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: f920e9483c2e4e9fa397c0677d1bb849 Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesAdminNegativeTest-329682094-project-admin Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: {"volumeAttachment": {"volumeId": "263eae79-888f-48ea-b2aa-bd3c3dfe3267"}} Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:48:49.946626 n-d-852771-8 devstack@n-api.service[129060]: exception: Volume 263eae79-888f-48ea-b2aa-bd3c3dfe3267 could not be found. Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': '4f8502f6-2eab-49d4-a303-7b9d9304c303', 'id': 'f824f713-4d07-4123-8af7-269a2b7ad808', 'body': {'volumeAttachment': {'volumeId': '263eae79-888f-48ea-b2aa-bd3c3dfe3267'}}} Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:48:49.948537 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 263eae79-888f-48ea-b2aa-bd3c3dfe3267 could not be found. (HTTP 404) (Request-ID: req-9fcafb78-bebd-4971-90f0-51ed05484582) Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 12:48:49.951956 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 263eae79-888f-48ea-b2aa-bd3c3dfe3267 could not be found. Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:49.954667 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 263eae79-888f-48ea-b2aa-bd3c3dfe3267 could not be found. Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 263eae79-888f-48ea-b2aa-bd3c3dfe3267 could not be found. Aug 25 12:48:49.962389 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.964971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Returning 400 to user: Volume 263eae79-888f-48ea-b2aa-bd3c3dfe3267 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:49.964971 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85e4abe0-eaf2-4ae9-ac2d-8f92676a8b36 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] 10.222.0.70 "PUT /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments/f824f713-4d07-4123-8af7-269a2b7ad808" status: 400 len: 107 microversion: 2.1 time: 1.058227 Aug 25 12:48:49.965804 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 740/1466] 10.222.0.70 () {60 vars in 1433 bytes} [Thu Aug 25 12:48:48 2022] PUT /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments/f824f713-4d07-4123-8af7-269a2b7ad808 => generated 107 bytes in 1073 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:48:49.974852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f1ec0d43-793c-4868-887f-a72638d390d1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a6c6ee0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:50.132728 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f1ec0d43-793c-4868-887f-a72638d390d1 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1455 microversion: 2.1 time: 0.164879 Aug 25 12:48:50.139516 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 741/1467] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:49 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1455 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:50.162993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-96d832ae-6b59-476a-9316-6a053cabf93c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:50.164567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-96d832ae-6b59-476a-9316-6a053cabf93c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:50.181160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d832ae-6b59-476a-9316-6a053cabf93c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:50.190467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d832ae-6b59-476a-9316-6a053cabf93c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:50.191908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d832ae-6b59-476a-9316-6a053cabf93c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:50.207490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d832ae-6b59-476a-9316-6a053cabf93c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:50.220297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d832ae-6b59-476a-9316-6a053cabf93c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:50.222329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d832ae-6b59-476a-9316-6a053cabf93c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:51.200908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-96d832ae-6b59-476a-9316-6a053cabf93c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:51.223300 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-96d832ae-6b59-476a-9316-6a053cabf93c tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1510 microversion: 2.1 time: 1.079850 Aug 25 12:48:51.229601 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 742/1468] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:50 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1510 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:51.264356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6edf129-59ce-4d24-9ec6-2d910c244a42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:51.266280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b6edf129-59ce-4d24-9ec6-2d910c244a42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:51.294554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6edf129-59ce-4d24-9ec6-2d910c244a42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:51.296406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6edf129-59ce-4d24-9ec6-2d910c244a42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:51.297765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6edf129-59ce-4d24-9ec6-2d910c244a42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:51.300779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6edf129-59ce-4d24-9ec6-2d910c244a42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:51.303440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6edf129-59ce-4d24-9ec6-2d910c244a42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:51.306418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6edf129-59ce-4d24-9ec6-2d910c244a42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:51.704257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:52.197478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b6edf129-59ce-4d24-9ec6-2d910c244a42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:52.229489 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b6edf129-59ce-4d24-9ec6-2d910c244a42 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1477 microversion: 2.1 time: 0.996492 Aug 25 12:48:52.240596 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 743/1469] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:51 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1477 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:52.252453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-def9b5c0-675a-4de3-b5d5-9067134f3484 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a6db280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:52.417386 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-def9b5c0-675a-4de3-b5d5-9067134f3484 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1433 microversion: 2.1 time: 0.173719 Aug 25 12:48:52.429035 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 744/1470] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:52 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1433 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:52.456674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b1de89f9-4120-4c80-a504-c01eacb7e50f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:52.472962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b1de89f9-4120-4c80-a504-c01eacb7e50f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:52.480525 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe3dbe29-8b4f-4f30-b85e-a4be3cca14fc tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291/action" status: 202 len: 0 microversion: 2.1 time: 5.609935 Aug 25 12:48:52.483609 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 727/1471] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:48:46 2022] POST /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291/action => generated 0 bytes in 5614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:52.497119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1de89f9-4120-4c80-a504-c01eacb7e50f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:52.498111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1de89f9-4120-4c80-a504-c01eacb7e50f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:52.498829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-38faf907-e623-4039-821b-bb65741e961a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:52.499013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1de89f9-4120-4c80-a504-c01eacb7e50f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:52.500286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1de89f9-4120-4c80-a504-c01eacb7e50f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:52.501218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1de89f9-4120-4c80-a504-c01eacb7e50f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:52.502047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1de89f9-4120-4c80-a504-c01eacb7e50f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:52.507016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-38faf907-e623-4039-821b-bb65741e961a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:52.526873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38faf907-e623-4039-821b-bb65741e961a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:52.529640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38faf907-e623-4039-821b-bb65741e961a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:52.530683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38faf907-e623-4039-821b-bb65741e961a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:52.532965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38faf907-e623-4039-821b-bb65741e961a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:52.537409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38faf907-e623-4039-821b-bb65741e961a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:52.542454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38faf907-e623-4039-821b-bb65741e961a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:52.650136 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-38faf907-e623-4039-821b-bb65741e961a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.162292 Aug 25 12:48:52.653094 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 728/1472] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 12:48:52 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:48:52.672417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c73bf3af-edb8-4a78-a6da-a661d1344694 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:52.674196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c73bf3af-edb8-4a78-a6da-a661d1344694 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:52.710223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c73bf3af-edb8-4a78-a6da-a661d1344694 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:52.713856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c73bf3af-edb8-4a78-a6da-a661d1344694 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:52.715212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c73bf3af-edb8-4a78-a6da-a661d1344694 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:52.719626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c73bf3af-edb8-4a78-a6da-a661d1344694 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:52.721188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c73bf3af-edb8-4a78-a6da-a661d1344694 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:52.724538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c73bf3af-edb8-4a78-a6da-a661d1344694 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:53.320212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-c73bf3af-edb8-4a78-a6da-a661d1344694 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lazy-loading 'services' on Instance uuid 4f8502f6-2eab-49d4-a303-7b9d9304c303 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:48:53.601800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:53.671867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:53.763193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b1de89f9-4120-4c80-a504-c01eacb7e50f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:53.830624 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b1de89f9-4120-4c80-a504-c01eacb7e50f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1307 microversion: 2.1 time: 1.396363 Aug 25 12:48:53.844907 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 745/1473] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:52 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1307 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:53.895586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7001cd43-f6a5-4a44-b848-cc94b234a385 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a6b40d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:54.005305 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c73bf3af-edb8-4a78-a6da-a661d1344694 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments/f824f713-4d07-4123-8af7-269a2b7ad808" status: 202 len: 0 microversion: 2.1 time: 1.349061 Aug 25 12:48:54.026282 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 729/1474] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 12:48:52 2022] DELETE /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments/f824f713-4d07-4123-8af7-269a2b7ad808 => generated 0 bytes in 1372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:54.045009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:54.078539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:54.096584 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7001cd43-f6a5-4a44-b848-cc94b234a385 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1455 microversion: 2.1 time: 0.221253 Aug 25 12:48:54.113531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:54.114259 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 746/1475] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:53 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1455 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:54.131367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:54.143371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6f1bc775-2b50-48e3-a25a-615b0e6b8aae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2ab074c0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:54.149913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:54.151407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:54.152267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:54.152985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:54.301855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:54.302796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:54.310847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:54.314825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lazy-loading 'fault' on Instance uuid 7be43090-1175-4a7d-9223-f5ab4aa9644e {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:48:54.387510 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6f1bc775-2b50-48e3-a25a-615b0e6b8aae tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 200 len: 1433 microversion: 2.1 time: 0.262287 Aug 25 12:48:54.395694 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 747/1476] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:54 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 1433 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:54.431074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-83ff8251-d0e4-4910-9fa0-1dd8ba7100a7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:54.432850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-83ff8251-d0e4-4910-9fa0-1dd8ba7100a7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:54.455278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83ff8251-d0e4-4910-9fa0-1dd8ba7100a7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:54.462988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83ff8251-d0e4-4910-9fa0-1dd8ba7100a7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:54.466469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83ff8251-d0e4-4910-9fa0-1dd8ba7100a7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:54.474386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83ff8251-d0e4-4910-9fa0-1dd8ba7100a7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:54.476452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83ff8251-d0e4-4910-9fa0-1dd8ba7100a7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:54.478160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83ff8251-d0e4-4910-9fa0-1dd8ba7100a7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:54.629565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e369e0cffa1642968966435504164d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8413d7bad4404fdb97547c08ca0a0fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:54.656340 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4ebc249-2fe2-447e-8176-c23f3f8f5f49 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 200 len: 1306 microversion: 2.1 time: 0.623456 Aug 25 12:48:54.675526 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 730/1477] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:54 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 1306 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:54.706310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-043bbb08-fb34-43b8-b75d-d76f1cae7710 req-2f20daef-3486-4be4-ab68-6a47c62bb22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd7cd1ff-cdb0-439f-803d-62483f38f5b6", "name": "network-vif-plugged", "status": "completed", "tag": "d6657196-f96f-4269-b16f-0022040bbd1e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:54.727758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-043bbb08-fb34-43b8-b75d-d76f1cae7710 req-2f20daef-3486-4be4-ab68-6a47c62bb22a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:54.729068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-043bbb08-fb34-43b8-b75d-d76f1cae7710 req-2f20daef-3486-4be4-ab68-6a47c62bb22a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:54.730318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-043bbb08-fb34-43b8-b75d-d76f1cae7710 req-2f20daef-3486-4be4-ab68-6a47c62bb22a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:54.759571 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-043bbb08-fb34-43b8-b75d-d76f1cae7710 req-2f20daef-3486-4be4-ab68-6a47c62bb22a service nova] Creating event network-vif-plugged:d6657196-f96f-4269-b16f-0022040bbd1e for instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 on n-h2-852771-8 Aug 25 12:48:54.772806 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-043bbb08-fb34-43b8-b75d-d76f1cae7710 req-2f20daef-3486-4be4-ab68-6a47c62bb22a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094240 Aug 25 12:48:54.774823 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 731/1478] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:54.789029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-4c498c5d-b5f5-4115-86e5-7a0bd64ee2d9 req-ca0ff599-48d6-4e10-8622-05b3468ca2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be43090-1175-4a7d-9223-f5ab4aa9644e", "name": "network-vif-deleted", "tag": "08fdd51a-068b-41f6-acaf-5fb7677d3600"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:54.813106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4c498c5d-b5f5-4115-86e5-7a0bd64ee2d9 req-ca0ff599-48d6-4e10-8622-05b3468ca2d9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:54.814494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4c498c5d-b5f5-4115-86e5-7a0bd64ee2d9 req-ca0ff599-48d6-4e10-8622-05b3468ca2d9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:54.816044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4c498c5d-b5f5-4115-86e5-7a0bd64ee2d9 req-ca0ff599-48d6-4e10-8622-05b3468ca2d9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:54.863011 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-4c498c5d-b5f5-4115-86e5-7a0bd64ee2d9 req-ca0ff599-48d6-4e10-8622-05b3468ca2d9 service nova] Creating event network-vif-deleted:08fdd51a-068b-41f6-acaf-5fb7677d3600 for instance 7be43090-1175-4a7d-9223-f5ab4aa9644e on n-h2-852771-8 Aug 25 12:48:54.885017 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-4c498c5d-b5f5-4115-86e5-7a0bd64ee2d9 req-ca0ff599-48d6-4e10-8622-05b3468ca2d9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107231 Aug 25 12:48:54.893773 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 732/1479] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:54.920931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1cfe7d32-004a-4383-8158-d723ab5523aa tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:54.924143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1cfe7d32-004a-4383-8158-d723ab5523aa tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:54.948224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cfe7d32-004a-4383-8158-d723ab5523aa tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:54.950114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cfe7d32-004a-4383-8158-d723ab5523aa tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:54.953922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cfe7d32-004a-4383-8158-d723ab5523aa tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:54.957248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cfe7d32-004a-4383-8158-d723ab5523aa tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:54.959241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cfe7d32-004a-4383-8158-d723ab5523aa tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:54.961277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cfe7d32-004a-4383-8158-d723ab5523aa tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:55.525311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-83ff8251-d0e4-4910-9fa0-1dd8ba7100a7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:55.570415 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-83ff8251-d0e4-4910-9fa0-1dd8ba7100a7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1503 microversion: 2.1 time: 1.141028 Aug 25 12:48:55.575192 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 748/1480] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:54 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1503 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:55.610322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b3d1983-5aa4-450a-8b28-4a114fa61393 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:55.636621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3b3d1983-5aa4-450a-8b28-4a114fa61393 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:55.691172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3d1983-5aa4-450a-8b28-4a114fa61393 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:55.695254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3d1983-5aa4-450a-8b28-4a114fa61393 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:55.702803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3d1983-5aa4-450a-8b28-4a114fa61393 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:55.704736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3d1983-5aa4-450a-8b28-4a114fa61393 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:55.705978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3d1983-5aa4-450a-8b28-4a114fa61393 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:55.710478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3d1983-5aa4-450a-8b28-4a114fa61393 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:55.878038 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3b3d1983-5aa4-450a-8b28-4a114fa61393 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.297721 Aug 25 12:48:55.890055 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 749/1481] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 12:48:55 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments => generated 197 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:48:55.921679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b0943323-fcec-4999-9e88-2f757c9c63b8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:55.931127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b0943323-fcec-4999-9e88-2f757c9c63b8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:55.962824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:55.983185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0943323-fcec-4999-9e88-2f757c9c63b8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:55.983500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0943323-fcec-4999-9e88-2f757c9c63b8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:55.983861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0943323-fcec-4999-9e88-2f757c9c63b8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:55.986600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0943323-fcec-4999-9e88-2f757c9c63b8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:55.988504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0943323-fcec-4999-9e88-2f757c9c63b8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:56.001699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0943323-fcec-4999-9e88-2f757c9c63b8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:56.191281 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b0943323-fcec-4999-9e88-2f757c9c63b8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.295732 Aug 25 12:48:56.208325 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 750/1482] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:48:55 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments => generated 197 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:56.234248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8323af66-142b-487c-8251-e941e16427db tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:56.235488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8323af66-142b-487c-8251-e941e16427db tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:56.263253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8323af66-142b-487c-8251-e941e16427db tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:56.264198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8323af66-142b-487c-8251-e941e16427db tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:56.265215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8323af66-142b-487c-8251-e941e16427db tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:56.267092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8323af66-142b-487c-8251-e941e16427db tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:56.281622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8323af66-142b-487c-8251-e941e16427db tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:56.283083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8323af66-142b-487c-8251-e941e16427db tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:57.132125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1cfe7d32-004a-4383-8158-d723ab5523aa tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:57.161185 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1cfe7d32-004a-4383-8158-d723ab5523aa tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1476 microversion: 2.1 time: 2.264703 Aug 25 12:48:57.180660 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 733/1483] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:54 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1476 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:57.197565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ba8ae8d3-14c8-4b4f-bef8-7a243492a275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:57.199141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ba8ae8d3-14c8-4b4f-bef8-7a243492a275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:57.214866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba8ae8d3-14c8-4b4f-bef8-7a243492a275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:57.216100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba8ae8d3-14c8-4b4f-bef8-7a243492a275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:57.217106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba8ae8d3-14c8-4b4f-bef8-7a243492a275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:57.219871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba8ae8d3-14c8-4b4f-bef8-7a243492a275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:57.221084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba8ae8d3-14c8-4b4f-bef8-7a243492a275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:57.224023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba8ae8d3-14c8-4b4f-bef8-7a243492a275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:57.762787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ba8ae8d3-14c8-4b4f-bef8-7a243492a275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:57.804698 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ba8ae8d3-14c8-4b4f-bef8-7a243492a275 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1307 microversion: 2.1 time: 0.621640 Aug 25 12:48:57.825329 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 734/1484] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:57 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1307 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:57.825329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-914b0429-9c68-46e8-9f84-294220b4a082 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a9c3ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:57.884853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8323af66-142b-487c-8251-e941e16427db tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:57.923117 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8323af66-142b-487c-8251-e941e16427db tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1466 microversion: 2.1 time: 1.721338 Aug 25 12:48:57.926387 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 751/1485] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:56 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1466 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:57.958086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:57.961379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] [instance: 7be43090-1175-4a7d-9223-f5ab4aa9644e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:57.962372 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-914b0429-9c68-46e8-9f84-294220b4a082 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1455 microversion: 2.1 time: 0.146937 Aug 25 12:48:57.966904 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 735/1486] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:57 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:57.992289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1c7630fc-f522-4c04-9e84-750f0a472fcc req-a55238da-f022-471d-a8d6-cd1552daec77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2408cea4-7716-49a5-a824-c5c508608abd", "name": "network-vif-unplugged", "status": "completed", "tag": "54770f9e-bb74-47fc-b419-3406ae7bf420"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:57.996522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.005274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.006959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.010430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.015641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.017062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.053942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1c7630fc-f522-4c04-9e84-750f0a472fcc req-a55238da-f022-471d-a8d6-cd1552daec77 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.056247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1c7630fc-f522-4c04-9e84-750f0a472fcc req-a55238da-f022-471d-a8d6-cd1552daec77 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.057703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1c7630fc-f522-4c04-9e84-750f0a472fcc req-a55238da-f022-471d-a8d6-cd1552daec77 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.090539 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] HTTP exception thrown: Instance 7be43090-1175-4a7d-9223-f5ab4aa9644e could not be found. Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Request method failure captured: Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e HTTP/1.1 Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB290noZ7oh50fhe07QOgL5F811xuLcMtZtqbz1BlZ73d1EB2vJ2esJHHTdzEpxU-OIG3y9B_2P0mryTkPEJPadJPLBZ3KbCGBkYlaEKWBygwJ8Z5L_NVnmJGqYYEWc5RUTq1_CellC_O6foi0S9QCBCRbdGfvkF11WkDMFOMSd3l-4s Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 8413d7bad4404fdb97547c08ca0a0fc6 Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerAddressesTestJSON-1044067369 Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:48:58.100150 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8413d7bad4404fdb97547c08ca0a0fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8413d7bad4404fdb97547c08ca0a0fc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8413d7bad4404fdb97547c08ca0a0fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8413d7bad4404fdb97547c08ca0a0fc6"}]}] Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerAddressesTestJSON-1044067369 Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 8413d7bad4404fdb97547c08ca0a0fc6 Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1044067369 Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerAddressesTestJSON-1044067369-project Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e369e0cffa1642968966435504164d17 Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerAddressesTestJSON-1044067369-project Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 7be43090-1175-4a7d-9223-f5ab4aa9644e could not be found. Aug 25 12:48:58.103082 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '7be43090-1175-4a7d-9223-f5ab4aa9644e'} Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be43090-1175-4a7d-9223-f5ab4aa9644e could not be found. Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:58.104653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be43090-1175-4a7d-9223-f5ab4aa9644e could not be found. Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be43090-1175-4a7d-9223-f5ab4aa9644e could not be found. Aug 25 12:48:58.107200 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:48:58.120150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] Returning 404 to user: Instance 7be43090-1175-4a7d-9223-f5ab4aa9644e could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:58.127269 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-776dec4e-3491-4ea5-9f30-6aa740e79be6 tempest-ServerAddressesTestJSON-1044067369 tempest-ServerAddressesTestJSON-1044067369-project] 10.222.0.70 "GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e" status: 404 len: 111 microversion: 2.1 time: 0.198280 Aug 25 12:48:58.129543 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 752/1487] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:57 2022] GET /compute/v2.1/servers/7be43090-1175-4a7d-9223-f5ab4aa9644e => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:48:58.136448 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1c7630fc-f522-4c04-9e84-750f0a472fcc req-a55238da-f022-471d-a8d6-cd1552daec77 service nova] Creating event network-vif-unplugged:54770f9e-bb74-47fc-b419-3406ae7bf420 for instance 2408cea4-7716-49a5-a824-c5c508608abd on n-h2-852771-8 Aug 25 12:48:58.150976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da1ed36a-8f5a-41e8-ae99-fe7b9c266d24 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:58.154777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da1ed36a-8f5a-41e8-ae99-fe7b9c266d24 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:58.162900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-1c7630fc-f522-4c04-9e84-750f0a472fcc req-a55238da-f022-471d-a8d6-cd1552daec77 service nova] Instance 2408cea4-7716-49a5-a824-c5c508608abd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:48:58.193335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da1ed36a-8f5a-41e8-ae99-fe7b9c266d24 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.197376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da1ed36a-8f5a-41e8-ae99-fe7b9c266d24 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.202474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da1ed36a-8f5a-41e8-ae99-fe7b9c266d24 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.204739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da1ed36a-8f5a-41e8-ae99-fe7b9c266d24 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.206318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da1ed36a-8f5a-41e8-ae99-fe7b9c266d24 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.210395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da1ed36a-8f5a-41e8-ae99-fe7b9c266d24 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.229143 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1c7630fc-f522-4c04-9e84-750f0a472fcc req-a55238da-f022-471d-a8d6-cd1552daec77 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.258650 Aug 25 12:48:58.232728 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 736/1488] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:58.277187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-90b07bdb-ac5b-40f5-a2ff-a99f9d27fe71 req-00f53718-4890-437e-b7ac-f38d9eee1618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb0cfcc-71e4-4326-b8d9-dcf129be2a48", "name": "network-vif-unplugged", "status": "completed", "tag": "3e258a14-cb05-447b-b747-9cbe36ed9fc5"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:58.358016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-90b07bdb-ac5b-40f5-a2ff-a99f9d27fe71 req-00f53718-4890-437e-b7ac-f38d9eee1618 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.361821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-90b07bdb-ac5b-40f5-a2ff-a99f9d27fe71 req-00f53718-4890-437e-b7ac-f38d9eee1618 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.367681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-90b07bdb-ac5b-40f5-a2ff-a99f9d27fe71 req-00f53718-4890-437e-b7ac-f38d9eee1618 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.409684 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-90b07bdb-ac5b-40f5-a2ff-a99f9d27fe71 req-00f53718-4890-437e-b7ac-f38d9eee1618 service nova] Creating event network-vif-unplugged:3e258a14-cb05-447b-b747-9cbe36ed9fc5 for instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 on n-h1-852771-8 Aug 25 12:48:58.426884 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-90b07bdb-ac5b-40f5-a2ff-a99f9d27fe71 req-00f53718-4890-437e-b7ac-f38d9eee1618 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.189021 Aug 25 12:48:58.436640 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 737/1489] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:58.450246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4e540f2d-8e0b-4553-a359-45eabe516075 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:58.456587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4e540f2d-8e0b-4553-a359-45eabe516075 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:58.470641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e540f2d-8e0b-4553-a359-45eabe516075 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.472298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e540f2d-8e0b-4553-a359-45eabe516075 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.474212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e540f2d-8e0b-4553-a359-45eabe516075 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.476448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e540f2d-8e0b-4553-a359-45eabe516075 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.477962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e540f2d-8e0b-4553-a359-45eabe516075 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.479143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e540f2d-8e0b-4553-a359-45eabe516075 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.641362 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4e540f2d-8e0b-4553-a359-45eabe516075 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.201514 Aug 25 12:48:58.669564 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 738/1490] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 12:48:58 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:48:58.711277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8f06cf9d-d82f-4ead-8922-e431ea34fe73 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:58.723464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8f06cf9d-d82f-4ead-8922-e431ea34fe73 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:58.740080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f06cf9d-d82f-4ead-8922-e431ea34fe73 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.741648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f06cf9d-d82f-4ead-8922-e431ea34fe73 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.742908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f06cf9d-d82f-4ead-8922-e431ea34fe73 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.758122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f06cf9d-d82f-4ead-8922-e431ea34fe73 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.760739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f06cf9d-d82f-4ead-8922-e431ea34fe73 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.763998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f06cf9d-d82f-4ead-8922-e431ea34fe73 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.890770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:58.897095 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8f06cf9d-d82f-4ead-8922-e431ea34fe73 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224520 Aug 25 12:48:58.905355 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 739/1491] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:48:58 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:58.931486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7d1b0f30-ddbb-46b2-bec8-e4ffb53a9c5b tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a59d160>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:59.093479 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7d1b0f30-ddbb-46b2-bec8-e4ffb53a9c5b tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/63977197-fc12-4c51-9b3a-b2cc8b9977ca" status: 200 len: 784 microversion: 2.1 time: 0.192347 Aug 25 12:48:59.118663 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 740/1492] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:48:58 2022] GET /compute/v2.1/images/63977197-fc12-4c51-9b3a-b2cc8b9977ca => generated 784 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:59.132919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-34c8b051-1f28-4f1c-8cef-2cec3a44fdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:59.133972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-34c8b051-1f28-4f1c-8cef-2cec3a44fdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:59.156350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34c8b051-1f28-4f1c-8cef-2cec3a44fdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:59.157957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34c8b051-1f28-4f1c-8cef-2cec3a44fdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:59.158124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34c8b051-1f28-4f1c-8cef-2cec3a44fdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:59.159695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34c8b051-1f28-4f1c-8cef-2cec3a44fdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:59.160533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34c8b051-1f28-4f1c-8cef-2cec3a44fdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:59.163012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34c8b051-1f28-4f1c-8cef-2cec3a44fdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:59.580130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da1ed36a-8f5a-41e8-ae99-fe7b9c266d24 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:59.631299 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da1ed36a-8f5a-41e8-ae99-fe7b9c266d24 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1503 microversion: 2.1 time: 1.498599 Aug 25 12:48:59.633374 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 753/1493] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:58 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1503 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:59.674622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-03aaa0a2-fd9a-4016-846f-a2dfa056f238 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:59.679149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-03aaa0a2-fd9a-4016-846f-a2dfa056f238 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:59.743781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03aaa0a2-fd9a-4016-846f-a2dfa056f238 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:59.750358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03aaa0a2-fd9a-4016-846f-a2dfa056f238 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:59.755785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03aaa0a2-fd9a-4016-846f-a2dfa056f238 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:59.759191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03aaa0a2-fd9a-4016-846f-a2dfa056f238 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:59.766372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03aaa0a2-fd9a-4016-846f-a2dfa056f238 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:59.767477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03aaa0a2-fd9a-4016-846f-a2dfa056f238 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:00.549190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-34c8b051-1f28-4f1c-8cef-2cec3a44fdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:00.582917 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-34c8b051-1f28-4f1c-8cef-2cec3a44fdec tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1476 microversion: 2.1 time: 1.462157 Aug 25 12:49:00.590325 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 741/1494] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:59 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1476 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:00.605984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5f3a07c3-61c8-472e-aef7-c6100eac0a7b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a9c3700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:00.767049 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5f3a07c3-61c8-472e-aef7-c6100eac0a7b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1455 microversion: 2.1 time: 0.172226 Aug 25 12:49:00.787631 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 742/1495] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:00 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1455 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:00.796818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d0d9a6e-d6e5-4f9b-9bf4-3c718c82eaf1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:00.804362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-03aaa0a2-fd9a-4016-846f-a2dfa056f238 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:00.832379 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-03aaa0a2-fd9a-4016-846f-a2dfa056f238 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1307 microversion: 2.1 time: 1.196519 Aug 25 12:49:00.832984 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 754/1496] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:59 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1307 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:00.865165 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4d0d9a6e-d6e5-4f9b-9bf4-3c718c82eaf1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.076482 Aug 25 12:49:00.889235 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 743/1497] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:49:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:00.899430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0d17656b-d6f3-4d3a-95b9-04f1ca5a6fbb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:00.903731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0d17656b-d6f3-4d3a-95b9-04f1ca5a6fbb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:00.910379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-96c83528-17a4-44ab-90b8-469d31386d95 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:00.917136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-96c83528-17a4-44ab-90b8-469d31386d95 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:00.933076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d17656b-d6f3-4d3a-95b9-04f1ca5a6fbb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:00.934044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d17656b-d6f3-4d3a-95b9-04f1ca5a6fbb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:00.934877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d17656b-d6f3-4d3a-95b9-04f1ca5a6fbb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:00.936209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d17656b-d6f3-4d3a-95b9-04f1ca5a6fbb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:00.937135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d17656b-d6f3-4d3a-95b9-04f1ca5a6fbb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:00.937987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d17656b-d6f3-4d3a-95b9-04f1ca5a6fbb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:00.948437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c83528-17a4-44ab-90b8-469d31386d95 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:00.949447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c83528-17a4-44ab-90b8-469d31386d95 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:00.950619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c83528-17a4-44ab-90b8-469d31386d95 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:00.952036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c83528-17a4-44ab-90b8-469d31386d95 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:00.952930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c83528-17a4-44ab-90b8-469d31386d95 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:00.961132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c83528-17a4-44ab-90b8-469d31386d95 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:01.083228 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0d17656b-d6f3-4d3a-95b9-04f1ca5a6fbb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.211620 Aug 25 12:49:01.107868 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 755/1498] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 12:49:00 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455/os-volume_attachments => generated 25 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:01.108716 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-96c83528-17a4-44ab-90b8-469d31386d95 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213956 Aug 25 12:49:01.108950 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 744/1499] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:49:00 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:01.121583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-138de1ac-7c40-4e7e-b9d4-ce89f0724caa req-70567331-5ae7-4763-8a6a-08969af904a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2408cea4-7716-49a5-a824-c5c508608abd", "tag": "54770f9e-bb74-47fc-b419-3406ae7bf420"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:01.128888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d09aa79b-1cd7-4255-846e-a15525d6ece0 req-f650c57a-ec65-4e6a-b2b6-fa5f1ab19f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5912e5f7-42bf-4388-9303-3510307e4122", "tag": "3c92f5a8-0d40-48c8-a9b0-8c1136b1bab2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:01.165215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-138de1ac-7c40-4e7e-b9d4-ce89f0724caa req-70567331-5ae7-4763-8a6a-08969af904a7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:01.166423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-138de1ac-7c40-4e7e-b9d4-ce89f0724caa req-70567331-5ae7-4763-8a6a-08969af904a7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:01.167265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-138de1ac-7c40-4e7e-b9d4-ce89f0724caa req-70567331-5ae7-4763-8a6a-08969af904a7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:01.179624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d09aa79b-1cd7-4255-846e-a15525d6ece0 req-f650c57a-ec65-4e6a-b2b6-fa5f1ab19f26 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:01.185617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d09aa79b-1cd7-4255-846e-a15525d6ece0 req-f650c57a-ec65-4e6a-b2b6-fa5f1ab19f26 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:01.185617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d09aa79b-1cd7-4255-846e-a15525d6ece0 req-f650c57a-ec65-4e6a-b2b6-fa5f1ab19f26 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:01.221127 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-138de1ac-7c40-4e7e-b9d4-ce89f0724caa req-70567331-5ae7-4763-8a6a-08969af904a7 service nova] Creating event network-changed:54770f9e-bb74-47fc-b419-3406ae7bf420 for instance 2408cea4-7716-49a5-a824-c5c508608abd on n-h2-852771-8 Aug 25 12:49:01.241648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-138de1ac-7c40-4e7e-b9d4-ce89f0724caa req-70567331-5ae7-4763-8a6a-08969af904a7 service nova] Instance 2408cea4-7716-49a5-a824-c5c508608abd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:49:01.248809 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d09aa79b-1cd7-4255-846e-a15525d6ece0 req-f650c57a-ec65-4e6a-b2b6-fa5f1ab19f26 service nova] Creating event network-changed:3c92f5a8-0d40-48c8-a9b0-8c1136b1bab2 for instance 5912e5f7-42bf-4388-9303-3510307e4122 on n-h1-852771-8 Aug 25 12:49:01.273491 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d09aa79b-1cd7-4255-846e-a15525d6ece0 req-f650c57a-ec65-4e6a-b2b6-fa5f1ab19f26 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157969 Aug 25 12:49:01.275651 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 745/1500] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:01.291910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d6b46a94-2a0b-48d9-8399-9be06f0bf080 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:01.293058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d6b46a94-2a0b-48d9-8399-9be06f0bf080 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:01.326730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6b46a94-2a0b-48d9-8399-9be06f0bf080 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:01.331409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6b46a94-2a0b-48d9-8399-9be06f0bf080 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:01.334702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6b46a94-2a0b-48d9-8399-9be06f0bf080 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:01.336450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6b46a94-2a0b-48d9-8399-9be06f0bf080 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:01.340890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6b46a94-2a0b-48d9-8399-9be06f0bf080 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:01.342133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6b46a94-2a0b-48d9-8399-9be06f0bf080 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:01.342617 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-138de1ac-7c40-4e7e-b9d4-ce89f0724caa req-70567331-5ae7-4763-8a6a-08969af904a7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230309 Aug 25 12:49:01.343938 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 756/1501] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:01.382551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8fcccb94-114a-426a-a163-311fddd0590f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a794550>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:03.224239 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8fcccb94-114a-426a-a163-311fddd0590f tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "DELETE /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 204 len: 0 microversion: 2.1 time: 1.874118 Aug 25 12:49:03.225824 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 757/1502] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:01 2022] DELETE /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 0 bytes in 1881 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:49:03.234846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d6b46a94-2a0b-48d9-8399-9be06f0bf080 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:03.251603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f8099cd4-e238-4af9-83b5-285879bef27f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:03.263651 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d6b46a94-2a0b-48d9-8399-9be06f0bf080 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1503 microversion: 2.1 time: 1.985609 Aug 25 12:49:03.266955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f8099cd4-e238-4af9-83b5-285879bef27f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:03.270429 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 746/1503] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:01 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1503 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:03.289662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef42fe2d-2936-4b0e-ad90-d682425321af tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2ae5d0d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:03.323572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8099cd4-e238-4af9-83b5-285879bef27f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:03.330871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8099cd4-e238-4af9-83b5-285879bef27f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:03.333013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8099cd4-e238-4af9-83b5-285879bef27f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:03.335065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8099cd4-e238-4af9-83b5-285879bef27f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:03.338436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8099cd4-e238-4af9-83b5-285879bef27f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:03.339727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8099cd4-e238-4af9-83b5-285879bef27f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:03.518523 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef42fe2d-2936-4b0e-ad90-d682425321af tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1455 microversion: 2.1 time: 0.243556 Aug 25 12:49:03.528944 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 747/1504] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:03 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1455 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:03.541631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-61a31694-793f-4674-94fc-125321d5f8e0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:03.552319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-61a31694-793f-4674-94fc-125321d5f8e0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:03.571001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:03.581705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61a31694-793f-4674-94fc-125321d5f8e0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:03.588668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61a31694-793f-4674-94fc-125321d5f8e0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:03.589963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61a31694-793f-4674-94fc-125321d5f8e0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:03.597287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61a31694-793f-4674-94fc-125321d5f8e0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:03.599706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61a31694-793f-4674-94fc-125321d5f8e0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:03.605888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61a31694-793f-4674-94fc-125321d5f8e0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:04.304117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f8099cd4-e238-4af9-83b5-285879bef27f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:04.338707 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f8099cd4-e238-4af9-83b5-285879bef27f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1474 microversion: 2.1 time: 1.110791 Aug 25 12:49:04.363996 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 758/1505] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:03 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1474 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:04.390666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-80ade5b0-7579-4e6a-b055-dee46ae25e00 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:04.404114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-80ade5b0-7579-4e6a-b055-dee46ae25e00 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:04.454778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:04.472750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80ade5b0-7579-4e6a-b055-dee46ae25e00 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:04.473845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80ade5b0-7579-4e6a-b055-dee46ae25e00 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:04.475372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80ade5b0-7579-4e6a-b055-dee46ae25e00 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:04.489834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80ade5b0-7579-4e6a-b055-dee46ae25e00 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:04.490839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80ade5b0-7579-4e6a-b055-dee46ae25e00 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:04.491987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80ade5b0-7579-4e6a-b055-dee46ae25e00 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:04.713492 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-80ade5b0-7579-4e6a-b055-dee46ae25e00 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.333274 Aug 25 12:49:04.735533 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 759/1506] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:49:04 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments => generated 197 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:04.769792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e4f53f9-38de-4cdf-b336-a0e1b3725027 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a1b9550>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:04.852462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-61a31694-793f-4674-94fc-125321d5f8e0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:04.889702 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-61a31694-793f-4674-94fc-125321d5f8e0 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1307 microversion: 2.1 time: 1.356622 Aug 25 12:49:04.890969 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 748/1507] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:03 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1307 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:04.920170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ddc8bb63-d34f-47d7-9ea1-b796d4608399 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:04.921198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ddc8bb63-d34f-47d7-9ea1-b796d4608399 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:04.932357 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-6e4f53f9-38de-4cdf-b336-a0e1b3725027 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] HTTP exception thrown: Image not found. Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e4f53f9-38de-4cdf-b336-a0e1b3725027 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Request method failure captured: Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 HTTP/1.1 Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB29I8HSaDvXZsUnpiD-cJzfnWolRk6FqHVeicy1uKqEOUiga-mPy6IA6_cIow2_m_7JE6fz-_WNbQZO__BPE-RZyrg3wiR4YbTFfPbwLQuaoJXjyBMgbRMAQ6lzlwZIQyetqbEuajs_Ct7NyndKepkfO4KoqB0dhUSxTdH_r26bjwcY Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 9d4312a6d6044d23a16429fcda142b0e Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerTestJSON-1278873808 Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:49:04.969000 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d4312a6d6044d23a16429fcda142b0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d4312a6d6044d23a16429fcda142b0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d4312a6d6044d23a16429fcda142b0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d4312a6d6044d23a16429fcda142b0e"}]}] Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerTestJSON-1278873808 Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 9d4312a6d6044d23a16429fcda142b0e Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1278873808 Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerTestJSON-1278873808-project Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: ff2960e821954604ac0d3153d9853a9f Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerTestJSON-1278873808-project Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: exception: Image not found. Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5'} Aug 25 12:49:04.973847 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:49:04.975533 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:49:04.982681 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 could not be found. Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:49:04.994884 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e4f53f9-38de-4cdf-b336-a0e1b3725027 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Returning 404 to user: Image not found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:49:05.000311 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e4f53f9-38de-4cdf-b336-a0e1b3725027 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 404 len: 62 microversion: 2.1 time: 0.243582 Aug 25 12:49:05.006398 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 760/1508] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:04 2022] GET /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 62 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:49:05.006652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddc8bb63-d34f-47d7-9ea1-b796d4608399 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:05.006652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddc8bb63-d34f-47d7-9ea1-b796d4608399 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:05.006652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddc8bb63-d34f-47d7-9ea1-b796d4608399 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:05.006652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddc8bb63-d34f-47d7-9ea1-b796d4608399 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:05.007558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddc8bb63-d34f-47d7-9ea1-b796d4608399 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:05.007558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddc8bb63-d34f-47d7-9ea1-b796d4608399 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:05.017197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3a7369bb-4a4a-49cf-9bba-ad1528667b67 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a2493a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:05.274990 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3a7369bb-4a4a-49cf-9bba-ad1528667b67 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1455 microversion: 2.1 time: 0.276935 Aug 25 12:49:05.279377 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 761/1509] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:04 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1455 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:05.294465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a246252c-9651-4e28-b4a1-57b444c6d014 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-240495306"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:05.312180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a246252c-9651-4e28-b4a1-57b444c6d014 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:05.367204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a246252c-9651-4e28-b4a1-57b444c6d014 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:05.370960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a246252c-9651-4e28-b4a1-57b444c6d014 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:05.372216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a246252c-9651-4e28-b4a1-57b444c6d014 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:05.375789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a246252c-9651-4e28-b4a1-57b444c6d014 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:05.376705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a246252c-9651-4e28-b4a1-57b444c6d014 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:05.380779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a246252c-9651-4e28-b4a1-57b444c6d014 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:06.066446 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a246252c-9651-4e28-b4a1-57b444c6d014 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "POST /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48/action" status: 202 len: 0 microversion: 2.1 time: 0.777560 Aug 25 12:49:06.086074 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 762/1510] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:49:05 2022] POST /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:49:06.133106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-132415fe-0dde-475d-80f2-5cb98c12544d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:06.140717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-132415fe-0dde-475d-80f2-5cb98c12544d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:06.167202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132415fe-0dde-475d-80f2-5cb98c12544d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:06.168715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132415fe-0dde-475d-80f2-5cb98c12544d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:06.169661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132415fe-0dde-475d-80f2-5cb98c12544d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:06.171395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132415fe-0dde-475d-80f2-5cb98c12544d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:06.172338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132415fe-0dde-475d-80f2-5cb98c12544d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:06.173277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132415fe-0dde-475d-80f2-5cb98c12544d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:08.743190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-132415fe-0dde-475d-80f2-5cb98c12544d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:08.816023 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-132415fe-0dde-475d-80f2-5cb98c12544d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1471 microversion: 2.1 time: 2.738104 Aug 25 12:49:08.833446 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 763/1511] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:06 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1471 bytes in 2761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:08.858127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ddc8bb63-d34f-47d7-9ea1-b796d4608399 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:08.908511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a5cfe072-9619-46ee-949f-c365089d02da tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:08.939488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a5cfe072-9619-46ee-949f-c365089d02da tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:08.958495 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ddc8bb63-d34f-47d7-9ea1-b796d4608399 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1503 microversion: 2.1 time: 4.059109 Aug 25 12:49:08.983081 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 749/1512] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:04 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1503 bytes in 4091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:09.000466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5cfe072-9619-46ee-949f-c365089d02da tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:09.006766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5cfe072-9619-46ee-949f-c365089d02da tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:09.013106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5cfe072-9619-46ee-949f-c365089d02da tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:09.014611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5cfe072-9619-46ee-949f-c365089d02da tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:09.015502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5cfe072-9619-46ee-949f-c365089d02da tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:09.016586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5cfe072-9619-46ee-949f-c365089d02da tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:09.041396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bcdc7454-9bf5-408f-ac06-d696349d4129 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:09.047725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bcdc7454-9bf5-408f-ac06-d696349d4129 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:09.047890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:09.090187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcdc7454-9bf5-408f-ac06-d696349d4129 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:09.097932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcdc7454-9bf5-408f-ac06-d696349d4129 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:09.104933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcdc7454-9bf5-408f-ac06-d696349d4129 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:09.106791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcdc7454-9bf5-408f-ac06-d696349d4129 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:09.108263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcdc7454-9bf5-408f-ac06-d696349d4129 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:09.109445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcdc7454-9bf5-408f-ac06-d696349d4129 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:09.256820 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a5cfe072-9619-46ee-949f-c365089d02da tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.418693 Aug 25 12:49:09.257993 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 764/1513] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:49:08 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments => generated 197 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:09.292690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-69e5ec7e-b829-4a84-984b-569b3e2491a1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2ab07ca0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:11.532940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bcdc7454-9bf5-408f-ac06-d696349d4129 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:11.584169 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bcdc7454-9bf5-408f-ac06-d696349d4129 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1307 microversion: 2.1 time: 2.597842 Aug 25 12:49:11.589960 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 750/1514] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:08 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1307 bytes in 2606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:11.624448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b9adf9d2-23bb-4bfa-bdb1-90e2eab42a32 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a59ae50>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:19.006626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=7 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:19.101961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=5 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:19.248186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=5 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:21.550445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=38 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:26.388907 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-69e5ec7e-b829-4a84-984b-569b3e2491a1 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 200 len: 1428 microversion: 2.1 time: 17.115831 Aug 25 12:49:26.397633 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b9adf9d2-23bb-4bfa-bdb1-90e2eab42a32 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1464 microversion: 2.1 time: 14.805196 Aug 25 12:49:26.405708 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 751/1515] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:11 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1464 bytes in 14814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:26.406101 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 765/1516] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:09 2022] GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 1428 bytes in 17147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:26.420021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ece5da7-eff8-4419-89dc-2fc5b46acdb5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:26.422296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7ece5da7-eff8-4419-89dc-2fc5b46acdb5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:26.432682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a02ca528-1655-4ea0-9290-b829e63ecaca req-658edfcb-dd04-4701-8ecc-8c572b698ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9992927-34a0-45d7-97a6-640fcc718291", "name": "network-vif-unplugged", "status": "completed", "tag": "be3062fa-b4a6-420c-a93f-db51f1259214"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:26.443617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ece5da7-eff8-4419-89dc-2fc5b46acdb5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:26.449168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ece5da7-eff8-4419-89dc-2fc5b46acdb5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:26.451072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ece5da7-eff8-4419-89dc-2fc5b46acdb5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:26.453029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ece5da7-eff8-4419-89dc-2fc5b46acdb5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:26.454434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ece5da7-eff8-4419-89dc-2fc5b46acdb5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:26.456493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ece5da7-eff8-4419-89dc-2fc5b46acdb5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:26.464523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a02ca528-1655-4ea0-9290-b829e63ecaca req-658edfcb-dd04-4701-8ecc-8c572b698ca1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:26.465902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a02ca528-1655-4ea0-9290-b829e63ecaca req-658edfcb-dd04-4701-8ecc-8c572b698ca1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:26.466729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a02ca528-1655-4ea0-9290-b829e63ecaca req-658edfcb-dd04-4701-8ecc-8c572b698ca1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:26.518776 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a02ca528-1655-4ea0-9290-b829e63ecaca req-658edfcb-dd04-4701-8ecc-8c572b698ca1 service nova] Creating event network-vif-unplugged:be3062fa-b4a6-420c-a93f-db51f1259214 for instance c9992927-34a0-45d7-97a6-640fcc718291 on n-h2-852771-8 Aug 25 12:49:26.540392 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a02ca528-1655-4ea0-9290-b829e63ecaca req-658edfcb-dd04-4701-8ecc-8c572b698ca1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132484 Aug 25 12:49:26.546091 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 752/1517] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:26.570150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5bf12dc3-7246-4fe4-ad5f-14962342872e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:26.572031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5bf12dc3-7246-4fe4-ad5f-14962342872e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:26.586210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bf12dc3-7246-4fe4-ad5f-14962342872e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:26.588056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bf12dc3-7246-4fe4-ad5f-14962342872e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:26.589231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bf12dc3-7246-4fe4-ad5f-14962342872e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:26.590911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bf12dc3-7246-4fe4-ad5f-14962342872e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:26.592122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bf12dc3-7246-4fe4-ad5f-14962342872e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:26.593293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bf12dc3-7246-4fe4-ad5f-14962342872e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:26.868397 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ece5da7-eff8-4419-89dc-2fc5b46acdb5 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "POST /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd/action" status: 202 len: 0 microversion: 2.1 time: 0.459875 Aug 25 12:49:26.870766 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 766/1518] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:49:26 2022] POST /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:49:26.884601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b3ca578e-5d02-4cc7-9b25-9b2d86a67d6f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:26.889969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b3ca578e-5d02-4cc7-9b25-9b2d86a67d6f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:26.908046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3ca578e-5d02-4cc7-9b25-9b2d86a67d6f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:26.910302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3ca578e-5d02-4cc7-9b25-9b2d86a67d6f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:26.911784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3ca578e-5d02-4cc7-9b25-9b2d86a67d6f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:26.914089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3ca578e-5d02-4cc7-9b25-9b2d86a67d6f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:26.915738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3ca578e-5d02-4cc7-9b25-9b2d86a67d6f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:26.917079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3ca578e-5d02-4cc7-9b25-9b2d86a67d6f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:27.046266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5bf12dc3-7246-4fe4-ad5f-14962342872e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:27.058618 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b3ca578e-5d02-4cc7-9b25-9b2d86a67d6f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.175526 Aug 25 12:49:27.068682 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 767/1519] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:49:26 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303/os-volume_attachments => generated 25 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:49:27.090641 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5bf12dc3-7246-4fe4-ad5f-14962342872e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1478 microversion: 2.1 time: 0.540385 Aug 25 12:49:27.093861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-74c1c60d-68fe-4e26-9387-58e9ea07bf1a req-63517e89-ea97-48cb-b9cd-906405fae9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2408cea4-7716-49a5-a824-c5c508608abd", "name": "network-vif-plugged", "status": "completed", "tag": "54770f9e-bb74-47fc-b419-3406ae7bf420"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:27.125454 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 753/1520] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:26 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1478 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:27.137346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-74c1c60d-68fe-4e26-9387-58e9ea07bf1a req-63517e89-ea97-48cb-b9cd-906405fae9c4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:27.145008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-74c1c60d-68fe-4e26-9387-58e9ea07bf1a req-63517e89-ea97-48cb-b9cd-906405fae9c4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:27.149327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-74c1c60d-68fe-4e26-9387-58e9ea07bf1a req-63517e89-ea97-48cb-b9cd-906405fae9c4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:27.160920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5008e616-0789-4ef6-9ffd-26ddb0b7c333 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:27.170185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5008e616-0789-4ef6-9ffd-26ddb0b7c333 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:27.217989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5008e616-0789-4ef6-9ffd-26ddb0b7c333 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:27.221262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5008e616-0789-4ef6-9ffd-26ddb0b7c333 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:27.222808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5008e616-0789-4ef6-9ffd-26ddb0b7c333 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:27.226587 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-74c1c60d-68fe-4e26-9387-58e9ea07bf1a req-63517e89-ea97-48cb-b9cd-906405fae9c4 service nova] Creating event network-vif-plugged:54770f9e-bb74-47fc-b419-3406ae7bf420 for instance 2408cea4-7716-49a5-a824-c5c508608abd on n-h2-852771-8 Aug 25 12:49:27.228487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5008e616-0789-4ef6-9ffd-26ddb0b7c333 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:27.229664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5008e616-0789-4ef6-9ffd-26ddb0b7c333 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:27.231024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5008e616-0789-4ef6-9ffd-26ddb0b7c333 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:27.264605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-74c1c60d-68fe-4e26-9387-58e9ea07bf1a req-63517e89-ea97-48cb-b9cd-906405fae9c4 service nova] Instance 2408cea4-7716-49a5-a824-c5c508608abd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:49:27.371188 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-74c1c60d-68fe-4e26-9387-58e9ea07bf1a req-63517e89-ea97-48cb-b9cd-906405fae9c4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296724 Aug 25 12:49:27.379063 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 768/1521] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:27.434969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a215a02e-b624-4815-9731-ea5f7eee1838 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e947160>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:28.094220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5008e616-0789-4ef6-9ffd-26ddb0b7c333 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:28.126583 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5008e616-0789-4ef6-9ffd-26ddb0b7c333 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1307 microversion: 2.1 time: 0.986043 Aug 25 12:49:28.151211 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 754/1522] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:27 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1307 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:28.172311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-62a9fd63-4aba-45e2-a6ca-04fb3c1d1572 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:28.174253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-62a9fd63-4aba-45e2-a6ca-04fb3c1d1572 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:28.193432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62a9fd63-4aba-45e2-a6ca-04fb3c1d1572 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:28.195334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62a9fd63-4aba-45e2-a6ca-04fb3c1d1572 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:28.196628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62a9fd63-4aba-45e2-a6ca-04fb3c1d1572 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:28.199797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62a9fd63-4aba-45e2-a6ca-04fb3c1d1572 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:28.201564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62a9fd63-4aba-45e2-a6ca-04fb3c1d1572 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:28.215636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62a9fd63-4aba-45e2-a6ca-04fb3c1d1572 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:30.126608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-62a9fd63-4aba-45e2-a6ca-04fb3c1d1572 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:30.182734 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-62a9fd63-4aba-45e2-a6ca-04fb3c1d1572 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1470 microversion: 2.1 time: 2.028864 Aug 25 12:49:30.187130 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 755/1523] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:28 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1470 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:30.203756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0897923-9bc7-4e61-aed9-210b9c2899be tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '.version_select at 0x7f3a2a117ca0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:30.223916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0897923-9bc7-4e61-aed9-210b9c2899be tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:30.227958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0897923-9bc7-4e61-aed9-210b9c2899be tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:30.230502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0897923-9bc7-4e61-aed9-210b9c2899be tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:30.322388 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0897923-9bc7-4e61-aed9-210b9c2899be tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 3507 microversion: 2.1 time: 0.103192 Aug 25 12:49:30.335940 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 756/1524] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:49:30 2022] GET /compute/v2.1/os-migrations => generated 3507 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:30.363861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8bfd513f-4910-49ad-8285-3c76f540ba16 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a11ce50>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:37.123033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:37.260656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:38.192016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:40.269668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=22 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:41.250807 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a215a02e-b624-4815-9731-ea5f7eee1838 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 200 len: 1464 microversion: 2.1 time: 13.867058 Aug 25 12:49:41.253274 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 769/1525] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:27 2022] GET /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 1464 bytes in 13873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:41.260741 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8bfd513f-4910-49ad-8285-3c76f540ba16 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 200 len: 1428 microversion: 2.1 time: 10.932749 Aug 25 12:49:41.262215 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 757/1526] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:30 2022] GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 1428 bytes in 10936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:41.276619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44612ec6-a87e-4752-a086-3c3c10a50495 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:41.277681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1422701804", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "ebb8dfc1-c19f-4e9a-a493-27a2bf61338f"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:41.278244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44612ec6-a87e-4752-a086-3c3c10a50495 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:41.301413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44612ec6-a87e-4752-a086-3c3c10a50495 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:41.302045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44612ec6-a87e-4752-a086-3c3c10a50495 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:41.307335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44612ec6-a87e-4752-a086-3c3c10a50495 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:41.309201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44612ec6-a87e-4752-a086-3c3c10a50495 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:41.331980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44612ec6-a87e-4752-a086-3c3c10a50495 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:41.344984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44612ec6-a87e-4752-a086-3c3c10a50495 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:41.622299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] validate_networks() for [('ebb8dfc1-c19f-4e9a-a493-27a2bf61338f', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:49:42.253290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44612ec6-a87e-4752-a086-3c3c10a50495 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:42.304030 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44612ec6-a87e-4752-a086-3c3c10a50495 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1307 microversion: 2.1 time: 1.039166 Aug 25 12:49:42.305626 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 758/1527] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:41 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1307 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:42.322596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-5b18a530-8cac-4cf6-a3ba-6a8d808317e7 req-b5299e71-00b5-4465-97de-38e2f98bb796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9992927-34a0-45d7-97a6-640fcc718291", "tag": "be3062fa-b4a6-420c-a93f-db51f1259214"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:42.397284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5b18a530-8cac-4cf6-a3ba-6a8d808317e7 req-b5299e71-00b5-4465-97de-38e2f98bb796 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:42.397284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5b18a530-8cac-4cf6-a3ba-6a8d808317e7 req-b5299e71-00b5-4465-97de-38e2f98bb796 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:42.397284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5b18a530-8cac-4cf6-a3ba-6a8d808317e7 req-b5299e71-00b5-4465-97de-38e2f98bb796 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:42.459401 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5b18a530-8cac-4cf6-a3ba-6a8d808317e7 req-b5299e71-00b5-4465-97de-38e2f98bb796 service nova] Creating event network-changed:be3062fa-b4a6-420c-a93f-db51f1259214 for instance c9992927-34a0-45d7-97a6-640fcc718291 on n-h2-852771-8 Aug 25 12:49:42.477148 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-5b18a530-8cac-4cf6-a3ba-6a8d808317e7 req-b5299e71-00b5-4465-97de-38e2f98bb796 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168872 Aug 25 12:49:42.480523 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 759/1528] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:43.014410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7d599202-b9e4-4640-b825-e64bd9f6c3db req-d17d0298-c95a-413c-a7ac-b1c02cd1355b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5912e5f7-42bf-4388-9303-3510307e4122", "name": "network-vif-plugged", "status": "completed", "tag": "3c92f5a8-0d40-48c8-a9b0-8c1136b1bab2"}, {"server_uuid": "ebb0cfcc-71e4-4326-b8d9-dcf129be2a48", "name": "network-vif-plugged", "status": "completed", "tag": "3e258a14-cb05-447b-b747-9cbe36ed9fc5"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:43.066483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7d599202-b9e4-4640-b825-e64bd9f6c3db req-d17d0298-c95a-413c-a7ac-b1c02cd1355b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:43.067485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7d599202-b9e4-4640-b825-e64bd9f6c3db req-d17d0298-c95a-413c-a7ac-b1c02cd1355b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:43.068570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7d599202-b9e4-4640-b825-e64bd9f6c3db req-d17d0298-c95a-413c-a7ac-b1c02cd1355b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:43.133496 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7d599202-b9e4-4640-b825-e64bd9f6c3db req-d17d0298-c95a-413c-a7ac-b1c02cd1355b service nova] Creating event network-vif-plugged:3c92f5a8-0d40-48c8-a9b0-8c1136b1bab2 for instance 5912e5f7-42bf-4388-9303-3510307e4122 on n-h1-852771-8 Aug 25 12:49:43.134937 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7d599202-b9e4-4640-b825-e64bd9f6c3db req-d17d0298-c95a-413c-a7ac-b1c02cd1355b service nova] Creating event network-vif-plugged:3e258a14-cb05-447b-b747-9cbe36ed9fc5 for instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 on n-h1-852771-8 Aug 25 12:49:43.165788 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7d599202-b9e4-4640-b825-e64bd9f6c3db req-d17d0298-c95a-413c-a7ac-b1c02cd1355b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.680172 Aug 25 12:49:43.167752 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 760/1529] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:43.203803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4ad93b1d-8b2b-4503-971d-cf5c1d82f482 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:43.214378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4ad93b1d-8b2b-4503-971d-cf5c1d82f482 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:43.229088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ad93b1d-8b2b-4503-971d-cf5c1d82f482 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:43.238950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ad93b1d-8b2b-4503-971d-cf5c1d82f482 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:43.240073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ad93b1d-8b2b-4503-971d-cf5c1d82f482 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:43.244163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ad93b1d-8b2b-4503-971d-cf5c1d82f482 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:43.251064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ad93b1d-8b2b-4503-971d-cf5c1d82f482 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:43.254847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ad93b1d-8b2b-4503-971d-cf5c1d82f482 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:44.324899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:49:44.328190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:49:44.329827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:49:44.331131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:49:44.342569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:49:44.375040 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4ad93b1d-8b2b-4503-971d-cf5c1d82f482 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1629 microversion: 2.1 time: 1.203463 Aug 25 12:49:44.379762 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 761/1530] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:43 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1629 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:44.405333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1dfe67b7-498e-4322-ab4c-3ee4e6670871 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:44.407007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1dfe67b7-498e-4322-ab4c-3ee4e6670871 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:44.436915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dfe67b7-498e-4322-ab4c-3ee4e6670871 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:44.438304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dfe67b7-498e-4322-ab4c-3ee4e6670871 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:44.440319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dfe67b7-498e-4322-ab4c-3ee4e6670871 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:44.442012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dfe67b7-498e-4322-ab4c-3ee4e6670871 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:44.443184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dfe67b7-498e-4322-ab4c-3ee4e6670871 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:44.443742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:44.447043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:44.448257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dfe67b7-498e-4322-ab4c-3ee4e6670871 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:44.452809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:44.459710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:44.462548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:44.463986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:44.596388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Getting quotas for project ea75680120684ccaae1b8c82e42b7c38. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:44.639846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Getting quotas for user 624fc054f45b48579ba7c47af4185e91 and project ea75680120684ccaae1b8c82e42b7c38. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:44.754865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:49:44.770832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:49:44.969682 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9a0d0b6c-7861-4196-9685-5864fb6fabab tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.713213 Aug 25 12:49:44.976371 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 770/1531] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:49:45.620236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86d7188e-ee59-4df5-bf83-26c55d2a30d0 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Action: 'create', calling method: .version_select at 0x7f3a2e947820>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-840435390", "policies": ["affinity"]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:45.751032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-86d7188e-ee59-4df5-bf83-26c55d2a30d0 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:45.774483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-86d7188e-ee59-4df5-bf83-26c55d2a30d0 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:45.868437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1dfe67b7-498e-4322-ab4c-3ee4e6670871 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:45.915911 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1dfe67b7-498e-4322-ab4c-3ee4e6670871 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1463 microversion: 2.1 time: 1.526603 Aug 25 12:49:45.920476 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 762/1532] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:44 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1463 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:45.945832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-51bf35fe-1e26-46a6-bb93-977acf1b0b58 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:45.952778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-51bf35fe-1e26-46a6-bb93-977acf1b0b58 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:46.016163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bf35fe-1e26-46a6-bb93-977acf1b0b58 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:46.021081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bf35fe-1e26-46a6-bb93-977acf1b0b58 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:46.028651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bf35fe-1e26-46a6-bb93-977acf1b0b58 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:46.037429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bf35fe-1e26-46a6-bb93-977acf1b0b58 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:46.043596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bf35fe-1e26-46a6-bb93-977acf1b0b58 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:46.054652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51bf35fe-1e26-46a6-bb93-977acf1b0b58 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:46.093575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-86d7188e-ee59-4df5-bf83-26c55d2a30d0 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:46.119066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-86d7188e-ee59-4df5-bf83-26c55d2a30d0 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:46.156892 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-86d7188e-ee59-4df5-bf83-26c55d2a30d0 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 1.177720 Aug 25 12:49:46.159100 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 771/1533] 10.222.0.70 () {60 vars in 1174 bytes} [Thu Aug 25 12:49:44 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:46.176473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aa3e5de0-5bb6-4aa9-89a3-6c99311528af tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a780a60>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:46.377206 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aa3e5de0-5bb6-4aa9-89a3-6c99311528af tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 200 len: 1428 microversion: 2.1 time: 0.205726 Aug 25 12:49:46.380195 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 772/1534] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:46 2022] GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 1428 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:46.395533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9a922dca-0a62-41f5-90ff-79716103521b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:46.398814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9a922dca-0a62-41f5-90ff-79716103521b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:46.421686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a922dca-0a62-41f5-90ff-79716103521b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:46.423491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a922dca-0a62-41f5-90ff-79716103521b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:46.425655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a922dca-0a62-41f5-90ff-79716103521b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:46.427562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a922dca-0a62-41f5-90ff-79716103521b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:46.429059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a922dca-0a62-41f5-90ff-79716103521b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:46.431117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a922dca-0a62-41f5-90ff-79716103521b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:46.999449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-51bf35fe-1e26-46a6-bb93-977acf1b0b58 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:47.054876 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-51bf35fe-1e26-46a6-bb93-977acf1b0b58 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1467 microversion: 2.1 time: 1.130823 Aug 25 12:49:47.056346 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 763/1535] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:45 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1467 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:47.076042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-91efab15-924c-4bd0-bce8-6e063c59beeb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Action: 'create', calling method: .version_select at 0x7f3a2a891040>, body: {"keypair": {"name": "tempest-keypair-707607541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgI6laTpZ7JA3UD2zWcycD0lxYXNspUEvnhR8AFh2UvnSTjfavzRpyXyoZuWifXJxgE5d/W1vHGgCszcDgZMP6P9LCJT5g6zVPUYcOQt0ScDavCMv5rorv4CxTqosHd/g=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:47.143368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-91efab15-924c-4bd0-bce8-6e063c59beeb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Getting quotas for project 5473d51e2cf040a3ae656d7e987feec2. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:47.155196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-91efab15-924c-4bd0-bce8-6e063c59beeb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Getting quotas for user 81b5d1940fe64714bd9ba7d2009004fd and project 5473d51e2cf040a3ae656d7e987feec2. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:47.197125 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-91efab15-924c-4bd0-bce8-6e063c59beeb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 12:49:47.214338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9a922dca-0a62-41f5-90ff-79716103521b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:47.262571 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9a922dca-0a62-41f5-90ff-79716103521b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1307 microversion: 2.1 time: 0.874638 Aug 25 12:49:47.277548 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 773/1536] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:46 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1307 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:47.710613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a5e6d865-1f01-43e5-8542-cb0c6e42bbb3 req-d86a0de1-8252-4539-8a99-f330934d5aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2408cea4-7716-49a5-a824-c5c508608abd", "name": "network-vif-unplugged", "status": "completed", "tag": "54770f9e-bb74-47fc-b419-3406ae7bf420"}, {"name": "network-changed", "server_uuid": "2408cea4-7716-49a5-a824-c5c508608abd", "tag": "54770f9e-bb74-47fc-b419-3406ae7bf420"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:47.753001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a5e6d865-1f01-43e5-8542-cb0c6e42bbb3 req-d86a0de1-8252-4539-8a99-f330934d5aa6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:47.796079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a5e6d865-1f01-43e5-8542-cb0c6e42bbb3 req-d86a0de1-8252-4539-8a99-f330934d5aa6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:47.797333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a5e6d865-1f01-43e5-8542-cb0c6e42bbb3 req-d86a0de1-8252-4539-8a99-f330934d5aa6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:47.868893 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a5e6d865-1f01-43e5-8542-cb0c6e42bbb3 req-d86a0de1-8252-4539-8a99-f330934d5aa6 service nova] Creating event network-vif-unplugged:54770f9e-bb74-47fc-b419-3406ae7bf420 for instance 2408cea4-7716-49a5-a824-c5c508608abd on n-h1-852771-8 Aug 25 12:49:47.870062 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a5e6d865-1f01-43e5-8542-cb0c6e42bbb3 req-d86a0de1-8252-4539-8a99-f330934d5aa6 service nova] Creating event network-changed:54770f9e-bb74-47fc-b419-3406ae7bf420 for instance 2408cea4-7716-49a5-a824-c5c508608abd on n-h1-852771-8 Aug 25 12:49:47.915434 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a5e6d865-1f01-43e5-8542-cb0c6e42bbb3 req-d86a0de1-8252-4539-8a99-f330934d5aa6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.648376 Aug 25 12:49:47.916431 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 774/1537] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:47.950896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f1d9a0f6-5084-433f-9a59-146a26792222 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:47.952368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f1d9a0f6-5084-433f-9a59-146a26792222 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:48.009075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d9a0f6-5084-433f-9a59-146a26792222 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:48.014780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d9a0f6-5084-433f-9a59-146a26792222 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:48.020106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d9a0f6-5084-433f-9a59-146a26792222 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:48.026142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d9a0f6-5084-433f-9a59-146a26792222 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:48.029038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d9a0f6-5084-433f-9a59-146a26792222 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:48.034050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d9a0f6-5084-433f-9a59-146a26792222 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:48.237179 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [None req-91efab15-924c-4bd0-bce8-6e063c59beeb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 55694. Aug 25 12:49:48.313622 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-91efab15-924c-4bd0-bce8-6e063c59beeb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.253957 Aug 25 12:49:48.315472 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 764/1538] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:49:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:48.360279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3050423b-5862-4c8c-a878-0d90940f4103 req-1acf1902-260f-44ce-b2c1-51715713e5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd7cd1ff-cdb0-439f-803d-62483f38f5b6", "name": "network-vif-unplugged", "status": "completed", "tag": "d6657196-f96f-4269-b16f-0022040bbd1e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:48.470869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3050423b-5862-4c8c-a878-0d90940f4103 req-1acf1902-260f-44ce-b2c1-51715713e5e4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:48.476257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3050423b-5862-4c8c-a878-0d90940f4103 req-1acf1902-260f-44ce-b2c1-51715713e5e4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:48.482968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3050423b-5862-4c8c-a878-0d90940f4103 req-1acf1902-260f-44ce-b2c1-51715713e5e4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:48.614459 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3050423b-5862-4c8c-a878-0d90940f4103 req-1acf1902-260f-44ce-b2c1-51715713e5e4 service nova] Creating event network-vif-unplugged:d6657196-f96f-4269-b16f-0022040bbd1e for instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 on n-h2-852771-8 Aug 25 12:49:48.636078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f1d9a0f6-5084-433f-9a59-146a26792222 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:48.685002 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3050423b-5862-4c8c-a878-0d90940f4103 req-1acf1902-260f-44ce-b2c1-51715713e5e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.340153 Aug 25 12:49:48.696242 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 765/1539] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:48.705294 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f1d9a0f6-5084-433f-9a59-146a26792222 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1222 microversion: 2.1 time: 0.768315 Aug 25 12:49:48.712278 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 775/1540] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:47 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1222 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:48.759443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b2994cc-d45e-4842-8c82-a39d66562d41 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:48.777743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b2994cc-d45e-4842-8c82-a39d66562d41 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:48.785500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b09ba898-4fe5-4a19-8641-1927524c7f2a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Action: 'create', calling method: .version_select at 0x7f3a2a1d14c0>, body: {"server_group": {"name": "tempest-server-group-128585256", "policies": ["affinity"]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:48.886570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2994cc-d45e-4842-8c82-a39d66562d41 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:48.947060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2994cc-d45e-4842-8c82-a39d66562d41 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.061s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:48.949130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2994cc-d45e-4842-8c82-a39d66562d41 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:48.971081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2994cc-d45e-4842-8c82-a39d66562d41 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:48.984799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2994cc-d45e-4842-8c82-a39d66562d41 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:48.984799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2994cc-d45e-4842-8c82-a39d66562d41 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:49.015382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b09ba898-4fe5-4a19-8641-1927524c7f2a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:49.051723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b09ba898-4fe5-4a19-8641-1927524c7f2a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:49.332391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b09ba898-4fe5-4a19-8641-1927524c7f2a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:49.364253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b09ba898-4fe5-4a19-8641-1927524c7f2a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:49.499737 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b09ba898-4fe5-4a19-8641-1927524c7f2a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.752907 Aug 25 12:49:49.510068 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 776/1541] 10.222.0.70 () {60 vars in 1173 bytes} [Thu Aug 25 12:49:48 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:49.560385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae61184e-3763-4895-8906-84c6d79fd55b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-442681444"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:49.575146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ae61184e-3763-4895-8906-84c6d79fd55b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:49.636900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae61184e-3763-4895-8906-84c6d79fd55b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:49.644179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae61184e-3763-4895-8906-84c6d79fd55b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:49.647914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae61184e-3763-4895-8906-84c6d79fd55b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:49.652740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae61184e-3763-4895-8906-84c6d79fd55b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:49.655659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae61184e-3763-4895-8906-84c6d79fd55b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:49.660745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae61184e-3763-4895-8906-84c6d79fd55b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:50.760542 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ae61184e-3763-4895-8906-84c6d79fd55b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "POST /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55/action" status: 202 len: 0 microversion: 2.1 time: 1.247242 Aug 25 12:49:50.768869 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 777/1542] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:49:49 2022] POST /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55/action => generated 0 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:49:50.797270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ef061344-dd55-4f06-834a-fac620ae18c8 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2ab83790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:50.887738 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b2994cc-d45e-4842-8c82-a39d66562d41 tempest-MigrationsAdminTest-577323606 tempest-MigrationsAdminTest-577323606-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1614 microversion: 2.1 time: 2.175371 Aug 25 12:49:50.895180 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 766/1543] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:48 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1614 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:50.917151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ce4629d-2d92-43cc-9634-22c6589749fa tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:50.921025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8ce4629d-2d92-43cc-9634-22c6589749fa tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:50.963782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce4629d-2d92-43cc-9634-22c6589749fa tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:50.967418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce4629d-2d92-43cc-9634-22c6589749fa tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:50.968794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce4629d-2d92-43cc-9634-22c6589749fa tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:50.975486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce4629d-2d92-43cc-9634-22c6589749fa tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:50.979091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce4629d-2d92-43cc-9634-22c6589749fa tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:50.980319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce4629d-2d92-43cc-9634-22c6589749fa tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:51.011270 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ef061344-dd55-4f06-834a-fac620ae18c8 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 200 len: 1428 microversion: 2.1 time: 0.235907 Aug 25 12:49:51.024195 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 778/1544] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:50 2022] GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 1428 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:51.066317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12a05876-629e-4d3f-8ee7-73b535ab95ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Action: 'create', calling method: .version_select at 0x7f3a2a1d19d0>, body: {"server_group": {"name": "tempest-server-group-128585256", "policies": ["affinity"]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:51.175695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-12a05876-629e-4d3f-8ee7-73b535ab95ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:51.199225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-12a05876-629e-4d3f-8ee7-73b535ab95ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:51.458670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-12a05876-629e-4d3f-8ee7-73b535ab95ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:51.485254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:51.488353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-12a05876-629e-4d3f-8ee7-73b535ab95ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:51.584339 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12a05876-629e-4d3f-8ee7-73b535ab95ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.557649 Aug 25 12:49:51.601708 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 779/1545] 10.222.0.70 () {60 vars in 1173 bytes} [Thu Aug 25 12:49:51 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:51.621809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eefa90e7-eac0-4544-8a1a-8b939fcc6fd8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:51.623992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eefa90e7-eac0-4544-8a1a-8b939fcc6fd8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:51.639367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eefa90e7-eac0-4544-8a1a-8b939fcc6fd8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:51.640923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eefa90e7-eac0-4544-8a1a-8b939fcc6fd8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:51.643915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eefa90e7-eac0-4544-8a1a-8b939fcc6fd8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:51.645867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eefa90e7-eac0-4544-8a1a-8b939fcc6fd8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:51.647143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eefa90e7-eac0-4544-8a1a-8b939fcc6fd8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:51.648239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eefa90e7-eac0-4544-8a1a-8b939fcc6fd8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:52.040590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8ce4629d-2d92-43cc-9634-22c6589749fa tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:52.076637 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8ce4629d-2d92-43cc-9634-22c6589749fa tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1486 microversion: 2.1 time: 1.179039 Aug 25 12:49:52.079889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eefa90e7-eac0-4544-8a1a-8b939fcc6fd8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:52.089707 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 767/1546] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:50 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1486 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:52.093724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6fedaa6f-129c-4eb1-81d5-dac7f887c7cb req-c9b750ce-ef7c-462c-b482-9afa932f4fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2408cea4-7716-49a5-a824-c5c508608abd", "name": "network-vif-plugged", "status": "completed", "tag": "54770f9e-bb74-47fc-b419-3406ae7bf420"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:52.110613 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eefa90e7-eac0-4544-8a1a-8b939fcc6fd8 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1276 microversion: 2.1 time: 0.504300 Aug 25 12:49:52.115144 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 780/1547] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:51 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1276 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:52.138868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3b74761-07e0-47d5-8fe0-593cc6ba62ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a32f5e0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:52.166288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6fedaa6f-129c-4eb1-81d5-dac7f887c7cb req-c9b750ce-ef7c-462c-b482-9afa932f4fd6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:52.170291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6fedaa6f-129c-4eb1-81d5-dac7f887c7cb req-c9b750ce-ef7c-462c-b482-9afa932f4fd6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:52.171599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6fedaa6f-129c-4eb1-81d5-dac7f887c7cb req-c9b750ce-ef7c-462c-b482-9afa932f4fd6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:52.244629 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6fedaa6f-129c-4eb1-81d5-dac7f887c7cb req-c9b750ce-ef7c-462c-b482-9afa932f4fd6 service nova] Creating event network-vif-plugged:54770f9e-bb74-47fc-b419-3406ae7bf420 for instance 2408cea4-7716-49a5-a824-c5c508608abd on n-h1-852771-8 Aug 25 12:49:52.272241 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3b74761-07e0-47d5-8fe0-593cc6ba62ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1454 microversion: 2.1 time: 0.153137 Aug 25 12:49:52.273312 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 781/1548] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:52 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:52.286564 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6fedaa6f-129c-4eb1-81d5-dac7f887c7cb req-c9b750ce-ef7c-462c-b482-9afa932f4fd6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200831 Aug 25 12:49:52.288267 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 768/1549] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:52.300201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1ff46051-15f8-475f-9915-a83aea721bee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:52.301182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1ff46051-15f8-475f-9915-a83aea721bee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:52.307373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7c035db4-a60f-4649-bc49-0bfbb88c2826 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:52.342868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff46051-15f8-475f-9915-a83aea721bee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:52.342868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff46051-15f8-475f-9915-a83aea721bee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:52.361428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff46051-15f8-475f-9915-a83aea721bee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:52.365938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff46051-15f8-475f-9915-a83aea721bee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:52.368981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff46051-15f8-475f-9915-a83aea721bee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:52.371570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff46051-15f8-475f-9915-a83aea721bee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:52.439805 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7c035db4-a60f-4649-bc49-0bfbb88c2826 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/f1ac64ac-e535-4bf9-adaf-dfca63368173" status: 204 len: 0 microversion: 2.1 time: 0.144922 Aug 25 12:49:52.441323 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 769/1550] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 12:49:52 2022] DELETE /compute/v2.1/os-server-groups/f1ac64ac-e535-4bf9-adaf-dfca63368173 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:49:52.453367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-999990b4-bbe6-47c9-9cdf-8a0dec534755 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2ae5d0d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:52.543826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1ff46051-15f8-475f-9915-a83aea721bee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:49:52.816902 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-999990b4-bbe6-47c9-9cdf-8a0dec534755 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 200 len: 1428 microversion: 2.1 time: 0.373392 Aug 25 12:49:52.833653 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 770/1551] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:52 2022] GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 1428 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:52.884879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ff17e3b-e482-41e4-93e0-fa96a849d917 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-462779338"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:52.900955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9ff17e3b-e482-41e4-93e0-fa96a849d917 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:52.940945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff17e3b-e482-41e4-93e0-fa96a849d917 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:52.948278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff17e3b-e482-41e4-93e0-fa96a849d917 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:52.953631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff17e3b-e482-41e4-93e0-fa96a849d917 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:52.956205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff17e3b-e482-41e4-93e0-fa96a849d917 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:52.957856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff17e3b-e482-41e4-93e0-fa96a849d917 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:52.961331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff17e3b-e482-41e4-93e0-fa96a849d917 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:52.992104 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1ff46051-15f8-475f-9915-a83aea721bee tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 204 len: 0 microversion: 2.1 time: 0.714758 Aug 25 12:49:52.994921 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 782/1552] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:49:52 2022] DELETE /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 0 bytes in 721 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:49:53.028935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81541ba6-49e9-4fd6-b9ca-a8a05f9d5631 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:53.122455 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-81541ba6-49e9-4fd6-b9ca-a8a05f9d5631 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.124357 Aug 25 12:49:53.125443 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 783/1553] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:49:52 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:53.136925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7074359f-9db5-4a47-9576-b5aa938e5427 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:53.139044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7074359f-9db5-4a47-9576-b5aa938e5427 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:53.156282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7074359f-9db5-4a47-9576-b5aa938e5427 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:53.158785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7074359f-9db5-4a47-9576-b5aa938e5427 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:53.160883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7074359f-9db5-4a47-9576-b5aa938e5427 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:53.162863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7074359f-9db5-4a47-9576-b5aa938e5427 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:53.164335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7074359f-9db5-4a47-9576-b5aa938e5427 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:53.165652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7074359f-9db5-4a47-9576-b5aa938e5427 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:53.675321 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9ff17e3b-e482-41e4-93e0-fa96a849d917 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "POST /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122/action" status: 202 len: 0 microversion: 2.1 time: 0.832145 Aug 25 12:49:53.677550 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 771/1554] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:49:52 2022] POST /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122/action => generated 0 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:49:53.700700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d01dd144-9a28-4436-bc4d-50a73c37e3e0 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:53.798101 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d01dd144-9a28-4436-bc4d-50a73c37e3e0 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/7a6c216f-199d-4bd9-a642-07e99f9ddfbd" status: 204 len: 0 microversion: 2.1 time: 0.115106 Aug 25 12:49:53.800037 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 772/1555] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 12:49:53 2022] DELETE /compute/v2.1/os-server-groups/7a6c216f-199d-4bd9-a642-07e99f9ddfbd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:49:53.824602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-46647590-8d93-4672-a917-108d415779a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:53.842876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-46647590-8d93-4672-a917-108d415779a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:53.876884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46647590-8d93-4672-a917-108d415779a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:53.902852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46647590-8d93-4672-a917-108d415779a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:53.904277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46647590-8d93-4672-a917-108d415779a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:53.911304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46647590-8d93-4672-a917-108d415779a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:53.912562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46647590-8d93-4672-a917-108d415779a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:53.913732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46647590-8d93-4672-a917-108d415779a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:54.163550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7074359f-9db5-4a47-9576-b5aa938e5427 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:54.201324 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7074359f-9db5-4a47-9576-b5aa938e5427 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1469 microversion: 2.1 time: 1.068409 Aug 25 12:49:54.203079 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 784/1556] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:53 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1469 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:54.224486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b13c84ac-3367-431a-a38f-c16350c2e323 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a1b6b80>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:54.258572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-46647590-8d93-4672-a917-108d415779a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:54.302536 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-46647590-8d93-4672-a917-108d415779a9 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1276 microversion: 2.1 time: 0.491390 Aug 25 12:49:54.304117 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 773/1557] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:53 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1276 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:54.318521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d23c6a5-5c2d-47d5-b3a2-8c59ad5d3786 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a127040>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:54.559247 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b13c84ac-3367-431a-a38f-c16350c2e323 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1454 microversion: 2.1 time: 0.317887 Aug 25 12:49:54.575100 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 785/1558] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:54 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1454 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:54.575280 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d23c6a5-5c2d-47d5-b3a2-8c59ad5d3786 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52" status: 200 len: 1411 microversion: 2.1 time: 0.267355 Aug 25 12:49:54.580201 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 774/1559] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:54 2022] GET /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52 => generated 1411 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:54.583546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:54.606953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59ce0760-4134-4fc4-8449-41328d7cc66e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a59d280>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:54.623158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0118c179-84b3-4ccf-ad07-d85c918c7ba4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:54.696514 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0118c179-84b3-4ccf-ad07-d85c918c7ba4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.132112 Aug 25 12:49:54.714127 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 786/1560] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:49:54 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:54.732973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4511ac1b-6a87-42ff-85cb-94ff7c603d17 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a780dc0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:54.790292 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59ce0760-4134-4fc4-8449-41328d7cc66e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 200 len: 1428 microversion: 2.1 time: 0.201305 Aug 25 12:49:54.800569 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 775/1561] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:54 2022] GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 1428 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:54.810343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d06e33be-b74e-4f0b-b25b-d43ac1621a3b tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Action: 'create', calling method: .version_select at 0x7f3a2a587dc0>, body: {"server_group": {"name": "tempest-server-group-2123589873", "policies": ["affinity"]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:54.922520 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4511ac1b-6a87-42ff-85cb-94ff7c603d17 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52" status: 200 len: 1411 microversion: 2.1 time: 0.204278 Aug 25 12:49:54.928673 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 787/1562] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:54 2022] GET /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52 => generated 1411 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:54.932431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d06e33be-b74e-4f0b-b25b-d43ac1621a3b tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:54.944644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d06e33be-b74e-4f0b-b25b-d43ac1621a3b tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:54.956874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7700d31e-f0e7-4e3a-b6a0-e7023a230774 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2e940430>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:55.207097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d06e33be-b74e-4f0b-b25b-d43ac1621a3b tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:55.231570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d06e33be-b74e-4f0b-b25b-d43ac1621a3b tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:55.336983 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d06e33be-b74e-4f0b-b25b-d43ac1621a3b tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.529322 Aug 25 12:49:55.338335 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 776/1563] 10.222.0.70 () {60 vars in 1173 bytes} [Thu Aug 25 12:49:54 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:55.383790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-459e3c91-ad0a-4cdb-8850-ef21a782347c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:55.388134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-459e3c91-ad0a-4cdb-8850-ef21a782347c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:55.426561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-459e3c91-ad0a-4cdb-8850-ef21a782347c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:55.428224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-459e3c91-ad0a-4cdb-8850-ef21a782347c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:55.429482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-459e3c91-ad0a-4cdb-8850-ef21a782347c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:55.431355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-459e3c91-ad0a-4cdb-8850-ef21a782347c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:55.432682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-459e3c91-ad0a-4cdb-8850-ef21a782347c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:55.434820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-459e3c91-ad0a-4cdb-8850-ef21a782347c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:55.578935 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7700d31e-f0e7-4e3a-b6a0-e7023a230774 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52" status: 204 len: 0 microversion: 2.1 time: 0.631374 Aug 25 12:49:55.580578 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 788/1564] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:54 2022] DELETE /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:49:55.602959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc9040c2-7fbd-458f-afab-612b9c9cbe21 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:55.604887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fc9040c2-7fbd-458f-afab-612b9c9cbe21 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:55.636536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc9040c2-7fbd-458f-afab-612b9c9cbe21 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:55.637797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc9040c2-7fbd-458f-afab-612b9c9cbe21 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:55.638787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc9040c2-7fbd-458f-afab-612b9c9cbe21 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:55.640371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc9040c2-7fbd-458f-afab-612b9c9cbe21 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:55.641471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc9040c2-7fbd-458f-afab-612b9c9cbe21 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:55.644927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc9040c2-7fbd-458f-afab-612b9c9cbe21 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:56.077378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc9040c2-7fbd-458f-afab-612b9c9cbe21 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:56.111076 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fc9040c2-7fbd-458f-afab-612b9c9cbe21 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1276 microversion: 2.1 time: 0.526605 Aug 25 12:49:56.113437 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 789/1565] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:55 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1276 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:56.124742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-af595314-c682-45d5-91fd-9da99270c334 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:56.259557 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-af595314-c682-45d5-91fd-9da99270c334 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/0f653dc1-e975-442f-8f21-feb4519418d7" status: 204 len: 0 microversion: 2.1 time: 0.142090 Aug 25 12:49:56.268092 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 790/1566] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 12:49:56 2022] DELETE /compute/v2.1/os-server-groups/0f653dc1-e975-442f-8f21-feb4519418d7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:49:56.274958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-317241732", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a8cc8d52-dd00-486a-beb8-ce1dce750174"}], "security_groups": [{"name": "tempest-securitygroup--92047331"}], "key_name": "tempest-keypair-707607541", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:56.813394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-459e3c91-ad0a-4cdb-8850-ef21a782347c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:56.851113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] validate_networks() for [('a8cc8d52-dd00-486a-beb8-ce1dce750174', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:49:56.856534 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-459e3c91-ad0a-4cdb-8850-ef21a782347c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 200 len: 1469 microversion: 2.1 time: 1.500405 Aug 25 12:49:56.863300 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 777/1567] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:55 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 1469 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:56.887193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8843ed51-67b0-45e1-98e8-6a389d2d7168 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a0b8af0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:56.991100 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8843ed51-67b0-45e1-98e8-6a389d2d7168 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Image not found. Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8843ed51-67b0-45e1-98e8-6a389d2d7168 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52 HTTP/1.1 Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:49:57.015478 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'fa6ad3a8-fb81-4037-a84f-64395182ba52'} Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:49:57.018928 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fa6ad3a8-fb81-4037-a84f-64395182ba52 Aug 25 12:49:57.020869 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:49:57.023564 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fa6ad3a8-fb81-4037-a84f-64395182ba52 could not be found. Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:49:57.030535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8843ed51-67b0-45e1-98e8-6a389d2d7168 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:49:57.034948 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8843ed51-67b0-45e1-98e8-6a389d2d7168 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52" status: 404 len: 62 microversion: 2.1 time: 0.153189 Aug 25 12:49:57.038597 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 778/1568] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:56 2022] GET /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52 => generated 62 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:49:57.049386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ad155c4-8815-4fe0-acf9-f8c41496ca28 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a083c10>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:57.265294 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8ad155c4-8815-4fe0-acf9-f8c41496ca28 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1454 microversion: 2.1 time: 0.233405 Aug 25 12:49:57.288491 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 779/1569] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:57 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1454 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:57.315740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-101b8492-6060-4d61-924a-6bde6445ef22 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a5e83a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:57.547496 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-101b8492-6060-4d61-924a-6bde6445ef22 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 200 len: 1428 microversion: 2.1 time: 0.220018 Aug 25 12:49:57.551438 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 780/1570] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:49:57 2022] GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 1428 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:57.603470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f97954d2-d7ac-42e2-a910-4aae1c781c66 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:57.752751 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f97954d2-d7ac-42e2-a910-4aae1c781c66 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.199074 Aug 25 12:49:57.771535 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 781/1571] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:49:57 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:57.812573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ca67e9c8-580d-4911-99b7-47c77442a8d6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:57.831448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca67e9c8-580d-4911-99b7-47c77442a8d6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:57.887201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca67e9c8-580d-4911-99b7-47c77442a8d6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:57.888382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca67e9c8-580d-4911-99b7-47c77442a8d6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:57.891105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca67e9c8-580d-4911-99b7-47c77442a8d6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:57.897425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca67e9c8-580d-4911-99b7-47c77442a8d6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:57.898694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca67e9c8-580d-4911-99b7-47c77442a8d6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:57.901399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca67e9c8-580d-4911-99b7-47c77442a8d6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:59.213288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:49:59.214197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:49:59.215112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:49:59.215993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:49:59.216806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:49:59.268404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:59.270908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:59.274097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:59.280988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:59.283506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:59.286718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:59.317354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ca67e9c8-580d-4911-99b7-47c77442a8d6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:59.360158 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ca67e9c8-580d-4911-99b7-47c77442a8d6 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1504 microversion: 2.1 time: 1.570865 Aug 25 12:49:59.375341 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 782/1572] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:57 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1504 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:59.402472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77a4d4e0-7af7-478b-a150-d94f95ec8d2f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:59.403685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-77a4d4e0-7af7-478b-a150-d94f95ec8d2f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:59.431455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Getting quotas for project 5473d51e2cf040a3ae656d7e987feec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:59.454283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Getting quotas for user 81b5d1940fe64714bd9ba7d2009004fd and project 5473d51e2cf040a3ae656d7e987feec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:59.481633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77a4d4e0-7af7-478b-a150-d94f95ec8d2f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:59.483414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77a4d4e0-7af7-478b-a150-d94f95ec8d2f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:59.484705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77a4d4e0-7af7-478b-a150-d94f95ec8d2f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:59.487098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77a4d4e0-7af7-478b-a150-d94f95ec8d2f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:59.490723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77a4d4e0-7af7-478b-a150-d94f95ec8d2f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:59.502950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77a4d4e0-7af7-478b-a150-d94f95ec8d2f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:59.522254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:49:59.538607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:49:59.825764 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-712fd931-612f-4e8f-8cb3-c5add675cf8e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.559450 Aug 25 12:49:59.852558 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 791/1573] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:49:56 2022] POST /compute/v2.1/servers => generated 404 bytes in 3587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:49:59.938690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-28ee969a-ebe3-4d50-8df2-31288a1ee3e3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Action: 'create', calling method: .version_select at 0x7f3a2a1cb820>, body: {"server_group": {"name": "tempest-server-group-1090613019", "policies": ["anti-affinity"]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:00.014680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-28ee969a-ebe3-4d50-8df2-31288a1ee3e3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:50:00.037292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-28ee969a-ebe3-4d50-8df2-31288a1ee3e3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:50:00.424849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-28ee969a-ebe3-4d50-8df2-31288a1ee3e3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:50:00.480617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-28ee969a-ebe3-4d50-8df2-31288a1ee3e3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:50:00.560300 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-28ee969a-ebe3-4d50-8df2-31288a1ee3e3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.665131 Aug 25 12:50:00.568056 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 792/1574] 10.222.0.70 () {60 vars in 1173 bytes} [Thu Aug 25 12:49:59 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:00.603964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:00.606569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 2408cea4-7716-49a5-a824-c5c508608abd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:00.625641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-77a4d4e0-7af7-478b-a150-d94f95ec8d2f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:00.647905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:00.660827 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-77a4d4e0-7af7-478b-a150-d94f95ec8d2f tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1318 microversion: 2.1 time: 1.283050 Aug 25 12:50:00.662985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:00.664425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:00.669333 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 783/1575] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:59 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1318 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:00.670531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:00.671610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:00.674962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:00.693207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d90745ba-666b-4469-9da6-98edb08115c2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a5e8ca0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:00.769605 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] HTTP exception thrown: Instance 2408cea4-7716-49a5-a824-c5c508608abd could not be found. Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Request method failure captured: Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd HTTP/1.1 Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23zrl8eFm6rCg0aDzSQsQRHaJKvV4Ry5sRTQJcMT21Rk_Kk42jZqJV9BFoU9rdHVIBWo_AjD7xVwIxBSFhDZh-zZpHAZIQ7EsG7Ex6GDD9FS--04JcLTUONJw_V1vei4n3X-Fu94JgAzy2oyNVVJoA5Bhk6BntQkU2bGnTOG-_JncE Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: ff9affc0d6e64775b2dfd65eceb7f223 Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:00.772979 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff9affc0d6e64775b2dfd65eceb7f223"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ff9affc0d6e64775b2dfd65eceb7f223", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ff9affc0d6e64775b2dfd65eceb7f223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff9affc0d6e64775b2dfd65eceb7f223"}]}] Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: ff9affc0d6e64775b2dfd65eceb7f223 Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-MigrationsAdminTest-1644461283-project Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: aad1bc68cede45a7b1ab7cbda0d8208e Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-MigrationsAdminTest-1644461283-project Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 2408cea4-7716-49a5-a824-c5c508608abd could not be found. Aug 25 12:50:00.776164 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '2408cea4-7716-49a5-a824-c5c508608abd'} Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2408cea4-7716-49a5-a824-c5c508608abd could not be found. Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:00.778145 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2408cea4-7716-49a5-a824-c5c508608abd could not be found. Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2408cea4-7716-49a5-a824-c5c508608abd could not be found. Aug 25 12:50:00.781664 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:00.788845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Returning 404 to user: Instance 2408cea4-7716-49a5-a824-c5c508608abd could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:00.791746 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f7fb0fdb-8f7f-4117-96a6-5f1387d43c5d tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd" status: 404 len: 111 microversion: 2.1 time: 0.220834 Aug 25 12:50:00.799479 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 793/1576] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:00 2022] GET /compute/v2.1/servers/2408cea4-7716-49a5-a824-c5c508608abd => generated 111 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:00.807065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e5e92ee-a408-4e0e-a598-c2d96ea95f13 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2e947dc0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:01.124467 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d90745ba-666b-4469-9da6-98edb08115c2 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1454 microversion: 2.1 time: 0.452366 Aug 25 12:50:01.137772 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 784/1577] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:00 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1454 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:01.160459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-707e650d-dc4c-41ab-872e-4328a9eb8235 req-a907cf88-1b0d-4dff-b359-82ef0f2914e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2408cea4-7716-49a5-a824-c5c508608abd", "name": "network-vif-deleted", "tag": "54770f9e-bb74-47fc-b419-3406ae7bf420"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:01.237605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-707e650d-dc4c-41ab-872e-4328a9eb8235 req-a907cf88-1b0d-4dff-b359-82ef0f2914e7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:01.239237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-707e650d-dc4c-41ab-872e-4328a9eb8235 req-a907cf88-1b0d-4dff-b359-82ef0f2914e7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:01.241039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-707e650d-dc4c-41ab-872e-4328a9eb8235 req-a907cf88-1b0d-4dff-b359-82ef0f2914e7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:01.257496 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e5e92ee-a408-4e0e-a598-c2d96ea95f13 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 200 len: 1428 microversion: 2.1 time: 0.457318 Aug 25 12:50:01.264891 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 794/1578] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:00 2022] GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 1428 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:01.324314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3c88d8d3-bdda-40ef-9f87-050c1224cfe9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:01.331219 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-707e650d-dc4c-41ab-872e-4328a9eb8235 req-a907cf88-1b0d-4dff-b359-82ef0f2914e7 service nova] Creating event network-vif-deleted:54770f9e-bb74-47fc-b419-3406ae7bf420 for instance 2408cea4-7716-49a5-a824-c5c508608abd on n-h1-852771-8 Aug 25 12:50:01.357583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3c88d8d3-bdda-40ef-9f87-050c1224cfe9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:01.382326 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-707e650d-dc4c-41ab-872e-4328a9eb8235 req-a907cf88-1b0d-4dff-b359-82ef0f2914e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235560 Aug 25 12:50:01.384536 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 785/1579] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:01.401728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-954bedb6-2576-4da6-8e02-ac6b6722731b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:01.405615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-954bedb6-2576-4da6-8e02-ac6b6722731b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:01.426367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954bedb6-2576-4da6-8e02-ac6b6722731b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:01.428034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954bedb6-2576-4da6-8e02-ac6b6722731b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:01.429548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954bedb6-2576-4da6-8e02-ac6b6722731b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:01.431618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954bedb6-2576-4da6-8e02-ac6b6722731b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:01.432949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954bedb6-2576-4da6-8e02-ac6b6722731b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:01.434242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954bedb6-2576-4da6-8e02-ac6b6722731b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:02.181068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3c88d8d3-bdda-40ef-9f87-050c1224cfe9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:02.254615 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3c88d8d3-bdda-40ef-9f87-050c1224cfe9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1233 microversion: 2.1 time: 0.973410 Aug 25 12:50:02.275338 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 795/1580] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:01 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1233 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:02.358976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d5dd6a89-10d5-4842-a575-48e5a0486f85 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:02.499760 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d5dd6a89-10d5-4842-a575-48e5a0486f85 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/5bc44126-7378-4f1e-9d04-4b15ad376ca1" status: 204 len: 0 microversion: 2.1 time: 0.180821 Aug 25 12:50:02.510039 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 796/1581] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 12:50:02 2022] DELETE /compute/v2.1/os-server-groups/5bc44126-7378-4f1e-9d04-4b15ad376ca1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:02.543269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fae0b270-b91a-45ff-897d-75253328d067 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:02.544579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fae0b270-b91a-45ff-897d-75253328d067 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:02.566581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fae0b270-b91a-45ff-897d-75253328d067 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:02.568314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fae0b270-b91a-45ff-897d-75253328d067 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:02.570370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fae0b270-b91a-45ff-897d-75253328d067 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:02.575112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fae0b270-b91a-45ff-897d-75253328d067 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:02.576678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fae0b270-b91a-45ff-897d-75253328d067 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:02.578357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fae0b270-b91a-45ff-897d-75253328d067 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:02.689497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fae0b270-b91a-45ff-897d-75253328d067 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:02.943281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-954bedb6-2576-4da6-8e02-ac6b6722731b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:02.974025 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-954bedb6-2576-4da6-8e02-ac6b6722731b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1504 microversion: 2.1 time: 1.586234 Aug 25 12:50:02.978636 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 786/1582] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:01 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1504 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:02.995314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cba476e4-b858-46ed-bdbc-1a0b298f3786 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:02.997477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cba476e4-b858-46ed-bdbc-1a0b298f3786 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:03.024405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba476e4-b858-46ed-bdbc-1a0b298f3786 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:03.026528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba476e4-b858-46ed-bdbc-1a0b298f3786 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:03.031389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba476e4-b858-46ed-bdbc-1a0b298f3786 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:03.039460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba476e4-b858-46ed-bdbc-1a0b298f3786 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:03.042223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba476e4-b858-46ed-bdbc-1a0b298f3786 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:03.046572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba476e4-b858-46ed-bdbc-1a0b298f3786 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:03.163181 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fae0b270-b91a-45ff-897d-75253328d067 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 204 len: 0 microversion: 2.1 time: 0.649153 Aug 25 12:50:03.166574 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 797/1583] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:02 2022] DELETE /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:03.190016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8358decb-9d7a-4a78-a078-5530ed0af2bd tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e947820>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:03.802206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cba476e4-b858-46ed-bdbc-1a0b298f3786 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:03.841159 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cba476e4-b858-46ed-bdbc-1a0b298f3786 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1318 microversion: 2.1 time: 0.856308 Aug 25 12:50:03.845243 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 787/1584] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:02 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1318 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:03.896244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c28d0d23-94d3-4e02-9b36-f01af636552d req-ebc7ba2c-1fac-4964-8821-bbd673fdba97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01013692-8e62-49a8-81b9-7f7cdd4a5a55", "name": "network-vif-plugged", "status": "completed", "tag": "73f30782-4779-447f-ba20-d60dfbdf553d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:03.941144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c28d0d23-94d3-4e02-9b36-f01af636552d req-ebc7ba2c-1fac-4964-8821-bbd673fdba97 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:03.945226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c28d0d23-94d3-4e02-9b36-f01af636552d req-ebc7ba2c-1fac-4964-8821-bbd673fdba97 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:03.948679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c28d0d23-94d3-4e02-9b36-f01af636552d req-ebc7ba2c-1fac-4964-8821-bbd673fdba97 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:03.990172 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c28d0d23-94d3-4e02-9b36-f01af636552d req-ebc7ba2c-1fac-4964-8821-bbd673fdba97 service nova] Creating event network-vif-plugged:73f30782-4779-447f-ba20-d60dfbdf553d for instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 on n-h2-852771-8 Aug 25 12:50:04.018253 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c28d0d23-94d3-4e02-9b36-f01af636552d req-ebc7ba2c-1fac-4964-8821-bbd673fdba97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164108 Aug 25 12:50:04.019738 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 788/1585] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:04.048743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d5b423eb-aeda-4d97-b1f7-0d547475e8da tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a5e8940>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:05.293120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=12 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:08.533651 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8358decb-9d7a-4a78-a078-5530ed0af2bd tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1454 microversion: 2.1 time: 5.363489 Aug 25 12:50:08.539141 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 798/1586] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:03 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1454 bytes in 5371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:08.559240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6a58853-14a3-49f2-a8be-072bb2ccdf32 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:08.569439 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d5b423eb-aeda-4d97-b1f7-0d547475e8da tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 200 len: 1437 microversion: 2.1 time: 4.546702 Aug 25 12:50:08.583077 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 789/1587] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:04 2022] GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 1437 bytes in 4562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:08.600600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:08.602579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:08.605884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:08.610046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:08.626928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:08.627874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:08.628610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:08.629209 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d6a58853-14a3-49f2-a8be-072bb2ccdf32 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.086925 Aug 25 12:50:08.629878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:08.630713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:08.631137 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 799/1588] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:50:08 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:08.631462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:08.641013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b0c2da56-fbd5-456e-8b6d-4b5b1e59afa6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:08.644364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:08.648208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b0c2da56-fbd5-456e-8b6d-4b5b1e59afa6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:08.668625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c2da56-fbd5-456e-8b6d-4b5b1e59afa6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:08.669449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c2da56-fbd5-456e-8b6d-4b5b1e59afa6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:08.670023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c2da56-fbd5-456e-8b6d-4b5b1e59afa6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:08.671092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c2da56-fbd5-456e-8b6d-4b5b1e59afa6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:08.671744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c2da56-fbd5-456e-8b6d-4b5b1e59afa6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:08.672541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c2da56-fbd5-456e-8b6d-4b5b1e59afa6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:08.776059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:08.794618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:08.795648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:08.796627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:08.797477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lazy-loading 'fault' on Instance uuid ca3155f7-5f48-47a9-a5a6-6ec064e160de {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:50:09.005344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:09.039462 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d493227-4703-4c1b-ae56-c1ca49a80f04 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 200 len: 1368 microversion: 2.1 time: 0.449419 Aug 25 12:50:09.052117 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 790/1589] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:08 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 1368 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:09.064615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-406c01da-d01e-4887-aef3-40e559d09f4c req-ccfdc0e6-9fa5-440f-b638-5cabeebd9aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c96283-54f7-4c9e-8e46-c8bdb92a130e", "tag": "fac0c551-d4c8-42f1-9ee7-511b8a30ea31"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:09.087249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-406c01da-d01e-4887-aef3-40e559d09f4c req-ccfdc0e6-9fa5-440f-b638-5cabeebd9aaa service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:09.088543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-406c01da-d01e-4887-aef3-40e559d09f4c req-ccfdc0e6-9fa5-440f-b638-5cabeebd9aaa service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:09.089681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-406c01da-d01e-4887-aef3-40e559d09f4c req-ccfdc0e6-9fa5-440f-b638-5cabeebd9aaa service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:09.138049 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-406c01da-d01e-4887-aef3-40e559d09f4c req-ccfdc0e6-9fa5-440f-b638-5cabeebd9aaa service nova] Creating event network-changed:fac0c551-d4c8-42f1-9ee7-511b8a30ea31 for instance f0c96283-54f7-4c9e-8e46-c8bdb92a130e on n-h2-852771-8 Aug 25 12:50:09.151187 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-406c01da-d01e-4887-aef3-40e559d09f4c req-ccfdc0e6-9fa5-440f-b638-5cabeebd9aaa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094410 Aug 25 12:50:09.153043 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 791/1590] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:09.169943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df2f3ae6-ef92-4ed5-8d5c-82b255c4a455 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:09.171606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df2f3ae6-ef92-4ed5-8d5c-82b255c4a455 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:09.212294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df2f3ae6-ef92-4ed5-8d5c-82b255c4a455 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:09.213654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df2f3ae6-ef92-4ed5-8d5c-82b255c4a455 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:09.214825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df2f3ae6-ef92-4ed5-8d5c-82b255c4a455 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:09.216526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df2f3ae6-ef92-4ed5-8d5c-82b255c4a455 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:09.217972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df2f3ae6-ef92-4ed5-8d5c-82b255c4a455 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:09.219293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df2f3ae6-ef92-4ed5-8d5c-82b255c4a455 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:09.350812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:09.596459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b0c2da56-fbd5-456e-8b6d-4b5b1e59afa6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:09.615522 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b0c2da56-fbd5-456e-8b6d-4b5b1e59afa6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1357 microversion: 2.1 time: 0.981940 Aug 25 12:50:09.616928 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 800/1591] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:08 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1357 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:09.626576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-04c891d0-adcc-4ab3-b9ad-979737d80220 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:09.628265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-04c891d0-adcc-4ab3-b9ad-979737d80220 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:09.641999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04c891d0-adcc-4ab3-b9ad-979737d80220 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:09.643991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04c891d0-adcc-4ab3-b9ad-979737d80220 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:09.645147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04c891d0-adcc-4ab3-b9ad-979737d80220 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:09.646909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04c891d0-adcc-4ab3-b9ad-979737d80220 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:09.653286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04c891d0-adcc-4ab3-b9ad-979737d80220 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:09.654477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04c891d0-adcc-4ab3-b9ad-979737d80220 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:10.392793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df2f3ae6-ef92-4ed5-8d5c-82b255c4a455 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:10.416903 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df2f3ae6-ef92-4ed5-8d5c-82b255c4a455 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1486 microversion: 2.1 time: 1.260504 Aug 25 12:50:10.496314 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 792/1592] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:09 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1486 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:10.496314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b64750f0-3b64-49b4-b65c-1197d8ba4774 req-81c82ece-9808-4676-8b5f-57a118336071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5912e5f7-42bf-4388-9303-3510307e4122", "name": "network-vif-plugged", "status": "completed", "tag": "3c92f5a8-0d40-48c8-a9b0-8c1136b1bab2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:10.496314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b64750f0-3b64-49b4-b65c-1197d8ba4774 req-81c82ece-9808-4676-8b5f-57a118336071 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:10.496314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b64750f0-3b64-49b4-b65c-1197d8ba4774 req-81c82ece-9808-4676-8b5f-57a118336071 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:10.497931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b64750f0-3b64-49b4-b65c-1197d8ba4774 req-81c82ece-9808-4676-8b5f-57a118336071 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:10.524757 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b64750f0-3b64-49b4-b65c-1197d8ba4774 req-81c82ece-9808-4676-8b5f-57a118336071 service nova] Creating event network-vif-plugged:3c92f5a8-0d40-48c8-a9b0-8c1136b1bab2 for instance 5912e5f7-42bf-4388-9303-3510307e4122 on n-h1-852771-8 Aug 25 12:50:10.533469 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b64750f0-3b64-49b4-b65c-1197d8ba4774 req-81c82ece-9808-4676-8b5f-57a118336071 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079445 Aug 25 12:50:10.535848 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 793/1593] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:10.663032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8614da12-b198-463e-98ac-94a0a5d128a9 req-8188c6c6-07a1-41e3-aa1b-37aa0b037307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3155f7-5f48-47a9-a5a6-6ec064e160de", "name": "network-vif-deleted", "tag": "5363dc13-2a91-4fbd-a4fa-f1335cb952e4"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:10.691092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8614da12-b198-463e-98ac-94a0a5d128a9 req-8188c6c6-07a1-41e3-aa1b-37aa0b037307 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:10.692463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8614da12-b198-463e-98ac-94a0a5d128a9 req-8188c6c6-07a1-41e3-aa1b-37aa0b037307 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:10.695003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8614da12-b198-463e-98ac-94a0a5d128a9 req-8188c6c6-07a1-41e3-aa1b-37aa0b037307 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:10.725719 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8614da12-b198-463e-98ac-94a0a5d128a9 req-8188c6c6-07a1-41e3-aa1b-37aa0b037307 service nova] Creating event network-vif-deleted:5363dc13-2a91-4fbd-a4fa-f1335cb952e4 for instance ca3155f7-5f48-47a9-a5a6-6ec064e160de on n-h2-852771-8 Aug 25 12:50:10.734793 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8614da12-b198-463e-98ac-94a0a5d128a9 req-8188c6c6-07a1-41e3-aa1b-37aa0b037307 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196626 Aug 25 12:50:10.742917 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 794/1594] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:10.752868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-834558290", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a8823b91-974d-48ac-9e76-e7cbde8ff3bd"}], "block_device_mapping_v2": [{"uuid": "a2f1a2b5-cad1-4ad3-9212-343edd2b5814", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:10.921293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] validate_networks() for [('a8823b91-974d-48ac-9e76-e7cbde8ff3bd', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:50:10.960754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-04c891d0-adcc-4ab3-b9ad-979737d80220 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:10.986321 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-04c891d0-adcc-4ab3-b9ad-979737d80220 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1318 microversion: 2.1 time: 1.366209 Aug 25 12:50:10.987336 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 801/1595] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:09 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1318 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:11.000203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ca3b44a5-0d87-4b65-b6c8-b33b1346c745 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a1cb3a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:11.102668 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ca3b44a5-0d87-4b65-b6c8-b33b1346c745 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 200 len: 1437 microversion: 2.1 time: 0.113003 Aug 25 12:50:11.104101 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 802/1596] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:10 2022] GET /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 1437 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:11.113757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2095369962", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "cfa954f1-0108-40aa-af08-4ceaf944842e"}]}, "os:scheduler_hints": {"group": "25439800-1adf-44ec-a52d-94e6c6b1d516"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:11.239611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] validate_networks() for [('cfa954f1-0108-40aa-af08-4ceaf944842e', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:50:12.240833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=46 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:13.396735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:50:13.400577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:50:13.402407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:50:13.404600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:50:13.412400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:50:13.458340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:13.461649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:13.463627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:13.465638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:13.466980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:13.469425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:13.540393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:50:13.542122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Getting quotas for project c899e2a1474d4eb28b598f50e93312f8. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:50:13.552490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:50:13.556203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Getting quotas for user b46ef01072a84a81b862baf3ea2387dd and project c899e2a1474d4eb28b598f50e93312f8. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:50:13.556495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:50:13.557010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:50:13.557765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:50:13.614170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:13.616819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:13.618067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:13.620066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:13.621367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:13.625196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:13.677346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:50:13.690731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:50:13.737037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:50:13.742729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:50:13.801016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:50:13.806156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2f1a2b5-cad1-4ad3-9212-343edd2b5814',volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:50:13.827345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=129060) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 25 12:50:13.877002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_group_members'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:50:13.888054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_group_members'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:50:13.979583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_group_members'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:50:13.991724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Getting quotas for user a32fc0529aca41c3bb78c94b844e4d36 and project 2d024268836d4dfba22a4e24d161df70. Resources: {'server_group_members'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:50:14.052172 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb8c319d-7aa1-4dfc-a84e-fff9ae59f12d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.945270 Aug 25 12:50:14.054769 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 803/1597] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:50:14.065843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f68474f-d334-4aa7-b6d9-c7418587f27d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a1cb0d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:14.262595 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f68474f-d334-4aa7-b6d9-c7418587f27d tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1454 microversion: 2.1 time: 0.205426 Aug 25 12:50:14.265787 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6bc63f86-a9c9-4647-846e-f149a34b8e43 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.520612 Aug 25 12:50:14.268357 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 795/1598] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 12:50:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3524 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:50:14.275650 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 804/1599] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:14 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1454 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:14.288100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:14.303073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: ca3155f7-5f48-47a9-a5a6-6ec064e160de] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:14.310987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b3e7bc0d-c895-477a-a1e9-accca9a2998c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:14.312233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b3e7bc0d-c895-477a-a1e9-accca9a2998c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:14.325772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.327824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.332379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.334252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.335504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.336672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.362217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3e7bc0d-c895-477a-a1e9-accca9a2998c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.363123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3e7bc0d-c895-477a-a1e9-accca9a2998c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.369242 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] HTTP exception thrown: Instance ca3155f7-5f48-47a9-a5a6-6ec064e160de could not be found. Aug 25 12:50:14.372527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3e7bc0d-c895-477a-a1e9-accca9a2998c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Request method failure captured: Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de HTTP/1.1 Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23zrl8eFm6rCg0aDzSQsQRHaJKvV4Ry5sRTQJcMT21Rk_Kk42jZqJV9BFoU9rdHVIBWo_AjD7xVwIxBSFhDZh-zZpHAZIQ7EsG7Ex6GDD9FS--04JcLTUONJw_V1vei4n3X-Fu94JgAzy2oyNVVJoA5Bhk6BntQkU2bGnTOG-_JncE Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: ff9affc0d6e64775b2dfd65eceb7f223 Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:14.373162 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff9affc0d6e64775b2dfd65eceb7f223"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ff9affc0d6e64775b2dfd65eceb7f223", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ff9affc0d6e64775b2dfd65eceb7f223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff9affc0d6e64775b2dfd65eceb7f223"}]}] Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: ff9affc0d6e64775b2dfd65eceb7f223 Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-MigrationsAdminTest-1644461283-project Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: aad1bc68cede45a7b1ab7cbda0d8208e Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-MigrationsAdminTest-1644461283-project Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ca3155f7-5f48-47a9-a5a6-6ec064e160de could not be found. Aug 25 12:50:14.377355 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ca3155f7-5f48-47a9-a5a6-6ec064e160de'} Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca3155f7-5f48-47a9-a5a6-6ec064e160de could not be found. Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:14.379272 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca3155f7-5f48-47a9-a5a6-6ec064e160de could not be found. Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca3155f7-5f48-47a9-a5a6-6ec064e160de could not be found. Aug 25 12:50:14.384372 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:14.386993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Returning 404 to user: Instance ca3155f7-5f48-47a9-a5a6-6ec064e160de could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:14.387168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3e7bc0d-c895-477a-a1e9-accca9a2998c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.388114 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a22fb95-169f-4366-9a9c-019618823b7c tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de" status: 404 len: 111 microversion: 2.1 time: 0.116350 Aug 25 12:50:14.396149 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 796/1600] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:14 2022] GET /compute/v2.1/servers/ca3155f7-5f48-47a9-a5a6-6ec064e160de => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:14.402017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3e7bc0d-c895-477a-a1e9-accca9a2998c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.402659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3e7bc0d-c895-477a-a1e9-accca9a2998c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.403838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-79af76e2-dc48-41da-99d5-46c34c1d2f09 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:14.405924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-79af76e2-dc48-41da-99d5-46c34c1d2f09 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:14.419332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79af76e2-dc48-41da-99d5-46c34c1d2f09 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.420801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79af76e2-dc48-41da-99d5-46c34c1d2f09 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.422074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79af76e2-dc48-41da-99d5-46c34c1d2f09 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.424985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79af76e2-dc48-41da-99d5-46c34c1d2f09 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.426331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79af76e2-dc48-41da-99d5-46c34c1d2f09 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.427655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79af76e2-dc48-41da-99d5-46c34c1d2f09 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.587260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b3e7bc0d-c895-477a-a1e9-accca9a2998c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:14.904749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-79af76e2-dc48-41da-99d5-46c34c1d2f09 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:14.921283 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-79af76e2-dc48-41da-99d5-46c34c1d2f09 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1357 microversion: 2.1 time: 0.523295 Aug 25 12:50:14.937456 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 797/1601] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:14 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1357 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:14.948750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6fdff3c4-efa7-47d8-9c7c-dc4645441d1a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:14.948750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6fdff3c4-efa7-47d8-9c7c-dc4645441d1a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:14.957693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fdff3c4-efa7-47d8-9c7c-dc4645441d1a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.959178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fdff3c4-efa7-47d8-9c7c-dc4645441d1a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.960524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fdff3c4-efa7-47d8-9c7c-dc4645441d1a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.962469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fdff3c4-efa7-47d8-9c7c-dc4645441d1a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.963183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fdff3c4-efa7-47d8-9c7c-dc4645441d1a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.965021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fdff3c4-efa7-47d8-9c7c-dc4645441d1a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:15.024827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b3e7bc0d-c895-477a-a1e9-accca9a2998c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 204 len: 0 microversion: 2.1 time: 0.744140 Aug 25 12:50:15.027414 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 805/1602] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:14 2022] DELETE /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:15.055160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-68c3b861-46bd-4a18-ba34-9b5e7bdc0126 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:15.057478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-68c3b861-46bd-4a18-ba34-9b5e7bdc0126 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:15.093266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68c3b861-46bd-4a18-ba34-9b5e7bdc0126 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:15.096011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68c3b861-46bd-4a18-ba34-9b5e7bdc0126 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:15.096920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68c3b861-46bd-4a18-ba34-9b5e7bdc0126 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:15.100767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68c3b861-46bd-4a18-ba34-9b5e7bdc0126 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:15.102665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68c3b861-46bd-4a18-ba34-9b5e7bdc0126 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:15.103391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68c3b861-46bd-4a18-ba34-9b5e7bdc0126 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:15.515429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6fdff3c4-efa7-47d8-9c7c-dc4645441d1a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:15.577810 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6fdff3c4-efa7-47d8-9c7c-dc4645441d1a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1466 microversion: 2.1 time: 0.647718 Aug 25 12:50:15.589295 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 798/1603] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:14 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1466 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:15.616789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-37a3c4a7-4781-4f84-984f-72633b019e54 req-a37126f2-6830-4317-b2db-86cd8dd959b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5912e5f7-42bf-4388-9303-3510307e4122", "name": "network-vif-unplugged", "status": "completed", "tag": "3c92f5a8-0d40-48c8-a9b0-8c1136b1bab2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:15.679670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-37a3c4a7-4781-4f84-984f-72633b019e54 req-a37126f2-6830-4317-b2db-86cd8dd959b0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:15.681284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-37a3c4a7-4781-4f84-984f-72633b019e54 req-a37126f2-6830-4317-b2db-86cd8dd959b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:15.682838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-37a3c4a7-4781-4f84-984f-72633b019e54 req-a37126f2-6830-4317-b2db-86cd8dd959b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:15.728663 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-37a3c4a7-4781-4f84-984f-72633b019e54 req-a37126f2-6830-4317-b2db-86cd8dd959b0 service nova] Creating event network-vif-unplugged:3c92f5a8-0d40-48c8-a9b0-8c1136b1bab2 for instance 5912e5f7-42bf-4388-9303-3510307e4122 on n-h1-852771-8 Aug 25 12:50:15.746592 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-37a3c4a7-4781-4f84-984f-72633b019e54 req-a37126f2-6830-4317-b2db-86cd8dd959b0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151407 Aug 25 12:50:15.766641 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 799/1604] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:15.776218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c5331d3b-6765-40f1-bdf9-b9ede3c8c1c0 req-59eafc8d-b97c-4cb1-b93e-90d6e94eaf26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc86590d-191c-4f59-8b1c-bb10c9ff4a49", "tag": "8e7fc008-75c2-4e5a-a9dc-0d165e20b75d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:15.806905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-68c3b861-46bd-4a18-ba34-9b5e7bdc0126 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:15.823591 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-68c3b861-46bd-4a18-ba34-9b5e7bdc0126 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1318 microversion: 2.1 time: 0.780533 Aug 25 12:50:15.825095 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 806/1605] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:15 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1318 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:15.836347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b8aabea2-e8bf-46ed-85fe-0cf9e620900b tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:15.838142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b8aabea2-e8bf-46ed-85fe-0cf9e620900b tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:15.844681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c5331d3b-6765-40f1-bdf9-b9ede3c8c1c0 req-59eafc8d-b97c-4cb1-b93e-90d6e94eaf26 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:15.846927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c5331d3b-6765-40f1-bdf9-b9ede3c8c1c0 req-59eafc8d-b97c-4cb1-b93e-90d6e94eaf26 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:15.850677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c5331d3b-6765-40f1-bdf9-b9ede3c8c1c0 req-59eafc8d-b97c-4cb1-b93e-90d6e94eaf26 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:15.902254 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c5331d3b-6765-40f1-bdf9-b9ede3c8c1c0 req-59eafc8d-b97c-4cb1-b93e-90d6e94eaf26 service nova] Creating event network-changed:8e7fc008-75c2-4e5a-a9dc-0d165e20b75d for instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 on n-h1-852771-8 Aug 25 12:50:15.940509 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c5331d3b-6765-40f1-bdf9-b9ede3c8c1c0 req-59eafc8d-b97c-4cb1-b93e-90d6e94eaf26 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170360 Aug 25 12:50:15.941352 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 800/1606] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:15.987398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:15.989845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:16.014457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:16.015814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:16.017584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:16.027736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:16.028645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:16.029488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:16.049410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b8aabea2-e8bf-46ed-85fe-0cf9e620900b tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:16.079312 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b8aabea2-e8bf-46ed-85fe-0cf9e620900b tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1213 microversion: 2.1 time: 0.251225 Aug 25 12:50:16.081120 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 807/1607] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:15 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1213 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:16.089877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e95e3d7a-8642-4c31-a741-f72b9616857e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '.version_select at 0x7f3a2a1b68b0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:16.134195 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e95e3d7a-8642-4c31-a741-f72b9616857e tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319400392" status: 202 len: 0 microversion: 2.1 time: 0.050382 Aug 25 12:50:16.135956 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 808/1608] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 12:50:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319400392 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:50:16.162555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6a36387-e09c-4813-b226-29e011b381bc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a1d19d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:16.201571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:16.221786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:16.232779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:16.236323 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bfc0f2ec-6a93-42d9-86ba-699358259680 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1184 microversion: 2.25 time: 0.292842 Aug 25 12:50:16.238169 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 801/1609] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:15 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1184 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:16.247204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-386b2fb3-0ccd-4825-bcd9-b2dbf4854771 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a061160>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:16.256858 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b6a36387-e09c-4813-b226-29e011b381bc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Image not found. Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6a36387-e09c-4813-b226-29e011b381bc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52 HTTP/1.1 Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:16.261386 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: exception: Image not found. Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'fa6ad3a8-fb81-4037-a84f-64395182ba52'} Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:16.263931 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fa6ad3a8-fb81-4037-a84f-64395182ba52 to delete Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:16.265439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fa6ad3a8-fb81-4037-a84f-64395182ba52 could not be found. Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:16.268887 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:16.271496 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:16.275576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6a36387-e09c-4813-b226-29e011b381bc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Image not found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:16.278706 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b6a36387-e09c-4813-b226-29e011b381bc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52" status: 404 len: 62 microversion: 2.1 time: 0.140518 Aug 25 12:50:16.282323 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 809/1610] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:16 2022] DELETE /compute/v2.1/images/fa6ad3a8-fb81-4037-a84f-64395182ba52 => generated 62 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:16.310065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6d3c97c-7b32-46d7-b6b2-b34cd8023d4e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2a1cb4c0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:17.822941 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b6d3c97c-7b32-46d7-b6b2-b34cd8023d4e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "DELETE /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6" status: 204 len: 0 microversion: 2.1 time: 1.529868 Aug 25 12:50:17.830295 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 810/1611] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:16 2022] DELETE /compute/v2.1/images/7c252f03-820a-47b1-8c4a-79cf7f5c51d6 => generated 0 bytes in 1541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:17.839671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da42fb18-1009-45f9-9975-6d926e926d82 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:17.841866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da42fb18-1009-45f9-9975-6d926e926d82 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:17.852116 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-386b2fb3-0ccd-4825-bcd9-b2dbf4854771 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1454 microversion: 2.1 time: 1.611306 Aug 25 12:50:17.854957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da42fb18-1009-45f9-9975-6d926e926d82 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.856440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da42fb18-1009-45f9-9975-6d926e926d82 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.857658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da42fb18-1009-45f9-9975-6d926e926d82 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.859369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da42fb18-1009-45f9-9975-6d926e926d82 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.861025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da42fb18-1009-45f9-9975-6d926e926d82 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.862225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da42fb18-1009-45f9-9975-6d926e926d82 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.865141 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 802/1612] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:16 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1454 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:17.873845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:17.874766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:17.886068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.887052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.887762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.889061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.890037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.891581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.963091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:18.087327 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.compute.api [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Instance is already in deleting state, ignoring this request Aug 25 12:50:18.089395 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-30092a54-13ce-4a04-8a64-5242a35361de tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 204 len: 0 microversion: 2.1 time: 0.222328 Aug 25 12:50:18.091614 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 803/1613] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:17 2022] DELETE /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:18.102997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a3bebbba-0bc7-4e37-8250-ded0be33f75d tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:18.104752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a3bebbba-0bc7-4e37-8250-ded0be33f75d tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:18.119649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bebbba-0bc7-4e37-8250-ded0be33f75d tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.120573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bebbba-0bc7-4e37-8250-ded0be33f75d tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.121403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bebbba-0bc7-4e37-8250-ded0be33f75d tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.123343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bebbba-0bc7-4e37-8250-ded0be33f75d tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.124294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bebbba-0bc7-4e37-8250-ded0be33f75d tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.125131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bebbba-0bc7-4e37-8250-ded0be33f75d tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.211063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da42fb18-1009-45f9-9975-6d926e926d82 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:18.229648 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da42fb18-1009-45f9-9975-6d926e926d82 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1357 microversion: 2.1 time: 0.396803 Aug 25 12:50:18.246341 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 811/1614] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:17 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1357 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:18.267440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-031c35e6-d60f-40db-9bd8-dd26a1a617d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:18.269642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-031c35e6-d60f-40db-9bd8-dd26a1a617d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:18.282643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-031c35e6-d60f-40db-9bd8-dd26a1a617d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.284278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-031c35e6-d60f-40db-9bd8-dd26a1a617d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.285345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-031c35e6-d60f-40db-9bd8-dd26a1a617d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.287207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-031c35e6-d60f-40db-9bd8-dd26a1a617d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.288671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-031c35e6-d60f-40db-9bd8-dd26a1a617d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.289832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-031c35e6-d60f-40db-9bd8-dd26a1a617d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.528405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-031c35e6-d60f-40db-9bd8-dd26a1a617d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:18.546275 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-031c35e6-d60f-40db-9bd8-dd26a1a617d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1217 microversion: 2.1 time: 0.287006 Aug 25 12:50:18.549149 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 812/1615] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:18 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1217 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:18.560162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:18.561868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:18.578078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.581468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.582527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.584069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.585262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.586042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.913904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:18.949912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:18.956542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:18.966086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a3bebbba-0bc7-4e37-8250-ded0be33f75d tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:18.972162 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9e1fcda1-ae64-4e17-833d-ae336975fea0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1176 microversion: 2.25 time: 0.420525 Aug 25 12:50:19.000742 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 813/1616] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:18 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1176 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:19.018458 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a3bebbba-0bc7-4e37-8250-ded0be33f75d tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1318 microversion: 2.1 time: 0.924477 Aug 25 12:50:19.023001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-98ed922b-7c0c-47b4-bf0a-094e7d6e825b req-0fa34cbd-3e3c-4d68-9898-c4e450ebbf32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c96283-54f7-4c9e-8e46-c8bdb92a130e", "name": "network-vif-plugged", "status": "completed", "tag": "fac0c551-d4c8-42f1-9ee7-511b8a30ea31"}, {"server_uuid": "ebb0cfcc-71e4-4326-b8d9-dcf129be2a48", "name": "network-vif-unplugged", "status": "completed", "tag": "3e258a14-cb05-447b-b747-9cbe36ed9fc5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:19.034225 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 804/1617] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:18 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1318 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:19.049563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dd408f53-36ea-4ce1-8a5d-353a697380dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:19.051068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dd408f53-36ea-4ce1-8a5d-353a697380dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:19.064480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd408f53-36ea-4ce1-8a5d-353a697380dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:19.065718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd408f53-36ea-4ce1-8a5d-353a697380dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:19.066817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd408f53-36ea-4ce1-8a5d-353a697380dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:19.068390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd408f53-36ea-4ce1-8a5d-353a697380dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:19.068557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-98ed922b-7c0c-47b4-bf0a-094e7d6e825b req-0fa34cbd-3e3c-4d68-9898-c4e450ebbf32 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:19.069868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd408f53-36ea-4ce1-8a5d-353a697380dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:19.070566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-98ed922b-7c0c-47b4-bf0a-094e7d6e825b req-0fa34cbd-3e3c-4d68-9898-c4e450ebbf32 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:19.071318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd408f53-36ea-4ce1-8a5d-353a697380dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:19.071630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-98ed922b-7c0c-47b4-bf0a-094e7d6e825b req-0fa34cbd-3e3c-4d68-9898-c4e450ebbf32 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:19.131969 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-98ed922b-7c0c-47b4-bf0a-094e7d6e825b req-0fa34cbd-3e3c-4d68-9898-c4e450ebbf32 service nova] Creating event network-vif-plugged:fac0c551-d4c8-42f1-9ee7-511b8a30ea31 for instance f0c96283-54f7-4c9e-8e46-c8bdb92a130e on n-h2-852771-8 Aug 25 12:50:19.136870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dd408f53-36ea-4ce1-8a5d-353a697380dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:19.137779 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-98ed922b-7c0c-47b4-bf0a-094e7d6e825b req-0fa34cbd-3e3c-4d68-9898-c4e450ebbf32 service nova] Creating event network-vif-unplugged:3e258a14-cb05-447b-b747-9cbe36ed9fc5 for instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 on n-h1-852771-8 Aug 25 12:50:19.162956 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-98ed922b-7c0c-47b4-bf0a-094e7d6e825b req-0fa34cbd-3e3c-4d68-9898-c4e450ebbf32 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.155613 Aug 25 12:50:19.163999 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 814/1618] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:19.175563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-90e7ed58-7890-47a1-9ae3-9840f1502245 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '.version_select at 0x7f3a2e947310>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:19.263344 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-90e7ed58-7890-47a1-9ae3-9840f1502245 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] HTTP exception thrown: Image not found. Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-90e7ed58-7890-47a1-9ae3-9840f1502245 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Request method failure captured: Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 HTTP/1.1 Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB29I8HSaDvXZsUnpiD-cJzfnWolRk6FqHVeicy1uKqEOUiga-mPy6IA6_cIow2_m_7JE6fz-_WNbQZO__BPE-RZyrg3wiR4YbTFfPbwLQuaoJXjyBMgbRMAQ6lzlwZIQyetqbEuajs_Ct7NyndKepkfO4KoqB0dhUSxTdH_r26bjwcY Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 9d4312a6d6044d23a16429fcda142b0e Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerTestJSON-1278873808 Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:19.269558 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d4312a6d6044d23a16429fcda142b0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d4312a6d6044d23a16429fcda142b0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d4312a6d6044d23a16429fcda142b0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d4312a6d6044d23a16429fcda142b0e"}]}] Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerTestJSON-1278873808 Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 9d4312a6d6044d23a16429fcda142b0e Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1278873808 Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerTestJSON-1278873808-project Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: ff2960e821954604ac0d3153d9853a9f Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerTestJSON-1278873808-project Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: exception: Image not found. Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5'} Aug 25 12:50:19.272567 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 to delete Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:19.274353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 could not be found. Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:19.276768 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:19.285823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-90e7ed58-7890-47a1-9ae3-9840f1502245 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Returning 404 to user: Image not found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:19.289045 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-90e7ed58-7890-47a1-9ae3-9840f1502245 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "DELETE /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5" status: 404 len: 62 microversion: 2.1 time: 0.123029 Aug 25 12:50:19.295687 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 815/1619] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:19 2022] DELETE /compute/v2.1/images/f70ca354-61e8-4ff0-90b7-fa5aeb8b5df5 => generated 62 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:19.323851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4505c4c5-f5e8-471c-b34c-895eef9a3515 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:19.333784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4505c4c5-f5e8-471c-b34c-895eef9a3515 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:19.402387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4505c4c5-f5e8-471c-b34c-895eef9a3515 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:19.408498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4505c4c5-f5e8-471c-b34c-895eef9a3515 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:19.411543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4505c4c5-f5e8-471c-b34c-895eef9a3515 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:19.421659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4505c4c5-f5e8-471c-b34c-895eef9a3515 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:19.427647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4505c4c5-f5e8-471c-b34c-895eef9a3515 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:19.428938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4505c4c5-f5e8-471c-b34c-895eef9a3515 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:19.582864 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dd408f53-36ea-4ce1-8a5d-353a697380dd tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 204 len: 0 microversion: 2.1 time: 0.521739 Aug 25 12:50:19.590050 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 805/1620] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:19 2022] DELETE /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:19.616683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e4b70ca3-c9cf-47cb-a5be-814c644ddea4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a0b74c0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:19.832047 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e4b70ca3-c9cf-47cb-a5be-814c644ddea4 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1454 microversion: 2.1 time: 0.238899 Aug 25 12:50:19.875313 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 806/1621] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:19 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1454 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:19.885423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-924984b6-6746-46d8-b80a-e20dceebdb3f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:19.887894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-924984b6-6746-46d8-b80a-e20dceebdb3f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:19.900393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924984b6-6746-46d8-b80a-e20dceebdb3f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:19.901990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924984b6-6746-46d8-b80a-e20dceebdb3f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:19.903173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924984b6-6746-46d8-b80a-e20dceebdb3f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:19.904720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924984b6-6746-46d8-b80a-e20dceebdb3f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:19.906203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924984b6-6746-46d8-b80a-e20dceebdb3f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:19.908202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924984b6-6746-46d8-b80a-e20dceebdb3f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:22.587183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-924984b6-6746-46d8-b80a-e20dceebdb3f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:22.621252 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-924984b6-6746-46d8-b80a-e20dceebdb3f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1357 microversion: 2.1 time: 2.742900 Aug 25 12:50:22.622708 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 807/1622] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:19 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1357 bytes in 2746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:22.642238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bed26f82-7cc4-4b3a-8998-1d6c10014e2e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:22.643840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bed26f82-7cc4-4b3a-8998-1d6c10014e2e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:22.657340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4505c4c5-f5e8-471c-b34c-895eef9a3515 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db6a11f66554018ba91a5fabb891492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da51872cc1924bb99ee10d4a28cfb2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:22.680999 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4505c4c5-f5e8-471c-b34c-895eef9a3515 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 200 len: 1492 microversion: 2.1 time: 3.382920 Aug 25 12:50:22.683374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bed26f82-7cc4-4b3a-8998-1d6c10014e2e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:22.684757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bed26f82-7cc4-4b3a-8998-1d6c10014e2e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:22.687687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bed26f82-7cc4-4b3a-8998-1d6c10014e2e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:22.689006 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 816/1623] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:19 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 1492 bytes in 3392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:22.693386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bed26f82-7cc4-4b3a-8998-1d6c10014e2e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:22.694812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bed26f82-7cc4-4b3a-8998-1d6c10014e2e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:22.706219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bed26f82-7cc4-4b3a-8998-1d6c10014e2e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:22.717288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-213848eb-3da5-4aab-b47c-224d5b35f5a4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:22.726754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-213848eb-3da5-4aab-b47c-224d5b35f5a4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:22.752438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-213848eb-3da5-4aab-b47c-224d5b35f5a4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:22.764315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-213848eb-3da5-4aab-b47c-224d5b35f5a4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:22.765494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-213848eb-3da5-4aab-b47c-224d5b35f5a4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:22.767883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-213848eb-3da5-4aab-b47c-224d5b35f5a4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:22.774759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-213848eb-3da5-4aab-b47c-224d5b35f5a4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:22.783488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-213848eb-3da5-4aab-b47c-224d5b35f5a4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:22.876913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bed26f82-7cc4-4b3a-8998-1d6c10014e2e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:23.092557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:23.187061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-213848eb-3da5-4aab-b47c-224d5b35f5a4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:23.238961 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bed26f82-7cc4-4b3a-8998-1d6c10014e2e tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 204 len: 0 microversion: 2.1 time: 0.613673 Aug 25 12:50:23.252987 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 808/1624] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:22 2022] DELETE /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:23.253995 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-213848eb-3da5-4aab-b47c-224d5b35f5a4 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1271 microversion: 2.1 time: 0.562375 Aug 25 12:50:23.255834 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 817/1625] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:22 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1271 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:23.270977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:23.273329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:23.287584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b5fe873-2cc0-487f-baf5-50b7a0d92254 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:23.289081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b5fe873-2cc0-487f-baf5-50b7a0d92254 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:23.291879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:23.293760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:23.298182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:23.303926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:23.306403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:23.307752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:23.310841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b5fe873-2cc0-487f-baf5-50b7a0d92254 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:23.311683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b5fe873-2cc0-487f-baf5-50b7a0d92254 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:23.312449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b5fe873-2cc0-487f-baf5-50b7a0d92254 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:23.323533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b5fe873-2cc0-487f-baf5-50b7a0d92254 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:23.324923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b5fe873-2cc0-487f-baf5-50b7a0d92254 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:23.326065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b5fe873-2cc0-487f-baf5-50b7a0d92254 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:23.499198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:23.573966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:23.651335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:24.678245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:24.776060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:24.790845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:24.793216 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eeb86692-35da-4d1c-b738-0fb1bed04b16 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1250 microversion: 2.25 time: 1.534638 Aug 25 12:50:24.819598 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 818/1626] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:23 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1250 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:24.847957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08685a90-4299-42cb-b69f-f3177b4e6928 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:24.863673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-08685a90-4299-42cb-b69f-f3177b4e6928 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:24.886983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08685a90-4299-42cb-b69f-f3177b4e6928 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:24.895461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08685a90-4299-42cb-b69f-f3177b4e6928 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:24.900092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08685a90-4299-42cb-b69f-f3177b4e6928 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:24.913271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08685a90-4299-42cb-b69f-f3177b4e6928 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:24.939169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08685a90-4299-42cb-b69f-f3177b4e6928 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:24.940525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08685a90-4299-42cb-b69f-f3177b4e6928 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.061461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b5fe873-2cc0-487f-baf5-50b7a0d92254 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:25.086635 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b5fe873-2cc0-487f-baf5-50b7a0d92254 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 200 len: 1469 microversion: 2.1 time: 1.829956 Aug 25 12:50:25.119604 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 809/1627] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:23 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 1469 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:25.170757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-237952e5-215c-4bbf-a291-91facb7a5a50 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a0939d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:25.399257 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-237952e5-215c-4bbf-a291-91facb7a5a50 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1454 microversion: 2.1 time: 0.250884 Aug 25 12:50:25.421058 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 810/1628] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:25 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1454 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:25.449158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-99a5973b-e48b-4c68-8918-c77b3aa6f5e2 req-dfa1d286-4e85-4663-b83f-a284ce7098d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5912e5f7-42bf-4388-9303-3510307e4122", "name": "network-vif-deleted", "tag": "3c92f5a8-0d40-48c8-a9b0-8c1136b1bab2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:25.527559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-99a5973b-e48b-4c68-8918-c77b3aa6f5e2 req-dfa1d286-4e85-4663-b83f-a284ce7098d2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:25.531247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-99a5973b-e48b-4c68-8918-c77b3aa6f5e2 req-dfa1d286-4e85-4663-b83f-a284ce7098d2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:25.537757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-99a5973b-e48b-4c68-8918-c77b3aa6f5e2 req-dfa1d286-4e85-4663-b83f-a284ce7098d2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.602568 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-99a5973b-e48b-4c68-8918-c77b3aa6f5e2 req-dfa1d286-4e85-4663-b83f-a284ce7098d2 service nova] Creating event network-vif-deleted:3c92f5a8-0d40-48c8-a9b0-8c1136b1bab2 for instance 5912e5f7-42bf-4388-9303-3510307e4122 on n-h1-852771-8 Aug 25 12:50:25.664144 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-99a5973b-e48b-4c68-8918-c77b3aa6f5e2 req-dfa1d286-4e85-4663-b83f-a284ce7098d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248856 Aug 25 12:50:25.670197 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 811/1629] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:25.728143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e453575-3b24-4fb1-b258-28f214d357bf tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:25.737182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5e453575-3b24-4fb1-b258-28f214d357bf tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:25.772027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e453575-3b24-4fb1-b258-28f214d357bf tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:25.772905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e453575-3b24-4fb1-b258-28f214d357bf tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:25.774207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e453575-3b24-4fb1-b258-28f214d357bf tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.785164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e453575-3b24-4fb1-b258-28f214d357bf tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:25.788218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e453575-3b24-4fb1-b258-28f214d357bf tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:25.790334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e453575-3b24-4fb1-b258-28f214d357bf tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.902515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-08685a90-4299-42cb-b69f-f3177b4e6928 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:25.984548 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-08685a90-4299-42cb-b69f-f3177b4e6928 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1509 microversion: 2.1 time: 1.165734 Aug 25 12:50:25.987560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 819/1630] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:24 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1509 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:25.999698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eada6964-df67-420d-90de-9368666e1516 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:26.001434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eada6964-df67-420d-90de-9368666e1516 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:26.029334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eada6964-df67-420d-90de-9368666e1516 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:26.032569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eada6964-df67-420d-90de-9368666e1516 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:26.033831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eada6964-df67-420d-90de-9368666e1516 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:26.037194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eada6964-df67-420d-90de-9368666e1516 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:26.041542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eada6964-df67-420d-90de-9368666e1516 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:26.044163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eada6964-df67-420d-90de-9368666e1516 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:26.104201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=16 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:26.997732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eada6964-df67-420d-90de-9368666e1516 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:27.049749 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eada6964-df67-420d-90de-9368666e1516 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1357 microversion: 2.1 time: 1.059720 Aug 25 12:50:27.057207 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 820/1631] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:25 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1357 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:27.081790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:27.083507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 5912e5f7-42bf-4388-9303-3510307e4122] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:27.110404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:27.126217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:27.127205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:27.134699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:27.135708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:27.136816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:27.211700 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Instance 5912e5f7-42bf-4388-9303-3510307e4122 could not be found. Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 HTTP/1.1 Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:27.222304 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 5912e5f7-42bf-4388-9303-3510307e4122 could not be found. Aug 25 12:50:27.225466 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '5912e5f7-42bf-4388-9303-3510307e4122'} Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5912e5f7-42bf-4388-9303-3510307e4122 could not be found. Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:27.227479 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5912e5f7-42bf-4388-9303-3510307e4122 could not be found. Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5912e5f7-42bf-4388-9303-3510307e4122 could not be found. Aug 25 12:50:27.230333 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:27.253887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Instance 5912e5f7-42bf-4388-9303-3510307e4122 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:27.258372 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f17ac749-c514-46af-930c-d0cddf0ba853 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122" status: 404 len: 111 microversion: 2.1 time: 0.198586 Aug 25 12:50:27.275901 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 821/1632] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:27 2022] GET /compute/v2.1/servers/5912e5f7-42bf-4388-9303-3510307e4122 => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:27.290088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9c71999b-f1cc-4e80-bc3e-1ac3ef875214 req-fa68b965-27dd-4cf5-a065-0bd750077371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc86590d-191c-4f59-8b1c-bb10c9ff4a49", "name": "network-vif-plugged", "status": "completed", "tag": "8e7fc008-75c2-4e5a-a9dc-0d165e20b75d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:27.306933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5e453575-3b24-4fb1-b258-28f214d357bf tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:27.348272 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5e453575-3b24-4fb1-b258-28f214d357bf tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1472 microversion: 2.1 time: 1.671369 Aug 25 12:50:27.354000 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 812/1633] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:25 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1472 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:27.354341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9c71999b-f1cc-4e80-bc3e-1ac3ef875214 req-fa68b965-27dd-4cf5-a065-0bd750077371 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:27.355156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9c71999b-f1cc-4e80-bc3e-1ac3ef875214 req-fa68b965-27dd-4cf5-a065-0bd750077371 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:27.355854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9c71999b-f1cc-4e80-bc3e-1ac3ef875214 req-fa68b965-27dd-4cf5-a065-0bd750077371 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:27.378949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10b430d7-0d45-4a46-a4a7-258434b59718 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:27.380656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-10b430d7-0d45-4a46-a4a7-258434b59718 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:27.418173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10b430d7-0d45-4a46-a4a7-258434b59718 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:27.421746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10b430d7-0d45-4a46-a4a7-258434b59718 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:27.425789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10b430d7-0d45-4a46-a4a7-258434b59718 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:27.432574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10b430d7-0d45-4a46-a4a7-258434b59718 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:27.433676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10b430d7-0d45-4a46-a4a7-258434b59718 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:27.436675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10b430d7-0d45-4a46-a4a7-258434b59718 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:27.465352 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9c71999b-f1cc-4e80-bc3e-1ac3ef875214 req-fa68b965-27dd-4cf5-a065-0bd750077371 service nova] Creating event network-vif-plugged:8e7fc008-75c2-4e5a-a9dc-0d165e20b75d for instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 on n-h1-852771-8 Aug 25 12:50:27.485206 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9c71999b-f1cc-4e80-bc3e-1ac3ef875214 req-fa68b965-27dd-4cf5-a065-0bd750077371 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205930 Aug 25 12:50:27.487707 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 822/1634] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:27.498187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:27.500168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:27.514248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:27.515813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:27.519115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:27.535633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:27.552600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:27.556722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:28.771201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10b430d7-0d45-4a46-a4a7-258434b59718 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:28.813263 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-10b430d7-0d45-4a46-a4a7-258434b59718 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1313 microversion: 2.1 time: 1.456215 Aug 25 12:50:28.815658 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 813/1635] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:27 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1313 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:28.836256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:28.842541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: fe666709-aa48-4785-8e47-ac9011592ddc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:28.872499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:28.880770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:28.882018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:28.889573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:28.891487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:28.907614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:28.966903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:28.981559 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] HTTP exception thrown: Instance fe666709-aa48-4785-8e47-ac9011592ddc could not be found. Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Request method failure captured: Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc HTTP/1.1 Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23zrl8eFm6rCg0aDzSQsQRHaJKvV4Ry5sRTQJcMT21Rk_Kk42jZqJV9BFoU9rdHVIBWo_AjD7xVwIxBSFhDZh-zZpHAZIQ7EsG7Ex6GDD9FS--04JcLTUONJw_V1vei4n3X-Fu94JgAzy2oyNVVJoA5Bhk6BntQkU2bGnTOG-_JncE Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: ff9affc0d6e64775b2dfd65eceb7f223 Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:29.028422 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff9affc0d6e64775b2dfd65eceb7f223"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ff9affc0d6e64775b2dfd65eceb7f223", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ff9affc0d6e64775b2dfd65eceb7f223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff9affc0d6e64775b2dfd65eceb7f223"}]}] Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: ff9affc0d6e64775b2dfd65eceb7f223 Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-MigrationsAdminTest-1644461283-project Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: aad1bc68cede45a7b1ab7cbda0d8208e Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-MigrationsAdminTest-1644461283-project Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance fe666709-aa48-4785-8e47-ac9011592ddc could not be found. Aug 25 12:50:29.032427 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'fe666709-aa48-4785-8e47-ac9011592ddc'} Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe666709-aa48-4785-8e47-ac9011592ddc could not be found. Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:29.034483 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe666709-aa48-4785-8e47-ac9011592ddc could not be found. Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe666709-aa48-4785-8e47-ac9011592ddc could not be found. Aug 25 12:50:29.037333 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.057872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Returning 404 to user: Instance fe666709-aa48-4785-8e47-ac9011592ddc could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:29.067991 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-21fd5c75-e28a-492a-996d-febeeacc1905 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc" status: 404 len: 111 microversion: 2.1 time: 0.247824 Aug 25 12:50:29.076047 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 814/1636] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:28 2022] GET /compute/v2.1/servers/fe666709-aa48-4785-8e47-ac9011592ddc => generated 111 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:29.089014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:29.107645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:29.118411 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74d6067f-4f03-41da-bdce-c0b7d0123723 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1292 microversion: 2.25 time: 1.619697 Aug 25 12:50:29.123662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2cb4abf7-8ab5-4daf-8c48-2fe8c1ca0d71 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a29fc9790>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:29.135853 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 823/1637] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:27 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1292 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:29.193657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2b979c4-385d-49cd-b40d-7a7cec0b972b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2e831a60>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:29.391659 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b2b979c4-385d-49cd-b40d-7a7cec0b972b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Image not found. Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2b979c4-385d-49cd-b40d-7a7cec0b972b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 HTTP/1.1 Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:29.399390 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: exception: Image not found. Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '3d59e417-4201-46c7-a35f-699f1627a853'} Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:29.402231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3d59e417-4201-46c7-a35f-699f1627a853 to delete Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.404305 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3d59e417-4201-46c7-a35f-699f1627a853 could not be found. Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:29.408065 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:29.414407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2b979c4-385d-49cd-b40d-7a7cec0b972b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Image not found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:29.423027 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2b979c4-385d-49cd-b40d-7a7cec0b972b tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853" status: 404 len: 62 microversion: 2.1 time: 0.285058 Aug 25 12:50:29.426824 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 824/1638] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:29 2022] DELETE /compute/v2.1/images/3d59e417-4201-46c7-a35f-699f1627a853 => generated 62 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:29.503493 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2cb4abf7-8ab5-4daf-8c48-2fe8c1ca0d71 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1454 microversion: 2.1 time: 0.419816 Aug 25 12:50:29.508122 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 815/1639] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:29 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1454 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:29.532759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-e98676b2-12df-4623-b35e-90b65c46ab86 req-926c5c6c-6af8-4d52-934f-dd07d65fc1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe666709-aa48-4785-8e47-ac9011592ddc", "name": "network-vif-deleted", "tag": "dde49cc7-dbaf-4c67-b244-a03554f3fb0c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:29.546019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ae8ddc50-77e1-4669-b446-3cbc26ee8b16 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:29.555033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ae8ddc50-77e1-4669-b446-3cbc26ee8b16 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:29.585291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc50-77e1-4669-b446-3cbc26ee8b16 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:29.598882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e98676b2-12df-4623-b35e-90b65c46ab86 req-926c5c6c-6af8-4d52-934f-dd07d65fc1c7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:29.607600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e98676b2-12df-4623-b35e-90b65c46ab86 req-926c5c6c-6af8-4d52-934f-dd07d65fc1c7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:29.608370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc50-77e1-4669-b446-3cbc26ee8b16 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:29.609433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc50-77e1-4669-b446-3cbc26ee8b16 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:29.611211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e98676b2-12df-4623-b35e-90b65c46ab86 req-926c5c6c-6af8-4d52-934f-dd07d65fc1c7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:29.613825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc50-77e1-4669-b446-3cbc26ee8b16 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:29.617916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc50-77e1-4669-b446-3cbc26ee8b16 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:29.629986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc50-77e1-4669-b446-3cbc26ee8b16 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:29.694535 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-e98676b2-12df-4623-b35e-90b65c46ab86 req-926c5c6c-6af8-4d52-934f-dd07d65fc1c7 service nova] Creating event network-vif-deleted:dde49cc7-dbaf-4c67-b244-a03554f3fb0c for instance fe666709-aa48-4785-8e47-ac9011592ddc on n-h1-852771-8 Aug 25 12:50:29.701640 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-e98676b2-12df-4623-b35e-90b65c46ab86 req-926c5c6c-6af8-4d52-934f-dd07d65fc1c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228836 Aug 25 12:50:29.711549 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 825/1640] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:29.742319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-afff5ccd-a802-4b9f-99e7-05769c41678a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:29.746767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-afff5ccd-a802-4b9f-99e7-05769c41678a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:29.761579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afff5ccd-a802-4b9f-99e7-05769c41678a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:29.764528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afff5ccd-a802-4b9f-99e7-05769c41678a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:29.767930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afff5ccd-a802-4b9f-99e7-05769c41678a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:29.770938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afff5ccd-a802-4b9f-99e7-05769c41678a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:29.771939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afff5ccd-a802-4b9f-99e7-05769c41678a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:29.774696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afff5ccd-a802-4b9f-99e7-05769c41678a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:29.845011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:30.144931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-afff5ccd-a802-4b9f-99e7-05769c41678a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2960e821954604ac0d3153d9853a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4312a6d6044d23a16429fcda142b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:30.188108 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-afff5ccd-a802-4b9f-99e7-05769c41678a tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 200 len: 1302 microversion: 2.1 time: 0.474558 Aug 25 12:50:30.199008 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 826/1641] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:29 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 1302 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:30.220329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-890372cf-ffc8-4e7a-a9a5-3a72fbf0698f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:30.221725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-890372cf-ffc8-4e7a-a9a5-3a72fbf0698f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:30.255352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890372cf-ffc8-4e7a-a9a5-3a72fbf0698f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:30.256276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890372cf-ffc8-4e7a-a9a5-3a72fbf0698f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:30.262030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890372cf-ffc8-4e7a-a9a5-3a72fbf0698f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:30.263887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890372cf-ffc8-4e7a-a9a5-3a72fbf0698f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:30.267695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890372cf-ffc8-4e7a-a9a5-3a72fbf0698f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:30.268921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890372cf-ffc8-4e7a-a9a5-3a72fbf0698f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:30.384628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-890372cf-ffc8-4e7a-a9a5-3a72fbf0698f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:30.904636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:30.925389 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-890372cf-ffc8-4e7a-a9a5-3a72fbf0698f tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 204 len: 0 microversion: 2.1 time: 0.719951 Aug 25 12:50:30.935928 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 827/1642] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:30 2022] DELETE /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:30.982700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:30.987371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:31.026620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.028033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.033896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.036688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.042317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.043679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.058330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ae8ddc50-77e1-4669-b446-3cbc26ee8b16 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:31.097881 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ae8ddc50-77e1-4669-b446-3cbc26ee8b16 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1357 microversion: 2.1 time: 1.583638 Aug 25 12:50:31.100437 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 816/1643] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:29 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1357 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:31.116972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-93f3a00c-053b-445f-8152-545da9dd321c tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:31.119174 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. Aug 25 12:50:31.119696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-93f3a00c-053b-445f-8152-545da9dd321c tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 HTTP/1.1 Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:31.125289 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. Aug 25 12:50:31.128704 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '7381daf9-37a3-47df-823d-69f8fc28e831'} Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:31.130475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. Aug 25 12:50:31.133763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:31.139068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:31.141985 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1dba9a3f-1fba-4872-93ec-79b30ea1e652 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 404 len: 111 microversion: 2.1 time: 0.196302 Aug 25 12:50:31.143462 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 828/1644] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:30 2022] DELETE /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:31.148905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93f3a00c-053b-445f-8152-545da9dd321c tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.150387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93f3a00c-053b-445f-8152-545da9dd321c tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.151777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93f3a00c-053b-445f-8152-545da9dd321c tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.153733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93f3a00c-053b-445f-8152-545da9dd321c tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.158395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93f3a00c-053b-445f-8152-545da9dd321c tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.159750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93f3a00c-053b-445f-8152-545da9dd321c tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.175712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:31.177289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:31.215704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.222017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.223477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.225270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.226596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.231821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.988656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:32.015184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:32.024599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:32.029562 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3a30b0bb-169b-44aa-9a45-5bb19f6e8790 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1292 microversion: 2.25 time: 0.875359 Aug 25 12:50:32.032272 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 829/1645] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:31 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1292 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:32.045144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0381b53d-65a6-422f-93b1-6c0972614de8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e8311f0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:32.155273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-93f3a00c-053b-445f-8152-545da9dd321c tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:32.207212 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0381b53d-65a6-422f-93b1-6c0972614de8 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1463 microversion: 2.1 time: 0.170155 Aug 25 12:50:32.225839 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-93f3a00c-053b-445f-8152-545da9dd321c tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1313 microversion: 2.1 time: 1.122585 Aug 25 12:50:32.227770 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 817/1647] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:31 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1313 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:32.228017 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 830/1647] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:32 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1463 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:32.243376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:32.243744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d1cb12e-6d64-43a2-ad2e-1c2741f041c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:32.244663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4d1cb12e-6d64-43a2-ad2e-1c2741f041c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:32.245885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 7381daf9-37a3-47df-823d-69f8fc28e831] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:32.263311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.264791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.268116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.269598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1cb12e-6d64-43a2-ad2e-1c2741f041c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.270467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1cb12e-6d64-43a2-ad2e-1c2741f041c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.271067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.271280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1cb12e-6d64-43a2-ad2e-1c2741f041c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.272418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1cb12e-6d64-43a2-ad2e-1c2741f041c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.273021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.276255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.284702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1cb12e-6d64-43a2-ad2e-1c2741f041c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.285564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1cb12e-6d64-43a2-ad2e-1c2741f041c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.330500 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 HTTP/1.1 Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:32.336060 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. Aug 25 12:50:32.339414 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7381daf9-37a3-47df-823d-69f8fc28e831'} Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:32.342733 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. Aug 25 12:50:32.347884 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:32.350382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Instance 7381daf9-37a3-47df-823d-69f8fc28e831 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:32.350382 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-56db106e-1a6b-4232-897e-0ce988a31c1e tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831" status: 404 len: 111 microversion: 2.1 time: 0.114160 Aug 25 12:50:32.350382 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 818/1648] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:32 2022] GET /compute/v2.1/servers/7381daf9-37a3-47df-823d-69f8fc28e831 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:32.367451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:32.376215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] [instance: ebb0cfcc-71e4-4326-b8d9-dcf129be2a48] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:32.392917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.394783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.396219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.398201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.399462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.404547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.462577 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] HTTP exception thrown: Instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 could not be found. Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Request method failure captured: Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 HTTP/1.1 Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB29I8HSaDvXZsUnpiD-cJzfnWolRk6FqHVeicy1uKqEOUiga-mPy6IA6_cIow2_m_7JE6fz-_WNbQZO__BPE-RZyrg3wiR4YbTFfPbwLQuaoJXjyBMgbRMAQ6lzlwZIQyetqbEuajs_Ct7NyndKepkfO4KoqB0dhUSxTdH_r26bjwcY Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 9d4312a6d6044d23a16429fcda142b0e Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesOneServerTestJSON-1278873808 Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:32.483681 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d4312a6d6044d23a16429fcda142b0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d4312a6d6044d23a16429fcda142b0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d4312a6d6044d23a16429fcda142b0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d4312a6d6044d23a16429fcda142b0e"}]}] Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesOneServerTestJSON-1278873808 Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 9d4312a6d6044d23a16429fcda142b0e Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1278873808 Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesOneServerTestJSON-1278873808-project Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: ff2960e821954604ac0d3153d9853a9f Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesOneServerTestJSON-1278873808-project Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 could not be found. Aug 25 12:50:32.488863 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ebb0cfcc-71e4-4326-b8d9-dcf129be2a48'} Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 could not be found. Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:32.492479 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 could not be found. Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 could not be found. Aug 25 12:50:32.496054 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:32.503462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] Returning 404 to user: Instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:32.505850 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d12614ed-ede1-4b1f-a254-82d2620e6744 tempest-ImagesOneServerTestJSON-1278873808 tempest-ImagesOneServerTestJSON-1278873808-project] 10.222.0.70 "GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48" status: 404 len: 111 microversion: 2.1 time: 0.148545 Aug 25 12:50:32.508241 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 819/1649] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:32 2022] GET /compute/v2.1/servers/ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:32.524923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9ace801f-d77a-44d3-99a5-422bbae0e8fc req-56c1344f-e309-4640-a1fb-3ae55c698042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb0cfcc-71e4-4326-b8d9-dcf129be2a48", "name": "network-vif-deleted", "tag": "3e258a14-cb05-447b-b747-9cbe36ed9fc5"}, {"name": "network-changed", "server_uuid": "ca859734-6370-48aa-b3c3-22ff3362f6b1", "tag": "e899f17a-afed-4127-8666-0bdca4cad26c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:32.574056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9ace801f-d77a-44d3-99a5-422bbae0e8fc req-56c1344f-e309-4640-a1fb-3ae55c698042 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.574952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9ace801f-d77a-44d3-99a5-422bbae0e8fc req-56c1344f-e309-4640-a1fb-3ae55c698042 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.575776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9ace801f-d77a-44d3-99a5-422bbae0e8fc req-56c1344f-e309-4640-a1fb-3ae55c698042 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.628946 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9ace801f-d77a-44d3-99a5-422bbae0e8fc req-56c1344f-e309-4640-a1fb-3ae55c698042 service nova] Creating event network-vif-deleted:3e258a14-cb05-447b-b747-9cbe36ed9fc5 for instance ebb0cfcc-71e4-4326-b8d9-dcf129be2a48 on n-h1-852771-8 Aug 25 12:50:32.629992 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9ace801f-d77a-44d3-99a5-422bbae0e8fc req-56c1344f-e309-4640-a1fb-3ae55c698042 service nova] Creating event network-changed:e899f17a-afed-4127-8666-0bdca4cad26c for instance ca859734-6370-48aa-b3c3-22ff3362f6b1 on n-h1-852771-8 Aug 25 12:50:32.651321 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9ace801f-d77a-44d3-99a5-422bbae0e8fc req-56c1344f-e309-4640-a1fb-3ae55c698042 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.139587 Aug 25 12:50:32.665148 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 820/1650] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:32.684478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-599df4be-f882-4ba7-91ef-1d9c3109f8d3 req-43cf0b2c-5127-4d5f-a388-899c8e548898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b40100f3-81b6-4ae1-8bd0-46a6e367df2f", "tag": "41ae88a6-3423-4cdf-a3a1-7841f4e38bfb"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:32.719011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-599df4be-f882-4ba7-91ef-1d9c3109f8d3 req-43cf0b2c-5127-4d5f-a388-899c8e548898 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.723746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-599df4be-f882-4ba7-91ef-1d9c3109f8d3 req-43cf0b2c-5127-4d5f-a388-899c8e548898 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.727107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-599df4be-f882-4ba7-91ef-1d9c3109f8d3 req-43cf0b2c-5127-4d5f-a388-899c8e548898 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.764082 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-599df4be-f882-4ba7-91ef-1d9c3109f8d3 req-43cf0b2c-5127-4d5f-a388-899c8e548898 service nova] Creating event network-changed:41ae88a6-3423-4cdf-a3a1-7841f4e38bfb for instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f on n-h1-852771-8 Aug 25 12:50:32.791431 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-599df4be-f882-4ba7-91ef-1d9c3109f8d3 req-43cf0b2c-5127-4d5f-a388-899c8e548898 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118556 Aug 25 12:50:32.795361 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 821/1651] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:32.806091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9b6cc3f9-1a6a-4077-bffc-fd939bc4d71a"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:32.810929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:32.840756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.841682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.842434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.844597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.845493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.846426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:33.097029 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] HTTP exception thrown: Volume 21942fb2-a37d-4db3-b64b-38cb5872ca7e could not be found. Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Request method failure captured: Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e/os-volume_attachments/21942fb2-a37d-4db3-b64b-38cb5872ca7e HTTP/1.1 Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 74 Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB28HrQtzxB6ibht-eYss1V-ajgO6mMiQIU97PDUIEcd_k6rU6wyj-DsxCFJchE_aYSXCUwoHLE1Y5F0ZQVxehtw_sEOlHZe-NPlgZblaQ6JaEuEfDrMk0UVoQLcNELlVEGfa6McPIAkP55omGmP1x_CQyVZFkjSS9DnS9FeTXW0jXR0 Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 2bbf3e5194b045198961dd8e7b2d5645 Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-VolumesAdminNegativeTest-329682094 Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 12:50:33.121993 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2bbf3e5194b045198961dd8e7b2d5645"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2bbf3e5194b045198961dd8e7b2d5645", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2bbf3e5194b045198961dd8e7b2d5645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2bbf3e5194b045198961dd8e7b2d5645"}]}] Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-VolumesAdminNegativeTest-329682094 Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 2bbf3e5194b045198961dd8e7b2d5645 Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-329682094 Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-VolumesAdminNegativeTest-329682094-project-admin Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: f920e9483c2e4e9fa397c0677d1bb849 Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-VolumesAdminNegativeTest-329682094-project-admin Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: {"volumeAttachment": {"volumeId": "9b6cc3f9-1a6a-4077-bffc-fd939bc4d71a"}} Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:50:33.125540 n-d-852771-8 devstack@n-api.service[129059]: exception: Volume 21942fb2-a37d-4db3-b64b-38cb5872ca7e could not be found. Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'server_id': 'f0c96283-54f7-4c9e-8e46-c8bdb92a130e', 'id': '21942fb2-a37d-4db3-b64b-38cb5872ca7e', 'body': {'volumeAttachment': {'volumeId': '9b6cc3f9-1a6a-4077-bffc-fd939bc4d71a'}}} Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:50:33.127668 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 21942fb2-a37d-4db3-b64b-38cb5872ca7e could not be found. (HTTP 404) (Request-ID: req-22374aa0-318d-47d4-83c5-0aedd1fa8983) Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 12:50:33.130193 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 21942fb2-a37d-4db3-b64b-38cb5872ca7e could not be found. Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:33.132673 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 21942fb2-a37d-4db3-b64b-38cb5872ca7e could not be found. Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 21942fb2-a37d-4db3-b64b-38cb5872ca7e could not be found. Aug 25 12:50:33.135252 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.142158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] Returning 404 to user: Volume 21942fb2-a37d-4db3-b64b-38cb5872ca7e could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:33.142158 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ed4366dc-018a-465d-8687-b482cf9c85b5 tempest-VolumesAdminNegativeTest-329682094 tempest-VolumesAdminNegativeTest-329682094-project-admin] 10.222.0.70 "PUT /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e/os-volume_attachments/21942fb2-a37d-4db3-b64b-38cb5872ca7e" status: 404 len: 109 microversion: 2.1 time: 0.326803 Aug 25 12:50:33.142158 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 822/1652] 10.222.0.70 () {60 vars in 1433 bytes} [Thu Aug 25 12:50:32 2022] PUT /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e/os-volume_attachments/21942fb2-a37d-4db3-b64b-38cb5872ca7e => generated 109 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:33.160842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df99b6ff-0109-4f49-88bf-2d787052161c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:33.178437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df99b6ff-0109-4f49-88bf-2d787052161c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:33.178797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4d1cb12e-6d64-43a2-ad2e-1c2741f041c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:33.200206 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d1cb12e-6d64-43a2-ad2e-1c2741f041c4 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1468 microversion: 2.1 time: 0.970143 Aug 25 12:50:33.211527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df99b6ff-0109-4f49-88bf-2d787052161c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:33.213336 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 831/1653] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:32 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1468 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:33.223306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df99b6ff-0109-4f49-88bf-2d787052161c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:33.227790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d8f622f-aa49-47c3-b001-f0d5c7268655 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a1b6670>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:33.230715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df99b6ff-0109-4f49-88bf-2d787052161c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:33.241103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df99b6ff-0109-4f49-88bf-2d787052161c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:33.243701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df99b6ff-0109-4f49-88bf-2d787052161c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:33.246669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df99b6ff-0109-4f49-88bf-2d787052161c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:33.450363 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5d8f622f-aa49-47c3-b001-f0d5c7268655 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 200 len: 1463 microversion: 2.1 time: 0.226366 Aug 25 12:50:33.459528 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 832/1654] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:33 2022] GET /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 1463 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:33.484175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93025884-df43-4122-ac9b-ea7bba7b2060 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2e8cd940>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:33.570092 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-93025884-df43-4122-ac9b-ea7bba7b2060 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Image not found. Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93025884-df43-4122-ac9b-ea7bba7b2060 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 HTTP/1.1 Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:33.576930 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: exception: Image not found. Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '543c6826-533a-4bc8-8cac-c1cdcc077033'} Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:33.579999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 543c6826-533a-4bc8-8cac-c1cdcc077033 to delete Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.582042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 543c6826-533a-4bc8-8cac-c1cdcc077033 could not be found. Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:33.584527 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:33.595563 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.598914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93025884-df43-4122-ac9b-ea7bba7b2060 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Image not found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:33.601488 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-93025884-df43-4122-ac9b-ea7bba7b2060 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033" status: 404 len: 62 microversion: 2.1 time: 0.139642 Aug 25 12:50:33.608322 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 833/1655] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:33 2022] DELETE /compute/v2.1/images/543c6826-533a-4bc8-8cac-c1cdcc077033 => generated 62 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:33.626636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:33.632687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:33.658667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:33.659987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:33.660808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:33.666132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:33.667295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:33.671184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:34.474659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df99b6ff-0109-4f49-88bf-2d787052161c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:34.518401 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df99b6ff-0109-4f49-88bf-2d787052161c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1540 microversion: 2.1 time: 1.366720 Aug 25 12:50:34.524722 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 823/1656] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:33 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1540 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:34.551885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-192212ef-2d90-4c4d-9ef9-d2d7a5662e16 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:34.559087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-192212ef-2d90-4c4d-9ef9-d2d7a5662e16 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:34.600271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-192212ef-2d90-4c4d-9ef9-d2d7a5662e16 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:34.603550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-192212ef-2d90-4c4d-9ef9-d2d7a5662e16 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:34.606396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-192212ef-2d90-4c4d-9ef9-d2d7a5662e16 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:34.615673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-192212ef-2d90-4c4d-9ef9-d2d7a5662e16 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:34.617255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-192212ef-2d90-4c4d-9ef9-d2d7a5662e16 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:34.620364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-192212ef-2d90-4c4d-9ef9-d2d7a5662e16 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:34.823632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:34.848931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:34.852678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:34.855307 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0697b7bd-0163-46cd-94d2-f0b7c4555dd2 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1292 microversion: 2.25 time: 1.243476 Aug 25 12:50:34.869550 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 834/1657] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:33 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1292 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:34.870416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a271c2b6-3a5f-4f4a-a877-aeee25619e15 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:34.872062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a271c2b6-3a5f-4f4a-a877-aeee25619e15 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:34.899080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a271c2b6-3a5f-4f4a-a877-aeee25619e15 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:34.899798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a271c2b6-3a5f-4f4a-a877-aeee25619e15 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:34.900624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a271c2b6-3a5f-4f4a-a877-aeee25619e15 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:34.902103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a271c2b6-3a5f-4f4a-a877-aeee25619e15 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:34.902972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a271c2b6-3a5f-4f4a-a877-aeee25619e15 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:34.903899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a271c2b6-3a5f-4f4a-a877-aeee25619e15 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.385036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-192212ef-2d90-4c4d-9ef9-d2d7a5662e16 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:35.419191 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-192212ef-2d90-4c4d-9ef9-d2d7a5662e16 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1313 microversion: 2.1 time: 0.891828 Aug 25 12:50:35.422794 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 824/1658] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:34 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1313 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:35.444003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:35.446873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:35.461606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.463004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.464163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.465867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.467114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.474132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.502173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a271c2b6-3a5f-4f4a-a877-aeee25619e15 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:35.534161 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a271c2b6-3a5f-4f4a-a877-aeee25619e15 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55" status: 200 len: 1467 microversion: 2.1 time: 0.674074 Aug 25 12:50:35.537021 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 835/1659] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:34 2022] GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55 => generated 1467 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:35.539139 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 HTTP/1.1 Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:35.543359 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. Aug 25 12:50:35.546381 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '305f349d-9b1a-4ad8-996a-e0da7d1cefd2'} Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:35.548826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. Aug 25 12:50:35.558771 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:35.564081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:35.564081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:35.564713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:35.569127 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-41bcf9a0-4c05-42f3-94ae-e62ce9678f34 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 404 len: 111 microversion: 2.1 time: 0.142066 Aug 25 12:50:35.575462 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 825/1660] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:35 2022] DELETE /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:35.576700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.579218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.581443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.588484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.592823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.594479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.602602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5fde4d80-ac96-4a9f-ae40-a4ddc2cb7015 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:35.603623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5fde4d80-ac96-4a9f-ae40-a4ddc2cb7015 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:35.640524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fde4d80-ac96-4a9f-ae40-a4ddc2cb7015 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.641713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fde4d80-ac96-4a9f-ae40-a4ddc2cb7015 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.642179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fde4d80-ac96-4a9f-ae40-a4ddc2cb7015 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.647727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fde4d80-ac96-4a9f-ae40-a4ddc2cb7015 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.647727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fde4d80-ac96-4a9f-ae40-a4ddc2cb7015 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.647727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fde4d80-ac96-4a9f-ae40-a4ddc2cb7015 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.795590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.796515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.797679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.798546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lazy-loading 'fault' on Instance uuid 3e481324-3e50-472a-857d-d015400b2260 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:50:35.972684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad1bc68cede45a7b1ab7cbda0d8208e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9affc0d6e64775b2dfd65eceb7f223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:36.016732 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-efb36535-9bcc-40ca-b1da-db3058028c0b tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 200 len: 1302 microversion: 2.1 time: 0.474320 Aug 25 12:50:36.022600 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 836/1661] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:35 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 1302 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:36.051905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b415fbd7-0bc3-46fb-a0bc-c03587fa4293 req-1f510125-e028-4b78-9412-c6fa3bd3a253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e481324-3e50-472a-857d-d015400b2260", "name": "network-vif-deleted", "tag": "3ab10696-8912-459d-b019-6b94e0f42269"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:36.077641 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5fde4d80-ac96-4a9f-ae40-a4ddc2cb7015 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.498638 Aug 25 12:50:36.092226 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 826/1662] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 12:50:35 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-interface => generated 285 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:36.109292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b415fbd7-0bc3-46fb-a0bc-c03587fa4293 req-1f510125-e028-4b78-9412-c6fa3bd3a253 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:36.111207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b415fbd7-0bc3-46fb-a0bc-c03587fa4293 req-1f510125-e028-4b78-9412-c6fa3bd3a253 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:36.112042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b415fbd7-0bc3-46fb-a0bc-c03587fa4293 req-1f510125-e028-4b78-9412-c6fa3bd3a253 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:36.119355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6320d454-7bb5-40a3-b97f-7d58d7db6a00 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a06c310>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:36.145990 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b415fbd7-0bc3-46fb-a0bc-c03587fa4293 req-1f510125-e028-4b78-9412-c6fa3bd3a253 service nova] Creating event network-vif-deleted:3ab10696-8912-459d-b019-6b94e0f42269 for instance 3e481324-3e50-472a-857d-d015400b2260 on n-h1-852771-8 Aug 25 12:50:36.172996 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b415fbd7-0bc3-46fb-a0bc-c03587fa4293 req-1f510125-e028-4b78-9412-c6fa3bd3a253 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143603 Aug 25 12:50:36.176734 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 837/1663] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:36.195181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:36.203184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 305f349d-9b1a-4ad8-996a-e0da7d1cefd2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:36.231915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:36.233481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:36.235281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:36.243063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:36.244278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:36.245605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:36.306847 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 HTTP/1.1 Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:36.315794 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. Aug 25 12:50:36.319068 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '305f349d-9b1a-4ad8-996a-e0da7d1cefd2'} Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:36.320794 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. Aug 25 12:50:36.323786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.331841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Instance 305f349d-9b1a-4ad8-996a-e0da7d1cefd2 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:36.341143 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22b7dc49-6f4a-4ce9-a0a9-7b0c1cca346f tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2" status: 404 len: 111 microversion: 2.1 time: 0.155333 Aug 25 12:50:36.343562 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 838/1664] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:36 2022] GET /compute/v2.1/servers/305f349d-9b1a-4ad8-996a-e0da7d1cefd2 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:36.368576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:36.377210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:36.404454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:36.408820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:36.409797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:36.411185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:36.412079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:36.412890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:36.555340 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6320d454-7bb5-40a3-b97f-7d58d7db6a00 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images?changes-since=2022-08-25T12%3A46%3A42Z" status: 200 len: 1902 microversion: 2.1 time: 0.461010 Aug 25 12:50:36.556464 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 827/1665] 10.222.0.70 () {58 vars in 1199 bytes} [Thu Aug 25 12:50:36 2022] GET /compute/v2.1/images?changes-since=2022-08-25T12%3A46%3A42Z => generated 1902 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:36.580590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3aaa2292-f190-4597-b595-e94baf21d97c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '.version_select at 0x7f3a2a02d790>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:36.646511 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-3aaa2292-f190-4597-b595-e94baf21d97c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Image not found. Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3aaa2292-f190-4597-b595-e94baf21d97c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 HTTP/1.1 Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:36.651550 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '0ea656bf-f03a-445a-b6db-e1e0e02de4a3'} Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:36.654774 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0ea656bf-f03a-445a-b6db-e1e0e02de4a3 to delete Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.657404 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0ea656bf-f03a-445a-b6db-e1e0e02de4a3 could not be found. Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:36.662551 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3aaa2292-f190-4597-b595-e94baf21d97c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3aaa2292-f190-4597-b595-e94baf21d97c tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3" status: 404 len: 62 microversion: 2.1 time: 0.087624 Aug 25 12:50:36.669485 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 828/1666] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:36 2022] DELETE /compute/v2.1/images/0ea656bf-f03a-445a-b6db-e1e0e02de4a3 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:36.675761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a9a7ccbc-5e71-46df-bd94-fbaab6173a01 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:36.675761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a9a7ccbc-5e71-46df-bd94-fbaab6173a01 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:36.691636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a7ccbc-5e71-46df-bd94-fbaab6173a01 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:36.693064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a7ccbc-5e71-46df-bd94-fbaab6173a01 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:36.694455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a7ccbc-5e71-46df-bd94-fbaab6173a01 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:36.696622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a7ccbc-5e71-46df-bd94-fbaab6173a01 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:36.698326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a7ccbc-5e71-46df-bd94-fbaab6173a01 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:36.699796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a7ccbc-5e71-46df-bd94-fbaab6173a01 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:37.616833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:37.689396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:37.697215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:37.702034 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-476651bc-55fd-4187-a59e-138e7b223220 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1292 microversion: 2.25 time: 1.353526 Aug 25 12:50:37.705421 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 839/1667] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:36 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1292 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:37.714793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-87451f64-346a-46b0-9f2a-a9671ccb09be tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e831ca0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:37.920092 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-87451f64-346a-46b0-9f2a-a9671ccb09be tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-220240874" status: 200 len: 484 microversion: 2.1 time: 0.212248 Aug 25 12:50:37.921497 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 840/1668] 10.222.0.70 () {58 vars in 1229 bytes} [Thu Aug 25 12:50:37 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-220240874 => generated 484 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:37.956500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:37.957885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:37.972611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:37.973735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:37.974735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:37.976293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:37.977563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:37.978731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.008618 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 HTTP/1.1 Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:38.012475 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. Aug 25 12:50:38.015513 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '40e66bf9-46f4-4037-8c41-400415f86c72'} Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:38.018241 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. Aug 25 12:50:38.022524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.027059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:38.027059 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-52db35f7-ff0e-46a7-a82e-66bacb41f4dc tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "DELETE /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 404 len: 111 microversion: 2.1 time: 0.072338 Aug 25 12:50:38.027059 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 841/1669] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:37 2022] DELETE /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:38.028092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:38.030245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] [instance: 3e481324-3e50-472a-857d-d015400b2260] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:38.046779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.047768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.048582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.050236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.051112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.051904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.089606 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] HTTP exception thrown: Instance 3e481324-3e50-472a-857d-d015400b2260 could not be found. Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Request method failure captured: Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 HTTP/1.1 Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23zrl8eFm6rCg0aDzSQsQRHaJKvV4Ry5sRTQJcMT21Rk_Kk42jZqJV9BFoU9rdHVIBWo_AjD7xVwIxBSFhDZh-zZpHAZIQ7EsG7Ex6GDD9FS--04JcLTUONJw_V1vei4n3X-Fu94JgAzy2oyNVVJoA5Bhk6BntQkU2bGnTOG-_JncE Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: ff9affc0d6e64775b2dfd65eceb7f223 Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:38.092708 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff9affc0d6e64775b2dfd65eceb7f223"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ff9affc0d6e64775b2dfd65eceb7f223", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ff9affc0d6e64775b2dfd65eceb7f223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff9affc0d6e64775b2dfd65eceb7f223"}]}] Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: ff9affc0d6e64775b2dfd65eceb7f223 Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-MigrationsAdminTest-1644461283 Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-MigrationsAdminTest-1644461283-project Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: aad1bc68cede45a7b1ab7cbda0d8208e Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-MigrationsAdminTest-1644461283-project Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 3e481324-3e50-472a-857d-d015400b2260 could not be found. Aug 25 12:50:38.096192 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '3e481324-3e50-472a-857d-d015400b2260'} Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e481324-3e50-472a-857d-d015400b2260 could not be found. Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:38.105579 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e481324-3e50-472a-857d-d015400b2260 could not be found. Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e481324-3e50-472a-857d-d015400b2260 could not be found. Aug 25 12:50:38.110254 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.118150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] Returning 404 to user: Instance 3e481324-3e50-472a-857d-d015400b2260 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:38.118150 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b7a82f1a-2b1d-4233-bc94-eab9cd7be9f2 tempest-MigrationsAdminTest-1644461283 tempest-MigrationsAdminTest-1644461283-project] 10.222.0.70 "GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260" status: 404 len: 111 microversion: 2.1 time: 0.074759 Aug 25 12:50:38.118150 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 842/1670] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:38 2022] GET /compute/v2.1/servers/3e481324-3e50-472a-857d-d015400b2260 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:38.118150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-94faea87-7998-408a-aed5-bb01b26df462 req-7426a071-e48b-4ed6-abf0-f9416ea7b4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01013692-8e62-49a8-81b9-7f7cdd4a5a55", "name": "network-vif-unplugged", "status": "completed", "tag": "73f30782-4779-447f-ba20-d60dfbdf553d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:38.139209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-94faea87-7998-408a-aed5-bb01b26df462 req-7426a071-e48b-4ed6-abf0-f9416ea7b4b0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.142211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-94faea87-7998-408a-aed5-bb01b26df462 req-7426a071-e48b-4ed6-abf0-f9416ea7b4b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.144138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-94faea87-7998-408a-aed5-bb01b26df462 req-7426a071-e48b-4ed6-abf0-f9416ea7b4b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.176465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9a7ccbc-5e71-46df-bd94-fbaab6173a01 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:38.214424 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-94faea87-7998-408a-aed5-bb01b26df462 req-7426a071-e48b-4ed6-abf0-f9416ea7b4b0 service nova] Creating event network-vif-unplugged:73f30782-4779-447f-ba20-d60dfbdf553d for instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 on n-h2-852771-8 Aug 25 12:50:38.216657 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a9a7ccbc-5e71-46df-bd94-fbaab6173a01 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1313 microversion: 2.1 time: 1.548901 Aug 25 12:50:38.248505 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 829/1671] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:36 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1313 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:38.261171 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-94faea87-7998-408a-aed5-bb01b26df462 req-7426a071-e48b-4ed6-abf0-f9416ea7b4b0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162161 Aug 25 12:50:38.267281 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 843/1672] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:38.269740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf4c95ec-2f94-4948-8e76-8639173e8464 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a093dc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:38.286405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:38.289158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] [instance: 40e66bf9-46f4-4037-8c41-400415f86c72] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:38.305382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.306368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.307387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.309060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.310210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.311055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.346350 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] HTTP exception thrown: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Request method failure captured: Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 HTTP/1.1 Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB25Ph2JcqojfzFyxTVS5ZVM-sXZzwvZOIy04LsrP4iB8edhlnjREPpnnjHW6OY4lrZPmCLd3K8gUjF3VtPaZGt7wS2jEFWEgZAMo4vvPOx7nAGAUSOTPZiLq-Q3gZtqYYuIOJIG4m3nJeZjQXcy4aq4gWufzHm0hysauk8YWcBLCFWQ Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:38.350435 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da51872cc1924bb99ee10d4a28cfb2a1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da51872cc1924bb99ee10d4a28cfb2a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da51872cc1924bb99ee10d4a28cfb2a1"}]}] Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesTestJSON-804954704 Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: da51872cc1924bb99ee10d4a28cfb2a1 Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesTestJSON-804954704 Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2db6a11f66554018ba91a5fabb891492 Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesTestJSON-804954704-project Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. Aug 25 12:50:38.353330 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '40e66bf9-46f4-4037-8c41-400415f86c72'} Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:38.356569 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. Aug 25 12:50:38.362086 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.365462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] Returning 404 to user: Instance 40e66bf9-46f4-4037-8c41-400415f86c72 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:38.365462 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-45b89216-b284-42e2-8e75-23277b7bd996 tempest-ImagesTestJSON-804954704 tempest-ImagesTestJSON-804954704-project] 10.222.0.70 "GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72" status: 404 len: 111 microversion: 2.1 time: 0.081725 Aug 25 12:50:38.365462 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 844/1673] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:38 2022] GET /compute/v2.1/servers/40e66bf9-46f4-4037-8c41-400415f86c72 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:38.652641 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bf4c95ec-2f94-4948-8e76-8639173e8464 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images?server=01013692-8e62-49a8-81b9-7f7cdd4a5a55" status: 200 len: 957 microversion: 2.1 time: 0.406906 Aug 25 12:50:38.659876 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 830/1674] 10.222.0.70 () {58 vars in 1209 bytes} [Thu Aug 25 12:50:38 2022] GET /compute/v2.1/images?server=01013692-8e62-49a8-81b9-7f7cdd4a5a55 => generated 957 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:38.705156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-53813b41-b7c1-4aa1-b619-19afeec941ef tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e86a1f0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:38.752234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:38.755779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:38.784879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:38.795983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.797419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.798694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.800821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.802140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.803262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.861799 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-53813b41-b7c1-4aa1-b619-19afeec941ef tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2Ffd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 485 microversion: 2.1 time: 0.182002 Aug 25 12:50:38.864618 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 845/1675] 10.222.0.70 () {58 vars in 1317 bytes} [Thu Aug 25 12:50:38 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2Ffd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 485 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:38.886797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d24d796-1d01-4d4e-a850-b9986222a7f5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a1cb3a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:39.010881 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5d24d796-1d01-4d4e-a850-b9986222a7f5 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2Ffd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 485 microversion: 2.1 time: 0.131000 Aug 25 12:50:39.013825 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 846/1676] 10.222.0.70 () {58 vars in 1303 bytes} [Thu Aug 25 12:50:38 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2Ffd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 485 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:39.043705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-15f4ee5f-2e3d-4f19-8a56-d56e2a8d1d10 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e81e280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:39.478980 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-15f4ee5f-2e3d-4f19-8a56-d56e2a8d1d10 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.445704 Aug 25 12:50:39.495073 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 847/1677] 10.222.0.70 () {58 vars in 1149 bytes} [Thu Aug 25 12:50:39 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:50:39.503574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-546cd531-99ac-44b6-adf2-e8921044e896 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:39.504790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-546cd531-99ac-44b6-adf2-e8921044e896 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:39.515584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546cd531-99ac-44b6-adf2-e8921044e896 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:39.516324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546cd531-99ac-44b6-adf2-e8921044e896 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:39.517028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546cd531-99ac-44b6-adf2-e8921044e896 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:39.518350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546cd531-99ac-44b6-adf2-e8921044e896 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:39.519216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546cd531-99ac-44b6-adf2-e8921044e896 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:39.520004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546cd531-99ac-44b6-adf2-e8921044e896 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:40.562154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:40.591607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:40.598539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:40.612174 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0baa5db-b25c-4388-8f06-2a548a28312e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1280 microversion: 2.25 time: 1.871738 Aug 25 12:50:40.613723 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 831/1678] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:38 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1280 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:40.623109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1cfeb3b3-0b08-4f72-be34-d0f5fe0ec3f3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a02daf0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:40.927578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1cfeb3b3-0b08-4f72-be34-d0f5fe0ec3f3 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.311431 Aug 25 12:50:40.938976 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 832/1679] 10.222.0.70 () {58 vars in 1149 bytes} [Thu Aug 25 12:50:40 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:40.961912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f8ad4224-cb2a-45e0-882f-fc6c36c66937 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:40.963422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f8ad4224-cb2a-45e0-882f-fc6c36c66937 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:40.996258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8ad4224-cb2a-45e0-882f-fc6c36c66937 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:40.997807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8ad4224-cb2a-45e0-882f-fc6c36c66937 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:40.998532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8ad4224-cb2a-45e0-882f-fc6c36c66937 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:41.000114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8ad4224-cb2a-45e0-882f-fc6c36c66937 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:41.001167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8ad4224-cb2a-45e0-882f-fc6c36c66937 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:41.002795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8ad4224-cb2a-45e0-882f-fc6c36c66937 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:41.102988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f8ad4224-cb2a-45e0-882f-fc6c36c66937 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:41.351580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-546cd531-99ac-44b6-adf2-e8921044e896 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:41.398123 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-546cd531-99ac-44b6-adf2-e8921044e896 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1313 microversion: 2.1 time: 1.901047 Aug 25 12:50:41.413548 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 848/1680] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:39 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1313 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:41.442332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-01f90856-6976-49d9-a833-ee9c7d45d3eb tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e879670>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:41.470700 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f8ad4224-cb2a-45e0-882f-fc6c36c66937 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 204 len: 0 microversion: 2.1 time: 0.524916 Aug 25 12:50:41.486671 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 833/1681] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:40 2022] DELETE /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:41.515188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1dffc7d6-b65d-4514-bba7-961840ef4528 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:41.515892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1dffc7d6-b65d-4514-bba7-961840ef4528 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:41.535168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dffc7d6-b65d-4514-bba7-961840ef4528 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:41.536785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dffc7d6-b65d-4514-bba7-961840ef4528 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:41.536785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dffc7d6-b65d-4514-bba7-961840ef4528 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:41.540656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dffc7d6-b65d-4514-bba7-961840ef4528 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:41.541781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dffc7d6-b65d-4514-bba7-961840ef4528 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:41.543544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dffc7d6-b65d-4514-bba7-961840ef4528 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:41.862699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-01f90856-6976-49d9-a833-ee9c7d45d3eb tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.457249 Aug 25 12:50:41.868093 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 849/1682] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:50:41 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:41.881384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:41.883292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:41.946879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:41.947921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:41.948725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:41.950074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:41.950895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:41.951641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:42.633595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1dffc7d6-b65d-4514-bba7-961840ef4528 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:42.673808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:42.678428 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1dffc7d6-b65d-4514-bba7-961840ef4528 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1515 microversion: 2.1 time: 1.183367 Aug 25 12:50:42.680910 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 834/1683] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:41 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1515 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:42.729166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-260e7070-571c-4a22-aba5-d807616e5548 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a0b7550>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:42.963516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:42.988730 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-260e7070-571c-4a22-aba5-d807616e5548 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/detail?changes-since=2022-08-25T12%3A46%3A31Z" status: 200 len: 6331 microversion: 2.1 time: 0.266719 Aug 25 12:50:42.990585 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 835/1684] 10.222.0.70 () {58 vars in 1220 bytes} [Thu Aug 25 12:50:42 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-25T12%3A46%3A31Z => generated 6331 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:43.009487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9e24ffd5-60e2-4d7f-a823-1c43d81e8127 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:43.012954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9e24ffd5-60e2-4d7f-a823-1c43d81e8127 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:43.019999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:43.027993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:43.030817 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-04598a65-3000-41eb-b541-c9c82c50989d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1280 microversion: 2.25 time: 1.160110 Aug 25 12:50:43.042986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e24ffd5-60e2-4d7f-a823-1c43d81e8127 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:43.049136 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 850/1685] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:41 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1280 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:43.049424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e24ffd5-60e2-4d7f-a823-1c43d81e8127 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:43.050277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e24ffd5-60e2-4d7f-a823-1c43d81e8127 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:43.051816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e24ffd5-60e2-4d7f-a823-1c43d81e8127 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:43.064850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e24ffd5-60e2-4d7f-a823-1c43d81e8127 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:43.064850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e24ffd5-60e2-4d7f-a823-1c43d81e8127 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:43.110503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d359198-f590-4ec4-926a-52780e44fe6b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a1b99d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:43.299127 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d359198-f590-4ec4-926a-52780e44fe6b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-220240874" status: 200 len: 664 microversion: 2.1 time: 0.246715 Aug 25 12:50:43.302246 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 851/1686] 10.222.0.70 () {58 vars in 1250 bytes} [Thu Aug 25 12:50:43 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-220240874 => generated 664 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:43.344194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-42f1ff8a-9e50-481b-a869-e763561f956f req-1bac4375-68ea-4e62-82af-15557401b7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40100f3-81b6-4ae1-8bd0-46a6e367df2f", "name": "network-vif-plugged", "status": "completed", "tag": "41ae88a6-3423-4cdf-a3a1-7841f4e38bfb"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:43.389648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-42f1ff8a-9e50-481b-a869-e763561f956f req-1bac4375-68ea-4e62-82af-15557401b7bb service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:43.391422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-42f1ff8a-9e50-481b-a869-e763561f956f req-1bac4375-68ea-4e62-82af-15557401b7bb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:43.392645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-42f1ff8a-9e50-481b-a869-e763561f956f req-1bac4375-68ea-4e62-82af-15557401b7bb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:43.441017 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-42f1ff8a-9e50-481b-a869-e763561f956f req-1bac4375-68ea-4e62-82af-15557401b7bb service nova] Creating event network-vif-plugged:41ae88a6-3423-4cdf-a3a1-7841f4e38bfb for instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f on n-h1-852771-8 Aug 25 12:50:43.463274 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-42f1ff8a-9e50-481b-a869-e763561f956f req-1bac4375-68ea-4e62-82af-15557401b7bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129878 Aug 25 12:50:43.465210 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 852/1687] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:50:43.493926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-370eca82-5eb1-4491-966a-a1cd681b8421 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e9408b0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:43.674843 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-370eca82-5eb1-4491-966a-a1cd681b8421 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2Ffd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1467 microversion: 2.1 time: 0.204057 Aug 25 12:50:43.691268 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 853/1688] 10.222.0.70 () {58 vars in 1338 bytes} [Thu Aug 25 12:50:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2Ffd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1467 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:43.707799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-badb55f9-500a-45e6-a606-01f4726c698b req-697d13f7-a825-440a-b613-fea9e0f431e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc86590d-191c-4f59-8b1c-bb10c9ff4a49", "tag": "8e7fc008-75c2-4e5a-a9dc-0d165e20b75d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:43.727482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-badb55f9-500a-45e6-a606-01f4726c698b req-697d13f7-a825-440a-b613-fea9e0f431e0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:43.729734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-badb55f9-500a-45e6-a606-01f4726c698b req-697d13f7-a825-440a-b613-fea9e0f431e0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:43.730813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-badb55f9-500a-45e6-a606-01f4726c698b req-697d13f7-a825-440a-b613-fea9e0f431e0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:43.757046 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-badb55f9-500a-45e6-a606-01f4726c698b req-697d13f7-a825-440a-b613-fea9e0f431e0 service nova] Creating event network-changed:8e7fc008-75c2-4e5a-a9dc-0d165e20b75d for instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 on n-h1-852771-8 Aug 25 12:50:43.769653 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-badb55f9-500a-45e6-a606-01f4726c698b req-697d13f7-a825-440a-b613-fea9e0f431e0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075353 Aug 25 12:50:43.771710 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 854/1689] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:43.786293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-83c01608-1f72-499a-bd3c-eae9d854ed84 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e947550>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:43.933604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9e24ffd5-60e2-4d7f-a823-1c43d81e8127 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:43.969865 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9e24ffd5-60e2-4d7f-a823-1c43d81e8127 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1313 microversion: 2.1 time: 0.973956 Aug 25 12:50:43.974103 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 836/1690] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:42 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1313 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:43.988757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-82fb404d-d62f-402f-a6b0-63135e927799 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:43.990552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-82fb404d-d62f-402f-a6b0-63135e927799 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:44.021128 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-83c01608-1f72-499a-bd3c-eae9d854ed84 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2Ffd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1467 microversion: 2.1 time: 0.246489 Aug 25 12:50:44.026400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fb404d-d62f-402f-a6b0-63135e927799 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:44.031856 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 855/1691] 10.222.0.70 () {58 vars in 1324 bytes} [Thu Aug 25 12:50:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2Ffd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1467 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:44.034098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fb404d-d62f-402f-a6b0-63135e927799 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:44.035747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fb404d-d62f-402f-a6b0-63135e927799 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:44.037326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fb404d-d62f-402f-a6b0-63135e927799 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:44.038081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fb404d-d62f-402f-a6b0-63135e927799 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:44.038976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fb404d-d62f-402f-a6b0-63135e927799 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:44.069858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4fa24079-64c0-457c-839d-fe1dc6aa3c66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e81ea60>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:44.398024 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4fa24079-64c0-457c-839d-fe1dc6aa3c66 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7106 microversion: 2.1 time: 0.336809 Aug 25 12:50:44.399975 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 856/1692] 10.222.0.70 () {58 vars in 1170 bytes} [Thu Aug 25 12:50:44 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7106 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:44.411901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:44.413756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:44.437294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:44.440271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:44.441614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:44.445433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:44.455160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:44.456334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:45.349801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-82fb404d-d62f-402f-a6b0-63135e927799 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:45.388855 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-82fb404d-d62f-402f-a6b0-63135e927799 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1515 microversion: 2.1 time: 1.400952 Aug 25 12:50:45.403563 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 837/1693] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:43 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1515 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:45.414906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4179cb3f-5c2c-4095-8110-b88ffa7ab24a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a29f49af0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:45.678157 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4179cb3f-5c2c-4095-8110-b88ffa7ab24a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.271438 Aug 25 12:50:45.685555 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 838/1694] 10.222.0.70 () {58 vars in 1170 bytes} [Thu Aug 25 12:50:45 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:45.696294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2a7c9d55-a623-47a9-9592-3be81ce495d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:45.707415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a7c9d55-a623-47a9-9592-3be81ce495d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:45.722450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d55-a623-47a9-9592-3be81ce495d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:45.723878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d55-a623-47a9-9592-3be81ce495d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:45.725135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d55-a623-47a9-9592-3be81ce495d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:45.729159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d55-a623-47a9-9592-3be81ce495d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:45.730150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d55-a623-47a9-9592-3be81ce495d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:45.731230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d55-a623-47a9-9592-3be81ce495d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:45.995596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:46.041773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:46.045499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:46.047917 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6a5463ab-552a-4efe-aee2-919f38fd9eee tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1280 microversion: 2.25 time: 1.645596 Aug 25 12:50:46.049005 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 857/1695] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:44 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1280 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:46.099681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-58185c9b-f311-4cad-90b1-11747dc1680f tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e8129d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:46.253216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2a7c9d55-a623-47a9-9592-3be81ce495d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:46.281919 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2a7c9d55-a623-47a9-9592-3be81ce495d5 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1313 microversion: 2.1 time: 0.592772 Aug 25 12:50:46.284406 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 839/1696] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:45 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:46.300467 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-58185c9b-f311-4cad-90b1-11747dc1680f tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/63977197-fc12-4c51-9b3a-b2cc8b9977ca" status: 200 len: 784 microversion: 2.1 time: 0.220313 Aug 25 12:50:46.310540 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 858/1697] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:50:46 2022] GET /compute/v2.1/images/63977197-fc12-4c51-9b3a-b2cc8b9977ca => generated 784 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:46.341189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f706ccc-7be3-44d8-b22b-99de6d541297 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e81ec10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:46.525839 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7f706ccc-7be3-44d8-b22b-99de6d541297 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.192013 Aug 25 12:50:46.551161 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 859/1698] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 12:50:46 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:50:46.583125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ddfdd842-ae28-482e-8030-99c468a01818 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:46.591620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ddfdd842-ae28-482e-8030-99c468a01818 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:46.642251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfdd842-ae28-482e-8030-99c468a01818 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:46.646401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfdd842-ae28-482e-8030-99c468a01818 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:46.666075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfdd842-ae28-482e-8030-99c468a01818 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:46.671372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfdd842-ae28-482e-8030-99c468a01818 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:46.673285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfdd842-ae28-482e-8030-99c468a01818 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:46.674561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfdd842-ae28-482e-8030-99c468a01818 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:46.850954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bbc8adef-4490-4b20-b780-057499301a54 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Calling method '.version_select at 0x7f3a29fd2820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:46.965641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ddfdd842-ae28-482e-8030-99c468a01818 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:46.993540 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-bbc8adef-4490-4b20-b780-057499301a54 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] HTTP exception thrown: Image not found. Aug 25 12:50:46.995346 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ddfdd842-ae28-482e-8030-99c468a01818 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1473 microversion: 2.1 time: 0.441179 Aug 25 12:50:46.997802 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 860/1699] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:46 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1473 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:47.011059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efcced17-40d0-402f-b4a6-f97ca3495d52 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e868ca0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bbc8adef-4490-4b20-b780-057499301a54 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Request method failure captured: Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/images/37df771b-66a5-4764-b57b-409d0c143bba/metadata/os_distro HTTP/1.1 Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3AlJYIdHkmeKqbhLRkEdBruulPLe4m15WIZGWW0oS6j1-mdBSh-pBADyx6jwFjeO85fbvDj_JAzNLB0i_2oN6zufKhLtMSQZVNi-vN9m6pG4BvN6TF5zmkU_3cRoqtYgGg1jatnt2AaxOZ6U05rJfVwJsPGkwyeLKT6fXk-yJNVZ3A Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:47.018922 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d1105bff8fb41ca951bab4cf0d078b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}] Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e932e9ce9e484ad6a3c62142b9f6de8c Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'image_id': '37df771b-66a5-4764-b57b-409d0c143bba', 'id': 'os_distro'} Aug 25 12:50:47.022341 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:47.024301 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 37df771b-66a5-4764-b57b-409d0c143bba Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:47.027280 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37df771b-66a5-4764-b57b-409d0c143bba could not be found. Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:47.029974 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.033572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bbc8adef-4490-4b20-b780-057499301a54 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:47.036123 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bbc8adef-4490-4b20-b780-057499301a54 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] 10.222.0.70 "DELETE /compute/v2.1/images/37df771b-66a5-4764-b57b-409d0c143bba/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.739995 Aug 25 12:50:47.041549 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 840/1700] 10.222.0.70 () {58 vars in 1293 bytes} [Thu Aug 25 12:50:46 2022] DELETE /compute/v2.1/images/37df771b-66a5-4764-b57b-409d0c143bba/metadata/os_distro => generated 62 bytes in 752 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:47.095619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4412f832-463d-40e9-a983-e15f3b949386 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Calling method '.version_select at 0x7f3a29fc91f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:47.257052 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-4412f832-463d-40e9-a983-e15f3b949386 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] HTTP exception thrown: Image not found. Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4412f832-463d-40e9-a983-e15f3b949386 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Request method failure captured: Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/images/18a8a20f-033b-471f-8190-3862438b235b/metadata/os_version HTTP/1.1 Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3AlJYIdHkmeKqbhLRkEdBruulPLe4m15WIZGWW0oS6j1-mdBSh-pBADyx6jwFjeO85fbvDj_JAzNLB0i_2oN6zufKhLtMSQZVNi-vN9m6pG4BvN6TF5zmkU_3cRoqtYgGg1jatnt2AaxOZ6U05rJfVwJsPGkwyeLKT6fXk-yJNVZ3A Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:47.262985 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d1105bff8fb41ca951bab4cf0d078b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}] Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e932e9ce9e484ad6a3c62142b9f6de8c Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'image_id': '18a8a20f-033b-471f-8190-3862438b235b', 'id': 'os_version'} Aug 25 12:50:47.267347 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:47.269350 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 18a8a20f-033b-471f-8190-3862438b235b Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:47.272002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 18a8a20f-033b-471f-8190-3862438b235b could not be found. Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:47.274719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:47.277314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4412f832-463d-40e9-a983-e15f3b949386 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:47.284189 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4412f832-463d-40e9-a983-e15f3b949386 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] 10.222.0.70 "GET /compute/v2.1/images/18a8a20f-033b-471f-8190-3862438b235b/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.223594 Aug 25 12:50:47.284189 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 841/1701] 10.222.0.70 () {58 vars in 1293 bytes} [Thu Aug 25 12:50:47 2022] GET /compute/v2.1/images/18a8a20f-033b-471f-8190-3862438b235b/metadata/os_version => generated 62 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 25 12:50:47.346357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:47.354981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:47.404785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:47.405948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:47.414731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:47.416430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:47.417743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:47.418737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:48.248622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:48.268646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:48.273279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:48.276239 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-22e2de86-7f72-4d79-81b9-651d0aabc289 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1280 microversion: 2.25 time: 0.988583 Aug 25 12:50:48.278603 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 842/1702] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:47 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1280 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:48.290849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec1e7f50-42d9-4702-8ea5-1e3df12b21f6 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Calling method '.version_select at 0x7f3a2a0615e0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:48.361929 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-ec1e7f50-42d9-4702-8ea5-1e3df12b21f6 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] HTTP exception thrown: Image not found. Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec1e7f50-42d9-4702-8ea5-1e3df12b21f6 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Request method failure captured: Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/images/5d2d18f5-2c28-4b1c-9cda-1d33e7148b0e/metadata HTTP/1.1 Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3AlJYIdHkmeKqbhLRkEdBruulPLe4m15WIZGWW0oS6j1-mdBSh-pBADyx6jwFjeO85fbvDj_JAzNLB0i_2oN6zufKhLtMSQZVNi-vN9m6pG4BvN6TF5zmkU_3cRoqtYgGg1jatnt2AaxOZ6U05rJfVwJsPGkwyeLKT6fXk-yJNVZ3A Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:48.370361 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d1105bff8fb41ca951bab4cf0d078b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}] Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e932e9ce9e484ad6a3c62142b9f6de8c Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'image_id': '5d2d18f5-2c28-4b1c-9cda-1d33e7148b0e'} Aug 25 12:50:48.373337 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:48.376574 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5d2d18f5-2c28-4b1c-9cda-1d33e7148b0e Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:48.379141 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5d2d18f5-2c28-4b1c-9cda-1d33e7148b0e could not be found. Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:48.386184 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:48.389042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec1e7f50-42d9-4702-8ea5-1e3df12b21f6 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:48.392694 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ec1e7f50-42d9-4702-8ea5-1e3df12b21f6 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] 10.222.0.70 "GET /compute/v2.1/images/5d2d18f5-2c28-4b1c-9cda-1d33e7148b0e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.103822 Aug 25 12:50:48.399361 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 843/1703] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:50:48 2022] GET /compute/v2.1/images/5d2d18f5-2c28-4b1c-9cda-1d33e7148b0e/metadata => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:48.430142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e6e46539-d2f1-452d-b8b4-d7fb9ca97b1d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:48.431948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e6e46539-d2f1-452d-b8b4-d7fb9ca97b1d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:48.475552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6e46539-d2f1-452d-b8b4-d7fb9ca97b1d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:48.477450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6e46539-d2f1-452d-b8b4-d7fb9ca97b1d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:48.482106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6e46539-d2f1-452d-b8b4-d7fb9ca97b1d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:48.487198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6e46539-d2f1-452d-b8b4-d7fb9ca97b1d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:48.502068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6e46539-d2f1-452d-b8b4-d7fb9ca97b1d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:48.503817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6e46539-d2f1-452d-b8b4-d7fb9ca97b1d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:49.187031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e6e46539-d2f1-452d-b8b4-d7fb9ca97b1d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:49.235501 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e6e46539-d2f1-452d-b8b4-d7fb9ca97b1d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1498 microversion: 2.1 time: 0.833203 Aug 25 12:50:49.237811 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 844/1704] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:48 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1498 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:49.292172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3e1ecd67-dd3f-4ed9-b73c-7e645c9df715 req-1a1707e9-afa7-4eff-8335-0302ad56f7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c96283-54f7-4c9e-8e46-c8bdb92a130e", "name": "network-vif-deleted", "tag": "fac0c551-d4c8-42f1-9ee7-511b8a30ea31"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:49.344918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e1ecd67-dd3f-4ed9-b73c-7e645c9df715 req-1a1707e9-afa7-4eff-8335-0302ad56f7d4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:49.344918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e1ecd67-dd3f-4ed9-b73c-7e645c9df715 req-1a1707e9-afa7-4eff-8335-0302ad56f7d4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:49.344918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e1ecd67-dd3f-4ed9-b73c-7e645c9df715 req-1a1707e9-afa7-4eff-8335-0302ad56f7d4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:49.357147 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3e1ecd67-dd3f-4ed9-b73c-7e645c9df715 req-1a1707e9-afa7-4eff-8335-0302ad56f7d4 service nova] Creating event network-vif-deleted:fac0c551-d4c8-42f1-9ee7-511b8a30ea31 for instance f0c96283-54f7-4c9e-8e46-c8bdb92a130e on n-h2-852771-8 Aug 25 12:50:49.376901 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3e1ecd67-dd3f-4ed9-b73c-7e645c9df715 req-1a1707e9-afa7-4eff-8335-0302ad56f7d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094702 Aug 25 12:50:49.379638 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 845/1705] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:49.395542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:49.397454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:49.416698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:49.417664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:49.418441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:49.419857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:49.420924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:49.424096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:49.613861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:49.615916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:49.617226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:49.620846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lazy-loading 'fault' on Instance uuid f0c96283-54f7-4c9e-8e46-c8bdb92a130e {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:50:49.830434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:49.850283 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-64af56b9-1df5-41ab-8af3-fd2909268150 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 200 len: 1308 microversion: 2.1 time: 0.468353 Aug 25 12:50:49.850814 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-efcced17-40d0-402f-b4a6-f97ca3495d52 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "DELETE /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941" status: 204 len: 0 microversion: 2.1 time: 2.848081 Aug 25 12:50:49.852144 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 861/1706] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:47 2022] DELETE /compute/v2.1/images/a7044056-9cb0-4554-b64c-cfbd1d2b0941 => generated 0 bytes in 2851 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:49.853125 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 846/1707] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:49 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 1308 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:49.864862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f3068c04-c3eb-4799-95fa-6767b35a4be3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:49.888929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4fcc5ea7-9ed0-46ed-9769-557132447757 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Action: 'update_all', calling method: .version_select at 0x7f3a2e831ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:49.897106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.server_groups [None req-f3068c04-c3eb-4799-95fa-6767b35a4be3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Querying cell 638d90be-ffdb-4b61-b94a-775c50a724be(cell1) for 1 instances {{(pid=129059) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 25 12:50:49.900244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3068c04-c3eb-4799-95fa-6767b35a4be3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:49.901726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3068c04-c3eb-4799-95fa-6767b35a4be3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:49.902939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3068c04-c3eb-4799-95fa-6767b35a4be3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:49.975551 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f3068c04-c3eb-4799-95fa-6767b35a4be3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/25439800-1adf-44ec-a52d-94e6c6b1d516" status: 200 len: 221 microversion: 2.1 time: 0.119825 Aug 25 12:50:49.989035 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 847/1708] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 12:50:49 2022] GET /compute/v2.1/os-server-groups/25439800-1adf-44ec-a52d-94e6c6b1d516 => generated 221 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:50.005142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:50.006344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:50.025952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:50.027401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:50.028610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:50.030357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:50.034498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:50.035876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:50.060683 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-4fcc5ea7-9ed0-46ed-9769-557132447757 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] HTTP exception thrown: Image not found. Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4fcc5ea7-9ed0-46ed-9769-557132447757 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Request method failure captured: Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: request: PUT /compute/v2.1/images/7f206c28-0166-4c84-99e3-98ad4aa54e20/metadata HTTP/1.1 Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 57 Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3AlJYIdHkmeKqbhLRkEdBruulPLe4m15WIZGWW0oS6j1-mdBSh-pBADyx6jwFjeO85fbvDj_JAzNLB0i_2oN6zufKhLtMSQZVNi-vN9m6pG4BvN6TF5zmkU_3cRoqtYgGg1jatnt2AaxOZ6U05rJfVwJsPGkwyeLKT6fXk-yJNVZ3A Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:50.067443 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d1105bff8fb41ca951bab4cf0d078b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}] Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e932e9ce9e484ad6a3c62142b9f6de8c Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: exception: Image not found. Aug 25 12:50:50.070805 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'image_id': '7f206c28-0166-4c84-99e3-98ad4aa54e20', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:50.072976 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7f206c28-0166-4c84-99e3-98ad4aa54e20 Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:50.075778 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f206c28-0166-4c84-99e3-98ad4aa54e20 could not be found. Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:50.078837 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:50.081974 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:50.084412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4fcc5ea7-9ed0-46ed-9769-557132447757 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Returning 404 to user: Image not found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:50.094657 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4fcc5ea7-9ed0-46ed-9769-557132447757 tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] 10.222.0.70 "PUT /compute/v2.1/images/7f206c28-0166-4c84-99e3-98ad4aa54e20/metadata" status: 404 len: 62 microversion: 2.1 time: 0.214776 Aug 25 12:50:50.096055 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 862/1709] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:50:49 2022] PUT /compute/v2.1/images/7f206c28-0166-4c84-99e3-98ad4aa54e20/metadata => generated 62 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:50.104682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-35d1d4b1-3173-443b-ab1d-5754c26fca62 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e8d6ee0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:50.612275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:50.664412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:50.669059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:50.691067 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-79126f0c-1b67-451f-9c88-9c65ef4750c3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1280 microversion: 2.25 time: 0.690937 Aug 25 12:50:50.705573 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 848/1710] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:49 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1280 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:50.708896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3249a6ec-4cc9-4298-8062-e304ee327770 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:50.710240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3249a6ec-4cc9-4298-8062-e304ee327770 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:50.726530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3249a6ec-4cc9-4298-8062-e304ee327770 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:50.727878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3249a6ec-4cc9-4298-8062-e304ee327770 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:50.728998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3249a6ec-4cc9-4298-8062-e304ee327770 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:50.730719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3249a6ec-4cc9-4298-8062-e304ee327770 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:50.733748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3249a6ec-4cc9-4298-8062-e304ee327770 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:50.735573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3249a6ec-4cc9-4298-8062-e304ee327770 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:50.842709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3249a6ec-4cc9-4298-8062-e304ee327770 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:51.132913 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3249a6ec-4cc9-4298-8062-e304ee327770 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 204 len: 0 microversion: 2.1 time: 0.433543 Aug 25 12:50:51.134002 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 849/1711] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:50 2022] DELETE /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:51.164209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d63b6dc-0851-49ea-a251-8dabd487e29e tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Action: 'update', calling method: .version_select at 0x7f3a29f51b80>, body: {"meta": {"os_distro": "alt"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:51.217562 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-4d63b6dc-0851-49ea-a251-8dabd487e29e tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] HTTP exception thrown: Image not found. Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d63b6dc-0851-49ea-a251-8dabd487e29e tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Request method failure captured: Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/images/a3426158-4934-4751-89ee-72f52889eed7/metadata/os_distro HTTP/1.1 Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 30 Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3AlJYIdHkmeKqbhLRkEdBruulPLe4m15WIZGWW0oS6j1-mdBSh-pBADyx6jwFjeO85fbvDj_JAzNLB0i_2oN6zufKhLtMSQZVNi-vN9m6pG4BvN6TF5zmkU_3cRoqtYgGg1jatnt2AaxOZ6U05rJfVwJsPGkwyeLKT6fXk-yJNVZ3A Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:51.222810 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d1105bff8fb41ca951bab4cf0d078b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}] Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e932e9ce9e484ad6a3c62142b9f6de8c Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: {"meta": {"os_distro": "alt"}} Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:50:51.225916 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'image_id': 'a3426158-4934-4751-89ee-72f52889eed7', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:51.227861 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a3426158-4934-4751-89ee-72f52889eed7 Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:51.230587 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3426158-4934-4751-89ee-72f52889eed7 could not be found. Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:51.239237 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:51.245394 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.250592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d63b6dc-0851-49ea-a251-8dabd487e29e tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:51.250592 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4d63b6dc-0851-49ea-a251-8dabd487e29e tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] 10.222.0.70 "PUT /compute/v2.1/images/a3426158-4934-4751-89ee-72f52889eed7/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.098096 Aug 25 12:50:51.250592 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 850/1712] 10.222.0.70 () {60 vars in 1310 bytes} [Thu Aug 25 12:50:51 2022] PUT /compute/v2.1/images/a3426158-4934-4751-89ee-72f52889eed7/metadata/os_distro => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:51.260824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:51.262996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: f0c96283-54f7-4c9e-8e46-c8bdb92a130e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:51.278497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:51.279928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:51.281791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:51.284038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:51.285361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:51.286773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:51.336724 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] HTTP exception thrown: Instance f0c96283-54f7-4c9e-8e46-c8bdb92a130e could not be found. Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Request method failure captured: Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e HTTP/1.1 Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB27YTYRFYqhnadeeC7zCa4VJWFBhcWo6WQ3Fpql_-Ox0uQyW7m43g_lp0DCg4J4p-lwhk1KWpjqh63aluUIb8j44IlGrg70RaoC__ZIFRt4FyJFuv0CAR60kwh_3tD1yzCPby3LYvLZ5S1P91ac6Wqd07OeOh3FcOqR6APoPQj-7lR0 Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: ea75680120684ccaae1b8c82e42b7c38 Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-VolumesAdminNegativeTest-801590104 Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:50:51.344166 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ea75680120684ccaae1b8c82e42b7c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ea75680120684ccaae1b8c82e42b7c38", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ea75680120684ccaae1b8c82e42b7c38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ea75680120684ccaae1b8c82e42b7c38"}]}] Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-VolumesAdminNegativeTest-801590104 Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: ea75680120684ccaae1b8c82e42b7c38 Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-801590104 Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-VolumesAdminNegativeTest-801590104-project Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 624fc054f45b48579ba7c47af4185e91 Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-VolumesAdminNegativeTest-801590104-project Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance f0c96283-54f7-4c9e-8e46-c8bdb92a130e could not be found. Aug 25 12:50:51.346997 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'f0c96283-54f7-4c9e-8e46-c8bdb92a130e'} Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c96283-54f7-4c9e-8e46-c8bdb92a130e could not be found. Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:51.348611 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c96283-54f7-4c9e-8e46-c8bdb92a130e could not be found. Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c96283-54f7-4c9e-8e46-c8bdb92a130e could not be found. Aug 25 12:50:51.355563 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.361232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Returning 404 to user: Instance f0c96283-54f7-4c9e-8e46-c8bdb92a130e could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:51.361232 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d683bb39-fef6-4554-9744-e95df3bfc073 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e" status: 404 len: 111 microversion: 2.1 time: 0.093833 Aug 25 12:50:51.361232 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 851/1713] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:51 2022] GET /compute/v2.1/servers/f0c96283-54f7-4c9e-8e46-c8bdb92a130e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:51.369281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ce64dee0-99cf-40b9-b7ce-899b63d386b3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:51.370515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ce64dee0-99cf-40b9-b7ce-899b63d386b3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:51.393330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce64dee0-99cf-40b9-b7ce-899b63d386b3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:51.397765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce64dee0-99cf-40b9-b7ce-899b63d386b3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:51.401451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce64dee0-99cf-40b9-b7ce-899b63d386b3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:51.407344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce64dee0-99cf-40b9-b7ce-899b63d386b3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:51.408934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce64dee0-99cf-40b9-b7ce-899b63d386b3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:51.410163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce64dee0-99cf-40b9-b7ce-899b63d386b3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:51.602504 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-35d1d4b1-3173-443b-ab1d-5754c26fca62 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "DELETE /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a" status: 204 len: 0 microversion: 2.1 time: 1.504452 Aug 25 12:50:51.603806 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 863/1714] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:50 2022] DELETE /compute/v2.1/images/a1230859-e4c7-4597-973a-21f1d6b9446a => generated 0 bytes in 1507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:51.617723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1624fd70-0062-4816-8f27-94b5b327059a tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Action: 'create', calling method: .version_select at 0x7f3a2a1ca820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:51.724456 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-1624fd70-0062-4816-8f27-94b5b327059a tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] HTTP exception thrown: Image not found. Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1624fd70-0062-4816-8f27-94b5b327059a tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Request method failure captured: Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/images/561b2073-a666-496a-8ee0-30392126a009/metadata HTTP/1.1 Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 57 Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3AlJYIdHkmeKqbhLRkEdBruulPLe4m15WIZGWW0oS6j1-mdBSh-pBADyx6jwFjeO85fbvDj_JAzNLB0i_2oN6zufKhLtMSQZVNi-vN9m6pG4BvN6TF5zmkU_3cRoqtYgGg1jatnt2AaxOZ6U05rJfVwJsPGkwyeLKT6fXk-yJNVZ3A Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:50:51.736921 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d1105bff8fb41ca951bab4cf0d078b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d1105bff8fb41ca951bab4cf0d078b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d1105bff8fb41ca951bab4cf0d078b5"}]}] Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 4d1105bff8fb41ca951bab4cf0d078b5 Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-259373171 Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e932e9ce9e484ad6a3c62142b9f6de8c Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-259373171-project Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: exception: Image not found. Aug 25 12:50:51.743110 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'image_id': '561b2073-a666-496a-8ee0-30392126a009', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:51.744903 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 561b2073-a666-496a-8ee0-30392126a009 Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:50:51.747247 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 561b2073-a666-496a-8ee0-30392126a009 could not be found. Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:51.767970 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:50:51.772703 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:50:51.783797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1624fd70-0062-4816-8f27-94b5b327059a tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] Returning 404 to user: Image not found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:51.783797 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1624fd70-0062-4816-8f27-94b5b327059a tempest-ImagesMetadataNegativeTestJSON-259373171 tempest-ImagesMetadataNegativeTestJSON-259373171-project] 10.222.0.70 "POST /compute/v2.1/images/561b2073-a666-496a-8ee0-30392126a009/metadata" status: 404 len: 62 microversion: 2.1 time: 0.140919 Aug 25 12:50:51.783797 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 864/1715] 10.222.0.70 () {60 vars in 1281 bytes} [Thu Aug 25 12:50:51 2022] POST /compute/v2.1/images/561b2073-a666-496a-8ee0-30392126a009/metadata => generated 62 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:51.797726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e73f11a-72d3-4ff6-b174-c54493a4d36f tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a1caaf0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:52.139284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ce64dee0-99cf-40b9-b7ce-899b63d386b3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:52.171381 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ce64dee0-99cf-40b9-b7ce-899b63d386b3 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1504 microversion: 2.1 time: 0.814612 Aug 25 12:50:52.206868 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 852/1716] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:51 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1504 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:52.223766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:52.225710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:52.247231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:52.248838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:52.252031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:52.253953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:52.255650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:52.257599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:52.997110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:53.055857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:53.062594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:53.072489 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0b443def-8abf-465b-adf6-0b06ad80e6df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1280 microversion: 2.25 time: 0.858476 Aug 25 12:50:53.089549 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 853/1717] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:52 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1280 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:53.231193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cfdbb645-88db-4051-b830-5fde7d08c954 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:53.233534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cfdbb645-88db-4051-b830-5fde7d08c954 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:53.261989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdbb645-88db-4051-b830-5fde7d08c954 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:53.266949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdbb645-88db-4051-b830-5fde7d08c954 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:53.268205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdbb645-88db-4051-b830-5fde7d08c954 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:53.270011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdbb645-88db-4051-b830-5fde7d08c954 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:53.275548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdbb645-88db-4051-b830-5fde7d08c954 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:53.282330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdbb645-88db-4051-b830-5fde7d08c954 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:53.544836 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e73f11a-72d3-4ff6-b174-c54493a4d36f tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "DELETE /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988" status: 204 len: 0 microversion: 2.1 time: 1.785239 Aug 25 12:50:53.545746 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 865/1718] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:51 2022] DELETE /compute/v2.1/images/b0fcce13-1cb9-4ca3-9e0d-b5f37b055988 => generated 0 bytes in 1787 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:53.566960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bc4e7635-edf9-497d-8776-0fbfcf1bed9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:53.572964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bc4e7635-edf9-497d-8776-0fbfcf1bed9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:53.611535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4e7635-edf9-497d-8776-0fbfcf1bed9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:53.613173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4e7635-edf9-497d-8776-0fbfcf1bed9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:53.614524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4e7635-edf9-497d-8776-0fbfcf1bed9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:53.616491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4e7635-edf9-497d-8776-0fbfcf1bed9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:53.620217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4e7635-edf9-497d-8776-0fbfcf1bed9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:53.621823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4e7635-edf9-497d-8776-0fbfcf1bed9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:53.640496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:53.745785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bc4e7635-edf9-497d-8776-0fbfcf1bed9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:54.098834 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bc4e7635-edf9-497d-8776-0fbfcf1bed9e tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 204 len: 0 microversion: 2.1 time: 0.537215 Aug 25 12:50:54.100051 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 866/1719] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:53 2022] DELETE /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:54.123035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4c77b311-ddaa-495b-9849-7c7cf33c1831 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:54.132138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4c77b311-ddaa-495b-9849-7c7cf33c1831 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:54.156435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c77b311-ddaa-495b-9849-7c7cf33c1831 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:54.158597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c77b311-ddaa-495b-9849-7c7cf33c1831 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:54.159759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c77b311-ddaa-495b-9849-7c7cf33c1831 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:54.162545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c77b311-ddaa-495b-9849-7c7cf33c1831 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:54.163448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c77b311-ddaa-495b-9849-7c7cf33c1831 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:54.164338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c77b311-ddaa-495b-9849-7c7cf33c1831 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:54.862213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4c77b311-ddaa-495b-9849-7c7cf33c1831 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:54.893025 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4c77b311-ddaa-495b-9849-7c7cf33c1831 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1473 microversion: 2.1 time: 0.782318 Aug 25 12:50:54.897707 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 867/1720] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:54 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1473 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:50:54.921318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:54.924903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:54.934064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cfdbb645-88db-4051-b830-5fde7d08c954 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:54.958036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:54.960910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:54.967445 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cfdbb645-88db-4051-b830-5fde7d08c954 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1504 microversion: 2.1 time: 1.753818 Aug 25 12:50:54.969705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:54.970732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:54.973400 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 854/1721] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:53 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1504 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:50:54.974018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:54.975413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:55.036276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-664586a1-43fd-4bf6-9cea-7daecf56c883 req-74b577ed-4197-4ff1-a0ed-b4875a5f9203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca859734-6370-48aa-b3c3-22ff3362f6b1", "name": "network-vif-plugged", "status": "completed", "tag": "e899f17a-afed-4127-8666-0bdca4cad26c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:55.097690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-664586a1-43fd-4bf6-9cea-7daecf56c883 req-74b577ed-4197-4ff1-a0ed-b4875a5f9203 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:55.098626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-664586a1-43fd-4bf6-9cea-7daecf56c883 req-74b577ed-4197-4ff1-a0ed-b4875a5f9203 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:55.106083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-664586a1-43fd-4bf6-9cea-7daecf56c883 req-74b577ed-4197-4ff1-a0ed-b4875a5f9203 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:55.169171 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-664586a1-43fd-4bf6-9cea-7daecf56c883 req-74b577ed-4197-4ff1-a0ed-b4875a5f9203 service nova] Creating event network-vif-plugged:e899f17a-afed-4127-8666-0bdca4cad26c for instance ca859734-6370-48aa-b3c3-22ff3362f6b1 on n-h1-852771-8 Aug 25 12:50:55.191774 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-664586a1-43fd-4bf6-9cea-7daecf56c883 req-74b577ed-4197-4ff1-a0ed-b4875a5f9203 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174180 Aug 25 12:50:55.196398 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 855/1722] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:55.947325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ae011650-153f-41b2-b773-3452927b183a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:55.960877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ae011650-153f-41b2-b773-3452927b183a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:55.991854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae011650-153f-41b2-b773-3452927b183a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:55.993336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae011650-153f-41b2-b773-3452927b183a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:55.994796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae011650-153f-41b2-b773-3452927b183a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:56.000778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae011650-153f-41b2-b773-3452927b183a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:56.004969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae011650-153f-41b2-b773-3452927b183a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:56.006452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae011650-153f-41b2-b773-3452927b183a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:57.584407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:57.680174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:57.697857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:57.701089 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7584a9fd-f455-4c7f-8d19-3030efb30bcb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1280 microversion: 2.25 time: 2.800392 Aug 25 12:50:57.708748 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 868/1723] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:54 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1280 bytes in 2810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:57.733786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5fd12fa3-a7a6-4d10-a1f9-e39728947c45 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:57.736538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5fd12fa3-a7a6-4d10-a1f9-e39728947c45 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:57.756318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fd12fa3-a7a6-4d10-a1f9-e39728947c45 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:57.759192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fd12fa3-a7a6-4d10-a1f9-e39728947c45 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:57.760440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fd12fa3-a7a6-4d10-a1f9-e39728947c45 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:57.763536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fd12fa3-a7a6-4d10-a1f9-e39728947c45 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:57.765622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fd12fa3-a7a6-4d10-a1f9-e39728947c45 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:57.779984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fd12fa3-a7a6-4d10-a1f9-e39728947c45 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:58.210902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5fd12fa3-a7a6-4d10-a1f9-e39728947c45 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:58.276599 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5fd12fa3-a7a6-4d10-a1f9-e39728947c45 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1298 microversion: 2.1 time: 0.565760 Aug 25 12:50:58.284927 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 869/1724] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:57 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1298 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:58.320756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2b2df811-dc33-404b-b910-f68f4ce13a86 req-646920ff-e9af-49bb-aafd-3e4297f2157b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40100f3-81b6-4ae1-8bd0-46a6e367df2f", "name": "network-vif-deleted", "tag": "41ae88a6-3423-4cdf-a3a1-7841f4e38bfb"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:58.349108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ae011650-153f-41b2-b773-3452927b183a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:58.396325 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ae011650-153f-41b2-b773-3452927b183a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1473 microversion: 2.1 time: 2.459786 Aug 25 12:50:58.400629 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 856/1725] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:55 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1473 bytes in 2466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:58.458878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2b2df811-dc33-404b-b910-f68f4ce13a86 req-646920ff-e9af-49bb-aafd-3e4297f2157b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:58.459718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2b2df811-dc33-404b-b910-f68f4ce13a86 req-646920ff-e9af-49bb-aafd-3e4297f2157b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:58.460591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2b2df811-dc33-404b-b910-f68f4ce13a86 req-646920ff-e9af-49bb-aafd-3e4297f2157b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:58.504326 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2b2df811-dc33-404b-b910-f68f4ce13a86 req-646920ff-e9af-49bb-aafd-3e4297f2157b service nova] Creating event network-vif-deleted:41ae88a6-3423-4cdf-a3a1-7841f4e38bfb for instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f on n-h1-852771-8 Aug 25 12:50:58.540373 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2b2df811-dc33-404b-b910-f68f4ce13a86 req-646920ff-e9af-49bb-aafd-3e4297f2157b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251367 Aug 25 12:50:58.542125 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 870/1726] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:58.760907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:58.770616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:58.802918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:58.803948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:58.804764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:58.806174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:58.806996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:58.807777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:59.342168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:59.348427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:59.387718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:59.395831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:59.401535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:59.407897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:59.414433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:59.420553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:59.667069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:59.676920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:59.688889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:59.690052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lazy-loading 'fault' on Instance uuid b40100f3-81b6-4ae1-8bd0-46a6e367df2f {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:50:59.977283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:00.009485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:00.016937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:00.020197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:00.041668 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-74042655-32ec-4f14-80b2-21ad6a944807 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1476 microversion: 2.25 time: 1.283091 Aug 25 12:51:00.042785 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 857/1727] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:58 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1476 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:00.092418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-64e39234-923e-4c50-ae87-567a80a45084 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:00.094646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-64e39234-923e-4c50-ae87-567a80a45084 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:00.147179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e39234-923e-4c50-ae87-567a80a45084 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:00.150240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e39234-923e-4c50-ae87-567a80a45084 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:00.166271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e39234-923e-4c50-ae87-567a80a45084 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:00.171955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e39234-923e-4c50-ae87-567a80a45084 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:00.172908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e39234-923e-4c50-ae87-567a80a45084 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:00.174007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e39234-923e-4c50-ae87-567a80a45084 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:00.378578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fc0529aca41c3bb78c94b844e4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d024268836d4dfba22a4e24d161df70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:00.419448 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8494f55d-5195-4b1c-ad3e-e78c6fc082bb tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 200 len: 1303 microversion: 2.1 time: 1.097961 Aug 25 12:51:00.429432 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 871/1728] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:59 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 1303 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:51:00.466137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d2c4fa3-c4b3-4d65-aedb-59de6534a549 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:00.467600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d2c4fa3-c4b3-4d65-aedb-59de6534a549 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:00.506764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2c4fa3-c4b3-4d65-aedb-59de6534a549 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:00.511270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2c4fa3-c4b3-4d65-aedb-59de6534a549 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:00.515041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2c4fa3-c4b3-4d65-aedb-59de6534a549 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:00.517763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2c4fa3-c4b3-4d65-aedb-59de6534a549 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:00.518872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2c4fa3-c4b3-4d65-aedb-59de6534a549 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:00.519664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2c4fa3-c4b3-4d65-aedb-59de6534a549 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:00.822135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-64e39234-923e-4c50-ae87-567a80a45084 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:00.878103 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-64e39234-923e-4c50-ae87-567a80a45084 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 200 len: 1431 microversion: 2.1 time: 0.828698 Aug 25 12:51:00.879279 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 858/1729] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:00 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 1431 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:00.909808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-798aac99-c504-4a47-aaaa-92a7956b0806 req-dccaaea8-4a50-4831-9dcc-38430d4064ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd7cd1ff-cdb0-439f-803d-62483f38f5b6", "name": "network-vif-deleted", "tag": "d6657196-f96f-4269-b16f-0022040bbd1e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:00.966044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-798aac99-c504-4a47-aaaa-92a7956b0806 req-dccaaea8-4a50-4831-9dcc-38430d4064ef service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:00.967055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-798aac99-c504-4a47-aaaa-92a7956b0806 req-dccaaea8-4a50-4831-9dcc-38430d4064ef service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:00.969247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-798aac99-c504-4a47-aaaa-92a7956b0806 req-dccaaea8-4a50-4831-9dcc-38430d4064ef service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:01.044019 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-798aac99-c504-4a47-aaaa-92a7956b0806 req-dccaaea8-4a50-4831-9dcc-38430d4064ef service nova] Creating event network-vif-deleted:d6657196-f96f-4269-b16f-0022040bbd1e for instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 on n-h2-852771-8 Aug 25 12:51:01.060488 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-798aac99-c504-4a47-aaaa-92a7956b0806 req-dccaaea8-4a50-4831-9dcc-38430d4064ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176868 Aug 25 12:51:01.062507 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 859/1730] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:01.496666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:01.506729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:01.551605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:01.558563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:01.559326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:01.560729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:01.574239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:01.580013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:01.635777 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] HTTP exception thrown: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Request method failure captured: Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f HTTP/1.1 Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB2_iQQExpbvDZq3Mb0AMZNpOPzaSgE65Wc5By6unsYGyz8fVKHUx4BAiP3Xoo8k60pLxZqqAu-T9DmLCM0K4ZVdSJ6R_9bwqpeOJEt_4xMaL0LjmWl5xdM_-gsdXs4tq_0aF9fKPSQTwYOw2_TFJvU8v2oCUceNu46LNC1-xPjdF4mY Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:51:01.639889 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2d024268836d4dfba22a4e24d161df70", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}] Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a32fc0529aca41c3bb78c94b844e4d36 Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:01.643854 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'b40100f3-81b6-4ae1-8bd0-46a6e367df2f'} Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:01.644856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:01.664230 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:01.680098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Returning 404 to user: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:01.683573 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9ff4af8b-4e7d-4c69-913c-1c9594c364ac tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 404 len: 111 microversion: 2.1 time: 0.201471 Aug 25 12:51:01.685713 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 860/1731] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:01 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:01.706981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d1ad45e-cca1-49b4-bca9-3e40f434c706 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:01.767326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.server_groups [None req-4d1ad45e-cca1-49b4-bca9-3e40f434c706 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Querying cell 638d90be-ffdb-4b61-b94a-775c50a724be(cell1) for 1 instances {{(pid=129059) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 25 12:51:01.769171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d1ad45e-cca1-49b4-bca9-3e40f434c706 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:01.771647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d1ad45e-cca1-49b4-bca9-3e40f434c706 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:01.772865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d1ad45e-cca1-49b4-bca9-3e40f434c706 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:01.810304 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4d1ad45e-cca1-49b4-bca9-3e40f434c706 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.110277 Aug 25 12:51:01.826530 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 861/1732] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 12:51:01 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:01.840937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4799d84a-d881-49d7-8584-9ea37867701d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:01.883112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.server_groups [None req-4799d84a-d881-49d7-8584-9ea37867701d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Querying cell 638d90be-ffdb-4b61-b94a-775c50a724be(cell1) for 1 instances {{(pid=129059) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 25 12:51:01.889054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4799d84a-d881-49d7-8584-9ea37867701d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:01.892991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4799d84a-d881-49d7-8584-9ea37867701d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:01.894242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4799d84a-d881-49d7-8584-9ea37867701d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:01.918605 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4799d84a-d881-49d7-8584-9ea37867701d tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/25439800-1adf-44ec-a52d-94e6c6b1d516" status: 200 len: 183 microversion: 2.1 time: 0.087996 Aug 25 12:51:01.920598 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 862/1733] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 12:51:01 2022] GET /compute/v2.1/os-server-groups/25439800-1adf-44ec-a52d-94e6c6b1d516 => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:01.930579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:01.932732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: fd7cd1ff-cdb0-439f-803d-62483f38f5b6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:01.954319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:01.955745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:01.956745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:01.959456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:01.960748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:01.961943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:01.999751 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] HTTP exception thrown: Instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 could not be found. Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Request method failure captured: Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 HTTP/1.1 Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB28mH38mts7LRYFBEDtglzfRurMgXBGSa43YNIwIXXEkvnGvGT4jySU9H5NsSuE78xKUO_y6Q1puZkEtn8tLXqdsUYmVs9Hz7f2Rp4dP9Fy3ADXN0UrE9JrDzsc8JekG0ydf-DMoMzuXr80gWXD_r8Dz0gzaD_aVzagntE4yS13b2rg Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 8ceae811fb184dba9e2231232124bcd1 Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ListImageFiltersTestJSON-1985456801 Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:51:02.009214 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ceae811fb184dba9e2231232124bcd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8ceae811fb184dba9e2231232124bcd1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8ceae811fb184dba9e2231232124bcd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ceae811fb184dba9e2231232124bcd1"}]}] Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ListImageFiltersTestJSON-1985456801 Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 8ceae811fb184dba9e2231232124bcd1 Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1985456801 Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ListImageFiltersTestJSON-1985456801-project Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 884fb1087aae4f87b047879b060d1e21 Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ListImageFiltersTestJSON-1985456801-project Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 could not be found. Aug 25 12:51:02.013092 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'fd7cd1ff-cdb0-439f-803d-62483f38f5b6'} Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 could not be found. Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:02.018610 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 could not be found. Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 could not be found. Aug 25 12:51:02.023625 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.027060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Returning 404 to user: Instance fd7cd1ff-cdb0-439f-803d-62483f38f5b6 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:02.030627 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7bf95292-9198-49c6-9ddb-8237241ee5ec tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6" status: 404 len: 111 microversion: 2.1 time: 0.107174 Aug 25 12:51:02.045796 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 863/1734] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:01 2022] GET /compute/v2.1/servers/fd7cd1ff-cdb0-439f-803d-62483f38f5b6 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:02.061582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:02.063988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:02.087375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:02.088530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:02.089371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.091095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:02.091943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:02.092790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.117697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-3d2c4fa3-c4b3-4d65-aedb-59de6534a549 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid ca859734-6370-48aa-b3c3-22ff3362f6b1 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:51:02.145709 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] HTTP exception thrown: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Request method failure captured: Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f HTTP/1.1 Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB2_iQQExpbvDZq3Mb0AMZNpOPzaSgE65Wc5By6unsYGyz8fVKHUx4BAiP3Xoo8k60pLxZqqAu-T9DmLCM0K4ZVdSJ6R_9bwqpeOJEt_4xMaL0LjmWl5xdM_-gsdXs4tq_0aF9fKPSQTwYOw2_TFJvU8v2oCUceNu46LNC1-xPjdF4mY Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:51:02.152129 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2d024268836d4dfba22a4e24d161df70", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}] Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a32fc0529aca41c3bb78c94b844e4d36 Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:02.155505 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'b40100f3-81b6-4ae1-8bd0-46a6e367df2f'} Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:02.158419 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:02.167201 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.169764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Returning 404 to user: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:02.174179 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-48043744-641e-465c-8767-b5c40e157019 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 404 len: 111 microversion: 2.1 time: 0.121197 Aug 25 12:51:02.177197 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 864/1735] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:51:02 2022] DELETE /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:02.204463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-51489e5c-4853-4788-a4bf-ede172f6de93 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:02.206395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-51489e5c-4853-4788-a4bf-ede172f6de93 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:02.212961 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d2c4fa3-c4b3-4d65-aedb-59de6534a549 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1968 microversion: 2.25 time: 1.780810 Aug 25 12:51:02.213924 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 872/1736] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:00 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1968 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:02.240223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51489e5c-4853-4788-a4bf-ede172f6de93 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:02.241946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51489e5c-4853-4788-a4bf-ede172f6de93 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:02.243048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51489e5c-4853-4788-a4bf-ede172f6de93 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.245455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51489e5c-4853-4788-a4bf-ede172f6de93 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:02.246897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51489e5c-4853-4788-a4bf-ede172f6de93 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:02.250837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51489e5c-4853-4788-a4bf-ede172f6de93 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.267324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:02.268765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] [instance: b40100f3-81b6-4ae1-8bd0-46a6e367df2f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:02.307295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=63 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:02.310240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:02.311002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:02.311758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.315206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:02.316392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:02.318094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.390159 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] HTTP exception thrown: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Request method failure captured: Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f HTTP/1.1 Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB2_iQQExpbvDZq3Mb0AMZNpOPzaSgE65Wc5By6unsYGyz8fVKHUx4BAiP3Xoo8k60pLxZqqAu-T9DmLCM0K4ZVdSJ6R_9bwqpeOJEt_4xMaL0LjmWl5xdM_-gsdXs4tq_0aF9fKPSQTwYOw2_TFJvU8v2oCUceNu46LNC1-xPjdF4mY Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:51:02.399453 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2d024268836d4dfba22a4e24d161df70", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}] Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a32fc0529aca41c3bb78c94b844e4d36 Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:02.402698 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b40100f3-81b6-4ae1-8bd0-46a6e367df2f'} Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:02.405377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. Aug 25 12:51:02.409188 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.413039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-51489e5c-4853-4788-a4bf-ede172f6de93 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:51:02.422417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Returning 404 to user: Instance b40100f3-81b6-4ae1-8bd0-46a6e367df2f could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:02.424463 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b85818ab-9bdc-4368-91be-1a925fc75e50 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f" status: 404 len: 111 microversion: 2.1 time: 0.189907 Aug 25 12:51:02.430964 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 873/1737] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:02 2022] GET /compute/v2.1/servers/b40100f3-81b6-4ae1-8bd0-46a6e367df2f => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:02.457667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad7c2354-aaf5-4097-b1de-ae00804303cd tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:02.459184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad7c2354-aaf5-4097-b1de-ae00804303cd tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:02.495041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad7c2354-aaf5-4097-b1de-ae00804303cd tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:02.519927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad7c2354-aaf5-4097-b1de-ae00804303cd tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:02.522645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad7c2354-aaf5-4097-b1de-ae00804303cd tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.526416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad7c2354-aaf5-4097-b1de-ae00804303cd tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:02.532571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad7c2354-aaf5-4097-b1de-ae00804303cd tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:02.534193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad7c2354-aaf5-4097-b1de-ae00804303cd tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.962330 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-51489e5c-4853-4788-a4bf-ede172f6de93 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "DELETE /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55" status: 204 len: 0 microversion: 2.1 time: 0.776992 Aug 25 12:51:02.965316 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 865/1738] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:51:02 2022] DELETE /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:51:02.983271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e983bb31-b363-4a84-ac07-93bebd6c2d8a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:03.013931 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-e983bb31-b363-4a84-ac07-93bebd6c2d8a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] HTTP exception thrown: Instance group 5bc44126-7378-4f1e-9d04-4b15ad376ca1 could not be found. Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e983bb31-b363-4a84-ac07-93bebd6c2d8a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Request method failure captured: Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-server-groups/5bc44126-7378-4f1e-9d04-4b15ad376ca1 HTTP/1.1 Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB2_iQQExpbvDZq3Mb0AMZNpOPzaSgE65Wc5By6unsYGyz8fVKHUx4BAiP3Xoo8k60pLxZqqAu-T9DmLCM0K4ZVdSJ6R_9bwqpeOJEt_4xMaL0LjmWl5xdM_-gsdXs4tq_0aF9fKPSQTwYOw2_TFJvU8v2oCUceNu46LNC1-xPjdF4mY Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:51:03.028662 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2d024268836d4dfba22a4e24d161df70", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}] Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a32fc0529aca41c3bb78c94b844e4d36 Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance group 5bc44126-7378-4f1e-9d04-4b15ad376ca1 could not be found. Aug 25 12:51:03.031430 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '5bc44126-7378-4f1e-9d04-4b15ad376ca1'} Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5bc44126-7378-4f1e-9d04-4b15ad376ca1 could not be found. Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:03.032815 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5bc44126-7378-4f1e-9d04-4b15ad376ca1 could not be found. Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5bc44126-7378-4f1e-9d04-4b15ad376ca1 could not be found. Aug 25 12:51:03.039028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:03.046991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e983bb31-b363-4a84-ac07-93bebd6c2d8a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Returning 404 to user: Instance group 5bc44126-7378-4f1e-9d04-4b15ad376ca1 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:03.046991 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e983bb31-b363-4a84-ac07-93bebd6c2d8a tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/5bc44126-7378-4f1e-9d04-4b15ad376ca1" status: 404 len: 117 microversion: 2.1 time: 0.063656 Aug 25 12:51:03.046991 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 866/1739] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 12:51:02 2022] DELETE /compute/v2.1/os-server-groups/5bc44126-7378-4f1e-9d04-4b15ad376ca1 => generated 117 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:03.651096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ad59be2-801e-4796-93d5-c45e3c416dbc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:03.662130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5ad59be2-801e-4796-93d5-c45e3c416dbc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:03.692249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ad59be2-801e-4796-93d5-c45e3c416dbc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:03.692933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ad59be2-801e-4796-93d5-c45e3c416dbc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:03.693779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ad59be2-801e-4796-93d5-c45e3c416dbc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:03.695172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ad59be2-801e-4796-93d5-c45e3c416dbc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:03.711672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ad59be2-801e-4796-93d5-c45e3c416dbc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:03.712535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ad59be2-801e-4796-93d5-c45e3c416dbc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:03.856305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5ad59be2-801e-4796-93d5-c45e3c416dbc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:51:03.896669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-ad7c2354-aaf5-4097-b1de-ae00804303cd tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid ca859734-6370-48aa-b3c3-22ff3362f6b1 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:51:03.967416 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad7c2354-aaf5-4097-b1de-ae00804303cd tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1968 microversion: 2.25 time: 1.531877 Aug 25 12:51:03.983477 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 874/1740] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:02 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1968 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:04.024377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bddb058c-092f-4b3b-acfd-de2c686f9b8b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:04.029931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bddb058c-092f-4b3b-acfd-de2c686f9b8b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:04.049654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bddb058c-092f-4b3b-acfd-de2c686f9b8b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:04.050973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bddb058c-092f-4b3b-acfd-de2c686f9b8b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:04.053111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bddb058c-092f-4b3b-acfd-de2c686f9b8b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:04.059648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bddb058c-092f-4b3b-acfd-de2c686f9b8b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:04.064170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bddb058c-092f-4b3b-acfd-de2c686f9b8b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:04.064794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bddb058c-092f-4b3b-acfd-de2c686f9b8b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:04.396064 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ad59be2-801e-4796-93d5-c45e3c416dbc tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 204 len: 0 microversion: 2.1 time: 1.315118 Aug 25 12:51:04.397288 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 867/1741] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:51:03 2022] DELETE /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 0 bytes in 1351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:51:04.431560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de51e13d-5ece-47a5-8bfa-7db1dce02eee tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:04.460315 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-de51e13d-5ece-47a5-8bfa-7db1dce02eee tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] HTTP exception thrown: Instance group 0f653dc1-e975-442f-8f21-feb4519418d7 could not be found. Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de51e13d-5ece-47a5-8bfa-7db1dce02eee tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Request method failure captured: Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-server-groups/0f653dc1-e975-442f-8f21-feb4519418d7 HTTP/1.1 Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB2_iQQExpbvDZq3Mb0AMZNpOPzaSgE65Wc5By6unsYGyz8fVKHUx4BAiP3Xoo8k60pLxZqqAu-T9DmLCM0K4ZVdSJ6R_9bwqpeOJEt_4xMaL0LjmWl5xdM_-gsdXs4tq_0aF9fKPSQTwYOw2_TFJvU8v2oCUceNu46LNC1-xPjdF4mY Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:51:04.469732 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2d024268836d4dfba22a4e24d161df70", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}] Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a32fc0529aca41c3bb78c94b844e4d36 Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance group 0f653dc1-e975-442f-8f21-feb4519418d7 could not be found. Aug 25 12:51:04.473130 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '0f653dc1-e975-442f-8f21-feb4519418d7'} Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0f653dc1-e975-442f-8f21-feb4519418d7 could not be found. Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:04.475021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0f653dc1-e975-442f-8f21-feb4519418d7 could not be found. Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0f653dc1-e975-442f-8f21-feb4519418d7 could not be found. Aug 25 12:51:04.478288 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:04.483244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de51e13d-5ece-47a5-8bfa-7db1dce02eee tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Returning 404 to user: Instance group 0f653dc1-e975-442f-8f21-feb4519418d7 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:04.486727 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-de51e13d-5ece-47a5-8bfa-7db1dce02eee tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/0f653dc1-e975-442f-8f21-feb4519418d7" status: 404 len: 117 microversion: 2.1 time: 0.086086 Aug 25 12:51:04.488754 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 868/1742] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 12:51:04 2022] DELETE /compute/v2.1/os-server-groups/0f653dc1-e975-442f-8f21-feb4519418d7 => generated 117 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:04.514591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c118fb9-46a0-4ca9-8b7a-269a7bda767f tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:04.531650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c118fb9-46a0-4ca9-8b7a-269a7bda767f tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:04.534054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c118fb9-46a0-4ca9-8b7a-269a7bda767f tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:04.535266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c118fb9-46a0-4ca9-8b7a-269a7bda767f tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:04.543237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c118fb9-46a0-4ca9-8b7a-269a7bda767f tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:04.545625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c118fb9-46a0-4ca9-8b7a-269a7bda767f tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:04.546568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c118fb9-46a0-4ca9-8b7a-269a7bda767f tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:04.628397 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c118fb9-46a0-4ca9-8b7a-269a7bda767f tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.136165 Aug 25 12:51:04.643259 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 869/1743] 10.222.0.70 () {60 vars in 1217 bytes} [Thu Aug 25 12:51:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:51:04.664303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee69b123-5925-4e42-b5b2-e0cf51323c4a tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:04.668851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee69b123-5925-4e42-b5b2-e0cf51323c4a tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:04.693259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee69b123-5925-4e42-b5b2-e0cf51323c4a tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:04.697242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee69b123-5925-4e42-b5b2-e0cf51323c4a tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:04.698144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee69b123-5925-4e42-b5b2-e0cf51323c4a tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:04.703375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee69b123-5925-4e42-b5b2-e0cf51323c4a tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:04.706216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee69b123-5925-4e42-b5b2-e0cf51323c4a tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:04.707028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee69b123-5925-4e42-b5b2-e0cf51323c4a tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:05.034113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bddb058c-092f-4b3b-acfd-de2c686f9b8b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:05.116133 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bddb058c-092f-4b3b-acfd-de2c686f9b8b tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55" status: 200 len: 1473 microversion: 2.1 time: 1.128925 Aug 25 12:51:05.122399 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 875/1744] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:03 2022] GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55 => generated 1473 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:05.180014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-339338fa-f5e7-43d9-b631-29ccdcc7d4b1 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:05.219037 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-339338fa-f5e7-43d9-b631-29ccdcc7d4b1 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] HTTP exception thrown: Instance group 7a6c216f-199d-4bd9-a642-07e99f9ddfbd could not be found. Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-339338fa-f5e7-43d9-b631-29ccdcc7d4b1 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Request method failure captured: Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-server-groups/7a6c216f-199d-4bd9-a642-07e99f9ddfbd HTTP/1.1 Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB2_iQQExpbvDZq3Mb0AMZNpOPzaSgE65Wc5By6unsYGyz8fVKHUx4BAiP3Xoo8k60pLxZqqAu-T9DmLCM0K4ZVdSJ6R_9bwqpeOJEt_4xMaL0LjmWl5xdM_-gsdXs4tq_0aF9fKPSQTwYOw2_TFJvU8v2oCUceNu46LNC1-xPjdF4mY Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:51:05.232422 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2d024268836d4dfba22a4e24d161df70", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}] Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a32fc0529aca41c3bb78c94b844e4d36 Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance group 7a6c216f-199d-4bd9-a642-07e99f9ddfbd could not be found. Aug 25 12:51:05.236387 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '7a6c216f-199d-4bd9-a642-07e99f9ddfbd'} Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7a6c216f-199d-4bd9-a642-07e99f9ddfbd could not be found. Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:05.238250 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7a6c216f-199d-4bd9-a642-07e99f9ddfbd could not be found. Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7a6c216f-199d-4bd9-a642-07e99f9ddfbd could not be found. Aug 25 12:51:05.241138 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.243760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-339338fa-f5e7-43d9-b631-29ccdcc7d4b1 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Returning 404 to user: Instance group 7a6c216f-199d-4bd9-a642-07e99f9ddfbd could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:05.243760 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-339338fa-f5e7-43d9-b631-29ccdcc7d4b1 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/7a6c216f-199d-4bd9-a642-07e99f9ddfbd" status: 404 len: 117 microversion: 2.1 time: 0.113002 Aug 25 12:51:05.247349 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 876/1745] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 12:51:05 2022] DELETE /compute/v2.1/os-server-groups/7a6c216f-199d-4bd9-a642-07e99f9ddfbd => generated 117 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:05.260014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852771-8", "block_migration": "auto"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:05.267340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:05.288956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:05.290726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:05.292070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:05.293988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:05.295541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:05.297231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:05.588457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'flavor' on Instance uuid ca859734-6370-48aa-b3c3-22ff3362f6b1 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:51:05.655418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Going to try to live migrate instance to n-h2-852771-8 {{(pid=129060) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:51:05.664954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ee69b123-5925-4e42-b5b2-e0cf51323c4a tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:05.764861 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee69b123-5925-4e42-b5b2-e0cf51323c4a tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1679 microversion: 2.1 time: 1.117781 Aug 25 12:51:05.788889 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 870/1746] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:04 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1679 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:05.818404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e3c862d0-088e-482d-a1a6-4db6b0bc0dea tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:05.826370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:05.833221 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-e3c862d0-088e-482d-a1a6-4db6b0bc0dea tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] HTTP exception thrown: Instance group f1ac64ac-e535-4bf9-adaf-dfca63368173 could not be found. Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e3c862d0-088e-482d-a1a6-4db6b0bc0dea tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Request method failure captured: Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-server-groups/f1ac64ac-e535-4bf9-adaf-dfca63368173 HTTP/1.1 Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB2_iQQExpbvDZq3Mb0AMZNpOPzaSgE65Wc5By6unsYGyz8fVKHUx4BAiP3Xoo8k60pLxZqqAu-T9DmLCM0K4ZVdSJ6R_9bwqpeOJEt_4xMaL0LjmWl5xdM_-gsdXs4tq_0aF9fKPSQTwYOw2_TFJvU8v2oCUceNu46LNC1-xPjdF4mY Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:51:05.838507 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2d024268836d4dfba22a4e24d161df70", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2d024268836d4dfba22a4e24d161df70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2d024268836d4dfba22a4e24d161df70"}]}] Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 2d024268836d4dfba22a4e24d161df70 Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerGroupTestJSON-1286558550 Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a32fc0529aca41c3bb78c94b844e4d36 Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerGroupTestJSON-1286558550-project Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance group f1ac64ac-e535-4bf9-adaf-dfca63368173 could not be found. Aug 25 12:51:05.841654 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'f1ac64ac-e535-4bf9-adaf-dfca63368173'} Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f1ac64ac-e535-4bf9-adaf-dfca63368173 could not be found. Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:05.844162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f1ac64ac-e535-4bf9-adaf-dfca63368173 could not be found. Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f1ac64ac-e535-4bf9-adaf-dfca63368173 could not be found. Aug 25 12:51:05.848011 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.851928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e3c862d0-088e-482d-a1a6-4db6b0bc0dea tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Returning 404 to user: Instance group f1ac64ac-e535-4bf9-adaf-dfca63368173 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:05.851928 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e3c862d0-088e-482d-a1a6-4db6b0bc0dea tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/f1ac64ac-e535-4bf9-adaf-dfca63368173" status: 404 len: 117 microversion: 2.1 time: 0.051113 Aug 25 12:51:05.851928 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 871/1747] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 12:51:05 2022] DELETE /compute/v2.1/os-server-groups/f1ac64ac-e535-4bf9-adaf-dfca63368173 => generated 117 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:06.582760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-457796958", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "d92653b3-acd5-4a7c-9b85-c26c0b939826"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:06.822927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] validate_networks() for [('d92653b3-acd5-4a7c-9b85-c26c0b939826', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:51:08.547514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:51:08.548521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:51:08.549076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:51:08.549876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:51:08.550705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:51:08.566620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:08.567975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:08.568704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:08.570128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:08.570989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:08.571807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:08.600018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Getting quotas for project d43be46fe4e84396b73fbdca834b3525. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:08.610492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Getting quotas for user 74d9b7c3351f44b9b986e6535fc62819 and project d43be46fe4e84396b73fbdca834b3525. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:08.635651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:51:08.640961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:51:09.481375 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-58f57c54-cc5a-459a-88b9-bae7831759dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.631065 Aug 25 12:51:09.485022 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 872/1748] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:51:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:51:09.503230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-386e6075-a35f-45b5-b1ca-e3fddf81b699 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:09.590194 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-386e6075-a35f-45b5-b1ca-e3fddf81b699 tempest-ServerGroupTestJSON-1286558550 tempest-ServerGroupTestJSON-1286558550-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/25439800-1adf-44ec-a52d-94e6c6b1d516" status: 204 len: 0 microversion: 2.1 time: 0.101787 Aug 25 12:51:09.591145 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 873/1749] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 12:51:09 2022] DELETE /compute/v2.1/os-server-groups/25439800-1adf-44ec-a52d-94e6c6b1d516 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:51:09.605345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cfb4d32f-1098-4c8e-8009-406ab3fcb23a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:09.606780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cfb4d32f-1098-4c8e-8009-406ab3fcb23a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:09.638930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfb4d32f-1098-4c8e-8009-406ab3fcb23a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:09.642479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfb4d32f-1098-4c8e-8009-406ab3fcb23a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:09.644609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfb4d32f-1098-4c8e-8009-406ab3fcb23a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:09.648246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfb4d32f-1098-4c8e-8009-406ab3fcb23a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:09.652254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfb4d32f-1098-4c8e-8009-406ab3fcb23a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:09.653441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfb4d32f-1098-4c8e-8009-406ab3fcb23a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:10.853687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cfb4d32f-1098-4c8e-8009-406ab3fcb23a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884fb1087aae4f87b047879b060d1e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ceae811fb184dba9e2231232124bcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:10.945710 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cfb4d32f-1098-4c8e-8009-406ab3fcb23a tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55" status: 200 len: 1431 microversion: 2.1 time: 1.350556 Aug 25 12:51:10.952330 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 874/1750] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:09 2022] GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55 => generated 1431 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:10.973355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aa21e42d-a9ca-43be-9f97-ebde7127de4e tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:10.987700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aa21e42d-a9ca-43be-9f97-ebde7127de4e tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:11.024550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa21e42d-a9ca-43be-9f97-ebde7127de4e tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:11.030009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa21e42d-a9ca-43be-9f97-ebde7127de4e tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:11.032575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa21e42d-a9ca-43be-9f97-ebde7127de4e tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:11.035306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa21e42d-a9ca-43be-9f97-ebde7127de4e tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:11.039353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa21e42d-a9ca-43be-9f97-ebde7127de4e tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:11.043609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa21e42d-a9ca-43be-9f97-ebde7127de4e tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:11.782086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aa21e42d-a9ca-43be-9f97-ebde7127de4e tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:11.824358 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aa21e42d-a9ca-43be-9f97-ebde7127de4e tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1612 microversion: 2.1 time: 0.867986 Aug 25 12:51:11.832228 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 875/1751] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:10 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1612 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:11.866516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-40cce9bd-0b4e-4d18-89e4-88b367b285b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:11.870143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-40cce9bd-0b4e-4d18-89e4-88b367b285b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:11.895176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cce9bd-0b4e-4d18-89e4-88b367b285b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:11.895703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cce9bd-0b4e-4d18-89e4-88b367b285b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:11.896398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cce9bd-0b4e-4d18-89e4-88b367b285b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:11.897766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cce9bd-0b4e-4d18-89e4-88b367b285b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:11.904452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cce9bd-0b4e-4d18-89e4-88b367b285b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:11.907058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cce9bd-0b4e-4d18-89e4-88b367b285b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.427188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-40cce9bd-0b4e-4d18-89e4-88b367b285b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:12.469424 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-40cce9bd-0b4e-4d18-89e4-88b367b285b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1228 microversion: 2.1 time: 0.631506 Aug 25 12:51:12.491087 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 876/1752] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:11 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1228 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:12.500897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a1fafc27-c498-492f-b83d-890926b2bb2e req-399e69d2-dd42-484c-9de2-5a4654998d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01013692-8e62-49a8-81b9-7f7cdd4a5a55", "name": "network-vif-deleted", "tag": "73f30782-4779-447f-ba20-d60dfbdf553d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:12.566886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a1fafc27-c498-492f-b83d-890926b2bb2e req-399e69d2-dd42-484c-9de2-5a4654998d4d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:12.571327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a1fafc27-c498-492f-b83d-890926b2bb2e req-399e69d2-dd42-484c-9de2-5a4654998d4d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:12.575078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a1fafc27-c498-492f-b83d-890926b2bb2e req-399e69d2-dd42-484c-9de2-5a4654998d4d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.642693 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a1fafc27-c498-492f-b83d-890926b2bb2e req-399e69d2-dd42-484c-9de2-5a4654998d4d service nova] Creating event network-vif-deleted:73f30782-4779-447f-ba20-d60dfbdf553d for instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 on n-h2-852771-8 Aug 25 12:51:12.664691 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a1fafc27-c498-492f-b83d-890926b2bb2e req-399e69d2-dd42-484c-9de2-5a4654998d4d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180120 Aug 25 12:51:12.674115 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 877/1753] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:12.726886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:12.729281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] [instance: 01013692-8e62-49a8-81b9-7f7cdd4a5a55] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:12.772475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:12.773993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:12.775048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.776648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:12.778663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:12.781030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.851511 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] HTTP exception thrown: Instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 could not be found. Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Request method failure captured: Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55 HTTP/1.1 Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB28mH38mts7LRYFBEDtglzfRurMgXBGSa43YNIwIXXEkvnGvGT4jySU9H5NsSuE78xKUO_y6Q1puZkEtn8tLXqdsUYmVs9Hz7f2Rp4dP9Fy3ADXN0UrE9JrDzsc8JekG0ydf-DMoMzuXr80gWXD_r8Dz0gzaD_aVzagntE4yS13b2rg Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 8ceae811fb184dba9e2231232124bcd1 Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ListImageFiltersTestJSON-1985456801 Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:51:12.861776 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ceae811fb184dba9e2231232124bcd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8ceae811fb184dba9e2231232124bcd1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8ceae811fb184dba9e2231232124bcd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ceae811fb184dba9e2231232124bcd1"}]}] Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ListImageFiltersTestJSON-1985456801 Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 8ceae811fb184dba9e2231232124bcd1 Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1985456801 Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ListImageFiltersTestJSON-1985456801-project Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 884fb1087aae4f87b047879b060d1e21 Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ListImageFiltersTestJSON-1985456801-project Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 could not be found. Aug 25 12:51:12.865193 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '01013692-8e62-49a8-81b9-7f7cdd4a5a55'} Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 could not be found. Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:12.867940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 could not be found. Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 could not be found. Aug 25 12:51:12.871057 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:12.878183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Returning 404 to user: Instance 01013692-8e62-49a8-81b9-7f7cdd4a5a55 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:12.878183 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a7e913f3-1435-44e9-bba1-46bc46196ae0 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55" status: 404 len: 111 microversion: 2.1 time: 0.199729 Aug 25 12:51:12.880206 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 878/1754] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:12 2022] GET /compute/v2.1/servers/01013692-8e62-49a8-81b9-7f7cdd4a5a55 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:13.701396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f572f64-3e80-4135-837d-dc548c08c756 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Action: 'create', calling method: .version_select at 0x7f3a2e95c160>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7hCO4Ri/NrQMRfK1jdaXzvGv7srBIkq+uuw5uGC0w0VWiAMMfP95myWgvqjoPa4TQIYInRVs0awoBMDRuyB0M857ReCJJVOIfhO/Xhe6bM3eu//aKRJMoeldy69CFNtg=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f572f64-3e80-4135-837d-dc548c08c756 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Request method failure captured: Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 257 Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3BA-AGOjm2OnrYQ2O2RC-3dFSfy_3a7LqUjAZrL-yHycXIt3cBKnYHHes4zDr9ZYqNzJ3-GXOMF4clWtKFwmbLZt2uE2ChW0NuYBI2KmjAiJwprVtWPLeB3UotxTdpoGN73lWZ7IKLs8_5apGn7j6orJPfW3PSgiHZikctWRT07nTA Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:51:13.727595 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c6ae46067d134b98adade5eb67b72cbf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}] Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bfc1518aca46495a8869b894bb238574 Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:51:13.731022 n-d-852771-8 devstack@n-api.service[129059]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7hCO4Ri/NrQMRfK1jdaXzvGv7srBIkq+uuw5uGC0w0VWiAMMfP95myWgvqjoPa4TQIYInRVs0awoBMDRuyB0M857ReCJJVOIfhO/Xhe6bM3eu//aKRJMoeldy69CFNtg=="}} Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7hCO4Ri/NrQMRfK1jdaXzvGv7srBIkq+uuw5uGC0w0VWiAMMfP95myWgvqjoPa4TQIYInRVs0awoBMDRuyB0M857ReCJJVOIfhO/Xhe6bM3eu//aKRJMoeldy69CFNtg=='}}} Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:13.732791 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:13.736644 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:51:13.744656 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:51:13.751415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 25 12:51:13.751415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.751415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f572f64-3e80-4135-837d-dc548c08c756 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:13.754747 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f572f64-3e80-4135-837d-dc548c08c756 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.871651 Aug 25 12:51:13.756759 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 879/1755] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:51:12 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 875 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:51:13.773492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52ee97e8-e2f6-4fab-9659-d6f36b34751b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:13.775492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52ee97e8-e2f6-4fab-9659-d6f36b34751b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:13.826029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ee97e8-e2f6-4fab-9659-d6f36b34751b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:13.827139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ee97e8-e2f6-4fab-9659-d6f36b34751b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:13.829031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ee97e8-e2f6-4fab-9659-d6f36b34751b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:13.831108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ee97e8-e2f6-4fab-9659-d6f36b34751b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:13.832358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ee97e8-e2f6-4fab-9659-d6f36b34751b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:13.836460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ee97e8-e2f6-4fab-9659-d6f36b34751b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:14.264718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52ee97e8-e2f6-4fab-9659-d6f36b34751b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624fc054f45b48579ba7c47af4185e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75680120684ccaae1b8c82e42b7c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:14.321625 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52ee97e8-e2f6-4fab-9659-d6f36b34751b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 200 len: 1612 microversion: 2.1 time: 0.561018 Aug 25 12:51:14.339071 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 880/1756] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:13 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 1612 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:14.370570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-be8600e0-7a8d-4780-ba3b-b096eee6a824 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a093a60>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:15.491443 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-142c5635-1c54-4b4d-acd5-3043fb1bfba2 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1/action" status: 202 len: 0 microversion: 2.25 time: 10.240243 Aug 25 12:51:15.495508 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 877/1757] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 12:51:05 2022] POST /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1/action => generated 0 bytes in 10247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:51:15.531248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5f03443f-8153-4c8a-b63e-b40e66422c01 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:15.536295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5f03443f-8153-4c8a-b63e-b40e66422c01 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:15.608143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f03443f-8153-4c8a-b63e-b40e66422c01 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:15.618648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f03443f-8153-4c8a-b63e-b40e66422c01 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:15.620363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f03443f-8153-4c8a-b63e-b40e66422c01 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:15.627897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f03443f-8153-4c8a-b63e-b40e66422c01 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:15.632234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f03443f-8153-4c8a-b63e-b40e66422c01 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:15.636108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f03443f-8153-4c8a-b63e-b40e66422c01 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:16.174022 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-be8600e0-7a8d-4780-ba3b-b096eee6a824 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "DELETE /compute/v2.1/images/5a990369-4bda-4504-8ae6-231cb061ae7f" status: 204 len: 0 microversion: 2.1 time: 1.833184 Aug 25 12:51:16.175581 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 881/1758] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:14 2022] DELETE /compute/v2.1/images/5a990369-4bda-4504-8ae6-231cb061ae7f => generated 0 bytes in 1836 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:51:16.196147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-882c0535-b12d-47eb-b22e-20a72924744e tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Action: 'create', calling method: .version_select at 0x7f3a29fc99d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-286275188", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:16.269689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-882c0535-b12d-47eb-b22e-20a72924744e tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Getting quotas for project c6ae46067d134b98adade5eb67b72cbf. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:16.280593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-882c0535-b12d-47eb-b22e-20a72924744e tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Getting quotas for user bfc1518aca46495a8869b894bb238574 and project c6ae46067d134b98adade5eb67b72cbf. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:16.335506 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-882c0535-b12d-47eb-b22e-20a72924744e tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-882c0535-b12d-47eb-b22e-20a72924744e tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Request method failure captured: Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 2166 Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3BA-AGOjm2OnrYQ2O2RC-3dFSfy_3a7LqUjAZrL-yHycXIt3cBKnYHHes4zDr9ZYqNzJ3-GXOMF4clWtKFwmbLZt2uE2ChW0NuYBI2KmjAiJwprVtWPLeB3UotxTdpoGN73lWZ7IKLs8_5apGn7j6orJPfW3PSgiHZikctWRT07nTA Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c6ae46067d134b98adade5eb67b72cbf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}] Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bfc1518aca46495a8869b894bb238574 Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-286275188", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:51:16.390201 n-d-852771-8 devstack@n-api.service[129059]: exception: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-286275188', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:16.395167 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-882c0535-b12d-47eb-b22e-20a72924744e tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-882c0535-b12d-47eb-b22e-20a72924744e tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.215700 Aug 25 12:51:16.412937 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 882/1759] 10.222.0.70 () {60 vars in 1160 bytes} [Thu Aug 25 12:51:16 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 219 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:51:16.429064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2de1a0f7-7eb2-4839-ba92-f851e5032993 req-4c1f6929-2fac-4cfa-b992-b6c87da03bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8502f6-2eab-49d4-a303-7b9d9304c303", "name": "network-vif-deleted", "tag": "23419627-d97d-478d-b65c-05fe9cf12679"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:16.429382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5f03443f-8153-4c8a-b63e-b40e66422c01 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:16.460355 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5f03443f-8153-4c8a-b63e-b40e66422c01 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1282 microversion: 2.1 time: 0.962606 Aug 25 12:51:16.463378 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 878/1760] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:15 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1282 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:16.473160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:16.473601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2de1a0f7-7eb2-4839-ba92-f851e5032993 req-4c1f6929-2fac-4cfa-b992-b6c87da03bda service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:16.475670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] [instance: 4f8502f6-2eab-49d4-a303-7b9d9304c303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:16.479807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2de1a0f7-7eb2-4839-ba92-f851e5032993 req-4c1f6929-2fac-4cfa-b992-b6c87da03bda service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:16.480216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2de1a0f7-7eb2-4839-ba92-f851e5032993 req-4c1f6929-2fac-4cfa-b992-b6c87da03bda service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:16.516818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:16.519298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:16.523777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:16.524083 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2de1a0f7-7eb2-4839-ba92-f851e5032993 req-4c1f6929-2fac-4cfa-b992-b6c87da03bda service nova] Creating event network-vif-deleted:23419627-d97d-478d-b65c-05fe9cf12679 for instance 4f8502f6-2eab-49d4-a303-7b9d9304c303 on n-h1-852771-8 Aug 25 12:51:16.526115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:16.534637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:16.536062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:16.538417 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2de1a0f7-7eb2-4839-ba92-f851e5032993 req-4c1f6929-2fac-4cfa-b992-b6c87da03bda service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124845 Aug 25 12:51:16.544871 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 883/1761] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:16.586063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:16.591155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:16.597939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] HTTP exception thrown: Instance 4f8502f6-2eab-49d4-a303-7b9d9304c303 could not be found. Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Request method failure captured: Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 HTTP/1.1 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB27YTYRFYqhnadeeC7zCa4VJWFBhcWo6WQ3Fpql_-Ox0uQyW7m43g_lp0DCg4J4p-lwhk1KWpjqh63aluUIb8j44IlGrg70RaoC__ZIFRt4FyJFuv0CAR60kwh_3tD1yzCPby3LYvLZ5S1P91ac6Wqd07OeOh3FcOqR6APoPQj-7lR0 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: ea75680120684ccaae1b8c82e42b7c38 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesAdminNegativeTest-801590104 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ea75680120684ccaae1b8c82e42b7c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ea75680120684ccaae1b8c82e42b7c38", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ea75680120684ccaae1b8c82e42b7c38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ea75680120684ccaae1b8c82e42b7c38"}]}] Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesAdminNegativeTest-801590104 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: ea75680120684ccaae1b8c82e42b7c38 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-801590104 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesAdminNegativeTest-801590104-project Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 624fc054f45b48579ba7c47af4185e91 Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesAdminNegativeTest-801590104-project Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 4f8502f6-2eab-49d4-a303-7b9d9304c303 could not be found. Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '4f8502f6-2eab-49d4-a303-7b9d9304c303'} Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8502f6-2eab-49d4-a303-7b9d9304c303 could not be found. Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8502f6-2eab-49d4-a303-7b9d9304c303 could not be found. Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:16.606169 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.622803 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:16.622803 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:16.622803 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:16.622803 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:16.622803 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:16.622803 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8502f6-2eab-49d4-a303-7b9d9304c303 could not be found. Aug 25 12:51:16.622803 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:16.622803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Returning 404 to user: Instance 4f8502f6-2eab-49d4-a303-7b9d9304c303 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:16.626740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:16.627677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:16.628173 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e4b6020a-9ea2-4449-9ff5-2ea8accd680b tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303" status: 404 len: 111 microversion: 2.1 time: 0.161919 Aug 25 12:51:16.628522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:16.630560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 879/1762] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:16 2022] GET /compute/v2.1/servers/4f8502f6-2eab-49d4-a303-7b9d9304c303 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:16.641364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1ec84810-54a2-4ab4-82fb-8a70080a7832 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2e879670>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:16.651134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:16.652118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:16.653196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:17.303099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:17.332430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:17.358560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:17.362855 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-03403082-1500-455a-b799-c1ecb6879500 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 0.815552 Aug 25 12:51:17.364120 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 884/1763] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:16 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:17.383258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d690aca6-bd28-446e-84ef-d6d012990fc8 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Action: 'create', calling method: .version_select at 0x7f3a2e980ca0>, body: {"keypair": {"name": "tempest-keypair-1734508760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaaETVg8nIXLsH0JYXkMRtbEo3KVHYzN1BHKUywsSZJNc0iUtzr4RYgVaVKJeNNXljD/RSP3iFDpTK922oLBKK8Bk84U/GUOEF5x2oZOuHspqvVRar6tIz4l9e9oYq6jg=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:17.476903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d690aca6-bd28-446e-84ef-d6d012990fc8 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Getting quotas for project c6ae46067d134b98adade5eb67b72cbf. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:17.498633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d690aca6-bd28-446e-84ef-d6d012990fc8 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Getting quotas for user bfc1518aca46495a8869b894bb238574 and project c6ae46067d134b98adade5eb67b72cbf. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:17.537307 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1ec84810-54a2-4ab4-82fb-8a70080a7832 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "DELETE /compute/v2.1/images/086c6619-469c-44a9-b986-a901be27a772" status: 204 len: 0 microversion: 2.1 time: 0.904302 Aug 25 12:51:17.540077 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 880/1764] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:16 2022] DELETE /compute/v2.1/images/086c6619-469c-44a9-b986-a901be27a772 => generated 0 bytes in 908 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:51:17.571824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8b8f3de2-1d25-4262-bec7-bcc64f5c6da7 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] Calling method '.version_select at 0x7f3a2a1b6e50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:17.671513 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d690aca6-bd28-446e-84ef-d6d012990fc8 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.303787 Aug 25 12:51:17.676803 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 885/1765] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:51:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:17.716388 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8b8f3de2-1d25-4262-bec7-bcc64f5c6da7 tempest-VolumesAdminNegativeTest-801590104 tempest-VolumesAdminNegativeTest-801590104-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705601256" status: 202 len: 0 microversion: 2.1 time: 0.168567 Aug 25 12:51:17.718156 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 881/1766] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 12:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705601256 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:51:17.725303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1299fcac-91f6-436d-8024-64efdc7db054 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:17.736985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1299fcac-91f6-436d-8024-64efdc7db054 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:17.756880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f36df35-a9dc-4059-82dd-b1223cdba671 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] Calling method '.version_select at 0x7f3a2a1b60d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:17.768636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1299fcac-91f6-436d-8024-64efdc7db054 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:17.769654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1299fcac-91f6-436d-8024-64efdc7db054 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:17.770519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1299fcac-91f6-436d-8024-64efdc7db054 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:17.783497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1299fcac-91f6-436d-8024-64efdc7db054 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:17.788785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1299fcac-91f6-436d-8024-64efdc7db054 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:17.798514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1299fcac-91f6-436d-8024-64efdc7db054 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:17.951132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:18.206149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1299fcac-91f6-436d-8024-64efdc7db054 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:18.236852 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1299fcac-91f6-436d-8024-64efdc7db054 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1282 microversion: 2.1 time: 0.547052 Aug 25 12:51:18.250247 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 886/1767] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:17 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1282 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:18.259072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5fedf9d2-abee-4e3e-a8a1-aac44037b596 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Action: 'create', calling method: .version_select at 0x7f3a29f6e160>, body: {"keypair": {"name": "tempest-keypair-1734508760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBVZktqnpTcKDIJxi0PakLT6/LEmlDlVF1rBD3EC/fuE0X+Hf2wHVV1xiKL9zRgbRTyA3OrZ1ACPpwqvpfh4jgrrUCDVIbM4eqpu6YMUX24i2DEk4GVAdXaINmC2TpVog=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:18.344233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-5fedf9d2-abee-4e3e-a8a1-aac44037b596 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Getting quotas for project c6ae46067d134b98adade5eb67b72cbf. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:18.360864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-5fedf9d2-abee-4e3e-a8a1-aac44037b596 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Getting quotas for user bfc1518aca46495a8869b894bb238574 and project c6ae46067d134b98adade5eb67b72cbf. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:18.446153 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-5fedf9d2-abee-4e3e-a8a1-aac44037b596 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] HTTP exception thrown: Key pair 'tempest-keypair-1734508760' already exists. Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5fedf9d2-abee-4e3e-a8a1-aac44037b596 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Request method failure captured: Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 273 Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3BA-AGOjm2OnrYQ2O2RC-3dFSfy_3a7LqUjAZrL-yHycXIt3cBKnYHHes4zDr9ZYqNzJ3-GXOMF4clWtKFwmbLZt2uE2ChW0NuYBI2KmjAiJwprVtWPLeB3UotxTdpoGN73lWZ7IKLs8_5apGn7j6orJPfW3PSgiHZikctWRT07nTA Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c6ae46067d134b98adade5eb67b72cbf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}] Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bfc1518aca46495a8869b894bb238574 Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: {"keypair": {"name": "tempest-keypair-1734508760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBVZktqnpTcKDIJxi0PakLT6/LEmlDlVF1rBD3EC/fuE0X+Hf2wHVV1xiKL9zRgbRTyA3OrZ1ACPpwqvpfh4jgrrUCDVIbM4eqpu6YMUX24i2DEk4GVAdXaINmC2TpVog=="}} Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: exception: Key pair 'tempest-keypair-1734508760' already exists. Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1734508760', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBVZktqnpTcKDIJxi0PakLT6/LEmlDlVF1rBD3EC/fuE0X+Hf2wHVV1xiKL9zRgbRTyA3OrZ1ACPpwqvpfh4jgrrUCDVIbM4eqpu6YMUX24i2DEk4GVAdXaINmC2TpVog=='}}} Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'bfc1518aca46495a8869b894bb238574-tempest-keypair-1734508760' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 25 12:51:18.469602 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi session.flush() Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:51:18.478362 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'bfc1518aca46495a8869b894bb238574-tempest-keypair-1734508760' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 25, 12, 51, 18, 421992), 'updated_at': None, 'name': 'tempest-keypair-1734508760', 'user_id': 'bfc1518aca46495a8869b894bb238574', 'fingerprint': '92:a7:19:bb:c1:63:64:f3:70:7a:55:6e:66:09:b1:c7', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBVZktqnpTcKDIJxi0PakLT6/LEmlDlVF1rBD3EC/fuE0X+Hf2wHVV1xiKL9zRgbRTyA3OrZ1ACPpwqvpfh4jgrrUCDVIbM4eqpu6YMUX24i2DEk4GVAdXaINmC2TpVog==', 'type': 'ssh'}] Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi keypair.create() Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._create() Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1734508760' already exists. Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 25 12:51:18.492012 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1734508760' already exists. Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1734508760' already exists. Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5fedf9d2-abee-4e3e-a8a1-aac44037b596 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Returning 409 to user: Key pair 'tempest-keypair-1734508760' already exists. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:18.506115 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5fedf9d2-abee-4e3e-a8a1-aac44037b596 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.243854 Aug 25 12:51:18.509677 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 887/1768] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:51:18 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 259 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:51:18.524267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:18.526210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:18.540838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:18.542318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:18.544505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:18.547223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:18.548767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:18.551443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:18.594555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:18.652208 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f36df35-a9dc-4059-82dd-b1223cdba671 tempest-ListImageFiltersTestJSON-1985456801 tempest-ListImageFiltersTestJSON-1985456801-project] 10.222.0.70 "DELETE /compute/v2.1/images/b8b3aa55-797f-4a9c-9ed1-61942f435a3b" status: 204 len: 0 microversion: 2.1 time: 0.930338 Aug 25 12:51:18.654920 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 882/1769] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:17 2022] DELETE /compute/v2.1/images/b8b3aa55-797f-4a9c-9ed1-61942f435a3b => generated 0 bytes in 936 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:51:18.670981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70c4745c-0046-469c-a183-2859c418805a tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Calling method '.version_select at 0x7f3a2e7db700>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:18.743632 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70c4745c-0046-469c-a183-2859c418805a tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734508760" status: 202 len: 0 microversion: 2.1 time: 0.086127 Aug 25 12:51:18.745597 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 883/1770] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 12:51:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734508760 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:51:18.767339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-947756b7-663f-462f-a65c-c5ff837364bb tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Action: 'create', calling method: .version_select at 0x7f3a2e806af0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeC1xIzNu0JJAS1EE/MKLuGAQ4vSjg8DhQX0ERKZuUV3U87fYWxNh3KI5XLs0+hH8SjQbUwWOE5qosBAPFSVLHZNsat91diwlnrxeL4nUVwlP8kGjAzTOhoe5Bn/RC9EA=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-947756b7-663f-462f-a65c-c5ff837364bb tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Request method failure captured: Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 247 Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3BA-AGOjm2OnrYQ2O2RC-3dFSfy_3a7LqUjAZrL-yHycXIt3cBKnYHHes4zDr9ZYqNzJ3-GXOMF4clWtKFwmbLZt2uE2ChW0NuYBI2KmjAiJwprVtWPLeB3UotxTdpoGN73lWZ7IKLs8_5apGn7j6orJPfW3PSgiHZikctWRT07nTA Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c6ae46067d134b98adade5eb67b72cbf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}] Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bfc1518aca46495a8869b894bb238574 Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeC1xIzNu0JJAS1EE/MKLuGAQ4vSjg8DhQX0ERKZuUV3U87fYWxNh3KI5XLs0+hH8SjQbUwWOE5qosBAPFSVLHZNsat91diwlnrxeL4nUVwlP8kGjAzTOhoe5Bn/RC9EA=="}} Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeC1xIzNu0JJAS1EE/MKLuGAQ4vSjg8DhQX0ERKZuUV3U87fYWxNh3KI5XLs0+hH8SjQbUwWOE5qosBAPFSVLHZNsat91diwlnrxeL4nUVwlP8kGjAzTOhoe5Bn/RC9EA=='}}} Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi '' Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:51:18.777378 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-947756b7-663f-462f-a65c-c5ff837364bb tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:18.792544 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-947756b7-663f-462f-a65c-c5ff837364bb tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.020910 Aug 25 12:51:18.795352 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 884/1771] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:51:18 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:51:18.826968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c62052c8-218f-436b-b6da-d9be05567251 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Action: 'create', calling method: .version_select at 0x7f3a2e8014c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1313194739", "public_key": " "}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:18.881372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c62052c8-218f-436b-b6da-d9be05567251 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Getting quotas for project c6ae46067d134b98adade5eb67b72cbf. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:18.906985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c62052c8-218f-436b-b6da-d9be05567251 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Getting quotas for user bfc1518aca46495a8869b894bb238574 and project c6ae46067d134b98adade5eb67b72cbf. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:18.993358 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c62052c8-218f-436b-b6da-d9be05567251 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c62052c8-218f-436b-b6da-d9be05567251 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Request method failure captured: Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 95 Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3BA-AGOjm2OnrYQ2O2RC-3dFSfy_3a7LqUjAZrL-yHycXIt3cBKnYHHes4zDr9ZYqNzJ3-GXOMF4clWtKFwmbLZt2uE2ChW0NuYBI2KmjAiJwprVtWPLeB3UotxTdpoGN73lWZ7IKLs8_5apGn7j6orJPfW3PSgiHZikctWRT07nTA Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c6ae46067d134b98adade5eb67b72cbf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}] Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bfc1518aca46495a8869b894bb238574 Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1313194739", "public_key": " "}} Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: exception: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1313194739', 'public_key': ' '}}} Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.005541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c62052c8-218f-436b-b6da-d9be05567251 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c62052c8-218f-436b-b6da-d9be05567251 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.221980 Aug 25 12:51:19.044764 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 885/1772] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Aug 25 12:51:18 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 226 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:51:19.068218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-049b3050-9607-456d-b038-fc4a92680104 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Action: 'create', calling method: .version_select at 0x7f3a2e806dc0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7glwj3/wNdkilq2ItwDik8IUtVnqnakep9GVPXcpswuWQjCxBoja0p1EsY5uHsP8KS75CqvmhKuwLvfbMxo45tGa3ybbTpX8s9xv7/bktKoGl6nkEArumaNLdYs5FS4Q=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-049b3050-9607-456d-b038-fc4a92680104 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Request method failure captured: Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 507 Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3BA-AGOjm2OnrYQ2O2RC-3dFSfy_3a7LqUjAZrL-yHycXIt3cBKnYHHes4zDr9ZYqNzJ3-GXOMF4clWtKFwmbLZt2uE2ChW0NuYBI2KmjAiJwprVtWPLeB3UotxTdpoGN73lWZ7IKLs8_5apGn7j6orJPfW3PSgiHZikctWRT07nTA Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c6ae46067d134b98adade5eb67b72cbf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}] Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bfc1518aca46495a8869b894bb238574 Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7glwj3/wNdkilq2ItwDik8IUtVnqnakep9GVPXcpswuWQjCxBoja0p1EsY5uHsP8KS75CqvmhKuwLvfbMxo45tGa3ybbTpX8s9xv7/bktKoGl6nkEArumaNLdYs5FS4Q=="}} Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7glwj3/wNdkilq2ItwDik8IUtVnqnakep9GVPXcpswuWQjCxBoja0p1EsY5uHsP8KS75CqvmhKuwLvfbMxo45tGa3ybbTpX8s9xv7/bktKoGl6nkEArumaNLdYs5FS4Q=='}}} Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 25 12:51:19.084467 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 25 12:51:19.096390 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.106039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-049b3050-9607-456d-b038-fc4a92680104 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:19.115469 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-049b3050-9607-456d-b038-fc4a92680104 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.058496 Aug 25 12:51:19.126856 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 886/1773] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:51:19 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 12:51:19.135576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08210fc1-5fec-458c-9d28-61fb8e0b0388 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Action: 'create', calling method: .version_select at 0x7f3a2e7ebdc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-897602994", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:19.176241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-08210fc1-5fec-458c-9d28-61fb8e0b0388 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Getting quotas for project c6ae46067d134b98adade5eb67b72cbf. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:19.190064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-08210fc1-5fec-458c-9d28-61fb8e0b0388 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Getting quotas for user bfc1518aca46495a8869b894bb238574 and project c6ae46067d134b98adade5eb67b72cbf. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:19.243877 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-08210fc1-5fec-458c-9d28-61fb8e0b0388 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08210fc1-5fec-458c-9d28-61fb8e0b0388 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Request method failure captured: Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 117 Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3BA-AGOjm2OnrYQ2O2RC-3dFSfy_3a7LqUjAZrL-yHycXIt3cBKnYHHes4zDr9ZYqNzJ3-GXOMF4clWtKFwmbLZt2uE2ChW0NuYBI2KmjAiJwprVtWPLeB3UotxTdpoGN73lWZ7IKLs8_5apGn7j6orJPfW3PSgiHZikctWRT07nTA Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c6ae46067d134b98adade5eb67b72cbf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}] Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bfc1518aca46495a8869b894bb238574 Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-897602994", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: exception: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-897602994', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 25 12:51:19.258043 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08210fc1-5fec-458c-9d28-61fb8e0b0388 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-08210fc1-5fec-458c-9d28-61fb8e0b0388 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.132042 Aug 25 12:51:19.270435 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 887/1774] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:51:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:51:19.317017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-729b0b2c-0004-4bff-9813-e941fff50fc1 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Calling method '.version_select at 0x7f3a2e8079d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:19.361738 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-729b0b2c-0004-4bff-9813-e941fff50fc1 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-958298864 not found for user bfc1518aca46495a8869b894bb238574 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-729b0b2c-0004-4bff-9813-e941fff50fc1 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Request method failure captured: Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-958298864 HTTP/1.1 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3BA-AGOjm2OnrYQ2O2RC-3dFSfy_3a7LqUjAZrL-yHycXIt3cBKnYHHes4zDr9ZYqNzJ3-GXOMF4clWtKFwmbLZt2uE2ChW0NuYBI2KmjAiJwprVtWPLeB3UotxTdpoGN73lWZ7IKLs8_5apGn7j6orJPfW3PSgiHZikctWRT07nTA Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c6ae46067d134b98adade5eb67b72cbf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c6ae46067d134b98adade5eb67b72cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6ae46067d134b98adade5eb67b72cbf"}]}] Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c6ae46067d134b98adade5eb67b72cbf Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-984101255 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bfc1518aca46495a8869b894bb238574 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-KeyPairsNegativeTestJSON-984101255-project Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: exception: Keypair tempest-keypair-non-existent-958298864 not found for user bfc1518aca46495a8869b894bb238574 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'tempest-keypair-non-existent-958298864'} Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-958298864 not found for user bfc1518aca46495a8869b894bb238574 Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.372178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-958298864 not found for user bfc1518aca46495a8869b894bb238574 Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-958298864 not found for user bfc1518aca46495a8869b894bb238574 Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-729b0b2c-0004-4bff-9813-e941fff50fc1 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] Returning 404 to user: Keypair tempest-keypair-non-existent-958298864 not found for user bfc1518aca46495a8869b894bb238574 {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-729b0b2c-0004-4bff-9813-e941fff50fc1 tempest-KeyPairsNegativeTestJSON-984101255 tempest-KeyPairsNegativeTestJSON-984101255-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-958298864" status: 404 len: 144 microversion: 2.1 time: 0.098774 Aug 25 12:51:19.381412 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 888/1775] 10.222.0.70 () {58 vars in 1257 bytes} [Thu Aug 25 12:51:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-958298864 => generated 144 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:19.413210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-adbd2d0b-dc19-495e-b3ee-e51a177d46b4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:19.414864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-adbd2d0b-dc19-495e-b3ee-e51a177d46b4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:19.451266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adbd2d0b-dc19-495e-b3ee-e51a177d46b4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:19.456850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adbd2d0b-dc19-495e-b3ee-e51a177d46b4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:19.458355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adbd2d0b-dc19-495e-b3ee-e51a177d46b4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:19.465087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adbd2d0b-dc19-495e-b3ee-e51a177d46b4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:19.466615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adbd2d0b-dc19-495e-b3ee-e51a177d46b4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:19.469383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adbd2d0b-dc19-495e-b3ee-e51a177d46b4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:19.476376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:19.508367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:19.518164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:19.521273 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-169fbb1e-0c62-4ead-bcf9-6549a80171df tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 1.008670 Aug 25 12:51:19.530441 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 888/1776] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:18 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:20.548509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-adbd2d0b-dc19-495e-b3ee-e51a177d46b4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:20.577711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:20.581710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:20.609651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:20.611972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:20.613815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:20.618879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:20.621176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:20.622855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:20.623923 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-adbd2d0b-dc19-495e-b3ee-e51a177d46b4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1282 microversion: 2.1 time: 1.228302 Aug 25 12:51:20.670497 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 889/1777] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:19 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1282 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:21.704918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ef71fab8-6d50-4996-ade8-aff8ecdf5db4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:21.706154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ef71fab8-6d50-4996-ade8-aff8ecdf5db4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:21.747095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef71fab8-6d50-4996-ade8-aff8ecdf5db4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:21.753119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef71fab8-6d50-4996-ade8-aff8ecdf5db4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:21.753799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef71fab8-6d50-4996-ade8-aff8ecdf5db4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:21.755449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef71fab8-6d50-4996-ade8-aff8ecdf5db4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:21.756060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef71fab8-6d50-4996-ade8-aff8ecdf5db4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:21.764138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef71fab8-6d50-4996-ade8-aff8ecdf5db4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:21.775829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:22.482997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:22.538951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:22.542682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:22.551500 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52ce7e39-6e9e-4102-a5c4-f63f465f52cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 1.985651 Aug 25 12:51:22.553293 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 889/1778] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:20 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:51:22.687676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ef71fab8-6d50-4996-ade8-aff8ecdf5db4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:22.736615 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ef71fab8-6d50-4996-ade8-aff8ecdf5db4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1324 microversion: 2.1 time: 1.041675 Aug 25 12:51:22.739568 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 890/1779] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:21 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1324 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:23.604644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:23.613935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:23.643856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:23.646350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:23.647597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:23.655081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:23.658742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:23.669230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:23.790362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-21c2704d-6826-4862-b36b-eff7a7e9aed4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:23.791669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-21c2704d-6826-4862-b36b-eff7a7e9aed4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:23.910720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21c2704d-6826-4862-b36b-eff7a7e9aed4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:23.911689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21c2704d-6826-4862-b36b-eff7a7e9aed4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:23.912477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21c2704d-6826-4862-b36b-eff7a7e9aed4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:23.914122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21c2704d-6826-4862-b36b-eff7a7e9aed4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:23.914846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21c2704d-6826-4862-b36b-eff7a7e9aed4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:23.915523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21c2704d-6826-4862-b36b-eff7a7e9aed4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:25.905123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:25.964449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:25.971257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:25.978558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-21c2704d-6826-4862-b36b-eff7a7e9aed4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:25.989474 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4d2818e5-8a27-429f-b1f4-9a816e5104c9 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 2.393443 Aug 25 12:51:26.028410 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 890/1780] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:23 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:26.038394 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-21c2704d-6826-4862-b36b-eff7a7e9aed4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1324 microversion: 2.1 time: 2.262745 Aug 25 12:51:26.039447 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 891/1781] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:23 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1324 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:26.837014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-71060119-361f-48d2-98af-df7a60c9c448 req-ece83f03-ffed-4022-afe8-80c6c4296de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ce5cde8-dd95-4c6f-b05f-802b0d47696a", "tag": "24d4479c-4502-454a-81e4-e76f3810bd64"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:26.902049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-71060119-361f-48d2-98af-df7a60c9c448 req-ece83f03-ffed-4022-afe8-80c6c4296de6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:26.906764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-71060119-361f-48d2-98af-df7a60c9c448 req-ece83f03-ffed-4022-afe8-80c6c4296de6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:26.911180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-71060119-361f-48d2-98af-df7a60c9c448 req-ece83f03-ffed-4022-afe8-80c6c4296de6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:27.006224 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-71060119-361f-48d2-98af-df7a60c9c448 req-ece83f03-ffed-4022-afe8-80c6c4296de6 service nova] Creating event network-changed:24d4479c-4502-454a-81e4-e76f3810bd64 for instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a on n-h1-852771-8 Aug 25 12:51:27.051085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:27.052184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:27.057737 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-71060119-361f-48d2-98af-df7a60c9c448 req-ece83f03-ffed-4022-afe8-80c6c4296de6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218645 Aug 25 12:51:27.066516 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 891/1782] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:51:27.086298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1fa0671e-2dfc-4c3c-9875-a130f21c6497 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:27.087618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1fa0671e-2dfc-4c3c-9875-a130f21c6497 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:27.089882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:27.091579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:27.098690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:27.101702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:27.103329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:27.108069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:27.140324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa0671e-2dfc-4c3c-9875-a130f21c6497 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:27.141267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa0671e-2dfc-4c3c-9875-a130f21c6497 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:27.142837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa0671e-2dfc-4c3c-9875-a130f21c6497 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:27.144563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa0671e-2dfc-4c3c-9875-a130f21c6497 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:27.145814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa0671e-2dfc-4c3c-9875-a130f21c6497 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:27.146949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa0671e-2dfc-4c3c-9875-a130f21c6497 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:28.402463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=18 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:28.417358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:28.466693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:28.474726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:28.483023 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8728e49c-309a-4993-8119-a6805282a63a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 1.443897 Aug 25 12:51:28.528291 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 892/1783] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:27 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:28.558176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1fa0671e-2dfc-4c3c-9875-a130f21c6497 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:28.622086 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1fa0671e-2dfc-4c3c-9875-a130f21c6497 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1324 microversion: 2.1 time: 1.548011 Aug 25 12:51:28.625880 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 892/1784] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:27 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1324 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:51:29.550456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:29.553198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:29.572713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:29.580602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:29.581441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:29.582313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:29.583657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:29.584509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:29.585298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:29.678610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4735c798-340b-42f2-b050-de0d9715211f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:29.682957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4735c798-340b-42f2-b050-de0d9715211f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:29.722168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4735c798-340b-42f2-b050-de0d9715211f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:29.725468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4735c798-340b-42f2-b050-de0d9715211f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:29.728381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4735c798-340b-42f2-b050-de0d9715211f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:29.742960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4735c798-340b-42f2-b050-de0d9715211f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:29.745126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4735c798-340b-42f2-b050-de0d9715211f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:29.746456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4735c798-340b-42f2-b050-de0d9715211f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:32.516065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4735c798-340b-42f2-b050-de0d9715211f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:32.521011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:32.579380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:32.589206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:32.590203 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4735c798-340b-42f2-b050-de0d9715211f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1324 microversion: 2.1 time: 2.915051 Aug 25 12:51:32.600713 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 893/1785] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:29 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1324 bytes in 2931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:51:32.603158 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b1bd59bb-aef2-482c-946d-ddf8deea413e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 3.069451 Aug 25 12:51:32.626614 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 893/1786] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:29 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 3084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:33.642738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e52e67e-5d75-4377-99e2-1ee70039da88 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:33.662030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:33.663419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:33.666842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5e52e67e-5d75-4377-99e2-1ee70039da88 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:33.710179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:33.715857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:33.716795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:33.718148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:33.719500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:33.720385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:33.721093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e52e67e-5d75-4377-99e2-1ee70039da88 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:33.721335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:33.723042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e52e67e-5d75-4377-99e2-1ee70039da88 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:33.724444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e52e67e-5d75-4377-99e2-1ee70039da88 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:33.726949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e52e67e-5d75-4377-99e2-1ee70039da88 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:33.728461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e52e67e-5d75-4377-99e2-1ee70039da88 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:33.730132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e52e67e-5d75-4377-99e2-1ee70039da88 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:36.528695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5e52e67e-5d75-4377-99e2-1ee70039da88 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:36.560083 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5e52e67e-5d75-4377-99e2-1ee70039da88 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1324 microversion: 2.1 time: 2.925531 Aug 25 12:51:36.562895 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 894/1787] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:33 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1324 bytes in 2930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:51:36.746252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:36.774303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:36.778198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:36.782144 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8e0b697f-907d-43e1-b781-e4bb67206d81 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 3.128544 Aug 25 12:51:36.799233 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 894/1788] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:33 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 3147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:37.612967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d66a784b-7d0a-4ac7-87c3-fa3a13c596e9 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:37.614231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d66a784b-7d0a-4ac7-87c3-fa3a13c596e9 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:37.621074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:37.635350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d66a784b-7d0a-4ac7-87c3-fa3a13c596e9 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:37.636843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d66a784b-7d0a-4ac7-87c3-fa3a13c596e9 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:37.638085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d66a784b-7d0a-4ac7-87c3-fa3a13c596e9 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:37.640527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d66a784b-7d0a-4ac7-87c3-fa3a13c596e9 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:37.674976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d66a784b-7d0a-4ac7-87c3-fa3a13c596e9 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:37.676309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d66a784b-7d0a-4ac7-87c3-fa3a13c596e9 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:37.834004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:37.841065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:37.877292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:37.880827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:37.881758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:37.883161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:37.909291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:37.911603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:39.371584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d66a784b-7d0a-4ac7-87c3-fa3a13c596e9 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:39.433853 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d66a784b-7d0a-4ac7-87c3-fa3a13c596e9 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1324 microversion: 2.1 time: 1.831738 Aug 25 12:51:39.451599 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 895/1789] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:37 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1324 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:39.606681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:39.648155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:39.659345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:39.663663 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cf9c0203-a144-4ded-a394-d13ef100b796 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 1.837754 Aug 25 12:51:39.665672 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 895/1790] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:37 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:40.382586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c401845d-9914-4dfd-8fe7-79f00f7860da req-0835d2e6-bab2-44a7-b0d3-8ccd477b179a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce5cde8-dd95-4c6f-b05f-802b0d47696a", "name": "network-vif-plugged", "status": "completed", "tag": "24d4479c-4502-454a-81e4-e76f3810bd64"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:40.437772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c401845d-9914-4dfd-8fe7-79f00f7860da req-0835d2e6-bab2-44a7-b0d3-8ccd477b179a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:40.446723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c401845d-9914-4dfd-8fe7-79f00f7860da req-0835d2e6-bab2-44a7-b0d3-8ccd477b179a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:40.447601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c401845d-9914-4dfd-8fe7-79f00f7860da req-0835d2e6-bab2-44a7-b0d3-8ccd477b179a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:40.483160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2cd03103-8d3a-4fb1-9ef1-1f0672c2994b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:40.484677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2cd03103-8d3a-4fb1-9ef1-1f0672c2994b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:40.500018 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c401845d-9914-4dfd-8fe7-79f00f7860da req-0835d2e6-bab2-44a7-b0d3-8ccd477b179a service nova] Creating event network-vif-plugged:24d4479c-4502-454a-81e4-e76f3810bd64 for instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a on n-h1-852771-8 Aug 25 12:51:40.517951 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c401845d-9914-4dfd-8fe7-79f00f7860da req-0835d2e6-bab2-44a7-b0d3-8ccd477b179a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161051 Aug 25 12:51:40.518310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cd03103-8d3a-4fb1-9ef1-1f0672c2994b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:40.518926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cd03103-8d3a-4fb1-9ef1-1f0672c2994b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:40.520135 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 896/1791] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 25 12:51:40.529657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cd03103-8d3a-4fb1-9ef1-1f0672c2994b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:40.531628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cd03103-8d3a-4fb1-9ef1-1f0672c2994b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:40.533095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cd03103-8d3a-4fb1-9ef1-1f0672c2994b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:40.534817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cd03103-8d3a-4fb1-9ef1-1f0672c2994b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:41.646771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:41.660888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:41.693158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:41.694152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:41.695246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:41.697834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:41.700554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:41.706911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:41.722292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2cd03103-8d3a-4fb1-9ef1-1f0672c2994b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:41.762423 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2cd03103-8d3a-4fb1-9ef1-1f0672c2994b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1324 microversion: 2.1 time: 1.286088 Aug 25 12:51:41.764042 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 896/1792] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:40 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1324 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:51:42.526631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1206013002", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "d67b71c1-567f-4c69-8cd3-645be627ebce"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:42.791136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] validate_networks() for [('d67b71c1-567f-4c69-8cd3-645be627ebce', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:51:43.347261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:43.421990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:43.442256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:43.445339 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-daa1f7a6-3f54-4cf0-b91e-6c64070439d0 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 2.740365 Aug 25 12:51:43.455456 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 897/1793] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:40 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 2755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:43.489261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a74ec81-e8cf-4937-b0ff-2880bfbe6c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:43.490648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a74ec81-e8cf-4937-b0ff-2880bfbe6c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:43.536189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a74ec81-e8cf-4937-b0ff-2880bfbe6c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:43.540090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a74ec81-e8cf-4937-b0ff-2880bfbe6c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:43.547293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a74ec81-e8cf-4937-b0ff-2880bfbe6c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:43.552553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a74ec81-e8cf-4937-b0ff-2880bfbe6c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:43.554325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a74ec81-e8cf-4937-b0ff-2880bfbe6c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:43.559068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a74ec81-e8cf-4937-b0ff-2880bfbe6c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:47.085890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a74ec81-e8cf-4937-b0ff-2880bfbe6c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:47.127260 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a74ec81-e8cf-4937-b0ff-2880bfbe6c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1324 microversion: 2.1 time: 3.669097 Aug 25 12:51:47.128364 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 898/1794] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:43 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1324 bytes in 3672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:47.151138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:47.164300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:47.190712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:47.192371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:47.194924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:47.198179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:47.199873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:47.201465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:48.260322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:48.267365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=65 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:48.303754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:48.314439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:48.320611 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-81101266-37be-4e3e-b93a-916abcdbe0e4 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 1.173439 Aug 25 12:51:48.321865 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 899/1795] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:47 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:48.890600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6939ab15-1eee-4e39-abae-f1f117065b0a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:48.893232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6939ab15-1eee-4e39-abae-f1f117065b0a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:48.928159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6939ab15-1eee-4e39-abae-f1f117065b0a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:48.933725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6939ab15-1eee-4e39-abae-f1f117065b0a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:48.935884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6939ab15-1eee-4e39-abae-f1f117065b0a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:48.939313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6939ab15-1eee-4e39-abae-f1f117065b0a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:48.940821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6939ab15-1eee-4e39-abae-f1f117065b0a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:48.942533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6939ab15-1eee-4e39-abae-f1f117065b0a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:50.491042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:51:50.491938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:51:50.499842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:51:50.503058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:51:50.517322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:51:50.569490 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6939ab15-1eee-4e39-abae-f1f117065b0a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1810 microversion: 2.1 time: 2.237590 Aug 25 12:51:50.575030 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 900/1796] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:48 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1810 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:50.594764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:50.610778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:50.615875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9d1e70eb-1668-4394-a89f-3d560bb6c7a9 req-b070aa93-5680-4478-9bbe-18e623ca506a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca859734-6370-48aa-b3c3-22ff3362f6b1", "name": "network-vif-unplugged", "status": "completed", "tag": "e899f17a-afed-4127-8666-0bdca4cad26c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:50.619020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:50.621700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:50.630653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:50.634064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:50.709370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9d1e70eb-1668-4394-a89f-3d560bb6c7a9 req-b070aa93-5680-4478-9bbe-18e623ca506a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:50.710716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Getting quotas for project a5a4e9ad75194e4ba441873f2258146b. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:50.716721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9d1e70eb-1668-4394-a89f-3d560bb6c7a9 req-b070aa93-5680-4478-9bbe-18e623ca506a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:50.721623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9d1e70eb-1668-4394-a89f-3d560bb6c7a9 req-b070aa93-5680-4478-9bbe-18e623ca506a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:50.734649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Getting quotas for user 8dc6134f93e044dda11bb83fc863960d and project a5a4e9ad75194e4ba441873f2258146b. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:50.791028 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9d1e70eb-1668-4394-a89f-3d560bb6c7a9 req-b070aa93-5680-4478-9bbe-18e623ca506a service nova] Creating event network-vif-unplugged:e899f17a-afed-4127-8666-0bdca4cad26c for instance ca859734-6370-48aa-b3c3-22ff3362f6b1 on n-h1-852771-8 Aug 25 12:51:50.829001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:51:50.829658 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9d1e70eb-1668-4394-a89f-3d560bb6c7a9 req-b070aa93-5680-4478-9bbe-18e623ca506a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.245791 Aug 25 12:51:50.835448 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 901/1797] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:50.840092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:51:50.870510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-246eb99f-2a90-45d2-8515-5d48e9c214a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:50.872937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-246eb99f-2a90-45d2-8515-5d48e9c214a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:50.892214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246eb99f-2a90-45d2-8515-5d48e9c214a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:50.893340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246eb99f-2a90-45d2-8515-5d48e9c214a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:50.895766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246eb99f-2a90-45d2-8515-5d48e9c214a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:50.897495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246eb99f-2a90-45d2-8515-5d48e9c214a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:50.898370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246eb99f-2a90-45d2-8515-5d48e9c214a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:50.902928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246eb99f-2a90-45d2-8515-5d48e9c214a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:51.087270 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7f048354-ff1a-4352-b623-c59a90cd3807 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.822478 Aug 25 12:51:51.088846 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 897/1798] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:51:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 8827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 12:51:51.101667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:51.103883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:51.124489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:51.126548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:51.127826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:51.130799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:51.133390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:51.134780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:52.171044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-246eb99f-2a90-45d2-8515-5d48e9c214a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:52.208068 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-246eb99f-2a90-45d2-8515-5d48e9c214a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1521 microversion: 2.1 time: 1.369798 Aug 25 12:51:52.210317 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 902/1799] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:50 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1521 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:52.223250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f528f709-9dca-4a9a-a4ae-9cb75ae1c9ac tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:52.238874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f528f709-9dca-4a9a-a4ae-9cb75ae1c9ac tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:52.239871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f528f709-9dca-4a9a-a4ae-9cb75ae1c9ac tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:52.240846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f528f709-9dca-4a9a-a4ae-9cb75ae1c9ac tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:52.243039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f528f709-9dca-4a9a-a4ae-9cb75ae1c9ac tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:52.244838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f528f709-9dca-4a9a-a4ae-9cb75ae1c9ac tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:52.246876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f528f709-9dca-4a9a-a4ae-9cb75ae1c9ac tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:52.285328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:52.294025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=48 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:52.307792 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f528f709-9dca-4a9a-a4ae-9cb75ae1c9ac tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.095332 Aug 25 12:51:52.309815 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 903/1800] 10.222.0.70 () {58 vars in 1176 bytes} [Thu Aug 25 12:51:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:52.312879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:52.320241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5a37247-002a-408a-91df-57d3b6359ad7 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:52.323678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b5a37247-002a-408a-91df-57d3b6359ad7 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:52.332830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:52.361858 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ab02737-cdfc-48f0-9281-ed401299dd49 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 1.260908 Aug 25 12:51:52.382266 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 898/1801] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:51 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:52.429096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f5f4698-e65f-4186-a8da-99859d17847e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:52.430805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0f5f4698-e65f-4186-a8da-99859d17847e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:52.450926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5f4698-e65f-4186-a8da-99859d17847e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:52.453007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5f4698-e65f-4186-a8da-99859d17847e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:52.454374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5f4698-e65f-4186-a8da-99859d17847e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:52.458345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5f4698-e65f-4186-a8da-99859d17847e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:52.459690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5f4698-e65f-4186-a8da-99859d17847e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:52.460883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5f4698-e65f-4186-a8da-99859d17847e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:52.683395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b5a37247-002a-408a-91df-57d3b6359ad7 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:52.707196 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b5a37247-002a-408a-91df-57d3b6359ad7 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1216 microversion: 2.1 time: 0.395439 Aug 25 12:51:52.725431 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 904/1802] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:52 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1216 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:53.035819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f671713e-3bc1-468e-b067-9ae15b9bb8fc req-d9912e1a-7663-4771-b75a-d759d71a5aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca859734-6370-48aa-b3c3-22ff3362f6b1", "tag": "e899f17a-afed-4127-8666-0bdca4cad26c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:53.114782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f671713e-3bc1-468e-b067-9ae15b9bb8fc req-d9912e1a-7663-4771-b75a-d759d71a5aa6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:53.115742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f671713e-3bc1-468e-b067-9ae15b9bb8fc req-d9912e1a-7663-4771-b75a-d759d71a5aa6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:53.118702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f671713e-3bc1-468e-b067-9ae15b9bb8fc req-d9912e1a-7663-4771-b75a-d759d71a5aa6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:53.186618 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f671713e-3bc1-468e-b067-9ae15b9bb8fc req-d9912e1a-7663-4771-b75a-d759d71a5aa6 service nova] Creating event network-changed:e899f17a-afed-4127-8666-0bdca4cad26c for instance ca859734-6370-48aa-b3c3-22ff3362f6b1 on n-h1-852771-8 Aug 25 12:51:53.213260 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f671713e-3bc1-468e-b067-9ae15b9bb8fc req-d9912e1a-7663-4771-b75a-d759d71a5aa6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188271 Aug 25 12:51:53.218136 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 905/1803] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:51:53.443612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:53.443612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:53.454841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f5f4698-e65f-4186-a8da-99859d17847e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:53.493462 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0f5f4698-e65f-4186-a8da-99859d17847e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1521 microversion: 2.1 time: 1.108332 Aug 25 12:51:53.495681 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 899/1804] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:52 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1521 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:53.500825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:53.514608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:53.519438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:53.526056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:53.527502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:53.529276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:53.599074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-488fb255-56e1-4a22-acd0-0efe414c85f5 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1754422772", "metadata": {"": ""}}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-488fb255-56e1-4a22-acd0-0efe414c85f5 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action HTTP/1.1 Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 107 Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1754422772", "metadata": {"": ""}}} Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '9ce5cde8-dd95-4c6f-b05f-802b0d47696a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1754422772', 'metadata': {'': ''}}}} Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'': ''} Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:53.664189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-488fb255-56e1-4a22-acd0-0efe414c85f5 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:53.680303 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-488fb255-56e1-4a22-acd0-0efe414c85f5 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action" status: 400 len: 170 microversion: 2.1 time: 0.122504 Aug 25 12:51:53.696347 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 900/1805] 10.222.0.70 () {60 vars in 1279 bytes} [Thu Aug 25 12:51:53 2022] POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action => generated 170 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:51:53.758807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1067ee49-7976-4793-a7e2-2af3d4d7b128 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:53.770380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1067ee49-7976-4793-a7e2-2af3d4d7b128 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:53.837262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-7976-4793-a7e2-2af3d4d7b128 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:53.841471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-7976-4793-a7e2-2af3d4d7b128 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:53.844085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-7976-4793-a7e2-2af3d4d7b128 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:53.851383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-7976-4793-a7e2-2af3d4d7b128 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:53.854372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-7976-4793-a7e2-2af3d4d7b128 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:53.856478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-7976-4793-a7e2-2af3d4d7b128 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:54.889910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1067ee49-7976-4793-a7e2-2af3d4d7b128 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:54.929182 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1067ee49-7976-4793-a7e2-2af3d4d7b128 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1521 microversion: 2.1 time: 1.227649 Aug 25 12:51:54.932871 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 901/1806] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:53 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1521 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:54.959454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7705c2c0-ae93-4040-b160-306ac05b542c tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:54.961942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7705c2c0-ae93-4040-b160-306ac05b542c tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:54.996264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7705c2c0-ae93-4040-b160-306ac05b542c tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:54.997267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7705c2c0-ae93-4040-b160-306ac05b542c tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:54.998165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7705c2c0-ae93-4040-b160-306ac05b542c tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:55.004029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7705c2c0-ae93-4040-b160-306ac05b542c tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:55.008599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7705c2c0-ae93-4040-b160-306ac05b542c tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:55.011898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7705c2c0-ae93-4040-b160-306ac05b542c tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:56.320381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7705c2c0-ae93-4040-b160-306ac05b542c tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:56.344595 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7705c2c0-ae93-4040-b160-306ac05b542c tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1276 microversion: 2.1 time: 1.408976 Aug 25 12:51:56.363447 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 902/1807] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:54 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1276 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:56.470664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42a98912-28de-46cc-b896-1cd3165fd14e tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Action: 'create', calling method: .version_select at 0x7f3a2e807c10>, body: {"keypair": {"name": "tempest-keypair-1065224550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVBKXZR6JldmpVfv8+HeXpndrH0PSD4b5zgKVwOwU0miU9AdFJNGtamzLRA6iHuwxlQZ9FtYx8l1k3tvZlWyspykjpCNKWV1LNWP13nNWK1jWlBJdn3uDFXyy8UGeaIAg=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:56.503190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-42a98912-28de-46cc-b896-1cd3165fd14e tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Getting quotas for project 33deff7a601e4470ae1697c0d0ebd3fa. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:56.513738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-42a98912-28de-46cc-b896-1cd3165fd14e tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Getting quotas for user 9b1996cd469f40e580b8267400f9273d and project 33deff7a601e4470ae1697c0d0ebd3fa. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:56.572439 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42a98912-28de-46cc-b896-1cd3165fd14e tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.222243 Aug 25 12:51:56.574347 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 903/1808] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:51:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:56.591503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7809aab2-8e41-4cc8-af60-c06e314d7a16 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:56.594420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7809aab2-8e41-4cc8-af60-c06e314d7a16 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:56.612625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7809aab2-8e41-4cc8-af60-c06e314d7a16 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:56.614997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7809aab2-8e41-4cc8-af60-c06e314d7a16 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:56.615990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7809aab2-8e41-4cc8-af60-c06e314d7a16 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:56.619253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7809aab2-8e41-4cc8-af60-c06e314d7a16 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:56.620774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7809aab2-8e41-4cc8-af60-c06e314d7a16 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:56.621833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7809aab2-8e41-4cc8-af60-c06e314d7a16 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:56.919902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:56.968923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:56.977156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:56.982474 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c1441405-a17d-4512-b6d5-cfdd97c67f29 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 3.553919 Aug 25 12:51:56.998965 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 906/1809] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:53 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 3571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:51:57.398202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-47f777c8-6898-4ffc-9cc9-c1963ae7f7aa tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:57.407063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-47f777c8-6898-4ffc-9cc9-c1963ae7f7aa tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:57.472659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f777c8-6898-4ffc-9cc9-c1963ae7f7aa tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:57.473854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f777c8-6898-4ffc-9cc9-c1963ae7f7aa tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:57.474685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f777c8-6898-4ffc-9cc9-c1963ae7f7aa tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:57.481354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f777c8-6898-4ffc-9cc9-c1963ae7f7aa tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:57.486125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f777c8-6898-4ffc-9cc9-c1963ae7f7aa tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:57.490563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f777c8-6898-4ffc-9cc9-c1963ae7f7aa tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:58.504154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7809aab2-8e41-4cc8-af60-c06e314d7a16 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:58.557776 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7809aab2-8e41-4cc8-af60-c06e314d7a16 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1521 microversion: 2.1 time: 1.969758 Aug 25 12:51:58.562259 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 904/1810] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:56 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1521 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:58.584247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:58.586991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:58.619819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:58.625053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:58.630165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:58.640046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:58.642021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:58.643298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:58.822165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-47f777c8-6898-4ffc-9cc9-c1963ae7f7aa tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:58.856243 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-47f777c8-6898-4ffc-9cc9-c1963ae7f7aa tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1274 microversion: 2.1 time: 1.469263 Aug 25 12:51:58.868500 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 907/1811] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:57 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1274 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:58.899565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ddef2a4-9463-45a0-9ffe-21db64e1985b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "728e586d-d40c-413f-bd1d-38591bbf94b0", "device": "/dev/xvdb"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:58.913092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ddef2a4-9463-45a0-9ffe-21db64e1985b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:58.964266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddef2a4-9463-45a0-9ffe-21db64e1985b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:58.969255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddef2a4-9463-45a0-9ffe-21db64e1985b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:58.970457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddef2a4-9463-45a0-9ffe-21db64e1985b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:58.980882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddef2a4-9463-45a0-9ffe-21db64e1985b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:58.981955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddef2a4-9463-45a0-9ffe-21db64e1985b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:58.982821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddef2a4-9463-45a0-9ffe-21db64e1985b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:59.402400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:59.437296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:59.446145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:59.452520 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-00fa18cc-41e4-4d7f-a4bd-d0fc3bcd0206 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 0.883910 Aug 25 12:51:59.458834 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 905/1812] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:58 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:59.470892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2fe8c704-a72e-415c-84ee-97a516d76fe5 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1773820305", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2fe8c704-a72e-415c-84ee-97a516d76fe5 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action HTTP/1.1 Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 619 Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1773820305", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '9ce5cde8-dd95-4c6f-b05f-802b0d47696a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1773820305', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:51:59.504896 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:51:59.511100 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:51:59.526774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2fe8c704-a72e-415c-84ee-97a516d76fe5 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:59.530461 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2fe8c704-a72e-415c-84ee-97a516d76fe5 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action" status: 400 len: 938 microversion: 2.1 time: 0.065346 Aug 25 12:51:59.533604 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 906/1813] 10.222.0.70 () {60 vars in 1279 bytes} [Thu Aug 25 12:51:59 2022] POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action => generated 938 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:51:59.557574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d552bc6f-9f0b-4f7e-9621-0306739dde54 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:59.569600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d552bc6f-9f0b-4f7e-9621-0306739dde54 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:59.592884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d552bc6f-9f0b-4f7e-9621-0306739dde54 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:59.594383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d552bc6f-9f0b-4f7e-9621-0306739dde54 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:59.595584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d552bc6f-9f0b-4f7e-9621-0306739dde54 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:59.597474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d552bc6f-9f0b-4f7e-9621-0306739dde54 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:59.598853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d552bc6f-9f0b-4f7e-9621-0306739dde54 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:59.600507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d552bc6f-9f0b-4f7e-9621-0306739dde54 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:00.182676 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ddef2a4-9463-45a0-9ffe-21db64e1985b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "POST /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.307185 Aug 25 12:52:00.187258 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 908/1814] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 12:51:58 2022] POST /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 194 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:00.239241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-527316e2-46b0-4b0f-be3e-3416528068d1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:00.245759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-527316e2-46b0-4b0f-be3e-3416528068d1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:00.311423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-527316e2-46b0-4b0f-be3e-3416528068d1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:00.324791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-527316e2-46b0-4b0f-be3e-3416528068d1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:00.329304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-527316e2-46b0-4b0f-be3e-3416528068d1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:00.331300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-527316e2-46b0-4b0f-be3e-3416528068d1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:00.335707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-527316e2-46b0-4b0f-be3e-3416528068d1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:00.337043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-527316e2-46b0-4b0f-be3e-3416528068d1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:00.681807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:01.234682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d552bc6f-9f0b-4f7e-9621-0306739dde54 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:01.255234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-527316e2-46b0-4b0f-be3e-3416528068d1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:01.282860 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d552bc6f-9f0b-4f7e-9621-0306739dde54 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1521 microversion: 2.1 time: 1.732479 Aug 25 12:52:01.314234 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 907/1815] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:59 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1521 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:01.318384 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-527316e2-46b0-4b0f-be3e-3416528068d1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1274 microversion: 2.1 time: 1.125898 Aug 25 12:52:01.320068 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 909/1816] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:00 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1274 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:01.341810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:01.349211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:01.367569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a3bcf9c4-53d0-4837-9e9f-4a3d130da210 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:01.371811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a3bcf9c4-53d0-4837-9e9f-4a3d130da210 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:01.402886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:01.406733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:01.407806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:01.408275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bcf9c4-53d0-4837-9e9f-4a3d130da210 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:01.410313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bcf9c4-53d0-4837-9e9f-4a3d130da210 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:01.412929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:01.417875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bcf9c4-53d0-4837-9e9f-4a3d130da210 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:01.419882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bcf9c4-53d0-4837-9e9f-4a3d130da210 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:01.420701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:01.423076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:01.426816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bcf9c4-53d0-4837-9e9f-4a3d130da210 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:01.432647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3bcf9c4-53d0-4837-9e9f-4a3d130da210 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:02.259842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:02.697396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:04.251041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:04.293820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:04.300794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:04.311288 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fd2c1869-93d2-402f-8f56-f733804f0f5b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 2.993104 Aug 25 12:52:04.318026 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 908/1817] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:01 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 3002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:04.330347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8784c7b3-a849-4f8e-bbc8-061c6bf04937 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:04.331520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8784c7b3-a849-4f8e-bbc8-061c6bf04937 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:04.358914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:04.378156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8784c7b3-a849-4f8e-bbc8-061c6bf04937 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:04.379462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8784c7b3-a849-4f8e-bbc8-061c6bf04937 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:04.380779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8784c7b3-a849-4f8e-bbc8-061c6bf04937 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:04.382267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8784c7b3-a849-4f8e-bbc8-061c6bf04937 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:04.383011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8784c7b3-a849-4f8e-bbc8-061c6bf04937 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:04.386401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8784c7b3-a849-4f8e-bbc8-061c6bf04937 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:05.024478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a3bcf9c4-53d0-4837-9e9f-4a3d130da210 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:05.075909 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a3bcf9c4-53d0-4837-9e9f-4a3d130da210 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1521 microversion: 2.1 time: 3.717985 Aug 25 12:52:05.078145 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 910/1818] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:01 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1521 bytes in 3722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:05.129162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e77478bb-23a7-4b95-b612-b51bfe29622b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e77478bb-23a7-4b95-b612-b51bfe29622b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action HTTP/1.1 Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 285 Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '9ce5cde8-dd95-4c6f-b05f-802b0d47696a', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:05.164275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:52:05.174727 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:05.185478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e77478bb-23a7-4b95-b612-b51bfe29622b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:05.189426 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e77478bb-23a7-4b95-b612-b51bfe29622b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action" status: 400 len: 619 microversion: 2.1 time: 0.069221 Aug 25 12:52:05.194540 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 911/1819] 10.222.0.70 () {60 vars in 1279 bytes} [Thu Aug 25 12:52:05 2022] POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action => generated 619 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:05.223832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aeccb0e4-ce32-4eb0-bb88-286757221c67 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:05.229924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aeccb0e4-ce32-4eb0-bb88-286757221c67 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:05.265493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeccb0e4-ce32-4eb0-bb88-286757221c67 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:05.268134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeccb0e4-ce32-4eb0-bb88-286757221c67 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:05.269476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeccb0e4-ce32-4eb0-bb88-286757221c67 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:05.271456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeccb0e4-ce32-4eb0-bb88-286757221c67 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:05.276613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeccb0e4-ce32-4eb0-bb88-286757221c67 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:05.278297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeccb0e4-ce32-4eb0-bb88-286757221c67 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:06.390636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aeccb0e4-ce32-4eb0-bb88-286757221c67 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:06.429334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aeccb0e4-ce32-4eb0-bb88-286757221c67 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1521 microversion: 2.1 time: 1.228816 Aug 25 12:52:06.430488 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 912/1820] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:05 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1521 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:06.452361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:06.453679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:06.470355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:06.471936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:06.473660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:06.475658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:06.476851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:06.477969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:06.528018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:08.055613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8784c7b3-a849-4f8e-bbc8-061c6bf04937 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:08.127129 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8784c7b3-a849-4f8e-bbc8-061c6bf04937 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1316 microversion: 2.1 time: 3.772117 Aug 25 12:52:08.128207 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 909/1821] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:04 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1316 bytes in 3809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:08.153574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-253d97b1-613a-4e44-bf1d-76d7bf397682 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:08.155854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-253d97b1-613a-4e44-bf1d-76d7bf397682 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:08.201342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-253d97b1-613a-4e44-bf1d-76d7bf397682 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:08.203043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-253d97b1-613a-4e44-bf1d-76d7bf397682 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:08.206193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-253d97b1-613a-4e44-bf1d-76d7bf397682 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:08.212224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-253d97b1-613a-4e44-bf1d-76d7bf397682 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:08.213779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-253d97b1-613a-4e44-bf1d-76d7bf397682 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:08.220151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-253d97b1-613a-4e44-bf1d-76d7bf397682 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:08.321202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:08.362125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:08.370152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:08.374379 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a9681b2f-bf27-4215-9c94-e529ca56ada1 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 1.930941 Aug 25 12:52:08.375880 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 913/1822] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:06 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:09.114543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-253d97b1-613a-4e44-bf1d-76d7bf397682 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:09.164798 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-253d97b1-613a-4e44-bf1d-76d7bf397682 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1521 microversion: 2.1 time: 1.034618 Aug 25 12:52:09.180902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bbd7e766-40c4-4f6a-a7f6-ebca306824b4 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:09.202762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bbd7e766-40c4-4f6a-a7f6-ebca306824b4 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:09.214944 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 910/1823] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:08 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1521 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:09.232206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a8279bb-e477-47de-8921-aacfdbaa7573 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1840892610"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:09.259081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=40 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:09.269137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd7e766-40c4-4f6a-a7f6-ebca306824b4 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:09.270165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a8279bb-e477-47de-8921-aacfdbaa7573 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:09.279581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd7e766-40c4-4f6a-a7f6-ebca306824b4 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:09.281323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd7e766-40c4-4f6a-a7f6-ebca306824b4 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:09.283329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd7e766-40c4-4f6a-a7f6-ebca306824b4 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:09.285134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd7e766-40c4-4f6a-a7f6-ebca306824b4 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:09.286855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd7e766-40c4-4f6a-a7f6-ebca306824b4 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:09.314153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8279bb-e477-47de-8921-aacfdbaa7573 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:09.315616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8279bb-e477-47de-8921-aacfdbaa7573 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:09.316715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8279bb-e477-47de-8921-aacfdbaa7573 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:09.321728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8279bb-e477-47de-8921-aacfdbaa7573 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:09.323228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8279bb-e477-47de-8921-aacfdbaa7573 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:09.330559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a8279bb-e477-47de-8921-aacfdbaa7573 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:10.216140 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a8279bb-e477-47de-8921-aacfdbaa7573 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action" status: 202 len: 0 microversion: 2.1 time: 0.991819 Aug 25 12:52:10.221450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 911/1824] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:52:09 2022] POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action => generated 0 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:52:10.259623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:10.265197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:10.286289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:10.287794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:10.289151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:10.291043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:10.292558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:10.294675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:11.421263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bbd7e766-40c4-4f6a-a7f6-ebca306824b4 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:11.447130 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bbd7e766-40c4-4f6a-a7f6-ebca306824b4 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1316 microversion: 2.1 time: 2.276877 Aug 25 12:52:11.448834 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 914/1825] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:09 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1316 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:11.477738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1222420919"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:11.485554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:11.511732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:11.519939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:11.521159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:11.522964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:11.526498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:11.529917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:11.600744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:11.628956 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Cannot 'createImage' instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a while it is in task_state image_snapshot Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action HTTP/1.1 Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 85 Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1222420919"}} Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: exception: Cannot 'createImage' instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a while it is in task_state image_snapshot Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '9ce5cde8-dd95-4c6f-b05f-802b0d47696a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1222420919'}}} Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:52:11.632584 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a while it is in task_state image_snapshot Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a while it is in task_state image_snapshot Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 409 to user: Cannot 'createImage' instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a while it is in task_state image_snapshot {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:11.645972 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d2d93761-4601-4cd2-8432-a9888b4515e1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action" status: 409 len: 159 microversion: 2.1 time: 0.184927 Aug 25 12:52:11.653196 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 915/1826] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:52:11 2022] POST /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a/action => generated 159 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:52:11.662812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4878b6e2-377b-4304-88c6-3c35fb9ff61b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '.version_select at 0x7f3a2e905670>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:11.680880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:11.700510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:11.703569 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-af788ddf-16cb-4f49-b282-1bea5e4334ea tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 1.479094 Aug 25 12:52:11.713767 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 912/1827] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:10 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:12.161180 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4878b6e2-377b-4304-88c6-3c35fb9ff61b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "DELETE /compute/v2.1/images/0cac324a-4153-416e-955c-99ab8d27006b" status: 204 len: 0 microversion: 2.1 time: 0.504990 Aug 25 12:52:12.162274 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 916/1828] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:11 2022] DELETE /compute/v2.1/images/0cac324a-4153-416e-955c-99ab8d27006b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:52:12.179161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-541d2d80-e533-4cd5-a12c-a1ceec5f81f3 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:12.183502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-541d2d80-e533-4cd5-a12c-a1ceec5f81f3 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:12.213163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-541d2d80-e533-4cd5-a12c-a1ceec5f81f3 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:12.214725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-541d2d80-e533-4cd5-a12c-a1ceec5f81f3 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:12.220937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-541d2d80-e533-4cd5-a12c-a1ceec5f81f3 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:12.223584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-541d2d80-e533-4cd5-a12c-a1ceec5f81f3 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:12.224897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-541d2d80-e533-4cd5-a12c-a1ceec5f81f3 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:12.229666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-541d2d80-e533-4cd5-a12c-a1ceec5f81f3 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:12.499453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00d25c07-ad18-45bf-840f-19cbf01dc6b1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:12.508594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-00d25c07-ad18-45bf-840f-19cbf01dc6b1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:12.540700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d25c07-ad18-45bf-840f-19cbf01dc6b1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:12.547084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d25c07-ad18-45bf-840f-19cbf01dc6b1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:12.552018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d25c07-ad18-45bf-840f-19cbf01dc6b1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:12.554653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d25c07-ad18-45bf-840f-19cbf01dc6b1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:12.555670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d25c07-ad18-45bf-840f-19cbf01dc6b1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:12.556562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d25c07-ad18-45bf-840f-19cbf01dc6b1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:13.691957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-00d25c07-ad18-45bf-840f-19cbf01dc6b1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:13.730806 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-00d25c07-ad18-45bf-840f-19cbf01dc6b1 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1316 microversion: 2.1 time: 1.240356 Aug 25 12:52:13.735163 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 917/1829] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:12 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1316 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:52:13.762495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:13.775792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:13.799226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:13.800815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:13.802448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:13.804384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:13.806000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:13.807419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:13.813812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-541d2d80-e533-4cd5-a12c-a1ceec5f81f3 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:13.844399 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-541d2d80-e533-4cd5-a12c-a1ceec5f81f3 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1533 microversion: 2.1 time: 1.675039 Aug 25 12:52:13.875714 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 913/1830] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:12 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1533 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:52:13.895798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-39ed525e-b9a5-41b0-a991-2f5e96e69113 req-2bc04403-489c-4af3-9f59-fd6e766e596b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48685680-7e3d-4549-910a-a454c4951c15", "tag": "2b598070-a73d-4150-bcc3-b8737f88e7d3"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:13.938154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-39ed525e-b9a5-41b0-a991-2f5e96e69113 req-2bc04403-489c-4af3-9f59-fd6e766e596b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:13.939524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-39ed525e-b9a5-41b0-a991-2f5e96e69113 req-2bc04403-489c-4af3-9f59-fd6e766e596b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:13.940593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-39ed525e-b9a5-41b0-a991-2f5e96e69113 req-2bc04403-489c-4af3-9f59-fd6e766e596b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:13.967553 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-39ed525e-b9a5-41b0-a991-2f5e96e69113 req-2bc04403-489c-4af3-9f59-fd6e766e596b service nova] Creating event network-changed:2b598070-a73d-4150-bcc3-b8737f88e7d3 for instance 48685680-7e3d-4549-910a-a454c4951c15 on n-h2-852771-8 Aug 25 12:52:13.978908 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-39ed525e-b9a5-41b0-a991-2f5e96e69113 req-2bc04403-489c-4af3-9f59-fd6e766e596b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100715 Aug 25 12:52:13.980766 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 914/1831] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:14.514745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e5137b94-bb7d-4f1e-833d-7c842fdde1f9 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e769a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1474133000", "description": "tempest-description-267953860"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:15.317999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:15.352015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:15.359486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:15.369469 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e595aaaa-a18e-4afd-b9f5-c4c3ce3253a5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1486 microversion: 2.25 time: 1.626138 Aug 25 12:52:15.370745 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 918/1832] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:13 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1486 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:15.392485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e829dda5-c2d9-4e7c-80b8-3f3dc100baf2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:15.394106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e829dda5-c2d9-4e7c-80b8-3f3dc100baf2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:15.427511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e829dda5-c2d9-4e7c-80b8-3f3dc100baf2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:15.428775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e829dda5-c2d9-4e7c-80b8-3f3dc100baf2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:15.429942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e829dda5-c2d9-4e7c-80b8-3f3dc100baf2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:15.431748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e829dda5-c2d9-4e7c-80b8-3f3dc100baf2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:15.432905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e829dda5-c2d9-4e7c-80b8-3f3dc100baf2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:15.437833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e829dda5-c2d9-4e7c-80b8-3f3dc100baf2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:16.407505 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e5137b94-bb7d-4f1e-833d-7c842fdde1f9 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.423453 Aug 25 12:52:16.409977 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 915/1833] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:52:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:16.435184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c58aebd1-664d-455d-8502-875cd46ade7f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:16.454166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c58aebd1-664d-455d-8502-875cd46ade7f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:16.517375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58aebd1-664d-455d-8502-875cd46ade7f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:16.540830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58aebd1-664d-455d-8502-875cd46ade7f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:16.546337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58aebd1-664d-455d-8502-875cd46ade7f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:16.547618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58aebd1-664d-455d-8502-875cd46ade7f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:16.549754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58aebd1-664d-455d-8502-875cd46ade7f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:16.554419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c58aebd1-664d-455d-8502-875cd46ade7f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:17.043129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e829dda5-c2d9-4e7c-80b8-3f3dc100baf2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:17.085872 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e829dda5-c2d9-4e7c-80b8-3f3dc100baf2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1316 microversion: 2.1 time: 1.709717 Aug 25 12:52:17.104655 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 919/1834] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:15 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1316 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:17.136862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:17.141803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:17.175758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:17.176928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:17.182894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:17.184850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:17.189670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:17.193903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:17.224458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:18.546998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:18.567595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c58aebd1-664d-455d-8502-875cd46ade7f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:18.580546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:18.585461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:18.609650 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c58aebd1-664d-455d-8502-875cd46ade7f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1539 microversion: 2.1 time: 2.185865 Aug 25 12:52:18.611734 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-498b2ec5-c00d-4f26-aeca-93c39451c669 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1476 microversion: 2.25 time: 1.498260 Aug 25 12:52:18.612924 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 920/1835] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:17 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1476 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:18.626410 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 916/1836] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:16 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1539 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:18.647614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9a286ef3-7e04-4b91-99de-63ecb233ecd2 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e905820>, body: {"security_group_rule": {"parent_group_id": "59d1e42d-2c96-4bf4-a469-8717674e9346", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:18.669242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52c27238-80bb-455f-817e-f4bd3d7dc8a8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:18.675093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-52c27238-80bb-455f-817e-f4bd3d7dc8a8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:18.704132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c27238-80bb-455f-817e-f4bd3d7dc8a8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:18.711700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c27238-80bb-455f-817e-f4bd3d7dc8a8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:18.712548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c27238-80bb-455f-817e-f4bd3d7dc8a8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:18.714060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c27238-80bb-455f-817e-f4bd3d7dc8a8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:18.714658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c27238-80bb-455f-817e-f4bd3d7dc8a8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:18.715116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c27238-80bb-455f-817e-f4bd3d7dc8a8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:19.870001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-52c27238-80bb-455f-817e-f4bd3d7dc8a8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:19.895455 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-52c27238-80bb-455f-817e-f4bd3d7dc8a8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1316 microversion: 2.1 time: 1.266160 Aug 25 12:52:19.896552 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 917/1837] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:18 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1316 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:20.416709 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9a286ef3-7e04-4b91-99de-63ecb233ecd2 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.798140 Aug 25 12:52:20.418060 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 921/1838] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:52:18 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:20.467642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1952115677", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2e21e0fa-e8be-4dff-a968-e93ced600d98"}], "security_groups": [{"name": "tempest-securitygroup--1355156526"}], "key_name": "tempest-keypair-1065224550", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:20.672705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e46b1de2-9272-492f-9c95-606b7c997be7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '.version_select at 0x7f3a2e7eeee0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:20.688011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e46b1de2-9272-492f-9c95-606b7c997be7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:20.714661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e46b1de2-9272-492f-9c95-606b7c997be7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:20.715692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e46b1de2-9272-492f-9c95-606b7c997be7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:20.791773 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e46b1de2-9272-492f-9c95-606b7c997be7 tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 2537 microversion: 2.25 time: 0.893337 Aug 25 12:52:20.793080 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 918/1839] 10.222.0.70 () {60 vars in 1184 bytes} [Thu Aug 25 12:52:19 2022] GET /compute/v2.1/os-migrations => generated 2537 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:20.800740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fd066dc3-e985-4f33-a09c-c82eecb22524 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:20.802309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fd066dc3-e985-4f33-a09c-c82eecb22524 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:20.815817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd066dc3-e985-4f33-a09c-c82eecb22524 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:20.817115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd066dc3-e985-4f33-a09c-c82eecb22524 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:20.820657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd066dc3-e985-4f33-a09c-c82eecb22524 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:20.822977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd066dc3-e985-4f33-a09c-c82eecb22524 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:20.828868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd066dc3-e985-4f33-a09c-c82eecb22524 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:20.832153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd066dc3-e985-4f33-a09c-c82eecb22524 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:20.968123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:22.303083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] validate_networks() for [('2e21e0fa-e8be-4dff-a968-e93ced600d98', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:52:22.732394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fd066dc3-e985-4f33-a09c-c82eecb22524 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:22.751528 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fd066dc3-e985-4f33-a09c-c82eecb22524 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1521 microversion: 2.1 time: 1.955792 Aug 25 12:52:22.770066 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 919/1840] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:20 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1521 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:22.795879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-56c58bf5-1c38-49c6-a8ce-b96f62a36b2c tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e7c5d30>, body: {"security_group_rule": {"parent_group_id": "59d1e42d-2c96-4bf4-a469-8717674e9346", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:23.228944 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-56c58bf5-1c38-49c6-a8ce-b96f62a36b2c tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] HTTP exception thrown: This rule already exists in group 59d1e42d-2c96-4bf4-a469-8717674e9346 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-56c58bf5-1c38-49c6-a8ce-b96f62a36b2c tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Request method failure captured: Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 138 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3B8TTsXm5Tmdh54VS7NgcP2GacVDc_pUxRqo-cV9Bv2jFz_N1iqfDDRLUMknpkASNJsr830RyIEFScLlk8-5p4llfkMS_9kLL9hgsGvu-dYpOgXkh7FCOyDWVEjB1eO0DxHTgCMDqJrYF0i0KPajQ6_6vfWPqy9dUxmVyANJehFXgw Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1ffca10ca7b4196ba6e12a7904686d1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}] Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c18a5a6985c243b983f300e38f507f29 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: {"security_group_rule": {"parent_group_id": "59d1e42d-2c96-4bf4-a469-8717674e9346", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: exception: This rule already exists in group 59d1e42d-2c96-4bf4-a469-8717674e9346 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'security_group_rule': {'parent_group_id': '59d1e42d-2c96-4bf4-a469-8717674e9346', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 59d1e42d-2c96-4bf4-a469-8717674e9346 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 59d1e42d-2c96-4bf4-a469-8717674e9346 Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:23.252431 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:23.265885 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:23.265885 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:23.265885 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 59d1e42d-2c96-4bf4-a469-8717674e9346 Aug 25 12:52:23.265885 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:23.265885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-56c58bf5-1c38-49c6-a8ce-b96f62a36b2c tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Returning 400 to user: This rule already exists in group 59d1e42d-2c96-4bf4-a469-8717674e9346 {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:23.265885 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-56c58bf5-1c38-49c6-a8ce-b96f62a36b2c tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.487463 Aug 25 12:52:23.268428 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 920/1841] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:52:22 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 497 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:23.436010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1382083473", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "530ea16b-ece3-428c-ba41-99f6cdb78f13"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:23.628602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] validate_networks() for [('530ea16b-ece3-428c-ba41-99f6cdb78f13', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:52:25.272062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Getting quotas for project 33deff7a601e4470ae1697c0d0ebd3fa. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:25.308371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Getting quotas for user 9b1996cd469f40e580b8267400f9273d and project 33deff7a601e4470ae1697c0d0ebd3fa. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:25.362004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:52:25.362961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:52:25.364101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:52:25.364946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:52:25.365825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:52:25.387372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:25.393007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:25.394092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:25.399300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:25.400394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:25.404601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:25.415952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:52:25.417280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:52:25.418331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:52:25.420589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:52:25.425200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:52:25.473241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:25.475942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:25.478530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:25.486021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:25.488857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:25.490524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:25.531926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Getting quotas for project 33deff7a601e4470ae1697c0d0ebd3fa. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:25.558546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Getting quotas for user 9b1996cd469f40e580b8267400f9273d and project 33deff7a601e4470ae1697c0d0ebd3fa. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:25.587618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Getting quotas for project 2b720cf289ad4a64b7ab3c291f7c9d9e. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:25.612759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Getting quotas for user 7d2e95a8c6eb4e2ca725bb39eceb86f3 and project 2b720cf289ad4a64b7ab3c291f7c9d9e. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:25.622863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:52:25.629687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:52:25.686604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:52:25.694150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:52:25.880896 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c74997f3-e621-4799-98be-6eb34c294c2f tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 5.445596 Aug 25 12:52:25.888464 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 922/1842] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:52:20 2022] POST /compute/v2.1/servers => generated 407 bytes in 5470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:52:25.897991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-afb8ba6e-6f87-4589-bb09-1aa40ba0764b tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:25.921020 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f3164b22-c77d-4405-bdc6-6ba241fb74da tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.649693 Aug 25 12:52:25.932926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-afb8ba6e-6f87-4589-bb09-1aa40ba0764b tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:25.941230 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 921/1843] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:52:25.954986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eb8194bc-0b4a-4755-97ca-1195399727df tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:25.956647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eb8194bc-0b4a-4755-97ca-1195399727df tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:25.972411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb8194bc-0b4a-4755-97ca-1195399727df tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:25.974418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb8194bc-0b4a-4755-97ca-1195399727df tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:25.975601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb8194bc-0b4a-4755-97ca-1195399727df tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:25.977110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb8194bc-0b4a-4755-97ca-1195399727df tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:25.978352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb8194bc-0b4a-4755-97ca-1195399727df tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:25.979378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb8194bc-0b4a-4755-97ca-1195399727df tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:25.984444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb8ba6e-6f87-4589-bb09-1aa40ba0764b tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:25.992132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb8ba6e-6f87-4589-bb09-1aa40ba0764b tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:25.993030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb8ba6e-6f87-4589-bb09-1aa40ba0764b tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:25.994412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb8ba6e-6f87-4589-bb09-1aa40ba0764b tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:25.995250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb8ba6e-6f87-4589-bb09-1aa40ba0764b tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:25.996006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb8ba6e-6f87-4589-bb09-1aa40ba0764b tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:26.678906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-afb8ba6e-6f87-4589-bb09-1aa40ba0764b tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] Lazy-loading 'services' on Instance uuid ca859734-6370-48aa-b3c3-22ff3362f6b1 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:52:26.732333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eb8194bc-0b4a-4755-97ca-1195399727df tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:26.775025 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eb8194bc-0b4a-4755-97ca-1195399727df tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1316 microversion: 2.1 time: 0.830694 Aug 25 12:52:26.777673 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-afb8ba6e-6f87-4589-bb09-1aa40ba0764b tempest-LiveAutoBlockMigrationV225Test-209074755 tempest-LiveAutoBlockMigrationV225Test-209074755-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1968 microversion: 2.25 time: 0.883975 Aug 25 12:52:26.795888 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 923/1844] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:25 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1968 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:26.797994 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 922/1845] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:25 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1316 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:26.816180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1fe3f957-c758-4bec-bfb5-2eb18567a057 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Calling method '.version_select at 0x7f3a2e868af0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:26.840893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-324acc1d-510a-47e3-99a1-0530d32f79cf tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:26.863656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-324acc1d-510a-47e3-99a1-0530d32f79cf tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:26.887788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-324acc1d-510a-47e3-99a1-0530d32f79cf tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:26.889184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-324acc1d-510a-47e3-99a1-0530d32f79cf tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:26.892440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-324acc1d-510a-47e3-99a1-0530d32f79cf tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:26.894315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-324acc1d-510a-47e3-99a1-0530d32f79cf tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:26.895712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-324acc1d-510a-47e3-99a1-0530d32f79cf tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:26.896817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-324acc1d-510a-47e3-99a1-0530d32f79cf tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:27.019539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-324acc1d-510a-47e3-99a1-0530d32f79cf tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:52:27.308416 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1fe3f957-c758-4bec-bfb5-2eb18567a057 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/02c8bdc8-87a6-4895-bc93-088edf640935" status: 202 len: 0 microversion: 2.1 time: 0.508238 Aug 25 12:52:27.313480 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 923/1846] 10.222.0.70 () {58 vars in 1287 bytes} [Thu Aug 25 12:52:26 2022] DELETE /compute/v2.1/os-security-group-rules/02c8bdc8-87a6-4895-bc93-088edf640935 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:52:27.332511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c9ebd922-36bb-4a05-bebf-2b252436771f req-54a0e2f2-206a-40db-984d-816320f39fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce5cde8-dd95-4c6f-b05f-802b0d47696a", "name": "network-vif-plugged", "status": "completed", "tag": "24d4479c-4502-454a-81e4-e76f3810bd64"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:27.382301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c9ebd922-36bb-4a05-bebf-2b252436771f req-54a0e2f2-206a-40db-984d-816320f39fb9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:27.383352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c9ebd922-36bb-4a05-bebf-2b252436771f req-54a0e2f2-206a-40db-984d-816320f39fb9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:27.385270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c9ebd922-36bb-4a05-bebf-2b252436771f req-54a0e2f2-206a-40db-984d-816320f39fb9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:27.422424 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c9ebd922-36bb-4a05-bebf-2b252436771f req-54a0e2f2-206a-40db-984d-816320f39fb9 service nova] Creating event network-vif-plugged:24d4479c-4502-454a-81e4-e76f3810bd64 for instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a on n-h1-852771-8 Aug 25 12:52:27.445450 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c9ebd922-36bb-4a05-bebf-2b252436771f req-54a0e2f2-206a-40db-984d-816320f39fb9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126519 Aug 25 12:52:27.448921 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 924/1847] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:27.476182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1648f13f-1cc9-40e2-a149-7a6d753a28c1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:27.481452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1648f13f-1cc9-40e2-a149-7a6d753a28c1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:27.496462 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-324acc1d-510a-47e3-99a1-0530d32f79cf tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 204 len: 0 microversion: 2.1 time: 0.698011 Aug 25 12:52:27.504052 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 924/1848] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:52:26 2022] DELETE /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 0 bytes in 707 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:52:27.516180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1648f13f-1cc9-40e2-a149-7a6d753a28c1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:27.518349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1648f13f-1cc9-40e2-a149-7a6d753a28c1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:27.519115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1648f13f-1cc9-40e2-a149-7a6d753a28c1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:27.526825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1648f13f-1cc9-40e2-a149-7a6d753a28c1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:27.528480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1648f13f-1cc9-40e2-a149-7a6d753a28c1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:27.532128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1648f13f-1cc9-40e2-a149-7a6d753a28c1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:27.532839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4316adba-5e49-4ea4-a66c-fb87abe0d657 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:27.537178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4316adba-5e49-4ea4-a66c-fb87abe0d657 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:27.793211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4316adba-5e49-4ea4-a66c-fb87abe0d657 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:27.835192 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4316adba-5e49-4ea4-a66c-fb87abe0d657 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1270 microversion: 2.1 time: 0.327987 Aug 25 12:52:27.849546 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 925/1849] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:27 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1270 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:27.849546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec424e13-2eb4-4cec-8bc8-84d5c59406f1 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:27.852139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ec424e13-2eb4-4cec-8bc8-84d5c59406f1 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:28.057496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ec424e13-2eb4-4cec-8bc8-84d5c59406f1 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:28.078357 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ec424e13-2eb4-4cec-8bc8-84d5c59406f1 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1216 microversion: 2.1 time: 0.239468 Aug 25 12:52:28.080014 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 926/1850] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:27 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1216 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:28.089636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d8189e3c-c9f5-4d69-84cb-d5f8203d3872 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:28.090658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d8189e3c-c9f5-4d69-84cb-d5f8203d3872 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:28.104918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8189e3c-c9f5-4d69-84cb-d5f8203d3872 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:28.106126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8189e3c-c9f5-4d69-84cb-d5f8203d3872 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:28.107578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8189e3c-c9f5-4d69-84cb-d5f8203d3872 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:28.109887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8189e3c-c9f5-4d69-84cb-d5f8203d3872 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:28.111001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8189e3c-c9f5-4d69-84cb-d5f8203d3872 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:28.111984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8189e3c-c9f5-4d69-84cb-d5f8203d3872 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:28.144486 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1648f13f-1cc9-40e2-a149-7a6d753a28c1 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1856 microversion: 2.1 time: 0.689640 Aug 25 12:52:28.158366 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 925/1851] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:27 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1856 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:28.177500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2699cb7c-cf60-4ee7-b145-72f39791117e tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e781670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1499311068", "description": "tempest-description-359756412"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:28.191084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d8189e3c-c9f5-4d69-84cb-d5f8203d3872 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:52:28.408875 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d8189e3c-c9f5-4d69-84cb-d5f8203d3872 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 204 len: 0 microversion: 2.25 time: 0.324154 Aug 25 12:52:28.408875 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 927/1852] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:52:28 2022] DELETE /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:52:28.434574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e62857f6-8d62-43f8-8ca3-b9fdf2c3129e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:28.439415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e62857f6-8d62-43f8-8ca3-b9fdf2c3129e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:28.471624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62857f6-8d62-43f8-8ca3-b9fdf2c3129e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:28.473217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62857f6-8d62-43f8-8ca3-b9fdf2c3129e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:28.474757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62857f6-8d62-43f8-8ca3-b9fdf2c3129e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:28.477293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62857f6-8d62-43f8-8ca3-b9fdf2c3129e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:28.480096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62857f6-8d62-43f8-8ca3-b9fdf2c3129e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:28.483519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62857f6-8d62-43f8-8ca3-b9fdf2c3129e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:28.574465 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2699cb7c-cf60-4ee7-b145-72f39791117e tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.413066 Aug 25 12:52:28.575697 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 926/1853] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:52:28 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:28.587364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-944d547e-d6a9-4918-9011-de3f862b9928 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:28.590620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-944d547e-d6a9-4918-9011-de3f862b9928 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:28.604993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-944d547e-d6a9-4918-9011-de3f862b9928 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:28.606482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-944d547e-d6a9-4918-9011-de3f862b9928 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:28.608211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-944d547e-d6a9-4918-9011-de3f862b9928 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:28.609789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-944d547e-d6a9-4918-9011-de3f862b9928 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:28.610556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-944d547e-d6a9-4918-9011-de3f862b9928 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:28.611370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-944d547e-d6a9-4918-9011-de3f862b9928 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:28.971524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e62857f6-8d62-43f8-8ca3-b9fdf2c3129e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:29.003548 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e62857f6-8d62-43f8-8ca3-b9fdf2c3129e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1527 microversion: 2.1 time: 0.586674 Aug 25 12:52:29.005017 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 928/1854] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:28 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1527 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:29.018123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852771-8", "block_migration": true, "disk_over_commit": false}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:29.033232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:29.059696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:29.061368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:29.062908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:29.075315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:29.077083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:29.079469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:29.124063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-944d547e-d6a9-4918-9011-de3f862b9928 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:29.146346 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-944d547e-d6a9-4918-9011-de3f862b9928 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1316 microversion: 2.1 time: 0.565790 Aug 25 12:52:29.147376 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 927/1855] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:28 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1316 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:29.160259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:29.161450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:29.179614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:29.181135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:29.182765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:29.184347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:29.185151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:29.186085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:29.187626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lazy-loading 'flavor' on Instance uuid bc86590d-191c-4f59-8b1c-bb10c9ff4a49 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:52:29.218953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Going to try to live migrate instance to n-h2-852771-8 {{(pid=129059) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:52:30.014466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:30.050293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:30.054490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:30.059691 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a195ef8f-dd0c-4354-b067-6104336ad448 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1482 microversion: 2.25 time: 0.909745 Aug 25 12:52:30.061783 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 928/1856] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:29 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1482 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:30.075022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-84c8aff4-d4ff-4f3b-b4d1-e84b1d9b7ce3 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e7c54c0>, body: {"security_group_rule": {"parent_group_id": "52d9986a-c2b4-4c24-87dd-9afd683ec241", "ip_protocol": "tcp", "from_port": 717001787, "to_port": 22}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:30.445013 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-84c8aff4-d4ff-4f3b-b4d1-e84b1d9b7ce3 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] HTTP exception thrown: Invalid port range 717001787:22. Former value cannot be greater than the later Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-84c8aff4-d4ff-4f3b-b4d1-e84b1d9b7ce3 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Request method failure captured: Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 145 Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3B8TTsXm5Tmdh54VS7NgcP2GacVDc_pUxRqo-cV9Bv2jFz_N1iqfDDRLUMknpkASNJsr830RyIEFScLlk8-5p4llfkMS_9kLL9hgsGvu-dYpOgXkh7FCOyDWVEjB1eO0DxHTgCMDqJrYF0i0KPajQ6_6vfWPqy9dUxmVyANJehFXgw Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1ffca10ca7b4196ba6e12a7904686d1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}] Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c18a5a6985c243b983f300e38f507f29 Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: {"security_group_rule": {"parent_group_id": "52d9986a-c2b4-4c24-87dd-9afd683ec241", "ip_protocol": "tcp", "from_port": 717001787, "to_port": 22}} Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid port range 717001787:22. Former value cannot be greater than the later Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'security_group_rule': {'parent_group_id': '52d9986a-c2b4-4c24-87dd-9afd683ec241', 'ip_protocol': 'tcp', 'from_port': 717001787, 'to_port': 22}}} Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 717001787:22. Former value cannot be greater than the later Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 717001787:22. Former value cannot be greater than the later Aug 25 12:52:30.448362 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:30.454962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:30.454962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:30.454962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:30.454962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:30.454962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:30.454962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:30.454962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:30.454962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 717001787:22. Former value cannot be greater than the later Aug 25 12:52:30.454962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:30.456797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-84c8aff4-d4ff-4f3b-b4d1-e84b1d9b7ce3 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Returning 400 to user: Invalid port range 717001787:22. Former value cannot be greater than the later {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:30.458216 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-84c8aff4-d4ff-4f3b-b4d1-e84b1d9b7ce3 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.394442 Aug 25 12:52:30.472006 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 929/1857] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:52:30 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 409 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:30.485112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4913cb5d-f0fe-4ef0-9028-dd8c84aaa9b6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:30.489227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4913cb5d-f0fe-4ef0-9028-dd8c84aaa9b6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:30.512191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4913cb5d-f0fe-4ef0-9028-dd8c84aaa9b6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:30.526427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4913cb5d-f0fe-4ef0-9028-dd8c84aaa9b6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:30.527430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4913cb5d-f0fe-4ef0-9028-dd8c84aaa9b6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:30.528696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4913cb5d-f0fe-4ef0-9028-dd8c84aaa9b6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:30.530341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4913cb5d-f0fe-4ef0-9028-dd8c84aaa9b6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:30.531118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4913cb5d-f0fe-4ef0-9028-dd8c84aaa9b6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:30.794005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4913cb5d-f0fe-4ef0-9028-dd8c84aaa9b6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:30.838493 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4913cb5d-f0fe-4ef0-9028-dd8c84aaa9b6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1330 microversion: 2.1 time: 0.357137 Aug 25 12:52:30.847606 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 930/1858] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:30 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1330 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:30.870355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-58469368-5cbb-416f-ac6a-7d074b73ab61 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:30.874200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-58469368-5cbb-416f-ac6a-7d074b73ab61 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:30.906773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58469368-5cbb-416f-ac6a-7d074b73ab61 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:30.909623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58469368-5cbb-416f-ac6a-7d074b73ab61 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:30.914250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58469368-5cbb-416f-ac6a-7d074b73ab61 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:30.929463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58469368-5cbb-416f-ac6a-7d074b73ab61 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:30.930397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58469368-5cbb-416f-ac6a-7d074b73ab61 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:30.931185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58469368-5cbb-416f-ac6a-7d074b73ab61 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:31.297031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-58469368-5cbb-416f-ac6a-7d074b73ab61 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:31.334551 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-58469368-5cbb-416f-ac6a-7d074b73ab61 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1286 microversion: 2.1 time: 0.475497 Aug 25 12:52:31.336442 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 931/1859] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:30 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1286 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:31.359534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0e907d19-a350-4ff3-8134-378ea5b8cd83 req-614c921f-4371-4667-b3f0-1130f4661781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48685680-7e3d-4549-910a-a454c4951c15", "name": "network-vif-plugged", "status": "completed", "tag": "2b598070-a73d-4150-bcc3-b8737f88e7d3"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:31.381393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0e907d19-a350-4ff3-8134-378ea5b8cd83 req-614c921f-4371-4667-b3f0-1130f4661781 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:31.382391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0e907d19-a350-4ff3-8134-378ea5b8cd83 req-614c921f-4371-4667-b3f0-1130f4661781 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:31.383367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0e907d19-a350-4ff3-8134-378ea5b8cd83 req-614c921f-4371-4667-b3f0-1130f4661781 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:31.432776 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0e907d19-a350-4ff3-8134-378ea5b8cd83 req-614c921f-4371-4667-b3f0-1130f4661781 service nova] Creating event network-vif-plugged:2b598070-a73d-4150-bcc3-b8737f88e7d3 for instance 48685680-7e3d-4549-910a-a454c4951c15 on n-h2-852771-8 Aug 25 12:52:31.452221 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0e907d19-a350-4ff3-8134-378ea5b8cd83 req-614c921f-4371-4667-b3f0-1130f4661781 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110487 Aug 25 12:52:31.455539 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 932/1860] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:31.471950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be8b688c-3251-403c-8b96-14414f7dc50b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:31.474041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be8b688c-3251-403c-8b96-14414f7dc50b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:31.488862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be8b688c-3251-403c-8b96-14414f7dc50b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:31.490411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be8b688c-3251-403c-8b96-14414f7dc50b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:31.491856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be8b688c-3251-403c-8b96-14414f7dc50b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:31.493614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be8b688c-3251-403c-8b96-14414f7dc50b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:31.494879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be8b688c-3251-403c-8b96-14414f7dc50b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:31.496114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be8b688c-3251-403c-8b96-14414f7dc50b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:32.466250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-be8b688c-3251-403c-8b96-14414f7dc50b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:32.505838 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-be8b688c-3251-403c-8b96-14414f7dc50b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 200 len: 1527 microversion: 2.1 time: 1.042635 Aug 25 12:52:32.508675 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 933/1861] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:31 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 1527 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:32.561627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-669d437c-1e60-4a78-809b-cc06a98f8bea tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:32.569446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-669d437c-1e60-4a78-809b-cc06a98f8bea tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:32.606242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-669d437c-1e60-4a78-809b-cc06a98f8bea tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:32.607816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-669d437c-1e60-4a78-809b-cc06a98f8bea tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:32.608996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-669d437c-1e60-4a78-809b-cc06a98f8bea tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:32.610540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-669d437c-1e60-4a78-809b-cc06a98f8bea tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:32.611431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-669d437c-1e60-4a78-809b-cc06a98f8bea tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:32.612309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-669d437c-1e60-4a78-809b-cc06a98f8bea tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.317017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-669d437c-1e60-4a78-809b-cc06a98f8bea tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:33.340495 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-669d437c-1e60-4a78-809b-cc06a98f8bea tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1316 microversion: 2.1 time: 0.827207 Aug 25 12:52:33.353354 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 934/1862] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:32 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1316 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:33.371081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f866bca-e247-42b2-b3d9-07cbca7e94dc tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e801af0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2014368534", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:33.387445 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-1f866bca-e247-42b2-b3d9-07cbca7e94dc tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] HTTP exception thrown: Security group id should be uuid Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f866bca-e247-42b2-b3d9-07cbca7e94dc tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Request method failure captured: Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 131 Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3B8TTsXm5Tmdh54VS7NgcP2GacVDc_pUxRqo-cV9Bv2jFz_N1iqfDDRLUMknpkASNJsr830RyIEFScLlk8-5p4llfkMS_9kLL9hgsGvu-dYpOgXkh7FCOyDWVEjB1eO0DxHTgCMDqJrYF0i0KPajQ6_6vfWPqy9dUxmVyANJehFXgw Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1ffca10ca7b4196ba6e12a7904686d1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}] Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c18a5a6985c243b983f300e38f507f29 Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2014368534", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: exception: Security group id should be uuid Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2014368534', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:33.391163 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:33.402723 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 25 12:52:33.402723 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:33.402723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f866bca-e247-42b2-b3d9-07cbca7e94dc tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Returning 400 to user: Security group id should be uuid {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:33.402723 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f866bca-e247-42b2-b3d9-07cbca7e94dc tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.038366 Aug 25 12:52:33.409807 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 935/1863] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:52:33 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:52:33.422645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:33.424209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:33.451888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:33.453354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:33.454605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.456564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:33.459498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:33.461135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.611382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:33.643613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:33.647902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:33.650511 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-775ecd93-5193-4b22-8e75-028ea0e585cf tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1265 microversion: 2.25 time: 0.238315 Aug 25 12:52:33.670360 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 936/1864] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:33 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:33.693013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5780a02e-3f41-4c04-988d-168647ed5bb7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:33.694800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5780a02e-3f41-4c04-988d-168647ed5bb7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:33.713148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5780a02e-3f41-4c04-988d-168647ed5bb7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:33.714771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5780a02e-3f41-4c04-988d-168647ed5bb7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:33.715844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5780a02e-3f41-4c04-988d-168647ed5bb7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.722042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5780a02e-3f41-4c04-988d-168647ed5bb7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:33.723300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5780a02e-3f41-4c04-988d-168647ed5bb7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:33.725742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5780a02e-3f41-4c04-988d-168647ed5bb7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.994357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5780a02e-3f41-4c04-988d-168647ed5bb7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:34.032972 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5780a02e-3f41-4c04-988d-168647ed5bb7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1328 microversion: 2.1 time: 0.358975 Aug 25 12:52:34.044117 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 937/1865] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:33 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1328 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:34.075338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-03401121-834f-4df6-a170-9be8f89058ae req-d8b1675a-a7ad-465f-9743-7359ed71b84c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce5cde8-dd95-4c6f-b05f-802b0d47696a", "name": "network-vif-deleted", "tag": "24d4479c-4502-454a-81e4-e76f3810bd64"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:34.136942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-03401121-834f-4df6-a170-9be8f89058ae req-d8b1675a-a7ad-465f-9743-7359ed71b84c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:34.143343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-03401121-834f-4df6-a170-9be8f89058ae req-d8b1675a-a7ad-465f-9743-7359ed71b84c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:34.144645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-03401121-834f-4df6-a170-9be8f89058ae req-d8b1675a-a7ad-465f-9743-7359ed71b84c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:34.207196 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-03401121-834f-4df6-a170-9be8f89058ae req-d8b1675a-a7ad-465f-9743-7359ed71b84c service nova] Creating event network-vif-deleted:24d4479c-4502-454a-81e4-e76f3810bd64 for instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a on n-h1-852771-8 Aug 25 12:52:34.254058 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-03401121-834f-4df6-a170-9be8f89058ae req-d8b1675a-a7ad-465f-9743-7359ed71b84c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203715 Aug 25 12:52:34.257376 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 938/1866] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:34.310601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0fe31a46-965f-40dc-aa24-8aa291627148 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:34.312908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0fe31a46-965f-40dc-aa24-8aa291627148 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:34.328610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fe31a46-965f-40dc-aa24-8aa291627148 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:34.329799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fe31a46-965f-40dc-aa24-8aa291627148 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:34.330786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fe31a46-965f-40dc-aa24-8aa291627148 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:34.332211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fe31a46-965f-40dc-aa24-8aa291627148 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:34.333492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fe31a46-965f-40dc-aa24-8aa291627148 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:34.334845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fe31a46-965f-40dc-aa24-8aa291627148 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:35.481398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:35.543704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:35.577405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0fe31a46-965f-40dc-aa24-8aa291627148 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:35.606541 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0fe31a46-965f-40dc-aa24-8aa291627148 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1316 microversion: 2.1 time: 1.343357 Aug 25 12:52:35.608780 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 939/1867] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:34 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1316 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:35.674309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:35.815506 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4e760ad-f09c-4563-abed-606eae308e6a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/action" status: 202 len: 0 microversion: 2.1 time: 6.801804 Aug 25 12:52:35.817781 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 929/1868] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:52:29 2022] POST /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/action => generated 0 bytes in 6812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:52:35.843077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-39fdbb36-6f78-4ddc-92d8-93ad9c513855 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e8925e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-832309581", "description": "tempest-description-1981343147"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:36.033629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d7da0cc3-4ee5-4dd0-a2b8-fc2e2a18211c tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:36.041380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:36.075340 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d7da0cc3-4ee5-4dd0-a2b8-fc2e2a18211c tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.464044 Aug 25 12:52:36.077072 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 940/1869] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:52:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:36.102631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:36.104518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:36.126940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.132990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.138617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.140572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.144619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.146208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.182442 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a HTTP/1.1 Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '9ce5cde8-dd95-4c6f-b05f-802b0d47696a'} Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:36.187164 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:36.202330 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:36.202330 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:36.202330 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:36.202330 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:36.202330 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:36.202330 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:36.202330 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:52:36.202330 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:36.202330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 404 to user: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:36.204788 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-528f7a2b-68d6-421d-bac8-0081d48339a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 404 len: 111 microversion: 2.1 time: 0.119160 Aug 25 12:52:36.206776 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 941/1870] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:36 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:36.227307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-68e3e8f2-cebd-4993-b563-ae36dd42eae5 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:36.228824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-68e3e8f2-cebd-4993-b563-ae36dd42eae5 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:36.242589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e3e8f2-cebd-4993-b563-ae36dd42eae5 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.244107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e3e8f2-cebd-4993-b563-ae36dd42eae5 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.245087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e3e8f2-cebd-4993-b563-ae36dd42eae5 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.246655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e3e8f2-cebd-4993-b563-ae36dd42eae5 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.248904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e3e8f2-cebd-4993-b563-ae36dd42eae5 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.250208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68e3e8f2-cebd-4993-b563-ae36dd42eae5 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.291620 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-39fdbb36-6f78-4ddc-92d8-93ad9c513855 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.470523 Aug 25 12:52:36.292759 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 930/1871] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:52:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:36.317067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:36.322792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:36.349718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.350967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.354161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.358294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.359619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.361496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.556085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:36.577620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:36.582287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:36.585202 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4052845a-28b7-4cac-9371-d8f374225122 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1265 microversion: 2.25 time: 0.290174 Aug 25 12:52:36.587171 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 931/1872] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:36 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:36.597231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6547ebd6-ed08-48c0-aedb-b4d4f06c6367 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:36.602830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6547ebd6-ed08-48c0-aedb-b4d4f06c6367 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:36.620039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6547ebd6-ed08-48c0-aedb-b4d4f06c6367 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.622344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6547ebd6-ed08-48c0-aedb-b4d4f06c6367 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.625610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6547ebd6-ed08-48c0-aedb-b4d4f06c6367 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.627613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6547ebd6-ed08-48c0-aedb-b4d4f06c6367 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.628947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6547ebd6-ed08-48c0-aedb-b4d4f06c6367 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.630175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6547ebd6-ed08-48c0-aedb-b4d4f06c6367 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.723022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-68e3e8f2-cebd-4993-b563-ae36dd42eae5 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:36.742268 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-68e3e8f2-cebd-4993-b563-ae36dd42eae5 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1503 microversion: 2.1 time: 0.533261 Aug 25 12:52:36.743687 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 942/1873] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:36 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1503 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:36.752101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-76527486-dd6e-4f16-a0de-66b11dd2af5d tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:36.755904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-76527486-dd6e-4f16-a0de-66b11dd2af5d tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:36.767457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76527486-dd6e-4f16-a0de-66b11dd2af5d tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.769338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76527486-dd6e-4f16-a0de-66b11dd2af5d tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.770313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76527486-dd6e-4f16-a0de-66b11dd2af5d tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.774391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76527486-dd6e-4f16-a0de-66b11dd2af5d tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.777481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76527486-dd6e-4f16-a0de-66b11dd2af5d tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.778813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76527486-dd6e-4f16-a0de-66b11dd2af5d tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:37.001179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6547ebd6-ed08-48c0-aedb-b4d4f06c6367 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:37.017736 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6547ebd6-ed08-48c0-aedb-b4d4f06c6367 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1396 microversion: 2.1 time: 0.428244 Aug 25 12:52:37.030606 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 932/1874] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:36 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1396 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:37.057846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4974a695-f027-4fde-b58f-2414d1d85829 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:37.101591 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4974a695-f027-4fde-b58f-2414d1d85829 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.068995 Aug 25 12:52:37.102990 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 933/1875] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 12:52:37 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:37.110181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9cb81769-d0d9-4d66-96fb-935ab05b2f2a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Action: 'create', calling method: .version_select at 0x7f3a2a004430>, body: {"keypair": {"name": "tempest-keypair-15364557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7IM2J0M186gyR/Be6/cRqNJnarVBZul6rkuLVZviUumLg1BNLasiF7nybRRzS+lMBgo2gn+uKZ0mKte4VRgZCMYgY57KGH5+ocOyEKx45B+GBg243c6ahCMK8tfkNlTA=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:37.128329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-76527486-dd6e-4f16-a0de-66b11dd2af5d tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:37.148670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-9cb81769-d0d9-4d66-96fb-935ab05b2f2a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Getting quotas for project d43be46fe4e84396b73fbdca834b3525. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:37.151921 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-76527486-dd6e-4f16-a0de-66b11dd2af5d tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 0.406254 Aug 25 12:52:37.153133 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 943/1876] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:36 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:37.160812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66bfb28a-c2b6-4fa3-ad44-3448d6b2d3f1 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e7c55e0>, body: {"security_group_rule": {"parent_group_id": "ad66dc99-15e8-4010-a061-4e0d994e4436", "ip_protocol": "tempest-999-1322975693", "from_port": 22, "to_port": 22}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:37.176431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-9cb81769-d0d9-4d66-96fb-935ab05b2f2a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Getting quotas for user 74d9b7c3351f44b9b986e6535fc62819 and project d43be46fe4e84396b73fbdca834b3525. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:37.219874 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9cb81769-d0d9-4d66-96fb-935ab05b2f2a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.114644 Aug 25 12:52:37.230174 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 934/1877] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:52:37 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:37.237038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9320f48a-f7ca-4b70-b705-f5a73f0db8aa req-ffbc818f-8f65-404b-baed-0ee9dc4c36d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca859734-6370-48aa-b3c3-22ff3362f6b1", "name": "network-vif-deleted", "tag": "e899f17a-afed-4127-8666-0bdca4cad26c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:37.259476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9320f48a-f7ca-4b70-b705-f5a73f0db8aa req-ffbc818f-8f65-404b-baed-0ee9dc4c36d0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:37.260674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9320f48a-f7ca-4b70-b705-f5a73f0db8aa req-ffbc818f-8f65-404b-baed-0ee9dc4c36d0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:37.261553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9320f48a-f7ca-4b70-b705-f5a73f0db8aa req-ffbc818f-8f65-404b-baed-0ee9dc4c36d0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:37.287598 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9320f48a-f7ca-4b70-b705-f5a73f0db8aa req-ffbc818f-8f65-404b-baed-0ee9dc4c36d0 service nova] Creating event network-vif-deleted:e899f17a-afed-4127-8666-0bdca4cad26c for instance ca859734-6370-48aa-b3c3-22ff3362f6b1 on n-h2-852771-8 Aug 25 12:52:37.297875 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9320f48a-f7ca-4b70-b705-f5a73f0db8aa req-ffbc818f-8f65-404b-baed-0ee9dc4c36d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074341 Aug 25 12:52:37.300664 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 935/1878] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:37.312971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eb293fe0-67c5-452e-96da-d72931769263 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:37.314401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb293fe0-67c5-452e-96da-d72931769263 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:37.323513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb293fe0-67c5-452e-96da-d72931769263 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:37.324465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb293fe0-67c5-452e-96da-d72931769263 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:37.325153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb293fe0-67c5-452e-96da-d72931769263 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:37.327597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb293fe0-67c5-452e-96da-d72931769263 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:37.328672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb293fe0-67c5-452e-96da-d72931769263 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:37.329532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb293fe0-67c5-452e-96da-d72931769263 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:37.489600 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-66bfb28a-c2b6-4fa3-ad44-3448d6b2d3f1 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] HTTP exception thrown: Invalid IP protocol tempest-999-1322975693. Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66bfb28a-c2b6-4fa3-ad44-3448d6b2d3f1 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Request method failure captured: Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 157 Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3B8TTsXm5Tmdh54VS7NgcP2GacVDc_pUxRqo-cV9Bv2jFz_N1iqfDDRLUMknpkASNJsr830RyIEFScLlk8-5p4llfkMS_9kLL9hgsGvu-dYpOgXkh7FCOyDWVEjB1eO0DxHTgCMDqJrYF0i0KPajQ6_6vfWPqy9dUxmVyANJehFXgw Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1ffca10ca7b4196ba6e12a7904686d1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}] Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c18a5a6985c243b983f300e38f507f29 Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: {"security_group_rule": {"parent_group_id": "ad66dc99-15e8-4010-a061-4e0d994e4436", "ip_protocol": "tempest-999-1322975693", "from_port": 22, "to_port": 22}} Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid IP protocol tempest-999-1322975693. Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ad66dc99-15e8-4010-a061-4e0d994e4436', 'ip_protocol': 'tempest-999-1322975693', 'from_port': 22, 'to_port': 22}}} Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1322975693. Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1322975693. Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.492273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1322975693. Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66bfb28a-c2b6-4fa3-ad44-3448d6b2d3f1 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Returning 400 to user: Invalid IP protocol tempest-999-1322975693. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66bfb28a-c2b6-4fa3-ad44-3448d6b2d3f1 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.339487 Aug 25 12:52:37.508919 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 944/1879] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:52:37 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:52:37.526089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efc89757-9c20-4adf-ab1a-9567db64b19d tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:37.527087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-efc89757-9c20-4adf-ab1a-9567db64b19d tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:37.545854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efc89757-9c20-4adf-ab1a-9567db64b19d tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:37.546750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efc89757-9c20-4adf-ab1a-9567db64b19d tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:37.548326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efc89757-9c20-4adf-ab1a-9567db64b19d tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:37.548902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efc89757-9c20-4adf-ab1a-9567db64b19d tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:37.549826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efc89757-9c20-4adf-ab1a-9567db64b19d tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:37.550635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efc89757-9c20-4adf-ab1a-9567db64b19d tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:37.620279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-efc89757-9c20-4adf-ab1a-9567db64b19d tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:52:37.688049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:37.844106 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-efc89757-9c20-4adf-ab1a-9567db64b19d tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "DELETE /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 204 len: 0 microversion: 2.1 time: 0.329590 Aug 25 12:52:37.853273 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 945/1880] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:52:37 2022] DELETE /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:52:37.863791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-33de991e-6a71-444d-ac91-953e3f1fb47f tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:37.881707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eb293fe0-67c5-452e-96da-d72931769263 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:37.890701 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-33de991e-6a71-444d-ac91-953e3f1fb47f tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034741 Aug 25 12:52:37.891709 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 946/1881] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:52:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:37.911552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86a3d84b-53c5-4cb2-a108-9631306a0014 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e81e310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1662289647", "description": "tempest-description-1790395469"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:37.912780 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eb293fe0-67c5-452e-96da-d72931769263 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1316 microversion: 2.1 time: 0.609433 Aug 25 12:52:37.914256 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 936/1882] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:37 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1316 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:37.938748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:37.941060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:37.955036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:37.956433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:37.957601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:37.959591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:37.961754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:37.962906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:38.187153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:38.204890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:38.209001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:38.216032 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-04d273aa-b42a-46b9-9557-8ad65fef49cd tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1265 microversion: 2.25 time: 0.300203 Aug 25 12:52:38.218640 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 937/1883] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:37 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:38.230304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bc6df895-08c1-4d1e-a3e9-fdcaf9b67494 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:38.235106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bc6df895-08c1-4d1e-a3e9-fdcaf9b67494 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:38.259861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc6df895-08c1-4d1e-a3e9-fdcaf9b67494 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:38.261227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc6df895-08c1-4d1e-a3e9-fdcaf9b67494 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:38.262460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc6df895-08c1-4d1e-a3e9-fdcaf9b67494 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:38.270869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc6df895-08c1-4d1e-a3e9-fdcaf9b67494 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:38.272344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc6df895-08c1-4d1e-a3e9-fdcaf9b67494 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:38.273554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc6df895-08c1-4d1e-a3e9-fdcaf9b67494 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:38.323276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:38.439719 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-86a3d84b-53c5-4cb2-a108-9631306a0014 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.545979 Aug 25 12:52:38.441614 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 947/1884] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:52:37 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:38.452319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0bdc8944-ca0b-44bc-8030-12e30f0f7c59 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:38.475084 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0bdc8944-ca0b-44bc-8030-12e30f0f7c59 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031229 Aug 25 12:52:38.476957 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 948/1885] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:52:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:38.493115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ffed902a-cf05-4d47-8254-f1761d7303f4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:38.499159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ffed902a-cf05-4d47-8254-f1761d7303f4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:38.511013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffed902a-cf05-4d47-8254-f1761d7303f4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:38.511968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffed902a-cf05-4d47-8254-f1761d7303f4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:38.512521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffed902a-cf05-4d47-8254-f1761d7303f4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:38.513893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffed902a-cf05-4d47-8254-f1761d7303f4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:38.516763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffed902a-cf05-4d47-8254-f1761d7303f4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:38.521018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffed902a-cf05-4d47-8254-f1761d7303f4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:38.862744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bc6df895-08c1-4d1e-a3e9-fdcaf9b67494 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:38.880176 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bc6df895-08c1-4d1e-a3e9-fdcaf9b67494 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1509 microversion: 2.1 time: 0.658115 Aug 25 12:52:38.894871 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 938/1886] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:38 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1509 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:38.915001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6e29fc86-110f-4d2d-b97a-13f3c75ac115 req-007e579d-e484-42ee-a1c9-b238ce7bfa66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e6d243-78f0-4af2-9799-9c8b0b34266b", "tag": "08c1c882-e962-4f32-bdbf-8593018a711c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:38.947790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6e29fc86-110f-4d2d-b97a-13f3c75ac115 req-007e579d-e484-42ee-a1c9-b238ce7bfa66 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:38.948676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6e29fc86-110f-4d2d-b97a-13f3c75ac115 req-007e579d-e484-42ee-a1c9-b238ce7bfa66 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:38.949474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6e29fc86-110f-4d2d-b97a-13f3c75ac115 req-007e579d-e484-42ee-a1c9-b238ce7bfa66 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:38.975289 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6e29fc86-110f-4d2d-b97a-13f3c75ac115 req-007e579d-e484-42ee-a1c9-b238ce7bfa66 service nova] Creating event network-changed:08c1c882-e962-4f32-bdbf-8593018a711c for instance b8e6d243-78f0-4af2-9799-9c8b0b34266b on n-h1-852771-8 Aug 25 12:52:38.984279 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6e29fc86-110f-4d2d-b97a-13f3c75ac115 req-007e579d-e484-42ee-a1c9-b238ce7bfa66 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087091 Aug 25 12:52:38.986058 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 939/1887] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:38.996102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf27088e-1bbb-43d9-acac-1b81ba59564c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:38.997777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cf27088e-1bbb-43d9-acac-1b81ba59564c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:39.010610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf27088e-1bbb-43d9-acac-1b81ba59564c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.011521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf27088e-1bbb-43d9-acac-1b81ba59564c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.012327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf27088e-1bbb-43d9-acac-1b81ba59564c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.014896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf27088e-1bbb-43d9-acac-1b81ba59564c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.015665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf27088e-1bbb-43d9-acac-1b81ba59564c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.016685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf27088e-1bbb-43d9-acac-1b81ba59564c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.080197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ffed902a-cf05-4d47-8254-f1761d7303f4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:39.106272 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ffed902a-cf05-4d47-8254-f1761d7303f4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1396 microversion: 2.1 time: 0.626642 Aug 25 12:52:39.110718 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 949/1888] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:38 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1396 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:39.121749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a5419b4-f633-4fb4-be9f-41b835a8cc5e tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e86a280>, body: {"security_group_rule": {"parent_group_id": "ef526d5e-99ee-4650-b137-1eecfce92bb9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:39.346967 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-0a5419b4-f633-4fb4-be9f-41b835a8cc5e tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a5419b4-f633-4fb4-be9f-41b835a8cc5e tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Request method failure captured: Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 138 Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3B8TTsXm5Tmdh54VS7NgcP2GacVDc_pUxRqo-cV9Bv2jFz_N1iqfDDRLUMknpkASNJsr830RyIEFScLlk8-5p4llfkMS_9kLL9hgsGvu-dYpOgXkh7FCOyDWVEjB1eO0DxHTgCMDqJrYF0i0KPajQ6_6vfWPqy9dUxmVyANJehFXgw Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1ffca10ca7b4196ba6e12a7904686d1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}] Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c18a5a6985c243b983f300e38f507f29 Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: {"security_group_rule": {"parent_group_id": "ef526d5e-99ee-4650-b137-1eecfce92bb9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ef526d5e-99ee-4650-b137-1eecfce92bb9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 25 12:52:39.351217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:39.361586 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:39.361586 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:39.361586 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:39.361586 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:39.361586 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:39.361586 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:39.361586 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:39.361586 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 25 12:52:39.361586 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:39.361586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a5419b4-f633-4fb4-be9f-41b835a8cc5e tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:39.363667 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a5419b4-f633-4fb4-be9f-41b835a8cc5e tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.243915 Aug 25 12:52:39.373650 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 950/1889] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:52:39 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:39.391995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b4603f9-2982-43e0-a3ab-cae1d4f9edc0 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:39.508656 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b4603f9-2982-43e0-a3ab-cae1d4f9edc0 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.133217 Aug 25 12:52:39.521560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 951/1890] 10.222.0.70 () {58 vars in 1165 bytes} [Thu Aug 25 12:52:39 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:39.535136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-13afb809-3824-4725-9c65-8581ec69114d tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:39.535569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-13afb809-3824-4725-9c65-8581ec69114d tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:39.561656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13afb809-3824-4725-9c65-8581ec69114d tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.562942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cf27088e-1bbb-43d9-acac-1b81ba59564c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:39.563661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13afb809-3824-4725-9c65-8581ec69114d tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.564852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13afb809-3824-4725-9c65-8581ec69114d tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.566632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13afb809-3824-4725-9c65-8581ec69114d tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.568782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13afb809-3824-4725-9c65-8581ec69114d tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.570094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13afb809-3824-4725-9c65-8581ec69114d tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.605626 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cf27088e-1bbb-43d9-acac-1b81ba59564c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 0.617159 Aug 25 12:52:39.611011 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 940/1891] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:38 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:39.626833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:39.634755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:39.647085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:39.659957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.666692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.670808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.677705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.678975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.680070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.879269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:39.908746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:39.913477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:39.916701 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9450b2b1-0f4f-43e8-9511-79a9b5d17441 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1265 microversion: 2.25 time: 0.303370 Aug 25 12:52:39.918225 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 941/1892] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:39 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:39.957636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2106e35c-6fc5-49ff-8a0c-3e5b8ffce4f8 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2a02daf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1352152021", "description": "tempest-description-1005855555"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:40.101688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-13afb809-3824-4725-9c65-8581ec69114d tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:40.125796 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-13afb809-3824-4725-9c65-8581ec69114d tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1316 microversion: 2.1 time: 0.614295 Aug 25 12:52:40.127342 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 952/1893] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:39 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:40.137406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f071a6e-400c-4b24-b825-e93e3beab5b4 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:40.156421 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f071a6e-400c-4b24-b825-e93e3beab5b4 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027265 Aug 25 12:52:40.157957 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 953/1894] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:52:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:40.174452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f98b1d4c-0bb8-4790-bceb-808288740bae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:40.175879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f98b1d4c-0bb8-4790-bceb-808288740bae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:40.203873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f98b1d4c-0bb8-4790-bceb-808288740bae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:40.204750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f98b1d4c-0bb8-4790-bceb-808288740bae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:40.214291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f98b1d4c-0bb8-4790-bceb-808288740bae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:40.216310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f98b1d4c-0bb8-4790-bceb-808288740bae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:40.217271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f98b1d4c-0bb8-4790-bceb-808288740bae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:40.218448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f98b1d4c-0bb8-4790-bceb-808288740bae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:40.516388 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2106e35c-6fc5-49ff-8a0c-3e5b8ffce4f8 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.579282 Aug 25 12:52:40.517782 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 942/1895] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:52:39 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:40.537381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec9cdf39-4581-4289-89b8-b6f3998d97bb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:40.541014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ec9cdf39-4581-4289-89b8-b6f3998d97bb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:40.591327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec9cdf39-4581-4289-89b8-b6f3998d97bb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:40.605649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec9cdf39-4581-4289-89b8-b6f3998d97bb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:40.605649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec9cdf39-4581-4289-89b8-b6f3998d97bb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:40.633689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec9cdf39-4581-4289-89b8-b6f3998d97bb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:40.635723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec9cdf39-4581-4289-89b8-b6f3998d97bb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:40.636908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec9cdf39-4581-4289-89b8-b6f3998d97bb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:40.885968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f98b1d4c-0bb8-4790-bceb-808288740bae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:40.903574 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f98b1d4c-0bb8-4790-bceb-808288740bae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1509 microversion: 2.1 time: 0.743681 Aug 25 12:52:40.925570 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 954/1896] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:40 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1509 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:40.925570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-90684539-c3a7-43c5-949f-ee8dd2a0d139 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:41.004640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ec9cdf39-4581-4289-89b8-b6f3998d97bb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:41.023790 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-90684539-c3a7-43c5-949f-ee8dd2a0d139 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.115615 Aug 25 12:52:41.025378 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 955/1897] 10.222.0.70 () {58 vars in 1169 bytes} [Thu Aug 25 12:52:40 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:41.038686 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ec9cdf39-4581-4289-89b8-b6f3998d97bb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1396 microversion: 2.1 time: 0.505737 Aug 25 12:52:41.042114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-36809f42-f728-45c9-96a2-f4383025ef49 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e868a60>, body: {"security_group_rule": {"parent_group_id": "294ba247-d131-434a-945d-151d4b1a7c5e", "ip_protocol": "tcp", "from_port": 22, "to_port": 1693341327}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:41.058239 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 943/1898] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:40 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1396 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:41.077429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fcb77bed-30c4-46c3-814e-32b800239247 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:41.080821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fcb77bed-30c4-46c3-814e-32b800239247 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:41.098227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcb77bed-30c4-46c3-814e-32b800239247 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.099185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcb77bed-30c4-46c3-814e-32b800239247 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.100038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcb77bed-30c4-46c3-814e-32b800239247 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.101457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcb77bed-30c4-46c3-814e-32b800239247 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.102375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcb77bed-30c4-46c3-814e-32b800239247 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.103196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcb77bed-30c4-46c3-814e-32b800239247 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.193222 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-36809f42-f728-45c9-96a2-f4383025ef49 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] HTTP exception thrown: Invalid port range 22:1693341327. Valid TCP ports should be between 1-65535 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-36809f42-f728-45c9-96a2-f4383025ef49 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Request method failure captured: Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 146 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3B8TTsXm5Tmdh54VS7NgcP2GacVDc_pUxRqo-cV9Bv2jFz_N1iqfDDRLUMknpkASNJsr830RyIEFScLlk8-5p4llfkMS_9kLL9hgsGvu-dYpOgXkh7FCOyDWVEjB1eO0DxHTgCMDqJrYF0i0KPajQ6_6vfWPqy9dUxmVyANJehFXgw Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1ffca10ca7b4196ba6e12a7904686d1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}] Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c18a5a6985c243b983f300e38f507f29 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: {"security_group_rule": {"parent_group_id": "294ba247-d131-434a-945d-151d4b1a7c5e", "ip_protocol": "tcp", "from_port": 22, "to_port": 1693341327}} Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid port range 22:1693341327. Valid TCP ports should be between 1-65535 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'security_group_rule': {'parent_group_id': '294ba247-d131-434a-945d-151d4b1a7c5e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1693341327}}} Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1693341327. Valid TCP ports should be between 1-65535 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1693341327. Valid TCP ports should be between 1-65535 Aug 25 12:52:41.197493 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.207815 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:41.207815 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.207815 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.207815 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:41.207815 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:41.207815 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:41.207815 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:41.207815 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1693341327. Valid TCP ports should be between 1-65535 Aug 25 12:52:41.207815 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.210900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-36809f42-f728-45c9-96a2-f4383025ef49 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Returning 400 to user: Invalid port range 22:1693341327. Valid TCP ports should be between 1-65535 {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:41.213033 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-36809f42-f728-45c9-96a2-f4383025ef49 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.185606 Aug 25 12:52:41.222867 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 956/1899] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:52:41 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:41.233987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:41.236023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:41.251646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.253037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.254332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.256279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.257617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.258778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.436224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:41.460910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:41.465813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:41.468729 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc78300a-d6ad-46e5-8c0d-bf8affa2594c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1265 microversion: 2.25 time: 0.243301 Aug 25 12:52:41.473654 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 957/1900] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:41 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:41.494281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e1263355-b056-42d6-b245-b2ee5c375668 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:41.529336 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e1263355-b056-42d6-b245-b2ee5c375668 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.052233 Aug 25 12:52:41.538484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fcb77bed-30c4-46c3-814e-32b800239247 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:41.539767 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 958/1901] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 12:52:41 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:41.562070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6bc44909-2795-41ab-9fdd-3497a25614b0 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:41.563811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6bc44909-2795-41ab-9fdd-3497a25614b0 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:41.566421 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fcb77bed-30c4-46c3-814e-32b800239247 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 0.515052 Aug 25 12:52:41.568193 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 944/1902] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:41 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:41.584424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bc44909-2795-41ab-9fdd-3497a25614b0 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.589101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cfe9c6e0-7dec-4b46-b559-688276a8c825 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Action: 'create', calling method: .version_select at 0x7f3a2e922ca0>, body: {"security_group_rule": {"parent_group_id": "1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:41.597864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bc44909-2795-41ab-9fdd-3497a25614b0 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.599212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bc44909-2795-41ab-9fdd-3497a25614b0 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.601177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bc44909-2795-41ab-9fdd-3497a25614b0 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.602724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bc44909-2795-41ab-9fdd-3497a25614b0 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.603924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6bc44909-2795-41ab-9fdd-3497a25614b0 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.655574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-cfe9c6e0-7dec-4b46-b559-688276a8c825 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3 does not exist", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:52:41.655802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.security_group_api [None req-cfe9c6e0-7dec-4b46-b559-688276a8c825 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Neutron security group 1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3 not found {{(pid=129059) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:52:41.661553 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-cfe9c6e0-7dec-4b46-b559-688276a8c825 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] HTTP exception thrown: Security group 1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3 does not exist Aug 25 12:52:41.661553 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-dffa3d95-5c94-44c2-813a-abffceb2bad1'] Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cfe9c6e0-7dec-4b46-b559-688276a8c825 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Request method failure captured: Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 138 Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3B8TTsXm5Tmdh54VS7NgcP2GacVDc_pUxRqo-cV9Bv2jFz_N1iqfDDRLUMknpkASNJsr830RyIEFScLlk8-5p4llfkMS_9kLL9hgsGvu-dYpOgXkh7FCOyDWVEjB1eO0DxHTgCMDqJrYF0i0KPajQ6_6vfWPqy9dUxmVyANJehFXgw Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1ffca10ca7b4196ba6e12a7904686d1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}] Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: c18a5a6985c243b983f300e38f507f29 Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: {"security_group_rule": {"parent_group_id": "1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: exception: Security group 1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3 does not exist Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-dffa3d95-5c94-44c2-813a-abffceb2bad1'] Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:52:41.669159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3 does not exist Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dffa3d95-5c94-44c2-813a-abffceb2bad1'] Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3 does not exist Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dffa3d95-5c94-44c2-813a-abffceb2bad1'] Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3 does not exist Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dffa3d95-5c94-44c2-813a-abffceb2bad1'] Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3 does not exist Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dffa3d95-5c94-44c2-813a-abffceb2bad1'] Aug 25 12:52:41.678600 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.687233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cfe9c6e0-7dec-4b46-b559-688276a8c825 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Returning 404 to user: Security group 1d1f8ebe-5ecb-49fb-a7a5-d09d40c6f6f3 does not exist Aug 25 12:52:41.687233 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-dffa3d95-5c94-44c2-813a-abffceb2bad1'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:41.688877 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cfe9c6e0-7dec-4b46-b559-688276a8c825 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.118048 Aug 25 12:52:41.691766 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 945/1903] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:52:41 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:41.704284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-448332c3-2ded-4621-a89c-b1725f1ac704 req-eb967f63-3645-4eed-9e7c-daa7b2b3dc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93190d43-5b60-464e-a1d4-ee5aba5f70e9", "tag": "336bb7d1-c5c5-48d1-8ae0-a6689485d1f5"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:41.726931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-448332c3-2ded-4621-a89c-b1725f1ac704 req-eb967f63-3645-4eed-9e7c-daa7b2b3dc77 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.727869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-448332c3-2ded-4621-a89c-b1725f1ac704 req-eb967f63-3645-4eed-9e7c-daa7b2b3dc77 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.728767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-448332c3-2ded-4621-a89c-b1725f1ac704 req-eb967f63-3645-4eed-9e7c-daa7b2b3dc77 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.752285 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-448332c3-2ded-4621-a89c-b1725f1ac704 req-eb967f63-3645-4eed-9e7c-daa7b2b3dc77 service nova] Creating event network-changed:336bb7d1-c5c5-48d1-8ae0-a6689485d1f5 for instance 93190d43-5b60-464e-a1d4-ee5aba5f70e9 on n-h1-852771-8 Aug 25 12:52:41.761711 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-448332c3-2ded-4621-a89c-b1725f1ac704 req-eb967f63-3645-4eed-9e7c-daa7b2b3dc77 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067030 Aug 25 12:52:41.765124 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 946/1904] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:41.774395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-967e8451-1520-4e39-943a-08ba3cbc5566 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:41.793627 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-967e8451-1520-4e39-943a-08ba3cbc5566 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026232 Aug 25 12:52:41.795931 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 947/1905] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:52:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:41.819389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e4b191b-d5f2-48a1-84e0-a6a62280bc3b tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Calling method '.version_select at 0x7f3a2e9225e0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:41.905291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-8e4b191b-d5f2-48a1-84e0-a6a62280bc3b tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 73dcef48-6fa2-495d-930b-0eb024f93b05 does not exist", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:52:41.908353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.security_group_api [None req-8e4b191b-d5f2-48a1-84e0-a6a62280bc3b tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Neutron security group rule 73dcef48-6fa2-495d-930b-0eb024f93b05 not found {{(pid=129059) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 25 12:52:41.910328 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8e4b191b-d5f2-48a1-84e0-a6a62280bc3b tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] HTTP exception thrown: Security group rule 73dcef48-6fa2-495d-930b-0eb024f93b05 does not exist Aug 25 12:52:41.910328 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-bce10a2d-b4f8-435c-a663-328365a5d674'] Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e4b191b-d5f2-48a1-84e0-a6a62280bc3b tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Request method failure captured: Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-security-group-rules/73dcef48-6fa2-495d-930b-0eb024f93b05 HTTP/1.1 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3B8TTsXm5Tmdh54VS7NgcP2GacVDc_pUxRqo-cV9Bv2jFz_N1iqfDDRLUMknpkASNJsr830RyIEFScLlk8-5p4llfkMS_9kLL9hgsGvu-dYpOgXkh7FCOyDWVEjB1eO0DxHTgCMDqJrYF0i0KPajQ6_6vfWPqy9dUxmVyANJehFXgw Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1ffca10ca7b4196ba6e12a7904686d1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1ffca10ca7b4196ba6e12a7904686d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1ffca10ca7b4196ba6e12a7904686d1"}]}] Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: e1ffca10ca7b4196ba6e12a7904686d1 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: c18a5a6985c243b983f300e38f507f29 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: exception: Security group rule 73dcef48-6fa2-495d-930b-0eb024f93b05 does not exist Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-bce10a2d-b4f8-435c-a663-328365a5d674'] Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '73dcef48-6fa2-495d-930b-0eb024f93b05'} Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:52:41.916980 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 73dcef48-6fa2-495d-930b-0eb024f93b05 does not exist Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bce10a2d-b4f8-435c-a663-328365a5d674'] Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 73dcef48-6fa2-495d-930b-0eb024f93b05 does not exist Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bce10a2d-b4f8-435c-a663-328365a5d674'] Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 73dcef48-6fa2-495d-930b-0eb024f93b05 does not exist Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bce10a2d-b4f8-435c-a663-328365a5d674'] Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 73dcef48-6fa2-495d-930b-0eb024f93b05 does not exist Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bce10a2d-b4f8-435c-a663-328365a5d674'] Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e4b191b-d5f2-48a1-84e0-a6a62280bc3b tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Returning 404 to user: Security group rule 73dcef48-6fa2-495d-930b-0eb024f93b05 does not exist Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-bce10a2d-b4f8-435c-a663-328365a5d674'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:41.928613 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e4b191b-d5f2-48a1-84e0-a6a62280bc3b tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/73dcef48-6fa2-495d-930b-0eb024f93b05" status: 404 len: 199 microversion: 2.1 time: 0.114734 Aug 25 12:52:41.942180 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 948/1906] 10.222.0.70 () {58 vars in 1287 bytes} [Thu Aug 25 12:52:41 2022] DELETE /compute/v2.1/os-security-group-rules/73dcef48-6fa2-495d-930b-0eb024f93b05 => generated 199 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:41.952087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9cdfbeb9-bd33-4db0-8c49-f9d1b9299f90 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:42.044429 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9cdfbeb9-bd33-4db0-8c49-f9d1b9299f90 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.100438 Aug 25 12:52:42.059338 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 949/1907] 10.222.0.70 () {58 vars in 1167 bytes} [Thu Aug 25 12:52:41 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:42.059662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6bc44909-2795-41ab-9fdd-3497a25614b0 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:42.059993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3eddc98d-3ff4-407e-b86b-1d3366ab8fe0 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Calling method '.version_select at 0x7f3a2e922820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:42.082939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6bc44909-2795-41ab-9fdd-3497a25614b0 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1316 microversion: 2.1 time: 0.537049 Aug 25 12:52:42.084056 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 959/1908] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:41 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:42.111650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b9991e7-9b30-4cbb-ace3-a86e6e64c5e8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:42.112350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b9991e7-9b30-4cbb-ace3-a86e6e64c5e8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:42.125131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9991e7-9b30-4cbb-ace3-a86e6e64c5e8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:42.126898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9991e7-9b30-4cbb-ace3-a86e6e64c5e8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:42.128229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9991e7-9b30-4cbb-ace3-a86e6e64c5e8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:42.130146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9991e7-9b30-4cbb-ace3-a86e6e64c5e8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:42.131568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9991e7-9b30-4cbb-ace3-a86e6e64c5e8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:42.132778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9991e7-9b30-4cbb-ace3-a86e6e64c5e8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:42.600534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b9991e7-9b30-4cbb-ace3-a86e6e64c5e8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc6134f93e044dda11bb83fc863960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a4e9ad75194e4ba441873f2258146b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:42.624812 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b9991e7-9b30-4cbb-ace3-a86e6e64c5e8 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 200 len: 1509 microversion: 2.1 time: 0.535642 Aug 25 12:52:42.627450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 960/1909] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:42 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 1509 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:42.662716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2b34d07-5b3a-4af4-a7a8-54435fb14dcd tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:42.683887 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e2b34d07-5b3a-4af4-a7a8-54435fb14dcd tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.048523 Aug 25 12:52:42.686469 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 961/1910] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:52:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:42.697931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-183bf2c4-4247-489c-98ef-b0bb0db91689 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:42.699640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-183bf2c4-4247-489c-98ef-b0bb0db91689 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:42.717410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183bf2c4-4247-489c-98ef-b0bb0db91689 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:42.720622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183bf2c4-4247-489c-98ef-b0bb0db91689 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:42.721651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183bf2c4-4247-489c-98ef-b0bb0db91689 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:42.723128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183bf2c4-4247-489c-98ef-b0bb0db91689 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:42.724056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183bf2c4-4247-489c-98ef-b0bb0db91689 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:42.724845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-183bf2c4-4247-489c-98ef-b0bb0db91689 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:42.868701 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3eddc98d-3ff4-407e-b86b-1d3366ab8fe0 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/294ba247-d131-434a-945d-151d4b1a7c5e" status: 202 len: 0 microversion: 2.1 time: 0.819631 Aug 25 12:52:42.879617 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 950/1911] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:52:42 2022] DELETE /compute/v2.1/os-security-groups/294ba247-d131-434a-945d-151d4b1a7c5e => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:52:42.895624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-eb75edd0-5a00-46cf-a878-9ae2ea9a8976 req-9844fe35-6e62-419f-86fb-292f34a93b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48685680-7e3d-4549-910a-a454c4951c15", "name": "network-vif-unplugged", "status": "completed", "tag": "2b598070-a73d-4150-bcc3-b8737f88e7d3"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:42.933004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-eb75edd0-5a00-46cf-a878-9ae2ea9a8976 req-9844fe35-6e62-419f-86fb-292f34a93b7b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:42.942987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-eb75edd0-5a00-46cf-a878-9ae2ea9a8976 req-9844fe35-6e62-419f-86fb-292f34a93b7b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:42.948398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-eb75edd0-5a00-46cf-a878-9ae2ea9a8976 req-9844fe35-6e62-419f-86fb-292f34a93b7b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:43.022848 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-eb75edd0-5a00-46cf-a878-9ae2ea9a8976 req-9844fe35-6e62-419f-86fb-292f34a93b7b service nova] Creating event network-vif-unplugged:2b598070-a73d-4150-bcc3-b8737f88e7d3 for instance 48685680-7e3d-4549-910a-a454c4951c15 on n-h2-852771-8 Aug 25 12:52:43.035811 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-eb75edd0-5a00-46cf-a878-9ae2ea9a8976 req-9844fe35-6e62-419f-86fb-292f34a93b7b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153519 Aug 25 12:52:43.037113 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 951/1912] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:43.046955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:43.048472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:43.068714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:43.069937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:43.073750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:43.079200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:43.080407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:43.081486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:43.128902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-183bf2c4-4247-489c-98ef-b0bb0db91689 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:43.147927 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-183bf2c4-4247-489c-98ef-b0bb0db91689 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1396 microversion: 2.1 time: 0.459097 Aug 25 12:52:43.149338 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 962/1913] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:42 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1396 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:43.158823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02f82b24-90d2-4218-9c29-2d28a89d284b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:43.160579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02f82b24-90d2-4218-9c29-2d28a89d284b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:43.172384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f82b24-90d2-4218-9c29-2d28a89d284b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:43.174668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f82b24-90d2-4218-9c29-2d28a89d284b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:43.176579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f82b24-90d2-4218-9c29-2d28a89d284b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:43.180798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f82b24-90d2-4218-9c29-2d28a89d284b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:43.183859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f82b24-90d2-4218-9c29-2d28a89d284b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:43.183859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f82b24-90d2-4218-9c29-2d28a89d284b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:43.268592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:43.287562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:43.290551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:43.293416 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d2cb15f1-b17f-45f0-938f-93eb6a3a45ef tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 200 len: 1265 microversion: 2.25 time: 0.255128 Aug 25 12:52:43.314423 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 952/1914] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:43 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:43.352543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6123f245-5700-44dd-ab1c-4b6c5ffaf45c tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:43.468596 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6123f245-5700-44dd-ab1c-4b6c5ffaf45c tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.151995 Aug 25 12:52:43.470168 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 953/1915] 10.222.0.70 () {58 vars in 1144 bytes} [Thu Aug 25 12:52:43 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:43.505827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1f891998-d296-4ce9-8c6a-6fecfd2396ac tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Calling method '.version_select at 0x7f3a2e8d5e50>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:44.145146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02f82b24-90d2-4218-9c29-2d28a89d284b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:44.183143 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02f82b24-90d2-4218-9c29-2d28a89d284b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 1.030879 Aug 25 12:52:44.185797 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 963/1916] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:43 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:44.199197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-28a8fb0e-492b-4d5e-9f44-364c57b49955 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:44.204136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-28a8fb0e-492b-4d5e-9f44-364c57b49955 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:44.224513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28a8fb0e-492b-4d5e-9f44-364c57b49955 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:44.226403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28a8fb0e-492b-4d5e-9f44-364c57b49955 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:44.228068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28a8fb0e-492b-4d5e-9f44-364c57b49955 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:44.230920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28a8fb0e-492b-4d5e-9f44-364c57b49955 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:44.232781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28a8fb0e-492b-4d5e-9f44-364c57b49955 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:44.234536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28a8fb0e-492b-4d5e-9f44-364c57b49955 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:44.786336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-28a8fb0e-492b-4d5e-9f44-364c57b49955 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:44.837777 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-28a8fb0e-492b-4d5e-9f44-364c57b49955 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1316 microversion: 2.1 time: 0.646152 Aug 25 12:52:44.842139 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 964/1917] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:44 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:44.880873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5ff1e29d-0b1b-411b-b2f7-c9abaafe4ba3 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:44.940985 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5ff1e29d-0b1b-411b-b2f7-c9abaafe4ba3 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.094889 Aug 25 12:52:44.944949 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 965/1918] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:52:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:44.989766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:44.995176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:45.028295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.036060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.037462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.039456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.040683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.041713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.106333 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] HTTP exception thrown: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Request method failure captured: Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 HTTP/1.1 Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3BdCI_DhmQsG1x07wmCoQLl7Fo3FVP8mjh4cfc3F4D3h9SIxg_tus-hd1V0w3xrxp33jI7_cXZsp2qJ4Xw7wuQTkP54FaWiPxABQt-DZMo5QAuIyEBQGPfjFJGNeolorD5PNokmNk-a4QpkXZX0rtfdL4wv9ScYO-xRQZkAjIfC47w Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a5a4e9ad75194e4ba441873f2258146b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}] Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 8dc6134f93e044dda11bb83fc863960d Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '48685680-7e3d-4549-910a-a454c4951c15'} Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:45.114528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.130320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:45.130320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:45.130320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:45.130320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:45.130320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:45.130320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:45.130320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.130320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Returning 404 to user: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:45.130320 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3774349f-4018-4c0a-9d00-ede505d41eae tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 404 len: 111 microversion: 2.1 time: 0.173074 Aug 25 12:52:45.130320 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 966/1919] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:44 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:45.137558 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1f891998-d296-4ce9-8c6a-6fecfd2396ac tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/ef526d5e-99ee-4650-b137-1eecfce92bb9" status: 202 len: 0 microversion: 2.1 time: 1.665050 Aug 25 12:52:45.145475 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 954/1920] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:52:43 2022] DELETE /compute/v2.1/os-security-groups/ef526d5e-99ee-4650-b137-1eecfce92bb9 => generated 0 bytes in 1670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:52:45.163684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b3e0deb6-fb37-4a14-9e10-fecc6d7df628 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:45.165937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-094e3c84-1658-48ae-8493-169ab95bd99f req-f134bbd1-ce96-498d-9fe1-da42aa38dc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48685680-7e3d-4549-910a-a454c4951c15", "name": "network-vif-deleted", "tag": "2b598070-a73d-4150-bcc3-b8737f88e7d3"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:45.167051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b3e0deb6-fb37-4a14-9e10-fecc6d7df628 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:45.187570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-094e3c84-1658-48ae-8493-169ab95bd99f req-f134bbd1-ce96-498d-9fe1-da42aa38dc57 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.188744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-094e3c84-1658-48ae-8493-169ab95bd99f req-f134bbd1-ce96-498d-9fe1-da42aa38dc57 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.189364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-094e3c84-1658-48ae-8493-169ab95bd99f req-f134bbd1-ce96-498d-9fe1-da42aa38dc57 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.210841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e0deb6-fb37-4a14-9e10-fecc6d7df628 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.214417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e0deb6-fb37-4a14-9e10-fecc6d7df628 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.220564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e0deb6-fb37-4a14-9e10-fecc6d7df628 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.224631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e0deb6-fb37-4a14-9e10-fecc6d7df628 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.227579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e0deb6-fb37-4a14-9e10-fecc6d7df628 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.230346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e0deb6-fb37-4a14-9e10-fecc6d7df628 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.236939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-094e3c84-1658-48ae-8493-169ab95bd99f req-f134bbd1-ce96-498d-9fe1-da42aa38dc57 service nova] Creating event network-vif-deleted:2b598070-a73d-4150-bcc3-b8737f88e7d3 for instance 48685680-7e3d-4549-910a-a454c4951c15 on n-h2-852771-8 Aug 25 12:52:45.255201 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-094e3c84-1658-48ae-8493-169ab95bd99f req-f134bbd1-ce96-498d-9fe1-da42aa38dc57 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121522 Aug 25 12:52:45.260939 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 967/1921] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:45.288631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:45.292919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: ca859734-6370-48aa-b3c3-22ff3362f6b1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:45.331940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.335548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.337163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.342027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.344968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.348358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.420775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] HTTP exception thrown: Instance ca859734-6370-48aa-b3c3-22ff3362f6b1 could not be found. Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Request method failure captured: Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 HTTP/1.1 Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23Y_Q6eXMzUT1NAbUqRdnE6wWum8RCsDJMzpEbGK5lMRF694G1TTPM4gAY9IPnu_ulB4qQTuqlKwXHvHrkBiwhwz6aBdiQjHY8I5gaids_rGE5BBdiStmMxwTjfGWjU-nGNRrCR0bA1NO6diSpBVvMbFD1GDiH232JKp94xEVmJz5E Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.25 Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c899e2a1474d4eb28b598f50e93312f8 Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c899e2a1474d4eb28b598f50e93312f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c899e2a1474d4eb28b598f50e93312f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c899e2a1474d4eb28b598f50e93312f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c899e2a1474d4eb28b598f50e93312f8"}]}] Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c899e2a1474d4eb28b598f50e93312f8 Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-LiveAutoBlockMigrationV225Test-1847538791-project Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b46ef01072a84a81b862baf3ea2387dd Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791-project Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance ca859734-6370-48aa-b3c3-22ff3362f6b1 could not be found. Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'ca859734-6370-48aa-b3c3-22ff3362f6b1'} Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca859734-6370-48aa-b3c3-22ff3362f6b1 could not be found. Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca859734-6370-48aa-b3c3-22ff3362f6b1 could not be found. Aug 25 12:52:45.424505 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.436618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:45.436618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.436618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:45.436618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:45.436618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:45.436618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:45.436618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:45.436618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca859734-6370-48aa-b3c3-22ff3362f6b1 could not be found. Aug 25 12:52:45.436618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.439822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Returning 404 to user: Instance ca859734-6370-48aa-b3c3-22ff3362f6b1 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:45.442220 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-355c0681-8a2b-4466-bb71-ff1670572efe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1" status: 404 len: 111 microversion: 2.25 time: 0.178557 Aug 25 12:52:45.444690 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 968/1922] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:45 2022] GET /compute/v2.1/servers/ca859734-6370-48aa-b3c3-22ff3362f6b1 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:45.459393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-defdb102-0f86-442e-a19c-da9d1243cf8f tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:45.509006 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-defdb102-0f86-442e-a19c-da9d1243cf8f tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.061718 Aug 25 12:52:45.511125 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 969/1923] 10.222.0.70 () {58 vars in 1148 bytes} [Thu Aug 25 12:52:45 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:45.528228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1355331335", "metadata": {"image_type": "test"}}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:45.538582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:45.552636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.554672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.556477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.558538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.563534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.565116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.601263 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] HTTP exception thrown: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Request method failure captured: Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15/action HTTP/1.1 Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 112 Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3BdCI_DhmQsG1x07wmCoQLl7Fo3FVP8mjh4cfc3F4D3h9SIxg_tus-hd1V0w3xrxp33jI7_cXZsp2qJ4Xw7wuQTkP54FaWiPxABQt-DZMo5QAuIyEBQGPfjFJGNeolorD5PNokmNk-a4QpkXZX0rtfdL4wv9ScYO-xRQZkAjIfC47w Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a5a4e9ad75194e4ba441873f2258146b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}] Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 8dc6134f93e044dda11bb83fc863960d Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1355331335", "metadata": {"image_type": "test"}}} Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '48685680-7e3d-4549-910a-a454c4951c15', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1355331335', 'metadata': {'image_type': 'test'}}}} Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 12:52:45.606793 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:45.628770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Returning 404 to user: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:45.632280 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42f21fe7-bc69-4e30-a30d-f54a25fcb867 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "POST /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15/action" status: 404 len: 111 microversion: 2.1 time: 0.107473 Aug 25 12:52:45.645204 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 970/1924] 10.222.0.70 () {60 vars in 1279 bytes} [Thu Aug 25 12:52:45 2022] POST /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15/action => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:45.667161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c39ff0ae-7796-4da8-bc13-6876290409e8 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Calling method '.version_select at 0x7f3a2e73d040>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:45.948446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b3e0deb6-fb37-4a14-9e10-fecc6d7df628 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:45.982682 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b3e0deb6-fb37-4a14-9e10-fecc6d7df628 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1396 microversion: 2.1 time: 0.839411 Aug 25 12:52:45.984827 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 955/1925] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:45 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1396 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:46.005734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-396d6331-f310-4170-99aa-885ac08b7632 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:46.014987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-396d6331-f310-4170-99aa-885ac08b7632 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:46.043148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-396d6331-f310-4170-99aa-885ac08b7632 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:46.044710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-396d6331-f310-4170-99aa-885ac08b7632 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:46.045964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-396d6331-f310-4170-99aa-885ac08b7632 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:46.047819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-396d6331-f310-4170-99aa-885ac08b7632 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:46.049826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-396d6331-f310-4170-99aa-885ac08b7632 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:46.051110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-396d6331-f310-4170-99aa-885ac08b7632 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:46.652444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-396d6331-f310-4170-99aa-885ac08b7632 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:46.684002 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-396d6331-f310-4170-99aa-885ac08b7632 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 0.696763 Aug 25 12:52:46.695084 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 956/1926] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:45 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:46.714001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-637477398", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:46.948143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] validate_networks() for [('d92653b3-acd5-4a7c-9b85-c26c0b939826', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:52:47.020337 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c39ff0ae-7796-4da8-bc13-6876290409e8 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/ad66dc99-15e8-4010-a061-4e0d994e4436" status: 202 len: 0 microversion: 2.1 time: 1.370975 Aug 25 12:52:47.021983 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 971/1927] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:52:45 2022] DELETE /compute/v2.1/os-security-groups/ad66dc99-15e8-4010-a061-4e0d994e4436 => generated 0 bytes in 1375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:52:47.057330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ca6d283-1685-4dc4-a313-d21f2cfe9a12 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:47.107860 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8ca6d283-1685-4dc4-a313-d21f2cfe9a12 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.078422 Aug 25 12:52:47.129713 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 972/1928] 10.222.0.70 () {58 vars in 1140 bytes} [Thu Aug 25 12:52:47 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:47.151855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a94f6c43-7a5e-4529-a560-e07591161ced tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1861753793", "metadata": {"image_type": "test"}}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:47.174730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a94f6c43-7a5e-4529-a560-e07591161ced tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Failed to fetch instance by id tempest-invalid-718196518 {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 12:52:47.175688 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a94f6c43-7a5e-4529-a560-e07591161ced tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] HTTP exception thrown: Instance tempest-invalid-718196518 could not be found. Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a94f6c43-7a5e-4529-a560-e07591161ced tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Request method failure captured: Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/tempest-invalid-718196518/action HTTP/1.1 Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 112 Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3BdCI_DhmQsG1x07wmCoQLl7Fo3FVP8mjh4cfc3F4D3h9SIxg_tus-hd1V0w3xrxp33jI7_cXZsp2qJ4Xw7wuQTkP54FaWiPxABQt-DZMo5QAuIyEBQGPfjFJGNeolorD5PNokmNk-a4QpkXZX0rtfdL4wv9ScYO-xRQZkAjIfC47w Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a5a4e9ad75194e4ba441873f2258146b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}] Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 8dc6134f93e044dda11bb83fc863960d Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1861753793", "metadata": {"image_type": "test"}}} Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance tempest-invalid-718196518 could not be found. Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'tempest-invalid-718196518', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1861753793', 'metadata': {'image_type': 'test'}}}} Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-718196518 could not be found. Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:52:47.187353 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-718196518 could not be found. Aug 25 12:52:47.198363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:47.198363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:47.198363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:47.198363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:47.198363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:47.198363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:47.198363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:47.198363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:47.198363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-718196518 could not be found. Aug 25 12:52:47.198363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:47.210563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=18 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:47.210763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a94f6c43-7a5e-4529-a560-e07591161ced tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Returning 404 to user: Instance tempest-invalid-718196518 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:47.210763 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a94f6c43-7a5e-4529-a560-e07591161ced tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "POST /compute/v2.1/servers/tempest-invalid-718196518/action" status: 404 len: 100 microversion: 2.1 time: 0.064837 Aug 25 12:52:47.210763 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 973/1929] 10.222.0.70 () {60 vars in 1246 bytes} [Thu Aug 25 12:52:47 2022] POST /compute/v2.1/servers/tempest-invalid-718196518/action => generated 100 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:47.252726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-67ea83b7-c189-4a6d-8ab5-c38feced548b tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:47.254127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-67ea83b7-c189-4a6d-8ab5-c38feced548b tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:47.287817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67ea83b7-c189-4a6d-8ab5-c38feced548b tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:47.288908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67ea83b7-c189-4a6d-8ab5-c38feced548b tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:47.289775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67ea83b7-c189-4a6d-8ab5-c38feced548b tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:47.298435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67ea83b7-c189-4a6d-8ab5-c38feced548b tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:47.299774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67ea83b7-c189-4a6d-8ab5-c38feced548b tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:47.300882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67ea83b7-c189-4a6d-8ab5-c38feced548b tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:48.082002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-67ea83b7-c189-4a6d-8ab5-c38feced548b tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:48.140360 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-67ea83b7-c189-4a6d-8ab5-c38feced548b tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1316 microversion: 2.1 time: 0.932829 Aug 25 12:52:48.153545 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 974/1930] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:47 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1316 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:48.169548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-00951a08-cb02-44c3-b49a-b177a0ff4ae1 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:48.169548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-00951a08-cb02-44c3-b49a-b177a0ff4ae1 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:48.202440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00951a08-cb02-44c3-b49a-b177a0ff4ae1 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:48.203773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00951a08-cb02-44c3-b49a-b177a0ff4ae1 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:48.204513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00951a08-cb02-44c3-b49a-b177a0ff4ae1 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:48.205886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00951a08-cb02-44c3-b49a-b177a0ff4ae1 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:48.206637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00951a08-cb02-44c3-b49a-b177a0ff4ae1 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:48.207321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00951a08-cb02-44c3-b49a-b177a0ff4ae1 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:48.469645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:52:48.472048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:52:48.474340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:52:48.477124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:52:48.479663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:52:48.505223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:48.506809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:48.508144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:48.510196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:48.511628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:48.514356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:48.567634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Getting quotas for project d43be46fe4e84396b73fbdca834b3525. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:48.581488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Getting quotas for user 74d9b7c3351f44b9b986e6535fc62819 and project d43be46fe4e84396b73fbdca834b3525. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:48.614505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:52:48.620803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:52:48.622273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-00951a08-cb02-44c3-b49a-b177a0ff4ae1 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:48.647887 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-00951a08-cb02-44c3-b49a-b177a0ff4ae1 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1396 microversion: 2.1 time: 0.503689 Aug 25 12:52:48.653850 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 975/1931] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:48 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1396 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:48.679712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d0d435b-2539-480f-93af-2006a480c2db tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Calling method '.version_select at 0x7f3a2e81e430>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:48.792311 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-345d9008-ec94-4cee-945d-375ac610c25c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.095189 Aug 25 12:52:48.799649 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 957/1932] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:52:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 2103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:52:48.821441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-67f49dbe-a978-4d60-9598-16dcb4959478 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:48.848466 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-67f49dbe-a978-4d60-9598-16dcb4959478 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046106 Aug 25 12:52:48.850629 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 958/1933] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:52:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:48.862950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-28198095-d6c0-4f4b-9f03-e92e35ee0844 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-439363387"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:48.869733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-28198095-d6c0-4f4b-9f03-e92e35ee0844 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 12:52:48.871425 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-28198095-d6c0-4f4b-9f03-e92e35ee0844 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-28198095-d6c0-4f4b-9f03-e92e35ee0844 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Request method failure captured: Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 56 Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3BdCI_DhmQsG1x07wmCoQLl7Fo3FVP8mjh4cfc3F4D3h9SIxg_tus-hd1V0w3xrxp33jI7_cXZsp2qJ4Xw7wuQTkP54FaWiPxABQt-DZMo5QAuIyEBQGPfjFJGNeolorD5PNokmNk-a4QpkXZX0rtfdL4wv9ScYO-xRQZkAjIfC47w Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a5a4e9ad75194e4ba441873f2258146b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}] Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 8dc6134f93e044dda11bb83fc863960d Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: {"createImage": {"name": "tempest-test-snap-439363387"}} Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-439363387'}}} Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:52:48.879053 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:48.888597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:48.888597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:48.888597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:48.888597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:48.888597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:48.888597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:48.888597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:48.888597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:52:48.888597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:48.896447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-28198095-d6c0-4f4b-9f03-e92e35ee0844 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:48.897501 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-28198095-d6c0-4f4b-9f03-e92e35ee0844 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.039935 Aug 25 12:52:48.899512 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 959/1934] 10.222.0.70 () {60 vars in 1275 bytes} [Thu Aug 25 12:52:48 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:48.912877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-350cf994-e164-45f6-89f2-bb063fe87f71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:48.917052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-350cf994-e164-45f6-89f2-bb063fe87f71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:48.932122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-350cf994-e164-45f6-89f2-bb063fe87f71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:48.933602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-350cf994-e164-45f6-89f2-bb063fe87f71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:48.935475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-350cf994-e164-45f6-89f2-bb063fe87f71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:48.938160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-350cf994-e164-45f6-89f2-bb063fe87f71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:48.939636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-350cf994-e164-45f6-89f2-bb063fe87f71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:48.940946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-350cf994-e164-45f6-89f2-bb063fe87f71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:49.371691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-350cf994-e164-45f6-89f2-bb063fe87f71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:49.424499 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-350cf994-e164-45f6-89f2-bb063fe87f71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 0.522259 Aug 25 12:52:49.457352 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 960/1935] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:48 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:49.467870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a46fd08f-aafd-435f-988f-9af851667867 req-bf3a63f9-a4f5-46ef-ac45-abfb313e7eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e6d243-78f0-4af2-9799-9c8b0b34266b", "name": "network-vif-plugged", "status": "completed", "tag": "08c1c882-e962-4f32-bdbf-8593018a711c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:49.493596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a46fd08f-aafd-435f-988f-9af851667867 req-bf3a63f9-a4f5-46ef-ac45-abfb313e7eca service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:49.495859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a46fd08f-aafd-435f-988f-9af851667867 req-bf3a63f9-a4f5-46ef-ac45-abfb313e7eca service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:49.497027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a46fd08f-aafd-435f-988f-9af851667867 req-bf3a63f9-a4f5-46ef-ac45-abfb313e7eca service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:49.534334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a46fd08f-aafd-435f-988f-9af851667867 req-bf3a63f9-a4f5-46ef-ac45-abfb313e7eca service nova] Creating event network-vif-plugged:08c1c882-e962-4f32-bdbf-8593018a711c for instance b8e6d243-78f0-4af2-9799-9c8b0b34266b on n-h1-852771-8 Aug 25 12:52:49.546444 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a46fd08f-aafd-435f-988f-9af851667867 req-bf3a63f9-a4f5-46ef-ac45-abfb313e7eca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085886 Aug 25 12:52:49.548116 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 961/1936] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:49.561284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-106806ef-da5c-477a-bac7-cb24cc936e47 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:49.563354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-106806ef-da5c-477a-bac7-cb24cc936e47 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:49.646236 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d0d435b-2539-480f-93af-2006a480c2db tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/52d9986a-c2b4-4c24-87dd-9afd683ec241" status: 202 len: 0 microversion: 2.1 time: 0.990423 Aug 25 12:52:49.653497 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 976/1937] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:52:48 2022] DELETE /compute/v2.1/os-security-groups/52d9986a-c2b4-4c24-87dd-9afd683ec241 => generated 0 bytes in 999 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:52:49.677852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ca83f10-4b5b-47da-89e1-a29263f24cd2 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:49.774299 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ca83f10-4b5b-47da-89e1-a29263f24cd2 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.117106 Aug 25 12:52:49.776622 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 977/1938] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:52:49 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:49.793261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-106806ef-da5c-477a-bac7-cb24cc936e47 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:49.805425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b755ab50-72d1-4f61-afaf-73068c1a1a62 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-687615823"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:49.814704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b755ab50-72d1-4f61-afaf-73068c1a1a62 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 12:52:49.816176 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b755ab50-72d1-4f61-afaf-73068c1a1a62 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:52:49.822660 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-106806ef-da5c-477a-bac7-cb24cc936e47 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1224 microversion: 2.1 time: 0.271895 Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b755ab50-72d1-4f61-afaf-73068c1a1a62 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Request method failure captured: Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 56 Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3BdCI_DhmQsG1x07wmCoQLl7Fo3FVP8mjh4cfc3F4D3h9SIxg_tus-hd1V0w3xrxp33jI7_cXZsp2qJ4Xw7wuQTkP54FaWiPxABQt-DZMo5QAuIyEBQGPfjFJGNeolorD5PNokmNk-a4QpkXZX0rtfdL4wv9ScYO-xRQZkAjIfC47w Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a5a4e9ad75194e4ba441873f2258146b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}] Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 8dc6134f93e044dda11bb83fc863960d Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: {"createImage": {"name": "tempest-test-snap-687615823"}} Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-687615823'}}} Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:52:49.826263 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:49.836219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:49.836219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:49.836219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:49.836219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:49.836219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:49.836219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:49.836219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:49.836219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:52:49.836219 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:49.843503 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 962/1939] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:49 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1224 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:49.843863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b755ab50-72d1-4f61-afaf-73068c1a1a62 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:49.845067 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b755ab50-72d1-4f61-afaf-73068c1a1a62 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.062942 Aug 25 12:52:49.855167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0fe63d8d-d0fd-4032-9eed-be709a3136ce tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:49.855167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0fe63d8d-d0fd-4032-9eed-be709a3136ce tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:49.856506 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 978/1940] 10.222.0.70 () {60 vars in 1281 bytes} [Thu Aug 25 12:52:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:49.867264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0623a5c7-e9a1-40b9-ba7a-7c61d69834b1 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] Calling method '.version_select at 0x7f3a2e781f70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:49.892544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fe63d8d-d0fd-4032-9eed-be709a3136ce tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:49.896865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fe63d8d-d0fd-4032-9eed-be709a3136ce tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:49.897997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fe63d8d-d0fd-4032-9eed-be709a3136ce tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:49.900513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fe63d8d-d0fd-4032-9eed-be709a3136ce tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:49.905453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fe63d8d-d0fd-4032-9eed-be709a3136ce tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:49.907168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fe63d8d-d0fd-4032-9eed-be709a3136ce tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:50.341347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0fe63d8d-d0fd-4032-9eed-be709a3136ce tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:50.370812 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0fe63d8d-d0fd-4032-9eed-be709a3136ce tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1316 microversion: 2.1 time: 0.528781 Aug 25 12:52:50.390257 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 963/1941] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:49 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:50.412093 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0623a5c7-e9a1-40b9-ba7a-7c61d69834b1 tempest-SecurityGroupRulesNegativeTestJSON-1458719916 tempest-SecurityGroupRulesNegativeTestJSON-1458719916-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/59d1e42d-2c96-4bf4-a469-8717674e9346" status: 202 len: 0 microversion: 2.1 time: 0.553472 Aug 25 12:52:50.413653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4b8e01b7-d496-478f-8e27-3f6a3ceeb2b9 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:50.414680 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 979/1942] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:52:49 2022] DELETE /compute/v2.1/os-security-groups/59d1e42d-2c96-4bf4-a469-8717674e9346 => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:52:50.415460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4b8e01b7-d496-478f-8e27-3f6a3ceeb2b9 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:50.429900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b8e01b7-d496-478f-8e27-3f6a3ceeb2b9 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:50.430674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c874ac31-1488-470e-a6ce-c8825cc49b66 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:50.431584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b8e01b7-d496-478f-8e27-3f6a3ceeb2b9 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:50.432711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b8e01b7-d496-478f-8e27-3f6a3ceeb2b9 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:50.434480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b8e01b7-d496-478f-8e27-3f6a3ceeb2b9 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:50.436376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b8e01b7-d496-478f-8e27-3f6a3ceeb2b9 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:50.437612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b8e01b7-d496-478f-8e27-3f6a3ceeb2b9 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:50.516563 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c874ac31-1488-470e-a6ce-c8825cc49b66 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.099924 Aug 25 12:52:50.531379 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 980/1943] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:52:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:50.540734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:50.555175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:50.571829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:50.584297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:50.585126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:50.593553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:50.594987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:50.596074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:50.645718 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] HTTP exception thrown: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Request method failure captured: Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 HTTP/1.1 Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3BdCI_DhmQsG1x07wmCoQLl7Fo3FVP8mjh4cfc3F4D3h9SIxg_tus-hd1V0w3xrxp33jI7_cXZsp2qJ4Xw7wuQTkP54FaWiPxABQt-DZMo5QAuIyEBQGPfjFJGNeolorD5PNokmNk-a4QpkXZX0rtfdL4wv9ScYO-xRQZkAjIfC47w Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a5a4e9ad75194e4ba441873f2258146b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}] Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 8dc6134f93e044dda11bb83fc863960d Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '48685680-7e3d-4549-910a-a454c4951c15'} Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:52:50.649212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:50.657679 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:50.664946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Returning 404 to user: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:50.664946 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-472ba485-556e-41b8-97cc-636109c42baf tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "DELETE /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 404 len: 111 microversion: 2.1 time: 0.131240 Aug 25 12:52:50.665580 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 981/1944] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:52:50 2022] DELETE /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:50.673363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47624766-8d26-46b0-8414-9e6e8bf99075 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:50.677791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-47624766-8d26-46b0-8414-9e6e8bf99075 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:50.691657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47624766-8d26-46b0-8414-9e6e8bf99075 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:50.694408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47624766-8d26-46b0-8414-9e6e8bf99075 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:50.695512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47624766-8d26-46b0-8414-9e6e8bf99075 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:50.696748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47624766-8d26-46b0-8414-9e6e8bf99075 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:50.697598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47624766-8d26-46b0-8414-9e6e8bf99075 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:50.698486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47624766-8d26-46b0-8414-9e6e8bf99075 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.006046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4b8e01b7-d496-478f-8e27-3f6a3ceeb2b9 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:51.026223 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4b8e01b7-d496-478f-8e27-3f6a3ceeb2b9 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1396 microversion: 2.1 time: 0.633423 Aug 25 12:52:51.029083 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 964/1945] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:50 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1396 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:51.041831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f0a9e078-7e68-41dc-8f0f-cf16b6fb7ea2 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:51.054126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-47624766-8d26-46b0-8414-9e6e8bf99075 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:51.065552 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f0a9e078-7e68-41dc-8f0f-cf16b6fb7ea2 tempest-FlavorsV2TestJSON-1941118098 tempest-FlavorsV2TestJSON-1941118098-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032266 Aug 25 12:52:51.067644 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 965/1946] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:52:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:51.078202 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47624766-8d26-46b0-8414-9e6e8bf99075 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 0.410607 Aug 25 12:52:51.079799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:51.080196 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 982/1947] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:50 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:51.081856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] [instance: 48685680-7e3d-4549-910a-a454c4951c15] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:51.091049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d6621bf-f97d-44a0-83b9-294c1bd0d36f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:51.092761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d6621bf-f97d-44a0-83b9-294c1bd0d36f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:51.099429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:51.100644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:51.101798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.103205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:51.105255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:51.106267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.112557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d6621bf-f97d-44a0-83b9-294c1bd0d36f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:51.114059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d6621bf-f97d-44a0-83b9-294c1bd0d36f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:51.115672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d6621bf-f97d-44a0-83b9-294c1bd0d36f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.117327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d6621bf-f97d-44a0-83b9-294c1bd0d36f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:51.118507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d6621bf-f97d-44a0-83b9-294c1bd0d36f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:51.119767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d6621bf-f97d-44a0-83b9-294c1bd0d36f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.167806 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] HTTP exception thrown: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Request method failure captured: Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 HTTP/1.1 Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3BdCI_DhmQsG1x07wmCoQLl7Fo3FVP8mjh4cfc3F4D3h9SIxg_tus-hd1V0w3xrxp33jI7_cXZsp2qJ4Xw7wuQTkP54FaWiPxABQt-DZMo5QAuIyEBQGPfjFJGNeolorD5PNokmNk-a4QpkXZX0rtfdL4wv9ScYO-xRQZkAjIfC47w Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a5a4e9ad75194e4ba441873f2258146b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a5a4e9ad75194e4ba441873f2258146b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a5a4e9ad75194e4ba441873f2258146b"}]}] Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: a5a4e9ad75194e4ba441873f2258146b Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-624767804 Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 8dc6134f93e044dda11bb83fc863960d Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesNegativeTestJSON-624767804-project Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '48685680-7e3d-4549-910a-a454c4951c15'} Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:51.171905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:51.181580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:51.181580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:51.181580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:51.181580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:51.181580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:51.181580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. Aug 25 12:52:51.181580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:52:51.181580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] Returning 404 to user: Instance 48685680-7e3d-4549-910a-a454c4951c15 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:51.181580 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-366b9349-9f19-4d49-9838-99f68f41ffe2 tempest-ImagesNegativeTestJSON-624767804 tempest-ImagesNegativeTestJSON-624767804-project] 10.222.0.70 "GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15" status: 404 len: 111 microversion: 2.1 time: 0.105103 Aug 25 12:52:51.185644 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 966/1948] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:51 2022] GET /compute/v2.1/servers/48685680-7e3d-4549-910a-a454c4951c15 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:51.418627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89271277-52a2-4b9d-bc56-9e4ce11ac895 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:51.424172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89271277-52a2-4b9d-bc56-9e4ce11ac895 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:51.452096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89271277-52a2-4b9d-bc56-9e4ce11ac895 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:51.455218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89271277-52a2-4b9d-bc56-9e4ce11ac895 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:51.456157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89271277-52a2-4b9d-bc56-9e4ce11ac895 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.458647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89271277-52a2-4b9d-bc56-9e4ce11ac895 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:51.463678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89271277-52a2-4b9d-bc56-9e4ce11ac895 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:51.467509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89271277-52a2-4b9d-bc56-9e4ce11ac895 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.804913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8d6621bf-f97d-44a0-83b9-294c1bd0d36f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:51.836640 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d6621bf-f97d-44a0-83b9-294c1bd0d36f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1276 microversion: 2.1 time: 0.751578 Aug 25 12:52:51.844047 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 983/1949] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:51 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1276 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:51.861017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-cc925855-4160-4b79-a4ea-9eadeacea799 req-e9a712c6-e9bb-42b5-8586-b5c62f536375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93190d43-5b60-464e-a1d4-ee5aba5f70e9", "name": "network-vif-plugged", "status": "completed", "tag": "336bb7d1-c5c5-48d1-8ae0-a6689485d1f5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:51.897605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cc925855-4160-4b79-a4ea-9eadeacea799 req-e9a712c6-e9bb-42b5-8586-b5c62f536375 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:51.899090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cc925855-4160-4b79-a4ea-9eadeacea799 req-e9a712c6-e9bb-42b5-8586-b5c62f536375 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:51.904325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cc925855-4160-4b79-a4ea-9eadeacea799 req-e9a712c6-e9bb-42b5-8586-b5c62f536375 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.941557 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-cc925855-4160-4b79-a4ea-9eadeacea799 req-e9a712c6-e9bb-42b5-8586-b5c62f536375 service nova] Creating event network-vif-plugged:336bb7d1-c5c5-48d1-8ae0-a6689485d1f5 for instance 93190d43-5b60-464e-a1d4-ee5aba5f70e9 on n-h1-852771-8 Aug 25 12:52:51.959627 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-cc925855-4160-4b79-a4ea-9eadeacea799 req-e9a712c6-e9bb-42b5-8586-b5c62f536375 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110742 Aug 25 12:52:51.959627 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 984/1950] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:52.088276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e399ebf4-12b5-471a-80d5-0714fe9dcfae tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:52.102061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e399ebf4-12b5-471a-80d5-0714fe9dcfae tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:52.145368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e399ebf4-12b5-471a-80d5-0714fe9dcfae tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:52.153423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e399ebf4-12b5-471a-80d5-0714fe9dcfae tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:52.157264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e399ebf4-12b5-471a-80d5-0714fe9dcfae tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:52.168303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e399ebf4-12b5-471a-80d5-0714fe9dcfae tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:52.178029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e399ebf4-12b5-471a-80d5-0714fe9dcfae tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:52.178941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e399ebf4-12b5-471a-80d5-0714fe9dcfae tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:52.251042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:52.533375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89271277-52a2-4b9d-bc56-9e4ce11ac895 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:52.561349 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89271277-52a2-4b9d-bc56-9e4ce11ac895 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1503 microversion: 2.1 time: 1.151020 Aug 25 12:52:52.581618 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 967/1951] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:51 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1503 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:52.590111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0ccaa678-5b56-4b50-81a8-c8c0b3811a8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:52.593001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ccaa678-5b56-4b50-81a8-c8c0b3811a8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:52.615605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ccaa678-5b56-4b50-81a8-c8c0b3811a8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:52.617362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ccaa678-5b56-4b50-81a8-c8c0b3811a8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:52.619536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ccaa678-5b56-4b50-81a8-c8c0b3811a8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:52.623800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ccaa678-5b56-4b50-81a8-c8c0b3811a8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:52.625369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ccaa678-5b56-4b50-81a8-c8c0b3811a8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:52.629304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ccaa678-5b56-4b50-81a8-c8c0b3811a8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.183282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e399ebf4-12b5-471a-80d5-0714fe9dcfae tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:53.214497 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e399ebf4-12b5-471a-80d5-0714fe9dcfae tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1396 microversion: 2.1 time: 1.140554 Aug 25 12:52:53.232530 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 985/1952] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:52 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1396 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:52:53.255844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a4fdeb0f-9862-44a2-b870-d814e67dec44 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:53.257273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a4fdeb0f-9862-44a2-b870-d814e67dec44 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:53.272089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb0f-9862-44a2-b870-d814e67dec44 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.274419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb0f-9862-44a2-b870-d814e67dec44 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.275886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb0f-9862-44a2-b870-d814e67dec44 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.277659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb0f-9862-44a2-b870-d814e67dec44 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.280985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb0f-9862-44a2-b870-d814e67dec44 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.282740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb0f-9862-44a2-b870-d814e67dec44 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.309043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ccaa678-5b56-4b50-81a8-c8c0b3811a8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:53.343026 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0ccaa678-5b56-4b50-81a8-c8c0b3811a8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 0.766098 Aug 25 12:52:53.353546 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 968/1953] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:52 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:53.371441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c6530e59-f178-40f6-915d-9d7cf603a21d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:53.378952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c6530e59-f178-40f6-915d-9d7cf603a21d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:53.411765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6530e59-f178-40f6-915d-9d7cf603a21d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.413291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6530e59-f178-40f6-915d-9d7cf603a21d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.416776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6530e59-f178-40f6-915d-9d7cf603a21d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.418720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6530e59-f178-40f6-915d-9d7cf603a21d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.431040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6530e59-f178-40f6-915d-9d7cf603a21d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.432291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6530e59-f178-40f6-915d-9d7cf603a21d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.557563 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a4fdeb0f-9862-44a2-b870-d814e67dec44 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.317713 Aug 25 12:52:53.565473 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 986/1954] 10.222.0.70 () {58 vars in 1296 bytes} [Thu Aug 25 12:52:53 2022] DELETE /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b/os-server-password => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:52:53.602926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dddb06c1-ec13-4275-ba9f-9afcdde65110 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:53.607566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dddb06c1-ec13-4275-ba9f-9afcdde65110 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:53.627473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dddb06c1-ec13-4275-ba9f-9afcdde65110 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.628990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dddb06c1-ec13-4275-ba9f-9afcdde65110 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.632086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dddb06c1-ec13-4275-ba9f-9afcdde65110 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.636504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dddb06c1-ec13-4275-ba9f-9afcdde65110 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.639629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dddb06c1-ec13-4275-ba9f-9afcdde65110 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.641065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dddb06c1-ec13-4275-ba9f-9afcdde65110 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.726346 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dddb06c1-ec13-4275-ba9f-9afcdde65110 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.141485 Aug 25 12:52:53.730329 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 987/1955] 10.222.0.70 () {58 vars in 1293 bytes} [Thu Aug 25 12:52:53 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b/os-server-password => generated 16 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 12:52:53.752111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-055c3364-e00c-49ad-be04-5b95ff98d631 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:53.752990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-055c3364-e00c-49ad-be04-5b95ff98d631 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:53.809944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-055c3364-e00c-49ad-be04-5b95ff98d631 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.811012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-055c3364-e00c-49ad-be04-5b95ff98d631 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.811797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-055c3364-e00c-49ad-be04-5b95ff98d631 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.813128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-055c3364-e00c-49ad-be04-5b95ff98d631 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.813986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-055c3364-e00c-49ad-be04-5b95ff98d631 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.814767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-055c3364-e00c-49ad-be04-5b95ff98d631 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.934083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-055c3364-e00c-49ad-be04-5b95ff98d631 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:52:54.215013 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-055c3364-e00c-49ad-be04-5b95ff98d631 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 204 len: 0 microversion: 2.1 time: 0.472489 Aug 25 12:52:54.217177 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 988/1956] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:52:53 2022] DELETE /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:52:54.233136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-850c3aff-fc0c-4322-af8a-77bede209a4a tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:54.240333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-850c3aff-fc0c-4322-af8a-77bede209a4a tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:54.280110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-850c3aff-fc0c-4322-af8a-77bede209a4a tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:54.280623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-850c3aff-fc0c-4322-af8a-77bede209a4a tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:54.281425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-850c3aff-fc0c-4322-af8a-77bede209a4a tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:54.282748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-850c3aff-fc0c-4322-af8a-77bede209a4a tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:54.283609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-850c3aff-fc0c-4322-af8a-77bede209a4a tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:54.284372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-850c3aff-fc0c-4322-af8a-77bede209a4a tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:55.384802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c6530e59-f178-40f6-915d-9d7cf603a21d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:55.416250 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c6530e59-f178-40f6-915d-9d7cf603a21d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1282 microversion: 2.1 time: 2.059368 Aug 25 12:52:55.418921 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 969/1957] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:53 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1282 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:55.464061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d9dc147f-6fd0-4c96-8209-a5c274580107 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:55.473928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d9dc147f-6fd0-4c96-8209-a5c274580107 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:55.509869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9dc147f-6fd0-4c96-8209-a5c274580107 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:55.520633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9dc147f-6fd0-4c96-8209-a5c274580107 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:55.526378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9dc147f-6fd0-4c96-8209-a5c274580107 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:55.535849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9dc147f-6fd0-4c96-8209-a5c274580107 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:55.545397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9dc147f-6fd0-4c96-8209-a5c274580107 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:55.546964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9dc147f-6fd0-4c96-8209-a5c274580107 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:56.912038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-850c3aff-fc0c-4322-af8a-77bede209a4a tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:56.936261 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-850c3aff-fc0c-4322-af8a-77bede209a4a tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1509 microversion: 2.1 time: 2.705080 Aug 25 12:52:56.937479 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 989/1958] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:54 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1509 bytes in 2714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:52:56.968632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02f1ff78-0e1d-4623-ae38-806a1eb2aa7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:56.969262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02f1ff78-0e1d-4623-ae38-806a1eb2aa7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:57.003137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f1ff78-0e1d-4623-ae38-806a1eb2aa7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.010916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f1ff78-0e1d-4623-ae38-806a1eb2aa7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.012159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f1ff78-0e1d-4623-ae38-806a1eb2aa7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.014584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f1ff78-0e1d-4623-ae38-806a1eb2aa7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.015637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f1ff78-0e1d-4623-ae38-806a1eb2aa7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.016269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02f1ff78-0e1d-4623-ae38-806a1eb2aa7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.471574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d9dc147f-6fd0-4c96-8209-a5c274580107 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:57.516013 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d9dc147f-6fd0-4c96-8209-a5c274580107 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1577 microversion: 2.1 time: 2.093215 Aug 25 12:52:57.531843 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 970/1959] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:55 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1577 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:57.566275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c5a4fee4-d742-4edf-9ecd-4d6851f3c72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:57.569754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c5a4fee4-d742-4edf-9ecd-4d6851f3c72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:57.616366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5a4fee4-d742-4edf-9ecd-4d6851f3c72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.621025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5a4fee4-d742-4edf-9ecd-4d6851f3c72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.629764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5a4fee4-d742-4edf-9ecd-4d6851f3c72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.632171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5a4fee4-d742-4edf-9ecd-4d6851f3c72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.635372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5a4fee4-d742-4edf-9ecd-4d6851f3c72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.636708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5a4fee4-d742-4edf-9ecd-4d6851f3c72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.668995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:57.924832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02f1ff78-0e1d-4623-ae38-806a1eb2aa7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:57.961782 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02f1ff78-0e1d-4623-ae38-806a1eb2aa7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 1.009534 Aug 25 12:52:57.978532 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 990/1960] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:56 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:58.406932 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-79c31567-9117-4409-a622-e45a0f0f473d tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] 10.222.0.70 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.425845 Aug 25 12:52:58.414619 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 991/1961] 10.222.0.70 () {58 vars in 1128 bytes} [Thu Aug 25 12:52:57 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 12:52:58.463989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4f93a58f-f58c-4aa4-ae36-3455897a694c tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:58.464840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4f93a58f-f58c-4aa4-ae36-3455897a694c tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:58.501979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f93a58f-f58c-4aa4-ae36-3455897a694c tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:58.506233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f93a58f-f58c-4aa4-ae36-3455897a694c tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:58.530243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f93a58f-f58c-4aa4-ae36-3455897a694c tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:58.537929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f93a58f-f58c-4aa4-ae36-3455897a694c tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:58.545020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:58.546355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f93a58f-f58c-4aa4-ae36-3455897a694c tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:58.552135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f93a58f-f58c-4aa4-ae36-3455897a694c tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:58.636277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c5a4fee4-d742-4edf-9ecd-4d6851f3c72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:58.684383 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c5a4fee4-d742-4edf-9ecd-4d6851f3c72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1324 microversion: 2.1 time: 1.147332 Aug 25 12:52:58.689103 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 971/1962] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:57 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1324 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:58.737724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-587e2b34-4476-48bd-ac7d-d3b8790640ee tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:58.743760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-587e2b34-4476-48bd-ac7d-d3b8790640ee tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:58.776743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-587e2b34-4476-48bd-ac7d-d3b8790640ee tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:58.780264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-587e2b34-4476-48bd-ac7d-d3b8790640ee tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:58.783720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-587e2b34-4476-48bd-ac7d-d3b8790640ee tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:58.786669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-587e2b34-4476-48bd-ac7d-d3b8790640ee tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:58.791422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-587e2b34-4476-48bd-ac7d-d3b8790640ee tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:58.795925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-587e2b34-4476-48bd-ac7d-d3b8790640ee tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:58.942831 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4f93a58f-f58c-4aa4-ae36-3455897a694c tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.509756 Aug 25 12:52:58.944671 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 992/1963] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 12:52:58 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9/os-interface => generated 284 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:58.997491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06f7db31-8f69-45da-b823-ebead00b9bb3 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Calling method '.version_select at 0x7f3a2e73d0d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:59.111542 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-06f7db31-8f69-45da-b823-ebead00b9bb3 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] HTTP exception thrown: Image not found. Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06f7db31-8f69-45da-b823-ebead00b9bb3 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Request method failure captured: Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3Cpy9wZiIitR5ECecKl6BdXm197fke3Kc3j-SZ0pkmv8CE7lSfxJqOnanqoM34D2xWwPtlxTz0ylQkByrU84m2wi-jnTiqLszbnUp8S2VX1MFBCMu1RadI0RF_je4r6WlqhwRTRVyphkEsD4Z_rjtfDAVt04-w1yiTH-j2Nvh-KGm8 Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 6e14a2b91338456da66f275f2707e5bb Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e14a2b91338456da66f275f2707e5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6e14a2b91338456da66f275f2707e5bb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6e14a2b91338456da66f275f2707e5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e14a2b91338456da66f275f2707e5bb"}]}] Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 6e14a2b91338456da66f275f2707e5bb Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesDeleteNegativeTestJSON-2039239376-project Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 00d441c7807545d6862072db77c0e71f Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376-project Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: exception: Image not found. Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '-1'} Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:59.113962 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06f7db31-8f69-45da-b823-ebead00b9bb3 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Returning 404 to user: Image not found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-06f7db31-8f69-45da-b823-ebead00b9bb3 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] 10.222.0.70 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.168353 Aug 25 12:52:59.129671 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 993/1964] 10.222.0.70 () {58 vars in 1134 bytes} [Thu Aug 25 12:52:58 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:52:59.148197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-95546b93-ac50-48fc-82a3-ddf15be01c11 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:59.150186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-95546b93-ac50-48fc-82a3-ddf15be01c11 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:59.171068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:59.182753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95546b93-ac50-48fc-82a3-ddf15be01c11 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:59.183624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95546b93-ac50-48fc-82a3-ddf15be01c11 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:59.184358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95546b93-ac50-48fc-82a3-ddf15be01c11 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:59.186913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95546b93-ac50-48fc-82a3-ddf15be01c11 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:59.187578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95546b93-ac50-48fc-82a3-ddf15be01c11 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:59.188341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95546b93-ac50-48fc-82a3-ddf15be01c11 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:59.805612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:01.700626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-95546b93-ac50-48fc-82a3-ddf15be01c11 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:01.773887 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-95546b93-ac50-48fc-82a3-ddf15be01c11 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 2.642281 Aug 25 12:53:01.785254 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 994/1965] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:59 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 2655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:01.803949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a339f9d8-bf10-4570-9a4b-f68089f5681c tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Calling method '.version_select at 0x7f3a29c8faf0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:01.930970 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a339f9d8-bf10-4570-9a4b-f68089f5681c tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] HTTP exception thrown: Image not found. Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a339f9d8-bf10-4570-9a4b-f68089f5681c tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Request method failure captured: Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/images/6991944b-e3fe-4c44-b104-1e2719ffe37j HTTP/1.1 Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3Cpy9wZiIitR5ECecKl6BdXm197fke3Kc3j-SZ0pkmv8CE7lSfxJqOnanqoM34D2xWwPtlxTz0ylQkByrU84m2wi-jnTiqLszbnUp8S2VX1MFBCMu1RadI0RF_je4r6WlqhwRTRVyphkEsD4Z_rjtfDAVt04-w1yiTH-j2Nvh-KGm8 Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 6e14a2b91338456da66f275f2707e5bb Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e14a2b91338456da66f275f2707e5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6e14a2b91338456da66f275f2707e5bb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6e14a2b91338456da66f275f2707e5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e14a2b91338456da66f275f2707e5bb"}]}] Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 6e14a2b91338456da66f275f2707e5bb Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesDeleteNegativeTestJSON-2039239376-project Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 00d441c7807545d6862072db77c0e71f Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376-project Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: exception: Image not found. Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '6991944b-e3fe-4c44-b104-1e2719ffe37j'} Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6991944b-e3fe-4c44-b104-1e2719ffe37j to delete Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6991944b-e3fe-4c44-b104-1e2719ffe37j could not be found. Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:01.936212 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:01.947364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a339f9d8-bf10-4570-9a4b-f68089f5681c tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Returning 404 to user: Image not found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:01.953295 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a339f9d8-bf10-4570-9a4b-f68089f5681c tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] 10.222.0.70 "DELETE /compute/v2.1/images/6991944b-e3fe-4c44-b104-1e2719ffe37j" status: 404 len: 62 microversion: 2.1 time: 0.161870 Aug 25 12:53:01.957655 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 995/1966] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:01 2022] DELETE /compute/v2.1/images/6991944b-e3fe-4c44-b104-1e2719ffe37j => generated 62 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:53:02.038023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff42bf1d-7acb-4ef8-931e-db47d78ed5a6 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:02.045950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff42bf1d-7acb-4ef8-931e-db47d78ed5a6 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:02.092548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff42bf1d-7acb-4ef8-931e-db47d78ed5a6 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.093947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff42bf1d-7acb-4ef8-931e-db47d78ed5a6 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.095062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff42bf1d-7acb-4ef8-931e-db47d78ed5a6 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.098822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff42bf1d-7acb-4ef8-931e-db47d78ed5a6 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.113688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff42bf1d-7acb-4ef8-931e-db47d78ed5a6 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.118878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff42bf1d-7acb-4ef8-931e-db47d78ed5a6 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.238480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-587e2b34-4476-48bd-ac7d-d3b8790640ee tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2e95a8c6eb4e2ca725bb39eceb86f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b720cf289ad4a64b7ab3c291f7c9d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:02.255679 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-587e2b34-4476-48bd-ac7d-d3b8790640ee tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 200 len: 1509 microversion: 2.1 time: 3.563181 Aug 25 12:53:02.257645 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 972/1967] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:58 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 1509 bytes in 3567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:02.268963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7aac7093-6879-4c52-9e91-24d3d6a323fa req-7d1abeaa-2b8c-4d6c-a3a3-7cd234fbcde6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e6d243-78f0-4af2-9799-9c8b0b34266b", "name": "network-vif-deleted", "tag": "08c1c882-e962-4f32-bdbf-8593018a711c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:02.300500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7aac7093-6879-4c52-9e91-24d3d6a323fa req-7d1abeaa-2b8c-4d6c-a3a3-7cd234fbcde6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.302159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7aac7093-6879-4c52-9e91-24d3d6a323fa req-7d1abeaa-2b8c-4d6c-a3a3-7cd234fbcde6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.303717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7aac7093-6879-4c52-9e91-24d3d6a323fa req-7d1abeaa-2b8c-4d6c-a3a3-7cd234fbcde6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.334807 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7aac7093-6879-4c52-9e91-24d3d6a323fa req-7d1abeaa-2b8c-4d6c-a3a3-7cd234fbcde6 service nova] Creating event network-vif-deleted:08c1c882-e962-4f32-bdbf-8593018a711c for instance b8e6d243-78f0-4af2-9799-9c8b0b34266b on n-h1-852771-8 Aug 25 12:53:02.355058 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7aac7093-6879-4c52-9e91-24d3d6a323fa req-7d1abeaa-2b8c-4d6c-a3a3-7cd234fbcde6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091260 Aug 25 12:53:02.357035 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 973/1968] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:02.375776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e820227-016c-412b-a829-335a3ca5a881 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Calling method '.version_select at 0x7f3a2e872160>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:02.440726 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8e820227-016c-412b-a829-335a3ca5a881 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] HTTP exception thrown: Image not found. Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e820227-016c-412b-a829-335a3ca5a881 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Request method failure captured: Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/images/2a242f2f-1aa2-4c72-ac96-bc6ca6458dc71 HTTP/1.1 Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3Cpy9wZiIitR5ECecKl6BdXm197fke3Kc3j-SZ0pkmv8CE7lSfxJqOnanqoM34D2xWwPtlxTz0ylQkByrU84m2wi-jnTiqLszbnUp8S2VX1MFBCMu1RadI0RF_je4r6WlqhwRTRVyphkEsD4Z_rjtfDAVt04-w1yiTH-j2Nvh-KGm8 Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 6e14a2b91338456da66f275f2707e5bb Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e14a2b91338456da66f275f2707e5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6e14a2b91338456da66f275f2707e5bb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6e14a2b91338456da66f275f2707e5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e14a2b91338456da66f275f2707e5bb"}]}] Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 6e14a2b91338456da66f275f2707e5bb Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesDeleteNegativeTestJSON-2039239376-project Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 00d441c7807545d6862072db77c0e71f Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376-project Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '2a242f2f-1aa2-4c72-ac96-bc6ca6458dc71'} Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2a242f2f-1aa2-4c72-ac96-bc6ca6458dc71 to delete Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2a242f2f-1aa2-4c72-ac96-bc6ca6458dc71 could not be found. Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.444948 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:53:02.454801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.467583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e820227-016c-412b-a829-335a3ca5a881 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:02.467583 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e820227-016c-412b-a829-335a3ca5a881 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] 10.222.0.70 "DELETE /compute/v2.1/images/2a242f2f-1aa2-4c72-ac96-bc6ca6458dc71" status: 404 len: 62 microversion: 2.1 time: 0.101145 Aug 25 12:53:02.468477 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 974/1969] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:53:02 2022] DELETE /compute/v2.1/images/2a242f2f-1aa2-4c72-ac96-bc6ca6458dc71 => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:53:02.480220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26c88d15-2369-4ba3-b0d0-65e417e8526a tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Calling method '.version_select at 0x7f3a2e872430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:02.549369 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-26c88d15-2369-4ba3-b0d0-65e417e8526a tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] HTTP exception thrown: Image not found. Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26c88d15-2369-4ba3-b0d0-65e417e8526a tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Request method failure captured: Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/images/tempest-invalid-1387851864 HTTP/1.1 Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3Cpy9wZiIitR5ECecKl6BdXm197fke3Kc3j-SZ0pkmv8CE7lSfxJqOnanqoM34D2xWwPtlxTz0ylQkByrU84m2wi-jnTiqLszbnUp8S2VX1MFBCMu1RadI0RF_je4r6WlqhwRTRVyphkEsD4Z_rjtfDAVt04-w1yiTH-j2Nvh-KGm8 Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 6e14a2b91338456da66f275f2707e5bb Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e14a2b91338456da66f275f2707e5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6e14a2b91338456da66f275f2707e5bb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6e14a2b91338456da66f275f2707e5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e14a2b91338456da66f275f2707e5bb"}]}] Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 6e14a2b91338456da66f275f2707e5bb Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesDeleteNegativeTestJSON-2039239376-project Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 00d441c7807545d6862072db77c0e71f Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376-project Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'tempest-invalid-1387851864'} Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1387851864 to delete Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1387851864 could not be found. Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.553763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26c88d15-2369-4ba3-b0d0-65e417e8526a tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:02.579489 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-26c88d15-2369-4ba3-b0d0-65e417e8526a tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] 10.222.0.70 "DELETE /compute/v2.1/images/tempest-invalid-1387851864" status: 404 len: 62 microversion: 2.1 time: 0.105559 Aug 25 12:53:02.589752 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 975/1970] 10.222.0.70 () {58 vars in 1206 bytes} [Thu Aug 25 12:53:02 2022] DELETE /compute/v2.1/images/tempest-invalid-1387851864 => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:53:02.608773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-74cecb85-7b47-4285-ae11-397b37d33fe8 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Calling method '.version_select at 0x7f3a2a891e50>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:02.657348 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-74cecb85-7b47-4285-ae11-397b37d33fe8 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] HTTP exception thrown: Image not found. Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-74cecb85-7b47-4285-ae11-397b37d33fe8 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Request method failure captured: Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/images/97d6e1ca-d670-43ea-842d-16f6b4084573 HTTP/1.1 Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3Cpy9wZiIitR5ECecKl6BdXm197fke3Kc3j-SZ0pkmv8CE7lSfxJqOnanqoM34D2xWwPtlxTz0ylQkByrU84m2wi-jnTiqLszbnUp8S2VX1MFBCMu1RadI0RF_je4r6WlqhwRTRVyphkEsD4Z_rjtfDAVt04-w1yiTH-j2Nvh-KGm8 Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 6e14a2b91338456da66f275f2707e5bb Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e14a2b91338456da66f275f2707e5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6e14a2b91338456da66f275f2707e5bb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6e14a2b91338456da66f275f2707e5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e14a2b91338456da66f275f2707e5bb"}]}] Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 6e14a2b91338456da66f275f2707e5bb Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376 Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesDeleteNegativeTestJSON-2039239376-project Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 00d441c7807545d6862072db77c0e71f Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2039239376-project Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '97d6e1ca-d670-43ea-842d-16f6b4084573'} Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 97d6e1ca-d670-43ea-842d-16f6b4084573 to delete Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 97d6e1ca-d670-43ea-842d-16f6b4084573 could not be found. Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.660192 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-74cecb85-7b47-4285-ae11-397b37d33fe8 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-74cecb85-7b47-4285-ae11-397b37d33fe8 tempest-ImagesDeleteNegativeTestJSON-2039239376 tempest-ImagesDeleteNegativeTestJSON-2039239376-project] 10.222.0.70 "DELETE /compute/v2.1/images/97d6e1ca-d670-43ea-842d-16f6b4084573" status: 404 len: 62 microversion: 2.1 time: 0.074107 Aug 25 12:53:02.670697 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 976/1971] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:02 2022] DELETE /compute/v2.1/images/97d6e1ca-d670-43ea-842d-16f6b4084573 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:53:02.822402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7be63840-818b-42e7-aa2d-a36132438cc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:02.823730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7be63840-818b-42e7-aa2d-a36132438cc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:02.857655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be63840-818b-42e7-aa2d-a36132438cc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.859863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be63840-818b-42e7-aa2d-a36132438cc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.863540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be63840-818b-42e7-aa2d-a36132438cc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.867191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be63840-818b-42e7-aa2d-a36132438cc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.871923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be63840-818b-42e7-aa2d-a36132438cc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.872907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be63840-818b-42e7-aa2d-a36132438cc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:03.367858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff42bf1d-7acb-4ef8-931e-db47d78ed5a6 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:03.380823 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff42bf1d-7acb-4ef8-931e-db47d78ed5a6 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1324 microversion: 2.1 time: 1.387431 Aug 25 12:53:03.383877 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 996/1972] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:01 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1324 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:03.395412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-367fe4a5-7d8b-463d-bef3-f884f33e0006 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:03.396338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-367fe4a5-7d8b-463d-bef3-f884f33e0006 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:03.428153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-367fe4a5-7d8b-463d-bef3-f884f33e0006 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:03.429760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-367fe4a5-7d8b-463d-bef3-f884f33e0006 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:03.433283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-367fe4a5-7d8b-463d-bef3-f884f33e0006 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:03.438440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-367fe4a5-7d8b-463d-bef3-f884f33e0006 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:03.439874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-367fe4a5-7d8b-463d-bef3-f884f33e0006 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:03.441295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-367fe4a5-7d8b-463d-bef3-f884f33e0006 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:03.503974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-367fe4a5-7d8b-463d-bef3-f884f33e0006 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:53:03.809768 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-367fe4a5-7d8b-463d-bef3-f884f33e0006 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "DELETE /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 204 len: 0 microversion: 2.25 time: 0.420331 Aug 25 12:53:03.814859 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 997/1973] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:53:03 2022] DELETE /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:53:03.838943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:03.840427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] [instance: b8e6d243-78f0-4af2-9799-9c8b0b34266b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:03.867806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:03.869473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:03.873874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:03.877549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:03.893140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:03.894355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:03.928338 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] HTTP exception thrown: Instance b8e6d243-78f0-4af2-9799-9c8b0b34266b could not be found. Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Request method failure captured: Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b HTTP/1.1 Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3CE7wJ_7b00GTU0GumMcFgM5vek3WIpkEpT8c_r07YITzeGbGB6o4yeQsAfpQS-b7uB-uPvnyPnxu6LVwkyYZ-DmX62tjCgiuggobf99KlDOYgCDeIG0WdT9g8L17qcH0fR_Qgz_CAXqUZ_VDBmD77EkSBQA1Cx1g01LEbuzJ2qOL0 Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 2b720cf289ad4a64b7ab3c291f7c9d9e Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerPasswordTestJSON-1509976778 Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2b720cf289ad4a64b7ab3c291f7c9d9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2b720cf289ad4a64b7ab3c291f7c9d9e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2b720cf289ad4a64b7ab3c291f7c9d9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2b720cf289ad4a64b7ab3c291f7c9d9e"}]}] Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerPasswordTestJSON-1509976778 Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 2b720cf289ad4a64b7ab3c291f7c9d9e Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1509976778 Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerPasswordTestJSON-1509976778-project Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 7d2e95a8c6eb4e2ca725bb39eceb86f3 Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerPasswordTestJSON-1509976778-project Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b8e6d243-78f0-4af2-9799-9c8b0b34266b could not be found. Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b8e6d243-78f0-4af2-9799-9c8b0b34266b'} Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8e6d243-78f0-4af2-9799-9c8b0b34266b could not be found. Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8e6d243-78f0-4af2-9799-9c8b0b34266b could not be found. Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:03.931606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:03.948365 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:03.948365 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:03.948365 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:03.948365 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:03.948365 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:03.948365 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8e6d243-78f0-4af2-9799-9c8b0b34266b could not be found. Aug 25 12:53:03.948365 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:03.948365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] Returning 404 to user: Instance b8e6d243-78f0-4af2-9799-9c8b0b34266b could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:03.948365 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-54610bc5-f4d0-4fab-bf8a-07098bfdc498 tempest-ServerPasswordTestJSON-1509976778 tempest-ServerPasswordTestJSON-1509976778-project] 10.222.0.70 "GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b" status: 404 len: 111 microversion: 2.1 time: 0.115904 Aug 25 12:53:03.953988 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 998/1974] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:03 2022] GET /compute/v2.1/servers/b8e6d243-78f0-4af2-9799-9c8b0b34266b => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:03.973091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ce39d0dd-a4ec-42b6-8116-3019e068e1f9 req-bd086b76-0027-4970-a5b1-002bb5542141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3e1033-d155-4d7c-b071-316ccabc84e7", "tag": "a356acde-57da-4791-b7c2-c879b3334a0c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:04.020057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ce39d0dd-a4ec-42b6-8116-3019e068e1f9 req-bd086b76-0027-4970-a5b1-002bb5542141 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:04.023234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ce39d0dd-a4ec-42b6-8116-3019e068e1f9 req-bd086b76-0027-4970-a5b1-002bb5542141 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:04.024014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ce39d0dd-a4ec-42b6-8116-3019e068e1f9 req-bd086b76-0027-4970-a5b1-002bb5542141 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:04.074806 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ce39d0dd-a4ec-42b6-8116-3019e068e1f9 req-bd086b76-0027-4970-a5b1-002bb5542141 service nova] Creating event network-changed:a356acde-57da-4791-b7c2-c879b3334a0c for instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 on n-h2-852771-8 Aug 25 12:53:04.083527 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ce39d0dd-a4ec-42b6-8116-3019e068e1f9 req-bd086b76-0027-4970-a5b1-002bb5542141 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127700 Aug 25 12:53:04.084464 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 999/1975] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:04.103164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:04.104473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:04.128566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:04.130273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:04.130273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:04.131409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:04.132197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:04.132922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:04.270274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7be63840-818b-42e7-aa2d-a36132438cc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:04.286457 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7be63840-818b-42e7-aa2d-a36132438cc0 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 1.471526 Aug 25 12:53:04.294662 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 977/1976] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:02 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:04.437325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e9ee5fc6-47b5-40c7-bc3f-82788f3db179 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:04.438659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e9ee5fc6-47b5-40c7-bc3f-82788f3db179 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:04.480463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9ee5fc6-47b5-40c7-bc3f-82788f3db179 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:04.487747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9ee5fc6-47b5-40c7-bc3f-82788f3db179 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:04.489866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9ee5fc6-47b5-40c7-bc3f-82788f3db179 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:04.491649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9ee5fc6-47b5-40c7-bc3f-82788f3db179 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:04.498303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9ee5fc6-47b5-40c7-bc3f-82788f3db179 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:04.500480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9ee5fc6-47b5-40c7-bc3f-82788f3db179 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:06.056325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:06.077934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:06.081688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:06.082878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e9ee5fc6-47b5-40c7-bc3f-82788f3db179 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:06.088952 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-69244a0a-d4bd-48fc-b14d-28bac0fbea12 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1732 microversion: 2.25 time: 2.001591 Aug 25 12:53:06.092122 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1000/1977] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:04 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1732 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:06.101841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-91c88fdc-1c79-4310-acfd-a3422bf0cc99 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:06.103674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-91c88fdc-1c79-4310-acfd-a3422bf0cc99 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:06.111414 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e9ee5fc6-47b5-40c7-bc3f-82788f3db179 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1324 microversion: 2.1 time: 1.691473 Aug 25 12:53:06.119823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91c88fdc-1c79-4310-acfd-a3422bf0cc99 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:06.121463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91c88fdc-1c79-4310-acfd-a3422bf0cc99 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:06.123963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91c88fdc-1c79-4310-acfd-a3422bf0cc99 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:06.125754 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 978/1978] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:04 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1324 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:06.126198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91c88fdc-1c79-4310-acfd-a3422bf0cc99 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:06.127192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91c88fdc-1c79-4310-acfd-a3422bf0cc99 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:06.128533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91c88fdc-1c79-4310-acfd-a3422bf0cc99 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.116918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-91c88fdc-1c79-4310-acfd-a3422bf0cc99 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:07.146845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b44e738-b534-46b4-9918-29dc0eaf3657 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:07.147533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6b44e738-b534-46b4-9918-29dc0eaf3657 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:07.161347 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-91c88fdc-1c79-4310-acfd-a3422bf0cc99 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 1.063929 Aug 25 12:53:07.164146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b44e738-b534-46b4-9918-29dc0eaf3657 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.182125 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1001/1979] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:06 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:07.199863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b44e738-b534-46b4-9918-29dc0eaf3657 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.201290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b44e738-b534-46b4-9918-29dc0eaf3657 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.202840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b44e738-b534-46b4-9918-29dc0eaf3657 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.203641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b44e738-b534-46b4-9918-29dc0eaf3657 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.204300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b44e738-b534-46b4-9918-29dc0eaf3657 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.210175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:07.220753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:07.231324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.242531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.243736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.245058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.246209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.248231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.291353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:07.805984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:07.830442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:07.833735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:07.836120 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ac4f5d56-2e53-4f77-a3ee-da2c527e3668 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1732 microversion: 2.25 time: 0.651183 Aug 25 12:53:07.837230 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1002/1980] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:07 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1732 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:07.881205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6b44e738-b534-46b4-9918-29dc0eaf3657 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:07.913131 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6b44e738-b534-46b4-9918-29dc0eaf3657 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1324 microversion: 2.1 time: 0.772186 Aug 25 12:53:07.927468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cea2b654-731e-4d05-af08-a64d27d742c7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:07.927468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cea2b654-731e-4d05-af08-a64d27d742c7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:07.938920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cea2b654-731e-4d05-af08-a64d27d742c7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.940148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cea2b654-731e-4d05-af08-a64d27d742c7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.943480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cea2b654-731e-4d05-af08-a64d27d742c7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.945028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cea2b654-731e-4d05-af08-a64d27d742c7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.946272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cea2b654-731e-4d05-af08-a64d27d742c7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.947094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cea2b654-731e-4d05-af08-a64d27d742c7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.950701 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 979/1981] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:07 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1324 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:07.962158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0758a39c-1f5f-4a6c-8dad-0a32cd4a328b req-896db319-6529-459b-a5f5-47f4e4241212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93190d43-5b60-464e-a1d4-ee5aba5f70e9", "tag": "336bb7d1-c5c5-48d1-8ae0-a6689485d1f5"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:07.983858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0758a39c-1f5f-4a6c-8dad-0a32cd4a328b req-896db319-6529-459b-a5f5-47f4e4241212 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.985185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0758a39c-1f5f-4a6c-8dad-0a32cd4a328b req-896db319-6529-459b-a5f5-47f4e4241212 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.986303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0758a39c-1f5f-4a6c-8dad-0a32cd4a328b req-896db319-6529-459b-a5f5-47f4e4241212 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:08.035275 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-0758a39c-1f5f-4a6c-8dad-0a32cd4a328b req-896db319-6529-459b-a5f5-47f4e4241212 service nova] Creating event network-changed:336bb7d1-c5c5-48d1-8ae0-a6689485d1f5 for instance 93190d43-5b60-464e-a1d4-ee5aba5f70e9 on n-h1-852771-8 Aug 25 12:53:08.054079 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0758a39c-1f5f-4a6c-8dad-0a32cd4a328b req-896db319-6529-459b-a5f5-47f4e4241212 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099093 Aug 25 12:53:08.055955 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 980/1982] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:08.214124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52447845-ff74-4902-8874-ad624459b138 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:08.215296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52447845-ff74-4902-8874-ad624459b138 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:08.238632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52447845-ff74-4902-8874-ad624459b138 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:08.243737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52447845-ff74-4902-8874-ad624459b138 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:08.244382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52447845-ff74-4902-8874-ad624459b138 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:08.245182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52447845-ff74-4902-8874-ad624459b138 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:08.245773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52447845-ff74-4902-8874-ad624459b138 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:08.246226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52447845-ff74-4902-8874-ad624459b138 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:08.312167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cea2b654-731e-4d05-af08-a64d27d742c7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:08.336271 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cea2b654-731e-4d05-af08-a64d27d742c7 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1577 microversion: 2.1 time: 0.426691 Aug 25 12:53:08.349557 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1003/1983] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:07 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1577 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:08.588592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52447845-ff74-4902-8874-ad624459b138 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:08.611171 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52447845-ff74-4902-8874-ad624459b138 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 0.406673 Aug 25 12:53:08.613563 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 981/1984] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:08 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:08.877252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:08.883425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:08.913273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:08.914548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:08.915637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:08.918221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:08.922966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:08.924241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:08.968712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6fa18887-07aa-4fce-a8a9-35eea5a6be2f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:08.969491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6fa18887-07aa-4fce-a8a9-35eea5a6be2f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:09.000710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fa18887-07aa-4fce-a8a9-35eea5a6be2f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:09.001622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fa18887-07aa-4fce-a8a9-35eea5a6be2f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:09.002396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fa18887-07aa-4fce-a8a9-35eea5a6be2f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:09.003654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fa18887-07aa-4fce-a8a9-35eea5a6be2f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:09.004440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fa18887-07aa-4fce-a8a9-35eea5a6be2f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:09.016342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fa18887-07aa-4fce-a8a9-35eea5a6be2f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:09.117686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:09.158442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:09.167696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:09.189865 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-81f5cb77-9e63-4812-ac99-7611f5991d78 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1664 microversion: 2.25 time: 0.323797 Aug 25 12:53:09.194982 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1004/1985] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:08 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1664 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:53:09.501834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6fa18887-07aa-4fce-a8a9-35eea5a6be2f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:09.518390 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6fa18887-07aa-4fce-a8a9-35eea5a6be2f tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1324 microversion: 2.1 time: 0.555673 Aug 25 12:53:09.535151 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 982/1986] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:08 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1324 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:09.661531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5447bb5d-d60d-45ee-9933-7dd43fa7cb60 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:09.662679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5447bb5d-d60d-45ee-9933-7dd43fa7cb60 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:09.691813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5447bb5d-d60d-45ee-9933-7dd43fa7cb60 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:09.692401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5447bb5d-d60d-45ee-9933-7dd43fa7cb60 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:09.692862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5447bb5d-d60d-45ee-9933-7dd43fa7cb60 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:09.693801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5447bb5d-d60d-45ee-9933-7dd43fa7cb60 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:09.694354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5447bb5d-d60d-45ee-9933-7dd43fa7cb60 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:09.694794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5447bb5d-d60d-45ee-9933-7dd43fa7cb60 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:10.192873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5447bb5d-d60d-45ee-9933-7dd43fa7cb60 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:10.218074 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5447bb5d-d60d-45ee-9933-7dd43fa7cb60 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 0.560289 Aug 25 12:53:10.242592 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1005/1987] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:09 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:10.266517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:10.267682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:10.288266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:10.319517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:10.320437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:10.322612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:10.327852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:10.331852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:10.334476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:10.559289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8fffd2e6-4d56-4370-80f3-05c9acd74d1e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:10.561631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8fffd2e6-4d56-4370-80f3-05c9acd74d1e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:10.573443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fffd2e6-4d56-4370-80f3-05c9acd74d1e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:10.574825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fffd2e6-4d56-4370-80f3-05c9acd74d1e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:10.576564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fffd2e6-4d56-4370-80f3-05c9acd74d1e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:10.578472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fffd2e6-4d56-4370-80f3-05c9acd74d1e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:10.579662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fffd2e6-4d56-4370-80f3-05c9acd74d1e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:10.580660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fffd2e6-4d56-4370-80f3-05c9acd74d1e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:10.874853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:10.920218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:10.928606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:10.933115 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6250d967-c3c8-4022-977a-bdc3fdd4336b tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1664 microversion: 2.25 time: 0.676415 Aug 25 12:53:10.940494 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 983/1988] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:10 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1664 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:11.262775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e9a6cddc-1567-45e9-9037-508511d6f4c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:11.264963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e9a6cddc-1567-45e9-9037-508511d6f4c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:11.278036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9a6cddc-1567-45e9-9037-508511d6f4c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:11.279791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9a6cddc-1567-45e9-9037-508511d6f4c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:11.280760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9a6cddc-1567-45e9-9037-508511d6f4c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:11.282288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9a6cddc-1567-45e9-9037-508511d6f4c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:11.283416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9a6cddc-1567-45e9-9037-508511d6f4c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:11.284352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9a6cddc-1567-45e9-9037-508511d6f4c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:11.544323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8fffd2e6-4d56-4370-80f3-05c9acd74d1e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:11.584988 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8fffd2e6-4d56-4370-80f3-05c9acd74d1e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1324 microversion: 2.1 time: 1.032004 Aug 25 12:53:11.589547 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1006/1989] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:10 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1324 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:11.987892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:11.989528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:12.000384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.001218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.002282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.003463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.004456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.005199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.289739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:12.354259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e9a6cddc-1567-45e9-9037-508511d6f4c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:12.367792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:12.387301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:12.391351 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47e2c1fd-5df1-425c-a950-18308cf05ed5 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 200 len: 1664 microversion: 2.25 time: 0.410344 Aug 25 12:53:12.396397 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e9a6cddc-1567-45e9-9037-508511d6f4c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 1.134258 Aug 25 12:53:12.396708 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1007/1990] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:11 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 1664 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:53:12.412144 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 984/1991] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:11 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:12.634569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c11a656-26bb-46de-991b-e1be92f8fee2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:12.637414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1c11a656-26bb-46de-991b-e1be92f8fee2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:12.668086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c11a656-26bb-46de-991b-e1be92f8fee2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.669470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c11a656-26bb-46de-991b-e1be92f8fee2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.670311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c11a656-26bb-46de-991b-e1be92f8fee2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.671510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c11a656-26bb-46de-991b-e1be92f8fee2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.673264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c11a656-26bb-46de-991b-e1be92f8fee2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.675433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c11a656-26bb-46de-991b-e1be92f8fee2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.823579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a8f60b80-57be-4463-98db-9cd88e3cc97f req-2ff62f11-b57c-4b3e-8d0a-dd39578c420f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18924dfe-fc9e-47d4-b4be-c249990c5455", "name": "network-vif-deleted", "tag": "c1a94bed-79da-44e9-a740-36d602c0c193"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:12.865107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a8f60b80-57be-4463-98db-9cd88e3cc97f req-2ff62f11-b57c-4b3e-8d0a-dd39578c420f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.865937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a8f60b80-57be-4463-98db-9cd88e3cc97f req-2ff62f11-b57c-4b3e-8d0a-dd39578c420f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.866781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a8f60b80-57be-4463-98db-9cd88e3cc97f req-2ff62f11-b57c-4b3e-8d0a-dd39578c420f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.921587 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a8f60b80-57be-4463-98db-9cd88e3cc97f req-2ff62f11-b57c-4b3e-8d0a-dd39578c420f service nova] Creating event network-vif-deleted:c1a94bed-79da-44e9-a740-36d602c0c193 for instance 18924dfe-fc9e-47d4-b4be-c249990c5455 on n-h2-852771-8 Aug 25 12:53:12.942552 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a8f60b80-57be-4463-98db-9cd88e3cc97f req-2ff62f11-b57c-4b3e-8d0a-dd39578c420f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126650 Aug 25 12:53:12.944808 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 985/1992] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:13.448006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6544ba8e-6763-4eaf-b540-2aeb1d1e6685 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:13.449134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6544ba8e-6763-4eaf-b540-2aeb1d1e6685 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:13.479541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6544ba8e-6763-4eaf-b540-2aeb1d1e6685 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:13.480424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6544ba8e-6763-4eaf-b540-2aeb1d1e6685 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:13.482790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6544ba8e-6763-4eaf-b540-2aeb1d1e6685 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:13.484780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6544ba8e-6763-4eaf-b540-2aeb1d1e6685 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:13.486033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6544ba8e-6763-4eaf-b540-2aeb1d1e6685 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:13.487280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6544ba8e-6763-4eaf-b540-2aeb1d1e6685 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:13.685658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1c11a656-26bb-46de-991b-e1be92f8fee2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:13.705320 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1c11a656-26bb-46de-991b-e1be92f8fee2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1324 microversion: 2.1 time: 1.078853 Aug 25 12:53:13.707602 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1008/1993] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:12 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1324 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:13.715003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:13.717620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 18924dfe-fc9e-47d4-b4be-c249990c5455] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:13.728832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:13.733642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:13.734880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:13.736523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:13.738019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:13.739083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:13.775189 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] HTTP exception thrown: Instance 18924dfe-fc9e-47d4-b4be-c249990c5455 could not be found. Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Request method failure captured: Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 HTTP/1.1 Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23Y_Q6eXMzUT1NAbUqRdnE6wWum8RCsDJMzpEbGK5lMRF694G1TTPM4gAY9IPnu_ulB4qQTuqlKwXHvHrkBiwhwz6aBdiQjHY8I5gaids_rGE5BBdiStmMxwTjfGWjU-nGNRrCR0bA1NO6diSpBVvMbFD1GDiH232JKp94xEVmJz5E Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.25 Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c899e2a1474d4eb28b598f50e93312f8 Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c899e2a1474d4eb28b598f50e93312f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c899e2a1474d4eb28b598f50e93312f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c899e2a1474d4eb28b598f50e93312f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c899e2a1474d4eb28b598f50e93312f8"}]}] Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c899e2a1474d4eb28b598f50e93312f8 Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-LiveAutoBlockMigrationV225Test-1847538791-project Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b46ef01072a84a81b862baf3ea2387dd Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791-project Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 18924dfe-fc9e-47d4-b4be-c249990c5455 could not be found. Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '18924dfe-fc9e-47d4-b4be-c249990c5455'} Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18924dfe-fc9e-47d4-b4be-c249990c5455 could not be found. Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18924dfe-fc9e-47d4-b4be-c249990c5455 could not be found. Aug 25 12:53:13.780442 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.794530 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.794530 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.794530 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.794530 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:13.794530 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:13.794530 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:13.794530 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:13.794530 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18924dfe-fc9e-47d4-b4be-c249990c5455 could not be found. Aug 25 12:53:13.794530 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.794530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Returning 404 to user: Instance 18924dfe-fc9e-47d4-b4be-c249990c5455 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:13.803865 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3b30830-a540-4951-b422-771400c917ad tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455" status: 404 len: 111 microversion: 2.25 time: 0.088684 Aug 25 12:53:13.804833 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1009/1994] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:13 2022] GET /compute/v2.1/servers/18924dfe-fc9e-47d4-b4be-c249990c5455 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:53:13.828275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d5dc9ab5-bb7f-4d28-9542-80c6979ab3fe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '.version_select at 0x7f3a29c9a4c0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:13.880205 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d5dc9ab5-bb7f-4d28-9542-80c6979ab3fe tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690300445" status: 204 len: 0 microversion: 2.25 time: 0.069788 Aug 25 12:53:13.882095 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1010/1995] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 12:53:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690300445 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 12:53:14.745219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a1977e95-1c16-4e0d-8498-ddca653e8871 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:14.748266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a1977e95-1c16-4e0d-8498-ddca653e8871 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:14.763905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1977e95-1c16-4e0d-8498-ddca653e8871 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:14.765263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1977e95-1c16-4e0d-8498-ddca653e8871 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:14.766426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1977e95-1c16-4e0d-8498-ddca653e8871 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:14.768097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1977e95-1c16-4e0d-8498-ddca653e8871 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:14.769258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1977e95-1c16-4e0d-8498-ddca653e8871 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:14.770496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1977e95-1c16-4e0d-8498-ddca653e8871 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:14.892253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6544ba8e-6763-4eaf-b540-2aeb1d1e6685 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:14.920842 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6544ba8e-6763-4eaf-b540-2aeb1d1e6685 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 1.478313 Aug 25 12:53:14.945734 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 986/1996] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:13 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:14.984129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-76550321-5287-41d7-8501-a1686e9d0f54 req-38b45084-cbac-457b-abd7-5382b618dd9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc86590d-191c-4f59-8b1c-bb10c9ff4a49", "name": "network-vif-unplugged", "status": "completed", "tag": "8e7fc008-75c2-4e5a-a9dc-0d165e20b75d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:15.026354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-76550321-5287-41d7-8501-a1686e9d0f54 req-38b45084-cbac-457b-abd7-5382b618dd9f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:15.027213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-76550321-5287-41d7-8501-a1686e9d0f54 req-38b45084-cbac-457b-abd7-5382b618dd9f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:15.029851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-76550321-5287-41d7-8501-a1686e9d0f54 req-38b45084-cbac-457b-abd7-5382b618dd9f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:15.107093 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-76550321-5287-41d7-8501-a1686e9d0f54 req-38b45084-cbac-457b-abd7-5382b618dd9f service nova] Creating event network-vif-unplugged:8e7fc008-75c2-4e5a-a9dc-0d165e20b75d for instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 on n-h1-852771-8 Aug 25 12:53:15.120606 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-76550321-5287-41d7-8501-a1686e9d0f54 req-38b45084-cbac-457b-abd7-5382b618dd9f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145171 Aug 25 12:53:15.124592 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 987/1997] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:15.969915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-442d9a16-0dbf-4469-9b7f-7c5f4325b4f8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:15.980729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-442d9a16-0dbf-4469-9b7f-7c5f4325b4f8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:16.009315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442d9a16-0dbf-4469-9b7f-7c5f4325b4f8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:16.009927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442d9a16-0dbf-4469-9b7f-7c5f4325b4f8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:16.010727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442d9a16-0dbf-4469-9b7f-7c5f4325b4f8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:16.014972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442d9a16-0dbf-4469-9b7f-7c5f4325b4f8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:16.015610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442d9a16-0dbf-4469-9b7f-7c5f4325b4f8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:16.017172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442d9a16-0dbf-4469-9b7f-7c5f4325b4f8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:16.123297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a1977e95-1c16-4e0d-8498-ddca653e8871 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:16.160029 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a1977e95-1c16-4e0d-8498-ddca653e8871 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1324 microversion: 2.1 time: 1.417770 Aug 25 12:53:16.175378 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1011/1998] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:14 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1324 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:16.841972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-442d9a16-0dbf-4469-9b7f-7c5f4325b4f8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:16.882299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-442d9a16-0dbf-4469-9b7f-7c5f4325b4f8 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 0.921257 Aug 25 12:53:16.884238 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 988/1999] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:15 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:17.210570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-494e359d-41e3-4bf9-9757-80ef2bd8d860 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:17.217944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-494e359d-41e3-4bf9-9757-80ef2bd8d860 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:17.256345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-494e359d-41e3-4bf9-9757-80ef2bd8d860 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:17.256345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-494e359d-41e3-4bf9-9757-80ef2bd8d860 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:17.256345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-494e359d-41e3-4bf9-9757-80ef2bd8d860 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:17.256881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-494e359d-41e3-4bf9-9757-80ef2bd8d860 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:17.257385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-494e359d-41e3-4bf9-9757-80ef2bd8d860 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:17.258504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-494e359d-41e3-4bf9-9757-80ef2bd8d860 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:17.339913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-31514ca9-8466-4f72-816a-38f7ad1ed4fa req-e071aa3b-21c0-4d37-a04a-0591bff049b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc86590d-191c-4f59-8b1c-bb10c9ff4a49", "tag": "8e7fc008-75c2-4e5a-a9dc-0d165e20b75d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:17.365909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-31514ca9-8466-4f72-816a-38f7ad1ed4fa req-e071aa3b-21c0-4d37-a04a-0591bff049b9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:17.372406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-31514ca9-8466-4f72-816a-38f7ad1ed4fa req-e071aa3b-21c0-4d37-a04a-0591bff049b9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:17.379579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-31514ca9-8466-4f72-816a-38f7ad1ed4fa req-e071aa3b-21c0-4d37-a04a-0591bff049b9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:17.426457 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-31514ca9-8466-4f72-816a-38f7ad1ed4fa req-e071aa3b-21c0-4d37-a04a-0591bff049b9 service nova] Creating event network-changed:8e7fc008-75c2-4e5a-a9dc-0d165e20b75d for instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 on n-h1-852771-8 Aug 25 12:53:17.456947 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-31514ca9-8466-4f72-816a-38f7ad1ed4fa req-e071aa3b-21c0-4d37-a04a-0591bff049b9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121025 Aug 25 12:53:17.458568 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 989/2000] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:53:17.956389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-494e359d-41e3-4bf9-9757-80ef2bd8d860 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:17.980762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-47af012d-0d5d-4849-9cfe-5e081c40fd73 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:17.987662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-47af012d-0d5d-4849-9cfe-5e081c40fd73 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:18.029106 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-494e359d-41e3-4bf9-9757-80ef2bd8d860 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1324 microversion: 2.1 time: 0.824849 Aug 25 12:53:18.040174 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1012/2001] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:17 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1324 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:18.049314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47af012d-0d5d-4849-9cfe-5e081c40fd73 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:18.050516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47af012d-0d5d-4849-9cfe-5e081c40fd73 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:18.054120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47af012d-0d5d-4849-9cfe-5e081c40fd73 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:18.060067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47af012d-0d5d-4849-9cfe-5e081c40fd73 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:18.061283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47af012d-0d5d-4849-9cfe-5e081c40fd73 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:18.062352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47af012d-0d5d-4849-9cfe-5e081c40fd73 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:18.235557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-611ab798-1194-48eb-b98b-a51cadf6462b req-737fca36-f23e-4819-818e-22c8677784f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3e1033-d155-4d7c-b071-316ccabc84e7", "name": "network-vif-plugged", "status": "completed", "tag": "a356acde-57da-4791-b7c2-c879b3334a0c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:18.285216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-611ab798-1194-48eb-b98b-a51cadf6462b req-737fca36-f23e-4819-818e-22c8677784f7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:18.288466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-611ab798-1194-48eb-b98b-a51cadf6462b req-737fca36-f23e-4819-818e-22c8677784f7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:18.289843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-611ab798-1194-48eb-b98b-a51cadf6462b req-737fca36-f23e-4819-818e-22c8677784f7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:18.333355 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-611ab798-1194-48eb-b98b-a51cadf6462b req-737fca36-f23e-4819-818e-22c8677784f7 service nova] Creating event network-vif-plugged:a356acde-57da-4791-b7c2-c879b3334a0c for instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 on n-h2-852771-8 Aug 25 12:53:18.346742 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-611ab798-1194-48eb-b98b-a51cadf6462b req-737fca36-f23e-4819-818e-22c8677784f7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131710 Aug 25 12:53:18.351097 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1013/2002] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:19.095851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b93bb475-e598-4fbc-90e0-a86f5d7418b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:19.097248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b93bb475-e598-4fbc-90e0-a86f5d7418b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:19.121574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b93bb475-e598-4fbc-90e0-a86f5d7418b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:19.124688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b93bb475-e598-4fbc-90e0-a86f5d7418b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:19.129932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b93bb475-e598-4fbc-90e0-a86f5d7418b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:19.145196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b93bb475-e598-4fbc-90e0-a86f5d7418b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:19.162930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b93bb475-e598-4fbc-90e0-a86f5d7418b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:19.165836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b93bb475-e598-4fbc-90e0-a86f5d7418b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:19.625409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-47af012d-0d5d-4849-9cfe-5e081c40fd73 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:19.675804 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-47af012d-0d5d-4849-9cfe-5e081c40fd73 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 1.746139 Aug 25 12:53:19.677755 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 990/2003] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:17 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:20.010713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fbe3341b-12f1-4b7f-a009-9d590d4eaf7c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:20.012114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fbe3341b-12f1-4b7f-a009-9d590d4eaf7c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:20.025056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbe3341b-12f1-4b7f-a009-9d590d4eaf7c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:20.026444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbe3341b-12f1-4b7f-a009-9d590d4eaf7c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:20.027585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbe3341b-12f1-4b7f-a009-9d590d4eaf7c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:20.029906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbe3341b-12f1-4b7f-a009-9d590d4eaf7c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:20.031246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbe3341b-12f1-4b7f-a009-9d590d4eaf7c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:20.032372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbe3341b-12f1-4b7f-a009-9d590d4eaf7c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:20.089393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fbe3341b-12f1-4b7f-a009-9d590d4eaf7c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:53:20.367048 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fbe3341b-12f1-4b7f-a009-9d590d4eaf7c tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 204 len: 0 microversion: 2.25 time: 0.364722 Aug 25 12:53:20.369953 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 991/2004] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:53:19 2022] DELETE /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:53:20.390466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:20.394657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:20.423686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:20.425430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:20.426503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:20.428287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:20.429328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:20.432191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:20.546088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:21.916696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b93bb475-e598-4fbc-90e0-a86f5d7418b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:21.981749 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b93bb475-e598-4fbc-90e0-a86f5d7418b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1324 microversion: 2.1 time: 2.898632 Aug 25 12:53:21.987354 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1014/2005] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:19 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1324 bytes in 2907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:22.033409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1815422-13b7-4fbd-97a1-7faf306d2395 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:22.036322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c1815422-13b7-4fbd-97a1-7faf306d2395 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:22.051461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1815422-13b7-4fbd-97a1-7faf306d2395 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:22.079108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1815422-13b7-4fbd-97a1-7faf306d2395 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:22.080926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1815422-13b7-4fbd-97a1-7faf306d2395 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:22.082654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1815422-13b7-4fbd-97a1-7faf306d2395 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:22.084037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1815422-13b7-4fbd-97a1-7faf306d2395 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:22.086113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1815422-13b7-4fbd-97a1-7faf306d2395 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:22.242417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:22.291874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:22.304495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:22.319536 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-073995da-0d53-4f39-aa21-8aa68f4a509e tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1549 microversion: 2.25 time: 1.941168 Aug 25 12:53:22.321952 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 992/2006] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:20 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1549 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:53:23.033916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dda48076-a8e9-4f8e-bcc2-f7c63698d616 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:23.036819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dda48076-a8e9-4f8e-bcc2-f7c63698d616 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:23.071059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dda48076-a8e9-4f8e-bcc2-f7c63698d616 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:23.082278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dda48076-a8e9-4f8e-bcc2-f7c63698d616 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:23.091170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dda48076-a8e9-4f8e-bcc2-f7c63698d616 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:23.092459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dda48076-a8e9-4f8e-bcc2-f7c63698d616 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:23.092982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dda48076-a8e9-4f8e-bcc2-f7c63698d616 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:23.093604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dda48076-a8e9-4f8e-bcc2-f7c63698d616 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:23.773888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1815422-13b7-4fbd-97a1-7faf306d2395 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:23.827153 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c1815422-13b7-4fbd-97a1-7faf306d2395 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 1.830521 Aug 25 12:53:23.844743 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1015/2007] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:21 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:23.846206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:23.848024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:23.909597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:23.917387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:23.923239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:23.928543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:23.932085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:23.935212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.087909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.094945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.095819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.096678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lazy-loading 'fault' on Instance uuid f461f436-381b-4331-ac39-4a67d4a3efdc {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:53:24.413548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:24.425279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dda48076-a8e9-4f8e-bcc2-f7c63698d616 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:24.448500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:24.457230 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dda48076-a8e9-4f8e-bcc2-f7c63698d616 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1521 microversion: 2.1 time: 1.430747 Aug 25 12:53:24.467192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:24.472106 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c66b7264-4c1e-47cd-b839-b512d6c0a0e3 tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 200 len: 1351 microversion: 2.25 time: 0.637586 Aug 25 12:53:24.475017 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1016/2009] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:23 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 1351 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:24.478841 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 993/2009] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:23 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1521 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:24.491647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-687f9d4a-fc87-41e8-9ba0-792cc5e2d086 req-8004239b-e66a-4620-aeff-c7fb20c86462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f461f436-381b-4331-ac39-4a67d4a3efdc", "name": "network-vif-deleted", "tag": "9f7b0b98-e0c1-4023-95f8-2759fe8df08d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:24.527323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-47f1078e-e575-4a5e-9ac1-2afddfa48b81 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:24.531099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-47f1078e-e575-4a5e-9ac1-2afddfa48b81 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:24.555675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f1078e-e575-4a5e-9ac1-2afddfa48b81 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.556689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f1078e-e575-4a5e-9ac1-2afddfa48b81 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.557558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f1078e-e575-4a5e-9ac1-2afddfa48b81 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.558934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f1078e-e575-4a5e-9ac1-2afddfa48b81 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.560422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f1078e-e575-4a5e-9ac1-2afddfa48b81 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.578617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47f1078e-e575-4a5e-9ac1-2afddfa48b81 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.607703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-687f9d4a-fc87-41e8-9ba0-792cc5e2d086 req-8004239b-e66a-4620-aeff-c7fb20c86462 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.608655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-687f9d4a-fc87-41e8-9ba0-792cc5e2d086 req-8004239b-e66a-4620-aeff-c7fb20c86462 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.609995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-687f9d4a-fc87-41e8-9ba0-792cc5e2d086 req-8004239b-e66a-4620-aeff-c7fb20c86462 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.713249 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-687f9d4a-fc87-41e8-9ba0-792cc5e2d086 req-8004239b-e66a-4620-aeff-c7fb20c86462 service nova] Creating event network-vif-deleted:9f7b0b98-e0c1-4023-95f8-2759fe8df08d for instance f461f436-381b-4331-ac39-4a67d4a3efdc on n-h2-852771-8 Aug 25 12:53:24.752154 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-687f9d4a-fc87-41e8-9ba0-792cc5e2d086 req-8004239b-e66a-4620-aeff-c7fb20c86462 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263541 Aug 25 12:53:24.754491 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1017/2010] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:24.902638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b1b12815-e5db-470c-9d4f-cd2060570959 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:24.905405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b1b12815-e5db-470c-9d4f-cd2060570959 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:24.937093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1b12815-e5db-470c-9d4f-cd2060570959 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.939239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1b12815-e5db-470c-9d4f-cd2060570959 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.944040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1b12815-e5db-470c-9d4f-cd2060570959 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.948184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1b12815-e5db-470c-9d4f-cd2060570959 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.951580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1b12815-e5db-470c-9d4f-cd2060570959 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.955512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1b12815-e5db-470c-9d4f-cd2060570959 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:26.868714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-47f1078e-e575-4a5e-9ac1-2afddfa48b81 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:26.905218 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-47f1078e-e575-4a5e-9ac1-2afddfa48b81 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1521 microversion: 2.1 time: 2.386797 Aug 25 12:53:26.937957 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 994/2011] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:24 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1521 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:26.984830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:26.985832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: f461f436-381b-4331-ac39-4a67d4a3efdc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:27.016902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:27.022559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:27.023841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:27.025439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:27.026362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:27.027250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:27.098213 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] HTTP exception thrown: Instance f461f436-381b-4331-ac39-4a67d4a3efdc could not be found. Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Request method failure captured: Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc HTTP/1.1 Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB23Y_Q6eXMzUT1NAbUqRdnE6wWum8RCsDJMzpEbGK5lMRF694G1TTPM4gAY9IPnu_ulB4qQTuqlKwXHvHrkBiwhwz6aBdiQjHY8I5gaids_rGE5BBdiStmMxwTjfGWjU-nGNRrCR0bA1NO6diSpBVvMbFD1GDiH232JKp94xEVmJz5E Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Openstack-Nova-Api-Version: 2.25 Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: c899e2a1474d4eb28b598f50e93312f8 Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c899e2a1474d4eb28b598f50e93312f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c899e2a1474d4eb28b598f50e93312f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c899e2a1474d4eb28b598f50e93312f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c899e2a1474d4eb28b598f50e93312f8"}]}] Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: c899e2a1474d4eb28b598f50e93312f8 Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-LiveAutoBlockMigrationV225Test-1847538791-project Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b46ef01072a84a81b862baf3ea2387dd Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791-project Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance f461f436-381b-4331-ac39-4a67d4a3efdc could not be found. Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'f461f436-381b-4331-ac39-4a67d4a3efdc'} Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f461f436-381b-4331-ac39-4a67d4a3efdc could not be found. Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f461f436-381b-4331-ac39-4a67d4a3efdc could not be found. Aug 25 12:53:27.107631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f461f436-381b-4331-ac39-4a67d4a3efdc could not be found. Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Returning 404 to user: Instance f461f436-381b-4331-ac39-4a67d4a3efdc could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:27.117485 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3aa363c0-53ea-4b40-b71c-b99990b2b9aa tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc" status: 404 len: 111 microversion: 2.25 time: 0.166409 Aug 25 12:53:27.122481 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 995/2012] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:26 2022] GET /compute/v2.1/servers/f461f436-381b-4331-ac39-4a67d4a3efdc => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:53:27.143418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b86cc2fa-c39c-49e4-a33f-9abbb665d54b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1541643141"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:27.158978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b86cc2fa-c39c-49e4-a33f-9abbb665d54b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:27.191122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b86cc2fa-c39c-49e4-a33f-9abbb665d54b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:27.192032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b86cc2fa-c39c-49e4-a33f-9abbb665d54b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:27.192850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b86cc2fa-c39c-49e4-a33f-9abbb665d54b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:27.194252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b86cc2fa-c39c-49e4-a33f-9abbb665d54b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:27.195134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b86cc2fa-c39c-49e4-a33f-9abbb665d54b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:27.195932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b86cc2fa-c39c-49e4-a33f-9abbb665d54b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:27.353778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b1b12815-e5db-470c-9d4f-cd2060570959 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:27.396706 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b1b12815-e5db-470c-9d4f-cd2060570959 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 2.513810 Aug 25 12:53:27.403946 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1018/2013] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:24 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 2525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:27.422971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9225b531-81b3-4ade-bc35-4f49cd7d3aca tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:27.435595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9225b531-81b3-4ade-bc35-4f49cd7d3aca tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:27.469656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9225b531-81b3-4ade-bc35-4f49cd7d3aca tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:27.469656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9225b531-81b3-4ade-bc35-4f49cd7d3aca tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:27.469656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9225b531-81b3-4ade-bc35-4f49cd7d3aca tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:27.469656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9225b531-81b3-4ade-bc35-4f49cd7d3aca tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:27.469656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9225b531-81b3-4ade-bc35-4f49cd7d3aca tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:27.475175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9225b531-81b3-4ade-bc35-4f49cd7d3aca tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:27.597483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9225b531-81b3-4ade-bc35-4f49cd7d3aca tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:53:27.990590 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b86cc2fa-c39c-49e4-a33f-9abbb665d54b tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "POST /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7/action" status: 202 len: 0 microversion: 2.1 time: 0.866352 Aug 25 12:53:28.005337 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 996/2014] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:53:27 2022] POST /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7/action => generated 0 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:53:28.014699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9225b531-81b3-4ade-bc35-4f49cd7d3aca tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 204 len: 0 microversion: 2.25 time: 0.607995 Aug 25 12:53:28.015938 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1019/2015] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 12:53:27 2022] DELETE /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:53:28.022724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6501d696-7642-428d-a8e8-ac1c088c4e8c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '.version_select at 0x7f3a2e872430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:28.062722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:28.064536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:28.112018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:28.123676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:28.126857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:28.136130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:28.149555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:28.152479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:28.172240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:28.603607 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6501d696-7642-428d-a8e8-ac1c088c4e8c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "DELETE /compute/v2.1/images/dfbec112-bb91-41a3-9700-56aac59fbbfc" status: 204 len: 0 microversion: 2.1 time: 0.595382 Aug 25 12:53:28.604956 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 997/2016] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:28 2022] DELETE /compute/v2.1/images/dfbec112-bb91-41a3-9700-56aac59fbbfc => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:53:29.149210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c805f91-5ab9-41ed-a432-def3326617ee tempest-AbsoluteLimitsTestJSON-801475520 tempest-AbsoluteLimitsTestJSON-801475520-project] Calling method '.version_select at 0x7f3a2e831ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:29.203159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c805f91-5ab9-41ed-a432-def3326617ee tempest-AbsoluteLimitsTestJSON-801475520 tempest-AbsoluteLimitsTestJSON-801475520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:29.204395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c805f91-5ab9-41ed-a432-def3326617ee tempest-AbsoluteLimitsTestJSON-801475520 tempest-AbsoluteLimitsTestJSON-801475520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:29.205407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c805f91-5ab9-41ed-a432-def3326617ee tempest-AbsoluteLimitsTestJSON-801475520 tempest-AbsoluteLimitsTestJSON-801475520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:29.207084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c805f91-5ab9-41ed-a432-def3326617ee tempest-AbsoluteLimitsTestJSON-801475520 tempest-AbsoluteLimitsTestJSON-801475520-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:29.208786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c805f91-5ab9-41ed-a432-def3326617ee tempest-AbsoluteLimitsTestJSON-801475520 tempest-AbsoluteLimitsTestJSON-801475520-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:29.209871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c805f91-5ab9-41ed-a432-def3326617ee tempest-AbsoluteLimitsTestJSON-801475520 tempest-AbsoluteLimitsTestJSON-801475520-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:29.279379 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0c805f91-5ab9-41ed-a432-def3326617ee tempest-AbsoluteLimitsTestJSON-801475520 tempest-AbsoluteLimitsTestJSON-801475520-project] 10.222.0.70 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.666562 Aug 25 12:53:29.281413 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 998/2017] 10.222.0.70 () {58 vars in 1122 bytes} [Thu Aug 25 12:53:28 2022] GET /compute/v2.1/limits => generated 511 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:29.306800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c91a66c8-a370-4ae0-ac84-8e5054f5c9cb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:29.308481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c91a66c8-a370-4ae0-ac84-8e5054f5c9cb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:29.334879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91a66c8-a370-4ae0-ac84-8e5054f5c9cb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:29.336956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91a66c8-a370-4ae0-ac84-8e5054f5c9cb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:29.338369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91a66c8-a370-4ae0-ac84-8e5054f5c9cb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:29.342126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91a66c8-a370-4ae0-ac84-8e5054f5c9cb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:29.343857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91a66c8-a370-4ae0-ac84-8e5054f5c9cb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:29.345128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91a66c8-a370-4ae0-ac84-8e5054f5c9cb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:29.362837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:29.400220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:29.410959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:29.419454 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9611f357-1ee0-44ec-9c3e-4fc6bd8b892d tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1565 microversion: 2.25 time: 1.394493 Aug 25 12:53:29.430123 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1020/2018] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:28 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1565 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:29.468173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0e779e43-2bc8-4bb0-8500-fd0487d6e462 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '.version_select at 0x7f3a2e6edc10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:29.536772 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-0e779e43-2bc8-4bb0-8500-fd0487d6e462 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Image not found. Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0e779e43-2bc8-4bb0-8500-fd0487d6e462 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/images/dfbec112-bb91-41a3-9700-56aac59fbbfc HTTP/1.1 Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: exception: Image not found. Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'dfbec112-bb91-41a3-9700-56aac59fbbfc'} Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dfbec112-bb91-41a3-9700-56aac59fbbfc Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:53:29.542453 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dfbec112-bb91-41a3-9700-56aac59fbbfc could not be found. Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:53:29.549855 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:29.558803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0e779e43-2bc8-4bb0-8500-fd0487d6e462 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 404 to user: Image not found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:29.562492 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0e779e43-2bc8-4bb0-8500-fd0487d6e462 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/images/dfbec112-bb91-41a3-9700-56aac59fbbfc" status: 404 len: 62 microversion: 2.1 time: 0.125637 Aug 25 12:53:29.572272 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1021/2019] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 12:53:29 2022] GET /compute/v2.1/images/dfbec112-bb91-41a3-9700-56aac59fbbfc => generated 62 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:53:29.593670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d60d85bb-3b98-4415-8bd9-39217bb129be tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:29.596575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d60d85bb-3b98-4415-8bd9-39217bb129be tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:29.619543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:29.623832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60d85bb-3b98-4415-8bd9-39217bb129be tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:29.629837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60d85bb-3b98-4415-8bd9-39217bb129be tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:29.633197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60d85bb-3b98-4415-8bd9-39217bb129be tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:29.634862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60d85bb-3b98-4415-8bd9-39217bb129be tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:29.638973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60d85bb-3b98-4415-8bd9-39217bb129be tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:29.641942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60d85bb-3b98-4415-8bd9-39217bb129be tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:30.930469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c91a66c8-a370-4ae0-ac84-8e5054f5c9cb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:30.936264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d60d85bb-3b98-4415-8bd9-39217bb129be tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:30.963808 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c91a66c8-a370-4ae0-ac84-8e5054f5c9cb tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 1.680043 Aug 25 12:53:30.967210 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 999/2020] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:29 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:30.972541 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d60d85bb-3b98-4415-8bd9-39217bb129be tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1533 microversion: 2.1 time: 1.397997 Aug 25 12:53:30.977208 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1022/2021] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:29 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1533 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:30.999933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:31.009251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:31.022782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:31.023967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:31.024974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:31.026523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:31.027608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:31.030213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:31.255060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:31.279072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:31.289727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b46ef01072a84a81b862baf3ea2387dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c899e2a1474d4eb28b598f50e93312f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:31.294342 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e114b7f-4630-43b0-aacf-076222a178bb tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 200 len: 1523 microversion: 2.25 time: 0.324258 Aug 25 12:53:31.296312 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1000/2022] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:30 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:31.866706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5ac48593-3f4b-4370-9a96-3b5fd0919fb9 req-cb0e6273-e0cc-4214-a875-263552cde06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0176f06a-ee98-45ab-b392-b9b46a8e82cd", "name": "network-vif-deleted", "tag": "ffaaa691-b79c-4ca1-bdce-2e197228d565"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:31.925357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5ac48593-3f4b-4370-9a96-3b5fd0919fb9 req-cb0e6273-e0cc-4214-a875-263552cde06c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:31.931828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5ac48593-3f4b-4370-9a96-3b5fd0919fb9 req-cb0e6273-e0cc-4214-a875-263552cde06c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:31.939834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5ac48593-3f4b-4370-9a96-3b5fd0919fb9 req-cb0e6273-e0cc-4214-a875-263552cde06c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:31.978065 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5ac48593-3f4b-4370-9a96-3b5fd0919fb9 req-cb0e6273-e0cc-4214-a875-263552cde06c service nova] Creating event network-vif-deleted:ffaaa691-b79c-4ca1-bdce-2e197228d565 for instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd on n-h2-852771-8 Aug 25 12:53:31.991891 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5ac48593-3f4b-4370-9a96-3b5fd0919fb9 req-cb0e6273-e0cc-4214-a875-263552cde06c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131522 Aug 25 12:53:31.993944 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1023/2023] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:32.008281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bbd44447-b563-4cb1-98b3-b2d8f93b7622 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:32.009461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bbd44447-b563-4cb1-98b3-b2d8f93b7622 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:32.030273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4c11b2a4-5120-458b-9770-f4d21477cad2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:32.031363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd44447-b563-4cb1-98b3-b2d8f93b7622 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:32.033207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4c11b2a4-5120-458b-9770-f4d21477cad2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:32.033458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd44447-b563-4cb1-98b3-b2d8f93b7622 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:32.034625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd44447-b563-4cb1-98b3-b2d8f93b7622 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:32.036506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd44447-b563-4cb1-98b3-b2d8f93b7622 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:32.039007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd44447-b563-4cb1-98b3-b2d8f93b7622 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:32.040251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbd44447-b563-4cb1-98b3-b2d8f93b7622 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:32.059103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c11b2a4-5120-458b-9770-f4d21477cad2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:32.070347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c11b2a4-5120-458b-9770-f4d21477cad2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:32.071440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c11b2a4-5120-458b-9770-f4d21477cad2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:32.072904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c11b2a4-5120-458b-9770-f4d21477cad2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:32.073927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c11b2a4-5120-458b-9770-f4d21477cad2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:32.074935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c11b2a4-5120-458b-9770-f4d21477cad2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:32.973251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4c11b2a4-5120-458b-9770-f4d21477cad2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:33.031871 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4c11b2a4-5120-458b-9770-f4d21477cad2 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1539 microversion: 2.1 time: 1.015947 Aug 25 12:53:33.049994 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1024/2024] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:32 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1539 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:33.062370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:33.063650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] [instance: 0176f06a-ee98-45ab-b392-b9b46a8e82cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:33.087050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:33.087963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:33.088709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:33.090008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:33.091425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:33.092234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:33.160558 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] HTTP exception thrown: Instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd could not be found. Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Request method failure captured: Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd HTTP/1.1 Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB23Y_Q6eXMzUT1NAbUqRdnE6wWum8RCsDJMzpEbGK5lMRF694G1TTPM4gAY9IPnu_ulB4qQTuqlKwXHvHrkBiwhwz6aBdiQjHY8I5gaids_rGE5BBdiStmMxwTjfGWjU-nGNRrCR0bA1NO6diSpBVvMbFD1GDiH232JKp94xEVmJz5E Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.25 Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c899e2a1474d4eb28b598f50e93312f8 Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c899e2a1474d4eb28b598f50e93312f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c899e2a1474d4eb28b598f50e93312f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c899e2a1474d4eb28b598f50e93312f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c899e2a1474d4eb28b598f50e93312f8"}]}] Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c899e2a1474d4eb28b598f50e93312f8 Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791 Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-LiveAutoBlockMigrationV225Test-1847538791-project Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b46ef01072a84a81b862baf3ea2387dd Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1847538791-project Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd could not be found. Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '0176f06a-ee98-45ab-b392-b9b46a8e82cd'} Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd could not be found. Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd could not be found. Aug 25 12:53:33.163901 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd could not be found. Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] Returning 404 to user: Instance 0176f06a-ee98-45ab-b392-b9b46a8e82cd could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:33.171937 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f7ebcb0-1c36-4e69-bd59-2df7998ab09a tempest-LiveAutoBlockMigrationV225Test-1847538791 tempest-LiveAutoBlockMigrationV225Test-1847538791-project] 10.222.0.70 "GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd" status: 404 len: 111 microversion: 2.25 time: 0.115149 Aug 25 12:53:33.178127 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1025/2025] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:33 2022] GET /compute/v2.1/servers/0176f06a-ee98-45ab-b392-b9b46a8e82cd => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:53:33.872369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bbd44447-b563-4cb1-98b3-b2d8f93b7622 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:33.944331 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bbd44447-b563-4cb1-98b3-b2d8f93b7622 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 1.940233 Aug 25 12:53:33.947255 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1001/2026] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:31 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:34.086372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f3a9c52f-b853-4902-b8f7-b8da5a45a0c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:34.090930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f3a9c52f-b853-4902-b8f7-b8da5a45a0c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:34.115507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3a9c52f-b853-4902-b8f7-b8da5a45a0c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:34.116709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3a9c52f-b853-4902-b8f7-b8da5a45a0c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:34.118853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3a9c52f-b853-4902-b8f7-b8da5a45a0c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:34.127251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3a9c52f-b853-4902-b8f7-b8da5a45a0c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:34.128378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3a9c52f-b853-4902-b8f7-b8da5a45a0c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:34.130275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3a9c52f-b853-4902-b8f7-b8da5a45a0c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:34.994611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3062fd8-049e-47ea-9bcc-f7d6a3c305a1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:35.011407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c3062fd8-049e-47ea-9bcc-f7d6a3c305a1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:35.073195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3062fd8-049e-47ea-9bcc-f7d6a3c305a1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:35.073679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3062fd8-049e-47ea-9bcc-f7d6a3c305a1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:35.075328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3062fd8-049e-47ea-9bcc-f7d6a3c305a1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:35.077840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3062fd8-049e-47ea-9bcc-f7d6a3c305a1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:35.083310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3062fd8-049e-47ea-9bcc-f7d6a3c305a1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:35.085928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3062fd8-049e-47ea-9bcc-f7d6a3c305a1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:37.245230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3062fd8-049e-47ea-9bcc-f7d6a3c305a1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:37.292543 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3062fd8-049e-47ea-9bcc-f7d6a3c305a1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1715 microversion: 2.1 time: 2.304728 Aug 25 12:53:37.298443 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1002/2027] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:34 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1715 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:37.551641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4f111272-17c0-44e5-9779-addacc4e2aad tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Calling method '.version_select at 0x7f3a2e8430d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:37.592044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f111272-17c0-44e5-9779-addacc4e2aad tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:37.593285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f111272-17c0-44e5-9779-addacc4e2aad tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:37.594557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f111272-17c0-44e5-9779-addacc4e2aad tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:37.598859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f111272-17c0-44e5-9779-addacc4e2aad tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:37.600044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f111272-17c0-44e5-9779-addacc4e2aad tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:37.602303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f111272-17c0-44e5-9779-addacc4e2aad tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:37.701989 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4f111272-17c0-44e5-9779-addacc4e2aad tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] 10.222.0.70 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.398994 Aug 25 12:53:37.703833 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1003/2028] 10.222.0.70 () {58 vars in 1122 bytes} [Thu Aug 25 12:53:37 2022] GET /compute/v2.1/limits => generated 511 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:37.770756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f3a9c52f-b853-4902-b8f7-b8da5a45a0c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:37.821203 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f3a9c52f-b853-4902-b8f7-b8da5a45a0c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1539 microversion: 2.1 time: 3.744020 Aug 25 12:53:37.821985 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1026/2029] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:34 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1539 bytes in 3746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:37.888396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6451f6aa-3bd7-4533-b493-ac47581ed7ba tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-480974248", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:38.067558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-6451f6aa-3bd7-4533-b493-ac47581ed7ba tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:53:38.335910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f18e1b15-132b-4190-9e7c-1bcd8c16f189 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:38.339886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f18e1b15-132b-4190-9e7c-1bcd8c16f189 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:38.377385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f18e1b15-132b-4190-9e7c-1bcd8c16f189 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:38.378332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f18e1b15-132b-4190-9e7c-1bcd8c16f189 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:38.379402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f18e1b15-132b-4190-9e7c-1bcd8c16f189 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:38.395746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f18e1b15-132b-4190-9e7c-1bcd8c16f189 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:38.440538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f18e1b15-132b-4190-9e7c-1bcd8c16f189 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:38.442011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f18e1b15-132b-4190-9e7c-1bcd8c16f189 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:39.909274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f18e1b15-132b-4190-9e7c-1bcd8c16f189 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:39.952936 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f18e1b15-132b-4190-9e7c-1bcd8c16f189 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1705 microversion: 2.1 time: 1.624193 Aug 25 12:53:39.953956 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1027/2030] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:38 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1705 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:39.995768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08e5fe5a-aedc-4807-b4c5-96a8e8443aac tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:40.015323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-08e5fe5a-aedc-4807-b4c5-96a8e8443aac tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:40.047809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08e5fe5a-aedc-4807-b4c5-96a8e8443aac tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:40.052112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08e5fe5a-aedc-4807-b4c5-96a8e8443aac tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:40.053691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08e5fe5a-aedc-4807-b4c5-96a8e8443aac tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:40.062514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08e5fe5a-aedc-4807-b4c5-96a8e8443aac tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:40.065659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08e5fe5a-aedc-4807-b4c5-96a8e8443aac tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:40.067292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08e5fe5a-aedc-4807-b4c5-96a8e8443aac tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:40.209378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-6451f6aa-3bd7-4533-b493-ac47581ed7ba tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Getting quotas for project 8cf637a9782c4d0b983d8215792bf595. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:40.253822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-6451f6aa-3bd7-4533-b493-ac47581ed7ba tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Getting quotas for user df3da7bb66274080931d87efe1d67061 and project 8cf637a9782c4d0b983d8215792bf595. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:40.350327 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-6451f6aa-3bd7-4533-b493-ac47581ed7ba tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6451f6aa-3bd7-4533-b493-ac47581ed7ba tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Request method failure captured: Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 1751 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3DPddseajwAXUTb2b8M5keieVMdyiYIbdR4M7sh2mSDc9-n3on6rLCKbWKcuhvFBbtDjPOv5dRHU5Cr85sIlw8tvS0l1wY8lhs19qBOrgaGhlqc_m00azQFKtE1qqPt1sfQo1pAu1Gb0VFq3fOXVKTM_SsiirZ8l9UFPBDXKOlBHog Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 8cf637a9782c4d0b983d8215792bf595 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2017449726 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cf637a9782c4d0b983d8215792bf595"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8cf637a9782c4d0b983d8215792bf595", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8cf637a9782c4d0b983d8215792bf595"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cf637a9782c4d0b983d8215792bf595"}]}] Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2017449726 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 8cf637a9782c4d0b983d8215792bf595 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2017449726 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: df3da7bb66274080931d87efe1d67061 Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-480974248", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:53:40.363756 n-d-852771-8 devstack@n-api.service[129059]: exception: Maximum number of metadata items exceeds 128 Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-480974248', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:53:40.368002 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6451f6aa-3bd7-4533-b493-ac47581ed7ba tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6451f6aa-3bd7-4533-b493-ac47581ed7ba tempest-AbsoluteLimitsNegativeTestJSON-2017449726 tempest-AbsoluteLimitsNegativeTestJSON-2017449726-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 2.486370 Aug 25 12:53:40.382522 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1004/2031] 10.222.0.70 () {60 vars in 1148 bytes} [Thu Aug 25 12:53:37 2022] POST /compute/v2.1/servers => generated 87 bytes in 2497 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:53:40.416533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d9e487b-4f3c-4e0d-8591-c960dd1b4ff5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '.version_select at 0x7f3a2e8928b0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:40.440829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d9e487b-4f3c-4e0d-8591-c960dd1b4ff5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:40.443460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d9e487b-4f3c-4e0d-8591-c960dd1b4ff5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:40.445694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d9e487b-4f3c-4e0d-8591-c960dd1b4ff5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:40.474525 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d9e487b-4f3c-4e0d-8591-c960dd1b4ff5 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1167 microversion: 2.1 time: 0.094657 Aug 25 12:53:40.476601 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1005/2032] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:53:40 2022] GET /compute/v2.1/os-migrations => generated 1167 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:40.513194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3801d5a4-6838-4918-8a6c-544f15dba3ff tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:40.522135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3801d5a4-6838-4918-8a6c-544f15dba3ff tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:40.547167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:40.554478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3801d5a4-6838-4918-8a6c-544f15dba3ff tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:40.555858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3801d5a4-6838-4918-8a6c-544f15dba3ff tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:40.557686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3801d5a4-6838-4918-8a6c-544f15dba3ff tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:40.561719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3801d5a4-6838-4918-8a6c-544f15dba3ff tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:40.564852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3801d5a4-6838-4918-8a6c-544f15dba3ff tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:40.566153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3801d5a4-6838-4918-8a6c-544f15dba3ff tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:42.325055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-08e5fe5a-aedc-4807-b4c5-96a8e8443aac tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:42.343098 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-08e5fe5a-aedc-4807-b4c5-96a8e8443aac tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1521 microversion: 2.1 time: 2.381111 Aug 25 12:53:42.345044 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1028/2033] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:39 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1521 bytes in 2387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:42.385845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b623337e-99d7-473f-ac26-7f991face798 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:42.386849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b623337e-99d7-473f-ac26-7f991face798 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:42.413459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b623337e-99d7-473f-ac26-7f991face798 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:42.414429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b623337e-99d7-473f-ac26-7f991face798 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:42.415298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b623337e-99d7-473f-ac26-7f991face798 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:42.416663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b623337e-99d7-473f-ac26-7f991face798 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:42.420171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b623337e-99d7-473f-ac26-7f991face798 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:42.426259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b623337e-99d7-473f-ac26-7f991face798 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:42.474528 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3801d5a4-6838-4918-8a6c-544f15dba3ff tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1856 microversion: 2.1 time: 1.975630 Aug 25 12:53:42.502627 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1006/2034] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:40 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1856 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:42.565382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b6c77221-7045-4e47-8fe8-c9703577240a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:42.566780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b6c77221-7045-4e47-8fe8-c9703577240a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:42.597077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c77221-7045-4e47-8fe8-c9703577240a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:42.603660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c77221-7045-4e47-8fe8-c9703577240a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:42.608337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c77221-7045-4e47-8fe8-c9703577240a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:42.610954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c77221-7045-4e47-8fe8-c9703577240a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:42.619759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c77221-7045-4e47-8fe8-c9703577240a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:42.622878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c77221-7045-4e47-8fe8-c9703577240a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:42.668861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b623337e-99d7-473f-ac26-7f991face798 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:53:43.036895 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b623337e-99d7-473f-ac26-7f991face798 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 204 len: 0 microversion: 2.1 time: 0.655233 Aug 25 12:53:43.047356 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1029/2035] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:53:42 2022] DELETE /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:53:43.078610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ccc4778-f032-42b4-8871-f03ff9b4a4c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:43.086992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ccc4778-f032-42b4-8871-f03ff9b4a4c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:43.130217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ccc4778-f032-42b4-8871-f03ff9b4a4c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:43.131478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ccc4778-f032-42b4-8871-f03ff9b4a4c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:43.133090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ccc4778-f032-42b4-8871-f03ff9b4a4c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:43.138381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ccc4778-f032-42b4-8871-f03ff9b4a4c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:43.143057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ccc4778-f032-42b4-8871-f03ff9b4a4c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:43.144392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ccc4778-f032-42b4-8871-f03ff9b4a4c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:44.917944 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b6c77221-7045-4e47-8fe8-c9703577240a tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1856 microversion: 2.1 time: 2.383968 Aug 25 12:53:44.930554 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1007/2036] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:42 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1856 bytes in 2398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:45.198898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0e573209-f99f-4f42-b6fd-c0f7b83ec559 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:45.201906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0e573209-f99f-4f42-b6fd-c0f7b83ec559 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:45.212985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e573209-f99f-4f42-b6fd-c0f7b83ec559 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:45.213939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e573209-f99f-4f42-b6fd-c0f7b83ec559 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:45.214564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e573209-f99f-4f42-b6fd-c0f7b83ec559 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:45.217274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e573209-f99f-4f42-b6fd-c0f7b83ec559 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:45.220430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e573209-f99f-4f42-b6fd-c0f7b83ec559 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:45.223196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e573209-f99f-4f42-b6fd-c0f7b83ec559 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:45.664259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-0e573209-f99f-4f42-b6fd-c0f7b83ec559 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lazy-loading 'services' on Instance uuid bc86590d-191c-4f59-8b1c-bb10c9ff4a49 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:53:45.701418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2ccc4778-f032-42b4-8871-f03ff9b4a4c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:45.756083 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2ccc4778-f032-42b4-8871-f03ff9b4a4c8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1527 microversion: 2.1 time: 2.707036 Aug 25 12:53:45.768094 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1030/2037] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:43 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1527 bytes in 2719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:46.023362 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0e573209-f99f-4f42-b6fd-c0f7b83ec559 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments/728e586d-d40c-413f-bd1d-38591bbf94b0" status: 202 len: 0 microversion: 2.1 time: 0.836657 Aug 25 12:53:46.043264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a9f70ee-79f2-4f1c-a877-5325c1d6e531 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:46.052647 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1008/2038] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 12:53:45 2022] DELETE /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments/728e586d-d40c-413f-bd1d-38591bbf94b0 => generated 0 bytes in 868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:53:46.055709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a9f70ee-79f2-4f1c-a877-5325c1d6e531 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:46.092527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a9f70ee-79f2-4f1c-a877-5325c1d6e531 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:46.093926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a9f70ee-79f2-4f1c-a877-5325c1d6e531 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:46.096007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a9f70ee-79f2-4f1c-a877-5325c1d6e531 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:46.102624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a9f70ee-79f2-4f1c-a877-5325c1d6e531 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:46.104404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a9f70ee-79f2-4f1c-a877-5325c1d6e531 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:46.107111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a9f70ee-79f2-4f1c-a877-5325c1d6e531 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:46.284393 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a9f70ee-79f2-4f1c-a877-5325c1d6e531 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.248298 Aug 25 12:53:46.285814 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1031/2039] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:53:46 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:53:46.812439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5330d41-bce7-48f9-86ee-459a0edd39b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:46.818205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b5330d41-bce7-48f9-86ee-459a0edd39b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:46.849119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5330d41-bce7-48f9-86ee-459a0edd39b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:46.850073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5330d41-bce7-48f9-86ee-459a0edd39b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:46.853923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5330d41-bce7-48f9-86ee-459a0edd39b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:46.858345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5330d41-bce7-48f9-86ee-459a0edd39b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:46.859476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5330d41-bce7-48f9-86ee-459a0edd39b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:46.875001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5330d41-bce7-48f9-86ee-459a0edd39b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:47.307097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5f48b666-36d1-4cd1-8374-01d5ddbbb4dd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:47.320461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5f48b666-36d1-4cd1-8374-01d5ddbbb4dd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:47.350005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f48b666-36d1-4cd1-8374-01d5ddbbb4dd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:47.362248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f48b666-36d1-4cd1-8374-01d5ddbbb4dd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:47.367050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f48b666-36d1-4cd1-8374-01d5ddbbb4dd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:47.373831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f48b666-36d1-4cd1-8374-01d5ddbbb4dd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:47.400560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f48b666-36d1-4cd1-8374-01d5ddbbb4dd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:47.401414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f48b666-36d1-4cd1-8374-01d5ddbbb4dd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:47.593451 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5f48b666-36d1-4cd1-8374-01d5ddbbb4dd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.295872 Aug 25 12:53:47.599737 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1032/2040] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:53:47 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:47.677569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:47.838845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0f39de83-6e60-4d9c-9d52-2299714ac43f req-72054afc-3810-45da-bbc4-60b4401ff3ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3e1033-d155-4d7c-b071-316ccabc84e7", "name": "network-vif-deleted", "tag": "a356acde-57da-4791-b7c2-c879b3334a0c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:47.854766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b5330d41-bce7-48f9-86ee-459a0edd39b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:47.894573 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b5330d41-bce7-48f9-86ee-459a0edd39b8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 200 len: 1527 microversion: 2.1 time: 1.091905 Aug 25 12:53:47.937886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0f39de83-6e60-4d9c-9d52-2299714ac43f req-72054afc-3810-45da-bbc4-60b4401ff3ae service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:47.938163 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1009/2041] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:46 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 1527 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:47.946500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0f39de83-6e60-4d9c-9d52-2299714ac43f req-72054afc-3810-45da-bbc4-60b4401ff3ae service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:47.955064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0f39de83-6e60-4d9c-9d52-2299714ac43f req-72054afc-3810-45da-bbc4-60b4401ff3ae service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:48.018674 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0f39de83-6e60-4d9c-9d52-2299714ac43f req-72054afc-3810-45da-bbc4-60b4401ff3ae service nova] Creating event network-vif-deleted:a356acde-57da-4791-b7c2-c879b3334a0c for instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 on n-h2-852771-8 Aug 25 12:53:48.069014 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0f39de83-6e60-4d9c-9d52-2299714ac43f req-72054afc-3810-45da-bbc4-60b4401ff3ae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240308 Aug 25 12:53:48.074141 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1033/2042] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:53:48.620610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-40dad3fd-66fd-42dc-81b2-ec33a65bcddf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:48.631671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-40dad3fd-66fd-42dc-81b2-ec33a65bcddf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:48.665208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40dad3fd-66fd-42dc-81b2-ec33a65bcddf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:48.668941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40dad3fd-66fd-42dc-81b2-ec33a65bcddf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:48.670348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40dad3fd-66fd-42dc-81b2-ec33a65bcddf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:48.672368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40dad3fd-66fd-42dc-81b2-ec33a65bcddf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:48.678874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40dad3fd-66fd-42dc-81b2-ec33a65bcddf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:48.682387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40dad3fd-66fd-42dc-81b2-ec33a65bcddf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:48.841356 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-40dad3fd-66fd-42dc-81b2-ec33a65bcddf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228262 Aug 25 12:53:48.843998 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1010/2043] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:53:48 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:48.955779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:48.957107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:48.997745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:49.000559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:49.001367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:49.017550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:49.021370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:49.023700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:49.088320 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 HTTP/1.1 Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '8e3e1033-d155-4d7c-b071-316ccabc84e7'} Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:49.109909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:49.117828 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:49.117828 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:49.117828 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:49.117828 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:49.117828 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:49.117828 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:49.117828 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:53:49.117828 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:53:49.117828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 404 to user: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:49.121806 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b409416f-9d43-419e-a8aa-d02e3bc04225 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 404 len: 111 microversion: 2.1 time: 0.173770 Aug 25 12:53:49.137570 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1034/2044] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:48 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:49.551474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1625411485", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:49.696420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] validate_networks() for [('d92653b3-acd5-4a7c-9b85-c26c0b939826', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:53:49.867623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e569d885-c316-485b-a4a1-f4560300a77a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:49.881557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e569d885-c316-485b-a4a1-f4560300a77a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:49.908144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e569d885-c316-485b-a4a1-f4560300a77a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:49.909008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e569d885-c316-485b-a4a1-f4560300a77a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:49.910136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e569d885-c316-485b-a4a1-f4560300a77a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:49.917116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e569d885-c316-485b-a4a1-f4560300a77a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:49.918205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e569d885-c316-485b-a4a1-f4560300a77a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:49.919815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e569d885-c316-485b-a4a1-f4560300a77a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:50.048192 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e569d885-c316-485b-a4a1-f4560300a77a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191246 Aug 25 12:53:50.050118 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1035/2045] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:53:49 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:53:50.311547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:51.254319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c3bbcc6-422d-4952-8573-1101ad7ce351 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Action: 'create', calling method: .version_select at 0x7f3a2e7699d0>, body: {"keypair": {"name": "tempest-keypair-1335077997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCssVYx4QzUSGRiZq5RDJ4BoO/RlHuFgXR690+vqstUeV7Y34IyHow6Ic9/EeWH8mbWj0eLAtPsa/IM7TcWx2ReaTOWJyFA4UnK0ZkboE/51B/if99+ys4xK0l+lg6YkyQ=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:51.350865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-5c3bbcc6-422d-4952-8573-1101ad7ce351 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Getting quotas for project bf46d29d4b5348719c7673598f94e4fd. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:51.388963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-5c3bbcc6-422d-4952-8573-1101ad7ce351 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Getting quotas for user 1c33cd8c1f0a4ac3ae9ad0410abb8a5b and project bf46d29d4b5348719c7673598f94e4fd. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:51.526549 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c3bbcc6-422d-4952-8573-1101ad7ce351 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.700756 Aug 25 12:53:51.532120 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1036/2046] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 12:53:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:51.566619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-38f5479f-5819-4b87-9022-e908129e1421 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:51.577930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-38f5479f-5819-4b87-9022-e908129e1421 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:51.629119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38f5479f-5819-4b87-9022-e908129e1421 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:51.633836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38f5479f-5819-4b87-9022-e908129e1421 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:51.639976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38f5479f-5819-4b87-9022-e908129e1421 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:51.672986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38f5479f-5819-4b87-9022-e908129e1421 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:51.674551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38f5479f-5819-4b87-9022-e908129e1421 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:51.675709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38f5479f-5819-4b87-9022-e908129e1421 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:51.824066 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-38f5479f-5819-4b87-9022-e908129e1421 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.272763 Aug 25 12:53:51.827119 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1037/2047] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:53:51 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:52.598895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:53:52.601112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:53:52.602408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:53:52.603115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:53:52.604054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:53:52.645311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:52.646200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:52.653626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:52.655465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:52.657041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:52.657194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:52.695392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:52.753674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Getting quotas for project d43be46fe4e84396b73fbdca834b3525. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:52.772735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Getting quotas for user 74d9b7c3351f44b9b986e6535fc62819 and project d43be46fe4e84396b73fbdca834b3525. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:52.832417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:53:52.842732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:53:52.852990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3cd94e38-d303-4ea4-be89-6f8cae290843 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:52.860040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3cd94e38-d303-4ea4-be89-6f8cae290843 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:52.877458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd94e38-d303-4ea4-be89-6f8cae290843 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:52.878896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd94e38-d303-4ea4-be89-6f8cae290843 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:52.880242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd94e38-d303-4ea4-be89-6f8cae290843 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:52.881921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd94e38-d303-4ea4-be89-6f8cae290843 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:52.901460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd94e38-d303-4ea4-be89-6f8cae290843 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:52.907884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3cd94e38-d303-4ea4-be89-6f8cae290843 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:53.026806 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3cd94e38-d303-4ea4-be89-6f8cae290843 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185090 Aug 25 12:53:53.042025 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1038/2048] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:53:52 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:53.048907 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ec87ca50-3a09-4aab-b48a-04de16e45961 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.516603 Aug 25 12:53:53.055304 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1011/2049] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:53:53.072274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-339187f3-4a6e-4bb1-9d3d-b556a404885a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:53.073469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-339187f3-4a6e-4bb1-9d3d-b556a404885a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:53.348802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-891193100", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "d634cb6f-96c1-47f8-8faa-51a09a599c12"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:53.487242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-339187f3-4a6e-4bb1-9d3d-b556a404885a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:53.524153 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-339187f3-4a6e-4bb1-9d3d-b556a404885a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1225 microversion: 2.1 time: 0.456714 Aug 25 12:53:53.529534 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1039/2050] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:53 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1225 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:53.595654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] validate_networks() for [('d634cb6f-96c1-47f8-8faa-51a09a599c12', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:53:54.055353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-96238922-1368-48b6-8093-27ae203b11b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:54.069024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-96238922-1368-48b6-8093-27ae203b11b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:54.135778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96238922-1368-48b6-8093-27ae203b11b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:54.137083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96238922-1368-48b6-8093-27ae203b11b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:54.148776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96238922-1368-48b6-8093-27ae203b11b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:54.155218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96238922-1368-48b6-8093-27ae203b11b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:54.156165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96238922-1368-48b6-8093-27ae203b11b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:54.171003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96238922-1368-48b6-8093-27ae203b11b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:54.333119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:54.341854 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-96238922-1368-48b6-8093-27ae203b11b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.299552 Aug 25 12:53:54.350608 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1040/2051] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:53:54 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:54.577718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1982bdab-ec87-46b5-ac71-3382c63d693c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:54.587027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1982bdab-ec87-46b5-ac71-3382c63d693c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:55.870920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1982bdab-ec87-46b5-ac71-3382c63d693c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:55.902190 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1982bdab-ec87-46b5-ac71-3382c63d693c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1225 microversion: 2.1 time: 1.333314 Aug 25 12:53:55.910107 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1041/2052] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:54 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1225 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:56.151110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1504287442", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:56.453217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] validate_networks() for [('b4445a82-ca09-4ee6-a5a5-5c41aed12921', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:53:57.275388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:53:57.276853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:53:57.278493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:53:57.279258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:53:57.280016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:53:57.380077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:57.381276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:57.382550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:57.390277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:57.393236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:57.394760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:57.459838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Getting quotas for project af530a60986043b1bd4f3febaee1c3af. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:57.473533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Getting quotas for user f3ab7808c55142d494e662334ae372fe and project af530a60986043b1bd4f3febaee1c3af. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:57.527195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:53:57.531553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:53:57.757959 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eef86ed6-f7cd-4aa6-8293-e9502609f00b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.662388 Aug 25 12:53:57.765644 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1012/2053] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 12:53:57.810990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dde5cfce-7315-438a-ba54-2db6e93f4b4e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:57.832711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dde5cfce-7315-438a-ba54-2db6e93f4b4e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:57.854901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dde5cfce-7315-438a-ba54-2db6e93f4b4e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:57.859535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dde5cfce-7315-438a-ba54-2db6e93f4b4e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:57.862192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dde5cfce-7315-438a-ba54-2db6e93f4b4e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:57.875102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dde5cfce-7315-438a-ba54-2db6e93f4b4e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:57.876696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dde5cfce-7315-438a-ba54-2db6e93f4b4e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:57.877998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dde5cfce-7315-438a-ba54-2db6e93f4b4e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.002441 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dde5cfce-7315-438a-ba54-2db6e93f4b4e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.234244 Aug 25 12:53:58.004157 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1013/2054] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:53:57 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:58.028530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b059197-577e-430e-b809-8bd803a843dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:58.030450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b059197-577e-430e-b809-8bd803a843dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:58.048483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b059197-577e-430e-b809-8bd803a843dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.049878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b059197-577e-430e-b809-8bd803a843dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.050950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b059197-577e-430e-b809-8bd803a843dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.052681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b059197-577e-430e-b809-8bd803a843dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.053839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b059197-577e-430e-b809-8bd803a843dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.056439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b059197-577e-430e-b809-8bd803a843dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.478810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b059197-577e-430e-b809-8bd803a843dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:58.483533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:53:58.484373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:53:58.486607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:53:58.487519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:53:58.488276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:53:58.519948 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b059197-577e-430e-b809-8bd803a843dc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1283 microversion: 2.1 time: 0.489428 Aug 25 12:53:58.530156 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1014/2055] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:58 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1283 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:58.547130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f3d9e36e-0d6e-49d8-a791-df29820e5114 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:58.548263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f3d9e36e-0d6e-49d8-a791-df29820e5114 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:58.557085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.565340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.047s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.569156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.584162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.588568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.593371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.660341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Getting quotas for project 3075ca68e13c46a092a2dc7981bbdc44. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:58.682115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Getting quotas for user 31e734231a3c496e982e5b1a718ebf23 and project 3075ca68e13c46a092a2dc7981bbdc44. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:58.736380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:53:58.750290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:53:58.842535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3d9e36e-0d6e-49d8-a791-df29820e5114 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:58.883762 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f3d9e36e-0d6e-49d8-a791-df29820e5114 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1224 microversion: 2.1 time: 0.351393 Aug 25 12:53:58.906785 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1015/2056] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:58 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1224 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:59.024282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04863b7e-df7a-4cb3-a059-f25565d5493e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:59.032165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-04863b7e-df7a-4cb3-a059-f25565d5493e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:59.035721 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d77ef6b8-457a-4d24-9b81-bea0aa381bd3 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.121329 Aug 25 12:53:59.047613 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1042/2057] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 3136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:53:59.082802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0d113c1d-4714-49df-a492-bbeb88df34bd tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:59.091069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0d113c1d-4714-49df-a492-bbeb88df34bd tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:59.094859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04863b7e-df7a-4cb3-a059-f25565d5493e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:59.110777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04863b7e-df7a-4cb3-a059-f25565d5493e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:59.114698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04863b7e-df7a-4cb3-a059-f25565d5493e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:59.117267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04863b7e-df7a-4cb3-a059-f25565d5493e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:59.134332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04863b7e-df7a-4cb3-a059-f25565d5493e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:59.135540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04863b7e-df7a-4cb3-a059-f25565d5493e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:59.475933 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-04863b7e-df7a-4cb3-a059-f25565d5493e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.458400 Aug 25 12:53:59.476511 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1016/2058] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:53:59 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:59.594119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a74cdd8b-041d-41af-aff0-11c43fa58d7a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:59.601381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a74cdd8b-041d-41af-aff0-11c43fa58d7a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:59.651747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a74cdd8b-041d-41af-aff0-11c43fa58d7a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:59.655737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a74cdd8b-041d-41af-aff0-11c43fa58d7a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:59.659431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a74cdd8b-041d-41af-aff0-11c43fa58d7a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:59.663604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a74cdd8b-041d-41af-aff0-11c43fa58d7a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:59.669886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a74cdd8b-041d-41af-aff0-11c43fa58d7a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:59.676227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a74cdd8b-041d-41af-aff0-11c43fa58d7a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:59.750598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0d113c1d-4714-49df-a492-bbeb88df34bd tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:59.786970 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0d113c1d-4714-49df-a492-bbeb88df34bd tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1223 microversion: 2.1 time: 0.712658 Aug 25 12:53:59.794540 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1043/2059] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:59 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1223 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:59.942371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ed400d89-799d-4134-bb80-b89cdbbb02c8 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:59.945906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ed400d89-799d-4134-bb80-b89cdbbb02c8 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:59.990776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:00.930122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a74cdd8b-041d-41af-aff0-11c43fa58d7a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:00.984343 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a74cdd8b-041d-41af-aff0-11c43fa58d7a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1283 microversion: 2.1 time: 1.392555 Aug 25 12:54:00.988238 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1017/2060] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:59 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1283 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:01.027222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-85622c77-1634-4a51-a4ca-7a6de8bc9186 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:01.032944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ed400d89-799d-4134-bb80-b89cdbbb02c8 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:01.041906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-85622c77-1634-4a51-a4ca-7a6de8bc9186 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:01.086965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85622c77-1634-4a51-a4ca-7a6de8bc9186 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:01.088092 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ed400d89-799d-4134-bb80-b89cdbbb02c8 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1224 microversion: 2.1 time: 1.153221 Aug 25 12:54:01.089190 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1044/2061] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:59 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1224 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:01.090652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85622c77-1634-4a51-a4ca-7a6de8bc9186 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:01.100284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85622c77-1634-4a51-a4ca-7a6de8bc9186 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:01.105199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85622c77-1634-4a51-a4ca-7a6de8bc9186 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:01.108264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85622c77-1634-4a51-a4ca-7a6de8bc9186 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:01.112634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85622c77-1634-4a51-a4ca-7a6de8bc9186 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:01.180242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5aef5c6-86ed-4ec8-86ef-e9fe2faf2494 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:01.185275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b5aef5c6-86ed-4ec8-86ef-e9fe2faf2494 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:01.331932 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-85622c77-1634-4a51-a4ca-7a6de8bc9186 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.341464 Aug 25 12:54:01.339495 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1018/2062] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:54:00 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:01.424563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b5aef5c6-86ed-4ec8-86ef-e9fe2faf2494 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:01.444907 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b5aef5c6-86ed-4ec8-86ef-e9fe2faf2494 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1223 microversion: 2.1 time: 0.309142 Aug 25 12:54:01.445752 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1045/2063] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:01 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1223 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:02.038465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e1a3ef1-aed5-495c-b5bd-f02ead046831 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:02.043699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e1a3ef1-aed5-495c-b5bd-f02ead046831 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:02.070955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e1a3ef1-aed5-495c-b5bd-f02ead046831 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.076386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e1a3ef1-aed5-495c-b5bd-f02ead046831 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.078043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e1a3ef1-aed5-495c-b5bd-f02ead046831 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.080130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e1a3ef1-aed5-495c-b5bd-f02ead046831 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.094285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e1a3ef1-aed5-495c-b5bd-f02ead046831 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.095499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e1a3ef1-aed5-495c-b5bd-f02ead046831 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.136940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b44fa46a-801b-413b-ac54-3d5368a5de46 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:02.138237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b44fa46a-801b-413b-ac54-3d5368a5de46 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:02.185301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b44fa46a-801b-413b-ac54-3d5368a5de46 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.212337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b44fa46a-801b-413b-ac54-3d5368a5de46 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.216241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b44fa46a-801b-413b-ac54-3d5368a5de46 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.224424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b44fa46a-801b-413b-ac54-3d5368a5de46 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.225324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b44fa46a-801b-413b-ac54-3d5368a5de46 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.234807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b44fa46a-801b-413b-ac54-3d5368a5de46 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.490701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e1a3ef1-aed5-495c-b5bd-f02ead046831 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:02.522469 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e1a3ef1-aed5-495c-b5bd-f02ead046831 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1283 microversion: 2.1 time: 0.492257 Aug 25 12:54:02.552089 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1019/2064] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:02 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1283 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:02.577792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:02.587410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:02.589143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Searching by: {'deleted': False, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:02.612367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.616441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.619411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.626270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.629627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.632089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.788414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b44fa46a-801b-413b-ac54-3d5368a5de46 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:02.808908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:54:02.817985 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b44fa46a-801b-413b-ac54-3d5368a5de46 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1294 microversion: 2.1 time: 0.694848 Aug 25 12:54:02.842447 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1046/2065] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:02 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1294 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:02.858591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e839b07-f36e-44b3-acc7-011df015ff9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:02.882868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4e839b07-f36e-44b3-acc7-011df015ff9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:02.911803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e839b07-f36e-44b3-acc7-011df015ff9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.912654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e839b07-f36e-44b3-acc7-011df015ff9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.913440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e839b07-f36e-44b3-acc7-011df015ff9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.926070 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-45c1468c-17f4-41a1-a14b-cbd4889eef45 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.371911 Aug 25 12:54:02.927144 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1020/2066] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 12:54:02 2022] GET /compute/v2.1/servers => generated 334 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:02.934682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e839b07-f36e-44b3-acc7-011df015ff9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.934682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e839b07-f36e-44b3-acc7-011df015ff9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.934682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e839b07-f36e-44b3-acc7-011df015ff9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.954831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-15961818-dadd-47b9-ba08-23e877842f84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:02.955934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-15961818-dadd-47b9-ba08-23e877842f84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:02.969583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15961818-dadd-47b9-ba08-23e877842f84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.970458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15961818-dadd-47b9-ba08-23e877842f84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.976646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15961818-dadd-47b9-ba08-23e877842f84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.978375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15961818-dadd-47b9-ba08-23e877842f84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.985468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15961818-dadd-47b9-ba08-23e877842f84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.987086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15961818-dadd-47b9-ba08-23e877842f84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.163490 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e839b07-f36e-44b3-acc7-011df015ff9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.319018 Aug 25 12:54:03.164544 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1047/2067] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:54:02 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 197 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:03.206493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:03.238222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:03.244592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Searching by: {'deleted': False, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:03.260425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.283096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.284689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.292654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.294233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.295515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.462748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:54:03.518918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-15961818-dadd-47b9-ba08-23e877842f84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:03.572948 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-15961818-dadd-47b9-ba08-23e877842f84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1275 microversion: 2.1 time: 0.615995 Aug 25 12:54:03.574715 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1021/2068] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:02 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1275 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:03.604688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0fee0a29-b3a4-4265-a4ab-6712afdcc74d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:03.611126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0fee0a29-b3a4-4265-a4ab-6712afdcc74d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:03.666366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fee0a29-b3a4-4265-a4ab-6712afdcc74d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.666704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fee0a29-b3a4-4265-a4ab-6712afdcc74d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.667187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fee0a29-b3a4-4265-a4ab-6712afdcc74d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.675932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fee0a29-b3a4-4265-a4ab-6712afdcc74d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.676753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fee0a29-b3a4-4265-a4ab-6712afdcc74d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.681969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0fee0a29-b3a4-4265-a4ab-6712afdcc74d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.712821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:03.739491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.751883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.752779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:04.581801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0fee0a29-b3a4-4265-a4ab-6712afdcc74d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:04.618269 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0fee0a29-b3a4-4265-a4ab-6712afdcc74d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1283 microversion: 2.1 time: 1.039433 Aug 25 12:54:04.649757 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1022/2069] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:03 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1283 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:04.670346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1f1e250-4a0c-4cd3-b564-3850a4a9a469 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:04.676166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e1f1e250-4a0c-4cd3-b564-3850a4a9a469 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:04.695003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1f1e250-4a0c-4cd3-b564-3850a4a9a469 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:04.707066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1f1e250-4a0c-4cd3-b564-3850a4a9a469 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:04.708590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1f1e250-4a0c-4cd3-b564-3850a4a9a469 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:04.710060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1f1e250-4a0c-4cd3-b564-3850a4a9a469 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:04.711356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1f1e250-4a0c-4cd3-b564-3850a4a9a469 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:04.712283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1f1e250-4a0c-4cd3-b564-3850a4a9a469 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.049968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e1f1e250-4a0c-4cd3-b564-3850a4a9a469 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:05.084554 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e1f1e250-4a0c-4cd3-b564-3850a4a9a469 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1282 microversion: 2.1 time: 0.423166 Aug 25 12:54:05.086460 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1023/2070] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:04 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1282 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:05.097810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9516750c-d106-4e1f-b391-2db22b4f7b9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:05.108452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9516750c-d106-4e1f-b391-2db22b4f7b9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:05.149230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9516750c-d106-4e1f-b391-2db22b4f7b9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.150655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9516750c-d106-4e1f-b391-2db22b4f7b9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.152016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9516750c-d106-4e1f-b391-2db22b4f7b9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.154262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9516750c-d106-4e1f-b391-2db22b4f7b9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.155235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9516750c-d106-4e1f-b391-2db22b4f7b9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.156029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9516750c-d106-4e1f-b391-2db22b4f7b9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.323283 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a369a7a-8290-424f-be0a-ced05ebd7233 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 2.156775 Aug 25 12:54:05.324438 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1048/2071] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:54:03 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:05.392201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0377f005-b4a3-4325-9e65-054cb66094d2 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:05.392972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0377f005-b4a3-4325-9e65-054cb66094d2 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:05.401874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0377f005-b4a3-4325-9e65-054cb66094d2 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.403189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0377f005-b4a3-4325-9e65-054cb66094d2 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.404057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0377f005-b4a3-4325-9e65-054cb66094d2 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.404274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0377f005-b4a3-4325-9e65-054cb66094d2 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.404657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0377f005-b4a3-4325-9e65-054cb66094d2 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.405272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0377f005-b4a3-4325-9e65-054cb66094d2 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.405399 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9516750c-d106-4e1f-b391-2db22b4f7b9b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.316602 Aug 25 12:54:05.407500 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1024/2072] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:54:05 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49/os-volume_attachments => generated 25 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:54:05.429639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6507ba09-fd4c-48ce-9d29-5c8af2865cbb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:05.480055 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6507ba09-fd4c-48ce-9d29-5c8af2865cbb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.070826 Aug 25 12:54:05.481589 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1025/2073] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:54:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:05.629014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0377f005-b4a3-4325-9e65-054cb66094d2 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:05.649398 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0377f005-b4a3-4325-9e65-054cb66094d2 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1281 microversion: 2.1 time: 0.323102 Aug 25 12:54:05.655163 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1049/2074] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:05 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1281 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:05.670693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-96107d21-d200-42a0-975c-81d2747fae1d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:05.680338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-96107d21-d200-42a0-975c-81d2747fae1d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:05.706994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96107d21-d200-42a0-975c-81d2747fae1d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.707911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96107d21-d200-42a0-975c-81d2747fae1d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.711051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96107d21-d200-42a0-975c-81d2747fae1d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.712040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96107d21-d200-42a0-975c-81d2747fae1d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.713161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96107d21-d200-42a0-975c-81d2747fae1d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.713953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96107d21-d200-42a0-975c-81d2747fae1d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.878375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8f7f414c-83ad-462d-9def-5643b4b8cf66 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:05.879854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8f7f414c-83ad-462d-9def-5643b4b8cf66 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:05.904919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f7f414c-83ad-462d-9def-5643b4b8cf66 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.908828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f7f414c-83ad-462d-9def-5643b4b8cf66 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.916012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f7f414c-83ad-462d-9def-5643b4b8cf66 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.921449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f7f414c-83ad-462d-9def-5643b4b8cf66 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.927882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f7f414c-83ad-462d-9def-5643b4b8cf66 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.930965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f7f414c-83ad-462d-9def-5643b4b8cf66 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.959193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-96107d21-d200-42a0-975c-81d2747fae1d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:06.003391 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-96107d21-d200-42a0-975c-81d2747fae1d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1283 microversion: 2.1 time: 0.337680 Aug 25 12:54:06.014670 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1026/2075] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:05 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1283 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:06.106077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8f7f414c-83ad-462d-9def-5643b4b8cf66 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:54:06.132847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9abbb603-dfa0-4241-9499-4400f72ce6da tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:06.139627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9abbb603-dfa0-4241-9499-4400f72ce6da tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:06.205479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abbb603-dfa0-4241-9499-4400f72ce6da tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.210743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abbb603-dfa0-4241-9499-4400f72ce6da tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.211714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abbb603-dfa0-4241-9499-4400f72ce6da tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:06.216675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abbb603-dfa0-4241-9499-4400f72ce6da tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.220785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abbb603-dfa0-4241-9499-4400f72ce6da tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.223670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abbb603-dfa0-4241-9499-4400f72ce6da tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:06.469064 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8f7f414c-83ad-462d-9def-5643b4b8cf66 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "DELETE /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 204 len: 0 microversion: 2.1 time: 0.597414 Aug 25 12:54:06.470135 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1050/2076] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:54:05 2022] DELETE /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:54:06.489442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b6d2dd7-8e42-47c6-b833-d89766d5cbfb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:06.490710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5b6d2dd7-8e42-47c6-b833-d89766d5cbfb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:06.507315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b6d2dd7-8e42-47c6-b833-d89766d5cbfb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.511676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b6d2dd7-8e42-47c6-b833-d89766d5cbfb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.516969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b6d2dd7-8e42-47c6-b833-d89766d5cbfb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:06.520753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b6d2dd7-8e42-47c6-b833-d89766d5cbfb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.521983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b6d2dd7-8e42-47c6-b833-d89766d5cbfb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.525759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b6d2dd7-8e42-47c6-b833-d89766d5cbfb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:06.569526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9abbb603-dfa0-4241-9499-4400f72ce6da tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:06.591677 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9abbb603-dfa0-4241-9499-4400f72ce6da tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1282 microversion: 2.1 time: 0.471599 Aug 25 12:54:06.593366 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1027/2077] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:06 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1282 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:06.701350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-35ac64bc-5ef5-4e35-ac2a-63c8a799dcb4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:06.708261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-35ac64bc-5ef5-4e35-ac2a-63c8a799dcb4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:06.750773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35ac64bc-5ef5-4e35-ac2a-63c8a799dcb4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.753303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35ac64bc-5ef5-4e35-ac2a-63c8a799dcb4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.757306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35ac64bc-5ef5-4e35-ac2a-63c8a799dcb4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:06.764924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35ac64bc-5ef5-4e35-ac2a-63c8a799dcb4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.767504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35ac64bc-5ef5-4e35-ac2a-63c8a799dcb4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.770742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35ac64bc-5ef5-4e35-ac2a-63c8a799dcb4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.015662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-35ac64bc-5ef5-4e35-ac2a-63c8a799dcb4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:07.065872 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-35ac64bc-5ef5-4e35-ac2a-63c8a799dcb4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1281 microversion: 2.1 time: 0.364890 Aug 25 12:54:07.072847 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1028/2078] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:06 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1281 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:07.102463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e766d882-5c96-419e-ab7f-15a0c499fddc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:07.104417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e766d882-5c96-419e-ab7f-15a0c499fddc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:07.135486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e766d882-5c96-419e-ab7f-15a0c499fddc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:07.138279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e766d882-5c96-419e-ab7f-15a0c499fddc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:07.142857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e766d882-5c96-419e-ab7f-15a0c499fddc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.144988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e766d882-5c96-419e-ab7f-15a0c499fddc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:07.149976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e766d882-5c96-419e-ab7f-15a0c499fddc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:07.151468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e766d882-5c96-419e-ab7f-15a0c499fddc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.305881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b6d2dd7-8e42-47c6-b833-d89766d5cbfb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:07.340697 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b6d2dd7-8e42-47c6-b833-d89766d5cbfb tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1702 microversion: 2.1 time: 0.862989 Aug 25 12:54:07.341720 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1051/2079] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:06 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1702 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:07.440254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e766d882-5c96-419e-ab7f-15a0c499fddc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:07.509931 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e766d882-5c96-419e-ab7f-15a0c499fddc tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1283 microversion: 2.1 time: 0.410161 Aug 25 12:54:07.520736 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1029/2080] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:07 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1283 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:07.637562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6258e2fc-052e-4af9-8fd8-e90140a50da0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:07.638827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6258e2fc-052e-4af9-8fd8-e90140a50da0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:07.713333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6258e2fc-052e-4af9-8fd8-e90140a50da0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:07.717552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6258e2fc-052e-4af9-8fd8-e90140a50da0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:07.718889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6258e2fc-052e-4af9-8fd8-e90140a50da0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.720436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6258e2fc-052e-4af9-8fd8-e90140a50da0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:07.723171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6258e2fc-052e-4af9-8fd8-e90140a50da0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:07.724427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6258e2fc-052e-4af9-8fd8-e90140a50da0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.960768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6258e2fc-052e-4af9-8fd8-e90140a50da0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:07.996640 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6258e2fc-052e-4af9-8fd8-e90140a50da0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1282 microversion: 2.1 time: 0.367401 Aug 25 12:54:08.022730 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1052/2081] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:07 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1282 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:08.116926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-db5615b6-74be-4de2-9335-d7ce7ed9ab0e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:08.118843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-db5615b6-74be-4de2-9335-d7ce7ed9ab0e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:08.142865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db5615b6-74be-4de2-9335-d7ce7ed9ab0e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:08.143952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db5615b6-74be-4de2-9335-d7ce7ed9ab0e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:08.145028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db5615b6-74be-4de2-9335-d7ce7ed9ab0e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:08.146293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db5615b6-74be-4de2-9335-d7ce7ed9ab0e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:08.147085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db5615b6-74be-4de2-9335-d7ce7ed9ab0e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:08.148026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db5615b6-74be-4de2-9335-d7ce7ed9ab0e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:08.367771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-db5615b6-74be-4de2-9335-d7ce7ed9ab0e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:08.372143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:08.390272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d19fa29e-47d2-4a40-919c-dcefcf280281 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:08.398900 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-db5615b6-74be-4de2-9335-d7ce7ed9ab0e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1281 microversion: 2.1 time: 0.287673 Aug 25 12:54:08.400242 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1030/2082] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:08 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1281 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:08.407438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d19fa29e-47d2-4a40-919c-dcefcf280281 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:08.475339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d19fa29e-47d2-4a40-919c-dcefcf280281 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:08.476290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d19fa29e-47d2-4a40-919c-dcefcf280281 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:08.477110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d19fa29e-47d2-4a40-919c-dcefcf280281 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:08.478576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d19fa29e-47d2-4a40-919c-dcefcf280281 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:08.490553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d19fa29e-47d2-4a40-919c-dcefcf280281 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:08.491391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d19fa29e-47d2-4a40-919c-dcefcf280281 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:08.571583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-772f60e7-20ac-4549-9892-5e1503a4baa8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:08.572767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-772f60e7-20ac-4549-9892-5e1503a4baa8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:08.609046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-772f60e7-20ac-4549-9892-5e1503a4baa8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:08.626094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-772f60e7-20ac-4549-9892-5e1503a4baa8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:08.627080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-772f60e7-20ac-4549-9892-5e1503a4baa8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:08.639542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-772f60e7-20ac-4549-9892-5e1503a4baa8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:08.640447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-772f60e7-20ac-4549-9892-5e1503a4baa8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:08.641239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-772f60e7-20ac-4549-9892-5e1503a4baa8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:08.851623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=14 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:09.251679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-772f60e7-20ac-4549-9892-5e1503a4baa8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:09.335382 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-772f60e7-20ac-4549-9892-5e1503a4baa8 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1283 microversion: 2.1 time: 0.769821 Aug 25 12:54:09.351854 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1031/2083] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:08 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1283 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:09.391649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d8f1549-1a9e-4f1b-944b-cac2203a9e63 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:09.393365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d8f1549-1a9e-4f1b-944b-cac2203a9e63 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:09.437716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d8f1549-1a9e-4f1b-944b-cac2203a9e63 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.446781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d8f1549-1a9e-4f1b-944b-cac2203a9e63 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.448031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d8f1549-1a9e-4f1b-944b-cac2203a9e63 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.454755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d8f1549-1a9e-4f1b-944b-cac2203a9e63 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.456381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d8f1549-1a9e-4f1b-944b-cac2203a9e63 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.457820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d8f1549-1a9e-4f1b-944b-cac2203a9e63 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.691044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6d8f1549-1a9e-4f1b-944b-cac2203a9e63 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:09.711197 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d8f1549-1a9e-4f1b-944b-cac2203a9e63 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1282 microversion: 2.1 time: 0.356986 Aug 25 12:54:09.725349 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1032/2084] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:09 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1282 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:09.734534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eeb42d34-fa8b-49a3-b06d-f81e04d22c5f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:09.744699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eeb42d34-fa8b-49a3-b06d-f81e04d22c5f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:09.767394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeb42d34-fa8b-49a3-b06d-f81e04d22c5f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.768880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeb42d34-fa8b-49a3-b06d-f81e04d22c5f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.771359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeb42d34-fa8b-49a3-b06d-f81e04d22c5f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.774592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeb42d34-fa8b-49a3-b06d-f81e04d22c5f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.779040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeb42d34-fa8b-49a3-b06d-f81e04d22c5f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.780838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeb42d34-fa8b-49a3-b06d-f81e04d22c5f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.905993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d19fa29e-47d2-4a40-919c-dcefcf280281 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:09.929315 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d19fa29e-47d2-4a40-919c-dcefcf280281 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1702 microversion: 2.1 time: 1.549236 Aug 25 12:54:09.933137 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1053/2085] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:08 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1702 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:10.383427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-396c52d8-360a-4895-bd4f-2c1c3a6309a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:10.384950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-396c52d8-360a-4895-bd4f-2c1c3a6309a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:10.421364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396c52d8-360a-4895-bd4f-2c1c3a6309a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:10.424866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396c52d8-360a-4895-bd4f-2c1c3a6309a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:10.435950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396c52d8-360a-4895-bd4f-2c1c3a6309a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:10.437868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396c52d8-360a-4895-bd4f-2c1c3a6309a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:10.439070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396c52d8-360a-4895-bd4f-2c1c3a6309a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:10.440123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396c52d8-360a-4895-bd4f-2c1c3a6309a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:10.888646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eeb42d34-fa8b-49a3-b06d-f81e04d22c5f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:10.930898 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eeb42d34-fa8b-49a3-b06d-f81e04d22c5f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1281 microversion: 2.1 time: 1.193732 Aug 25 12:54:10.941716 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1033/2086] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:09 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1281 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:10.967286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-79cf75a6-0984-4512-bd8b-d68dd5d4c2e7 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:10.970507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-79cf75a6-0984-4512-bd8b-d68dd5d4c2e7 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:11.000429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:11.018427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79cf75a6-0984-4512-bd8b-d68dd5d4c2e7 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:11.025311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79cf75a6-0984-4512-bd8b-d68dd5d4c2e7 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:11.026843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79cf75a6-0984-4512-bd8b-d68dd5d4c2e7 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:11.030975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79cf75a6-0984-4512-bd8b-d68dd5d4c2e7 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:11.038417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79cf75a6-0984-4512-bd8b-d68dd5d4c2e7 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:11.040081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79cf75a6-0984-4512-bd8b-d68dd5d4c2e7 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:11.438283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-79cf75a6-0984-4512-bd8b-d68dd5d4c2e7 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:11.489312 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-79cf75a6-0984-4512-bd8b-d68dd5d4c2e7 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1282 microversion: 2.1 time: 0.544857 Aug 25 12:54:11.491818 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1034/2087] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:10 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1282 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:11.519985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0224ff3-b81e-49ff-bdba-4402b3f35bed tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:11.522583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b0224ff3-b81e-49ff-bdba-4402b3f35bed tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:11.553026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0224ff3-b81e-49ff-bdba-4402b3f35bed tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:11.554385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0224ff3-b81e-49ff-bdba-4402b3f35bed tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:11.554601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0224ff3-b81e-49ff-bdba-4402b3f35bed tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:11.555842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0224ff3-b81e-49ff-bdba-4402b3f35bed tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:11.556730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0224ff3-b81e-49ff-bdba-4402b3f35bed tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:11.557637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0224ff3-b81e-49ff-bdba-4402b3f35bed tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:11.974243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-396c52d8-360a-4895-bd4f-2c1c3a6309a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:11.988383 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-396c52d8-360a-4895-bd4f-2c1c3a6309a1 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 1.613527 Aug 25 12:54:11.996432 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1054/2088] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:10 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:12.002642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43fa455a-556f-4652-97a2-158f1d1cd8cb tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:12.009457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43fa455a-556f-4652-97a2-158f1d1cd8cb tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:12.031954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fa455a-556f-4652-97a2-158f1d1cd8cb tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.033879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fa455a-556f-4652-97a2-158f1d1cd8cb tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.034701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fa455a-556f-4652-97a2-158f1d1cd8cb tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.036126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fa455a-556f-4652-97a2-158f1d1cd8cb tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.036953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fa455a-556f-4652-97a2-158f1d1cd8cb tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.037666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fa455a-556f-4652-97a2-158f1d1cd8cb tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.282996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43fa455a-556f-4652-97a2-158f1d1cd8cb tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:12.317539 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43fa455a-556f-4652-97a2-158f1d1cd8cb tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1281 microversion: 2.1 time: 0.318790 Aug 25 12:54:12.326218 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1055/2089] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:11 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1281 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:12.394486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b0224ff3-b81e-49ff-bdba-4402b3f35bed tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:12.430142 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b0224ff3-b81e-49ff-bdba-4402b3f35bed tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1702 microversion: 2.1 time: 0.930156 Aug 25 12:54:12.454747 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1035/2090] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:11 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1702 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:12.529424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42f790b4-c28b-4b43-a4ed-805f34159285 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:12.531248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42f790b4-c28b-4b43-a4ed-805f34159285 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:12.591954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f790b4-c28b-4b43-a4ed-805f34159285 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.592750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f790b4-c28b-4b43-a4ed-805f34159285 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.603405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f790b4-c28b-4b43-a4ed-805f34159285 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.604850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f790b4-c28b-4b43-a4ed-805f34159285 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.610342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f790b4-c28b-4b43-a4ed-805f34159285 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.611080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42f790b4-c28b-4b43-a4ed-805f34159285 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.875698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-42f790b4-c28b-4b43-a4ed-805f34159285 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:12.916092 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42f790b4-c28b-4b43-a4ed-805f34159285 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1282 microversion: 2.1 time: 0.401228 Aug 25 12:54:12.922872 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1056/2091] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:12 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1282 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:13.033083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8eb5b7c3-f58c-4b89-bf3f-c02e73b4cc4d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:13.033957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8eb5b7c3-f58c-4b89-bf3f-c02e73b4cc4d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:13.060929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:13.063374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8eb5b7c3-f58c-4b89-bf3f-c02e73b4cc4d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.064272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8eb5b7c3-f58c-4b89-bf3f-c02e73b4cc4d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.065276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8eb5b7c3-f58c-4b89-bf3f-c02e73b4cc4d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.066146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8eb5b7c3-f58c-4b89-bf3f-c02e73b4cc4d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.066678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8eb5b7c3-f58c-4b89-bf3f-c02e73b4cc4d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.067157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8eb5b7c3-f58c-4b89-bf3f-c02e73b4cc4d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.357448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f4b4049-088c-4558-81df-d2c2fcf25694 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:13.361879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f4b4049-088c-4558-81df-d2c2fcf25694 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:13.368461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:13.396153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f4b4049-088c-4558-81df-d2c2fcf25694 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.399394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f4b4049-088c-4558-81df-d2c2fcf25694 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.402282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f4b4049-088c-4558-81df-d2c2fcf25694 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.405995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f4b4049-088c-4558-81df-d2c2fcf25694 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.408413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f4b4049-088c-4558-81df-d2c2fcf25694 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.413475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f4b4049-088c-4558-81df-d2c2fcf25694 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.711941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=22 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:13.826842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2f4b4049-088c-4558-81df-d2c2fcf25694 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:13.840376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8eb5b7c3-f58c-4b89-bf3f-c02e73b4cc4d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:13.871331 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f4b4049-088c-4558-81df-d2c2fcf25694 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1281 microversion: 2.1 time: 0.521739 Aug 25 12:54:13.877712 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8eb5b7c3-f58c-4b89-bf3f-c02e73b4cc4d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 0.851248 Aug 25 12:54:13.883504 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1036/2092] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:13 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:13.893949 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1057/2093] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:13 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1281 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:13.900056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-25294e1c-8be3-4750-9be3-671e58b23576 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:13.900812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-25294e1c-8be3-4750-9be3-671e58b23576 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:13.962878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5db3db12-b0d4-4652-a472-49bde60804d6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:13.971990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5db3db12-b0d4-4652-a472-49bde60804d6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:13.985618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25294e1c-8be3-4750-9be3-671e58b23576 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.987133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5db3db12-b0d4-4652-a472-49bde60804d6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.988399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5db3db12-b0d4-4652-a472-49bde60804d6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.989915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5db3db12-b0d4-4652-a472-49bde60804d6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.992441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5db3db12-b0d4-4652-a472-49bde60804d6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.992686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25294e1c-8be3-4750-9be3-671e58b23576 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.994029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5db3db12-b0d4-4652-a472-49bde60804d6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.995166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5db3db12-b0d4-4652-a472-49bde60804d6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.996393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25294e1c-8be3-4750-9be3-671e58b23576 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.998271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25294e1c-8be3-4750-9be3-671e58b23576 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.999180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25294e1c-8be3-4750-9be3-671e58b23576 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:14.000017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25294e1c-8be3-4750-9be3-671e58b23576 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:14.243113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5db3db12-b0d4-4652-a472-49bde60804d6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:14.287497 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5db3db12-b0d4-4652-a472-49bde60804d6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1282 microversion: 2.1 time: 0.336749 Aug 25 12:54:14.290040 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1037/2094] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:13 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1282 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:14.302020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-68ca987d-6612-4180-910c-69739d860f4e req-75f55c3f-e4aa-4779-a002-6b22c77762c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93190d43-5b60-464e-a1d4-ee5aba5f70e9", "name": "network-vif-deleted", "tag": "336bb7d1-c5c5-48d1-8ae0-a6689485d1f5"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:14.335121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-68ca987d-6612-4180-910c-69739d860f4e req-75f55c3f-e4aa-4779-a002-6b22c77762c6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:14.336545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-68ca987d-6612-4180-910c-69739d860f4e req-75f55c3f-e4aa-4779-a002-6b22c77762c6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:14.337649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-68ca987d-6612-4180-910c-69739d860f4e req-75f55c3f-e4aa-4779-a002-6b22c77762c6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:14.374689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-25294e1c-8be3-4750-9be3-671e58b23576 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1996cd469f40e580b8267400f9273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33deff7a601e4470ae1697c0d0ebd3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:14.386401 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-68ca987d-6612-4180-910c-69739d860f4e req-75f55c3f-e4aa-4779-a002-6b22c77762c6 service nova] Creating event network-vif-deleted:336bb7d1-c5c5-48d1-8ae0-a6689485d1f5 for instance 93190d43-5b60-464e-a1d4-ee5aba5f70e9 on n-h1-852771-8 Aug 25 12:54:14.411645 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-25294e1c-8be3-4750-9be3-671e58b23576 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 200 len: 1634 microversion: 2.1 time: 0.512568 Aug 25 12:54:14.412225 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-68ca987d-6612-4180-910c-69739d860f4e req-75f55c3f-e4aa-4779-a002-6b22c77762c6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118484 Aug 25 12:54:14.415208 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1058/2095] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:13 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 1634 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:14.441019 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1038/2096] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:14.935973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e568af90-9961-432b-a3e4-40b3efd7dec4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:14.937093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8b6144d-d315-4b61-8839-3629e9277b2d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:14.939853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a8b6144d-d315-4b61-8839-3629e9277b2d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:14.944351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e568af90-9961-432b-a3e4-40b3efd7dec4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:14.974635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e568af90-9961-432b-a3e4-40b3efd7dec4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:14.984736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8b6144d-d315-4b61-8839-3629e9277b2d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:14.987972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8b6144d-d315-4b61-8839-3629e9277b2d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:14.988634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e568af90-9961-432b-a3e4-40b3efd7dec4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:14.989468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e568af90-9961-432b-a3e4-40b3efd7dec4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:14.992516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e568af90-9961-432b-a3e4-40b3efd7dec4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:14.997117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8b6144d-d315-4b61-8839-3629e9277b2d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:14.998564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e568af90-9961-432b-a3e4-40b3efd7dec4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:14.999354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e568af90-9961-432b-a3e4-40b3efd7dec4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.013813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8b6144d-d315-4b61-8839-3629e9277b2d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.013813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8b6144d-d315-4b61-8839-3629e9277b2d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.026057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8b6144d-d315-4b61-8839-3629e9277b2d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.740833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e568af90-9961-432b-a3e4-40b3efd7dec4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:15.745413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:15.797789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a8b6144d-d315-4b61-8839-3629e9277b2d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:15.808942 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e568af90-9961-432b-a3e4-40b3efd7dec4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 0.881353 Aug 25 12:54:15.838067 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1059/2097] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:14 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:15.850605 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a8b6144d-d315-4b61-8839-3629e9277b2d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 0.910640 Aug 25 12:54:15.857083 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1039/2098] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:14 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:15.880369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d18b86ff-9b9c-4a79-8e3e-93dbcf1f8016 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:15.898065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d18b86ff-9b9c-4a79-8e3e-93dbcf1f8016 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:15.904507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:15.909454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] [instance: 93190d43-5b60-464e-a1d4-ee5aba5f70e9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:15.931773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d18b86ff-9b9c-4a79-8e3e-93dbcf1f8016 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.933456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d18b86ff-9b9c-4a79-8e3e-93dbcf1f8016 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.939431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d18b86ff-9b9c-4a79-8e3e-93dbcf1f8016 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.941413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d18b86ff-9b9c-4a79-8e3e-93dbcf1f8016 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.941808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.943570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.944283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.945097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d18b86ff-9b9c-4a79-8e3e-93dbcf1f8016 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.946333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.946994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.947778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.955387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d18b86ff-9b9c-4a79-8e3e-93dbcf1f8016 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:16.021653 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] HTTP exception thrown: Instance 93190d43-5b60-464e-a1d4-ee5aba5f70e9 could not be found. Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Request method failure captured: Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 HTTP/1.1 Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3BpczeQmIFvraaqmP0mZD1z4X1Qe0_8ExpJ3RhQW7SVxvW1GNZmuEvusBWSgPDAOVrJEOgeZz1ZQKjsqMnFilkdpvqRxvVutxCr3kLv9nqbLkvPd8RhAEHjyGcrGjtH7hFIAERgVYawSTWQAYk4IhsLovHGLRtrquZxwHYTE2o4lmY Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 33deff7a601e4470ae1697c0d0ebd3fa Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestJSON-1398707601 Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33deff7a601e4470ae1697c0d0ebd3fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33deff7a601e4470ae1697c0d0ebd3fa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33deff7a601e4470ae1697c0d0ebd3fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33deff7a601e4470ae1697c0d0ebd3fa"}]}] Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestJSON-1398707601 Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 33deff7a601e4470ae1697c0d0ebd3fa Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestJSON-1398707601 Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestJSON-1398707601-project Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 9b1996cd469f40e580b8267400f9273d Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestJSON-1398707601-project Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 93190d43-5b60-464e-a1d4-ee5aba5f70e9 could not be found. Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '93190d43-5b60-464e-a1d4-ee5aba5f70e9'} Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93190d43-5b60-464e-a1d4-ee5aba5f70e9 could not be found. Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93190d43-5b60-464e-a1d4-ee5aba5f70e9 could not be found. Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:16.046030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:16.058571 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:16.058571 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:16.058571 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:16.058571 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:16.058571 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:16.058571 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93190d43-5b60-464e-a1d4-ee5aba5f70e9 could not be found. Aug 25 12:54:16.058571 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:16.071087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Returning 404 to user: Instance 93190d43-5b60-464e-a1d4-ee5aba5f70e9 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:16.075172 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b4b78e90-b6cc-44ed-967b-292bec8f29f6 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9" status: 404 len: 111 microversion: 2.1 time: 0.205844 Aug 25 12:54:16.088434 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1040/2099] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:15 2022] GET /compute/v2.1/servers/93190d43-5b60-464e-a1d4-ee5aba5f70e9 => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:54:16.124820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1ae95cc-05b3-46eb-a7fe-b4599cf680d4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] Calling method '.version_select at 0x7f3a2e892700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:16.235221 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e1ae95cc-05b3-46eb-a7fe-b4599cf680d4 tempest-ServersTestJSON-1398707601 tempest-ServersTestJSON-1398707601-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065224550" status: 202 len: 0 microversion: 2.1 time: 0.143598 Aug 25 12:54:16.236899 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1041/2100] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 12:54:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065224550 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:54:16.785258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d18b86ff-9b9c-4a79-8e3e-93dbcf1f8016 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:16.820414 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d18b86ff-9b9c-4a79-8e3e-93dbcf1f8016 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 0.980006 Aug 25 12:54:16.837298 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1060/2101] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:15 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:16.864771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-80d3f34e-c8cd-4faa-be56-715a9106ccaa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:16.869498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-80d3f34e-c8cd-4faa-be56-715a9106ccaa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:16.901231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a40f84c-afd3-4135-935a-852b38b1ee03 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:16.903576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7a40f84c-afd3-4135-935a-852b38b1ee03 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:16.938509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80d3f34e-c8cd-4faa-be56-715a9106ccaa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:16.943126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80d3f34e-c8cd-4faa-be56-715a9106ccaa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:16.946855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a40f84c-afd3-4135-935a-852b38b1ee03 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:16.951653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a40f84c-afd3-4135-935a-852b38b1ee03 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:16.954160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80d3f34e-c8cd-4faa-be56-715a9106ccaa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:16.955616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80d3f34e-c8cd-4faa-be56-715a9106ccaa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:16.956051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a40f84c-afd3-4135-935a-852b38b1ee03 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:16.959684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80d3f34e-c8cd-4faa-be56-715a9106ccaa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:16.960684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80d3f34e-c8cd-4faa-be56-715a9106ccaa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:16.961735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a40f84c-afd3-4135-935a-852b38b1ee03 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:16.963100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a40f84c-afd3-4135-935a-852b38b1ee03 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:16.966352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a40f84c-afd3-4135-935a-852b38b1ee03 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:18.504532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7a40f84c-afd3-4135-935a-852b38b1ee03 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:18.520362 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a40f84c-afd3-4135-935a-852b38b1ee03 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 1.630015 Aug 25 12:54:18.522453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-80d3f34e-c8cd-4faa-be56-715a9106ccaa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:18.523490 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1061/2102] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:16 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:18.540710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b2af453-ef04-4e79-a04c-7163175d7e34 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:18.543929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b2af453-ef04-4e79-a04c-7163175d7e34 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:18.557315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b2af453-ef04-4e79-a04c-7163175d7e34 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:18.558026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b2af453-ef04-4e79-a04c-7163175d7e34 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:18.559799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b2af453-ef04-4e79-a04c-7163175d7e34 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:18.560879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b2af453-ef04-4e79-a04c-7163175d7e34 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:18.561702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b2af453-ef04-4e79-a04c-7163175d7e34 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:18.562562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b2af453-ef04-4e79-a04c-7163175d7e34 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:18.571508 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-80d3f34e-c8cd-4faa-be56-715a9106ccaa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 1.715190 Aug 25 12:54:18.573500 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1042/2103] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:16 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:19.103357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b2af453-ef04-4e79-a04c-7163175d7e34 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:19.128409 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b2af453-ef04-4e79-a04c-7163175d7e34 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 0.602064 Aug 25 12:54:19.130406 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1062/2104] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:18 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:19.583796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52ca7481-d29e-4c68-b39a-719ab53660cc tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:19.591146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52ca7481-d29e-4c68-b39a-719ab53660cc tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:19.619125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c585e45-da76-4b6b-bca2-8ed26ad80ae4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:19.623820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c585e45-da76-4b6b-bca2-8ed26ad80ae4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:19.631891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ca7481-d29e-4c68-b39a-719ab53660cc tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:19.635803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ca7481-d29e-4c68-b39a-719ab53660cc tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:19.642071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ca7481-d29e-4c68-b39a-719ab53660cc tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:19.643831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ca7481-d29e-4c68-b39a-719ab53660cc tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:19.645948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ca7481-d29e-4c68-b39a-719ab53660cc tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:19.654067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ca7481-d29e-4c68-b39a-719ab53660cc tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:19.666854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c585e45-da76-4b6b-bca2-8ed26ad80ae4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:19.668022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c585e45-da76-4b6b-bca2-8ed26ad80ae4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:19.668938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c585e45-da76-4b6b-bca2-8ed26ad80ae4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:19.670659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c585e45-da76-4b6b-bca2-8ed26ad80ae4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:19.671604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c585e45-da76-4b6b-bca2-8ed26ad80ae4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:19.672463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c585e45-da76-4b6b-bca2-8ed26ad80ae4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.360874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0c585e45-da76-4b6b-bca2-8ed26ad80ae4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:20.386307 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c585e45-da76-4b6b-bca2-8ed26ad80ae4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 0.775280 Aug 25 12:54:20.388630 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1063/2105] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:19 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:20.397960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c403467c-4e7d-4277-b0ea-31d1ae2a41ab tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:20.406099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c403467c-4e7d-4277-b0ea-31d1ae2a41ab tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:20.415997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c403467c-4e7d-4277-b0ea-31d1ae2a41ab tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.417258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c403467c-4e7d-4277-b0ea-31d1ae2a41ab tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.419053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c403467c-4e7d-4277-b0ea-31d1ae2a41ab tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.420913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c403467c-4e7d-4277-b0ea-31d1ae2a41ab tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.422224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c403467c-4e7d-4277-b0ea-31d1ae2a41ab tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.423343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c403467c-4e7d-4277-b0ea-31d1ae2a41ab tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.529301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52ca7481-d29e-4c68-b39a-719ab53660cc tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:20.555739 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52ca7481-d29e-4c68-b39a-719ab53660cc tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 0.991171 Aug 25 12:54:20.557726 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1043/2106] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:19 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:20.881852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c403467c-4e7d-4277-b0ea-31d1ae2a41ab tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:20.916433 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c403467c-4e7d-4277-b0ea-31d1ae2a41ab tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 0.522344 Aug 25 12:54:20.917863 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1064/2107] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:20 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:21.304205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6dcf4546-efd1-4cf1-9d5e-30114511898c req-adf787bb-a4a1-40a7-9749-71b128f5889b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109e20e8-e1d6-4055-b38e-2d4e11aaaae8", "tag": "6c61d1f1-529c-4eb9-8682-fb8b4eea9ca1"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:21.326114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6dcf4546-efd1-4cf1-9d5e-30114511898c req-adf787bb-a4a1-40a7-9749-71b128f5889b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.327526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6dcf4546-efd1-4cf1-9d5e-30114511898c req-adf787bb-a4a1-40a7-9749-71b128f5889b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.328663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6dcf4546-efd1-4cf1-9d5e-30114511898c req-adf787bb-a4a1-40a7-9749-71b128f5889b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.358250 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6dcf4546-efd1-4cf1-9d5e-30114511898c req-adf787bb-a4a1-40a7-9749-71b128f5889b service nova] Creating event network-changed:6c61d1f1-529c-4eb9-8682-fb8b4eea9ca1 for instance 109e20e8-e1d6-4055-b38e-2d4e11aaaae8 on n-h1-852771-8 Aug 25 12:54:21.367038 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6dcf4546-efd1-4cf1-9d5e-30114511898c req-adf787bb-a4a1-40a7-9749-71b128f5889b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070674 Aug 25 12:54:21.369717 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1044/2108] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:21.414807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4a0523c9-60e7-43bf-970d-ecbc153c71fa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:21.416300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4a0523c9-60e7-43bf-970d-ecbc153c71fa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:21.437081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a0523c9-60e7-43bf-970d-ecbc153c71fa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.438553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a0523c9-60e7-43bf-970d-ecbc153c71fa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.440037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a0523c9-60e7-43bf-970d-ecbc153c71fa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.441289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a0523c9-60e7-43bf-970d-ecbc153c71fa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.442842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a0523c9-60e7-43bf-970d-ecbc153c71fa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.444029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a0523c9-60e7-43bf-970d-ecbc153c71fa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.600494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b619a46c-59f3-45bd-8248-0a31fdc55d79 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:21.601862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b619a46c-59f3-45bd-8248-0a31fdc55d79 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:21.637605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b619a46c-59f3-45bd-8248-0a31fdc55d79 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.639018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b619a46c-59f3-45bd-8248-0a31fdc55d79 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.639848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b619a46c-59f3-45bd-8248-0a31fdc55d79 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.641188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b619a46c-59f3-45bd-8248-0a31fdc55d79 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.643154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b619a46c-59f3-45bd-8248-0a31fdc55d79 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.644209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b619a46c-59f3-45bd-8248-0a31fdc55d79 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.958513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4a0523c9-60e7-43bf-970d-ecbc153c71fa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:21.998264 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4a0523c9-60e7-43bf-970d-ecbc153c71fa tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 0.590571 Aug 25 12:54:22.010805 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1065/2109] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:21 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:22.039289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6ffaeb1e-a751-4c91-a8dd-f15009b024b0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:22.041095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6ffaeb1e-a751-4c91-a8dd-f15009b024b0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:22.061920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ffaeb1e-a751-4c91-a8dd-f15009b024b0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.063324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ffaeb1e-a751-4c91-a8dd-f15009b024b0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.064472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ffaeb1e-a751-4c91-a8dd-f15009b024b0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.066827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ffaeb1e-a751-4c91-a8dd-f15009b024b0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.067965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ffaeb1e-a751-4c91-a8dd-f15009b024b0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.069006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ffaeb1e-a751-4c91-a8dd-f15009b024b0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.206739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b619a46c-59f3-45bd-8248-0a31fdc55d79 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:22.237905 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b619a46c-59f3-45bd-8248-0a31fdc55d79 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 0.644934 Aug 25 12:54:22.255618 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1045/2110] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:21 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:22.494784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6ffaeb1e-a751-4c91-a8dd-f15009b024b0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:22.519052 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6ffaeb1e-a751-4c91-a8dd-f15009b024b0 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 0.505274 Aug 25 12:54:22.520389 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1066/2111] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:22 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:23.047860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0546e0a5-6b36-4c7c-b531-0235f28b13cd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:23.063919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0546e0a5-6b36-4c7c-b531-0235f28b13cd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:23.104585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0546e0a5-6b36-4c7c-b531-0235f28b13cd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:23.106617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0546e0a5-6b36-4c7c-b531-0235f28b13cd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:23.107372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0546e0a5-6b36-4c7c-b531-0235f28b13cd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:23.119433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0546e0a5-6b36-4c7c-b531-0235f28b13cd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:23.124275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0546e0a5-6b36-4c7c-b531-0235f28b13cd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:23.125447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0546e0a5-6b36-4c7c-b531-0235f28b13cd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:23.309888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-04eaa428-a04f-4386-a86d-5886229efb47 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:23.320215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-04eaa428-a04f-4386-a86d-5886229efb47 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:23.354106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04eaa428-a04f-4386-a86d-5886229efb47 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:23.357741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04eaa428-a04f-4386-a86d-5886229efb47 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:23.358746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04eaa428-a04f-4386-a86d-5886229efb47 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:23.362443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04eaa428-a04f-4386-a86d-5886229efb47 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:23.368518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04eaa428-a04f-4386-a86d-5886229efb47 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:23.373547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04eaa428-a04f-4386-a86d-5886229efb47 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.739660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-04eaa428-a04f-4386-a86d-5886229efb47 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:24.764487 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-04eaa428-a04f-4386-a86d-5886229efb47 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 1.490504 Aug 25 12:54:24.769784 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1067/2112] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:23 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:24.784804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5eb77e77-b9ca-4c94-9889-ad41cb876d87 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:24.790699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5eb77e77-b9ca-4c94-9889-ad41cb876d87 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:24.805934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0546e0a5-6b36-4c7c-b531-0235f28b13cd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:24.819948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eb77e77-b9ca-4c94-9889-ad41cb876d87 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.820759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eb77e77-b9ca-4c94-9889-ad41cb876d87 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.821650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eb77e77-b9ca-4c94-9889-ad41cb876d87 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.822991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eb77e77-b9ca-4c94-9889-ad41cb876d87 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.824409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eb77e77-b9ca-4c94-9889-ad41cb876d87 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.825258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eb77e77-b9ca-4c94-9889-ad41cb876d87 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.833385 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0546e0a5-6b36-4c7c-b531-0235f28b13cd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 1.792923 Aug 25 12:54:24.877658 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1046/2113] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:23 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:24.976272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-68a69af1-70d3-45bb-8519-b326091a8065 req-315d746f-b121-477d-b185-6044e6d70e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece", "tag": "f768abed-af60-4ed6-a009-839ff2fd5389"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:25.045254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-68a69af1-70d3-45bb-8519-b326091a8065 req-315d746f-b121-477d-b185-6044e6d70e6f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.049068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-68a69af1-70d3-45bb-8519-b326091a8065 req-315d746f-b121-477d-b185-6044e6d70e6f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.056047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-68a69af1-70d3-45bb-8519-b326091a8065 req-315d746f-b121-477d-b185-6044e6d70e6f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.130920 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-68a69af1-70d3-45bb-8519-b326091a8065 req-315d746f-b121-477d-b185-6044e6d70e6f service nova] Creating event network-changed:f768abed-af60-4ed6-a009-839ff2fd5389 for instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece on n-h2-852771-8 Aug 25 12:54:25.154014 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-68a69af1-70d3-45bb-8519-b326091a8065 req-315d746f-b121-477d-b185-6044e6d70e6f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188426 Aug 25 12:54:25.158841 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1047/2114] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:25.799320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-481f4ae6-1c5f-4e42-8dc9-6c16acb47962 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:25.809923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-481f4ae6-1c5f-4e42-8dc9-6c16acb47962 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:25.849591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-481f4ae6-1c5f-4e42-8dc9-6c16acb47962 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.851391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-481f4ae6-1c5f-4e42-8dc9-6c16acb47962 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.856382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-481f4ae6-1c5f-4e42-8dc9-6c16acb47962 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.858636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-481f4ae6-1c5f-4e42-8dc9-6c16acb47962 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.864747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-481f4ae6-1c5f-4e42-8dc9-6c16acb47962 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.871712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-481f4ae6-1c5f-4e42-8dc9-6c16acb47962 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.883011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5eb77e77-b9ca-4c94-9889-ad41cb876d87 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:25.919164 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5eb77e77-b9ca-4c94-9889-ad41cb876d87 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 1.145808 Aug 25 12:54:25.920294 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1068/2115] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:24 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:25.936843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e184c92f-b2bb-492c-b960-89a42df1fc58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:25.947225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e184c92f-b2bb-492c-b960-89a42df1fc58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:25.994521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e184c92f-b2bb-492c-b960-89a42df1fc58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.996067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e184c92f-b2bb-492c-b960-89a42df1fc58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:26.002417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e184c92f-b2bb-492c-b960-89a42df1fc58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:26.003781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e184c92f-b2bb-492c-b960-89a42df1fc58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:26.004663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e184c92f-b2bb-492c-b960-89a42df1fc58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:26.005643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e184c92f-b2bb-492c-b960-89a42df1fc58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:27.009289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e184c92f-b2bb-492c-b960-89a42df1fc58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:27.045213 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e184c92f-b2bb-492c-b960-89a42df1fc58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 1.122865 Aug 25 12:54:27.077707 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1069/2116] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:25 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:27.131858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0351129a-4501-45d5-8274-e40e7229dac6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:27.133225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0351129a-4501-45d5-8274-e40e7229dac6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:27.164267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0351129a-4501-45d5-8274-e40e7229dac6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:27.165185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0351129a-4501-45d5-8274-e40e7229dac6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:27.166950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0351129a-4501-45d5-8274-e40e7229dac6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:27.167277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0351129a-4501-45d5-8274-e40e7229dac6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:27.171145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0351129a-4501-45d5-8274-e40e7229dac6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:27.172393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0351129a-4501-45d5-8274-e40e7229dac6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:27.228492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-481f4ae6-1c5f-4e42-8dc9-6c16acb47962 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:27.272746 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-481f4ae6-1c5f-4e42-8dc9-6c16acb47962 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 1.482506 Aug 25 12:54:27.273862 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1048/2117] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:25 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:27.376764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9822a0ff-4700-4945-8364-ad8cba6c9bb3 req-715de518-c6c4-40a9-9e05-c35116c65db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c977ed6-c046-4cf6-b62e-adde43a91022", "tag": "61d6a3d1-4657-4b7b-b799-4f2fd85b0767"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:27.425676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9822a0ff-4700-4945-8364-ad8cba6c9bb3 req-715de518-c6c4-40a9-9e05-c35116c65db3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:27.428151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9822a0ff-4700-4945-8364-ad8cba6c9bb3 req-715de518-c6c4-40a9-9e05-c35116c65db3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:27.429427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9822a0ff-4700-4945-8364-ad8cba6c9bb3 req-715de518-c6c4-40a9-9e05-c35116c65db3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:27.481280 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9822a0ff-4700-4945-8364-ad8cba6c9bb3 req-715de518-c6c4-40a9-9e05-c35116c65db3 service nova] Creating event network-changed:61d6a3d1-4657-4b7b-b799-4f2fd85b0767 for instance 8c977ed6-c046-4cf6-b62e-adde43a91022 on n-h2-852771-8 Aug 25 12:54:27.491899 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9822a0ff-4700-4945-8364-ad8cba6c9bb3 req-715de518-c6c4-40a9-9e05-c35116c65db3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123117 Aug 25 12:54:27.498814 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1049/2118] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:54:28.101466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0351129a-4501-45d5-8274-e40e7229dac6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:28.135987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5c32f962-1c52-4a3b-b163-007cee93a63a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:28.141552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5c32f962-1c52-4a3b-b163-007cee93a63a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:28.163744 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0351129a-4501-45d5-8274-e40e7229dac6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 1.081043 Aug 25 12:54:28.173637 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1070/2119] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:27 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:28.198385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c32f962-1c52-4a3b-b163-007cee93a63a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.204042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c32f962-1c52-4a3b-b163-007cee93a63a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.205420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c32f962-1c52-4a3b-b163-007cee93a63a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.208865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c32f962-1c52-4a3b-b163-007cee93a63a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.212406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c32f962-1c52-4a3b-b163-007cee93a63a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.217494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c32f962-1c52-4a3b-b163-007cee93a63a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.315852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02309498-11a2-481c-9a2a-310b22c42325 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:28.317856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02309498-11a2-481c-9a2a-310b22c42325 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:28.331194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02309498-11a2-481c-9a2a-310b22c42325 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.332446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02309498-11a2-481c-9a2a-310b22c42325 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.333444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02309498-11a2-481c-9a2a-310b22c42325 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.335079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02309498-11a2-481c-9a2a-310b22c42325 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.336221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02309498-11a2-481c-9a2a-310b22c42325 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.337698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02309498-11a2-481c-9a2a-310b22c42325 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:29.519542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c32f962-1c52-4a3b-b163-007cee93a63a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:29.561197 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5c32f962-1c52-4a3b-b163-007cee93a63a tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 1.436669 Aug 25 12:54:29.568350 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1050/2120] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:28 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:29.618653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bacc357f-2009-4a41-bbd1-1902715dfecc tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:29.631852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bacc357f-2009-4a41-bbd1-1902715dfecc tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:29.690413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bacc357f-2009-4a41-bbd1-1902715dfecc tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:29.691243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bacc357f-2009-4a41-bbd1-1902715dfecc tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:29.692063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bacc357f-2009-4a41-bbd1-1902715dfecc tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:29.693380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bacc357f-2009-4a41-bbd1-1902715dfecc tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:29.699348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bacc357f-2009-4a41-bbd1-1902715dfecc tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:29.705668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bacc357f-2009-4a41-bbd1-1902715dfecc tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:29.822725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02309498-11a2-481c-9a2a-310b22c42325 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:29.869298 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02309498-11a2-481c-9a2a-310b22c42325 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 1.561858 Aug 25 12:54:29.870431 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1071/2121] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:28 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:30.613463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bacc357f-2009-4a41-bbd1-1902715dfecc tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:30.618791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:30.653154 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bacc357f-2009-4a41-bbd1-1902715dfecc tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 1.068944 Aug 25 12:54:30.654882 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1051/2122] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:29 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:30.676256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c91cc21a-52b8-4e05-a00a-811c87a1259c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:30.678745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c91cc21a-52b8-4e05-a00a-811c87a1259c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:30.687291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a85c3f0f-dde0-491a-90f7-a46ddcbd58b8 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a29c34c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-611910749", "description": "tempest-description-543809723"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:30.706828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91cc21a-52b8-4e05-a00a-811c87a1259c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:30.707451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91cc21a-52b8-4e05-a00a-811c87a1259c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:30.707990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91cc21a-52b8-4e05-a00a-811c87a1259c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:30.708851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91cc21a-52b8-4e05-a00a-811c87a1259c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:30.709392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91cc21a-52b8-4e05-a00a-811c87a1259c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:30.709979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c91cc21a-52b8-4e05-a00a-811c87a1259c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.362612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c91cc21a-52b8-4e05-a00a-811c87a1259c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:31.389419 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c91cc21a-52b8-4e05-a00a-811c87a1259c tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 0.724832 Aug 25 12:54:31.391774 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1052/2123] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:30 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:31.406733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-239528a6-4765-4ef1-b6c0-043e12239278 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:31.411574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-239528a6-4765-4ef1-b6c0-043e12239278 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:31.440407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-239528a6-4765-4ef1-b6c0-043e12239278 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.444757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-239528a6-4765-4ef1-b6c0-043e12239278 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.446858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-239528a6-4765-4ef1-b6c0-043e12239278 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.455270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-239528a6-4765-4ef1-b6c0-043e12239278 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.456917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-239528a6-4765-4ef1-b6c0-043e12239278 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.458050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-239528a6-4765-4ef1-b6c0-043e12239278 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:32.274229 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a85c3f0f-dde0-491a-90f7-a46ddcbd58b8 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.816578 Aug 25 12:54:32.275302 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1072/2124] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:54:30 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:54:32.286477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-314a01ac-6b6f-4915-b24f-21022e227bf6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:32.288689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-314a01ac-6b6f-4915-b24f-21022e227bf6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:32.302523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:32.306998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314a01ac-6b6f-4915-b24f-21022e227bf6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:32.308848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314a01ac-6b6f-4915-b24f-21022e227bf6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:32.310040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314a01ac-6b6f-4915-b24f-21022e227bf6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:32.312077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314a01ac-6b6f-4915-b24f-21022e227bf6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:32.313257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314a01ac-6b6f-4915-b24f-21022e227bf6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:32.314081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314a01ac-6b6f-4915-b24f-21022e227bf6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:32.641458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-239528a6-4765-4ef1-b6c0-043e12239278 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:32.676753 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-239528a6-4765-4ef1-b6c0-043e12239278 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 1.281066 Aug 25 12:54:32.678259 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1053/2125] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:31 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:32.717972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2ac2b807-b325-420f-aba3-5ed5e33b2a0b tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e8430d0>, body: {"security_group_rule": {"parent_group_id": "4075463a-17a0-4c55-b0e4-e9a0fa88c8d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:32.823661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-314a01ac-6b6f-4915-b24f-21022e227bf6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:32.863202 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-314a01ac-6b6f-4915-b24f-21022e227bf6 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 0.584389 Aug 25 12:54:32.877742 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1073/2126] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:32 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:32.916893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c64eeae5-dccc-4ceb-a9a5-61b81447c35d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:32.919665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c64eeae5-dccc-4ceb-a9a5-61b81447c35d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:32.948525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c64eeae5-dccc-4ceb-a9a5-61b81447c35d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:32.952409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c64eeae5-dccc-4ceb-a9a5-61b81447c35d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:32.953225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c64eeae5-dccc-4ceb-a9a5-61b81447c35d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:32.955731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c64eeae5-dccc-4ceb-a9a5-61b81447c35d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:32.960786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c64eeae5-dccc-4ceb-a9a5-61b81447c35d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:32.961595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c64eeae5-dccc-4ceb-a9a5-61b81447c35d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.988047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c64eeae5-dccc-4ceb-a9a5-61b81447c35d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:34.032937 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c64eeae5-dccc-4ceb-a9a5-61b81447c35d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 1.152130 Aug 25 12:54:34.043973 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1074/2127] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:32 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:34.059978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-32455e11-9e1e-4b93-8af5-75cc14748b5e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:34.064469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-32455e11-9e1e-4b93-8af5-75cc14748b5e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:34.138480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32455e11-9e1e-4b93-8af5-75cc14748b5e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.143968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32455e11-9e1e-4b93-8af5-75cc14748b5e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.151230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32455e11-9e1e-4b93-8af5-75cc14748b5e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.156514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32455e11-9e1e-4b93-8af5-75cc14748b5e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.167851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32455e11-9e1e-4b93-8af5-75cc14748b5e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.170594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32455e11-9e1e-4b93-8af5-75cc14748b5e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.480630 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2ac2b807-b325-420f-aba3-5ed5e33b2a0b tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.785539 Aug 25 12:54:34.482344 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1054/2128] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:54:32 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:34.502600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb20b491-017b-4585-a072-c5ae6611193f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:34.513048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fb20b491-017b-4585-a072-c5ae6611193f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:34.568056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb20b491-017b-4585-a072-c5ae6611193f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.577241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb20b491-017b-4585-a072-c5ae6611193f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.578613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb20b491-017b-4585-a072-c5ae6611193f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.580559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb20b491-017b-4585-a072-c5ae6611193f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.581750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb20b491-017b-4585-a072-c5ae6611193f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.586632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb20b491-017b-4585-a072-c5ae6611193f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.188066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-32455e11-9e1e-4b93-8af5-75cc14748b5e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:35.242877 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-32455e11-9e1e-4b93-8af5-75cc14748b5e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 1.195198 Aug 25 12:54:35.243997 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1075/2129] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:34 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:35.296308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2e1889dd-9d73-499c-9a8f-49122ddce85d req-9eb03292-80f7-4981-81df-5ec44e6c17b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109e20e8-e1d6-4055-b38e-2d4e11aaaae8", "name": "network-vif-plugged", "status": "completed", "tag": "6c61d1f1-529c-4eb9-8682-fb8b4eea9ca1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:35.327793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fb20b491-017b-4585-a072-c5ae6611193f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:35.364910 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb20b491-017b-4585-a072-c5ae6611193f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 0.878550 Aug 25 12:54:35.367639 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1055/2130] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:34 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:35.370347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2e1889dd-9d73-499c-9a8f-49122ddce85d req-9eb03292-80f7-4981-81df-5ec44e6c17b5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.372202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2e1889dd-9d73-499c-9a8f-49122ddce85d req-9eb03292-80f7-4981-81df-5ec44e6c17b5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.376681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2e1889dd-9d73-499c-9a8f-49122ddce85d req-9eb03292-80f7-4981-81df-5ec44e6c17b5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.395776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9041b19a-baa4-44bb-a21f-3260fa720b0e tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e79f1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1521937847", "description": "tempest-description-2012472129"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:35.436873 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2e1889dd-9d73-499c-9a8f-49122ddce85d req-9eb03292-80f7-4981-81df-5ec44e6c17b5 service nova] Creating event network-vif-plugged:6c61d1f1-529c-4eb9-8682-fb8b4eea9ca1 for instance 109e20e8-e1d6-4055-b38e-2d4e11aaaae8 on n-h1-852771-8 Aug 25 12:54:35.448569 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2e1889dd-9d73-499c-9a8f-49122ddce85d req-9eb03292-80f7-4981-81df-5ec44e6c17b5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183767 Aug 25 12:54:35.450176 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1076/2131] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:35.466336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6609f4bd-6262-4a11-9e64-8047770928dd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:35.470168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6609f4bd-6262-4a11-9e64-8047770928dd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:35.485002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6609f4bd-6262-4a11-9e64-8047770928dd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.485962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6609f4bd-6262-4a11-9e64-8047770928dd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.486926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6609f4bd-6262-4a11-9e64-8047770928dd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.488892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6609f4bd-6262-4a11-9e64-8047770928dd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.491257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6609f4bd-6262-4a11-9e64-8047770928dd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.492743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6609f4bd-6262-4a11-9e64-8047770928dd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.259898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6609f4bd-6262-4a11-9e64-8047770928dd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:36.299140 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6609f4bd-6262-4a11-9e64-8047770928dd tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 0.846331 Aug 25 12:54:36.300288 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1077/2132] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:35 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:36.352115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e077c0dd-ff37-40d3-a0a7-57acdd28b556 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:36.352115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e077c0dd-ff37-40d3-a0a7-57acdd28b556 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:36.387927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e077c0dd-ff37-40d3-a0a7-57acdd28b556 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.393800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e077c0dd-ff37-40d3-a0a7-57acdd28b556 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.395224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e077c0dd-ff37-40d3-a0a7-57acdd28b556 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.396867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e077c0dd-ff37-40d3-a0a7-57acdd28b556 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.403570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e077c0dd-ff37-40d3-a0a7-57acdd28b556 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.405299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e077c0dd-ff37-40d3-a0a7-57acdd28b556 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.434835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:36.522756 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9041b19a-baa4-44bb-a21f-3260fa720b0e tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.139385 Aug 25 12:54:36.524085 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1056/2133] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:54:35 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:36.575234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-905542f7-57ad-4613-8889-d70359830537 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:36.580395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-905542f7-57ad-4613-8889-d70359830537 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:36.736537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-905542f7-57ad-4613-8889-d70359830537 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.738316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-905542f7-57ad-4613-8889-d70359830537 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.740313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-905542f7-57ad-4613-8889-d70359830537 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.743496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-905542f7-57ad-4613-8889-d70359830537 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.746431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-905542f7-57ad-4613-8889-d70359830537 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.747714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-905542f7-57ad-4613-8889-d70359830537 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:37.632540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-905542f7-57ad-4613-8889-d70359830537 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:37.675496 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-905542f7-57ad-4613-8889-d70359830537 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 1.149595 Aug 25 12:54:37.676998 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1057/2134] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:36 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:37.705827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-07376b98-74a6-419f-bc20-641292b88f1d tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e8438b0>, body: {"security_group_rule": {"parent_group_id": "3f3fb03b-81bc-4df0-89f0-b3196058cd3d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:37.833178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e077c0dd-ff37-40d3-a0a7-57acdd28b556 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:37.858880 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e077c0dd-ff37-40d3-a0a7-57acdd28b556 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 1.544160 Aug 25 12:54:37.860816 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1078/2135] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:36 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:37.883208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-51eec17a-971c-4834-aaa3-c3aafd4a3c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:37.887427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-51eec17a-971c-4834-aaa3-c3aafd4a3c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:37.904453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51eec17a-971c-4834-aaa3-c3aafd4a3c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:37.905878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51eec17a-971c-4834-aaa3-c3aafd4a3c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:37.907019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51eec17a-971c-4834-aaa3-c3aafd4a3c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:37.911538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51eec17a-971c-4834-aaa3-c3aafd4a3c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:37.913300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51eec17a-971c-4834-aaa3-c3aafd4a3c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:37.914928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51eec17a-971c-4834-aaa3-c3aafd4a3c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.113184 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-07376b98-74a6-419f-bc20-641292b88f1d tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.433797 Aug 25 12:54:39.114772 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1058/2136] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:54:37 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:39.128890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8434ca30-5fbf-4ae2-b051-dc9e99dfa920 req-2f541221-08ed-4c72-ba11-e9a408bcc691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c977ed6-c046-4cf6-b62e-adde43a91022", "name": "network-vif-plugged", "status": "completed", "tag": "61d6a3d1-4657-4b7b-b799-4f2fd85b0767"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:39.163331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-51eec17a-971c-4834-aaa3-c3aafd4a3c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.174149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8434ca30-5fbf-4ae2-b051-dc9e99dfa920 req-2f541221-08ed-4c72-ba11-e9a408bcc691 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.175019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8434ca30-5fbf-4ae2-b051-dc9e99dfa920 req-2f541221-08ed-4c72-ba11-e9a408bcc691 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.175796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8434ca30-5fbf-4ae2-b051-dc9e99dfa920 req-2f541221-08ed-4c72-ba11-e9a408bcc691 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.227010 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8434ca30-5fbf-4ae2-b051-dc9e99dfa920 req-2f541221-08ed-4c72-ba11-e9a408bcc691 service nova] Creating event network-vif-plugged:61d6a3d1-4657-4b7b-b799-4f2fd85b0767 for instance 8c977ed6-c046-4cf6-b62e-adde43a91022 on n-h2-852771-8 Aug 25 12:54:39.240391 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8434ca30-5fbf-4ae2-b051-dc9e99dfa920 req-2f541221-08ed-4c72-ba11-e9a408bcc691 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123464 Aug 25 12:54:39.241709 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1059/2137] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:39.256865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ab936629-858d-4023-9ef3-a2ed52871b9c tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:39.259725 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-51eec17a-971c-4834-aaa3-c3aafd4a3c96 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1325 microversion: 2.1 time: 1.396406 Aug 25 12:54:39.260030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ab936629-858d-4023-9ef3-a2ed52871b9c tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:39.266402 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1079/2138] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:37 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1325 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:39.289197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fbf3058e-c3b3-411c-bf30-9b3ad73fe2d6 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:39.291003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fbf3058e-c3b3-411c-bf30-9b3ad73fe2d6 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:39.298480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab936629-858d-4023-9ef3-a2ed52871b9c tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.299415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab936629-858d-4023-9ef3-a2ed52871b9c tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.300234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab936629-858d-4023-9ef3-a2ed52871b9c tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.309348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab936629-858d-4023-9ef3-a2ed52871b9c tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.310408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab936629-858d-4023-9ef3-a2ed52871b9c tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.310967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab936629-858d-4023-9ef3-a2ed52871b9c tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.411815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbf3058e-c3b3-411c-bf30-9b3ad73fe2d6 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.421405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbf3058e-c3b3-411c-bf30-9b3ad73fe2d6 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.424810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbf3058e-c3b3-411c-bf30-9b3ad73fe2d6 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.428304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbf3058e-c3b3-411c-bf30-9b3ad73fe2d6 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.428851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbf3058e-c3b3-411c-bf30-9b3ad73fe2d6 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.433762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbf3058e-c3b3-411c-bf30-9b3ad73fe2d6 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.943379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ab936629-858d-4023-9ef3-a2ed52871b9c tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.963731 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ab936629-858d-4023-9ef3-a2ed52871b9c tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 0.716732 Aug 25 12:54:39.973808 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1060/2139] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:39 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:39.979377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fbf3058e-c3b3-411c-bf30-9b3ad73fe2d6 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.989189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52c0e0de-53b5-4a0b-b7ee-dfa0620085ae tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e8403a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1990676901", "description": "tempest-description-1656289067"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:39.996993 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fbf3058e-c3b3-411c-bf30-9b3ad73fe2d6 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 0.722976 Aug 25 12:54:40.002581 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1080/2140] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:39 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:40.317896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-31afce3c-f323-464a-8f73-ceaf572c8ee4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:40.322953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-31afce3c-f323-464a-8f73-ceaf572c8ee4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:40.349559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31afce3c-f323-464a-8f73-ceaf572c8ee4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.351137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31afce3c-f323-464a-8f73-ceaf572c8ee4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.354731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31afce3c-f323-464a-8f73-ceaf572c8ee4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.357393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31afce3c-f323-464a-8f73-ceaf572c8ee4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.367182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31afce3c-f323-464a-8f73-ceaf572c8ee4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.368870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31afce3c-f323-464a-8f73-ceaf572c8ee4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.428008 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52c0e0de-53b5-4a0b-b7ee-dfa0620085ae tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.454568 Aug 25 12:54:40.428813 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1061/2141] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:54:39 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:40.450651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-faed81f1-d28b-4ec8-a536-c5ca4dc8a68a tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e7e9940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1982642707", "description": "tempest-description-179928175"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:40.897396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-31afce3c-f323-464a-8f73-ceaf572c8ee4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:40.934921 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-31afce3c-f323-464a-8f73-ceaf572c8ee4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1522 microversion: 2.1 time: 0.622486 Aug 25 12:54:40.937175 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1081/2142] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:40 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1522 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:40.982890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6069fc9d-d4a3-4312-bad6-4d89222ee8a7 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:40.983833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6069fc9d-d4a3-4312-bad6-4d89222ee8a7 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:40.996728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6069fc9d-d4a3-4312-bad6-4d89222ee8a7 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.998525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6069fc9d-d4a3-4312-bad6-4d89222ee8a7 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.999642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6069fc9d-d4a3-4312-bad6-4d89222ee8a7 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.001278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6069fc9d-d4a3-4312-bad6-4d89222ee8a7 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.002482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6069fc9d-d4a3-4312-bad6-4d89222ee8a7 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.003568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6069fc9d-d4a3-4312-bad6-4d89222ee8a7 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.111387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6069fc9d-d4a3-4312-bad6-4d89222ee8a7 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:54:41.235695 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-faed81f1-d28b-4ec8-a536-c5ca4dc8a68a tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.789642 Aug 25 12:54:41.236760 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1062/2143] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:54:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:41.249230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8f9226ef-2e48-4920-a276-e18ce0cb7276 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:41.271631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8f9226ef-2e48-4920-a276-e18ce0cb7276 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:41.283661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:41.333833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f9226ef-2e48-4920-a276-e18ce0cb7276 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.335143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f9226ef-2e48-4920-a276-e18ce0cb7276 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.340055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f9226ef-2e48-4920-a276-e18ce0cb7276 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.341352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f9226ef-2e48-4920-a276-e18ce0cb7276 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.342239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f9226ef-2e48-4920-a276-e18ce0cb7276 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.343041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f9226ef-2e48-4920-a276-e18ce0cb7276 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.502990 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6069fc9d-d4a3-4312-bad6-4d89222ee8a7 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "DELETE /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 204 len: 0 microversion: 2.1 time: 0.521810 Aug 25 12:54:41.508862 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1082/2144] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:54:40 2022] DELETE /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:54:41.537882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10303589-a369-4b74-8c6d-566928d95c4f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:41.540959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-10303589-a369-4b74-8c6d-566928d95c4f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:41.582111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10303589-a369-4b74-8c6d-566928d95c4f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.583956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10303589-a369-4b74-8c6d-566928d95c4f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.585395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10303589-a369-4b74-8c6d-566928d95c4f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.587585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10303589-a369-4b74-8c6d-566928d95c4f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.589793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10303589-a369-4b74-8c6d-566928d95c4f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.591531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10303589-a369-4b74-8c6d-566928d95c4f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:42.199581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-10303589-a369-4b74-8c6d-566928d95c4f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:42.228724 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-10303589-a369-4b74-8c6d-566928d95c4f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 0.715897 Aug 25 12:54:42.230739 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1083/2145] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:41 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:42.253208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d340f92-3ada-4db6-9b31-2d643d8fd050 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e73de50>, body: {"security_group_rule": {"parent_group_id": "3be7a6b5-4c03-44b0-9869-6eb2c3b36183", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "99dd4542-896b-46db-bea7-4d9961e148f6"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:42.353294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8f9226ef-2e48-4920-a276-e18ce0cb7276 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:42.386639 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8f9226ef-2e48-4920-a276-e18ce0cb7276 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1324 microversion: 2.1 time: 1.144964 Aug 25 12:54:42.391024 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1063/2146] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:41 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1324 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:42.414556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0ba2779-d311-41c3-9929-997476257af0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:42.416281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d0ba2779-d311-41c3-9929-997476257af0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:42.448084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0ba2779-d311-41c3-9929-997476257af0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:42.449095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0ba2779-d311-41c3-9929-997476257af0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:42.450066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0ba2779-d311-41c3-9929-997476257af0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:42.452011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0ba2779-d311-41c3-9929-997476257af0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:42.452921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0ba2779-d311-41c3-9929-997476257af0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:42.454742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0ba2779-d311-41c3-9929-997476257af0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:42.929001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d0ba2779-d311-41c3-9929-997476257af0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:42.989978 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d0ba2779-d311-41c3-9929-997476257af0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1528 microversion: 2.1 time: 0.583941 Aug 25 12:54:43.006915 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1064/2147] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:42 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1528 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:43.184327 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d340f92-3ada-4db6-9b31-2d643d8fd050 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.945591 Aug 25 12:54:43.187164 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1084/2148] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:54:42 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:43.213948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eeea3c07-a2f0-4c6b-aa58-175969f7561b tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e807ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2071024919", "description": "tempest-description-300764207"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:43.703587 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eeea3c07-a2f0-4c6b-aa58-175969f7561b tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.498424 Aug 25 12:54:43.717552 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1085/2149] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:54:43 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:54:43.723374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b24a4abc-7997-479c-9a37-b151efed28ed tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:43.724988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b24a4abc-7997-479c-9a37-b151efed28ed tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:43.750278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b24a4abc-7997-479c-9a37-b151efed28ed tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.753632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b24a4abc-7997-479c-9a37-b151efed28ed tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.755380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b24a4abc-7997-479c-9a37-b151efed28ed tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.757454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b24a4abc-7997-479c-9a37-b151efed28ed tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.758564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-66ba7dd6-87bc-4128-bc3c-cad33a47f518 req-54932464-80c2-4d99-9b46-4e0f2c89338f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece", "name": "network-vif-plugged", "status": "completed", "tag": "f768abed-af60-4ed6-a009-839ff2fd5389"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:43.760463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b24a4abc-7997-479c-9a37-b151efed28ed tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.763882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b24a4abc-7997-479c-9a37-b151efed28ed tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.828384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-66ba7dd6-87bc-4128-bc3c-cad33a47f518 req-54932464-80c2-4d99-9b46-4e0f2c89338f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.830327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-66ba7dd6-87bc-4128-bc3c-cad33a47f518 req-54932464-80c2-4d99-9b46-4e0f2c89338f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.830479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-66ba7dd6-87bc-4128-bc3c-cad33a47f518 req-54932464-80c2-4d99-9b46-4e0f2c89338f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.869095 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-66ba7dd6-87bc-4128-bc3c-cad33a47f518 req-54932464-80c2-4d99-9b46-4e0f2c89338f service nova] Creating event network-vif-plugged:f768abed-af60-4ed6-a009-839ff2fd5389 for instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece on n-h2-852771-8 Aug 25 12:54:43.887121 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-66ba7dd6-87bc-4128-bc3c-cad33a47f518 req-54932464-80c2-4d99-9b46-4e0f2c89338f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.881806 Aug 25 12:54:43.894732 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1065/2150] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:43.903091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-20b2f62a-2cf4-4552-a4aa-48cb7041a50b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:43.909034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-20b2f62a-2cf4-4552-a4aa-48cb7041a50b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:43.940099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b2f62a-2cf4-4552-a4aa-48cb7041a50b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.942640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b2f62a-2cf4-4552-a4aa-48cb7041a50b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.943984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b2f62a-2cf4-4552-a4aa-48cb7041a50b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.945690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b2f62a-2cf4-4552-a4aa-48cb7041a50b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.947093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b2f62a-2cf4-4552-a4aa-48cb7041a50b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.949186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b2f62a-2cf4-4552-a4aa-48cb7041a50b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:44.569963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b24a4abc-7997-479c-9a37-b151efed28ed tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:44.597022 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b24a4abc-7997-479c-9a37-b151efed28ed tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 0.890152 Aug 25 12:54:44.628521 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1086/2151] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:43 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:44.659891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-96ace648-01b9-4627-8746-09c2025c5944 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e75f550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-416922492", "description": "tempest-description-510771457"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:44.830692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-20b2f62a-2cf4-4552-a4aa-48cb7041a50b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:44.858457 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-20b2f62a-2cf4-4552-a4aa-48cb7041a50b tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1521 microversion: 2.1 time: 0.952928 Aug 25 12:54:44.860152 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1066/2152] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:43 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1521 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:44.884235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-928d0aef-fe16-4dd6-b728-7a07fcb835c4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:44.885772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-928d0aef-fe16-4dd6-b728-7a07fcb835c4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:44.934242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-928d0aef-fe16-4dd6-b728-7a07fcb835c4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:44.942740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-928d0aef-fe16-4dd6-b728-7a07fcb835c4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:44.953590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-928d0aef-fe16-4dd6-b728-7a07fcb835c4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:44.956698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-928d0aef-fe16-4dd6-b728-7a07fcb835c4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:44.963725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-928d0aef-fe16-4dd6-b728-7a07fcb835c4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:44.966410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-928d0aef-fe16-4dd6-b728-7a07fcb835c4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.251353 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-96ace648-01b9-4627-8746-09c2025c5944 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.620017 Aug 25 12:54:45.252773 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1087/2153] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:54:44 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:45.276729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:45.278093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:45.325614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:45.329302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:45.331460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.337763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:45.338751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:45.342117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.475908 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] HTTP exception thrown: Instance is not a member of specified network Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Request method failure captured: Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022/ips/invalid HTTP/1.1 Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3DgA7_A4x5sDFAezHFzI6KlNWlLml8g1j_mdgN3VDWW1D5_n0MbD9mh9D1I-ZpasUHkuxXZFsALZlrbdLTKlBrnKvRw3bERnxUOIHqUX0qEL1jamBpgCUxYYCMrGWMm-qnrfy7nbVDLwGAsDrefWe-Cmyb-yiY6R9ALeW8Xno_hBEo Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: af530a60986043b1bd4f3febaee1c3af Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-64460891 Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af530a60986043b1bd4f3febaee1c3af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af530a60986043b1bd4f3febaee1c3af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af530a60986043b1bd4f3febaee1c3af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af530a60986043b1bd4f3febaee1c3af"}]}] Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-64460891 Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: af530a60986043b1bd4f3febaee1c3af Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-64460891 Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerAddressesNegativeTestJSON-64460891-project Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: f3ab7808c55142d494e662334ae372fe Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-64460891-project Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance is not a member of specified network Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': '8c977ed6-c046-4cf6-b62e-adde43a91022', 'id': 'invalid'} Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 25 12:54:45.491786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:45.500205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Returning 404 to user: Instance is not a member of specified network {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:45.502528 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b91c7deb-4da2-4da4-adbe-d790bd71d781 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.247618 Aug 25 12:54:45.512872 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1088/2154] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:54:45 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022/ips/invalid => generated 91 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:54:45.565803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9bdd97c7-824d-41b1-add0-474e39b4e4b3 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e6ed8b0>, body: {"security_group_rule": {"parent_group_id": "e663ec31-74c3-43d5-a24b-3963d39e27c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "50c4123f-62ea-4d89-a5b5-90e0c11798ac"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:45.858851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-928d0aef-fe16-4dd6-b728-7a07fcb835c4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d9b7c3351f44b9b986e6535fc62819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43be46fe4e84396b73fbdca834b3525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:45.902865 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-928d0aef-fe16-4dd6-b728-7a07fcb835c4 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 200 len: 1528 microversion: 2.1 time: 1.039707 Aug 25 12:54:45.906231 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1067/2155] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:44 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 1528 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:45.924413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf81afff-435b-4d7d-85a3-4569fa85c07e tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:45.939480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bf81afff-435b-4d7d-85a3-4569fa85c07e tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Failed to fetch instance by id 999 {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 12:54:45.940897 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-bf81afff-435b-4d7d-85a3-4569fa85c07e tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] HTTP exception thrown: Instance 999 could not be found. Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf81afff-435b-4d7d-85a3-4569fa85c07e tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Request method failure captured: Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3DgA7_A4x5sDFAezHFzI6KlNWlLml8g1j_mdgN3VDWW1D5_n0MbD9mh9D1I-ZpasUHkuxXZFsALZlrbdLTKlBrnKvRw3bERnxUOIHqUX0qEL1jamBpgCUxYYCMrGWMm-qnrfy7nbVDLwGAsDrefWe-Cmyb-yiY6R9ALeW8Xno_hBEo Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: af530a60986043b1bd4f3febaee1c3af Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-64460891 Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af530a60986043b1bd4f3febaee1c3af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af530a60986043b1bd4f3febaee1c3af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af530a60986043b1bd4f3febaee1c3af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af530a60986043b1bd4f3febaee1c3af"}]}] Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-64460891 Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: af530a60986043b1bd4f3febaee1c3af Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-64460891 Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerAddressesNegativeTestJSON-64460891-project Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: f3ab7808c55142d494e662334ae372fe Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-64460891-project Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 999 could not be found. Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'server_id': '999'} Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 25 12:54:45.957015 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:45.971595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf81afff-435b-4d7d-85a3-4569fa85c07e tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Returning 404 to user: Instance 999 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:45.978240 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bf81afff-435b-4d7d-85a3-4569fa85c07e tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.064610 Aug 25 12:54:45.983103 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1068/2156] 10.222.0.70 () {58 vars in 1149 bytes} [Thu Aug 25 12:54:45 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:54:46.002165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2360892e-69a2-48b4-a49c-5b7bf460ffa4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:46.004963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2360892e-69a2-48b4-a49c-5b7bf460ffa4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:46.054978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2360892e-69a2-48b4-a49c-5b7bf460ffa4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.070069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2360892e-69a2-48b4-a49c-5b7bf460ffa4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.072574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2360892e-69a2-48b4-a49c-5b7bf460ffa4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:46.076443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2360892e-69a2-48b4-a49c-5b7bf460ffa4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.098634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2360892e-69a2-48b4-a49c-5b7bf460ffa4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.103141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2360892e-69a2-48b4-a49c-5b7bf460ffa4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:46.729300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2360892e-69a2-48b4-a49c-5b7bf460ffa4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:46.752508 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2360892e-69a2-48b4-a49c-5b7bf460ffa4 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1323 microversion: 2.1 time: 0.766984 Aug 25 12:54:46.788746 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1069/2157] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:45 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1323 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:46.809168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-80275e68-16f9-4832-991e-9f8dbfa1da85 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:46.810216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-80275e68-16f9-4832-991e-9f8dbfa1da85 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:46.844356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80275e68-16f9-4832-991e-9f8dbfa1da85 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.861587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80275e68-16f9-4832-991e-9f8dbfa1da85 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.861587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80275e68-16f9-4832-991e-9f8dbfa1da85 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:46.871800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80275e68-16f9-4832-991e-9f8dbfa1da85 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.875806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80275e68-16f9-4832-991e-9f8dbfa1da85 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.879995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80275e68-16f9-4832-991e-9f8dbfa1da85 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.025967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-80275e68-16f9-4832-991e-9f8dbfa1da85 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:54:47.359474 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9bdd97c7-824d-41b1-add0-474e39b4e4b3 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.845319 Aug 25 12:54:47.363574 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1089/2158] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:54:45 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:47.379513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-af80a2d0-9a5c-41ef-b85c-c31f5a0b9cec req-c90b751c-bf66-4119-a591-5b171fb53d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109e20e8-e1d6-4055-b38e-2d4e11aaaae8", "name": "network-vif-deleted", "tag": "6c61d1f1-529c-4eb9-8682-fb8b4eea9ca1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:47.413495 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-80275e68-16f9-4832-991e-9f8dbfa1da85 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 204 len: 0 microversion: 2.1 time: 0.621975 Aug 25 12:54:47.418599 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1070/2159] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:54:46 2022] DELETE /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:54:47.422461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-af80a2d0-9a5c-41ef-b85c-c31f5a0b9cec req-c90b751c-bf66-4119-a591-5b171fb53d33 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.424134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-af80a2d0-9a5c-41ef-b85c-c31f5a0b9cec req-c90b751c-bf66-4119-a591-5b171fb53d33 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.425923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-af80a2d0-9a5c-41ef-b85c-c31f5a0b9cec req-c90b751c-bf66-4119-a591-5b171fb53d33 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.463073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:47.468091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 109e20e8-e1d6-4055-b38e-2d4e11aaaae8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:47.487745 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-af80a2d0-9a5c-41ef-b85c-c31f5a0b9cec req-c90b751c-bf66-4119-a591-5b171fb53d33 service nova] Creating event network-vif-deleted:6c61d1f1-529c-4eb9-8682-fb8b4eea9ca1 for instance 109e20e8-e1d6-4055-b38e-2d4e11aaaae8 on n-h1-852771-8 Aug 25 12:54:47.510243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.516459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.522226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.525979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.527315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.527695 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-af80a2d0-9a5c-41ef-b85c-c31f5a0b9cec req-c90b751c-bf66-4119-a591-5b171fb53d33 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155905 Aug 25 12:54:47.530283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.531026 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1090/2160] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:47.561132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-471d814e-6545-43b9-b3a3-24de77825d87 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a29c1c3a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:47.606398 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Instance 109e20e8-e1d6-4055-b38e-2d4e11aaaae8 could not be found. Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 HTTP/1.1 Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 109e20e8-e1d6-4055-b38e-2d4e11aaaae8 could not be found. Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '109e20e8-e1d6-4055-b38e-2d4e11aaaae8'} Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109e20e8-e1d6-4055-b38e-2d4e11aaaae8 could not be found. Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109e20e8-e1d6-4055-b38e-2d4e11aaaae8 could not be found. Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:47.611264 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:47.619210 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:47.619210 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:47.619210 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:47.619210 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:47.619210 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:47.619210 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:47.619210 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109e20e8-e1d6-4055-b38e-2d4e11aaaae8 could not be found. Aug 25 12:54:47.619210 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:47.619210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 404 to user: Instance 109e20e8-e1d6-4055-b38e-2d4e11aaaae8 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:47.619210 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-993e9529-8f6c-4153-877e-0fe95093f6b0 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8" status: 404 len: 111 microversion: 2.1 time: 0.185264 Aug 25 12:54:47.624129 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1071/2161] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:47 2022] GET /compute/v2.1/servers/109e20e8-e1d6-4055-b38e-2d4e11aaaae8 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:54:47.635673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b24927ad-21c8-46db-993e-e0ee9f3626de tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:47.638837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b24927ad-21c8-46db-993e-e0ee9f3626de tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:47.650497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b24927ad-21c8-46db-993e-e0ee9f3626de tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.652631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b24927ad-21c8-46db-993e-e0ee9f3626de tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.653333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b24927ad-21c8-46db-993e-e0ee9f3626de tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.655709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b24927ad-21c8-46db-993e-e0ee9f3626de tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.657001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b24927ad-21c8-46db-993e-e0ee9f3626de tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.657771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b24927ad-21c8-46db-993e-e0ee9f3626de tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:48.653177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b24927ad-21c8-46db-993e-e0ee9f3626de tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:48.686353 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b24927ad-21c8-46db-993e-e0ee9f3626de tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1527 microversion: 2.1 time: 1.060074 Aug 25 12:54:48.687763 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1072/2162] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:47 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1527 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:48.709571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87b92f0b-b2ce-4a0f-8e57-f88912d56f4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '.version_select at 0x7f3a2e88a820>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:49.159416 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-471d814e-6545-43b9-b3a3-24de77825d87 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/50c4123f-62ea-4d89-a5b5-90e0c11798ac" status: 202 len: 0 microversion: 2.1 time: 1.618815 Aug 25 12:54:49.163413 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1091/2163] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:54:47 2022] DELETE /compute/v2.1/os-security-groups/50c4123f-62ea-4d89-a5b5-90e0c11798ac => generated 0 bytes in 1631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:54:49.194407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9eaaa16-f754-416d-bcd9-66cded9f3e21 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:49.196662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b9eaaa16-f754-416d-bcd9-66cded9f3e21 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:49.225479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9eaaa16-f754-416d-bcd9-66cded9f3e21 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:49.227436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9eaaa16-f754-416d-bcd9-66cded9f3e21 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:49.228315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9eaaa16-f754-416d-bcd9-66cded9f3e21 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:49.230443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9eaaa16-f754-416d-bcd9-66cded9f3e21 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:49.231302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9eaaa16-f754-416d-bcd9-66cded9f3e21 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:49.232672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9eaaa16-f754-416d-bcd9-66cded9f3e21 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:49.892589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b9eaaa16-f754-416d-bcd9-66cded9f3e21 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:49.923998 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9eaaa16-f754-416d-bcd9-66cded9f3e21 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1517 microversion: 2.1 time: 0.758103 Aug 25 12:54:49.925068 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1092/2164] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:49 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1517 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:50.445787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93cc6ca2-2f4e-4aed-8b5a-67ade150b41b tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Calling method '.version_select at 0x7f3a29c1ce50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:50.696678 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-93cc6ca2-2f4e-4aed-8b5a-67ade150b41b tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/4d9b8e2759034516973f26b830d0eb7c" status: 200 len: 371 microversion: 2.1 time: 0.753433 Aug 25 12:54:50.697735 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1093/2165] 10.222.0.70 () {58 vars in 1242 bytes} [Thu Aug 25 12:54:49 2022] GET /compute/v2.1/os-quota-sets/4d9b8e2759034516973f26b830d0eb7c => generated 371 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:50.722629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-19c91edd-0524-4177-a8d4-d0c76ab9d054 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a29c28af0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:51.010326 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-19c91edd-0524-4177-a8d4-d0c76ab9d054 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/e663ec31-74c3-43d5-a24b-3963d39e27c5" status: 200 len: 247 microversion: 2.1 time: 0.307879 Aug 25 12:54:51.011352 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1094/2166] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:54:50 2022] GET /compute/v2.1/os-security-groups/e663ec31-74c3-43d5-a24b-3963d39e27c5 => generated 247 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:51.039481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:51.044620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:51.075801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:51.077410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:51.078370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:51.079733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:51.080611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:51.081429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:51.190720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:51.192197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:51.193567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:51.195355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lazy-loading 'fault' on Instance uuid 8c977ed6-c046-4cf6-b62e-adde43a91022 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:54:51.343451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab7808c55142d494e662334ae372fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530a60986043b1bd4f3febaee1c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:51.375089 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-60ac6d06-e71e-407f-8f25-ae14f403299f tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 200 len: 1314 microversion: 2.1 time: 0.358330 Aug 25 12:54:51.376217 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1095/2167] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:51 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:51.393954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-40a8df9b-7bc3-4659-9fc6-e6a67cf9cf84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:51.403866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-40a8df9b-7bc3-4659-9fc6-e6a67cf9cf84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:51.423193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40a8df9b-7bc3-4659-9fc6-e6a67cf9cf84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:51.424530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40a8df9b-7bc3-4659-9fc6-e6a67cf9cf84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:51.425323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40a8df9b-7bc3-4659-9fc6-e6a67cf9cf84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:51.438017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40a8df9b-7bc3-4659-9fc6-e6a67cf9cf84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:51.440936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40a8df9b-7bc3-4659-9fc6-e6a67cf9cf84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:51.442486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40a8df9b-7bc3-4659-9fc6-e6a67cf9cf84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:51.544451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-40a8df9b-7bc3-4659-9fc6-e6a67cf9cf84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lazy-loading 'flavor' on Instance uuid 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:54:51.937887 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-40a8df9b-7bc3-4659-9fc6-e6a67cf9cf84 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "POST /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece/action" status: 200 len: 32 microversion: 2.1 time: 0.553563 Aug 25 12:54:51.975521 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1096/2168] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:54:51 2022] POST /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece/action => generated 32 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:54:52.018150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06c95ccf-fcba-47b1-984e-f5662957482a tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Action: 'update', calling method: .version_select at 0x7f3a29c1c1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:52.207216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06c95ccf-fcba-47b1-984e-f5662957482a tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:52.208124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06c95ccf-fcba-47b1-984e-f5662957482a tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:52.208891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06c95ccf-fcba-47b1-984e-f5662957482a tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:52.216041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06c95ccf-fcba-47b1-984e-f5662957482a tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:52.220375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06c95ccf-fcba-47b1-984e-f5662957482a tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:52.222312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06c95ccf-fcba-47b1-984e-f5662957482a tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:52.450169 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-06c95ccf-fcba-47b1-984e-f5662957482a tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/4d9b8e2759034516973f26b830d0eb7c" status: 200 len: 328 microversion: 2.1 time: 0.466783 Aug 25 12:54:52.459558 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1097/2169] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 12:54:51 2022] PUT /compute/v2.1/os-quota-sets/4d9b8e2759034516973f26b830d0eb7c => generated 328 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:52.475618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4c0e14b0-6621-41ab-9ace-e8a9e226efb9 req-4feb019e-f8d8-4ccc-b571-df4c87ebdfca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c977ed6-c046-4cf6-b62e-adde43a91022", "name": "network-vif-deleted", "tag": "61d6a3d1-4657-4b7b-b799-4f2fd85b0767"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:52.501311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4c0e14b0-6621-41ab-9ace-e8a9e226efb9 req-4feb019e-f8d8-4ccc-b571-df4c87ebdfca service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:52.503115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4c0e14b0-6621-41ab-9ace-e8a9e226efb9 req-4feb019e-f8d8-4ccc-b571-df4c87ebdfca service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:52.504259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4c0e14b0-6621-41ab-9ace-e8a9e226efb9 req-4feb019e-f8d8-4ccc-b571-df4c87ebdfca service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:52.536234 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4c0e14b0-6621-41ab-9ace-e8a9e226efb9 req-4feb019e-f8d8-4ccc-b571-df4c87ebdfca service nova] Creating event network-vif-deleted:61d6a3d1-4657-4b7b-b799-4f2fd85b0767 for instance 8c977ed6-c046-4cf6-b62e-adde43a91022 on n-h2-852771-8 Aug 25 12:54:52.551535 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4c0e14b0-6621-41ab-9ace-e8a9e226efb9 req-4feb019e-f8d8-4ccc-b571-df4c87ebdfca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085242 Aug 25 12:54:52.555144 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1098/2170] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:52.572388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f8f9157d-4877-4be8-9b37-101c83b1c446 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e7eb310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1240735055", "description": "tempest-description-1425721208"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:53.948893 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f8f9157d-4877-4be8-9b37-101c83b1c446 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.390238 Aug 25 12:54:53.950898 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1099/2171] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:54:52 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:53.984610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-31893a14-34ba-4b2a-ac89-a7cd9077064c tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:53.987167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-31893a14-34ba-4b2a-ac89-a7cd9077064c tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:54.002220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31893a14-34ba-4b2a-ac89-a7cd9077064c tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:54.002981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31893a14-34ba-4b2a-ac89-a7cd9077064c tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:54.003808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31893a14-34ba-4b2a-ac89-a7cd9077064c tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:54.005657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31893a14-34ba-4b2a-ac89-a7cd9077064c tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:54.006783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31893a14-34ba-4b2a-ac89-a7cd9077064c tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:54.007605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31893a14-34ba-4b2a-ac89-a7cd9077064c tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:54.657868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-31893a14-34ba-4b2a-ac89-a7cd9077064c tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:54.676842 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-31893a14-34ba-4b2a-ac89-a7cd9077064c tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 0.723979 Aug 25 12:54:54.678735 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1100/2172] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:53 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:54.688692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:54.690406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] [instance: 8c977ed6-c046-4cf6-b62e-adde43a91022] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:54.705410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:54.706988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:54.708094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:54.709877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:54.711191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:54.712321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:54.743873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:54.748404 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] HTTP exception thrown: Instance 8c977ed6-c046-4cf6-b62e-adde43a91022 could not be found. Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Request method failure captured: Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 HTTP/1.1 Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3DgA7_A4x5sDFAezHFzI6KlNWlLml8g1j_mdgN3VDWW1D5_n0MbD9mh9D1I-ZpasUHkuxXZFsALZlrbdLTKlBrnKvRw3bERnxUOIHqUX0qEL1jamBpgCUxYYCMrGWMm-qnrfy7nbVDLwGAsDrefWe-Cmyb-yiY6R9ALeW8Xno_hBEo Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: af530a60986043b1bd4f3febaee1c3af Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-64460891 Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af530a60986043b1bd4f3febaee1c3af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af530a60986043b1bd4f3febaee1c3af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af530a60986043b1bd4f3febaee1c3af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af530a60986043b1bd4f3febaee1c3af"}]}] Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-64460891 Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: af530a60986043b1bd4f3febaee1c3af Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-64460891 Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerAddressesNegativeTestJSON-64460891-project Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: f3ab7808c55142d494e662334ae372fe Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-64460891-project Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 8c977ed6-c046-4cf6-b62e-adde43a91022 could not be found. Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '8c977ed6-c046-4cf6-b62e-adde43a91022'} Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c977ed6-c046-4cf6-b62e-adde43a91022 could not be found. Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c977ed6-c046-4cf6-b62e-adde43a91022 could not be found. Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:54.754799 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:54.764894 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:54.764894 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:54.764894 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:54.764894 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:54.764894 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:54.764894 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:54.764894 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c977ed6-c046-4cf6-b62e-adde43a91022 could not be found. Aug 25 12:54:54.764894 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:54.769137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] Returning 404 to user: Instance 8c977ed6-c046-4cf6-b62e-adde43a91022 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:54.771282 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6fe0a1e-39f5-43d7-831f-7e99326fbd40 tempest-ServerAddressesNegativeTestJSON-64460891 tempest-ServerAddressesNegativeTestJSON-64460891-project] 10.222.0.70 "GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022" status: 404 len: 111 microversion: 2.1 time: 0.090392 Aug 25 12:54:54.772722 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1101/2173] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:54 2022] GET /compute/v2.1/servers/8c977ed6-c046-4cf6-b62e-adde43a91022 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:54:54.784238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c330984-4cff-4d84-a594-8d46433e60f7 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:54.828673 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c330984-4cff-4d84-a594-8d46433e60f7 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-quota-sets/4d9b8e2759034516973f26b830d0eb7c" status: 202 len: 0 microversion: 2.1 time: 0.052584 Aug 25 12:54:54.830506 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1102/2174] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 12:54:54 2022] DELETE /compute/v2.1/os-quota-sets/4d9b8e2759034516973f26b830d0eb7c => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:54:54.844315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-98073aee-ecf6-4690-8429-bee0023e0c6c tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a29c1c3a0>, body: {"security_group_rule": {"parent_group_id": "0f0ea387-4d65-4676-9c79-e3f1897dd004", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:55.275017 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-87b92f0b-b2ce-4a0f-8e57-f88912d56f4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Image not found. Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87b92f0b-b2ce-4a0f-8e57-f88912d56f4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/images/dfbec112-bb91-41a3-9700-56aac59fbbfc HTTP/1.1 Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'dfbec112-bb91-41a3-9700-56aac59fbbfc'} Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dfbec112-bb91-41a3-9700-56aac59fbbfc to delete Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dfbec112-bb91-41a3-9700-56aac59fbbfc could not be found. Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:55.280469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:54:55.289017 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.293455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87b92f0b-b2ce-4a0f-8e57-f88912d56f4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:55.295150 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87b92f0b-b2ce-4a0f-8e57-f88912d56f4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "DELETE /compute/v2.1/images/dfbec112-bb91-41a3-9700-56aac59fbbfc" status: 404 len: 62 microversion: 2.1 time: 6.601600 Aug 25 12:54:55.296387 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1073/2175] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:48 2022] DELETE /compute/v2.1/images/dfbec112-bb91-41a3-9700-56aac59fbbfc => generated 62 bytes in 6608 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:54:55.326312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b349cf9c-3569-4ef7-9542-79e6a26aac44 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Calling method '.version_select at 0x7f3a2e799700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:55.546023 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-98073aee-ecf6-4690-8429-bee0023e0c6c tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.713360 Aug 25 12:54:55.564502 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1103/2176] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:54:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:55.576723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:55.578170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:55.628889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:55.633005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:55.634305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:55.636984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:55.645776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:55.647486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:55.659334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b349cf9c-3569-4ef7-9542-79e6a26aac44 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/4d9b8e2759034516973f26b830d0eb7c" status: 200 len: 371 microversion: 2.1 time: 0.359056 Aug 25 12:54:55.660722 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1074/2177] 10.222.0.70 () {58 vars in 1242 bytes} [Thu Aug 25 12:54:55 2022] GET /compute/v2.1/os-quota-sets/4d9b8e2759034516973f26b830d0eb7c => generated 371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:55.687558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-75284784-1638-4ce7-a609-5ddd3439bfef tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Action: 'create', calling method: .version_select at 0x7f3a2e8a1700>, body: {"security_group_rule": {"parent_group_id": "0f0ea387-4d65-4676-9c79-e3f1897dd004", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:55.732721 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 HTTP/1.1 Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '8e3e1033-d155-4d7c-b071-316ccabc84e7'} Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:54:55.737357 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:54:55.744587 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.750029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 404 to user: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:55.752126 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-636e51a3-b7a2-441f-af4d-21d2e56bde4e tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 404 len: 111 microversion: 2.1 time: 0.190030 Aug 25 12:54:55.754779 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1104/2178] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:54:55 2022] DELETE /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:54:55.768525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d02e0da5-a606-4090-ab79-4370117bd774 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:55.770315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d02e0da5-a606-4090-ab79-4370117bd774 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:55.785446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d02e0da5-a606-4090-ab79-4370117bd774 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:55.787053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d02e0da5-a606-4090-ab79-4370117bd774 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:55.788900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d02e0da5-a606-4090-ab79-4370117bd774 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:55.790732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d02e0da5-a606-4090-ab79-4370117bd774 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:55.792528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d02e0da5-a606-4090-ab79-4370117bd774 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:55.793788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d02e0da5-a606-4090-ab79-4370117bd774 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:56.415535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d02e0da5-a606-4090-ab79-4370117bd774 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:56.445413 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d02e0da5-a606-4090-ab79-4370117bd774 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 0.685176 Aug 25 12:54:56.446559 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1105/2179] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:55 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:56.468568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:56.473089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 8e3e1033-d155-4d7c-b071-316ccabc84e7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:56.491507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:56.491833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:56.492283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:56.493132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:56.493805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:56.494206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:56.570067 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 HTTP/1.1 Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '8e3e1033-d155-4d7c-b071-316ccabc84e7'} Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:56.572134 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 404 to user: Instance 8e3e1033-d155-4d7c-b071-316ccabc84e7 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-717bf9d2-200a-493e-bad6-f742050ec72d tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7" status: 404 len: 111 microversion: 2.1 time: 0.123731 Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1106/2180] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:56 2022] GET /compute/v2.1/servers/8e3e1033-d155-4d7c-b071-316ccabc84e7 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:54:56.595168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-266a4338-53b3-4352-b6a4-a1e6ae59d990 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Calling method '.version_select at 0x7f3a2e6ed670>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:56.612181 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-75284784-1638-4ce7-a609-5ddd3439bfef tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.944049 Aug 25 12:54:56.630692 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1075/2181] 10.222.0.70 () {60 vars in 1195 bytes} [Thu Aug 25 12:54:55 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:56.639858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b9bcd4c3-541d-402d-b479-6ff4f8166d58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '.version_select at 0x7f3a2e799ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:56.683685 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b9bcd4c3-541d-402d-b479-6ff4f8166d58 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-15364557" status: 202 len: 0 microversion: 2.1 time: 0.049499 Aug 25 12:54:56.688739 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1076/2182] 10.222.0.70 () {58 vars in 1215 bytes} [Thu Aug 25 12:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-15364557 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:54:56.697320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-38470e08-5a07-45fd-acbb-5fcfba6cb006 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a2e7b41f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:56.950868 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-38470e08-5a07-45fd-acbb-5fcfba6cb006 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/0f0ea387-4d65-4676-9c79-e3f1897dd004" status: 200 len: 665 microversion: 2.1 time: 0.260427 Aug 25 12:54:56.961102 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1077/2183] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:54:56 2022] GET /compute/v2.1/os-security-groups/0f0ea387-4d65-4676-9c79-e3f1897dd004 => generated 665 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:56.967816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1299cb7-2702-4433-95c0-5b0c409c3744 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a2e7b3700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:56.969381 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-266a4338-53b3-4352-b6a4-a1e6ae59d990 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/7b641b763ff74ff889406e5babdaa2b9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.393048 Aug 25 12:54:56.971243 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1107/2184] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:54:56 2022] GET /compute/v2.1/os-quota-sets/7b641b763ff74ff889406e5babdaa2b9/defaults => generated 371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:57.502873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-630b44e3-f413-4a17-9310-528b38e70ea1 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:57.512272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-630b44e3-f413-4a17-9310-528b38e70ea1 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:57.571161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-630b44e3-f413-4a17-9310-528b38e70ea1 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:57.572932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-630b44e3-f413-4a17-9310-528b38e70ea1 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:57.575707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-630b44e3-f413-4a17-9310-528b38e70ea1 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:57.581773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-630b44e3-f413-4a17-9310-528b38e70ea1 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:57.585978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-630b44e3-f413-4a17-9310-528b38e70ea1 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:57.591302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-630b44e3-f413-4a17-9310-528b38e70ea1 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:57.940844 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c1299cb7-2702-4433-95c0-5b0c409c3744 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/c8e3962c-b10a-49f8-8599-952fc5f41745" status: 202 len: 0 microversion: 2.1 time: 0.978056 Aug 25 12:54:57.948937 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1078/2185] 10.222.0.70 () {58 vars in 1287 bytes} [Thu Aug 25 12:54:56 2022] DELETE /compute/v2.1/os-security-group-rules/c8e3962c-b10a-49f8-8599-952fc5f41745 => generated 0 bytes in 986 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:54:57.958713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fca5f679-ec3f-43eb-bd57-644ad73c45d0 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2e7b45e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:58.117200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-630b44e3-f413-4a17-9310-528b38e70ea1 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:58.138273 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-630b44e3-f413-4a17-9310-528b38e70ea1 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 0.666975 Aug 25 12:54:58.140140 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1108/2186] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:57 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:58.150464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6adbac89-ba3f-4251-b8f9-d8eab73332e6 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a2e73d280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:58.517983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fca5f679-ec3f-43eb-bd57-644ad73c45d0 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.521202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fca5f679-ec3f-43eb-bd57-644ad73c45d0 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.522268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fca5f679-ec3f-43eb-bd57-644ad73c45d0 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:58.526264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fca5f679-ec3f-43eb-bd57-644ad73c45d0 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.531602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fca5f679-ec3f-43eb-bd57-644ad73c45d0 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.532606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fca5f679-ec3f-43eb-bd57-644ad73c45d0 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:58.843180 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fca5f679-ec3f-43eb-bd57-644ad73c45d0 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/298974eb96ca4eae8a5ebb531b145326" status: 200 len: 328 microversion: 2.1 time: 0.892027 Aug 25 12:54:58.858206 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6adbac89-ba3f-4251-b8f9-d8eab73332e6 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/0f0ea387-4d65-4676-9c79-e3f1897dd004" status: 202 len: 0 microversion: 2.1 time: 0.715916 Aug 25 12:54:58.861284 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1079/2187] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 12:54:57 2022] PUT /compute/v2.1/os-quota-sets/298974eb96ca4eae8a5ebb531b145326 => generated 328 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:58.864506 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1109/2188] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:54:58 2022] DELETE /compute/v2.1/os-security-groups/0f0ea387-4d65-4676-9c79-e3f1897dd004 => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:54:58.879908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0e130d5-b167-4d05-9840-2170e14bf1dc tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Calling method '.version_select at 0x7f3a2e88a310>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:58.906676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b65da68-6ea3-4c0a-a898-fee7c2ced136 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a2e806f70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:59.039059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-6b65da68-6ea3-4c0a-a898-fee7c2ced136 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 50c4123f-62ea-4d89-a5b5-90e0c11798ac does not exist", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:54:59.040667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.security_group_api [None req-6b65da68-6ea3-4c0a-a898-fee7c2ced136 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Neutron security group 50c4123f-62ea-4d89-a5b5-90e0c11798ac not found {{(pid=129060) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:54:59.041666 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-6b65da68-6ea3-4c0a-a898-fee7c2ced136 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] HTTP exception thrown: Security group 50c4123f-62ea-4d89-a5b5-90e0c11798ac does not exist Aug 25 12:54:59.041666 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-c1b39026-47ba-47b5-991b-3c7b6f73fc13'] Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b65da68-6ea3-4c0a-a898-fee7c2ced136 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Request method failure captured: Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-security-groups/50c4123f-62ea-4d89-a5b5-90e0c11798ac HTTP/1.1 Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3EGpivrR8OAg8msKlZ1ZS-z9kwf9xbcErZUqwTPkPabAUSwHfoiRy80bbvs7Fez6ps6ntOj9491-pxct4vEq2XWI46E4KKfAligCK4InQ50N2Nd5r3ORaZfVOs9lG5EXBHzvomyyxuwxzx5_1vY3teOpsYOvst8psJxNsFKGWheDeg Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 99a84a1d7d554882a92c6156bdf24919 Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1485567692 Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/99a84a1d7d554882a92c6156bdf24919"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_99a84a1d7d554882a92c6156bdf24919", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/99a84a1d7d554882a92c6156bdf24919"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/99a84a1d7d554882a92c6156bdf24919"}]}] Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1485567692 Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 99a84a1d7d554882a92c6156bdf24919 Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1485567692 Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupRulesTestJSON-1485567692-project Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 85a3f9319902468eb0ec3bdefa976e8f Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1485567692-project Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: exception: Security group 50c4123f-62ea-4d89-a5b5-90e0c11798ac does not exist Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-c1b39026-47ba-47b5-991b-3c7b6f73fc13'] Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '50c4123f-62ea-4d89-a5b5-90e0c11798ac'} Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:54:59.046805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 50c4123f-62ea-4d89-a5b5-90e0c11798ac does not exist Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1b39026-47ba-47b5-991b-3c7b6f73fc13'] Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 50c4123f-62ea-4d89-a5b5-90e0c11798ac does not exist Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1b39026-47ba-47b5-991b-3c7b6f73fc13'] Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 50c4123f-62ea-4d89-a5b5-90e0c11798ac does not exist Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1b39026-47ba-47b5-991b-3c7b6f73fc13'] Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 50c4123f-62ea-4d89-a5b5-90e0c11798ac does not exist Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1b39026-47ba-47b5-991b-3c7b6f73fc13'] Aug 25 12:54:59.050650 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:54:59.054260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b65da68-6ea3-4c0a-a898-fee7c2ced136 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Returning 404 to user: Security group 50c4123f-62ea-4d89-a5b5-90e0c11798ac does not exist Aug 25 12:54:59.054260 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-c1b39026-47ba-47b5-991b-3c7b6f73fc13'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:59.056989 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b65da68-6ea3-4c0a-a898-fee7c2ced136 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/50c4123f-62ea-4d89-a5b5-90e0c11798ac" status: 404 len: 194 microversion: 2.1 time: 0.190127 Aug 25 12:54:59.067994 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1110/2189] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:54:58 2022] DELETE /compute/v2.1/os-security-groups/50c4123f-62ea-4d89-a5b5-90e0c11798ac => generated 194 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:54:59.085383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9d563f0-7277-4c34-bef8-7a1d5a53f984 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a2e7eb160>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:59.145584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e130d5-b167-4d05-9840-2170e14bf1dc tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:59.149780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e130d5-b167-4d05-9840-2170e14bf1dc tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:59.153086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e130d5-b167-4d05-9840-2170e14bf1dc tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:59.155801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e130d5-b167-4d05-9840-2170e14bf1dc tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:59.156653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e130d5-b167-4d05-9840-2170e14bf1dc tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:59.162041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e130d5-b167-4d05-9840-2170e14bf1dc tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:59.254481 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0e130d5-b167-4d05-9840-2170e14bf1dc tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/298974eb96ca4eae8a5ebb531b145326/detail" status: 200 len: 916 microversion: 2.1 time: 0.390982 Aug 25 12:54:59.269545 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1080/2190] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 12:54:58 2022] GET /compute/v2.1/os-quota-sets/298974eb96ca4eae8a5ebb531b145326/detail => generated 916 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:59.289687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-316df5d7-2602-44d1-b8c8-9f587210d70f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:59.291251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-316df5d7-2602-44d1-b8c8-9f587210d70f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:59.304944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-316df5d7-2602-44d1-b8c8-9f587210d70f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:59.306208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-316df5d7-2602-44d1-b8c8-9f587210d70f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:59.307125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-316df5d7-2602-44d1-b8c8-9f587210d70f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:59.309432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-316df5d7-2602-44d1-b8c8-9f587210d70f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:59.310697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-316df5d7-2602-44d1-b8c8-9f587210d70f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:59.311767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-316df5d7-2602-44d1-b8c8-9f587210d70f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:59.816462 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9d563f0-7277-4c34-bef8-7a1d5a53f984 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/e663ec31-74c3-43d5-a24b-3963d39e27c5" status: 202 len: 0 microversion: 2.1 time: 0.746421 Aug 25 12:54:59.817394 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1111/2191] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:54:59 2022] DELETE /compute/v2.1/os-security-groups/e663ec31-74c3-43d5-a24b-3963d39e27c5 => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:54:59.833264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2e6ed310>, body: {"quota_set": {"ram": "2048"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:00.059506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:00.061733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:00.068202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:00.070221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:00.071337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:00.071982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:00.237576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:00.240517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:00.243805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:00.249218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:00.250763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:00.251974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:00.446359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-316df5d7-2602-44d1-b8c8-9f587210d70f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:00.488500 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-316df5d7-2602-44d1-b8c8-9f587210d70f tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 1.211594 Aug 25 12:55:00.517441 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1081/2192] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:59 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:00.540761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7a07e909-e2d4-46bc-89e1-e78b9ac8bdf3 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a2e81bee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:00.572114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:00.584196 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ee4141d2-db84-4500-9016-0337fad73cb5 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/298974eb96ca4eae8a5ebb531b145326?user_id=89108f6eb9a046edbb18cf54a6338522" status: 200 len: 328 microversion: 2.1 time: 0.757720 Aug 25 12:55:00.588501 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1112/2193] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 12:54:59 2022] PUT /compute/v2.1/os-quota-sets/298974eb96ca4eae8a5ebb531b145326?user_id=89108f6eb9a046edbb18cf54a6338522 => generated 328 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:00.618898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9560ea5-6b44-4f18-9a54-511b8456cce9 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Calling method '.version_select at 0x7f3a2e75f4c0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:01.080783 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9560ea5-6b44-4f18-9a54-511b8456cce9 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/298974eb96ca4eae8a5ebb531b145326?user_id=89108f6eb9a046edbb18cf54a6338522" status: 200 len: 370 microversion: 2.1 time: 0.475952 Aug 25 12:55:01.084964 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1113/2194] 10.222.0.70 () {58 vars in 1323 bytes} [Thu Aug 25 12:55:00 2022] GET /compute/v2.1/os-quota-sets/298974eb96ca4eae8a5ebb531b145326?user_id=89108f6eb9a046edbb18cf54a6338522 => generated 370 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:55:01.568702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f14ee9f3-711e-4815-9a26-3361e90338d7 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:01.570474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f14ee9f3-711e-4815-9a26-3361e90338d7 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:01.617990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14ee9f3-711e-4815-9a26-3361e90338d7 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:01.617990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14ee9f3-711e-4815-9a26-3361e90338d7 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:01.631973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14ee9f3-711e-4815-9a26-3361e90338d7 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:01.634410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14ee9f3-711e-4815-9a26-3361e90338d7 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:01.636475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14ee9f3-711e-4815-9a26-3361e90338d7 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:01.637823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14ee9f3-711e-4815-9a26-3361e90338d7 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:01.937856 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7a07e909-e2d4-46bc-89e1-e78b9ac8bdf3 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/99dd4542-896b-46db-bea7-4d9961e148f6" status: 202 len: 0 microversion: 2.1 time: 1.412715 Aug 25 12:55:01.942120 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1082/2195] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:55:00 2022] DELETE /compute/v2.1/os-security-groups/99dd4542-896b-46db-bea7-4d9961e148f6 => generated 0 bytes in 1424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:55:01.989315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89256239-3c52-4ad5-828e-a6aeea4423f3 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a2e81b040>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:02.868495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f14ee9f3-711e-4815-9a26-3361e90338d7 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:02.939316 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f14ee9f3-711e-4815-9a26-3361e90338d7 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 1.382137 Aug 25 12:55:02.944285 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1114/2196] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:01 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:02.984206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d0d8d6f-63b0-40fa-a550-f3de6ebd3727 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Calling method '.version_select at 0x7f3a2e6ed1f0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:03.588299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89256239-3c52-4ad5-828e-a6aeea4423f3 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/3be7a6b5-4c03-44b0-9869-6eb2c3b36183" status: 202 len: 0 microversion: 2.1 time: 1.633949 Aug 25 12:55:03.598337 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1083/2197] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:55:01 2022] DELETE /compute/v2.1/os-security-groups/3be7a6b5-4c03-44b0-9869-6eb2c3b36183 => generated 0 bytes in 1645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:55:03.632881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-183ac4ca-4188-4ee5-9bfe-070bb1752611 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a2e7d6e50>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:03.852344 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d0d8d6f-63b0-40fa-a550-f3de6ebd3727 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/7b641b763ff74ff889406e5babdaa2b9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.901622 Aug 25 12:55:03.853350 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1115/2198] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:55:02 2022] GET /compute/v2.1/os-quota-sets/7b641b763ff74ff889406e5babdaa2b9/defaults => generated 371 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:03.887187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c255162-ab41-47fd-abc0-61fd4538d2f2 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2e806280>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:04.222331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c255162-ab41-47fd-abc0-61fd4538d2f2 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:04.230841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c255162-ab41-47fd-abc0-61fd4538d2f2 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:04.232511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c255162-ab41-47fd-abc0-61fd4538d2f2 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:04.240024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c255162-ab41-47fd-abc0-61fd4538d2f2 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:04.241583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c255162-ab41-47fd-abc0-61fd4538d2f2 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:04.242679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c255162-ab41-47fd-abc0-61fd4538d2f2 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:04.617409 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-183ac4ca-4188-4ee5-9bfe-070bb1752611 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/3f3fb03b-81bc-4df0-89f0-b3196058cd3d" status: 202 len: 0 microversion: 2.1 time: 1.010384 Aug 25 12:55:04.621172 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1084/2199] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:55:03 2022] DELETE /compute/v2.1/os-security-groups/3f3fb03b-81bc-4df0-89f0-b3196058cd3d => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:55:04.659652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-80a37593-3c18-4d66-9648-fa24622c1fe5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:04.671610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-80a37593-3c18-4d66-9648-fa24622c1fe5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:04.759726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a37593-3c18-4d66-9648-fa24622c1fe5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:04.761351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a37593-3c18-4d66-9648-fa24622c1fe5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:04.785642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a37593-3c18-4d66-9648-fa24622c1fe5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:04.794523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a37593-3c18-4d66-9648-fa24622c1fe5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:04.801577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a37593-3c18-4d66-9648-fa24622c1fe5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:04.805816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a37593-3c18-4d66-9648-fa24622c1fe5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:04.834589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:05.233894 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c255162-ab41-47fd-abc0-61fd4538d2f2 tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/7b641b763ff74ff889406e5babdaa2b9" status: 200 len: 329 microversion: 2.1 time: 1.357822 Aug 25 12:55:05.250752 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1116/2200] 10.222.0.70 () {60 vars in 1263 bytes} [Thu Aug 25 12:55:03 2022] PUT /compute/v2.1/os-quota-sets/7b641b763ff74ff889406e5babdaa2b9 => generated 329 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:05.276683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dd024a30-6d18-470e-8fc0-46e011ad5108 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] Calling method '.version_select at 0x7f3a2e6ed9d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:05.451614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-80a37593-3c18-4d66-9648-fa24622c1fe5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:05.486534 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-80a37593-3c18-4d66-9648-fa24622c1fe5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 0.861672 Aug 25 12:55:05.488403 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1085/2201] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:04 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:05.499518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-474bc68f-70da-4e91-be8e-f69b547dfd34 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '.version_select at 0x7f3a2e7d63a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:05.585976 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-474bc68f-70da-4e91-be8e-f69b547dfd34 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Image not found. Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-474bc68f-70da-4e91-be8e-f69b547dfd34 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/images/0cac324a-4153-416e-955c-99ab8d27006b HTTP/1.1 Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '0cac324a-4153-416e-955c-99ab8d27006b'} Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0cac324a-4153-416e-955c-99ab8d27006b to delete Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0cac324a-4153-416e-955c-99ab8d27006b could not be found. Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:05.590826 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-474bc68f-70da-4e91-be8e-f69b547dfd34 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-474bc68f-70da-4e91-be8e-f69b547dfd34 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "DELETE /compute/v2.1/images/0cac324a-4153-416e-955c-99ab8d27006b" status: 404 len: 62 microversion: 2.1 time: 0.102991 Aug 25 12:55:05.605285 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1086/2202] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:05 2022] DELETE /compute/v2.1/images/0cac324a-4153-416e-955c-99ab8d27006b => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:55:05.634858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e0a5074-d847-4249-9b18-dce7833205ae tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2e8e65e0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:05.938448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e0a5074-d847-4249-9b18-dce7833205ae tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:05.939334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e0a5074-d847-4249-9b18-dce7833205ae tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:05.940164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e0a5074-d847-4249-9b18-dce7833205ae tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:05.941721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e0a5074-d847-4249-9b18-dce7833205ae tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:05.942557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e0a5074-d847-4249-9b18-dce7833205ae tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:05.943383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e0a5074-d847-4249-9b18-dce7833205ae tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.230118 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dd024a30-6d18-470e-8fc0-46e011ad5108 tempest-SecurityGroupRulesTestJSON-1485567692 tempest-SecurityGroupRulesTestJSON-1485567692-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/4075463a-17a0-4c55-b0e4-e9a0fa88c8d5" status: 202 len: 0 microversion: 2.1 time: 0.976684 Aug 25 12:55:06.231758 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1117/2203] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:55:05 2022] DELETE /compute/v2.1/os-security-groups/4075463a-17a0-4c55-b0e4-e9a0fa88c8d5 => generated 0 bytes in 980 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:55:06.257847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:06.262597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:06.316381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.320165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.330350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.337837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.339421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.343934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.416978 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a HTTP/1.1 Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '9ce5cde8-dd95-4c6f-b05f-802b0d47696a'} Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:06.426045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 404 to user: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:06.436021 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8cd788c6-2dc1-4351-b1b6-37fb1819bc85 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 404 len: 111 microversion: 2.1 time: 0.195180 Aug 25 12:55:06.440655 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1118/2204] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:55:06 2022] DELETE /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:06.468097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:06.471501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] [instance: 9ce5cde8-dd95-4c6f-b05f-802b0d47696a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:06.497778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.498668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.499493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.508103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.512856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.514588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.602277 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] HTTP exception thrown: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Request method failure captured: Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a HTTP/1.1 Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3A5CVOcJ017snRHb4jBdBkPounDIq-J3lElaFDIOqZVxiN2Y1mfdUfzZbLeeqmbT2ikO1zv0bp68wN7VjMON99Ks9MCzqCeiAuZc1kljGnKks1els5cmeXerlz4f_1dWf6bg8yhz-AqZ988VgiaHsmuWM2sMnj1SIQjZwuyXKgzsRc Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d43be46fe4e84396b73fbdca834b3525", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d43be46fe4e84396b73fbdca834b3525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d43be46fe4e84396b73fbdca834b3525"}]}] Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d43be46fe4e84396b73fbdca834b3525 Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166 Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 74d9b7c3351f44b9b986e6535fc62819 Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1672760166-project Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '9ce5cde8-dd95-4c6f-b05f-802b0d47696a'} Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:06.614347 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:06.621752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:06.621752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:06.621752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:06.621752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:06.621752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:06.621752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:06.621752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. Aug 25 12:55:06.621752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:06.621752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] Returning 404 to user: Instance 9ce5cde8-dd95-4c6f-b05f-802b0d47696a could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:06.627044 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bfae1818-6808-4418-ac01-da3894304490 tempest-ImagesOneServerNegativeTestJSON-1672760166 tempest-ImagesOneServerNegativeTestJSON-1672760166-project] 10.222.0.70 "GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a" status: 404 len: 111 microversion: 2.1 time: 0.183687 Aug 25 12:55:06.628328 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1119/2205] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:06 2022] GET /compute/v2.1/servers/9ce5cde8-dd95-4c6f-b05f-802b0d47696a => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:06.640973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-80e3548c-f597-48b4-96c2-2a2373aa799b tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:06.667683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-80e3548c-f597-48b4-96c2-2a2373aa799b tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:06.717295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e3548c-f597-48b4-96c2-2a2373aa799b tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.720511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e3548c-f597-48b4-96c2-2a2373aa799b tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.725444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e3548c-f597-48b4-96c2-2a2373aa799b tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.730124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e3548c-f597-48b4-96c2-2a2373aa799b tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.731097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e3548c-f597-48b4-96c2-2a2373aa799b tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.733846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e3548c-f597-48b4-96c2-2a2373aa799b tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.856197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=10,nova_api:DELETE=1,nova_api:INSERT=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:07.319364 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5e0a5074-d847-4249-9b18-dce7833205ae tempest-QuotasAdminTestJSON-651867307 tempest-QuotasAdminTestJSON-651867307-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/7b641b763ff74ff889406e5babdaa2b9" status: 200 len: 329 microversion: 2.1 time: 1.704975 Aug 25 12:55:07.321713 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1087/2206] 10.222.0.70 () {60 vars in 1263 bytes} [Thu Aug 25 12:55:05 2022] PUT /compute/v2.1/os-quota-sets/7b641b763ff74ff889406e5babdaa2b9 => generated 329 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:07.429772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-80e3548c-f597-48b4-96c2-2a2373aa799b tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:07.466589 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-80e3548c-f597-48b4-96c2-2a2373aa799b tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 0.832649 Aug 25 12:55:07.473764 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1120/2207] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:06 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:08.534413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b41c9f4-0ad6-43a8-989d-c14ae759e46d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:08.536103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b41c9f4-0ad6-43a8-989d-c14ae759e46d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:08.589806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b41c9f4-0ad6-43a8-989d-c14ae759e46d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:08.591116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b41c9f4-0ad6-43a8-989d-c14ae759e46d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:08.594616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b41c9f4-0ad6-43a8-989d-c14ae759e46d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:08.600007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b41c9f4-0ad6-43a8-989d-c14ae759e46d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:08.603416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b41c9f4-0ad6-43a8-989d-c14ae759e46d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:08.605579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b41c9f4-0ad6-43a8-989d-c14ae759e46d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:09.327921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b41c9f4-0ad6-43a8-989d-c14ae759e46d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:09.344137 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b41c9f4-0ad6-43a8-989d-c14ae759e46d tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 0.823331 Aug 25 12:55:09.371672 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1088/2208] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:08 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:10.388617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-05dccdea-ba89-42ea-94fe-d4f5e31f5dc8 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:10.390173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-05dccdea-ba89-42ea-94fe-d4f5e31f5dc8 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:10.457805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05dccdea-ba89-42ea-94fe-d4f5e31f5dc8 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:10.458780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05dccdea-ba89-42ea-94fe-d4f5e31f5dc8 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:10.475388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05dccdea-ba89-42ea-94fe-d4f5e31f5dc8 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:10.484143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05dccdea-ba89-42ea-94fe-d4f5e31f5dc8 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:10.485170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05dccdea-ba89-42ea-94fe-d4f5e31f5dc8 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:10.487307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05dccdea-ba89-42ea-94fe-d4f5e31f5dc8 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:11.523163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-05dccdea-ba89-42ea-94fe-d4f5e31f5dc8 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:11.561240 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-05dccdea-ba89-42ea-94fe-d4f5e31f5dc8 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 1.179192 Aug 25 12:55:11.569391 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1121/2209] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:10 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:12.614556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d5ce453-6da6-4bf0-8d7a-f57c9ff29ed5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:12.616728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4d5ce453-6da6-4bf0-8d7a-f57c9ff29ed5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:12.674000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5ce453-6da6-4bf0-8d7a-f57c9ff29ed5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:12.675120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5ce453-6da6-4bf0-8d7a-f57c9ff29ed5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:12.675928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5ce453-6da6-4bf0-8d7a-f57c9ff29ed5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:12.677342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5ce453-6da6-4bf0-8d7a-f57c9ff29ed5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:12.678250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5ce453-6da6-4bf0-8d7a-f57c9ff29ed5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:12.679118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5ce453-6da6-4bf0-8d7a-f57c9ff29ed5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:13.860808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-734861579", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "8786102b-a15d-4894-b94c-776d2b47ed6a"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:14.048072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4d5ce453-6da6-4bf0-8d7a-f57c9ff29ed5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:14.074667 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4d5ce453-6da6-4bf0-8d7a-f57c9ff29ed5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 1.468462 Aug 25 12:55:14.159820 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1089/2210] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:12 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:14.297457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] validate_networks() for [('8786102b-a15d-4894-b94c-776d2b47ed6a', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:55:14.321789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=9 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:15.191511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=60 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:15.205565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a085ac0f-4577-44c8-8413-93132a266551 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:15.206907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a085ac0f-4577-44c8-8413-93132a266551 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:15.247217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a085ac0f-4577-44c8-8413-93132a266551 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:15.250123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a085ac0f-4577-44c8-8413-93132a266551 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:15.251075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a085ac0f-4577-44c8-8413-93132a266551 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:15.264707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a085ac0f-4577-44c8-8413-93132a266551 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:15.266315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a085ac0f-4577-44c8-8413-93132a266551 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:15.267421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a085ac0f-4577-44c8-8413-93132a266551 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:15.993765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:16.037483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a085ac0f-4577-44c8-8413-93132a266551 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:16.067653 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a085ac0f-4577-44c8-8413-93132a266551 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 0.875983 Aug 25 12:55:16.073765 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1090/2211] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:15 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:55:17.116326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ba92b79-b3b8-4ec2-ac39-df30d8aa0dec tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:17.117556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9ba92b79-b3b8-4ec2-ac39-df30d8aa0dec tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:17.178822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ba92b79-b3b8-4ec2-ac39-df30d8aa0dec tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:17.184011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ba92b79-b3b8-4ec2-ac39-df30d8aa0dec tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:17.186243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ba92b79-b3b8-4ec2-ac39-df30d8aa0dec tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:17.197167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ba92b79-b3b8-4ec2-ac39-df30d8aa0dec tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:17.200895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ba92b79-b3b8-4ec2-ac39-df30d8aa0dec tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:17.202693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ba92b79-b3b8-4ec2-ac39-df30d8aa0dec tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:17.450751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=46 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:18.674877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:55:18.677699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:55:18.679656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:55:18.681221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:55:18.685442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:55:18.750355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9ba92b79-b3b8-4ec2-ac39-df30d8aa0dec tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:18.794782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:18.800544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:18.807211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:18.819693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:18.821848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:18.823347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:18.830595 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9ba92b79-b3b8-4ec2-ac39-df30d8aa0dec tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 1.725408 Aug 25 12:55:18.836953 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1091/2212] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:17 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:55:18.930302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:55:18.966104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for user 2b81a6a01a24413b8212f140080ed018 and project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:55:19.051710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:55:19.065666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:55:19.296293 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8bba2bdc-ff7a-4dd2-bc7e-a011ab4bf6bf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.184268 Aug 25 12:55:19.299757 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1122/2213] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:55:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 6189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:55:19.335411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ceba7c2-ef22-4160-9ec6-26934195dcd5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:19.340930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5ceba7c2-ef22-4160-9ec6-26934195dcd5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:19.747752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5ceba7c2-ef22-4160-9ec6-26934195dcd5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:19.775793 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ceba7c2-ef22-4160-9ec6-26934195dcd5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1214 microversion: 2.1 time: 0.464238 Aug 25 12:55:19.778393 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1092/2214] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:19 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1214 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:55:19.912227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a96cef66-34d2-4a5c-935d-5a4c29045ff9 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:19.913920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a96cef66-34d2-4a5c-935d-5a4c29045ff9 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:19.969741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a96cef66-34d2-4a5c-935d-5a4c29045ff9 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:19.975878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a96cef66-34d2-4a5c-935d-5a4c29045ff9 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:19.976671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a96cef66-34d2-4a5c-935d-5a4c29045ff9 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:19.981758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a96cef66-34d2-4a5c-935d-5a4c29045ff9 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:19.985185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a96cef66-34d2-4a5c-935d-5a4c29045ff9 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:19.988403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a96cef66-34d2-4a5c-935d-5a4c29045ff9 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:20.087334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2006730561", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a8cc8d52-dd00-486a-beb8-ce1dce750174"}], "block_device_mapping_v2": [{"uuid": "25400210-77ca-4ab6-8411-24eccebf65eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:20.459655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] validate_networks() for [('a8cc8d52-dd00-486a-beb8-ce1dce750174', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:55:21.884902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a96cef66-34d2-4a5c-935d-5a4c29045ff9 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:21.939248 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a96cef66-34d2-4a5c-935d-5a4c29045ff9 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1523 microversion: 2.1 time: 2.060418 Aug 25 12:55:21.941346 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1123/2215] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:19 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1523 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:21.984712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b965d37d-2cd5-455c-8d1f-9da406cf0a0e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:21.988075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b965d37d-2cd5-455c-8d1f-9da406cf0a0e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:22.055528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b965d37d-2cd5-455c-8d1f-9da406cf0a0e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:22.056493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b965d37d-2cd5-455c-8d1f-9da406cf0a0e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:22.057172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b965d37d-2cd5-455c-8d1f-9da406cf0a0e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:22.086378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b965d37d-2cd5-455c-8d1f-9da406cf0a0e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:22.092121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b965d37d-2cd5-455c-8d1f-9da406cf0a0e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:22.096685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b965d37d-2cd5-455c-8d1f-9da406cf0a0e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:22.896025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b965d37d-2cd5-455c-8d1f-9da406cf0a0e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:22.925373 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b965d37d-2cd5-455c-8d1f-9da406cf0a0e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1218 microversion: 2.1 time: 0.981802 Aug 25 12:55:22.954189 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1124/2216] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:21 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1218 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:22.989682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1834570994", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b29f3072-ee4a-4589-9d60-9c89bd7fbbbc"}], "security_groups": [{"name": "tempest-securitygroup--130449130"}], "key_name": "tempest-keypair-1335077997", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "a2c86050-9bfa-49e2-8f30-844f0a6ee318", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:23.744025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:55:23.744996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:55:23.747319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:55:23.748151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:55:23.748982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:55:23.826889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:23.827127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] validate_networks() for [('b29f3072-ee4a-4589-9d60-9c89bd7fbbbc', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:55:23.833289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:23.836489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:23.841029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:23.841676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:23.844559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:23.952668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Getting quotas for project 5473d51e2cf040a3ae656d7e987feec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:55:23.978725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Getting quotas for user 81b5d1940fe64714bd9ba7d2009004fd and project 5473d51e2cf040a3ae656d7e987feec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:55:24.344666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:55:24.353734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25400210-77ca-4ab6-8411-24eccebf65eb',volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:55:25.059322 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-234258b5-1527-4a1f-b72f-c14d826a9cdf tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.988583 Aug 25 12:55:25.063480 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1093/2217] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:55:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:55:25.691913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Getting quotas for project bf46d29d4b5348719c7673598f94e4fd. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:55:25.709790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Getting quotas for user 1c33cd8c1f0a4ac3ae9ad0410abb8a5b and project bf46d29d4b5348719c7673598f94e4fd. Resources: dict_keys(['metadata_items']) {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:55:25.733124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:55:25.733925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:55:25.734996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:55:25.735569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:55:25.736329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:55:25.762845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:25.763708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:25.764493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:25.765945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:25.766909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:25.767656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:25.794020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=61 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:25.812226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Getting quotas for project bf46d29d4b5348719c7673598f94e4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:55:25.821545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Getting quotas for user 1c33cd8c1f0a4ac3ae9ad0410abb8a5b and project bf46d29d4b5348719c7673598f94e4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:55:25.868077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=17 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:25.938678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d5407473-20d0-4a42-ab6e-8415c35dc195 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:25.985834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5407473-20d0-4a42-ab6e-8415c35dc195 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:25.990004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5407473-20d0-4a42-ab6e-8415c35dc195 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:25.992251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5407473-20d0-4a42-ab6e-8415c35dc195 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:25.994243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5407473-20d0-4a42-ab6e-8415c35dc195 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:25.995870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5407473-20d0-4a42-ab6e-8415c35dc195 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:25.996682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5407473-20d0-4a42-ab6e-8415c35dc195 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:26.055631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:55:26.059643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2c86050-9bfa-49e2-8f30-844f0a6ee318',volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:55:26.076056 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d5407473-20d0-4a42-ab6e-8415c35dc195 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 1.004980 Aug 25 12:55:26.080597 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1094/2218] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:55:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:26.092446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-60e20992-6acf-4492-a3a8-ab2cfb857f62 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:26.094202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-60e20992-6acf-4492-a3a8-ab2cfb857f62 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:26.113930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60e20992-6acf-4492-a3a8-ab2cfb857f62 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:26.115317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60e20992-6acf-4492-a3a8-ab2cfb857f62 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:26.117207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60e20992-6acf-4492-a3a8-ab2cfb857f62 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:26.125326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60e20992-6acf-4492-a3a8-ab2cfb857f62 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:26.129156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60e20992-6acf-4492-a3a8-ab2cfb857f62 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:26.130977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60e20992-6acf-4492-a3a8-ab2cfb857f62 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:26.562655 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dc2c42ac-3c11-4ad6-b366-6aad91ddcb50 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.605646 Aug 25 12:55:26.565240 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1125/2219] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:55:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 3610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:55:26.576347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e356e01a-348d-4437-9358-e8d7a13b702f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:26.576618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60e20992-6acf-4492-a3a8-ab2cfb857f62 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:26.578960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e356e01a-348d-4437-9358-e8d7a13b702f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:26.598775 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-60e20992-6acf-4492-a3a8-ab2cfb857f62 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1503 microversion: 2.1 time: 0.515780 Aug 25 12:55:26.601562 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1095/2220] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:26 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1503 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:26.623009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a1eb7b5f-354a-4937-8542-875b99442368 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:26.625276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a1eb7b5f-354a-4937-8542-875b99442368 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:26.644096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e356e01a-348d-4437-9358-e8d7a13b702f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:26.645765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1eb7b5f-354a-4937-8542-875b99442368 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:26.648412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1eb7b5f-354a-4937-8542-875b99442368 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:26.649739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1eb7b5f-354a-4937-8542-875b99442368 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:26.650352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e356e01a-348d-4437-9358-e8d7a13b702f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:26.655287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1eb7b5f-354a-4937-8542-875b99442368 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:26.655544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e356e01a-348d-4437-9358-e8d7a13b702f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:26.658034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1eb7b5f-354a-4937-8542-875b99442368 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:26.659367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1eb7b5f-354a-4937-8542-875b99442368 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:26.665545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e356e01a-348d-4437-9358-e8d7a13b702f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:26.680512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e356e01a-348d-4437-9358-e8d7a13b702f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:26.699114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e356e01a-348d-4437-9358-e8d7a13b702f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.069768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1eb7b5f-354a-4937-8542-875b99442368 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:27.144009 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a1eb7b5f-354a-4937-8542-875b99442368 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1103 microversion: 2.1 time: 0.539934 Aug 25 12:55:27.165043 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1096/2221] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:26 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1103 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:27.203592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-475791a5-16f3-4b5a-a881-0562eaca7d36 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:27.213208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475791a5-16f3-4b5a-a881-0562eaca7d36 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.214528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475791a5-16f3-4b5a-a881-0562eaca7d36 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:27.215314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475791a5-16f3-4b5a-a881-0562eaca7d36 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.216781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475791a5-16f3-4b5a-a881-0562eaca7d36 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.217665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475791a5-16f3-4b5a-a881-0562eaca7d36 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:27.218799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475791a5-16f3-4b5a-a881-0562eaca7d36 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.259443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e356e01a-348d-4437-9358-e8d7a13b702f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:27.306618 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e356e01a-348d-4437-9358-e8d7a13b702f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1272 microversion: 2.1 time: 0.739166 Aug 25 12:55:27.321450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1126/2222] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:26 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1272 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:27.321745 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-475791a5-16f3-4b5a-a881-0562eaca7d36 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.138873 Aug 25 12:55:27.321745 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1097/2223] 10.222.0.70 () {58 vars in 1170 bytes} [Thu Aug 25 12:55:27 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:27.334553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-501f590b-4ab3-4911-8db4-47ad8cf11416 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:27.338242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-501f590b-4ab3-4911-8db4-47ad8cf11416 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:27.338642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a36fa461-32b0-420a-9dfd-d9bd4b3c3721 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Action: 'create', calling method: .version_select at 0x7f3a2e81baf0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-303231418", "description": "tempest-description-839925019"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:27.558805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-501f590b-4ab3-4911-8db4-47ad8cf11416 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:27.587658 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-501f590b-4ab3-4911-8db4-47ad8cf11416 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1122 microversion: 2.1 time: 0.277491 Aug 25 12:55:27.589726 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1127/2224] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:27 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1122 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:27.611279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-92982234-980e-4094-bb34-e269491bacf7 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:27.631406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92982234-980e-4094-bb34-e269491bacf7 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.633224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92982234-980e-4094-bb34-e269491bacf7 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:27.636986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92982234-980e-4094-bb34-e269491bacf7 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.640206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92982234-980e-4094-bb34-e269491bacf7 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.643156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92982234-980e-4094-bb34-e269491bacf7 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:27.644936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92982234-980e-4094-bb34-e269491bacf7 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.770296 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-92982234-980e-4094-bb34-e269491bacf7 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.173616 Aug 25 12:55:27.788407 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1128/2225] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:55:27 2022] GET /compute/v2.1/os-services => generated 944 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:27.799592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-89e8b584-5d5f-4063-bde0-c6a0b3b69f74 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:27.810535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89e8b584-5d5f-4063-bde0-c6a0b3b69f74 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.812019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89e8b584-5d5f-4063-bde0-c6a0b3b69f74 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:27.813214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89e8b584-5d5f-4063-bde0-c6a0b3b69f74 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.816554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89e8b584-5d5f-4063-bde0-c6a0b3b69f74 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.820116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89e8b584-5d5f-4063-bde0-c6a0b3b69f74 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:27.823654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89e8b584-5d5f-4063-bde0-c6a0b3b69f74 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.953315 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-89e8b584-5d5f-4063-bde0-c6a0b3b69f74 tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-852771-8&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.161438 Aug 25 12:55:27.970819 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1129/2226] 10.222.0.70 () {58 vars in 1194 bytes} [Thu Aug 25 12:55:27 2022] GET /compute/v2.1/os-services?host=n-d-852771-8&binary=xxx => generated 16 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:55:27.989587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8490c005-59f7-407b-971c-868a8bcad7bb tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:27.998254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8490c005-59f7-407b-971c-868a8bcad7bb tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.999653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8490c005-59f7-407b-971c-868a8bcad7bb tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.001119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8490c005-59f7-407b-971c-868a8bcad7bb tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:28.003118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8490c005-59f7-407b-971c-868a8bcad7bb tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:28.004348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8490c005-59f7-407b-971c-868a8bcad7bb tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.005427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8490c005-59f7-407b-971c-868a8bcad7bb tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:28.072586 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8490c005-59f7-407b-971c-868a8bcad7bb tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.099293 Aug 25 12:55:28.090796 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1130/2227] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:55:27 2022] GET /compute/v2.1/os-services => generated 944 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:28.105150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-614a233a-756f-4484-a129-7aae4612ffab tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:28.125244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-614a233a-756f-4484-a129-7aae4612ffab tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:28.126626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-614a233a-756f-4484-a129-7aae4612ffab tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.128378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-614a233a-756f-4484-a129-7aae4612ffab tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:28.130524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-614a233a-756f-4484-a129-7aae4612ffab tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:28.132650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-614a233a-756f-4484-a129-7aae4612ffab tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.133944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-614a233a-756f-4484-a129-7aae4612ffab tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:28.197057 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-614a233a-756f-4484-a129-7aae4612ffab tempest-ServicesAdminNegativeTestJSON-648251327 tempest-ServicesAdminNegativeTestJSON-648251327-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.101095 Aug 25 12:55:28.214891 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1131/2228] 10.222.0.70 () {58 vars in 1198 bytes} [Thu Aug 25 12:55:28 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 12:55:28.231277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d27031f-1fa8-4472-ba8e-a17ca933ead9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:28.234237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5d27031f-1fa8-4472-ba8e-a17ca933ead9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:28.254244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d27031f-1fa8-4472-ba8e-a17ca933ead9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:28.257977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d27031f-1fa8-4472-ba8e-a17ca933ead9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.260415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d27031f-1fa8-4472-ba8e-a17ca933ead9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:28.265664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d27031f-1fa8-4472-ba8e-a17ca933ead9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:28.267449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d27031f-1fa8-4472-ba8e-a17ca933ead9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.268984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d27031f-1fa8-4472-ba8e-a17ca933ead9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:29.511423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5d27031f-1fa8-4472-ba8e-a17ca933ead9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:29.553225 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5d27031f-1fa8-4472-ba8e-a17ca933ead9 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1159 microversion: 2.1 time: 1.335495 Aug 25 12:55:29.561184 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1132/2229] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:28 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1159 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:30.196121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5595b409-ac56-4040-95fe-2dcd0e402a62 tempest-ServicesAdminNegativeTestJSON-1245717384 tempest-ServicesAdminNegativeTestJSON-1245717384-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:30.203275 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a36fa461-32b0-420a-9dfd-d9bd4b3c3721 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 2.879651 Aug 25 12:55:30.210795 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1098/2230] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:55:27 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 2889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:30.223777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5595b409-ac56-4040-95fe-2dcd0e402a62 tempest-ServicesAdminNegativeTestJSON-1245717384 tempest-ServicesAdminNegativeTestJSON-1245717384-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e80f6b4cb7994e7ebf678d6b22d164cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70815bfcc5c14bb093bd865787189bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:30.235134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8538a61d-8334-4ebd-a682-dca83850f7a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:30.236312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8538a61d-8334-4ebd-a682-dca83850f7a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5595b409-ac56-4040-95fe-2dcd0e402a62 tempest-ServicesAdminNegativeTestJSON-1245717384 tempest-ServicesAdminNegativeTestJSON-1245717384-project] Request method failure captured: Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3E35DqT-6hiRPhRz4-5QIzZeT51V-JB7lCSdIRAdMOcrfLWJXLhLBTWdyzgjRgRN51aDl0aCt529qdIG1Rmgdjlmc7QdXTWGChYkgMcTtO6e8pjdOTag9SmCaiMpvVGnd5SWQ8mJm6lBo8TOejgLLtsOlAAYDKE4LsiNxz6t6UTvf4 Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 70815bfcc5c14bb093bd865787189bd6 Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1245717384 Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/70815bfcc5c14bb093bd865787189bd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_70815bfcc5c14bb093bd865787189bd6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/70815bfcc5c14bb093bd865787189bd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/70815bfcc5c14bb093bd865787189bd6"}]}] Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1245717384 Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 70815bfcc5c14bb093bd865787189bd6 Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1245717384 Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServicesAdminNegativeTestJSON-1245717384-project Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e80f6b4cb7994e7ebf678d6b22d164cf Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1245717384-project Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: action_args: {} Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:55:30.237121 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5595b409-ac56-4040-95fe-2dcd0e402a62 tempest-ServicesAdminNegativeTestJSON-1245717384 tempest-ServicesAdminNegativeTestJSON-1245717384-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5595b409-ac56-4040-95fe-2dcd0e402a62 tempest-ServicesAdminNegativeTestJSON-1245717384 tempest-ServicesAdminNegativeTestJSON-1245717384-project] 10.222.0.70 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.676752 Aug 25 12:55:30.257452 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1133/2231] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:55:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 679 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:30.266094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0ee6f4ce-1d78-4204-a71e-ca7ad421135a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:30.277719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0ee6f4ce-1d78-4204-a71e-ca7ad421135a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:30.304078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ce-1d78-4204-a71e-ca7ad421135a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:30.305018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ce-1d78-4204-a71e-ca7ad421135a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:30.308484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ce-1d78-4204-a71e-ca7ad421135a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:30.310071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ce-1d78-4204-a71e-ca7ad421135a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:30.310240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8538a61d-8334-4ebd-a682-dca83850f7a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:30.310741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ce-1d78-4204-a71e-ca7ad421135a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:30.310991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8538a61d-8334-4ebd-a682-dca83850f7a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:30.311661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ce-1d78-4204-a71e-ca7ad421135a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:30.311836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8538a61d-8334-4ebd-a682-dca83850f7a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:30.312985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8538a61d-8334-4ebd-a682-dca83850f7a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:30.330040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8538a61d-8334-4ebd-a682-dca83850f7a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:30.330957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8538a61d-8334-4ebd-a682-dca83850f7a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:30.772631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ee6f4ce-1d78-4204-a71e-ca7ad421135a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:30.855664 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0ee6f4ce-1d78-4204-a71e-ca7ad421135a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1238 microversion: 2.1 time: 0.607917 Aug 25 12:55:30.862134 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1134/2232] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:30 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1238 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:30.899401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d8438c2-60ac-4334-bafd-80d43e692e8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-303231418"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:30.915407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d8438c2-60ac-4334-bafd-80d43e692e8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:30.978718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d8438c2-60ac-4334-bafd-80d43e692e8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:30.981969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d8438c2-60ac-4334-bafd-80d43e692e8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:30.982824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d8438c2-60ac-4334-bafd-80d43e692e8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:30.984638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d8438c2-60ac-4334-bafd-80d43e692e8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:30.986798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d8438c2-60ac-4334-bafd-80d43e692e8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:30.987717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d8438c2-60ac-4334-bafd-80d43e692e8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.668810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8538a61d-8334-4ebd-a682-dca83850f7a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:31.700605 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8538a61d-8334-4ebd-a682-dca83850f7a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1314 microversion: 2.1 time: 1.483502 Aug 25 12:55:31.713803 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1099/2233] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:30 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1314 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:31.752367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f74fa376-13d0-43c1-8c6c-cbb12bda7448 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:31.753968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f74fa376-13d0-43c1-8c6c-cbb12bda7448 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:31.772653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f74fa376-13d0-43c1-8c6c-cbb12bda7448 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.777107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f74fa376-13d0-43c1-8c6c-cbb12bda7448 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.778051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f74fa376-13d0-43c1-8c6c-cbb12bda7448 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.779453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f74fa376-13d0-43c1-8c6c-cbb12bda7448 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.780336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f74fa376-13d0-43c1-8c6c-cbb12bda7448 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.781126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f74fa376-13d0-43c1-8c6c-cbb12bda7448 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:32.286175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f74fa376-13d0-43c1-8c6c-cbb12bda7448 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:32.341348 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f74fa376-13d0-43c1-8c6c-cbb12bda7448 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1169 microversion: 2.1 time: 0.597614 Aug 25 12:55:32.346556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1100/2234] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:31 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1169 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:32.391943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ce6c09e-f1ec-422a-a787-d0400bbd5a19 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:32.395902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5ce6c09e-f1ec-422a-a787-d0400bbd5a19 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:32.426997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ce6c09e-f1ec-422a-a787-d0400bbd5a19 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:32.427966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ce6c09e-f1ec-422a-a787-d0400bbd5a19 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:32.428857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ce6c09e-f1ec-422a-a787-d0400bbd5a19 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:32.430338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ce6c09e-f1ec-422a-a787-d0400bbd5a19 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:32.431272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ce6c09e-f1ec-422a-a787-d0400bbd5a19 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:32.432222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ce6c09e-f1ec-422a-a787-d0400bbd5a19 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:32.569116 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.network.security_group_api [None req-8d8438c2-60ac-4334-bafd-80d43e692e8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Adding security group 397e3991-2e3c-40bb-9e10-4cfcb01c99a9 to port f768abed-af60-4ed6-a009-839ff2fd5389 Aug 25 12:55:32.806514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5ce6c09e-f1ec-422a-a787-d0400bbd5a19 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:32.838279 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ce6c09e-f1ec-422a-a787-d0400bbd5a19 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1238 microversion: 2.1 time: 0.474938 Aug 25 12:55:32.841817 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1101/2235] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:32 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1238 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:32.853432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c00a7b79-6db0-4ec1-b568-70fe0719dc4c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:32.857948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c00a7b79-6db0-4ec1-b568-70fe0719dc4c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:32.874624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c00a7b79-6db0-4ec1-b568-70fe0719dc4c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:32.876357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c00a7b79-6db0-4ec1-b568-70fe0719dc4c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:32.877966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c00a7b79-6db0-4ec1-b568-70fe0719dc4c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:32.881869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c00a7b79-6db0-4ec1-b568-70fe0719dc4c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:32.890971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c00a7b79-6db0-4ec1-b568-70fe0719dc4c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:32.893346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c00a7b79-6db0-4ec1-b568-70fe0719dc4c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:33.796611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c00a7b79-6db0-4ec1-b568-70fe0719dc4c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:33.816479 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c00a7b79-6db0-4ec1-b568-70fe0719dc4c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1314 microversion: 2.1 time: 0.971055 Aug 25 12:55:33.817855 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1102/2236] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:32 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:33.831235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5463f103-f370-4f3f-99e3-df2ca5378e55 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:33.832911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5463f103-f370-4f3f-99e3-df2ca5378e55 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:33.852205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5463f103-f370-4f3f-99e3-df2ca5378e55 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:33.853734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5463f103-f370-4f3f-99e3-df2ca5378e55 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:33.854960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5463f103-f370-4f3f-99e3-df2ca5378e55 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:33.857725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5463f103-f370-4f3f-99e3-df2ca5378e55 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:33.859067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5463f103-f370-4f3f-99e3-df2ca5378e55 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:33.860193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5463f103-f370-4f3f-99e3-df2ca5378e55 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:34.029386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:34.724367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5463f103-f370-4f3f-99e3-df2ca5378e55 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:34.760583 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5463f103-f370-4f3f-99e3-df2ca5378e55 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1211 microversion: 2.1 time: 0.940119 Aug 25 12:55:34.780794 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1103/2237] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:33 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1211 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:34.815372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-37dafce3-59ba-4ce7-ac39-99eb438c84b9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:34.825122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-37dafce3-59ba-4ce7-ac39-99eb438c84b9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:34.871380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37dafce3-59ba-4ce7-ac39-99eb438c84b9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:34.873418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37dafce3-59ba-4ce7-ac39-99eb438c84b9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:34.875271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37dafce3-59ba-4ce7-ac39-99eb438c84b9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:34.877009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37dafce3-59ba-4ce7-ac39-99eb438c84b9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:34.878814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37dafce3-59ba-4ce7-ac39-99eb438c84b9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:34.879917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37dafce3-59ba-4ce7-ac39-99eb438c84b9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:35.192742 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d8438c2-60ac-4334-bafd-80d43e692e8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "POST /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece/action" status: 202 len: 0 microversion: 2.1 time: 4.328714 Aug 25 12:55:35.196194 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1135/2238] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:55:30 2022] POST /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece/action => generated 0 bytes in 4333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:55:35.221662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bec92e74-e782-4451-be8a-40d424e2cc99 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:35.227503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bec92e74-e782-4451-be8a-40d424e2cc99 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:35.270433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bec92e74-e782-4451-be8a-40d424e2cc99 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:35.271392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bec92e74-e782-4451-be8a-40d424e2cc99 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:35.272217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bec92e74-e782-4451-be8a-40d424e2cc99 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:35.277829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bec92e74-e782-4451-be8a-40d424e2cc99 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:35.280958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bec92e74-e782-4451-be8a-40d424e2cc99 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:35.282069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bec92e74-e782-4451-be8a-40d424e2cc99 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:35.423254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37dafce3-59ba-4ce7-ac39-99eb438c84b9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:35.432535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=84 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:35.475994 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-37dafce3-59ba-4ce7-ac39-99eb438c84b9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1238 microversion: 2.1 time: 0.692848 Aug 25 12:55:35.484935 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1104/2239] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:34 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1238 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:35.511938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a3c1249c-2bf9-44c6-b075-bfa34d88e269 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-303231418"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:35.516728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a3c1249c-2bf9-44c6-b075-bfa34d88e269 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:35.569339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3c1249c-2bf9-44c6-b075-bfa34d88e269 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:35.570908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3c1249c-2bf9-44c6-b075-bfa34d88e269 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:35.572118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3c1249c-2bf9-44c6-b075-bfa34d88e269 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:35.575817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3c1249c-2bf9-44c6-b075-bfa34d88e269 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:35.577309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3c1249c-2bf9-44c6-b075-bfa34d88e269 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:35.579328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3c1249c-2bf9-44c6-b075-bfa34d88e269 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:36.034467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bec92e74-e782-4451-be8a-40d424e2cc99 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:36.077464 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bec92e74-e782-4451-be8a-40d424e2cc99 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1314 microversion: 2.1 time: 0.878955 Aug 25 12:55:36.093575 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1136/2240] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:35 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1314 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:36.768791 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.network.security_group_api [None req-a3c1249c-2bf9-44c6-b075-bfa34d88e269 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Removing security group 397e3991-2e3c-40bb-9e10-4cfcb01c99a9 from port f768abed-af60-4ed6-a009-839ff2fd5389 Aug 25 12:55:36.828913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-37fea8dc-c131-4cb5-af56-6d9e327506c6 req-2d9d20b1-92e3-4f6e-b31c-cd525be492f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece", "tag": "f768abed-af60-4ed6-a009-839ff2fd5389"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:36.876656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-37fea8dc-c131-4cb5-af56-6d9e327506c6 req-2d9d20b1-92e3-4f6e-b31c-cd525be492f7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:36.878008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-37fea8dc-c131-4cb5-af56-6d9e327506c6 req-2d9d20b1-92e3-4f6e-b31c-cd525be492f7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:36.878811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-37fea8dc-c131-4cb5-af56-6d9e327506c6 req-2d9d20b1-92e3-4f6e-b31c-cd525be492f7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:36.923899 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-37fea8dc-c131-4cb5-af56-6d9e327506c6 req-2d9d20b1-92e3-4f6e-b31c-cd525be492f7 service nova] Creating event network-changed:f768abed-af60-4ed6-a009-839ff2fd5389 for instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece on n-h2-852771-8 Aug 25 12:55:36.938691 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-37fea8dc-c131-4cb5-af56-6d9e327506c6 req-2d9d20b1-92e3-4f6e-b31c-cd525be492f7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.842742 Aug 25 12:55:36.940337 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1137/2241] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:36.975264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0101218d-890c-472b-a9da-314d90c634cd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:36.977051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0101218d-890c-472b-a9da-314d90c634cd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:36.997447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0101218d-890c-472b-a9da-314d90c634cd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:36.998089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0101218d-890c-472b-a9da-314d90c634cd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:36.998622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0101218d-890c-472b-a9da-314d90c634cd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:37.000440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0101218d-890c-472b-a9da-314d90c634cd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:37.001558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0101218d-890c-472b-a9da-314d90c634cd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:37.002608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0101218d-890c-472b-a9da-314d90c634cd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:37.255505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:37.570786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=18 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:38.151793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=12 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:39.217238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0101218d-890c-472b-a9da-314d90c634cd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:39.265090 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0101218d-890c-472b-a9da-314d90c634cd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1211 microversion: 2.1 time: 2.317629 Aug 25 12:55:39.273188 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1138/2242] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:36 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1211 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:39.315371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3daf04a-df1f-4200-8c4e-12c189f73e6c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:39.317137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c3daf04a-df1f-4200-8c4e-12c189f73e6c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:39.338988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3daf04a-df1f-4200-8c4e-12c189f73e6c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:39.339840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3daf04a-df1f-4200-8c4e-12c189f73e6c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:39.341245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3daf04a-df1f-4200-8c4e-12c189f73e6c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:39.343020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3daf04a-df1f-4200-8c4e-12c189f73e6c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:39.344191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3daf04a-df1f-4200-8c4e-12c189f73e6c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:39.345283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3daf04a-df1f-4200-8c4e-12c189f73e6c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:40.162976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c3daf04a-df1f-4200-8c4e-12c189f73e6c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:40.191860 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3daf04a-df1f-4200-8c4e-12c189f73e6c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1305 microversion: 2.1 time: 0.891918 Aug 25 12:55:40.193250 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1139/2243] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:39 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1305 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:40.208233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4686d892-2508-410f-94b0-8e757e1a4700 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:40.209334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4686d892-2508-410f-94b0-8e757e1a4700 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:40.237385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4686d892-2508-410f-94b0-8e757e1a4700 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:40.238402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4686d892-2508-410f-94b0-8e757e1a4700 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:40.238996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4686d892-2508-410f-94b0-8e757e1a4700 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:40.240261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4686d892-2508-410f-94b0-8e757e1a4700 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:40.241051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4686d892-2508-410f-94b0-8e757e1a4700 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:40.241811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4686d892-2508-410f-94b0-8e757e1a4700 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:40.286807 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a3c1249c-2bf9-44c6-b075-bfa34d88e269 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "POST /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece/action" status: 202 len: 0 microversion: 2.1 time: 4.799095 Aug 25 12:55:40.289453 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1105/2244] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:55:35 2022] POST /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece/action => generated 0 bytes in 4803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:55:40.321622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f15dc3dc-06d2-4b0f-a4a0-badab527b824 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Action: 'create', calling method: .version_select at 0x7f3a29f31c10>, body: {"pool": null} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:41.463941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4686d892-2508-410f-94b0-8e757e1a4700 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:41.507489 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4686d892-2508-410f-94b0-8e757e1a4700 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1314 microversion: 2.1 time: 1.307884 Aug 25 12:55:41.517015 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1140/2245] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:40 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1314 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:41.543059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-84cc75c3-95a2-4b77-8b9e-5d2f24d4337c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:41.544828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-84cc75c3-95a2-4b77-8b9e-5d2f24d4337c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:41.575119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84cc75c3-95a2-4b77-8b9e-5d2f24d4337c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.582311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84cc75c3-95a2-4b77-8b9e-5d2f24d4337c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.584827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84cc75c3-95a2-4b77-8b9e-5d2f24d4337c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.603170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84cc75c3-95a2-4b77-8b9e-5d2f24d4337c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.612510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84cc75c3-95a2-4b77-8b9e-5d2f24d4337c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.614929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84cc75c3-95a2-4b77-8b9e-5d2f24d4337c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.689867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-84cc75c3-95a2-4b77-8b9e-5d2f24d4337c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:42.727988 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-84cc75c3-95a2-4b77-8b9e-5d2f24d4337c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1211 microversion: 2.1 time: 1.208603 Aug 25 12:55:42.729110 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1141/2246] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:41 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1211 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:42.757585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1fb25e53-103a-4151-a062-4735adfe8fd0 req-062355d9-e6c2-4114-9b2c-7f999e854ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece", "tag": "f768abed-af60-4ed6-a009-839ff2fd5389"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:42.798255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1fb25e53-103a-4151-a062-4735adfe8fd0 req-062355d9-e6c2-4114-9b2c-7f999e854ce7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.799177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1fb25e53-103a-4151-a062-4735adfe8fd0 req-062355d9-e6c2-4114-9b2c-7f999e854ce7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.799996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1fb25e53-103a-4151-a062-4735adfe8fd0 req-062355d9-e6c2-4114-9b2c-7f999e854ce7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.860427 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1fb25e53-103a-4151-a062-4735adfe8fd0 req-062355d9-e6c2-4114-9b2c-7f999e854ce7 service nova] Creating event network-changed:f768abed-af60-4ed6-a009-839ff2fd5389 for instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece on n-h2-852771-8 Aug 25 12:55:42.889950 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1fb25e53-103a-4151-a062-4735adfe8fd0 req-062355d9-e6c2-4114-9b2c-7f999e854ce7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148227 Aug 25 12:55:42.891426 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1142/2247] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:43.505158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-060cf662-4485-4616-885f-7fd82aa882ec req-f95c2bf7-1418-4da7-af38-37027559d16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04521122-af66-4daa-bdba-20b76aefde0f", "tag": "a985794d-88ba-4e9b-a707-3576ee70146f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:43.548031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-060cf662-4485-4616-885f-7fd82aa882ec req-f95c2bf7-1418-4da7-af38-37027559d16e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:43.549435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-060cf662-4485-4616-885f-7fd82aa882ec req-f95c2bf7-1418-4da7-af38-37027559d16e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:43.550639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-060cf662-4485-4616-885f-7fd82aa882ec req-f95c2bf7-1418-4da7-af38-37027559d16e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:43.575904 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-060cf662-4485-4616-885f-7fd82aa882ec req-f95c2bf7-1418-4da7-af38-37027559d16e service nova] Creating event network-changed:a985794d-88ba-4e9b-a707-3576ee70146f for instance 04521122-af66-4daa-bdba-20b76aefde0f on n-h1-852771-8 Aug 25 12:55:43.586092 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-060cf662-4485-4616-885f-7fd82aa882ec req-f95c2bf7-1418-4da7-af38-37027559d16e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.688970 Aug 25 12:55:43.587985 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1143/2248] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:43.598580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0810a41f-0231-4b43-9db4-b2cb9145f9f9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:43.600886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0810a41f-0231-4b43-9db4-b2cb9145f9f9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:43.614284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0810a41f-0231-4b43-9db4-b2cb9145f9f9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:43.615628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0810a41f-0231-4b43-9db4-b2cb9145f9f9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:43.616707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0810a41f-0231-4b43-9db4-b2cb9145f9f9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:43.618493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0810a41f-0231-4b43-9db4-b2cb9145f9f9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:43.620455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0810a41f-0231-4b43-9db4-b2cb9145f9f9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:43.621980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0810a41f-0231-4b43-9db4-b2cb9145f9f9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:44.594020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0810a41f-0231-4b43-9db4-b2cb9145f9f9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:44.633649 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0810a41f-0231-4b43-9db4-b2cb9145f9f9 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1305 microversion: 2.1 time: 1.042828 Aug 25 12:55:44.647351 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1144/2249] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:43 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1305 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:44.656913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06069d71-e201-4048-a802-9885b345ff16 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:44.665588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-06069d71-e201-4048-a802-9885b345ff16 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:44.691847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06069d71-e201-4048-a802-9885b345ff16 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:44.693182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06069d71-e201-4048-a802-9885b345ff16 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:44.694304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06069d71-e201-4048-a802-9885b345ff16 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:44.696002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06069d71-e201-4048-a802-9885b345ff16 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:44.697150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06069d71-e201-4048-a802-9885b345ff16 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:44.700600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06069d71-e201-4048-a802-9885b345ff16 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:45.566663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=64,nova_api:UPDATE=5 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:45.691419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=5 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:46.952730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-06069d71-e201-4048-a802-9885b345ff16 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:46.986619 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-06069d71-e201-4048-a802-9885b345ff16 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1314 microversion: 2.1 time: 2.336643 Aug 25 12:55:46.995322 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1145/2250] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:44 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1314 bytes in 2346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:47.016422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cedd4262-a792-466d-a9ae-4e5e4891938a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:47.018235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cedd4262-a792-466d-a9ae-4e5e4891938a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:47.043705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cedd4262-a792-466d-a9ae-4e5e4891938a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:47.045173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cedd4262-a792-466d-a9ae-4e5e4891938a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:47.046201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cedd4262-a792-466d-a9ae-4e5e4891938a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:47.047897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cedd4262-a792-466d-a9ae-4e5e4891938a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:47.049395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cedd4262-a792-466d-a9ae-4e5e4891938a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:47.051233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cedd4262-a792-466d-a9ae-4e5e4891938a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:48.227789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cedd4262-a792-466d-a9ae-4e5e4891938a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:48.264397 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cedd4262-a792-466d-a9ae-4e5e4891938a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1211 microversion: 2.1 time: 1.266843 Aug 25 12:55:48.266383 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1146/2251] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:46 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1211 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:48.295001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52610360-d17a-461d-94e2-60a498bdee61 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:48.299505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-52610360-d17a-461d-94e2-60a498bdee61 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:48.331886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52610360-d17a-461d-94e2-60a498bdee61 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:48.333249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52610360-d17a-461d-94e2-60a498bdee61 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:48.334366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52610360-d17a-461d-94e2-60a498bdee61 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:48.336053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52610360-d17a-461d-94e2-60a498bdee61 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:48.337201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52610360-d17a-461d-94e2-60a498bdee61 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:48.340549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52610360-d17a-461d-94e2-60a498bdee61 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.032625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-52610360-d17a-461d-94e2-60a498bdee61 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:49.090307 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-52610360-d17a-461d-94e2-60a498bdee61 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1305 microversion: 2.1 time: 0.804652 Aug 25 12:55:49.091469 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1147/2252] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:48 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1305 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:49.114559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-96966464-3685-4405-97dd-8553d053095c req-0153bc63-5790-486b-a5ae-768197699de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24695ae5-f061-4367-ba68-ba09b5e60cd8", "tag": "bf435e69-cad0-4f31-8880-d901851ff9cb"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:49.214857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-96966464-3685-4405-97dd-8553d053095c req-0153bc63-5790-486b-a5ae-768197699de0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.215770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-96966464-3685-4405-97dd-8553d053095c req-0153bc63-5790-486b-a5ae-768197699de0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.222866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-96966464-3685-4405-97dd-8553d053095c req-0153bc63-5790-486b-a5ae-768197699de0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.297672 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-96966464-3685-4405-97dd-8553d053095c req-0153bc63-5790-486b-a5ae-768197699de0 service nova] Creating event network-changed:bf435e69-cad0-4f31-8880-d901851ff9cb for instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 on n-h2-852771-8 Aug 25 12:55:49.320187 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-96966464-3685-4405-97dd-8553d053095c req-0153bc63-5790-486b-a5ae-768197699de0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222939 Aug 25 12:55:49.320187 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1148/2253] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:49.333990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-889281fe-8a01-4478-86f5-cab244a24b68 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:49.338396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-889281fe-8a01-4478-86f5-cab244a24b68 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:49.355896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889281fe-8a01-4478-86f5-cab244a24b68 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.358154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889281fe-8a01-4478-86f5-cab244a24b68 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.359839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889281fe-8a01-4478-86f5-cab244a24b68 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.362147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889281fe-8a01-4478-86f5-cab244a24b68 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.363546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889281fe-8a01-4478-86f5-cab244a24b68 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.366032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889281fe-8a01-4478-86f5-cab244a24b68 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.440423 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f15dc3dc-06d2-4b0f-a4a0-badab527b824 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.141358 Aug 25 12:55:49.441731 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1106/2254] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 12:55:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:49.467137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ea626439-9c2d-469a-a1f7-1a092ece1ed1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:49.469407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ea626439-9c2d-469a-a1f7-1a092ece1ed1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:49.512902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea626439-9c2d-469a-a1f7-1a092ece1ed1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.513843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea626439-9c2d-469a-a1f7-1a092ece1ed1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.522262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea626439-9c2d-469a-a1f7-1a092ece1ed1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.524096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea626439-9c2d-469a-a1f7-1a092ece1ed1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.530365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea626439-9c2d-469a-a1f7-1a092ece1ed1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.532169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea626439-9c2d-469a-a1f7-1a092ece1ed1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.237926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-889281fe-8a01-4478-86f5-cab244a24b68 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:50.269245 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-889281fe-8a01-4478-86f5-cab244a24b68 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1314 microversion: 2.1 time: 0.946185 Aug 25 12:55:50.270868 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1149/2255] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:49 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1314 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:50.284699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Action: 'action', calling method: .version_select at 0x7f3a2c2050d0>, body: {"addFloatingIp": {"address": "172.25.1.202"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:50.293352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:50.306645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ea626439-9c2d-469a-a1f7-1a092ece1ed1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:50.321862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.331757 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ea626439-9c2d-469a-a1f7-1a092ece1ed1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1211 microversion: 2.1 time: 0.888334 Aug 25 12:55:50.333077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.334014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.335463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.336786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.340144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.341040 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1107/2256] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:49 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1211 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:50.371196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f2cb0385-fe3e-41ff-b492-70226e5ce8b3 req-1e845d44-6a5c-4276-8394-c6efc15756fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04521122-af66-4daa-bdba-20b76aefde0f", "name": "network-vif-plugged", "status": "completed", "tag": "a985794d-88ba-4e9b-a707-3576ee70146f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:50.413056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f2cb0385-fe3e-41ff-b492-70226e5ce8b3 req-1e845d44-6a5c-4276-8394-c6efc15756fb service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.414335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f2cb0385-fe3e-41ff-b492-70226e5ce8b3 req-1e845d44-6a5c-4276-8394-c6efc15756fb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.415366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f2cb0385-fe3e-41ff-b492-70226e5ce8b3 req-1e845d44-6a5c-4276-8394-c6efc15756fb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.459660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:50.464474 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f2cb0385-fe3e-41ff-b492-70226e5ce8b3 req-1e845d44-6a5c-4276-8394-c6efc15756fb service nova] Creating event network-vif-plugged:a985794d-88ba-4e9b-a707-3576ee70146f for instance 04521122-af66-4daa-bdba-20b76aefde0f on n-h1-852771-8 Aug 25 12:55:50.475557 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f2cb0385-fe3e-41ff-b492-70226e5ce8b3 req-1e845d44-6a5c-4276-8394-c6efc15756fb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119782 Aug 25 12:55:50.477287 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1108/2257] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:50.492792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c1b075f-41aa-4976-9926-35398847ddb6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:50.495437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9c1b075f-41aa-4976-9926-35398847ddb6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:50.509211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c1b075f-41aa-4976-9926-35398847ddb6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.510702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c1b075f-41aa-4976-9926-35398847ddb6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.512462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c1b075f-41aa-4976-9926-35398847ddb6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.514332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c1b075f-41aa-4976-9926-35398847ddb6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.527230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c1b075f-41aa-4976-9926-35398847ddb6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.530850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c1b075f-41aa-4976-9926-35398847ddb6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.605298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "refresh_cache-6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:55:50.608883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquired lock "refresh_cache-6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:55:51.258681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9c1b075f-41aa-4976-9926-35398847ddb6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:51.287083 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c1b075f-41aa-4976-9926-35398847ddb6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1305 microversion: 2.1 time: 0.806240 Aug 25 12:55:51.300056 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1109/2258] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:50 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1305 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:51.335172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-31eb95d2-1727-4e16-a97e-760e7dee43f3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:51.337997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-31eb95d2-1727-4e16-a97e-760e7dee43f3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:51.364469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31eb95d2-1727-4e16-a97e-760e7dee43f3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:51.368718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31eb95d2-1727-4e16-a97e-760e7dee43f3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:51.372446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31eb95d2-1727-4e16-a97e-760e7dee43f3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:51.376977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31eb95d2-1727-4e16-a97e-760e7dee43f3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:51.384748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31eb95d2-1727-4e16-a97e-760e7dee43f3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:51.388617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31eb95d2-1727-4e16-a97e-760e7dee43f3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:53.030767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-31eb95d2-1727-4e16-a97e-760e7dee43f3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:53.065655 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-31eb95d2-1727-4e16-a97e-760e7dee43f3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1314 microversion: 2.1 time: 1.755004 Aug 25 12:55:53.082416 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1110/2259] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:51 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1314 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:53.121393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3fa2a33c-0333-458b-bfc0-51b3ba070609 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:53.131892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3fa2a33c-0333-458b-bfc0-51b3ba070609 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:53.158056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fa2a33c-0333-458b-bfc0-51b3ba070609 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:53.159017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fa2a33c-0333-458b-bfc0-51b3ba070609 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:53.159829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fa2a33c-0333-458b-bfc0-51b3ba070609 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:53.161203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fa2a33c-0333-458b-bfc0-51b3ba070609 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:53.172849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fa2a33c-0333-458b-bfc0-51b3ba070609 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:53.174112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fa2a33c-0333-458b-bfc0-51b3ba070609 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:54.520067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3fa2a33c-0333-458b-bfc0-51b3ba070609 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:54.548324 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3fa2a33c-0333-458b-bfc0-51b3ba070609 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1211 microversion: 2.1 time: 1.463315 Aug 25 12:55:54.570365 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1111/2260] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:53 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1211 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:54.595339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-60b827d1-fb84-4532-bc57-51faa6633c5b req-de01dcbe-1763-4c72-a23e-94a6d222e5bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48a5d0b-80f0-43cf-a5b4-50707002de75", "tag": "2e1d4e9f-8326-4a76-bf2f-01736ee09112"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:54.616535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-60b827d1-fb84-4532-bc57-51faa6633c5b req-de01dcbe-1763-4c72-a23e-94a6d222e5bb service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:54.618251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-60b827d1-fb84-4532-bc57-51faa6633c5b req-de01dcbe-1763-4c72-a23e-94a6d222e5bb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:54.620078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-60b827d1-fb84-4532-bc57-51faa6633c5b req-de01dcbe-1763-4c72-a23e-94a6d222e5bb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:54.649757 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-60b827d1-fb84-4532-bc57-51faa6633c5b req-de01dcbe-1763-4c72-a23e-94a6d222e5bb service nova] Creating event network-changed:2e1d4e9f-8326-4a76-bf2f-01736ee09112 for instance d48a5d0b-80f0-43cf-a5b4-50707002de75 on n-h2-852771-8 Aug 25 12:55:54.664399 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-60b827d1-fb84-4532-bc57-51faa6633c5b req-de01dcbe-1763-4c72-a23e-94a6d222e5bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078452 Aug 25 12:55:54.673428 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1112/2261] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:54.690463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7c450a5-d88d-4207-a0f9-b0aea6585610 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:54.693058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a7c450a5-d88d-4207-a0f9-b0aea6585610 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:54.709899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7c450a5-d88d-4207-a0f9-b0aea6585610 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:54.711520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7c450a5-d88d-4207-a0f9-b0aea6585610 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:54.713715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7c450a5-d88d-4207-a0f9-b0aea6585610 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:54.717379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7c450a5-d88d-4207-a0f9-b0aea6585610 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:54.719612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7c450a5-d88d-4207-a0f9-b0aea6585610 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:54.720433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7c450a5-d88d-4207-a0f9-b0aea6585610 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:56.123354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a7c450a5-d88d-4207-a0f9-b0aea6585610 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:56.165417 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a7c450a5-d88d-4207-a0f9-b0aea6585610 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1305 microversion: 2.1 time: 1.487227 Aug 25 12:55:56.167454 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1113/2262] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:54 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1305 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:56.200741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e3cad17-0644-493b-94d6-778c0d06a6fc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:56.201838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5e3cad17-0644-493b-94d6-778c0d06a6fc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:56.256185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e3cad17-0644-493b-94d6-778c0d06a6fc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:56.257175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e3cad17-0644-493b-94d6-778c0d06a6fc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:56.258046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e3cad17-0644-493b-94d6-778c0d06a6fc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:56.274601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e3cad17-0644-493b-94d6-778c0d06a6fc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:56.275642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e3cad17-0644-493b-94d6-778c0d06a6fc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:56.276596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e3cad17-0644-493b-94d6-778c0d06a6fc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:57.572011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Building network info cache for instance {{(pid=129060) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:55:59.310987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5e3cad17-0644-493b-94d6-778c0d06a6fc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:59.354755 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5e3cad17-0644-493b-94d6-778c0d06a6fc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1501 microversion: 2.1 time: 3.182738 Aug 25 12:55:59.359397 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1114/2263] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:56 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1501 bytes in 3191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:59.380964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-190efbdb-f46c-42cd-b1a6-eae46378bcda tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:59.382700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-190efbdb-f46c-42cd-b1a6-eae46378bcda tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:59.414477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-190efbdb-f46c-42cd-b1a6-eae46378bcda tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:59.416766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-190efbdb-f46c-42cd-b1a6-eae46378bcda tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:59.420507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-190efbdb-f46c-42cd-b1a6-eae46378bcda tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:59.426905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-190efbdb-f46c-42cd-b1a6-eae46378bcda tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:59.428267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-190efbdb-f46c-42cd-b1a6-eae46378bcda tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:59.429637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-190efbdb-f46c-42cd-b1a6-eae46378bcda tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:00.320262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:00.664818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-190efbdb-f46c-42cd-b1a6-eae46378bcda tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:00.716065 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-190efbdb-f46c-42cd-b1a6-eae46378bcda tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1199 microversion: 2.1 time: 1.354259 Aug 25 12:56:00.719142 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1115/2264] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:59 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1199 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:00.756645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e8c1953-8c3a-462a-be1d-2f6150009c28 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:00.766030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e8c1953-8c3a-462a-be1d-2f6150009c28 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:00.798450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e8c1953-8c3a-462a-be1d-2f6150009c28 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:00.799504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e8c1953-8c3a-462a-be1d-2f6150009c28 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:00.800602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e8c1953-8c3a-462a-be1d-2f6150009c28 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:00.807036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e8c1953-8c3a-462a-be1d-2f6150009c28 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:00.808479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e8c1953-8c3a-462a-be1d-2f6150009c28 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:00.812666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e8c1953-8c3a-462a-be1d-2f6150009c28 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:02.312270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e8c1953-8c3a-462a-be1d-2f6150009c28 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:02.342738 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e8c1953-8c3a-462a-be1d-2f6150009c28 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1293 microversion: 2.1 time: 1.600350 Aug 25 12:56:02.345941 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1116/2265] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:00 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1293 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:02.368876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6bb205ba-f3a9-4c7c-9858-b31b926c08fd req-a0607247-6af8-42c1-bb2e-5c885e8790b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece", "tag": "f768abed-af60-4ed6-a009-839ff2fd5389"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:02.397021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6bb205ba-f3a9-4c7c-9858-b31b926c08fd req-a0607247-6af8-42c1-bb2e-5c885e8790b4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:02.398827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6bb205ba-f3a9-4c7c-9858-b31b926c08fd req-a0607247-6af8-42c1-bb2e-5c885e8790b4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:02.399877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6bb205ba-f3a9-4c7c-9858-b31b926c08fd req-a0607247-6af8-42c1-bb2e-5c885e8790b4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:02.433920 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6bb205ba-f3a9-4c7c-9858-b31b926c08fd req-a0607247-6af8-42c1-bb2e-5c885e8790b4 service nova] Creating event network-changed:f768abed-af60-4ed6-a009-839ff2fd5389 for instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece on n-h2-852771-8 Aug 25 12:56:02.446753 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6bb205ba-f3a9-4c7c-9858-b31b926c08fd req-a0607247-6af8-42c1-bb2e-5c885e8790b4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098046 Aug 25 12:56:02.454201 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1117/2266] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:02.483408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-22f164fc-d5a7-4307-8959-cf1f2231d56b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:02.484785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-22f164fc-d5a7-4307-8959-cf1f2231d56b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:02.507379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22f164fc-d5a7-4307-8959-cf1f2231d56b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:02.508708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22f164fc-d5a7-4307-8959-cf1f2231d56b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:02.510177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22f164fc-d5a7-4307-8959-cf1f2231d56b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:02.513683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22f164fc-d5a7-4307-8959-cf1f2231d56b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:02.515466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22f164fc-d5a7-4307-8959-cf1f2231d56b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:02.516867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22f164fc-d5a7-4307-8959-cf1f2231d56b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:02.618461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-22f164fc-d5a7-4307-8959-cf1f2231d56b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:56:02.932898 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-22f164fc-d5a7-4307-8959-cf1f2231d56b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 204 len: 0 microversion: 2.1 time: 0.474247 Aug 25 12:56:02.934202 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1118/2267] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:56:02 2022] DELETE /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:56:02.969019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a65e3d18-c558-47ad-9d4b-a27d491a7d7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:02.971188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a65e3d18-c558-47ad-9d4b-a27d491a7d7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:03.007799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a65e3d18-c558-47ad-9d4b-a27d491a7d7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:03.012361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a65e3d18-c558-47ad-9d4b-a27d491a7d7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:03.013315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a65e3d18-c558-47ad-9d4b-a27d491a7d7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:03.014742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a65e3d18-c558-47ad-9d4b-a27d491a7d7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:03.015627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a65e3d18-c558-47ad-9d4b-a27d491a7d7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:03.016418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a65e3d18-c558-47ad-9d4b-a27d491a7d7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:04.086639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Updating instance_info_cache with network_info: [{"id": "f768abed-af60-4ed6-a009-839ff2fd5389", "address": "fa:16:3e:c6:4f:51", "network": {"id": "b4445a82-ca09-4ee6-a5a5-5c41aed12921", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-259751213-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3075ca68e13c46a092a2dc7981bbdc44", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf768abed-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129060) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:56:04.137023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Releasing lock "refresh_cache-6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:56:04.139205 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a1f9fc7-6b6d-4cfc-a730-050f077bb616 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "POST /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece/action" status: 202 len: 0 microversion: 2.1 time: 13.865844 Aug 25 12:56:04.140306 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1150/2268] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:55:50 2022] POST /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece/action => generated 0 bytes in 13869 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:56:04.204569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e972270-8632-456b-b55e-332ea993c7df tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:04.216270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e972270-8632-456b-b55e-332ea993c7df tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:04.262382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e972270-8632-456b-b55e-332ea993c7df tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:04.264246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e972270-8632-456b-b55e-332ea993c7df tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:04.265043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e972270-8632-456b-b55e-332ea993c7df tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:04.270290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e972270-8632-456b-b55e-332ea993c7df tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:04.277933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e972270-8632-456b-b55e-332ea993c7df tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:04.280044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e972270-8632-456b-b55e-332ea993c7df tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:04.457131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a65e3d18-c558-47ad-9d4b-a27d491a7d7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:04.491734 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a65e3d18-c558-47ad-9d4b-a27d491a7d7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1199 microversion: 2.1 time: 1.555024 Aug 25 12:56:04.504580 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1119/2269] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:02 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1199 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:04.521670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d3425894-3af4-489a-8ca4-d9fb59af8d5e tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:04.525681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d3425894-3af4-489a-8ca4-d9fb59af8d5e tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:04.550044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3425894-3af4-489a-8ca4-d9fb59af8d5e tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:04.551306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3425894-3af4-489a-8ca4-d9fb59af8d5e tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:04.553749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3425894-3af4-489a-8ca4-d9fb59af8d5e tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:04.555549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3425894-3af4-489a-8ca4-d9fb59af8d5e tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:04.557420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3425894-3af4-489a-8ca4-d9fb59af8d5e tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:04.559688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3425894-3af4-489a-8ca4-d9fb59af8d5e tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:07.167293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d3425894-3af4-489a-8ca4-d9fb59af8d5e tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:07.203209 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d3425894-3af4-489a-8ca4-d9fb59af8d5e tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1293 microversion: 2.1 time: 2.696332 Aug 25 12:56:07.207081 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1120/2270] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:04 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1293 bytes in 2702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:07.238347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Action: 'action', calling method: .version_select at 0x7f3a2c288c10>, body: {"removeFloatingIp": {"address": "172.25.1.202"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:07.939669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e972270-8632-456b-b55e-332ea993c7df tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:07.989841 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e972270-8632-456b-b55e-332ea993c7df tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 200 len: 1507 microversion: 2.1 time: 3.830966 Aug 25 12:56:07.990946 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1151/2271] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:04 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 1507 bytes in 3838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:08.011350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e5842f9-e53a-4edc-86a3-26166c3d35af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:08.016910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e5842f9-e53a-4edc-86a3-26166c3d35af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:08.044564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e5842f9-e53a-4edc-86a3-26166c3d35af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:08.059319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e5842f9-e53a-4edc-86a3-26166c3d35af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:08.060626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e5842f9-e53a-4edc-86a3-26166c3d35af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:08.062719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e5842f9-e53a-4edc-86a3-26166c3d35af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:08.064231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e5842f9-e53a-4edc-86a3-26166c3d35af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:08.065435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e5842f9-e53a-4edc-86a3-26166c3d35af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:10.238776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:10.257163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:10.258513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:10.263012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:10.264852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:10.268622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:10.269223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.099958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e5842f9-e53a-4edc-86a3-26166c3d35af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:11.130199 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e5842f9-e53a-4edc-86a3-26166c3d35af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1199 microversion: 2.1 time: 3.137149 Aug 25 12:56:11.131763 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1152/2272] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:07 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1199 bytes in 3140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:11.160004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2ea99d68-f7c8-4a09-bfb1-fafe93064dc8 req-ba009a0a-2688-4bc1-9e3c-d34ee5c43d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04521122-af66-4daa-bdba-20b76aefde0f", "name": "network-vif-deleted", "tag": "a985794d-88ba-4e9b-a707-3576ee70146f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:11.181230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2ea99d68-f7c8-4a09-bfb1-fafe93064dc8 req-ba009a0a-2688-4bc1-9e3c-d34ee5c43d9d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:11.182073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2ea99d68-f7c8-4a09-bfb1-fafe93064dc8 req-ba009a0a-2688-4bc1-9e3c-d34ee5c43d9d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:11.183366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2ea99d68-f7c8-4a09-bfb1-fafe93064dc8 req-ba009a0a-2688-4bc1-9e3c-d34ee5c43d9d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.207891 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2ea99d68-f7c8-4a09-bfb1-fafe93064dc8 req-ba009a0a-2688-4bc1-9e3c-d34ee5c43d9d service nova] Creating event network-vif-deleted:a985794d-88ba-4e9b-a707-3576ee70146f for instance 04521122-af66-4daa-bdba-20b76aefde0f on n-h1-852771-8 Aug 25 12:56:11.218677 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2ea99d68-f7c8-4a09-bfb1-fafe93064dc8 req-ba009a0a-2688-4bc1-9e3c-d34ee5c43d9d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065625 Aug 25 12:56:11.220372 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1153/2273] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:11.232757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-77e7c7f9-fb3a-4eba-997d-def32e7016ff tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:11.234252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-77e7c7f9-fb3a-4eba-997d-def32e7016ff tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:11.250218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77e7c7f9-fb3a-4eba-997d-def32e7016ff tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:11.251322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77e7c7f9-fb3a-4eba-997d-def32e7016ff tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:11.253124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77e7c7f9-fb3a-4eba-997d-def32e7016ff tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.253696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77e7c7f9-fb3a-4eba-997d-def32e7016ff tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:11.254531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77e7c7f9-fb3a-4eba-997d-def32e7016ff tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:11.255298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77e7c7f9-fb3a-4eba-997d-def32e7016ff tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:12.209342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "refresh_cache-6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:56:12.211252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquired lock "refresh_cache-6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:56:12.261867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77e7c7f9-fb3a-4eba-997d-def32e7016ff tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:12.303490 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-77e7c7f9-fb3a-4eba-997d-def32e7016ff tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1293 microversion: 2.1 time: 1.079693 Aug 25 12:56:12.304596 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1154/2274] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:11 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1293 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:12.330202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:12.331451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:12.361382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:12.362777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:12.364067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:12.365857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:12.366874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:12.368355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:12.398254 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f HTTP/1.1 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '04521122-af66-4daa-bdba-20b76aefde0f'} Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:12.402618 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:12.412696 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:12.412696 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:12.412696 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:12.412696 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:12.412696 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:12.412696 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 12:56:12.412696 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:12.412696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:12.412696 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-62825a26-b98c-4d83-84f2-b52608b489ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 404 len: 111 microversion: 2.1 time: 0.099140 Aug 25 12:56:12.412696 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1155/2275] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:12 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:12.417398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1be4ec21-f1ab-4afd-964e-b5802e4c2b98 req-65ba0b19-4c9d-41c5-bec7-0fefbae2f13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24695ae5-f061-4367-ba68-ba09b5e60cd8", "name": "network-vif-plugged", "status": "completed", "tag": "bf435e69-cad0-4f31-8880-d901851ff9cb"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:12.439796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1be4ec21-f1ab-4afd-964e-b5802e4c2b98 req-65ba0b19-4c9d-41c5-bec7-0fefbae2f13d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:12.440987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1be4ec21-f1ab-4afd-964e-b5802e4c2b98 req-65ba0b19-4c9d-41c5-bec7-0fefbae2f13d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:12.442047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1be4ec21-f1ab-4afd-964e-b5802e4c2b98 req-65ba0b19-4c9d-41c5-bec7-0fefbae2f13d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:12.467137 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1be4ec21-f1ab-4afd-964e-b5802e4c2b98 req-65ba0b19-4c9d-41c5-bec7-0fefbae2f13d service nova] Creating event network-vif-plugged:bf435e69-cad0-4f31-8880-d901851ff9cb for instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 on n-h2-852771-8 Aug 25 12:56:12.479016 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1be4ec21-f1ab-4afd-964e-b5802e4c2b98 req-65ba0b19-4c9d-41c5-bec7-0fefbae2f13d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068975 Aug 25 12:56:12.481060 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1156/2276] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:12.492495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0575f628-814b-41f5-9cff-a8b2c49af336 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:12.495021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0575f628-814b-41f5-9cff-a8b2c49af336 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:12.512158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0575f628-814b-41f5-9cff-a8b2c49af336 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:12.515071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0575f628-814b-41f5-9cff-a8b2c49af336 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:12.516282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0575f628-814b-41f5-9cff-a8b2c49af336 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:12.518328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0575f628-814b-41f5-9cff-a8b2c49af336 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:12.519684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0575f628-814b-41f5-9cff-a8b2c49af336 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:12.520976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0575f628-814b-41f5-9cff-a8b2c49af336 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:13.982289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0575f628-814b-41f5-9cff-a8b2c49af336 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:14.004095 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0575f628-814b-41f5-9cff-a8b2c49af336 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1199 microversion: 2.1 time: 1.520278 Aug 25 12:56:14.006081 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1157/2277] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:12 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1199 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:14.050252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1564998922", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "8786102b-a15d-4894-b94c-776d2b47ed6a"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:14.208147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] validate_networks() for [('8786102b-a15d-4894-b94c-776d2b47ed6a', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:56:17.801695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Building network info cache for instance {{(pid=129059) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:56:17.861991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:18.124755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:56:18.125783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:56:18.127206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:56:18.128319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:56:18.132652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:56:18.205075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:18.206975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:18.208683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:18.210617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:18.213671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:18.215033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:18.263083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:56:18.274112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for user 2b81a6a01a24413b8212f140080ed018 and project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:56:18.306390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:56:18.316192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:56:18.522463 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8dd4f527-8dbc-4023-b9e4-abdfb5e02013 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.494294 Aug 25 12:56:18.524601 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1158/2278] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:56:18.562809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cefff33f-35d4-4da1-89c0-1443e5e798c1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:18.570882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cefff33f-35d4-4da1-89c0-1443e5e798c1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:18.607547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cefff33f-35d4-4da1-89c0-1443e5e798c1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:18.612593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cefff33f-35d4-4da1-89c0-1443e5e798c1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:18.616589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cefff33f-35d4-4da1-89c0-1443e5e798c1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:18.620716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cefff33f-35d4-4da1-89c0-1443e5e798c1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:18.623705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cefff33f-35d4-4da1-89c0-1443e5e798c1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:18.627242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cefff33f-35d4-4da1-89c0-1443e5e798c1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:20.246049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:20.884379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cefff33f-35d4-4da1-89c0-1443e5e798c1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:20.899435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=44,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:20.955970 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cefff33f-35d4-4da1-89c0-1443e5e798c1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1293 microversion: 2.1 time: 2.426587 Aug 25 12:56:20.965845 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1159/2279] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:18 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1293 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:20.994738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b40844ee-461f-45e2-9db7-a685ee0913c4 req-462bb0c0-b3ac-4e0e-bf01-f165efe2d525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48a5d0b-80f0-43cf-a5b4-50707002de75", "name": "network-vif-plugged", "status": "completed", "tag": "2e1d4e9f-8326-4a76-bf2f-01736ee09112"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:21.102397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b40844ee-461f-45e2-9db7-a685ee0913c4 req-462bb0c0-b3ac-4e0e-bf01-f165efe2d525 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:21.106815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b40844ee-461f-45e2-9db7-a685ee0913c4 req-462bb0c0-b3ac-4e0e-bf01-f165efe2d525 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:21.107901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b40844ee-461f-45e2-9db7-a685ee0913c4 req-462bb0c0-b3ac-4e0e-bf01-f165efe2d525 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:21.199286 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b40844ee-461f-45e2-9db7-a685ee0913c4 req-462bb0c0-b3ac-4e0e-bf01-f165efe2d525 service nova] Creating event network-vif-plugged:2e1d4e9f-8326-4a76-bf2f-01736ee09112 for instance d48a5d0b-80f0-43cf-a5b4-50707002de75 on n-h2-852771-8 Aug 25 12:56:21.237802 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b40844ee-461f-45e2-9db7-a685ee0913c4 req-462bb0c0-b3ac-4e0e-bf01-f165efe2d525 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268009 Aug 25 12:56:21.250136 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1160/2280] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:21.304691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02793c30-0677-419d-866c-b4bac1c7038b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:21.307491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02793c30-0677-419d-866c-b4bac1c7038b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:21.337191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02793c30-0677-419d-866c-b4bac1c7038b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:21.340197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02793c30-0677-419d-866c-b4bac1c7038b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:21.345225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02793c30-0677-419d-866c-b4bac1c7038b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:21.347732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02793c30-0677-419d-866c-b4bac1c7038b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:21.354824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02793c30-0677-419d-866c-b4bac1c7038b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:21.356096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02793c30-0677-419d-866c-b4bac1c7038b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.266070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Updating instance_info_cache with network_info: [{"id": "f768abed-af60-4ed6-a009-839ff2fd5389", "address": "fa:16:3e:c6:4f:51", "network": {"id": "b4445a82-ca09-4ee6-a5a5-5c41aed12921", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-259751213-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3075ca68e13c46a092a2dc7981bbdc44", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf768abed-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129059) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:56:22.366638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Releasing lock "refresh_cache-6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:56:22.380603 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-69cdcb39-f95c-48f7-b7b3-b100be4520a5 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "POST /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece/action" status: 202 len: 0 microversion: 2.1 time: 15.161234 Aug 25 12:56:22.390442 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1121/2281] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:56:07 2022] POST /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece/action => generated 0 bytes in 15182 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:56:22.410641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7689db32-690d-4280-9134-cf11ea62e0b7 req-57768220-78e9-43b1-9774-cd32a203ae07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece", "tag": "f768abed-af60-4ed6-a009-839ff2fd5389"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:22.473827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7689db32-690d-4280-9134-cf11ea62e0b7 req-57768220-78e9-43b1-9774-cd32a203ae07 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.481809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7689db32-690d-4280-9134-cf11ea62e0b7 req-57768220-78e9-43b1-9774-cd32a203ae07 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.486881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7689db32-690d-4280-9134-cf11ea62e0b7 req-57768220-78e9-43b1-9774-cd32a203ae07 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.566286 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7689db32-690d-4280-9134-cf11ea62e0b7 req-57768220-78e9-43b1-9774-cd32a203ae07 service nova] Creating event network-changed:f768abed-af60-4ed6-a009-839ff2fd5389 for instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece on n-h2-852771-8 Aug 25 12:56:22.589197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02793c30-0677-419d-866c-b4bac1c7038b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:22.597103 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7689db32-690d-4280-9134-cf11ea62e0b7 req-57768220-78e9-43b1-9774-cd32a203ae07 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203204 Aug 25 12:56:22.604539 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1122/2282] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:22.629381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-076da90b-59c8-4398-94cc-e6b97f9abd51 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:22.637219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-076da90b-59c8-4398-94cc-e6b97f9abd51 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:22.643494 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02793c30-0677-419d-866c-b4bac1c7038b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1382 microversion: 2.1 time: 1.390522 Aug 25 12:56:22.644490 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1161/2283] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:21 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1382 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:22.668321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-076da90b-59c8-4398-94cc-e6b97f9abd51 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.675226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-076da90b-59c8-4398-94cc-e6b97f9abd51 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.680305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-076da90b-59c8-4398-94cc-e6b97f9abd51 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.684379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-076da90b-59c8-4398-94cc-e6b97f9abd51 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.687244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3a54eba2-e554-40ef-9300-991979c260a0 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:22.687526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-076da90b-59c8-4398-94cc-e6b97f9abd51 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.691696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3a54eba2-e554-40ef-9300-991979c260a0 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:22.692826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-076da90b-59c8-4398-94cc-e6b97f9abd51 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.727756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a54eba2-e554-40ef-9300-991979c260a0 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.728512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a54eba2-e554-40ef-9300-991979c260a0 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.729335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a54eba2-e554-40ef-9300-991979c260a0 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.730685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a54eba2-e554-40ef-9300-991979c260a0 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.749947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a54eba2-e554-40ef-9300-991979c260a0 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.751225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a54eba2-e554-40ef-9300-991979c260a0 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:23.182404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-076da90b-59c8-4398-94cc-e6b97f9abd51 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:23.217049 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-076da90b-59c8-4398-94cc-e6b97f9abd51 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1267 microversion: 2.1 time: 0.601687 Aug 25 12:56:23.218852 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1123/2284] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:22 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1267 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:23.239819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e74e7c12-6331-4bfb-b031-621af2ae6855 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '.version_select at 0x7f3a2a004f70>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:23.675481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3a54eba2-e554-40ef-9300-991979c260a0 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:23.728480 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3a54eba2-e554-40ef-9300-991979c260a0 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1293 microversion: 2.1 time: 1.062226 Aug 25 12:56:23.730880 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1162/2285] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:22 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1293 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:25.632612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-27b3965a-8e9f-4c6c-94dc-65b58c5f27bf tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: .version_select at 0x7f3a29c289d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1161276744", "description": "tempest-description-1774033857"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:26.833072 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-27b3965a-8e9f-4c6c-94dc-65b58c5f27bf tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 3.099086 Aug 25 12:56:26.834341 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1163/2286] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:56:23 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 3102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:26.844299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4fe127fd-94dc-447f-9687-c7e9e63189a0 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:26.859398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4fe127fd-94dc-447f-9687-c7e9e63189a0 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:26.894396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fe127fd-94dc-447f-9687-c7e9e63189a0 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:26.902799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fe127fd-94dc-447f-9687-c7e9e63189a0 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:26.904515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fe127fd-94dc-447f-9687-c7e9e63189a0 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:26.910083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fe127fd-94dc-447f-9687-c7e9e63189a0 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:26.910829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fe127fd-94dc-447f-9687-c7e9e63189a0 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:26.914985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fe127fd-94dc-447f-9687-c7e9e63189a0 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:27.439956 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4fe127fd-94dc-447f-9687-c7e9e63189a0 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1533 microversion: 2.1 time: 0.602272 Aug 25 12:56:27.442701 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1164/2287] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:26 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1533 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:27.475151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9cf38ab7-093a-4826-8645-f5cc5a4158de tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:27.481242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9cf38ab7-093a-4826-8645-f5cc5a4158de tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:27.531670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf38ab7-093a-4826-8645-f5cc5a4158de tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:27.540407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf38ab7-093a-4826-8645-f5cc5a4158de tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:27.543042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf38ab7-093a-4826-8645-f5cc5a4158de tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:27.546029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf38ab7-093a-4826-8645-f5cc5a4158de tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:27.550772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf38ab7-093a-4826-8645-f5cc5a4158de tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:27.551982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf38ab7-093a-4826-8645-f5cc5a4158de tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:27.974802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9cf38ab7-093a-4826-8645-f5cc5a4158de tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:28.015046 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9cf38ab7-093a-4826-8645-f5cc5a4158de tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1273 microversion: 2.1 time: 0.565522 Aug 25 12:56:28.031947 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1165/2288] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:27 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1273 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:28.069726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-48b465f3-73b7-427b-a812-c81c76ff5b2d tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:28.073335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-48b465f3-73b7-427b-a812-c81c76ff5b2d tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:28.093644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48b465f3-73b7-427b-a812-c81c76ff5b2d tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:28.100104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48b465f3-73b7-427b-a812-c81c76ff5b2d tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:28.101365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48b465f3-73b7-427b-a812-c81c76ff5b2d tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:28.103887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48b465f3-73b7-427b-a812-c81c76ff5b2d tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:28.110890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48b465f3-73b7-427b-a812-c81c76ff5b2d tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:28.112260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48b465f3-73b7-427b-a812-c81c76ff5b2d tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:28.250850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:28.292221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:28.661660 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e74e7c12-6331-4bfb-b031-621af2ae6855 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/74d193e1-e797-4d60-8d80-8eb74ab43b87" status: 202 len: 0 microversion: 2.1 time: 5.438421 Aug 25 12:56:28.663048 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1124/2289] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 12:56:23 2022] DELETE /compute/v2.1/os-floating-ips/74d193e1-e797-4d60-8d80-8eb74ab43b87 => generated 0 bytes in 5443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:56:28.689337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3b2e4879-27d0-4bc2-a8e1-d17f73e65712 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: .version_select at 0x7f3a2e81baf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2042658937", "description": "tempest-description-1589378766"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:29.221963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-48b465f3-73b7-427b-a812-c81c76ff5b2d tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:29.241969 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-48b465f3-73b7-427b-a812-c81c76ff5b2d tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1484 microversion: 2.1 time: 1.207316 Aug 25 12:56:29.264183 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1166/2290] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:28 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1484 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:29.295947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-563c9cf6-2c47-457e-966c-5a3073656939 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:29.297694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-563c9cf6-2c47-457e-966c-5a3073656939 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:29.328447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-563c9cf6-2c47-457e-966c-5a3073656939 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:29.329305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-563c9cf6-2c47-457e-966c-5a3073656939 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:29.332071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-563c9cf6-2c47-457e-966c-5a3073656939 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:29.336280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-563c9cf6-2c47-457e-966c-5a3073656939 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:29.338043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-563c9cf6-2c47-457e-966c-5a3073656939 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:29.343180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-563c9cf6-2c47-457e-966c-5a3073656939 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:29.569858 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3b2e4879-27d0-4bc2-a8e1-d17f73e65712 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.904447 Aug 25 12:56:29.581704 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1125/2291] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:56:28 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:30.001067 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-563c9cf6-2c47-457e-966c-5a3073656939 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1533 microversion: 2.1 time: 0.718389 Aug 25 12:56:30.014843 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1167/2292] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:29 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1533 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:30.030148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b80951b-cccd-4b61-b6d2-cf68dad31519 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '.version_select at 0x7f3a2e8bf8b0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:30.754929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1089862628", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "76635244-431e-41b7-9377-f49623b762de"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:30.965233 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b80951b-cccd-4b61-b6d2-cf68dad31519 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/397e3991-2e3c-40bb-9e10-4cfcb01c99a9" status: 202 len: 0 microversion: 2.1 time: 0.945097 Aug 25 12:56:30.969028 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1168/2293] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:56:30 2022] DELETE /compute/v2.1/os-security-groups/397e3991-2e3c-40bb-9e10-4cfcb01c99a9 => generated 0 bytes in 953 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:56:30.996573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-09a9adf3-87ea-4317-958e-e7d8359fd8f0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:31.004922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-09a9adf3-87ea-4317-958e-e7d8359fd8f0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:31.020902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:31.025914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09a9adf3-87ea-4317-958e-e7d8359fd8f0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:31.027697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09a9adf3-87ea-4317-958e-e7d8359fd8f0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:31.029248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09a9adf3-87ea-4317-958e-e7d8359fd8f0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:31.063571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09a9adf3-87ea-4317-958e-e7d8359fd8f0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:31.064808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09a9adf3-87ea-4317-958e-e7d8359fd8f0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:31.065755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09a9adf3-87ea-4317-958e-e7d8359fd8f0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:31.101209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] validate_networks() for [('76635244-431e-41b7-9377-f49623b762de', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:56:32.000347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-09a9adf3-87ea-4317-958e-e7d8359fd8f0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:32.056921 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-09a9adf3-87ea-4317-958e-e7d8359fd8f0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1315 microversion: 2.1 time: 1.085231 Aug 25 12:56:32.086560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1169/2294] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:30 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1315 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:32.107305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-506ac97d-4609-4584-9f6a-f1b830655099 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:32.108319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-506ac97d-4609-4584-9f6a-f1b830655099 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:32.137958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-506ac97d-4609-4584-9f6a-f1b830655099 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:32.139072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-506ac97d-4609-4584-9f6a-f1b830655099 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:32.140095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-506ac97d-4609-4584-9f6a-f1b830655099 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:32.141694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-506ac97d-4609-4584-9f6a-f1b830655099 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:32.145949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-506ac97d-4609-4584-9f6a-f1b830655099 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:32.146903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-506ac97d-4609-4584-9f6a-f1b830655099 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:32.566947 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-506ac97d-4609-4584-9f6a-f1b830655099 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.477224 Aug 25 12:56:32.569003 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1170/2295] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 12:56:32 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75/os-interface => generated 284 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:32.586438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cd5823e6-60d0-45a7-a116-b94298de7182 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:32.602010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd5823e6-60d0-45a7-a116-b94298de7182 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:32.604677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd5823e6-60d0-45a7-a116-b94298de7182 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:32.606764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd5823e6-60d0-45a7-a116-b94298de7182 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:32.610368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd5823e6-60d0-45a7-a116-b94298de7182 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:32.612785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd5823e6-60d0-45a7-a116-b94298de7182 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:32.617330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd5823e6-60d0-45a7-a116-b94298de7182 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:32.701388 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cd5823e6-60d0-45a7-a116-b94298de7182 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.129354 Aug 25 12:56:32.704392 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1171/2296] 10.222.0.70 () {58 vars in 1176 bytes} [Thu Aug 25 12:56:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:32.717742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-873576217", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "db945ddc-3e26-486f-9113-757f7c8d2785"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:32.910608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] validate_networks() for [('db945ddc-3e26-486f-9113-757f7c8d2785', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:56:33.207465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=11,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:34.350426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:56:34.352922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:56:34.354971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:56:34.356108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:56:34.359406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:56:34.390478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:34.391838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:34.393046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:34.405042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:34.412563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:34.414602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:34.489558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Getting quotas for project b4719646f1444a8ea7977af53061340a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:56:34.527745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Getting quotas for user 21f364ac015b44eb91ba63481f8595b4 and project b4719646f1444a8ea7977af53061340a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:56:34.627560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:56:34.639848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:56:34.937964 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f5a2e194-da02-4638-8350-f219264bae0e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.363600 Aug 25 12:56:34.940293 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1126/2297] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 5368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:56:34.956351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef9739a1-70b3-444e-ba95-74308c059074 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:34.959375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ef9739a1-70b3-444e-ba95-74308c059074 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:34.977816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef9739a1-70b3-444e-ba95-74308c059074 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:34.980146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef9739a1-70b3-444e-ba95-74308c059074 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:34.982905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef9739a1-70b3-444e-ba95-74308c059074 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:34.986094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef9739a1-70b3-444e-ba95-74308c059074 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:34.988282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef9739a1-70b3-444e-ba95-74308c059074 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:34.990988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef9739a1-70b3-444e-ba95-74308c059074 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:35.131812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ef9739a1-70b3-444e-ba95-74308c059074 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:56:35.676615 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef9739a1-70b3-444e-ba95-74308c059074 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 204 len: 0 microversion: 2.1 time: 0.730858 Aug 25 12:56:35.679997 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1127/2298] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:56:34 2022] DELETE /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:56:36.268776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:56:36.269975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:56:36.271316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:56:36.272701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:56:36.277537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:56:36.341824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:36.345232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:36.349962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:36.354650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:36.358781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:36.361553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:36.423515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5eac6738-d624-4fb0-bc80-45b1fca9094a tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Calling method '.version_select at 0x7f3a29fdd940>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:36.470827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Getting quotas for project 3073060ec2e34c7187935c76726b9982. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:56:36.497968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Getting quotas for user 6b304954aa4e44979d9d79fc06909e94 and project 3073060ec2e34c7187935c76726b9982. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:56:36.530686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:56:36.537847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:56:36.596058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-5eac6738-d624-4fb0-bc80-45b1fca9094a tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 036c3ea6-e5a9-4e3e-8edc-049620560ce1 does not exist", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:56:36.598848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.security_group_api [None req-5eac6738-d624-4fb0-bc80-45b1fca9094a tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Neutron security group 036c3ea6-e5a9-4e3e-8edc-049620560ce1 not found {{(pid=129059) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:56:36.601211 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-5eac6738-d624-4fb0-bc80-45b1fca9094a tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] HTTP exception thrown: Security group 036c3ea6-e5a9-4e3e-8edc-049620560ce1 does not exist Aug 25 12:56:36.601211 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-5e7bc43f-bb31-48cc-b870-4fed4f3349a4'] Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5eac6738-d624-4fb0-bc80-45b1fca9094a tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Request method failure captured: Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-security-groups/036c3ea6-e5a9-4e3e-8edc-049620560ce1 HTTP/1.1 Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F-U6qDR0GjIQK95Dy-ytkSMeit4t-3oslZdnoZ51PklbeTKXKdVMdP5jlSVyQqkf0a5FeAxospEak6AyEtI1O6Pxup5k4pWUuj3toTDc2wu6IpkUvGgXFp7Zf8KtedqKKxuKh1qRGCWM-o3VP1X_EXu1swibs4HuHmlRDNvXVqI7k Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 03fae7e9ae89491a9a5fd394a9ab2129 Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03fae7e9ae89491a9a5fd394a9ab2129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_03fae7e9ae89491a9a5fd394a9ab2129", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/03fae7e9ae89491a9a5fd394a9ab2129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03fae7e9ae89491a9a5fd394a9ab2129"}]}] Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 03fae7e9ae89491a9a5fd394a9ab2129 Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsNegativeTestJSON-933787619-project Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 9803a694ff38436ca1eec1ce78ecc22f Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-933787619-project Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: exception: Security group 036c3ea6-e5a9-4e3e-8edc-049620560ce1 does not exist Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-5e7bc43f-bb31-48cc-b870-4fed4f3349a4'] Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '036c3ea6-e5a9-4e3e-8edc-049620560ce1'} Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:56:36.612535 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 036c3ea6-e5a9-4e3e-8edc-049620560ce1 does not exist Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e7bc43f-bb31-48cc-b870-4fed4f3349a4'] Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 036c3ea6-e5a9-4e3e-8edc-049620560ce1 does not exist Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e7bc43f-bb31-48cc-b870-4fed4f3349a4'] Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 036c3ea6-e5a9-4e3e-8edc-049620560ce1 does not exist Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e7bc43f-bb31-48cc-b870-4fed4f3349a4'] Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 036c3ea6-e5a9-4e3e-8edc-049620560ce1 does not exist Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e7bc43f-bb31-48cc-b870-4fed4f3349a4'] Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5eac6738-d624-4fb0-bc80-45b1fca9094a tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Returning 404 to user: Security group 036c3ea6-e5a9-4e3e-8edc-049620560ce1 does not exist Aug 25 12:56:36.620843 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-5e7bc43f-bb31-48cc-b870-4fed4f3349a4'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:36.633749 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5eac6738-d624-4fb0-bc80-45b1fca9094a tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/036c3ea6-e5a9-4e3e-8edc-049620560ce1" status: 404 len: 194 microversion: 2.1 time: 0.935031 Aug 25 12:56:36.633749 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1128/2299] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:56:35 2022] DELETE /compute/v2.1/os-security-groups/036c3ea6-e5a9-4e3e-8edc-049620560ce1 => generated 194 bytes in 947 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:36.670679 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e6fb1049-b646-40f3-b0c7-da11354a073a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.962859 Aug 25 12:56:36.673598 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1172/2300] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:56:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:56:36.684879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-38c0b0e5-2ccb-4061-892c-c5ad7f945372 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:36.688054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-38c0b0e5-2ccb-4061-892c-c5ad7f945372 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:36.702336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38c0b0e5-2ccb-4061-892c-c5ad7f945372 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:36.703964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38c0b0e5-2ccb-4061-892c-c5ad7f945372 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:36.705225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38c0b0e5-2ccb-4061-892c-c5ad7f945372 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:36.707463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38c0b0e5-2ccb-4061-892c-c5ad7f945372 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:36.708838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38c0b0e5-2ccb-4061-892c-c5ad7f945372 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:36.710023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38c0b0e5-2ccb-4061-892c-c5ad7f945372 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:36.719652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852771-8", "block_migration": false, "disk_over_commit": false}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:36.732681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:36.780942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:36.782186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:36.783011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:36.784412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:36.785249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:36.786793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:36.882563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lazy-loading 'flavor' on Instance uuid 24695ae5-f061-4367-ba68-ba09b5e60cd8 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:56:36.995515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Going to try to live migrate instance to n-h1-852771-8 {{(pid=129059) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:56:37.376719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-38c0b0e5-2ccb-4061-892c-c5ad7f945372 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:37.409204 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-38c0b0e5-2ccb-4061-892c-c5ad7f945372 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1315 microversion: 2.1 time: 0.731809 Aug 25 12:56:37.430998 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1173/2301] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:36 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:37.450590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b9c0b856-80d0-40e0-af3f-a485f5fdab9c req-21a04e82-8070-4acf-bdf8-a2689aeb80f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08f4120a-39c6-4978-9fed-e4dc6b49edf2", "tag": "23baf837-77da-452d-a544-e9e93948b696"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:37.476482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b9c0b856-80d0-40e0-af3f-a485f5fdab9c req-21a04e82-8070-4acf-bdf8-a2689aeb80f5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:37.479400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b9c0b856-80d0-40e0-af3f-a485f5fdab9c req-21a04e82-8070-4acf-bdf8-a2689aeb80f5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:37.483312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b9c0b856-80d0-40e0-af3f-a485f5fdab9c req-21a04e82-8070-4acf-bdf8-a2689aeb80f5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:37.522626 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b9c0b856-80d0-40e0-af3f-a485f5fdab9c req-21a04e82-8070-4acf-bdf8-a2689aeb80f5 service nova] Creating event network-changed:23baf837-77da-452d-a544-e9e93948b696 for instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 on n-h1-852771-8 Aug 25 12:56:37.559195 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b9c0b856-80d0-40e0-af3f-a485f5fdab9c req-21a04e82-8070-4acf-bdf8-a2689aeb80f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121513 Aug 25 12:56:37.560583 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1174/2302] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:37.573684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-573856c4-fea7-4f42-bf6d-6e2d6021c63d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:37.575175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-573856c4-fea7-4f42-bf6d-6e2d6021c63d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:37.613873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-573856c4-fea7-4f42-bf6d-6e2d6021c63d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:37.614779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-573856c4-fea7-4f42-bf6d-6e2d6021c63d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:37.621387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-573856c4-fea7-4f42-bf6d-6e2d6021c63d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:37.625235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-573856c4-fea7-4f42-bf6d-6e2d6021c63d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:37.628273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-573856c4-fea7-4f42-bf6d-6e2d6021c63d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:37.634057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-573856c4-fea7-4f42-bf6d-6e2d6021c63d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:37.963612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-573856c4-fea7-4f42-bf6d-6e2d6021c63d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:38.046100 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-573856c4-fea7-4f42-bf6d-6e2d6021c63d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1276 microversion: 2.1 time: 0.483122 Aug 25 12:56:38.047981 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1175/2303] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:37 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1276 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:38.072060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9ce4914c-1bae-4e0f-864d-ab146b8d5f60 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:38.079983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9ce4914c-1bae-4e0f-864d-ab146b8d5f60 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:38.125830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ce4914c-1bae-4e0f-864d-ab146b8d5f60 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:38.133775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ce4914c-1bae-4e0f-864d-ab146b8d5f60 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:38.136254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ce4914c-1bae-4e0f-864d-ab146b8d5f60 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:38.141875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ce4914c-1bae-4e0f-864d-ab146b8d5f60 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:38.152143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ce4914c-1bae-4e0f-864d-ab146b8d5f60 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:38.153579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ce4914c-1bae-4e0f-864d-ab146b8d5f60 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:38.770507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9ce4914c-1bae-4e0f-864d-ab146b8d5f60 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:38.802981 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9ce4914c-1bae-4e0f-864d-ab146b8d5f60 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1509 microversion: 2.1 time: 0.751620 Aug 25 12:56:38.804040 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1176/2304] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:38 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1509 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:38.819933 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a1c4e1ea-bfe1-466b-bc98-90e2034b7064 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.009475 Aug 25 12:56:38.830520 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1177/2305] 10.222.0.70 () {58 vars in 1164 bytes} [Thu Aug 25 12:56:38 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 12:56:38.870063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-40e7a890-13f0-4273-8e40-633b56e051e4 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:38.872422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-40e7a890-13f0-4273-8e40-633b56e051e4 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:38.918357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40e7a890-13f0-4273-8e40-633b56e051e4 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:38.920256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40e7a890-13f0-4273-8e40-633b56e051e4 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:38.921080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40e7a890-13f0-4273-8e40-633b56e051e4 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:38.925816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40e7a890-13f0-4273-8e40-633b56e051e4 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:38.928615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40e7a890-13f0-4273-8e40-633b56e051e4 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:38.933797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40e7a890-13f0-4273-8e40-633b56e051e4 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:39.175163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-40e7a890-13f0-4273-8e40-633b56e051e4 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:39.218033 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-40e7a890-13f0-4273-8e40-633b56e051e4 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1219 microversion: 2.1 time: 0.364108 Aug 25 12:56:39.223463 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1178/2306] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:38 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1219 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:39.253177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7558c632-cf9e-497a-bd75-6bf019e15be8 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:39.254645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7558c632-cf9e-497a-bd75-6bf019e15be8 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:39.294085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7558c632-cf9e-497a-bd75-6bf019e15be8 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:39.295584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7558c632-cf9e-497a-bd75-6bf019e15be8 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:39.299608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7558c632-cf9e-497a-bd75-6bf019e15be8 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:39.302060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7558c632-cf9e-497a-bd75-6bf019e15be8 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:39.306904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7558c632-cf9e-497a-bd75-6bf019e15be8 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:39.312625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7558c632-cf9e-497a-bd75-6bf019e15be8 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:39.956395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7558c632-cf9e-497a-bd75-6bf019e15be8 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:39.990242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7558c632-cf9e-497a-bd75-6bf019e15be8 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1484 microversion: 2.1 time: 0.764606 Aug 25 12:56:39.992687 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1179/2307] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:39 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1484 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:40.021605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-64fd1579-ee5e-40f4-a3da-a300a2e33ef5 req-0b6135c6-71a8-43b8-9b04-9eb407fa3c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48a5d0b-80f0-43cf-a5b4-50707002de75", "tag": "2e1d4e9f-8326-4a76-bf2f-01736ee09112"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:40.054462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-64fd1579-ee5e-40f4-a3da-a300a2e33ef5 req-0b6135c6-71a8-43b8-9b04-9eb407fa3c91 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:40.058829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-64fd1579-ee5e-40f4-a3da-a300a2e33ef5 req-0b6135c6-71a8-43b8-9b04-9eb407fa3c91 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:40.063069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-64fd1579-ee5e-40f4-a3da-a300a2e33ef5 req-0b6135c6-71a8-43b8-9b04-9eb407fa3c91 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:40.110968 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-64fd1579-ee5e-40f4-a3da-a300a2e33ef5 req-0b6135c6-71a8-43b8-9b04-9eb407fa3c91 service nova] Creating event network-changed:2e1d4e9f-8326-4a76-bf2f-01736ee09112 for instance d48a5d0b-80f0-43cf-a5b4-50707002de75 on n-h2-852771-8 Aug 25 12:56:40.134901 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-64fd1579-ee5e-40f4-a3da-a300a2e33ef5 req-0b6135c6-71a8-43b8-9b04-9eb407fa3c91 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133499 Aug 25 12:56:40.158952 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1180/2308] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:40.199865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e925cd1-094c-4480-b020-a42a83a2e21f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:40.201753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e925cd1-094c-4480-b020-a42a83a2e21f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:40.251523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e925cd1-094c-4480-b020-a42a83a2e21f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:40.252718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e925cd1-094c-4480-b020-a42a83a2e21f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:40.261397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e925cd1-094c-4480-b020-a42a83a2e21f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:40.263524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e925cd1-094c-4480-b020-a42a83a2e21f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:40.282715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e925cd1-094c-4480-b020-a42a83a2e21f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:40.284133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e925cd1-094c-4480-b020-a42a83a2e21f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:41.413234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e925cd1-094c-4480-b020-a42a83a2e21f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:41.465645 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e925cd1-094c-4480-b020-a42a83a2e21f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1315 microversion: 2.1 time: 1.303716 Aug 25 12:56:41.476881 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1181/2309] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:40 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1315 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:41.495525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9eac4b0-08c6-4462-84c2-41852103cdf0 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Calling method '.version_select at 0x7f3a2e940f70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:43.299909 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9eac4b0-08c6-4462-84c2-41852103cdf0 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.817623 Aug 25 12:56:43.301995 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1182/2310] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 12:56:41 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:43.321225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6dc8d373-fd83-48fe-9b82-142df4dcb956 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:43.328324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6dc8d373-fd83-48fe-9b82-142df4dcb956 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:43.348755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6dc8d373-fd83-48fe-9b82-142df4dcb956 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:43.350603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6dc8d373-fd83-48fe-9b82-142df4dcb956 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:43.351964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6dc8d373-fd83-48fe-9b82-142df4dcb956 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:43.354291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6dc8d373-fd83-48fe-9b82-142df4dcb956 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:43.355539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6dc8d373-fd83-48fe-9b82-142df4dcb956 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:43.356637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6dc8d373-fd83-48fe-9b82-142df4dcb956 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:43.544246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6dc8d373-fd83-48fe-9b82-142df4dcb956 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:43.586377 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6dc8d373-fd83-48fe-9b82-142df4dcb956 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1282 microversion: 2.1 time: 0.282050 Aug 25 12:56:43.588480 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1183/2311] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:43 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1282 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:43.607394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-577f360d-c65c-42c3-bba9-236b01c2bb8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:43.609282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-577f360d-c65c-42c3-bba9-236b01c2bb8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:43.639699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-577f360d-c65c-42c3-bba9-236b01c2bb8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:43.641393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-577f360d-c65c-42c3-bba9-236b01c2bb8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:43.660567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-577f360d-c65c-42c3-bba9-236b01c2bb8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:43.664984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-577f360d-c65c-42c3-bba9-236b01c2bb8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:43.665278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-577f360d-c65c-42c3-bba9-236b01c2bb8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:43.677286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-577f360d-c65c-42c3-bba9-236b01c2bb8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:43.759749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:44.451075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:44.461322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-577f360d-c65c-42c3-bba9-236b01c2bb8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:44.503083 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-577f360d-c65c-42c3-bba9-236b01c2bb8e tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1509 microversion: 2.1 time: 0.912027 Aug 25 12:56:44.504281 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1184/2312] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:43 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1509 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:44.532711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-61cb4065-a4a3-46ad-965b-6931d5041f74 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:44.544047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-61cb4065-a4a3-46ad-965b-6931d5041f74 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:44.557258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:44.574618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61cb4065-a4a3-46ad-965b-6931d5041f74 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:44.579409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61cb4065-a4a3-46ad-965b-6931d5041f74 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:44.583014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61cb4065-a4a3-46ad-965b-6931d5041f74 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:44.584485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61cb4065-a4a3-46ad-965b-6931d5041f74 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:44.588638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61cb4065-a4a3-46ad-965b-6931d5041f74 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:44.591492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61cb4065-a4a3-46ad-965b-6931d5041f74 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:45.308399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-61cb4065-a4a3-46ad-965b-6931d5041f74 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:45.392495 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-61cb4065-a4a3-46ad-965b-6931d5041f74 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1273 microversion: 2.1 time: 0.874508 Aug 25 12:56:45.395567 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1185/2313] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:44 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1273 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:45.412642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3c93f121-d435-4bfe-9f50-79d789aa836e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:45.437600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3c93f121-d435-4bfe-9f50-79d789aa836e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:45.478704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c93f121-d435-4bfe-9f50-79d789aa836e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:45.488112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c93f121-d435-4bfe-9f50-79d789aa836e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:45.492142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c93f121-d435-4bfe-9f50-79d789aa836e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:45.498307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c93f121-d435-4bfe-9f50-79d789aa836e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:45.501744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c93f121-d435-4bfe-9f50-79d789aa836e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:45.505197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c93f121-d435-4bfe-9f50-79d789aa836e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:45.657425 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2a9da6be-5c49-4e9f-aaa2-e0f7698da181 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8/action" status: 202 len: 0 microversion: 2.1 time: 8.963700 Aug 25 12:56:45.657425 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1129/2314] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:56:36 2022] POST /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8/action => generated 0 bytes in 9029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:56:45.700321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c79cc8a5-77b5-4df7-becf-f66674417565 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Calling method '.version_select at 0x7f3a2a093a60>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:46.416392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:46.519082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:46.842207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3c93f121-d435-4bfe-9f50-79d789aa836e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:46.882576 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3c93f121-d435-4bfe-9f50-79d789aa836e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1315 microversion: 2.1 time: 1.482550 Aug 25 12:56:46.887515 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1186/2315] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:45 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1315 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:46.909253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a9cee97a-0ffd-43c1-a85f-8f4183852bfd req-4a1bb1bd-20e1-4be4-b08c-4eba5225cd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece", "name": "network-vif-unplugged", "status": "completed", "tag": "f768abed-af60-4ed6-a009-839ff2fd5389"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:46.967549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a9cee97a-0ffd-43c1-a85f-8f4183852bfd req-4a1bb1bd-20e1-4be4-b08c-4eba5225cd29 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:46.979440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a9cee97a-0ffd-43c1-a85f-8f4183852bfd req-4a1bb1bd-20e1-4be4-b08c-4eba5225cd29 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:46.984301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a9cee97a-0ffd-43c1-a85f-8f4183852bfd req-4a1bb1bd-20e1-4be4-b08c-4eba5225cd29 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:47.031247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:47.059565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-c79cc8a5-77b5-4df7-becf-f66674417565 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:56:47.061269 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c79cc8a5-77b5-4df7-becf-f66674417565 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 25 12:56:47.061269 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-13845894-1a92-431b-a0a3-b50e42d97b24'] Aug 25 12:56:47.065448 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a9cee97a-0ffd-43c1-a85f-8f4183852bfd req-4a1bb1bd-20e1-4be4-b08c-4eba5225cd29 service nova] Creating event network-vif-unplugged:f768abed-af60-4ed6-a009-839ff2fd5389 for instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece on n-h2-852771-8 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c79cc8a5-77b5-4df7-becf-f66674417565 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Request method failure captured: Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-security-groups/7fceb03b-9e7c-4ae2-beb3-80238acf159b HTTP/1.1 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F-U6qDR0GjIQK95Dy-ytkSMeit4t-3oslZdnoZ51PklbeTKXKdVMdP5jlSVyQqkf0a5FeAxospEak6AyEtI1O6Pxup5k4pWUuj3toTDc2wu6IpkUvGgXFp7Zf8KtedqKKxuKh1qRGCWM-o3VP1X_EXu1swibs4HuHmlRDNvXVqI7k Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 03fae7e9ae89491a9a5fd394a9ab2129 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03fae7e9ae89491a9a5fd394a9ab2129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_03fae7e9ae89491a9a5fd394a9ab2129", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/03fae7e9ae89491a9a5fd394a9ab2129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03fae7e9ae89491a9a5fd394a9ab2129"}]}] Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 03fae7e9ae89491a9a5fd394a9ab2129 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsNegativeTestJSON-933787619-project Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 9803a694ff38436ca1eec1ce78ecc22f Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-933787619-project Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: exception: Insufficient rights for removing default security group. Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-13845894-1a92-431b-a0a3-b50e42d97b24'] Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7fceb03b-9e7c-4ae2-beb3-80238acf159b'} Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:56:47.067270 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-13845894-1a92-431b-a0a3-b50e42d97b24'] Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-13845894-1a92-431b-a0a3-b50e42d97b24'] Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-13845894-1a92-431b-a0a3-b50e42d97b24'] Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-13845894-1a92-431b-a0a3-b50e42d97b24'] Aug 25 12:56:47.076819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:47.090003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c79cc8a5-77b5-4df7-becf-f66674417565 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 25 12:56:47.090003 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-13845894-1a92-431b-a0a3-b50e42d97b24'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:47.102223 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c79cc8a5-77b5-4df7-becf-f66674417565 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/7fceb03b-9e7c-4ae2-beb3-80238acf159b" status: 400 len: 182 microversion: 2.1 time: 1.432717 Aug 25 12:56:47.106154 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1130/2316] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:56:45 2022] DELETE /compute/v2.1/os-security-groups/7fceb03b-9e7c-4ae2-beb3-80238acf159b => generated 182 bytes in 1448 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:56:47.118917 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a9cee97a-0ffd-43c1-a85f-8f4183852bfd req-4a1bb1bd-20e1-4be4-b08c-4eba5225cd29 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.219463 Aug 25 12:56:47.121205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e7e3e62e-39a7-4445-8936-c1a70f95ede5 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:47.130237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e7e3e62e-39a7-4445-8936-c1a70f95ede5 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:47.134163 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1187/2317] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:47.165174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7e3e62e-39a7-4445-8936-c1a70f95ede5 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:47.168736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7e3e62e-39a7-4445-8936-c1a70f95ede5 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:47.171593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7e3e62e-39a7-4445-8936-c1a70f95ede5 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:47.173734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7e3e62e-39a7-4445-8936-c1a70f95ede5 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:47.175521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7e3e62e-39a7-4445-8936-c1a70f95ede5 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:47.177560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7e3e62e-39a7-4445-8936-c1a70f95ede5 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:47.178001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:47.187513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:47.221377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:47.222431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:47.223247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:47.224688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:47.225465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:47.251320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:47.411190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:47.412137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:47.412969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:47.414220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lazy-loading 'fault' on Instance uuid 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:56:47.634962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e734231a3c496e982e5b1a718ebf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3075ca68e13c46a092a2dc7981bbdc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:47.684950 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f5df1745-b8ee-478b-81db-8688d8d1f648 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 200 len: 1313 microversion: 2.1 time: 0.547194 Aug 25 12:56:47.687209 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1188/2318] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:47 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:47.699369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e622c653-159b-4068-9a27-483b88c557c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:47.701683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e622c653-159b-4068-9a27-483b88c557c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:47.718069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e622c653-159b-4068-9a27-483b88c557c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:47.719797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e622c653-159b-4068-9a27-483b88c557c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:47.722154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e622c653-159b-4068-9a27-483b88c557c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:47.724360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e622c653-159b-4068-9a27-483b88c557c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:47.726722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e622c653-159b-4068-9a27-483b88c557c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:47.728418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e622c653-159b-4068-9a27-483b88c557c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:48.044257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e7e3e62e-39a7-4445-8936-c1a70f95ede5 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:48.074956 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e7e3e62e-39a7-4445-8936-c1a70f95ede5 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1324 microversion: 2.1 time: 0.966183 Aug 25 12:56:48.083081 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1131/2319] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:47 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1324 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:48.110996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19377e4d-6d9e-473d-beba-91c8bc3f976c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:48.114875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-19377e4d-6d9e-473d-beba-91c8bc3f976c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:48.144815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19377e4d-6d9e-473d-beba-91c8bc3f976c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:48.150729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19377e4d-6d9e-473d-beba-91c8bc3f976c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:48.153574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19377e4d-6d9e-473d-beba-91c8bc3f976c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:48.161427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19377e4d-6d9e-473d-beba-91c8bc3f976c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:48.165142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19377e4d-6d9e-473d-beba-91c8bc3f976c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:48.168335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19377e4d-6d9e-473d-beba-91c8bc3f976c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:48.751148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e622c653-159b-4068-9a27-483b88c557c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:48.769942 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e622c653-159b-4068-9a27-483b88c557c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.080213 Aug 25 12:56:48.771986 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1189/2320] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:47 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:48.782610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-199b966a-5871-4346-8552-4c6b7a7aa8fc req-d1295afb-644e-446a-b577-9ae377d2d3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece", "name": "network-vif-deleted", "tag": "f768abed-af60-4ed6-a009-839ff2fd5389"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:48.807273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-199b966a-5871-4346-8552-4c6b7a7aa8fc req-d1295afb-644e-446a-b577-9ae377d2d3d4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:48.809429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-199b966a-5871-4346-8552-4c6b7a7aa8fc req-d1295afb-644e-446a-b577-9ae377d2d3d4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:48.810815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-199b966a-5871-4346-8552-4c6b7a7aa8fc req-d1295afb-644e-446a-b577-9ae377d2d3d4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:48.840210 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-199b966a-5871-4346-8552-4c6b7a7aa8fc req-d1295afb-644e-446a-b577-9ae377d2d3d4 service nova] Creating event network-vif-deleted:f768abed-af60-4ed6-a009-839ff2fd5389 for instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece on n-h2-852771-8 Aug 25 12:56:48.851057 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-199b966a-5871-4346-8552-4c6b7a7aa8fc req-d1295afb-644e-446a-b577-9ae377d2d3d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075891 Aug 25 12:56:48.853745 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1190/2321] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:48.864739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-508410dc-8db0-43c4-94ea-c826e330eef4 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Calling method '.version_select at 0x7f3a2a359820>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:48.892194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-19377e4d-6d9e-473d-beba-91c8bc3f976c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:48.909117 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19377e4d-6d9e-473d-beba-91c8bc3f976c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1315 microversion: 2.1 time: 0.822110 Aug 25 12:56:48.910855 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1132/2322] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:48 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:48.946092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-da8f9571-8a9e-4164-847a-e31e978616ac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:48.948607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-da8f9571-8a9e-4164-847a-e31e978616ac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:48.962075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da8f9571-8a9e-4164-847a-e31e978616ac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:48.964924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da8f9571-8a9e-4164-847a-e31e978616ac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:48.966660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da8f9571-8a9e-4164-847a-e31e978616ac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:48.968392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da8f9571-8a9e-4164-847a-e31e978616ac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:48.971368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da8f9571-8a9e-4164-847a-e31e978616ac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:48.972696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da8f9571-8a9e-4164-847a-e31e978616ac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:49.139456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-508410dc-8db0-43c4-94ea-c826e330eef4 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 does not exist", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:56:49.141075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.security_group_api [None req-508410dc-8db0-43c4-94ea-c826e330eef4 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Neutron security group 173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 not found {{(pid=129060) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:56:49.142580 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-508410dc-8db0-43c4-94ea-c826e330eef4 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] HTTP exception thrown: Security group 173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 does not exist Aug 25 12:56:49.142580 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-6c5fa6f5-5435-44a5-b1f2-8a11e95d7819'] Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-508410dc-8db0-43c4-94ea-c826e330eef4 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Request method failure captured: Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-security-groups/173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 HTTP/1.1 Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3F-U6qDR0GjIQK95Dy-ytkSMeit4t-3oslZdnoZ51PklbeTKXKdVMdP5jlSVyQqkf0a5FeAxospEak6AyEtI1O6Pxup5k4pWUuj3toTDc2wu6IpkUvGgXFp7Zf8KtedqKKxuKh1qRGCWM-o3VP1X_EXu1swibs4HuHmlRDNvXVqI7k Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 03fae7e9ae89491a9a5fd394a9ab2129 Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03fae7e9ae89491a9a5fd394a9ab2129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_03fae7e9ae89491a9a5fd394a9ab2129", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/03fae7e9ae89491a9a5fd394a9ab2129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03fae7e9ae89491a9a5fd394a9ab2129"}]}] Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 03fae7e9ae89491a9a5fd394a9ab2129 Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupsNegativeTestJSON-933787619-project Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 9803a694ff38436ca1eec1ce78ecc22f Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-933787619-project Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: exception: Security group 173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 does not exist Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-6c5fa6f5-5435-44a5-b1f2-8a11e95d7819'] Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6'} Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:56:49.147394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 does not exist Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c5fa6f5-5435-44a5-b1f2-8a11e95d7819'] Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 does not exist Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c5fa6f5-5435-44a5-b1f2-8a11e95d7819'] Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 does not exist Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c5fa6f5-5435-44a5-b1f2-8a11e95d7819'] Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 does not exist Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c5fa6f5-5435-44a5-b1f2-8a11e95d7819'] Aug 25 12:56:49.159053 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.168539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-508410dc-8db0-43c4-94ea-c826e330eef4 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Returning 404 to user: Security group 173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 does not exist Aug 25 12:56:49.168539 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-6c5fa6f5-5435-44a5-b1f2-8a11e95d7819'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:49.170923 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-508410dc-8db0-43c4-94ea-c826e330eef4 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6" status: 404 len: 194 microversion: 2.1 time: 0.314429 Aug 25 12:56:49.172926 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1191/2323] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:56:48 2022] GET /compute/v2.1/os-security-groups/173c58be-0dfa-439b-b1ac-ccb2ca6eb2f6 => generated 194 bytes in 318 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:49.183343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:49.185480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] [instance: 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:49.204593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:49.206777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:49.207929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:49.209567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:49.210655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:49.211561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:49.251279 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] HTTP exception thrown: Instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece could not be found. Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Request method failure captured: Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece HTTP/1.1 Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3DioJswghwj6XD1PGEvuHMOdnbjZRLfuudpx_PS-6WGEs2rGx4l4NSaqNVbZSkhrPVYk5N7jfy-34AzJQo894_sckDLBZQRvJaeKtHu4894LQZvCl1giNgCZ4jO4XbkrBpyQfI-8JVXA2YqzGctwjaPT9F3Cz95CaGE7MgrfeRFK4s Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3075ca68e13c46a092a2dc7981bbdc44 Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1700837297 Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3075ca68e13c46a092a2dc7981bbdc44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3075ca68e13c46a092a2dc7981bbdc44", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3075ca68e13c46a092a2dc7981bbdc44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3075ca68e13c46a092a2dc7981bbdc44"}]}] Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1700837297 Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3075ca68e13c46a092a2dc7981bbdc44 Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1700837297 Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerRescueTestJSONUnderV235-1700837297-project Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 31e734231a3c496e982e5b1a718ebf23 Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1700837297-project Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece could not be found. Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece'} Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece could not be found. Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece could not be found. Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.255984 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:49.267920 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.267920 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:49.267920 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:49.267920 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:49.267920 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:49.267920 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:49.267920 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece could not be found. Aug 25 12:56:49.267920 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:56:49.267920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] Returning 404 to user: Instance 6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:49.270639 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cbbcbd83-328c-493d-8bda-f02b0d1e5576 tempest-ServerRescueTestJSONUnderV235-1700837297 tempest-ServerRescueTestJSONUnderV235-1700837297-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece" status: 404 len: 111 microversion: 2.1 time: 0.092047 Aug 25 12:56:49.280634 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1192/2324] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:49 2022] GET /compute/v2.1/servers/6bf69ccc-5bb1-43a9-98c2-01cfb51a8ece => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:49.295188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-61d49e5c-9819-48b4-90ae-38c79ef30a78 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:49.295759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-61d49e5c-9819-48b4-90ae-38c79ef30a78 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:49.326294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d49e5c-9819-48b4-90ae-38c79ef30a78 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:49.327632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d49e5c-9819-48b4-90ae-38c79ef30a78 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:49.329162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d49e5c-9819-48b4-90ae-38c79ef30a78 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:49.331747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d49e5c-9819-48b4-90ae-38c79ef30a78 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:49.336337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d49e5c-9819-48b4-90ae-38c79ef30a78 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:49.337120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d49e5c-9819-48b4-90ae-38c79ef30a78 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:50.158592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-da8f9571-8a9e-4164-847a-e31e978616ac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:50.198239 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-da8f9571-8a9e-4164-847a-e31e978616ac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1315 microversion: 2.1 time: 1.270101 Aug 25 12:56:50.203964 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1133/2325] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:48 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1315 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:50.260321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c7832b0-0f4b-42f9-ac5d-e2aca8a066f5 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Action: 'update', calling method: .version_select at 0x7f3a29f513a0>, body: {"security_group": {"name": "tempest-sg-299348289", "description": "tempest-description-267068479"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:50.616395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-61d49e5c-9819-48b4-90ae-38c79ef30a78 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:50.637259 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-61d49e5c-9819-48b4-90ae-38c79ef30a78 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1324 microversion: 2.1 time: 1.354195 Aug 25 12:56:50.639371 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1193/2326] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:49 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1324 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:50.659746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c6ab69d0-0bb2-43b9-892a-082cce3f4e1e req-abab13ac-5b7e-40e2-adac-dd606e4e04bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f4120a-39c6-4978-9fed-e4dc6b49edf2", "name": "network-vif-plugged", "status": "completed", "tag": "23baf837-77da-452d-a544-e9e93948b696"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:50.681170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-0c7832b0-0f4b-42f9-ac5d-e2aca8a066f5 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b8defa4-69cd-4f1e-bcd1-27a004a22a81 does not exist", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:56:50.691381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.security_group_api [None req-0c7832b0-0f4b-42f9-ac5d-e2aca8a066f5 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Neutron security group 8b8defa4-69cd-4f1e-bcd1-27a004a22a81 not found {{(pid=129059) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:56:50.692970 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-0c7832b0-0f4b-42f9-ac5d-e2aca8a066f5 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] HTTP exception thrown: Security group 8b8defa4-69cd-4f1e-bcd1-27a004a22a81 does not exist Aug 25 12:56:50.692970 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-d9a3b546-91e4-47bd-acad-5d8e24ff7286'] Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c7832b0-0f4b-42f9-ac5d-e2aca8a066f5 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Request method failure captured: Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/os-security-groups/8b8defa4-69cd-4f1e-bcd1-27a004a22a81 HTTP/1.1 Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 100 Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F-U6qDR0GjIQK95Dy-ytkSMeit4t-3oslZdnoZ51PklbeTKXKdVMdP5jlSVyQqkf0a5FeAxospEak6AyEtI1O6Pxup5k4pWUuj3toTDc2wu6IpkUvGgXFp7Zf8KtedqKKxuKh1qRGCWM-o3VP1X_EXu1swibs4HuHmlRDNvXVqI7k Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 03fae7e9ae89491a9a5fd394a9ab2129 Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03fae7e9ae89491a9a5fd394a9ab2129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_03fae7e9ae89491a9a5fd394a9ab2129", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/03fae7e9ae89491a9a5fd394a9ab2129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03fae7e9ae89491a9a5fd394a9ab2129"}]}] Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 03fae7e9ae89491a9a5fd394a9ab2129 Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-933787619 Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsNegativeTestJSON-933787619-project Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 9803a694ff38436ca1eec1ce78ecc22f Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-933787619-project Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: {"security_group": {"name": "tempest-sg-299348289", "description": "tempest-description-267068479"}} Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: exception: Security group 8b8defa4-69cd-4f1e-bcd1-27a004a22a81 does not exist Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-d9a3b546-91e4-47bd-acad-5d8e24ff7286'] Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '8b8defa4-69cd-4f1e-bcd1-27a004a22a81', 'body': {'security_group': {'name': 'tempest-sg-299348289', 'description': 'tempest-description-267068479'}}} Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:56:50.703778 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b8defa4-69cd-4f1e-bcd1-27a004a22a81 does not exist Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9a3b546-91e4-47bd-acad-5d8e24ff7286'] Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b8defa4-69cd-4f1e-bcd1-27a004a22a81 does not exist Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9a3b546-91e4-47bd-acad-5d8e24ff7286'] Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b8defa4-69cd-4f1e-bcd1-27a004a22a81 does not exist Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9a3b546-91e4-47bd-acad-5d8e24ff7286'] Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b8defa4-69cd-4f1e-bcd1-27a004a22a81 does not exist Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9a3b546-91e4-47bd-acad-5d8e24ff7286'] Aug 25 12:56:50.711243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:56:50.720501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c6ab69d0-0bb2-43b9-892a-082cce3f4e1e req-abab13ac-5b7e-40e2-adac-dd606e4e04bf service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:50.720501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c6ab69d0-0bb2-43b9-892a-082cce3f4e1e req-abab13ac-5b7e-40e2-adac-dd606e4e04bf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:50.720501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c6ab69d0-0bb2-43b9-892a-082cce3f4e1e req-abab13ac-5b7e-40e2-adac-dd606e4e04bf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:50.724511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c7832b0-0f4b-42f9-ac5d-e2aca8a066f5 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] Returning 404 to user: Security group 8b8defa4-69cd-4f1e-bcd1-27a004a22a81 does not exist Aug 25 12:56:50.724511 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-d9a3b546-91e4-47bd-acad-5d8e24ff7286'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:50.728065 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0c7832b0-0f4b-42f9-ac5d-e2aca8a066f5 tempest-SecurityGroupsNegativeTestJSON-933787619 tempest-SecurityGroupsNegativeTestJSON-933787619-project] 10.222.0.70 "PUT /compute/v2.1/os-security-groups/8b8defa4-69cd-4f1e-bcd1-27a004a22a81" status: 404 len: 194 microversion: 2.1 time: 0.520519 Aug 25 12:56:50.732936 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1134/2327] 10.222.0.70 () {60 vars in 1290 bytes} [Thu Aug 25 12:56:50 2022] PUT /compute/v2.1/os-security-groups/8b8defa4-69cd-4f1e-bcd1-27a004a22a81 => generated 194 bytes in 528 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:50.769099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4cad5460-6840-4b47-acb2-85e8a4b1dd40 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:50.772948 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c6ab69d0-0bb2-43b9-892a-082cce3f4e1e req-abab13ac-5b7e-40e2-adac-dd606e4e04bf service nova] Creating event network-vif-plugged:23baf837-77da-452d-a544-e9e93948b696 for instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 on n-h1-852771-8 Aug 25 12:56:50.789775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4cad5460-6840-4b47-acb2-85e8a4b1dd40 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:50.810989 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c6ab69d0-0bb2-43b9-892a-082cce3f4e1e req-abab13ac-5b7e-40e2-adac-dd606e4e04bf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168597 Aug 25 12:56:50.813428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cad5460-6840-4b47-acb2-85e8a4b1dd40 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:50.818327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cad5460-6840-4b47-acb2-85e8a4b1dd40 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:50.831096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cad5460-6840-4b47-acb2-85e8a4b1dd40 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:50.831564 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1194/2328] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:50.836543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cad5460-6840-4b47-acb2-85e8a4b1dd40 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:50.844574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cad5460-6840-4b47-acb2-85e8a4b1dd40 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:50.846749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cad5460-6840-4b47-acb2-85e8a4b1dd40 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:50.872280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0fc8f3f2-84d6-4aee-afe9-56881d9f43af tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:50.878033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0fc8f3f2-84d6-4aee-afe9-56881d9f43af tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:50.911079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc8f3f2-84d6-4aee-afe9-56881d9f43af tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:50.945429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc8f3f2-84d6-4aee-afe9-56881d9f43af tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:50.949360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc8f3f2-84d6-4aee-afe9-56881d9f43af tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:50.954820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc8f3f2-84d6-4aee-afe9-56881d9f43af tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:50.974436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc8f3f2-84d6-4aee-afe9-56881d9f43af tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:50.979297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc8f3f2-84d6-4aee-afe9-56881d9f43af tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:52.520846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0fc8f3f2-84d6-4aee-afe9-56881d9f43af tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:52.553417 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0fc8f3f2-84d6-4aee-afe9-56881d9f43af tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1315 microversion: 2.1 time: 1.718996 Aug 25 12:56:52.558995 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1195/2329] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:50 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1315 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:52.605608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f7104588-670b-4ccf-852f-b18fbf6d0a3f req-82d2e7db-4fac-40be-89ca-285927931f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81427539-a364-486a-8e7c-cd0ba4536b9d", "tag": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:52.636938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f7104588-670b-4ccf-852f-b18fbf6d0a3f req-82d2e7db-4fac-40be-89ca-285927931f8f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:52.639032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f7104588-670b-4ccf-852f-b18fbf6d0a3f req-82d2e7db-4fac-40be-89ca-285927931f8f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:52.640070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4cad5460-6840-4b47-acb2-85e8a4b1dd40 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:52.645307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f7104588-670b-4ccf-852f-b18fbf6d0a3f req-82d2e7db-4fac-40be-89ca-285927931f8f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:52.665145 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4cad5460-6840-4b47-acb2-85e8a4b1dd40 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.926528 Aug 25 12:56:52.682957 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1135/2330] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:50 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:52.693428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aa901a9d-cea3-4804-b0e7-0aabaf8d2305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:52.700789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aa901a9d-cea3-4804-b0e7-0aabaf8d2305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:52.701619 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f7104588-670b-4ccf-852f-b18fbf6d0a3f req-82d2e7db-4fac-40be-89ca-285927931f8f service nova] Creating event network-changed:a7c80ac3-bf92-4489-a5f3-e9d699fb2d81 for instance 81427539-a364-486a-8e7c-cd0ba4536b9d on n-h1-852771-8 Aug 25 12:56:52.718031 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f7104588-670b-4ccf-852f-b18fbf6d0a3f req-82d2e7db-4fac-40be-89ca-285927931f8f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148606 Aug 25 12:56:52.721799 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1196/2331] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:52.726134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa901a9d-cea3-4804-b0e7-0aabaf8d2305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:52.730840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa901a9d-cea3-4804-b0e7-0aabaf8d2305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:52.732172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa901a9d-cea3-4804-b0e7-0aabaf8d2305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:52.736434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa901a9d-cea3-4804-b0e7-0aabaf8d2305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:52.738630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa901a9d-cea3-4804-b0e7-0aabaf8d2305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:52.752551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa901a9d-cea3-4804-b0e7-0aabaf8d2305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:52.766047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b529364-46ad-43b3-85c3-e62f8da47454 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:52.784505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b529364-46ad-43b3-85c3-e62f8da47454 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:52.832008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b529364-46ad-43b3-85c3-e62f8da47454 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:52.832971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b529364-46ad-43b3-85c3-e62f8da47454 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:52.833731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b529364-46ad-43b3-85c3-e62f8da47454 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:52.834992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b529364-46ad-43b3-85c3-e62f8da47454 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:52.835830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b529364-46ad-43b3-85c3-e62f8da47454 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:52.836486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b529364-46ad-43b3-85c3-e62f8da47454 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:54.615142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b529364-46ad-43b3-85c3-e62f8da47454 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:54.637380 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b529364-46ad-43b3-85c3-e62f8da47454 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1324 microversion: 2.1 time: 1.912516 Aug 25 12:56:54.655465 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1197/2332] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:52 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1324 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:54.660231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aa901a9d-cea3-4804-b0e7-0aabaf8d2305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:54.678757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-63058d0c-f202-43d5-bc9e-d3caa4049a2c req-500bde95-83c5-4e3a-b62f-8fe8c38681bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16f93e2-3483-45a3-bb63-db445da43d3e", "tag": "4358b2d8-828a-475b-8e47-a1d534789187"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:54.689936 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aa901a9d-cea3-4804-b0e7-0aabaf8d2305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1315 microversion: 2.1 time: 2.004343 Aug 25 12:56:54.708278 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1136/2333] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:52 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1315 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:54.716016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-63058d0c-f202-43d5-bc9e-d3caa4049a2c req-500bde95-83c5-4e3a-b62f-8fe8c38681bb service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:54.717272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-63058d0c-f202-43d5-bc9e-d3caa4049a2c req-500bde95-83c5-4e3a-b62f-8fe8c38681bb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:54.718381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-63058d0c-f202-43d5-bc9e-d3caa4049a2c req-500bde95-83c5-4e3a-b62f-8fe8c38681bb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:54.740998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-67433ee3-d202-487d-be30-57b440bddf0d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:54.742949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-67433ee3-d202-487d-be30-57b440bddf0d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:54.771717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67433ee3-d202-487d-be30-57b440bddf0d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:54.771717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67433ee3-d202-487d-be30-57b440bddf0d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:54.772767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67433ee3-d202-487d-be30-57b440bddf0d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:54.773494 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-63058d0c-f202-43d5-bc9e-d3caa4049a2c req-500bde95-83c5-4e3a-b62f-8fe8c38681bb service nova] Creating event network-changed:4358b2d8-828a-475b-8e47-a1d534789187 for instance b16f93e2-3483-45a3-bb63-db445da43d3e on n-h1-852771-8 Aug 25 12:56:54.779292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67433ee3-d202-487d-be30-57b440bddf0d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:54.783234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67433ee3-d202-487d-be30-57b440bddf0d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:54.786083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67433ee3-d202-487d-be30-57b440bddf0d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:54.797963 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-63058d0c-f202-43d5-bc9e-d3caa4049a2c req-500bde95-83c5-4e3a-b62f-8fe8c38681bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136115 Aug 25 12:56:54.799778 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1198/2334] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:54.827634 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 12:56:54.829116 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 12:56:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 (ip 10.222.0.70) !!! Aug 25 12:56:55.563359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86333e73-34a9-4575-aa43-faad583d0813 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:55.564823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-86333e73-34a9-4575-aa43-faad583d0813 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:55.577548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86333e73-34a9-4575-aa43-faad583d0813 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:55.578312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86333e73-34a9-4575-aa43-faad583d0813 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:55.578988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86333e73-34a9-4575-aa43-faad583d0813 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:55.580307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86333e73-34a9-4575-aa43-faad583d0813 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:55.581708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86333e73-34a9-4575-aa43-faad583d0813 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:55.582922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-86333e73-34a9-4575-aa43-faad583d0813 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:55.647687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-67433ee3-d202-487d-be30-57b440bddf0d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:55.681580 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-67433ee3-d202-487d-be30-57b440bddf0d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1315 microversion: 2.1 time: 0.966309 Aug 25 12:56:55.686537 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1137/2335] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:54 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:55.707229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0df3621-4d8c-4b0e-939d-f37dedc6af31 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:55.709637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d0df3621-4d8c-4b0e-939d-f37dedc6af31 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:55.736121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0df3621-4d8c-4b0e-939d-f37dedc6af31 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:55.737495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0df3621-4d8c-4b0e-939d-f37dedc6af31 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:55.738663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0df3621-4d8c-4b0e-939d-f37dedc6af31 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:55.741875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0df3621-4d8c-4b0e-939d-f37dedc6af31 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:55.743154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0df3621-4d8c-4b0e-939d-f37dedc6af31 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:55.745840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0df3621-4d8c-4b0e-939d-f37dedc6af31 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:57.268286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-86333e73-34a9-4575-aa43-faad583d0813 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:57.278295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d0df3621-4d8c-4b0e-939d-f37dedc6af31 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:57.303254 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d0df3621-4d8c-4b0e-939d-f37dedc6af31 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1324 microversion: 2.1 time: 1.613842 Aug 25 12:56:57.304516 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1138/2336] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:55 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1324 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:57.310078 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-86333e73-34a9-4575-aa43-faad583d0813 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 2.505750 Aug 25 12:56:57.315315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8dcbe676-4f92-47ac-824c-faa520be9781 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:57.319303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8dcbe676-4f92-47ac-824c-faa520be9781 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:57.327175 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1199/2337] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:54 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 2526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:57.335871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8dcbe676-4f92-47ac-824c-faa520be9781 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:57.336817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8dcbe676-4f92-47ac-824c-faa520be9781 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:57.337749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8dcbe676-4f92-47ac-824c-faa520be9781 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:57.339730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8dcbe676-4f92-47ac-824c-faa520be9781 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:57.341169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8dcbe676-4f92-47ac-824c-faa520be9781 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:57.342173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8dcbe676-4f92-47ac-824c-faa520be9781 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:57.345980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ae01fdd-43a0-412a-b6e3-bde594ede800 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:57.348314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7ae01fdd-43a0-412a-b6e3-bde594ede800 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:57.367702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ae01fdd-43a0-412a-b6e3-bde594ede800 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:57.369870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ae01fdd-43a0-412a-b6e3-bde594ede800 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:57.371026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ae01fdd-43a0-412a-b6e3-bde594ede800 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:57.372977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ae01fdd-43a0-412a-b6e3-bde594ede800 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:57.374486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ae01fdd-43a0-412a-b6e3-bde594ede800 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:57.376872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ae01fdd-43a0-412a-b6e3-bde594ede800 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:58.115266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8dcbe676-4f92-47ac-824c-faa520be9781 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:58.147698 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8dcbe676-4f92-47ac-824c-faa520be9781 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1502 microversion: 2.1 time: 0.839625 Aug 25 12:56:58.165550 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1139/2338] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:57 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1502 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:58.217691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7ae01fdd-43a0-412a-b6e3-bde594ede800 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:58.279546 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ae01fdd-43a0-412a-b6e3-bde594ede800 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1315 microversion: 2.1 time: 0.950267 Aug 25 12:56:58.326425 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1200/2339] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:57 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:58.372908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-820f0a83-c1b0-429e-981c-5dbbb32f972f tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:58.379264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-820f0a83-c1b0-429e-981c-5dbbb32f972f tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:58.381699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bf9c701e-79fc-4bb2-90bc-cef5a68f6087 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:58.386906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bf9c701e-79fc-4bb2-90bc-cef5a68f6087 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:58.421923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf9c701e-79fc-4bb2-90bc-cef5a68f6087 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:58.423193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf9c701e-79fc-4bb2-90bc-cef5a68f6087 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:58.424341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf9c701e-79fc-4bb2-90bc-cef5a68f6087 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:58.430166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf9c701e-79fc-4bb2-90bc-cef5a68f6087 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:58.432117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf9c701e-79fc-4bb2-90bc-cef5a68f6087 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:58.433435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf9c701e-79fc-4bb2-90bc-cef5a68f6087 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:58.439716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-820f0a83-c1b0-429e-981c-5dbbb32f972f tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:58.441353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-820f0a83-c1b0-429e-981c-5dbbb32f972f tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:58.446216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-820f0a83-c1b0-429e-981c-5dbbb32f972f tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:58.454161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-820f0a83-c1b0-429e-981c-5dbbb32f972f tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:58.461633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-820f0a83-c1b0-429e-981c-5dbbb32f972f tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:58.466097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-820f0a83-c1b0-429e-981c-5dbbb32f972f tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:59.761430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bf9c701e-79fc-4bb2-90bc-cef5a68f6087 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:59.767241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-820f0a83-c1b0-429e-981c-5dbbb32f972f tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:59.787655 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-820f0a83-c1b0-429e-981c-5dbbb32f972f tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1324 microversion: 2.1 time: 1.449384 Aug 25 12:56:59.789990 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1140/2340] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:58 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1324 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:59.810045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-973d3e73-e5fc-4de4-8f15-b528ea670f92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:59.811846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-973d3e73-e5fc-4de4-8f15-b528ea670f92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:59.825262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-973d3e73-e5fc-4de4-8f15-b528ea670f92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:59.829073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-973d3e73-e5fc-4de4-8f15-b528ea670f92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:59.830662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-973d3e73-e5fc-4de4-8f15-b528ea670f92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:59.832581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-973d3e73-e5fc-4de4-8f15-b528ea670f92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:59.833758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-973d3e73-e5fc-4de4-8f15-b528ea670f92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:59.835038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-973d3e73-e5fc-4de4-8f15-b528ea670f92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:59.846153 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bf9c701e-79fc-4bb2-90bc-cef5a68f6087 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.486428 Aug 25 12:56:59.885792 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1201/2341] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:58 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:00.807276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-973d3e73-e5fc-4de4-8f15-b528ea670f92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:00.843299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5cc41cba-d9a7-4723-80d0-153c4216996c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:00.848839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5cc41cba-d9a7-4723-80d0-153c4216996c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:00.887999 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-973d3e73-e5fc-4de4-8f15-b528ea670f92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1315 microversion: 2.1 time: 1.094061 Aug 25 12:57:00.900034 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1141/2342] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:59 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1315 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:00.921763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cc41cba-d9a7-4723-80d0-153c4216996c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:00.923888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cc41cba-d9a7-4723-80d0-153c4216996c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:00.925047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cc41cba-d9a7-4723-80d0-153c4216996c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:00.929156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cc41cba-d9a7-4723-80d0-153c4216996c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:00.933818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cc41cba-d9a7-4723-80d0-153c4216996c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:00.934737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-35fb6d28-99e0-4085-9c18-6023052f3185 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:00.935962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5cc41cba-d9a7-4723-80d0-153c4216996c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:00.938486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-35fb6d28-99e0-4085-9c18-6023052f3185 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:00.995825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35fb6d28-99e0-4085-9c18-6023052f3185 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:00.996744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35fb6d28-99e0-4085-9c18-6023052f3185 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:01.000914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35fb6d28-99e0-4085-9c18-6023052f3185 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:01.005496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35fb6d28-99e0-4085-9c18-6023052f3185 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:01.016488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35fb6d28-99e0-4085-9c18-6023052f3185 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:01.025693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35fb6d28-99e0-4085-9c18-6023052f3185 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:01.094033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:02.275625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5cc41cba-d9a7-4723-80d0-153c4216996c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:02.328102 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5cc41cba-d9a7-4723-80d0-153c4216996c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1324 microversion: 2.1 time: 1.494483 Aug 25 12:57:02.336100 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1202/2343] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:00 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1324 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:02.355286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a5950d26-836e-4697-8ab7-c6240c4ae463 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:02.373952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a5950d26-836e-4697-8ab7-c6240c4ae463 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:02.377197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-35fb6d28-99e0-4085-9c18-6023052f3185 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:02.402960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:02.421253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5950d26-836e-4697-8ab7-c6240c4ae463 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:02.422925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5950d26-836e-4697-8ab7-c6240c4ae463 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:02.426785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5950d26-836e-4697-8ab7-c6240c4ae463 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:02.428736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5950d26-836e-4697-8ab7-c6240c4ae463 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:02.435519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5950d26-836e-4697-8ab7-c6240c4ae463 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:02.444142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5950d26-836e-4697-8ab7-c6240c4ae463 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:02.464399 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-35fb6d28-99e0-4085-9c18-6023052f3185 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.560793 Aug 25 12:57:02.467148 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1142/2344] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:00 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:03.383705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ca851185-776a-4d68-b9ed-d2d5dcf7b772 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:03.395070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca851185-776a-4d68-b9ed-d2d5dcf7b772 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:03.436940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca851185-776a-4d68-b9ed-d2d5dcf7b772 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:03.443022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca851185-776a-4d68-b9ed-d2d5dcf7b772 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:03.447345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca851185-776a-4d68-b9ed-d2d5dcf7b772 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:03.456317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca851185-776a-4d68-b9ed-d2d5dcf7b772 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:03.457834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca851185-776a-4d68-b9ed-d2d5dcf7b772 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:03.462796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca851185-776a-4d68-b9ed-d2d5dcf7b772 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:04.407341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a5950d26-836e-4697-8ab7-c6240c4ae463 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:04.459447 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a5950d26-836e-4697-8ab7-c6240c4ae463 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1315 microversion: 2.1 time: 2.120812 Aug 25 12:57:04.464785 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1203/2345] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:02 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1315 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:04.489337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-afdfc4a2-669f-4fd7-9a5c-0769e5f692e6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:04.490941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-afdfc4a2-669f-4fd7-9a5c-0769e5f692e6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:04.536363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afdfc4a2-669f-4fd7-9a5c-0769e5f692e6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:04.537307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afdfc4a2-669f-4fd7-9a5c-0769e5f692e6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:04.545966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afdfc4a2-669f-4fd7-9a5c-0769e5f692e6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:04.547464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afdfc4a2-669f-4fd7-9a5c-0769e5f692e6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:04.548326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afdfc4a2-669f-4fd7-9a5c-0769e5f692e6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:04.549563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afdfc4a2-669f-4fd7-9a5c-0769e5f692e6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:04.757973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ca851185-776a-4d68-b9ed-d2d5dcf7b772 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:04.792488 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ca851185-776a-4d68-b9ed-d2d5dcf7b772 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1324 microversion: 2.1 time: 1.424688 Aug 25 12:57:04.797094 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1143/2346] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:03 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1324 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:04.825216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef7b953d-796f-4616-83a5-7b63ea92eafe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd9d7529-31f4-487b-9b8b-8ab8ce41f608"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:04.836675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ef7b953d-796f-4616-83a5-7b63ea92eafe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:04.864358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef7b953d-796f-4616-83a5-7b63ea92eafe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:04.865434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef7b953d-796f-4616-83a5-7b63ea92eafe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:04.867457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef7b953d-796f-4616-83a5-7b63ea92eafe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:04.870679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef7b953d-796f-4616-83a5-7b63ea92eafe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:04.872015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef7b953d-796f-4616-83a5-7b63ea92eafe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:04.873208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef7b953d-796f-4616-83a5-7b63ea92eafe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:05.395065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-afdfc4a2-669f-4fd7-9a5c-0769e5f692e6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:05.429100 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-afdfc4a2-669f-4fd7-9a5c-0769e5f692e6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 0.962234 Aug 25 12:57:05.452622 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1204/2347] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:04 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:05.467638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f4f1c309-3066-43f2-9446-ae9a114d9360 req-edb55283-ec11-4acc-bc2f-34a9a47f0bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81427539-a364-486a-8e7c-cd0ba4536b9d", "name": "network-vif-plugged", "status": "completed", "tag": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:05.503522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f4f1c309-3066-43f2-9446-ae9a114d9360 req-edb55283-ec11-4acc-bc2f-34a9a47f0bc9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:05.505449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f4f1c309-3066-43f2-9446-ae9a114d9360 req-edb55283-ec11-4acc-bc2f-34a9a47f0bc9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:05.506752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f4f1c309-3066-43f2-9446-ae9a114d9360 req-edb55283-ec11-4acc-bc2f-34a9a47f0bc9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:05.536890 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f4f1c309-3066-43f2-9446-ae9a114d9360 req-edb55283-ec11-4acc-bc2f-34a9a47f0bc9 service nova] Creating event network-vif-plugged:a7c80ac3-bf92-4489-a5f3-e9d699fb2d81 for instance 81427539-a364-486a-8e7c-cd0ba4536b9d on n-h1-852771-8 Aug 25 12:57:05.552139 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f4f1c309-3066-43f2-9446-ae9a114d9360 req-edb55283-ec11-4acc-bc2f-34a9a47f0bc9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095973 Aug 25 12:57:05.554022 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1205/2348] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:05.573722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02d138d8-6c3a-41c1-8db5-f9843cf1feac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:05.576186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02d138d8-6c3a-41c1-8db5-f9843cf1feac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:05.588757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02d138d8-6c3a-41c1-8db5-f9843cf1feac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:05.590521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02d138d8-6c3a-41c1-8db5-f9843cf1feac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:05.592059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02d138d8-6c3a-41c1-8db5-f9843cf1feac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:05.594372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02d138d8-6c3a-41c1-8db5-f9843cf1feac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:05.595977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02d138d8-6c3a-41c1-8db5-f9843cf1feac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:05.597623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02d138d8-6c3a-41c1-8db5-f9843cf1feac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:05.691366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:05.859249 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef7b953d-796f-4616-83a5-7b63ea92eafe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.059427 Aug 25 12:57:05.870165 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1144/2349] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 12:57:04 2022] POST /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2/os-volume_attachments => generated 194 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:05.909875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5fd7992c-1f9f-4200-8a19-0d05b05a7da3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:05.912908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5fd7992c-1f9f-4200-8a19-0d05b05a7da3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:05.951961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fd7992c-1f9f-4200-8a19-0d05b05a7da3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:05.960686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fd7992c-1f9f-4200-8a19-0d05b05a7da3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:05.962797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fd7992c-1f9f-4200-8a19-0d05b05a7da3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:05.965912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fd7992c-1f9f-4200-8a19-0d05b05a7da3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:05.973008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fd7992c-1f9f-4200-8a19-0d05b05a7da3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:05.974642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fd7992c-1f9f-4200-8a19-0d05b05a7da3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:07.258277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02d138d8-6c3a-41c1-8db5-f9843cf1feac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:07.334520 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02d138d8-6c3a-41c1-8db5-f9843cf1feac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1315 microversion: 2.1 time: 1.775775 Aug 25 12:57:07.341588 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1206/2350] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:05 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1315 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:07.370106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-16faf682-a8cb-4207-8a22-051274fd8588 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:07.388090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-16faf682-a8cb-4207-8a22-051274fd8588 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:07.418826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16faf682-a8cb-4207-8a22-051274fd8588 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:07.420307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16faf682-a8cb-4207-8a22-051274fd8588 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:07.422046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16faf682-a8cb-4207-8a22-051274fd8588 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:07.425467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16faf682-a8cb-4207-8a22-051274fd8588 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:07.427726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16faf682-a8cb-4207-8a22-051274fd8588 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:07.428966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16faf682-a8cb-4207-8a22-051274fd8588 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:07.507298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5fd7992c-1f9f-4200-8a19-0d05b05a7da3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:07.574526 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5fd7992c-1f9f-4200-8a19-0d05b05a7da3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1324 microversion: 2.1 time: 1.706308 Aug 25 12:57:07.596188 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1145/2351] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:05 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1324 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:08.382089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed6c7cf3-9be7-47a7-a965-8224f2c4c935 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:08.384613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ed6c7cf3-9be7-47a7-a965-8224f2c4c935 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:08.431782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6c7cf3-9be7-47a7-a965-8224f2c4c935 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:08.432464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6c7cf3-9be7-47a7-a965-8224f2c4c935 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:08.454767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6c7cf3-9be7-47a7-a965-8224f2c4c935 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:08.456270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6c7cf3-9be7-47a7-a965-8224f2c4c935 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:08.457180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6c7cf3-9be7-47a7-a965-8224f2c4c935 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:08.462371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6c7cf3-9be7-47a7-a965-8224f2c4c935 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:08.698280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-16faf682-a8cb-4207-8a22-051274fd8588 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:08.719017 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-16faf682-a8cb-4207-8a22-051274fd8588 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.372016 Aug 25 12:57:08.746370 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1207/2352] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:07 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:08.757409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-427c010b-bc77-4375-9db7-7ad22ec87373 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:08.758689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-427c010b-bc77-4375-9db7-7ad22ec87373 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:08.784529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427c010b-bc77-4375-9db7-7ad22ec87373 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:08.785492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427c010b-bc77-4375-9db7-7ad22ec87373 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:08.791838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427c010b-bc77-4375-9db7-7ad22ec87373 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:08.793328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427c010b-bc77-4375-9db7-7ad22ec87373 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:08.794524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427c010b-bc77-4375-9db7-7ad22ec87373 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:08.795539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427c010b-bc77-4375-9db7-7ad22ec87373 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:09.500958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ed6c7cf3-9be7-47a7-a965-8224f2c4c935 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:09.535358 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ed6c7cf3-9be7-47a7-a965-8224f2c4c935 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1315 microversion: 2.1 time: 1.161309 Aug 25 12:57:09.537890 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1146/2353] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:08 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1315 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:09.584820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a92e0e12-8d0e-4fa9-bb15-839c427c3001 req-ffa76fbc-9359-421f-b396-eafba7bd840f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16f93e2-3483-45a3-bb63-db445da43d3e", "name": "network-vif-plugged", "status": "completed", "tag": "4358b2d8-828a-475b-8e47-a1d534789187"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:09.616624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a92e0e12-8d0e-4fa9-bb15-839c427c3001 req-ffa76fbc-9359-421f-b396-eafba7bd840f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:09.628349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a92e0e12-8d0e-4fa9-bb15-839c427c3001 req-ffa76fbc-9359-421f-b396-eafba7bd840f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:09.629319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a92e0e12-8d0e-4fa9-bb15-839c427c3001 req-ffa76fbc-9359-421f-b396-eafba7bd840f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:09.684041 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a92e0e12-8d0e-4fa9-bb15-839c427c3001 req-ffa76fbc-9359-421f-b396-eafba7bd840f service nova] Creating event network-vif-plugged:4358b2d8-828a-475b-8e47-a1d534789187 for instance b16f93e2-3483-45a3-bb63-db445da43d3e on n-h1-852771-8 Aug 25 12:57:09.710178 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a92e0e12-8d0e-4fa9-bb15-839c427c3001 req-ffa76fbc-9359-421f-b396-eafba7bd840f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169249 Aug 25 12:57:09.735778 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1147/2354] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:09.771430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-427c010b-bc77-4375-9db7-7ad22ec87373 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:09.782384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9b724cf1-1f9a-499f-b15e-8e695fe73932 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:09.791667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9b724cf1-1f9a-499f-b15e-8e695fe73932 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:09.803940 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-427c010b-bc77-4375-9db7-7ad22ec87373 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1324 microversion: 2.1 time: 1.055410 Aug 25 12:57:09.819828 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1208/2355] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:08 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1324 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:09.832724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b724cf1-1f9a-499f-b15e-8e695fe73932 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:09.846697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b724cf1-1f9a-499f-b15e-8e695fe73932 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:09.847725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b724cf1-1f9a-499f-b15e-8e695fe73932 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:09.851330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b724cf1-1f9a-499f-b15e-8e695fe73932 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:09.852388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b724cf1-1f9a-499f-b15e-8e695fe73932 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:09.855651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b724cf1-1f9a-499f-b15e-8e695fe73932 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:10.585867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-73df32e6-1c9d-46ca-91ea-8fab86f6095b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:10.592523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-73df32e6-1c9d-46ca-91ea-8fab86f6095b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:10.640200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73df32e6-1c9d-46ca-91ea-8fab86f6095b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:10.661007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73df32e6-1c9d-46ca-91ea-8fab86f6095b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:10.668853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73df32e6-1c9d-46ca-91ea-8fab86f6095b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:10.671631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73df32e6-1c9d-46ca-91ea-8fab86f6095b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:10.672850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73df32e6-1c9d-46ca-91ea-8fab86f6095b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:10.674281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73df32e6-1c9d-46ca-91ea-8fab86f6095b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:10.689491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9b724cf1-1f9a-499f-b15e-8e695fe73932 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:10.720876 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9b724cf1-1f9a-499f-b15e-8e695fe73932 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 0.947179 Aug 25 12:57:10.726286 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1148/2356] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:09 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:10.865028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cab91b58-6da1-4d15-9c39-4886fb98b852 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:10.866635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cab91b58-6da1-4d15-9c39-4886fb98b852 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:10.891987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab91b58-6da1-4d15-9c39-4886fb98b852 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:10.903157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab91b58-6da1-4d15-9c39-4886fb98b852 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:10.905127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab91b58-6da1-4d15-9c39-4886fb98b852 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:10.908433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab91b58-6da1-4d15-9c39-4886fb98b852 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:10.909333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab91b58-6da1-4d15-9c39-4886fb98b852 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:10.910165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab91b58-6da1-4d15-9c39-4886fb98b852 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:11.294627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-73df32e6-1c9d-46ca-91ea-8fab86f6095b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:11.327909 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-73df32e6-1c9d-46ca-91ea-8fab86f6095b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1315 microversion: 2.1 time: 0.751477 Aug 25 12:57:11.330666 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1209/2357] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:10 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:11.527547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cab91b58-6da1-4d15-9c39-4886fb98b852 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:11.568072 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cab91b58-6da1-4d15-9c39-4886fb98b852 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1520 microversion: 2.1 time: 0.719361 Aug 25 12:57:11.575935 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1149/2358] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:10 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1520 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:11.615748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-53a2d6f5-d6a6-475b-b753-c30d2440ce4a tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Action: 'create', calling method: .version_select at 0x7f3a2a1b9a60>, body: {"pool": null} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:11.769730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2c7d624a-879c-4771-8da6-bf9448c97742 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:11.770965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2c7d624a-879c-4771-8da6-bf9448c97742 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:11.818290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c7d624a-879c-4771-8da6-bf9448c97742 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:11.819945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c7d624a-879c-4771-8da6-bf9448c97742 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:11.824726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c7d624a-879c-4771-8da6-bf9448c97742 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:11.826619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c7d624a-879c-4771-8da6-bf9448c97742 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:11.827942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c7d624a-879c-4771-8da6-bf9448c97742 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:11.828812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c7d624a-879c-4771-8da6-bf9448c97742 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:12.738221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2c7d624a-879c-4771-8da6-bf9448c97742 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:12.776989 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2c7d624a-879c-4771-8da6-bf9448c97742 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.018723 Aug 25 12:57:12.782778 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1150/2359] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:11 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:12.799141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-73a3a655-ed8b-49c5-8fef-c8def4f13b96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:12.802752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-73a3a655-ed8b-49c5-8fef-c8def4f13b96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:12.830563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73a3a655-ed8b-49c5-8fef-c8def4f13b96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:12.831461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73a3a655-ed8b-49c5-8fef-c8def4f13b96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:12.832282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73a3a655-ed8b-49c5-8fef-c8def4f13b96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:12.840262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73a3a655-ed8b-49c5-8fef-c8def4f13b96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:12.846972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73a3a655-ed8b-49c5-8fef-c8def4f13b96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:12.848395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73a3a655-ed8b-49c5-8fef-c8def4f13b96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:13.624258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-73a3a655-ed8b-49c5-8fef-c8def4f13b96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:13.680571 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-73a3a655-ed8b-49c5-8fef-c8def4f13b96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1503 microversion: 2.1 time: 0.895870 Aug 25 12:57:13.686257 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1151/2360] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:12 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1503 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:13.737996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7f007604-9265-4ff4-86e6-9ff144e8041b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1161276744"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:13.739037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7f007604-9265-4ff4-86e6-9ff144e8041b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:13.765315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f007604-9265-4ff4-86e6-9ff144e8041b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:13.769907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f007604-9265-4ff4-86e6-9ff144e8041b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:13.775848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f007604-9265-4ff4-86e6-9ff144e8041b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:13.778491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f007604-9265-4ff4-86e6-9ff144e8041b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:13.780525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f007604-9265-4ff4-86e6-9ff144e8041b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:13.781340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f007604-9265-4ff4-86e6-9ff144e8041b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:14.329085 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.network.security_group_api [None req-7f007604-9265-4ff4-86e6-9ff144e8041b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Adding security group 3736a837-ccb0-4f24-ab62-3b8d12984552 to port 4358b2d8-828a-475b-8e47-a1d534789187 Aug 25 12:57:17.768801 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7f007604-9265-4ff4-86e6-9ff144e8041b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e/action" status: 202 len: 0 microversion: 2.1 time: 4.040015 Aug 25 12:57:17.787760 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1152/2361] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:57:13 2022] POST /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e/action => generated 0 bytes in 4061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:57:17.819766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:17.822986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:17.903413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=43 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:17.919669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:17.926464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:17.930516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:17.937722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:17.939485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:17.941883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:18.990079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:19.012875 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.218561 Aug 25 12:57:19.024237 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1153/2362] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:17 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:19.040332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:19.061662 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5d0af16e-f207-4eb5-9b3c-21619c8e19ae tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.022031 Aug 25 12:57:19.063228 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1154/2363] 10.222.0.70 () {56 vars in 886 bytes} [Thu Aug 25 12:57:19 2022] GET /compute/ => generated 377 bytes in 38 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 25 12:57:19.085496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3384b490-359f-4edb-96a4-0bdcb09c3fc4 req-2be9361e-81ad-4a4d-adb4-e28f01c5ca74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24695ae5-f061-4367-ba68-ba09b5e60cd8", "name": "network-vif-unplugged", "status": "completed", "tag": "bf435e69-cad0-4f31-8880-d901851ff9cb"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:19.126735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3384b490-359f-4edb-96a4-0bdcb09c3fc4 req-2be9361e-81ad-4a4d-adb4-e28f01c5ca74 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:19.133270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3384b490-359f-4edb-96a4-0bdcb09c3fc4 req-2be9361e-81ad-4a4d-adb4-e28f01c5ca74 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:19.135803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3384b490-359f-4edb-96a4-0bdcb09c3fc4 req-2be9361e-81ad-4a4d-adb4-e28f01c5ca74 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:19.187309 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3384b490-359f-4edb-96a4-0bdcb09c3fc4 req-2be9361e-81ad-4a4d-adb4-e28f01c5ca74 service nova] Creating event network-vif-unplugged:bf435e69-cad0-4f31-8880-d901851ff9cb for instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 on n-h2-852771-8 Aug 25 12:57:19.213024 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3384b490-359f-4edb-96a4-0bdcb09c3fc4 req-2be9361e-81ad-4a4d-adb4-e28f01c5ca74 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146494 Aug 25 12:57:19.214648 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1155/2364] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:19.239202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6db47b3a-b16c-40bf-8b87-4f6b09c33393 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2042658937"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:19.250877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6db47b3a-b16c-40bf-8b87-4f6b09c33393 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:19.281924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6db47b3a-b16c-40bf-8b87-4f6b09c33393 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:19.283299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6db47b3a-b16c-40bf-8b87-4f6b09c33393 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:19.284200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6db47b3a-b16c-40bf-8b87-4f6b09c33393 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:19.285903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6db47b3a-b16c-40bf-8b87-4f6b09c33393 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:19.286992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6db47b3a-b16c-40bf-8b87-4f6b09c33393 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:19.287977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6db47b3a-b16c-40bf-8b87-4f6b09c33393 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:20.190313 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.network.security_group_api [None req-6db47b3a-b16c-40bf-8b87-4f6b09c33393 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Adding security group 7089421e-3bc1-46fb-a07d-bdc295a9d93c to port 4358b2d8-828a-475b-8e47-a1d534789187 Aug 25 12:57:20.640648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=13 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:21.065605 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-53a2d6f5-d6a6-475b-b753-c30d2440ce4a tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.458390 Aug 25 12:57:21.067561 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1210/2365] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 12:57:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:21.070753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-53a2d6f5-d6a6-475b-b753-c30d2440ce4a tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:21.073819 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-53a2d6f5-d6a6-475b-b753-c30d2440ce4a tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003903 Aug 25 12:57:21.085158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1211/2366] 10.222.0.70 () {54 vars in 1035 bytes} [Thu Aug 25 12:57:21 2022] GET /compute/v2/ => generated 379 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 25 12:57:21.108042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:21.109244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:21.161568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:21.162090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:21.162925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:21.164886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:21.172607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:21.174065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:21.734337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:21.775894 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 0.679139 Aug 25 12:57:21.779649 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1212/2367] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:21 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:21.784053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:21.792868 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da277779-1884-441d-a012-264113c7a4ee tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.006708 Aug 25 12:57:21.810564 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1213/2368] 10.222.0.70 () {54 vars in 1041 bytes} [Thu Aug 25 12:57:21 2022] GET /compute/v2.1/ => generated 388 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:21.843157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5239402f-47db-4246-af98-40c27778f8eb req-d8c12bc6-9448-430d-a614-20bb5962cb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16f93e2-3483-45a3-bb63-db445da43d3e", "tag": "4358b2d8-828a-475b-8e47-a1d534789187"}, {"name": "network-changed", "server_uuid": "24695ae5-f061-4367-ba68-ba09b5e60cd8", "tag": "bf435e69-cad0-4f31-8880-d901851ff9cb"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:21.892267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5239402f-47db-4246-af98-40c27778f8eb req-d8c12bc6-9448-430d-a614-20bb5962cb99 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:21.898920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5239402f-47db-4246-af98-40c27778f8eb req-d8c12bc6-9448-430d-a614-20bb5962cb99 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:21.902064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5239402f-47db-4246-af98-40c27778f8eb req-d8c12bc6-9448-430d-a614-20bb5962cb99 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:21.936944 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5239402f-47db-4246-af98-40c27778f8eb req-d8c12bc6-9448-430d-a614-20bb5962cb99 service nova] Creating event network-changed:4358b2d8-828a-475b-8e47-a1d534789187 for instance b16f93e2-3483-45a3-bb63-db445da43d3e on n-h1-852771-8 Aug 25 12:57:21.938673 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5239402f-47db-4246-af98-40c27778f8eb req-d8c12bc6-9448-430d-a614-20bb5962cb99 service nova] Creating event network-changed:bf435e69-cad0-4f31-8880-d901851ff9cb for instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 on n-h2-852771-8 Aug 25 12:57:21.996458 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5239402f-47db-4246-af98-40c27778f8eb req-d8c12bc6-9448-430d-a614-20bb5962cb99 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.177994 Aug 25 12:57:21.998640 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1214/2369] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:22.031462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1253906619", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "76635244-431e-41b7-9377-f49623b762de"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:22.248665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] validate_networks() for [('76635244-431e-41b7-9377-f49623b762de', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:57:23.070132 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6db47b3a-b16c-40bf-8b87-4f6b09c33393 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e/action" status: 202 len: 0 microversion: 2.1 time: 3.850479 Aug 25 12:57:23.076269 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1156/2370] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:57:19 2022] POST /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e/action => generated 0 bytes in 3856 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:57:23.091558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:23.128345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:23.130137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Searching by: {'deleted': False, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:57:23.145696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:23.147571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:23.148410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:23.150614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:23.151586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:23.152401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:23.246672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:57:23.353380 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.278130 Aug 25 12:57:23.366409 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1157/2371] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 12:57:23 2022] GET /compute/v2.1/servers => generated 344 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:23.369391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:23.383255 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-92d01336-21eb-428e-882f-a2f8df4a4900 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.008367 Aug 25 12:57:23.384688 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1158/2372] 10.222.0.70 () {56 vars in 886 bytes} [Thu Aug 25 12:57:23 2022] GET /compute/ => generated 377 bytes in 18 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 25 12:57:23.434355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-abddb3ee-620f-419a-a498-14ed1105c4ab tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:23.436488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-abddb3ee-620f-419a-a498-14ed1105c4ab tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:23.456707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abddb3ee-620f-419a-a498-14ed1105c4ab tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:23.458571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abddb3ee-620f-419a-a498-14ed1105c4ab tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:23.459922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abddb3ee-620f-419a-a498-14ed1105c4ab tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:23.461661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abddb3ee-620f-419a-a498-14ed1105c4ab tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:23.463584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abddb3ee-620f-419a-a498-14ed1105c4ab tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:23.464914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abddb3ee-620f-419a-a498-14ed1105c4ab tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:24.742377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-abddb3ee-620f-419a-a498-14ed1105c4ab tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:24.815507 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-abddb3ee-620f-419a-a498-14ed1105c4ab tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.428453 Aug 25 12:57:24.842873 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1159/2373] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:23 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:24.876498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8b0cd87-85cc-489d-acbf-2d762b8338d6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:24.882374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8b0cd87-85cc-489d-acbf-2d762b8338d6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:24.912947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b0cd87-85cc-489d-acbf-2d762b8338d6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:24.914210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b0cd87-85cc-489d-acbf-2d762b8338d6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:24.915366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b0cd87-85cc-489d-acbf-2d762b8338d6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:24.916673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b0cd87-85cc-489d-acbf-2d762b8338d6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:24.917477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b0cd87-85cc-489d-acbf-2d762b8338d6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:24.925626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b0cd87-85cc-489d-acbf-2d762b8338d6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:25.608373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:57:25.609217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:57:25.610301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:57:25.611118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:57:25.612097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:57:25.675342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:25.691387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:25.695368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:25.697942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:25.699864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:25.700945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:25.799994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Getting quotas for project b4719646f1444a8ea7977af53061340a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:57:25.820424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Getting quotas for user 21f364ac015b44eb91ba63481f8595b4 and project b4719646f1444a8ea7977af53061340a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:57:25.873068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:57:25.881139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:57:26.113169 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e370bf9b-c19f-4d63-a816-1f08339785d9 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.108466 Aug 25 12:57:26.113169 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1215/2374] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:57:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:57:26.170418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:26.222974 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8b0cd87-85cc-489d-acbf-2d762b8338d6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 1.363063 Aug 25 12:57:26.225045 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1160/2375] 10.222.0.70 () {58 vars in 1293 bytes} [Thu Aug 25 12:57:24 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e/os-security-groups => generated 1159 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:26.252301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:26.264163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-140c7b48-e6c2-4414-95fc-856ccfbe6d78 req-509a103d-0a2d-4b5c-9a34-1146c235bc8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16f93e2-3483-45a3-bb63-db445da43d3e", "tag": "4358b2d8-828a-475b-8e47-a1d534789187"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:26.278524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Searching by: {'deleted': False, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:57:26.335683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-140c7b48-e6c2-4414-95fc-856ccfbe6d78 req-509a103d-0a2d-4b5c-9a34-1146c235bc8e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:26.346314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-140c7b48-e6c2-4414-95fc-856ccfbe6d78 req-509a103d-0a2d-4b5c-9a34-1146c235bc8e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:26.349095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-140c7b48-e6c2-4414-95fc-856ccfbe6d78 req-509a103d-0a2d-4b5c-9a34-1146c235bc8e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:26.356576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:26.367462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:26.383303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:26.398898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:26.408421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:26.409383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:26.492538 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-140c7b48-e6c2-4414-95fc-856ccfbe6d78 req-509a103d-0a2d-4b5c-9a34-1146c235bc8e service nova] Creating event network-changed:4358b2d8-828a-475b-8e47-a1d534789187 for instance b16f93e2-3483-45a3-bb63-db445da43d3e on n-h1-852771-8 Aug 25 12:57:26.516127 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-140c7b48-e6c2-4414-95fc-856ccfbe6d78 req-509a103d-0a2d-4b5c-9a34-1146c235bc8e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288153 Aug 25 12:57:26.521968 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1161/2376] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:26.537330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-98aa36f1-fa07-4c01-b8e9-778957fe4c56 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:26.554378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-98aa36f1-fa07-4c01-b8e9-778957fe4c56 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:26.589072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98aa36f1-fa07-4c01-b8e9-778957fe4c56 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:26.598141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98aa36f1-fa07-4c01-b8e9-778957fe4c56 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:26.599464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98aa36f1-fa07-4c01-b8e9-778957fe4c56 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:26.605608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98aa36f1-fa07-4c01-b8e9-778957fe4c56 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:26.606556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98aa36f1-fa07-4c01-b8e9-778957fe4c56 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:26.607373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98aa36f1-fa07-4c01-b8e9-778957fe4c56 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:26.660826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:57:26.765864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:26.837612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:26.897297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:26.904680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:26.908884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:27.883498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-98aa36f1-fa07-4c01-b8e9-778957fe4c56 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:27.885399 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c4982452-aa6f-4506-9e10-4013da7baa18 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 1.770678 Aug 25 12:57:27.906188 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1216/2377] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:57:26 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:27.928604 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-98aa36f1-fa07-4c01-b8e9-778957fe4c56 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.401656 Aug 25 12:57:27.933303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-491f78c5-d587-4343-8508-241edfe04445 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:27.945415 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1162/2378] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:26 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:27.959741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-491f78c5-d587-4343-8508-241edfe04445 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:27.973678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d1af0e4f-d8c0-4f1e-b5b3-d2eeb896f558 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: .version_select at 0x7f3a2a3efc10>, body: {"security_group": {"name": " tempest-securitygroup -538504948 ", "description": "tempest-description-1784451714"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:28.405172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-491f78c5-d587-4343-8508-241edfe04445 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:28.450066 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-491f78c5-d587-4343-8508-241edfe04445 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1224 microversion: 2.1 time: 0.534538 Aug 25 12:57:28.458317 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1217/2379] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:27 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1224 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:28.506520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8f515392-ba43-40d5-9951-9a29ecce2f25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:28.507368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8f515392-ba43-40d5-9951-9a29ecce2f25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:28.559418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f515392-ba43-40d5-9951-9a29ecce2f25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:28.560274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f515392-ba43-40d5-9951-9a29ecce2f25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:28.561099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f515392-ba43-40d5-9951-9a29ecce2f25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:28.576545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f515392-ba43-40d5-9951-9a29ecce2f25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:28.577552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f515392-ba43-40d5-9951-9a29ecce2f25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:28.578264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8f515392-ba43-40d5-9951-9a29ecce2f25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:28.720121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8f515392-ba43-40d5-9951-9a29ecce2f25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:57:29.052739 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8f515392-ba43-40d5-9951-9a29ecce2f25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 204 len: 0 microversion: 2.1 time: 0.590441 Aug 25 12:57:29.058531 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1218/2380] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:57:28 2022] DELETE /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:57:29.068573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3780d95f-8e2b-4dbf-8cf4-e1989f91d4b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:29.110486 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3780d95f-8e2b-4dbf-8cf4-e1989f91d4b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049513 Aug 25 12:57:29.117058 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1219/2381] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:57:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:29.145263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85ef8437-a1c3-488c-a0ed-aab3f2439252 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:29.148105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85ef8437-a1c3-488c-a0ed-aab3f2439252 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:29.162418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85ef8437-a1c3-488c-a0ed-aab3f2439252 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:29.165056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85ef8437-a1c3-488c-a0ed-aab3f2439252 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:29.166672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85ef8437-a1c3-488c-a0ed-aab3f2439252 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:29.168627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85ef8437-a1c3-488c-a0ed-aab3f2439252 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:29.169968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85ef8437-a1c3-488c-a0ed-aab3f2439252 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:29.171135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85ef8437-a1c3-488c-a0ed-aab3f2439252 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:29.260577 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d1af0e4f-d8c0-4f1e-b5b3-d2eeb896f558 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.300693 Aug 25 12:57:29.263049 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1163/2382] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:57:27 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:29.297552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-af8f7af8-20a4-4bc0-91af-4821247bc1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:29.298623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-af8f7af8-20a4-4bc0-91af-4821247bc1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:29.339346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af8f7af8-20a4-4bc0-91af-4821247bc1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:29.346629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af8f7af8-20a4-4bc0-91af-4821247bc1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:29.351352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af8f7af8-20a4-4bc0-91af-4821247bc1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:29.359464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af8f7af8-20a4-4bc0-91af-4821247bc1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:29.379886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af8f7af8-20a4-4bc0-91af-4821247bc1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:29.383897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af8f7af8-20a4-4bc0-91af-4821247bc1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:30.096435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-85ef8437-a1c3-488c-a0ed-aab3f2439252 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:30.124951 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85ef8437-a1c3-488c-a0ed-aab3f2439252 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.005447 Aug 25 12:57:30.147695 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1220/2383] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:29 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:30.162525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93dbfe50-553f-4aa2-94bb-2481528f1bcc tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2e93c790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:30.434125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-af8f7af8-20a4-4bc0-91af-4821247bc1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:30.450541 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-93dbfe50-553f-4aa2-94bb-2481528f1bcc tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/ad2a370f-9376-49b6-9089-df1323f98e88" status: 200 len: 223 microversion: 2.1 time: 0.306820 Aug 25 12:57:30.451740 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1221/2384] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:57:30 2022] GET /compute/v2.1/os-security-groups/ad2a370f-9376-49b6-9089-df1323f98e88 => generated 223 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:30.469542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97e92b75-f1a5-48a9-9d7a-9e50c77b353b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:30.489338 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-af8f7af8-20a4-4bc0-91af-4821247bc1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1554 microversion: 2.1 time: 1.223764 Aug 25 12:57:30.490869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-97e92b75-f1a5-48a9-9d7a-9e50c77b353b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:30.515311 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1164/2385] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:29 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1554 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:30.545491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97e92b75-f1a5-48a9-9d7a-9e50c77b353b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:30.559161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97e92b75-f1a5-48a9-9d7a-9e50c77b353b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:30.561287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fc8dadb9-950f-4d94-a116-5110661ed8ee tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:30.562676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97e92b75-f1a5-48a9-9d7a-9e50c77b353b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:30.568632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fc8dadb9-950f-4d94-a116-5110661ed8ee tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:30.573428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97e92b75-f1a5-48a9-9d7a-9e50c77b353b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:30.574820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97e92b75-f1a5-48a9-9d7a-9e50c77b353b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:30.582609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97e92b75-f1a5-48a9-9d7a-9e50c77b353b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:30.615128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc8dadb9-950f-4d94-a116-5110661ed8ee tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:30.618101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc8dadb9-950f-4d94-a116-5110661ed8ee tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:30.623546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc8dadb9-950f-4d94-a116-5110661ed8ee tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:30.632071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc8dadb9-950f-4d94-a116-5110661ed8ee tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:30.636220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc8dadb9-950f-4d94-a116-5110661ed8ee tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:30.638013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc8dadb9-950f-4d94-a116-5110661ed8ee tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:30.751680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-97e92b75-f1a5-48a9-9d7a-9e50c77b353b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:57:31.032227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc8dadb9-950f-4d94-a116-5110661ed8ee tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:31.060017 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fc8dadb9-950f-4d94-a116-5110661ed8ee tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1282 microversion: 2.1 time: 0.532954 Aug 25 12:57:31.085050 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1165/2386] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:30 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1282 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:31.113616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1e7b0d91-8e88-4de9-8fef-901053431677 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2e916280>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:31.228791 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-97e92b75-f1a5-48a9-9d7a-9e50c77b353b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 204 len: 0 microversion: 2.1 time: 0.771982 Aug 25 12:57:31.234013 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1222/2387] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:57:30 2022] DELETE /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:57:31.251589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74daac20-42ca-4511-a775-9ba783771679 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:31.255268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74daac20-42ca-4511-a775-9ba783771679 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:31.288262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74daac20-42ca-4511-a775-9ba783771679 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:31.294194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74daac20-42ca-4511-a775-9ba783771679 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:31.295832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74daac20-42ca-4511-a775-9ba783771679 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:31.298964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74daac20-42ca-4511-a775-9ba783771679 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:31.302329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74daac20-42ca-4511-a775-9ba783771679 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:31.312401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74daac20-42ca-4511-a775-9ba783771679 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:32.058254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74daac20-42ca-4511-a775-9ba783771679 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:32.080149 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74daac20-42ca-4511-a775-9ba783771679 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 0.843088 Aug 25 12:57:32.090428 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1223/2388] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:31 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:32.108497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0b6e3ec7-2917-4e39-b29b-ed25c7947d7a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:32.110457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0b6e3ec7-2917-4e39-b29b-ed25c7947d7a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:32.134449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b6e3ec7-2917-4e39-b29b-ed25c7947d7a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:32.135285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b6e3ec7-2917-4e39-b29b-ed25c7947d7a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:32.136054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b6e3ec7-2917-4e39-b29b-ed25c7947d7a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:32.161707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b6e3ec7-2917-4e39-b29b-ed25c7947d7a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:32.172460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b6e3ec7-2917-4e39-b29b-ed25c7947d7a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:32.173272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b6e3ec7-2917-4e39-b29b-ed25c7947d7a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:32.374060 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1e7b0d91-8e88-4de9-8fef-901053431677 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/ad2a370f-9376-49b6-9089-df1323f98e88" status: 202 len: 0 microversion: 2.1 time: 1.286229 Aug 25 12:57:32.376558 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1166/2389] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:57:31 2022] DELETE /compute/v2.1/os-security-groups/ad2a370f-9376-49b6-9089-df1323f98e88 => generated 0 bytes in 1290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:57:32.394120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b9dd0d6-0d7e-424a-af8e-9f13668d47ec tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:32.399123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b9dd0d6-0d7e-424a-af8e-9f13668d47ec tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:32.446113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b9dd0d6-0d7e-424a-af8e-9f13668d47ec tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:32.448667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b9dd0d6-0d7e-424a-af8e-9f13668d47ec tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:32.454588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b9dd0d6-0d7e-424a-af8e-9f13668d47ec tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:32.464292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b9dd0d6-0d7e-424a-af8e-9f13668d47ec tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:32.465342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b9dd0d6-0d7e-424a-af8e-9f13668d47ec tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:32.466208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b9dd0d6-0d7e-424a-af8e-9f13668d47ec tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:32.970905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0b6e3ec7-2917-4e39-b29b-ed25c7947d7a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:33.004757 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0b6e3ec7-2917-4e39-b29b-ed25c7947d7a tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1609 microversion: 2.1 time: 0.911768 Aug 25 12:57:33.013098 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1224/2390] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:32 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1609 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:33.041637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cda16e38-df25-414b-831c-a1d344360edb tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:33.043953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cda16e38-df25-414b-831c-a1d344360edb tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:33.060514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cda16e38-df25-414b-831c-a1d344360edb tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:33.062096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cda16e38-df25-414b-831c-a1d344360edb tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:33.063647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cda16e38-df25-414b-831c-a1d344360edb tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:33.065300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cda16e38-df25-414b-831c-a1d344360edb tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:33.066574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cda16e38-df25-414b-831c-a1d344360edb tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:33.067638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cda16e38-df25-414b-831c-a1d344360edb tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:33.113732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b9dd0d6-0d7e-424a-af8e-9f13668d47ec tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:33.155529 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b9dd0d6-0d7e-424a-af8e-9f13668d47ec tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1554 microversion: 2.1 time: 0.773374 Aug 25 12:57:33.157728 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1167/2391] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:32 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1554 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:33.185147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e00d9c39-84b9-4cb9-8adb-ba1d40a31cc9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a004f70>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:33.209400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:33.302755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cda16e38-df25-414b-831c-a1d344360edb tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:33.307272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-e00d9c39-84b9-4cb9-8adb-ba1d40a31cc9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:57:33.310024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.security_group_api [None req-e00d9c39-84b9-4cb9-8adb-ba1d40a31cc9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Neutron security group ad2a370f-9376-49b6-9089-df1323f98e88 not found {{(pid=129059) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:57:33.311838 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-e00d9c39-84b9-4cb9-8adb-ba1d40a31cc9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:57:33.311838 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-643c76e1-91c6-4b88-89c6-04b3841d7b4f'] Aug 25 12:57:33.317026 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cda16e38-df25-414b-831c-a1d344360edb tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1282 microversion: 2.1 time: 0.301495 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e00d9c39-84b9-4cb9-8adb-ba1d40a31cc9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-security-groups/ad2a370f-9376-49b6-9089-df1323f98e88 HTTP/1.1 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: exception: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-643c76e1-91c6-4b88-89c6-04b3841d7b4f'] Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ad2a370f-9376-49b6-9089-df1323f98e88'} Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:57:33.318658 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-643c76e1-91c6-4b88-89c6-04b3841d7b4f'] Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-643c76e1-91c6-4b88-89c6-04b3841d7b4f'] Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-643c76e1-91c6-4b88-89c6-04b3841d7b4f'] Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-643c76e1-91c6-4b88-89c6-04b3841d7b4f'] Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e00d9c39-84b9-4cb9-8adb-ba1d40a31cc9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:57:33.343172 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-643c76e1-91c6-4b88-89c6-04b3841d7b4f'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:33.353298 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1225/2392] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:33 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1282 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:33.353667 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e00d9c39-84b9-4cb9-8adb-ba1d40a31cc9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/ad2a370f-9376-49b6-9089-df1323f98e88" status: 404 len: 194 microversion: 2.1 time: 0.172031 Aug 25 12:57:33.353667 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1168/2393] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:57:33 2022] GET /compute/v2.1/os-security-groups/ad2a370f-9376-49b6-9089-df1323f98e88 => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:57:33.363444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ccc0bc84-771a-466d-bb44-e2107a00de71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:33.365880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ccc0bc84-771a-466d-bb44-e2107a00de71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:33.385455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccc0bc84-771a-466d-bb44-e2107a00de71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:33.387969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccc0bc84-771a-466d-bb44-e2107a00de71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:33.389191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccc0bc84-771a-466d-bb44-e2107a00de71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:33.390975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccc0bc84-771a-466d-bb44-e2107a00de71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:33.392277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccc0bc84-771a-466d-bb44-e2107a00de71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:33.393551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccc0bc84-771a-466d-bb44-e2107a00de71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:33.801780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ccc0bc84-771a-466d-bb44-e2107a00de71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:33.827212 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ccc0bc84-771a-466d-bb44-e2107a00de71 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 0.490367 Aug 25 12:57:33.843892 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1169/2394] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:33 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:33.881253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-621e56f9-d6ed-4bc2-8213-471d86dd6a28 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: .version_select at 0x7f3a2e7d63a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-365213058", "description": "tempest-description-998253384"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:34.143305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-14347b20-4177-4dfb-b31c-12045c2786e3 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Action: 'create', calling method: .version_select at 0x7f3a2e75f040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-555053205", "metadata": {"Type": "work"}}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-14347b20-4177-4dfb-b31c-12045c2786e3 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Request method failure captured: Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 121 Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3G8Ktkb9d2OLtYxGXjRJopX__xqTICyo3go2S6BzOjlkHiuu-SGM05f7nMVZMHE6m0vtWh2B9Z_tSRuWxzs7U-pZJgE7pwcb5WpETqae6Z8lcG5lYoNAtU9DKaN_OMoa3iKUzTsT53-g2t5f7QOpNsK-bDnlhi3UdndOGdZxZ_j5EA Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a0d59eff602b4485b8806de981757838", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a0d59eff602b4485b8806de981757838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}] Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 3efa9af481d14442852f9df4efe07782 Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-555053205", "metadata": {"Type": "work"}}} Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-555053205', 'metadata': {'Type': 'work'}}}} Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi '#$%' Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:57:34.153197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:34.174595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-14347b20-4177-4dfb-b31c-12045c2786e3 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:34.210409 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-14347b20-4177-4dfb-b31c-12045c2786e3 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.833992 Aug 25 12:57:34.213044 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1226/2395] 10.222.0.70 () {60 vars in 1156 bytes} [Thu Aug 25 12:57:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 878 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:57:34.231759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5479c405-097c-4fce-b34d-c1a88f72d094 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:34.233487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5479c405-097c-4fce-b34d-c1a88f72d094 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:34.265710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5479c405-097c-4fce-b34d-c1a88f72d094 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:34.266623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5479c405-097c-4fce-b34d-c1a88f72d094 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:34.268710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5479c405-097c-4fce-b34d-c1a88f72d094 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:34.270135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5479c405-097c-4fce-b34d-c1a88f72d094 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:34.270991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5479c405-097c-4fce-b34d-c1a88f72d094 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:34.271679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5479c405-097c-4fce-b34d-c1a88f72d094 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:34.299621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:34.413390 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-621e56f9-d6ed-4bc2-8213-471d86dd6a28 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.552804 Aug 25 12:57:34.416607 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1170/2396] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:57:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:34.433478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-931024fe-6d54-48d9-9d3d-72a6e0bea96b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:34.434972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-931024fe-6d54-48d9-9d3d-72a6e0bea96b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:34.466625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-931024fe-6d54-48d9-9d3d-72a6e0bea96b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:34.467596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-931024fe-6d54-48d9-9d3d-72a6e0bea96b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:34.473070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-931024fe-6d54-48d9-9d3d-72a6e0bea96b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:34.474612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-931024fe-6d54-48d9-9d3d-72a6e0bea96b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:34.476934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-931024fe-6d54-48d9-9d3d-72a6e0bea96b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:34.479937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-931024fe-6d54-48d9-9d3d-72a6e0bea96b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:35.580860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5479c405-097c-4fce-b34d-c1a88f72d094 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:35.599125 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5479c405-097c-4fce-b34d-c1a88f72d094 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1609 microversion: 2.1 time: 1.382852 Aug 25 12:57:35.630234 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1227/2397] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:34 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1609 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:35.641226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f93143f-f4b0-4ef9-b538-11cd8e0af631 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Action: 'create', calling method: .version_select at 0x7f3a2a3a2dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1582484949", "metadata": {"Type": "work"}}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f93143f-f4b0-4ef9-b538-11cd8e0af631 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Request method failure captured: Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 120 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3G8Ktkb9d2OLtYxGXjRJopX__xqTICyo3go2S6BzOjlkHiuu-SGM05f7nMVZMHE6m0vtWh2B9Z_tSRuWxzs7U-pZJgE7pwcb5WpETqae6Z8lcG5lYoNAtU9DKaN_OMoa3iKUzTsT53-g2t5f7QOpNsK-bDnlhi3UdndOGdZxZ_j5EA Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a0d59eff602b4485b8806de981757838", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a0d59eff602b4485b8806de981757838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}] Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 3efa9af481d14442852f9df4efe07782 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1582484949", "metadata": {"Type": "work"}}} Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1582484949', 'metadata': {'Type': 'work'}}}} Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi '0' Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:57:35.647820 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 12:57:35.656513 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:35.661113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f93143f-f4b0-4ef9-b538-11cd8e0af631 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:35.662967 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f93143f-f4b0-4ef9-b538-11cd8e0af631 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030604 Aug 25 12:57:35.685095 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1228/2398] 10.222.0.70 () {60 vars in 1156 bytes} [Thu Aug 25 12:57:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:57:35.700049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-550796d2-db00-48bb-8f18-c4078fe69919 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:35.702014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-550796d2-db00-48bb-8f18-c4078fe69919 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:35.730471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-550796d2-db00-48bb-8f18-c4078fe69919 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:35.738058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-550796d2-db00-48bb-8f18-c4078fe69919 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:35.739769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-550796d2-db00-48bb-8f18-c4078fe69919 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:35.741855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-550796d2-db00-48bb-8f18-c4078fe69919 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:35.743237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-550796d2-db00-48bb-8f18-c4078fe69919 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:35.744560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-550796d2-db00-48bb-8f18-c4078fe69919 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:35.796880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-931024fe-6d54-48d9-9d3d-72a6e0bea96b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:35.846668 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-931024fe-6d54-48d9-9d3d-72a6e0bea96b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1554 microversion: 2.1 time: 1.424907 Aug 25 12:57:35.852534 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1171/2399] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:34 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1554 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:35.876960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-22390943-d9f9-4fb2-9b52-13b2ed880229 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: .version_select at 0x7f3a29fc9ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1389992679", "description": "tempest-description-725890076"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:36.006072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-550796d2-db00-48bb-8f18-c4078fe69919 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:36.031764 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-550796d2-db00-48bb-8f18-c4078fe69919 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1282 microversion: 2.1 time: 0.343795 Aug 25 12:57:36.070114 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1229/2400] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:35 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1282 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:36.089915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0430cfb8-1602-4783-a7c9-ac29cb17fe15 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:36.090953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0430cfb8-1602-4783-a7c9-ac29cb17fe15 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:36.103522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0430cfb8-1602-4783-a7c9-ac29cb17fe15 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:36.104773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0430cfb8-1602-4783-a7c9-ac29cb17fe15 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:36.105836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0430cfb8-1602-4783-a7c9-ac29cb17fe15 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:36.107540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0430cfb8-1602-4783-a7c9-ac29cb17fe15 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:36.108504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0430cfb8-1602-4783-a7c9-ac29cb17fe15 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:36.109958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0430cfb8-1602-4783-a7c9-ac29cb17fe15 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:36.568278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:36.610277 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-22390943-d9f9-4fb2-9b52-13b2ed880229 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.751688 Aug 25 12:57:36.612306 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1172/2401] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:57:35 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:36.632045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b04e9958-ad40-41ef-8233-5b26cd6e54c6 req-12690a64-2c7f-40f2-b7fc-3fa1cfe27a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48a5d0b-80f0-43cf-a5b4-50707002de75", "name": "network-vif-unplugged", "status": "completed", "tag": "2e1d4e9f-8326-4a76-bf2f-01736ee09112"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:36.677167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b04e9958-ad40-41ef-8233-5b26cd6e54c6 req-12690a64-2c7f-40f2-b7fc-3fa1cfe27a50 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:36.678961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b04e9958-ad40-41ef-8233-5b26cd6e54c6 req-12690a64-2c7f-40f2-b7fc-3fa1cfe27a50 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:36.680079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b04e9958-ad40-41ef-8233-5b26cd6e54c6 req-12690a64-2c7f-40f2-b7fc-3fa1cfe27a50 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:36.714875 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b04e9958-ad40-41ef-8233-5b26cd6e54c6 req-12690a64-2c7f-40f2-b7fc-3fa1cfe27a50 service nova] Creating event network-vif-unplugged:2e1d4e9f-8326-4a76-bf2f-01736ee09112 for instance d48a5d0b-80f0-43cf-a5b4-50707002de75 on n-h2-852771-8 Aug 25 12:57:36.732628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b04e9958-ad40-41ef-8233-5b26cd6e54c6 req-12690a64-2c7f-40f2-b7fc-3fa1cfe27a50 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110371 Aug 25 12:57:36.735577 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1173/2402] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:36.748566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ddde4321-a4db-42c1-994b-5136ef11d2a2 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Action: 'create', calling method: .version_select at 0x7f3a29fc94c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-322165215", "metadata": {"Type": "work"}}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ddde4321-a4db-42c1-994b-5136ef11d2a2 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Request method failure captured: Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 118 Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3G8Ktkb9d2OLtYxGXjRJopX__xqTICyo3go2S6BzOjlkHiuu-SGM05f7nMVZMHE6m0vtWh2B9Z_tSRuWxzs7U-pZJgE7pwcb5WpETqae6Z8lcG5lYoNAtU9DKaN_OMoa3iKUzTsT53-g2t5f7QOpNsK-bDnlhi3UdndOGdZxZ_j5EA Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a0d59eff602b4485b8806de981757838", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a0d59eff602b4485b8806de981757838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}] Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3efa9af481d14442852f9df4efe07782 Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-322165215", "metadata": {"Type": "work"}}} Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-322165215', 'metadata': {'Type': 'work'}}}} Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi '' Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:57:36.756695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 12:57:36.775376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:36.777541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0430cfb8-1602-4783-a7c9-ac29cb17fe15 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:36.778404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ddde4321-a4db-42c1-994b-5136ef11d2a2 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:36.778404 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ddde4321-a4db-42c1-994b-5136ef11d2a2 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022398 Aug 25 12:57:36.778404 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1174/2403] 10.222.0.70 () {60 vars in 1156 bytes} [Thu Aug 25 12:57:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:57:36.786755 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0430cfb8-1602-4783-a7c9-ac29cb17fe15 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 0.714016 Aug 25 12:57:36.787908 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1230/2404] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:36 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:36.797293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0f7283d-3a0c-4d89-bce2-16ae9a88b642 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: .version_select at 0x7f3a2e7d6040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1007735115", "description": "tempest-description-1246535258"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:36.849930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-257b4abe-40c7-4ee8-9302-8c78003c7a1b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:36.851765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-257b4abe-40c7-4ee8-9302-8c78003c7a1b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:36.886616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-257b4abe-40c7-4ee8-9302-8c78003c7a1b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:36.891835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-257b4abe-40c7-4ee8-9302-8c78003c7a1b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:36.893601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-257b4abe-40c7-4ee8-9302-8c78003c7a1b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:36.895663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-257b4abe-40c7-4ee8-9302-8c78003c7a1b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:36.897354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-257b4abe-40c7-4ee8-9302-8c78003c7a1b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:36.898594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-257b4abe-40c7-4ee8-9302-8c78003c7a1b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:37.363066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-257b4abe-40c7-4ee8-9302-8c78003c7a1b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:37.405997 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-257b4abe-40c7-4ee8-9302-8c78003c7a1b tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1609 microversion: 2.1 time: 0.596676 Aug 25 12:57:37.407539 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1231/2405] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:36 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1609 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:37.417255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22bf433c-0e67-404d-8e70-96aff846e771 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Calling method '.version_select at 0x7f3a2a6c6f70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:37.518805 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-22bf433c-0e67-404d-8e70-96aff846e771 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] HTTP exception thrown: Volume tempest-invalid-1629375821 could not be found. Aug 25 12:57:37.522868 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d0f7283d-3a0c-4d89-bce2-16ae9a88b642 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.757427 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22bf433c-0e67-404d-8e70-96aff846e771 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Request method failure captured: Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1629375821 HTTP/1.1 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3G8Ktkb9d2OLtYxGXjRJopX__xqTICyo3go2S6BzOjlkHiuu-SGM05f7nMVZMHE6m0vtWh2B9Z_tSRuWxzs7U-pZJgE7pwcb5WpETqae6Z8lcG5lYoNAtU9DKaN_OMoa3iKUzTsT53-g2t5f7QOpNsK-bDnlhi3UdndOGdZxZ_j5EA Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a0d59eff602b4485b8806de981757838", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a0d59eff602b4485b8806de981757838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}] Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 3efa9af481d14442852f9df4efe07782 Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: exception: Volume tempest-invalid-1629375821 could not be found. Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'tempest-invalid-1629375821'} Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1629375821 could not be found. (HTTP 404) (Request-ID: req-a1e1cfc7-8966-449f-8bcf-e5ecb41ed62d) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 12:57:37.523577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1629375821 could not be found. Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1629375821 could not be found. Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1629375821 could not be found. Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22bf433c-0e67-404d-8e70-96aff846e771 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Returning 404 to user: Volume tempest-invalid-1629375821 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22bf433c-0e67-404d-8e70-96aff846e771 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1629375821" status: 404 len: 99 microversion: 2.1 time: 0.118419 Aug 25 12:57:37.532653 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1232/2406] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 12:57:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1629375821 => generated 99 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:57:37.546778 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1175/2407] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:57:36 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:37.557435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-08e1b08b-9a73-4d96-9f16-800e4bf1e44d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:37.559470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-08e1b08b-9a73-4d96-9f16-800e4bf1e44d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:37.564350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5ce30df-ffc1-4e2b-a581-cf68473bfa1f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:37.565587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b5ce30df-ffc1-4e2b-a581-cf68473bfa1f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:37.574691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e1b08b-9a73-4d96-9f16-800e4bf1e44d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:37.575771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e1b08b-9a73-4d96-9f16-800e4bf1e44d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:37.576759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e1b08b-9a73-4d96-9f16-800e4bf1e44d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:37.578209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e1b08b-9a73-4d96-9f16-800e4bf1e44d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:37.579256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e1b08b-9a73-4d96-9f16-800e4bf1e44d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:37.580229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e1b08b-9a73-4d96-9f16-800e4bf1e44d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:37.587687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ce30df-ffc1-4e2b-a581-cf68473bfa1f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:37.589047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ce30df-ffc1-4e2b-a581-cf68473bfa1f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:37.591092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ce30df-ffc1-4e2b-a581-cf68473bfa1f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:37.592903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ce30df-ffc1-4e2b-a581-cf68473bfa1f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:37.594112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ce30df-ffc1-4e2b-a581-cf68473bfa1f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:37.596095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ce30df-ffc1-4e2b-a581-cf68473bfa1f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:37.756889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-08e1b08b-9a73-4d96-9f16-800e4bf1e44d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:37.773289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b5ce30df-ffc1-4e2b-a581-cf68473bfa1f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:37.778848 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-08e1b08b-9a73-4d96-9f16-800e4bf1e44d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1282 microversion: 2.1 time: 0.232922 Aug 25 12:57:37.780078 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1176/2408] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:37 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:37.792083 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-638cced0-93af-449e-8b31-78f523e9acb8 tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007292 Aug 25 12:57:37.795405 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1177/2409] 10.222.0.70 () {58 vars in 1140 bytes} [Thu Aug 25 12:57:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 12:57:37.805005 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b5ce30df-ffc1-4e2b-a581-cf68473bfa1f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1512 microversion: 2.1 time: 0.273667 Aug 25 12:57:37.806499 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1233/2410] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:37 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1512 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:37.811779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0539b750-e0bd-4185-ba5a-7aa4f7da8430 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a3efb80>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:37.833092 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d1b42b8c-75c6-4b9a-b86c-ebd3348e3b5e tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010444 Aug 25 12:57:37.834053 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1234/2411] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 12:57:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 12:57:37.854620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c7e552b7-9c00-4300-8fca-43eeae422d5b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:37.856086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c7e552b7-9c00-4300-8fca-43eeae422d5b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:37.889532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7e552b7-9c00-4300-8fca-43eeae422d5b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:37.891203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7e552b7-9c00-4300-8fca-43eeae422d5b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:37.892561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7e552b7-9c00-4300-8fca-43eeae422d5b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:37.894293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7e552b7-9c00-4300-8fca-43eeae422d5b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:37.895366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7e552b7-9c00-4300-8fca-43eeae422d5b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:37.896175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7e552b7-9c00-4300-8fca-43eeae422d5b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:38.421380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:38.589241 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0539b750-e0bd-4185-ba5a-7aa4f7da8430 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.792081 Aug 25 12:57:38.591208 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1178/2412] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 12:57:37 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:38.612892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d70771a7-21de-45c1-a272-8ca6bac7dd4c tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Calling method '.version_select at 0x7f3a2a591f70>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:38.620063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c7e552b7-9c00-4300-8fca-43eeae422d5b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:38.682574 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c7e552b7-9c00-4300-8fca-43eeae422d5b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 0.837659 Aug 25 12:57:38.700849 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1235/2413] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:37 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:38.733378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a8ebbb5f-dc1d-467e-9ecb-36ecfc685543 req-67ecd1c8-ca47-442b-9b49-63a492f3092a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f4120a-39c6-4978-9fed-e4dc6b49edf2", "name": "network-vif-deleted", "tag": "23baf837-77da-452d-a544-e9e93948b696"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:38.759954 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-d70771a7-21de-45c1-a272-8ca6bac7dd4c tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] HTTP exception thrown: Volume c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65 could not be found. Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d70771a7-21de-45c1-a272-8ca6bac7dd4c tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Request method failure captured: Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-volumes/c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65 HTTP/1.1 Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3G8Ktkb9d2OLtYxGXjRJopX__xqTICyo3go2S6BzOjlkHiuu-SGM05f7nMVZMHE6m0vtWh2B9Z_tSRuWxzs7U-pZJgE7pwcb5WpETqae6Z8lcG5lYoNAtU9DKaN_OMoa3iKUzTsT53-g2t5f7QOpNsK-bDnlhi3UdndOGdZxZ_j5EA Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a0d59eff602b4485b8806de981757838", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a0d59eff602b4485b8806de981757838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}] Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3efa9af481d14442852f9df4efe07782 Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: exception: Volume c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65 could not be found. Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65'} Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65 could not be found. (HTTP 404) (Request-ID: req-cb648522-63bd-47de-a62b-40f45ab5fccd) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 12:57:38.765179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65 could not be found. Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65 could not be found. Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65 could not be found. Aug 25 12:57:38.776396 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:38.784135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a8ebbb5f-dc1d-467e-9ecb-36ecfc685543 req-67ecd1c8-ca47-442b-9b49-63a492f3092a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:38.784135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a8ebbb5f-dc1d-467e-9ecb-36ecfc685543 req-67ecd1c8-ca47-442b-9b49-63a492f3092a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:38.784135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a8ebbb5f-dc1d-467e-9ecb-36ecfc685543 req-67ecd1c8-ca47-442b-9b49-63a492f3092a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:38.784885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d70771a7-21de-45c1-a272-8ca6bac7dd4c tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Returning 404 to user: Volume c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:38.784885 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d70771a7-21de-45c1-a272-8ca6bac7dd4c tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65" status: 404 len: 109 microversion: 2.1 time: 0.176221 Aug 25 12:57:38.795347 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1179/2414] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 12:57:38 2022] DELETE /compute/v2.1/os-volumes/c7a127bc-e3e6-48ac-9bc6-9f8e55b21a65 => generated 109 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:57:38.807146 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a8ebbb5f-dc1d-467e-9ecb-36ecfc685543 req-67ecd1c8-ca47-442b-9b49-63a492f3092a service nova] Creating event network-vif-deleted:23baf837-77da-452d-a544-e9e93948b696 for instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 on n-h1-852771-8 Aug 25 12:57:38.810821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-add0fab7-477d-4b29-be83-32b6d8af8ac4 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:38.812052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-add0fab7-477d-4b29-be83-32b6d8af8ac4 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:38.818574 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a8ebbb5f-dc1d-467e-9ecb-36ecfc685543 req-67ecd1c8-ca47-442b-9b49-63a492f3092a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116203 Aug 25 12:57:38.820006 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1236/2415] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:38.839121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9f16e39-e017-455b-a787-719948eb1849 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a1b9040>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:38.846228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add0fab7-477d-4b29-be83-32b6d8af8ac4 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:38.847145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add0fab7-477d-4b29-be83-32b6d8af8ac4 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:38.847980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add0fab7-477d-4b29-be83-32b6d8af8ac4 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:38.859164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add0fab7-477d-4b29-be83-32b6d8af8ac4 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:38.860029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add0fab7-477d-4b29-be83-32b6d8af8ac4 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:38.860775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add0fab7-477d-4b29-be83-32b6d8af8ac4 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:39.588579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-add0fab7-477d-4b29-be83-32b6d8af8ac4 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:39.620267 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-add0fab7-477d-4b29-be83-32b6d8af8ac4 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1609 microversion: 2.1 time: 0.832519 Aug 25 12:57:39.622455 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1180/2416] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:38 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1609 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:39.653961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-734d0859-9f5d-4d0b-850d-03418f60d87a tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Calling method '.version_select at 0x7f3a29fc9d30>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:39.694019 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9f16e39-e017-455b-a787-719948eb1849 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b" status: 202 len: 0 microversion: 2.1 time: 0.865974 Aug 25 12:57:39.696057 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1237/2417] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:57:38 2022] DELETE /compute/v2.1/os-security-groups/5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:57:39.715891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5fee55ec-044c-4175-83cd-6ae6dfa533e1 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:39.723245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5fee55ec-044c-4175-83cd-6ae6dfa533e1 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:39.753059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fee55ec-044c-4175-83cd-6ae6dfa533e1 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:39.753924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fee55ec-044c-4175-83cd-6ae6dfa533e1 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:39.754402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fee55ec-044c-4175-83cd-6ae6dfa533e1 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:39.755453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fee55ec-044c-4175-83cd-6ae6dfa533e1 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:39.756299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fee55ec-044c-4175-83cd-6ae6dfa533e1 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:39.757091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fee55ec-044c-4175-83cd-6ae6dfa533e1 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:39.772801 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-734d0859-9f5d-4d0b-850d-03418f60d87a tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] HTTP exception thrown: Volume fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76 could not be found. Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-734d0859-9f5d-4d0b-850d-03418f60d87a tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Request method failure captured: Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-volumes/fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76 HTTP/1.1 Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3G8Ktkb9d2OLtYxGXjRJopX__xqTICyo3go2S6BzOjlkHiuu-SGM05f7nMVZMHE6m0vtWh2B9Z_tSRuWxzs7U-pZJgE7pwcb5WpETqae6Z8lcG5lYoNAtU9DKaN_OMoa3iKUzTsT53-g2t5f7QOpNsK-bDnlhi3UdndOGdZxZ_j5EA Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a0d59eff602b4485b8806de981757838", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a0d59eff602b4485b8806de981757838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0d59eff602b4485b8806de981757838"}]}] Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: a0d59eff602b4485b8806de981757838 Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-VolumesNegativeTest-2075615464 Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3efa9af481d14442852f9df4efe07782 Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-VolumesNegativeTest-2075615464-project Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: exception: Volume fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76 could not be found. Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76'} Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76 could not be found. (HTTP 404) (Request-ID: req-b83d1efb-a3c4-454f-beff-655ee57086e4) Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 12:57:39.779114 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76 could not be found. Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76 could not be found. Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76 could not be found. Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-734d0859-9f5d-4d0b-850d-03418f60d87a tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] Returning 404 to user: Volume fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-734d0859-9f5d-4d0b-850d-03418f60d87a tempest-VolumesNegativeTest-2075615464 tempest-VolumesNegativeTest-2075615464-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76" status: 404 len: 109 microversion: 2.1 time: 0.153970 Aug 25 12:57:39.798559 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1181/2418] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 12:57:39 2022] GET /compute/v2.1/os-volumes/fc3d3cac-b2a8-48a6-b2bd-33dd551c4c76 => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:57:39.815408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fcd6a953-b0d0-46a3-81ec-4cd8e5cec7b0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:39.815408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fcd6a953-b0d0-46a3-81ec-4cd8e5cec7b0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:39.869684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcd6a953-b0d0-46a3-81ec-4cd8e5cec7b0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:39.874070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcd6a953-b0d0-46a3-81ec-4cd8e5cec7b0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:39.877149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcd6a953-b0d0-46a3-81ec-4cd8e5cec7b0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:39.879075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcd6a953-b0d0-46a3-81ec-4cd8e5cec7b0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:39.885355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcd6a953-b0d0-46a3-81ec-4cd8e5cec7b0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:39.887009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fcd6a953-b0d0-46a3-81ec-4cd8e5cec7b0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:40.027628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5fee55ec-044c-4175-83cd-6ae6dfa533e1 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:40.058744 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5fee55ec-044c-4175-83cd-6ae6dfa533e1 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1282 microversion: 2.1 time: 0.359541 Aug 25 12:57:40.059946 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1238/2419] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:39 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1282 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:40.081146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2abda0c2-87ae-46a4-b4b8-6c2a102fee43 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a259af0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:40.148411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fcd6a953-b0d0-46a3-81ec-4cd8e5cec7b0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:40.176170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-2abda0c2-87ae-46a4-b4b8-6c2a102fee43 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:57:40.177281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.security_group_api [None req-2abda0c2-87ae-46a4-b4b8-6c2a102fee43 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Neutron security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b not found {{(pid=129060) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:57:40.178370 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-2abda0c2-87ae-46a4-b4b8-6c2a102fee43 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:57:40.178370 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-54bd74cf-ec8c-4310-b66d-2f4db439b921'] Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2abda0c2-87ae-46a4-b4b8-6c2a102fee43 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-security-groups/5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b HTTP/1.1 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: exception: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-54bd74cf-ec8c-4310-b66d-2f4db439b921'] Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b'} Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:57:40.182231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54bd74cf-ec8c-4310-b66d-2f4db439b921'] Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54bd74cf-ec8c-4310-b66d-2f4db439b921'] Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54bd74cf-ec8c-4310-b66d-2f4db439b921'] Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54bd74cf-ec8c-4310-b66d-2f4db439b921'] Aug 25 12:57:40.203471 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:57:40.212304 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fcd6a953-b0d0-46a3-81ec-4cd8e5cec7b0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1346 microversion: 2.1 time: 0.398101 Aug 25 12:57:40.212304 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1182/2420] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:39 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1346 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:40.212304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-46d86ae8-2663-45e4-86ef-c329d3fea5e3 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:40.212304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-46d86ae8-2663-45e4-86ef-c329d3fea5e3 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:40.213131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d86ae8-2663-45e4-86ef-c329d3fea5e3 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:40.217577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d86ae8-2663-45e4-86ef-c329d3fea5e3 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:40.217577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d86ae8-2663-45e4-86ef-c329d3fea5e3 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:40.217577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d86ae8-2663-45e4-86ef-c329d3fea5e3 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:40.218140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2abda0c2-87ae-46a4-b4b8-6c2a102fee43 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:57:40.218140 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-54bd74cf-ec8c-4310-b66d-2f4db439b921'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:40.218502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d86ae8-2663-45e4-86ef-c329d3fea5e3 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:40.218502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d86ae8-2663-45e4-86ef-c329d3fea5e3 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:40.218764 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2abda0c2-87ae-46a4-b4b8-6c2a102fee43 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b" status: 404 len: 194 microversion: 2.1 time: 0.155124 Aug 25 12:57:40.219271 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1239/2421] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:57:40 2022] GET /compute/v2.1/os-security-groups/5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:57:40.243631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c550361d-b0c1-4a0a-8a0c-64577ab5ad94 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a32fb80>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:40.942992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-46d86ae8-2663-45e4-86ef-c329d3fea5e3 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:40.982025 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-46d86ae8-2663-45e4-86ef-c329d3fea5e3 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 0.793687 Aug 25 12:57:40.989734 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1183/2422] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:40 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:41.008306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7eb3fad7-5bde-4246-a087-e8fd546feefa tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:41.009636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7eb3fad7-5bde-4246-a087-e8fd546feefa tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:41.041853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb3fad7-5bde-4246-a087-e8fd546feefa tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:41.045063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb3fad7-5bde-4246-a087-e8fd546feefa tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:41.045935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb3fad7-5bde-4246-a087-e8fd546feefa tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:41.054538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb3fad7-5bde-4246-a087-e8fd546feefa tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:41.055654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb3fad7-5bde-4246-a087-e8fd546feefa tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:41.056530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb3fad7-5bde-4246-a087-e8fd546feefa tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:41.623326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7eb3fad7-5bde-4246-a087-e8fd546feefa tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:41.635531 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c550361d-b0c1-4a0a-8a0c-64577ab5ad94 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/19b62f13-f5bd-4209-b53b-281be5dd50cf" status: 202 len: 0 microversion: 2.1 time: 1.408393 Aug 25 12:57:41.638019 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1240/2423] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:57:40 2022] DELETE /compute/v2.1/os-security-groups/19b62f13-f5bd-4209-b53b-281be5dd50cf => generated 0 bytes in 1413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:57:41.678080 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7eb3fad7-5bde-4246-a087-e8fd546feefa tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1542 microversion: 2.1 time: 0.671281 Aug 25 12:57:41.680233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1e772ab-e023-453f-851b-5d171c5ed4e3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:41.681837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c1e772ab-e023-453f-851b-5d171c5ed4e3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:41.685230 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1184/2424] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:40 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1542 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:41.710463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1d9026cb-b92d-46a7-b47a-48eec8a267d1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:41.729877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1d9026cb-b92d-46a7-b47a-48eec8a267d1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:41.735580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e772ab-e023-453f-851b-5d171c5ed4e3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:41.736650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e772ab-e023-453f-851b-5d171c5ed4e3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:41.737318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e772ab-e023-453f-851b-5d171c5ed4e3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:41.738667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e772ab-e023-453f-851b-5d171c5ed4e3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:41.739454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e772ab-e023-453f-851b-5d171c5ed4e3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:41.740211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e772ab-e023-453f-851b-5d171c5ed4e3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:41.760955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d9026cb-b92d-46a7-b47a-48eec8a267d1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:41.762063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d9026cb-b92d-46a7-b47a-48eec8a267d1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:41.763628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d9026cb-b92d-46a7-b47a-48eec8a267d1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:41.767543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d9026cb-b92d-46a7-b47a-48eec8a267d1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:41.769267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d9026cb-b92d-46a7-b47a-48eec8a267d1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:41.772362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d9026cb-b92d-46a7-b47a-48eec8a267d1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:42.142655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1d9026cb-b92d-46a7-b47a-48eec8a267d1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:42.195712 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1d9026cb-b92d-46a7-b47a-48eec8a267d1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1346 microversion: 2.1 time: 0.504055 Aug 25 12:57:42.209914 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1185/2425] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:41 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1346 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:42.224081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7044de49-8da8-4efb-8292-e041147992e3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a891550>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:42.398405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-7044de49-8da8-4efb-8292-e041147992e3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:57:42.399551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.security_group_api [None req-7044de49-8da8-4efb-8292-e041147992e3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Neutron security group 19b62f13-f5bd-4209-b53b-281be5dd50cf not found {{(pid=129059) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:57:42.400918 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-7044de49-8da8-4efb-8292-e041147992e3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:57:42.400918 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-a0500221-474f-468b-91ee-f1969b1f0b2f'] Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7044de49-8da8-4efb-8292-e041147992e3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-security-groups/19b62f13-f5bd-4209-b53b-281be5dd50cf HTTP/1.1 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: exception: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-a0500221-474f-468b-91ee-f1969b1f0b2f'] Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '19b62f13-f5bd-4209-b53b-281be5dd50cf'} Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:57:42.406800 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0500221-474f-468b-91ee-f1969b1f0b2f'] Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0500221-474f-468b-91ee-f1969b1f0b2f'] Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0500221-474f-468b-91ee-f1969b1f0b2f'] Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0500221-474f-468b-91ee-f1969b1f0b2f'] Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7044de49-8da8-4efb-8292-e041147992e3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:57:42.413870 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-a0500221-474f-468b-91ee-f1969b1f0b2f'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:42.423427 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7044de49-8da8-4efb-8292-e041147992e3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/19b62f13-f5bd-4209-b53b-281be5dd50cf" status: 404 len: 194 microversion: 2.1 time: 0.203567 Aug 25 12:57:42.428297 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1186/2426] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:57:42 2022] GET /compute/v2.1/os-security-groups/19b62f13-f5bd-4209-b53b-281be5dd50cf => generated 194 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:57:42.582466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1e772ab-e023-453f-851b-5d171c5ed4e3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:42.622134 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c1e772ab-e023-453f-851b-5d171c5ed4e3 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1324 microversion: 2.1 time: 0.981987 Aug 25 12:57:42.651787 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1241/2427] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:41 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1324 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:42.679189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-552aba6a-d2eb-4aea-9e58-1c6d30f9003b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:42.680236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-552aba6a-d2eb-4aea-9e58-1c6d30f9003b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:42.712977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-552aba6a-d2eb-4aea-9e58-1c6d30f9003b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:42.718117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-552aba6a-d2eb-4aea-9e58-1c6d30f9003b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:42.726603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-552aba6a-d2eb-4aea-9e58-1c6d30f9003b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:42.733908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-552aba6a-d2eb-4aea-9e58-1c6d30f9003b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:42.734457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-552aba6a-d2eb-4aea-9e58-1c6d30f9003b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:42.734960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-552aba6a-d2eb-4aea-9e58-1c6d30f9003b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:43.686711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-552aba6a-d2eb-4aea-9e58-1c6d30f9003b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:43.727778 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-552aba6a-d2eb-4aea-9e58-1c6d30f9003b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 1.071422 Aug 25 12:57:43.732591 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1242/2428] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:42 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:43.769630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7d1ef4d4-2c95-48ad-a7b1-d8ce90a6dc89 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a5419d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:43.809164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-214724246", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "23951b60-3553-4f0b-98ee-d9fa93cb37ce"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:44.082220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] validate_networks() for [('23951b60-3553-4f0b-98ee-d9fa93cb37ce', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:57:45.477430 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7d1ef4d4-2c95-48ad-a7b1-d8ce90a6dc89 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/71c488d4-912a-4c34-8d0b-47157a2df93b" status: 202 len: 0 microversion: 2.1 time: 1.740740 Aug 25 12:57:45.479384 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1243/2429] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:57:43 2022] DELETE /compute/v2.1/os-security-groups/71c488d4-912a-4c34-8d0b-47157a2df93b => generated 0 bytes in 1746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:57:45.502749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-270659e9-048c-4b89-869f-ab63e86bc6a6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:45.504570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-270659e9-048c-4b89-869f-ab63e86bc6a6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:45.567048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-270659e9-048c-4b89-869f-ab63e86bc6a6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:45.575764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-270659e9-048c-4b89-869f-ab63e86bc6a6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:45.576786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-270659e9-048c-4b89-869f-ab63e86bc6a6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:45.584551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-270659e9-048c-4b89-869f-ab63e86bc6a6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:45.590453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-270659e9-048c-4b89-869f-ab63e86bc6a6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:45.591728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-270659e9-048c-4b89-869f-ab63e86bc6a6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:45.901727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-270659e9-048c-4b89-869f-ab63e86bc6a6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:45.956842 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-270659e9-048c-4b89-869f-ab63e86bc6a6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.471729 Aug 25 12:57:45.961350 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1244/2430] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:45 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:45.987842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9beea3bd-1d70-45d5-a0e0-ecd71af31613 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:46.002951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9beea3bd-1d70-45d5-a0e0-ecd71af31613 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:46.040982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9beea3bd-1d70-45d5-a0e0-ecd71af31613 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:46.048373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9beea3bd-1d70-45d5-a0e0-ecd71af31613 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:46.059128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9beea3bd-1d70-45d5-a0e0-ecd71af31613 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:46.062504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9beea3bd-1d70-45d5-a0e0-ecd71af31613 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:46.067323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9beea3bd-1d70-45d5-a0e0-ecd71af31613 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:46.068504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9beea3bd-1d70-45d5-a0e0-ecd71af31613 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:46.839576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9beea3bd-1d70-45d5-a0e0-ecd71af31613 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:46.880995 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9beea3bd-1d70-45d5-a0e0-ecd71af31613 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1346 microversion: 2.1 time: 0.916787 Aug 25 12:57:46.883286 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1245/2431] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:45 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1346 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:46.910789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9dd00c82-eceb-4c0d-87b2-d29f1813b661 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:46.912497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9dd00c82-eceb-4c0d-87b2-d29f1813b661 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:46.938121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dd00c82-eceb-4c0d-87b2-d29f1813b661 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:46.945301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dd00c82-eceb-4c0d-87b2-d29f1813b661 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:46.946672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dd00c82-eceb-4c0d-87b2-d29f1813b661 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:46.952336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dd00c82-eceb-4c0d-87b2-d29f1813b661 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:46.953443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dd00c82-eceb-4c0d-87b2-d29f1813b661 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:46.954633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dd00c82-eceb-4c0d-87b2-d29f1813b661 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:47.213442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:57:47.217055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:57:47.218545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:57:47.219675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:57:47.222605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:57:47.266566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:47.268326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:47.269808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:47.271853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:47.273363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:47.274795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:47.397971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Getting quotas for project e6bdd5be7e61484a9cef681123269dde. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:57:47.424474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Getting quotas for user 84366b3cfd704ef08d29ef315a035026 and project e6bdd5be7e61484a9cef681123269dde. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:57:47.497466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9dd00c82-eceb-4c0d-87b2-d29f1813b661 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:47.506909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:57:47.517532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:57:47.554400 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9dd00c82-eceb-4c0d-87b2-d29f1813b661 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1324 microversion: 2.1 time: 0.668160 Aug 25 12:57:47.568266 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1246/2432] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:46 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1324 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:47.620249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b55b20d5-4c7a-46df-801e-36a9797685d0 req-4a18c844-e4f7-40ae-a4a2-4b0e0ef2641c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48a5d0b-80f0-43cf-a5b4-50707002de75", "name": "network-vif-deleted", "tag": "2e1d4e9f-8326-4a76-bf2f-01736ee09112"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:47.689713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b55b20d5-4c7a-46df-801e-36a9797685d0 req-4a18c844-e4f7-40ae-a4a2-4b0e0ef2641c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:47.691508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b55b20d5-4c7a-46df-801e-36a9797685d0 req-4a18c844-e4f7-40ae-a4a2-4b0e0ef2641c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:47.692705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b55b20d5-4c7a-46df-801e-36a9797685d0 req-4a18c844-e4f7-40ae-a4a2-4b0e0ef2641c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:47.741987 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b55b20d5-4c7a-46df-801e-36a9797685d0 req-4a18c844-e4f7-40ae-a4a2-4b0e0ef2641c service nova] Creating event network-vif-deleted:2e1d4e9f-8326-4a76-bf2f-01736ee09112 for instance d48a5d0b-80f0-43cf-a5b4-50707002de75 on n-h2-852771-8 Aug 25 12:57:47.764706 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b55b20d5-4c7a-46df-801e-36a9797685d0 req-4a18c844-e4f7-40ae-a4a2-4b0e0ef2641c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187364 Aug 25 12:57:47.767382 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1247/2433] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:47.799170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a8b9918b-3585-4875-8eac-b13f0eaa805f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:47.801235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a8b9918b-3585-4875-8eac-b13f0eaa805f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:47.834777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b9918b-3585-4875-8eac-b13f0eaa805f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:47.836383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b9918b-3585-4875-8eac-b13f0eaa805f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:47.838220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b9918b-3585-4875-8eac-b13f0eaa805f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:47.840264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b9918b-3585-4875-8eac-b13f0eaa805f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:47.842755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b9918b-3585-4875-8eac-b13f0eaa805f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:47.844103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b9918b-3585-4875-8eac-b13f0eaa805f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:47.897181 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eebca177-f60a-4405-b79f-17af71d3f78b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.464355 Aug 25 12:57:47.912401 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1187/2434] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:57:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 5483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:57:47.970835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-90f5ed8e-5b68-49f8-8d6f-b5adde68ffb9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a246430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:48.064867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-90f5ed8e-5b68-49f8-8d6f-b5adde68ffb9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:57:48.067301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.security_group_api [None req-90f5ed8e-5b68-49f8-8d6f-b5adde68ffb9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Neutron security group 71c488d4-912a-4c34-8d0b-47157a2df93b not found {{(pid=129059) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:57:48.068479 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-90f5ed8e-5b68-49f8-8d6f-b5adde68ffb9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:57:48.068479 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-1789729f-11fa-4986-afc6-c6e287522473'] Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-90f5ed8e-5b68-49f8-8d6f-b5adde68ffb9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-security-groups/71c488d4-912a-4c34-8d0b-47157a2df93b HTTP/1.1 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: exception: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-1789729f-11fa-4986-afc6-c6e287522473'] Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '71c488d4-912a-4c34-8d0b-47157a2df93b'} Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:57:48.072903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1789729f-11fa-4986-afc6-c6e287522473'] Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1789729f-11fa-4986-afc6-c6e287522473'] Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1789729f-11fa-4986-afc6-c6e287522473'] Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1789729f-11fa-4986-afc6-c6e287522473'] Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-90f5ed8e-5b68-49f8-8d6f-b5adde68ffb9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-1789729f-11fa-4986-afc6-c6e287522473'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-90f5ed8e-5b68-49f8-8d6f-b5adde68ffb9 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/71c488d4-912a-4c34-8d0b-47157a2df93b" status: 404 len: 194 microversion: 2.1 time: 0.156944 Aug 25 12:57:48.086966 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1188/2435] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:57:47 2022] GET /compute/v2.1/os-security-groups/71c488d4-912a-4c34-8d0b-47157a2df93b => generated 194 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:57:48.115557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0e1ff3eb-8316-4023-a55a-bfb55c44dd73 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:48.116875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0e1ff3eb-8316-4023-a55a-bfb55c44dd73 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:48.125165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:48.165397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e1ff3eb-8316-4023-a55a-bfb55c44dd73 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:48.173543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e1ff3eb-8316-4023-a55a-bfb55c44dd73 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:48.174686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e1ff3eb-8316-4023-a55a-bfb55c44dd73 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:48.176301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e1ff3eb-8316-4023-a55a-bfb55c44dd73 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:48.177471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e1ff3eb-8316-4023-a55a-bfb55c44dd73 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:48.178690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e1ff3eb-8316-4023-a55a-bfb55c44dd73 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:48.516852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0e1ff3eb-8316-4023-a55a-bfb55c44dd73 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:48.563574 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0e1ff3eb-8316-4023-a55a-bfb55c44dd73 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.463325 Aug 25 12:57:48.564934 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1189/2436] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:48 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:48.610128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-09f1b47b-7c57-4edd-8f78-b8906d5f83ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:48.611984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-09f1b47b-7c57-4edd-8f78-b8906d5f83ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:48.638391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09f1b47b-7c57-4edd-8f78-b8906d5f83ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:48.667793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09f1b47b-7c57-4edd-8f78-b8906d5f83ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:48.674236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a8b9918b-3585-4875-8eac-b13f0eaa805f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:48.674540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09f1b47b-7c57-4edd-8f78-b8906d5f83ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:48.677043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09f1b47b-7c57-4edd-8f78-b8906d5f83ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:48.678610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09f1b47b-7c57-4edd-8f78-b8906d5f83ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:48.683000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09f1b47b-7c57-4edd-8f78-b8906d5f83ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:48.703495 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a8b9918b-3585-4875-8eac-b13f0eaa805f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1392 microversion: 2.1 time: 0.932525 Aug 25 12:57:48.705648 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1248/2437] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:47 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1392 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:48.718759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b180617f-6986-4e4f-870e-34dd89d6e00f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:48.720428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b180617f-6986-4e4f-870e-34dd89d6e00f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:49.050255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b180617f-6986-4e4f-870e-34dd89d6e00f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:49.081477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-09f1b47b-7c57-4edd-8f78-b8906d5f83ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:49.124373 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-09f1b47b-7c57-4edd-8f78-b8906d5f83ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1346 microversion: 2.1 time: 0.542609 Aug 25 12:57:49.126619 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1190/2438] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:48 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1346 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:49.139258 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b180617f-6986-4e4f-870e-34dd89d6e00f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1216 microversion: 2.1 time: 0.431167 Aug 25 12:57:49.139696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1c9c8b2-70d4-4926-a89b-2e3b90c92195 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2e7d6040>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:49.145417 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1249/2439] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:48 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1216 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:49.189877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc671018-2d15-404c-bef5-3688e353ec4e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:49.191186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc671018-2d15-404c-bef5-3688e353ec4e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:49.232708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc671018-2d15-404c-bef5-3688e353ec4e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:49.234433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc671018-2d15-404c-bef5-3688e353ec4e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:49.236657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc671018-2d15-404c-bef5-3688e353ec4e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:49.238356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc671018-2d15-404c-bef5-3688e353ec4e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:49.239425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc671018-2d15-404c-bef5-3688e353ec4e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:49.240448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc671018-2d15-404c-bef5-3688e353ec4e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:50.423851 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b1c9c8b2-70d4-4926-a89b-2e3b90c92195 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 1.291553 Aug 25 12:57:50.425368 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1191/2440] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 12:57:49 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:50.460535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5aee8a61-e1bb-446c-a9aa-2412f42fae63 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:50.463383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5aee8a61-e1bb-446c-a9aa-2412f42fae63 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:50.479995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aee8a61-e1bb-446c-a9aa-2412f42fae63 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:50.482502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aee8a61-e1bb-446c-a9aa-2412f42fae63 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:50.483851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aee8a61-e1bb-446c-a9aa-2412f42fae63 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:50.486263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aee8a61-e1bb-446c-a9aa-2412f42fae63 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:50.487739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aee8a61-e1bb-446c-a9aa-2412f42fae63 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:50.488988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aee8a61-e1bb-446c-a9aa-2412f42fae63 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:50.699743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc671018-2d15-404c-bef5-3688e353ec4e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:50.736751 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc671018-2d15-404c-bef5-3688e353ec4e tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1324 microversion: 2.1 time: 1.587485 Aug 25 12:57:50.744723 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1250/2441] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:49 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1324 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:50.770435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5f4052ab-3900-4153-8cfa-5989c903b65b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:50.779307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5f4052ab-3900-4153-8cfa-5989c903b65b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:50.796537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:50.858490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f4052ab-3900-4153-8cfa-5989c903b65b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:50.860349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f4052ab-3900-4153-8cfa-5989c903b65b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:50.862722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f4052ab-3900-4153-8cfa-5989c903b65b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:50.866583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f4052ab-3900-4153-8cfa-5989c903b65b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:50.868873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f4052ab-3900-4153-8cfa-5989c903b65b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:50.873316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f4052ab-3900-4153-8cfa-5989c903b65b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:50.955914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5aee8a61-e1bb-446c-a9aa-2412f42fae63 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:51.023875 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5aee8a61-e1bb-446c-a9aa-2412f42fae63 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.563787 Aug 25 12:57:51.045992 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1192/2442] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:50 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:51.076690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ab64b06f-9a7d-4a05-9755-e8c3de3b58fd req-baada5c2-76fa-4b3d-a92d-25a94cf3e918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586ef5d3-65f8-47ca-856b-167fdaeb7ced", "tag": "ea948e8c-9fa9-4615-88c2-16f3e4c9d28f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:51.117243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ab64b06f-9a7d-4a05-9755-e8c3de3b58fd req-baada5c2-76fa-4b3d-a92d-25a94cf3e918 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:51.122697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ab64b06f-9a7d-4a05-9755-e8c3de3b58fd req-baada5c2-76fa-4b3d-a92d-25a94cf3e918 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:51.123909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ab64b06f-9a7d-4a05-9755-e8c3de3b58fd req-baada5c2-76fa-4b3d-a92d-25a94cf3e918 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:51.208484 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ab64b06f-9a7d-4a05-9755-e8c3de3b58fd req-baada5c2-76fa-4b3d-a92d-25a94cf3e918 service nova] Creating event network-changed:ea948e8c-9fa9-4615-88c2-16f3e4c9d28f for instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced on n-h2-852771-8 Aug 25 12:57:51.257263 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ab64b06f-9a7d-4a05-9755-e8c3de3b58fd req-baada5c2-76fa-4b3d-a92d-25a94cf3e918 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204541 Aug 25 12:57:51.266712 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1193/2443] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:51.320276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bb5ffb69-6118-4844-bf6a-1623ce15e574 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:51.324424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bb5ffb69-6118-4844-bf6a-1623ce15e574 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:51.381047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb5ffb69-6118-4844-bf6a-1623ce15e574 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:51.388055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb5ffb69-6118-4844-bf6a-1623ce15e574 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:51.399055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb5ffb69-6118-4844-bf6a-1623ce15e574 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:51.401703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb5ffb69-6118-4844-bf6a-1623ce15e574 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:51.403014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb5ffb69-6118-4844-bf6a-1623ce15e574 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:51.407702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb5ffb69-6118-4844-bf6a-1623ce15e574 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:51.587929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5f4052ab-3900-4153-8cfa-5989c903b65b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:51.671841 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5f4052ab-3900-4153-8cfa-5989c903b65b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1382 microversion: 2.1 time: 0.892171 Aug 25 12:57:51.673611 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1251/2444] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:50 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1382 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:51.684345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6f23b61-ebcb-4b84-9d9e-be63ef113351 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:51.685789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d6f23b61-ebcb-4b84-9d9e-be63ef113351 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:51.702515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f23b61-ebcb-4b84-9d9e-be63ef113351 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:51.705313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f23b61-ebcb-4b84-9d9e-be63ef113351 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:51.707667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f23b61-ebcb-4b84-9d9e-be63ef113351 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:51.710019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f23b61-ebcb-4b84-9d9e-be63ef113351 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:51.713022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f23b61-ebcb-4b84-9d9e-be63ef113351 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:51.714569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f23b61-ebcb-4b84-9d9e-be63ef113351 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:51.825781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bb5ffb69-6118-4844-bf6a-1623ce15e574 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:51.854482 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bb5ffb69-6118-4844-bf6a-1623ce15e574 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1346 microversion: 2.1 time: 0.584930 Aug 25 12:57:51.860986 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1194/2445] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:51 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1346 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:51.882417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d9f5ec1-5ab9-4c8e-987e-c149eedf9897 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: .version_select at 0x7f3a2e7b3790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1663803159", "description": "tempest-description-1577347789"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:52.094458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d6f23b61-ebcb-4b84-9d9e-be63ef113351 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:52.144143 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d6f23b61-ebcb-4b84-9d9e-be63ef113351 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1268 microversion: 2.1 time: 0.437606 Aug 25 12:57:52.145872 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1252/2446] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:51 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1268 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:52.166510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-717542d8-28ab-42f8-bbd2-dd03c90f991b tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '.version_select at 0x7f3a2aa304c0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:52.181887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-717542d8-28ab-42f8-bbd2-dd03c90f991b tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:52.187921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-717542d8-28ab-42f8-bbd2-dd03c90f991b tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:52.188962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-717542d8-28ab-42f8-bbd2-dd03c90f991b tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:52.224947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:52.238671 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-717542d8-28ab-42f8-bbd2-dd03c90f991b tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.090083 Aug 25 12:57:52.259771 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1253/2447] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 12:57:52 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:52.270952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1d8ea07c-4591-4f2b-8946-ce469dee872c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:52.273157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1d8ea07c-4591-4f2b-8946-ce469dee872c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:52.292766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ea07c-4591-4f2b-8946-ce469dee872c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:52.294077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ea07c-4591-4f2b-8946-ce469dee872c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:52.295259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ea07c-4591-4f2b-8946-ce469dee872c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:52.296925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ea07c-4591-4f2b-8946-ce469dee872c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:52.298213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ea07c-4591-4f2b-8946-ce469dee872c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:52.299370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ea07c-4591-4f2b-8946-ce469dee872c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:52.954802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d8ea07c-4591-4f2b-8946-ce469dee872c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:53.017299 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1d8ea07c-4591-4f2b-8946-ce469dee872c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1324 microversion: 2.1 time: 0.755153 Aug 25 12:57:53.030959 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1254/2448] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:52 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1324 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:53.054311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d039ec7-a358-4189-b57f-46a1d4a91f66 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:53.056060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9d039ec7-a358-4189-b57f-46a1d4a91f66 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:53.092338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d039ec7-a358-4189-b57f-46a1d4a91f66 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.110926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d039ec7-a358-4189-b57f-46a1d4a91f66 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.111900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d039ec7-a358-4189-b57f-46a1d4a91f66 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.119698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d039ec7-a358-4189-b57f-46a1d4a91f66 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.122355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d039ec7-a358-4189-b57f-46a1d4a91f66 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.124482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d039ec7-a358-4189-b57f-46a1d4a91f66 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.303990 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d9f5ec1-5ab9-4c8e-987e-c149eedf9897 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.439633 Aug 25 12:57:53.306297 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1195/2449] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:57:51 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:53.328886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1d524f29-2e31-4712-88b6-84976f48e185 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:53.333597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1d524f29-2e31-4712-88b6-84976f48e185 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:53.364584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d524f29-2e31-4712-88b6-84976f48e185 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.366324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d524f29-2e31-4712-88b6-84976f48e185 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.366586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d524f29-2e31-4712-88b6-84976f48e185 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.367859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d524f29-2e31-4712-88b6-84976f48e185 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.369175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d524f29-2e31-4712-88b6-84976f48e185 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.370957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d524f29-2e31-4712-88b6-84976f48e185 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.380638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:53.513558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d039ec7-a358-4189-b57f-46a1d4a91f66 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:53.533500 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d039ec7-a358-4189-b57f-46a1d4a91f66 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.507802 Aug 25 12:57:53.536936 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1255/2450] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:53 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:53.590015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-440bca31-9c9d-477b-9892-6c088b5e985b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:53.594626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-440bca31-9c9d-477b-9892-6c088b5e985b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:53.625914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-440bca31-9c9d-477b-9892-6c088b5e985b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.627083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-440bca31-9c9d-477b-9892-6c088b5e985b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.635146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-440bca31-9c9d-477b-9892-6c088b5e985b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.636756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-440bca31-9c9d-477b-9892-6c088b5e985b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.638051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-440bca31-9c9d-477b-9892-6c088b5e985b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.639138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-440bca31-9c9d-477b-9892-6c088b5e985b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.830714 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1d524f29-2e31-4712-88b6-84976f48e185 tempest-LiveMigrationTest-1228892656 tempest-LiveMigrationTest-1228892656-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1533 microversion: 2.1 time: 0.522382 Aug 25 12:57:53.839287 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1196/2451] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:53 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1533 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:53.862697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e8353ded-a56f-4beb-bcba-59be92e1b31f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:53.870911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e8353ded-a56f-4beb-bcba-59be92e1b31f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:53.905642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8353ded-a56f-4beb-bcba-59be92e1b31f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.907059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8353ded-a56f-4beb-bcba-59be92e1b31f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.909358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8353ded-a56f-4beb-bcba-59be92e1b31f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.912565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8353ded-a56f-4beb-bcba-59be92e1b31f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.917709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8353ded-a56f-4beb-bcba-59be92e1b31f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.918953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8353ded-a56f-4beb-bcba-59be92e1b31f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.984934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-440bca31-9c9d-477b-9892-6c088b5e985b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:54.036307 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-440bca31-9c9d-477b-9892-6c088b5e985b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1346 microversion: 2.1 time: 0.488589 Aug 25 12:57:54.046059 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1256/2452] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:53 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1346 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:54.076443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-345f2444-0030-4c2d-9e5c-df932c3e6181 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: .version_select at 0x7f3a2a7a3af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-54336925", "description": "tempest-description-1264652044"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:54.312217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e8353ded-a56f-4beb-bcba-59be92e1b31f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:54.362439 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e8353ded-a56f-4beb-bcba-59be92e1b31f tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1274 microversion: 2.1 time: 0.517179 Aug 25 12:57:54.390968 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1197/2453] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:53 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1274 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:54.459667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aa537ad3-4a9d-4f23-be03-875b86c4bb5f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:54.463667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aa537ad3-4a9d-4f23-be03-875b86c4bb5f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:54.492019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa537ad3-4a9d-4f23-be03-875b86c4bb5f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:54.495861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa537ad3-4a9d-4f23-be03-875b86c4bb5f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:54.495861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa537ad3-4a9d-4f23-be03-875b86c4bb5f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:54.497380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa537ad3-4a9d-4f23-be03-875b86c4bb5f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:54.498784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa537ad3-4a9d-4f23-be03-875b86c4bb5f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:54.499005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa537ad3-4a9d-4f23-be03-875b86c4bb5f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:54.594332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aa537ad3-4a9d-4f23-be03-875b86c4bb5f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:57:54.769844 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-345f2444-0030-4c2d-9e5c-df932c3e6181 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.715723 Aug 25 12:57:54.772533 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1257/2454] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:57:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:54.786603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-78e58401-177b-4cbf-a2bb-f83778613784 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:54.788463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-78e58401-177b-4cbf-a2bb-f83778613784 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:54.817753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78e58401-177b-4cbf-a2bb-f83778613784 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:54.823201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78e58401-177b-4cbf-a2bb-f83778613784 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:54.824700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78e58401-177b-4cbf-a2bb-f83778613784 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:54.829552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78e58401-177b-4cbf-a2bb-f83778613784 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:54.833804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78e58401-177b-4cbf-a2bb-f83778613784 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:54.835171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78e58401-177b-4cbf-a2bb-f83778613784 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:54.968728 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aa537ad3-4a9d-4f23-be03-875b86c4bb5f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 204 len: 0 microversion: 2.1 time: 0.573680 Aug 25 12:57:54.971462 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1198/2455] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:57:54 2022] DELETE /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:57:55.001375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-20b67489-5f7f-423d-b4fb-c0820a5f59d7 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:55.005423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-20b67489-5f7f-423d-b4fb-c0820a5f59d7 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:55.021181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b67489-5f7f-423d-b4fb-c0820a5f59d7 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:55.022627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b67489-5f7f-423d-b4fb-c0820a5f59d7 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:55.023825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b67489-5f7f-423d-b4fb-c0820a5f59d7 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:55.027284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b67489-5f7f-423d-b4fb-c0820a5f59d7 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:55.028534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b67489-5f7f-423d-b4fb-c0820a5f59d7 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:55.029741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20b67489-5f7f-423d-b4fb-c0820a5f59d7 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:55.330765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-20b67489-5f7f-423d-b4fb-c0820a5f59d7 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:55.363534 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-20b67489-5f7f-423d-b4fb-c0820a5f59d7 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.388851 Aug 25 12:57:55.368868 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1199/2456] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:54 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:55.395769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f1cfeab0-d061-4e4a-84f4-03cc0e99420a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:55.397109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f1cfeab0-d061-4e4a-84f4-03cc0e99420a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:55.427355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1cfeab0-d061-4e4a-84f4-03cc0e99420a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:55.427756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-78e58401-177b-4cbf-a2bb-f83778613784 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:55.437301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1cfeab0-d061-4e4a-84f4-03cc0e99420a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:55.438335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1cfeab0-d061-4e4a-84f4-03cc0e99420a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:55.443973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1cfeab0-d061-4e4a-84f4-03cc0e99420a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:55.446697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1cfeab0-d061-4e4a-84f4-03cc0e99420a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:55.449270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1cfeab0-d061-4e4a-84f4-03cc0e99420a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:55.453305 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-78e58401-177b-4cbf-a2bb-f83778613784 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1324 microversion: 2.1 time: 0.677106 Aug 25 12:57:55.455592 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1258/2457] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:54 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1324 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:55.503883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d3be247c-b70e-4eea-8b53-a6f9932a8c7a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:55.516041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d3be247c-b70e-4eea-8b53-a6f9932a8c7a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:55.561933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3be247c-b70e-4eea-8b53-a6f9932a8c7a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:55.564322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3be247c-b70e-4eea-8b53-a6f9932a8c7a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:55.568604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3be247c-b70e-4eea-8b53-a6f9932a8c7a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:55.571657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3be247c-b70e-4eea-8b53-a6f9932a8c7a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:55.573910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3be247c-b70e-4eea-8b53-a6f9932a8c7a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:55.578144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3be247c-b70e-4eea-8b53-a6f9932a8c7a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:56.004343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d3be247c-b70e-4eea-8b53-a6f9932a8c7a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:56.044885 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d3be247c-b70e-4eea-8b53-a6f9932a8c7a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 200 len: 1346 microversion: 2.1 time: 0.577537 Aug 25 12:57:56.069760 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1259/2458] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:55 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 1346 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:56.124838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-230907666", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "db945ddc-3e26-486f-9113-757f7c8d2785"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:56.481398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] validate_networks() for [('db945ddc-3e26-486f-9113-757f7c8d2785', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:57:56.563216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f1cfeab0-d061-4e4a-84f4-03cc0e99420a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:56.593372 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f1cfeab0-d061-4e4a-84f4-03cc0e99420a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1388 microversion: 2.1 time: 1.220917 Aug 25 12:57:56.595810 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1200/2459] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:55 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1388 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:56.606990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5f42c521-aee9-4261-b3a0-f31326772deb tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:56.608731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5f42c521-aee9-4261-b3a0-f31326772deb tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:56.622160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f42c521-aee9-4261-b3a0-f31326772deb tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:56.624189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f42c521-aee9-4261-b3a0-f31326772deb tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:56.625560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f42c521-aee9-4261-b3a0-f31326772deb tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:56.627478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f42c521-aee9-4261-b3a0-f31326772deb tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:56.628870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f42c521-aee9-4261-b3a0-f31326772deb tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:56.630081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f42c521-aee9-4261-b3a0-f31326772deb tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:57.315650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:57.468304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5f42c521-aee9-4261-b3a0-f31326772deb tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:57.491745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:57.497459 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5f42c521-aee9-4261-b3a0-f31326772deb tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1316 microversion: 2.1 time: 0.899081 Aug 25 12:57:57.522380 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1201/2460] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:56 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1316 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:57.545442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4330cffa-6165-4d76-b931-e7a0193ea2a1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:57.547351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4330cffa-6165-4d76-b931-e7a0193ea2a1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:57.573229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4330cffa-6165-4d76-b931-e7a0193ea2a1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:57.575540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4330cffa-6165-4d76-b931-e7a0193ea2a1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:57.576898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4330cffa-6165-4d76-b931-e7a0193ea2a1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:57.578821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4330cffa-6165-4d76-b931-e7a0193ea2a1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:57.580183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4330cffa-6165-4d76-b931-e7a0193ea2a1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:57.581415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4330cffa-6165-4d76-b931-e7a0193ea2a1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:57.888799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4330cffa-6165-4d76-b931-e7a0193ea2a1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:57.935000 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4330cffa-6165-4d76-b931-e7a0193ea2a1 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.409822 Aug 25 12:57:57.936069 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1202/2461] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:57 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:57.971334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e306f7e2-11de-4e32-8359-9b68e1be90f7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:57.980089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e306f7e2-11de-4e32-8359-9b68e1be90f7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:58.002258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e306f7e2-11de-4e32-8359-9b68e1be90f7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:58.003810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e306f7e2-11de-4e32-8359-9b68e1be90f7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:58.005815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e306f7e2-11de-4e32-8359-9b68e1be90f7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:58.007694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e306f7e2-11de-4e32-8359-9b68e1be90f7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:58.009723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e306f7e2-11de-4e32-8359-9b68e1be90f7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:58.011113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e306f7e2-11de-4e32-8359-9b68e1be90f7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:58.895349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e306f7e2-11de-4e32-8359-9b68e1be90f7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:58.929193 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e306f7e2-11de-4e32-8359-9b68e1be90f7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1324 microversion: 2.1 time: 0.986250 Aug 25 12:57:58.930772 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1203/2462] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:57 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1324 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:58.958799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:59.004956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:59.022229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:59.024945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:59.027431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:59.030965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:59.032041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:59.032849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:59.068106 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 HTTP/1.1 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '08f4120a-39c6-4978-9fed-e4dc6b49edf2'} Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:59.073981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:59.085217 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:59.085217 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:59.085217 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:59.085217 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:57:59.085217 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:57:59.085217 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 12:57:59.085217 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:57:59.085217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:59.085217 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-41541943-2fe9-40ac-8adf-4cd7b8073aac tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 404 len: 111 microversion: 2.1 time: 0.143661 Aug 25 12:57:59.085217 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1204/2463] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:58 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:57:59.087939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ebdddf1d-add4-4c70-9ed1-ba95eed65d7a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:59.089158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ebdddf1d-add4-4c70-9ed1-ba95eed65d7a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:59.102062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdddf1d-add4-4c70-9ed1-ba95eed65d7a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:59.103501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdddf1d-add4-4c70-9ed1-ba95eed65d7a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:59.104340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdddf1d-add4-4c70-9ed1-ba95eed65d7a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:59.106145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdddf1d-add4-4c70-9ed1-ba95eed65d7a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:59.107005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdddf1d-add4-4c70-9ed1-ba95eed65d7a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:59.107799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdddf1d-add4-4c70-9ed1-ba95eed65d7a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:59.130695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:59.796582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:57:59.798542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:57:59.799904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:57:59.800993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:57:59.805020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:57:59.850148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:59.851353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:59.853074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:59.856085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:59.858331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:59.859909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:59.947391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Getting quotas for project 3073060ec2e34c7187935c76726b9982. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:57:59.999019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Getting quotas for user 6b304954aa4e44979d9d79fc06909e94 and project 3073060ec2e34c7187935c76726b9982. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:58:00.055974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ebdddf1d-add4-4c70-9ed1-ba95eed65d7a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:00.065474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:58:00.074592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:58:00.101192 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ebdddf1d-add4-4c70-9ed1-ba95eed65d7a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1388 microversion: 2.1 time: 1.010787 Aug 25 12:58:00.103302 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1205/2464] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:59 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1388 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:00.128296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4c1e5a19-c638-46ea-8247-f3039be1c73e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:00.129697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4c1e5a19-c638-46ea-8247-f3039be1c73e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:00.177071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c1e5a19-c638-46ea-8247-f3039be1c73e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.178190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c1e5a19-c638-46ea-8247-f3039be1c73e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.179161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c1e5a19-c638-46ea-8247-f3039be1c73e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.180419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c1e5a19-c638-46ea-8247-f3039be1c73e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.181407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c1e5a19-c638-46ea-8247-f3039be1c73e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.184308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c1e5a19-c638-46ea-8247-f3039be1c73e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.304018 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d60eaa5-d408-4ec3-91b6-970e9a97224e tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.225324 Aug 25 12:58:00.317106 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1260/2465] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:57:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:58:00.374040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e254d7f4-1eee-454a-8bef-f3c8c775a920 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:00.385808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e254d7f4-1eee-454a-8bef-f3c8c775a920 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:00.408934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e254d7f4-1eee-454a-8bef-f3c8c775a920 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.413969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e254d7f4-1eee-454a-8bef-f3c8c775a920 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.415596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e254d7f4-1eee-454a-8bef-f3c8c775a920 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.423675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e254d7f4-1eee-454a-8bef-f3c8c775a920 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.424946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e254d7f4-1eee-454a-8bef-f3c8c775a920 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.426107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e254d7f4-1eee-454a-8bef-f3c8c775a920 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.720280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e254d7f4-1eee-454a-8bef-f3c8c775a920 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:00.755218 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e254d7f4-1eee-454a-8bef-f3c8c775a920 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.431722 Aug 25 12:58:00.759794 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1261/2466] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:00 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:00.800934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4826d930-b637-444d-ad34-e57db826d7bd req-1fe86f6f-9e53-49a9-b720-40417f471874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade349c6-8fb8-4a74-a87f-bff718e29ad1", "tag": "80325278-076e-48b7-ab0c-04ec2238f397"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:00.828356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4826d930-b637-444d-ad34-e57db826d7bd req-1fe86f6f-9e53-49a9-b720-40417f471874 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.829433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4826d930-b637-444d-ad34-e57db826d7bd req-1fe86f6f-9e53-49a9-b720-40417f471874 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.830374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4826d930-b637-444d-ad34-e57db826d7bd req-1fe86f6f-9e53-49a9-b720-40417f471874 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.846591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4c1e5a19-c638-46ea-8247-f3039be1c73e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:00.867219 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4c1e5a19-c638-46ea-8247-f3039be1c73e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1316 microversion: 2.1 time: 0.759114 Aug 25 12:58:00.868970 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1206/2467] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:00 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1316 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:00.877418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:00.882596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:00.887746 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4826d930-b637-444d-ad34-e57db826d7bd req-1fe86f6f-9e53-49a9-b720-40417f471874 service nova] Creating event network-changed:80325278-076e-48b7-ab0c-04ec2238f397 for instance ade349c6-8fb8-4a74-a87f-bff718e29ad1 on n-h1-852771-8 Aug 25 12:58:00.901668 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4826d930-b637-444d-ad34-e57db826d7bd req-1fe86f6f-9e53-49a9-b720-40417f471874 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123991 Aug 25 12:58:00.903653 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1262/2468] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:00.905572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.906807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.908173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.910124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.911799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.913553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.919473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a23a3b3d-f92c-43c2-96c8-0024e3a27187 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:00.921237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a23a3b3d-f92c-43c2-96c8-0024e3a27187 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:00.960917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a23a3b3d-f92c-43c2-96c8-0024e3a27187 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.962849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a23a3b3d-f92c-43c2-96c8-0024e3a27187 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.967428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a23a3b3d-f92c-43c2-96c8-0024e3a27187 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.968979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a23a3b3d-f92c-43c2-96c8-0024e3a27187 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.970536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a23a3b3d-f92c-43c2-96c8-0024e3a27187 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.971735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a23a3b3d-f92c-43c2-96c8-0024e3a27187 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.994086 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2/os-volume_attachments HTTP/1.1 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'server_id': '08f4120a-39c6-4978-9fed-e4dc6b49edf2'} Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:58:01.001890 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 12:58:01.010777 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:01.018085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:58:01.026141 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6dea880e-9254-4478-a77d-68c2869529fa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.152137 Aug 25 12:58:01.031793 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1207/2469] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 12:58:00 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2/os-volume_attachments => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:58:01.052511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d5e3b0b5-b373-42a6-99af-24a5d339be99 req-2ab169ac-6bf3-4dfe-8e9d-1b5c4c11c0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24695ae5-f061-4367-ba68-ba09b5e60cd8", "name": "network-vif-deleted", "tag": "bf435e69-cad0-4f31-8880-d901851ff9cb"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:01.084426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d5e3b0b5-b373-42a6-99af-24a5d339be99 req-2ab169ac-6bf3-4dfe-8e9d-1b5c4c11c0f9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:01.090636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d5e3b0b5-b373-42a6-99af-24a5d339be99 req-2ab169ac-6bf3-4dfe-8e9d-1b5c4c11c0f9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:01.091803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d5e3b0b5-b373-42a6-99af-24a5d339be99 req-2ab169ac-6bf3-4dfe-8e9d-1b5c4c11c0f9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:01.135756 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d5e3b0b5-b373-42a6-99af-24a5d339be99 req-2ab169ac-6bf3-4dfe-8e9d-1b5c4c11c0f9 service nova] Creating event network-vif-deleted:bf435e69-cad0-4f31-8880-d901851ff9cb for instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 on n-h1-852771-8 Aug 25 12:58:01.157712 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d5e3b0b5-b373-42a6-99af-24a5d339be99 req-2ab169ac-6bf3-4dfe-8e9d-1b5c4c11c0f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123122 Aug 25 12:58:01.161106 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1208/2470] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:01.187305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-318d6498-f4ae-4791-a62a-a86e685138cb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:01.190669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-318d6498-f4ae-4791-a62a-a86e685138cb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:01.382423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-318d6498-f4ae-4791-a62a-a86e685138cb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:01.423499 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-318d6498-f4ae-4791-a62a-a86e685138cb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1215 microversion: 2.1 time: 0.256065 Aug 25 12:58:01.431375 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1209/2471] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:01 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:01.491593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-606a3303-5d01-4e13-8674-692be5d70b7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:01.497819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-606a3303-5d01-4e13-8674-692be5d70b7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:01.587997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-606a3303-5d01-4e13-8674-692be5d70b7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:01.609165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-606a3303-5d01-4e13-8674-692be5d70b7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:01.610665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-606a3303-5d01-4e13-8674-692be5d70b7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:01.619862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-606a3303-5d01-4e13-8674-692be5d70b7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:01.622713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-606a3303-5d01-4e13-8674-692be5d70b7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:01.630221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-606a3303-5d01-4e13-8674-692be5d70b7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:01.667518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a23a3b3d-f92c-43c2-96c8-0024e3a27187 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:01.694341 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a23a3b3d-f92c-43c2-96c8-0024e3a27187 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1324 microversion: 2.1 time: 0.788413 Aug 25 12:58:01.698609 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1263/2472] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:00 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1324 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:01.804280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8af98151-4d7a-4f5c-a4ea-be2fcd599797 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:01.813790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8af98151-4d7a-4f5c-a4ea-be2fcd599797 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:01.845734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8af98151-4d7a-4f5c-a4ea-be2fcd599797 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:01.848053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8af98151-4d7a-4f5c-a4ea-be2fcd599797 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:01.854446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8af98151-4d7a-4f5c-a4ea-be2fcd599797 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:01.856459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8af98151-4d7a-4f5c-a4ea-be2fcd599797 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:01.862522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8af98151-4d7a-4f5c-a4ea-be2fcd599797 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:01.866459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8af98151-4d7a-4f5c-a4ea-be2fcd599797 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:01.937795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-606a3303-5d01-4e13-8674-692be5d70b7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:01.964136 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-606a3303-5d01-4e13-8674-692be5d70b7c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1184 microversion: 2.1 time: 0.529554 Aug 25 12:58:01.969396 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1210/2473] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:01 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1184 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:01.993595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-639fef03-eb4f-4089-8efc-e55298f01687 req-853ac211-320b-4f1c-86c9-8cf5f0b39ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ef5d3-65f8-47ca-856b-167fdaeb7ced", "name": "network-vif-plugged", "status": "completed", "tag": "ea948e8c-9fa9-4615-88c2-16f3e4c9d28f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:02.035320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-639fef03-eb4f-4089-8efc-e55298f01687 req-853ac211-320b-4f1c-86c9-8cf5f0b39ae6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:02.036820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-639fef03-eb4f-4089-8efc-e55298f01687 req-853ac211-320b-4f1c-86c9-8cf5f0b39ae6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:02.038080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-639fef03-eb4f-4089-8efc-e55298f01687 req-853ac211-320b-4f1c-86c9-8cf5f0b39ae6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:02.067263 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-639fef03-eb4f-4089-8efc-e55298f01687 req-853ac211-320b-4f1c-86c9-8cf5f0b39ae6 service nova] Creating event network-vif-plugged:ea948e8c-9fa9-4615-88c2-16f3e4c9d28f for instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced on n-h2-852771-8 Aug 25 12:58:02.083094 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-639fef03-eb4f-4089-8efc-e55298f01687 req-853ac211-320b-4f1c-86c9-8cf5f0b39ae6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106450 Aug 25 12:58:02.086821 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1211/2474] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:02.143689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-979fe2d6-0d29-4df6-9462-25799d4c5c1b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:02.148448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-979fe2d6-0d29-4df6-9462-25799d4c5c1b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:02.182619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-979fe2d6-0d29-4df6-9462-25799d4c5c1b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:02.187638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-979fe2d6-0d29-4df6-9462-25799d4c5c1b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:02.189150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-979fe2d6-0d29-4df6-9462-25799d4c5c1b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:02.191403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-979fe2d6-0d29-4df6-9462-25799d4c5c1b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:02.194571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-979fe2d6-0d29-4df6-9462-25799d4c5c1b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:02.197348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-979fe2d6-0d29-4df6-9462-25799d4c5c1b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:02.210725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8af98151-4d7a-4f5c-a4ea-be2fcd599797 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:02.254219 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8af98151-4d7a-4f5c-a4ea-be2fcd599797 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.458737 Aug 25 12:58:02.257974 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1264/2475] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:01 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:02.474486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6fa5127d-e069-49b1-961f-c9630d87b349 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:02.476696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6fa5127d-e069-49b1-961f-c9630d87b349 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:02.512067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa5127d-e069-49b1-961f-c9630d87b349 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:02.512431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa5127d-e069-49b1-961f-c9630d87b349 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:02.513750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa5127d-e069-49b1-961f-c9630d87b349 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:02.516202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa5127d-e069-49b1-961f-c9630d87b349 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:02.518370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa5127d-e069-49b1-961f-c9630d87b349 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:02.519704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa5127d-e069-49b1-961f-c9630d87b349 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:02.772979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-979fe2d6-0d29-4df6-9462-25799d4c5c1b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:02.792073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6fa5127d-e069-49b1-961f-c9630d87b349 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:02.796423 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-979fe2d6-0d29-4df6-9462-25799d4c5c1b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1316 microversion: 2.1 time: 0.700790 Aug 25 12:58:02.800072 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1212/2476] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:02 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1316 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:02.812329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9f2c1d42-f3a7-42f4-aee3-230f11d2193c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:02.814173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9f2c1d42-f3a7-42f4-aee3-230f11d2193c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:02.824400 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6fa5127d-e069-49b1-961f-c9630d87b349 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1211 microversion: 2.1 time: 0.364598 Aug 25 12:58:02.825922 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1265/2477] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:02 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1211 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:58:02.835672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f2c1d42-f3a7-42f4-aee3-230f11d2193c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:02.837550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f2c1d42-f3a7-42f4-aee3-230f11d2193c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:02.838994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f2c1d42-f3a7-42f4-aee3-230f11d2193c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:02.846455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f2c1d42-f3a7-42f4-aee3-230f11d2193c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:02.847393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f2c1d42-f3a7-42f4-aee3-230f11d2193c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:02.848237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f2c1d42-f3a7-42f4-aee3-230f11d2193c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:03.020335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d76632e6-b874-444c-b046-95698a7eb2d4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:03.021877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d76632e6-b874-444c-b046-95698a7eb2d4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:03.034573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76632e6-b874-444c-b046-95698a7eb2d4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:03.035938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76632e6-b874-444c-b046-95698a7eb2d4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:03.037149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76632e6-b874-444c-b046-95698a7eb2d4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:03.038811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76632e6-b874-444c-b046-95698a7eb2d4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:03.040110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76632e6-b874-444c-b046-95698a7eb2d4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:03.041600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76632e6-b874-444c-b046-95698a7eb2d4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:03.238610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d76632e6-b874-444c-b046-95698a7eb2d4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:03.256758 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d76632e6-b874-444c-b046-95698a7eb2d4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1184 microversion: 2.1 time: 0.242627 Aug 25 12:58:03.258764 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1266/2478] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:03 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1184 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:58:03.304646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b093756c-0b4b-48ee-ae5b-16caa78630b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:03.307668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b093756c-0b4b-48ee-ae5b-16caa78630b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:03.317621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b093756c-0b4b-48ee-ae5b-16caa78630b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:03.319300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b093756c-0b4b-48ee-ae5b-16caa78630b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:03.320388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b093756c-0b4b-48ee-ae5b-16caa78630b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:03.322938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b093756c-0b4b-48ee-ae5b-16caa78630b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:03.324098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b093756c-0b4b-48ee-ae5b-16caa78630b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:03.325131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b093756c-0b4b-48ee-ae5b-16caa78630b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:03.356915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9f2c1d42-f3a7-42f4-aee3-230f11d2193c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:03.409590 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9f2c1d42-f3a7-42f4-aee3-230f11d2193c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1324 microversion: 2.1 time: 0.606696 Aug 25 12:58:03.411535 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1213/2479] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:02 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1324 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:03.497084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b093756c-0b4b-48ee-ae5b-16caa78630b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:03.517689 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b093756c-0b4b-48ee-ae5b-16caa78630b6 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.218894 Aug 25 12:58:03.520042 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1267/2480] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:03 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:03.856599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b83faf0-b8fb-4357-a7d5-04044716877e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:03.872755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b83faf0-b8fb-4357-a7d5-04044716877e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:03.873400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1d97b336-7d98-44f4-b755-3b8a4ead4106 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:03.880470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1d97b336-7d98-44f4-b755-3b8a4ead4106 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:03.893810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b83faf0-b8fb-4357-a7d5-04044716877e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:03.895700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b83faf0-b8fb-4357-a7d5-04044716877e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:03.897230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b83faf0-b8fb-4357-a7d5-04044716877e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:03.901931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b83faf0-b8fb-4357-a7d5-04044716877e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:03.915471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b83faf0-b8fb-4357-a7d5-04044716877e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:03.919029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b83faf0-b8fb-4357-a7d5-04044716877e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:03.921948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d97b336-7d98-44f4-b755-3b8a4ead4106 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:03.924728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d97b336-7d98-44f4-b755-3b8a4ead4106 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:03.926464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d97b336-7d98-44f4-b755-3b8a4ead4106 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:03.932907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d97b336-7d98-44f4-b755-3b8a4ead4106 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:03.934676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d97b336-7d98-44f4-b755-3b8a4ead4106 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:03.938602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d97b336-7d98-44f4-b755-3b8a4ead4106 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:04.293223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d97b336-7d98-44f4-b755-3b8a4ead4106 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:04.342413 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1d97b336-7d98-44f4-b755-3b8a4ead4106 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1275 microversion: 2.1 time: 0.478013 Aug 25 12:58:04.343232 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1268/2481] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:03 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1275 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:58:04.381716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b26b0e9-c00e-4fab-ab93-4173f26e7b0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:04.383742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3b26b0e9-c00e-4fab-ab93-4173f26e7b0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:04.397350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b26b0e9-c00e-4fab-ab93-4173f26e7b0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:04.398865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b26b0e9-c00e-4fab-ab93-4173f26e7b0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:04.400125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b26b0e9-c00e-4fab-ab93-4173f26e7b0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:04.402066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b26b0e9-c00e-4fab-ab93-4173f26e7b0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:04.404005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b26b0e9-c00e-4fab-ab93-4173f26e7b0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:04.406286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b26b0e9-c00e-4fab-ab93-4173f26e7b0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:04.645637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3b26b0e9-c00e-4fab-ab93-4173f26e7b0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:04.669674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b83faf0-b8fb-4357-a7d5-04044716877e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:04.677846 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3b26b0e9-c00e-4fab-ab93-4173f26e7b0b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1184 microversion: 2.1 time: 0.317141 Aug 25 12:58:04.683392 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1269/2482] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:04 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1184 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:04.684009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:04.698908 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b83faf0-b8fb-4357-a7d5-04044716877e tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1316 microversion: 2.1 time: 0.860480 Aug 25 12:58:04.714192 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1214/2483] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:03 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1316 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:04.715527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e3deb04f-ae04-41f1-a04d-5ec9cc67a4f8 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:04.729558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e3deb04f-ae04-41f1-a04d-5ec9cc67a4f8 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:04.740407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-219615c4-07c8-4d94-8d68-92e812553957 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:04.741967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-219615c4-07c8-4d94-8d68-92e812553957 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:04.750879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3deb04f-ae04-41f1-a04d-5ec9cc67a4f8 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:04.752523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3deb04f-ae04-41f1-a04d-5ec9cc67a4f8 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:04.754030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3deb04f-ae04-41f1-a04d-5ec9cc67a4f8 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:04.755907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3deb04f-ae04-41f1-a04d-5ec9cc67a4f8 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:04.756975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3deb04f-ae04-41f1-a04d-5ec9cc67a4f8 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:04.757845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-219615c4-07c8-4d94-8d68-92e812553957 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:04.758142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3deb04f-ae04-41f1-a04d-5ec9cc67a4f8 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:04.759393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-219615c4-07c8-4d94-8d68-92e812553957 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:04.760500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-219615c4-07c8-4d94-8d68-92e812553957 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:04.762224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-219615c4-07c8-4d94-8d68-92e812553957 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:04.763349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-219615c4-07c8-4d94-8d68-92e812553957 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:04.764468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-219615c4-07c8-4d94-8d68-92e812553957 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:04.923209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-219615c4-07c8-4d94-8d68-92e812553957 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:04.951492 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-219615c4-07c8-4d94-8d68-92e812553957 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.234586 Aug 25 12:58:04.986589 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1215/2484] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:04 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:05.221796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e3deb04f-ae04-41f1-a04d-5ec9cc67a4f8 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:05.249066 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e3deb04f-ae04-41f1-a04d-5ec9cc67a4f8 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 200 len: 1520 microversion: 2.1 time: 0.563180 Aug 25 12:58:05.251141 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1270/2485] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:04 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 1520 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:05.291468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Action: 'action', calling method: .version_select at 0x7f3a2c288b80>, body: {"addFloatingIp": {"address": "172.25.1.107"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:05.296827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:05.310439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:05.311590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:05.312484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:05.313963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:05.314882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:05.315751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:05.390500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dd486b5e-5354-4e15-8718-5b29ea571515 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:05.391940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dd486b5e-5354-4e15-8718-5b29ea571515 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:05.406930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "refresh_cache-81427539-a364-486a-8e7c-cd0ba4536b9d" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:58:05.408049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquired lock "refresh_cache-81427539-a364-486a-8e7c-cd0ba4536b9d" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:58:05.420271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd486b5e-5354-4e15-8718-5b29ea571515 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:05.424658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd486b5e-5354-4e15-8718-5b29ea571515 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:05.425782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd486b5e-5354-4e15-8718-5b29ea571515 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:05.429742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd486b5e-5354-4e15-8718-5b29ea571515 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:05.432445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd486b5e-5354-4e15-8718-5b29ea571515 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:05.436621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd486b5e-5354-4e15-8718-5b29ea571515 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:05.768755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dd486b5e-5354-4e15-8718-5b29ea571515 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:05.801975 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dd486b5e-5354-4e15-8718-5b29ea571515 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1273 microversion: 2.1 time: 0.417945 Aug 25 12:58:05.802947 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1271/2486] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:05 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1273 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:58:05.816518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-946a2295-8f37-4a62-be31-87508312826f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:05.826344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-946a2295-8f37-4a62-be31-87508312826f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:05.866793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-946a2295-8f37-4a62-be31-87508312826f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:05.871279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-946a2295-8f37-4a62-be31-87508312826f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:05.872785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-946a2295-8f37-4a62-be31-87508312826f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:05.882527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-946a2295-8f37-4a62-be31-87508312826f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:05.887518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-946a2295-8f37-4a62-be31-87508312826f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:05.892288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-946a2295-8f37-4a62-be31-87508312826f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:06.892402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-946a2295-8f37-4a62-be31-87508312826f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:06.900831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:06.938008 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-946a2295-8f37-4a62-be31-87508312826f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1184 microversion: 2.1 time: 1.129641 Aug 25 12:58:06.940626 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1272/2487] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:05 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1184 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:06.961220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-775e8c8e-7230-43e1-934f-571439778044 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:06.964918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-775e8c8e-7230-43e1-934f-571439778044 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:07.010403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775e8c8e-7230-43e1-934f-571439778044 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:07.013680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775e8c8e-7230-43e1-934f-571439778044 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:07.016323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775e8c8e-7230-43e1-934f-571439778044 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:07.017747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775e8c8e-7230-43e1-934f-571439778044 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:07.023625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775e8c8e-7230-43e1-934f-571439778044 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:07.025448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-775e8c8e-7230-43e1-934f-571439778044 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:07.972482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-775e8c8e-7230-43e1-934f-571439778044 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:08.035161 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-775e8c8e-7230-43e1-934f-571439778044 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1316 microversion: 2.1 time: 1.086284 Aug 25 12:58:08.043638 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1273/2488] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:06 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1316 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:08.089057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08eaecc0-c71e-40be-97cc-ea84d3f6769c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:08.099246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-08eaecc0-c71e-40be-97cc-ea84d3f6769c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:08.160972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08eaecc0-c71e-40be-97cc-ea84d3f6769c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:08.161910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08eaecc0-c71e-40be-97cc-ea84d3f6769c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:08.162741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08eaecc0-c71e-40be-97cc-ea84d3f6769c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:08.176957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08eaecc0-c71e-40be-97cc-ea84d3f6769c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:08.178054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08eaecc0-c71e-40be-97cc-ea84d3f6769c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:08.181185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08eaecc0-c71e-40be-97cc-ea84d3f6769c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:08.598241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-08eaecc0-c71e-40be-97cc-ea84d3f6769c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:08.634848 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-08eaecc0-c71e-40be-97cc-ea84d3f6769c tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1253 microversion: 2.1 time: 0.584529 Aug 25 12:58:08.640341 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1274/2489] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:08 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1253 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:08.665900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a5144aa0-0690-4a91-baa0-27589763bb02 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:08.669903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a5144aa0-0690-4a91-baa0-27589763bb02 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:08.706162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5144aa0-0690-4a91-baa0-27589763bb02 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:08.707613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5144aa0-0690-4a91-baa0-27589763bb02 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:08.709150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5144aa0-0690-4a91-baa0-27589763bb02 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:08.714072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5144aa0-0690-4a91-baa0-27589763bb02 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:08.718017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5144aa0-0690-4a91-baa0-27589763bb02 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:08.720953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5144aa0-0690-4a91-baa0-27589763bb02 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:09.731358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a5144aa0-0690-4a91-baa0-27589763bb02 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:09.768616 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a5144aa0-0690-4a91-baa0-27589763bb02 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1315 microversion: 2.1 time: 1.112646 Aug 25 12:58:09.769814 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1275/2490] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:08 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:09.803349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-87165aae-750a-48d3-9e8b-f168d16692af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:09.812408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-87165aae-750a-48d3-9e8b-f168d16692af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:09.846884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87165aae-750a-48d3-9e8b-f168d16692af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:09.848205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87165aae-750a-48d3-9e8b-f168d16692af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:09.849298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87165aae-750a-48d3-9e8b-f168d16692af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:09.851834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87165aae-750a-48d3-9e8b-f168d16692af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:09.860097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87165aae-750a-48d3-9e8b-f168d16692af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:09.866672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87165aae-750a-48d3-9e8b-f168d16692af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:09.922804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:10.048791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:10.262615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-87165aae-750a-48d3-9e8b-f168d16692af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:10.308758 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-87165aae-750a-48d3-9e8b-f168d16692af tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1184 microversion: 2.1 time: 0.527132 Aug 25 12:58:10.346282 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1276/2491] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:09 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1184 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:10.383769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eb932a64-e12c-4ca1-b292-2b4c96bae05b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:10.388913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eb932a64-e12c-4ca1-b292-2b4c96bae05b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:10.418692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb932a64-e12c-4ca1-b292-2b4c96bae05b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:10.420188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb932a64-e12c-4ca1-b292-2b4c96bae05b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:10.421334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb932a64-e12c-4ca1-b292-2b4c96bae05b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:10.423390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb932a64-e12c-4ca1-b292-2b4c96bae05b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:10.426365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb932a64-e12c-4ca1-b292-2b4c96bae05b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:10.431280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb932a64-e12c-4ca1-b292-2b4c96bae05b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:10.969206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Building network info cache for instance {{(pid=129059) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:58:11.405710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:11.514036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eb932a64-e12c-4ca1-b292-2b4c96bae05b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:11.551365 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eb932a64-e12c-4ca1-b292-2b4c96bae05b tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1316 microversion: 2.1 time: 1.192592 Aug 25 12:58:11.558473 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1277/2492] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:10 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1316 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:11.593484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:11.602049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:11.695388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:11.698857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.055s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:11.702654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:11.713238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:11.716622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:11.720526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:11.939974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:11.941252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:11.948004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:11.949550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lazy-loading 'fault' on Instance uuid d48a5d0b-80f0-43cf-a5b4-50707002de75 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:58:12.201050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c33cd8c1f0a4ac3ae9ad0410abb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf46d29d4b5348719c7673598f94e4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:12.248986 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3aa7929f-6a33-4418-90b3-1e3f083ee8cc tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 200 len: 1212 microversion: 2.1 time: 0.687971 Aug 25 12:58:12.252469 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1278/2493] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:11 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 1212 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:12.294063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9cf37ba7-307d-4f77-87c4-aae45cf29a96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:12.307965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9cf37ba7-307d-4f77-87c4-aae45cf29a96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:12.332715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf37ba7-307d-4f77-87c4-aae45cf29a96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:12.334445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf37ba7-307d-4f77-87c4-aae45cf29a96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:12.335671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf37ba7-307d-4f77-87c4-aae45cf29a96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:12.338627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf37ba7-307d-4f77-87c4-aae45cf29a96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:12.339950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf37ba7-307d-4f77-87c4-aae45cf29a96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:12.341401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cf37ba7-307d-4f77-87c4-aae45cf29a96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:13.751109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9cf37ba7-307d-4f77-87c4-aae45cf29a96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:13.787023 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9cf37ba7-307d-4f77-87c4-aae45cf29a96 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1315 microversion: 2.1 time: 1.532098 Aug 25 12:58:13.825848 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1279/2494] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:12 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1315 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:13.841954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0252f14c-18ca-4f9e-861d-4551310e5ab2 req-94d76242-ab1c-48e5-8bef-175d90924c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81427539-a364-486a-8e7c-cd0ba4536b9d", "tag": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:13.871588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0252f14c-18ca-4f9e-861d-4551310e5ab2 req-94d76242-ab1c-48e5-8bef-175d90924c48 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:13.872928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0252f14c-18ca-4f9e-861d-4551310e5ab2 req-94d76242-ab1c-48e5-8bef-175d90924c48 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:13.876089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0252f14c-18ca-4f9e-861d-4551310e5ab2 req-94d76242-ab1c-48e5-8bef-175d90924c48 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:13.938053 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0252f14c-18ca-4f9e-861d-4551310e5ab2 req-94d76242-ab1c-48e5-8bef-175d90924c48 service nova] Creating event network-changed:a7c80ac3-bf92-4489-a5f3-e9d699fb2d81 for instance 81427539-a364-486a-8e7c-cd0ba4536b9d on n-h1-852771-8 Aug 25 12:58:13.966878 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0252f14c-18ca-4f9e-861d-4551310e5ab2 req-94d76242-ab1c-48e5-8bef-175d90924c48 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138291 Aug 25 12:58:13.974265 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1280/2495] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:13.997054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2062759438", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "8786102b-a15d-4894-b94c-776d2b47ed6a"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:14.184460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] validate_networks() for [('8786102b-a15d-4894-b94c-776d2b47ed6a', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:58:14.789341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Updating instance_info_cache with network_info: [{"id": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81", "address": "fa:16:3e:da:0d:20", "network": {"id": "76635244-431e-41b7-9377-f49623b762de", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-807492449-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4719646f1444a8ea7977af53061340a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa7c80ac3-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129059) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:58:14.812020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Releasing lock "refresh_cache-81427539-a364-486a-8e7c-cd0ba4536b9d" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:58:14.813952 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4ea04579-6c60-4ffa-a401-d11684ad3a53 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "POST /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d/action" status: 202 len: 0 microversion: 2.1 time: 9.530750 Aug 25 12:58:14.816745 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1216/2496] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:05 2022] POST /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d/action => generated 0 bytes in 9535 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:58:14.842501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e8af004-0fc2-4eb6-a54e-42fe8581d23c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:14.843738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6e8af004-0fc2-4eb6-a54e-42fe8581d23c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:14.867876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e8af004-0fc2-4eb6-a54e-42fe8581d23c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:14.868729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e8af004-0fc2-4eb6-a54e-42fe8581d23c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:14.869564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e8af004-0fc2-4eb6-a54e-42fe8581d23c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:14.876719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e8af004-0fc2-4eb6-a54e-42fe8581d23c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:14.877965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e8af004-0fc2-4eb6-a54e-42fe8581d23c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:14.879034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e8af004-0fc2-4eb6-a54e-42fe8581d23c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.201376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e8af004-0fc2-4eb6-a54e-42fe8581d23c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:15.256597 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6e8af004-0fc2-4eb6-a54e-42fe8581d23c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1184 microversion: 2.1 time: 0.435340 Aug 25 12:58:15.280766 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1217/2497] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:14 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1184 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:15.303965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6a75b8d6-95e1-4dbc-9ef3-5b6825c2fd3c req-d246aba4-c3fb-4098-94e0-fa3d2dff8ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade349c6-8fb8-4a74-a87f-bff718e29ad1", "name": "network-vif-plugged", "status": "completed", "tag": "80325278-076e-48b7-ab0c-04ec2238f397"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:15.351612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a75b8d6-95e1-4dbc-9ef3-5b6825c2fd3c req-d246aba4-c3fb-4098-94e0-fa3d2dff8ade service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.353435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a75b8d6-95e1-4dbc-9ef3-5b6825c2fd3c req-d246aba4-c3fb-4098-94e0-fa3d2dff8ade service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.357543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a75b8d6-95e1-4dbc-9ef3-5b6825c2fd3c req-d246aba4-c3fb-4098-94e0-fa3d2dff8ade service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.413208 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6a75b8d6-95e1-4dbc-9ef3-5b6825c2fd3c req-d246aba4-c3fb-4098-94e0-fa3d2dff8ade service nova] Creating event network-vif-plugged:80325278-076e-48b7-ab0c-04ec2238f397 for instance ade349c6-8fb8-4a74-a87f-bff718e29ad1 on n-h1-852771-8 Aug 25 12:58:15.439576 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6a75b8d6-95e1-4dbc-9ef3-5b6825c2fd3c req-d246aba4-c3fb-4098-94e0-fa3d2dff8ade service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148098 Aug 25 12:58:15.442691 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1218/2498] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:15.469372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-67b06d85-8b37-4106-a6f4-6f30b9597706 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:15.471000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-67b06d85-8b37-4106-a6f4-6f30b9597706 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:15.496616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b06d85-8b37-4106-a6f4-6f30b9597706 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.497587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b06d85-8b37-4106-a6f4-6f30b9597706 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.502535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b06d85-8b37-4106-a6f4-6f30b9597706 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.503691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b06d85-8b37-4106-a6f4-6f30b9597706 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.509820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b06d85-8b37-4106-a6f4-6f30b9597706 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.511111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b06d85-8b37-4106-a6f4-6f30b9597706 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:16.195133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:58:16.197229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:58:16.198870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:58:16.200225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:58:16.201023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:58:16.240160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:16.245022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:16.258135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:16.260351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:16.261256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:16.262488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:16.318003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-67b06d85-8b37-4106-a6f4-6f30b9597706 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:16.346563 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-67b06d85-8b37-4106-a6f4-6f30b9597706 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1316 microversion: 2.1 time: 0.901532 Aug 25 12:58:16.348095 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1219/2499] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:15 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1316 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:16.354425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:58:16.364045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8b61f4a3-0840-44ac-baea-99b3887cc6ad req-58642dd9-b78b-4c1f-a646-37da362d0e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1df7169-5d0d-49ec-b515-10e8b0346159", "tag": "bd9ba707-5ed9-4937-8ed6-f39a96c948e0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:16.369634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for user 2b81a6a01a24413b8212f140080ed018 and project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:58:16.398657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:58:16.405011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:58:16.406454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8b61f4a3-0840-44ac-baea-99b3887cc6ad req-58642dd9-b78b-4c1f-a646-37da362d0e8c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:16.407424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8b61f4a3-0840-44ac-baea-99b3887cc6ad req-58642dd9-b78b-4c1f-a646-37da362d0e8c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:16.408462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8b61f4a3-0840-44ac-baea-99b3887cc6ad req-58642dd9-b78b-4c1f-a646-37da362d0e8c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:16.453388 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8b61f4a3-0840-44ac-baea-99b3887cc6ad req-58642dd9-b78b-4c1f-a646-37da362d0e8c service nova] Creating event network-changed:bd9ba707-5ed9-4937-8ed6-f39a96c948e0 for instance e1df7169-5d0d-49ec-b515-10e8b0346159 on n-h2-852771-8 Aug 25 12:58:16.468218 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8b61f4a3-0840-44ac-baea-99b3887cc6ad req-58642dd9-b78b-4c1f-a646-37da362d0e8c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117729 Aug 25 12:58:16.470483 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1220/2500] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:16.484813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:16.504275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] [instance: d48a5d0b-80f0-43cf-a5b4-50707002de75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:16.524883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:16.531914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:16.535910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:16.540370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:16.541392 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4762cda2-e4a4-41c5-b43b-b87d9f6f023b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.563694 Aug 25 12:58:16.542873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:16.547350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:16.553942 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1281/2501] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:58:16.564383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.107"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:16.569464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:16.589026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:16.590638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:16.591961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:16.595051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:16.596467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:16.597823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:16.604718 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] HTTP exception thrown: Instance d48a5d0b-80f0-43cf-a5b4-50707002de75 could not be found. Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Request method failure captured: Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 HTTP/1.1 Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3DeQHpwcDARgei_InkNP25LropkZyXrpEwug64k5jRkPyqPQOQjJjawV5DL0uAyKDs7re48pzen56adOq4oix_C_58xMj0-DALxkylfufyJtliZupu36LuLQip_dyooANtWmBpmczEcC3Kw2zVgyMJ1fNzpq3Ib013vDxH1CRPXzTc Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: bf46d29d4b5348719c7673598f94e4fd Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestBootFromVolume-789739761 Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf46d29d4b5348719c7673598f94e4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf46d29d4b5348719c7673598f94e4fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf46d29d4b5348719c7673598f94e4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf46d29d4b5348719c7673598f94e4fd"}]}] Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestBootFromVolume-789739761 Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: bf46d29d4b5348719c7673598f94e4fd Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestBootFromVolume-789739761 Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestBootFromVolume-789739761-project Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1c33cd8c1f0a4ac3ae9ad0410abb8a5b Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestBootFromVolume-789739761-project Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance d48a5d0b-80f0-43cf-a5b4-50707002de75 could not be found. Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'd48a5d0b-80f0-43cf-a5b4-50707002de75'} Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48a5d0b-80f0-43cf-a5b4-50707002de75 could not be found. Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48a5d0b-80f0-43cf-a5b4-50707002de75 could not be found. Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:16.608271 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:16.619951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:16.619951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:16.619951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:16.619951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:58:16.619951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:58:16.619951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48a5d0b-80f0-43cf-a5b4-50707002de75 could not be found. Aug 25 12:58:16.619951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:16.619951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Returning 404 to user: Instance d48a5d0b-80f0-43cf-a5b4-50707002de75 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:58:16.619951 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-892f8afe-8901-4c31-9e8f-ce50646bf311 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75" status: 404 len: 111 microversion: 2.1 time: 0.138477 Aug 25 12:58:16.619951 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1221/2502] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:16 2022] GET /compute/v2.1/servers/d48a5d0b-80f0-43cf-a5b4-50707002de75 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:58:16.631027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cfdfe59e-2af6-4763-a80e-647fd3243427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:16.632338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cfdfe59e-2af6-4763-a80e-647fd3243427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:16.647117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdfe59e-2af6-4763-a80e-647fd3243427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:16.647997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdfe59e-2af6-4763-a80e-647fd3243427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:16.648793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdfe59e-2af6-4763-a80e-647fd3243427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:16.650671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdfe59e-2af6-4763-a80e-647fd3243427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:16.651627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdfe59e-2af6-4763-a80e-647fd3243427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:16.652467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfdfe59e-2af6-4763-a80e-647fd3243427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:16.775917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "refresh_cache-586ef5d3-65f8-47ca-856b-167fdaeb7ced" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:58:16.777102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquired lock "refresh_cache-586ef5d3-65f8-47ca-856b-167fdaeb7ced" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:58:17.403240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cfdfe59e-2af6-4763-a80e-647fd3243427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:17.443619 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cfdfe59e-2af6-4763-a80e-647fd3243427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1315 microversion: 2.1 time: 0.820668 Aug 25 12:58:17.458710 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1222/2503] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:16 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1315 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:17.487955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3034d569-adbe-4773-b27c-a8c9384adb8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:17.489298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3034d569-adbe-4773-b27c-a8c9384adb8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:17.503069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3034d569-adbe-4773-b27c-a8c9384adb8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:17.503941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3034d569-adbe-4773-b27c-a8c9384adb8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:17.505127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3034d569-adbe-4773-b27c-a8c9384adb8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:17.507142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3034d569-adbe-4773-b27c-a8c9384adb8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:17.508339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3034d569-adbe-4773-b27c-a8c9384adb8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:17.509969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3034d569-adbe-4773-b27c-a8c9384adb8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:17.757292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3034d569-adbe-4773-b27c-a8c9384adb8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:17.783144 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3034d569-adbe-4773-b27c-a8c9384adb8f tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1184 microversion: 2.1 time: 0.321979 Aug 25 12:58:17.807813 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1223/2504] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:17 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1184 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:17.830728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c4c8b531-bd4c-4dc1-945b-c45f88e44b0f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:17.832482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c4c8b531-bd4c-4dc1-945b-c45f88e44b0f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:19.002034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c4c8b531-bd4c-4dc1-945b-c45f88e44b0f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:19.049852 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c4c8b531-bd4c-4dc1-945b-c45f88e44b0f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 200 len: 1215 microversion: 2.1 time: 1.233766 Aug 25 12:58:19.057557 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1224/2505] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:17 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 1215 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:19.084864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-91058194-fac1-4fac-981d-8d7ea33d29c2 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] Calling method '.version_select at 0x7f3a29f51670>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:19.149674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:19.224344 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-91058194-fac1-4fac-981d-8d7ea33d29c2 tempest-ServersTestBootFromVolume-789739761 tempest-ServersTestBootFromVolume-789739761-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335077997" status: 202 len: 0 microversion: 2.1 time: 0.162978 Aug 25 12:58:19.229012 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1225/2506] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 12:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335077997 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:58:19.253075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3047fdb2-ecbb-45d5-8d7a-d9f70a7b26b0 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:19.258146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3047fdb2-ecbb-45d5-8d7a-d9f70a7b26b0 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:19.276864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3047fdb2-ecbb-45d5-8d7a-d9f70a7b26b0 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:19.278522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3047fdb2-ecbb-45d5-8d7a-d9f70a7b26b0 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:19.281701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3047fdb2-ecbb-45d5-8d7a-d9f70a7b26b0 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:19.285154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3047fdb2-ecbb-45d5-8d7a-d9f70a7b26b0 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:19.286329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3047fdb2-ecbb-45d5-8d7a-d9f70a7b26b0 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:19.288231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3047fdb2-ecbb-45d5-8d7a-d9f70a7b26b0 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:20.591650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3047fdb2-ecbb-45d5-8d7a-d9f70a7b26b0 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:20.652400 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3047fdb2-ecbb-45d5-8d7a-d9f70a7b26b0 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1504 microversion: 2.1 time: 1.411431 Aug 25 12:58:20.679434 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1226/2507] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:19 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1504 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:20.713803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f893379f-83a4-4d78-807c-cc22d3acf9b1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:20.715198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f893379f-83a4-4d78-807c-cc22d3acf9b1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:20.747458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f893379f-83a4-4d78-807c-cc22d3acf9b1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:20.748975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f893379f-83a4-4d78-807c-cc22d3acf9b1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:20.750368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f893379f-83a4-4d78-807c-cc22d3acf9b1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:20.756866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f893379f-83a4-4d78-807c-cc22d3acf9b1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:20.760782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f893379f-83a4-4d78-807c-cc22d3acf9b1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:20.764139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f893379f-83a4-4d78-807c-cc22d3acf9b1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:21.593204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f893379f-83a4-4d78-807c-cc22d3acf9b1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:21.613616 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f893379f-83a4-4d78-807c-cc22d3acf9b1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1315 microversion: 2.1 time: 0.931586 Aug 25 12:58:21.614690 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1227/2508] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:20 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1315 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:21.630092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b94e7d58-4533-40ea-832a-4988a1398e3a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:21.631808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b94e7d58-4533-40ea-832a-4988a1398e3a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:21.729545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b94e7d58-4533-40ea-832a-4988a1398e3a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:21.731654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b94e7d58-4533-40ea-832a-4988a1398e3a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:21.732369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b94e7d58-4533-40ea-832a-4988a1398e3a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:21.733356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b94e7d58-4533-40ea-832a-4988a1398e3a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:21.734194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b94e7d58-4533-40ea-832a-4988a1398e3a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:21.734794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b94e7d58-4533-40ea-832a-4988a1398e3a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:21.909728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b94e7d58-4533-40ea-832a-4988a1398e3a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:21.946288 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b94e7d58-4533-40ea-832a-4988a1398e3a tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1184 microversion: 2.1 time: 0.325227 Aug 25 12:58:21.969641 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1228/2509] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:21 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1184 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:21.997215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-441dbd62-80d7-4020-9b8d-31f264eb2270 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:21.998223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-441dbd62-80d7-4020-9b8d-31f264eb2270 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:22.032345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-441dbd62-80d7-4020-9b8d-31f264eb2270 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:22.034464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-441dbd62-80d7-4020-9b8d-31f264eb2270 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:22.035671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-441dbd62-80d7-4020-9b8d-31f264eb2270 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:22.038500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-441dbd62-80d7-4020-9b8d-31f264eb2270 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:22.043558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-441dbd62-80d7-4020-9b8d-31f264eb2270 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:22.045080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-441dbd62-80d7-4020-9b8d-31f264eb2270 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:22.130446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-441dbd62-80d7-4020-9b8d-31f264eb2270 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:58:22.447550 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-441dbd62-80d7-4020-9b8d-31f264eb2270 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 204 len: 0 microversion: 2.1 time: 0.471469 Aug 25 12:58:22.452894 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1229/2510] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:58:21 2022] DELETE /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:58:22.479047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e4055cd1-c2b6-465c-936d-642cab4f7b68 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:22.480558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e4055cd1-c2b6-465c-936d-642cab4f7b68 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:22.518865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4055cd1-c2b6-465c-936d-642cab4f7b68 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:22.525770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4055cd1-c2b6-465c-936d-642cab4f7b68 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:22.538743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4055cd1-c2b6-465c-936d-642cab4f7b68 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:22.541694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4055cd1-c2b6-465c-936d-642cab4f7b68 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:22.543304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4055cd1-c2b6-465c-936d-642cab4f7b68 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:22.546809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4055cd1-c2b6-465c-936d-642cab4f7b68 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:22.731335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e4055cd1-c2b6-465c-936d-642cab4f7b68 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:22.736298 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e4055cd1-c2b6-465c-936d-642cab4f7b68 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1/os-instance-actions/req-eebca177-f60a-4405-b79f-17af71d3f78b" status: 200 len: 313 microversion: 2.1 time: 0.280316 Aug 25 12:58:22.760995 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1230/2511] 10.222.0.70 () {58 vars in 1419 bytes} [Thu Aug 25 12:58:22 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1/os-instance-actions/req-eebca177-f60a-4405-b79f-17af71d3f78b => generated 313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:22.770671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a1c6f199-f2e7-4507-8a6b-c1cc901d3aa0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:22.771844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a1c6f199-f2e7-4507-8a6b-c1cc901d3aa0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:22.802871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1c6f199-f2e7-4507-8a6b-c1cc901d3aa0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:22.803762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1c6f199-f2e7-4507-8a6b-c1cc901d3aa0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:22.804560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1c6f199-f2e7-4507-8a6b-c1cc901d3aa0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:22.814690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1c6f199-f2e7-4507-8a6b-c1cc901d3aa0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:22.818388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1c6f199-f2e7-4507-8a6b-c1cc901d3aa0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:22.819230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1c6f199-f2e7-4507-8a6b-c1cc901d3aa0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:23.165993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1c6f199-f2e7-4507-8a6b-c1cc901d3aa0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:23.192532 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a1c6f199-f2e7-4507-8a6b-c1cc901d3aa0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 200 len: 1273 microversion: 2.1 time: 0.429433 Aug 25 12:58:23.213545 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1231/2512] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:22 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 1273 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:23.236391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7661e86c-9d55-4a55-80e8-6121d7340b57 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:23.238081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7661e86c-9d55-4a55-80e8-6121d7340b57 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:23.292157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7661e86c-9d55-4a55-80e8-6121d7340b57 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:23.295529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7661e86c-9d55-4a55-80e8-6121d7340b57 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:23.304081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7661e86c-9d55-4a55-80e8-6121d7340b57 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:23.306259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7661e86c-9d55-4a55-80e8-6121d7340b57 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:23.319673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7661e86c-9d55-4a55-80e8-6121d7340b57 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:23.325254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7661e86c-9d55-4a55-80e8-6121d7340b57 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:24.185655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7661e86c-9d55-4a55-80e8-6121d7340b57 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:24.208605 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7661e86c-9d55-4a55-80e8-6121d7340b57 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1315 microversion: 2.1 time: 1.005430 Aug 25 12:58:24.226102 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1232/2513] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:23 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:24.265483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cff69a05-a208-4a4d-829a-55e8c1591992 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:24.282900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cff69a05-a208-4a4d-829a-55e8c1591992 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:24.333944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cff69a05-a208-4a4d-829a-55e8c1591992 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:24.336186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cff69a05-a208-4a4d-829a-55e8c1591992 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:24.344121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cff69a05-a208-4a4d-829a-55e8c1591992 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:24.346384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cff69a05-a208-4a4d-829a-55e8c1591992 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:24.347619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cff69a05-a208-4a4d-829a-55e8c1591992 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:24.348776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cff69a05-a208-4a4d-829a-55e8c1591992 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:24.370488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:24.852733 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cff69a05-a208-4a4d-829a-55e8c1591992 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "POST /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1/action" status: 202 len: 0 microversion: 2.1 time: 0.619929 Aug 25 12:58:24.881103 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1233/2514] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:24 2022] POST /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:58:24.921482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5aa9ed63-fd33-440c-9302-68e10542c3c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:24.922877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5aa9ed63-fd33-440c-9302-68e10542c3c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:24.962578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa9ed63-fd33-440c-9302-68e10542c3c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:24.963609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa9ed63-fd33-440c-9302-68e10542c3c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:24.964403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa9ed63-fd33-440c-9302-68e10542c3c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:24.971212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa9ed63-fd33-440c-9302-68e10542c3c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:24.975580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa9ed63-fd33-440c-9302-68e10542c3c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:24.976646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa9ed63-fd33-440c-9302-68e10542c3c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:25.926725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5aa9ed63-fd33-440c-9302-68e10542c3c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:25.946124 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5aa9ed63-fd33-440c-9302-68e10542c3c6 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 200 len: 1184 microversion: 2.1 time: 1.055208 Aug 25 12:58:25.958959 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1234/2515] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:24 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 1184 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:25.997613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-17de9c7a-4712-4e7b-8384-b5b14870aeb5 req-be37adf8-c98c-4118-b4e3-6da5f385efb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1df7169-5d0d-49ec-b515-10e8b0346159", "name": "network-vif-plugged", "status": "completed", "tag": "bd9ba707-5ed9-4937-8ed6-f39a96c948e0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:26.041594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-17de9c7a-4712-4e7b-8384-b5b14870aeb5 req-be37adf8-c98c-4118-b4e3-6da5f385efb3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:26.050754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-17de9c7a-4712-4e7b-8384-b5b14870aeb5 req-be37adf8-c98c-4118-b4e3-6da5f385efb3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:26.058723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-17de9c7a-4712-4e7b-8384-b5b14870aeb5 req-be37adf8-c98c-4118-b4e3-6da5f385efb3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:26.117893 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-17de9c7a-4712-4e7b-8384-b5b14870aeb5 req-be37adf8-c98c-4118-b4e3-6da5f385efb3 service nova] Creating event network-vif-plugged:bd9ba707-5ed9-4937-8ed6-f39a96c948e0 for instance e1df7169-5d0d-49ec-b515-10e8b0346159 on n-h2-852771-8 Aug 25 12:58:26.148180 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-17de9c7a-4712-4e7b-8384-b5b14870aeb5 req-be37adf8-c98c-4118-b4e3-6da5f385efb3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180129 Aug 25 12:58:26.168641 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1235/2516] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:26.201445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3b3b4e93-9285-4eea-9216-2ea783a70a94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:26.202883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3b3b4e93-9285-4eea-9216-2ea783a70a94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:26.234693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b3b4e93-9285-4eea-9216-2ea783a70a94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:26.235648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b3b4e93-9285-4eea-9216-2ea783a70a94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:26.236644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b3b4e93-9285-4eea-9216-2ea783a70a94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:26.244773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b3b4e93-9285-4eea-9216-2ea783a70a94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:26.246300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b3b4e93-9285-4eea-9216-2ea783a70a94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:26.247118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b3b4e93-9285-4eea-9216-2ea783a70a94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:26.279199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:26.390266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:26.587306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:26.769027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=53 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:27.690106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3b3b4e93-9285-4eea-9216-2ea783a70a94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:27.727733 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3b3b4e93-9285-4eea-9216-2ea783a70a94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 200 len: 1315 microversion: 2.1 time: 1.551766 Aug 25 12:58:27.730412 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1236/2517] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:26 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 1315 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:27.751409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9fe31e05-3f5e-46ec-a208-aebd03b13536 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:27.754949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9fe31e05-3f5e-46ec-a208-aebd03b13536 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:27.779296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fe31e05-3f5e-46ec-a208-aebd03b13536 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:27.780081 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.network.neutron [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] re-assign floating IP 172.25.1.107 from instance 81427539-a364-486a-8e7c-cd0ba4536b9d Aug 25 12:58:27.781423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fe31e05-3f5e-46ec-a208-aebd03b13536 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:27.782335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fe31e05-3f5e-46ec-a208-aebd03b13536 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:27.783596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fe31e05-3f5e-46ec-a208-aebd03b13536 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:27.784514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fe31e05-3f5e-46ec-a208-aebd03b13536 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:27.785482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fe31e05-3f5e-46ec-a208-aebd03b13536 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:27.981106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Building network info cache for instance {{(pid=129060) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:58:29.020743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:29.118936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9fe31e05-3f5e-46ec-a208-aebd03b13536 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:29.155395 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9fe31e05-3f5e-46ec-a208-aebd03b13536 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1506 microversion: 2.1 time: 1.420146 Aug 25 12:58:29.157828 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1237/2518] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:27 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1506 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:29.202207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b127935c-03cb-4131-82d5-7c58dba0e427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:29.211191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b127935c-03cb-4131-82d5-7c58dba0e427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:29.252989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b127935c-03cb-4131-82d5-7c58dba0e427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:29.262842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b127935c-03cb-4131-82d5-7c58dba0e427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:29.264249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b127935c-03cb-4131-82d5-7c58dba0e427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:29.266026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b127935c-03cb-4131-82d5-7c58dba0e427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:29.268922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b127935c-03cb-4131-82d5-7c58dba0e427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:29.275843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b127935c-03cb-4131-82d5-7c58dba0e427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:30.550414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b127935c-03cb-4131-82d5-7c58dba0e427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:30.615205 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b127935c-03cb-4131-82d5-7c58dba0e427 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1503 microversion: 2.1 time: 1.437637 Aug 25 12:58:30.624520 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1238/2519] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:29 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1503 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:30.648445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:30.685380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 24695ae5-f061-4367-ba68-ba09b5e60cd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:30.725016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:30.726138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:30.727026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:30.739586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:30.740900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:30.743890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:30.802658 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] HTTP exception thrown: Instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 could not be found. Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Request method failure captured: Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 HTTP/1.1 Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB2798MLDFBXKtcI5bfZbD-ym0xfAWRceYZM5zRwPd8pK8OQBsxPsnkbZfnXqUoJ3RLLBu76f7wHPGQrG9qrIug60g9h8XvWx1X1hKf9cK3kLnGTBziTjLMQk8AbsQ3sDTCFeWRdvQyflRgybaFQFXdL1iyGK6s5yvoYWWccKvHRTBn4 Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5473d51e2cf040a3ae656d7e987feec2 Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-LiveMigrationTest-940338641 Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d51e2cf040a3ae656d7e987feec2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5473d51e2cf040a3ae656d7e987feec2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5473d51e2cf040a3ae656d7e987feec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d51e2cf040a3ae656d7e987feec2"}]}] Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-LiveMigrationTest-940338641 Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5473d51e2cf040a3ae656d7e987feec2 Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-LiveMigrationTest-940338641 Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-LiveMigrationTest-940338641-project Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 81b5d1940fe64714bd9ba7d2009004fd Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-LiveMigrationTest-940338641-project Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 could not be found. Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '24695ae5-f061-4367-ba68-ba09b5e60cd8'} Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 could not be found. Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 could not be found. Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:30.808415 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:30.817601 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:30.817601 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:30.817601 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:30.817601 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:58:30.817601 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:58:30.817601 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 could not be found. Aug 25 12:58:30.817601 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:30.820534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Returning 404 to user: Instance 24695ae5-f061-4367-ba68-ba09b5e60cd8 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:58:30.834908 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c4313fbd-fc5d-4ba5-a8d9-1c5d219ad404 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8" status: 404 len: 111 microversion: 2.1 time: 0.207739 Aug 25 12:58:30.836954 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1239/2520] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:30 2022] GET /compute/v2.1/servers/24695ae5-f061-4367-ba68-ba09b5e60cd8 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:58:30.872633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-5ece1965-8230-4197-a5dc-476e819dbb42 req-8b06016a-052b-4780-b53a-144e6fd415b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81427539-a364-486a-8e7c-cd0ba4536b9d", "tag": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:30.950955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5ece1965-8230-4197-a5dc-476e819dbb42 req-8b06016a-052b-4780-b53a-144e6fd415b9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:30.950955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5ece1965-8230-4197-a5dc-476e819dbb42 req-8b06016a-052b-4780-b53a-144e6fd415b9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:30.962751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5ece1965-8230-4197-a5dc-476e819dbb42 req-8b06016a-052b-4780-b53a-144e6fd415b9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:31.044562 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5ece1965-8230-4197-a5dc-476e819dbb42 req-8b06016a-052b-4780-b53a-144e6fd415b9 service nova] Creating event network-changed:a7c80ac3-bf92-4489-a5f3-e9d699fb2d81 for instance 81427539-a364-486a-8e7c-cd0ba4536b9d on n-h1-852771-8 Aug 25 12:58:31.069638 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-5ece1965-8230-4197-a5dc-476e819dbb42 req-8b06016a-052b-4780-b53a-144e6fd415b9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211578 Aug 25 12:58:31.074437 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1240/2521] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:31.116479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7f8cb553-6a7e-4b28-b76c-4b1c8f6e6505 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:31.123297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7f8cb553-6a7e-4b28-b76c-4b1c8f6e6505 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:31.154811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f8cb553-6a7e-4b28-b76c-4b1c8f6e6505 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:31.158857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f8cb553-6a7e-4b28-b76c-4b1c8f6e6505 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:31.161464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f8cb553-6a7e-4b28-b76c-4b1c8f6e6505 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:31.163934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f8cb553-6a7e-4b28-b76c-4b1c8f6e6505 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:31.168945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f8cb553-6a7e-4b28-b76c-4b1c8f6e6505 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:31.170008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f8cb553-6a7e-4b28-b76c-4b1c8f6e6505 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:32.352810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Updating instance_info_cache with network_info: [{"id": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81", "address": "fa:16:3e:da:0d:20", "network": {"id": "76635244-431e-41b7-9377-f49623b762de", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-807492449-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4719646f1444a8ea7977af53061340a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa7c80ac3-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129060) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:58:32.420934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Building network info cache for instance {{(pid=129060) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:58:33.740518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7f8cb553-6a7e-4b28-b76c-4b1c8f6e6505 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:33.803318 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7f8cb553-6a7e-4b28-b76c-4b1c8f6e6505 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 200 len: 1315 microversion: 2.1 time: 2.711699 Aug 25 12:58:33.808874 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1241/2522] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:31 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 1315 bytes in 2732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:33.834776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b11779b3-54c6-45c4-80a2-152787f2296d req-f03d7c27-6431-4b9c-bf5e-03281a4a2255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d3c3dd-dfa6-4d24-bd30-df478d87d7b7", "tag": "34d1d2c8-2934-4f93-a204-a39ecd337aec"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:33.887146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b11779b3-54c6-45c4-80a2-152787f2296d req-f03d7c27-6431-4b9c-bf5e-03281a4a2255 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:33.893493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b11779b3-54c6-45c4-80a2-152787f2296d req-f03d7c27-6431-4b9c-bf5e-03281a4a2255 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:33.896936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b11779b3-54c6-45c4-80a2-152787f2296d req-f03d7c27-6431-4b9c-bf5e-03281a4a2255 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:33.959176 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b11779b3-54c6-45c4-80a2-152787f2296d req-f03d7c27-6431-4b9c-bf5e-03281a4a2255 service nova] Creating event network-changed:34d1d2c8-2934-4f93-a204-a39ecd337aec for instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 on n-h1-852771-8 Aug 25 12:58:33.984173 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b11779b3-54c6-45c4-80a2-152787f2296d req-f03d7c27-6431-4b9c-bf5e-03281a4a2255 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168302 Aug 25 12:58:33.984898 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1242/2523] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:34.009366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8fb2f3ad-aff9-49e5-817b-1529da35d969 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:34.015231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8fb2f3ad-aff9-49e5-817b-1529da35d969 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:34.043610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fb2f3ad-aff9-49e5-817b-1529da35d969 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:34.048161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fb2f3ad-aff9-49e5-817b-1529da35d969 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:34.051356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fb2f3ad-aff9-49e5-817b-1529da35d969 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:34.058413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fb2f3ad-aff9-49e5-817b-1529da35d969 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:34.064247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fb2f3ad-aff9-49e5-817b-1529da35d969 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:34.071740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fb2f3ad-aff9-49e5-817b-1529da35d969 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:37.240846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8fb2f3ad-aff9-49e5-817b-1529da35d969 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:37.278983 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8fb2f3ad-aff9-49e5-817b-1529da35d969 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1504 microversion: 2.1 time: 3.288075 Aug 25 12:58:37.288753 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1243/2524] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:33 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1504 bytes in 3302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:37.337832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b9ce4be-5483-42d0-8f22-f6d1a02c5149 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1663803159"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:37.344250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6b9ce4be-5483-42d0-8f22-f6d1a02c5149 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:37.401087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b9ce4be-5483-42d0-8f22-f6d1a02c5149 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:37.402032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b9ce4be-5483-42d0-8f22-f6d1a02c5149 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:37.407585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b9ce4be-5483-42d0-8f22-f6d1a02c5149 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:37.409328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b9ce4be-5483-42d0-8f22-f6d1a02c5149 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:37.413464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b9ce4be-5483-42d0-8f22-f6d1a02c5149 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:37.418302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b9ce4be-5483-42d0-8f22-f6d1a02c5149 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:38.672976 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.network.security_group_api [None req-6b9ce4be-5483-42d0-8f22-f6d1a02c5149 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Adding security group 3b1e1efa-d517-456d-a6df-adbee537d937 to port bd9ba707-5ed9-4937-8ed6-f39a96c948e0 Aug 25 12:58:39.454150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Updating instance_info_cache with network_info: [{"id": "ea948e8c-9fa9-4615-88c2-16f3e4c9d28f", "address": "fa:16:3e:13:a2:19", "network": {"id": "76635244-431e-41b7-9377-f49623b762de", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-807492449-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4719646f1444a8ea7977af53061340a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapea948e8c-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129060) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:58:39.513954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Releasing lock "refresh_cache-586ef5d3-65f8-47ca-856b-167fdaeb7ced" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:58:39.520082 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-845a6118-e718-4075-8992-46fb48b7e8ca tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "POST /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced/action" status: 202 len: 0 microversion: 2.1 time: 22.962497 Aug 25 12:58:39.542770 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1282/2525] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:16 2022] POST /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced/action => generated 0 bytes in 22988 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:58:39.568064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d9d26eba-b86e-4ac5-bbe6-a12f50ec37f5 req-3d4b06c7-3b59-4b0d-b524-b939b2622ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586ef5d3-65f8-47ca-856b-167fdaeb7ced", "tag": "ea948e8c-9fa9-4615-88c2-16f3e4c9d28f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:39.629563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d9d26eba-b86e-4ac5-bbe6-a12f50ec37f5 req-3d4b06c7-3b59-4b0d-b524-b939b2622ffc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:39.630919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d9d26eba-b86e-4ac5-bbe6-a12f50ec37f5 req-3d4b06c7-3b59-4b0d-b524-b939b2622ffc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:39.633958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d9d26eba-b86e-4ac5-bbe6-a12f50ec37f5 req-3d4b06c7-3b59-4b0d-b524-b939b2622ffc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:39.726566 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d9d26eba-b86e-4ac5-bbe6-a12f50ec37f5 req-3d4b06c7-3b59-4b0d-b524-b939b2622ffc service nova] Creating event network-changed:ea948e8c-9fa9-4615-88c2-16f3e4c9d28f for instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced on n-h2-852771-8 Aug 25 12:58:39.743801 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d9d26eba-b86e-4ac5-bbe6-a12f50ec37f5 req-3d4b06c7-3b59-4b0d-b524-b939b2622ffc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195991 Aug 25 12:58:39.756982 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1283/2526] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:39.791621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e504842-229b-455c-9bd4-3e742e2904f2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:39.795880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3e504842-229b-455c-9bd4-3e742e2904f2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:39.814180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e504842-229b-455c-9bd4-3e742e2904f2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:39.815051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e504842-229b-455c-9bd4-3e742e2904f2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:39.822030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e504842-229b-455c-9bd4-3e742e2904f2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:39.823741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e504842-229b-455c-9bd4-3e742e2904f2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:39.830257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e504842-229b-455c-9bd4-3e742e2904f2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:39.831749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e504842-229b-455c-9bd4-3e742e2904f2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:42.553937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3e504842-229b-455c-9bd4-3e742e2904f2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:42.597449 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3e504842-229b-455c-9bd4-3e742e2904f2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 200 len: 1315 microversion: 2.1 time: 2.836778 Aug 25 12:58:42.616395 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1284/2527] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:39 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 1315 bytes in 2858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:42.668715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5a86a8bf-7b16-4120-bf56-616f87c3a011 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '.version_select at 0x7f3a2a6dba60>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:42.678112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5a86a8bf-7b16-4120-bf56-616f87c3a011 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:42.731254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a86a8bf-7b16-4120-bf56-616f87c3a011 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:42.737689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a86a8bf-7b16-4120-bf56-616f87c3a011 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:42.739400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a86a8bf-7b16-4120-bf56-616f87c3a011 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:42.751109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a86a8bf-7b16-4120-bf56-616f87c3a011 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:42.754092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a86a8bf-7b16-4120-bf56-616f87c3a011 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:42.757415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a86a8bf-7b16-4120-bf56-616f87c3a011 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:42.806758 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6b9ce4be-5483-42d0-8f22-f6d1a02c5149 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159/action" status: 202 len: 0 microversion: 2.1 time: 5.506937 Aug 25 12:58:42.827663 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1244/2528] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:37 2022] POST /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159/action => generated 0 bytes in 5528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:58:42.881860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.107"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:42.988003 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5a86a8bf-7b16-4120-bf56-616f87c3a011 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.358175 Aug 25 12:58:42.997633 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1285/2529] 10.222.0.70 () {58 vars in 1296 bytes} [Thu Aug 25 12:58:42 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1/os-instance-actions => generated 611 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:43.037321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f4fcba07-ccfc-4012-b187-520d69b04e6c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a2b6280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:45.158007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:45.188271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:45.190194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:45.191848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:45.194282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:45.198267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:45.199453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:45.223618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-f4fcba07-ccfc-4012-b187-520d69b04e6c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3b1e1efa-d517-456d-a6df-adbee537d937 in use.", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:58:45.224819 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f4fcba07-ccfc-4012-b187-520d69b04e6c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security Group 3b1e1efa-d517-456d-a6df-adbee537d937 in use. Aug 25 12:58:45.224819 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-329b00f8-a4ff-475f-8ba9-b3c160dd5bac'] Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f4fcba07-ccfc-4012-b187-520d69b04e6c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-security-groups/3b1e1efa-d517-456d-a6df-adbee537d937 HTTP/1.1 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: exception: Security Group 3b1e1efa-d517-456d-a6df-adbee537d937 in use. Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-329b00f8-a4ff-475f-8ba9-b3c160dd5bac'] Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '3b1e1efa-d517-456d-a6df-adbee537d937'} Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:58:45.229444 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 3b1e1efa-d517-456d-a6df-adbee537d937 in use. Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-329b00f8-a4ff-475f-8ba9-b3c160dd5bac'] Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 3b1e1efa-d517-456d-a6df-adbee537d937 in use. Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-329b00f8-a4ff-475f-8ba9-b3c160dd5bac'] Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 3b1e1efa-d517-456d-a6df-adbee537d937 in use. Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-329b00f8-a4ff-475f-8ba9-b3c160dd5bac'] Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 3b1e1efa-d517-456d-a6df-adbee537d937 in use. Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-329b00f8-a4ff-475f-8ba9-b3c160dd5bac'] Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f4fcba07-ccfc-4012-b187-520d69b04e6c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 400 to user: Security Group 3b1e1efa-d517-456d-a6df-adbee537d937 in use. Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-329b00f8-a4ff-475f-8ba9-b3c160dd5bac'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f4fcba07-ccfc-4012-b187-520d69b04e6c tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/3b1e1efa-d517-456d-a6df-adbee537d937" status: 400 len: 185 microversion: 2.1 time: 2.232221 Aug 25 12:58:45.244425 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1286/2530] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:58:42 2022] DELETE /compute/v2.1/os-security-groups/3b1e1efa-d517-456d-a6df-adbee537d937 => generated 185 bytes in 2235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:58:45.297031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-46fabe08-08bb-4e57-8f38-7e3fb0de688b req-a4148fd7-8dc7-41d6-a15e-741d693c5601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1df7169-5d0d-49ec-b515-10e8b0346159", "tag": "bd9ba707-5ed9-4937-8ed6-f39a96c948e0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:45.384682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-46fabe08-08bb-4e57-8f38-7e3fb0de688b req-a4148fd7-8dc7-41d6-a15e-741d693c5601 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:45.386320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-46fabe08-08bb-4e57-8f38-7e3fb0de688b req-a4148fd7-8dc7-41d6-a15e-741d693c5601 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:45.386526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-46fabe08-08bb-4e57-8f38-7e3fb0de688b req-a4148fd7-8dc7-41d6-a15e-741d693c5601 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:45.452358 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-46fabe08-08bb-4e57-8f38-7e3fb0de688b req-a4148fd7-8dc7-41d6-a15e-741d693c5601 service nova] Creating event network-changed:bd9ba707-5ed9-4937-8ed6-f39a96c948e0 for instance e1df7169-5d0d-49ec-b515-10e8b0346159 on n-h2-852771-8 Aug 25 12:58:45.485644 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-46fabe08-08bb-4e57-8f38-7e3fb0de688b req-a4148fd7-8dc7-41d6-a15e-741d693c5601 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230945 Aug 25 12:58:45.488682 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1287/2531] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:45.531230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3dd6aa79-2166-4400-909f-d20daffd09ea tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:45.538643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3dd6aa79-2166-4400-909f-d20daffd09ea tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:45.576786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd6aa79-2166-4400-909f-d20daffd09ea tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:45.583709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd6aa79-2166-4400-909f-d20daffd09ea tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:45.584536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd6aa79-2166-4400-909f-d20daffd09ea tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:45.587673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd6aa79-2166-4400-909f-d20daffd09ea tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:45.591556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd6aa79-2166-4400-909f-d20daffd09ea tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:45.594711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd6aa79-2166-4400-909f-d20daffd09ea tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:45.776714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3dd6aa79-2166-4400-909f-d20daffd09ea tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:58:46.255418 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3dd6aa79-2166-4400-909f-d20daffd09ea tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 204 len: 0 microversion: 2.1 time: 0.753783 Aug 25 12:58:46.260749 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1288/2532] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:58:45 2022] DELETE /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:58:46.274187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-459453f2-2f69-46b2-a05a-af390ae6f99b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:46.279696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-459453f2-2f69-46b2-a05a-af390ae6f99b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:46.312818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-459453f2-2f69-46b2-a05a-af390ae6f99b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:46.315261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-459453f2-2f69-46b2-a05a-af390ae6f99b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:46.317016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-459453f2-2f69-46b2-a05a-af390ae6f99b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:46.319052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-459453f2-2f69-46b2-a05a-af390ae6f99b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:46.320312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-459453f2-2f69-46b2-a05a-af390ae6f99b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:46.323064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-459453f2-2f69-46b2-a05a-af390ae6f99b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:46.360287 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] HTTP exception thrown: Floating IP 172.25.1.107 is not associated with instance 81427539-a364-486a-8e7c-cd0ba4536b9d. Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Request method failure captured: Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d/action HTTP/1.1 Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 49 Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F7NAdf2f4njMqmNRcsWEEDf-tq4R1fSpFpSswIfbHR9uSdYLAGSKRaZy6YRXVFhfhBJFY9SHTFUUMAfIpMVkHIbfPyuGcgLocQ09OQ3X5SQstMR1GjkXVvh10leq8RYMN-aWEtjguL6RF61Ohl-dSVxPHjy5CYkQqGZ0pXLKCB224 Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b4719646f1444a8ea7977af53061340a Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b4719646f1444a8ea7977af53061340a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b4719646f1444a8ea7977af53061340a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b4719646f1444a8ea7977af53061340a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b4719646f1444a8ea7977af53061340a"}]}] Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b4719646f1444a8ea7977af53061340a Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPsAssociationTestJSON-533804185-project Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 21f364ac015b44eb91ba63481f8595b4 Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-533804185-project Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: {"removeFloatingIp": {"address": "172.25.1.107"}} Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: exception: Floating IP 172.25.1.107 is not associated with instance 81427539-a364-486a-8e7c-cd0ba4536b9d. Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '81427539-a364-486a-8e7c-cd0ba4536b9d', 'body': {'removeFloatingIp': {'address': '172.25.1.107'}}} Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.107 is not associated with instance 81427539-a364-486a-8e7c-cd0ba4536b9d. Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.107 is not associated with instance 81427539-a364-486a-8e7c-cd0ba4536b9d. Aug 25 12:58:46.363709 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:46.374109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Returning 409 to user: Floating IP 172.25.1.107 is not associated with instance 81427539-a364-486a-8e7c-cd0ba4536b9d. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:58:46.374109 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9f7ad23f-4875-4d07-9ca8-90ef3270f6c4 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "POST /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d/action" status: 409 len: 146 microversion: 2.1 time: 3.537024 Aug 25 12:58:46.374109 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1245/2533] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:42 2022] POST /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d/action => generated 146 bytes in 3543 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:58:46.385257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9d083068-7fba-40de-a2d2-9148f82bd3b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:46.387859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9d083068-7fba-40de-a2d2-9148f82bd3b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:46.401723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d083068-7fba-40de-a2d2-9148f82bd3b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:46.403533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d083068-7fba-40de-a2d2-9148f82bd3b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:46.404690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d083068-7fba-40de-a2d2-9148f82bd3b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:46.406741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d083068-7fba-40de-a2d2-9148f82bd3b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:46.408119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d083068-7fba-40de-a2d2-9148f82bd3b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:46.409295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d083068-7fba-40de-a2d2-9148f82bd3b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:46.613140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9d083068-7fba-40de-a2d2-9148f82bd3b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:58:46.905242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-459453f2-2f69-46b2-a05a-af390ae6f99b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:46.947649 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-459453f2-2f69-46b2-a05a-af390ae6f99b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 200 len: 1315 microversion: 2.1 time: 0.681082 Aug 25 12:58:46.951317 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1289/2534] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:46 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:46.961930 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9d083068-7fba-40de-a2d2-9148f82bd3b5 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 204 len: 0 microversion: 2.1 time: 0.587432 Aug 25 12:58:46.964441 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1246/2535] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:58:46 2022] DELETE /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:58:46.973291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc1804c4-1f98-4add-bac8-1234b76cf42b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:46.982412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc1804c4-1f98-4add-bac8-1234b76cf42b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:46.992435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-61b2b123-cabc-4dab-825b-11fade12b6b7 req-1b652bde-0119-4a73-bb60-966e2457719f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d3c3dd-dfa6-4d24-bd30-df478d87d7b7", "name": "network-vif-plugged", "status": "completed", "tag": "34d1d2c8-2934-4f93-a204-a39ecd337aec"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:47.007488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc1804c4-1f98-4add-bac8-1234b76cf42b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.010631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc1804c4-1f98-4add-bac8-1234b76cf42b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.011561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc1804c4-1f98-4add-bac8-1234b76cf42b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:47.014545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc1804c4-1f98-4add-bac8-1234b76cf42b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.015396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc1804c4-1f98-4add-bac8-1234b76cf42b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.016312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc1804c4-1f98-4add-bac8-1234b76cf42b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:47.037946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-61b2b123-cabc-4dab-825b-11fade12b6b7 req-1b652bde-0119-4a73-bb60-966e2457719f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.040919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-61b2b123-cabc-4dab-825b-11fade12b6b7 req-1b652bde-0119-4a73-bb60-966e2457719f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.042410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-61b2b123-cabc-4dab-825b-11fade12b6b7 req-1b652bde-0119-4a73-bb60-966e2457719f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:47.097776 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-61b2b123-cabc-4dab-825b-11fade12b6b7 req-1b652bde-0119-4a73-bb60-966e2457719f service nova] Creating event network-vif-plugged:34d1d2c8-2934-4f93-a204-a39ecd337aec for instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 on n-h1-852771-8 Aug 25 12:58:47.123762 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-61b2b123-cabc-4dab-825b-11fade12b6b7 req-1b652bde-0119-4a73-bb60-966e2457719f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154173 Aug 25 12:58:47.124856 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1247/2536] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:47.155646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6bd3af62-9e2b-4191-82a7-1083b1b00cb8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:47.160754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6bd3af62-9e2b-4191-82a7-1083b1b00cb8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:47.192034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd3af62-9e2b-4191-82a7-1083b1b00cb8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.195002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd3af62-9e2b-4191-82a7-1083b1b00cb8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.198950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd3af62-9e2b-4191-82a7-1083b1b00cb8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:47.208207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd3af62-9e2b-4191-82a7-1083b1b00cb8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.209668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd3af62-9e2b-4191-82a7-1083b1b00cb8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.213335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd3af62-9e2b-4191-82a7-1083b1b00cb8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:47.296387 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc1804c4-1f98-4add-bac8-1234b76cf42b tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159/action" status: 202 len: 0 microversion: 2.1 time: 0.323036 Aug 25 12:58:47.303074 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1290/2537] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:46 2022] POST /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:58:47.356721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Action: 'action', calling method: .version_select at 0x7f3a2c205f70>, body: {"removeFloatingIp": {"address": "172.25.1.107"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:48.808197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:48.828886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:48.829895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:48.831056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:48.840127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:48.841078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:48.845840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:48.931302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6bd3af62-9e2b-4191-82a7-1083b1b00cb8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:48.965836 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6bd3af62-9e2b-4191-82a7-1083b1b00cb8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1510 microversion: 2.1 time: 1.827538 Aug 25 12:58:48.968777 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1248/2538] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:47 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1510 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:48.979722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cc1abf82-ac45-4ad9-b3c3-dbec097ec35e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:48.982432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cc1abf82-ac45-4ad9-b3c3-dbec097ec35e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:49.015820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc1abf82-ac45-4ad9-b3c3-dbec097ec35e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:49.017200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc1abf82-ac45-4ad9-b3c3-dbec097ec35e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:49.019500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc1abf82-ac45-4ad9-b3c3-dbec097ec35e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:49.022242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc1abf82-ac45-4ad9-b3c3-dbec097ec35e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:49.028892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc1abf82-ac45-4ad9-b3c3-dbec097ec35e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:49.029937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc1abf82-ac45-4ad9-b3c3-dbec097ec35e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:49.623855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cc1abf82-ac45-4ad9-b3c3-dbec097ec35e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:49.671638 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cc1abf82-ac45-4ad9-b3c3-dbec097ec35e tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1665 microversion: 2.1 time: 0.669239 Aug 25 12:58:49.674068 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1249/2539] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:48 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1665 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:49.688341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b80cef02-b056-4d15-9eb1-bd5b5a8978b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:49.698719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b80cef02-b056-4d15-9eb1-bd5b5a8978b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:49.710219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:49.724629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b80cef02-b056-4d15-9eb1-bd5b5a8978b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:49.726271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b80cef02-b056-4d15-9eb1-bd5b5a8978b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:49.728315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b80cef02-b056-4d15-9eb1-bd5b5a8978b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:49.731216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b80cef02-b056-4d15-9eb1-bd5b5a8978b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:49.732843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b80cef02-b056-4d15-9eb1-bd5b5a8978b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:49.734319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b80cef02-b056-4d15-9eb1-bd5b5a8978b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:49.974472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "refresh_cache-586ef5d3-65f8-47ca-856b-167fdaeb7ced" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:58:49.979143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquired lock "refresh_cache-586ef5d3-65f8-47ca-856b-167fdaeb7ced" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:58:50.842829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b80cef02-b056-4d15-9eb1-bd5b5a8978b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:50.874614 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b80cef02-b056-4d15-9eb1-bd5b5a8978b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1574 microversion: 2.1 time: 1.198049 Aug 25 12:58:50.877739 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1250/2540] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:49 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1574 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:50.888574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-968b59f4-d6a5-4505-a7f0-433855e4ea5a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:50.891033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-968b59f4-d6a5-4505-a7f0-433855e4ea5a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:50.904608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-968b59f4-d6a5-4505-a7f0-433855e4ea5a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:50.907212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-968b59f4-d6a5-4505-a7f0-433855e4ea5a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:50.909102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-968b59f4-d6a5-4505-a7f0-433855e4ea5a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:50.913584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-968b59f4-d6a5-4505-a7f0-433855e4ea5a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:50.916549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-968b59f4-d6a5-4505-a7f0-433855e4ea5a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:50.918071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-968b59f4-d6a5-4505-a7f0-433855e4ea5a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:51.003179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:51.925404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-968b59f4-d6a5-4505-a7f0-433855e4ea5a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:51.948312 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-968b59f4-d6a5-4505-a7f0-433855e4ea5a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 200 len: 1315 microversion: 2.1 time: 1.062456 Aug 25 12:58:51.950335 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1251/2541] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:50 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 1315 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:52.004634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:52.009095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:52.036614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:52.038414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:52.040259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:52.042667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:52.049943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:52.052187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:52.132654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:52.143304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:52.144303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:52.146873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lazy-loading 'fault' on Instance uuid ade349c6-8fb8-4a74-a87f-bff718e29ad1 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:58:52.332089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84366b3cfd704ef08d29ef315a035026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bdd5be7e61484a9cef681123269dde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:52.348090 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f588e14a-8591-4bc6-9c32-28fd1c2aeeda tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 200 len: 1306 microversion: 2.1 time: 0.356446 Aug 25 12:58:52.349374 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1252/2542] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:51 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 1306 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:52.361431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03542441-4b32-47c4-8c7b-465df6e035e7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:52.363481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-03542441-4b32-47c4-8c7b-465df6e035e7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:52.380049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03542441-4b32-47c4-8c7b-465df6e035e7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:52.381825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03542441-4b32-47c4-8c7b-465df6e035e7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:52.383203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03542441-4b32-47c4-8c7b-465df6e035e7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:52.385406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03542441-4b32-47c4-8c7b-465df6e035e7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:52.387708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03542441-4b32-47c4-8c7b-465df6e035e7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:52.390971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03542441-4b32-47c4-8c7b-465df6e035e7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:53.515181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03542441-4b32-47c4-8c7b-465df6e035e7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:53.546590 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-03542441-4b32-47c4-8c7b-465df6e035e7 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1665 microversion: 2.1 time: 1.193194 Aug 25 12:58:53.559094 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1253/2543] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:52 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1665 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:53.589162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6c522334-287d-4502-8648-cded56334ea0 req-1c417cd3-b57d-4680-a437-b843d53d327b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade349c6-8fb8-4a74-a87f-bff718e29ad1", "name": "network-vif-deleted", "tag": "80325278-076e-48b7-ab0c-04ec2238f397"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:53.665333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6c522334-287d-4502-8648-cded56334ea0 req-1c417cd3-b57d-4680-a437-b843d53d327b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:53.668761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6c522334-287d-4502-8648-cded56334ea0 req-1c417cd3-b57d-4680-a437-b843d53d327b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:53.671661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6c522334-287d-4502-8648-cded56334ea0 req-1c417cd3-b57d-4680-a437-b843d53d327b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:53.729265 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6c522334-287d-4502-8648-cded56334ea0 req-1c417cd3-b57d-4680-a437-b843d53d327b service nova] Creating event network-vif-deleted:80325278-076e-48b7-ab0c-04ec2238f397 for instance ade349c6-8fb8-4a74-a87f-bff718e29ad1 on n-h1-852771-8 Aug 25 12:58:53.749040 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6c522334-287d-4502-8648-cded56334ea0 req-1c417cd3-b57d-4680-a437-b843d53d327b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182852 Aug 25 12:58:53.750965 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1254/2544] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:53.764423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-512b377e-b6ae-4c47-a5e6-de46ca0aa0b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:53.766741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-512b377e-b6ae-4c47-a5e6-de46ca0aa0b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:53.783616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-512b377e-b6ae-4c47-a5e6-de46ca0aa0b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:53.784490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-512b377e-b6ae-4c47-a5e6-de46ca0aa0b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:53.785306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-512b377e-b6ae-4c47-a5e6-de46ca0aa0b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:53.787179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-512b377e-b6ae-4c47-a5e6-de46ca0aa0b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:53.788204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-512b377e-b6ae-4c47-a5e6-de46ca0aa0b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:53.789112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-512b377e-b6ae-4c47-a5e6-de46ca0aa0b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:54.669137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Building network info cache for instance {{(pid=129060) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:58:54.680938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-512b377e-b6ae-4c47-a5e6-de46ca0aa0b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:54.696967 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-512b377e-b6ae-4c47-a5e6-de46ca0aa0b7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1574 microversion: 2.1 time: 0.943487 Aug 25 12:58:54.698606 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1255/2545] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:53 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1574 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:54.733756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bc8b3a9a-e159-4e26-82bd-81dbcc01c1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:54.735010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bc8b3a9a-e159-4e26-82bd-81dbcc01c1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:54.749224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc8b3a9a-e159-4e26-82bd-81dbcc01c1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:54.750214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc8b3a9a-e159-4e26-82bd-81dbcc01c1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:54.751325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc8b3a9a-e159-4e26-82bd-81dbcc01c1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:54.753312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc8b3a9a-e159-4e26-82bd-81dbcc01c1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:54.754595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc8b3a9a-e159-4e26-82bd-81dbcc01c1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:54.755759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc8b3a9a-e159-4e26-82bd-81dbcc01c1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:55.204520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bc8b3a9a-e159-4e26-82bd-81dbcc01c1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:55.240407 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bc8b3a9a-e159-4e26-82bd-81dbcc01c1c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 200 len: 1294 microversion: 2.1 time: 0.524730 Aug 25 12:58:55.242020 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1256/2546] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:54 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 1294 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:55.289983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:55.292069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] [instance: ade349c6-8fb8-4a74-a87f-bff718e29ad1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:55.304353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:55.306392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:55.307742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:55.309308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:55.310824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:55.311888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:55.361903 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] HTTP exception thrown: Instance ade349c6-8fb8-4a74-a87f-bff718e29ad1 could not be found. Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Request method failure captured: Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 HTTP/1.1 Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3HENXjm7Ev45RtYZZCoTC_Zq6j_VS6d_m6cpyjzOYHGsTDzhRKvkKY1rDUHKPPLH0LT_dRMsGvqpQ-GOjbH4sG79aiXQ_1DkSYis3FYFvtDiY8s2voanCqI5Edbc6QKQPsiMfCWk0QrXtKCmpTrqC1QtiEHchJ2iXUehjnULuZRzAo Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: e6bdd5be7e61484a9cef681123269dde Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-InstanceActionsTestJSON-83988119 Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e6bdd5be7e61484a9cef681123269dde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e6bdd5be7e61484a9cef681123269dde", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e6bdd5be7e61484a9cef681123269dde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e6bdd5be7e61484a9cef681123269dde"}]}] Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-InstanceActionsTestJSON-83988119 Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: e6bdd5be7e61484a9cef681123269dde Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-InstanceActionsTestJSON-83988119 Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-InstanceActionsTestJSON-83988119-project Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 84366b3cfd704ef08d29ef315a035026 Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-InstanceActionsTestJSON-83988119-project Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ade349c6-8fb8-4a74-a87f-bff718e29ad1 could not be found. Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ade349c6-8fb8-4a74-a87f-bff718e29ad1'} Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade349c6-8fb8-4a74-a87f-bff718e29ad1 could not be found. Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade349c6-8fb8-4a74-a87f-bff718e29ad1 could not be found. Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:55.376549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:55.382898 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:55.382898 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:55.382898 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:55.382898 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:58:55.382898 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:58:55.382898 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade349c6-8fb8-4a74-a87f-bff718e29ad1 could not be found. Aug 25 12:58:55.382898 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:55.386491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] Returning 404 to user: Instance ade349c6-8fb8-4a74-a87f-bff718e29ad1 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:58:55.392013 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-691868b7-f631-4193-96ea-2ca4bc740ed8 tempest-InstanceActionsTestJSON-83988119 tempest-InstanceActionsTestJSON-83988119-project] 10.222.0.70 "GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1" status: 404 len: 111 microversion: 2.1 time: 0.116636 Aug 25 12:58:55.397312 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1257/2547] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:55 2022] GET /compute/v2.1/servers/ade349c6-8fb8-4a74-a87f-bff718e29ad1 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:58:55.412595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-491f4ce2-77d0-402a-aa81-6851de2fca35 req-ffd26785-99d8-4545-b7cc-23bf4d1b9efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d3c3dd-dfa6-4d24-bd30-df478d87d7b7", "name": "network-vif-deleted", "tag": "34d1d2c8-2934-4f93-a204-a39ecd337aec"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:55.444088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-491f4ce2-77d0-402a-aa81-6851de2fca35 req-ffd26785-99d8-4545-b7cc-23bf4d1b9efc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:55.445173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-491f4ce2-77d0-402a-aa81-6851de2fca35 req-ffd26785-99d8-4545-b7cc-23bf4d1b9efc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:55.447357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-491f4ce2-77d0-402a-aa81-6851de2fca35 req-ffd26785-99d8-4545-b7cc-23bf4d1b9efc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:55.493734 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-491f4ce2-77d0-402a-aa81-6851de2fca35 req-ffd26785-99d8-4545-b7cc-23bf4d1b9efc service nova] Creating event network-vif-deleted:34d1d2c8-2934-4f93-a204-a39ecd337aec for instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 on n-h1-852771-8 Aug 25 12:58:55.512165 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-491f4ce2-77d0-402a-aa81-6851de2fca35 req-ffd26785-99d8-4545-b7cc-23bf4d1b9efc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108037 Aug 25 12:58:55.517101 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1258/2548] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:55.541785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-49efc9df-f5e2-4aa9-947d-63a8a2691292 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:55.544081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-49efc9df-f5e2-4aa9-947d-63a8a2691292 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:55.559275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49efc9df-f5e2-4aa9-947d-63a8a2691292 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:55.560868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49efc9df-f5e2-4aa9-947d-63a8a2691292 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:55.562297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49efc9df-f5e2-4aa9-947d-63a8a2691292 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:55.564138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49efc9df-f5e2-4aa9-947d-63a8a2691292 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:55.565459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49efc9df-f5e2-4aa9-947d-63a8a2691292 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:55.567249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49efc9df-f5e2-4aa9-947d-63a8a2691292 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:56.036323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-49efc9df-f5e2-4aa9-947d-63a8a2691292 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:56.066698 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-49efc9df-f5e2-4aa9-947d-63a8a2691292 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 200 len: 1599 microversion: 2.1 time: 0.545554 Aug 25 12:58:56.068197 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1259/2549] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:55 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 1599 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:56.090938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a1854af0-e1b7-46b0-b8d9-6a0dccd6bdd0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:56.092129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a1854af0-e1b7-46b0-b8d9-6a0dccd6bdd0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:56.119766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1854af0-e1b7-46b0-b8d9-6a0dccd6bdd0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:56.120687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1854af0-e1b7-46b0-b8d9-6a0dccd6bdd0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:56.121568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1854af0-e1b7-46b0-b8d9-6a0dccd6bdd0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:56.122920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1854af0-e1b7-46b0-b8d9-6a0dccd6bdd0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:56.123798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1854af0-e1b7-46b0-b8d9-6a0dccd6bdd0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:56.124605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1854af0-e1b7-46b0-b8d9-6a0dccd6bdd0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.415225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1854af0-e1b7-46b0-b8d9-6a0dccd6bdd0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:57.446986 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a1854af0-e1b7-46b0-b8d9-6a0dccd6bdd0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1572 microversion: 2.1 time: 1.363160 Aug 25 12:58:57.470635 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1260/2550] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:56 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1572 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:57.484673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-41022f84-806a-45bc-94c8-c91ca33e6c2e req-cb909805-993b-411e-87c4-06609e8d99c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc86590d-191c-4f59-8b1c-bb10c9ff4a49", "name": "network-vif-deleted", "tag": "8e7fc008-75c2-4e5a-a9dc-0d165e20b75d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:57.518433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-41022f84-806a-45bc-94c8-c91ca33e6c2e req-cb909805-993b-411e-87c4-06609e8d99c5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:57.520163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-41022f84-806a-45bc-94c8-c91ca33e6c2e req-cb909805-993b-411e-87c4-06609e8d99c5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:57.521378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-41022f84-806a-45bc-94c8-c91ca33e6c2e req-cb909805-993b-411e-87c4-06609e8d99c5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.571739 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-41022f84-806a-45bc-94c8-c91ca33e6c2e req-cb909805-993b-411e-87c4-06609e8d99c5 service nova] Creating event network-vif-deleted:8e7fc008-75c2-4e5a-a9dc-0d165e20b75d for instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 on n-h2-852771-8 Aug 25 12:58:57.589792 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-41022f84-806a-45bc-94c8-c91ca33e6c2e req-cb909805-993b-411e-87c4-06609e8d99c5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121186 Aug 25 12:58:57.593852 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1261/2551] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:57.627107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5adf4c4a-688e-4c0d-aeb2-82e310a387e1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:57.634472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5adf4c4a-688e-4c0d-aeb2-82e310a387e1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:57.662116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5adf4c4a-688e-4c0d-aeb2-82e310a387e1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:57.665424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5adf4c4a-688e-4c0d-aeb2-82e310a387e1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:57.668809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5adf4c4a-688e-4c0d-aeb2-82e310a387e1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.674604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5adf4c4a-688e-4c0d-aeb2-82e310a387e1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:57.676193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5adf4c4a-688e-4c0d-aeb2-82e310a387e1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:57.677492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5adf4c4a-688e-4c0d-aeb2-82e310a387e1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.932325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5adf4c4a-688e-4c0d-aeb2-82e310a387e1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:57.971519 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5adf4c4a-688e-4c0d-aeb2-82e310a387e1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 200 len: 1294 microversion: 2.1 time: 0.357962 Aug 25 12:58:57.980226 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1262/2552] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:57 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 1294 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:58.001434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Updating instance_info_cache with network_info: [{"id": "ea948e8c-9fa9-4615-88c2-16f3e4c9d28f", "address": "fa:16:3e:13:a2:19", "network": {"id": "76635244-431e-41b7-9377-f49623b762de", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-807492449-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4719646f1444a8ea7977af53061340a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapea948e8c-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129060) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:58:58.012746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:58.015747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: bc86590d-191c-4f59-8b1c-bb10c9ff4a49] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:58.029328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=63,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:58.039176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Releasing lock "refresh_cache-586ef5d3-65f8-47ca-856b-167fdaeb7ced" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:58:58.040588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.042817 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e971fc7f-8fab-49af-a506-16bdc9406a5d tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "POST /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced/action" status: 202 len: 0 microversion: 2.1 time: 10.727237 Aug 25 12:58:58.043479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.044483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.046562 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1291/2553] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:47 2022] POST /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced/action => generated 0 bytes in 10742 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:58:58.048239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.050808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.056794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.059442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eb2a393a-30b1-4064-ac7a-1d01b331943a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-54336925"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:58.061044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eb2a393a-30b1-4064-ac7a-1d01b331943a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:58.078543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb2a393a-30b1-4064-ac7a-1d01b331943a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.080170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb2a393a-30b1-4064-ac7a-1d01b331943a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.081806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb2a393a-30b1-4064-ac7a-1d01b331943a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.083824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb2a393a-30b1-4064-ac7a-1d01b331943a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.085226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb2a393a-30b1-4064-ac7a-1d01b331943a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.086871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb2a393a-30b1-4064-ac7a-1d01b331943a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.118626 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] HTTP exception thrown: Instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 could not be found. Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Request method failure captured: Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 HTTP/1.1 Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB2798MLDFBXKtcI5bfZbD-ym0xfAWRceYZM5zRwPd8pK8OQBsxPsnkbZfnXqUoJ3RLLBu76f7wHPGQrG9qrIug60g9h8XvWx1X1hKf9cK3kLnGTBziTjLMQk8AbsQ3sDTCFeWRdvQyflRgybaFQFXdL1iyGK6s5yvoYWWccKvHRTBn4 Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5473d51e2cf040a3ae656d7e987feec2 Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-LiveMigrationTest-940338641 Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d51e2cf040a3ae656d7e987feec2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5473d51e2cf040a3ae656d7e987feec2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5473d51e2cf040a3ae656d7e987feec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d51e2cf040a3ae656d7e987feec2"}]}] Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-LiveMigrationTest-940338641 Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5473d51e2cf040a3ae656d7e987feec2 Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-LiveMigrationTest-940338641 Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-LiveMigrationTest-940338641-project Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 81b5d1940fe64714bd9ba7d2009004fd Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-LiveMigrationTest-940338641-project Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 could not be found. Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'bc86590d-191c-4f59-8b1c-bb10c9ff4a49'} Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 could not be found. Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 could not be found. Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:58:58.127331 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:58.141678 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:58:58.141678 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:58:58.141678 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:58:58.141678 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:58:58.141678 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:58:58.141678 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 could not be found. Aug 25 12:58:58.141678 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:58:58.141678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Returning 404 to user: Instance bc86590d-191c-4f59-8b1c-bb10c9ff4a49 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:58:58.141678 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a862afc7-6cef-4df1-b858-ded776ba718b tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49" status: 404 len: 111 microversion: 2.1 time: 0.154927 Aug 25 12:58:58.145133 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1263/2554] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:57 2022] GET /compute/v2.1/servers/bc86590d-191c-4f59-8b1c-bb10c9ff4a49 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:58:58.166227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-42a64b57-67cf-4b13-89d5-2b03a1492f57 req-b60c52a6-7889-47a9-bba8-a084f05961a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586ef5d3-65f8-47ca-856b-167fdaeb7ced", "tag": "ea948e8c-9fa9-4615-88c2-16f3e4c9d28f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:58.193306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-42a64b57-67cf-4b13-89d5-2b03a1492f57 req-b60c52a6-7889-47a9-bba8-a084f05961a0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.195015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-42a64b57-67cf-4b13-89d5-2b03a1492f57 req-b60c52a6-7889-47a9-bba8-a084f05961a0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.195955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-42a64b57-67cf-4b13-89d5-2b03a1492f57 req-b60c52a6-7889-47a9-bba8-a084f05961a0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.243089 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-42a64b57-67cf-4b13-89d5-2b03a1492f57 req-b60c52a6-7889-47a9-bba8-a084f05961a0 service nova] Creating event network-changed:ea948e8c-9fa9-4615-88c2-16f3e4c9d28f for instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced on n-h2-852771-8 Aug 25 12:58:58.259929 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-42a64b57-67cf-4b13-89d5-2b03a1492f57 req-b60c52a6-7889-47a9-bba8-a084f05961a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108706 Aug 25 12:58:58.266543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1264/2555] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:58.300160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1004a232-e437-4d6a-af20-d9b89a171ee2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:58.303587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1004a232-e437-4d6a-af20-d9b89a171ee2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:58.338170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1004a232-e437-4d6a-af20-d9b89a171ee2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.339614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1004a232-e437-4d6a-af20-d9b89a171ee2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.343276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1004a232-e437-4d6a-af20-d9b89a171ee2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.347964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1004a232-e437-4d6a-af20-d9b89a171ee2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.356898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1004a232-e437-4d6a-af20-d9b89a171ee2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.359900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1004a232-e437-4d6a-af20-d9b89a171ee2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.497806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1004a232-e437-4d6a-af20-d9b89a171ee2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:58:58.892401 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1004a232-e437-4d6a-af20-d9b89a171ee2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "DELETE /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 204 len: 0 microversion: 2.1 time: 0.621931 Aug 25 12:58:58.893777 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1265/2556] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:58:58 2022] DELETE /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:58:58.924272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-613fc408-5e91-42de-9571-434c45c4b1fd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '.version_select at 0x7f3a2a553700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:59.006298 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-613fc408-5e91-42de-9571-434c45c4b1fd tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-707607541" status: 202 len: 0 microversion: 2.1 time: 0.110376 Aug 25 12:58:59.007734 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1266/2557] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 12:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-707607541 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:58:59.024618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.107"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:59.039659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:59.089754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:59.096173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:59.097870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:59.099231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:59.106655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:59.107930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:59.203639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "refresh_cache-81427539-a364-486a-8e7c-cd0ba4536b9d" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:58:59.204489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquired lock "refresh_cache-81427539-a364-486a-8e7c-cd0ba4536b9d" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:58:59.428660 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.network.security_group_api [None req-eb2a393a-30b1-4064-ac7a-1d01b331943a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Adding security group b77558f4-ecde-4ea9-805d-e50acc81f623 to port bd9ba707-5ed9-4937-8ed6-f39a96c948e0 Aug 25 12:59:02.538164 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eb2a393a-30b1-4064-ac7a-1d01b331943a tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159/action" status: 202 len: 0 microversion: 2.1 time: 4.488624 Aug 25 12:59:02.541379 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1292/2558] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:58 2022] POST /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159/action => generated 0 bytes in 4493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:59:02.569074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:02.574301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:02.611075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:02.621410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:02.624965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:02.630083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:02.635437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:02.641062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:02.716894 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 HTTP/1.1 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '38d3c3dd-dfa6-4d24-bd30-df478d87d7b7'} Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:02.723895 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:02.739798 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:02.739798 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:02.739798 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:02.739798 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:02.739798 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:02.739798 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 12:59:02.739798 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:02.739798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:02.739798 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-035a3722-1a3d-43c1-844d-f0ef59c06f61 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 404 len: 111 microversion: 2.1 time: 0.188617 Aug 25 12:59:02.739798 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1293/2559] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:02 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:02.766780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b121238e-8bfe-4fa0-a475-806f408ce358 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a360d30>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:04.256511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-b121238e-8bfe-4fa0-a475-806f408ce358 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b77558f4-ecde-4ea9-805d-e50acc81f623 in use.", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:59:04.264897 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b121238e-8bfe-4fa0-a475-806f408ce358 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security Group b77558f4-ecde-4ea9-805d-e50acc81f623 in use. Aug 25 12:59:04.264897 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-8be9a032-444b-479a-a179-9374e37097fa'] Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b121238e-8bfe-4fa0-a475-806f408ce358 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-security-groups/b77558f4-ecde-4ea9-805d-e50acc81f623 HTTP/1.1 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: exception: Security Group b77558f4-ecde-4ea9-805d-e50acc81f623 in use. Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-8be9a032-444b-479a-a179-9374e37097fa'] Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b77558f4-ecde-4ea9-805d-e50acc81f623'} Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:59:04.276290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b77558f4-ecde-4ea9-805d-e50acc81f623 in use. Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8be9a032-444b-479a-a179-9374e37097fa'] Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b77558f4-ecde-4ea9-805d-e50acc81f623 in use. Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8be9a032-444b-479a-a179-9374e37097fa'] Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b77558f4-ecde-4ea9-805d-e50acc81f623 in use. Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8be9a032-444b-479a-a179-9374e37097fa'] Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b77558f4-ecde-4ea9-805d-e50acc81f623 in use. Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8be9a032-444b-479a-a179-9374e37097fa'] Aug 25 12:59:04.286274 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:04.312325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b121238e-8bfe-4fa0-a475-806f408ce358 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 400 to user: Security Group b77558f4-ecde-4ea9-805d-e50acc81f623 in use. Aug 25 12:59:04.312325 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-8be9a032-444b-479a-a179-9374e37097fa'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:04.324455 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b121238e-8bfe-4fa0-a475-806f408ce358 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/b77558f4-ecde-4ea9-805d-e50acc81f623" status: 400 len: 185 microversion: 2.1 time: 1.583296 Aug 25 12:59:04.328438 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1294/2560] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:02 2022] DELETE /compute/v2.1/os-security-groups/b77558f4-ecde-4ea9-805d-e50acc81f623 => generated 185 bytes in 1590 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:59:04.373461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-110e83e0-8245-4947-870b-814c24bddb09 req-2ad4a148-c8f8-493c-ace8-2313a7a48c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1df7169-5d0d-49ec-b515-10e8b0346159", "tag": "bd9ba707-5ed9-4937-8ed6-f39a96c948e0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:04.417053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-110e83e0-8245-4947-870b-814c24bddb09 req-2ad4a148-c8f8-493c-ace8-2313a7a48c42 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:04.424137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-110e83e0-8245-4947-870b-814c24bddb09 req-2ad4a148-c8f8-493c-ace8-2313a7a48c42 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:04.425304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-110e83e0-8245-4947-870b-814c24bddb09 req-2ad4a148-c8f8-493c-ace8-2313a7a48c42 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:04.473793 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-110e83e0-8245-4947-870b-814c24bddb09 req-2ad4a148-c8f8-493c-ace8-2313a7a48c42 service nova] Creating event network-changed:bd9ba707-5ed9-4937-8ed6-f39a96c948e0 for instance e1df7169-5d0d-49ec-b515-10e8b0346159 on n-h2-852771-8 Aug 25 12:59:04.499727 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-110e83e0-8245-4947-870b-814c24bddb09 req-2ad4a148-c8f8-493c-ace8-2313a7a48c42 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163338 Aug 25 12:59:04.507751 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1295/2561] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:04.527578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1483368919", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "8786102b-a15d-4894-b94c-776d2b47ed6a"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:04.803969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] validate_networks() for [('8786102b-a15d-4894-b94c-776d2b47ed6a', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:59:06.280433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Building network info cache for instance {{(pid=129059) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:59:07.675538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:59:07.677668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:59:07.679064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:59:07.680979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:59:07.684761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:59:07.698669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:07.741090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:07.757796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:07.759644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:07.761223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:07.762174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:07.763008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:07.847965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:59:07.868249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for user 2b81a6a01a24413b8212f140080ed018 and project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:59:07.912436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:59:07.924690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:59:08.219939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-10f53554-1b65-49bc-aae7-d49cd7e92f0a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.709934 Aug 25 12:59:08.232715 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1296/2562] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:59:08.233498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-53108094-856f-409b-8b57-337a36edfdf2 req-6877c4e9-8f3a-426f-917e-8778b481f53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ef5d3-65f8-47ca-856b-167fdaeb7ced", "name": "network-vif-deleted", "tag": "ea948e8c-9fa9-4615-88c2-16f3e4c9d28f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:08.289851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-53108094-856f-409b-8b57-337a36edfdf2 req-6877c4e9-8f3a-426f-917e-8778b481f53a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:08.302098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-53108094-856f-409b-8b57-337a36edfdf2 req-6877c4e9-8f3a-426f-917e-8778b481f53a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:08.303038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-53108094-856f-409b-8b57-337a36edfdf2 req-6877c4e9-8f3a-426f-917e-8778b481f53a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:08.347808 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-53108094-856f-409b-8b57-337a36edfdf2 req-6877c4e9-8f3a-426f-917e-8778b481f53a service nova] Creating event network-vif-deleted:ea948e8c-9fa9-4615-88c2-16f3e4c9d28f for instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced on n-h2-852771-8 Aug 25 12:59:08.374742 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-53108094-856f-409b-8b57-337a36edfdf2 req-6877c4e9-8f3a-426f-917e-8778b481f53a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146232 Aug 25 12:59:08.376239 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1297/2563] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:08.400006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dd97fd1d-3a6b-41a6-8d2d-7d87fb581686 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:08.401088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dd97fd1d-3a6b-41a6-8d2d-7d87fb581686 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:08.433998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd97fd1d-3a6b-41a6-8d2d-7d87fb581686 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:08.434858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd97fd1d-3a6b-41a6-8d2d-7d87fb581686 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:08.435683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd97fd1d-3a6b-41a6-8d2d-7d87fb581686 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:08.436989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd97fd1d-3a6b-41a6-8d2d-7d87fb581686 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:08.444864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd97fd1d-3a6b-41a6-8d2d-7d87fb581686 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:08.452434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd97fd1d-3a6b-41a6-8d2d-7d87fb581686 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:08.601033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dd97fd1d-3a6b-41a6-8d2d-7d87fb581686 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:09.032024 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dd97fd1d-3a6b-41a6-8d2d-7d87fb581686 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 204 len: 0 microversion: 2.1 time: 0.650678 Aug 25 12:59:09.036926 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1298/2564] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:08 2022] DELETE /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:59:09.073701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:09.086010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-84f8addb-3167-406c-be05-2344a30f6ab1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:09.094778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-84f8addb-3167-406c-be05-2344a30f6ab1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:09.114568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84f8addb-3167-406c-be05-2344a30f6ab1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:09.116905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84f8addb-3167-406c-be05-2344a30f6ab1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:09.118805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84f8addb-3167-406c-be05-2344a30f6ab1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:09.122032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84f8addb-3167-406c-be05-2344a30f6ab1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:09.123477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84f8addb-3167-406c-be05-2344a30f6ab1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:09.127266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-84f8addb-3167-406c-be05-2344a30f6ab1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:09.214158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-84f8addb-3167-406c-be05-2344a30f6ab1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:09.593771 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-84f8addb-3167-406c-be05-2344a30f6ab1 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 204 len: 0 microversion: 2.1 time: 0.552020 Aug 25 12:59:09.597069 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1299/2565] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:09 2022] DELETE /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:59:09.622372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b38e4fad-e8e8-4e61-8090-0f2a7f27e74d req-86fc8459-8b02-4aa0-98ae-bc878273cfcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81427539-a364-486a-8e7c-cd0ba4536b9d", "tag": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:09.677593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b38e4fad-e8e8-4e61-8090-0f2a7f27e74d req-86fc8459-8b02-4aa0-98ae-bc878273cfcc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:09.678830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b38e4fad-e8e8-4e61-8090-0f2a7f27e74d req-86fc8459-8b02-4aa0-98ae-bc878273cfcc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:09.682938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b38e4fad-e8e8-4e61-8090-0f2a7f27e74d req-86fc8459-8b02-4aa0-98ae-bc878273cfcc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:09.769748 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b38e4fad-e8e8-4e61-8090-0f2a7f27e74d req-86fc8459-8b02-4aa0-98ae-bc878273cfcc service nova] Creating event network-changed:a7c80ac3-bf92-4489-a5f3-e9d699fb2d81 for instance 81427539-a364-486a-8e7c-cd0ba4536b9d on n-h1-852771-8 Aug 25 12:59:09.785820 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b38e4fad-e8e8-4e61-8090-0f2a7f27e74d req-86fc8459-8b02-4aa0-98ae-bc878273cfcc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184109 Aug 25 12:59:09.786535 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1300/2566] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:09.804026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-de3d6df6-9a6d-4c23-bda5-0ff0269d52c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:09.810628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-de3d6df6-9a6d-4c23-bda5-0ff0269d52c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:10.696018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-de3d6df6-9a6d-4c23-bda5-0ff0269d52c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:10.731321 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-de3d6df6-9a6d-4c23-bda5-0ff0269d52c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1215 microversion: 2.1 time: 0.939221 Aug 25 12:59:10.747951 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1301/2567] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:09 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1215 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:10.799207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cab8584d-ae39-4707-afcc-73945bf45204 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:10.800876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cab8584d-ae39-4707-afcc-73945bf45204 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:10.825751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab8584d-ae39-4707-afcc-73945bf45204 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:10.826945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab8584d-ae39-4707-afcc-73945bf45204 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:10.830767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab8584d-ae39-4707-afcc-73945bf45204 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:10.832478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab8584d-ae39-4707-afcc-73945bf45204 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:10.842383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab8584d-ae39-4707-afcc-73945bf45204 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:10.843677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab8584d-ae39-4707-afcc-73945bf45204 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:12.547470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Updating instance_info_cache with network_info: [{"id": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81", "address": "fa:16:3e:da:0d:20", "network": {"id": "76635244-431e-41b7-9377-f49623b762de", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-807492449-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4719646f1444a8ea7977af53061340a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa7c80ac3-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129059) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:59:12.598655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Releasing lock "refresh_cache-81427539-a364-486a-8e7c-cd0ba4536b9d" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:59:12.604307 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-781ddff1-6fde-47d6-82ea-cb459a814d87 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "POST /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d/action" status: 202 len: 0 microversion: 2.1 time: 13.590055 Aug 25 12:59:12.610374 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1267/2568] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:59 2022] POST /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d/action => generated 0 bytes in 13601 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:59:12.650564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e6c9b60f-bba7-435f-a759-4f4dd661dea4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:12.652134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e6c9b60f-bba7-435f-a759-4f4dd661dea4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:12.691337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6c9b60f-bba7-435f-a759-4f4dd661dea4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:12.696430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6c9b60f-bba7-435f-a759-4f4dd661dea4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:12.698146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6c9b60f-bba7-435f-a759-4f4dd661dea4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:12.701688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6c9b60f-bba7-435f-a759-4f4dd661dea4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:12.706214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6c9b60f-bba7-435f-a759-4f4dd661dea4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:12.707718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6c9b60f-bba7-435f-a759-4f4dd661dea4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:13.408042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cab8584d-ae39-4707-afcc-73945bf45204 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:13.435512 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cab8584d-ae39-4707-afcc-73945bf45204 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1645 microversion: 2.1 time: 2.674664 Aug 25 12:59:13.438604 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1302/2569] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:10 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1645 bytes in 2684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:13.466660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-35d7d74c-43ca-4a0a-b2e8-d91f33e348c2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:13.468999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-35d7d74c-43ca-4a0a-b2e8-d91f33e348c2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:13.489927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d7d74c-43ca-4a0a-b2e8-d91f33e348c2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:13.491772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d7d74c-43ca-4a0a-b2e8-d91f33e348c2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:13.494402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d7d74c-43ca-4a0a-b2e8-d91f33e348c2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:13.498209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d7d74c-43ca-4a0a-b2e8-d91f33e348c2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:13.502337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d7d74c-43ca-4a0a-b2e8-d91f33e348c2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:13.504268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35d7d74c-43ca-4a0a-b2e8-d91f33e348c2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:13.708534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-35d7d74c-43ca-4a0a-b2e8-d91f33e348c2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:13.760522 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-35d7d74c-43ca-4a0a-b2e8-d91f33e348c2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1273 microversion: 2.1 time: 0.310582 Aug 25 12:59:13.764823 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1303/2570] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:13 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:13.791369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ee83461c-747b-45e1-832c-fee9584feeb7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '.version_select at 0x7f3a2aa524c0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:14.122128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e6c9b60f-bba7-435f-a759-4f4dd661dea4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:14.161260 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e6c9b60f-bba7-435f-a759-4f4dd661dea4 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1484 microversion: 2.1 time: 1.548711 Aug 25 12:59:14.166208 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1268/2571] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:12 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1484 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:14.485535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5c91bab3-ecbc-48ed-8146-42ad92da1ec1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:14.487228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5c91bab3-ecbc-48ed-8146-42ad92da1ec1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:14.529777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c91bab3-ecbc-48ed-8146-42ad92da1ec1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:14.531087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c91bab3-ecbc-48ed-8146-42ad92da1ec1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:14.531981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c91bab3-ecbc-48ed-8146-42ad92da1ec1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:14.533293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c91bab3-ecbc-48ed-8146-42ad92da1ec1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:14.536805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c91bab3-ecbc-48ed-8146-42ad92da1ec1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:14.542721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c91bab3-ecbc-48ed-8146-42ad92da1ec1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:14.930794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c91bab3-ecbc-48ed-8146-42ad92da1ec1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:14.964997 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5c91bab3-ecbc-48ed-8146-42ad92da1ec1 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 200 len: 1467 microversion: 2.1 time: 0.491412 Aug 25 12:59:14.993775 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1269/2572] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:14 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 1467 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:59:15.015401 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ee83461c-747b-45e1-832c-fee9584feeb7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/0778c644-6ade-42d5-850e-bb9ddc838d66" status: 200 len: 185 microversion: 2.1 time: 1.246739 Aug 25 12:59:15.018527 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1304/2573] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 12:59:13 2022] GET /compute/v2.1/os-floating-ips/0778c644-6ade-42d5-850e-bb9ddc838d66 => generated 185 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:15.033392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f1d55dba-efaf-44be-8ef4-1318ffa62d94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:15.051779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f1d55dba-efaf-44be-8ef4-1318ffa62d94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:15.058943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f2da94bf-e5b1-49f2-b7d7-5a85e6f77cb9 req-2d90248c-2ce3-498c-b204-2b020c484d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1df7169-5d0d-49ec-b515-10e8b0346159", "name": "network-vif-deleted", "tag": "bd9ba707-5ed9-4937-8ed6-f39a96c948e0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:15.105008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d55dba-efaf-44be-8ef4-1318ffa62d94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:15.111585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d55dba-efaf-44be-8ef4-1318ffa62d94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:15.113680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d55dba-efaf-44be-8ef4-1318ffa62d94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:15.120444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d55dba-efaf-44be-8ef4-1318ffa62d94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:15.123998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d55dba-efaf-44be-8ef4-1318ffa62d94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:15.128190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f2da94bf-e5b1-49f2-b7d7-5a85e6f77cb9 req-2d90248c-2ce3-498c-b204-2b020c484d3a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:15.128760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d55dba-efaf-44be-8ef4-1318ffa62d94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:15.131050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f2da94bf-e5b1-49f2-b7d7-5a85e6f77cb9 req-2d90248c-2ce3-498c-b204-2b020c484d3a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:15.131907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f2da94bf-e5b1-49f2-b7d7-5a85e6f77cb9 req-2d90248c-2ce3-498c-b204-2b020c484d3a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:15.156370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:15.185460 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f2da94bf-e5b1-49f2-b7d7-5a85e6f77cb9 req-2d90248c-2ce3-498c-b204-2b020c484d3a service nova] Creating event network-vif-deleted:bd9ba707-5ed9-4937-8ed6-f39a96c948e0 for instance e1df7169-5d0d-49ec-b515-10e8b0346159 on n-h2-852771-8 Aug 25 12:59:15.198669 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f2da94bf-e5b1-49f2-b7d7-5a85e6f77cb9 req-2d90248c-2ce3-498c-b204-2b020c484d3a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176478 Aug 25 12:59:15.200541 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1305/2574] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:15.218010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.107"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:15.422299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f1d55dba-efaf-44be-8ef4-1318ffa62d94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:15.467286 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f1d55dba-efaf-44be-8ef4-1318ffa62d94 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1273 microversion: 2.1 time: 0.470491 Aug 25 12:59:15.477811 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1270/2575] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:14 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1273 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:15.493599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f9f892a-b257-4e8e-b6d1-e2b2d936a967 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:15.496503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f9f892a-b257-4e8e-b6d1-e2b2d936a967 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:15.527785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f9f892a-b257-4e8e-b6d1-e2b2d936a967 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:15.529398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f9f892a-b257-4e8e-b6d1-e2b2d936a967 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:15.535051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f9f892a-b257-4e8e-b6d1-e2b2d936a967 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:15.537014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f9f892a-b257-4e8e-b6d1-e2b2d936a967 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:15.541607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f9f892a-b257-4e8e-b6d1-e2b2d936a967 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:15.543347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f9f892a-b257-4e8e-b6d1-e2b2d936a967 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:16.397492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:16.425411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:16.427114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:16.428356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:16.431763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:16.433191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:16.435872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:17.112509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f9f892a-b257-4e8e-b6d1-e2b2d936a967 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:17.161805 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f9f892a-b257-4e8e-b6d1-e2b2d936a967 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 200 len: 1484 microversion: 2.1 time: 1.681377 Aug 25 12:59:17.184199 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1271/2576] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:15 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 1484 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:17.210660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:17.213453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:17.234899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:17.236113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:17.236864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:17.240712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:17.245760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:17.246620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:17.326136 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 HTTP/1.1 Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'e1df7169-5d0d-49ec-b515-10e8b0346159'} Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:17.335478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:17.347548 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:17.347548 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:17.347548 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:17.347548 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:17.347548 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:17.347548 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:17.347548 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:17.351288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:17.363763 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4ebdf6a-4390-4276-9199-b3d0be78f8ac tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 404 len: 111 microversion: 2.1 time: 0.168254 Aug 25 12:59:17.374526 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1272/2577] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:17 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:17.405946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8f5fa4c7-209f-4ebb-b3fe-e655669bb0c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:17.407478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8f5fa4c7-209f-4ebb-b3fe-e655669bb0c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:17.420072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f5fa4c7-209f-4ebb-b3fe-e655669bb0c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:17.427276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f5fa4c7-209f-4ebb-b3fe-e655669bb0c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:17.428722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f5fa4c7-209f-4ebb-b3fe-e655669bb0c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:17.430545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f5fa4c7-209f-4ebb-b3fe-e655669bb0c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:17.431927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f5fa4c7-209f-4ebb-b3fe-e655669bb0c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:17.433066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f5fa4c7-209f-4ebb-b3fe-e655669bb0c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:17.779740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8f5fa4c7-209f-4ebb-b3fe-e655669bb0c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:17.796911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "refresh_cache-81427539-a364-486a-8e7c-cd0ba4536b9d" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:59:17.797825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquired lock "refresh_cache-81427539-a364-486a-8e7c-cd0ba4536b9d" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:59:17.814894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:17.835635 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8f5fa4c7-209f-4ebb-b3fe-e655669bb0c5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1273 microversion: 2.1 time: 0.458696 Aug 25 12:59:17.838309 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1273/2578] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:17 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1273 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:17.852967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d92554fb-ed62-44f1-a790-cdd86cd5aa92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a53d670>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:20.269809 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d92554fb-ed62-44f1-a790-cdd86cd5aa92 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/3b1e1efa-d517-456d-a6df-adbee537d937" status: 202 len: 0 microversion: 2.1 time: 2.429796 Aug 25 12:59:20.271475 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1274/2579] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:17 2022] DELETE /compute/v2.1/os-security-groups/3b1e1efa-d517-456d-a6df-adbee537d937 => generated 0 bytes in 2432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:59:20.286289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-16e1a6ad-67c4-47f7-b651-74620ba350ff req-7796237e-69b2-41dd-9c5a-5bffee166e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9992927-34a0-45d7-97a6-640fcc718291", "name": "network-vif-deleted", "tag": "be3062fa-b4a6-420c-a93f-db51f1259214"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:20.331488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-16e1a6ad-67c4-47f7-b651-74620ba350ff req-7796237e-69b2-41dd-9c5a-5bffee166e94 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:20.332592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-16e1a6ad-67c4-47f7-b651-74620ba350ff req-7796237e-69b2-41dd-9c5a-5bffee166e94 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:20.333621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-16e1a6ad-67c4-47f7-b651-74620ba350ff req-7796237e-69b2-41dd-9c5a-5bffee166e94 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:20.396879 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-16e1a6ad-67c4-47f7-b651-74620ba350ff req-7796237e-69b2-41dd-9c5a-5bffee166e94 service nova] Creating event network-vif-deleted:be3062fa-b4a6-420c-a93f-db51f1259214 for instance c9992927-34a0-45d7-97a6-640fcc718291 on n-h2-852771-8 Aug 25 12:59:20.425820 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-16e1a6ad-67c4-47f7-b651-74620ba350ff req-7796237e-69b2-41dd-9c5a-5bffee166e94 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147104 Aug 25 12:59:20.427185 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1275/2580] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:20.448146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:20.450248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: c9992927-34a0-45d7-97a6-640fcc718291] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:20.472675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:20.478805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:20.486796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:20.488850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:20.490466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:20.491503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:20.526885 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] HTTP exception thrown: Instance c9992927-34a0-45d7-97a6-640fcc718291 could not be found. Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Request method failure captured: Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 HTTP/1.1 Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB2798MLDFBXKtcI5bfZbD-ym0xfAWRceYZM5zRwPd8pK8OQBsxPsnkbZfnXqUoJ3RLLBu76f7wHPGQrG9qrIug60g9h8XvWx1X1hKf9cK3kLnGTBziTjLMQk8AbsQ3sDTCFeWRdvQyflRgybaFQFXdL1iyGK6s5yvoYWWccKvHRTBn4 Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5473d51e2cf040a3ae656d7e987feec2 Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-LiveMigrationTest-940338641 Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d51e2cf040a3ae656d7e987feec2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5473d51e2cf040a3ae656d7e987feec2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5473d51e2cf040a3ae656d7e987feec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d51e2cf040a3ae656d7e987feec2"}]}] Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-LiveMigrationTest-940338641 Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5473d51e2cf040a3ae656d7e987feec2 Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-LiveMigrationTest-940338641 Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-LiveMigrationTest-940338641-project Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 81b5d1940fe64714bd9ba7d2009004fd Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-LiveMigrationTest-940338641-project Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance c9992927-34a0-45d7-97a6-640fcc718291 could not be found. Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'c9992927-34a0-45d7-97a6-640fcc718291'} Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9992927-34a0-45d7-97a6-640fcc718291 could not be found. Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9992927-34a0-45d7-97a6-640fcc718291 could not be found. Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:20.530969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:20.542764 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:20.542764 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:20.542764 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:20.542764 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:20.542764 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:20.542764 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9992927-34a0-45d7-97a6-640fcc718291 could not be found. Aug 25 12:59:20.542764 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:20.543781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Returning 404 to user: Instance c9992927-34a0-45d7-97a6-640fcc718291 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:20.545985 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-03f99a3f-282d-4d7d-819e-70db8d1532ea tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291" status: 404 len: 111 microversion: 2.1 time: 0.116234 Aug 25 12:59:20.547878 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1276/2581] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:20 2022] GET /compute/v2.1/servers/c9992927-34a0-45d7-97a6-640fcc718291 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:20.560235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b7f7936-8af2-46b6-82b9-3713a931586d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:20.561711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b7f7936-8af2-46b6-82b9-3713a931586d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:20.575400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b7f7936-8af2-46b6-82b9-3713a931586d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:20.576766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b7f7936-8af2-46b6-82b9-3713a931586d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:20.577927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b7f7936-8af2-46b6-82b9-3713a931586d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:20.579701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b7f7936-8af2-46b6-82b9-3713a931586d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:20.580853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b7f7936-8af2-46b6-82b9-3713a931586d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:20.581910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b7f7936-8af2-46b6-82b9-3713a931586d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:20.721112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:21.519055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b7f7936-8af2-46b6-82b9-3713a931586d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:21.568843 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b7f7936-8af2-46b6-82b9-3713a931586d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1315 microversion: 2.1 time: 1.018904 Aug 25 12:59:21.603063 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1277/2582] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:20 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:21.621706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89ee233e-2522-46b1-bacb-d13ca35afc77 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a5495e0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:22.272310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Building network info cache for instance {{(pid=129060) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:59:23.726219 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89ee233e-2522-46b1-bacb-d13ca35afc77 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/b77558f4-ecde-4ea9-805d-e50acc81f623" status: 202 len: 0 microversion: 2.1 time: 2.120559 Aug 25 12:59:23.727861 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1278/2583] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:21 2022] DELETE /compute/v2.1/os-security-groups/b77558f4-ecde-4ea9-805d-e50acc81f623 => generated 0 bytes in 2124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:59:23.741592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6eb6aafd-4441-4e26-8891-c42b1f07ae9c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:23.747996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6eb6aafd-4441-4e26-8891-c42b1f07ae9c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:23.798477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6eb6aafd-4441-4e26-8891-c42b1f07ae9c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:23.800414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6eb6aafd-4441-4e26-8891-c42b1f07ae9c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:23.801833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6eb6aafd-4441-4e26-8891-c42b1f07ae9c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:23.804632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6eb6aafd-4441-4e26-8891-c42b1f07ae9c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:23.810085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6eb6aafd-4441-4e26-8891-c42b1f07ae9c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:23.814642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6eb6aafd-4441-4e26-8891-c42b1f07ae9c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:23.928583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6eb6aafd-4441-4e26-8891-c42b1f07ae9c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:24.300835 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6eb6aafd-4441-4e26-8891-c42b1f07ae9c tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 204 len: 0 microversion: 2.1 time: 0.551930 Aug 25 12:59:24.315104 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1279/2584] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:23 2022] DELETE /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:59:25.100186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] Calling method '.version_select at 0x7f3a2a4e4160>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:25.111654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.113847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.114655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.180003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.181644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.182853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.225921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.229963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.231019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.279579 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a56b49d9-66a3-407e-b3d3-382860c3a969 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1603542876-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.961610 Aug 25 12:59:25.281425 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1280/2585] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:59:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:25.291114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-da7251a8-a94a-4649-bfb8-b0bd14e6275a req-704a2504-db6e-4a12-80ff-66c0cf825ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81427539-a364-486a-8e7c-cd0ba4536b9d", "tag": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:25.317758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-da7251a8-a94a-4649-bfb8-b0bd14e6275a req-704a2504-db6e-4a12-80ff-66c0cf825ace service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.318537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-da7251a8-a94a-4649-bfb8-b0bd14e6275a req-704a2504-db6e-4a12-80ff-66c0cf825ace service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.319231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-da7251a8-a94a-4649-bfb8-b0bd14e6275a req-704a2504-db6e-4a12-80ff-66c0cf825ace service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.403015 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-da7251a8-a94a-4649-bfb8-b0bd14e6275a req-704a2504-db6e-4a12-80ff-66c0cf825ace service nova] Creating event network-changed:a7c80ac3-bf92-4489-a5f3-e9d699fb2d81 for instance 81427539-a364-486a-8e7c-cd0ba4536b9d on n-h1-852771-8 Aug 25 12:59:25.440674 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-da7251a8-a94a-4649-bfb8-b0bd14e6275a req-704a2504-db6e-4a12-80ff-66c0cf825ace service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157368 Aug 25 12:59:25.444298 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1281/2586] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:25.469386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4337fc14-ddd4-41b0-a2bc-62f6a24c59fe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:25.473576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4337fc14-ddd4-41b0-a2bc-62f6a24c59fe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:25.506485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4337fc14-ddd4-41b0-a2bc-62f6a24c59fe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.507354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4337fc14-ddd4-41b0-a2bc-62f6a24c59fe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.508389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4337fc14-ddd4-41b0-a2bc-62f6a24c59fe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.510197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4337fc14-ddd4-41b0-a2bc-62f6a24c59fe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.511265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4337fc14-ddd4-41b0-a2bc-62f6a24c59fe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.516789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4337fc14-ddd4-41b0-a2bc-62f6a24c59fe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.617997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Updating instance_info_cache with network_info: [{"id": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81", "address": "fa:16:3e:da:0d:20", "network": {"id": "76635244-431e-41b7-9377-f49623b762de", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-807492449-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4719646f1444a8ea7977af53061340a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa7c80ac3-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129060) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:59:25.679062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Releasing lock "refresh_cache-81427539-a364-486a-8e7c-cd0ba4536b9d" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:59:25.684389 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bf7f05bf-f4f4-4986-beb9-29dbec70adc7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "POST /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d/action" status: 202 len: 0 microversion: 2.1 time: 10.479052 Aug 25 12:59:25.692912 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1306/2587] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:59:15 2022] POST /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d/action => generated 0 bytes in 10491 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:59:25.704340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b5295e87-6f7d-4b50-946c-d5f5e4ae8afd req-ccd80dac-b91c-48a1-8c79-54387499c9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0404e5d7-4b1f-4e3d-93f0-1f769b94fe09", "tag": "97946545-59e2-4663-9161-cbf2f703fe0d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:25.726487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b5295e87-6f7d-4b50-946c-d5f5e4ae8afd req-ccd80dac-b91c-48a1-8c79-54387499c9b5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.728595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b5295e87-6f7d-4b50-946c-d5f5e4ae8afd req-ccd80dac-b91c-48a1-8c79-54387499c9b5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.729827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b5295e87-6f7d-4b50-946c-d5f5e4ae8afd req-ccd80dac-b91c-48a1-8c79-54387499c9b5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.755499 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b5295e87-6f7d-4b50-946c-d5f5e4ae8afd req-ccd80dac-b91c-48a1-8c79-54387499c9b5 service nova] Creating event network-changed:97946545-59e2-4663-9161-cbf2f703fe0d for instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 on n-h2-852771-8 Aug 25 12:59:25.795739 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b5295e87-6f7d-4b50-946c-d5f5e4ae8afd req-ccd80dac-b91c-48a1-8c79-54387499c9b5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079927 Aug 25 12:59:25.797141 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1307/2588] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:25.814126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-107a257b-0cd7-4625-8868-7562fb413164 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'create', calling method: .version_select at 0x7f3a2b1be700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1650762337", "description": "tempest-description-988307948"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:26.462910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4337fc14-ddd4-41b0-a2bc-62f6a24c59fe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:26.489123 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4337fc14-ddd4-41b0-a2bc-62f6a24c59fe tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1315 microversion: 2.1 time: 1.041143 Aug 25 12:59:26.494018 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1282/2589] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:25 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:26.511647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d75a3cd-f8bb-406a-a60b-b1cb2b7a3d84 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:26.519713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5d75a3cd-f8bb-406a-a60b-b1cb2b7a3d84 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:26.542346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d75a3cd-f8bb-406a-a60b-b1cb2b7a3d84 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:26.550536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d75a3cd-f8bb-406a-a60b-b1cb2b7a3d84 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:26.556227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d75a3cd-f8bb-406a-a60b-b1cb2b7a3d84 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:26.571906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d75a3cd-f8bb-406a-a60b-b1cb2b7a3d84 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:26.572784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d75a3cd-f8bb-406a-a60b-b1cb2b7a3d84 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:26.578242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d75a3cd-f8bb-406a-a60b-b1cb2b7a3d84 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:26.982560 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-107a257b-0cd7-4625-8868-7562fb413164 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.182626 Aug 25 12:59:26.987688 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1308/2590] 10.222.0.70 () {60 vars in 1180 bytes} [Thu Aug 25 12:59:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:27.020789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:27.023471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:27.067809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:27.072127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:27.074171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:27.080523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:27.084579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:27.086714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:27.180478 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] HTTP exception thrown: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Request method failure captured: Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced HTTP/1.1 Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3F7NAdf2f4njMqmNRcsWEEDf-tq4R1fSpFpSswIfbHR9uSdYLAGSKRaZy6YRXVFhfhBJFY9SHTFUUMAfIpMVkHIbfPyuGcgLocQ09OQ3X5SQstMR1GjkXVvh10leq8RYMN-aWEtjguL6RF61Ohl-dSVxPHjy5CYkQqGZ0pXLKCB224 Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: b4719646f1444a8ea7977af53061340a Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b4719646f1444a8ea7977af53061340a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b4719646f1444a8ea7977af53061340a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b4719646f1444a8ea7977af53061340a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b4719646f1444a8ea7977af53061340a"}]}] Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: b4719646f1444a8ea7977af53061340a Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FloatingIPsAssociationTestJSON-533804185-project Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 21f364ac015b44eb91ba63481f8595b4 Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-533804185-project Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '586ef5d3-65f8-47ca-856b-167fdaeb7ced'} Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:27.196196 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Returning 404 to user: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:27.209167 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74d4beec-9171-46b3-aa6c-76d68c6a477c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "DELETE /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 404 len: 111 microversion: 2.1 time: 0.207643 Aug 25 12:59:27.213837 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1309/2591] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:26 2022] DELETE /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:27.229542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-867b84f1-26f2-409b-b0d4-a1ace2e2a4b3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Action: 'update', calling method: .version_select at 0x7f3a2e7c53a0>, body: {"security_group": {"name": "tempest-sg-hth-185276224", "description": "tempest-description-hth-1185276241"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:27.601007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5d75a3cd-f8bb-406a-a60b-b1cb2b7a3d84 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:27.642522 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5d75a3cd-f8bb-406a-a60b-b1cb2b7a3d84 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1499 microversion: 2.1 time: 1.138741 Aug 25 12:59:27.652626 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1283/2592] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:26 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1499 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:27.685496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:27.694204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 586ef5d3-65f8-47ca-856b-167fdaeb7ced] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:27.728007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:27.729362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:27.734695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:27.744497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:27.746832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:27.750833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:27.835546 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] HTTP exception thrown: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Request method failure captured: Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced HTTP/1.1 Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F7NAdf2f4njMqmNRcsWEEDf-tq4R1fSpFpSswIfbHR9uSdYLAGSKRaZy6YRXVFhfhBJFY9SHTFUUMAfIpMVkHIbfPyuGcgLocQ09OQ3X5SQstMR1GjkXVvh10leq8RYMN-aWEtjguL6RF61Ohl-dSVxPHjy5CYkQqGZ0pXLKCB224 Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b4719646f1444a8ea7977af53061340a Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b4719646f1444a8ea7977af53061340a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b4719646f1444a8ea7977af53061340a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b4719646f1444a8ea7977af53061340a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b4719646f1444a8ea7977af53061340a"}]}] Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b4719646f1444a8ea7977af53061340a Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPsAssociationTestJSON-533804185-project Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 21f364ac015b44eb91ba63481f8595b4 Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-533804185-project Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '586ef5d3-65f8-47ca-856b-167fdaeb7ced'} Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:27.840886 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:27.845719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:27.845719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:27.845719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:27.845719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:27.845719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:27.845719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:27.845719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. Aug 25 12:59:27.845719 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:27.849403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Returning 404 to user: Instance 586ef5d3-65f8-47ca-856b-167fdaeb7ced could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:27.850381 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bd7e6044-f09f-4572-baae-94a1a7b73cd2 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced" status: 404 len: 111 microversion: 2.1 time: 0.194425 Aug 25 12:59:27.850973 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1284/2593] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:27 2022] GET /compute/v2.1/servers/586ef5d3-65f8-47ca-856b-167fdaeb7ced => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:27.871332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-adb940ac-52ad-4186-bbab-053964a9d307 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:27.871969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-adb940ac-52ad-4186-bbab-053964a9d307 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:27.922664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adb940ac-52ad-4186-bbab-053964a9d307 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:27.923975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adb940ac-52ad-4186-bbab-053964a9d307 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:27.925978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adb940ac-52ad-4186-bbab-053964a9d307 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:27.927766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adb940ac-52ad-4186-bbab-053964a9d307 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:27.929146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adb940ac-52ad-4186-bbab-053964a9d307 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:27.930831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-adb940ac-52ad-4186-bbab-053964a9d307 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:28.880626 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-867b84f1-26f2-409b-b0d4-a1ace2e2a4b3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "PUT /compute/v2.1/os-security-groups/1aa81867-b160-4654-86ed-523db044d6b2" status: 200 len: 217 microversion: 2.1 time: 1.664787 Aug 25 12:59:28.892461 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1310/2594] 10.222.0.70 () {60 vars in 1290 bytes} [Thu Aug 25 12:59:27 2022] PUT /compute/v2.1/os-security-groups/1aa81867-b160-4654-86ed-523db044d6b2 => generated 217 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:28.903905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8b5f30f5-81d4-40de-971a-748353f8f25c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '.version_select at 0x7f3a2a780d30>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:29.270628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-adb940ac-52ad-4186-bbab-053964a9d307 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:29.317598 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-adb940ac-52ad-4186-bbab-053964a9d307 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1315 microversion: 2.1 time: 1.462515 Aug 25 12:59:29.321557 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1285/2595] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:27 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1315 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:29.338800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6968fa81-c936-4b49-a71c-1953edf1c873 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:29.340236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6968fa81-c936-4b49-a71c-1953edf1c873 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:29.355857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6968fa81-c936-4b49-a71c-1953edf1c873 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:29.356891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6968fa81-c936-4b49-a71c-1953edf1c873 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:29.358023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6968fa81-c936-4b49-a71c-1953edf1c873 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:29.359590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6968fa81-c936-4b49-a71c-1953edf1c873 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:29.361950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6968fa81-c936-4b49-a71c-1953edf1c873 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:29.366729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6968fa81-c936-4b49-a71c-1953edf1c873 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:31.173097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6968fa81-c936-4b49-a71c-1953edf1c873 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b5d1940fe64714bd9ba7d2009004fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473d51e2cf040a3ae656d7e987feec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:31.216132 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6968fa81-c936-4b49-a71c-1953edf1c873 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 200 len: 1499 microversion: 2.1 time: 1.891966 Aug 25 12:59:31.222452 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1286/2596] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:29 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 1499 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:31.248078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b108afaf-5b3d-4ff1-bea4-2999df7ba7e6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a486a60>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:31.819988 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b108afaf-5b3d-4ff1-bea4-2999df7ba7e6 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/1aa81867-b160-4654-86ed-523db044d6b2" status: 200 len: 217 microversion: 2.1 time: 0.586035 Aug 25 12:59:31.821293 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1287/2597] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 12:59:31 2022] GET /compute/v2.1/os-security-groups/1aa81867-b160-4654-86ed-523db044d6b2 => generated 217 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:31.845485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-750442a9-9501-4777-81b6-1d8b304cc7bc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:31.846478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-750442a9-9501-4777-81b6-1d8b304cc7bc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:31.875579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-750442a9-9501-4777-81b6-1d8b304cc7bc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:31.876324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-750442a9-9501-4777-81b6-1d8b304cc7bc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:31.876803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-750442a9-9501-4777-81b6-1d8b304cc7bc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:31.884390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-750442a9-9501-4777-81b6-1d8b304cc7bc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:31.885369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-750442a9-9501-4777-81b6-1d8b304cc7bc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:31.886220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-750442a9-9501-4777-81b6-1d8b304cc7bc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:32.826504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-750442a9-9501-4777-81b6-1d8b304cc7bc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:32.898019 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-750442a9-9501-4777-81b6-1d8b304cc7bc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1315 microversion: 2.1 time: 1.065599 Aug 25 12:59:32.904460 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1288/2598] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:31 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1315 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:32.925780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2b1e868c-7920-4477-85d4-bbec2c53d4af req-77029619-dd70-4b4f-a2b1-0adc2bbd0c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8744baf7-d42a-4d3d-8ac3-0f1a36739d16", "name": "network-vif-deleted", "tag": "a9b376a9-bd63-44ff-bfa3-b06ca15ece4f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:32.987759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2b1e868c-7920-4477-85d4-bbec2c53d4af req-77029619-dd70-4b4f-a2b1-0adc2bbd0c4c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:32.991148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2b1e868c-7920-4477-85d4-bbec2c53d4af req-77029619-dd70-4b4f-a2b1-0adc2bbd0c4c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:32.994564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2b1e868c-7920-4477-85d4-bbec2c53d4af req-77029619-dd70-4b4f-a2b1-0adc2bbd0c4c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:33.038364 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2b1e868c-7920-4477-85d4-bbec2c53d4af req-77029619-dd70-4b4f-a2b1-0adc2bbd0c4c service nova] Creating event network-vif-deleted:a9b376a9-bd63-44ff-bfa3-b06ca15ece4f for instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 on n-h2-852771-8 Aug 25 12:59:33.058408 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2b1e868c-7920-4477-85d4-bbec2c53d4af req-77029619-dd70-4b4f-a2b1-0adc2bbd0c4c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150465 Aug 25 12:59:33.060792 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1289/2599] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:33.075634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7561dc58-1b1a-4ccf-8440-ed554daa82e3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a549b80>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:34.626930 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8b5f30f5-81d4-40de-971a-748353f8f25c tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/0778c644-6ade-42d5-850e-bb9ddc838d66" status: 202 len: 0 microversion: 2.1 time: 5.743606 Aug 25 12:59:34.629659 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1311/2600] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 12:59:28 2022] DELETE /compute/v2.1/os-floating-ips/0778c644-6ade-42d5-850e-bb9ddc838d66 => generated 0 bytes in 5747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:59:34.657133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:34.658387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] [instance: 8744baf7-d42a-4d3d-8ac3-0f1a36739d16] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:34.713060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:34.721266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:34.727550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:34.729052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:34.729993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:34.735670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:34.796271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=70,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:34.799486 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] HTTP exception thrown: Instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 could not be found. Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Request method failure captured: Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 HTTP/1.1 Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB2798MLDFBXKtcI5bfZbD-ym0xfAWRceYZM5zRwPd8pK8OQBsxPsnkbZfnXqUoJ3RLLBu76f7wHPGQrG9qrIug60g9h8XvWx1X1hKf9cK3kLnGTBziTjLMQk8AbsQ3sDTCFeWRdvQyflRgybaFQFXdL1iyGK6s5yvoYWWccKvHRTBn4 Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5473d51e2cf040a3ae656d7e987feec2 Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-LiveMigrationTest-940338641 Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d51e2cf040a3ae656d7e987feec2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5473d51e2cf040a3ae656d7e987feec2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5473d51e2cf040a3ae656d7e987feec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5473d51e2cf040a3ae656d7e987feec2"}]}] Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-LiveMigrationTest-940338641 Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5473d51e2cf040a3ae656d7e987feec2 Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-LiveMigrationTest-940338641 Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-LiveMigrationTest-940338641-project Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 81b5d1940fe64714bd9ba7d2009004fd Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-LiveMigrationTest-940338641-project Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 could not be found. Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '8744baf7-d42a-4d3d-8ac3-0f1a36739d16'} Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 could not be found. Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 could not be found. Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:34.808386 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:34.816830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:34.816830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:34.816830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:34.816830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:34.816830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:34.816830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 could not be found. Aug 25 12:59:34.816830 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:34.816830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] Returning 404 to user: Instance 8744baf7-d42a-4d3d-8ac3-0f1a36739d16 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:34.820364 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-989b4f39-dfcd-4d75-9a67-0fa879132c68 tempest-LiveMigrationTest-940338641 tempest-LiveMigrationTest-940338641-project] 10.222.0.70 "GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16" status: 404 len: 111 microversion: 2.1 time: 0.187066 Aug 25 12:59:34.831052 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1312/2601] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:34 2022] GET /compute/v2.1/servers/8744baf7-d42a-4d3d-8ac3-0f1a36739d16 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:34.866131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b1541ee-8ccb-46c3-9807-012d4fe22c13 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:34.867339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b1541ee-8ccb-46c3-9807-012d4fe22c13 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:34.900250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1541ee-8ccb-46c3-9807-012d4fe22c13 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:34.901438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1541ee-8ccb-46c3-9807-012d4fe22c13 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:34.902300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1541ee-8ccb-46c3-9807-012d4fe22c13 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:34.903708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1541ee-8ccb-46c3-9807-012d4fe22c13 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:34.904556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1541ee-8ccb-46c3-9807-012d4fe22c13 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:34.905383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1541ee-8ccb-46c3-9807-012d4fe22c13 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:35.483395 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7561dc58-1b1a-4ccf-8440-ed554daa82e3 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/1aa81867-b160-4654-86ed-523db044d6b2" status: 202 len: 0 microversion: 2.1 time: 2.419048 Aug 25 12:59:35.493608 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1290/2602] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:33 2022] DELETE /compute/v2.1/os-security-groups/1aa81867-b160-4654-86ed-523db044d6b2 => generated 0 bytes in 2431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:59:35.514467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-96d5aebe-0967-433c-a400-c79f70f27402 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:35.518122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-96d5aebe-0967-433c-a400-c79f70f27402 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:35.578383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96d5aebe-0967-433c-a400-c79f70f27402 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:35.579867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96d5aebe-0967-433c-a400-c79f70f27402 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:35.587507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96d5aebe-0967-433c-a400-c79f70f27402 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:35.589324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96d5aebe-0967-433c-a400-c79f70f27402 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:35.590641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96d5aebe-0967-433c-a400-c79f70f27402 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:35.593054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96d5aebe-0967-433c-a400-c79f70f27402 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:35.684266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-96d5aebe-0967-433c-a400-c79f70f27402 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:35.850977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:36.043312 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-96d5aebe-0967-433c-a400-c79f70f27402 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "DELETE /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 204 len: 0 microversion: 2.1 time: 0.538878 Aug 25 12:59:36.046805 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1291/2603] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:35 2022] DELETE /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:59:36.064037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3ca22444-d540-4a4e-a3c1-ef85571966c1 req-a48027bc-9859-4d3a-a9f5-22fc106f6bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0404e5d7-4b1f-4e3d-93f0-1f769b94fe09", "name": "network-vif-plugged", "status": "completed", "tag": "97946545-59e2-4663-9161-cbf2f703fe0d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:36.091290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3ca22444-d540-4a4e-a3c1-ef85571966c1 req-a48027bc-9859-4d3a-a9f5-22fc106f6bc5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:36.093776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3ca22444-d540-4a4e-a3c1-ef85571966c1 req-a48027bc-9859-4d3a-a9f5-22fc106f6bc5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:36.094963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3ca22444-d540-4a4e-a3c1-ef85571966c1 req-a48027bc-9859-4d3a-a9f5-22fc106f6bc5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:36.124360 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3ca22444-d540-4a4e-a3c1-ef85571966c1 req-a48027bc-9859-4d3a-a9f5-22fc106f6bc5 service nova] Creating event network-vif-plugged:97946545-59e2-4663-9161-cbf2f703fe0d for instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 on n-h2-852771-8 Aug 25 12:59:36.135713 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3ca22444-d540-4a4e-a3c1-ef85571966c1 req-a48027bc-9859-4d3a-a9f5-22fc106f6bc5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084283 Aug 25 12:59:36.137257 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1292/2604] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:36.177459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:36.181407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:36.218990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:36.220325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:36.221469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:36.225275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:36.227254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:36.228487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:36.327688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b1541ee-8ccb-46c3-9807-012d4fe22c13 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:36.380223 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b1541ee-8ccb-46c3-9807-012d4fe22c13 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1315 microversion: 2.1 time: 1.546979 Aug 25 12:59:36.410858 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1313/2605] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:34 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1315 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:36.428171 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:36.452745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-30a6a030-fa58-41a0-a170-1d5858a1f2ea tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:36.457663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-30a6a030-fa58-41a0-a170-1d5858a1f2ea tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 HTTP/1.1 Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'e1df7169-5d0d-49ec-b515-10e8b0346159'} Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:36.459608 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:36.467526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:36.469086 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-49fbb5a4-35ca-4405-8bee-837bdc554a66 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 404 len: 111 microversion: 2.1 time: 0.326312 Aug 25 12:59:36.472545 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1293/2606] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:36 2022] DELETE /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 111 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:36.498319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30a6a030-fa58-41a0-a170-1d5858a1f2ea tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:36.500424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30a6a030-fa58-41a0-a170-1d5858a1f2ea tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:36.501241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30a6a030-fa58-41a0-a170-1d5858a1f2ea tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:36.502788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30a6a030-fa58-41a0-a170-1d5858a1f2ea tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:36.503664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30a6a030-fa58-41a0-a170-1d5858a1f2ea tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:36.504963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30a6a030-fa58-41a0-a170-1d5858a1f2ea tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:36.509183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:36.510892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: e1df7169-5d0d-49ec-b515-10e8b0346159] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:36.528992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:36.530411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:36.531287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:36.536329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:36.537749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:36.542734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:36.720383 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 HTTP/1.1 Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'e1df7169-5d0d-49ec-b515-10e8b0346159'} Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:36.728046 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:36.735982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:36.735982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:36.735982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:36.735982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:36.735982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:36.735982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. Aug 25 12:59:36.735982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:36.740006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Instance e1df7169-5d0d-49ec-b515-10e8b0346159 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:36.749046 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cd54fa0e-79ac-4262-a66a-be748fa48351 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159" status: 404 len: 111 microversion: 2.1 time: 0.266774 Aug 25 12:59:36.771844 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1294/2607] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:36 2022] GET /compute/v2.1/servers/e1df7169-5d0d-49ec-b515-10e8b0346159 => generated 111 bytes in 291 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:36.797133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-141c3a1c-f423-48cf-8d12-752bc2d2e7bb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a29f31f70>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:37.269564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-141c3a1c-f423-48cf-8d12-752bc2d2e7bb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b77558f4-ecde-4ea9-805d-e50acc81f623 does not exist", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:59:37.270961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.security_group_api [None req-141c3a1c-f423-48cf-8d12-752bc2d2e7bb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Neutron security group b77558f4-ecde-4ea9-805d-e50acc81f623 not found {{(pid=129059) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:59:37.272120 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-141c3a1c-f423-48cf-8d12-752bc2d2e7bb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security group b77558f4-ecde-4ea9-805d-e50acc81f623 does not exist Aug 25 12:59:37.272120 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-5d109560-3e32-400a-9080-28f13cccade7'] Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-141c3a1c-f423-48cf-8d12-752bc2d2e7bb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-security-groups/b77558f4-ecde-4ea9-805d-e50acc81f623 HTTP/1.1 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: exception: Security group b77558f4-ecde-4ea9-805d-e50acc81f623 does not exist Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-5d109560-3e32-400a-9080-28f13cccade7'] Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'b77558f4-ecde-4ea9-805d-e50acc81f623'} Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:59:37.278981 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b77558f4-ecde-4ea9-805d-e50acc81f623 does not exist Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d109560-3e32-400a-9080-28f13cccade7'] Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b77558f4-ecde-4ea9-805d-e50acc81f623 does not exist Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d109560-3e32-400a-9080-28f13cccade7'] Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b77558f4-ecde-4ea9-805d-e50acc81f623 does not exist Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d109560-3e32-400a-9080-28f13cccade7'] Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b77558f4-ecde-4ea9-805d-e50acc81f623 does not exist Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d109560-3e32-400a-9080-28f13cccade7'] Aug 25 12:59:37.287497 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.298953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-141c3a1c-f423-48cf-8d12-752bc2d2e7bb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Security group b77558f4-ecde-4ea9-805d-e50acc81f623 does not exist Aug 25 12:59:37.298953 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-5d109560-3e32-400a-9080-28f13cccade7'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:37.307352 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-141c3a1c-f423-48cf-8d12-752bc2d2e7bb tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/b77558f4-ecde-4ea9-805d-e50acc81f623" status: 404 len: 194 microversion: 2.1 time: 0.531133 Aug 25 12:59:37.309410 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1295/2608] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:36 2022] DELETE /compute/v2.1/os-security-groups/b77558f4-ecde-4ea9-805d-e50acc81f623 => generated 194 bytes in 536 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:37.332157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a7fe8f1-051f-45ee-86e6-06e2983414c0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2a246550>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:37.458161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-5a7fe8f1-051f-45ee-86e6-06e2983414c0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b1e1efa-d517-456d-a6df-adbee537d937 does not exist", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:59:37.459700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.security_group_api [None req-5a7fe8f1-051f-45ee-86e6-06e2983414c0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Neutron security group 3b1e1efa-d517-456d-a6df-adbee537d937 not found {{(pid=129059) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:59:37.462356 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-5a7fe8f1-051f-45ee-86e6-06e2983414c0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security group 3b1e1efa-d517-456d-a6df-adbee537d937 does not exist Aug 25 12:59:37.462356 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-463d9055-a078-420b-9653-f44ff84aaac6'] Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a7fe8f1-051f-45ee-86e6-06e2983414c0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/os-security-groups/3b1e1efa-d517-456d-a6df-adbee537d937 HTTP/1.1 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: exception: Security group 3b1e1efa-d517-456d-a6df-adbee537d937 does not exist Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-463d9055-a078-420b-9653-f44ff84aaac6'] Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '3b1e1efa-d517-456d-a6df-adbee537d937'} Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:59:37.466971 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3b1e1efa-d517-456d-a6df-adbee537d937 does not exist Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-463d9055-a078-420b-9653-f44ff84aaac6'] Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3b1e1efa-d517-456d-a6df-adbee537d937 does not exist Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-463d9055-a078-420b-9653-f44ff84aaac6'] Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3b1e1efa-d517-456d-a6df-adbee537d937 does not exist Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-463d9055-a078-420b-9653-f44ff84aaac6'] Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3b1e1efa-d517-456d-a6df-adbee537d937 does not exist Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-463d9055-a078-420b-9653-f44ff84aaac6'] Aug 25 12:59:37.473964 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:37.484599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a7fe8f1-051f-45ee-86e6-06e2983414c0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Security group 3b1e1efa-d517-456d-a6df-adbee537d937 does not exist Aug 25 12:59:37.484599 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-463d9055-a078-420b-9653-f44ff84aaac6'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:37.490402 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a7fe8f1-051f-45ee-86e6-06e2983414c0 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/3b1e1efa-d517-456d-a6df-adbee537d937" status: 404 len: 194 microversion: 2.1 time: 0.173255 Aug 25 12:59:37.491846 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1296/2609] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:37 2022] DELETE /compute/v2.1/os-security-groups/3b1e1efa-d517-456d-a6df-adbee537d937 => generated 194 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:37.520413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6bb8a932-a6fe-488a-ba53-77af4bdc84c1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:37.529045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6bb8a932-a6fe-488a-ba53-77af4bdc84c1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:37.563035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bb8a932-a6fe-488a-ba53-77af4bdc84c1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:37.571387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bb8a932-a6fe-488a-ba53-77af4bdc84c1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:37.572673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bb8a932-a6fe-488a-ba53-77af4bdc84c1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:37.574537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bb8a932-a6fe-488a-ba53-77af4bdc84c1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:37.576049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bb8a932-a6fe-488a-ba53-77af4bdc84c1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:37.579524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bb8a932-a6fe-488a-ba53-77af4bdc84c1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:38.710397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-30a6a030-fa58-41a0-a170-1d5858a1f2ea tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:38.740289 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-30a6a030-fa58-41a0-a170-1d5858a1f2ea tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1526 microversion: 2.1 time: 2.325649 Aug 25 12:59:38.742641 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1314/2610] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:36 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1526 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:38.754749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5b39776-930e-40a4-b54d-5cbf9619e78d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2e709040>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:38.982041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-b5b39776-930e-40a4-b54d-5cbf9619e78d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:59:38.984474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.security_group_api [None req-b5b39776-930e-40a4-b54d-5cbf9619e78d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Neutron security group 71c488d4-912a-4c34-8d0b-47157a2df93b not found {{(pid=129060) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:59:38.986048 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b5b39776-930e-40a4-b54d-5cbf9619e78d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:59:38.986048 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-a10f3bbf-d00c-458d-bf0b-294468c57304'] Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5b39776-930e-40a4-b54d-5cbf9619e78d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-security-groups/71c488d4-912a-4c34-8d0b-47157a2df93b HTTP/1.1 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: exception: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-a10f3bbf-d00c-458d-bf0b-294468c57304'] Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '71c488d4-912a-4c34-8d0b-47157a2df93b'} Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:59:38.994738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a10f3bbf-d00c-458d-bf0b-294468c57304'] Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a10f3bbf-d00c-458d-bf0b-294468c57304'] Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a10f3bbf-d00c-458d-bf0b-294468c57304'] Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a10f3bbf-d00c-458d-bf0b-294468c57304'] Aug 25 12:59:39.005883 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:39.015347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5b39776-930e-40a4-b54d-5cbf9619e78d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Security group 71c488d4-912a-4c34-8d0b-47157a2df93b does not exist Aug 25 12:59:39.015347 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-a10f3bbf-d00c-458d-bf0b-294468c57304'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:39.025866 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b5b39776-930e-40a4-b54d-5cbf9619e78d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/71c488d4-912a-4c34-8d0b-47157a2df93b" status: 404 len: 194 microversion: 2.1 time: 0.275751 Aug 25 12:59:39.029419 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1315/2611] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:38 2022] DELETE /compute/v2.1/os-security-groups/71c488d4-912a-4c34-8d0b-47157a2df93b => generated 194 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:39.071440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6e5c1b9-1d56-4475-b486-5e625937e0e7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2ab83f70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:39.796877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6bb8a932-a6fe-488a-ba53-77af4bdc84c1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:39.827140 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6bb8a932-a6fe-488a-ba53-77af4bdc84c1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1315 microversion: 2.1 time: 2.329880 Aug 25 12:59:39.831260 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1297/2612] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:37 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1315 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:39.852032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0ff75969-9ad3-46fd-b3e1-0aa00fd7e361 req-83d68543-70df-46f3-a7b8-466a8290f672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81427539-a364-486a-8e7c-cd0ba4536b9d", "name": "network-vif-deleted", "tag": "a7c80ac3-bf92-4489-a5f3-e9d699fb2d81"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:39.879858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:39.919449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0ff75969-9ad3-46fd-b3e1-0aa00fd7e361 req-83d68543-70df-46f3-a7b8-466a8290f672 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:39.920307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0ff75969-9ad3-46fd-b3e1-0aa00fd7e361 req-83d68543-70df-46f3-a7b8-466a8290f672 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:39.922336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0ff75969-9ad3-46fd-b3e1-0aa00fd7e361 req-83d68543-70df-46f3-a7b8-466a8290f672 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:39.975316 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-0ff75969-9ad3-46fd-b3e1-0aa00fd7e361 req-83d68543-70df-46f3-a7b8-466a8290f672 service nova] Creating event network-vif-deleted:a7c80ac3-bf92-4489-a5f3-e9d699fb2d81 for instance 81427539-a364-486a-8e7c-cd0ba4536b9d on n-h1-852771-8 Aug 25 12:59:39.999899 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0ff75969-9ad3-46fd-b3e1-0aa00fd7e361 req-83d68543-70df-46f3-a7b8-466a8290f672 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163905 Aug 25 12:59:40.003792 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1298/2613] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:40.030722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:40.033418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:40.064992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.069276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.071031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:40.074297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.076710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.077972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:40.250041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.251803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.252692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:40.253595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lazy-loading 'fault' on Instance uuid 81427539-a364-486a-8e7c-cd0ba4536b9d {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:59:40.700539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-c6e5c1b9-1d56-4475-b486-5e625937e0e7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:59:40.701899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.security_group_api [None req-c6e5c1b9-1d56-4475-b486-5e625937e0e7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Neutron security group 19b62f13-f5bd-4209-b53b-281be5dd50cf not found {{(pid=129060) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:59:40.703176 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c6e5c1b9-1d56-4475-b486-5e625937e0e7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:59:40.703176 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-d8f1f67b-a256-441c-9f4c-9bdf547cd4eb'] Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6e5c1b9-1d56-4475-b486-5e625937e0e7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-security-groups/19b62f13-f5bd-4209-b53b-281be5dd50cf HTTP/1.1 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: exception: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-d8f1f67b-a256-441c-9f4c-9bdf547cd4eb'] Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '19b62f13-f5bd-4209-b53b-281be5dd50cf'} Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:59:40.711528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8f1f67b-a256-441c-9f4c-9bdf547cd4eb'] Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8f1f67b-a256-441c-9f4c-9bdf547cd4eb'] Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8f1f67b-a256-441c-9f4c-9bdf547cd4eb'] Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8f1f67b-a256-441c-9f4c-9bdf547cd4eb'] Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6e5c1b9-1d56-4475-b486-5e625937e0e7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Security group 19b62f13-f5bd-4209-b53b-281be5dd50cf does not exist Aug 25 12:59:40.721319 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-d8f1f67b-a256-441c-9f4c-9bdf547cd4eb'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:40.732133 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6e5c1b9-1d56-4475-b486-5e625937e0e7 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/19b62f13-f5bd-4209-b53b-281be5dd50cf" status: 404 len: 194 microversion: 2.1 time: 1.678779 Aug 25 12:59:40.732133 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1316/2614] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:39 2022] DELETE /compute/v2.1/os-security-groups/19b62f13-f5bd-4209-b53b-281be5dd50cf => generated 194 bytes in 1691 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:40.754291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-248f194e-5304-48b4-8a9d-eb9d345352ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a29c4d040>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:40.894277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f364ac015b44eb91ba63481f8595b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4719646f1444a8ea7977af53061340a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:40.921588 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a69474cc-001b-4dee-a3d7-947ebe21d6b7 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 200 len: 1314 microversion: 2.1 time: 0.908026 Aug 25 12:59:40.926469 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1299/2615] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:40 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 1314 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:40.941823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-db3dfb98-0006-4967-99b4-e0d07b40aca5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:40.947447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-db3dfb98-0006-4967-99b4-e0d07b40aca5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:40.978106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db3dfb98-0006-4967-99b4-e0d07b40aca5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.979185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db3dfb98-0006-4967-99b4-e0d07b40aca5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.983030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-248f194e-5304-48b4-8a9d-eb9d345352ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:59:40.984988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.security_group_api [None req-248f194e-5304-48b4-8a9d-eb9d345352ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Neutron security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b not found {{(pid=129060) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:59:40.987369 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-248f194e-5304-48b4-8a9d-eb9d345352ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:59:40.987369 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-6ba17829-5bc0-4d57-b8e0-ace20e0b753a'] Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-248f194e-5304-48b4-8a9d-eb9d345352ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-security-groups/5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b HTTP/1.1 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: exception: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-6ba17829-5bc0-4d57-b8e0-ace20e0b753a'] Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b'} Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:59:40.995058 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba17829-5bc0-4d57-b8e0-ace20e0b753a'] Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba17829-5bc0-4d57-b8e0-ace20e0b753a'] Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba17829-5bc0-4d57-b8e0-ace20e0b753a'] Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba17829-5bc0-4d57-b8e0-ace20e0b753a'] Aug 25 12:59:41.005899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.016780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-248f194e-5304-48b4-8a9d-eb9d345352ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Security group 5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b does not exist Aug 25 12:59:41.016780 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-6ba17829-5bc0-4d57-b8e0-ace20e0b753a'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:41.017455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db3dfb98-0006-4967-99b4-e0d07b40aca5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:41.023658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db3dfb98-0006-4967-99b4-e0d07b40aca5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:41.027763 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-248f194e-5304-48b4-8a9d-eb9d345352ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b" status: 404 len: 194 microversion: 2.1 time: 0.291814 Aug 25 12:59:41.029716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db3dfb98-0006-4967-99b4-e0d07b40aca5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:41.030955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db3dfb98-0006-4967-99b4-e0d07b40aca5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:41.031753 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1317/2616] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:40 2022] DELETE /compute/v2.1/os-security-groups/5ce19ea4-2c80-4a7b-bf95-cd14bfb1817b => generated 194 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:41.057079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae8bcf5a-171f-44ad-b82b-f65b6b7a03bf tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2e7dbdc0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:41.336948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG neutronclient.v2_0.client [None req-ae8bcf5a-171f-44ad-b82b-f65b6b7a03bf tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist", "detail": ""}} {{(pid=129060) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:59:41.338572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.security_group_api [None req-ae8bcf5a-171f-44ad-b82b-f65b6b7a03bf tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Neutron security group ad2a370f-9376-49b6-9089-df1323f98e88 not found {{(pid=129060) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:59:41.339569 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ae8bcf5a-171f-44ad-b82b-f65b6b7a03bf tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:59:41.339569 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-ec18f537-eb57-44a5-993a-db485a25094e'] Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae8bcf5a-171f-44ad-b82b-f65b6b7a03bf tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-security-groups/ad2a370f-9376-49b6-9089-df1323f98e88 HTTP/1.1 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: exception: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-ec18f537-eb57-44a5-993a-db485a25094e'] Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'ad2a370f-9376-49b6-9089-df1323f98e88'} Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:59:41.343641 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec18f537-eb57-44a5-993a-db485a25094e'] Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec18f537-eb57-44a5-993a-db485a25094e'] Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec18f537-eb57-44a5-993a-db485a25094e'] Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec18f537-eb57-44a5-993a-db485a25094e'] Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae8bcf5a-171f-44ad-b82b-f65b6b7a03bf tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Security group ad2a370f-9376-49b6-9089-df1323f98e88 does not exist Aug 25 12:59:41.353738 n-d-852771-8 devstack@n-api.service[129060]: Neutron server returns request_ids: ['req-ec18f537-eb57-44a5-993a-db485a25094e'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:41.365136 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ae8bcf5a-171f-44ad-b82b-f65b6b7a03bf tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/ad2a370f-9376-49b6-9089-df1323f98e88" status: 404 len: 194 microversion: 2.1 time: 0.326444 Aug 25 12:59:41.370038 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1318/2617] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:41 2022] DELETE /compute/v2.1/os-security-groups/ad2a370f-9376-49b6-9089-df1323f98e88 => generated 194 bytes in 333 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:41.411425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0d6feec3-f3ff-444d-b532-398cd71244ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:41.442258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0d6feec3-f3ff-444d-b532-398cd71244ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:41.454878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:41.481316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d6feec3-f3ff-444d-b532-398cd71244ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:41.482950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d6feec3-f3ff-444d-b532-398cd71244ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:41.484105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d6feec3-f3ff-444d-b532-398cd71244ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:41.489036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d6feec3-f3ff-444d-b532-398cd71244ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:41.490943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d6feec3-f3ff-444d-b532-398cd71244ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:41.506408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d6feec3-f3ff-444d-b532-398cd71244ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:41.583307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0d6feec3-f3ff-444d-b532-398cd71244ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:41.684619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-db3dfb98-0006-4967-99b4-e0d07b40aca5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:41.729298 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-db3dfb98-0006-4967-99b4-e0d07b40aca5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1502 microversion: 2.1 time: 0.800444 Aug 25 12:59:41.735871 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1300/2618] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:40 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1502 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:41.792091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e91c172b-2e64-4671-ae98-518e76f05630 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:41.794160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e91c172b-2e64-4671-ae98-518e76f05630 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:41.825778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e91c172b-2e64-4671-ae98-518e76f05630 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:41.827050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e91c172b-2e64-4671-ae98-518e76f05630 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:41.828151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e91c172b-2e64-4671-ae98-518e76f05630 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:41.831087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e91c172b-2e64-4671-ae98-518e76f05630 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:41.842966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e91c172b-2e64-4671-ae98-518e76f05630 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:41.843551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e91c172b-2e64-4671-ae98-518e76f05630 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:41.919141 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0d6feec3-f3ff-444d-b532-398cd71244ae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 204 len: 0 microversion: 2.1 time: 0.541169 Aug 25 12:59:41.920959 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1319/2619] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:41 2022] DELETE /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:59:41.945616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-17e1dea6-46d4-4700-b193-ea46f320aeae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:41.952515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-17e1dea6-46d4-4700-b193-ea46f320aeae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:41.987240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17e1dea6-46d4-4700-b193-ea46f320aeae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:41.992034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17e1dea6-46d4-4700-b193-ea46f320aeae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:41.993366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17e1dea6-46d4-4700-b193-ea46f320aeae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:41.999057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17e1dea6-46d4-4700-b193-ea46f320aeae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.001889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17e1dea6-46d4-4700-b193-ea46f320aeae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.003243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17e1dea6-46d4-4700-b193-ea46f320aeae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:42.135479 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e91c172b-2e64-4671-ae98-518e76f05630 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09/action" status: 202 len: 0 microversion: 2.1 time: 0.354415 Aug 25 12:59:42.141788 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1301/2620] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 12:59:41 2022] POST /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:59:42.162398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:42.173073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] [instance: 81427539-a364-486a-8e7c-cd0ba4536b9d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:42.204011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.207461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.212246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:42.237428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.244715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.247914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:42.303687 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] HTTP exception thrown: Instance 81427539-a364-486a-8e7c-cd0ba4536b9d could not be found. Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Request method failure captured: Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d HTTP/1.1 Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F7NAdf2f4njMqmNRcsWEEDf-tq4R1fSpFpSswIfbHR9uSdYLAGSKRaZy6YRXVFhfhBJFY9SHTFUUMAfIpMVkHIbfPyuGcgLocQ09OQ3X5SQstMR1GjkXVvh10leq8RYMN-aWEtjguL6RF61Ohl-dSVxPHjy5CYkQqGZ0pXLKCB224 Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b4719646f1444a8ea7977af53061340a Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b4719646f1444a8ea7977af53061340a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b4719646f1444a8ea7977af53061340a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b4719646f1444a8ea7977af53061340a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b4719646f1444a8ea7977af53061340a"}]}] Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b4719646f1444a8ea7977af53061340a Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-533804185 Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPsAssociationTestJSON-533804185-project Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 21f364ac015b44eb91ba63481f8595b4 Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-533804185-project Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 81427539-a364-486a-8e7c-cd0ba4536b9d could not be found. Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '81427539-a364-486a-8e7c-cd0ba4536b9d'} Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81427539-a364-486a-8e7c-cd0ba4536b9d could not be found. Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81427539-a364-486a-8e7c-cd0ba4536b9d could not be found. Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:42.310403 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:42.326075 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:42.326075 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:42.326075 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:42.326075 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:42.326075 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:42.326075 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:42.326075 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81427539-a364-486a-8e7c-cd0ba4536b9d could not be found. Aug 25 12:59:42.326075 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:42.326075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] Returning 404 to user: Instance 81427539-a364-486a-8e7c-cd0ba4536b9d could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:42.329816 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-57963d30-2059-4e11-b4aa-7cddd236b286 tempest-FloatingIPsAssociationTestJSON-533804185 tempest-FloatingIPsAssociationTestJSON-533804185-project] 10.222.0.70 "GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d" status: 404 len: 111 microversion: 2.1 time: 0.185131 Aug 25 12:59:42.340370 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1302/2621] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:42 2022] GET /compute/v2.1/servers/81427539-a364-486a-8e7c-cd0ba4536b9d => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:42.357796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b31ac780-f4dd-4ccd-b5a5-74b787d137a6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:42.361734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b31ac780-f4dd-4ccd-b5a5-74b787d137a6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:42.378883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b31ac780-f4dd-4ccd-b5a5-74b787d137a6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.388736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b31ac780-f4dd-4ccd-b5a5-74b787d137a6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.394519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b31ac780-f4dd-4ccd-b5a5-74b787d137a6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:42.402574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b31ac780-f4dd-4ccd-b5a5-74b787d137a6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.410593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b31ac780-f4dd-4ccd-b5a5-74b787d137a6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.415244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b31ac780-f4dd-4ccd-b5a5-74b787d137a6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:43.862339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-17e1dea6-46d4-4700-b193-ea46f320aeae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:43.897210 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-17e1dea6-46d4-4700-b193-ea46f320aeae tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1647 microversion: 2.1 time: 1.968836 Aug 25 12:59:43.919791 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1320/2622] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:41 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1647 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:44.112636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b31ac780-f4dd-4ccd-b5a5-74b787d137a6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:44.154739 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b31ac780-f4dd-4ccd-b5a5-74b787d137a6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1507 microversion: 2.1 time: 1.811623 Aug 25 12:59:44.160491 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1303/2623] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:42 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1507 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:44.948509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-baa0f9a4-1a23-4a78-b2bc-8d2dafc7b883 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:44.952619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-baa0f9a4-1a23-4a78-b2bc-8d2dafc7b883 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:44.989862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa0f9a4-1a23-4a78-b2bc-8d2dafc7b883 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:44.992060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa0f9a4-1a23-4a78-b2bc-8d2dafc7b883 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:44.995098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa0f9a4-1a23-4a78-b2bc-8d2dafc7b883 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:45.000333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa0f9a4-1a23-4a78-b2bc-8d2dafc7b883 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:45.002727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa0f9a4-1a23-4a78-b2bc-8d2dafc7b883 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:45.005592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baa0f9a4-1a23-4a78-b2bc-8d2dafc7b883 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:45.207364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d3deffc2-73c4-4db3-a442-deed3dc7f6ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:45.212471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d3deffc2-73c4-4db3-a442-deed3dc7f6ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:45.238633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3deffc2-73c4-4db3-a442-deed3dc7f6ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:45.240172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3deffc2-73c4-4db3-a442-deed3dc7f6ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:45.243152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3deffc2-73c4-4db3-a442-deed3dc7f6ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:45.249280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3deffc2-73c4-4db3-a442-deed3dc7f6ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:45.252275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3deffc2-73c4-4db3-a442-deed3dc7f6ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:45.263219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3deffc2-73c4-4db3-a442-deed3dc7f6ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:46.604234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d3deffc2-73c4-4db3-a442-deed3dc7f6ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:46.641106 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d3deffc2-73c4-4db3-a442-deed3dc7f6ba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1487 microversion: 2.1 time: 1.442681 Aug 25 12:59:46.654198 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1304/2624] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:45 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1487 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:59:46.695567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-17da5da7-badf-4cdb-a7a0-444c5c699e36 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:46.696460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-17da5da7-badf-4cdb-a7a0-444c5c699e36 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:46.717410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17da5da7-badf-4cdb-a7a0-444c5c699e36 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:46.717942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17da5da7-badf-4cdb-a7a0-444c5c699e36 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:46.720857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17da5da7-badf-4cdb-a7a0-444c5c699e36 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:46.726963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17da5da7-badf-4cdb-a7a0-444c5c699e36 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:46.728428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17da5da7-badf-4cdb-a7a0-444c5c699e36 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:46.734570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17da5da7-badf-4cdb-a7a0-444c5c699e36 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:46.891343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-17da5da7-badf-4cdb-a7a0-444c5c699e36 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:46.904524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-baa0f9a4-1a23-4a78-b2bc-8d2dafc7b883 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:46.937751 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-baa0f9a4-1a23-4a78-b2bc-8d2dafc7b883 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1647 microversion: 2.1 time: 1.998765 Aug 25 12:59:46.946255 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1321/2625] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:44 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1647 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:59:47.360003 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-17da5da7-badf-4cdb-a7a0-444c5c699e36 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 204 len: 0 microversion: 2.1 time: 0.669776 Aug 25 12:59:47.361149 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1305/2626] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:46 2022] DELETE /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:59:47.383248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-20e9c135-54bc-4932-8f72-0d2d23a10044 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:47.384524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-20e9c135-54bc-4932-8f72-0d2d23a10044 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:47.411735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20e9c135-54bc-4932-8f72-0d2d23a10044 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:47.432229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20e9c135-54bc-4932-8f72-0d2d23a10044 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:47.433291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20e9c135-54bc-4932-8f72-0d2d23a10044 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:47.434735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20e9c135-54bc-4932-8f72-0d2d23a10044 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:47.435683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20e9c135-54bc-4932-8f72-0d2d23a10044 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:47.436435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20e9c135-54bc-4932-8f72-0d2d23a10044 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:47.563094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-fc94a1a6-14b7-4ff8-a8ff-f4ed660ddaf6 req-811dbc3d-e92c-4396-8709-9a637de6edb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16f93e2-3483-45a3-bb63-db445da43d3e", "name": "network-vif-deleted", "tag": "4358b2d8-828a-475b-8e47-a1d534789187"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:47.645775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fc94a1a6-14b7-4ff8-a8ff-f4ed660ddaf6 req-811dbc3d-e92c-4396-8709-9a637de6edb1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:47.653271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fc94a1a6-14b7-4ff8-a8ff-f4ed660ddaf6 req-811dbc3d-e92c-4396-8709-9a637de6edb1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:47.656607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fc94a1a6-14b7-4ff8-a8ff-f4ed660ddaf6 req-811dbc3d-e92c-4396-8709-9a637de6edb1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:47.732200 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-fc94a1a6-14b7-4ff8-a8ff-f4ed660ddaf6 req-811dbc3d-e92c-4396-8709-9a637de6edb1 service nova] Creating event network-vif-deleted:4358b2d8-828a-475b-8e47-a1d534789187 for instance b16f93e2-3483-45a3-bb63-db445da43d3e on n-h1-852771-8 Aug 25 12:59:47.767803 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-fc94a1a6-14b7-4ff8-a8ff-f4ed660ddaf6 req-811dbc3d-e92c-4396-8709-9a637de6edb1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233072 Aug 25 12:59:47.775609 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1306/2627] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:48.004228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:48.024249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:48.052411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:48.059806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:48.061118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:48.062987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:48.064930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:48.068041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:48.226742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:48.227651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:48.233035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:48.234109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lazy-loading 'fault' on Instance uuid b16f93e2-3483-45a3-bb63-db445da43d3e {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:59:48.499876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b304954aa4e44979d9d79fc06909e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073060ec2e34c7187935c76726b9982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:48.527969 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ccf6c45f-5680-4cc0-9845-24d0908f0019 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 200 len: 1305 microversion: 2.1 time: 0.536007 Aug 25 12:59:48.561797 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1307/2628] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:47 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 1305 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:49.480705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-20e9c135-54bc-4932-8f72-0d2d23a10044 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:49.518754 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-20e9c135-54bc-4932-8f72-0d2d23a10044 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1493 microversion: 2.1 time: 2.151444 Aug 25 12:59:49.536245 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1322/2629] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:47 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1493 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:49.579410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:49.587838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] [instance: b16f93e2-3483-45a3-bb63-db445da43d3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:49.609535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:49.614828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:49.618520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:49.619950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:49.622332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:49.624509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:49.699515 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] HTTP exception thrown: Instance b16f93e2-3483-45a3-bb63-db445da43d3e could not be found. Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Request method failure captured: Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e HTTP/1.1 Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3F2s4DZhGq7nTRVFAQY3hkH0-oWmX_EEVwiaWZALrCHF5Kh96xwcnUz4M8tdik1bhTCfAeJeBbZ2oY4olXmyJCwZJQ4fZhAzWEy7uX5Zvf2fe0OHD2oqXYmXx1lDbnbnZeca42KR_1hTvkzMmNODgzPBSaPqJVgqaiR9H6Aj910aaQ Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3073060ec2e34c7187935c76726b9982", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3073060ec2e34c7187935c76726b9982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3073060ec2e34c7187935c76726b9982"}]}] Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3073060ec2e34c7187935c76726b9982 Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-776745524 Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 6b304954aa4e44979d9d79fc06909e94 Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-SecurityGroupsTestJSON-776745524-project Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance b16f93e2-3483-45a3-bb63-db445da43d3e could not be found. Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'b16f93e2-3483-45a3-bb63-db445da43d3e'} Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16f93e2-3483-45a3-bb63-db445da43d3e could not be found. Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16f93e2-3483-45a3-bb63-db445da43d3e could not be found. Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:49.717412 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:49.729086 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:49.729086 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:49.729086 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:49.729086 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:49.729086 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:49.729086 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16f93e2-3483-45a3-bb63-db445da43d3e could not be found. Aug 25 12:59:49.729086 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 12:59:49.729086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Returning 404 to user: Instance b16f93e2-3483-45a3-bb63-db445da43d3e could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:49.734386 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-470d36cd-8661-441c-a6c1-750e6ace702d tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e" status: 404 len: 111 microversion: 2.1 time: 0.167351 Aug 25 12:59:49.736569 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1308/2630] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:49 2022] GET /compute/v2.1/servers/b16f93e2-3483-45a3-bb63-db445da43d3e => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:49.762838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a2339a64-87de-4a5d-a25c-63da619cdd05 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a2ab175e0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:50.332137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] Calling method '.version_select at 0x7f3a2a4d3280>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:50.345748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:50.347934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:50.352735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:50.420870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:50.426404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:50.431975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:50.483976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:50.489058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:50.490768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:50.518681 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f8484e2f-f001-4669-8e20-a385c05e1589 tempest-PortsAdminExtendedAttrsTestJSON-1806441488 tempest-PortsAdminExtendedAttrsTestJSON-1806441488-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.690960 Aug 25 12:59:50.521340 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1309/2631] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 12:59:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:50.566562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1136adbc-f693-4809-8e68-8151c85fff79 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:50.567870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1136adbc-f693-4809-8e68-8151c85fff79 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:50.591770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1136adbc-f693-4809-8e68-8151c85fff79 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:50.597591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1136adbc-f693-4809-8e68-8151c85fff79 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:50.598898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1136adbc-f693-4809-8e68-8151c85fff79 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:50.607443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1136adbc-f693-4809-8e68-8151c85fff79 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:50.609368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1136adbc-f693-4809-8e68-8151c85fff79 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:50.611121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1136adbc-f693-4809-8e68-8151c85fff79 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:51.383038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1136adbc-f693-4809-8e68-8151c85fff79 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:51.436713 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1136adbc-f693-4809-8e68-8151c85fff79 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1493 microversion: 2.1 time: 0.866798 Aug 25 12:59:51.438333 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1310/2632] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:50 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1493 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:52.338038 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a2339a64-87de-4a5d-a25c-63da619cdd05 tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/7089421e-3bc1-46fb-a07d-bdc295a9d93c" status: 202 len: 0 microversion: 2.1 time: 2.591357 Aug 25 12:59:52.344970 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1323/2633] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:49 2022] DELETE /compute/v2.1/os-security-groups/7089421e-3bc1-46fb-a07d-bdc295a9d93c => generated 0 bytes in 2603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:59:52.359747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de93fd0f-3854-4e82-a2d2-c63b255a806f tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] Calling method '.version_select at 0x7f3a29f494c0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:52.490571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f58bf598-0a76-4abf-89b0-9385e82ee18e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:52.493076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f58bf598-0a76-4abf-89b0-9385e82ee18e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:52.505737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f58bf598-0a76-4abf-89b0-9385e82ee18e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:52.507369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f58bf598-0a76-4abf-89b0-9385e82ee18e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:52.508892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f58bf598-0a76-4abf-89b0-9385e82ee18e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:52.511118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f58bf598-0a76-4abf-89b0-9385e82ee18e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:52.512752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f58bf598-0a76-4abf-89b0-9385e82ee18e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:52.514625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f58bf598-0a76-4abf-89b0-9385e82ee18e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:54.038591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f58bf598-0a76-4abf-89b0-9385e82ee18e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:54.056222 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f58bf598-0a76-4abf-89b0-9385e82ee18e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 200 len: 1493 microversion: 2.1 time: 1.573751 Aug 25 12:59:54.078620 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1324/2634] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:52 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 1493 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:54.085096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c2566b6c-56cd-4cab-b64d-613da5bc0f1b req-d92ff874-08be-4203-b5fb-24bbd7328e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0404e5d7-4b1f-4e3d-93f0-1f769b94fe09", "name": "network-vif-deleted", "tag": "97946545-59e2-4663-9161-cbf2f703fe0d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:54.105660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c2566b6c-56cd-4cab-b64d-613da5bc0f1b req-d92ff874-08be-4203-b5fb-24bbd7328e7f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:54.106608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c2566b6c-56cd-4cab-b64d-613da5bc0f1b req-d92ff874-08be-4203-b5fb-24bbd7328e7f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:54.107472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c2566b6c-56cd-4cab-b64d-613da5bc0f1b req-d92ff874-08be-4203-b5fb-24bbd7328e7f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:54.143675 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c2566b6c-56cd-4cab-b64d-613da5bc0f1b req-d92ff874-08be-4203-b5fb-24bbd7328e7f service nova] Creating event network-vif-deleted:97946545-59e2-4663-9161-cbf2f703fe0d for instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 on n-h2-852771-8 Aug 25 12:59:54.154798 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c2566b6c-56cd-4cab-b64d-613da5bc0f1b req-d92ff874-08be-4203-b5fb-24bbd7328e7f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073466 Aug 25 12:59:54.157363 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1325/2635] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:54.987272 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-de93fd0f-3854-4e82-a2d2-c63b255a806f tempest-SecurityGroupsTestJSON-776745524 tempest-SecurityGroupsTestJSON-776745524-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/3736a837-ccb0-4f24-ab62-3b8d12984552" status: 202 len: 0 microversion: 2.1 time: 2.635866 Aug 25 12:59:55.002922 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1311/2636] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Aug 25 12:59:52 2022] DELETE /compute/v2.1/os-security-groups/3736a837-ccb0-4f24-ab62-3b8d12984552 => generated 0 bytes in 2654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:59:55.091706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:55.095247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:55.128121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:55.128797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:55.129252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:55.137838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:55.139112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:55.139944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:55.185937 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 HTTP/1.1 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '0404e5d7-4b1f-4e3d-93f0-1f769b94fe09'} Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:55.189906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:55.206225 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:55.206225 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:55.206225 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:55.206225 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:55.206225 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:55.206225 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 12:59:55.206225 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 12:59:55.206225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:55.206225 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1185a56c-8427-4e07-8345-8d7d9fe09170 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 404 len: 111 microversion: 2.1 time: 0.118325 Aug 25 12:59:55.220691 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1326/2637] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:55 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:59:55.521292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-482732924", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "8786102b-a15d-4894-b94c-776d2b47ed6a"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:55.702538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] validate_networks() for [('8786102b-a15d-4894-b94c-776d2b47ed6a', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:59:57.644423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-377784338", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "20be0b40-1f9e-40a4-bab4-26e31f5f7f6c"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:57.900288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] validate_networks() for [('20be0b40-1f9e-40a4-bab4-26e31f5f7f6c', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:00:00.064768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:00:00.065945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:00:00.067139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:00:00.067936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:00:00.069011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:00:00.123448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:00.124424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:00.125569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:00.129251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:00.130267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:00.131118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:00.236849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:00.258540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for user 2b81a6a01a24413b8212f140080ed018 and project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:00.327187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:00:00.338674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:00:00.644475 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dab2aa61-3fc6-4450-ace8-e5799c9a93ee tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.131250 Aug 25 13:00:00.665168 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1312/2638] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:59:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 5151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:00:00.685281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-11f8e276-4ed5-45ed-ac21-3aef8d0b9907 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:00.686818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-11f8e276-4ed5-45ed-ac21-3aef8d0b9907 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:01.330127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:00:01.331196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:00:01.333602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:00:01.338382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:00:01.344843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:00:01.429133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-11f8e276-4ed5-45ed-ac21-3aef8d0b9907 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:01.433014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:01.434017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:01.434812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:01.436317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:01.437227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:01.456469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:01.466685 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-11f8e276-4ed5-45ed-ac21-3aef8d0b9907 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1214 microversion: 2.1 time: 0.789929 Aug 25 13:00:01.473963 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1313/2639] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:00 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1214 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:01.589831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Getting quotas for project 1d432cdb3bfe4c078b18f66a2fe8e23e. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:01.621853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Getting quotas for user 92c08951ee044049ace7c7f8c92283f9 and project 1d432cdb3bfe4c078b18f66a2fe8e23e. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:01.703438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Going to run 2 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:00:01.720132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: a33c88e9-940f-41be-9de2-4eb9dc3ec851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:00:01.841157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=a33c88e9-940f-41be-9de2-4eb9dc3ec851,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:00:02.172790 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b01df806-e2e6-4570-9eb0-beed21000140 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.767635 Aug 25 13:00:02.184655 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1327/2640] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 12:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:00:02.194024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c159bb6-f879-4e0c-addc-caff39c2d91a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:02.213432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9c159bb6-f879-4e0c-addc-caff39c2d91a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:02.225359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9c159bb6-f879-4e0c-addc-caff39c2d91a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Searching by: {'deleted': False, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:00:02.341842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c159bb6-f879-4e0c-addc-caff39c2d91a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:02.343467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c159bb6-f879-4e0c-addc-caff39c2d91a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:02.348411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c159bb6-f879-4e0c-addc-caff39c2d91a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:02.352684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c159bb6-f879-4e0c-addc-caff39c2d91a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:02.354040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c159bb6-f879-4e0c-addc-caff39c2d91a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:02.357104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c159bb6-f879-4e0c-addc-caff39c2d91a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:02.465704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:02.521376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-92756f47-d74a-4c65-9a02-d1fc82fbc218 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:02.522612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-92756f47-d74a-4c65-9a02-d1fc82fbc218 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:02.525576 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c159bb6-f879-4e0c-addc-caff39c2d91a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.335347 Aug 25 13:00:02.528738 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1314/2641] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 13:00:02 2022] GET /compute/v2.1/servers => generated 675 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:00:02.553478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-80955456-1913-4b8e-abdc-9200a4b0275d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:02.563698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-80955456-1913-4b8e-abdc-9200a4b0275d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:02.593393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92756f47-d74a-4c65-9a02-d1fc82fbc218 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:02.593986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92756f47-d74a-4c65-9a02-d1fc82fbc218 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:02.595180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92756f47-d74a-4c65-9a02-d1fc82fbc218 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:02.596603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92756f47-d74a-4c65-9a02-d1fc82fbc218 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:02.597546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92756f47-d74a-4c65-9a02-d1fc82fbc218 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:02.629887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92756f47-d74a-4c65-9a02-d1fc82fbc218 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:02.769539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-80955456-1913-4b8e-abdc-9200a4b0275d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:02.804455 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-80955456-1913-4b8e-abdc-9200a4b0275d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1219 microversion: 2.1 time: 0.258438 Aug 25 13:00:02.808126 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1315/2642] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:02 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1219 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:03.048111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-92756f47-d74a-4c65-9a02-d1fc82fbc218 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:03.077686 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-92756f47-d74a-4c65-9a02-d1fc82fbc218 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1218 microversion: 2.1 time: 0.563051 Aug 25 13:00:03.083258 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1328/2643] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:02 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1218 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:03.847851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b9f2b8c4-7f7c-48a0-ac9b-dd3ac5937af5 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:03.859147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b9f2b8c4-7f7c-48a0-ac9b-dd3ac5937af5 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:04.125726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ee787f31-ebe6-459b-8a6c-627917f1cfba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:04.127173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ee787f31-ebe6-459b-8a6c-627917f1cfba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:04.159578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee787f31-ebe6-459b-8a6c-627917f1cfba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:04.166672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee787f31-ebe6-459b-8a6c-627917f1cfba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:04.168385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee787f31-ebe6-459b-8a6c-627917f1cfba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:04.177100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee787f31-ebe6-459b-8a6c-627917f1cfba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:04.183081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee787f31-ebe6-459b-8a6c-627917f1cfba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:04.184621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee787f31-ebe6-459b-8a6c-627917f1cfba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:04.345804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b9f2b8c4-7f7c-48a0-ac9b-dd3ac5937af5 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:04.380733 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b9f2b8c4-7f7c-48a0-ac9b-dd3ac5937af5 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1219 microversion: 2.1 time: 0.540136 Aug 25 13:00:04.382418 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1316/2644] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:03 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1219 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:04.716747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ee787f31-ebe6-459b-8a6c-627917f1cfba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:04.816347 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ee787f31-ebe6-459b-8a6c-627917f1cfba tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1274 microversion: 2.1 time: 0.697882 Aug 25 13:00:04.818355 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1329/2645] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:04 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1274 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:05.447940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0a83222b-501b-4459-aae2-82c98546530b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:05.449157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0a83222b-501b-4459-aae2-82c98546530b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:05.493029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a83222b-501b-4459-aae2-82c98546530b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:05.497043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a83222b-501b-4459-aae2-82c98546530b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:05.511496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a83222b-501b-4459-aae2-82c98546530b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:05.517670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a83222b-501b-4459-aae2-82c98546530b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:05.519380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a83222b-501b-4459-aae2-82c98546530b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:05.525042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a83222b-501b-4459-aae2-82c98546530b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:05.854527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0a83222b-501b-4459-aae2-82c98546530b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:05.868096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-01addb33-91d1-46c2-8ae6-6a9ebef99663 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:05.869215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-01addb33-91d1-46c2-8ae6-6a9ebef99663 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:05.915697 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0a83222b-501b-4459-aae2-82c98546530b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1215 microversion: 2.1 time: 0.487401 Aug 25 13:00:05.917695 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1317/2646] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:05 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1215 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:05.933018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01addb33-91d1-46c2-8ae6-6a9ebef99663 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:05.935402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01addb33-91d1-46c2-8ae6-6a9ebef99663 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:05.936810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01addb33-91d1-46c2-8ae6-6a9ebef99663 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:05.938659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01addb33-91d1-46c2-8ae6-6a9ebef99663 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:05.939954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01addb33-91d1-46c2-8ae6-6a9ebef99663 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:05.941110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01addb33-91d1-46c2-8ae6-6a9ebef99663 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:05.958795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:06.334947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-01addb33-91d1-46c2-8ae6-6a9ebef99663 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:06.389460 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-01addb33-91d1-46c2-8ae6-6a9ebef99663 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1272 microversion: 2.1 time: 0.530611 Aug 25 13:00:06.394230 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1330/2647] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:05 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1272 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:06.968420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-113b0389-01e9-41f4-bd43-3b17c0bfa5b4 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:06.983081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-113b0389-01e9-41f4-bd43-3b17c0bfa5b4 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:07.029550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-113b0389-01e9-41f4-bd43-3b17c0bfa5b4 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:07.046978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-113b0389-01e9-41f4-bd43-3b17c0bfa5b4 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:07.047700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-113b0389-01e9-41f4-bd43-3b17c0bfa5b4 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:07.049500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-113b0389-01e9-41f4-bd43-3b17c0bfa5b4 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:07.050310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-113b0389-01e9-41f4-bd43-3b17c0bfa5b4 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:07.051830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-113b0389-01e9-41f4-bd43-3b17c0bfa5b4 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:07.421460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-113b0389-01e9-41f4-bd43-3b17c0bfa5b4 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:07.445264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-daf3ee0d-bb84-4bf5-8c82-9e8f9362b381 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:07.450422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-daf3ee0d-bb84-4bf5-8c82-9e8f9362b381 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:07.457121 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-113b0389-01e9-41f4-bd43-3b17c0bfa5b4 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1279 microversion: 2.1 time: 0.498208 Aug 25 13:00:07.465879 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1318/2648] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:06 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1279 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:07.499822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daf3ee0d-bb84-4bf5-8c82-9e8f9362b381 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:07.500968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daf3ee0d-bb84-4bf5-8c82-9e8f9362b381 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:07.514793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daf3ee0d-bb84-4bf5-8c82-9e8f9362b381 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:07.516204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daf3ee0d-bb84-4bf5-8c82-9e8f9362b381 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:07.517081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daf3ee0d-bb84-4bf5-8c82-9e8f9362b381 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:07.517944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daf3ee0d-bb84-4bf5-8c82-9e8f9362b381 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:07.804162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-daf3ee0d-bb84-4bf5-8c82-9e8f9362b381 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:07.824726 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-daf3ee0d-bb84-4bf5-8c82-9e8f9362b381 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1272 microversion: 2.1 time: 0.389818 Aug 25 13:00:07.826212 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1331/2649] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:07 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:08.517226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c8b7c709-3328-435b-aab2-1b0c1cd3fd24 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:08.518643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c8b7c709-3328-435b-aab2-1b0c1cd3fd24 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:08.544459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8b7c709-3328-435b-aab2-1b0c1cd3fd24 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:08.545973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8b7c709-3328-435b-aab2-1b0c1cd3fd24 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:08.547318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8b7c709-3328-435b-aab2-1b0c1cd3fd24 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:08.550398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8b7c709-3328-435b-aab2-1b0c1cd3fd24 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:08.551741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8b7c709-3328-435b-aab2-1b0c1cd3fd24 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:08.552389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8b7c709-3328-435b-aab2-1b0c1cd3fd24 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:08.879382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f0d4107-9b1a-4793-93dd-18572c8a996d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:08.880450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f0d4107-9b1a-4793-93dd-18572c8a996d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:08.909372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f0d4107-9b1a-4793-93dd-18572c8a996d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:08.909987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f0d4107-9b1a-4793-93dd-18572c8a996d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:08.910695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f0d4107-9b1a-4793-93dd-18572c8a996d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:08.912332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f0d4107-9b1a-4793-93dd-18572c8a996d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:08.914281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f0d4107-9b1a-4793-93dd-18572c8a996d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:08.915396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f0d4107-9b1a-4793-93dd-18572c8a996d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:09.593568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c8b7c709-3328-435b-aab2-1b0c1cd3fd24 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:09.611674 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c8b7c709-3328-435b-aab2-1b0c1cd3fd24 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1277 microversion: 2.1 time: 1.105254 Aug 25 13:00:09.629960 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1319/2650] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:08 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1277 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:09.729600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2f0d4107-9b1a-4793-93dd-18572c8a996d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:09.754022 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f0d4107-9b1a-4793-93dd-18572c8a996d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1272 microversion: 2.1 time: 0.887237 Aug 25 13:00:09.756411 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1332/2651] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:08 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1272 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:10.653294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-259f345e-3050-41dd-8cdb-1c25b023fac2 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:10.656498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-259f345e-3050-41dd-8cdb-1c25b023fac2 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:10.680416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:10.697200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-259f345e-3050-41dd-8cdb-1c25b023fac2 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:10.699862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-259f345e-3050-41dd-8cdb-1c25b023fac2 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:10.703695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-259f345e-3050-41dd-8cdb-1c25b023fac2 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:10.706625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-259f345e-3050-41dd-8cdb-1c25b023fac2 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:10.708047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-259f345e-3050-41dd-8cdb-1c25b023fac2 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:10.711003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-259f345e-3050-41dd-8cdb-1c25b023fac2 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:10.801973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d112253a-226a-4ec4-8f34-96240fccf904 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:10.804188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d112253a-226a-4ec4-8f34-96240fccf904 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:10.814643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d112253a-226a-4ec4-8f34-96240fccf904 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:10.815461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d112253a-226a-4ec4-8f34-96240fccf904 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:10.816406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d112253a-226a-4ec4-8f34-96240fccf904 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:10.817418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d112253a-226a-4ec4-8f34-96240fccf904 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:10.818146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d112253a-226a-4ec4-8f34-96240fccf904 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:10.818758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d112253a-226a-4ec4-8f34-96240fccf904 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:11.170925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-259f345e-3050-41dd-8cdb-1c25b023fac2 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:11.215582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d112253a-226a-4ec4-8f34-96240fccf904 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:11.232573 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-259f345e-3050-41dd-8cdb-1c25b023fac2 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1277 microversion: 2.1 time: 0.577800 Aug 25 13:00:11.234682 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1320/2652] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:10 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1277 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:11.296939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d112253a-226a-4ec4-8f34-96240fccf904 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1272 microversion: 2.1 time: 0.505682 Aug 25 13:00:11.303653 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1333/2653] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:10 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1272 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:12.281965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bb67870a-6197-48f2-a1fb-f157dff4e3f0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:12.286514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bb67870a-6197-48f2-a1fb-f157dff4e3f0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:12.308765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb67870a-6197-48f2-a1fb-f157dff4e3f0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:12.310544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb67870a-6197-48f2-a1fb-f157dff4e3f0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:12.312016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb67870a-6197-48f2-a1fb-f157dff4e3f0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:12.313857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb67870a-6197-48f2-a1fb-f157dff4e3f0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:12.315086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb67870a-6197-48f2-a1fb-f157dff4e3f0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:12.316567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb67870a-6197-48f2-a1fb-f157dff4e3f0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:12.365860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12f1ae46-1532-487a-b4ed-7f8dace57fc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:12.367389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12f1ae46-1532-487a-b4ed-7f8dace57fc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:12.415242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:12.425463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:12.443981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:12.511380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:12.559288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f1ae46-1532-487a-b4ed-7f8dace57fc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:12.562172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f1ae46-1532-487a-b4ed-7f8dace57fc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:12.565295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f1ae46-1532-487a-b4ed-7f8dace57fc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:12.579779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f1ae46-1532-487a-b4ed-7f8dace57fc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:12.580883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f1ae46-1532-487a-b4ed-7f8dace57fc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:12.587035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f1ae46-1532-487a-b4ed-7f8dace57fc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:13.025960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bb67870a-6197-48f2-a1fb-f157dff4e3f0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:13.056706 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bb67870a-6197-48f2-a1fb-f157dff4e3f0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1277 microversion: 2.1 time: 0.786682 Aug 25 13:00:13.067904 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1321/2654] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:12 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1277 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:14.379126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=12 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:14.598651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bb6f5c35-7ae6-4530-92d1-1302b70a0aca tempest-ListImageFiltersNegativeTestJSON-815883282 tempest-ListImageFiltersNegativeTestJSON-815883282-project] Calling method '.version_select at 0x7f3a2e905280>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:14.685099 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-bb6f5c35-7ae6-4530-92d1-1302b70a0aca tempest-ListImageFiltersNegativeTestJSON-815883282 tempest-ListImageFiltersNegativeTestJSON-815883282-project] HTTP exception thrown: Image not found. Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bb6f5c35-7ae6-4530-92d1-1302b70a0aca tempest-ListImageFiltersNegativeTestJSON-815883282 tempest-ListImageFiltersNegativeTestJSON-815883282-project] Request method failure captured: Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/images/bee5ac8d-5fc0-45db-a3b7-98d9a3f4beb4 HTTP/1.1 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3JdwJaPsc5TeAoDisdmFgKuGW-1DZOtVV9s4-TyjCKGNNMoBmtge7HJsm6Es0L2lc0BUqfxcOLNIi2Jf7Gtt_z-nXDtgkLVqbYItBqa_3FzBxKEo9fILgo2Rfj4KX0WtsJusMJPzKl_Bd0BHf4oOgYe3pFS7b4uUGczgkvdIrvt3jo Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0a4bf9e1df2946b4b0ad22f1d475f5c0 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-815883282 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a4bf9e1df2946b4b0ad22f1d475f5c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0a4bf9e1df2946b4b0ad22f1d475f5c0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0a4bf9e1df2946b4b0ad22f1d475f5c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a4bf9e1df2946b4b0ad22f1d475f5c0"}]}] Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-815883282 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0a4bf9e1df2946b4b0ad22f1d475f5c0 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-815883282 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ListImageFiltersNegativeTestJSON-815883282-project Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2275496ac3cb4f63b887e40fa7e53b84 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-815883282-project Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: exception: Image not found. Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'bee5ac8d-5fc0-45db-a3b7-98d9a3f4beb4'} Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bee5ac8d-5fc0-45db-a3b7-98d9a3f4beb4 Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 13:00:14.691731 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bee5ac8d-5fc0-45db-a3b7-98d9a3f4beb4 could not be found. Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 13:00:14.707433 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.724802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bb6f5c35-7ae6-4530-92d1-1302b70a0aca tempest-ListImageFiltersNegativeTestJSON-815883282 tempest-ListImageFiltersNegativeTestJSON-815883282-project] Returning 404 to user: Image not found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:14.729712 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bb6f5c35-7ae6-4530-92d1-1302b70a0aca tempest-ListImageFiltersNegativeTestJSON-815883282 tempest-ListImageFiltersNegativeTestJSON-815883282-project] 10.222.0.70 "GET /compute/v2.1/images/bee5ac8d-5fc0-45db-a3b7-98d9a3f4beb4" status: 404 len: 62 microversion: 2.1 time: 0.942517 Aug 25 13:00:14.731320 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1322/2655] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 13:00:13 2022] GET /compute/v2.1/images/bee5ac8d-5fc0-45db-a3b7-98d9a3f4beb4 => generated 62 bytes in 947 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 25 13:00:14.749349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2799b6f-f84f-4c63-bbdd-fa2ecb528e44 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:14.751021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2799b6f-f84f-4c63-bbdd-fa2ecb528e44 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:14.770862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2799b6f-f84f-4c63-bbdd-fa2ecb528e44 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:14.772296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2799b6f-f84f-4c63-bbdd-fa2ecb528e44 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:14.774882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2799b6f-f84f-4c63-bbdd-fa2ecb528e44 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:14.776636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2799b6f-f84f-4c63-bbdd-fa2ecb528e44 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:14.779994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2799b6f-f84f-4c63-bbdd-fa2ecb528e44 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:14.782346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2799b6f-f84f-4c63-bbdd-fa2ecb528e44 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:14.859140 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:00:14.859992 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 13:00:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec (ip 10.222.0.70) !!! Aug 25 13:00:15.030080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2799b6f-f84f-4c63-bbdd-fa2ecb528e44 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:15.072594 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2799b6f-f84f-4c63-bbdd-fa2ecb528e44 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1277 microversion: 2.1 time: 0.335338 Aug 25 13:00:15.076055 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1323/2656] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:14 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1277 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:15.119598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12f1ae46-1532-487a-b4ed-7f8dace57fc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:15.162116 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12f1ae46-1532-487a-b4ed-7f8dace57fc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 2.818156 Aug 25 13:00:15.165870 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1334/2657] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:12 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 2823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:16.121285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-149f6b6a-2201-4c13-93ce-af787d01d800 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:16.124103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-149f6b6a-2201-4c13-93ce-af787d01d800 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:16.153877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149f6b6a-2201-4c13-93ce-af787d01d800 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:16.155015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149f6b6a-2201-4c13-93ce-af787d01d800 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:16.155858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149f6b6a-2201-4c13-93ce-af787d01d800 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:16.162000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149f6b6a-2201-4c13-93ce-af787d01d800 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:16.164431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149f6b6a-2201-4c13-93ce-af787d01d800 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:16.166165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149f6b6a-2201-4c13-93ce-af787d01d800 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:16.215662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-665286c8-1e29-440f-9df8-d7c624671edb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:16.219130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-665286c8-1e29-440f-9df8-d7c624671edb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:16.248166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-665286c8-1e29-440f-9df8-d7c624671edb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:16.251586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-665286c8-1e29-440f-9df8-d7c624671edb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:16.255083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-665286c8-1e29-440f-9df8-d7c624671edb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:16.259276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-665286c8-1e29-440f-9df8-d7c624671edb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:16.263400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-665286c8-1e29-440f-9df8-d7c624671edb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:16.266564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-665286c8-1e29-440f-9df8-d7c624671edb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:18.202832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-665286c8-1e29-440f-9df8-d7c624671edb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:18.221451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-149f6b6a-2201-4c13-93ce-af787d01d800 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:18.250511 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-149f6b6a-2201-4c13-93ce-af787d01d800 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 2.138894 Aug 25 13:00:18.255939 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1324/2658] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:16 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:18.295566 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-665286c8-1e29-440f-9df8-d7c624671edb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 2.088995 Aug 25 13:00:18.302830 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1335/2659] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:16 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:19.317043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-355e6f6f-541f-49ba-a4c9-4ddc3b4f8b1b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:19.321310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-355e6f6f-541f-49ba-a4c9-4ddc3b4f8b1b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:19.361812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2230b03d-830f-413e-8c96-91ed6bf0b280 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:19.364047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2230b03d-830f-413e-8c96-91ed6bf0b280 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:19.374166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355e6f6f-541f-49ba-a4c9-4ddc3b4f8b1b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:19.381797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355e6f6f-541f-49ba-a4c9-4ddc3b4f8b1b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:19.386225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355e6f6f-541f-49ba-a4c9-4ddc3b4f8b1b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:19.388776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2230b03d-830f-413e-8c96-91ed6bf0b280 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:19.391400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2230b03d-830f-413e-8c96-91ed6bf0b280 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:19.392813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2230b03d-830f-413e-8c96-91ed6bf0b280 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:19.394966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2230b03d-830f-413e-8c96-91ed6bf0b280 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:19.395543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355e6f6f-541f-49ba-a4c9-4ddc3b4f8b1b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:19.396517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2230b03d-830f-413e-8c96-91ed6bf0b280 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:19.397807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2230b03d-830f-413e-8c96-91ed6bf0b280 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:19.412599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355e6f6f-541f-49ba-a4c9-4ddc3b4f8b1b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:19.416475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355e6f6f-541f-49ba-a4c9-4ddc3b4f8b1b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:20.336752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2230b03d-830f-413e-8c96-91ed6bf0b280 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:20.369317 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2230b03d-830f-413e-8c96-91ed6bf0b280 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 1.031126 Aug 25 13:00:20.383124 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1336/2660] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:19 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:20.608065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-355e6f6f-541f-49ba-a4c9-4ddc3b4f8b1b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:20.636757 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-355e6f6f-541f-49ba-a4c9-4ddc3b4f8b1b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 1.337913 Aug 25 13:00:20.650831 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1325/2661] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:19 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:21.441251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c5f49353-e375-42a4-b8bc-cfb42c2f46b8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:21.443242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c5f49353-e375-42a4-b8bc-cfb42c2f46b8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:21.484909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f49353-e375-42a4-b8bc-cfb42c2f46b8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:21.486280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f49353-e375-42a4-b8bc-cfb42c2f46b8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:21.488028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f49353-e375-42a4-b8bc-cfb42c2f46b8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:21.489460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f49353-e375-42a4-b8bc-cfb42c2f46b8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:21.490371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f49353-e375-42a4-b8bc-cfb42c2f46b8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:21.491105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f49353-e375-42a4-b8bc-cfb42c2f46b8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:21.619813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-260a5023-c093-4370-9b32-f8764b602b3f tempest-ListImagesTestJSON-1035483896 tempest-ListImagesTestJSON-1035483896-project] Calling method '.version_select at 0x7f3a2a657e50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:21.832806 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-260a5023-c093-4370-9b32-f8764b602b3f tempest-ListImagesTestJSON-1035483896 tempest-ListImagesTestJSON-1035483896-project] 10.222.0.70 "GET /compute/v2.1/images/63977197-fc12-4c51-9b3a-b2cc8b9977ca" status: 200 len: 784 microversion: 2.1 time: 0.640834 Aug 25 13:00:21.845709 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1337/2662] 10.222.0.70 () {58 vars in 1233 bytes} [Thu Aug 25 13:00:21 2022] GET /compute/v2.1/images/63977197-fc12-4c51-9b3a-b2cc8b9977ca => generated 784 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:21.867691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c3c477a7-bc60-46a3-bde5-c3f5fcee7928 req-c5280b0e-c691-471a-8347-0cc06c5ee6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a33c88e9-940f-41be-9de2-4eb9dc3ec851", "tag": "35d5ec0b-1b08-47f3-833f-8033d2c71646"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:21.924530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c3c477a7-bc60-46a3-bde5-c3f5fcee7928 req-c5280b0e-c691-471a-8347-0cc06c5ee6bc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:21.924530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c3c477a7-bc60-46a3-bde5-c3f5fcee7928 req-c5280b0e-c691-471a-8347-0cc06c5ee6bc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:21.925231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c3c477a7-bc60-46a3-bde5-c3f5fcee7928 req-c5280b0e-c691-471a-8347-0cc06c5ee6bc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:21.959535 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c3c477a7-bc60-46a3-bde5-c3f5fcee7928 req-c5280b0e-c691-471a-8347-0cc06c5ee6bc service nova] Creating event network-changed:35d5ec0b-1b08-47f3-833f-8033d2c71646 for instance a33c88e9-940f-41be-9de2-4eb9dc3ec851 on n-h2-852771-8 Aug 25 13:00:21.998400 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c3c477a7-bc60-46a3-bde5-c3f5fcee7928 req-c5280b0e-c691-471a-8347-0cc06c5ee6bc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149809 Aug 25 13:00:21.999590 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1338/2663] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:22.024979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eb1e17f5-7e77-4963-ab79-f73bf2ec971d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:22.026562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eb1e17f5-7e77-4963-ab79-f73bf2ec971d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:22.056540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb1e17f5-7e77-4963-ab79-f73bf2ec971d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:22.059840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb1e17f5-7e77-4963-ab79-f73bf2ec971d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:22.061956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb1e17f5-7e77-4963-ab79-f73bf2ec971d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:22.064636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb1e17f5-7e77-4963-ab79-f73bf2ec971d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:22.066267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb1e17f5-7e77-4963-ab79-f73bf2ec971d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:22.067698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb1e17f5-7e77-4963-ab79-f73bf2ec971d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:22.854869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c5f49353-e375-42a4-b8bc-cfb42c2f46b8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:22.900083 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c5f49353-e375-42a4-b8bc-cfb42c2f46b8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 1.466036 Aug 25 13:00:22.903081 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1326/2664] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:21 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:22.928654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-935af9f6-a2ce-4d7e-82e0-acaa87b9cd64 tempest-ListImagesTestJSON-1035483896 tempest-ListImagesTestJSON-1035483896-project] Calling method '.version_select at 0x7f3a2a127430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:23.384806 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-935af9f6-a2ce-4d7e-82e0-acaa87b9cd64 tempest-ListImagesTestJSON-1035483896 tempest-ListImagesTestJSON-1035483896-project] 10.222.0.70 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.467725 Aug 25 13:00:23.386429 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1327/2665] 10.222.0.70 () {58 vars in 1122 bytes} [Thu Aug 25 13:00:22 2022] GET /compute/v2.1/images => generated 445 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:23.433190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6c7ee27c-e067-46e4-80fd-4c3118d78cf4 tempest-ListImagesTestJSON-1035483896 tempest-ListImagesTestJSON-1035483896-project] Calling method '.version_select at 0x7f3a2e905280>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:23.452233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eb1e17f5-7e77-4963-ab79-f73bf2ec971d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:23.485055 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eb1e17f5-7e77-4963-ab79-f73bf2ec971d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 1.482447 Aug 25 13:00:23.498292 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1339/2666] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:21 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:23.716057 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6c7ee27c-e067-46e4-80fd-4c3118d78cf4 tempest-ListImagesTestJSON-1035483896 tempest-ListImagesTestJSON-1035483896-project] 10.222.0.70 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.312584 Aug 25 13:00:23.728737 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1328/2667] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 13:00:23 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:23.948384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4beda7f2-dada-40a1-b101-a450084803eb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:23.948384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4beda7f2-dada-40a1-b101-a450084803eb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:24.001713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4beda7f2-dada-40a1-b101-a450084803eb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:24.002633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4beda7f2-dada-40a1-b101-a450084803eb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:24.003414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4beda7f2-dada-40a1-b101-a450084803eb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:24.008912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4beda7f2-dada-40a1-b101-a450084803eb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:24.009907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4beda7f2-dada-40a1-b101-a450084803eb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:24.010720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4beda7f2-dada-40a1-b101-a450084803eb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:24.255300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6d3917b7-6079-4d70-84ef-d4dcafa83d9c req-64b7d906-148c-4dd1-a49a-344160b97b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e64e778-70de-4c3e-9c61-f2c8bec2d5ec", "tag": "8f2e03c2-5abc-4f32-8f18-4699fec26d8d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:24.290430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6d3917b7-6079-4d70-84ef-d4dcafa83d9c req-64b7d906-148c-4dd1-a49a-344160b97b2e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:24.295233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6d3917b7-6079-4d70-84ef-d4dcafa83d9c req-64b7d906-148c-4dd1-a49a-344160b97b2e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:24.296486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6d3917b7-6079-4d70-84ef-d4dcafa83d9c req-64b7d906-148c-4dd1-a49a-344160b97b2e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:24.362020 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6d3917b7-6079-4d70-84ef-d4dcafa83d9c req-64b7d906-148c-4dd1-a49a-344160b97b2e service nova] Creating event network-changed:8f2e03c2-5abc-4f32-8f18-4699fec26d8d for instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec on n-h2-852771-8 Aug 25 13:00:24.380354 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6d3917b7-6079-4d70-84ef-d4dcafa83d9c req-64b7d906-148c-4dd1-a49a-344160b97b2e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132097 Aug 25 13:00:24.388820 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1329/2668] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:00:24.552253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7c3bcb2e-bb61-4222-ac0a-2e1eff7eac99 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:24.566905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7c3bcb2e-bb61-4222-ac0a-2e1eff7eac99 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:24.634288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c3bcb2e-bb61-4222-ac0a-2e1eff7eac99 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:24.636914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c3bcb2e-bb61-4222-ac0a-2e1eff7eac99 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:24.641173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c3bcb2e-bb61-4222-ac0a-2e1eff7eac99 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:24.652438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c3bcb2e-bb61-4222-ac0a-2e1eff7eac99 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:24.659788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c3bcb2e-bb61-4222-ac0a-2e1eff7eac99 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:24.667577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7c3bcb2e-bb61-4222-ac0a-2e1eff7eac99 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:26.213582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4beda7f2-dada-40a1-b101-a450084803eb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:26.256166 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4beda7f2-dada-40a1-b101-a450084803eb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 2.313025 Aug 25 13:00:26.275183 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1340/2669] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:23 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:26.789830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c6eeba52-02ac-449c-a5eb-fc72094d6242 req-268977aa-2645-4bcf-baf9-56470bebbab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0968b644-3ae3-49e9-b773-8dd7239de78c", "tag": "37837bff-1f9f-414a-8702-39d8aedc4015"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:26.820430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7c3bcb2e-bb61-4222-ac0a-2e1eff7eac99 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:26.871126 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7c3bcb2e-bb61-4222-ac0a-2e1eff7eac99 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 2.330536 Aug 25 13:00:26.875582 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1330/2670] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:24 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:26.919451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c6eeba52-02ac-449c-a5eb-fc72094d6242 req-268977aa-2645-4bcf-baf9-56470bebbab9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:26.926473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c6eeba52-02ac-449c-a5eb-fc72094d6242 req-268977aa-2645-4bcf-baf9-56470bebbab9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:26.933490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c6eeba52-02ac-449c-a5eb-fc72094d6242 req-268977aa-2645-4bcf-baf9-56470bebbab9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:27.013072 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c6eeba52-02ac-449c-a5eb-fc72094d6242 req-268977aa-2645-4bcf-baf9-56470bebbab9 service nova] Creating event network-changed:37837bff-1f9f-414a-8702-39d8aedc4015 for instance 0968b644-3ae3-49e9-b773-8dd7239de78c on n-h2-852771-8 Aug 25 13:00:27.048019 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c6eeba52-02ac-449c-a5eb-fc72094d6242 req-268977aa-2645-4bcf-baf9-56470bebbab9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268807 Aug 25 13:00:27.051900 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1341/2671] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:27.295505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52ed87e3-2ad2-48c6-8b71-e8052f8e6544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:27.297648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52ed87e3-2ad2-48c6-8b71-e8052f8e6544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:27.332931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ed87e3-2ad2-48c6-8b71-e8052f8e6544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:27.336859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ed87e3-2ad2-48c6-8b71-e8052f8e6544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:27.339604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ed87e3-2ad2-48c6-8b71-e8052f8e6544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:27.345740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ed87e3-2ad2-48c6-8b71-e8052f8e6544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:27.347998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ed87e3-2ad2-48c6-8b71-e8052f8e6544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:27.351672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52ed87e3-2ad2-48c6-8b71-e8052f8e6544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:27.923491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-298f1cb5-e4cf-4291-818a-58585aeefbe0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:27.947211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-298f1cb5-e4cf-4291-818a-58585aeefbe0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:27.984249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-298f1cb5-e4cf-4291-818a-58585aeefbe0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:27.985346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-298f1cb5-e4cf-4291-818a-58585aeefbe0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:27.992186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-298f1cb5-e4cf-4291-818a-58585aeefbe0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:27.996430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-298f1cb5-e4cf-4291-818a-58585aeefbe0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:28.009582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-298f1cb5-e4cf-4291-818a-58585aeefbe0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:28.010960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-298f1cb5-e4cf-4291-818a-58585aeefbe0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:30.357571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-298f1cb5-e4cf-4291-818a-58585aeefbe0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:30.402284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52ed87e3-2ad2-48c6-8b71-e8052f8e6544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:30.410995 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-298f1cb5-e4cf-4291-818a-58585aeefbe0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 2.495699 Aug 25 13:00:30.412195 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1342/2672] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:27 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 2505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:30.442641 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52ed87e3-2ad2-48c6-8b71-e8052f8e6544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 3.158515 Aug 25 13:00:30.458063 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1331/2673] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:27 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 3176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:31.467597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aa230c6b-c6b2-4228-ab07-2f9ff450cdd0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:31.470358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-aa230c6b-c6b2-4228-ab07-2f9ff450cdd0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:31.538755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f463f2e3-cdca-4cae-9148-a53092eda49d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:31.546382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f463f2e3-cdca-4cae-9148-a53092eda49d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:31.564875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa230c6b-c6b2-4228-ab07-2f9ff450cdd0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:31.571764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa230c6b-c6b2-4228-ab07-2f9ff450cdd0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:31.579410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa230c6b-c6b2-4228-ab07-2f9ff450cdd0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:31.590431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa230c6b-c6b2-4228-ab07-2f9ff450cdd0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:31.591496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa230c6b-c6b2-4228-ab07-2f9ff450cdd0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:31.592331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa230c6b-c6b2-4228-ab07-2f9ff450cdd0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:31.610018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f463f2e3-cdca-4cae-9148-a53092eda49d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:31.615658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f463f2e3-cdca-4cae-9148-a53092eda49d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:31.626016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f463f2e3-cdca-4cae-9148-a53092eda49d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:31.628078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f463f2e3-cdca-4cae-9148-a53092eda49d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:31.629307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f463f2e3-cdca-4cae-9148-a53092eda49d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:31.638228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f463f2e3-cdca-4cae-9148-a53092eda49d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:33.575994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-aa230c6b-c6b2-4228-ab07-2f9ff450cdd0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:33.631284 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aa230c6b-c6b2-4228-ab07-2f9ff450cdd0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 2.171009 Aug 25 13:00:33.636991 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1343/2674] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:31 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:33.710768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f463f2e3-cdca-4cae-9148-a53092eda49d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:33.718154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=74 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:33.770593 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f463f2e3-cdca-4cae-9148-a53092eda49d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 2.266845 Aug 25 13:00:33.796739 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1332/2675] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:31 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:34.376693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47ecf5a4-1285-4b74-82b4-10717759996a tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Action: 'create', calling method: .version_select at 0x7f3a29c4da60>, body: {"keypair": {"name": "tempest-keypair-1568751110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOgeeDiPqkK6ePfOfsxq13dhWtGcIO1wQ9Dr97RFdg/lGkWDxclTPENA6tqwf9m7pqreq0pqA9CX85ykwlyV0I0su8ZenTfCFaoTBG8oUgQi9Z6JBpBZLGPdozQi/+iqg=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:34.480300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-47ecf5a4-1285-4b74-82b4-10717759996a tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:34.500779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-47ecf5a4-1285-4b74-82b4-10717759996a tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for user 5f007f226c214b2689907ef932c33de3 and project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:34.617838 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47ecf5a4-1285-4b74-82b4-10717759996a tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.758841 Aug 25 13:00:34.619017 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1344/2676] 10.222.0.70 () {62 vars in 1199 bytes} [Thu Aug 25 13:00:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 763 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 13:00:34.639792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bda28510-806a-40c4-ac77-78ba6df03fb1 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a2e88aca0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:34.683909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a490e69-f447-4331-9e98-69adc22b9c4a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:34.685151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a490e69-f447-4331-9e98-69adc22b9c4a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:34.720004 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bda28510-806a-40c4-ac77-78ba6df03fb1 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-1568751110" status: 200 len: 513 microversion: 2.2 time: 0.074168 Aug 25 13:00:34.726099 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1333/2677] 10.222.0.70 () {60 vars in 1258 bytes} [Thu Aug 25 13:00:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1568751110 => generated 513 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:34.726800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a490e69-f447-4331-9e98-69adc22b9c4a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:34.727882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a490e69-f447-4331-9e98-69adc22b9c4a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:34.729131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a490e69-f447-4331-9e98-69adc22b9c4a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:34.737187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a490e69-f447-4331-9e98-69adc22b9c4a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:34.744943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0795978a-a64e-4452-bcf7-3becf7d1d896 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a2e83fdc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:34.746766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a490e69-f447-4331-9e98-69adc22b9c4a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:34.754758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a490e69-f447-4331-9e98-69adc22b9c4a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:34.843515 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0795978a-a64e-4452-bcf7-3becf7d1d896 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568751110" status: 204 len: 0 microversion: 2.2 time: 0.109090 Aug 25 13:00:34.845290 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1334/2678] 10.222.0.70 () {60 vars in 1261 bytes} [Thu Aug 25 13:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568751110 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:34.867357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-45ccc100-62dd-4ab8-ad64-21d575a82659 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:34.868571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-45ccc100-62dd-4ab8-ad64-21d575a82659 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:34.908050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ccc100-62dd-4ab8-ad64-21d575a82659 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:34.908916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ccc100-62dd-4ab8-ad64-21d575a82659 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:34.909739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ccc100-62dd-4ab8-ad64-21d575a82659 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:34.910991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ccc100-62dd-4ab8-ad64-21d575a82659 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:34.911757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ccc100-62dd-4ab8-ad64-21d575a82659 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:34.912539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ccc100-62dd-4ab8-ad64-21d575a82659 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:35.740678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a490e69-f447-4331-9e98-69adc22b9c4a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:35.773882 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a490e69-f447-4331-9e98-69adc22b9c4a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 1.097532 Aug 25 13:00:35.779474 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1345/2679] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:34 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:35.819671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e9e8426-8e60-40c9-89da-d0e2f3337bf6 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Action: 'create', calling method: .version_select at 0x7f3a2e769040>, body: {"keypair": {"name": "tempest-keypair-278507095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDmHJXjz1OptGwv3Xfk+WgRMKvY3q4k2HJRmRUTfBNIJVA3I9dMTgnlh+o0vJ2Kn9kH2UvfrAEeo+7DnAp6p7lrDesnkXv/Kc+x0dYVlBGHf7rNLHwSrQCDwPR5clLJVQ=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:35.899876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-5e9e8426-8e60-40c9-89da-d0e2f3337bf6 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:35.935937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-5e9e8426-8e60-40c9-89da-d0e2f3337bf6 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for user 5f007f226c214b2689907ef932c33de3 and project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:36.000806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-45ccc100-62dd-4ab8-ad64-21d575a82659 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:36.024860 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5e9e8426-8e60-40c9-89da-d0e2f3337bf6 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.216017 Aug 25 13:00:36.028941 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1346/2680] 10.222.0.70 () {62 vars in 1199 bytes} [Thu Aug 25 13:00:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 232 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 13:00:36.040313 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-45ccc100-62dd-4ab8-ad64-21d575a82659 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 1.192672 Aug 25 13:00:36.045832 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1335/2681] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:34 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:36.110094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-53aed117-4ffc-479e-a627-cf66a0fc9eaf tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a2a127430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:36.168172 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-53aed117-4ffc-479e-a627-cf66a0fc9eaf tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-278507095" status: 204 len: 0 microversion: 2.2 time: 0.104457 Aug 25 13:00:36.181406 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1336/2682] 10.222.0.70 () {60 vars in 1258 bytes} [Thu Aug 25 13:00:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-278507095 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:36.207472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4353e06f-8d1a-4b3a-8567-183c4d7e12c0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Action: 'create', calling method: .version_select at 0x7f3a29f6eca0>, body: {"keypair": {"name": "tempest-keypair-1481170712", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:36.279743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-4353e06f-8d1a-4b3a-8567-183c4d7e12c0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:36.299156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-4353e06f-8d1a-4b3a-8567-183c4d7e12c0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for user 5f007f226c214b2689907ef932c33de3 and project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:36.352565 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4353e06f-8d1a-4b3a-8567-183c4d7e12c0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.167142 Aug 25 13:00:36.363615 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1337/2683] 10.222.0.70 () {62 vars in 1199 bytes} [Thu Aug 25 13:00:36 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 13:00:36.373908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d9363342-1a8c-4605-9c04-67adcd668b3b tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a2e821ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:36.430148 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d9363342-1a8c-4605-9c04-67adcd668b3b tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1481170712" status: 204 len: 0 microversion: 2.2 time: 0.063317 Aug 25 13:00:36.448695 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1338/2684] 10.222.0.70 () {60 vars in 1261 bytes} [Thu Aug 25 13:00:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1481170712 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:36.477947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bc3797b8-7f2c-4845-822c-751c08da4d9d tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Action: 'create', calling method: .version_select at 0x7f3a29f6ef70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-114870400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETHmAHtyrFMY1eO0JlTtGU2X0y6TF8Yw5SE5HMTAifAQW3uuzLkIkddcYtc5ylPTURmwxYVEdgtlOHlb3kWksGTAGAPF9F2z1vMN9XvILrdefBIRmQYSjK2HnV3xM56cQ=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:36.525847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-bc3797b8-7f2c-4845-822c-751c08da4d9d tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:36.542594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-bc3797b8-7f2c-4845-822c-751c08da4d9d tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for user 5f007f226c214b2689907ef932c33de3 and project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:36.626557 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bc3797b8-7f2c-4845-822c-751c08da4d9d tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.173278 Aug 25 13:00:36.630018 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1339/2685] 10.222.0.70 () {62 vars in 1199 bytes} [Thu Aug 25 13:00:36 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 13:00:36.667566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d07f0454-5ee3-4526-b79c-c00895c13138 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Action: 'create', calling method: .version_select at 0x7f3a2e79d820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1937830177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx1bozN4nDNnZaTUQPw7ewonXWsOIjlAp3h7AMrljm5mSOzEyz0Exr4pKTYcwmHrK978lSz2WMOc3iJfhpVwQLWI3JnWse8rifyeiMreNbQi5qlI/8G1UbjrmBH5J3o+g=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:36.673069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-11cd12e0-7b38-4a8a-8c9f-a3f21dc738d8 req-944e9b39-f3b6-489a-9f37-68c7f64a3a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33c88e9-940f-41be-9de2-4eb9dc3ec851", "name": "network-vif-plugged", "status": "completed", "tag": "35d5ec0b-1b08-47f3-833f-8033d2c71646"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:36.732017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-11cd12e0-7b38-4a8a-8c9f-a3f21dc738d8 req-944e9b39-f3b6-489a-9f37-68c7f64a3a8b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:36.738463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-11cd12e0-7b38-4a8a-8c9f-a3f21dc738d8 req-944e9b39-f3b6-489a-9f37-68c7f64a3a8b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:36.747942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-11cd12e0-7b38-4a8a-8c9f-a3f21dc738d8 req-944e9b39-f3b6-489a-9f37-68c7f64a3a8b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:36.779579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=76 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:36.783748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d07f0454-5ee3-4526-b79c-c00895c13138 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:36.802764 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-11cd12e0-7b38-4a8a-8c9f-a3f21dc738d8 req-944e9b39-f3b6-489a-9f37-68c7f64a3a8b service nova] Creating event network-vif-plugged:35d5ec0b-1b08-47f3-833f-8033d2c71646 for instance a33c88e9-940f-41be-9de2-4eb9dc3ec851 on n-h2-852771-8 Aug 25 13:00:36.815540 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-11cd12e0-7b38-4a8a-8c9f-a3f21dc738d8 req-944e9b39-f3b6-489a-9f37-68c7f64a3a8b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.783464 Aug 25 13:00:36.818369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d07f0454-5ee3-4526-b79c-c00895c13138 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for user 5f007f226c214b2689907ef932c33de3 and project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:36.827642 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1347/2686] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:36.845910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d287092-cafc-48be-ae2e-cac370458263 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:36.847876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4d287092-cafc-48be-ae2e-cac370458263 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:36.863438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d287092-cafc-48be-ae2e-cac370458263 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:36.865920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d287092-cafc-48be-ae2e-cac370458263 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:36.867764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d287092-cafc-48be-ae2e-cac370458263 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:36.870116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d287092-cafc-48be-ae2e-cac370458263 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:36.871661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d287092-cafc-48be-ae2e-cac370458263 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:36.873133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d287092-cafc-48be-ae2e-cac370458263 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:36.947092 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d07f0454-5ee3-4526-b79c-c00895c13138 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.294506 Aug 25 13:00:36.948379 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1340/2687] 10.222.0.70 () {62 vars in 1199 bytes} [Thu Aug 25 13:00:36 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 298 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 13:00:36.984091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a3439f81-471d-46ca-9b19-95c02b86fb42 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Action: 'create', calling method: .version_select at 0x7f3a2a207b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1376012336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6NP999+RxvU/liofTv1NcWN2B+gIqCPmX9smtYq3Qi4yFdyTesQkzVsrzoBaWeaJz7XDD51yZvEN7x3WUD75u+cNp+y7CKxVEazARVWkdurRs7yfvL+lW985zQ+pRQag=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:37.078217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a3439f81-471d-46ca-9b19-95c02b86fb42 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:37.092923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a3439f81-471d-46ca-9b19-95c02b86fb42 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for user 5f007f226c214b2689907ef932c33de3 and project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:37.191637 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a3439f81-471d-46ca-9b19-95c02b86fb42 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.227583 Aug 25 13:00:37.194908 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1341/2688] 10.222.0.70 () {62 vars in 1199 bytes} [Thu Aug 25 13:00:36 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 232 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 13:00:37.225498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-32906534-075b-45f3-a335-9d469103dbf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:37.226819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-32906534-075b-45f3-a335-9d469103dbf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:37.253708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32906534-075b-45f3-a335-9d469103dbf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:37.254045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32906534-075b-45f3-a335-9d469103dbf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:37.254636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32906534-075b-45f3-a335-9d469103dbf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:37.262928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32906534-075b-45f3-a335-9d469103dbf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:37.266338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32906534-075b-45f3-a335-9d469103dbf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:37.267282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32906534-075b-45f3-a335-9d469103dbf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:37.633658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4d287092-cafc-48be-ae2e-cac370458263 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:37.682117 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d287092-cafc-48be-ae2e-cac370458263 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 0.840170 Aug 25 13:00:37.687804 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1348/2689] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:36 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:37.727975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ddc13bef-53ba-49ca-bb46-aa911537d029 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a2aa52e50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:37.774237 n-d-852771-8 devstack@n-api.service[129060]: WARNING oslo_db.sqlalchemy.utils [None req-ddc13bef-53ba-49ca-bb46-aa911537d029 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 13:00:37.826560 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ddc13bef-53ba-49ca-bb46-aa911537d029 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.129072 Aug 25 13:00:37.828816 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1349/2690] 10.222.0.70 () {60 vars in 1177 bytes} [Thu Aug 25 13:00:37 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:37.886277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29dc250f-ecdf-45a0-a5a7-51677d903b53 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a29bc29d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:37.909977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-32906534-075b-45f3-a335-9d469103dbf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:37.952076 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-32906534-075b-45f3-a335-9d469103dbf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 0.752016 Aug 25 13:00:37.954102 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1342/2691] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:37 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:37.999587 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29dc250f-ecdf-45a0-a5a7-51677d903b53 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1376012336" status: 204 len: 0 microversion: 2.2 time: 0.144652 Aug 25 13:00:38.003333 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1350/2692] 10.222.0.70 () {60 vars in 1321 bytes} [Thu Aug 25 13:00:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1376012336 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:38.019423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-46493c40-32d5-4c75-afb1-90e091935ee1 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a29f6e5e0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:38.064181 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-46493c40-32d5-4c75-afb1-90e091935ee1 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1937830177" status: 204 len: 0 microversion: 2.2 time: 0.051121 Aug 25 13:00:38.066872 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1343/2693] 10.222.0.70 () {60 vars in 1321 bytes} [Thu Aug 25 13:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1937830177 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:38.086803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-572f87c1-e613-461b-a0bc-6e6d59ac24bb tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a29be9790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:38.161642 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-572f87c1-e613-461b-a0bc-6e6d59ac24bb tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-114870400" status: 204 len: 0 microversion: 2.2 time: 0.087090 Aug 25 13:00:38.167257 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1351/2694] 10.222.0.70 () {60 vars in 1318 bytes} [Thu Aug 25 13:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-114870400 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:38.189998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4b7a9258-af74-4d2f-8772-fb6824a98da7 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Action: 'create', calling method: .version_select at 0x7f3a2a55b9d0>, body: {"keypair": {"name": "tempest-keypair-692338261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7eak3n+RGvfKAdl0/8nsjmYvTeppV/2bLIQTLVrIxQw+74+GYlkCN5WlBW9VnyOogD83zrt4LpdKSBCSCoigCcDfO9Ynh6sjyHHx2oPYh9vCXNKtsHk3u5HeJLSxHHaQ=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:38.230665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-4b7a9258-af74-4d2f-8772-fb6824a98da7 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:38.242733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-4b7a9258-af74-4d2f-8772-fb6824a98da7 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for user 5f007f226c214b2689907ef932c33de3 and project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:38.296650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:38.321975 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4b7a9258-af74-4d2f-8772-fb6824a98da7 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.138489 Aug 25 13:00:38.348001 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1344/2695] 10.222.0.70 () {62 vars in 1199 bytes} [Thu Aug 25 13:00:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 13:00:38.348302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-733b970f-4e71-4cbf-bb8e-50f74ec9cd67 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a29bc23a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:38.368198 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-733b970f-4e71-4cbf-bb8e-50f74ec9cd67 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-692338261" status: 200 len: 512 microversion: 2.2 time: 0.032119 Aug 25 13:00:38.390482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-515bc643-f7b4-439a-92ca-44243e7ccee1 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a2e914310>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:38.392037 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1352/2696] 10.222.0.70 () {60 vars in 1255 bytes} [Thu Aug 25 13:00:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-692338261 => generated 512 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:38.402632 n-d-852771-8 devstack@n-api.service[129059]: WARNING oslo_db.sqlalchemy.utils [None req-515bc643-f7b4-439a-92ca-44243e7ccee1 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 13:00:38.420748 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-515bc643-f7b4-439a-92ca-44243e7ccee1 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.037643 Aug 25 13:00:38.432524 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1345/2697] 10.222.0.70 () {60 vars in 1177 bytes} [Thu Aug 25 13:00:38 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:38.442530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d201536d-92f0-4fb3-b2bc-e9c3e4f42ffe tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a2a1caf70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:38.513500 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d201536d-92f0-4fb3-b2bc-e9c3e4f42ffe tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-692338261" status: 204 len: 0 microversion: 2.2 time: 0.078164 Aug 25 13:00:38.514591 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1353/2698] 10.222.0.70 () {60 vars in 1258 bytes} [Thu Aug 25 13:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-692338261 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:38.538028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a25db4c5-0e09-41f0-bf48-aa7a7f2ffed0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Action: 'create', calling method: .version_select at 0x7f3a29f6ef70>, body: {"keypair": {"name": "tempest-keypair-508947288", "type": "x509"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:38.620230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a25db4c5-0e09-41f0-bf48-aa7a7f2ffed0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:38.633701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a25db4c5-0e09-41f0-bf48-aa7a7f2ffed0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for user 5f007f226c214b2689907ef932c33de3 and project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:38.708716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.processutils [None req-a25db4c5-0e09-41f0-bf48-aa7a7f2ffed0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpsbb0147r/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpsbb0147r/temp.key -subj /CN=5f007f226c214b2689907ef932c33de3 -extensions v3_req_client {{(pid=129059) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 25 13:00:38.732401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-616c2bb9-14d4-4cc7-9f3a-f1d0aa50f69b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:38.734983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-616c2bb9-14d4-4cc7-9f3a-f1d0aa50f69b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:38.781865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-616c2bb9-14d4-4cc7-9f3a-f1d0aa50f69b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:38.782990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-616c2bb9-14d4-4cc7-9f3a-f1d0aa50f69b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:38.783552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-616c2bb9-14d4-4cc7-9f3a-f1d0aa50f69b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:38.795004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-616c2bb9-14d4-4cc7-9f3a-f1d0aa50f69b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:38.796655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-616c2bb9-14d4-4cc7-9f3a-f1d0aa50f69b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:38.797467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-616c2bb9-14d4-4cc7-9f3a-f1d0aa50f69b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:39.135474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.processutils [None req-a25db4c5-0e09-41f0-bf48-aa7a7f2ffed0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpsbb0147r/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpsbb0147r/temp.key -subj /CN=5f007f226c214b2689907ef932c33de3 -extensions v3_req_client" returned: 0 in 0.426s {{(pid=129059) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 25 13:00:39.140678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.processutils [None req-a25db4c5-0e09-41f0-bf48-aa7a7f2ffed0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpsbb0147r/temp.key -password pass: {{(pid=129059) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 25 13:00:39.250216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.processutils [None req-a25db4c5-0e09-41f0-bf48-aa7a7f2ffed0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpsbb0147r/temp.key -password pass:" returned: 0 in 0.110s {{(pid=129059) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 25 13:00:39.382877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-616c2bb9-14d4-4cc7-9f3a-f1d0aa50f69b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:39.417551 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-616c2bb9-14d4-4cc7-9f3a-f1d0aa50f69b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 0.690207 Aug 25 13:00:39.439038 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1354/2699] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:38 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:39.442917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a25db4c5-0e09-41f0-bf48-aa7a7f2ffed0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:39.462417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a25db4c5-0e09-41f0-bf48-aa7a7f2ffed0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Getting quotas for user 5f007f226c214b2689907ef932c33de3 and project 65d30779cf644542b54e3eee7c139def. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:39.481263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-17736004-ef9d-43f7-a079-a0e9127a8d39 req-8222b0b3-ca86-42ed-bee9-5b2783ba5f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e64e778-70de-4c3e-9c61-f2c8bec2d5ec", "name": "network-vif-plugged", "status": "completed", "tag": "8f2e03c2-5abc-4f32-8f18-4699fec26d8d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:39.515718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-17736004-ef9d-43f7-a079-a0e9127a8d39 req-8222b0b3-ca86-42ed-bee9-5b2783ba5f40 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:39.516453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-17736004-ef9d-43f7-a079-a0e9127a8d39 req-8222b0b3-ca86-42ed-bee9-5b2783ba5f40 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:39.518723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-17736004-ef9d-43f7-a079-a0e9127a8d39 req-8222b0b3-ca86-42ed-bee9-5b2783ba5f40 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:39.559110 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-17736004-ef9d-43f7-a079-a0e9127a8d39 req-8222b0b3-ca86-42ed-bee9-5b2783ba5f40 service nova] Creating event network-vif-plugged:8f2e03c2-5abc-4f32-8f18-4699fec26d8d for instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec on n-h2-852771-8 Aug 25 13:00:39.584531 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-17736004-ef9d-43f7-a079-a0e9127a8d39 req-8222b0b3-ca86-42ed-bee9-5b2783ba5f40 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143050 Aug 25 13:00:39.587005 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a25db4c5-0e09-41f0-bf48-aa7a7f2ffed0 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.061203 Aug 25 13:00:39.590164 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1346/2700] 10.222.0.70 () {62 vars in 1198 bytes} [Thu Aug 25 13:00:38 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1069 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:39.599685 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1355/2701] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:39.622046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-16c6d4e5-ab0f-4064-afe7-b2158b463357 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a29be0040>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:39.652460 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-16c6d4e5-ab0f-4064-afe7-b2158b463357 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-508947288" status: 200 len: 1533 microversion: 2.2 time: 0.049232 Aug 25 13:00:39.655282 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1356/2702] 10.222.0.70 () {60 vars in 1255 bytes} [Thu Aug 25 13:00:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-508947288 => generated 1533 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:39.678043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf66f3be-b5ca-429a-b75f-528cf605e486 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:39.679529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cf66f3be-b5ca-429a-b75f-528cf605e486 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:39.708161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9fbcbbaa-529d-4ff4-85d8-856c624a92e6 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a29c4d160>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:39.718411 n-d-852771-8 devstack@n-api.service[129060]: WARNING oslo_db.sqlalchemy.utils [None req-9fbcbbaa-529d-4ff4-85d8-856c624a92e6 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 13:00:39.729570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf66f3be-b5ca-429a-b75f-528cf605e486 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:39.731346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf66f3be-b5ca-429a-b75f-528cf605e486 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:39.732794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf66f3be-b5ca-429a-b75f-528cf605e486 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:39.733316 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9fbcbbaa-529d-4ff4-85d8-856c624a92e6 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.061656 Aug 25 13:00:39.735525 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1357/2703] 10.222.0.70 () {60 vars in 1177 bytes} [Thu Aug 25 13:00:39 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:39.750086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf66f3be-b5ca-429a-b75f-528cf605e486 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:39.753592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf66f3be-b5ca-429a-b75f-528cf605e486 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:39.761312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf66f3be-b5ca-429a-b75f-528cf605e486 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:39.776560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29561517-6449-4cd2-b2dd-3dda5430b591 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] Calling method '.version_select at 0x7f3a2e709310>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:39.865086 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29561517-6449-4cd2-b2dd-3dda5430b591 tempest-KeyPairsV22TestJSON-1558151681 tempest-KeyPairsV22TestJSON-1558151681-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508947288" status: 204 len: 0 microversion: 2.2 time: 0.112918 Aug 25 13:00:39.868619 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1358/2704] 10.222.0.70 () {60 vars in 1258 bytes} [Thu Aug 25 13:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508947288 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:40.277542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cf66f3be-b5ca-429a-b75f-528cf605e486 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:40.312382 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cf66f3be-b5ca-429a-b75f-528cf605e486 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 0.711723 Aug 25 13:00:40.327547 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1347/2705] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:39 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:40.475656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cfd6f035-d7da-4570-8e63-887f29003c91 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:40.480236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cfd6f035-d7da-4570-8e63-887f29003c91 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:40.514701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd6f035-d7da-4570-8e63-887f29003c91 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:40.518423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd6f035-d7da-4570-8e63-887f29003c91 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:40.521792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd6f035-d7da-4570-8e63-887f29003c91 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:40.526683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd6f035-d7da-4570-8e63-887f29003c91 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:40.529531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd6f035-d7da-4570-8e63-887f29003c91 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:40.531923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfd6f035-d7da-4570-8e63-887f29003c91 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:41.079099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-621beb6f-71a0-4e00-bb30-a924d98f4450 tempest-AZV2TestJSON-2102621913 tempest-AZV2TestJSON-2102621913-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:41.082535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621beb6f-71a0-4e00-bb30-a924d98f4450 tempest-AZV2TestJSON-2102621913 tempest-AZV2TestJSON-2102621913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:41.096353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621beb6f-71a0-4e00-bb30-a924d98f4450 tempest-AZV2TestJSON-2102621913 tempest-AZV2TestJSON-2102621913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:41.097113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621beb6f-71a0-4e00-bb30-a924d98f4450 tempest-AZV2TestJSON-2102621913 tempest-AZV2TestJSON-2102621913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:41.098537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621beb6f-71a0-4e00-bb30-a924d98f4450 tempest-AZV2TestJSON-2102621913 tempest-AZV2TestJSON-2102621913-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:41.106050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621beb6f-71a0-4e00-bb30-a924d98f4450 tempest-AZV2TestJSON-2102621913 tempest-AZV2TestJSON-2102621913-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:41.107781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cfd6f035-d7da-4570-8e63-887f29003c91 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:41.109825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621beb6f-71a0-4e00-bb30-a924d98f4450 tempest-AZV2TestJSON-2102621913 tempest-AZV2TestJSON-2102621913-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:41.126829 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cfd6f035-d7da-4570-8e63-887f29003c91 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 0.661701 Aug 25 13:00:41.142969 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1348/2706] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:40 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:41.232879 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-621beb6f-71a0-4e00-bb30-a924d98f4450 tempest-AZV2TestJSON-2102621913 tempest-AZV2TestJSON-2102621913-project] 10.222.0.70 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.362248 Aug 25 13:00:41.247264 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1359/2707] 10.222.0.70 () {58 vars in 1164 bytes} [Thu Aug 25 13:00:39 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:00:41.363656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2e625779-3c13-4361-bd49-59b00fe260dd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:41.376040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2e625779-3c13-4361-bd49-59b00fe260dd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:41.407579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e625779-3c13-4361-bd49-59b00fe260dd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:41.409226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e625779-3c13-4361-bd49-59b00fe260dd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:41.412730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e625779-3c13-4361-bd49-59b00fe260dd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:41.419594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e625779-3c13-4361-bd49-59b00fe260dd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:41.423106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e625779-3c13-4361-bd49-59b00fe260dd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:41.424349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e625779-3c13-4361-bd49-59b00fe260dd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:41.844118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2e625779-3c13-4361-bd49-59b00fe260dd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:41.867110 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2e625779-3c13-4361-bd49-59b00fe260dd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1314 microversion: 2.1 time: 0.512930 Aug 25 13:00:41.880673 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1349/2708] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:41 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:42.172294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6c1b5e0e-0fac-458d-a4e0-373bbb9d40de tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:42.173824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6c1b5e0e-0fac-458d-a4e0-373bbb9d40de tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:42.214310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c1b5e0e-0fac-458d-a4e0-373bbb9d40de tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:42.219319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c1b5e0e-0fac-458d-a4e0-373bbb9d40de tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:42.222624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c1b5e0e-0fac-458d-a4e0-373bbb9d40de tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:42.226956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c1b5e0e-0fac-458d-a4e0-373bbb9d40de tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:42.229834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c1b5e0e-0fac-458d-a4e0-373bbb9d40de tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:42.233688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c1b5e0e-0fac-458d-a4e0-373bbb9d40de tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:42.911203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-08f09603-018d-4448-b245-dc032c1057e8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:42.916642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-08f09603-018d-4448-b245-dc032c1057e8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:42.948758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f09603-018d-4448-b245-dc032c1057e8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:42.951092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f09603-018d-4448-b245-dc032c1057e8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:42.954564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f09603-018d-4448-b245-dc032c1057e8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:42.955949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f09603-018d-4448-b245-dc032c1057e8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:42.962281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f09603-018d-4448-b245-dc032c1057e8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:42.963237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f09603-018d-4448-b245-dc032c1057e8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:43.359227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6c1b5e0e-0fac-458d-a4e0-373bbb9d40de tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:43.402236 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6c1b5e0e-0fac-458d-a4e0-373bbb9d40de tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 1.232237 Aug 25 13:00:43.404311 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1360/2709] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:42 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:43.447583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-78dceb18-f16a-42ee-a064-aaff1e317099 req-fd4a3299-b912-4203-ba17-67a851e6afa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0968b644-3ae3-49e9-b773-8dd7239de78c", "name": "network-vif-plugged", "status": "completed", "tag": "37837bff-1f9f-414a-8702-39d8aedc4015"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:43.487022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:43.539320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-78dceb18-f16a-42ee-a064-aaff1e317099 req-fd4a3299-b912-4203-ba17-67a851e6afa1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:43.543144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-78dceb18-f16a-42ee-a064-aaff1e317099 req-fd4a3299-b912-4203-ba17-67a851e6afa1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:43.564167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-78dceb18-f16a-42ee-a064-aaff1e317099 req-fd4a3299-b912-4203-ba17-67a851e6afa1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:43.635756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-08f09603-018d-4448-b245-dc032c1057e8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:43.646817 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-78dceb18-f16a-42ee-a064-aaff1e317099 req-fd4a3299-b912-4203-ba17-67a851e6afa1 service nova] Creating event network-vif-plugged:37837bff-1f9f-414a-8702-39d8aedc4015 for instance 0968b644-3ae3-49e9-b773-8dd7239de78c on n-h2-852771-8 Aug 25 13:00:43.667705 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-78dceb18-f16a-42ee-a064-aaff1e317099 req-fd4a3299-b912-4203-ba17-67a851e6afa1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260627 Aug 25 13:00:43.680513 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1361/2710] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:43.717429 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-08f09603-018d-4448-b245-dc032c1057e8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1501 microversion: 2.1 time: 0.813788 Aug 25 13:00:43.725431 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1350/2711] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:42 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1501 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:43.775858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-532b309a-ff3b-472b-85ba-ef6221005814 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:43.781296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-532b309a-ff3b-472b-85ba-ef6221005814 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:43.813032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-532b309a-ff3b-472b-85ba-ef6221005814 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:43.816823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-532b309a-ff3b-472b-85ba-ef6221005814 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:43.822461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-532b309a-ff3b-472b-85ba-ef6221005814 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:43.838953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-532b309a-ff3b-472b-85ba-ef6221005814 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:43.839485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-532b309a-ff3b-472b-85ba-ef6221005814 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:43.840032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-532b309a-ff3b-472b-85ba-ef6221005814 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:43.958565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-532b309a-ff3b-472b-85ba-ef6221005814 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lazy-loading 'flavor' on Instance uuid 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:00:44.462633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-030b853f-25a9-4aec-916e-85c30f36f77c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:44.463869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-030b853f-25a9-4aec-916e-85c30f36f77c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:44.511739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-030b853f-25a9-4aec-916e-85c30f36f77c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:44.512781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-030b853f-25a9-4aec-916e-85c30f36f77c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:44.513900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-030b853f-25a9-4aec-916e-85c30f36f77c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:44.514949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-030b853f-25a9-4aec-916e-85c30f36f77c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:44.515812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-030b853f-25a9-4aec-916e-85c30f36f77c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:44.516716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-030b853f-25a9-4aec-916e-85c30f36f77c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:44.713292 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-532b309a-ff3b-472b-85ba-ef6221005814 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec/action" status: 202 len: 0 microversion: 2.1 time: 0.947284 Aug 25 13:00:44.717423 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1362/2712] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:00:43 2022] POST /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec/action => generated 0 bytes in 955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:00:44.760745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3355979-bef3-4c61-8ee4-376ac5b3228c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:44.770395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c3355979-bef3-4c61-8ee4-376ac5b3228c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:44.829680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3355979-bef3-4c61-8ee4-376ac5b3228c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:44.844926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3355979-bef3-4c61-8ee4-376ac5b3228c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:44.850819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3355979-bef3-4c61-8ee4-376ac5b3228c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:44.866976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3355979-bef3-4c61-8ee4-376ac5b3228c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:44.867955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3355979-bef3-4c61-8ee4-376ac5b3228c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:44.868775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3355979-bef3-4c61-8ee4-376ac5b3228c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:45.383811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-030b853f-25a9-4aec-916e-85c30f36f77c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:45.408506 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-030b853f-25a9-4aec-916e-85c30f36f77c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1319 microversion: 2.1 time: 0.960591 Aug 25 13:00:45.417970 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1351/2713] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:44 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1319 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:45.613792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c3355979-bef3-4c61-8ee4-376ac5b3228c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:45.639095 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3355979-bef3-4c61-8ee4-376ac5b3228c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1507 microversion: 2.1 time: 0.908884 Aug 25 13:00:45.666209 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1363/2714] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:44 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1507 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:46.459068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b096b736-96dd-421d-8867-15679530a69f tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:46.462643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b096b736-96dd-421d-8867-15679530a69f tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:46.479106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b096b736-96dd-421d-8867-15679530a69f tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:46.481096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b096b736-96dd-421d-8867-15679530a69f tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:46.482296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b096b736-96dd-421d-8867-15679530a69f tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:46.485346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b096b736-96dd-421d-8867-15679530a69f tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:46.487072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b096b736-96dd-421d-8867-15679530a69f tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:46.488554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b096b736-96dd-421d-8867-15679530a69f tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:46.675548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:46.689338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bbac01d4-7f31-47ff-a7f0-95a805e680a3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:46.700428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bbac01d4-7f31-47ff-a7f0-95a805e680a3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:46.721991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbac01d4-7f31-47ff-a7f0-95a805e680a3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:46.728211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbac01d4-7f31-47ff-a7f0-95a805e680a3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:46.729466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbac01d4-7f31-47ff-a7f0-95a805e680a3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:46.731181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbac01d4-7f31-47ff-a7f0-95a805e680a3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:46.734815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbac01d4-7f31-47ff-a7f0-95a805e680a3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:46.741018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbac01d4-7f31-47ff-a7f0-95a805e680a3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:47.018966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b096b736-96dd-421d-8867-15679530a69f tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:47.042626 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b096b736-96dd-421d-8867-15679530a69f tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 200 len: 1508 microversion: 2.1 time: 0.592389 Aug 25 13:00:47.048901 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1352/2715] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:46 2022] GET /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 1508 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:47.092789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1900e6d4-fa5e-4b7d-9b45-72f9974184f7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:47.094627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1900e6d4-fa5e-4b7d-9b45-72f9974184f7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: a33c88e9-940f-41be-9de2-4eb9dc3ec851] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:47.109935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1900e6d4-fa5e-4b7d-9b45-72f9974184f7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:47.111261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1900e6d4-fa5e-4b7d-9b45-72f9974184f7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:47.112882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1900e6d4-fa5e-4b7d-9b45-72f9974184f7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:47.115301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1900e6d4-fa5e-4b7d-9b45-72f9974184f7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:47.117259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1900e6d4-fa5e-4b7d-9b45-72f9974184f7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:47.118882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1900e6d4-fa5e-4b7d-9b45-72f9974184f7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:47.224162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bbac01d4-7f31-47ff-a7f0-95a805e680a3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:47.276084 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bbac01d4-7f31-47ff-a7f0-95a805e680a3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1507 microversion: 2.1 time: 0.596107 Aug 25 13:00:47.277755 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1364/2716] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:46 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1507 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:47.595523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1900e6d4-fa5e-4b7d-9b45-72f9974184f7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:47.611609 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1900e6d4-fa5e-4b7d-9b45-72f9974184f7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/a33c88e9-940f-41be-9de2-4eb9dc3ec851" status: 200 len: 1508 microversion: 2.1 time: 0.528327 Aug 25 13:00:47.616023 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1353/2717] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:47 2022] GET /compute/v2.1/servers/a33c88e9-940f-41be-9de2-4eb9dc3ec851 => generated 1508 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:47.685401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec6cf894-278b-47f9-925e-c32aa0ed7962 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:47.686691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec6cf894-278b-47f9-925e-c32aa0ed7962 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: a33c88e9-940f-41be-9de2-4eb9dc3ec851] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:47.713647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec6cf894-278b-47f9-925e-c32aa0ed7962 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:47.720141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec6cf894-278b-47f9-925e-c32aa0ed7962 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:47.722568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec6cf894-278b-47f9-925e-c32aa0ed7962 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:47.725527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec6cf894-278b-47f9-925e-c32aa0ed7962 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:47.726520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec6cf894-278b-47f9-925e-c32aa0ed7962 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:47.729337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec6cf894-278b-47f9-925e-c32aa0ed7962 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:47.811620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec6cf894-278b-47f9-925e-c32aa0ed7962 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: a33c88e9-940f-41be-9de2-4eb9dc3ec851] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:00:48.040035 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ec6cf894-278b-47f9-925e-c32aa0ed7962 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a33c88e9-940f-41be-9de2-4eb9dc3ec851" status: 204 len: 0 microversion: 2.1 time: 0.373587 Aug 25 13:00:48.047822 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1365/2718] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:47 2022] DELETE /compute/v2.1/servers/a33c88e9-940f-41be-9de2-4eb9dc3ec851 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:48.061885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a24c067-5014-41bd-9e85-989bcafd745b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:48.064090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a24c067-5014-41bd-9e85-989bcafd745b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:48.081102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a24c067-5014-41bd-9e85-989bcafd745b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:48.082689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a24c067-5014-41bd-9e85-989bcafd745b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:48.086303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a24c067-5014-41bd-9e85-989bcafd745b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:48.091008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a24c067-5014-41bd-9e85-989bcafd745b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:48.092278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a24c067-5014-41bd-9e85-989bcafd745b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:48.093175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a24c067-5014-41bd-9e85-989bcafd745b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:48.156486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a24c067-5014-41bd-9e85-989bcafd745b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 0968b644-3ae3-49e9-b773-8dd7239de78c] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:00:48.328740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6f2b99e8-ec90-4954-af0c-7434845d85e0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:48.333358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6f2b99e8-ec90-4954-af0c-7434845d85e0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:48.369432 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a24c067-5014-41bd-9e85-989bcafd745b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c" status: 204 len: 0 microversion: 2.1 time: 0.318921 Aug 25 13:00:48.374807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2b99e8-ec90-4954-af0c-7434845d85e0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:48.376141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2b99e8-ec90-4954-af0c-7434845d85e0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:48.376379 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1354/2719] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:48 2022] DELETE /compute/v2.1/servers/0968b644-3ae3-49e9-b773-8dd7239de78c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:48.376598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2b99e8-ec90-4954-af0c-7434845d85e0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:48.378297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2b99e8-ec90-4954-af0c-7434845d85e0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:48.389264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2b99e8-ec90-4954-af0c-7434845d85e0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:48.389264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2b99e8-ec90-4954-af0c-7434845d85e0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:48.763844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6f2b99e8-ec90-4954-af0c-7434845d85e0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:48.786612 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6f2b99e8-ec90-4954-af0c-7434845d85e0 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1507 microversion: 2.1 time: 0.471778 Aug 25 13:00:48.802865 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1366/2720] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:48 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:49.186434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-836404535", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "20be0b40-1f9e-40a4-bab4-26e31f5f7f6c"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:49.336163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] validate_networks() for [('20be0b40-1f9e-40a4-bab4-26e31f5f7f6c', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:00:49.533766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=28 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:49.907116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3b35f5de-b7e2-4862-8918-6c9dc4f7320a tempest-QuotaClassesAdminTestJSON-963043280 tempest-QuotaClassesAdminTestJSON-963043280-project-admin] Calling method '.version_select at 0x7f3a2e95cca0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:49.978923 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3b35f5de-b7e2-4862-8918-6c9dc4f7320a tempest-QuotaClassesAdminTestJSON-963043280 tempest-QuotaClassesAdminTestJSON-963043280-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 1.252811 Aug 25 13:00:49.980074 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1355/2721] 10.222.0.70 () {58 vars in 1185 bytes} [Thu Aug 25 13:00:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:50.009112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b05791f4-ef7d-4d89-bd96-ff49746fa4e2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:50.010918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b05791f4-ef7d-4d89-bd96-ff49746fa4e2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:50.024088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b05791f4-ef7d-4d89-bd96-ff49746fa4e2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:50.025791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b05791f4-ef7d-4d89-bd96-ff49746fa4e2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:50.027015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b05791f4-ef7d-4d89-bd96-ff49746fa4e2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:50.028572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b05791f4-ef7d-4d89-bd96-ff49746fa4e2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:50.030024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b05791f4-ef7d-4d89-bd96-ff49746fa4e2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:50.031383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b05791f4-ef7d-4d89-bd96-ff49746fa4e2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:50.537287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:00:50.537287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:00:50.537287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:00:50.541244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:00:50.541244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:00:50.560282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b05791f4-ef7d-4d89-bd96-ff49746fa4e2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:50.585854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:50.588546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:50.589802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:50.592439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:50.592995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:50.602191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:50.644844 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b05791f4-ef7d-4d89-bd96-ff49746fa4e2 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1507 microversion: 2.1 time: 0.657333 Aug 25 13:00:50.670778 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1356/2722] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:49 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1507 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:50.702692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3bfde238-5e14-4966-b50e-de949f24efaf tempest-QuotaClassesAdminTestJSON-963043280 tempest-QuotaClassesAdminTestJSON-963043280-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2e831a60>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:50.705526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Getting quotas for project 1d432cdb3bfe4c078b18f66a2fe8e23e. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:50.732189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Getting quotas for user 92c08951ee044049ace7c7f8c92283f9 and project 1d432cdb3bfe4c078b18f66a2fe8e23e. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:50.763709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Going to run 2 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:00:50.773322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 4340a9e5-42e7-4871-8e95-d6bca86fc303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:00:50.901500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=4340a9e5-42e7-4871-8e95-d6bca86fc303,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:00:51.223521 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ddf55bc6-bdc3-4394-a596-15b2bcac65e6 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.048476 Aug 25 13:00:51.229602 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1367/2723] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:00:49 2022] POST /compute/v2.1/servers => generated 32 bytes in 2056 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 25 13:00:51.251839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:51.279988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:51.282554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Searching by: {'deleted': False, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:00:51.342414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:51.343843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:51.345123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:51.347159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:51.348768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:51.350140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:51.458396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:00:51.647535 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3bfde238-5e14-4966-b50e-de949f24efaf tempest-QuotaClassesAdminTestJSON-963043280 tempest-QuotaClassesAdminTestJSON-963043280-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.974536 Aug 25 13:00:51.649873 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1357/2724] 10.222.0.70 () {60 vars in 1206 bytes} [Thu Aug 25 13:00:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:51.678225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9a4ac4f8-6b2b-4e87-a62e-a010bde8c6a1 tempest-QuotaClassesAdminTestJSON-963043280 tempest-QuotaClassesAdminTestJSON-963043280-project-admin] Calling method '.version_select at 0x7f3a2e831940>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:51.683009 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8e0fce51-d0de-4216-9a30-5d33cdfd30e3 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.445369 Aug 25 13:00:51.688654 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1368/2725] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 13:00:51 2022] GET /compute/v2.1/servers => generated 1333 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:51.737871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6da67be1-1042-4da9-b37c-3cbc0c5359d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:51.739647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=78,nova_api:UPDATE=13 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:51.742400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6da67be1-1042-4da9-b37c-3cbc0c5359d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:51.768068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da67be1-1042-4da9-b37c-3cbc0c5359d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:51.769781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da67be1-1042-4da9-b37c-3cbc0c5359d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:51.771860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da67be1-1042-4da9-b37c-3cbc0c5359d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:51.781752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da67be1-1042-4da9-b37c-3cbc0c5359d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:51.784093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da67be1-1042-4da9-b37c-3cbc0c5359d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:51.784690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6da67be1-1042-4da9-b37c-3cbc0c5359d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:51.803299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9a4ac4f8-6b2b-4e87-a62e-a010bde8c6a1 tempest-QuotaClassesAdminTestJSON-963043280 tempest-QuotaClassesAdminTestJSON-963043280-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.139885 Aug 25 13:00:51.818007 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1358/2726] 10.222.0.70 () {58 vars in 1185 bytes} [Thu Aug 25 13:00:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:51.842510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d7454898-a8c4-4ef3-9a5e-4a4c7f9e14e0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:51.853372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d7454898-a8c4-4ef3-9a5e-4a4c7f9e14e0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:52.133307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d7454898-a8c4-4ef3-9a5e-4a4c7f9e14e0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:52.160347 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d7454898-a8c4-4ef3-9a5e-4a4c7f9e14e0 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1217 microversion: 2.1 time: 0.333848 Aug 25 13:00:52.175461 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1359/2727] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:51 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1217 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:52.190684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c4d0aed7-a547-45ba-bbca-94b5083a82b5 tempest-QuotaClassesAdminTestJSON-963043280 tempest-QuotaClassesAdminTestJSON-963043280-project-admin] Action: 'update', calling method: .version_select at 0x7f3a2b08f820>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:52.353230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6da67be1-1042-4da9-b37c-3cbc0c5359d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:52.378389 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6da67be1-1042-4da9-b37c-3cbc0c5359d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1507 microversion: 2.1 time: 0.675126 Aug 25 13:00:52.381069 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1369/2728] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:51 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1507 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:52.702243 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c4d0aed7-a547-45ba-bbca-94b5083a82b5 tempest-QuotaClassesAdminTestJSON-963043280 tempest-QuotaClassesAdminTestJSON-963043280-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.535957 Aug 25 13:00:52.703515 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1360/2729] 10.222.0.70 () {60 vars in 1206 bytes} [Thu Aug 25 13:00:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:53.219054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-54d0a8f6-faf6-4767-a057-21f3b275b307 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:53.243549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-54d0a8f6-faf6-4767-a057-21f3b275b307 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:53.430890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e97725c1-b863-4e7b-aa75-b94051ff6aea tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:53.432111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e97725c1-b863-4e7b-aa75-b94051ff6aea tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:53.472497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97725c1-b863-4e7b-aa75-b94051ff6aea tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:53.486121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97725c1-b863-4e7b-aa75-b94051ff6aea tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:53.487000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97725c1-b863-4e7b-aa75-b94051ff6aea tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:53.488321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97725c1-b863-4e7b-aa75-b94051ff6aea tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:53.490853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97725c1-b863-4e7b-aa75-b94051ff6aea tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:53.492330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97725c1-b863-4e7b-aa75-b94051ff6aea tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:53.673298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-54d0a8f6-faf6-4767-a057-21f3b275b307 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:53.737483 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-54d0a8f6-faf6-4767-a057-21f3b275b307 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1217 microversion: 2.1 time: 0.525459 Aug 25 13:00:53.747833 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1370/2730] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:53 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1217 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:54.582342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-06dae5cb-dec3-43a9-aa7c-7c4a48f6ab63 req-2c72d254-982d-43cc-9877-64e17db6fe4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0968b644-3ae3-49e9-b773-8dd7239de78c", "name": "network-vif-unplugged", "status": "completed", "tag": "37837bff-1f9f-414a-8702-39d8aedc4015"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:54.672250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-06dae5cb-dec3-43a9-aa7c-7c4a48f6ab63 req-2c72d254-982d-43cc-9877-64e17db6fe4c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:54.684148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-06dae5cb-dec3-43a9-aa7c-7c4a48f6ab63 req-2c72d254-982d-43cc-9877-64e17db6fe4c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:54.687440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-06dae5cb-dec3-43a9-aa7c-7c4a48f6ab63 req-2c72d254-982d-43cc-9877-64e17db6fe4c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:54.784289 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-06dae5cb-dec3-43a9-aa7c-7c4a48f6ab63 req-2c72d254-982d-43cc-9877-64e17db6fe4c service nova] Creating event network-vif-unplugged:37837bff-1f9f-414a-8702-39d8aedc4015 for instance 0968b644-3ae3-49e9-b773-8dd7239de78c on n-h2-852771-8 Aug 25 13:00:54.809242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-06dae5cb-dec3-43a9-aa7c-7c4a48f6ab63 req-2c72d254-982d-43cc-9877-64e17db6fe4c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.236948 Aug 25 13:00:54.813770 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1371/2731] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:00:54.830006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5676c651-ef08-42e7-b9c4-09cb499f279a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:54.831277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5676c651-ef08-42e7-b9c4-09cb499f279a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:54.964427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e97725c1-b863-4e7b-aa75-b94051ff6aea tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:54.997918 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e97725c1-b863-4e7b-aa75-b94051ff6aea tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1507 microversion: 2.1 time: 1.575524 Aug 25 13:00:55.004404 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1361/2732] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:53 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1507 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:00:55.375308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5676c651-ef08-42e7-b9c4-09cb499f279a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:55.413730 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5676c651-ef08-42e7-b9c4-09cb499f279a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1217 microversion: 2.1 time: 0.595330 Aug 25 13:00:55.426212 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1372/2733] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:54 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1217 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:56.050738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6854c5ac-3e66-4a83-a678-1261553d9469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:56.053115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6854c5ac-3e66-4a83-a678-1261553d9469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:56.075081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6854c5ac-3e66-4a83-a678-1261553d9469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:56.084045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6854c5ac-3e66-4a83-a678-1261553d9469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:56.086942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6854c5ac-3e66-4a83-a678-1261553d9469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:56.090225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6854c5ac-3e66-4a83-a678-1261553d9469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:56.093046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6854c5ac-3e66-4a83-a678-1261553d9469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:56.097346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6854c5ac-3e66-4a83-a678-1261553d9469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:56.464406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d21d56c-f28f-4576-b5c9-1f1fc12a9b55 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:56.465768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9d21d56c-f28f-4576-b5c9-1f1fc12a9b55 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:56.507896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d21d56c-f28f-4576-b5c9-1f1fc12a9b55 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:56.508908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d21d56c-f28f-4576-b5c9-1f1fc12a9b55 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:56.509837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d21d56c-f28f-4576-b5c9-1f1fc12a9b55 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:56.511355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d21d56c-f28f-4576-b5c9-1f1fc12a9b55 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:56.512271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d21d56c-f28f-4576-b5c9-1f1fc12a9b55 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:56.513078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d21d56c-f28f-4576-b5c9-1f1fc12a9b55 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:57.575715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d21d56c-f28f-4576-b5c9-1f1fc12a9b55 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:57.579827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:57.597227 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d21d56c-f28f-4576-b5c9-1f1fc12a9b55 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1269 microversion: 2.1 time: 1.142604 Aug 25 13:00:57.599512 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1373/2734] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:56 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1269 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:58.065056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6854c5ac-3e66-4a83-a678-1261553d9469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:58.131079 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6854c5ac-3e66-4a83-a678-1261553d9469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1507 microversion: 2.1 time: 2.089108 Aug 25 13:00:58.145547 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1362/2735] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:56 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1507 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:58.209566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a177537b-1032-45b5-b47a-3e91b6760879 req-4b98ae95-1a42-450e-afa2-dcde99eccfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33c88e9-940f-41be-9de2-4eb9dc3ec851", "name": "network-vif-deleted", "tag": "35d5ec0b-1b08-47f3-833f-8033d2c71646"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:58.237526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a177537b-1032-45b5-b47a-3e91b6760879 req-4b98ae95-1a42-450e-afa2-dcde99eccfe2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:58.239742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a177537b-1032-45b5-b47a-3e91b6760879 req-4b98ae95-1a42-450e-afa2-dcde99eccfe2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:58.240931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a177537b-1032-45b5-b47a-3e91b6760879 req-4b98ae95-1a42-450e-afa2-dcde99eccfe2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:58.284625 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a177537b-1032-45b5-b47a-3e91b6760879 req-4b98ae95-1a42-450e-afa2-dcde99eccfe2 service nova] Creating event network-vif-deleted:35d5ec0b-1b08-47f3-833f-8033d2c71646 for instance a33c88e9-940f-41be-9de2-4eb9dc3ec851 on n-h2-852771-8 Aug 25 13:00:58.315061 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a177537b-1032-45b5-b47a-3e91b6760879 req-4b98ae95-1a42-450e-afa2-dcde99eccfe2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.712175 Aug 25 13:00:58.321753 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1374/2736] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:58.648621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b71abea-af00-454e-8981-503fcf6b28ae tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:58.649611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b71abea-af00-454e-8981-503fcf6b28ae tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:58.681103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b71abea-af00-454e-8981-503fcf6b28ae tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:58.682485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b71abea-af00-454e-8981-503fcf6b28ae tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:58.683051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b71abea-af00-454e-8981-503fcf6b28ae tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:58.690858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b71abea-af00-454e-8981-503fcf6b28ae tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:58.692775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b71abea-af00-454e-8981-503fcf6b28ae tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:58.696484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b71abea-af00-454e-8981-503fcf6b28ae tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:59.187644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d0c21cc-9637-47e5-8829-5610fe0b4c1d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:59.200498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9d0c21cc-9637-47e5-8829-5610fe0b4c1d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:59.223305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d0c21cc-9637-47e5-8829-5610fe0b4c1d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:59.230911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d0c21cc-9637-47e5-8829-5610fe0b4c1d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:59.232862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d0c21cc-9637-47e5-8829-5610fe0b4c1d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:59.234581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d0c21cc-9637-47e5-8829-5610fe0b4c1d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:59.235856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d0c21cc-9637-47e5-8829-5610fe0b4c1d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:59.238600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b71abea-af00-454e-8981-503fcf6b28ae tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:59.246718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d0c21cc-9637-47e5-8829-5610fe0b4c1d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:59.273236 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b71abea-af00-454e-8981-503fcf6b28ae tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1275 microversion: 2.1 time: 0.629230 Aug 25 13:00:59.276364 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1363/2737] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:58 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1275 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:00.331425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-935ecd63-8884-4fa6-83fa-fe138da4b1ce tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:00.333048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-935ecd63-8884-4fa6-83fa-fe138da4b1ce tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:00.359751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935ecd63-8884-4fa6-83fa-fe138da4b1ce tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:00.370886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935ecd63-8884-4fa6-83fa-fe138da4b1ce tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:00.372256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935ecd63-8884-4fa6-83fa-fe138da4b1ce tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:00.374087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935ecd63-8884-4fa6-83fa-fe138da4b1ce tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:00.375398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935ecd63-8884-4fa6-83fa-fe138da4b1ce tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:00.376978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935ecd63-8884-4fa6-83fa-fe138da4b1ce tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:01.365592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:02.373028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-935ecd63-8884-4fa6-83fa-fe138da4b1ce tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:02.420649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:02.436828 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-935ecd63-8884-4fa6-83fa-fe138da4b1ce tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1275 microversion: 2.1 time: 2.112145 Aug 25 13:01:02.445356 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1364/2738] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:00 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1275 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:01:02.484060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f0e46c6e-0c89-4216-9000-62c8b3ab6970 req-fad272ce-8656-456b-879c-51f9e2af5c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0968b644-3ae3-49e9-b773-8dd7239de78c", "name": "network-vif-deleted", "tag": "37837bff-1f9f-414a-8702-39d8aedc4015"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:02.527658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f0e46c6e-0c89-4216-9000-62c8b3ab6970 req-fad272ce-8656-456b-879c-51f9e2af5c82 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:02.535213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f0e46c6e-0c89-4216-9000-62c8b3ab6970 req-fad272ce-8656-456b-879c-51f9e2af5c82 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:02.536059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f0e46c6e-0c89-4216-9000-62c8b3ab6970 req-fad272ce-8656-456b-879c-51f9e2af5c82 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:02.586445 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f0e46c6e-0c89-4216-9000-62c8b3ab6970 req-fad272ce-8656-456b-879c-51f9e2af5c82 service nova] Creating event network-vif-deleted:37837bff-1f9f-414a-8702-39d8aedc4015 for instance 0968b644-3ae3-49e9-b773-8dd7239de78c on n-h2-852771-8 Aug 25 13:01:02.609084 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f0e46c6e-0c89-4216-9000-62c8b3ab6970 req-fad272ce-8656-456b-879c-51f9e2af5c82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160617 Aug 25 13:01:02.611065 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1365/2739] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:03.303242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d0c21cc-9637-47e5-8829-5610fe0b4c1d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:03.337742 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d0c21cc-9637-47e5-8829-5610fe0b4c1d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1507 microversion: 2.1 time: 4.159233 Aug 25 13:01:03.338921 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1375/2740] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:59 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1507 bytes in 4162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:03.491968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a51fcc80-daf8-4e1d-8a46-d5d654c117ca tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:03.507036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a51fcc80-daf8-4e1d-8a46-d5d654c117ca tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:03.517539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=31,nova_cell0:UPDATE=7 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:03.562107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a51fcc80-daf8-4e1d-8a46-d5d654c117ca tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:03.563035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a51fcc80-daf8-4e1d-8a46-d5d654c117ca tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:03.563892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a51fcc80-daf8-4e1d-8a46-d5d654c117ca tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:03.566078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a51fcc80-daf8-4e1d-8a46-d5d654c117ca tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:03.599067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a51fcc80-daf8-4e1d-8a46-d5d654c117ca tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:03.629350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a51fcc80-daf8-4e1d-8a46-d5d654c117ca tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:04.382476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b30ae0e8-9f11-47ba-bc6b-fa0b62e95469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:04.383901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b30ae0e8-9f11-47ba-bc6b-fa0b62e95469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:04.449931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30ae0e8-9f11-47ba-bc6b-fa0b62e95469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:04.452832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30ae0e8-9f11-47ba-bc6b-fa0b62e95469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:04.493604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30ae0e8-9f11-47ba-bc6b-fa0b62e95469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:04.499352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30ae0e8-9f11-47ba-bc6b-fa0b62e95469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:04.504287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30ae0e8-9f11-47ba-bc6b-fa0b62e95469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:04.509465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30ae0e8-9f11-47ba-bc6b-fa0b62e95469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:05.388834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:07.384356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a51fcc80-daf8-4e1d-8a46-d5d654c117ca tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:07.405041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b30ae0e8-9f11-47ba-bc6b-fa0b62e95469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:07.448486 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b30ae0e8-9f11-47ba-bc6b-fa0b62e95469 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1507 microversion: 2.1 time: 3.073298 Aug 25 13:01:07.450772 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1376/2741] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:04 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1507 bytes in 3078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:07.457726 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a51fcc80-daf8-4e1d-8a46-d5d654c117ca tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1317 microversion: 2.1 time: 3.974796 Aug 25 13:01:07.459555 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1366/2742] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:03 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1317 bytes in 3979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:01:08.499363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ee9c493d-4ca3-40ff-963a-7e5f1398d07b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:08.513996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ee9c493d-4ca3-40ff-963a-7e5f1398d07b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:08.522176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59f4e213-d703-4898-bcbd-784285645630 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:08.524566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59f4e213-d703-4898-bcbd-784285645630 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:08.551781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee9c493d-4ca3-40ff-963a-7e5f1398d07b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.553391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee9c493d-4ca3-40ff-963a-7e5f1398d07b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.558025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee9c493d-4ca3-40ff-963a-7e5f1398d07b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.559950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee9c493d-4ca3-40ff-963a-7e5f1398d07b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.565454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee9c493d-4ca3-40ff-963a-7e5f1398d07b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.566751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee9c493d-4ca3-40ff-963a-7e5f1398d07b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.574823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59f4e213-d703-4898-bcbd-784285645630 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.575845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59f4e213-d703-4898-bcbd-784285645630 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.580147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59f4e213-d703-4898-bcbd-784285645630 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.590821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59f4e213-d703-4898-bcbd-784285645630 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.592499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59f4e213-d703-4898-bcbd-784285645630 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.593665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59f4e213-d703-4898-bcbd-784285645630 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:09.389811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-59f4e213-d703-4898-bcbd-784285645630 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:09.456169 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59f4e213-d703-4898-bcbd-784285645630 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1317 microversion: 2.1 time: 0.957709 Aug 25 13:01:09.457633 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1367/2743] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:08 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1317 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:01:10.207213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ee9c493d-4ca3-40ff-963a-7e5f1398d07b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:10.233341 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ee9c493d-4ca3-40ff-963a-7e5f1398d07b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1507 microversion: 2.1 time: 1.741482 Aug 25 13:01:10.242260 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1377/2744] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:08 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1507 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:01:10.509371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d61497a-5505-42bb-8fa4-18ec65eb0a20 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:10.515156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d61497a-5505-42bb-8fa4-18ec65eb0a20 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:10.578022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d61497a-5505-42bb-8fa4-18ec65eb0a20 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:10.581052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d61497a-5505-42bb-8fa4-18ec65eb0a20 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:10.588669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d61497a-5505-42bb-8fa4-18ec65eb0a20 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:10.590264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d61497a-5505-42bb-8fa4-18ec65eb0a20 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:10.591189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d61497a-5505-42bb-8fa4-18ec65eb0a20 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:10.607084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d61497a-5505-42bb-8fa4-18ec65eb0a20 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:11.292804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b41c5f75-d9ea-41ea-824d-106c250b0861 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:11.292804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b41c5f75-d9ea-41ea-824d-106c250b0861 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:11.359466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b41c5f75-d9ea-41ea-824d-106c250b0861 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:11.370339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b41c5f75-d9ea-41ea-824d-106c250b0861 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:11.371396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b41c5f75-d9ea-41ea-824d-106c250b0861 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:11.372581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b41c5f75-d9ea-41ea-824d-106c250b0861 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:11.374859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b41c5f75-d9ea-41ea-824d-106c250b0861 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:11.375583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b41c5f75-d9ea-41ea-824d-106c250b0861 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:12.617109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6d61497a-5505-42bb-8fa4-18ec65eb0a20 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:12.661437 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d61497a-5505-42bb-8fa4-18ec65eb0a20 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1317 microversion: 2.1 time: 2.168242 Aug 25 13:01:12.676085 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1368/2745] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:10 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1317 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:01:13.387300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b41c5f75-d9ea-41ea-824d-106c250b0861 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:13.417888 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b41c5f75-d9ea-41ea-824d-106c250b0861 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1528 microversion: 2.1 time: 2.133264 Aug 25 13:01:13.433748 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1378/2746] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:11 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1528 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:01:13.539600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-24b2674e-ae2a-4311-9562-36ff8066ef68 req-43b90a62-1b98-4c02-9e01-d7ca3a2bb930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcb03cb5-2a02-4234-bb78-f89decec1b51", "tag": "1925067b-170a-4815-af70-0523b6a0fc2f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:13.590145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-24b2674e-ae2a-4311-9562-36ff8066ef68 req-43b90a62-1b98-4c02-9e01-d7ca3a2bb930 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:13.591332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-24b2674e-ae2a-4311-9562-36ff8066ef68 req-43b90a62-1b98-4c02-9e01-d7ca3a2bb930 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:13.592345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-24b2674e-ae2a-4311-9562-36ff8066ef68 req-43b90a62-1b98-4c02-9e01-d7ca3a2bb930 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:13.636524 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-24b2674e-ae2a-4311-9562-36ff8066ef68 req-43b90a62-1b98-4c02-9e01-d7ca3a2bb930 service nova] Creating event network-changed:1925067b-170a-4815-af70-0523b6a0fc2f for instance bcb03cb5-2a02-4234-bb78-f89decec1b51 on n-h2-852771-8 Aug 25 13:01:13.656519 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-24b2674e-ae2a-4311-9562-36ff8066ef68 req-43b90a62-1b98-4c02-9e01-d7ca3a2bb930 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.978416 Aug 25 13:01:13.658495 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1369/2747] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:13.731446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-789b6df5-4f92-4a7b-b51c-92021404322d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:13.736361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-789b6df5-4f92-4a7b-b51c-92021404322d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:13.769559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-789b6df5-4f92-4a7b-b51c-92021404322d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:13.770890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-789b6df5-4f92-4a7b-b51c-92021404322d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:13.771897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-789b6df5-4f92-4a7b-b51c-92021404322d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:13.774644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-789b6df5-4f92-4a7b-b51c-92021404322d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:13.778845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-789b6df5-4f92-4a7b-b51c-92021404322d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:13.780291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-789b6df5-4f92-4a7b-b51c-92021404322d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:14.483240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-39997755-d4cb-47d3-a768-0bbd98fb9fb6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:14.485590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-39997755-d4cb-47d3-a768-0bbd98fb9fb6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:14.518659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39997755-d4cb-47d3-a768-0bbd98fb9fb6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:14.520438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39997755-d4cb-47d3-a768-0bbd98fb9fb6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:14.526134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39997755-d4cb-47d3-a768-0bbd98fb9fb6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:14.528205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39997755-d4cb-47d3-a768-0bbd98fb9fb6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:14.529494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39997755-d4cb-47d3-a768-0bbd98fb9fb6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:14.534779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39997755-d4cb-47d3-a768-0bbd98fb9fb6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:15.736866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-789b6df5-4f92-4a7b-b51c-92021404322d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:15.785630 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-789b6df5-4f92-4a7b-b51c-92021404322d tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1317 microversion: 2.1 time: 2.065032 Aug 25 13:01:15.817253 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1379/2748] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:13 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1317 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:16.730059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-39997755-d4cb-47d3-a768-0bbd98fb9fb6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:16.779082 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-39997755-d4cb-47d3-a768-0bbd98fb9fb6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1528 microversion: 2.1 time: 2.322366 Aug 25 13:01:16.790729 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1370/2749] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:14 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1528 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:01:16.828089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-359c780f-4011-49a4-bd81-90060b4942e7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:16.839793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-359c780f-4011-49a4-bd81-90060b4942e7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:16.874510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-359c780f-4011-49a4-bd81-90060b4942e7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:16.886770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-359c780f-4011-49a4-bd81-90060b4942e7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:16.888655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-359c780f-4011-49a4-bd81-90060b4942e7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:16.890718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-359c780f-4011-49a4-bd81-90060b4942e7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:16.896088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-359c780f-4011-49a4-bd81-90060b4942e7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:16.904129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-359c780f-4011-49a4-bd81-90060b4942e7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:17.232110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1439709534", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:17.278769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:17.436782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:01:20.026230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-359c780f-4011-49a4-bd81-90060b4942e7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:20.096273 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-359c780f-4011-49a4-bd81-90060b4942e7 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1317 microversion: 2.1 time: 3.275352 Aug 25 13:01:20.098039 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1371/2750] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:16 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1317 bytes in 3279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:20.121828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-4f3e0030-401c-4f31-b759-b3ba57d9c0a7 req-cafc09b9-5a97-4cce-8032-8e3935d39ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4340a9e5-42e7-4871-8e95-d6bca86fc303", "tag": "f4f99c2a-8114-4265-8763-e1939912210b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:20.159135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4f3e0030-401c-4f31-b759-b3ba57d9c0a7 req-cafc09b9-5a97-4cce-8032-8e3935d39ee0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:20.161151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4f3e0030-401c-4f31-b759-b3ba57d9c0a7 req-cafc09b9-5a97-4cce-8032-8e3935d39ee0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:20.162665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4f3e0030-401c-4f31-b759-b3ba57d9c0a7 req-cafc09b9-5a97-4cce-8032-8e3935d39ee0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:20.192434 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-4f3e0030-401c-4f31-b759-b3ba57d9c0a7 req-cafc09b9-5a97-4cce-8032-8e3935d39ee0 service nova] Creating event network-changed:f4f99c2a-8114-4265-8763-e1939912210b for instance 4340a9e5-42e7-4871-8e95-d6bca86fc303 on n-h2-852771-8 Aug 25 13:01:20.206278 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-4f3e0030-401c-4f31-b759-b3ba57d9c0a7 req-cafc09b9-5a97-4cce-8032-8e3935d39ee0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101523 Aug 25 13:01:20.208434 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1372/2751] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:20.219985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a958928a-11ae-4ecf-87c3-c71aeeb171ab tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:20.222901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a958928a-11ae-4ecf-87c3-c71aeeb171ab tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:20.236963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a958928a-11ae-4ecf-87c3-c71aeeb171ab tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:20.238614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a958928a-11ae-4ecf-87c3-c71aeeb171ab tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:20.239996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a958928a-11ae-4ecf-87c3-c71aeeb171ab tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:20.242472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a958928a-11ae-4ecf-87c3-c71aeeb171ab tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:20.243876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a958928a-11ae-4ecf-87c3-c71aeeb171ab tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:20.245122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a958928a-11ae-4ecf-87c3-c71aeeb171ab tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:20.621218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:01:20.622849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:01:20.627059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:01:20.630237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:01:20.637714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:01:20.710175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:20.711110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:20.712017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:20.713279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:20.728765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:20.730270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:20.832730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:01:20.868589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:01:20.939063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:01:20.948107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:01:21.249366 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5366ddb0-3d78-4996-bc6d-d6d5ee36ffd2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.695312 Aug 25 13:01:21.253855 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1380/2752] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:01:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:01:21.279800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-79c0a650-8e48-450d-816f-27ce6604762c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:21.283725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-79c0a650-8e48-450d-816f-27ce6604762c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:21.331245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79c0a650-8e48-450d-816f-27ce6604762c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:21.339090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79c0a650-8e48-450d-816f-27ce6604762c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:21.346746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79c0a650-8e48-450d-816f-27ce6604762c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:21.355535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79c0a650-8e48-450d-816f-27ce6604762c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:21.362346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79c0a650-8e48-450d-816f-27ce6604762c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:21.373126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79c0a650-8e48-450d-816f-27ce6604762c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:25.425874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a958928a-11ae-4ecf-87c3-c71aeeb171ab tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:25.519190 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a958928a-11ae-4ecf-87c3-c71aeeb171ab tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 5.307170 Aug 25 13:01:25.565013 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1373/2753] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:20 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 5346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:25.618307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1fa45151-2790-4b84-adc9-9194f64e3ad3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:25.627886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1fa45151-2790-4b84-adc9-9194f64e3ad3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:25.658168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=12 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:25.676853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa45151-2790-4b84-adc9-9194f64e3ad3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:25.679061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa45151-2790-4b84-adc9-9194f64e3ad3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:25.680288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa45151-2790-4b84-adc9-9194f64e3ad3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:25.698104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa45151-2790-4b84-adc9-9194f64e3ad3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:25.703415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa45151-2790-4b84-adc9-9194f64e3ad3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:25.707883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1fa45151-2790-4b84-adc9-9194f64e3ad3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:26.206230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-79c0a650-8e48-450d-816f-27ce6604762c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:26.238389 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-79c0a650-8e48-450d-816f-27ce6604762c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1317 microversion: 2.1 time: 4.978854 Aug 25 13:01:26.251119 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1381/2754] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:21 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1317 bytes in 4997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:26.271915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c67a5372-4eb7-4d78-bd7b-548fc563db5a req-3f8cd68c-c9c5-4c08-ac17-bbd156c80f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e64e778-70de-4c3e-9c61-f2c8bec2d5ec", "name": "network-vif-plugged", "status": "completed", "tag": "8f2e03c2-5abc-4f32-8f18-4699fec26d8d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:26.308334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c67a5372-4eb7-4d78-bd7b-548fc563db5a req-3f8cd68c-c9c5-4c08-ac17-bbd156c80f6c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:26.309070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c67a5372-4eb7-4d78-bd7b-548fc563db5a req-3f8cd68c-c9c5-4c08-ac17-bbd156c80f6c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:26.309963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c67a5372-4eb7-4d78-bd7b-548fc563db5a req-3f8cd68c-c9c5-4c08-ac17-bbd156c80f6c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:26.361919 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c67a5372-4eb7-4d78-bd7b-548fc563db5a req-3f8cd68c-c9c5-4c08-ac17-bbd156c80f6c service nova] Creating event network-vif-plugged:8f2e03c2-5abc-4f32-8f18-4699fec26d8d for instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec on n-h2-852771-8 Aug 25 13:01:26.383987 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c67a5372-4eb7-4d78-bd7b-548fc563db5a req-3f8cd68c-c9c5-4c08-ac17-bbd156c80f6c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129350 Aug 25 13:01:26.386592 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1382/2755] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:26.581997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f6a5993-e7d7-41cc-bb59-21f35a0c07c4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:26.584426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f6a5993-e7d7-41cc-bb59-21f35a0c07c4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:26.652923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6a5993-e7d7-41cc-bb59-21f35a0c07c4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:26.662397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6a5993-e7d7-41cc-bb59-21f35a0c07c4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:26.664000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6a5993-e7d7-41cc-bb59-21f35a0c07c4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:26.666278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6a5993-e7d7-41cc-bb59-21f35a0c07c4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:26.667718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6a5993-e7d7-41cc-bb59-21f35a0c07c4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:26.684380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f6a5993-e7d7-41cc-bb59-21f35a0c07c4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:27.230049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1fa45151-2790-4b84-adc9-9194f64e3ad3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:27.279733 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1fa45151-2790-4b84-adc9-9194f64e3ad3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1277 microversion: 2.1 time: 1.702555 Aug 25 13:01:27.282144 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1374/2756] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:25 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1277 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:27.344327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5824e93c-2e35-41c6-a4fd-f1153c243f15 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:27.347103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5824e93c-2e35-41c6-a4fd-f1153c243f15 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:27.372300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5824e93c-2e35-41c6-a4fd-f1153c243f15 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:27.390840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5824e93c-2e35-41c6-a4fd-f1153c243f15 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:27.393263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5824e93c-2e35-41c6-a4fd-f1153c243f15 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:27.402625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5824e93c-2e35-41c6-a4fd-f1153c243f15 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:27.410942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5824e93c-2e35-41c6-a4fd-f1153c243f15 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:27.412217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5824e93c-2e35-41c6-a4fd-f1153c243f15 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:29.701342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2f6a5993-e7d7-41cc-bb59-21f35a0c07c4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:29.767191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=48 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:29.790692 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f6a5993-e7d7-41cc-bb59-21f35a0c07c4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 3.225497 Aug 25 13:01:29.799833 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1383/2757] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:26 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 3236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:29.829648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ae92ddb-dde9-4f32-8928-b32bafa8587d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:29.840126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8ae92ddb-dde9-4f32-8928-b32bafa8587d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:29.889757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae92ddb-dde9-4f32-8928-b32bafa8587d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:29.910744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae92ddb-dde9-4f32-8928-b32bafa8587d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:29.913962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae92ddb-dde9-4f32-8928-b32bafa8587d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:29.919379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae92ddb-dde9-4f32-8928-b32bafa8587d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:29.920704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae92ddb-dde9-4f32-8928-b32bafa8587d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:29.930878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ae92ddb-dde9-4f32-8928-b32bafa8587d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:29.950432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5824e93c-2e35-41c6-a4fd-f1153c243f15 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:30.001167 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5824e93c-2e35-41c6-a4fd-f1153c243f15 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1317 microversion: 2.1 time: 2.704371 Aug 25 13:01:30.002676 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1375/2758] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:27 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1317 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:30.533876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8ae92ddb-dde9-4f32-8928-b32bafa8587d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:30.597046 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8ae92ddb-dde9-4f32-8928-b32bafa8587d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1275 microversion: 2.1 time: 0.795013 Aug 25 13:01:30.605959 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1384/2759] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:29 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1275 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:30.841391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-49a14d8f-60fc-4bee-88d7-8aad50466e25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:30.845101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-49a14d8f-60fc-4bee-88d7-8aad50466e25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:30.875041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a14d8f-60fc-4bee-88d7-8aad50466e25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:30.878042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a14d8f-60fc-4bee-88d7-8aad50466e25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:30.882211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a14d8f-60fc-4bee-88d7-8aad50466e25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:30.884174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a14d8f-60fc-4bee-88d7-8aad50466e25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:30.888115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a14d8f-60fc-4bee-88d7-8aad50466e25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:30.890773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a14d8f-60fc-4bee-88d7-8aad50466e25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:30.961549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0917f683-2915-46f1-9fdf-9587b5f4a717 req-f7516484-d13b-49e8-9219-1526ec76a10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb03cb5-2a02-4234-bb78-f89decec1b51", "name": "network-vif-plugged", "status": "completed", "tag": "1925067b-170a-4815-af70-0523b6a0fc2f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:31.020562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:31.021544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:31.056910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0917f683-2915-46f1-9fdf-9587b5f4a717 req-f7516484-d13b-49e8-9219-1526ec76a10e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:31.057822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0917f683-2915-46f1-9fdf-9587b5f4a717 req-f7516484-d13b-49e8-9219-1526ec76a10e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:31.058575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0917f683-2915-46f1-9fdf-9587b5f4a717 req-f7516484-d13b-49e8-9219-1526ec76a10e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:31.179276 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0917f683-2915-46f1-9fdf-9587b5f4a717 req-f7516484-d13b-49e8-9219-1526ec76a10e service nova] Creating event network-vif-plugged:1925067b-170a-4815-af70-0523b6a0fc2f for instance bcb03cb5-2a02-4234-bb78-f89decec1b51 on n-h2-852771-8 Aug 25 13:01:31.216303 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0917f683-2915-46f1-9fdf-9587b5f4a717 req-f7516484-d13b-49e8-9219-1526ec76a10e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258523 Aug 25 13:01:31.236331 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1385/2760] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:01:31.274882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff8b525f-505b-4543-94cc-d515792a6b12 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:31.276311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff8b525f-505b-4543-94cc-d515792a6b12 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:31.324964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff8b525f-505b-4543-94cc-d515792a6b12 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:31.327446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff8b525f-505b-4543-94cc-d515792a6b12 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:31.330416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff8b525f-505b-4543-94cc-d515792a6b12 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:31.339189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff8b525f-505b-4543-94cc-d515792a6b12 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:31.343068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff8b525f-505b-4543-94cc-d515792a6b12 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:31.344644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff8b525f-505b-4543-94cc-d515792a6b12 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:32.433734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff8b525f-505b-4543-94cc-d515792a6b12 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:32.467668 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff8b525f-505b-4543-94cc-d515792a6b12 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1317 microversion: 2.1 time: 1.228558 Aug 25 13:01:32.512133 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1386/2761] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:31 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1317 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:32.712210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b39b21d7-828f-4d58-a5c6-ad6ff5dff91d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Action: 'create', calling method: .version_select at 0x7f3a2a541dc0>, body: {"keypair": {"name": "tempest-keypair-711133921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxnWGRCeYQvcH1sVHpY9aQ57tmorEqhH3GX/ZnVK7SMjjjZ0t/zQvSC5f+1Pw9iDvRwroOjuOKZmvXu3K9GJhftIzmrgmPCBK5/OWZuTpspFr1NJnkhlbvmjAzpRM/mAA=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:32.770039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b39b21d7-828f-4d58-a5c6-ad6ff5dff91d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Getting quotas for project b2ef1136a7fb486ca299eaca4181a996. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:01:32.785304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-49a14d8f-60fc-4bee-88d7-8aad50466e25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:32.804017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=60 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:32.810837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b39b21d7-828f-4d58-a5c6-ad6ff5dff91d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Getting quotas for user 7a30a7e80c424ee8b24224f161c1cce8 and project b2ef1136a7fb486ca299eaca4181a996. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:01:32.826672 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-49a14d8f-60fc-4bee-88d7-8aad50466e25 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 1.993077 Aug 25 13:01:32.837909 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1376/2762] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:30 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:32.885312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-75dd4b24-ba05-4aae-8a96-6f913cd44076 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:32.889305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-75dd4b24-ba05-4aae-8a96-6f913cd44076 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:32.951548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75dd4b24-ba05-4aae-8a96-6f913cd44076 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:32.952780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75dd4b24-ba05-4aae-8a96-6f913cd44076 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:32.956322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75dd4b24-ba05-4aae-8a96-6f913cd44076 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:32.962102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75dd4b24-ba05-4aae-8a96-6f913cd44076 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:32.963602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75dd4b24-ba05-4aae-8a96-6f913cd44076 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:32.964056 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b39b21d7-828f-4d58-a5c6-ad6ff5dff91d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.447320 Aug 25 13:01:32.966004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75dd4b24-ba05-4aae-8a96-6f913cd44076 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:32.968804 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1387/2763] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:01:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:33.515320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff04e31e-7e2f-4c35-8936-e4444adc5e21 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:33.519160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff04e31e-7e2f-4c35-8936-e4444adc5e21 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:33.562798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff04e31e-7e2f-4c35-8936-e4444adc5e21 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:33.564303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff04e31e-7e2f-4c35-8936-e4444adc5e21 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:33.566159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff04e31e-7e2f-4c35-8936-e4444adc5e21 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:33.570196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff04e31e-7e2f-4c35-8936-e4444adc5e21 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:33.571599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff04e31e-7e2f-4c35-8936-e4444adc5e21 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:33.572824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff04e31e-7e2f-4c35-8936-e4444adc5e21 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:33.706670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-75dd4b24-ba05-4aae-8a96-6f913cd44076 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:33.753601 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-75dd4b24-ba05-4aae-8a96-6f913cd44076 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1317 microversion: 2.1 time: 0.912933 Aug 25 13:01:33.774543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1377/2764] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:32 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1317 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:33.864904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7f5225f9-3b66-41d0-869d-351b9e45adf9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:33.867814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7f5225f9-3b66-41d0-869d-351b9e45adf9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:33.890493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f5225f9-3b66-41d0-869d-351b9e45adf9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:33.891372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f5225f9-3b66-41d0-869d-351b9e45adf9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:33.896748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f5225f9-3b66-41d0-869d-351b9e45adf9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:33.915534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f5225f9-3b66-41d0-869d-351b9e45adf9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:33.922234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f5225f9-3b66-41d0-869d-351b9e45adf9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:33.923193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f5225f9-3b66-41d0-869d-351b9e45adf9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:34.563963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff04e31e-7e2f-4c35-8936-e4444adc5e21 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:34.593803 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff04e31e-7e2f-4c35-8936-e4444adc5e21 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1317 microversion: 2.1 time: 1.087637 Aug 25 13:01:34.629279 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1388/2765] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:33 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1317 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:34.808879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7823326f-9dce-4a17-a905-53f6b81479f0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:34.809978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7823326f-9dce-4a17-a905-53f6b81479f0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:34.840045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7823326f-9dce-4a17-a905-53f6b81479f0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:34.850567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7823326f-9dce-4a17-a905-53f6b81479f0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:34.851439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7823326f-9dce-4a17-a905-53f6b81479f0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:34.852936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7823326f-9dce-4a17-a905-53f6b81479f0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:34.853850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7823326f-9dce-4a17-a905-53f6b81479f0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:34.868032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7823326f-9dce-4a17-a905-53f6b81479f0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:36.497556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7f5225f9-3b66-41d0-869d-351b9e45adf9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:36.529135 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7f5225f9-3b66-41d0-869d-351b9e45adf9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 2.671369 Aug 25 13:01:36.532604 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1378/2766] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:33 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 2678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:36.553147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d05af117-aad6-4692-890d-e9987ae2023a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:36.555657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d05af117-aad6-4692-890d-e9987ae2023a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:36.580087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05af117-aad6-4692-890d-e9987ae2023a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:36.581750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05af117-aad6-4692-890d-e9987ae2023a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:36.583048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05af117-aad6-4692-890d-e9987ae2023a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:36.585409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05af117-aad6-4692-890d-e9987ae2023a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:36.587929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05af117-aad6-4692-890d-e9987ae2023a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:36.589368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05af117-aad6-4692-890d-e9987ae2023a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:37.326126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7823326f-9dce-4a17-a905-53f6b81479f0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:37.379111 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7823326f-9dce-4a17-a905-53f6b81479f0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1317 microversion: 2.1 time: 2.578123 Aug 25 13:01:37.385154 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1389/2767] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:34 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1317 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:01:37.728151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ac5880d-8337-4101-941e-17ebc5790f48 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Action: 'create', calling method: .version_select at 0x7f3a29baadc0>, body: {"keypair": {"name": "tempest-keypair-199103592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUbKN75ny/tGMFkE27wYBRpBOvgdNYjLvIFMbKTFJNAxmuzBxVloaGyrp6R0yDDsdGiQz5Q45rxQQAQgugTVUiBnUJdp7+3LZvktg9y7xPONVAcVPNl4sOUtI0JYP3M8Q=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:37.925646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7ac5880d-8337-4101-941e-17ebc5790f48 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Getting quotas for project 9d299d545c86446392d864f9689e0208. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:01:37.973996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7ac5880d-8337-4101-941e-17ebc5790f48 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Getting quotas for user 2bb2beca1cfb4b31b0e0080b39d12497 and project 9d299d545c86446392d864f9689e0208. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:01:38.099808 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ac5880d-8337-4101-941e-17ebc5790f48 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.712024 Aug 25 13:01:38.106628 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1390/2768] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:01:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:38.130783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0ae9629d-0a02-421f-ab74-572eaf653acf req-81b5ebec-b186-486a-b505-2d2f85edd782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c46524-70ff-4c0a-9fce-afaacf9d2ba5", "tag": "b79d7cd8-5914-4ce2-9c72-b63b5435b25c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:38.178119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0ae9629d-0a02-421f-ab74-572eaf653acf req-81b5ebec-b186-486a-b505-2d2f85edd782 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:38.182582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0ae9629d-0a02-421f-ab74-572eaf653acf req-81b5ebec-b186-486a-b505-2d2f85edd782 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:38.183498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0ae9629d-0a02-421f-ab74-572eaf653acf req-81b5ebec-b186-486a-b505-2d2f85edd782 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:38.245454 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0ae9629d-0a02-421f-ab74-572eaf653acf req-81b5ebec-b186-486a-b505-2d2f85edd782 service nova] Creating event network-changed:b79d7cd8-5914-4ce2-9c72-b63b5435b25c for instance 34c46524-70ff-4c0a-9fce-afaacf9d2ba5 on n-h2-852771-8 Aug 25 13:01:38.270023 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0ae9629d-0a02-421f-ab74-572eaf653acf req-81b5ebec-b186-486a-b505-2d2f85edd782 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156646 Aug 25 13:01:38.280156 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1391/2769] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:38.297324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-39e4a0f9-cb23-42e8-bf28-c4d9df4ff337 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:38.311923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-39e4a0f9-cb23-42e8-bf28-c4d9df4ff337 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:38.332840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39e4a0f9-cb23-42e8-bf28-c4d9df4ff337 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:38.342372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39e4a0f9-cb23-42e8-bf28-c4d9df4ff337 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:38.344038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39e4a0f9-cb23-42e8-bf28-c4d9df4ff337 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:38.347697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39e4a0f9-cb23-42e8-bf28-c4d9df4ff337 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:38.349250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39e4a0f9-cb23-42e8-bf28-c4d9df4ff337 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:38.360036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39e4a0f9-cb23-42e8-bf28-c4d9df4ff337 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:38.884958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d05af117-aad6-4692-890d-e9987ae2023a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:38.953581 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d05af117-aad6-4692-890d-e9987ae2023a tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1506 microversion: 2.1 time: 2.414196 Aug 25 13:01:38.990115 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1379/2770] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:36 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1506 bytes in 2450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:39.014560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e266d25-aefa-4e1a-b7c9-0b67a0126e3b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:39.017311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6e266d25-aefa-4e1a-b7c9-0b67a0126e3b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:39.051489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e266d25-aefa-4e1a-b7c9-0b67a0126e3b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:39.053451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e266d25-aefa-4e1a-b7c9-0b67a0126e3b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:39.056250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e266d25-aefa-4e1a-b7c9-0b67a0126e3b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:39.057921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e266d25-aefa-4e1a-b7c9-0b67a0126e3b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:39.060642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e266d25-aefa-4e1a-b7c9-0b67a0126e3b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:39.062153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e266d25-aefa-4e1a-b7c9-0b67a0126e3b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:40.120349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-39e4a0f9-cb23-42e8-bf28-c4d9df4ff337 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:40.169743 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-39e4a0f9-cb23-42e8-bf28-c4d9df4ff337 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 1.886031 Aug 25 13:01:40.208303 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1392/2771] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:38 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:40.234688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ad526dd5-774f-478e-8fe7-4d9ddf10cab7 req-b1d8d0af-f132-4a0e-abdc-5ae193c51ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4340a9e5-42e7-4871-8e95-d6bca86fc303", "name": "network-vif-plugged", "status": "completed", "tag": "f4f99c2a-8114-4265-8763-e1939912210b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:40.282650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ad526dd5-774f-478e-8fe7-4d9ddf10cab7 req-b1d8d0af-f132-4a0e-abdc-5ae193c51ae3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:40.287161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ad526dd5-774f-478e-8fe7-4d9ddf10cab7 req-b1d8d0af-f132-4a0e-abdc-5ae193c51ae3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:40.289266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ad526dd5-774f-478e-8fe7-4d9ddf10cab7 req-b1d8d0af-f132-4a0e-abdc-5ae193c51ae3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:40.348412 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ad526dd5-774f-478e-8fe7-4d9ddf10cab7 req-b1d8d0af-f132-4a0e-abdc-5ae193c51ae3 service nova] Creating event network-vif-plugged:f4f99c2a-8114-4265-8763-e1939912210b for instance 4340a9e5-42e7-4871-8e95-d6bca86fc303 on n-h2-852771-8 Aug 25 13:01:40.373691 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ad526dd5-774f-478e-8fe7-4d9ddf10cab7 req-b1d8d0af-f132-4a0e-abdc-5ae193c51ae3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161268 Aug 25 13:01:40.393064 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1393/2772] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:40.433661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f0447f9-aacd-42de-90c2-5ef5a997e31b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:40.438886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7f0447f9-aacd-42de-90c2-5ef5a997e31b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 4340a9e5-42e7-4871-8e95-d6bca86fc303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:40.519476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f0447f9-aacd-42de-90c2-5ef5a997e31b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:40.522952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f0447f9-aacd-42de-90c2-5ef5a997e31b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:40.528899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f0447f9-aacd-42de-90c2-5ef5a997e31b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:40.531381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f0447f9-aacd-42de-90c2-5ef5a997e31b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:40.539797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f0447f9-aacd-42de-90c2-5ef5a997e31b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:40.556610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f0447f9-aacd-42de-90c2-5ef5a997e31b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:41.445674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e266d25-aefa-4e1a-b7c9-0b67a0126e3b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:41.480064 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6e266d25-aefa-4e1a-b7c9-0b67a0126e3b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1317 microversion: 2.1 time: 2.482927 Aug 25 13:01:41.495185 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1380/2773] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:38 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1317 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:41.528521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-71d61394-6db2-4426-bae0-8768e60adc86 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:41.533675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-71d61394-6db2-4426-bae0-8768e60adc86 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:41.554754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71d61394-6db2-4426-bae0-8768e60adc86 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:41.560648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71d61394-6db2-4426-bae0-8768e60adc86 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:41.563607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71d61394-6db2-4426-bae0-8768e60adc86 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:41.569725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71d61394-6db2-4426-bae0-8768e60adc86 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:41.573835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71d61394-6db2-4426-bae0-8768e60adc86 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:41.579660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71d61394-6db2-4426-bae0-8768e60adc86 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:43.472892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7f0447f9-aacd-42de-90c2-5ef5a997e31b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:43.509409 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7f0447f9-aacd-42de-90c2-5ef5a997e31b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303" status: 200 len: 1317 microversion: 2.1 time: 3.107246 Aug 25 13:01:43.525036 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1394/2774] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:40 2022] GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303 => generated 1317 bytes in 3131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:43.543296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0fd16792-8654-452b-a926-a4c07b4943d5 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:43.547979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0fd16792-8654-452b-a926-a4c07b4943d5 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:43.581705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fd16792-8654-452b-a926-a4c07b4943d5 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:43.596590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fd16792-8654-452b-a926-a4c07b4943d5 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:43.598215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fd16792-8654-452b-a926-a4c07b4943d5 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:43.600022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fd16792-8654-452b-a926-a4c07b4943d5 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:43.604770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fd16792-8654-452b-a926-a4c07b4943d5 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:43.606739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fd16792-8654-452b-a926-a4c07b4943d5 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:44.017443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-71d61394-6db2-4426-bae0-8768e60adc86 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:44.058746 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-71d61394-6db2-4426-bae0-8768e60adc86 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 2.558776 Aug 25 13:01:44.078335 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1381/2775] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:41 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 2582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:44.579875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e517827-0547-4194-9854-e48dc51e4e2b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:44.586190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5e517827-0547-4194-9854-e48dc51e4e2b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 4340a9e5-42e7-4871-8e95-d6bca86fc303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:44.602405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e517827-0547-4194-9854-e48dc51e4e2b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:44.604500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e517827-0547-4194-9854-e48dc51e4e2b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:44.606132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e517827-0547-4194-9854-e48dc51e4e2b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:44.608283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e517827-0547-4194-9854-e48dc51e4e2b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:44.610032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e517827-0547-4194-9854-e48dc51e4e2b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:44.611527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e517827-0547-4194-9854-e48dc51e4e2b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:44.745042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0fd16792-8654-452b-a926-a4c07b4943d5 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:44.814284 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0fd16792-8654-452b-a926-a4c07b4943d5 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1317 microversion: 2.1 time: 1.281351 Aug 25 13:01:44.816541 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1395/2776] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:43 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1317 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:45.121122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e5cf47a-c495-4fc1-b32e-0edd1c35bf50 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:45.123424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6e5cf47a-c495-4fc1-b32e-0edd1c35bf50 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:45.177922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e5cf47a-c495-4fc1-b32e-0edd1c35bf50 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:45.183680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e5cf47a-c495-4fc1-b32e-0edd1c35bf50 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:45.185037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e5cf47a-c495-4fc1-b32e-0edd1c35bf50 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:45.191768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e5cf47a-c495-4fc1-b32e-0edd1c35bf50 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:45.201807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e5cf47a-c495-4fc1-b32e-0edd1c35bf50 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:45.203193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e5cf47a-c495-4fc1-b32e-0edd1c35bf50 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:46.244814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5e517827-0547-4194-9854-e48dc51e4e2b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:46.270097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6e5cf47a-c495-4fc1-b32e-0edd1c35bf50 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:46.300568 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5e517827-0547-4194-9854-e48dc51e4e2b tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303" status: 200 len: 1317 microversion: 2.1 time: 1.725399 Aug 25 13:01:46.315497 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e5cf47a-c495-4fc1-b32e-0edd1c35bf50 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 1.205760 Aug 25 13:01:46.334255 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1396/2777] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:45 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:46.364148 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1382/2778] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:44 2022] GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303 => generated 1317 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:46.373266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e3566137-5cd4-40d8-aab7-cafb1c82e235 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:46.375025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e3566137-5cd4-40d8-aab7-cafb1c82e235 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:46.393610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3566137-5cd4-40d8-aab7-cafb1c82e235 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:46.399444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3566137-5cd4-40d8-aab7-cafb1c82e235 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:46.400904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3566137-5cd4-40d8-aab7-cafb1c82e235 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:46.402605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3566137-5cd4-40d8-aab7-cafb1c82e235 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:46.405770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3566137-5cd4-40d8-aab7-cafb1c82e235 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:46.407669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3566137-5cd4-40d8-aab7-cafb1c82e235 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:47.394911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c069980-c3c7-407f-a60d-c7fa23e58e73 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:47.399566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9c069980-c3c7-407f-a60d-c7fa23e58e73 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:47.439948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c069980-c3c7-407f-a60d-c7fa23e58e73 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:47.446093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c069980-c3c7-407f-a60d-c7fa23e58e73 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:47.447409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c069980-c3c7-407f-a60d-c7fa23e58e73 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:47.452751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c069980-c3c7-407f-a60d-c7fa23e58e73 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:47.454314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c069980-c3c7-407f-a60d-c7fa23e58e73 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:47.456482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c069980-c3c7-407f-a60d-c7fa23e58e73 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:48.003960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:48.650471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e3566137-5cd4-40d8-aab7-cafb1c82e235 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:48.696014 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e3566137-5cd4-40d8-aab7-cafb1c82e235 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1317 microversion: 2.1 time: 2.352052 Aug 25 13:01:48.719171 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1397/2779] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:46 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1317 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:48.737885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9c069980-c3c7-407f-a60d-c7fa23e58e73 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:48.747132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c202cc72-bfa7-4a9b-974c-f2c8daf01731 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:48.749169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c202cc72-bfa7-4a9b-974c-f2c8daf01731 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 4340a9e5-42e7-4871-8e95-d6bca86fc303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:48.763716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=5 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:48.776445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c202cc72-bfa7-4a9b-974c-f2c8daf01731 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:48.777841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c202cc72-bfa7-4a9b-974c-f2c8daf01731 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:48.779085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c202cc72-bfa7-4a9b-974c-f2c8daf01731 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:48.780805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c202cc72-bfa7-4a9b-974c-f2c8daf01731 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:48.783121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c202cc72-bfa7-4a9b-974c-f2c8daf01731 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:48.784523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c202cc72-bfa7-4a9b-974c-f2c8daf01731 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:48.791164 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c069980-c3c7-407f-a60d-c7fa23e58e73 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 1.423103 Aug 25 13:01:48.805744 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1383/2780] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:47 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:49.363581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c202cc72-bfa7-4a9b-974c-f2c8daf01731 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:49.397767 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c202cc72-bfa7-4a9b-974c-f2c8daf01731 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303" status: 200 len: 1505 microversion: 2.1 time: 0.670182 Aug 25 13:01:49.407074 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1398/2781] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:48 2022] GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303 => generated 1505 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:49.462904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7245933e-0baa-4911-8ca9-04ea3433a15c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:49.468066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7245933e-0baa-4911-8ca9-04ea3433a15c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 4340a9e5-42e7-4871-8e95-d6bca86fc303] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:49.525735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7245933e-0baa-4911-8ca9-04ea3433a15c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:49.537996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7245933e-0baa-4911-8ca9-04ea3433a15c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:49.547740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7245933e-0baa-4911-8ca9-04ea3433a15c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:49.550546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7245933e-0baa-4911-8ca9-04ea3433a15c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:49.555230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7245933e-0baa-4911-8ca9-04ea3433a15c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:49.563202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7245933e-0baa-4911-8ca9-04ea3433a15c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:49.763912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a1e47729-1bf6-4c33-bce8-1524b6d7d478 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:49.770534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a1e47729-1bf6-4c33-bce8-1524b6d7d478 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:49.803411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e47729-1bf6-4c33-bce8-1524b6d7d478 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:49.804902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e47729-1bf6-4c33-bce8-1524b6d7d478 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:49.810968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e47729-1bf6-4c33-bce8-1524b6d7d478 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:49.823547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e47729-1bf6-4c33-bce8-1524b6d7d478 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:49.828185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e47729-1bf6-4c33-bce8-1524b6d7d478 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:49.841909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7245933e-0baa-4911-8ca9-04ea3433a15c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 4340a9e5-42e7-4871-8e95-d6bca86fc303] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:01:49.843326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e47729-1bf6-4c33-bce8-1524b6d7d478 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:50.289386 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7245933e-0baa-4911-8ca9-04ea3433a15c tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303" status: 204 len: 0 microversion: 2.1 time: 0.816463 Aug 25 13:01:50.301795 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1384/2782] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:01:49 2022] DELETE /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:01:50.336643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1286634573", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b98d6842-edde-4af8-9173-86d12c6cb113"}], "security_groups": [{"name": "tempest-securitygroup--475311927"}], "key_name": "tempest-keypair-711133921", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:50.380679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a1e47729-1bf6-4c33-bce8-1524b6d7d478 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:50.416965 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a1e47729-1bf6-4c33-bce8-1524b6d7d478 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1317 microversion: 2.1 time: 0.656554 Aug 25 13:01:50.423691 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1399/2783] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:49 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:01:50.438969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70a13f52-1132-4b1c-9ad3-728863abbc27 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:50.440210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70a13f52-1132-4b1c-9ad3-728863abbc27 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:50.481963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a13f52-1132-4b1c-9ad3-728863abbc27 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:50.483494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a13f52-1132-4b1c-9ad3-728863abbc27 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:50.484267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a13f52-1132-4b1c-9ad3-728863abbc27 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:50.486190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a13f52-1132-4b1c-9ad3-728863abbc27 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:50.487092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a13f52-1132-4b1c-9ad3-728863abbc27 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:50.487924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70a13f52-1132-4b1c-9ad3-728863abbc27 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:51.265017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] validate_networks() for [('b98d6842-edde-4af8-9173-86d12c6cb113', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:01:52.618718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70a13f52-1132-4b1c-9ad3-728863abbc27 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:52.693722 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70a13f52-1132-4b1c-9ad3-728863abbc27 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 2.261399 Aug 25 13:01:52.706708 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1400/2784] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:50 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 2282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:52.729923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-abcdf3db-52f6-4b60-b762-d68b1cd6fd74 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:52.731966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-abcdf3db-52f6-4b60-b762-d68b1cd6fd74 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:52.752915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abcdf3db-52f6-4b60-b762-d68b1cd6fd74 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:52.757692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abcdf3db-52f6-4b60-b762-d68b1cd6fd74 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:52.759204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abcdf3db-52f6-4b60-b762-d68b1cd6fd74 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:52.761479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abcdf3db-52f6-4b60-b762-d68b1cd6fd74 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:52.768312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abcdf3db-52f6-4b60-b762-d68b1cd6fd74 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:52.769660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abcdf3db-52f6-4b60-b762-d68b1cd6fd74 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:52.900264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-abcdf3db-52f6-4b60-b762-d68b1cd6fd74 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:01:53.347173 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-abcdf3db-52f6-4b60-b762-d68b1cd6fd74 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 204 len: 0 microversion: 2.1 time: 0.637630 Aug 25 13:01:53.348545 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1401/2785] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:01:52 2022] DELETE /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:01:53.392736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea29d8b4-658f-4043-be9f-873679480552 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:53.399996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ea29d8b4-658f-4043-be9f-873679480552 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:53.433461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea29d8b4-658f-4043-be9f-873679480552 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:53.437318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea29d8b4-658f-4043-be9f-873679480552 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:53.443386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea29d8b4-658f-4043-be9f-873679480552 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:53.447141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea29d8b4-658f-4043-be9f-873679480552 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:53.449967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea29d8b4-658f-4043-be9f-873679480552 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:53.453781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea29d8b4-658f-4043-be9f-873679480552 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:54.708604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ea29d8b4-658f-4043-be9f-873679480552 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:54.713390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:54.762419 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ea29d8b4-658f-4043-be9f-873679480552 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1317 microversion: 2.1 time: 1.411458 Aug 25 13:01:54.764604 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1402/2786] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:53 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1317 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:54.776185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-115ab41c-5fe4-4b99-9c0d-43fd338af729 req-036186e9-14af-4e84-94b5-cadbd503550d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c46524-70ff-4c0a-9fce-afaacf9d2ba5", "name": "network-vif-plugged", "status": "completed", "tag": "b79d7cd8-5914-4ce2-9c72-b63b5435b25c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:54.825601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-115ab41c-5fe4-4b99-9c0d-43fd338af729 req-036186e9-14af-4e84-94b5-cadbd503550d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:54.827910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-115ab41c-5fe4-4b99-9c0d-43fd338af729 req-036186e9-14af-4e84-94b5-cadbd503550d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:54.829796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-115ab41c-5fe4-4b99-9c0d-43fd338af729 req-036186e9-14af-4e84-94b5-cadbd503550d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:54.869251 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-115ab41c-5fe4-4b99-9c0d-43fd338af729 req-036186e9-14af-4e84-94b5-cadbd503550d service nova] Creating event network-vif-plugged:b79d7cd8-5914-4ce2-9c72-b63b5435b25c for instance 34c46524-70ff-4c0a-9fce-afaacf9d2ba5 on n-h2-852771-8 Aug 25 13:01:54.890021 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-115ab41c-5fe4-4b99-9c0d-43fd338af729 req-036186e9-14af-4e84-94b5-cadbd503550d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117117 Aug 25 13:01:54.915189 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1403/2787] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:54.932536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6be2137-54c2-4095-b199-8ac3c0828c0e tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:54.934409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d6be2137-54c2-4095-b199-8ac3c0828c0e tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 4340a9e5-42e7-4871-8e95-d6bca86fc303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:54.949793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6be2137-54c2-4095-b199-8ac3c0828c0e tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:54.951361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6be2137-54c2-4095-b199-8ac3c0828c0e tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:54.952583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6be2137-54c2-4095-b199-8ac3c0828c0e tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:54.956190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6be2137-54c2-4095-b199-8ac3c0828c0e tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:54.957534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6be2137-54c2-4095-b199-8ac3c0828c0e tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:54.958668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6be2137-54c2-4095-b199-8ac3c0828c0e tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:56.558181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:56.636747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Getting quotas for project b2ef1136a7fb486ca299eaca4181a996. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:01:56.693229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Getting quotas for user 7a30a7e80c424ee8b24224f161c1cce8 and project b2ef1136a7fb486ca299eaca4181a996. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:01:56.811956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:01:56.815147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:01:56.822163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:01:56.826071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:01:56.833993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:01:56.895847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:56.899604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:56.900483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:56.903842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:56.908275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:56.909784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:56.999563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Getting quotas for project b2ef1136a7fb486ca299eaca4181a996. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:01:57.019139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Getting quotas for user 7a30a7e80c424ee8b24224f161c1cce8 and project b2ef1136a7fb486ca299eaca4181a996. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:01:57.055966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:01:57.065108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:01:57.347556 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f8947fa1-06d7-466a-addc-b47569c6362a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 7.037442 Aug 25 13:01:57.356303 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1385/2788] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:01:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 7053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:01:57.400784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c4b81ac0-844c-4945-842b-d959f53ebe67 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:57.406785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c4b81ac0-844c-4945-842b-d959f53ebe67 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:57.437250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4b81ac0-844c-4945-842b-d959f53ebe67 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.447534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4b81ac0-844c-4945-842b-d959f53ebe67 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.450917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4b81ac0-844c-4945-842b-d959f53ebe67 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:57.454826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4b81ac0-844c-4945-842b-d959f53ebe67 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.458222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4b81ac0-844c-4945-842b-d959f53ebe67 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.459359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4b81ac0-844c-4945-842b-d959f53ebe67 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:57.728243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d6be2137-54c2-4095-b199-8ac3c0828c0e tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:57.784384 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d6be2137-54c2-4095-b199-8ac3c0828c0e tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303" status: 200 len: 1511 microversion: 2.1 time: 2.866265 Aug 25 13:01:57.786506 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1404/2789] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:54 2022] GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303 => generated 1511 bytes in 2870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:57.808752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3117fdfe-3f9a-418e-bf46-c61bda113697 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:57.813301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3117fdfe-3f9a-418e-bf46-c61bda113697 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:57.853369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3117fdfe-3f9a-418e-bf46-c61bda113697 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.859115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3117fdfe-3f9a-418e-bf46-c61bda113697 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.865358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3117fdfe-3f9a-418e-bf46-c61bda113697 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:57.868512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3117fdfe-3f9a-418e-bf46-c61bda113697 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.872034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3117fdfe-3f9a-418e-bf46-c61bda113697 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.873255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3117fdfe-3f9a-418e-bf46-c61bda113697 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:59.699047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3117fdfe-3f9a-418e-bf46-c61bda113697 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:59.749890 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3117fdfe-3f9a-418e-bf46-c61bda113697 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1466 microversion: 2.1 time: 1.955016 Aug 25 13:01:59.791148 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1405/2790] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:57 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1466 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:59.825028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7a0e6e4-4a8c-413b-a41f-ac832ab2fe32 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:59.832761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b7a0e6e4-4a8c-413b-a41f-ac832ab2fe32 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:59.865055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a0e6e4-4a8c-413b-a41f-ac832ab2fe32 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:59.869276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a0e6e4-4a8c-413b-a41f-ac832ab2fe32 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:59.897714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a0e6e4-4a8c-413b-a41f-ac832ab2fe32 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:59.899322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a0e6e4-4a8c-413b-a41f-ac832ab2fe32 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:59.900364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a0e6e4-4a8c-413b-a41f-ac832ab2fe32 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:59.901096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7a0e6e4-4a8c-413b-a41f-ac832ab2fe32 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.127686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c4b81ac0-844c-4945-842b-d959f53ebe67 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:00.167147 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c4b81ac0-844c-4945-842b-d959f53ebe67 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 2.807374 Aug 25 13:02:00.168249 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1386/2791] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:57 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 2811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:00.218552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b244ba42-12e0-4e1d-994c-bc92539db8f2 req-0e881ffb-b4b8-45a1-a6f0-d0570cdcf9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4340a9e5-42e7-4871-8e95-d6bca86fc303", "name": "network-vif-deleted", "tag": "f4f99c2a-8114-4265-8763-e1939912210b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:00.242933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b244ba42-12e0-4e1d-994c-bc92539db8f2 req-0e881ffb-b4b8-45a1-a6f0-d0570cdcf9d0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.245882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b244ba42-12e0-4e1d-994c-bc92539db8f2 req-0e881ffb-b4b8-45a1-a6f0-d0570cdcf9d0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.247176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b244ba42-12e0-4e1d-994c-bc92539db8f2 req-0e881ffb-b4b8-45a1-a6f0-d0570cdcf9d0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.285619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b7a0e6e4-4a8c-413b-a41f-ac832ab2fe32 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:00.303075 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b244ba42-12e0-4e1d-994c-bc92539db8f2 req-0e881ffb-b4b8-45a1-a6f0-d0570cdcf9d0 service nova] Creating event network-vif-deleted:f4f99c2a-8114-4265-8763-e1939912210b for instance 4340a9e5-42e7-4871-8e95-d6bca86fc303 on n-h2-852771-8 Aug 25 13:02:00.323042 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b7a0e6e4-4a8c-413b-a41f-ac832ab2fe32 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1273 microversion: 2.1 time: 0.528361 Aug 25 13:02:00.345820 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b244ba42-12e0-4e1d-994c-bc92539db8f2 req-0e881ffb-b4b8-45a1-a6f0-d0570cdcf9d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167098 Aug 25 13:02:00.352502 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1406/2792] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:59 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1273 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:00.353468 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1387/2793] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:00.420227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:00.421500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: 4340a9e5-42e7-4871-8e95-d6bca86fc303] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:00.451532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.452527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.460150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.464271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.470563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.471803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.558070 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] HTTP exception thrown: Instance 4340a9e5-42e7-4871-8e95-d6bca86fc303 could not be found. Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Request method failure captured: Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303 HTTP/1.1 Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3JMOqxEwcrOU9h-eVULeVSbzkGxxcFDJ8U_LDoelg2B_o8UIJL1BmTG-Xvr8nri3xoB-UvcpLvjJLRgtIW62L7EwJBbzlU0ixAXCmlscXAL_ew4uAYXm8CBQ4FO1jbDhyGSqE8Qb4uIToFN9Fh6LAuYHpcQfhAqk20IAtXc0fKDnhQ Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 1d432cdb3bfe4c078b18f66a2fe8e23e Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-MultipleCreateTestJSON-2132214548 Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1d432cdb3bfe4c078b18f66a2fe8e23e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1d432cdb3bfe4c078b18f66a2fe8e23e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1d432cdb3bfe4c078b18f66a2fe8e23e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1d432cdb3bfe4c078b18f66a2fe8e23e"}]}] Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-MultipleCreateTestJSON-2132214548 Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 1d432cdb3bfe4c078b18f66a2fe8e23e Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2132214548 Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-MultipleCreateTestJSON-2132214548-project Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 92c08951ee044049ace7c7f8c92283f9 Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-MultipleCreateTestJSON-2132214548-project Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 4340a9e5-42e7-4871-8e95-d6bca86fc303 could not be found. Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '4340a9e5-42e7-4871-8e95-d6bca86fc303'} Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4340a9e5-42e7-4871-8e95-d6bca86fc303 could not be found. Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4340a9e5-42e7-4871-8e95-d6bca86fc303 could not be found. Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:00.574433 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:00.589231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:00.589231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:00.589231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:00.589231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:00.589231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:00.589231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4340a9e5-42e7-4871-8e95-d6bca86fc303 could not be found. Aug 25 13:02:00.589231 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:00.597388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Returning 404 to user: Instance 4340a9e5-42e7-4871-8e95-d6bca86fc303 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:00.599230 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1c0668c1-0e55-40fb-9626-76bcbde17617 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303" status: 404 len: 111 microversion: 2.1 time: 0.234099 Aug 25 13:02:00.608880 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1407/2794] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:00 2022] GET /compute/v2.1/servers/4340a9e5-42e7-4871-8e95-d6bca86fc303 => generated 111 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:00.620303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4cab112f-de50-4093-a2a0-5e6715537753 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:00.621956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4cab112f-de50-4093-a2a0-5e6715537753 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:00.636599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cab112f-de50-4093-a2a0-5e6715537753 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.640893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cab112f-de50-4093-a2a0-5e6715537753 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.642522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cab112f-de50-4093-a2a0-5e6715537753 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.645410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cab112f-de50-4093-a2a0-5e6715537753 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.646424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cab112f-de50-4093-a2a0-5e6715537753 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.647722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cab112f-de50-4093-a2a0-5e6715537753 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:01.361446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7cb9fcf7-32fe-4852-89e8-f203c9fb5ad7 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:01.369239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7cb9fcf7-32fe-4852-89e8-f203c9fb5ad7 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:01.406529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cb9fcf7-32fe-4852-89e8-f203c9fb5ad7 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:01.407511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cb9fcf7-32fe-4852-89e8-f203c9fb5ad7 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:01.409764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cb9fcf7-32fe-4852-89e8-f203c9fb5ad7 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:01.414114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cb9fcf7-32fe-4852-89e8-f203c9fb5ad7 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:01.419242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cb9fcf7-32fe-4852-89e8-f203c9fb5ad7 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:01.420539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cb9fcf7-32fe-4852-89e8-f203c9fb5ad7 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:03.387904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4cab112f-de50-4093-a2a0-5e6715537753 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c08951ee044049ace7c7f8c92283f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d432cdb3bfe4c078b18f66a2fe8e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:03.426753 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4cab112f-de50-4093-a2a0-5e6715537753 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 200 len: 1512 microversion: 2.1 time: 2.815418 Aug 25 13:02:03.431808 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1408/2795] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:00 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 1512 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:03.479130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-6be96793-0ec3-4cc7-b444-e2a512595eb4 req-fcff8e73-7350-4930-973c-8d9a21f9a451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb03cb5-2a02-4234-bb78-f89decec1b51", "name": "network-vif-unplugged", "status": "completed", "tag": "1925067b-170a-4815-af70-0523b6a0fc2f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:03.500087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6be96793-0ec3-4cc7-b444-e2a512595eb4 req-fcff8e73-7350-4930-973c-8d9a21f9a451 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:03.501426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6be96793-0ec3-4cc7-b444-e2a512595eb4 req-fcff8e73-7350-4930-973c-8d9a21f9a451 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:03.502571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6be96793-0ec3-4cc7-b444-e2a512595eb4 req-fcff8e73-7350-4930-973c-8d9a21f9a451 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:03.532443 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-6be96793-0ec3-4cc7-b444-e2a512595eb4 req-fcff8e73-7350-4930-973c-8d9a21f9a451 service nova] Creating event network-vif-unplugged:1925067b-170a-4815-af70-0523b6a0fc2f for instance bcb03cb5-2a02-4234-bb78-f89decec1b51 on n-h2-852771-8 Aug 25 13:02:03.594172 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-6be96793-0ec3-4cc7-b444-e2a512595eb4 req-fcff8e73-7350-4930-973c-8d9a21f9a451 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144325 Aug 25 13:02:03.618163 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1409/2796] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:03.659607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3bef582a-c4a1-4a37-835d-09d36a1d662b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:03.666086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3bef582a-c4a1-4a37-835d-09d36a1d662b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:03.713882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bef582a-c4a1-4a37-835d-09d36a1d662b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:03.715377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bef582a-c4a1-4a37-835d-09d36a1d662b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:03.722871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bef582a-c4a1-4a37-835d-09d36a1d662b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:03.726311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bef582a-c4a1-4a37-835d-09d36a1d662b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:03.733089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bef582a-c4a1-4a37-835d-09d36a1d662b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:03.734301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bef582a-c4a1-4a37-835d-09d36a1d662b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:05.418563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3bef582a-c4a1-4a37-835d-09d36a1d662b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:05.471703 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3bef582a-c4a1-4a37-835d-09d36a1d662b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 1.851125 Aug 25 13:02:05.486685 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1410/2797] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:03 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:05.522987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f41f36f4-5519-44d6-9cfd-698ccfe1bbe9 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:05.524222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f41f36f4-5519-44d6-9cfd-698ccfe1bbe9 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:05.545369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f41f36f4-5519-44d6-9cfd-698ccfe1bbe9 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:05.547095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f41f36f4-5519-44d6-9cfd-698ccfe1bbe9 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:05.548237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f41f36f4-5519-44d6-9cfd-698ccfe1bbe9 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:05.549874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f41f36f4-5519-44d6-9cfd-698ccfe1bbe9 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:05.551055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f41f36f4-5519-44d6-9cfd-698ccfe1bbe9 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:05.555474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f41f36f4-5519-44d6-9cfd-698ccfe1bbe9 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:05.917537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f41f36f4-5519-44d6-9cfd-698ccfe1bbe9 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:05.946085 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f41f36f4-5519-44d6-9cfd-698ccfe1bbe9 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1335 microversion: 2.1 time: 0.457255 Aug 25 13:02:05.950981 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1411/2798] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:05 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1335 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:05.968789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "464b6075-30b7-4ea0-a614-7d4408b1e95c"}], "security_groups": [{"name": "tempest-securitygroup--261533030"}], "key_name": "tempest-keypair-199103592", "user_data": "}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:06.142822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:06.152348 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7cb9fcf7-32fe-4852-89e8-f203c9fb5ad7 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1617 microversion: 2.1 time: 5.794758 Aug 25 13:02:06.154655 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1388/2799] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:00 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1617 bytes in 5799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:06.167506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:06.169739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] [instance: bcb03cb5-2a02-4234-bb78-f89decec1b51] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:06.191626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:06.193125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:06.194703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:06.196524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:06.201105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:06.202975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:06.240502 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] HTTP exception thrown: Instance bcb03cb5-2a02-4234-bb78-f89decec1b51 could not be found. Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Request method failure captured: Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 HTTP/1.1 Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3JMOqxEwcrOU9h-eVULeVSbzkGxxcFDJ8U_LDoelg2B_o8UIJL1BmTG-Xvr8nri3xoB-UvcpLvjJLRgtIW62L7EwJBbzlU0ixAXCmlscXAL_ew4uAYXm8CBQ4FO1jbDhyGSqE8Qb4uIToFN9Fh6LAuYHpcQfhAqk20IAtXc0fKDnhQ Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 1d432cdb3bfe4c078b18f66a2fe8e23e Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-MultipleCreateTestJSON-2132214548 Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1d432cdb3bfe4c078b18f66a2fe8e23e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1d432cdb3bfe4c078b18f66a2fe8e23e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1d432cdb3bfe4c078b18f66a2fe8e23e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1d432cdb3bfe4c078b18f66a2fe8e23e"}]}] Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-MultipleCreateTestJSON-2132214548 Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 1d432cdb3bfe4c078b18f66a2fe8e23e Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2132214548 Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-MultipleCreateTestJSON-2132214548-project Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 92c08951ee044049ace7c7f8c92283f9 Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-MultipleCreateTestJSON-2132214548-project Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance bcb03cb5-2a02-4234-bb78-f89decec1b51 could not be found. Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'bcb03cb5-2a02-4234-bb78-f89decec1b51'} Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb03cb5-2a02-4234-bb78-f89decec1b51 could not be found. Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb03cb5-2a02-4234-bb78-f89decec1b51 could not be found. Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:06.247457 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:06.258850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:06.258850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:06.258850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:06.258850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:06.258850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:06.258850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb03cb5-2a02-4234-bb78-f89decec1b51 could not be found. Aug 25 13:02:06.258850 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:06.260187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] Returning 404 to user: Instance bcb03cb5-2a02-4234-bb78-f89decec1b51 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:06.263574 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3ebc2235-3926-4a1f-af3f-69a4bf137a60 tempest-MultipleCreateTestJSON-2132214548 tempest-MultipleCreateTestJSON-2132214548-project] 10.222.0.70 "GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51" status: 404 len: 111 microversion: 2.1 time: 0.104587 Aug 25 13:02:06.265133 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1389/2800] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:06 2022] GET /compute/v2.1/servers/bcb03cb5-2a02-4234-bb78-f89decec1b51 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:06.277771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-caa4b535-12a7-49ef-a559-0e88ab4b18b4 req-cf426738-378a-455b-acf6-31f6d97b7909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb03cb5-2a02-4234-bb78-f89decec1b51", "name": "network-vif-deleted", "tag": "1925067b-170a-4815-af70-0523b6a0fc2f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:06.302698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-caa4b535-12a7-49ef-a559-0e88ab4b18b4 req-cf426738-378a-455b-acf6-31f6d97b7909 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:06.304639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-caa4b535-12a7-49ef-a559-0e88ab4b18b4 req-cf426738-378a-455b-acf6-31f6d97b7909 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:06.306653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-caa4b535-12a7-49ef-a559-0e88ab4b18b4 req-cf426738-378a-455b-acf6-31f6d97b7909 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:06.338070 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-caa4b535-12a7-49ef-a559-0e88ab4b18b4 req-cf426738-378a-455b-acf6-31f6d97b7909 service nova] Creating event network-vif-deleted:1925067b-170a-4815-af70-0523b6a0fc2f for instance bcb03cb5-2a02-4234-bb78-f89decec1b51 on n-h2-852771-8 Aug 25 13:02:06.370625 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-caa4b535-12a7-49ef-a559-0e88ab4b18b4 req-cf426738-378a-455b-acf6-31f6d97b7909 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100950 Aug 25 13:02:06.375775 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1390/2801] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:06.389634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8bc88396-7a67-4643-b8d1-19d7036555ce tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Action: 'create', calling method: .version_select at 0x7f3a2e95c160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1840040810", "policies": ["affinity"]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:06.442874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-8bc88396-7a67-4643-b8d1-19d7036555ce tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:06.457602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-8bc88396-7a67-4643-b8d1-19d7036555ce tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:06.592137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-8bc88396-7a67-4643-b8d1-19d7036555ce tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:06.614382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-8bc88396-7a67-4643-b8d1-19d7036555ce tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:06.619988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] validate_networks() for [('464b6075-30b7-4ea0-a614-7d4408b1e95c', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:02:06.709216 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8bc88396-7a67-4643-b8d1-19d7036555ce tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.329996 Aug 25 13:02:06.721563 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1391/2802] 10.222.0.70 () {60 vars in 1174 bytes} [Thu Aug 25 13:02:06 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:06.727250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-84e4a09c-7b4d-42d6-86d3-9b9088046730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:06.729752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-84e4a09c-7b4d-42d6-86d3-9b9088046730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:06.750571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84e4a09c-7b4d-42d6-86d3-9b9088046730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:06.752416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84e4a09c-7b4d-42d6-86d3-9b9088046730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:06.757651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84e4a09c-7b4d-42d6-86d3-9b9088046730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:06.760394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84e4a09c-7b4d-42d6-86d3-9b9088046730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:06.765354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84e4a09c-7b4d-42d6-86d3-9b9088046730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:06.766903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84e4a09c-7b4d-42d6-86d3-9b9088046730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:06.959127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:07.766506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-84e4a09c-7b4d-42d6-86d3-9b9088046730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:07.798870 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-84e4a09c-7b4d-42d6-86d3-9b9088046730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1523 microversion: 2.1 time: 1.083270 Aug 25 13:02:07.800198 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1392/2803] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:06 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1523 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:07.814213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8239b01f-67ed-446c-86cc-7be16c1de5c4 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:07.816429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8239b01f-67ed-446c-86cc-7be16c1de5c4 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:07.841767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8239b01f-67ed-446c-86cc-7be16c1de5c4 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:07.843306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8239b01f-67ed-446c-86cc-7be16c1de5c4 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:07.844500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8239b01f-67ed-446c-86cc-7be16c1de5c4 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:07.846291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8239b01f-67ed-446c-86cc-7be16c1de5c4 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:07.847560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8239b01f-67ed-446c-86cc-7be16c1de5c4 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:07.850971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8239b01f-67ed-446c-86cc-7be16c1de5c4 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:08.116018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8239b01f-67ed-446c-86cc-7be16c1de5c4 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:08.168548 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8239b01f-67ed-446c-86cc-7be16c1de5c4 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1335 microversion: 2.1 time: 0.364641 Aug 25 13:02:08.184939 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1393/2804] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:07 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1335 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:08.186774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-988206419", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ad9da14b-a14d-4fbb-8c0f-d848b3ab02d8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:08.362419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:02:09.749021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:02:09.751496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:02:09.753981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:02:09.757670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:02:09.762570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:02:09.798840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:09.799620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:09.800353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:09.801948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:09.802810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:09.804163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:09.846800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Getting quotas for project 9d299d545c86446392d864f9689e0208. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:09.862062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Getting quotas for user 2bb2beca1cfb4b31b0e0080b39d12497 and project 9d299d545c86446392d864f9689e0208. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:09.929250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:02:09.936109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:02:10.086177 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ea286159-aa6e-4b34-935b-1c6615351ad1 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.129642 Aug 25 13:02:10.098364 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1412/2805] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:02:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 4136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:02:10.119022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-312987c4-15fa-4c39-8be5-aa1e062cffe4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:10.122690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-312987c4-15fa-4c39-8be5-aa1e062cffe4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:10.145663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:02:10.151901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:02:10.158811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:02:10.159178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-312987c4-15fa-4c39-8be5-aa1e062cffe4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:10.162828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:02:10.164679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-312987c4-15fa-4c39-8be5-aa1e062cffe4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:10.167699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-312987c4-15fa-4c39-8be5-aa1e062cffe4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:10.169387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-312987c4-15fa-4c39-8be5-aa1e062cffe4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:10.171761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:02:10.176832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-312987c4-15fa-4c39-8be5-aa1e062cffe4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:10.181545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-312987c4-15fa-4c39-8be5-aa1e062cffe4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:10.292517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:10.294567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:10.295798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:10.305208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:10.308350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:10.312952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:10.435549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:10.458761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:10.538865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Going to run 2 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:02:10.552597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 1eaf403a-3a50-4864-845c-340bf0a70683] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:02:10.750440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=129059) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 25 13:02:10.811689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:10.828227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:10.942857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:10.970986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:10.996229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:11.064066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=1eaf403a-3a50-4864-845c-340bf0a70683,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:02:11.207111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:11.218432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-312987c4-15fa-4c39-8be5-aa1e062cffe4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:11.220941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:11.245696 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-312987c4-15fa-4c39-8be5-aa1e062cffe4 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1505 microversion: 2.1 time: 1.153104 Aug 25 13:02:11.246800 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1413/2806] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:10 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1505 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:11.270937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-61d8351f-0eb4-4ccf-9620-015a4cb12be7 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:11.273126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-61d8351f-0eb4-4ccf-9620-015a4cb12be7 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:11.300199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d8351f-0eb4-4ccf-9620-015a4cb12be7 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.301544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d8351f-0eb4-4ccf-9620-015a4cb12be7 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.303897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d8351f-0eb4-4ccf-9620-015a4cb12be7 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.310111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d8351f-0eb4-4ccf-9620-015a4cb12be7 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.311409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d8351f-0eb4-4ccf-9620-015a4cb12be7 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.311792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:11.320749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61d8351f-0eb4-4ccf-9620-015a4cb12be7 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.324567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:11.477423 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-27b596a5-4c1a-4995-a588-282874f72d5d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.300266 Aug 25 13:02:11.487124 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1394/2807] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:02:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 3310 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 25 13:02:11.507958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ce1381b-f98e-4475-8aba-1604450f511e tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:11.509579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8ce1381b-f98e-4475-8aba-1604450f511e tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:11.532550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce1381b-f98e-4475-8aba-1604450f511e tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.533383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce1381b-f98e-4475-8aba-1604450f511e tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.534320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce1381b-f98e-4475-8aba-1604450f511e tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.535654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce1381b-f98e-4475-8aba-1604450f511e tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.547353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce1381b-f98e-4475-8aba-1604450f511e tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.548317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ce1381b-f98e-4475-8aba-1604450f511e tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.984877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8ce1381b-f98e-4475-8aba-1604450f511e tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:12.008739 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8ce1381b-f98e-4475-8aba-1604450f511e tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1229 microversion: 2.1 time: 0.522430 Aug 25 13:02:12.011579 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1395/2808] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:11 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1229 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:12.021771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8ddf0379-1b96-4bc0-a8b9-05837f333c67 req-72bc4edb-3365-454f-9e9b-637137d70ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e64e778-70de-4c3e-9c61-f2c8bec2d5ec", "name": "network-vif-unplugged", "status": "completed", "tag": "8f2e03c2-5abc-4f32-8f18-4699fec26d8d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:12.050053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8ddf0379-1b96-4bc0-a8b9-05837f333c67 req-72bc4edb-3365-454f-9e9b-637137d70ce4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:12.051265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8ddf0379-1b96-4bc0-a8b9-05837f333c67 req-72bc4edb-3365-454f-9e9b-637137d70ce4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:12.052376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8ddf0379-1b96-4bc0-a8b9-05837f333c67 req-72bc4edb-3365-454f-9e9b-637137d70ce4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:12.083415 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8ddf0379-1b96-4bc0-a8b9-05837f333c67 req-72bc4edb-3365-454f-9e9b-637137d70ce4 service nova] Creating event network-vif-unplugged:8f2e03c2-5abc-4f32-8f18-4699fec26d8d for instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec on n-h2-852771-8 Aug 25 13:02:12.097081 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8ddf0379-1b96-4bc0-a8b9-05837f333c67 req-72bc4edb-3365-454f-9e9b-637137d70ce4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081648 Aug 25 13:02:12.098996 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1396/2809] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:12.111657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:12.123047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:12.125159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Searching by: {'deleted': False, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:02:12.174603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:12.176268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:12.177891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:12.180723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:12.182256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:12.183414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:12.246352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:02:12.361708 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ef1990c-5e92-4ac2-ae47-ac055f478992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.259962 Aug 25 13:02:12.373580 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1397/2810] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 13:02:12 2022] GET /compute/v2.1/servers => generated 1002 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:12.377764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f2a598cf-647b-44e4-84f7-bbf4af67ad29 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:12.378848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f2a598cf-647b-44e4-84f7-bbf4af67ad29 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:12.394681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2a598cf-647b-44e4-84f7-bbf4af67ad29 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:12.395819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2a598cf-647b-44e4-84f7-bbf4af67ad29 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:12.399152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2a598cf-647b-44e4-84f7-bbf4af67ad29 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:12.401272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2a598cf-647b-44e4-84f7-bbf4af67ad29 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:12.401584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2a598cf-647b-44e4-84f7-bbf4af67ad29 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:12.402894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2a598cf-647b-44e4-84f7-bbf4af67ad29 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:12.816044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-61d8351f-0eb4-4ccf-9620-015a4cb12be7 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:12.853555 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-61d8351f-0eb4-4ccf-9620-015a4cb12be7 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1402 microversion: 2.1 time: 1.589553 Aug 25 13:02:12.854747 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1414/2811] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:11 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1402 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:12.872535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02ea581e-1f2d-4a56-8553-3b59116dbf5e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:12.883569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02ea581e-1f2d-4a56-8553-3b59116dbf5e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:13.160163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02ea581e-1f2d-4a56-8553-3b59116dbf5e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:13.186922 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02ea581e-1f2d-4a56-8553-3b59116dbf5e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1218 microversion: 2.1 time: 0.330594 Aug 25 13:02:13.188241 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1415/2812] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:12 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1218 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:13.252228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e7b40058-6c24-4e71-9169-d8b8a9e8b86d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:13.269718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e7b40058-6c24-4e71-9169-d8b8a9e8b86d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:13.300021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b40058-6c24-4e71-9169-d8b8a9e8b86d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.300958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b40058-6c24-4e71-9169-d8b8a9e8b86d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.301848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b40058-6c24-4e71-9169-d8b8a9e8b86d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:13.303923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b40058-6c24-4e71-9169-d8b8a9e8b86d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.304823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b40058-6c24-4e71-9169-d8b8a9e8b86d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.321101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b40058-6c24-4e71-9169-d8b8a9e8b86d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:13.690876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e7b40058-6c24-4e71-9169-d8b8a9e8b86d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:13.731014 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e7b40058-6c24-4e71-9169-d8b8a9e8b86d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1221 microversion: 2.1 time: 0.498608 Aug 25 13:02:13.733770 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1416/2813] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:13 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1221 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:13.801124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f2a598cf-647b-44e4-84f7-bbf4af67ad29 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:13.844858 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f2a598cf-647b-44e4-84f7-bbf4af67ad29 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1505 microversion: 2.1 time: 1.478437 Aug 25 13:02:13.861992 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1398/2814] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:12 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1505 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:13.912519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-164c7bf0-4c3a-4627-9bdf-26185a537fac tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:13.914373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-164c7bf0-4c3a-4627-9bdf-26185a537fac tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:13.940288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164c7bf0-4c3a-4627-9bdf-26185a537fac tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.941673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164c7bf0-4c3a-4627-9bdf-26185a537fac tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.942484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164c7bf0-4c3a-4627-9bdf-26185a537fac tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:13.944723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164c7bf0-4c3a-4627-9bdf-26185a537fac tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.946013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164c7bf0-4c3a-4627-9bdf-26185a537fac tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.946796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164c7bf0-4c3a-4627-9bdf-26185a537fac tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:14.231878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2e2c44fc-1ed4-422b-ac01-94fb1930a272 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:14.233613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2e2c44fc-1ed4-422b-ac01-94fb1930a272 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:14.258744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e2c44fc-1ed4-422b-ac01-94fb1930a272 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:14.267882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e2c44fc-1ed4-422b-ac01-94fb1930a272 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:14.269305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e2c44fc-1ed4-422b-ac01-94fb1930a272 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:14.273116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e2c44fc-1ed4-422b-ac01-94fb1930a272 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:14.274485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e2c44fc-1ed4-422b-ac01-94fb1930a272 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:14.280456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e2c44fc-1ed4-422b-ac01-94fb1930a272 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:15.187488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2e2c44fc-1ed4-422b-ac01-94fb1930a272 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:15.214006 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2e2c44fc-1ed4-422b-ac01-94fb1930a272 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1214 microversion: 2.1 time: 0.988735 Aug 25 13:02:15.227062 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1399/2815] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:14 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1214 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:15.254814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f713871e-4df2-405b-a6a0-c225f15dd794 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:15.256268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f713871e-4df2-405b-a6a0-c225f15dd794 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:15.279019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f713871e-4df2-405b-a6a0-c225f15dd794 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:15.285985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f713871e-4df2-405b-a6a0-c225f15dd794 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:15.288122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f713871e-4df2-405b-a6a0-c225f15dd794 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:15.292823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f713871e-4df2-405b-a6a0-c225f15dd794 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:15.294142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f713871e-4df2-405b-a6a0-c225f15dd794 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:15.299354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f713871e-4df2-405b-a6a0-c225f15dd794 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:15.695427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f713871e-4df2-405b-a6a0-c225f15dd794 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:15.714360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-164c7bf0-4c3a-4627-9bdf-26185a537fac tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:15.741976 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f713871e-4df2-405b-a6a0-c225f15dd794 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1283 microversion: 2.1 time: 0.511736 Aug 25 13:02:15.743009 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-164c7bf0-4c3a-4627-9bdf-26185a537fac tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1402 microversion: 2.1 time: 1.837601 Aug 25 13:02:15.743631 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1400/2816] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:15 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1283 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:15.745064 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1417/2817] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:13 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1402 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:15.752039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff40c3b7-a207-48dc-b035-ec7267adc795 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:15.753169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ff40c3b7-a207-48dc-b035-ec7267adc795 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:15.800730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff40c3b7-a207-48dc-b035-ec7267adc795 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:15.801967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff40c3b7-a207-48dc-b035-ec7267adc795 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:15.802608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff40c3b7-a207-48dc-b035-ec7267adc795 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:15.804535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff40c3b7-a207-48dc-b035-ec7267adc795 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:15.805400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff40c3b7-a207-48dc-b035-ec7267adc795 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:15.805971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff40c3b7-a207-48dc-b035-ec7267adc795 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:16.262559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-95b6fc8c-3458-4c17-b565-7b5e1b6c1a39 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:16.265806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-95b6fc8c-3458-4c17-b565-7b5e1b6c1a39 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:16.290823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95b6fc8c-3458-4c17-b565-7b5e1b6c1a39 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:16.292391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95b6fc8c-3458-4c17-b565-7b5e1b6c1a39 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:16.293999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95b6fc8c-3458-4c17-b565-7b5e1b6c1a39 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:16.295973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95b6fc8c-3458-4c17-b565-7b5e1b6c1a39 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:16.297443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95b6fc8c-3458-4c17-b565-7b5e1b6c1a39 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:16.298523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95b6fc8c-3458-4c17-b565-7b5e1b6c1a39 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:16.702444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-95b6fc8c-3458-4c17-b565-7b5e1b6c1a39 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:16.732962 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-95b6fc8c-3458-4c17-b565-7b5e1b6c1a39 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1276 microversion: 2.1 time: 0.481856 Aug 25 13:02:16.762173 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1418/2818] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:16 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1276 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:02:16.787679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bb69b143-6276-4a37-8557-53253e720090 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:16.790968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bb69b143-6276-4a37-8557-53253e720090 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:16.807592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb69b143-6276-4a37-8557-53253e720090 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:16.808941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb69b143-6276-4a37-8557-53253e720090 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:16.811011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb69b143-6276-4a37-8557-53253e720090 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:16.813025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb69b143-6276-4a37-8557-53253e720090 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:16.815741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb69b143-6276-4a37-8557-53253e720090 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:16.816928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb69b143-6276-4a37-8557-53253e720090 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:17.099561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ff40c3b7-a207-48dc-b035-ec7267adc795 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:17.124942 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff40c3b7-a207-48dc-b035-ec7267adc795 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 200 len: 1448 microversion: 2.1 time: 1.378540 Aug 25 13:02:17.126138 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1401/2819] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:15 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 1448 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:17.146651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b9fb0159-ca70-4160-92f9-fab5d0888c79 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:17.151263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b9fb0159-ca70-4160-92f9-fab5d0888c79 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:17.177741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb0159-ca70-4160-92f9-fab5d0888c79 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:17.179787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb0159-ca70-4160-92f9-fab5d0888c79 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:17.180931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb0159-ca70-4160-92f9-fab5d0888c79 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:17.183496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb0159-ca70-4160-92f9-fab5d0888c79 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:17.184989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb0159-ca70-4160-92f9-fab5d0888c79 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:17.186257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb0159-ca70-4160-92f9-fab5d0888c79 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.063590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b9fb0159-ca70-4160-92f9-fab5d0888c79 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:18.082128 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b9fb0159-ca70-4160-92f9-fab5d0888c79 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1283 microversion: 2.1 time: 0.953310 Aug 25 13:02:18.083682 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1402/2820] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:17 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1283 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:18.094671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b18514ee-7757-4adc-bc8d-45203dacf1e9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Action: 'create', calling method: .version_select at 0x7f3a2e7178b0>, body: {"keypair": {"name": "tempest-keypair-1908816326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGthroaomrHQHHLPy8AgFxkiZZzAcfDcNacKBRF+UwSKurZWpkV296GgTGHPB0pTEJyYvUP0y5KiXmAiUgCM5nBppNFmkVMXW1Pqi0WUcILcNG3fcxTQdSnFy258HD08XA=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:18.142889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-b18514ee-7757-4adc-bc8d-45203dacf1e9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Getting quotas for project f8cc27316e7c44e0a1b9d1f608ee22cc. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:18.158692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-b18514ee-7757-4adc-bc8d-45203dacf1e9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Getting quotas for user 2af4362b4f9e40deb004983ba8cd43a7 and project f8cc27316e7c44e0a1b9d1f608ee22cc. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:18.227526 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b18514ee-7757-4adc-bc8d-45203dacf1e9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.140381 Aug 25 13:02:18.240311 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1403/2821] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Aug 25 13:02:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 13:02:18.260024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:18.262195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:18.278178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.280826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.282633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.285095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.286466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.288961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.370994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:02:18.387457 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.compute.api [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Working on deleting snapshot 27d882c2-80fe-4d3f-bfc5-2c4bb86689fe from shelved instance... Aug 25 13:02:18.801533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bb69b143-6276-4a37-8557-53253e720090 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:18.830389 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bb69b143-6276-4a37-8557-53253e720090 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1402 microversion: 2.1 time: 2.052063 Aug 25 13:02:18.848736 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1419/2822] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:16 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1402 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:18.888396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c512b15c-9b6e-43aa-92aa-339b41532e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:18.892011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c512b15c-9b6e-43aa-92aa-339b41532e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:18.908215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:18.911581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c512b15c-9b6e-43aa-92aa-339b41532e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.914121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c512b15c-9b6e-43aa-92aa-339b41532e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.915405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c512b15c-9b6e-43aa-92aa-339b41532e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.919354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c512b15c-9b6e-43aa-92aa-339b41532e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.920684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c512b15c-9b6e-43aa-92aa-339b41532e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.922067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c512b15c-9b6e-43aa-92aa-339b41532e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:19.196047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c512b15c-9b6e-43aa-92aa-339b41532e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:19.217406 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c512b15c-9b6e-43aa-92aa-339b41532e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1276 microversion: 2.1 time: 0.364173 Aug 25 13:02:19.220607 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1420/2823] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:18 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1276 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:19.231391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d57ec792-3e58-44d7-8ff3-10086447a4a5 req-cc273a1b-c568-4e5c-96ee-ace46a08a8be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0a087a-758a-493c-b573-2d558b6b592e", "tag": "a249548b-1a44-405f-8547-1727f160c723"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:19.259137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d57ec792-3e58-44d7-8ff3-10086447a4a5 req-cc273a1b-c568-4e5c-96ee-ace46a08a8be service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:19.260458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d57ec792-3e58-44d7-8ff3-10086447a4a5 req-cc273a1b-c568-4e5c-96ee-ace46a08a8be service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:19.261387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d57ec792-3e58-44d7-8ff3-10086447a4a5 req-cc273a1b-c568-4e5c-96ee-ace46a08a8be service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:19.293699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d57ec792-3e58-44d7-8ff3-10086447a4a5 req-cc273a1b-c568-4e5c-96ee-ace46a08a8be service nova] Creating event network-changed:a249548b-1a44-405f-8547-1727f160c723 for instance 6e0a087a-758a-493c-b573-2d558b6b592e on n-h2-852771-8 Aug 25 13:02:19.309974 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d57ec792-3e58-44d7-8ff3-10086447a4a5 req-cc273a1b-c568-4e5c-96ee-ace46a08a8be service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085878 Aug 25 13:02:19.311434 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1421/2824] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:19.323877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-940d77a9-88c7-4d38-ab30-bf25b212dc1d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:19.325696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-940d77a9-88c7-4d38-ab30-bf25b212dc1d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:19.341612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-940d77a9-88c7-4d38-ab30-bf25b212dc1d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:19.342589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-940d77a9-88c7-4d38-ab30-bf25b212dc1d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:19.343388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-940d77a9-88c7-4d38-ab30-bf25b212dc1d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:19.345096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-940d77a9-88c7-4d38-ab30-bf25b212dc1d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:19.345899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-940d77a9-88c7-4d38-ab30-bf25b212dc1d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:19.346719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-940d77a9-88c7-4d38-ab30-bf25b212dc1d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:19.826868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:20.502752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Doing local delete in cell 638d90be-ffdb-4b61-b94a-775c50a724be(cell1) {{(pid=129059) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 25 13:02:20.504316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:20.505786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:20.507033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:20.507974 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.compute.api [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 25 13:02:20.515348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] deallocate_for_instance() {{(pid=129059) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 25 13:02:20.632022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-940d77a9-88c7-4d38-ab30-bf25b212dc1d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:20.676336 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-940d77a9-88c7-4d38-ab30-bf25b212dc1d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1283 microversion: 2.1 time: 1.362637 Aug 25 13:02:20.678949 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1422/2825] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:19 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1283 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:20.689761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-192bd94d-4977-4f6e-ba8a-192482f3f51c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:20.705488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-192bd94d-4977-4f6e-ba8a-192482f3f51c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:20.722952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-192bd94d-4977-4f6e-ba8a-192482f3f51c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:20.726078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-192bd94d-4977-4f6e-ba8a-192482f3f51c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:20.727580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-192bd94d-4977-4f6e-ba8a-192482f3f51c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:20.734825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-192bd94d-4977-4f6e-ba8a-192482f3f51c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:20.737032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-192bd94d-4977-4f6e-ba8a-192482f3f51c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:20.738031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-192bd94d-4977-4f6e-ba8a-192482f3f51c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:22.208913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:22.394132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-192bd94d-4977-4f6e-ba8a-192482f3f51c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:22.400040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:22.419970 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-192bd94d-4977-4f6e-ba8a-192482f3f51c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1402 microversion: 2.1 time: 1.737841 Aug 25 13:02:22.422823 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1423/2826] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:20 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1402 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:22.435117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ccaa7466-32f0-4058-8701-086c75d70fbe tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:22.436728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ccaa7466-32f0-4058-8701-086c75d70fbe tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:22.455839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ccaa7466-32f0-4058-8701-086c75d70fbe tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:22.457452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ccaa7466-32f0-4058-8701-086c75d70fbe tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:22.459076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ccaa7466-32f0-4058-8701-086c75d70fbe tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:22.461430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ccaa7466-32f0-4058-8701-086c75d70fbe tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:22.463318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ccaa7466-32f0-4058-8701-086c75d70fbe tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:22.464496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ccaa7466-32f0-4058-8701-086c75d70fbe tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:23.167200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:23.690824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ccaa7466-32f0-4058-8701-086c75d70fbe tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:23.721270 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ccaa7466-32f0-4058-8701-086c75d70fbe tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1318 microversion: 2.1 time: 1.295872 Aug 25 13:02:23.723423 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1424/2827] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:22 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1318 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:23.747400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3fec8bbf-5da5-4e06-a4e3-32af8903f68d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:23.748879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3fec8bbf-5da5-4e06-a4e3-32af8903f68d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:23.765424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fec8bbf-5da5-4e06-a4e3-32af8903f68d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:23.766879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fec8bbf-5da5-4e06-a4e3-32af8903f68d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:23.769332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fec8bbf-5da5-4e06-a4e3-32af8903f68d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:23.771137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fec8bbf-5da5-4e06-a4e3-32af8903f68d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:23.773829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fec8bbf-5da5-4e06-a4e3-32af8903f68d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:23.774683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fec8bbf-5da5-4e06-a4e3-32af8903f68d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:25.667654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3fec8bbf-5da5-4e06-a4e3-32af8903f68d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:25.697469 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3fec8bbf-5da5-4e06-a4e3-32af8903f68d tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1350 microversion: 2.1 time: 1.969687 Aug 25 13:02:25.699396 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1425/2828] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:23 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1350 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:25.734417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f3df21d2-ed7a-4dd4-b646-18ea32479d4d req-8d776191-4533-48b4-964b-07d9858307cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaf403a-3a50-4864-845c-340bf0a70683", "tag": "b5ebb407-44f3-4334-8a0d-f16b9fd1b1a0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:25.759984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f3df21d2-ed7a-4dd4-b646-18ea32479d4d req-8d776191-4533-48b4-964b-07d9858307cc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:25.761487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f3df21d2-ed7a-4dd4-b646-18ea32479d4d req-8d776191-4533-48b4-964b-07d9858307cc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:25.762201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f3df21d2-ed7a-4dd4-b646-18ea32479d4d req-8d776191-4533-48b4-964b-07d9858307cc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:25.789885 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f3df21d2-ed7a-4dd4-b646-18ea32479d4d req-8d776191-4533-48b4-964b-07d9858307cc service nova] Creating event network-changed:b5ebb407-44f3-4334-8a0d-f16b9fd1b1a0 for instance 1eaf403a-3a50-4864-845c-340bf0a70683 on n-h2-852771-8 Aug 25 13:02:25.799857 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f3df21d2-ed7a-4dd4-b646-18ea32479d4d req-8d776191-4533-48b4-964b-07d9858307cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096906 Aug 25 13:02:25.801319 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1426/2829] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:25.811630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb1b72ce-8e85-4751-826a-3dfd9b060dee tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:25.813444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb1b72ce-8e85-4751-826a-3dfd9b060dee tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:25.831726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1b72ce-8e85-4751-826a-3dfd9b060dee tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:25.832738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1b72ce-8e85-4751-826a-3dfd9b060dee tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:25.833645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1b72ce-8e85-4751-826a-3dfd9b060dee tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:25.836550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1b72ce-8e85-4751-826a-3dfd9b060dee tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:25.837451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1b72ce-8e85-4751-826a-3dfd9b060dee tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:25.838544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb1b72ce-8e85-4751-826a-3dfd9b060dee tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:27.238899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Updating instance_info_cache with network_info: [] {{(pid=129059) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 13:02:27.569319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cb1b72ce-8e85-4751-826a-3dfd9b060dee tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:27.606716 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb1b72ce-8e85-4751-826a-3dfd9b060dee tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1402 microversion: 2.1 time: 1.803250 Aug 25 13:02:27.611359 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1427/2830] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:25 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1402 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:27.623830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6247cebf-0c49-4782-beac-e8c7f21e1015 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:27.626080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6247cebf-0c49-4782-beac-e8c7f21e1015 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:27.643156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6247cebf-0c49-4782-beac-e8c7f21e1015 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:27.644976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6247cebf-0c49-4782-beac-e8c7f21e1015 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:27.647571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6247cebf-0c49-4782-beac-e8c7f21e1015 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:27.649844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6247cebf-0c49-4782-beac-e8c7f21e1015 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:27.652555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6247cebf-0c49-4782-beac-e8c7f21e1015 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:27.653586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6247cebf-0c49-4782-beac-e8c7f21e1015 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:28.122174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=9,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:28.196279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=44 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:28.274577 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7fe374a4-eb1f-4321-8d83-c9229bf94200 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 204 len: 0 microversion: 2.1 time: 10.027857 Aug 25 13:02:28.277950 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1404/2831] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:02:18 2022] DELETE /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 0 bytes in 10037 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:02:28.295023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d6bbee1-5c76-4d25-87f0-1a8ba99b0b78 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:28.298749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d6bbee1-5c76-4d25-87f0-1a8ba99b0b78 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:28.316452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d6bbee1-5c76-4d25-87f0-1a8ba99b0b78 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:28.318020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d6bbee1-5c76-4d25-87f0-1a8ba99b0b78 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:28.320404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d6bbee1-5c76-4d25-87f0-1a8ba99b0b78 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:28.322765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d6bbee1-5c76-4d25-87f0-1a8ba99b0b78 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:28.324123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d6bbee1-5c76-4d25-87f0-1a8ba99b0b78 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:28.325295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d6bbee1-5c76-4d25-87f0-1a8ba99b0b78 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:29.395571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6247cebf-0c49-4782-beac-e8c7f21e1015 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:29.417858 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6247cebf-0c49-4782-beac-e8c7f21e1015 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1318 microversion: 2.1 time: 1.802887 Aug 25 13:02:29.434747 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1428/2832] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:27 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1318 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:29.453226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-439977470", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5261ad03-70eb-4bdc-9408-1286ed68a3e6"}, {"port": "2cf476bc-998d-4575-aaf0-a2986161d365", "tag": "port-1"}, {"port": "d8ec31a3-80bb-4d7b-bc7a-5a21d51389c7", "tag": "port-2"}, {"uuid": "b2b2b67e-3c69-4b98-8466-ae1dedbfa1ca", "tag": "net-1"}, {"uuid": "b2b2b67e-3c69-4b98-8466-ae1dedbfa1ca"}, {"uuid": "a8d9727f-6936-462e-8c9d-e12cd5fd429d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a8d9727f-6936-462e-8c9d-e12cd5fd429d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0910034e-3b98-496e-b77e-e998d8e12b01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9beb680f-4302-4355-9f7d-b2e11951c04b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "44c1f8a2-010c-4164-8813-19cc4253e6b1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--861302622"}], "key_name": "tempest-keypair-1908816326", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:29.972092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6d6bbee1-5c76-4d25-87f0-1a8ba99b0b78 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:30.002829 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d6bbee1-5c76-4d25-87f0-1a8ba99b0b78 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1350 microversion: 2.1 time: 1.720836 Aug 25 13:02:30.005424 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1405/2833] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:28 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1350 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:30.018761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0b11ecdd-f75d-4483-bfaa-dffa9e35bdd2 req-adf41a27-74a3-4d44-b91b-d842bb379d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e64e778-70de-4c3e-9c61-f2c8bec2d5ec", "name": "network-vif-deleted", "tag": "8f2e03c2-5abc-4f32-8f18-4699fec26d8d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:30.082666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0b11ecdd-f75d-4483-bfaa-dffa9e35bdd2 req-adf41a27-74a3-4d44-b91b-d842bb379d29 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:30.083872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0b11ecdd-f75d-4483-bfaa-dffa9e35bdd2 req-adf41a27-74a3-4d44-b91b-d842bb379d29 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:30.088840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0b11ecdd-f75d-4483-bfaa-dffa9e35bdd2 req-adf41a27-74a3-4d44-b91b-d842bb379d29 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:30.129855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.server_external_events [req-0b11ecdd-f75d-4483-bfaa-dffa9e35bdd2 req-adf41a27-74a3-4d44-b91b-d842bb379d29 service nova] Unable to find a host for instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec. Dropping event network-vif-deleted {{(pid=129059) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 13:02:30.132025 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0b11ecdd-f75d-4483-bfaa-dffa9e35bdd2 req-adf41a27-74a3-4d44-b91b-d842bb379d29 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.124328 Aug 25 13:02:30.139125 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1406/2834] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 133 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 13:02:30.150765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c988dcd8-d960-4e18-8aa0-708275f943bc req-5af1af67-c702-476d-8a3c-68675eff5f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b109be4f-78d3-4756-baad-da4d207af9d6", "tag": "b1739094-bd39-4996-a2e1-43a8b97c716f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:30.190733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c988dcd8-d960-4e18-8aa0-708275f943bc req-5af1af67-c702-476d-8a3c-68675eff5f3e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:30.195061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c988dcd8-d960-4e18-8aa0-708275f943bc req-5af1af67-c702-476d-8a3c-68675eff5f3e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:30.196095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c988dcd8-d960-4e18-8aa0-708275f943bc req-5af1af67-c702-476d-8a3c-68675eff5f3e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:30.226935 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c988dcd8-d960-4e18-8aa0-708275f943bc req-5af1af67-c702-476d-8a3c-68675eff5f3e service nova] Creating event network-changed:b1739094-bd39-4996-a2e1-43a8b97c716f for instance b109be4f-78d3-4756-baad-da4d207af9d6 on n-h2-852771-8 Aug 25 13:02:30.265329 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c988dcd8-d960-4e18-8aa0-708275f943bc req-5af1af67-c702-476d-8a3c-68675eff5f3e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119328 Aug 25 13:02:30.275360 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1407/2835] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:30.291821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:30.293699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:30.320361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:30.328549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:30.334111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:30.335948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:30.341684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:30.342896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:30.418130 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec HTTP/1.1 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7e64e778-70de-4c3e-9c61-f2c8bec2d5ec'} Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:30.421439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:30.433944 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:30.433944 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:30.433944 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:30.433944 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:30.433944 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:30.433944 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:02:30.433944 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:30.433944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:30.433944 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f89d41f5-b911-41ae-9bf2-57dbd7f48c2b tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 404 len: 111 microversion: 2.1 time: 0.149502 Aug 25 13:02:30.436889 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1408/2836] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:30 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:30.445415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-35c1cfb8-1f2d-4cf2-a0a2-0b23d291277a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:30.447052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-35c1cfb8-1f2d-4cf2-a0a2-0b23d291277a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:30.476294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35c1cfb8-1f2d-4cf2-a0a2-0b23d291277a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:30.478164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35c1cfb8-1f2d-4cf2-a0a2-0b23d291277a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:30.479738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35c1cfb8-1f2d-4cf2-a0a2-0b23d291277a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:30.481557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35c1cfb8-1f2d-4cf2-a0a2-0b23d291277a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:30.483037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35c1cfb8-1f2d-4cf2-a0a2-0b23d291277a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:30.485029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35c1cfb8-1f2d-4cf2-a0a2-0b23d291277a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:30.592175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] validate_networks() for [('5261ad03-70eb-4bdc-9408-1286ed68a3e6', None, None, None, None, None), (None, None, '2cf476bc-998d-4575-aaf0-a2986161d365', None, None, None), (None, None, 'd8ec31a3-80bb-4d7b-bc7a-5a21d51389c7', None, None, None), ('b2b2b67e-3c69-4b98-8466-ae1dedbfa1ca', None, None, None, None, None), ('b2b2b67e-3c69-4b98-8466-ae1dedbfa1ca', None, None, None, None, None), ('a8d9727f-6936-462e-8c9d-e12cd5fd429d', '10.2.2.100', None, None, None, None), ('a8d9727f-6936-462e-8c9d-e12cd5fd429d', '10.2.2.200', None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:02:31.657753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-35c1cfb8-1f2d-4cf2-a0a2-0b23d291277a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:31.705361 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-35c1cfb8-1f2d-4cf2-a0a2-0b23d291277a tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1402 microversion: 2.1 time: 1.261545 Aug 25 13:02:31.706830 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1409/2837] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:30 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1402 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:31.722486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-20ff3280-dec9-439f-9b0c-cd091e864a8f req-74f23594-d14b-4351-b5bd-f7a6375bff37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0a087a-758a-493c-b573-2d558b6b592e", "name": "network-vif-plugged", "status": "completed", "tag": "a249548b-1a44-405f-8547-1727f160c723"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:31.749810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-20ff3280-dec9-439f-9b0c-cd091e864a8f req-74f23594-d14b-4351-b5bd-f7a6375bff37 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:31.751074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-20ff3280-dec9-439f-9b0c-cd091e864a8f req-74f23594-d14b-4351-b5bd-f7a6375bff37 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:31.752123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-20ff3280-dec9-439f-9b0c-cd091e864a8f req-74f23594-d14b-4351-b5bd-f7a6375bff37 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:31.786753 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-20ff3280-dec9-439f-9b0c-cd091e864a8f req-74f23594-d14b-4351-b5bd-f7a6375bff37 service nova] Creating event network-vif-plugged:a249548b-1a44-405f-8547-1727f160c723 for instance 6e0a087a-758a-493c-b573-2d558b6b592e on n-h2-852771-8 Aug 25 13:02:31.803379 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-20ff3280-dec9-439f-9b0c-cd091e864a8f req-74f23594-d14b-4351-b5bd-f7a6375bff37 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093817 Aug 25 13:02:31.819758 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1410/2838] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:31.828262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa07d1d7-e57e-463f-9c70-1d53d1527a17 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:31.830026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa07d1d7-e57e-463f-9c70-1d53d1527a17 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:31.861343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa07d1d7-e57e-463f-9c70-1d53d1527a17 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:31.862633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa07d1d7-e57e-463f-9c70-1d53d1527a17 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:31.863987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa07d1d7-e57e-463f-9c70-1d53d1527a17 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:31.865653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa07d1d7-e57e-463f-9c70-1d53d1527a17 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:31.866790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa07d1d7-e57e-463f-9c70-1d53d1527a17 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:31.867831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa07d1d7-e57e-463f-9c70-1d53d1527a17 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:32.722970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fa07d1d7-e57e-463f-9c70-1d53d1527a17 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:32.738752 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa07d1d7-e57e-463f-9c70-1d53d1527a17 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1318 microversion: 2.1 time: 0.924328 Aug 25 13:02:32.740474 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1411/2839] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:31 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1318 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:32.780587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-646724486", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "8786102b-a15d-4894-b94c-776d2b47ed6a"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:32.891810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] validate_networks() for [('8786102b-a15d-4894-b94c-776d2b47ed6a', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:02:36.202363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:02:36.204634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:02:36.207136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:02:36.208252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:02:36.209362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:02:36.246278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:36.247661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:36.248562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:36.250042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:36.250890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:36.252116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:36.284594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:36.298183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for user 2b81a6a01a24413b8212f140080ed018 and project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:36.333093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:02:36.338254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:02:36.369626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:36.433944 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1bb33ee0-212f-425a-a8a2-f43be436db23 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.675036 Aug 25 13:02:36.436017 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1412/2840] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:02:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:02:36.442740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9cec825f-b731-4e0e-ad25-3155d01e2fd5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:36.443950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9cec825f-b731-4e0e-ad25-3155d01e2fd5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:36.455595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cec825f-b731-4e0e-ad25-3155d01e2fd5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:36.457185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cec825f-b731-4e0e-ad25-3155d01e2fd5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:36.458415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cec825f-b731-4e0e-ad25-3155d01e2fd5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:36.460675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cec825f-b731-4e0e-ad25-3155d01e2fd5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:36.461870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cec825f-b731-4e0e-ad25-3155d01e2fd5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:36.462974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cec825f-b731-4e0e-ad25-3155d01e2fd5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:37.606734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9cec825f-b731-4e0e-ad25-3155d01e2fd5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:37.626584 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9cec825f-b731-4e0e-ad25-3155d01e2fd5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1350 microversion: 2.1 time: 1.188519 Aug 25 13:02:37.627684 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1413/2841] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:36 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1350 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:37.671103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d234627a-a2d0-41df-9b20-e97e7009014c req-d72429f4-0a22-4387-888c-1d0ab9ecbfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59f80e3-c2a8-4ca1-b4cd-41027f74aa90", "tag": "cef37bc8-24da-4194-a393-9253f1b67704"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:37.713680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d234627a-a2d0-41df-9b20-e97e7009014c req-d72429f4-0a22-4387-888c-1d0ab9ecbfe2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:37.714973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d234627a-a2d0-41df-9b20-e97e7009014c req-d72429f4-0a22-4387-888c-1d0ab9ecbfe2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:37.716071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d234627a-a2d0-41df-9b20-e97e7009014c req-d72429f4-0a22-4387-888c-1d0ab9ecbfe2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:37.741719 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d234627a-a2d0-41df-9b20-e97e7009014c req-d72429f4-0a22-4387-888c-1d0ab9ecbfe2 service nova] Creating event network-changed:cef37bc8-24da-4194-a393-9253f1b67704 for instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 on n-h2-852771-8 Aug 25 13:02:37.754507 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d234627a-a2d0-41df-9b20-e97e7009014c req-d72429f4-0a22-4387-888c-1d0ab9ecbfe2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124485 Aug 25 13:02:37.755627 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1414/2842] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:37.766808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb447322-e87f-4949-8c6d-179447b80d33 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:37.769489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fb447322-e87f-4949-8c6d-179447b80d33 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:37.783822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb447322-e87f-4949-8c6d-179447b80d33 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:37.785103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb447322-e87f-4949-8c6d-179447b80d33 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:37.786368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb447322-e87f-4949-8c6d-179447b80d33 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:37.788319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb447322-e87f-4949-8c6d-179447b80d33 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:37.789623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb447322-e87f-4949-8c6d-179447b80d33 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:37.790904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb447322-e87f-4949-8c6d-179447b80d33 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:38.622373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fb447322-e87f-4949-8c6d-179447b80d33 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:38.679643 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb447322-e87f-4949-8c6d-179447b80d33 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1589 microversion: 2.1 time: 0.919136 Aug 25 13:02:38.680367 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1415/2843] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:37 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1589 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:38.697210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-09c159b9-bb43-47c2-9f6e-98e12b6f5608 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:38.702097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-09c159b9-bb43-47c2-9f6e-98e12b6f5608 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:38.725807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09c159b9-bb43-47c2-9f6e-98e12b6f5608 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:38.737632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09c159b9-bb43-47c2-9f6e-98e12b6f5608 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:38.738904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09c159b9-bb43-47c2-9f6e-98e12b6f5608 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:38.740800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09c159b9-bb43-47c2-9f6e-98e12b6f5608 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:38.742062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09c159b9-bb43-47c2-9f6e-98e12b6f5608 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:38.743162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09c159b9-bb43-47c2-9f6e-98e12b6f5608 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:39.429580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=27 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:39.854901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-09c159b9-bb43-47c2-9f6e-98e12b6f5608 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:39.878278 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-09c159b9-bb43-47c2-9f6e-98e12b6f5608 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1318 microversion: 2.1 time: 1.195632 Aug 25 13:02:39.880803 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1416/2844] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:38 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1318 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:40.507905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-575dfaff-4aad-409e-b472-8d1a365402a3 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-264050655", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:40.519007 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-575dfaff-4aad-409e-b472-8d1a365402a3 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] HTTP exception thrown: min_count must be <= max_count Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-575dfaff-4aad-409e-b472-8d1a365402a3 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Request method failure captured: Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 183 Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3Lqw5dPMCJw6tMiS3VYwGkEsm_LG59zKWoJ0R_liSYRAdQ36YhIBG2cDSIspgKEMg_BMqnFvywmPHBmCka3hiKNRrJQm-KYYzQsojhOD1oROdREkbAzs3enp7TEJBXyFvrLT8D4lY8gg1rYyOQt3MGy4tBlZF_9MJOTqOJh6CSt8uo Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: c37a9a8216a048cbadfe33a0bf826826 Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c37a9a8216a048cbadfe33a0bf826826"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c37a9a8216a048cbadfe33a0bf826826", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c37a9a8216a048cbadfe33a0bf826826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c37a9a8216a048cbadfe33a0bf826826"}]}] Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: c37a9a8216a048cbadfe33a0bf826826 Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-MultipleCreateNegativeTestJSON-1308250900-project Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1a4b644610ea470b9c1efb6c1f94932d Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1308250900-project Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-264050655", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: exception: min_count must be <= max_count Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-264050655', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 25 13:02:40.527044 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:40.533331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-575dfaff-4aad-409e-b472-8d1a365402a3 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Returning 400 to user: min_count must be <= max_count {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:40.535403 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-575dfaff-4aad-409e-b472-8d1a365402a3 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.651684 Aug 25 13:02:40.539227 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1417/2845] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:02:39 2022] POST /compute/v2.1/servers => generated 74 bytes in 657 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 13:02:40.562611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f550372f-7315-4de0-830a-0a1fc77d6207 req-c71f3ed8-dd4d-4f0f-9ded-55838e18db3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b109be4f-78d3-4756-baad-da4d207af9d6", "name": "network-vif-plugged", "status": "completed", "tag": "b1739094-bd39-4996-a2e1-43a8b97c716f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:40.581410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f550372f-7315-4de0-830a-0a1fc77d6207 req-c71f3ed8-dd4d-4f0f-9ded-55838e18db3a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:40.582265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f550372f-7315-4de0-830a-0a1fc77d6207 req-c71f3ed8-dd4d-4f0f-9ded-55838e18db3a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:40.582906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f550372f-7315-4de0-830a-0a1fc77d6207 req-c71f3ed8-dd4d-4f0f-9ded-55838e18db3a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:40.596929 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f550372f-7315-4de0-830a-0a1fc77d6207 req-c71f3ed8-dd4d-4f0f-9ded-55838e18db3a service nova] Creating event network-vif-plugged:b1739094-bd39-4996-a2e1-43a8b97c716f for instance b109be4f-78d3-4756-baad-da4d207af9d6 on n-h2-852771-8 Aug 25 13:02:40.605782 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f550372f-7315-4de0-830a-0a1fc77d6207 req-c71f3ed8-dd4d-4f0f-9ded-55838e18db3a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053973 Aug 25 13:02:40.607186 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1418/2846] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:40.617736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fd6de0b7-6788-4469-b630-3be7a5a98e93 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:40.618829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fd6de0b7-6788-4469-b630-3be7a5a98e93 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:40.628697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd6de0b7-6788-4469-b630-3be7a5a98e93 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:40.630009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd6de0b7-6788-4469-b630-3be7a5a98e93 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:40.630869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd6de0b7-6788-4469-b630-3be7a5a98e93 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:40.633817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd6de0b7-6788-4469-b630-3be7a5a98e93 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:40.634912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd6de0b7-6788-4469-b630-3be7a5a98e93 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:40.635591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd6de0b7-6788-4469-b630-3be7a5a98e93 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:40.987296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fd6de0b7-6788-4469-b630-3be7a5a98e93 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:41.018440 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fd6de0b7-6788-4469-b630-3be7a5a98e93 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1274 microversion: 2.1 time: 0.409047 Aug 25 13:02:41.019605 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1419/2847] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:40 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1274 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:41.036513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1036044-1a1e-49a0-87f2-a9747cceac29 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:41.049103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e1036044-1a1e-49a0-87f2-a9747cceac29 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:41.064449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1036044-1a1e-49a0-87f2-a9747cceac29 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:41.075761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1036044-1a1e-49a0-87f2-a9747cceac29 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:41.076872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1036044-1a1e-49a0-87f2-a9747cceac29 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:41.078790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1036044-1a1e-49a0-87f2-a9747cceac29 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:41.079575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1036044-1a1e-49a0-87f2-a9747cceac29 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:41.080261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1036044-1a1e-49a0-87f2-a9747cceac29 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:42.276913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e1036044-1a1e-49a0-87f2-a9747cceac29 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:42.318327 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e1036044-1a1e-49a0-87f2-a9747cceac29 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1350 microversion: 2.1 time: 1.288679 Aug 25 13:02:42.321938 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1420/2848] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:41 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1350 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:42.332197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-60582412-4684-49cf-9319-a5cae3e12ceb tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:42.334018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-60582412-4684-49cf-9319-a5cae3e12ceb tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:42.409971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60582412-4684-49cf-9319-a5cae3e12ceb tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:42.414534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60582412-4684-49cf-9319-a5cae3e12ceb tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:42.425384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60582412-4684-49cf-9319-a5cae3e12ceb tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:42.445703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60582412-4684-49cf-9319-a5cae3e12ceb tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:42.451270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60582412-4684-49cf-9319-a5cae3e12ceb tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:42.457545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60582412-4684-49cf-9319-a5cae3e12ceb tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:42.970946 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-60582412-4684-49cf-9319-a5cae3e12ceb tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.646090 Aug 25 13:02:42.986701 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1421/2849] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:02:42 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e/os-interface => generated 284 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:43.017585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8c85ff1-3e76-4dd4-976e-b0c3a5eca221 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1946061520", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "max_count": 0}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8c85ff1-3e76-4dd4-976e-b0c3a5eca221 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Request method failure captured: Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 168 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3Lqw5dPMCJw6tMiS3VYwGkEsm_LG59zKWoJ0R_liSYRAdQ36YhIBG2cDSIspgKEMg_BMqnFvywmPHBmCka3hiKNRrJQm-KYYzQsojhOD1oROdREkbAzs3enp7TEJBXyFvrLT8D4lY8gg1rYyOQt3MGy4tBlZF_9MJOTqOJh6CSt8uo Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: c37a9a8216a048cbadfe33a0bf826826 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c37a9a8216a048cbadfe33a0bf826826"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c37a9a8216a048cbadfe33a0bf826826", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c37a9a8216a048cbadfe33a0bf826826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c37a9a8216a048cbadfe33a0bf826826"}]}] Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: c37a9a8216a048cbadfe33a0bf826826 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-MultipleCreateNegativeTestJSON-1308250900-project Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1a4b644610ea470b9c1efb6c1f94932d Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1308250900-project Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1946061520", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "max_count": 0}} Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1946061520', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'max_count': 0}}} Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 0 Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:02:43.037895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 25 13:02:43.050969 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:43.073026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8c85ff1-3e76-4dd4-976e-b0c3a5eca221 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:43.075478 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8c85ff1-3e76-4dd4-976e-b0c3a5eca221 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.086018 Aug 25 13:02:43.090580 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1422/2850] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:02:42 2022] POST /compute/v2.1/servers => generated 130 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:02:43.109864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df5950d0-02a0-4294-86ef-eb254c85fb8c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:43.111772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df5950d0-02a0-4294-86ef-eb254c85fb8c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:43.144479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5950d0-02a0-4294-86ef-eb254c85fb8c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:43.146273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5950d0-02a0-4294-86ef-eb254c85fb8c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:43.149403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5950d0-02a0-4294-86ef-eb254c85fb8c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:43.151397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5950d0-02a0-4294-86ef-eb254c85fb8c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:43.152796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5950d0-02a0-4294-86ef-eb254c85fb8c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:43.154127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df5950d0-02a0-4294-86ef-eb254c85fb8c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:43.346198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=21 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:45.776023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df5950d0-02a0-4294-86ef-eb254c85fb8c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:45.808484 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df5950d0-02a0-4294-86ef-eb254c85fb8c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1318 microversion: 2.1 time: 2.715307 Aug 25 13:02:45.817868 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1423/2851] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:43 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1318 bytes in 2726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:45.883341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5699d0de-fd32-426a-96bf-2ae7c888f1f5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:45.888428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5699d0de-fd32-426a-96bf-2ae7c888f1f5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:45.916667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5699d0de-fd32-426a-96bf-2ae7c888f1f5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:45.917539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5699d0de-fd32-426a-96bf-2ae7c888f1f5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:45.918336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5699d0de-fd32-426a-96bf-2ae7c888f1f5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:45.919734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5699d0de-fd32-426a-96bf-2ae7c888f1f5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:45.920622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5699d0de-fd32-426a-96bf-2ae7c888f1f5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:45.921436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5699d0de-fd32-426a-96bf-2ae7c888f1f5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:46.218004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5699d0de-fd32-426a-96bf-2ae7c888f1f5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:46.269339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:46.291366 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5699d0de-fd32-426a-96bf-2ae7c888f1f5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1272 microversion: 2.1 time: 0.446528 Aug 25 13:02:46.297261 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1424/2852] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:45 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1272 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:46.343901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0435e50c-402e-4452-8c06-39f6d39fc80d req-c7e8a046-2114-4ac1-b484-e9b75daae320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaf403a-3a50-4864-845c-340bf0a70683", "name": "network-vif-plugged", "status": "completed", "tag": "b5ebb407-44f3-4334-8a0d-f16b9fd1b1a0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:46.396271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:46.430447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0435e50c-402e-4452-8c06-39f6d39fc80d req-c7e8a046-2114-4ac1-b484-e9b75daae320 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:46.448167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0435e50c-402e-4452-8c06-39f6d39fc80d req-c7e8a046-2114-4ac1-b484-e9b75daae320 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:46.451466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0435e50c-402e-4452-8c06-39f6d39fc80d req-c7e8a046-2114-4ac1-b484-e9b75daae320 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:46.499961 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-0435e50c-402e-4452-8c06-39f6d39fc80d req-c7e8a046-2114-4ac1-b484-e9b75daae320 service nova] Creating event network-vif-plugged:b5ebb407-44f3-4334-8a0d-f16b9fd1b1a0 for instance 1eaf403a-3a50-4864-845c-340bf0a70683 on n-h2-852771-8 Aug 25 13:02:46.523475 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0435e50c-402e-4452-8c06-39f6d39fc80d req-c7e8a046-2114-4ac1-b484-e9b75daae320 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220288 Aug 25 13:02:46.542533 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1425/2853] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:46.587648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b2d3a3a1-52b6-4678-b076-f162fe2b857e tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2122894922", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "max_count": 2.5}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b2d3a3a1-52b6-4678-b076-f162fe2b857e tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Request method failure captured: Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 170 Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3Lqw5dPMCJw6tMiS3VYwGkEsm_LG59zKWoJ0R_liSYRAdQ36YhIBG2cDSIspgKEMg_BMqnFvywmPHBmCka3hiKNRrJQm-KYYzQsojhOD1oROdREkbAzs3enp7TEJBXyFvrLT8D4lY8gg1rYyOQt3MGy4tBlZF_9MJOTqOJh6CSt8uo Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: c37a9a8216a048cbadfe33a0bf826826 Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c37a9a8216a048cbadfe33a0bf826826"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c37a9a8216a048cbadfe33a0bf826826", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c37a9a8216a048cbadfe33a0bf826826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c37a9a8216a048cbadfe33a0bf826826"}]}] Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: c37a9a8216a048cbadfe33a0bf826826 Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-MultipleCreateNegativeTestJSON-1308250900-project Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1a4b644610ea470b9c1efb6c1f94932d Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1308250900-project Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2122894922", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "max_count": 2.5}} Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2122894922', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'max_count': 2.5}}} Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 2.5 Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:02:46.602896 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 13:02:46.614846 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:46.623136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b2d3a3a1-52b6-4678-b076-f162fe2b857e tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:46.623136 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b2d3a3a1-52b6-4678-b076-f162fe2b857e tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.062089 Aug 25 13:02:46.624777 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1426/2854] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:02:46 2022] POST /compute/v2.1/servers => generated 139 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:02:46.650571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b7e1d0e-4696-4eb7-9414-490ece0981ae tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:46.657312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b7e1d0e-4696-4eb7-9414-490ece0981ae tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:46.684007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7e1d0e-4696-4eb7-9414-490ece0981ae tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:46.685471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7e1d0e-4696-4eb7-9414-490ece0981ae tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:46.687723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7e1d0e-4696-4eb7-9414-490ece0981ae tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:46.689913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7e1d0e-4696-4eb7-9414-490ece0981ae tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:46.691291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7e1d0e-4696-4eb7-9414-490ece0981ae tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:46.692395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7e1d0e-4696-4eb7-9414-490ece0981ae tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:47.902251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b7e1d0e-4696-4eb7-9414-490ece0981ae tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:47.952071 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b7e1d0e-4696-4eb7-9414-490ece0981ae tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1350 microversion: 2.1 time: 1.324822 Aug 25 13:02:47.953168 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1427/2855] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:46 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1350 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:47.968034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d67f9f38-7268-400d-81d7-4bcb86a67a30 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-493059703", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 0}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d67f9f38-7268-400d-81d7-4bcb86a67a30 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Request method failure captured: Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 167 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3Lqw5dPMCJw6tMiS3VYwGkEsm_LG59zKWoJ0R_liSYRAdQ36YhIBG2cDSIspgKEMg_BMqnFvywmPHBmCka3hiKNRrJQm-KYYzQsojhOD1oROdREkbAzs3enp7TEJBXyFvrLT8D4lY8gg1rYyOQt3MGy4tBlZF_9MJOTqOJh6CSt8uo Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: c37a9a8216a048cbadfe33a0bf826826 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c37a9a8216a048cbadfe33a0bf826826"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c37a9a8216a048cbadfe33a0bf826826", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c37a9a8216a048cbadfe33a0bf826826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c37a9a8216a048cbadfe33a0bf826826"}]}] Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: c37a9a8216a048cbadfe33a0bf826826 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-MultipleCreateNegativeTestJSON-1308250900-project Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1a4b644610ea470b9c1efb6c1f94932d Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1308250900-project Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-493059703", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 0}} Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-493059703', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'min_count': 0}}} Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 0 Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:02:47.979642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d67f9f38-7268-400d-81d7-4bcb86a67a30 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:47.993592 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d67f9f38-7268-400d-81d7-4bcb86a67a30 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.036786 Aug 25 13:02:47.999226 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1428/2856] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:02:47 2022] POST /compute/v2.1/servers => generated 130 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:02:48.018439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6fd8190e-9fc4-4a00-b329-558be5675434 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:48.024049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6fd8190e-9fc4-4a00-b329-558be5675434 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:48.040146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fd8190e-9fc4-4a00-b329-558be5675434 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:48.042173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fd8190e-9fc4-4a00-b329-558be5675434 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:48.043085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fd8190e-9fc4-4a00-b329-558be5675434 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:48.045039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fd8190e-9fc4-4a00-b329-558be5675434 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:48.046534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fd8190e-9fc4-4a00-b329-558be5675434 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:48.047913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fd8190e-9fc4-4a00-b329-558be5675434 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:48.487853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:02:48.491594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:02:48.494865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:02:48.496991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:02:48.498074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:02:48.542192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:48.543295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:48.546455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:48.551101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:48.553832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:48.555384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:48.678852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Getting quotas for project f8cc27316e7c44e0a1b9d1f608ee22cc. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:48.707972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Getting quotas for user 2af4362b4f9e40deb004983ba8cd43a7 and project f8cc27316e7c44e0a1b9d1f608ee22cc. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:49.310081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:02:49.347824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0910034e-3b98-496e-b77e-e998d8e12b01',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9beb680f-4302-4355-9f7d-b2e11951c04b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44c1f8a2-010c-4164-8813-19cc4253e6b1',volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:02:49.880464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6fd8190e-9fc4-4a00-b329-558be5675434 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:49.887460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:DELETE=2,nova_cell1:SELECT=91 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:49.922556 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6fd8190e-9fc4-4a00-b329-558be5675434 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1468 microversion: 2.1 time: 1.920666 Aug 25 13:02:49.938584 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1429/2857] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:47 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1468 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:49.980683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f517f7c-a227-46e3-a1a2-88fe10acce6c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:49.982460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f517f7c-a227-46e3-a1a2-88fe10acce6c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:49.998483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f517f7c-a227-46e3-a1a2-88fe10acce6c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:50.001239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f517f7c-a227-46e3-a1a2-88fe10acce6c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:50.002864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f517f7c-a227-46e3-a1a2-88fe10acce6c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:50.004727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f517f7c-a227-46e3-a1a2-88fe10acce6c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:50.006716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f517f7c-a227-46e3-a1a2-88fe10acce6c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:50.008102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f517f7c-a227-46e3-a1a2-88fe10acce6c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:50.508300 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c964f2e6-d7af-42f3-846e-118f80f87d5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 21.068296 Aug 25 13:02:50.511039 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1429/2858] 10.222.0.70 () {62 vars in 1189 bytes} [Thu Aug 25 13:02:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 21076 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:02:50.520768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-633403d1-47f1-4584-96d0-25d631762974 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-756224406", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 2.5}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-633403d1-47f1-4584-96d0-25d631762974 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Request method failure captured: Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 169 Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3Lqw5dPMCJw6tMiS3VYwGkEsm_LG59zKWoJ0R_liSYRAdQ36YhIBG2cDSIspgKEMg_BMqnFvywmPHBmCka3hiKNRrJQm-KYYzQsojhOD1oROdREkbAzs3enp7TEJBXyFvrLT8D4lY8gg1rYyOQt3MGy4tBlZF_9MJOTqOJh6CSt8uo Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c37a9a8216a048cbadfe33a0bf826826 Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c37a9a8216a048cbadfe33a0bf826826"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c37a9a8216a048cbadfe33a0bf826826", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c37a9a8216a048cbadfe33a0bf826826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c37a9a8216a048cbadfe33a0bf826826"}]}] Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c37a9a8216a048cbadfe33a0bf826826 Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1308250900 Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-MultipleCreateNegativeTestJSON-1308250900-project Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1a4b644610ea470b9c1efb6c1f94932d Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1308250900-project Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-756224406", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 2.5}} Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-756224406', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'min_count': 2.5}}} Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 2.5 Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:02:50.531096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 13:02:50.543368 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:02:50.551422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-633403d1-47f1-4584-96d0-25d631762974 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:50.553786 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-633403d1-47f1-4584-96d0-25d631762974 tempest-MultipleCreateNegativeTestJSON-1308250900 tempest-MultipleCreateNegativeTestJSON-1308250900-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037778 Aug 25 13:02:50.555866 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1430/2859] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:02:50 2022] POST /compute/v2.1/servers => generated 139 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:02:50.572234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-378b2639-ff9b-4a12-ad3c-a9873c992e01 req-ed98a9b4-49aa-45d0-b29e-dc2cddb125fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59f80e3-c2a8-4ca1-b4cd-41027f74aa90", "name": "network-vif-plugged", "status": "completed", "tag": "cef37bc8-24da-4194-a393-9253f1b67704"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:50.602243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-378b2639-ff9b-4a12-ad3c-a9873c992e01 req-ed98a9b4-49aa-45d0-b29e-dc2cddb125fa service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:50.619356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-378b2639-ff9b-4a12-ad3c-a9873c992e01 req-ed98a9b4-49aa-45d0-b29e-dc2cddb125fa service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:50.625062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-378b2639-ff9b-4a12-ad3c-a9873c992e01 req-ed98a9b4-49aa-45d0-b29e-dc2cddb125fa service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:50.689234 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-378b2639-ff9b-4a12-ad3c-a9873c992e01 req-ed98a9b4-49aa-45d0-b29e-dc2cddb125fa service nova] Creating event network-vif-plugged:cef37bc8-24da-4194-a393-9253f1b67704 for instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 on n-h2-852771-8 Aug 25 13:02:50.742703 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-378b2639-ff9b-4a12-ad3c-a9873c992e01 req-ed98a9b4-49aa-45d0-b29e-dc2cddb125fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175446 Aug 25 13:02:50.748817 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1431/2860] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:50.778865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c8277c91-221c-426f-856d-3c0130dcd634 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:50.785626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c8277c91-221c-426f-856d-3c0130dcd634 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:50.816932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8277c91-221c-426f-856d-3c0130dcd634 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:50.820779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8277c91-221c-426f-856d-3c0130dcd634 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:50.826186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8277c91-221c-426f-856d-3c0130dcd634 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:50.831002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8277c91-221c-426f-856d-3c0130dcd634 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:50.833108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8277c91-221c-426f-856d-3c0130dcd634 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:50.838567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8277c91-221c-426f-856d-3c0130dcd634 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:51.481411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2f517f7c-a227-46e3-a1a2-88fe10acce6c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:51.525917 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f517f7c-a227-46e3-a1a2-88fe10acce6c tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1314 microversion: 2.1 time: 1.555554 Aug 25 13:02:51.534467 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1430/2861] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:49 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1314 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:51.572449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16046017-0adb-4cba-beb1-40e8890213a1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:51.575720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-16046017-0adb-4cba-beb1-40e8890213a1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 1eaf403a-3a50-4864-845c-340bf0a70683] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:51.602551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16046017-0adb-4cba-beb1-40e8890213a1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:51.605596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16046017-0adb-4cba-beb1-40e8890213a1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:51.606990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16046017-0adb-4cba-beb1-40e8890213a1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:51.610630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16046017-0adb-4cba-beb1-40e8890213a1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:51.612687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16046017-0adb-4cba-beb1-40e8890213a1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:51.614965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16046017-0adb-4cba-beb1-40e8890213a1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:51.928670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c8277c91-221c-426f-856d-3c0130dcd634 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:51.953489 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c8277c91-221c-426f-856d-3c0130dcd634 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1350 microversion: 2.1 time: 1.200980 Aug 25 13:02:51.970889 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1432/2862] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:50 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1350 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:52.018343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-57386906-66c3-4b52-b361-46ec670238f8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:52.022199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-57386906-66c3-4b52-b361-46ec670238f8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:52.505096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-57386906-66c3-4b52-b361-46ec670238f8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:52.545965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-57386906-66c3-4b52-b361-46ec670238f8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:52.555726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-57386906-66c3-4b52-b361-46ec670238f8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:52.572328 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-57386906-66c3-4b52-b361-46ec670238f8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1285 microversion: 2.42 time: 0.612090 Aug 25 13:02:52.584999 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1433/2863] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:51 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1285 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:52.595671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-179a2f6d-06f8-4610-a2d2-9fc7a704b321 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:52.596913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-179a2f6d-06f8-4610-a2d2-9fc7a704b321 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:52.619753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-179a2f6d-06f8-4610-a2d2-9fc7a704b321 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:52.620312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-179a2f6d-06f8-4610-a2d2-9fc7a704b321 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:52.620760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-179a2f6d-06f8-4610-a2d2-9fc7a704b321 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:52.623561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-179a2f6d-06f8-4610-a2d2-9fc7a704b321 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:52.628502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-179a2f6d-06f8-4610-a2d2-9fc7a704b321 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:52.629043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-179a2f6d-06f8-4610-a2d2-9fc7a704b321 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:53.523645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16046017-0adb-4cba-beb1-40e8890213a1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:53.575295 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-16046017-0adb-4cba-beb1-40e8890213a1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683" status: 200 len: 1467 microversion: 2.1 time: 2.038068 Aug 25 13:02:53.583605 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1431/2864] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:51 2022] GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683 => generated 1467 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:53.634770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d8dd3db2-4b5c-44e1-96f5-3543842373d2 req-d1d8dcb4-7c90-407e-a669-9fe6490867b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0a087a-758a-493c-b573-2d558b6b592e", "tag": "a249548b-1a44-405f-8547-1727f160c723"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:53.694458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d8dd3db2-4b5c-44e1-96f5-3543842373d2 req-d1d8dcb4-7c90-407e-a669-9fe6490867b8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:53.702373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d8dd3db2-4b5c-44e1-96f5-3543842373d2 req-d1d8dcb4-7c90-407e-a669-9fe6490867b8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:53.703700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d8dd3db2-4b5c-44e1-96f5-3543842373d2 req-d1d8dcb4-7c90-407e-a669-9fe6490867b8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:53.758597 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d8dd3db2-4b5c-44e1-96f5-3543842373d2 req-d1d8dcb4-7c90-407e-a669-9fe6490867b8 service nova] Creating event network-changed:a249548b-1a44-405f-8547-1727f160c723 for instance 6e0a087a-758a-493c-b573-2d558b6b592e on n-h2-852771-8 Aug 25 13:02:53.790872 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d8dd3db2-4b5c-44e1-96f5-3543842373d2 req-d1d8dcb4-7c90-407e-a669-9fe6490867b8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182401 Aug 25 13:02:53.792059 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1432/2865] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:53.835793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03a4cd96-4a68-4fb8-b654-87b18beeead6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:53.844241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-03a4cd96-4a68-4fb8-b654-87b18beeead6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:53.895918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03a4cd96-4a68-4fb8-b654-87b18beeead6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:53.897383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03a4cd96-4a68-4fb8-b654-87b18beeead6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:53.898482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03a4cd96-4a68-4fb8-b654-87b18beeead6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:53.906208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03a4cd96-4a68-4fb8-b654-87b18beeead6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:53.907109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03a4cd96-4a68-4fb8-b654-87b18beeead6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:53.907946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03a4cd96-4a68-4fb8-b654-87b18beeead6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:54.385451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-179a2f6d-06f8-4610-a2d2-9fc7a704b321 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:54.413775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-179a2f6d-06f8-4610-a2d2-9fc7a704b321 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1589 microversion: 2.1 time: 1.827006 Aug 25 13:02:54.419524 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1434/2866] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:52 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1589 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:54.444302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a8cf9ea3-beb2-4b9e-b9f3-97e61af80485 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:54.445495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a8cf9ea3-beb2-4b9e-b9f3-97e61af80485 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:54.467863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8cf9ea3-beb2-4b9e-b9f3-97e61af80485 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:54.469235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8cf9ea3-beb2-4b9e-b9f3-97e61af80485 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:54.470563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8cf9ea3-beb2-4b9e-b9f3-97e61af80485 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:54.472202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8cf9ea3-beb2-4b9e-b9f3-97e61af80485 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:54.474564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8cf9ea3-beb2-4b9e-b9f3-97e61af80485 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:54.476669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8cf9ea3-beb2-4b9e-b9f3-97e61af80485 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:55.773809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03a4cd96-4a68-4fb8-b654-87b18beeead6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:55.800193 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-03a4cd96-4a68-4fb8-b654-87b18beeead6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1314 microversion: 2.1 time: 2.002204 Aug 25 13:02:55.812904 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1433/2867] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:53 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1314 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:55.840494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:55.842485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:55.870337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:55.871731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:55.872999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:55.874952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:55.876165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:55.878312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:56.049910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a8cf9ea3-beb2-4b9e-b9f3-97e61af80485 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:56.081878 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a8cf9ea3-beb2-4b9e-b9f3-97e61af80485 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1540 microversion: 2.1 time: 1.657841 Aug 25 13:02:56.086860 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1435/2868] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:54 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1540 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:56.108877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:56.119834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:56.123049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Searching by: {'reservation_id': 'r-75flcaza', 'deleted': False, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:02:56.134546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:56.136000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:56.137185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:56.139023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:56.140655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:56.141979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:56.532104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:02:56.816015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:56.836580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:56.838103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:56.841406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:56.914863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:56.954402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:56.958120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:56.970007 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-60506992-1179-4de6-8434-ba916aa83c1d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1593 microversion: 2.42 time: 1.154351 Aug 25 13:02:56.972233 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1434/2869] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:55 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1593 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:56.982816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2ae6aa8-e41d-42de-9b7c-c8f8b3c79124 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:56.984546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2ae6aa8-e41d-42de-9b7c-c8f8b3c79124 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:57.005325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae6aa8-e41d-42de-9b7c-c8f8b3c79124 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:57.006960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae6aa8-e41d-42de-9b7c-c8f8b3c79124 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:57.008238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae6aa8-e41d-42de-9b7c-c8f8b3c79124 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:57.010379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae6aa8-e41d-42de-9b7c-c8f8b3c79124 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:57.011705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae6aa8-e41d-42de-9b7c-c8f8b3c79124 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:57.012844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae6aa8-e41d-42de-9b7c-c8f8b3c79124 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:58.167489 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2ae6aa8-e41d-42de-9b7c-c8f8b3c79124 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.193081 Aug 25 13:02:58.183304 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1435/2870] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:02:56 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90/os-interface => generated 285 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:58.195321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1c64b31-a885-4331-84a4-7e396e3d866d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:58.196440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e1c64b31-a885-4331-84a4-7e396e3d866d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:58.270834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-a885-4331-84a4-7e396e3d866d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:58.276188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-a885-4331-84a4-7e396e3d866d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:58.278764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-a885-4331-84a4-7e396e3d866d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:58.283430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-a885-4331-84a4-7e396e3d866d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:58.286734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-a885-4331-84a4-7e396e3d866d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:58.288527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c64b31-a885-4331-84a4-7e396e3d866d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:59.085426 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0df1944a-841a-49fb-b4a3-d54895b3faab tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?reservation_id=r-75flcaza" status: 200 len: 2928 microversion: 2.1 time: 2.992559 Aug 25 13:02:59.114386 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1436/2871] 10.222.0.70 () {58 vars in 1197 bytes} [Thu Aug 25 13:02:56 2022] GET /compute/v2.1/servers/detail?reservation_id=r-75flcaza => generated 2928 bytes in 3023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:59.134680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0d8a2535-5703-44a1-be01-9b1a475b43aa req-809e1d1a-3f35-4904-907c-86dd82358a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46fd34ef-a381-41f0-a819-dc99a352e09a", "tag": "2e868831-7b21-4aa7-b9f8-efc48e541cc2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:59.156957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0d8a2535-5703-44a1-be01-9b1a475b43aa req-809e1d1a-3f35-4904-907c-86dd82358a62 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:59.158754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0d8a2535-5703-44a1-be01-9b1a475b43aa req-809e1d1a-3f35-4904-907c-86dd82358a62 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:59.160087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0d8a2535-5703-44a1-be01-9b1a475b43aa req-809e1d1a-3f35-4904-907c-86dd82358a62 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:59.187874 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0d8a2535-5703-44a1-be01-9b1a475b43aa req-809e1d1a-3f35-4904-907c-86dd82358a62 service nova] Creating event network-changed:2e868831-7b21-4aa7-b9f8-efc48e541cc2 for instance 46fd34ef-a381-41f0-a819-dc99a352e09a on n-h2-852771-8 Aug 25 13:02:59.197456 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0d8a2535-5703-44a1-be01-9b1a475b43aa req-809e1d1a-3f35-4904-907c-86dd82358a62 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080218 Aug 25 13:02:59.198955 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1437/2872] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:59.207900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:59.210328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:59.224042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:59.228817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:59.232503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:59.234684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:59.241698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:59.243922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:00.112459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:00.170014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:00.185954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:00.193270 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6fa6891d-7d89-4a4f-9a9e-adc659f2ac49 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1593 microversion: 2.42 time: 0.990980 Aug 25 13:03:00.208104 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1438/2873] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:59 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1593 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:00.217253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4819b727-e6b5-4c45-a503-2ccac26e1cdd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:00.270795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.compute.server_groups [None req-4819b727-e6b5-4c45-a503-2ccac26e1cdd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Querying cell 638d90be-ffdb-4b61-b94a-775c50a724be(cell1) for 2 instances {{(pid=129060) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 25 13:03:00.272748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4819b727-e6b5-4c45-a503-2ccac26e1cdd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:00.275783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4819b727-e6b5-4c45-a503-2ccac26e1cdd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:00.276802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4819b727-e6b5-4c45-a503-2ccac26e1cdd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:00.348676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e1c64b31-a885-4331-84a4-7e396e3d866d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:00.383749 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e1c64b31-a885-4331-84a4-7e396e3d866d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1314 microversion: 2.1 time: 2.198471 Aug 25 13:03:00.389332 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1436/2874] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:58 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1314 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:00.404952 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4819b727-e6b5-4c45-a503-2ccac26e1cdd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/ad9da14b-a14d-4fbb-8c0f-d848b3ab02d8" status: 200 len: 266 microversion: 2.1 time: 0.205738 Aug 25 13:03:00.406098 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1439/2875] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 13:03:00 2022] GET /compute/v2.1/os-server-groups/ad9da14b-a14d-4fbb-8c0f-d848b3ab02d8 => generated 266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:00.435276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-68195350-e1be-4778-9b53-49ed834749bf tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:00.436518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-68195350-e1be-4778-9b53-49ed834749bf tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:00.465163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68195350-e1be-4778-9b53-49ed834749bf tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:00.467398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68195350-e1be-4778-9b53-49ed834749bf tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:00.471198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68195350-e1be-4778-9b53-49ed834749bf tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:00.474726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68195350-e1be-4778-9b53-49ed834749bf tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:00.483565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68195350-e1be-4778-9b53-49ed834749bf tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:00.486595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68195350-e1be-4778-9b53-49ed834749bf tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:01.269661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:01.270651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:01.305674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:01.306664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:01.307759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:01.309381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:01.310649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:01.311730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:01.829999 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-68195350-e1be-4778-9b53-49ed834749bf tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 200 len: 1619 microversion: 2.1 time: 1.395012 Aug 25 13:03:01.831171 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1437/2876] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:00 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 1619 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:01.854273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0824c13-b156-46dd-9241-15678314a5e5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:01.855235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e0824c13-b156-46dd-9241-15678314a5e5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:01.869357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0824c13-b156-46dd-9241-15678314a5e5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:01.870945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0824c13-b156-46dd-9241-15678314a5e5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:01.872117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0824c13-b156-46dd-9241-15678314a5e5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:01.906036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0824c13-b156-46dd-9241-15678314a5e5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:01.907949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0824c13-b156-46dd-9241-15678314a5e5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:01.909322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0824c13-b156-46dd-9241-15678314a5e5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:02.925557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:02.957158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:02.961632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:02.964479 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5046c667-21f4-469f-85eb-f3f92931313d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1660 microversion: 2.42 time: 1.703168 Aug 25 13:03:02.987373 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1440/2877] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:01 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1660 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:03.008222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-583662ed-552e-4417-aeec-f3a0e09cbe1c tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:03.009699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-583662ed-552e-4417-aeec-f3a0e09cbe1c tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] [instance: 1eaf403a-3a50-4864-845c-340bf0a70683] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:03.026382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-583662ed-552e-4417-aeec-f3a0e09cbe1c tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:03.027592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-583662ed-552e-4417-aeec-f3a0e09cbe1c tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:03.029786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-583662ed-552e-4417-aeec-f3a0e09cbe1c tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:03.031522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-583662ed-552e-4417-aeec-f3a0e09cbe1c tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:03.033860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-583662ed-552e-4417-aeec-f3a0e09cbe1c tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:03.035213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-583662ed-552e-4417-aeec-f3a0e09cbe1c tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:03.119682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e0824c13-b156-46dd-9241-15678314a5e5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:03.170730 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0824c13-b156-46dd-9241-15678314a5e5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1314 microversion: 2.1 time: 1.336286 Aug 25 13:03:03.175847 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1438/2878] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:01 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1314 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:03.794967 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-583662ed-552e-4417-aeec-f3a0e09cbe1c tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683" status: 200 len: 1618 microversion: 2.1 time: 0.796352 Aug 25 13:03:03.798314 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1441/2879] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:02 2022] GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683 => generated 1618 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:03.863219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fcbe8fab-0f9f-46af-a8b3-ed4663a3adba tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Action: 'create', calling method: .version_select at 0x7f3a299a2af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1540743464", "policies": ["anti-affinity"]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:03.908730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-fcbe8fab-0f9f-46af-a8b3-ed4663a3adba tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:03.922799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-fcbe8fab-0f9f-46af-a8b3-ed4663a3adba tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:04.019899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:04.026837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:04.071222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:04.073607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-fcbe8fab-0f9f-46af-a8b3-ed4663a3adba tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:04.076937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:04.082459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:04.095678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:04.101005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:04.105149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:04.121071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-fcbe8fab-0f9f-46af-a8b3-ed4663a3adba tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_groups'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:04.197070 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fcbe8fab-0f9f-46af-a8b3-ed4663a3adba tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.336634 Aug 25 13:03:04.200304 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1439/2880] 10.222.0.70 () {60 vars in 1174 bytes} [Thu Aug 25 13:03:03 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:04.217220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-37cc0cd9-0af4-4b4a-96c9-ac63c09dfef8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:04.219383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-37cc0cd9-0af4-4b4a-96c9-ac63c09dfef8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:04.269562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cc0cd9-0af4-4b4a-96c9-ac63c09dfef8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:04.274734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cc0cd9-0af4-4b4a-96c9-ac63c09dfef8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:04.277047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cc0cd9-0af4-4b4a-96c9-ac63c09dfef8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:04.282836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cc0cd9-0af4-4b4a-96c9-ac63c09dfef8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:04.286458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cc0cd9-0af4-4b4a-96c9-ac63c09dfef8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:04.291750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37cc0cd9-0af4-4b4a-96c9-ac63c09dfef8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:06.253205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:06.266557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37cc0cd9-0af4-4b4a-96c9-ac63c09dfef8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:06.309787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:06.342323 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-37cc0cd9-0af4-4b4a-96c9-ac63c09dfef8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1314 microversion: 2.1 time: 2.130982 Aug 25 13:03:06.371506 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1440/2881] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:04 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1314 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:06.404127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:06.406165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1721111881", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "50550a82-1963-47e3-a5ff-1df9ddff4278"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:06.419904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:06.431037 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7942e3cf-d850-4aa5-b39d-798b010d08bc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1660 microversion: 2.42 time: 2.411379 Aug 25 13:03:06.439120 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1442/2882] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:04 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1660 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:06.453391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=72 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:06.624053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:03:06.978767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4d3ea081-eb8f-4513-83c8-7d28f2b96d32 req-78c0ff91-f76b-4d42-86c0-3d2d3e99674d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59f80e3-c2a8-4ca1-b4cd-41027f74aa90", "tag": "cef37bc8-24da-4194-a393-9253f1b67704"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:07.016205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:07.052991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4d3ea081-eb8f-4513-83c8-7d28f2b96d32 req-78c0ff91-f76b-4d42-86c0-3d2d3e99674d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:07.055491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4d3ea081-eb8f-4513-83c8-7d28f2b96d32 req-78c0ff91-f76b-4d42-86c0-3d2d3e99674d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:07.058184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4d3ea081-eb8f-4513-83c8-7d28f2b96d32 req-78c0ff91-f76b-4d42-86c0-3d2d3e99674d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:07.136496 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4d3ea081-eb8f-4513-83c8-7d28f2b96d32 req-78c0ff91-f76b-4d42-86c0-3d2d3e99674d service nova] Creating event network-changed:cef37bc8-24da-4194-a393-9253f1b67704 for instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 on n-h2-852771-8 Aug 25 13:03:07.159302 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4d3ea081-eb8f-4513-83c8-7d28f2b96d32 req-78c0ff91-f76b-4d42-86c0-3d2d3e99674d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195493 Aug 25 13:03:07.166538 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1443/2883] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:03:07.423478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5ddee6c5-5a1d-47eb-bd02-2587894425bd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:07.437286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5ddee6c5-5a1d-47eb-bd02-2587894425bd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:07.485228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ddee6c5-5a1d-47eb-bd02-2587894425bd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:07.486626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ddee6c5-5a1d-47eb-bd02-2587894425bd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:07.489330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ddee6c5-5a1d-47eb-bd02-2587894425bd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:07.495668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ddee6c5-5a1d-47eb-bd02-2587894425bd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:07.501549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ddee6c5-5a1d-47eb-bd02-2587894425bd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:07.502917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ddee6c5-5a1d-47eb-bd02-2587894425bd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:08.151165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:03:08.153188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:03:08.154641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:03:08.161684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:03:08.163687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:03:08.230918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:08.231843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:08.232668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:08.234199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:08.256639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:08.257478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:08.338117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:08.361947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:08.426546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Going to run 2 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:03:08.440516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: c9221961-b954-4113-b962-f35e65e91f36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:03:08.731129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5ddee6c5-5a1d-47eb-bd02-2587894425bd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:08.757554 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5ddee6c5-5a1d-47eb-bd02-2587894425bd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1314 microversion: 2.1 time: 1.370100 Aug 25 13:03:08.764910 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1444/2884] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:07 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1314 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:08.777230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:08.778309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:08.797255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:08.816136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:08.816974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:08.818426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:08.819744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:08.821198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:08.821691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:08.885810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:09.064139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:09.099011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:09.178893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=c9221961-b954-4113-b962-f35e65e91f36,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:03:09.315134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:09.331254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:09.424882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:09.439400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'server_group_members'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:09.565895 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-faec0596-c6f5-4041-886e-95d68850f5bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.191393 Aug 25 13:03:09.570032 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1441/2885] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:03:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 3197 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 25 13:03:09.598400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:09.623709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:09.625315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Searching by: {'deleted': False, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:03:09.701329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:09.706356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=75 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:09.739862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:09.743474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:09.744416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:09.745244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:09.748535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:09.753943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:09.757608 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-50d84850-4138-4976-893b-c951ed0f117f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1706 microversion: 2.42 time: 0.986661 Aug 25 13:03:09.757847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:09.758862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:09.770602 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1445/2886] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:08 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1706 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:09.818240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f56be01d-2b5c-4f0c-bab4-a51a9f508305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:09.822090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f56be01d-2b5c-4f0c-bab4-a51a9f508305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:09.858428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56be01d-2b5c-4f0c-bab4-a51a9f508305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:09.860901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56be01d-2b5c-4f0c-bab4-a51a9f508305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:09.868962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56be01d-2b5c-4f0c-bab4-a51a9f508305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:09.871344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56be01d-2b5c-4f0c-bab4-a51a9f508305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:09.874832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56be01d-2b5c-4f0c-bab4-a51a9f508305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:09.879063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56be01d-2b5c-4f0c-bab4-a51a9f508305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:09.910460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:03:10.051170 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5f85a07f-54a5-4f9c-b2bc-b291d1ba17fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.463481 Aug 25 13:03:10.065070 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1442/2887] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 13:03:09 2022] GET /compute/v2.1/servers => generated 1664 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:10.085867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a18ad04c-7133-4bf0-ae38-acce2a83bcf1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:10.087264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a18ad04c-7133-4bf0-ae38-acce2a83bcf1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:10.293396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a18ad04c-7133-4bf0-ae38-acce2a83bcf1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:10.326694 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a18ad04c-7133-4bf0-ae38-acce2a83bcf1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1219 microversion: 2.1 time: 0.249133 Aug 25 13:03:10.329280 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1443/2888] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:10 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1219 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:10.830831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f56be01d-2b5c-4f0c-bab4-a51a9f508305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:10.837651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:10.845059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:10.877624 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f56be01d-2b5c-4f0c-bab4-a51a9f508305 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1314 microversion: 2.1 time: 1.066952 Aug 25 13:03:10.877624 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1446/2889] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:09 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1314 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:10.901844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:10.903279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:10.906589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:10.919688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:10.921811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:10.923204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:11.373780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2186fed8-eb95-4026-b80a-119a224ead63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:11.377778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2186fed8-eb95-4026-b80a-119a224ead63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:11.884571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2186fed8-eb95-4026-b80a-119a224ead63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:11.910074 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2186fed8-eb95-4026-b80a-119a224ead63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1219 microversion: 2.1 time: 0.547659 Aug 25 13:03:11.925228 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1447/2890] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:11 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1219 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:11.950112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ff53656-f378-4e00-af70-236d5654a4ff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:11.953023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3ff53656-f378-4e00-af70-236d5654a4ff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:11.971833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:11.987857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ff53656-f378-4e00-af70-236d5654a4ff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:11.992760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ff53656-f378-4e00-af70-236d5654a4ff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:11.994195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ff53656-f378-4e00-af70-236d5654a4ff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:11.997611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ff53656-f378-4e00-af70-236d5654a4ff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:12.000286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ff53656-f378-4e00-af70-236d5654a4ff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:12.003000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ff53656-f378-4e00-af70-236d5654a4ff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:12.028921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:12.035664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:12.046330 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d2b14e49-867f-4295-a6d4-99ce77489c07 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1706 microversion: 2.42 time: 1.218307 Aug 25 13:03:12.055071 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1444/2891] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:10 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1706 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:03:12.555422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3ff53656-f378-4e00-af70-236d5654a4ff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:12.618242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3ff53656-f378-4e00-af70-236d5654a4ff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1314 microversion: 2.1 time: 0.671364 Aug 25 13:03:12.622554 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1448/2892] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:11 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:12.700645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ce35131b-8e79-47fa-9a68-2084dd7327e7 req-488fb04a-c2d6-4852-82c8-32b57ae18dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fd34ef-a381-41f0-a819-dc99a352e09a", "name": "network-vif-plugged", "status": "completed", "tag": "2e868831-7b21-4aa7-b9f8-efc48e541cc2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:12.770926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ce35131b-8e79-47fa-9a68-2084dd7327e7 req-488fb04a-c2d6-4852-82c8-32b57ae18dce service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:12.772456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ce35131b-8e79-47fa-9a68-2084dd7327e7 req-488fb04a-c2d6-4852-82c8-32b57ae18dce service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:12.773361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ce35131b-8e79-47fa-9a68-2084dd7327e7 req-488fb04a-c2d6-4852-82c8-32b57ae18dce service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:12.822659 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ce35131b-8e79-47fa-9a68-2084dd7327e7 req-488fb04a-c2d6-4852-82c8-32b57ae18dce service nova] Creating event network-vif-plugged:2e868831-7b21-4aa7-b9f8-efc48e541cc2 for instance 46fd34ef-a381-41f0-a819-dc99a352e09a on n-h2-852771-8 Aug 25 13:03:12.843390 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ce35131b-8e79-47fa-9a68-2084dd7327e7 req-488fb04a-c2d6-4852-82c8-32b57ae18dce service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150354 Aug 25 13:03:12.850323 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1445/2893] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:12.969655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e7786fb4-e550-4f5c-9730-bd2abd454f3a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:12.977199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e7786fb4-e550-4f5c-9730-bd2abd454f3a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:13.011825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7786fb4-e550-4f5c-9730-bd2abd454f3a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:13.014205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7786fb4-e550-4f5c-9730-bd2abd454f3a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:13.019426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7786fb4-e550-4f5c-9730-bd2abd454f3a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:13.023296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7786fb4-e550-4f5c-9730-bd2abd454f3a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:13.028376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7786fb4-e550-4f5c-9730-bd2abd454f3a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:13.038700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7786fb4-e550-4f5c-9730-bd2abd454f3a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:13.132776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:13.143696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:13.202920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:13.210750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:13.211271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:13.212141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:13.212643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:13.220026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:13.745295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e7786fb4-e550-4f5c-9730-bd2abd454f3a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:13.787009 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e7786fb4-e550-4f5c-9730-bd2abd454f3a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1271 microversion: 2.1 time: 0.828638 Aug 25 13:03:13.816171 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1449/2894] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:12 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1271 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:13.852299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a8e9ed27-7e64-4cb7-a347-13e85bd7bade tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:13.865609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a8e9ed27-7e64-4cb7-a347-13e85bd7bade tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:13.875482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:13.908413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8e9ed27-7e64-4cb7-a347-13e85bd7bade tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:13.914338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8e9ed27-7e64-4cb7-a347-13e85bd7bade tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:13.918231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8e9ed27-7e64-4cb7-a347-13e85bd7bade tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:13.926110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8e9ed27-7e64-4cb7-a347-13e85bd7bade tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:13.931820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8e9ed27-7e64-4cb7-a347-13e85bd7bade tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:13.936187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8e9ed27-7e64-4cb7-a347-13e85bd7bade tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:16.186396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:16.223161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a8e9ed27-7e64-4cb7-a347-13e85bd7bade tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:16.238272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:16.252409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:16.257270 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d8f1620-d2f3-4158-acee-be1368f6d75e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1706 microversion: 2.42 time: 3.165081 Aug 25 13:03:16.267181 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a8e9ed27-7e64-4cb7-a347-13e85bd7bade tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1314 microversion: 2.1 time: 2.446223 Aug 25 13:03:16.286042 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1450/2895] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:13 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1314 bytes in 2469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:16.291781 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1446/2896] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:13 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1706 bytes in 3203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:03:16.318148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8e802acf-8377-4f07-9e41-26b0ecaf2244 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:16.322302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8e802acf-8377-4f07-9e41-26b0ecaf2244 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:16.349912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e802acf-8377-4f07-9e41-26b0ecaf2244 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:16.354579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e802acf-8377-4f07-9e41-26b0ecaf2244 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:16.356244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e802acf-8377-4f07-9e41-26b0ecaf2244 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:16.361913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e802acf-8377-4f07-9e41-26b0ecaf2244 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:16.366262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e802acf-8377-4f07-9e41-26b0ecaf2244 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:16.371736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e802acf-8377-4f07-9e41-26b0ecaf2244 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:16.745380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8e802acf-8377-4f07-9e41-26b0ecaf2244 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:16.769049 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8e802acf-8377-4f07-9e41-26b0ecaf2244 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1277 microversion: 2.1 time: 0.479890 Aug 25 13:03:16.799986 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1451/2897] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:16 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1277 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:17.335247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44b8e10b-6f06-41de-97be-f83faa54c75e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:17.339101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44b8e10b-6f06-41de-97be-f83faa54c75e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:17.347873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:17.351749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:17.391512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:17.393618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:17.394965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:17.397401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b8e10b-6f06-41de-97be-f83faa54c75e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:17.401480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:17.405152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b8e10b-6f06-41de-97be-f83faa54c75e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:17.406403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b8e10b-6f06-41de-97be-f83faa54c75e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:17.416288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b8e10b-6f06-41de-97be-f83faa54c75e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:17.417446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b8e10b-6f06-41de-97be-f83faa54c75e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:17.418355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b8e10b-6f06-41de-97be-f83faa54c75e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:17.421217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:17.424533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:18.386139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:18.436875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:18.448961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:18.452110 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fc31e0e6-b980-4bf4-a3ce-5cf04cd35c05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1752 microversion: 2.42 time: 1.124669 Aug 25 13:03:18.454084 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1452/2898] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:17 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1752 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:18.470208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e477e1ab-31ed-45bf-91d3-c1e822a8bb2c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:18.478335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e477e1ab-31ed-45bf-91d3-c1e822a8bb2c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:18.504133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e477e1ab-31ed-45bf-91d3-c1e822a8bb2c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:18.509123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e477e1ab-31ed-45bf-91d3-c1e822a8bb2c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:18.523257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e477e1ab-31ed-45bf-91d3-c1e822a8bb2c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:18.527177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e477e1ab-31ed-45bf-91d3-c1e822a8bb2c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:18.530517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e477e1ab-31ed-45bf-91d3-c1e822a8bb2c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:18.536947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e477e1ab-31ed-45bf-91d3-c1e822a8bb2c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:19.066124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e477e1ab-31ed-45bf-91d3-c1e822a8bb2c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:19.090628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44b8e10b-6f06-41de-97be-f83faa54c75e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:19.095403 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e477e1ab-31ed-45bf-91d3-c1e822a8bb2c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1277 microversion: 2.1 time: 0.632003 Aug 25 13:03:19.095745 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1453/2899] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:18 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1277 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:19.161654 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44b8e10b-6f06-41de-97be-f83faa54c75e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1314 microversion: 2.1 time: 1.845554 Aug 25 13:03:19.183783 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1447/2900] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:17 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1314 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:19.503074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:19.511830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:19.570168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:19.575711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:19.577307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:19.579643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:19.580901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:19.582161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:20.143209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c964fae-c3e2-4047-8bbc-868623e7651c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:20.147617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3c964fae-c3e2-4047-8bbc-868623e7651c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:20.158436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:20.189016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c964fae-c3e2-4047-8bbc-868623e7651c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:20.191855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c964fae-c3e2-4047-8bbc-868623e7651c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:20.192803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c964fae-c3e2-4047-8bbc-868623e7651c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:20.194345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c964fae-c3e2-4047-8bbc-868623e7651c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:20.204703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c964fae-c3e2-4047-8bbc-868623e7651c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:20.206348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c964fae-c3e2-4047-8bbc-868623e7651c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:20.227783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=86 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:20.345832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=32 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:20.390478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:20.432615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:20.434642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:20.441703 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-63f055d2-c788-4caa-9611-c6b471d5f217 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1752 microversion: 2.42 time: 0.944629 Aug 25 13:03:20.442883 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1454/2901] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:19 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1752 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:20.463286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-af7a5719-f42d-4cf2-ade0-722a3e1f7667 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:20.464138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-af7a5719-f42d-4cf2-ade0-722a3e1f7667 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:20.495066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af7a5719-f42d-4cf2-ade0-722a3e1f7667 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:20.495977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af7a5719-f42d-4cf2-ade0-722a3e1f7667 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:20.515248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af7a5719-f42d-4cf2-ade0-722a3e1f7667 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:20.519040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af7a5719-f42d-4cf2-ade0-722a3e1f7667 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:20.520714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af7a5719-f42d-4cf2-ade0-722a3e1f7667 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:20.523451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af7a5719-f42d-4cf2-ade0-722a3e1f7667 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:20.822269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3c964fae-c3e2-4047-8bbc-868623e7651c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:20.878472 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3c964fae-c3e2-4047-8bbc-868623e7651c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1277 microversion: 2.1 time: 0.742543 Aug 25 13:03:20.880723 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1448/2902] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:20 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1277 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:21.495805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:21.497094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:21.513049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:21.515279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:21.516864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:21.519270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:21.520751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:21.522646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:21.571403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-af7a5719-f42d-4cf2-ade0-722a3e1f7667 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:21.602340 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-af7a5719-f42d-4cf2-ade0-722a3e1f7667 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1502 microversion: 2.1 time: 1.146991 Aug 25 13:03:21.605680 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1455/2903] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:20 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1502 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:21.660385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fa73640c-a690-44fd-b9da-3a64ed4622a1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:21.685026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa73640c-a690-44fd-b9da-3a64ed4622a1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:21.686507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa73640c-a690-44fd-b9da-3a64ed4622a1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:21.694246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa73640c-a690-44fd-b9da-3a64ed4622a1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:21.858318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fa73640c-a690-44fd-b9da-3a64ed4622a1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Going to try to stop instance {{(pid=129060) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:03:21.920594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:21.970075 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fa73640c-a690-44fd-b9da-3a64ed4622a1 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a/action" status: 202 len: 0 microversion: 2.1 time: 0.317447 Aug 25 13:03:21.972696 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1456/2904] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:03:21 2022] POST /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:03:21.985059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f175fa77-fd9e-4635-8c0e-e79428e5cb8d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:21.987173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f175fa77-fd9e-4635-8c0e-e79428e5cb8d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:22.003218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f175fa77-fd9e-4635-8c0e-e79428e5cb8d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:22.004677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f175fa77-fd9e-4635-8c0e-e79428e5cb8d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:22.006706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f175fa77-fd9e-4635-8c0e-e79428e5cb8d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:22.008478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f175fa77-fd9e-4635-8c0e-e79428e5cb8d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:22.009950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f175fa77-fd9e-4635-8c0e-e79428e5cb8d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:22.011154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f175fa77-fd9e-4635-8c0e-e79428e5cb8d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:22.219759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f175fa77-fd9e-4635-8c0e-e79428e5cb8d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:22.259032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:22.289938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:22.304219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:22.306767 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f175fa77-fd9e-4635-8c0e-e79428e5cb8d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1277 microversion: 2.1 time: 0.316629 Aug 25 13:03:22.317590 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1457/2905] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:21 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1277 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:22.335202 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a7444379-b397-45ca-b4f9-59550579284a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1752 microversion: 2.42 time: 0.827475 Aug 25 13:03:22.335527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f4dc5675-3b79-48ba-8cc6-c43f17f8b9cf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:22.339492 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1449/2906] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:21 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1752 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:22.346682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f4dc5675-3b79-48ba-8cc6-c43f17f8b9cf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:22.367990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4dc5675-3b79-48ba-8cc6-c43f17f8b9cf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:22.371435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4dc5675-3b79-48ba-8cc6-c43f17f8b9cf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:22.372287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4dc5675-3b79-48ba-8cc6-c43f17f8b9cf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:22.373725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4dc5675-3b79-48ba-8cc6-c43f17f8b9cf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:22.374627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4dc5675-3b79-48ba-8cc6-c43f17f8b9cf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:22.375667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4dc5675-3b79-48ba-8cc6-c43f17f8b9cf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:22.836819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f4dc5675-3b79-48ba-8cc6-c43f17f8b9cf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:22.864455 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f4dc5675-3b79-48ba-8cc6-c43f17f8b9cf tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 0.550400 Aug 25 13:03:22.892992 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1458/2907] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:22 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:23.347914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1e0bf483-0b3f-445c-8633-232c70db2842 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:23.353007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1e0bf483-0b3f-445c-8633-232c70db2842 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:23.370976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e0bf483-0b3f-445c-8633-232c70db2842 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:23.372550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e0bf483-0b3f-445c-8633-232c70db2842 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:23.384018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:23.386431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e0bf483-0b3f-445c-8633-232c70db2842 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:23.390519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:23.392450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e0bf483-0b3f-445c-8633-232c70db2842 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:23.396153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e0bf483-0b3f-445c-8633-232c70db2842 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:23.397869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e0bf483-0b3f-445c-8633-232c70db2842 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:23.417771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:23.420839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:23.424153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:23.430323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:23.433392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:23.436508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:24.237253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:24.271577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:24.284555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:24.288022 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1d3b5a1b-f572-4b0f-adc5-7933b2066b94 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1752 microversion: 2.42 time: 0.912003 Aug 25 13:03:24.314016 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1459/2908] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:23 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1752 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:24.342654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a7f8a5d-4d0d-4481-8ee3-4784be2a231d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:24.343818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a7f8a5d-4d0d-4481-8ee3-4784be2a231d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:24.362071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a7f8a5d-4d0d-4481-8ee3-4784be2a231d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:24.363077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a7f8a5d-4d0d-4481-8ee3-4784be2a231d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:24.370725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a7f8a5d-4d0d-4481-8ee3-4784be2a231d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:24.372734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a7f8a5d-4d0d-4481-8ee3-4784be2a231d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:24.374072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a7f8a5d-4d0d-4481-8ee3-4784be2a231d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:24.375375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a7f8a5d-4d0d-4481-8ee3-4784be2a231d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:25.035421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1e0bf483-0b3f-445c-8633-232c70db2842 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:25.074314 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1e0bf483-0b3f-445c-8633-232c70db2842 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1319 microversion: 2.1 time: 1.735156 Aug 25 13:03:25.076326 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1450/2909] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:23 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1319 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:25.352289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:25.355027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:25.373053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:25.374589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:25.375755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:25.377480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:25.378826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:25.379942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:25.407264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a7f8a5d-4d0d-4481-8ee3-4784be2a231d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:25.433500 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a7f8a5d-4d0d-4481-8ee3-4784be2a231d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 1.117064 Aug 25 13:03:25.467550 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1460/2910] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:24 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:26.125470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3a2f8e43-100c-4002-9554-d7ef09513ce1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:26.127503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3a2f8e43-100c-4002-9554-d7ef09513ce1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:26.145117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a2f8e43-100c-4002-9554-d7ef09513ce1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:26.147998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a2f8e43-100c-4002-9554-d7ef09513ce1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:26.149303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a2f8e43-100c-4002-9554-d7ef09513ce1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:26.154615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a2f8e43-100c-4002-9554-d7ef09513ce1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:26.155883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a2f8e43-100c-4002-9554-d7ef09513ce1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:26.157113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a2f8e43-100c-4002-9554-d7ef09513ce1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:26.440494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:26.466495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:26.470524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:26.474152 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dd41bbd8-96ba-4890-8eab-d93d03bd030f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1798 microversion: 2.42 time: 1.128612 Aug 25 13:03:26.477583 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1451/2911] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:25 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1798 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:03:26.486272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-632813f2-7546-4408-b1cf-5fa285426b2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:26.487422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-632813f2-7546-4408-b1cf-5fa285426b2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:26.496856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-632813f2-7546-4408-b1cf-5fa285426b2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:26.497942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-632813f2-7546-4408-b1cf-5fa285426b2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:26.498903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-632813f2-7546-4408-b1cf-5fa285426b2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:26.500002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-632813f2-7546-4408-b1cf-5fa285426b2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:26.500780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-632813f2-7546-4408-b1cf-5fa285426b2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:26.501851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-632813f2-7546-4408-b1cf-5fa285426b2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:27.120171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3a2f8e43-100c-4002-9554-d7ef09513ce1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:27.147818 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3a2f8e43-100c-4002-9554-d7ef09513ce1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1319 microversion: 2.1 time: 1.027112 Aug 25 13:03:27.149343 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1461/2912] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:26 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1319 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:27.160510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-6b5440f5-a62e-4ee9-acf5-64bac2a57c93 req-96d33e6a-5851-4a96-8241-1a59fa819413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9221961-b954-4113-b962-f35e65e91f36", "tag": "0ab2e9a6-9dec-4ada-8adc-c03de8b4fa09"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:27.191680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6b5440f5-a62e-4ee9-acf5-64bac2a57c93 req-96d33e6a-5851-4a96-8241-1a59fa819413 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:27.193046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6b5440f5-a62e-4ee9-acf5-64bac2a57c93 req-96d33e6a-5851-4a96-8241-1a59fa819413 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:27.194566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6b5440f5-a62e-4ee9-acf5-64bac2a57c93 req-96d33e6a-5851-4a96-8241-1a59fa819413 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:27.225476 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-6b5440f5-a62e-4ee9-acf5-64bac2a57c93 req-96d33e6a-5851-4a96-8241-1a59fa819413 service nova] Creating event network-changed:0ab2e9a6-9dec-4ada-8adc-c03de8b4fa09 for instance c9221961-b954-4113-b962-f35e65e91f36 on n-h2-852771-8 Aug 25 13:03:27.247443 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-6b5440f5-a62e-4ee9-acf5-64bac2a57c93 req-96d33e6a-5851-4a96-8241-1a59fa819413 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094436 Aug 25 13:03:27.249306 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1462/2913] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:27.249829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-632813f2-7546-4408-b1cf-5fa285426b2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:27.272795 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-632813f2-7546-4408-b1cf-5fa285426b2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 0.792284 Aug 25 13:03:27.281813 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1452/2914] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:26 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:27.536630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:27.539579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:27.568931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:27.575056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:27.576300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:27.579056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:27.579922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:27.580896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:27.597654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:28.208620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f7dc0f03-3a82-4323-9e21-144382a4f039 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:28.212005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f7dc0f03-3a82-4323-9e21-144382a4f039 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:28.238777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7dc0f03-3a82-4323-9e21-144382a4f039 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:28.241555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7dc0f03-3a82-4323-9e21-144382a4f039 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:28.242796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7dc0f03-3a82-4323-9e21-144382a4f039 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:28.244497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7dc0f03-3a82-4323-9e21-144382a4f039 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:28.245753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7dc0f03-3a82-4323-9e21-144382a4f039 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:28.248021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7dc0f03-3a82-4323-9e21-144382a4f039 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:28.435571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:28.453548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:28.457224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:28.460149 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-41ddd578-513b-4884-83ff-6f4aeeec8c74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1798 microversion: 2.42 time: 0.933627 Aug 25 13:03:28.462036 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1463/2915] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:27 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1798 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:28.471628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bfab8033-1126-4b5b-bbae-62c0f97f3760 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:28.473325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bfab8033-1126-4b5b-bbae-62c0f97f3760 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:28.486005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfab8033-1126-4b5b-bbae-62c0f97f3760 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:28.487370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfab8033-1126-4b5b-bbae-62c0f97f3760 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:28.488444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfab8033-1126-4b5b-bbae-62c0f97f3760 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:28.490729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfab8033-1126-4b5b-bbae-62c0f97f3760 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:28.491898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfab8033-1126-4b5b-bbae-62c0f97f3760 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:28.493006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfab8033-1126-4b5b-bbae-62c0f97f3760 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:29.150592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f7dc0f03-3a82-4323-9e21-144382a4f039 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:29.179511 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f7dc0f03-3a82-4323-9e21-144382a4f039 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1319 microversion: 2.1 time: 0.975258 Aug 25 13:03:29.181531 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1453/2916] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:28 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1319 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:29.220178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bfab8033-1126-4b5b-bbae-62c0f97f3760 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:29.261229 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bfab8033-1126-4b5b-bbae-62c0f97f3760 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 0.796864 Aug 25 13:03:29.263014 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1464/2917] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:28 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:29.533414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:29.534833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:29.570740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:29.571375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:29.572738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:29.574358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:29.575085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:29.580617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:30.136160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:30.174550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:30.184025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:30.190882 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1cc0ba30-e308-4586-a5e2-e35056ff4d83 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1798 microversion: 2.42 time: 0.675819 Aug 25 13:03:30.202512 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1454/2918] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:29 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1798 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:30.232183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-17c7a1df-2fcc-4f68-9a44-d52e85f687a6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:30.235600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-17c7a1df-2fcc-4f68-9a44-d52e85f687a6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:30.252418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-61ebfd28-1971-469a-8a03-5bddc55bd67e req-ea01f60f-f235-4281-a6f2-2cdc987a07c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a97f70b-4323-4b49-b4dc-fa5c78170ae9", "tag": "0a9a7acf-80db-4e80-a571-b66bd271a714"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:30.278965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17c7a1df-2fcc-4f68-9a44-d52e85f687a6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:30.287916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17c7a1df-2fcc-4f68-9a44-d52e85f687a6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:30.290162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17c7a1df-2fcc-4f68-9a44-d52e85f687a6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:30.299733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17c7a1df-2fcc-4f68-9a44-d52e85f687a6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:30.300780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17c7a1df-2fcc-4f68-9a44-d52e85f687a6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:30.306576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17c7a1df-2fcc-4f68-9a44-d52e85f687a6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:30.309987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-61ebfd28-1971-469a-8a03-5bddc55bd67e req-ea01f60f-f235-4281-a6f2-2cdc987a07c2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:30.310899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-61ebfd28-1971-469a-8a03-5bddc55bd67e req-ea01f60f-f235-4281-a6f2-2cdc987a07c2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:30.311749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-61ebfd28-1971-469a-8a03-5bddc55bd67e req-ea01f60f-f235-4281-a6f2-2cdc987a07c2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:30.380600 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-61ebfd28-1971-469a-8a03-5bddc55bd67e req-ea01f60f-f235-4281-a6f2-2cdc987a07c2 service nova] Creating event network-changed:0a9a7acf-80db-4e80-a571-b66bd271a714 for instance 5a97f70b-4323-4b49-b4dc-fa5c78170ae9 on n-h1-852771-8 Aug 25 13:03:30.408436 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-61ebfd28-1971-469a-8a03-5bddc55bd67e req-ea01f60f-f235-4281-a6f2-2cdc987a07c2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165912 Aug 25 13:03:30.409813 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1455/2919] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:03:30.429568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f2476ddd-9194-43a0-a3b0-80bc463b87f9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:30.439389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f2476ddd-9194-43a0-a3b0-80bc463b87f9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:30.481788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:30.489391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2476ddd-9194-43a0-a3b0-80bc463b87f9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:30.491985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2476ddd-9194-43a0-a3b0-80bc463b87f9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:30.493478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2476ddd-9194-43a0-a3b0-80bc463b87f9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:30.496846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2476ddd-9194-43a0-a3b0-80bc463b87f9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:30.499121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2476ddd-9194-43a0-a3b0-80bc463b87f9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:30.500388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2476ddd-9194-43a0-a3b0-80bc463b87f9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:32.005835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f2476ddd-9194-43a0-a3b0-80bc463b87f9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:32.036773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-17c7a1df-2fcc-4f68-9a44-d52e85f687a6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:32.065443 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-17c7a1df-2fcc-4f68-9a44-d52e85f687a6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1319 microversion: 2.1 time: 1.847066 Aug 25 13:03:32.066974 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f2476ddd-9194-43a0-a3b0-80bc463b87f9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 1.654852 Aug 25 13:03:32.071920 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1456/2920] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:30 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:32.087301 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1465/2921] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:30 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1319 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:32.096575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:32.098666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:32.121691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:32.125064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:32.129994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:32.131662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:32.136753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:32.137739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:32.799462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:32.832647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:32.845291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:32.848276 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c68b2aff-18e3-4070-80d5-4fb132d4dc74 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1844 microversion: 2.42 time: 0.773854 Aug 25 13:03:32.873947 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1457/2922] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:32 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1844 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:33.133206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ca789b56-3548-4b9b-b5bd-6e9b0edc679e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:33.151485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b291a719-18e6-430f-8042-2223d7eb7f07 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:33.158006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca789b56-3548-4b9b-b5bd-6e9b0edc679e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:33.163728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b291a719-18e6-430f-8042-2223d7eb7f07 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:33.246762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca789b56-3548-4b9b-b5bd-6e9b0edc679e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:33.252476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca789b56-3548-4b9b-b5bd-6e9b0edc679e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:33.259538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b291a719-18e6-430f-8042-2223d7eb7f07 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:33.262415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca789b56-3548-4b9b-b5bd-6e9b0edc679e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:33.267918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b291a719-18e6-430f-8042-2223d7eb7f07 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:33.272803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca789b56-3548-4b9b-b5bd-6e9b0edc679e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:33.273931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b291a719-18e6-430f-8042-2223d7eb7f07 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:33.275159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca789b56-3548-4b9b-b5bd-6e9b0edc679e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:33.310320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca789b56-3548-4b9b-b5bd-6e9b0edc679e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:33.311596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b291a719-18e6-430f-8042-2223d7eb7f07 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:33.312606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b291a719-18e6-430f-8042-2223d7eb7f07 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:33.313427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b291a719-18e6-430f-8042-2223d7eb7f07 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:34.717723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ca789b56-3548-4b9b-b5bd-6e9b0edc679e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:34.749488 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ca789b56-3548-4b9b-b5bd-6e9b0edc679e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 1.641297 Aug 25 13:03:34.752313 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1458/2923] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:33 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:34.786145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:34.794712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:34.826151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:34.827694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:34.828977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:34.831233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:34.832648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:34.833954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:35.241739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b291a719-18e6-430f-8042-2223d7eb7f07 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:35.285444 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b291a719-18e6-430f-8042-2223d7eb7f07 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1319 microversion: 2.1 time: 2.173317 Aug 25 13:03:35.292428 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1466/2924] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:33 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1319 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:35.803901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dfd8a796-d796-4512-a9bc-bdb6faa1e442 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:35.813872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dfd8a796-d796-4512-a9bc-bdb6faa1e442 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:35.884773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfd8a796-d796-4512-a9bc-bdb6faa1e442 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:35.886538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfd8a796-d796-4512-a9bc-bdb6faa1e442 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:35.887826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfd8a796-d796-4512-a9bc-bdb6faa1e442 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:35.898569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfd8a796-d796-4512-a9bc-bdb6faa1e442 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:35.900113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfd8a796-d796-4512-a9bc-bdb6faa1e442 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:35.902957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfd8a796-d796-4512-a9bc-bdb6faa1e442 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:36.461992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:36.516075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:36.532147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:36.536807 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-efb94259-58c3-4b35-9d73-7827fcc41c5b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1844 microversion: 2.42 time: 1.782419 Aug 25 13:03:36.539001 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1459/2925] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:34 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1844 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:36.562809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dfd8a796-d796-4512-a9bc-bdb6faa1e442 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:36.590427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0ef54502-106d-404d-bb88-267e13aca2cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:36.598227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ef54502-106d-404d-bb88-267e13aca2cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:36.611059 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dfd8a796-d796-4512-a9bc-bdb6faa1e442 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 0.823038 Aug 25 13:03:36.614036 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1467/2926] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:35 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:36.622070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ef54502-106d-404d-bb88-267e13aca2cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:36.624974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ef54502-106d-404d-bb88-267e13aca2cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:36.630359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ef54502-106d-404d-bb88-267e13aca2cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:36.632796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ef54502-106d-404d-bb88-267e13aca2cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:36.633968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ef54502-106d-404d-bb88-267e13aca2cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:36.635043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ef54502-106d-404d-bb88-267e13aca2cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:37.219647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ef54502-106d-404d-bb88-267e13aca2cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:37.246129 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0ef54502-106d-404d-bb88-267e13aca2cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1319 microversion: 2.1 time: 0.701177 Aug 25 13:03:37.248329 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1460/2927] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:36 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1319 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:37.582155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-231a20c4-fbe4-4835-8940-a78fa0c14aba req-399ad039-566d-47df-a24f-7fec64bc619d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9221961-b954-4113-b962-f35e65e91f36", "name": "network-vif-plugged", "status": "completed", "tag": "0ab2e9a6-9dec-4ada-8adc-c03de8b4fa09"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:37.584719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:37.587979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:37.618634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:37.620356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:37.622014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:37.623507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:37.624358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:37.624595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-231a20c4-fbe4-4835-8940-a78fa0c14aba req-399ad039-566d-47df-a24f-7fec64bc619d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:37.625580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-231a20c4-fbe4-4835-8940-a78fa0c14aba req-399ad039-566d-47df-a24f-7fec64bc619d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:37.625874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:37.626389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-231a20c4-fbe4-4835-8940-a78fa0c14aba req-399ad039-566d-47df-a24f-7fec64bc619d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:37.707490 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-231a20c4-fbe4-4835-8940-a78fa0c14aba req-399ad039-566d-47df-a24f-7fec64bc619d service nova] Creating event network-vif-plugged:0ab2e9a6-9dec-4ada-8adc-c03de8b4fa09 for instance c9221961-b954-4113-b962-f35e65e91f36 on n-h2-852771-8 Aug 25 13:03:37.738229 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-231a20c4-fbe4-4835-8940-a78fa0c14aba req-399ad039-566d-47df-a24f-7fec64bc619d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169275 Aug 25 13:03:37.740576 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1468/2928] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:37.770015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43fbfd8b-d7dc-42b1-bcb2-ff695daab130 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:37.775026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43fbfd8b-d7dc-42b1-bcb2-ff695daab130 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:37.815707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fbfd8b-d7dc-42b1-bcb2-ff695daab130 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:37.817339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fbfd8b-d7dc-42b1-bcb2-ff695daab130 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:37.826489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fbfd8b-d7dc-42b1-bcb2-ff695daab130 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:37.828445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fbfd8b-d7dc-42b1-bcb2-ff695daab130 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:37.830767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fbfd8b-d7dc-42b1-bcb2-ff695daab130 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:37.832400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43fbfd8b-d7dc-42b1-bcb2-ff695daab130 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:38.939082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:38.978712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:38.983446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:38.987265 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cf1bf36c-02b1-49d0-b6d0-10c8497e59ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1844 microversion: 2.42 time: 1.410728 Aug 25 13:03:39.006880 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1461/2929] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:37 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1844 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:39.025405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f77746e1-73ab-416a-b89a-cea8d2b0aa08 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:39.027461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f77746e1-73ab-416a-b89a-cea8d2b0aa08 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:39.043057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f77746e1-73ab-416a-b89a-cea8d2b0aa08 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:39.043365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43fbfd8b-d7dc-42b1-bcb2-ff695daab130 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:39.044483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f77746e1-73ab-416a-b89a-cea8d2b0aa08 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:39.045897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f77746e1-73ab-416a-b89a-cea8d2b0aa08 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:39.047562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f77746e1-73ab-416a-b89a-cea8d2b0aa08 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:39.052185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f77746e1-73ab-416a-b89a-cea8d2b0aa08 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:39.053162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f77746e1-73ab-416a-b89a-cea8d2b0aa08 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:39.070726 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43fbfd8b-d7dc-42b1-bcb2-ff695daab130 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 1.325694 Aug 25 13:03:39.087958 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1469/2930] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:37 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:39.177391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-037d3f6d-c971-4ae8-822d-d032de86de83 req-74c161c1-22e6-4553-9a17-705f8cfe6ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "tag": "dd23ef5c-d8a0-4337-97d4-d03bd3e7954e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:39.233247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-037d3f6d-c971-4ae8-822d-d032de86de83 req-74c161c1-22e6-4553-9a17-705f8cfe6ffe service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:39.234939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-037d3f6d-c971-4ae8-822d-d032de86de83 req-74c161c1-22e6-4553-9a17-705f8cfe6ffe service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:39.240785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-037d3f6d-c971-4ae8-822d-d032de86de83 req-74c161c1-22e6-4553-9a17-705f8cfe6ffe service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:39.311876 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-037d3f6d-c971-4ae8-822d-d032de86de83 req-74c161c1-22e6-4553-9a17-705f8cfe6ffe service nova] Creating event network-changed:dd23ef5c-d8a0-4337-97d4-d03bd3e7954e for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:03:39.332521 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-037d3f6d-c971-4ae8-822d-d032de86de83 req-74c161c1-22e6-4553-9a17-705f8cfe6ffe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163687 Aug 25 13:03:39.333975 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1470/2931] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:39.505043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f77746e1-73ab-416a-b89a-cea8d2b0aa08 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:39.523638 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f77746e1-73ab-416a-b89a-cea8d2b0aa08 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1319 microversion: 2.1 time: 0.514394 Aug 25 13:03:39.534683 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1462/2932] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:39 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1319 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:39.751023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5f819714-b5b8-4d2c-8d6c-8edd577c0430 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'create', calling method: .version_select at 0x7f3a29955ee0>, body: {"keypair": {"name": "tempest-keypair-269775316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3n7pwpIoPHpxmCR80bzTDhi0Ibk9TXLNwf1nKhg6/Z7gzZzK97tq0POH7cDdBz5IEuclq89mdrQd62jHATVFjs2oMRDJ61jMnkSxhPtiQrEPaTCrQ1nehDUGuyRmVL2w=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:39.791865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-5f819714-b5b8-4d2c-8d6c-8edd577c0430 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:39.810272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-5f819714-b5b8-4d2c-8d6c-8edd577c0430 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for user e320ccc6c0624541895fc42bf681da76 and project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:39.884828 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5f819714-b5b8-4d2c-8d6c-8edd577c0430 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.269351 Aug 25 13:03:39.885927 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1471/2933] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:03:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:40.040223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:40.041366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:40.067648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:40.068983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:40.070248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:40.072189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:40.073425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:40.074566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:40.116273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-71a87f8b-84b8-4b23-ba5c-fb5f383afaf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:40.125760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-71a87f8b-84b8-4b23-ba5c-fb5f383afaf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:40.145038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71a87f8b-84b8-4b23-ba5c-fb5f383afaf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:40.149556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71a87f8b-84b8-4b23-ba5c-fb5f383afaf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:40.154402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71a87f8b-84b8-4b23-ba5c-fb5f383afaf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:40.160599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71a87f8b-84b8-4b23-ba5c-fb5f383afaf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:40.162711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71a87f8b-84b8-4b23-ba5c-fb5f383afaf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:40.169302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71a87f8b-84b8-4b23-ba5c-fb5f383afaf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:41.197090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:41.237547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:41.246778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:41.259818 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ea7726ea-dae6-4855-9c2d-d6189bdd1b90 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1832 microversion: 2.42 time: 1.227599 Aug 25 13:03:41.268977 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1463/2934] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:40 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1832 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:03:41.295321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2ae9e80-aec0-4b88-83ad-a6c4cfab74e7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:41.297351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2ae9e80-aec0-4b88-83ad-a6c4cfab74e7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:41.303463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-71a87f8b-84b8-4b23-ba5c-fb5f383afaf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:41.325802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae9e80-aec0-4b88-83ad-a6c4cfab74e7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:41.326695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae9e80-aec0-4b88-83ad-a6c4cfab74e7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:41.327174 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-71a87f8b-84b8-4b23-ba5c-fb5f383afaf8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 1.219024 Aug 25 13:03:41.327568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae9e80-aec0-4b88-83ad-a6c4cfab74e7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:41.327798 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1472/2935] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:40 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:41.333850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae9e80-aec0-4b88-83ad-a6c4cfab74e7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:41.336782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae9e80-aec0-4b88-83ad-a6c4cfab74e7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:41.338179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2ae9e80-aec0-4b88-83ad-a6c4cfab74e7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:41.348464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-517e2ecb-7e10-4a3b-993a-67a39c843ed3 req-afd2d24f-5bb8-4ccb-9ed1-69df52e3e51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a97f70b-4323-4b49-b4dc-fa5c78170ae9", "name": "network-vif-plugged", "status": "completed", "tag": "0a9a7acf-80db-4e80-a571-b66bd271a714"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:41.388611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-517e2ecb-7e10-4a3b-993a-67a39c843ed3 req-afd2d24f-5bb8-4ccb-9ed1-69df52e3e51e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:41.389947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-517e2ecb-7e10-4a3b-993a-67a39c843ed3 req-afd2d24f-5bb8-4ccb-9ed1-69df52e3e51e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:41.391031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-517e2ecb-7e10-4a3b-993a-67a39c843ed3 req-afd2d24f-5bb8-4ccb-9ed1-69df52e3e51e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:41.443778 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-517e2ecb-7e10-4a3b-993a-67a39c843ed3 req-afd2d24f-5bb8-4ccb-9ed1-69df52e3e51e service nova] Creating event network-vif-plugged:0a9a7acf-80db-4e80-a571-b66bd271a714 for instance 5a97f70b-4323-4b49-b4dc-fa5c78170ae9 on n-h1-852771-8 Aug 25 13:03:41.452012 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-517e2ecb-7e10-4a3b-993a-67a39c843ed3 req-afd2d24f-5bb8-4ccb-9ed1-69df52e3e51e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122384 Aug 25 13:03:41.463478 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1473/2936] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:42.320359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:42.322180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:42.360568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:42.361319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:42.362197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:42.363518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:42.364386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:42.365790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:42.953436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2ae9e80-aec0-4b88-83ad-a6c4cfab74e7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:42.972189 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2ae9e80-aec0-4b88-83ad-a6c4cfab74e7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1319 microversion: 2.1 time: 1.699234 Aug 25 13:03:42.974518 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1464/2937] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:41 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1319 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:42.982482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ccf780db-f09a-4527-abfb-8ed8930f8cd8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:42.984466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ccf780db-f09a-4527-abfb-8ed8930f8cd8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:42.997674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf780db-f09a-4527-abfb-8ed8930f8cd8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:42.999082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf780db-f09a-4527-abfb-8ed8930f8cd8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:43.000534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf780db-f09a-4527-abfb-8ed8930f8cd8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:43.002263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf780db-f09a-4527-abfb-8ed8930f8cd8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:43.003464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf780db-f09a-4527-abfb-8ed8930f8cd8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:43.004555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ccf780db-f09a-4527-abfb-8ed8930f8cd8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:43.039747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:43.341679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:43.377444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:43.381947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:43.389371 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9dfd978-b543-45a4-8db8-26c91f84d4f9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1853 microversion: 2.42 time: 1.079866 Aug 25 13:03:43.391844 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1474/2938] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:42 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1853 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:03:43.524038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ccf780db-f09a-4527-abfb-8ed8930f8cd8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:43.540020 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ccf780db-f09a-4527-abfb-8ed8930f8cd8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 0.562752 Aug 25 13:03:43.558725 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1465/2939] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:42 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:44.030432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9e6ed50d-5cc5-4211-9176-c3cc54389c6c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:44.031859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9e6ed50d-5cc5-4211-9176-c3cc54389c6c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:44.035821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:44.049134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e6ed50d-5cc5-4211-9176-c3cc54389c6c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:44.050603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e6ed50d-5cc5-4211-9176-c3cc54389c6c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:44.051875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e6ed50d-5cc5-4211-9176-c3cc54389c6c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:44.053767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e6ed50d-5cc5-4211-9176-c3cc54389c6c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:44.055246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e6ed50d-5cc5-4211-9176-c3cc54389c6c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:44.056511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e6ed50d-5cc5-4211-9176-c3cc54389c6c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:44.443293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:44.451115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:44.478061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:44.479163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:44.479786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:44.493609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:44.494486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:44.495313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:45.356103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9e6ed50d-5cc5-4211-9176-c3cc54389c6c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:45.389414 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9e6ed50d-5cc5-4211-9176-c3cc54389c6c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1469 microversion: 2.1 time: 1.373633 Aug 25 13:03:45.407379 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1475/2940] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:44 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1469 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:45.438532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-53687f1a-cc64-491c-b912-139ee04beaaa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:45.440168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-53687f1a-cc64-491c-b912-139ee04beaaa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:45.454443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53687f1a-cc64-491c-b912-139ee04beaaa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:45.456607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53687f1a-cc64-491c-b912-139ee04beaaa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:45.458628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53687f1a-cc64-491c-b912-139ee04beaaa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:45.468041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53687f1a-cc64-491c-b912-139ee04beaaa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:45.480801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53687f1a-cc64-491c-b912-139ee04beaaa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:45.483992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53687f1a-cc64-491c-b912-139ee04beaaa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:46.056928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:46.080803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:46.091384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:46.093605 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-03f00152-de15-4a85-8a87-e03c4894bcc1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1853 microversion: 2.42 time: 1.657665 Aug 25 13:03:46.097980 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1466/2941] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:44 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1853 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:46.113943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7efbdf79-e1d4-4bf0-bf40-343bf4827056 req-56dace31-ebdf-49bb-ae4b-8d00ec7022e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "tag": "2cf476bc-998d-4575-aaf0-a2986161d365"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:46.145554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7efbdf79-e1d4-4bf0-bf40-343bf4827056 req-56dace31-ebdf-49bb-ae4b-8d00ec7022e7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:46.150868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7efbdf79-e1d4-4bf0-bf40-343bf4827056 req-56dace31-ebdf-49bb-ae4b-8d00ec7022e7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:46.153546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7efbdf79-e1d4-4bf0-bf40-343bf4827056 req-56dace31-ebdf-49bb-ae4b-8d00ec7022e7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:46.182418 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7efbdf79-e1d4-4bf0-bf40-343bf4827056 req-56dace31-ebdf-49bb-ae4b-8d00ec7022e7 service nova] Creating event network-changed:2cf476bc-998d-4575-aaf0-a2986161d365 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:03:46.192851 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7efbdf79-e1d4-4bf0-bf40-343bf4827056 req-56dace31-ebdf-49bb-ae4b-8d00ec7022e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091319 Aug 25 13:03:46.195101 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1467/2942] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:46.216881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a0a8f8db-84d1-4cc1-8e5d-441344f450c9 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:46.218680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a0a8f8db-84d1-4cc1-8e5d-441344f450c9 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: c9221961-b954-4113-b962-f35e65e91f36] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:46.235998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0a8f8db-84d1-4cc1-8e5d-441344f450c9 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:46.237261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0a8f8db-84d1-4cc1-8e5d-441344f450c9 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:46.238758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0a8f8db-84d1-4cc1-8e5d-441344f450c9 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:46.241448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0a8f8db-84d1-4cc1-8e5d-441344f450c9 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:46.243012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0a8f8db-84d1-4cc1-8e5d-441344f450c9 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:46.244489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0a8f8db-84d1-4cc1-8e5d-441344f450c9 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:46.279233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-53687f1a-cc64-491c-b912-139ee04beaaa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:46.322766 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-53687f1a-cc64-491c-b912-139ee04beaaa tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1512 microversion: 2.1 time: 0.912958 Aug 25 13:03:46.334052 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1476/2943] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:45 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1512 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:47.144994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a0a8f8db-84d1-4cc1-8e5d-441344f450c9 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:47.175351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:47.176588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:47.182675 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a0a8f8db-84d1-4cc1-8e5d-441344f450c9 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36" status: 200 len: 1469 microversion: 2.1 time: 0.984874 Aug 25 13:03:47.183774 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1468/2944] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:46 2022] GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36 => generated 1469 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:47.195460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:47.196757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:47.197940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:47.199831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:47.201021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:47.202112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:47.248093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:47.266287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:47.268916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Searching by: {'reservation_id': 'r-8gxy66rc', 'deleted': False, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:03:47.285311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:47.289319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:47.290617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:47.293182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:47.297110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:47.298898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:47.499988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:03:47.659124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:47.673127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:47.674537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:47.675490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:48.141172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:48.184642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:48.191572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:48.198019 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-31f7f6e1-33c6-44cc-8e5c-3ff7f23ee30e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1853 microversion: 2.42 time: 1.049515 Aug 25 13:03:48.206515 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1477/2945] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:47 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1853 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:48.238755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4a642500-7d2e-4d61-9a3e-d9e6f1ba8085 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:48.247019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4a642500-7d2e-4d61-9a3e-d9e6f1ba8085 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:48.265411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a642500-7d2e-4d61-9a3e-d9e6f1ba8085 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:48.267210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a642500-7d2e-4d61-9a3e-d9e6f1ba8085 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:48.268761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a642500-7d2e-4d61-9a3e-d9e6f1ba8085 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:48.271015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a642500-7d2e-4d61-9a3e-d9e6f1ba8085 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:48.275245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a642500-7d2e-4d61-9a3e-d9e6f1ba8085 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:48.276144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a642500-7d2e-4d61-9a3e-d9e6f1ba8085 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:48.334451 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d9b601cd-35f9-499e-85fe-2d95865186fc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?reservation_id=r-8gxy66rc" status: 200 len: 2931 microversion: 2.1 time: 1.095236 Aug 25 13:03:48.339127 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1469/2946] 10.222.0.70 () {58 vars in 1197 bytes} [Thu Aug 25 13:03:47 2022] GET /compute/v2.1/servers/detail?reservation_id=r-8gxy66rc => generated 2931 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:48.404776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f1f9f92-b738-451e-ae63-22160e6548dc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:48.452606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.server_groups [None req-2f1f9f92-b738-451e-ae63-22160e6548dc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Querying cell 638d90be-ffdb-4b61-b94a-775c50a724be(cell1) for 2 instances {{(pid=129059) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 25 13:03:48.456965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f1f9f92-b738-451e-ae63-22160e6548dc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:48.458469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f1f9f92-b738-451e-ae63-22160e6548dc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:48.460835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f1f9f92-b738-451e-ae63-22160e6548dc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:48.519600 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f1f9f92-b738-451e-ae63-22160e6548dc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/50550a82-1963-47e3-a5ff-1df9ddff4278" status: 200 len: 271 microversion: 2.1 time: 0.128343 Aug 25 13:03:48.521743 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1470/2947] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 13:03:48 2022] GET /compute/v2.1/os-server-groups/50550a82-1963-47e3-a5ff-1df9ddff4278 => generated 271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:48.553678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4b967250-8dec-4987-a77d-8bec632c851b tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:48.554976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4b967250-8dec-4987-a77d-8bec632c851b tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:48.576922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b967250-8dec-4987-a77d-8bec632c851b tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:48.579383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b967250-8dec-4987-a77d-8bec632c851b tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:48.581187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b967250-8dec-4987-a77d-8bec632c851b tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:48.583004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b967250-8dec-4987-a77d-8bec632c851b tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:48.586408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b967250-8dec-4987-a77d-8bec632c851b tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:48.587522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b967250-8dec-4987-a77d-8bec632c851b tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:48.950499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4a642500-7d2e-4d61-9a3e-d9e6f1ba8085 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:48.983169 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4a642500-7d2e-4d61-9a3e-d9e6f1ba8085 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1489 microversion: 2.1 time: 0.773638 Aug 25 13:03:48.992022 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1478/2948] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:48 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1489 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:48.999577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1670047980", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c492fa6-6e78-453d-bf88-c7f9aac830a1"}], "security_groups": [{"name": "tempest-securitygroup--8900455"}], "key_name": "tempest-keypair-269775316", "user_data": "}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:49.032302 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4b967250-8dec-4987-a77d-8bec632c851b tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 200 len: 1620 microversion: 2.1 time: 0.497767 Aug 25 13:03:49.033320 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1471/2949] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:48 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 1620 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:49.057855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a7573fa-581f-474c-99f6-08de20e37dfd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:49.059390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a7573fa-581f-474c-99f6-08de20e37dfd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:49.085200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a7573fa-581f-474c-99f6-08de20e37dfd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:49.086664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a7573fa-581f-474c-99f6-08de20e37dfd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:49.087775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a7573fa-581f-474c-99f6-08de20e37dfd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:49.089159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a7573fa-581f-474c-99f6-08de20e37dfd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:49.090094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a7573fa-581f-474c-99f6-08de20e37dfd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:49.091486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a7573fa-581f-474c-99f6-08de20e37dfd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:49.152017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a7573fa-581f-474c-99f6-08de20e37dfd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:03:49.306895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] validate_networks() for [('7c492fa6-6e78-453d-bf88-c7f9aac830a1', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:03:49.406514 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a7573fa-581f-474c-99f6-08de20e37dfd tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 204 len: 0 microversion: 2.1 time: 0.356178 Aug 25 13:03:49.409816 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1472/2950] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:03:49 2022] DELETE /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:03:49.426094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e3c67177-e360-48ae-9c09-fa6cf319071a tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:49.428150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e3c67177-e360-48ae-9c09-fa6cf319071a tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] [instance: c9221961-b954-4113-b962-f35e65e91f36] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:49.441060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c67177-e360-48ae-9c09-fa6cf319071a tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:49.442282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c67177-e360-48ae-9c09-fa6cf319071a tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:49.444790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c67177-e360-48ae-9c09-fa6cf319071a tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:49.444790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c67177-e360-48ae-9c09-fa6cf319071a tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:49.445744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c67177-e360-48ae-9c09-fa6cf319071a tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:49.446531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3c67177-e360-48ae-9c09-fa6cf319071a tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:49.837811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:49.900885 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e3c67177-e360-48ae-9c09-fa6cf319071a tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36" status: 200 len: 1620 microversion: 2.1 time: 0.486190 Aug 25 13:03:49.903085 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1473/2951] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:49 2022] GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36 => generated 1620 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:49.913293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:49.914692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:49.930707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:49.931868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:49.934287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:49.937077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:49.939677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:49.946436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:51.069388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:51.092151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:03:51.094132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:03:51.095398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:03:51.096460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:03:51.097432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:03:51.117457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:51.125854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:51.126366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:51.127140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:51.128522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:51.129377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:51.130197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:51.132569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:51.136174 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-31844240-db0c-4327-b089-7a425e5694f2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.231224 Aug 25 13:03:51.151721 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1474/2952] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:49 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:51.174992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d281d99b-e818-44b1-a410-b1f599c64c93 req-67f29d0c-6c06-4a86-a6d2-9df12e0fd786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "tag": "d8ec31a3-80bb-4d7b-bc7a-5a21d51389c7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:51.192771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:51.203762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d281d99b-e818-44b1-a410-b1f599c64c93 req-67f29d0c-6c06-4a86-a6d2-9df12e0fd786 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:51.204642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d281d99b-e818-44b1-a410-b1f599c64c93 req-67f29d0c-6c06-4a86-a6d2-9df12e0fd786 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:51.206040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d281d99b-e818-44b1-a410-b1f599c64c93 req-67f29d0c-6c06-4a86-a6d2-9df12e0fd786 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:51.206919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for user e320ccc6c0624541895fc42bf681da76 and project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:51.230990 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d281d99b-e818-44b1-a410-b1f599c64c93 req-67f29d0c-6c06-4a86-a6d2-9df12e0fd786 service nova] Creating event network-changed:d8ec31a3-80bb-4d7b-bc7a-5a21d51389c7 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:03:51.240741 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d281d99b-e818-44b1-a410-b1f599c64c93 req-67f29d0c-6c06-4a86-a6d2-9df12e0fd786 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085680 Aug 25 13:03:51.242330 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1475/2953] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:51.249345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:03:51.252416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe6ce6af-f2eb-4b7e-9adc-ef36a43c73c8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:51.253909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe6ce6af-f2eb-4b7e-9adc-ef36a43c73c8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:51.258723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:03:51.267839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe6ce6af-f2eb-4b7e-9adc-ef36a43c73c8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:51.269184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe6ce6af-f2eb-4b7e-9adc-ef36a43c73c8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:51.270326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe6ce6af-f2eb-4b7e-9adc-ef36a43c73c8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:51.272787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe6ce6af-f2eb-4b7e-9adc-ef36a43c73c8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:51.274079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe6ce6af-f2eb-4b7e-9adc-ef36a43c73c8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:51.275160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe6ce6af-f2eb-4b7e-9adc-ef36a43c73c8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:51.389854 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8b4593f8-f76f-4bc9-8ad2-62f66ea4366b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.401432 Aug 25 13:03:51.391506 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1479/2954] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:03:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 2405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:03:51.420567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-403626910", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "34c46524-70ff-4c0a-9fce-afaacf9d2ba5"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:51.621984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:03:52.119379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fe6ce6af-f2eb-4b7e-9adc-ef36a43c73c8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:52.146916 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe6ce6af-f2eb-4b7e-9adc-ef36a43c73c8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1495 microversion: 2.1 time: 0.901550 Aug 25 13:03:52.148201 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1476/2955] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:51 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1495 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:52.171809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4ef2439a-3b6c-4c5b-9711-eeea04be3d01 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:52.173409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4ef2439a-3b6c-4c5b-9711-eeea04be3d01 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:52.414925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4ef2439a-3b6c-4c5b-9711-eeea04be3d01 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:52.465989 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4ef2439a-3b6c-4c5b-9711-eeea04be3d01 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1238 microversion: 2.1 time: 0.312352 Aug 25 13:03:52.467837 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1477/2956] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:52 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1238 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:52.493163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:52.494577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:52.532270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:52.533014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:52.534096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:52.535678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:52.536618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:52.538108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:52.915806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:03:52.919817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:03:52.921538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:03:52.925480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:03:52.926908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:03:52.948451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:52.950041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:52.951261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:52.953227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:52.956513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:52.958182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:53.002101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:53.032593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:53.069212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:03:53.073968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:03:53.226626 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-abc9e8e3-ed88-4633-9bba-70ff3700de74 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.832889 Aug 25 13:03:53.244920 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1480/2957] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:03:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:03:53.255370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1ec4248a-f0c8-40dd-9fac-46791ac1c06e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:53.259467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1ec4248a-f0c8-40dd-9fac-46791ac1c06e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:53.274697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec4248a-f0c8-40dd-9fac-46791ac1c06e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:53.276071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec4248a-f0c8-40dd-9fac-46791ac1c06e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:53.277376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec4248a-f0c8-40dd-9fac-46791ac1c06e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:53.279241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec4248a-f0c8-40dd-9fac-46791ac1c06e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:53.280563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec4248a-f0c8-40dd-9fac-46791ac1c06e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:53.281779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec4248a-f0c8-40dd-9fac-46791ac1c06e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:53.301119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:53.348526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:53.357035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:53.364203 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a5dc50f-8361-45d1-a02b-1b59bea9987f tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 0.890361 Aug 25 13:03:53.369974 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1478/2958] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:52 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:53.402510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4b2b455-0c33-411a-a3c2-e3563f1a1dcf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:53.404586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4b2b455-0c33-411a-a3c2-e3563f1a1dcf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:53.551006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1ec4248a-f0c8-40dd-9fac-46791ac1c06e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:53.591856 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1ec4248a-f0c8-40dd-9fac-46791ac1c06e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 200 len: 1453 microversion: 2.1 time: 0.344372 Aug 25 13:03:53.596292 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1481/2959] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:53 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 1453 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:53.612446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4e89c000-66f1-4415-a249-ed0c1c4c525f req-1557af54-b8fe-4f03-b43f-29f59a010d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fd34ef-a381-41f0-a819-dc99a352e09a", "name": "network-vif-deleted", "tag": "2e868831-7b21-4aa7-b9f8-efc48e541cc2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:53.666282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4e89c000-66f1-4415-a249-ed0c1c4c525f req-1557af54-b8fe-4f03-b43f-29f59a010d47 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:53.671305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4e89c000-66f1-4415-a249-ed0c1c4c525f req-1557af54-b8fe-4f03-b43f-29f59a010d47 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:53.681202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4e89c000-66f1-4415-a249-ed0c1c4c525f req-1557af54-b8fe-4f03-b43f-29f59a010d47 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:53.691407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d4b2b455-0c33-411a-a3c2-e3563f1a1dcf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:53.722069 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4e89c000-66f1-4415-a249-ed0c1c4c525f req-1557af54-b8fe-4f03-b43f-29f59a010d47 service nova] Creating event network-vif-deleted:2e868831-7b21-4aa7-b9f8-efc48e541cc2 for instance 46fd34ef-a381-41f0-a819-dc99a352e09a on n-h2-852771-8 Aug 25 13:03:53.722400 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4b2b455-0c33-411a-a3c2-e3563f1a1dcf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1216 microversion: 2.1 time: 0.349586 Aug 25 13:03:53.730680 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1479/2960] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:53 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1216 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:53.744142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4299b161-715f-4d51-94ed-7c794aa51a7b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:53.760432 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4e89c000-66f1-4415-a249-ed0c1c4c525f req-1557af54-b8fe-4f03-b43f-29f59a010d47 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146618 Aug 25 13:03:53.761038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4299b161-715f-4d51-94ed-7c794aa51a7b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:53.782093 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1482/2961] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:53.782615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4299b161-715f-4d51-94ed-7c794aa51a7b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:53.784402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4299b161-715f-4d51-94ed-7c794aa51a7b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:53.788472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4299b161-715f-4d51-94ed-7c794aa51a7b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:53.789932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4299b161-715f-4d51-94ed-7c794aa51a7b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:53.796059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4299b161-715f-4d51-94ed-7c794aa51a7b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:53.797063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4299b161-715f-4d51-94ed-7c794aa51a7b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:54.012742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4299b161-715f-4d51-94ed-7c794aa51a7b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:54.029163 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4299b161-715f-4d51-94ed-7c794aa51a7b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1290 microversion: 2.1 time: 0.295325 Aug 25 13:03:54.030477 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1480/2962] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:53 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1290 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:54.448967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:54.451589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:54.499416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:54.499416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:54.499416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:54.499972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:54.501114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:54.502059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:54.668660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:54.678216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:54.692858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:54.695227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:54.697069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:54.700225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:54.702997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:54.704256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:54.754182 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a HTTP/1.1 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '46fd34ef-a381-41f0-a819-dc99a352e09a'} Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:03:54.760317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:03:54.775165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:54.775165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:03:54.775165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:03:54.775165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:03:54.775165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:03:54.775165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:03:54.775165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:03:54.782157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:03:54.782157 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b0215105-1c56-4f97-9da6-e48a13a8f3c3 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 404 len: 111 microversion: 2.1 time: 0.143413 Aug 25 13:03:54.784004 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1481/2963] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:54 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:03:54.797647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0fdc3df0-cc5c-4295-a787-c0e76cc754b4 req-ec8c59c1-4762-4632-915b-a1123a56fcef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "tag": "ed5bbca5-cf27-4cc2-9c60-a1ffe6539741"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:54.840030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0fdc3df0-cc5c-4295-a787-c0e76cc754b4 req-ec8c59c1-4762-4632-915b-a1123a56fcef service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:54.841466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0fdc3df0-cc5c-4295-a787-c0e76cc754b4 req-ec8c59c1-4762-4632-915b-a1123a56fcef service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:54.847929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0fdc3df0-cc5c-4295-a787-c0e76cc754b4 req-ec8c59c1-4762-4632-915b-a1123a56fcef service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:54.875133 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-0fdc3df0-cc5c-4295-a787-c0e76cc754b4 req-ec8c59c1-4762-4632-915b-a1123a56fcef service nova] Creating event network-changed:ed5bbca5-cf27-4cc2-9c60-a1ffe6539741 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:03:54.885996 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0fdc3df0-cc5c-4295-a787-c0e76cc754b4 req-ec8c59c1-4762-4632-915b-a1123a56fcef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098565 Aug 25 13:03:54.891643 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1482/2964] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:54.903870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-71b0d93c-8b94-412f-b5c6-1750a352cfde tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:54.906017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-71b0d93c-8b94-412f-b5c6-1750a352cfde tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:54.923161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b0d93c-8b94-412f-b5c6-1750a352cfde tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:54.924521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b0d93c-8b94-412f-b5c6-1750a352cfde tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:54.925395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b0d93c-8b94-412f-b5c6-1750a352cfde tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:54.927301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b0d93c-8b94-412f-b5c6-1750a352cfde tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:54.929042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b0d93c-8b94-412f-b5c6-1750a352cfde tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:54.930289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b0d93c-8b94-412f-b5c6-1750a352cfde tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:55.374410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-71b0d93c-8b94-412f-b5c6-1750a352cfde tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:55.393796 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-71b0d93c-8b94-412f-b5c6-1750a352cfde tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1212 microversion: 2.1 time: 0.498390 Aug 25 13:03:55.395698 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1483/2965] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:54 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1212 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:55.405822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c792a428-f15f-4543-b184-ecf25e5e86a0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:55.407141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c792a428-f15f-4543-b184-ecf25e5e86a0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:55.421061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c792a428-f15f-4543-b184-ecf25e5e86a0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:55.422013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c792a428-f15f-4543-b184-ecf25e5e86a0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:55.422855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c792a428-f15f-4543-b184-ecf25e5e86a0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:55.424441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c792a428-f15f-4543-b184-ecf25e5e86a0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:55.425453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c792a428-f15f-4543-b184-ecf25e5e86a0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:55.426112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c792a428-f15f-4543-b184-ecf25e5e86a0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:55.500277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:55.527746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:55.531884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:55.535707 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e6d51f4c-f7f1-4589-b93e-23d9608e8d6a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.098403 Aug 25 13:03:55.557598 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1483/2966] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:54 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:55.572129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-78376307", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "8786102b-a15d-4894-b94c-776d2b47ed6a"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:55.717919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] validate_networks() for [('8786102b-a15d-4894-b94c-776d2b47ed6a', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:03:55.772986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c792a428-f15f-4543-b184-ecf25e5e86a0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:55.787880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:55.816621 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c792a428-f15f-4543-b184-ecf25e5e86a0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1296 microversion: 2.1 time: 0.418474 Aug 25 13:03:55.821819 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1484/2967] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:55 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1296 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:56.439933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0d9f11d-2fb3-4c75-8073-5f2972906d91 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:56.441481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c0d9f11d-2fb3-4c75-8073-5f2972906d91 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:56.471689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0d9f11d-2fb3-4c75-8073-5f2972906d91 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:56.473012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0d9f11d-2fb3-4c75-8073-5f2972906d91 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:56.475311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0d9f11d-2fb3-4c75-8073-5f2972906d91 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:56.477184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0d9f11d-2fb3-4c75-8073-5f2972906d91 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:56.478571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0d9f11d-2fb3-4c75-8073-5f2972906d91 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:56.479644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0d9f11d-2fb3-4c75-8073-5f2972906d91 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:56.749663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c0d9f11d-2fb3-4c75-8073-5f2972906d91 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:56.773730 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0d9f11d-2fb3-4c75-8073-5f2972906d91 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1274 microversion: 2.1 time: 0.347271 Aug 25 13:03:56.775693 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1485/2968] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:56 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1274 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:56.789837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:56.792967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:56.817228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:56.818053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:56.819112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:56.820338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:56.821074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:56.821773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:57.379626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:57.515592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:03:57.517722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:03:57.518596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:03:57.519859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:03:57.520786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:03:57.550319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:57.556169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:57.557868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:57.559067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:57.561072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:57.562193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:57.563258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:57.582179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:57.587469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:57.590373 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-86a85687-d85d-467e-a63b-8f7815d01d61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 0.810909 Aug 25 13:03:57.591652 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1486/2969] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:56 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:57.628465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:57.636011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3788b0c1-de1c-4527-a224-46360c1ce68d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:57.637295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3788b0c1-de1c-4527-a224-46360c1ce68d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:57.649561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Getting quotas for user 2b81a6a01a24413b8212f140080ed018 and project 24ffc96935324a758f7b39e81a4b49d5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:57.660209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3788b0c1-de1c-4527-a224-46360c1ce68d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:57.661224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3788b0c1-de1c-4527-a224-46360c1ce68d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:57.668125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3788b0c1-de1c-4527-a224-46360c1ce68d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:57.669275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3788b0c1-de1c-4527-a224-46360c1ce68d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:57.670306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3788b0c1-de1c-4527-a224-46360c1ce68d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:57.676273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3788b0c1-de1c-4527-a224-46360c1ce68d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:57.691823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:03:57.700305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:03:57.822373 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-09b73500-7495-4bf4-a272-898c29ce8318 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.267292 Aug 25 13:03:57.836743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3788b0c1-de1c-4527-a224-46360c1ce68d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:57.838549 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1484/2970] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:03:57.848335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d4541e73-3af1-46a2-91a1-52fb49cea1c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:57.850156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d4541e73-3af1-46a2-91a1-52fb49cea1c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:57.862592 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3788b0c1-de1c-4527-a224-46360c1ce68d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1296 microversion: 2.1 time: 0.254542 Aug 25 13:03:57.863713 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1487/2971] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:57 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1296 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:57.866032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4541e73-3af1-46a2-91a1-52fb49cea1c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:57.867327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4541e73-3af1-46a2-91a1-52fb49cea1c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:57.868627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4541e73-3af1-46a2-91a1-52fb49cea1c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:57.870300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4541e73-3af1-46a2-91a1-52fb49cea1c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:57.871483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4541e73-3af1-46a2-91a1-52fb49cea1c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:57.872805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8c644348-4608-43cb-8eb4-1daac38c0fb9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:57.873185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4541e73-3af1-46a2-91a1-52fb49cea1c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:57.880192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:57.883342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8c644348-4608-43cb-8eb4-1daac38c0fb9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:58.081678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d4541e73-3af1-46a2-91a1-52fb49cea1c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:58.117454 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d4541e73-3af1-46a2-91a1-52fb49cea1c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1274 microversion: 2.1 time: 0.276872 Aug 25 13:03:58.119387 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1485/2972] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:57 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:58.158404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8c644348-4608-43cb-8eb4-1daac38c0fb9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:58.182071 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8c644348-4608-43cb-8eb4-1daac38c0fb9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1213 microversion: 2.1 time: 0.316144 Aug 25 13:03:58.183472 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1488/2973] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:57 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1213 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:58.652923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:58.659542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:58.679570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:58.680258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:58.680775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:58.695479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:58.696674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:58.698488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:58.930459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3dd97532-8ccc-4293-9d0f-00fc5605b205 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:58.931736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3dd97532-8ccc-4293-9d0f-00fc5605b205 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:58.953809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dd97532-8ccc-4293-9d0f-00fc5605b205 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:58.955109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dd97532-8ccc-4293-9d0f-00fc5605b205 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:58.956721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dd97532-8ccc-4293-9d0f-00fc5605b205 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:58.958514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dd97532-8ccc-4293-9d0f-00fc5605b205 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:58.959961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dd97532-8ccc-4293-9d0f-00fc5605b205 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:58.962708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dd97532-8ccc-4293-9d0f-00fc5605b205 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:00.083416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:00.105797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:00.110102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:00.113352 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b467d814-186b-4dab-ab19-99251146c8e4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.473205 Aug 25 13:04:00.115096 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1486/2974] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:58 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:00.124837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b11d002c-6fa0-468e-a02d-ed67f5cbb3cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:00.126781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b11d002c-6fa0-468e-a02d-ed67f5cbb3cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:00.140267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b11d002c-6fa0-468e-a02d-ed67f5cbb3cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:00.141877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b11d002c-6fa0-468e-a02d-ed67f5cbb3cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:00.143091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b11d002c-6fa0-468e-a02d-ed67f5cbb3cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:00.144916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b11d002c-6fa0-468e-a02d-ed67f5cbb3cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:00.147570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b11d002c-6fa0-468e-a02d-ed67f5cbb3cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:00.148995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b11d002c-6fa0-468e-a02d-ed67f5cbb3cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:00.259950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3dd97532-8ccc-4293-9d0f-00fc5605b205 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:00.280771 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3dd97532-8ccc-4293-9d0f-00fc5605b205 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1361 microversion: 2.1 time: 1.368595 Aug 25 13:04:00.297688 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1489/2975] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:58 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1361 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:00.310969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8cf1f5f8-952b-444a-b227-8a2d33a6d041 req-421e4abe-0487-4d41-b426-ed0c1b5d9428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "tag": "2220c4ad-2d43-43af-8e24-1c7cdc12d117"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:00.335680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8cf1f5f8-952b-444a-b227-8a2d33a6d041 req-421e4abe-0487-4d41-b426-ed0c1b5d9428 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:00.336671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8cf1f5f8-952b-444a-b227-8a2d33a6d041 req-421e4abe-0487-4d41-b426-ed0c1b5d9428 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:00.337658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8cf1f5f8-952b-444a-b227-8a2d33a6d041 req-421e4abe-0487-4d41-b426-ed0c1b5d9428 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:00.367650 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8cf1f5f8-952b-444a-b227-8a2d33a6d041 req-421e4abe-0487-4d41-b426-ed0c1b5d9428 service nova] Creating event network-changed:2220c4ad-2d43-43af-8e24-1c7cdc12d117 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:04:00.379574 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8cf1f5f8-952b-444a-b227-8a2d33a6d041 req-421e4abe-0487-4d41-b426-ed0c1b5d9428 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089484 Aug 25 13:04:00.382235 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1490/2976] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:00.393173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d89b03b4-8308-4eb1-b716-828659114418 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:00.395258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d89b03b4-8308-4eb1-b716-828659114418 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:00.414336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b11d002c-6fa0-468e-a02d-ed67f5cbb3cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:00.426448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d89b03b4-8308-4eb1-b716-828659114418 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:00.431507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d89b03b4-8308-4eb1-b716-828659114418 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:00.432950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d89b03b4-8308-4eb1-b716-828659114418 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:00.440565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d89b03b4-8308-4eb1-b716-828659114418 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:00.442121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d89b03b4-8308-4eb1-b716-828659114418 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:00.443365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d89b03b4-8308-4eb1-b716-828659114418 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:00.457603 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b11d002c-6fa0-468e-a02d-ed67f5cbb3cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1274 microversion: 2.1 time: 0.333534 Aug 25 13:04:00.464681 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1487/2977] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:00 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1274 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:00.790156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d89b03b4-8308-4eb1-b716-828659114418 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:00.812901 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d89b03b4-8308-4eb1-b716-828659114418 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1271 microversion: 2.1 time: 0.427616 Aug 25 13:04:00.817291 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1491/2978] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:00 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1271 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:01.175580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:01.180407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:01.198481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:01.200538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:01.202525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:01.204409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:01.206737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:01.208000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:01.334743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-300c75a1-3bb4-45f2-87c3-6434a2a66d48 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:01.337959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-300c75a1-3bb4-45f2-87c3-6434a2a66d48 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:01.344975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:01.359146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-300c75a1-3bb4-45f2-87c3-6434a2a66d48 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:01.360439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-300c75a1-3bb4-45f2-87c3-6434a2a66d48 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:01.361414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-300c75a1-3bb4-45f2-87c3-6434a2a66d48 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:01.363937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-300c75a1-3bb4-45f2-87c3-6434a2a66d48 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:01.365829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-300c75a1-3bb4-45f2-87c3-6434a2a66d48 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:01.368901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-300c75a1-3bb4-45f2-87c3-6434a2a66d48 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:02.850714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-300c75a1-3bb4-45f2-87c3-6434a2a66d48 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:02.859071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:02.889335 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-300c75a1-3bb4-45f2-87c3-6434a2a66d48 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1361 microversion: 2.1 time: 1.565106 Aug 25 13:04:02.897764 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1492/2979] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:01 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1361 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:02.918014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:02.925208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:02.940099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7cf1fd1b-6982-4cbf-9474-3fad9af91bf2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:02.944870 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d8a29f7-28a9-46c9-a21a-2411e52bb8cf tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.763977 Aug 25 13:04:02.953707 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1488/2980] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:01 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:02.964816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7cf1fd1b-6982-4cbf-9474-3fad9af91bf2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:02.994707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a0e7c55-1b64-4d2c-9faa-ad78a3fdc4ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:02.996075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a0e7c55-1b64-4d2c-9faa-ad78a3fdc4ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:03.008309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf1fd1b-6982-4cbf-9474-3fad9af91bf2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:03.011347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf1fd1b-6982-4cbf-9474-3fad9af91bf2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:03.012758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf1fd1b-6982-4cbf-9474-3fad9af91bf2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:03.015662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf1fd1b-6982-4cbf-9474-3fad9af91bf2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:03.016752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf1fd1b-6982-4cbf-9474-3fad9af91bf2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:03.017876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf1fd1b-6982-4cbf-9474-3fad9af91bf2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:03.024276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c55-1b64-4d2c-9faa-ad78a3fdc4ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:03.025099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c55-1b64-4d2c-9faa-ad78a3fdc4ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:03.025916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c55-1b64-4d2c-9faa-ad78a3fdc4ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:03.027262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c55-1b64-4d2c-9faa-ad78a3fdc4ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:03.028452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c55-1b64-4d2c-9faa-ad78a3fdc4ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:03.034835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c55-1b64-4d2c-9faa-ad78a3fdc4ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:03.577021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a0e7c55-1b64-4d2c-9faa-ad78a3fdc4ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:03.597647 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a0e7c55-1b64-4d2c-9faa-ad78a3fdc4ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1271 microversion: 2.1 time: 0.629783 Aug 25 13:04:03.621061 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1489/2981] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:02 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1271 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:03.922276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7cf1fd1b-6982-4cbf-9474-3fad9af91bf2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:03.939893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ba0d5fa-737e-4f58-bac4-a587ee7eb0f1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:03.942292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7ba0d5fa-737e-4f58-bac4-a587ee7eb0f1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:03.949344 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7cf1fd1b-6982-4cbf-9474-3fad9af91bf2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1316 microversion: 2.1 time: 1.048881 Aug 25 13:04:03.951465 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1493/2982] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:02 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1316 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:03.958099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ba0d5fa-737e-4f58-bac4-a587ee7eb0f1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:03.962914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ba0d5fa-737e-4f58-bac4-a587ee7eb0f1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:03.966527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ba0d5fa-737e-4f58-bac4-a587ee7eb0f1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:03.970026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ba0d5fa-737e-4f58-bac4-a587ee7eb0f1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:03.972419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ba0d5fa-737e-4f58-bac4-a587ee7eb0f1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:03.975038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ba0d5fa-737e-4f58-bac4-a587ee7eb0f1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:04.007512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:04.009431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:04.026815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:04.028130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:04.029443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:04.031187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:04.032412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:04.033554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:05.688460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7ba0d5fa-737e-4f58-bac4-a587ee7eb0f1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:05.705592 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ba0d5fa-737e-4f58-bac4-a587ee7eb0f1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1361 microversion: 2.1 time: 1.772871 Aug 25 13:04:05.706810 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1490/2983] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:03 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1361 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:05.715528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8906a4f8-2a10-47a2-9d16-48723ee6e32f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:05.717268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8906a4f8-2a10-47a2-9d16-48723ee6e32f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:05.733690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8906a4f8-2a10-47a2-9d16-48723ee6e32f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:05.735043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8906a4f8-2a10-47a2-9d16-48723ee6e32f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:05.736392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8906a4f8-2a10-47a2-9d16-48723ee6e32f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:05.738544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8906a4f8-2a10-47a2-9d16-48723ee6e32f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:05.739432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8906a4f8-2a10-47a2-9d16-48723ee6e32f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:05.742759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8906a4f8-2a10-47a2-9d16-48723ee6e32f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:05.773323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:05.807448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:05.822152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:05.824874 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ba740699-42bc-465a-8e71-1ebc1b25fcb0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.826860 Aug 25 13:04:05.826026 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1494/2984] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:03 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:05.838018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0f383a34-a0d7-4ddb-b73a-59af7eb6b5ec req-b6917f77-855b-4bd5-9685-769a4364366f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe3eccca-1677-409a-bcf9-99d321525b2b", "tag": "4d308beb-5849-4af8-9677-9649024147e8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:05.869123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0f383a34-a0d7-4ddb-b73a-59af7eb6b5ec req-b6917f77-855b-4bd5-9685-769a4364366f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:05.870495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0f383a34-a0d7-4ddb-b73a-59af7eb6b5ec req-b6917f77-855b-4bd5-9685-769a4364366f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:05.871805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0f383a34-a0d7-4ddb-b73a-59af7eb6b5ec req-b6917f77-855b-4bd5-9685-769a4364366f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:05.895429 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-0f383a34-a0d7-4ddb-b73a-59af7eb6b5ec req-b6917f77-855b-4bd5-9685-769a4364366f service nova] Creating event network-changed:4d308beb-5849-4af8-9677-9649024147e8 for instance fe3eccca-1677-409a-bcf9-99d321525b2b on n-h2-852771-8 Aug 25 13:04:05.908090 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0f383a34-a0d7-4ddb-b73a-59af7eb6b5ec req-b6917f77-855b-4bd5-9685-769a4364366f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078981 Aug 25 13:04:05.909940 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1495/2985] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:05.918369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8906a4f8-2a10-47a2-9d16-48723ee6e32f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:05.923038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-079b3fdd-cd56-40c7-b69b-966d2ddd261c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:05.925640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-079b3fdd-cd56-40c7-b69b-966d2ddd261c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:05.941667 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8906a4f8-2a10-47a2-9d16-48723ee6e32f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1271 microversion: 2.1 time: 0.232520 Aug 25 13:04:05.957672 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1491/2986] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:05 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:05.958036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079b3fdd-cd56-40c7-b69b-966d2ddd261c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:05.958036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079b3fdd-cd56-40c7-b69b-966d2ddd261c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:05.958036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079b3fdd-cd56-40c7-b69b-966d2ddd261c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:05.958036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079b3fdd-cd56-40c7-b69b-966d2ddd261c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:05.958036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079b3fdd-cd56-40c7-b69b-966d2ddd261c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:05.958036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079b3fdd-cd56-40c7-b69b-966d2ddd261c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:06.747139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f944d84-5c7e-4b3b-9ffa-03738b807150 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:06.749889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0f944d84-5c7e-4b3b-9ffa-03738b807150 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:06.767136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f944d84-5c7e-4b3b-9ffa-03738b807150 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:06.768558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f944d84-5c7e-4b3b-9ffa-03738b807150 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:06.769929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f944d84-5c7e-4b3b-9ffa-03738b807150 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:06.772208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f944d84-5c7e-4b3b-9ffa-03738b807150 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:06.774114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f944d84-5c7e-4b3b-9ffa-03738b807150 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:06.775244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f944d84-5c7e-4b3b-9ffa-03738b807150 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:06.989080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-079b3fdd-cd56-40c7-b69b-966d2ddd261c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:07.027749 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-079b3fdd-cd56-40c7-b69b-966d2ddd261c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1316 microversion: 2.1 time: 1.112999 Aug 25 13:04:07.033794 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1496/2987] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:05 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1316 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:07.056364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:07.058070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:07.075405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:07.076758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:07.078003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:07.080520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:07.081773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:07.083033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:07.545918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f944d84-5c7e-4b3b-9ffa-03738b807150 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:07.563391 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0f944d84-5c7e-4b3b-9ffa-03738b807150 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1361 microversion: 2.1 time: 0.825195 Aug 25 13:04:07.582443 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1492/2988] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:06 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1361 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:07.588920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4205381b-d965-42c6-9a4c-9e157ea03674 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:07.593785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4205381b-d965-42c6-9a4c-9e157ea03674 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:07.605892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4205381b-d965-42c6-9a4c-9e157ea03674 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:07.606904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4205381b-d965-42c6-9a4c-9e157ea03674 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:07.608069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4205381b-d965-42c6-9a4c-9e157ea03674 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:07.609952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4205381b-d965-42c6-9a4c-9e157ea03674 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:07.612461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4205381b-d965-42c6-9a4c-9e157ea03674 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:07.614210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4205381b-d965-42c6-9a4c-9e157ea03674 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:07.617221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:07.678047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=18 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:07.838437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:07.873787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:07.876546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:07.879505 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f3367f58-63fd-4dda-a94a-5b394dc5c08b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 0.843312 Aug 25 13:04:07.903861 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1497/2989] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:07 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:08.080743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bfe54c76-5440-4ce6-a659-4d7b58b7cf72 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:08.083410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bfe54c76-5440-4ce6-a659-4d7b58b7cf72 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:08.096134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfe54c76-5440-4ce6-a659-4d7b58b7cf72 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:08.097070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfe54c76-5440-4ce6-a659-4d7b58b7cf72 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:08.098113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfe54c76-5440-4ce6-a659-4d7b58b7cf72 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:08.100460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfe54c76-5440-4ce6-a659-4d7b58b7cf72 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:08.102302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfe54c76-5440-4ce6-a659-4d7b58b7cf72 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:08.103531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bfe54c76-5440-4ce6-a659-4d7b58b7cf72 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:08.178880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:08.196591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4205381b-d965-42c6-9a4c-9e157ea03674 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:08.219967 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4205381b-d965-42c6-9a4c-9e157ea03674 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1313 microversion: 2.1 time: 0.634735 Aug 25 13:04:08.222232 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1493/2990] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:07 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:08.232664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-de06e7d7-b6cb-4667-b9d7-85427e7aaeb5 req-c80af21a-4c92-467a-8d3c-67ec75e150d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "tag": "bd20681c-2a18-4c40-b6eb-ea84168bffcb"}, {"name": "network-changed", "server_uuid": "82b4b807-bb57-49f1-bce8-6267ce7f6b63", "tag": "56eca57d-dec8-464e-92c2-d15ebfe3657f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:08.266649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-de06e7d7-b6cb-4667-b9d7-85427e7aaeb5 req-c80af21a-4c92-467a-8d3c-67ec75e150d0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:08.268022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-de06e7d7-b6cb-4667-b9d7-85427e7aaeb5 req-c80af21a-4c92-467a-8d3c-67ec75e150d0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:08.269131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-de06e7d7-b6cb-4667-b9d7-85427e7aaeb5 req-c80af21a-4c92-467a-8d3c-67ec75e150d0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:08.304134 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-de06e7d7-b6cb-4667-b9d7-85427e7aaeb5 req-c80af21a-4c92-467a-8d3c-67ec75e150d0 service nova] Creating event network-changed:bd20681c-2a18-4c40-b6eb-ea84168bffcb for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:04:08.305978 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-de06e7d7-b6cb-4667-b9d7-85427e7aaeb5 req-c80af21a-4c92-467a-8d3c-67ec75e150d0 service nova] Creating event network-changed:56eca57d-dec8-464e-92c2-d15ebfe3657f for instance 82b4b807-bb57-49f1-bce8-6267ce7f6b63 on n-h1-852771-8 Aug 25 13:04:08.324235 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-de06e7d7-b6cb-4667-b9d7-85427e7aaeb5 req-c80af21a-4c92-467a-8d3c-67ec75e150d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.098685 Aug 25 13:04:08.326522 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1494/2991] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:08.610494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b4e97b69-c2b3-47bc-a903-30c18d4a7cdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:08.616951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b4e97b69-c2b3-47bc-a903-30c18d4a7cdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:08.635113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4e97b69-c2b3-47bc-a903-30c18d4a7cdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:08.637672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4e97b69-c2b3-47bc-a903-30c18d4a7cdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:08.638939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4e97b69-c2b3-47bc-a903-30c18d4a7cdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:08.640609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4e97b69-c2b3-47bc-a903-30c18d4a7cdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:08.641989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4e97b69-c2b3-47bc-a903-30c18d4a7cdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:08.643172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4e97b69-c2b3-47bc-a903-30c18d4a7cdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:08.697543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bfe54c76-5440-4ce6-a659-4d7b58b7cf72 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:08.723561 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bfe54c76-5440-4ce6-a659-4d7b58b7cf72 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1316 microversion: 2.1 time: 0.650808 Aug 25 13:04:08.725664 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1498/2992] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:08 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:08.934990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:08.937082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:08.953351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:08.954960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:08.956242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:08.958014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:08.960086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:08.961464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:09.440226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b4e97b69-c2b3-47bc-a903-30c18d4a7cdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:09.458442 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b4e97b69-c2b3-47bc-a903-30c18d4a7cdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1361 microversion: 2.1 time: 0.860100 Aug 25 13:04:09.461318 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1495/2993] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:08 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1361 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:09.470706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d27538a8-8647-4f2a-b8d0-9fdd30ba4d92 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:09.472578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d27538a8-8647-4f2a-b8d0-9fdd30ba4d92 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:09.486472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d27538a8-8647-4f2a-b8d0-9fdd30ba4d92 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:09.488141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d27538a8-8647-4f2a-b8d0-9fdd30ba4d92 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:09.489456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d27538a8-8647-4f2a-b8d0-9fdd30ba4d92 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:09.491447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d27538a8-8647-4f2a-b8d0-9fdd30ba4d92 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:09.492909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d27538a8-8647-4f2a-b8d0-9fdd30ba4d92 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:09.496493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d27538a8-8647-4f2a-b8d0-9fdd30ba4d92 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:09.754185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:09.772700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:09.775369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:09.778203 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e45bdba9-8dd9-4065-b1e1-6e459824b46b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 0.855623 Aug 25 13:04:09.793777 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1499/2994] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:08 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:09.813229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6ff2cba8-f72c-449d-87de-c48fdf5434cb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:09.814792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6ff2cba8-f72c-449d-87de-c48fdf5434cb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:09.825186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ff2cba8-f72c-449d-87de-c48fdf5434cb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:09.825866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ff2cba8-f72c-449d-87de-c48fdf5434cb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:09.826654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ff2cba8-f72c-449d-87de-c48fdf5434cb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:09.828383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ff2cba8-f72c-449d-87de-c48fdf5434cb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:09.829893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ff2cba8-f72c-449d-87de-c48fdf5434cb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:09.830816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ff2cba8-f72c-449d-87de-c48fdf5434cb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:10.289460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d27538a8-8647-4f2a-b8d0-9fdd30ba4d92 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:10.309566 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d27538a8-8647-4f2a-b8d0-9fdd30ba4d92 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1313 microversion: 2.1 time: 0.845505 Aug 25 13:04:10.327478 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1496/2995] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:09 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1313 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:10.345814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-cc12465c-57a7-4ba1-a09c-39d9764c353a req-9021e1e1-3081-43c7-b353-7621c082e746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "782a5140-3657-472b-a8cf-e2796e47c0f6", "tag": "64762d66-313e-4763-9922-ceb595918461"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:10.386871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cc12465c-57a7-4ba1-a09c-39d9764c353a req-9021e1e1-3081-43c7-b353-7621c082e746 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:10.394494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cc12465c-57a7-4ba1-a09c-39d9764c353a req-9021e1e1-3081-43c7-b353-7621c082e746 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:10.395301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cc12465c-57a7-4ba1-a09c-39d9764c353a req-9021e1e1-3081-43c7-b353-7621c082e746 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:10.451023 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-cc12465c-57a7-4ba1-a09c-39d9764c353a req-9021e1e1-3081-43c7-b353-7621c082e746 service nova] Creating event network-changed:64762d66-313e-4763-9922-ceb595918461 for instance 782a5140-3657-472b-a8cf-e2796e47c0f6 on n-h1-852771-8 Aug 25 13:04:10.472865 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-cc12465c-57a7-4ba1-a09c-39d9764c353a req-9021e1e1-3081-43c7-b353-7621c082e746 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142847 Aug 25 13:04:10.475519 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1497/2996] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:10.614303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6ff2cba8-f72c-449d-87de-c48fdf5434cb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:10.644528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ffbe9552-7148-4f9a-b286-d407fc4a9c33 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:10.671194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ffbe9552-7148-4f9a-b286-d407fc4a9c33 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:10.680579 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6ff2cba8-f72c-449d-87de-c48fdf5434cb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1316 microversion: 2.1 time: 0.877697 Aug 25 13:04:10.713202 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1500/2997] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:09 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1316 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:10.720970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffbe9552-7148-4f9a-b286-d407fc4a9c33 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:10.720970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffbe9552-7148-4f9a-b286-d407fc4a9c33 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:10.720970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffbe9552-7148-4f9a-b286-d407fc4a9c33 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:10.720970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffbe9552-7148-4f9a-b286-d407fc4a9c33 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:10.720970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffbe9552-7148-4f9a-b286-d407fc4a9c33 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:10.720970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffbe9552-7148-4f9a-b286-d407fc4a9c33 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:10.839069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:10.843922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:10.870194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:10.871180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:10.872133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:10.873405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:10.874373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:10.875787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:11.869268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ffbe9552-7148-4f9a-b286-d407fc4a9c33 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:11.888324 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ffbe9552-7148-4f9a-b286-d407fc4a9c33 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1361 microversion: 2.1 time: 1.259938 Aug 25 13:04:11.890020 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1498/2998] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:10 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1361 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:11.901349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-99bcaa4e-d7f3-4697-8e95-de3506a99ac6 req-52dfd257-fede-439f-bfd6-1dcc018ffad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "tag": "f3625622-a332-4f68-bfa8-134a05eaf7d2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:11.922715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-99bcaa4e-d7f3-4697-8e95-de3506a99ac6 req-52dfd257-fede-439f-bfd6-1dcc018ffad5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:11.922715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-99bcaa4e-d7f3-4697-8e95-de3506a99ac6 req-52dfd257-fede-439f-bfd6-1dcc018ffad5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:11.923259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-99bcaa4e-d7f3-4697-8e95-de3506a99ac6 req-52dfd257-fede-439f-bfd6-1dcc018ffad5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:11.950528 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-99bcaa4e-d7f3-4697-8e95-de3506a99ac6 req-52dfd257-fede-439f-bfd6-1dcc018ffad5 service nova] Creating event network-changed:f3625622-a332-4f68-bfa8-134a05eaf7d2 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:04:11.962361 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-99bcaa4e-d7f3-4697-8e95-de3506a99ac6 req-52dfd257-fede-439f-bfd6-1dcc018ffad5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069833 Aug 25 13:04:11.965338 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1499/2999] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:11.968154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:11.985806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c30dd328-c71a-4910-831e-d8320d717648 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:11.986489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c30dd328-c71a-4910-831e-d8320d717648 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:11.991698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:11.995117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:11.997578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0e438651-348b-4c76-a956-7129d6a0cd61 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.182782 Aug 25 13:04:12.015842 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1501/3000] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:10 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:04:12.036326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30dd328-c71a-4910-831e-d8320d717648 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:12.037473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30dd328-c71a-4910-831e-d8320d717648 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:12.038478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30dd328-c71a-4910-831e-d8320d717648 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:12.040090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30dd328-c71a-4910-831e-d8320d717648 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:12.041061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30dd328-c71a-4910-831e-d8320d717648 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:12.041912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30dd328-c71a-4910-831e-d8320d717648 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:12.042585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-22dc6c42-d896-41f3-8af5-65f33c975c35 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:12.043796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-22dc6c42-d896-41f3-8af5-65f33c975c35 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:12.057338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22dc6c42-d896-41f3-8af5-65f33c975c35 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:12.058258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22dc6c42-d896-41f3-8af5-65f33c975c35 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:12.059415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22dc6c42-d896-41f3-8af5-65f33c975c35 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:12.060800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22dc6c42-d896-41f3-8af5-65f33c975c35 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:12.061732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22dc6c42-d896-41f3-8af5-65f33c975c35 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:12.062790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22dc6c42-d896-41f3-8af5-65f33c975c35 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:13.359399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c30dd328-c71a-4910-831e-d8320d717648 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:13.384400 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c30dd328-c71a-4910-831e-d8320d717648 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1313 microversion: 2.1 time: 1.410118 Aug 25 13:04:13.386969 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1500/3001] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:11 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1313 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:13.404106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-22dc6c42-d896-41f3-8af5-65f33c975c35 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:13.437569 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-22dc6c42-d896-41f3-8af5-65f33c975c35 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1316 microversion: 2.1 time: 1.420544 Aug 25 13:04:13.442669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b72bf98-4518-4cfd-aa44-f1dbb53a2bc0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:13.444159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b72bf98-4518-4cfd-aa44-f1dbb53a2bc0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:13.450002 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1502/3002] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:12 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1316 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:13.471208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:13.472413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:13.477988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b72bf98-4518-4cfd-aa44-f1dbb53a2bc0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:13.479138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b72bf98-4518-4cfd-aa44-f1dbb53a2bc0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:13.484704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b72bf98-4518-4cfd-aa44-f1dbb53a2bc0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:13.487597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b72bf98-4518-4cfd-aa44-f1dbb53a2bc0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:13.489499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b72bf98-4518-4cfd-aa44-f1dbb53a2bc0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:13.491447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b72bf98-4518-4cfd-aa44-f1dbb53a2bc0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:13.498574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:13.503456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:13.504928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:13.509543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:13.519053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:13.520035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:14.543469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b72bf98-4518-4cfd-aa44-f1dbb53a2bc0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:14.572793 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b72bf98-4518-4cfd-aa44-f1dbb53a2bc0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1361 microversion: 2.1 time: 1.160384 Aug 25 13:04:14.578126 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1501/3003] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:13 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1361 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:14.587503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42cda2fc-8322-4096-bb41-3b8a441c6276 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:14.589295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42cda2fc-8322-4096-bb41-3b8a441c6276 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:14.627195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:14.634078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cda2fc-8322-4096-bb41-3b8a441c6276 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:14.634976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cda2fc-8322-4096-bb41-3b8a441c6276 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:14.636125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cda2fc-8322-4096-bb41-3b8a441c6276 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:14.637612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cda2fc-8322-4096-bb41-3b8a441c6276 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:14.639681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cda2fc-8322-4096-bb41-3b8a441c6276 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:14.640998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42cda2fc-8322-4096-bb41-3b8a441c6276 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:14.762428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:14.771893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:14.804923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:14.810739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:14.827210 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b5d5f7ac-3b1b-4593-8763-4102c1eeb0fd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.373372 Aug 25 13:04:14.831972 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1503/3004] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:13 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:14.856656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1170d77a-da73-48b4-bb78-9395f9073ba7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:14.858436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1170d77a-da73-48b4-bb78-9395f9073ba7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:14.892645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1170d77a-da73-48b4-bb78-9395f9073ba7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:14.894465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1170d77a-da73-48b4-bb78-9395f9073ba7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:14.895728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1170d77a-da73-48b4-bb78-9395f9073ba7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:14.899606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1170d77a-da73-48b4-bb78-9395f9073ba7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:14.901077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1170d77a-da73-48b4-bb78-9395f9073ba7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:14.902582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1170d77a-da73-48b4-bb78-9395f9073ba7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:15.222960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-42cda2fc-8322-4096-bb41-3b8a441c6276 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:15.251603 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42cda2fc-8322-4096-bb41-3b8a441c6276 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1313 microversion: 2.1 time: 0.671447 Aug 25 13:04:15.254862 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1502/3005] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:14 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1313 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:15.630006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1170d77a-da73-48b4-bb78-9395f9073ba7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:15.635813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f74a6841-29cb-48ee-b5f1-4ff81690d9b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:15.639165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f74a6841-29cb-48ee-b5f1-4ff81690d9b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:15.656838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-29cb-48ee-b5f1-4ff81690d9b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:15.657950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-29cb-48ee-b5f1-4ff81690d9b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:15.660568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-29cb-48ee-b5f1-4ff81690d9b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:15.662678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-29cb-48ee-b5f1-4ff81690d9b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:15.663810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-29cb-48ee-b5f1-4ff81690d9b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:15.665136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-29cb-48ee-b5f1-4ff81690d9b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:15.676522 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1170d77a-da73-48b4-bb78-9395f9073ba7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1316 microversion: 2.1 time: 0.838004 Aug 25 13:04:15.679486 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1504/3006] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:14 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1316 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:15.885410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:15.886732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:15.900929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:15.901884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:15.903218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:15.904941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:15.905876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:15.906804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:16.242956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f74a6841-29cb-48ee-b5f1-4ff81690d9b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:16.249685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:16.267579 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f74a6841-29cb-48ee-b5f1-4ff81690d9b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1361 microversion: 2.1 time: 0.641763 Aug 25 13:04:16.268645 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1503/3007] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:15 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1361 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:16.292685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b91bb06-19b0-4e4b-919e-d5c24518a9ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:16.305764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b91bb06-19b0-4e4b-919e-d5c24518a9ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:16.329707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91bb06-19b0-4e4b-919e-d5c24518a9ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:16.335071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91bb06-19b0-4e4b-919e-d5c24518a9ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:16.336749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91bb06-19b0-4e4b-919e-d5c24518a9ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:16.340806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91bb06-19b0-4e4b-919e-d5c24518a9ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:16.341762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91bb06-19b0-4e4b-919e-d5c24518a9ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:16.342815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91bb06-19b0-4e4b-919e-d5c24518a9ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:16.694153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:16.739178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:16.749673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:16.758142 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e839b0f3-f137-448d-8c4a-7176c9bb739a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 0.878220 Aug 25 13:04:16.761456 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1505/3008] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:15 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:04:16.776137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b606b9c1-14dd-4968-8b99-aadc5ba79312 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:16.780954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b606b9c1-14dd-4968-8b99-aadc5ba79312 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:16.803852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b606b9c1-14dd-4968-8b99-aadc5ba79312 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:16.804739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b606b9c1-14dd-4968-8b99-aadc5ba79312 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:16.807894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b606b9c1-14dd-4968-8b99-aadc5ba79312 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:16.809296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b606b9c1-14dd-4968-8b99-aadc5ba79312 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:16.813785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b606b9c1-14dd-4968-8b99-aadc5ba79312 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:16.814574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b606b9c1-14dd-4968-8b99-aadc5ba79312 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:17.002655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b91bb06-19b0-4e4b-919e-d5c24518a9ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:17.084909 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b91bb06-19b0-4e4b-919e-d5c24518a9ed tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1313 microversion: 2.1 time: 0.795553 Aug 25 13:04:17.087177 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1504/3009] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:16 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:17.321533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75fa910c-e53c-44c9-b9b8-f09f035573e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:17.327720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-75fa910c-e53c-44c9-b9b8-f09f035573e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:17.353842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fa910c-e53c-44c9-b9b8-f09f035573e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:17.355096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fa910c-e53c-44c9-b9b8-f09f035573e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:17.355964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fa910c-e53c-44c9-b9b8-f09f035573e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:17.357401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fa910c-e53c-44c9-b9b8-f09f035573e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:17.377727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fa910c-e53c-44c9-b9b8-f09f035573e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:17.378894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fa910c-e53c-44c9-b9b8-f09f035573e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:17.532306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b606b9c1-14dd-4968-8b99-aadc5ba79312 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:17.568890 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b606b9c1-14dd-4968-8b99-aadc5ba79312 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1316 microversion: 2.1 time: 0.803736 Aug 25 13:04:17.579858 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1506/3010] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:16 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1316 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:17.618811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-cf6ee2b6-1665-4665-98fe-ec19933daf26 req-ac8984a1-9b2c-4196-b8ce-0d0e4d05978e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3eccca-1677-409a-bcf9-99d321525b2b", "name": "network-vif-plugged", "status": "completed", "tag": "4d308beb-5849-4af8-9677-9649024147e8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:17.682741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cf6ee2b6-1665-4665-98fe-ec19933daf26 req-ac8984a1-9b2c-4196-b8ce-0d0e4d05978e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:17.684240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cf6ee2b6-1665-4665-98fe-ec19933daf26 req-ac8984a1-9b2c-4196-b8ce-0d0e4d05978e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:17.685631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cf6ee2b6-1665-4665-98fe-ec19933daf26 req-ac8984a1-9b2c-4196-b8ce-0d0e4d05978e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:17.709922 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-cf6ee2b6-1665-4665-98fe-ec19933daf26 req-ac8984a1-9b2c-4196-b8ce-0d0e4d05978e service nova] Creating event network-vif-plugged:4d308beb-5849-4af8-9677-9649024147e8 for instance fe3eccca-1677-409a-bcf9-99d321525b2b on n-h2-852771-8 Aug 25 13:04:17.720835 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-cf6ee2b6-1665-4665-98fe-ec19933daf26 req-ac8984a1-9b2c-4196-b8ce-0d0e4d05978e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114265 Aug 25 13:04:17.723212 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1507/3011] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:17.812475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:17.825608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:17.841067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:17.847702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:17.850354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:17.852340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:17.853814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:17.855150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:18.485447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-75fa910c-e53c-44c9-b9b8-f09f035573e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:18.512942 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-75fa910c-e53c-44c9-b9b8-f09f035573e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1361 microversion: 2.1 time: 1.201360 Aug 25 13:04:18.524664 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1505/3012] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:17 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1361 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:18.534287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2013273f-b6f2-4e2d-8389-5c5fcdaae730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:18.535367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2013273f-b6f2-4e2d-8389-5c5fcdaae730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:18.567686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2013273f-b6f2-4e2d-8389-5c5fcdaae730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:18.569219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2013273f-b6f2-4e2d-8389-5c5fcdaae730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:18.570107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2013273f-b6f2-4e2d-8389-5c5fcdaae730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:18.580002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2013273f-b6f2-4e2d-8389-5c5fcdaae730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:18.581080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2013273f-b6f2-4e2d-8389-5c5fcdaae730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:18.584440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2013273f-b6f2-4e2d-8389-5c5fcdaae730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:19.525313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:19.590427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:19.593763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:19.596263 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a1f2971f-c61e-47bf-ba35-d4102ea80ef1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.791039 Aug 25 13:04:19.629993 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1508/3013] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:17 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:19.662926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-84b5774b-e702-412d-836f-a39aa77a09bd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:19.663989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-84b5774b-e702-412d-836f-a39aa77a09bd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:19.699807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84b5774b-e702-412d-836f-a39aa77a09bd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:19.701756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84b5774b-e702-412d-836f-a39aa77a09bd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:19.702935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84b5774b-e702-412d-836f-a39aa77a09bd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:19.706580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84b5774b-e702-412d-836f-a39aa77a09bd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:19.707770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84b5774b-e702-412d-836f-a39aa77a09bd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:19.710342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84b5774b-e702-412d-836f-a39aa77a09bd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:19.972763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2013273f-b6f2-4e2d-8389-5c5fcdaae730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:20.014258 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2013273f-b6f2-4e2d-8389-5c5fcdaae730 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1313 microversion: 2.1 time: 1.484067 Aug 25 13:04:20.017106 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1506/3014] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:18 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1313 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:20.063593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:20.076991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:20.079309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Searching by: {'deleted': False, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:04:20.092493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:20.093907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:20.094996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:20.097625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:20.099135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:20.103230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:20.188595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:04:20.308757 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f1f34664-e224-41c5-9754-23dc0913bd0c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.275920 Aug 25 13:04:20.309743 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1507/3015] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 13:04:20 2022] GET /compute/v2.1/servers => generated 340 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:20.337940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-24825c96-5e62-44de-b9d8-8ad1fb60c190 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:20.340407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-24825c96-5e62-44de-b9d8-8ad1fb60c190 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:20.354758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24825c96-5e62-44de-b9d8-8ad1fb60c190 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:20.356059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24825c96-5e62-44de-b9d8-8ad1fb60c190 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:20.357039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24825c96-5e62-44de-b9d8-8ad1fb60c190 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:20.359670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24825c96-5e62-44de-b9d8-8ad1fb60c190 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:20.360875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24825c96-5e62-44de-b9d8-8ad1fb60c190 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:20.361894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24825c96-5e62-44de-b9d8-8ad1fb60c190 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:21.178912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-84b5774b-e702-412d-836f-a39aa77a09bd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:21.202847 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-84b5774b-e702-412d-836f-a39aa77a09bd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1316 microversion: 2.1 time: 1.566480 Aug 25 13:04:21.205134 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1509/3016] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:19 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1316 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:21.223596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-44449dc0-4f60-4cf2-a637-30f7cff7ea6b req-c86f8a32-8caa-454f-bcbf-e88c04b31956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b4b807-bb57-49f1-bce8-6267ce7f6b63", "name": "network-vif-plugged", "status": "completed", "tag": "56eca57d-dec8-464e-92c2-d15ebfe3657f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:21.266144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-24825c96-5e62-44de-b9d8-8ad1fb60c190 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:21.274561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-44449dc0-4f60-4cf2-a637-30f7cff7ea6b req-c86f8a32-8caa-454f-bcbf-e88c04b31956 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:21.275456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-44449dc0-4f60-4cf2-a637-30f7cff7ea6b req-c86f8a32-8caa-454f-bcbf-e88c04b31956 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:21.276287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-44449dc0-4f60-4cf2-a637-30f7cff7ea6b req-c86f8a32-8caa-454f-bcbf-e88c04b31956 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:21.294920 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-24825c96-5e62-44de-b9d8-8ad1fb60c190 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1361 microversion: 2.1 time: 0.966112 Aug 25 13:04:21.297875 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1508/3017] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:20 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1361 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:21.316777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:21.330963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:21.333573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Searching by: {'deleted': False, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:04:21.336917 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-44449dc0-4f60-4cf2-a637-30f7cff7ea6b req-c86f8a32-8caa-454f-bcbf-e88c04b31956 service nova] Creating event network-vif-plugged:56eca57d-dec8-464e-92c2-d15ebfe3657f for instance 82b4b807-bb57-49f1-bce8-6267ce7f6b63 on n-h1-852771-8 Aug 25 13:04:21.351285 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-44449dc0-4f60-4cf2-a637-30f7cff7ea6b req-c86f8a32-8caa-454f-bcbf-e88c04b31956 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142204 Aug 25 13:04:21.352488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:21.352818 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1510/3018] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:21.354433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:21.355883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:21.358554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:21.360763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:21.364420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:21.368380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:21.370147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:21.388202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:21.389275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:21.390242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:21.407960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:21.409586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:21.412820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:21.506982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:04:21.616602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:21.639592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:21.640552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:21.641362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:22.711377 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a11a009-69e2-45bf-84cc-6aade61d9d7c tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.408752 Aug 25 13:04:22.713667 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1509/3019] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 13:04:21 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:22.729500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b3184fb-2702-4f7f-8699-78ef1bb27422 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:22.732628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3b3184fb-2702-4f7f-8699-78ef1bb27422 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:22.739662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:22.746999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3184fb-2702-4f7f-8699-78ef1bb27422 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:22.748008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3184fb-2702-4f7f-8699-78ef1bb27422 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:22.749041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3184fb-2702-4f7f-8699-78ef1bb27422 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:22.750661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3184fb-2702-4f7f-8699-78ef1bb27422 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:22.751635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3184fb-2702-4f7f-8699-78ef1bb27422 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:22.752741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b3184fb-2702-4f7f-8699-78ef1bb27422 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:22.762307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:22.765371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:22.767760 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7495fab0-c021-414e-9ea6-4f226880e9dc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.412985 Aug 25 13:04:22.769259 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1511/3020] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:21 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:22.792793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c7785323-ad7c-4197-baa4-eac3e697d1f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:22.795408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c7785323-ad7c-4197-baa4-eac3e697d1f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:22.808383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7785323-ad7c-4197-baa4-eac3e697d1f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:22.809718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7785323-ad7c-4197-baa4-eac3e697d1f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:22.810675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7785323-ad7c-4197-baa4-eac3e697d1f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:22.811717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7785323-ad7c-4197-baa4-eac3e697d1f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:22.812377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7785323-ad7c-4197-baa4-eac3e697d1f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:22.813021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7785323-ad7c-4197-baa4-eac3e697d1f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.541081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3b3184fb-2702-4f7f-8699-78ef1bb27422 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:23.547511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c7785323-ad7c-4197-baa4-eac3e697d1f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:23.580672 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c7785323-ad7c-4197-baa4-eac3e697d1f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1316 microversion: 2.1 time: 0.806730 Aug 25 13:04:23.582489 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1512/3021] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:22 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1316 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:23.595860 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3b3184fb-2702-4f7f-8699-78ef1bb27422 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1313 microversion: 2.1 time: 0.875485 Aug 25 13:04:23.613553 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1510/3022] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:22 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1313 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:23.633545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9ec01195-fa3a-40a4-b859-0917a3e6ab6f tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:23.633926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e6c726c-f040-42e4-a115-d847dd2efc57 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:23.635442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e6c726c-f040-42e4-a115-d847dd2efc57 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:23.667205 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9ec01195-fa3a-40a4-b859-0917a3e6ab6f tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.062165 Aug 25 13:04:23.667673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e6c726c-f040-42e4-a115-d847dd2efc57 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:23.674438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e6c726c-f040-42e4-a115-d847dd2efc57 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:23.675979 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1511/3023] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 13:04:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:23.677245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e6c726c-f040-42e4-a115-d847dd2efc57 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.683869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e6c726c-f040-42e4-a115-d847dd2efc57 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:23.701013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e6c726c-f040-42e4-a115-d847dd2efc57 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:23.703687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e6c726c-f040-42e4-a115-d847dd2efc57 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.704478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b736bf94-94f0-48fa-aef1-4a2c5cdf71b4 req-8b919ae6-30dc-4938-83b5-7fbab2e69338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782a5140-3657-472b-a8cf-e2796e47c0f6", "name": "network-vif-plugged", "status": "completed", "tag": "64762d66-313e-4763-9922-ceb595918461"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:23.765785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b736bf94-94f0-48fa-aef1-4a2c5cdf71b4 req-8b919ae6-30dc-4938-83b5-7fbab2e69338 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:23.766843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b736bf94-94f0-48fa-aef1-4a2c5cdf71b4 req-8b919ae6-30dc-4938-83b5-7fbab2e69338 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:23.767444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b736bf94-94f0-48fa-aef1-4a2c5cdf71b4 req-8b919ae6-30dc-4938-83b5-7fbab2e69338 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.799887 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b736bf94-94f0-48fa-aef1-4a2c5cdf71b4 req-8b919ae6-30dc-4938-83b5-7fbab2e69338 service nova] Creating event network-vif-plugged:64762d66-313e-4763-9922-ceb595918461 for instance 782a5140-3657-472b-a8cf-e2796e47c0f6 on n-h1-852771-8 Aug 25 13:04:23.822190 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b736bf94-94f0-48fa-aef1-4a2c5cdf71b4 req-8b919ae6-30dc-4938-83b5-7fbab2e69338 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136573 Aug 25 13:04:23.824045 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1512/3024] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:23.839592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:23.841191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:23.856988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:23.858017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:23.859123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.860689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:23.861558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:23.862328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:24.846041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e6c726c-f040-42e4-a115-d847dd2efc57 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:24.862905 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e6c726c-f040-42e4-a115-d847dd2efc57 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1548 microversion: 2.1 time: 1.272847 Aug 25 13:04:24.878320 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1513/3025] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:23 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1548 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:24.901356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e8ecfac9-25b9-47f5-a0d6-027761955148 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:24.902507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e8ecfac9-25b9-47f5-a0d6-027761955148 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:24.915469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8ecfac9-25b9-47f5-a0d6-027761955148 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:24.916639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8ecfac9-25b9-47f5-a0d6-027761955148 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:24.917643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8ecfac9-25b9-47f5-a0d6-027761955148 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:24.919316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8ecfac9-25b9-47f5-a0d6-027761955148 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:24.920345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8ecfac9-25b9-47f5-a0d6-027761955148 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:24.921598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8ecfac9-25b9-47f5-a0d6-027761955148 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:24.953769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:24.976148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:24.979267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e8ecfac9-25b9-47f5-a0d6-027761955148 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:04:24.980414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:24.983361 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f9466b27-968c-4b85-b001-353d8e43677e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.156199 Aug 25 13:04:24.984905 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1513/3026] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:23 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:24.995053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-17ab8c94-e60b-47ca-8f83-be4784183301 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:24.996542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-17ab8c94-e60b-47ca-8f83-be4784183301 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:25.009342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17ab8c94-e60b-47ca-8f83-be4784183301 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:25.010802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17ab8c94-e60b-47ca-8f83-be4784183301 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:25.011907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17ab8c94-e60b-47ca-8f83-be4784183301 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:25.013628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17ab8c94-e60b-47ca-8f83-be4784183301 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:25.015346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17ab8c94-e60b-47ca-8f83-be4784183301 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:25.016422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17ab8c94-e60b-47ca-8f83-be4784183301 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:25.208336 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e8ecfac9-25b9-47f5-a0d6-027761955148 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 204 len: 0 microversion: 2.1 time: 0.327335 Aug 25 13:04:25.215714 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1514/3027] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:24 2022] DELETE /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:04:25.228594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c5c0c24c-ea03-47b1-ab18-a02aa879e8bb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:25.230555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c5c0c24c-ea03-47b1-ab18-a02aa879e8bb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:25.245107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5c0c24c-ea03-47b1-ab18-a02aa879e8bb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:25.245989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5c0c24c-ea03-47b1-ab18-a02aa879e8bb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:25.247145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5c0c24c-ea03-47b1-ab18-a02aa879e8bb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:25.250830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5c0c24c-ea03-47b1-ab18-a02aa879e8bb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:25.251021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5c0c24c-ea03-47b1-ab18-a02aa879e8bb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:25.251675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5c0c24c-ea03-47b1-ab18-a02aa879e8bb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:26.141659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-17ab8c94-e60b-47ca-8f83-be4784183301 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:26.167631 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-17ab8c94-e60b-47ca-8f83-be4784183301 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1466 microversion: 2.1 time: 1.180373 Aug 25 13:04:26.169350 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1514/3028] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:24 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1466 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:26.179515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2efcacb6-5947-42eb-ab7e-5c944a45da54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:26.180927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2efcacb6-5947-42eb-ab7e-5c944a45da54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:26.195848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efcacb6-5947-42eb-ab7e-5c944a45da54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:26.197434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efcacb6-5947-42eb-ab7e-5c944a45da54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:26.199003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efcacb6-5947-42eb-ab7e-5c944a45da54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:26.200552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efcacb6-5947-42eb-ab7e-5c944a45da54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:26.201902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efcacb6-5947-42eb-ab7e-5c944a45da54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:26.202889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efcacb6-5947-42eb-ab7e-5c944a45da54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:26.345300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c5c0c24c-ea03-47b1-ab18-a02aa879e8bb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:26.364161 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c5c0c24c-ea03-47b1-ab18-a02aa879e8bb tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1313 microversion: 2.1 time: 1.145419 Aug 25 13:04:26.377565 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1515/3029] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:25 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1313 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:26.377565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b897bf1e-f74f-4cb3-bdd1-b7e3e728e448 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:26.379778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b897bf1e-f74f-4cb3-bdd1-b7e3e728e448 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:26.393100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b897bf1e-f74f-4cb3-bdd1-b7e3e728e448 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:26.394166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b897bf1e-f74f-4cb3-bdd1-b7e3e728e448 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:26.395154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b897bf1e-f74f-4cb3-bdd1-b7e3e728e448 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:26.398652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b897bf1e-f74f-4cb3-bdd1-b7e3e728e448 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:26.399740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b897bf1e-f74f-4cb3-bdd1-b7e3e728e448 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:26.400665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b897bf1e-f74f-4cb3-bdd1-b7e3e728e448 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:26.679142 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2efcacb6-5947-42eb-ab7e-5c944a45da54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.503583 Aug 25 13:04:26.694234 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1515/3030] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:04:26 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/os-interface => generated 284 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:26.704424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:26.705910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:26.723016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:26.723918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:26.726206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:26.731009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:26.732459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:26.739733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:27.428956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b897bf1e-f74f-4cb3-bdd1-b7e3e728e448 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:27.472391 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b897bf1e-f74f-4cb3-bdd1-b7e3e728e448 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1714 microversion: 2.1 time: 1.102442 Aug 25 13:04:27.473671 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1516/3031] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:26 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1714 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:27.482796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe437238-3be9-4772-8b0d-24a3ea82e909 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:27.483745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe437238-3be9-4772-8b0d-24a3ea82e909 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:27.506749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe437238-3be9-4772-8b0d-24a3ea82e909 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:27.507566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe437238-3be9-4772-8b0d-24a3ea82e909 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:27.508218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe437238-3be9-4772-8b0d-24a3ea82e909 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:27.509131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe437238-3be9-4772-8b0d-24a3ea82e909 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:27.509876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe437238-3be9-4772-8b0d-24a3ea82e909 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:27.510697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe437238-3be9-4772-8b0d-24a3ea82e909 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:27.747288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:27.782849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:27.789555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:27.793392 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d136eae9-6822-49d3-845f-b5fca252af8b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.107169 Aug 25 13:04:27.794531 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1516/3032] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:26 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:27.805173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b91a8f8-8041-4377-b33c-e99f91823f64 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:27.806877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b91a8f8-8041-4377-b33c-e99f91823f64 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:27.835293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91a8f8-8041-4377-b33c-e99f91823f64 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:27.836883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91a8f8-8041-4377-b33c-e99f91823f64 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:27.839051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91a8f8-8041-4377-b33c-e99f91823f64 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:27.841418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91a8f8-8041-4377-b33c-e99f91823f64 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:27.843125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91a8f8-8041-4377-b33c-e99f91823f64 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:27.844443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b91a8f8-8041-4377-b33c-e99f91823f64 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:28.116551 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe437238-3be9-4772-8b0d-24a3ea82e909 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1617 microversion: 2.1 time: 0.637103 Aug 25 13:04:28.128711 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1517/3033] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:27 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1617 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:28.354969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-600993951", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["34c46524-70ff-4c0a-9fce-afaacf9d2ba5"]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:28.475826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:04:28.594060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b91a8f8-8041-4377-b33c-e99f91823f64 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:28.613482 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b91a8f8-8041-4377-b33c-e99f91823f64 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1500 microversion: 2.1 time: 0.816557 Aug 25 13:04:28.616249 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1517/3034] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:27 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1500 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:28.641644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e934c61a-7132-4c43-9336-940e527713a5 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:28.644256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e934c61a-7132-4c43-9336-940e527713a5 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:28.670299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e934c61a-7132-4c43-9336-940e527713a5 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:28.672578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e934c61a-7132-4c43-9336-940e527713a5 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:28.674078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e934c61a-7132-4c43-9336-940e527713a5 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:28.678454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e934c61a-7132-4c43-9336-940e527713a5 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:28.680260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e934c61a-7132-4c43-9336-940e527713a5 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:28.682124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e934c61a-7132-4c43-9336-940e527713a5 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.266475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e934c61a-7132-4c43-9336-940e527713a5 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:29.288862 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e934c61a-7132-4c43-9336-940e527713a5 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1714 microversion: 2.1 time: 0.669509 Aug 25 13:04:29.311939 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1518/3035] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:28 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1714 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:29.312529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:04:29.312529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:04:29.312529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:04:29.312529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:04:29.312529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:04:29.313211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ad78924-a0e9-45a4-9156-2d78bb0ae12d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:29.313211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3ad78924-a0e9-45a4-9156-2d78bb0ae12d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:29.329284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ad78924-a0e9-45a4-9156-2d78bb0ae12d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.330210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ad78924-a0e9-45a4-9156-2d78bb0ae12d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.331254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ad78924-a0e9-45a4-9156-2d78bb0ae12d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.332632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ad78924-a0e9-45a4-9156-2d78bb0ae12d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.335337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ad78924-a0e9-45a4-9156-2d78bb0ae12d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.336151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ad78924-a0e9-45a4-9156-2d78bb0ae12d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.354623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.356378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.358349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.360537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.362148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.363340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.403900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-3ad78924-a0e9-45a4-9156-2d78bb0ae12d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lazy-loading 'flavor' on Instance uuid 782a5140-3657-472b-a8cf-e2796e47c0f6 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:04:29.414350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:04:29.433178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:04:29.469267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:04:29.476738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:04:29.576228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:29.613201 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3ad78924-a0e9-45a4-9156-2d78bb0ae12d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "POST /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6/action" status: 202 len: 0 microversion: 2.1 time: 0.319398 Aug 25 13:04:29.615438 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1519/3036] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:04:29 2022] POST /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:04:29.629818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:29.632626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:29.650494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.650831 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0c8527cc-7011-4dc5-8ebd-b103c023ba23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.301156 Aug 25 13:04:29.652622 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1518/3037] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:04:29.652892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.654129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.655882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.656965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.657967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.671539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1cd6532-4699-4b2d-9350-5e407ad50bd6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:29.673731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b1cd6532-4699-4b2d-9350-5e407ad50bd6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:29.696338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1cd6532-4699-4b2d-9350-5e407ad50bd6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.698072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1cd6532-4699-4b2d-9350-5e407ad50bd6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.699303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1cd6532-4699-4b2d-9350-5e407ad50bd6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.702082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1cd6532-4699-4b2d-9350-5e407ad50bd6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.703620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1cd6532-4699-4b2d-9350-5e407ad50bd6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.704901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1cd6532-4699-4b2d-9350-5e407ad50bd6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:30.392843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:30.426236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:30.430410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:30.433214 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b1eb3e2d-f3c2-4e3c-9d2d-4265454601dd tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 0.814349 Aug 25 13:04:30.435088 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1520/3038] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:29 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:30.454879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b1cd6532-4699-4b2d-9350-5e407ad50bd6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:30.465551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2abb551-a708-49e9-9d99-bf21c3acc5ce tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:30.466822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e2abb551-a708-49e9-9d99-bf21c3acc5ce tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:30.479029 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b1cd6532-4699-4b2d-9350-5e407ad50bd6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1508 microversion: 2.1 time: 0.821357 Aug 25 13:04:30.505404 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1519/3039] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:29 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1508 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:30.522081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ca7b4498-7858-4446-94ec-645f8e333953 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:30.526794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca7b4498-7858-4446-94ec-645f8e333953 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:30.546408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca7b4498-7858-4446-94ec-645f8e333953 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:30.547060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca7b4498-7858-4446-94ec-645f8e333953 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:30.551965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca7b4498-7858-4446-94ec-645f8e333953 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:30.555061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca7b4498-7858-4446-94ec-645f8e333953 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:30.556145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca7b4498-7858-4446-94ec-645f8e333953 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:30.556788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca7b4498-7858-4446-94ec-645f8e333953 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:30.894609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2abb551-a708-49e9-9d99-bf21c3acc5ce tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:30.926038 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e2abb551-a708-49e9-9d99-bf21c3acc5ce tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1216 microversion: 2.1 time: 0.487915 Aug 25 13:04:30.929649 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1521/3040] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:30 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1216 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:31.220746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ca7b4498-7858-4446-94ec-645f8e333953 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:31.228044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:31.260241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-445ba67b-af73-43f5-b29f-5e353ab6ce55 req-3bd4ce78-edcc-4133-afcd-1d93d94b4b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0a087a-758a-493c-b573-2d558b6b592e", "name": "network-vif-unplugged", "status": "completed", "tag": "a249548b-1a44-405f-8547-1727f160c723"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:31.263448 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ca7b4498-7858-4446-94ec-645f8e333953 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1714 microversion: 2.1 time: 0.755914 Aug 25 13:04:31.265696 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1520/3041] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:30 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1714 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:31.326680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-445ba67b-af73-43f5-b29f-5e353ab6ce55 req-3bd4ce78-edcc-4133-afcd-1d93d94b4b5b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:31.329564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-445ba67b-af73-43f5-b29f-5e353ab6ce55 req-3bd4ce78-edcc-4133-afcd-1d93d94b4b5b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:31.331276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-445ba67b-af73-43f5-b29f-5e353ab6ce55 req-3bd4ce78-edcc-4133-afcd-1d93d94b4b5b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:31.382132 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-445ba67b-af73-43f5-b29f-5e353ab6ce55 req-3bd4ce78-edcc-4133-afcd-1d93d94b4b5b service nova] Creating event network-vif-unplugged:a249548b-1a44-405f-8547-1727f160c723 for instance 6e0a087a-758a-493c-b573-2d558b6b592e on n-h2-852771-8 Aug 25 13:04:31.397635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:31.413721 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-445ba67b-af73-43f5-b29f-5e353ab6ce55 req-3bd4ce78-edcc-4133-afcd-1d93d94b4b5b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164891 Aug 25 13:04:31.438674 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1522/3042] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:31.493819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:31.498334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:31.524725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:31.532411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:31.535806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:31.542529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:31.548737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2528e379-e103-4bda-b410-96f39bd3d9a9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:31.549344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:31.551454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:31.556619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2528e379-e103-4bda-b410-96f39bd3d9a9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:31.557303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:31.610397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2528e379-e103-4bda-b410-96f39bd3d9a9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:31.610895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2528e379-e103-4bda-b410-96f39bd3d9a9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:31.618522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2528e379-e103-4bda-b410-96f39bd3d9a9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:31.620186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2528e379-e103-4bda-b410-96f39bd3d9a9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:31.635695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2528e379-e103-4bda-b410-96f39bd3d9a9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:31.639565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2528e379-e103-4bda-b410-96f39bd3d9a9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.386588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:32.425578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:32.433299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:32.439241 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8f8473cd-46ac-4dc2-91bc-fa8b8c138622 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 0.960139 Aug 25 13:04:32.456422 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1521/3043] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:31 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:04:32.471214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2528e379-e103-4bda-b410-96f39bd3d9a9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:32.478965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4548a367-3a19-44ae-828e-c2e1a8f61283 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:32.492343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4548a367-3a19-44ae-828e-c2e1a8f61283 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:32.501466 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2528e379-e103-4bda-b410-96f39bd3d9a9 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1491 microversion: 2.1 time: 0.989150 Aug 25 13:04:32.502599 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1523/3044] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:31 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1491 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:32.509418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4548a367-3a19-44ae-828e-c2e1a8f61283 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.510988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4548a367-3a19-44ae-828e-c2e1a8f61283 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.512052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4548a367-3a19-44ae-828e-c2e1a8f61283 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.514894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4548a367-3a19-44ae-828e-c2e1a8f61283 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.515884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4548a367-3a19-44ae-828e-c2e1a8f61283 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.516688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4548a367-3a19-44ae-828e-c2e1a8f61283 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.540488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9ef27aa4-a687-4902-be6d-9125ac26146d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:32.542400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9ef27aa4-a687-4902-be6d-9125ac26146d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:32.556468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ef27aa4-a687-4902-be6d-9125ac26146d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.557878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ef27aa4-a687-4902-be6d-9125ac26146d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.559089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ef27aa4-a687-4902-be6d-9125ac26146d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.561109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ef27aa4-a687-4902-be6d-9125ac26146d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.562403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ef27aa4-a687-4902-be6d-9125ac26146d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.563580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ef27aa4-a687-4902-be6d-9125ac26146d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.723347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9ef27aa4-a687-4902-be6d-9125ac26146d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:32.742329 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9ef27aa4-a687-4902-be6d-9125ac26146d tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1647 microversion: 2.1 time: 0.218368 Aug 25 13:04:32.744092 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1524/3045] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:32 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1647 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:32.754434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-134126d4-f9e4-4fc3-9df5-71c36b3059dc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:32.755852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-134126d4-f9e4-4fc3-9df5-71c36b3059dc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:32.768904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-134126d4-f9e4-4fc3-9df5-71c36b3059dc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.770792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-134126d4-f9e4-4fc3-9df5-71c36b3059dc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.772582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-134126d4-f9e4-4fc3-9df5-71c36b3059dc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.774580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-134126d4-f9e4-4fc3-9df5-71c36b3059dc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.775769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-134126d4-f9e4-4fc3-9df5-71c36b3059dc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.777013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-134126d4-f9e4-4fc3-9df5-71c36b3059dc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.839039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4548a367-3a19-44ae-828e-c2e1a8f61283 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:32.862069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-134126d4-f9e4-4fc3-9df5-71c36b3059dc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:04:32.885563 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4548a367-3a19-44ae-828e-c2e1a8f61283 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1274 microversion: 2.1 time: 0.415827 Aug 25 13:04:32.887673 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1522/3046] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:32 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1274 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:33.088470 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-134126d4-f9e4-4fc3-9df5-71c36b3059dc tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 204 len: 0 microversion: 2.1 time: 0.341074 Aug 25 13:04:33.089899 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1525/3047] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:32 2022] DELETE /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:04:33.118524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0e0f3ec-e067-461e-b469-e5ecf67624d6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:33.120544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e0e0f3ec-e067-461e-b469-e5ecf67624d6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:33.137158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e0f3ec-e067-461e-b469-e5ecf67624d6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:33.141964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e0f3ec-e067-461e-b469-e5ecf67624d6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:33.144912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e0f3ec-e067-461e-b469-e5ecf67624d6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:33.148951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e0f3ec-e067-461e-b469-e5ecf67624d6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:33.153014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e0f3ec-e067-461e-b469-e5ecf67624d6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:33.154266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0e0f3ec-e067-461e-b469-e5ecf67624d6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:33.499445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:33.500738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:33.522280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:33.523176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:33.530946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:33.532557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:33.533568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:33.534414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:33.537946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e0e0f3ec-e067-461e-b469-e5ecf67624d6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:33.573042 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0e0f3ec-e067-461e-b469-e5ecf67624d6 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1497 microversion: 2.1 time: 0.471414 Aug 25 13:04:33.582954 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1523/3048] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:33 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1497 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:33.788674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-12023bf8-65c9-4080-959b-f74ea68e5e12 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:33.790872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-12023bf8-65c9-4080-959b-f74ea68e5e12 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:33.807084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12023bf8-65c9-4080-959b-f74ea68e5e12 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:33.809744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12023bf8-65c9-4080-959b-f74ea68e5e12 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:33.812593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12023bf8-65c9-4080-959b-f74ea68e5e12 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:33.814800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12023bf8-65c9-4080-959b-f74ea68e5e12 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:33.816562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12023bf8-65c9-4080-959b-f74ea68e5e12 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:33.818466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12023bf8-65c9-4080-959b-f74ea68e5e12 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:34.042222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:34.047502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-12023bf8-65c9-4080-959b-f74ea68e5e12 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:34.070343 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-12023bf8-65c9-4080-959b-f74ea68e5e12 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1647 microversion: 2.1 time: 0.290123 Aug 25 13:04:34.085914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:34.086530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:34.089677 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4618cb00-321c-44f9-82e3-1f0a64bf9f9d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 0.598155 Aug 25 13:04:34.090385 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1524/3049] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:33 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1647 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:34.106306 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1526/3050] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:33 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:34.115896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7168e23b-3b15-480c-8cd5-b2744ff86f8f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:34.117186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7168e23b-3b15-480c-8cd5-b2744ff86f8f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:34.131363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7168e23b-3b15-480c-8cd5-b2744ff86f8f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:34.132296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7168e23b-3b15-480c-8cd5-b2744ff86f8f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:34.132925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7168e23b-3b15-480c-8cd5-b2744ff86f8f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:34.133951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7168e23b-3b15-480c-8cd5-b2744ff86f8f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:34.134648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7168e23b-3b15-480c-8cd5-b2744ff86f8f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:34.135309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7168e23b-3b15-480c-8cd5-b2744ff86f8f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:34.295071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7168e23b-3b15-480c-8cd5-b2744ff86f8f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:34.313299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7168e23b-3b15-480c-8cd5-b2744ff86f8f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1274 microversion: 2.1 time: 0.218423 Aug 25 13:04:34.314829 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1525/3051] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:34 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:34.626871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0edc6dbf-c35b-424a-a3f5-a06dca2f4d34 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:34.629691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0edc6dbf-c35b-424a-a3f5-a06dca2f4d34 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:34.657483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-5b480af6-5f81-49fc-90fa-d90580ba0dbb req-345b2f59-e86f-4be3-b168-ce5f09d3c843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe3eccca-1677-409a-bcf9-99d321525b2b", "tag": "4d308beb-5849-4af8-9677-9649024147e8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:34.683767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edc6dbf-c35b-424a-a3f5-a06dca2f4d34 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:34.688352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edc6dbf-c35b-424a-a3f5-a06dca2f4d34 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:34.691301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5b480af6-5f81-49fc-90fa-d90580ba0dbb req-345b2f59-e86f-4be3-b168-ce5f09d3c843 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:34.692420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5b480af6-5f81-49fc-90fa-d90580ba0dbb req-345b2f59-e86f-4be3-b168-ce5f09d3c843 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:34.693542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5b480af6-5f81-49fc-90fa-d90580ba0dbb req-345b2f59-e86f-4be3-b168-ce5f09d3c843 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:34.696389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edc6dbf-c35b-424a-a3f5-a06dca2f4d34 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:34.700912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edc6dbf-c35b-424a-a3f5-a06dca2f4d34 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:34.703050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edc6dbf-c35b-424a-a3f5-a06dca2f4d34 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:34.704992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0edc6dbf-c35b-424a-a3f5-a06dca2f4d34 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:34.723741 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5b480af6-5f81-49fc-90fa-d90580ba0dbb req-345b2f59-e86f-4be3-b168-ce5f09d3c843 service nova] Creating event network-changed:4d308beb-5849-4af8-9677-9649024147e8 for instance fe3eccca-1677-409a-bcf9-99d321525b2b on n-h2-852771-8 Aug 25 13:04:34.736290 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-5b480af6-5f81-49fc-90fa-d90580ba0dbb req-345b2f59-e86f-4be3-b168-ce5f09d3c843 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098620 Aug 25 13:04:34.738474 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1526/3052] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:04:35.120543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16b572b2-7913-4cc4-b513-d47d1ab5eacc tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:35.124886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-16b572b2-7913-4cc4-b513-d47d1ab5eacc tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:35.160751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b572b2-7913-4cc4-b513-d47d1ab5eacc tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.171098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b572b2-7913-4cc4-b513-d47d1ab5eacc tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.174687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b572b2-7913-4cc4-b513-d47d1ab5eacc tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:35.176223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b572b2-7913-4cc4-b513-d47d1ab5eacc tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.181170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b572b2-7913-4cc4-b513-d47d1ab5eacc tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.182469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16b572b2-7913-4cc4-b513-d47d1ab5eacc tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:35.319516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0edc6dbf-c35b-424a-a3f5-a06dca2f4d34 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:35.383221 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0edc6dbf-c35b-424a-a3f5-a06dca2f4d34 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1497 microversion: 2.1 time: 0.759195 Aug 25 13:04:35.387241 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1527/3053] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:34 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1497 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:35.430890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:35.442296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:35.477003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.480928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.486146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:35.489491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.491996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.495642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:35.550747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16b572b2-7913-4cc4-b513-d47d1ab5eacc tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a30a7e80c424ee8b24224f161c1cce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ef1136a7fb486ca299eaca4181a996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:35.628098 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-16b572b2-7913-4cc4-b513-d47d1ab5eacc tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 200 len: 1647 microversion: 2.1 time: 0.518457 Aug 25 13:04:35.632047 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1527/3054] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:35 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 1647 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:35.648201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8fdfc00-d104-4527-a57b-4642aeae4268 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:35.651674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8fdfc00-d104-4527-a57b-4642aeae4268 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:35.714537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8fdfc00-d104-4527-a57b-4642aeae4268 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.715540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8fdfc00-d104-4527-a57b-4642aeae4268 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.725315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8fdfc00-d104-4527-a57b-4642aeae4268 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:35.731650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8fdfc00-d104-4527-a57b-4642aeae4268 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.735061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8fdfc00-d104-4527-a57b-4642aeae4268 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.736015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8fdfc00-d104-4527-a57b-4642aeae4268 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:36.330765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b8fdfc00-d104-4527-a57b-4642aeae4268 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:36.370671 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8fdfc00-d104-4527-a57b-4642aeae4268 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1274 microversion: 2.1 time: 0.736485 Aug 25 13:04:36.375482 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1528/3055] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:35 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1274 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:36.438493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-389e90eb-29fe-48ac-a5e9-16950148ec95 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:36.446096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-389e90eb-29fe-48ac-a5e9-16950148ec95 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:36.507645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-389e90eb-29fe-48ac-a5e9-16950148ec95 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:36.518215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-389e90eb-29fe-48ac-a5e9-16950148ec95 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:36.542538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-389e90eb-29fe-48ac-a5e9-16950148ec95 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:36.545492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-389e90eb-29fe-48ac-a5e9-16950148ec95 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:36.555783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-389e90eb-29fe-48ac-a5e9-16950148ec95 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:36.565342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-389e90eb-29fe-48ac-a5e9-16950148ec95 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:38.334745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:38.375677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:38.379804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:38.383632 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d84eae09-b2d9-418a-a674-89c762ef5fd5 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 2.993816 Aug 25 13:04:38.398757 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1528/3056] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:35 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 3010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:38.441857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:38.444397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] [instance: 6e0a087a-758a-493c-b573-2d558b6b592e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:38.461731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:38.464213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:38.465735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:38.467814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:38.469843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:38.471864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:38.510016 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] HTTP exception thrown: Instance 6e0a087a-758a-493c-b573-2d558b6b592e could not be found. Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Request method failure captured: Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e HTTP/1.1 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3KrU6zP4BasU9JnUKIGI34iKFx5ChChCCsm3xJF1gLAFVbHLTt8VZDhORuZpAsiGLpofqZOWbqXqzLve_k7ler8e8f98z3-EUYFObPQjUaTBMsxzbLbopQTdOU0XypDE43g4coIYm9GM6OXXiKv-VzuYR6zzaYMfJ-URoMqGrdIFi8 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: b2ef1136a7fb486ca299eaca4181a996 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestManualDisk-1675039018 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2ef1136a7fb486ca299eaca4181a996"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b2ef1136a7fb486ca299eaca4181a996", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b2ef1136a7fb486ca299eaca4181a996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2ef1136a7fb486ca299eaca4181a996"}]}] Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestManualDisk-1675039018 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: b2ef1136a7fb486ca299eaca4181a996 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestManualDisk-1675039018 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestManualDisk-1675039018-project Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 7a30a7e80c424ee8b24224f161c1cce8 Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestManualDisk-1675039018-project Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 6e0a087a-758a-493c-b573-2d558b6b592e could not be found. Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '6e0a087a-758a-493c-b573-2d558b6b592e'} Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0a087a-758a-493c-b573-2d558b6b592e could not be found. Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0a087a-758a-493c-b573-2d558b6b592e could not be found. Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:38.515918 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:38.525451 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:38.525451 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:38.525451 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:38.525451 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:38.525451 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:38.525451 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0a087a-758a-493c-b573-2d558b6b592e could not be found. Aug 25 13:04:38.525451 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:38.535547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Returning 404 to user: Instance 6e0a087a-758a-493c-b573-2d558b6b592e could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:38.535547 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-58d67759-da89-4959-a17d-02ec835a5d87 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e" status: 404 len: 111 microversion: 2.1 time: 0.117775 Aug 25 13:04:38.538295 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1529/3057] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:38 2022] GET /compute/v2.1/servers/6e0a087a-758a-493c-b573-2d558b6b592e => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:38.553249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-03b38bc0-c25d-406c-a611-ead96a08803d req-e40d7744-8105-403c-80e3-5266a517cbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0a087a-758a-493c-b573-2d558b6b592e", "name": "network-vif-deleted", "tag": "a249548b-1a44-405f-8547-1727f160c723"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:38.581228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-03b38bc0-c25d-406c-a611-ead96a08803d req-e40d7744-8105-403c-80e3-5266a517cbe3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:38.584058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-03b38bc0-c25d-406c-a611-ead96a08803d req-e40d7744-8105-403c-80e3-5266a517cbe3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:38.586101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-03b38bc0-c25d-406c-a611-ead96a08803d req-e40d7744-8105-403c-80e3-5266a517cbe3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:38.618140 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-03b38bc0-c25d-406c-a611-ead96a08803d req-e40d7744-8105-403c-80e3-5266a517cbe3 service nova] Creating event network-vif-deleted:a249548b-1a44-405f-8547-1727f160c723 for instance 6e0a087a-758a-493c-b573-2d558b6b592e on n-h2-852771-8 Aug 25 13:04:38.633776 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-03b38bc0-c25d-406c-a611-ead96a08803d req-e40d7744-8105-403c-80e3-5266a517cbe3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090717 Aug 25 13:04:38.635795 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1530/3058] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:38.648520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8431ef16-6528-4aa3-814b-2da9970fc97c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:38.650571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8431ef16-6528-4aa3-814b-2da9970fc97c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:38.665453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8431ef16-6528-4aa3-814b-2da9970fc97c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:38.666808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8431ef16-6528-4aa3-814b-2da9970fc97c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:38.667834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8431ef16-6528-4aa3-814b-2da9970fc97c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:38.670087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8431ef16-6528-4aa3-814b-2da9970fc97c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:38.673181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8431ef16-6528-4aa3-814b-2da9970fc97c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:38.674632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8431ef16-6528-4aa3-814b-2da9970fc97c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:38.735830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-389e90eb-29fe-48ac-a5e9-16950148ec95 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:38.776795 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-389e90eb-29fe-48ac-a5e9-16950148ec95 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1497 microversion: 2.1 time: 2.348854 Aug 25 13:04:38.793557 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1529/3059] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:36 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1497 bytes in 2360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:38.796883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77cda268-097a-40e0-a6ca-758342027cd6 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] Calling method '.version_select at 0x7f3a2e76adc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:38.850872 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-77cda268-097a-40e0-a6ca-758342027cd6 tempest-ServersTestManualDisk-1675039018 tempest-ServersTestManualDisk-1675039018-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-711133921" status: 202 len: 0 microversion: 2.1 time: 0.069711 Aug 25 13:04:38.853353 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1530/3060] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 13:04:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-711133921 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:04:39.397635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8431ef16-6528-4aa3-814b-2da9970fc97c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:39.441779 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8431ef16-6528-4aa3-814b-2da9970fc97c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1316 microversion: 2.1 time: 0.802788 Aug 25 13:04:39.442876 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1531/3061] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:38 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1316 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:39.445423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:39.453046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:39.487041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:39.491476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:39.524026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:39.531870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:39.532685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:39.538976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:39.539583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:39.546478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:39.824211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e48541ad-4856-4aa0-b9c7-6f9ecad17aa8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:39.826148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e48541ad-4856-4aa0-b9c7-6f9ecad17aa8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:39.841246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48541ad-4856-4aa0-b9c7-6f9ecad17aa8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:39.842800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48541ad-4856-4aa0-b9c7-6f9ecad17aa8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:39.844160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48541ad-4856-4aa0-b9c7-6f9ecad17aa8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:39.845915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48541ad-4856-4aa0-b9c7-6f9ecad17aa8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:39.847196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48541ad-4856-4aa0-b9c7-6f9ecad17aa8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:39.850638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48541ad-4856-4aa0-b9c7-6f9ecad17aa8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:40.218236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e48541ad-4856-4aa0-b9c7-6f9ecad17aa8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81a6a01a24413b8212f140080ed018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ffc96935324a758f7b39e81a4b49d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:40.239156 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e48541ad-4856-4aa0-b9c7-6f9ecad17aa8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 200 len: 1455 microversion: 2.1 time: 0.422614 Aug 25 13:04:40.247799 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1532/3062] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:39 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 1455 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:40.392606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1b2bc059-3b3f-428a-9b5c-ce6bf469311f req-595dba99-751e-4674-a8c6-53ab2077d8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782a5140-3657-472b-a8cf-e2796e47c0f6", "name": "network-vif-deleted", "tag": "64762d66-313e-4763-9922-ceb595918461"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:40.414465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1b2bc059-3b3f-428a-9b5c-ce6bf469311f req-595dba99-751e-4674-a8c6-53ab2077d8db service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:40.415441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1b2bc059-3b3f-428a-9b5c-ce6bf469311f req-595dba99-751e-4674-a8c6-53ab2077d8db service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:40.416388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1b2bc059-3b3f-428a-9b5c-ce6bf469311f req-595dba99-751e-4674-a8c6-53ab2077d8db service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:40.449007 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1b2bc059-3b3f-428a-9b5c-ce6bf469311f req-595dba99-751e-4674-a8c6-53ab2077d8db service nova] Creating event network-vif-deleted:64762d66-313e-4763-9922-ceb595918461 for instance 782a5140-3657-472b-a8cf-e2796e47c0f6 on n-h1-852771-8 Aug 25 13:04:40.460288 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1b2bc059-3b3f-428a-9b5c-ce6bf469311f req-595dba99-751e-4674-a8c6-53ab2077d8db service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083367 Aug 25 13:04:40.462563 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1533/3063] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:04:40.519437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-21ae1ee9-ffb4-47b7-9f5f-55974d12580f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:40.521789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-21ae1ee9-ffb4-47b7-9f5f-55974d12580f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:40.542644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21ae1ee9-ffb4-47b7-9f5f-55974d12580f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:40.543710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21ae1ee9-ffb4-47b7-9f5f-55974d12580f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:40.545997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21ae1ee9-ffb4-47b7-9f5f-55974d12580f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:40.548078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21ae1ee9-ffb4-47b7-9f5f-55974d12580f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:40.549548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21ae1ee9-ffb4-47b7-9f5f-55974d12580f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:40.550985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21ae1ee9-ffb4-47b7-9f5f-55974d12580f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:40.609807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:40.657384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:40.664343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:40.668617 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-83a0730d-7377-4991-81b5-5b8f655d99f1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.233290 Aug 25 13:04:40.670264 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1531/3064] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:39 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:04:40.905967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:41.057643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-21ae1ee9-ffb4-47b7-9f5f-55974d12580f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:41.077231 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-21ae1ee9-ffb4-47b7-9f5f-55974d12580f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1316 microversion: 2.1 time: 0.582014 Aug 25 13:04:41.080329 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1534/3065] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:40 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:41.296234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:41.298114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.319062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.320275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.322083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.322427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.323392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.324385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.360728 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 HTTP/1.1 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '782a5140-3657-472b-a8cf-e2796e47c0f6'} Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.364536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.376739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.376739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.376739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.376739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:41.376739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:41.376739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.376739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.376739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:41.376739 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cc907380-9ecf-4693-a197-a6240e9560d8 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 404 len: 111 microversion: 2.1 time: 0.084457 Aug 25 13:04:41.383242 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1532/3066] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:41 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:41.399490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:41.400415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.413605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.414988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.417228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.419370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.420701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.421840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.455288 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 HTTP/1.1 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '782a5140-3657-472b-a8cf-e2796e47c0f6'} Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:41.460752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.475348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:41.479208 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e8e4e4b3-33ff-4e6a-bc8d-a1a28b9e6b87 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 404 len: 111 microversion: 2.1 time: 0.083251 Aug 25 13:04:41.481168 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1535/3067] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:41 2022] DELETE /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:41.497748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:41.498951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 782a5140-3657-472b-a8cf-e2796e47c0f6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.513500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.514991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.516357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.518116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.519652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.520556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.554510 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 HTTP/1.1 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '782a5140-3657-472b-a8cf-e2796e47c0f6'} Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.558064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.566511 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.566511 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.566511 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.566511 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:41.566511 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:41.566511 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. Aug 25 13:04:41.566511 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.572948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 782a5140-3657-472b-a8cf-e2796e47c0f6 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:41.572948 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b77fcf94-9b8b-4080-bfe7-2da98393ccef tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6" status: 404 len: 111 microversion: 2.1 time: 0.082035 Aug 25 13:04:41.572948 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1533/3068] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:41 2022] GET /compute/v2.1/servers/782a5140-3657-472b-a8cf-e2796e47c0f6 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:41.590062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:41.590062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.598813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.600693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.601738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.603276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.604553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.606328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.639054 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a HTTP/1.1 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '46fd34ef-a381-41f0-a819-dc99a352e09a'} Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:41.643351 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:41.651440 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-194d2657-572b-4ce8-b357-82671bcd4c84 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 404 len: 111 microversion: 2.1 time: 0.066619 Aug 25 13:04:41.654436 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1536/3069] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:41 2022] DELETE /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:41.672447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:41.675787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 46fd34ef-a381-41f0-a819-dc99a352e09a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.689628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.690757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.691348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.692817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.693604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.694355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.727746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:41.731267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.739195 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a HTTP/1.1 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '46fd34ef-a381-41f0-a819-dc99a352e09a'} Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.742429 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.762078 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.762078 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.762078 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.762078 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:41.762078 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:41.762078 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. Aug 25 13:04:41.762078 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.762078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 46fd34ef-a381-41f0-a819-dc99a352e09a could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:41.762078 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8550b7e4-21e2-4fb1-bdda-08fb0890702d tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a" status: 404 len: 111 microversion: 2.1 time: 0.094031 Aug 25 13:04:41.762078 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1534/3070] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:41 2022] GET /compute/v2.1/servers/46fd34ef-a381-41f0-a819-dc99a352e09a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:41.763443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.763443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.765803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.767833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.769158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.770495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.777687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:41.778598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.791953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.792938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.794698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.796113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.796971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.797880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.834024 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec HTTP/1.1 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7e64e778-70de-4c3e-9c61-f2c8bec2d5ec'} Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:41.837810 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:04:41.846332 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.852304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:41.853393 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d0025ca3-d5c3-476a-be39-52761141ab9a tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 404 len: 111 microversion: 2.1 time: 0.085040 Aug 25 13:04:41.855332 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1535/3071] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:41 2022] DELETE /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:04:41.894228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:41.896834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.910706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.912922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.914276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.918047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.919761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.921082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.955074 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec HTTP/1.1 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7e64e778-70de-4c3e-9c61-f2c8bec2d5ec'} Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.959808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.969759 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.969759 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.969759 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.969759 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:41.969759 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:41.969759 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. Aug 25 13:04:41.969759 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.974974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 7e64e778-70de-4c3e-9c61-f2c8bec2d5ec could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:41.975760 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-02cc1080-977a-4fc9-8c55-756efdb98bc5 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec" status: 404 len: 111 microversion: 2.1 time: 0.095097 Aug 25 13:04:41.977285 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1536/3072] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:41 2022] GET /compute/v2.1/servers/7e64e778-70de-4c3e-9c61-f2c8bec2d5ec => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:42.000801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:42.002130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:42.017770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.019635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.021626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.023500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.024816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.027132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.082615 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 HTTP/1.1 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '0404e5d7-4b1f-4e3d-93f0-1f769b94fe09'} Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:42.088581 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 13:04:42.100273 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.106266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:42.108506 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e7bc677-dc0a-4eda-bb70-c10e04e514a7 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 404 len: 111 microversion: 2.1 time: 0.124199 Aug 25 13:04:42.111249 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1537/3073] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:41 2022] DELETE /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:42.133661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:42.135316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:42.148171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.149069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.149916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.151279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.152332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.152949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.184950 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 HTTP/1.1 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '0404e5d7-4b1f-4e3d-93f0-1f769b94fe09'} Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:42.189887 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.206904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:42.206904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:42.206904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:42.206904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:42.206904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:42.206904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. Aug 25 13:04:42.206904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.206904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:42.206904 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-308e5197-1808-4419-91b1-456ae460853e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09" status: 404 len: 111 microversion: 2.1 time: 0.067944 Aug 25 13:04:42.206904 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1538/3074] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:42 2022] GET /compute/v2.1/servers/0404e5d7-4b1f-4e3d-93f0-1f769b94fe09 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:42.212240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3b007d2-c2e0-4dc1-998b-bd47f8e8dc63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:42.214080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c3b007d2-c2e0-4dc1-998b-bd47f8e8dc63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:42.227599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b007d2-c2e0-4dc1-998b-bd47f8e8dc63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.228537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b007d2-c2e0-4dc1-998b-bd47f8e8dc63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.229377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b007d2-c2e0-4dc1-998b-bd47f8e8dc63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.231905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b007d2-c2e0-4dc1-998b-bd47f8e8dc63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.232871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b007d2-c2e0-4dc1-998b-bd47f8e8dc63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.234059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b007d2-c2e0-4dc1-998b-bd47f8e8dc63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.774798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:42.801251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:42.807266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:42.810936 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c4a1a19-c74f-421b-99d9-88ce755aaff9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.097689 Aug 25 13:04:42.812636 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1537/3075] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:41 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:42.826076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:42.827621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:42.841633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.843044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.844225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.847875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.851432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.853599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.889012 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 HTTP/1.1 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '38d3c3dd-dfa6-4d24-bd30-df478d87d7b7'} Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:42.893296 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b548703f-e333-45b9-a4f1-d6fbed55abff tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 404 len: 111 microversion: 2.1 time: 0.084649 Aug 25 13:04:42.909462 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1538/3076] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:42 2022] DELETE /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:42.916282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5524c915-ca4e-4b85-97b0-58ab8833005b req-a58007f1-dee7-461e-8d4d-ddf113532ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232ef74e-cf0e-48a4-bcef-40ba42bff597", "tag": "9821267d-e9f4-4ac5-bbc2-badbc3cdda86"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:42.941045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5524c915-ca4e-4b85-97b0-58ab8833005b req-a58007f1-dee7-461e-8d4d-ddf113532ac2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.942123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5524c915-ca4e-4b85-97b0-58ab8833005b req-a58007f1-dee7-461e-8d4d-ddf113532ac2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.944118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5524c915-ca4e-4b85-97b0-58ab8833005b req-a58007f1-dee7-461e-8d4d-ddf113532ac2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.975497 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5524c915-ca4e-4b85-97b0-58ab8833005b req-a58007f1-dee7-461e-8d4d-ddf113532ac2 service nova] Creating event network-changed:9821267d-e9f4-4ac5-bbc2-badbc3cdda86 for instance 232ef74e-cf0e-48a4-bcef-40ba42bff597 on n-h1-852771-8 Aug 25 13:04:42.997609 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5524c915-ca4e-4b85-97b0-58ab8833005b req-a58007f1-dee7-461e-8d4d-ddf113532ac2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091059 Aug 25 13:04:43.001759 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1539/3077] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:43.026324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3b007d2-c2e0-4dc1-998b-bd47f8e8dc63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:43.027263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:43.028738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:43.051713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:43.054580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:43.056152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:43.057323 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3b007d2-c2e0-4dc1-998b-bd47f8e8dc63 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1316 microversion: 2.1 time: 0.859690 Aug 25 13:04:43.058699 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1539/3078] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:42 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1316 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:43.059689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:43.061035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:43.062840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:43.102300 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 HTTP/1.1 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '38d3c3dd-dfa6-4d24-bd30-df478d87d7b7'} Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:43.106469 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:43.114882 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:43.114882 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:43.114882 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:43.114882 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:43.114882 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:43.114882 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. Aug 25 13:04:43.114882 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:43.114882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:43.118293 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a73bb55c-c852-4365-9b75-766692da9544 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7" status: 404 len: 111 microversion: 2.1 time: 0.105660 Aug 25 13:04:43.121793 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1540/3079] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:43 2022] GET /compute/v2.1/servers/38d3c3dd-dfa6-4d24-bd30-df478d87d7b7 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:43.859643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:43.868380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:43.891198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:43.892132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:43.892993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:43.894430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:43.895328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:43.897066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:44.102671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-505572d5-2c14-4a57-bb31-e7bbc0ed7487 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:44.106399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-505572d5-2c14-4a57-bb31-e7bbc0ed7487 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:44.143429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-505572d5-2c14-4a57-bb31-e7bbc0ed7487 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:44.144353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-505572d5-2c14-4a57-bb31-e7bbc0ed7487 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:44.150131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-505572d5-2c14-4a57-bb31-e7bbc0ed7487 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:44.152012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-505572d5-2c14-4a57-bb31-e7bbc0ed7487 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:44.153281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-505572d5-2c14-4a57-bb31-e7bbc0ed7487 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:44.156136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-505572d5-2c14-4a57-bb31-e7bbc0ed7487 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.006589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:45.054615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:45.057986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:45.060360 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-027514ed-85c9-40ca-b434-170b926b4f76 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.210059 Aug 25 13:04:45.068265 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1540/3080] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:43 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:04:45.082500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-82fbd41f-1873-4284-a26e-1a179ef4eb6a tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:45.090855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-82fbd41f-1873-4284-a26e-1a179ef4eb6a tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:45.112052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fbd41f-1873-4284-a26e-1a179ef4eb6a tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.122830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fbd41f-1873-4284-a26e-1a179ef4eb6a tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.126014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fbd41f-1873-4284-a26e-1a179ef4eb6a tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.127599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fbd41f-1873-4284-a26e-1a179ef4eb6a tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.128794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fbd41f-1873-4284-a26e-1a179ef4eb6a tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.129972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82fbd41f-1873-4284-a26e-1a179ef4eb6a tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.320171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-82fbd41f-1873-4284-a26e-1a179ef4eb6a tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:04:45.337446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-505572d5-2c14-4a57-bb31-e7bbc0ed7487 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:45.355813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:45.419492 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-505572d5-2c14-4a57-bb31-e7bbc0ed7487 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1316 microversion: 2.1 time: 1.309458 Aug 25 13:04:45.422861 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1541/3081] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:44 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1316 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:45.856426 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-82fbd41f-1873-4284-a26e-1a179ef4eb6a tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 204 len: 0 microversion: 2.1 time: 0.787900 Aug 25 13:04:45.863419 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1541/3082] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:45 2022] DELETE /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:04:45.884553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2914c19a-abf6-4997-8e38-5c45130711b5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:45.886434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2914c19a-abf6-4997-8e38-5c45130711b5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:45.912107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:45.987313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2914c19a-abf6-4997-8e38-5c45130711b5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.988435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2914c19a-abf6-4997-8e38-5c45130711b5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.994317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2914c19a-abf6-4997-8e38-5c45130711b5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:46.002362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2914c19a-abf6-4997-8e38-5c45130711b5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:46.003409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2914c19a-abf6-4997-8e38-5c45130711b5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:46.007528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2914c19a-abf6-4997-8e38-5c45130711b5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:46.144670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:46.154493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:46.199663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:46.205207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:46.208058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:46.209118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:46.212399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:46.213861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:46.225642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:48.092604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2914c19a-abf6-4997-8e38-5c45130711b5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:48.130847 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2914c19a-abf6-4997-8e38-5c45130711b5 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1665 microversion: 2.1 time: 2.265088 Aug 25 13:04:48.140068 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1542/3083] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:45 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1665 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:48.171511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d91d8f9d-1530-45c1-9e07-d6f5051a4708 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:48.174417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d91d8f9d-1530-45c1-9e07-d6f5051a4708 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:48.222902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d91d8f9d-1530-45c1-9e07-d6f5051a4708 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:48.226769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d91d8f9d-1530-45c1-9e07-d6f5051a4708 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:48.227626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d91d8f9d-1530-45c1-9e07-d6f5051a4708 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:48.236373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d91d8f9d-1530-45c1-9e07-d6f5051a4708 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:48.236921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d91d8f9d-1530-45c1-9e07-d6f5051a4708 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:48.242539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d91d8f9d-1530-45c1-9e07-d6f5051a4708 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:49.125986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:49.250150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:49.291030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:49.302737 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-247b15aa-af36-40c3-93c2-d00f73c890e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 3.173258 Aug 25 13:04:49.310221 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1542/3084] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:46 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 3186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:49.332827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4465d082-5355-41f5-bf22-a3d62c1f8ef2 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:49.338078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4465d082-5355-41f5-bf22-a3d62c1f8ef2 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:49.374561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4465d082-5355-41f5-bf22-a3d62c1f8ef2 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:49.376705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4465d082-5355-41f5-bf22-a3d62c1f8ef2 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:49.383490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4465d082-5355-41f5-bf22-a3d62c1f8ef2 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:49.391458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4465d082-5355-41f5-bf22-a3d62c1f8ef2 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:49.393433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4465d082-5355-41f5-bf22-a3d62c1f8ef2 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:49.395437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4465d082-5355-41f5-bf22-a3d62c1f8ef2 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:51.823947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d91d8f9d-1530-45c1-9e07-d6f5051a4708 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:51.865380 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d91d8f9d-1530-45c1-9e07-d6f5051a4708 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1316 microversion: 2.1 time: 3.722348 Aug 25 13:04:51.876732 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1543/3085] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:48 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1316 bytes in 3735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:51.910565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:51.915857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:51.946743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:51.949491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:51.953787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:51.955972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:51.964196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:51.965813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:52.318395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4465d082-5355-41f5-bf22-a3d62c1f8ef2 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:52.348613 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4465d082-5355-41f5-bf22-a3d62c1f8ef2 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1665 microversion: 2.1 time: 3.035759 Aug 25 13:04:52.351810 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1543/3086] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:49 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1665 bytes in 3040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:52.377026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c1387616-1334-49ae-94d4-ae72b1515654 req-e96da8a6-34f8-459f-b832-882ac0d70072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59f80e3-c2a8-4ca1-b4cd-41027f74aa90", "name": "network-vif-unplugged", "status": "completed", "tag": "cef37bc8-24da-4194-a393-9253f1b67704"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:52.440102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c1387616-1334-49ae-94d4-ae72b1515654 req-e96da8a6-34f8-459f-b832-882ac0d70072 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:52.440102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c1387616-1334-49ae-94d4-ae72b1515654 req-e96da8a6-34f8-459f-b832-882ac0d70072 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:52.440102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c1387616-1334-49ae-94d4-ae72b1515654 req-e96da8a6-34f8-459f-b832-882ac0d70072 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:52.523857 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c1387616-1334-49ae-94d4-ae72b1515654 req-e96da8a6-34f8-459f-b832-882ac0d70072 service nova] Creating event network-vif-unplugged:cef37bc8-24da-4194-a393-9253f1b67704 for instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 on n-h2-852771-8 Aug 25 13:04:52.562405 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c1387616-1334-49ae-94d4-ae72b1515654 req-e96da8a6-34f8-459f-b832-882ac0d70072 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.205221 Aug 25 13:04:52.570924 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1544/3087] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:52.918005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d3b3270-f7a3-4914-ae61-58332208ce64 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:52.919636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4d3b3270-f7a3-4914-ae61-58332208ce64 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:52.947969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d3b3270-f7a3-4914-ae61-58332208ce64 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:52.952374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d3b3270-f7a3-4914-ae61-58332208ce64 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:52.953480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d3b3270-f7a3-4914-ae61-58332208ce64 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:52.962677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d3b3270-f7a3-4914-ae61-58332208ce64 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:52.963619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d3b3270-f7a3-4914-ae61-58332208ce64 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:52.964449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d3b3270-f7a3-4914-ae61-58332208ce64 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:53.190712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:53.232715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:53.240911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:53.248659 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70b01313-96ca-4fa5-aa4f-8953739d6a27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.364957 Aug 25 13:04:53.256355 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1544/3088] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:51 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:53.392307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f06a7be-b0c8-4603-a29d-bbe8dd0cb488 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:53.405776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f06a7be-b0c8-4603-a29d-bbe8dd0cb488 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:53.419140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f06a7be-b0c8-4603-a29d-bbe8dd0cb488 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:53.422611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f06a7be-b0c8-4603-a29d-bbe8dd0cb488 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:53.426540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f06a7be-b0c8-4603-a29d-bbe8dd0cb488 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:53.430887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f06a7be-b0c8-4603-a29d-bbe8dd0cb488 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:53.431835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f06a7be-b0c8-4603-a29d-bbe8dd0cb488 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:53.440090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f06a7be-b0c8-4603-a29d-bbe8dd0cb488 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:54.414598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4d3b3270-f7a3-4914-ae61-58332208ce64 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:54.465806 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4d3b3270-f7a3-4914-ae61-58332208ce64 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1316 microversion: 2.1 time: 1.554160 Aug 25 13:04:54.467565 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1545/3089] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:52 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1316 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:54.504824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:54.512779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:54.539009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:54.540035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:54.540986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:54.544971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:54.546087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:54.546941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.280416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f06a7be-b0c8-4603-a29d-bbe8dd0cb488 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:55.309841 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f06a7be-b0c8-4603-a29d-bbe8dd0cb488 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1665 microversion: 2.1 time: 1.924870 Aug 25 13:04:55.310976 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1545/3090] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:53 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1665 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:55.363192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-82f8e2ff-2f9f-48b5-963d-0c135c38b000 req-cd6e6a5a-de15-4251-8e50-ee2b09a8b8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232ef74e-cf0e-48a4-bcef-40ba42bff597", "name": "network-vif-plugged", "status": "completed", "tag": "9821267d-e9f4-4ac5-bbc2-badbc3cdda86"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:55.411897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-82f8e2ff-2f9f-48b5-963d-0c135c38b000 req-cd6e6a5a-de15-4251-8e50-ee2b09a8b8f9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.413037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-82f8e2ff-2f9f-48b5-963d-0c135c38b000 req-cd6e6a5a-de15-4251-8e50-ee2b09a8b8f9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.413995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-82f8e2ff-2f9f-48b5-963d-0c135c38b000 req-cd6e6a5a-de15-4251-8e50-ee2b09a8b8f9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.473283 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-82f8e2ff-2f9f-48b5-963d-0c135c38b000 req-cd6e6a5a-de15-4251-8e50-ee2b09a8b8f9 service nova] Creating event network-vif-plugged:9821267d-e9f4-4ac5-bbc2-badbc3cdda86 for instance 232ef74e-cf0e-48a4-bcef-40ba42bff597 on n-h1-852771-8 Aug 25 13:04:55.487537 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-82f8e2ff-2f9f-48b5-963d-0c135c38b000 req-cd6e6a5a-de15-4251-8e50-ee2b09a8b8f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137243 Aug 25 13:04:55.488589 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1546/3091] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:55.507560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:55.509266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:55.524439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.526041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.527382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.529275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.530918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.532148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.567872 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 HTTP/1.1 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '08f4120a-39c6-4978-9fed-e4dc6b49edf2'} Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:55.573047 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 13:04:55.582146 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.585601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:55.587863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:55.589592 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6ff2bad1-039a-46b8-9cb5-4461d5efbe2f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 404 len: 111 microversion: 2.1 time: 0.098070 Aug 25 13:04:55.591672 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1547/3092] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:55 2022] DELETE /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:55.604473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5dd06cc-db81-412a-b002-dfb428d47f23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:55.606636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5dd06cc-db81-412a-b002-dfb428d47f23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:55.621398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5dd06cc-db81-412a-b002-dfb428d47f23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.622914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5dd06cc-db81-412a-b002-dfb428d47f23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.624148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5dd06cc-db81-412a-b002-dfb428d47f23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.626271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5dd06cc-db81-412a-b002-dfb428d47f23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.627748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5dd06cc-db81-412a-b002-dfb428d47f23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.631316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5dd06cc-db81-412a-b002-dfb428d47f23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.658402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:55.671181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:55.689647 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6fcac140-18ae-470d-bcc5-ad971e2d6306 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.204422 Aug 25 13:04:55.691405 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1546/3093] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:54 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:55.713755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:55.715735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 08f4120a-39c6-4978-9fed-e4dc6b49edf2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:55.740058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.746698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.748222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.750275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.751706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.753061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.812107 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 HTTP/1.1 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '08f4120a-39c6-4978-9fed-e4dc6b49edf2'} Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:55.821028 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.831488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.831488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:55.831488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:55.831488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:55.831488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:55.831488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. Aug 25 13:04:55.831488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.831488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 08f4120a-39c6-4978-9fed-e4dc6b49edf2 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:55.831488 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b6fe83e3-a0b5-4c09-8ff4-b90c9dd4c826 tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2" status: 404 len: 111 microversion: 2.1 time: 0.136025 Aug 25 13:04:55.838012 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1547/3094] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:55 2022] GET /compute/v2.1/servers/08f4120a-39c6-4978-9fed-e4dc6b49edf2 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:55.849827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:55.850856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:55.862785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.863833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.864877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.866451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.867444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.868300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.910587 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f HTTP/1.1 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '04521122-af66-4daa-bdba-20b76aefde0f'} Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:55.915546 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8d03920-f914-4051-8778-43f33fe7680e tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "DELETE /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 404 len: 111 microversion: 2.1 time: 0.078605 Aug 25 13:04:55.926163 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1548/3095] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:55 2022] DELETE /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:55.936529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:55.937948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] [instance: 04521122-af66-4daa-bdba-20b76aefde0f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:55.952390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.953431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.954329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.957138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.959792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.960747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.993957 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] HTTP exception thrown: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Request method failure captured: Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f HTTP/1.1 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3EwFEt29724NlFjUl0BLgb88bknHc52BI9viQFSfB-6T5ifHLNPRRrw9BlUf_PtqDfE5VLz5mIpjUFIdG48Tq1vZb_DI-8rzNDSkJj6vjqFhS2Vv4SRZ0NG3WFfx_JAHIhl9JZy-Fmytl4yJm3UskiM-UofBP6TiP9NXblQ59vHTt8 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24ffc96935324a758f7b39e81a4b49d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24ffc96935324a758f7b39e81a4b49d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24ffc96935324a758f7b39e81a4b49d5"}]}] Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 24ffc96935324a758f7b39e81a4b49d5 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766798789 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b81a6a01a24413b8212f140080ed018 Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1766798789-project Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '04521122-af66-4daa-bdba-20b76aefde0f'} Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:55.997494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:56.005262 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:56.005262 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:56.005262 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:56.005262 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:56.005262 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:56.005262 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. Aug 25 13:04:56.005262 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:04:56.005262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] Returning 404 to user: Instance 04521122-af66-4daa-bdba-20b76aefde0f could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:56.005262 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-920e03b5-0620-4542-9f8f-713ca3ca930f tempest-DeleteServersTestJSON-1766798789 tempest-DeleteServersTestJSON-1766798789-project] 10.222.0.70 "GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f" status: 404 len: 111 microversion: 2.1 time: 0.072790 Aug 25 13:04:56.005262 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1549/3096] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:55 2022] GET /compute/v2.1/servers/04521122-af66-4daa-bdba-20b76aefde0f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:56.362590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-126f5beb-9f4a-4faf-a09a-fae8d03f0add tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:56.363721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-126f5beb-9f4a-4faf-a09a-fae8d03f0add tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:56.394349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126f5beb-9f4a-4faf-a09a-fae8d03f0add tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.395244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126f5beb-9f4a-4faf-a09a-fae8d03f0add tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.396659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126f5beb-9f4a-4faf-a09a-fae8d03f0add tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.398097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126f5beb-9f4a-4faf-a09a-fae8d03f0add tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.416792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126f5beb-9f4a-4faf-a09a-fae8d03f0add tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.418088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126f5beb-9f4a-4faf-a09a-fae8d03f0add tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.835600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-126f5beb-9f4a-4faf-a09a-fae8d03f0add tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:56.863499 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-126f5beb-9f4a-4faf-a09a-fae8d03f0add tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1598 microversion: 2.1 time: 0.509971 Aug 25 13:04:56.868954 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1550/3097] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:56 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1598 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:56.887455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:56.891846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:56.919235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.920556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.921738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.923346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.926817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.937756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:57.278948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5dd06cc-db81-412a-b002-dfb428d47f23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:57.322122 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5dd06cc-db81-412a-b002-dfb428d47f23 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1316 microversion: 2.1 time: 1.727243 Aug 25 13:04:57.344937 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1548/3098] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:55 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1316 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:57.922403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-180e069d-462b-4578-82d9-80565671e936 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:57.924488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-180e069d-462b-4578-82d9-80565671e936 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:57.944418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-180e069d-462b-4578-82d9-80565671e936 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:57.945849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-180e069d-462b-4578-82d9-80565671e936 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:57.948068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-180e069d-462b-4578-82d9-80565671e936 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:57.949909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-180e069d-462b-4578-82d9-80565671e936 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:57.951141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-180e069d-462b-4578-82d9-80565671e936 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:57.952295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-180e069d-462b-4578-82d9-80565671e936 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:58.368728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-180e069d-462b-4578-82d9-80565671e936 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:58.406927 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-180e069d-462b-4578-82d9-80565671e936 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1598 microversion: 2.1 time: 0.498789 Aug 25 13:04:58.408478 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1549/3099] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:57 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1598 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:58.424049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2c2e77dd-d9f1-4f79-bfb5-ded654e7ae46 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:58.426311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2c2e77dd-d9f1-4f79-bfb5-ded654e7ae46 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:58.443354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c2e77dd-d9f1-4f79-bfb5-ded654e7ae46 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:58.445736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c2e77dd-d9f1-4f79-bfb5-ded654e7ae46 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:58.447359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c2e77dd-d9f1-4f79-bfb5-ded654e7ae46 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:58.450179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c2e77dd-d9f1-4f79-bfb5-ded654e7ae46 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:58.451742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c2e77dd-d9f1-4f79-bfb5-ded654e7ae46 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:58.452973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c2e77dd-d9f1-4f79-bfb5-ded654e7ae46 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:59.516957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:59.575554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:59.588795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:59.598123 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-124010a2-5e51-46dc-a209-0c779fb9d0af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 2.726088 Aug 25 13:04:59.601599 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1551/3100] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:04:56 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 2732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:04:59.709371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a40bed38-a74d-4e04-aa12-dc896a9b2346 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:59.710693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a40bed38-a74d-4e04-aa12-dc896a9b2346 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:59.743123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40bed38-a74d-4e04-aa12-dc896a9b2346 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:59.746589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40bed38-a74d-4e04-aa12-dc896a9b2346 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:59.750087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40bed38-a74d-4e04-aa12-dc896a9b2346 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:59.751680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40bed38-a74d-4e04-aa12-dc896a9b2346 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:59.770650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40bed38-a74d-4e04-aa12-dc896a9b2346 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:59.772740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40bed38-a74d-4e04-aa12-dc896a9b2346 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:00.264794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a40bed38-a74d-4e04-aa12-dc896a9b2346 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2beca1cfb4b31b0e0080b39d12497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d299d545c86446392d864f9689e0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:00.302718 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a40bed38-a74d-4e04-aa12-dc896a9b2346 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 200 len: 1598 microversion: 2.1 time: 0.656946 Aug 25 13:05:00.304575 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1552/3101] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:59 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 1598 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:00.324847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2c2e77dd-d9f1-4f79-bfb5-ded654e7ae46 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:00.334645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-e94ca0c7-653a-429f-a438-026bf2fafafb req-afcb2c2c-0c06-40fb-a904-da5dbce25989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59f80e3-c2a8-4ca1-b4cd-41027f74aa90", "name": "network-vif-deleted", "tag": "cef37bc8-24da-4194-a393-9253f1b67704"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:00.370452 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2c2e77dd-d9f1-4f79-bfb5-ded654e7ae46 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1466 microversion: 2.1 time: 1.959561 Aug 25 13:05:00.377834 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1550/3102] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:58 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1466 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:00.397832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e94ca0c7-653a-429f-a438-026bf2fafafb req-afcb2c2c-0c06-40fb-a904-da5dbce25989 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:00.406601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e94ca0c7-653a-429f-a438-026bf2fafafb req-afcb2c2c-0c06-40fb-a904-da5dbce25989 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:00.410016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e94ca0c7-653a-429f-a438-026bf2fafafb req-afcb2c2c-0c06-40fb-a904-da5dbce25989 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:00.439728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-39f97463-1fce-4b3a-90a0-f61ce1373c9f tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:00.448256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-39f97463-1fce-4b3a-90a0-f61ce1373c9f tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:00.480227 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-e94ca0c7-653a-429f-a438-026bf2fafafb req-afcb2c2c-0c06-40fb-a904-da5dbce25989 service nova] Creating event network-vif-deleted:cef37bc8-24da-4194-a393-9253f1b67704 for instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 on n-h2-852771-8 Aug 25 13:05:00.490050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39f97463-1fce-4b3a-90a0-f61ce1373c9f tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:00.491997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39f97463-1fce-4b3a-90a0-f61ce1373c9f tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:00.496092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39f97463-1fce-4b3a-90a0-f61ce1373c9f tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:00.497462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39f97463-1fce-4b3a-90a0-f61ce1373c9f tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:00.502673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39f97463-1fce-4b3a-90a0-f61ce1373c9f tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:00.502800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39f97463-1fce-4b3a-90a0-f61ce1373c9f tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:00.517317 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-e94ca0c7-653a-429f-a438-026bf2fafafb req-afcb2c2c-0c06-40fb-a904-da5dbce25989 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206829 Aug 25 13:05:00.525987 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1553/3103] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:00.699406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:00.705635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:00.728147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:00.729694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:00.732112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:00.735819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:00.738245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:00.739813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:01.714685 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-39f97463-1fce-4b3a-90a0-f61ce1373c9f tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1617 microversion: 2.1 time: 1.288006 Aug 25 13:05:01.719893 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1551/3104] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:00 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1617 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:01.747647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:01.761611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] [instance: a59f80e3-c2a8-4ca1-b4cd-41027f74aa90] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:01.787857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:01.790749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:01.792059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:01.794213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:01.795543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:01.796913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:01.832943 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] HTTP exception thrown: Instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 could not be found. Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Request method failure captured: Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 HTTP/1.1 Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3Kw6gCp1J3nGW44nzzhskh4zI4Xy8C30lAL_Hqx8TAWAGpCkBt4fYkHQTNvmxIjCZ7WTULqdAX4nlWbRzvJVAqatL6QY_pE7wWYbUafjnZ90tfh80AahhEtcj5be3HJwxdQX1BADbVYr5IClXwWynWp2dYeyirncfElgtOkSMQ4jrc Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 9d299d545c86446392d864f9689e0208 Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestFqdnHostnames-1147033458 Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d299d545c86446392d864f9689e0208"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d299d545c86446392d864f9689e0208", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d299d545c86446392d864f9689e0208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d299d545c86446392d864f9689e0208"}]}] Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestFqdnHostnames-1147033458 Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 9d299d545c86446392d864f9689e0208 Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1147033458 Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestFqdnHostnames-1147033458-project Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2bb2beca1cfb4b31b0e0080b39d12497 Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestFqdnHostnames-1147033458-project Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 could not be found. Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'a59f80e3-c2a8-4ca1-b4cd-41027f74aa90'} Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 could not be found. Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 could not be found. Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:01.848217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:05:01.858018 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:01.858018 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:01.858018 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:01.858018 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:05:01.858018 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:05:01.858018 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 could not be found. Aug 25 13:05:01.858018 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:05:01.858018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Returning 404 to user: Instance a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:05:01.858018 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-be3e3996-f8eb-47c4-a6ac-e892be394092 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90" status: 404 len: 111 microversion: 2.1 time: 0.125941 Aug 25 13:05:01.858018 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1552/3105] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:01 2022] GET /compute/v2.1/servers/a59f80e3-c2a8-4ca1-b4cd-41027f74aa90 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:05:01.865846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-24b9f833-366f-41aa-a870-b5f70a917351 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] Calling method '.version_select at 0x7f3a299ca0d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:01.919963 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-24b9f833-366f-41aa-a870-b5f70a917351 tempest-ServersTestFqdnHostnames-1147033458 tempest-ServersTestFqdnHostnames-1147033458-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-199103592" status: 202 len: 0 microversion: 2.1 time: 0.061624 Aug 25 13:05:01.920287 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1553/3106] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 13:05:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-199103592 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:05:02.117044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-429809063", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "34c46524-70ff-4c0a-9fce-afaacf9d2ba5"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:02.291214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:02.309006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:05:02.347933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:02.352659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:02.360592 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bae06075-3e51-44d1-84d8-2e59908186c2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.705624 Aug 25 13:05:02.362845 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1554/3107] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:00 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:03.420835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:03.423068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:03.439325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:03.447808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:03.449410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:03.450786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:03.452751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:03.454320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:03.455813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:03.720045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:05:03.721998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:05:03.723258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:05:03.724915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:05:03.725894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:05:03.755377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:03.758130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:03.759425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:03.761719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:03.763139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:03.764326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:03.807887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:05:03.832140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Getting quotas for user a98046249f4e4b8fbe18ed2747d6ed6b and project 5b864a9e1e6b4c2f9552a9e167d71e14. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:05:03.869723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:05:03.874974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:05:04.021938 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42b582fb-a526-46a1-849d-3ec49832f714 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.913458 Aug 25 13:05:04.023578 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1554/3108] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:05:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:05:04.046114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-83c9e1fd-747e-4c69-895b-9623faf18369 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:04.050991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-83c9e1fd-747e-4c69-895b-9623faf18369 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:04.353387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-83c9e1fd-747e-4c69-895b-9623faf18369 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:04.388561 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-83c9e1fd-747e-4c69-895b-9623faf18369 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1216 microversion: 2.1 time: 0.350349 Aug 25 13:05:04.396905 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1555/3109] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:04 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1216 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:05.453053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a5300a0f-7a80-4e1d-b41c-bf6344cdd100 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:05.459655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a5300a0f-7a80-4e1d-b41c-bf6344cdd100 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:05.534697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:05.594850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:05.616169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:05.624313 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bcca8af2-319c-47d3-a511-09bacf0da446 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 2.220612 Aug 25 13:05:05.638134 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1555/3110] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:03 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:05:06.371805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a5300a0f-7a80-4e1d-b41c-bf6344cdd100 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:06.400470 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a5300a0f-7a80-4e1d-b41c-bf6344cdd100 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1216 microversion: 2.1 time: 0.954634 Aug 25 13:05:06.406961 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1556/3111] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:05 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1216 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:06.671192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:06.672080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:06.716921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:06.718518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:06.719674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:06.721303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:06.722561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:06.723672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:07.449422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b528c622-0d26-4be8-9487-644addbf40de tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:07.454453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b528c622-0d26-4be8-9487-644addbf40de tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:07.486476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b528c622-0d26-4be8-9487-644addbf40de tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:07.492097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b528c622-0d26-4be8-9487-644addbf40de tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:07.493298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b528c622-0d26-4be8-9487-644addbf40de tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:07.500438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b528c622-0d26-4be8-9487-644addbf40de tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:07.504635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b528c622-0d26-4be8-9487-644addbf40de tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:07.506587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b528c622-0d26-4be8-9487-644addbf40de tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:09.041354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b528c622-0d26-4be8-9487-644addbf40de tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:09.111469 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b528c622-0d26-4be8-9487-644addbf40de tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1274 microversion: 2.1 time: 1.663384 Aug 25 13:05:09.130215 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1557/3112] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:07 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1274 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:09.905321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:09.941606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:09.945721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:09.948282 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7edda7be-e10f-4430-8cda-9be0edb615af tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 3.282794 Aug 25 13:05:09.958003 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1556/3113] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:06 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 3290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:10.157856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fb2d3e9a-5197-4f51-b978-7732bce22ebf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:10.174348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fb2d3e9a-5197-4f51-b978-7732bce22ebf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:10.210783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb2d3e9a-5197-4f51-b978-7732bce22ebf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:10.211835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb2d3e9a-5197-4f51-b978-7732bce22ebf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:10.215570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb2d3e9a-5197-4f51-b978-7732bce22ebf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:10.220289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb2d3e9a-5197-4f51-b978-7732bce22ebf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:10.226168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb2d3e9a-5197-4f51-b978-7732bce22ebf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:10.227135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb2d3e9a-5197-4f51-b978-7732bce22ebf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:10.826994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fb2d3e9a-5197-4f51-b978-7732bce22ebf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:10.883185 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fb2d3e9a-5197-4f51-b978-7732bce22ebf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1274 microversion: 2.1 time: 0.732824 Aug 25 13:05:10.884795 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1558/3114] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:10 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1274 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:10.997441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:10.998641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:11.058630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:11.065241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:11.066795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:11.068923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:11.076568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:11.077780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:11.946431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7228b486-4fa9-4f43-a532-d5bd9d385b3e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:11.948615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7228b486-4fa9-4f43-a532-d5bd9d385b3e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:11.999680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7228b486-4fa9-4f43-a532-d5bd9d385b3e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:12.000938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7228b486-4fa9-4f43-a532-d5bd9d385b3e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:12.004173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7228b486-4fa9-4f43-a532-d5bd9d385b3e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:12.007675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7228b486-4fa9-4f43-a532-d5bd9d385b3e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:12.011538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7228b486-4fa9-4f43-a532-d5bd9d385b3e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:12.013458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7228b486-4fa9-4f43-a532-d5bd9d385b3e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:12.490253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7228b486-4fa9-4f43-a532-d5bd9d385b3e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:12.523959 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7228b486-4fa9-4f43-a532-d5bd9d385b3e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1274 microversion: 2.1 time: 0.602340 Aug 25 13:05:12.526604 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1559/3115] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:11 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1274 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:13.226771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:13.260627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:13.264693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:13.268032 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d05bb6b7-e9a4-431b-bfff-7a22d1294a47 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 2.278101 Aug 25 13:05:13.270130 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1557/3116] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:10 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 2282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:13.570092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75ed4f7c-8fda-4d64-9824-9c7a8505a900 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:13.571770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-75ed4f7c-8fda-4d64-9824-9c7a8505a900 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:13.584827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75ed4f7c-8fda-4d64-9824-9c7a8505a900 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:13.586002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75ed4f7c-8fda-4d64-9824-9c7a8505a900 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:13.587988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75ed4f7c-8fda-4d64-9824-9c7a8505a900 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:13.589630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75ed4f7c-8fda-4d64-9824-9c7a8505a900 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:13.591724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75ed4f7c-8fda-4d64-9824-9c7a8505a900 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:13.592656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75ed4f7c-8fda-4d64-9824-9c7a8505a900 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:13.796573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:13.944879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-75ed4f7c-8fda-4d64-9824-9c7a8505a900 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:13.973082 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-75ed4f7c-8fda-4d64-9824-9c7a8505a900 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1274 microversion: 2.1 time: 0.412059 Aug 25 13:05:13.983859 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1560/3117] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:13 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1274 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:14.322820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:14.334501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:14.373394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:14.374350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:14.375196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:14.376549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:14.377435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:14.378312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:15.020574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c11118f4-b606-42bf-95e6-9c4977d36e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:15.027063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c11118f4-b606-42bf-95e6-9c4977d36e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:15.055446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11118f4-b606-42bf-95e6-9c4977d36e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:15.062518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11118f4-b606-42bf-95e6-9c4977d36e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:15.065982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11118f4-b606-42bf-95e6-9c4977d36e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:15.068354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11118f4-b606-42bf-95e6-9c4977d36e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:15.074937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11118f4-b606-42bf-95e6-9c4977d36e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:15.076262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c11118f4-b606-42bf-95e6-9c4977d36e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:16.038075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c11118f4-b606-42bf-95e6-9c4977d36e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:16.059020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=86 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:16.071184 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c11118f4-b606-42bf-95e6-9c4977d36e04 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1316 microversion: 2.1 time: 1.057611 Aug 25 13:05:16.078772 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1561/3118] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:15 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1316 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:16.214447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:16.244936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:16.262810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:16.268030 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ede6081c-35db-4856-bd49-678215db4a87 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.955415 Aug 25 13:05:16.285565 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1558/3119] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:14 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:17.129685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47165d21-329d-4a50-9800-33bd83537b0d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:17.131554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-47165d21-329d-4a50-9800-33bd83537b0d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:17.151424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:17.156303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:17.166743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47165d21-329d-4a50-9800-33bd83537b0d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:17.167615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47165d21-329d-4a50-9800-33bd83537b0d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:17.168437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47165d21-329d-4a50-9800-33bd83537b0d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:17.170181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47165d21-329d-4a50-9800-33bd83537b0d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:17.171101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47165d21-329d-4a50-9800-33bd83537b0d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:17.172321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47165d21-329d-4a50-9800-33bd83537b0d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:17.326490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:17.328828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:17.345846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:17.347428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:17.351148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:17.354098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:17.355329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:17.356709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:17.412225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=82 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:18.327626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-47165d21-329d-4a50-9800-33bd83537b0d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:18.351545 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47165d21-329d-4a50-9800-33bd83537b0d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1316 microversion: 2.1 time: 1.241111 Aug 25 13:05:18.370724 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1562/3120] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:17 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1316 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:18.392452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9e7e35fd-725a-491f-826b-90c8dfef628b req-daa1340d-38b2-401c-a620-6f485dba9dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-plugged", "status": "completed", "tag": "ed5bbca5-cf27-4cc2-9c60-a1ffe6539741"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:18.413964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9e7e35fd-725a-491f-826b-90c8dfef628b req-daa1340d-38b2-401c-a620-6f485dba9dc0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:18.415283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9e7e35fd-725a-491f-826b-90c8dfef628b req-daa1340d-38b2-401c-a620-6f485dba9dc0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:18.416408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9e7e35fd-725a-491f-826b-90c8dfef628b req-daa1340d-38b2-401c-a620-6f485dba9dc0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:18.445910 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9e7e35fd-725a-491f-826b-90c8dfef628b req-daa1340d-38b2-401c-a620-6f485dba9dc0 service nova] Creating event network-vif-plugged:ed5bbca5-cf27-4cc2-9c60-a1ffe6539741 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:05:18.459362 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9e7e35fd-725a-491f-826b-90c8dfef628b req-daa1340d-38b2-401c-a620-6f485dba9dc0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084712 Aug 25 13:05:18.462370 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1563/3121] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:18.573256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:18.607081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:18.610385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:18.612770 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9094ce1d-5dc4-48ad-aa3b-f3eee0272239 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.295246 Aug 25 13:05:18.635678 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1559/3122] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:17 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:05:19.401011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-26f5f6aa-622d-462c-954a-d433f092e53f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:19.403467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-26f5f6aa-622d-462c-954a-d433f092e53f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:19.417923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26f5f6aa-622d-462c-954a-d433f092e53f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:19.419249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26f5f6aa-622d-462c-954a-d433f092e53f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:19.420320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26f5f6aa-622d-462c-954a-d433f092e53f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:19.422066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26f5f6aa-622d-462c-954a-d433f092e53f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:19.423312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26f5f6aa-622d-462c-954a-d433f092e53f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:19.424489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26f5f6aa-622d-462c-954a-d433f092e53f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:19.663629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:19.670171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:19.706520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:19.707888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:19.710477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:19.713815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:19.715237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:19.724088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:20.761573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-26f5f6aa-622d-462c-954a-d433f092e53f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:20.801871 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-26f5f6aa-622d-462c-954a-d433f092e53f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1316 microversion: 2.1 time: 1.407927 Aug 25 13:05:20.822110 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1564/3123] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:19 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1316 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:20.839466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0f7e248f-c925-4e15-9415-23a9b03c3503 req-3792835e-ec6f-44ad-b48d-2d2eeff750c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-plugged", "status": "completed", "tag": "dd23ef5c-d8a0-4337-97d4-d03bd3e7954e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:20.869336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0f7e248f-c925-4e15-9415-23a9b03c3503 req-3792835e-ec6f-44ad-b48d-2d2eeff750c0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:20.870264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0f7e248f-c925-4e15-9415-23a9b03c3503 req-3792835e-ec6f-44ad-b48d-2d2eeff750c0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:20.871092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0f7e248f-c925-4e15-9415-23a9b03c3503 req-3792835e-ec6f-44ad-b48d-2d2eeff750c0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:20.908988 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0f7e248f-c925-4e15-9415-23a9b03c3503 req-3792835e-ec6f-44ad-b48d-2d2eeff750c0 service nova] Creating event network-vif-plugged:dd23ef5c-d8a0-4337-97d4-d03bd3e7954e for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:05:20.932591 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0f7e248f-c925-4e15-9415-23a9b03c3503 req-3792835e-ec6f-44ad-b48d-2d2eeff750c0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107681 Aug 25 13:05:20.935058 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1565/3124] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:21.418973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:21.463552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:21.467581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:21.470707 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e03079a-643e-4c55-a6ce-cabbfaac24c4 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.815208 Aug 25 13:05:21.475581 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1560/3125] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:19 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:05:21.854982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2b9f87f6-80b3-41de-93df-34ac6ed0f395 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:21.863881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2b9f87f6-80b3-41de-93df-34ac6ed0f395 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:21.884531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b9f87f6-80b3-41de-93df-34ac6ed0f395 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:21.885935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b9f87f6-80b3-41de-93df-34ac6ed0f395 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:21.887119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b9f87f6-80b3-41de-93df-34ac6ed0f395 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:21.888457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b9f87f6-80b3-41de-93df-34ac6ed0f395 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:21.890686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b9f87f6-80b3-41de-93df-34ac6ed0f395 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:21.892579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b9f87f6-80b3-41de-93df-34ac6ed0f395 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:23.344937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:23.348488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:23.364253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:23.366473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:23.367907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:23.369765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:23.371099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:23.372488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:23.900734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2b9f87f6-80b3-41de-93df-34ac6ed0f395 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:23.926831 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2b9f87f6-80b3-41de-93df-34ac6ed0f395 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1316 microversion: 2.1 time: 2.079543 Aug 25 13:05:23.928099 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1566/3126] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:21 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1316 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:23.955435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-292dd225-e845-4304-a7c8-a8371bfa891a req-00443509-bd7d-42ed-945c-cf61754503d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a35e2416-c483-461e-a814-a81ef7debcc8", "tag": "c18cc499-b9cf-4473-b272-3c082e05498b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:23.991497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-292dd225-e845-4304-a7c8-a8371bfa891a req-00443509-bd7d-42ed-945c-cf61754503d5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:23.992718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-292dd225-e845-4304-a7c8-a8371bfa891a req-00443509-bd7d-42ed-945c-cf61754503d5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:23.993734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-292dd225-e845-4304-a7c8-a8371bfa891a req-00443509-bd7d-42ed-945c-cf61754503d5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:24.022389 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-292dd225-e845-4304-a7c8-a8371bfa891a req-00443509-bd7d-42ed-945c-cf61754503d5 service nova] Creating event network-changed:c18cc499-b9cf-4473-b272-3c082e05498b for instance a35e2416-c483-461e-a814-a81ef7debcc8 on n-h2-852771-8 Aug 25 13:05:24.035084 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-292dd225-e845-4304-a7c8-a8371bfa891a req-00443509-bd7d-42ed-945c-cf61754503d5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095596 Aug 25 13:05:24.037884 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1567/3127] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:24.282528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1cf34ad1-5b43-492a-a46c-5dfaba674aab req-04fe746c-9679-470e-88f1-8a37b781f18b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-plugged", "status": "completed", "tag": "2cf476bc-998d-4575-aaf0-a2986161d365"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:24.315278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1cf34ad1-5b43-492a-a46c-5dfaba674aab req-04fe746c-9679-470e-88f1-8a37b781f18b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:24.332453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1cf34ad1-5b43-492a-a46c-5dfaba674aab req-04fe746c-9679-470e-88f1-8a37b781f18b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:24.336933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1cf34ad1-5b43-492a-a46c-5dfaba674aab req-04fe746c-9679-470e-88f1-8a37b781f18b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:24.383026 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1cf34ad1-5b43-492a-a46c-5dfaba674aab req-04fe746c-9679-470e-88f1-8a37b781f18b service nova] Creating event network-vif-plugged:2cf476bc-998d-4575-aaf0-a2986161d365 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:05:24.397072 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1cf34ad1-5b43-492a-a46c-5dfaba674aab req-04fe746c-9679-470e-88f1-8a37b781f18b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125494 Aug 25 13:05:24.406967 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1568/3128] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:05:24.826622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:24.852438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:24.857328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:24.860893 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f11a919-14a3-4b93-ac36-ccedee2c1a36 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 2.350205 Aug 25 13:05:24.863088 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1561/3129] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:22 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:24.971549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-542de2ed-14f7-48ba-82f7-3bb69a117092 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:24.972929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-542de2ed-14f7-48ba-82f7-3bb69a117092 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:25.024503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-542de2ed-14f7-48ba-82f7-3bb69a117092 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:25.029575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-542de2ed-14f7-48ba-82f7-3bb69a117092 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:25.031433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-542de2ed-14f7-48ba-82f7-3bb69a117092 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:25.034874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-542de2ed-14f7-48ba-82f7-3bb69a117092 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:25.035905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-542de2ed-14f7-48ba-82f7-3bb69a117092 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:25.038889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-542de2ed-14f7-48ba-82f7-3bb69a117092 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:25.906333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:25.907691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:25.931505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:25.935109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:25.940042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:25.943154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:25.945050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:25.946536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:26.964598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:27.022003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:27.025037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:27.049836 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-01dbb2b0-66cc-434b-a6f6-9dd40210bf05 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.149882 Aug 25 13:05:27.066701 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1562/3130] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:25 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:27.104226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-542de2ed-14f7-48ba-82f7-3bb69a117092 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:27.109651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-78b94661-609e-4a59-8c70-31fce382061d req-bfea9c40-746e-4ee0-a6c7-6f9781e193a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-plugged", "status": "completed", "tag": "bd20681c-2a18-4c40-b6eb-ea84168bffcb"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:27.151812 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-542de2ed-14f7-48ba-82f7-3bb69a117092 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1316 microversion: 2.1 time: 2.188166 Aug 25 13:05:27.162392 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1569/3131] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:24 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1316 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:27.194438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-78b94661-609e-4a59-8c70-31fce382061d req-bfea9c40-746e-4ee0-a6c7-6f9781e193a8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:27.210784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-78b94661-609e-4a59-8c70-31fce382061d req-bfea9c40-746e-4ee0-a6c7-6f9781e193a8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:27.211590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-78b94661-609e-4a59-8c70-31fce382061d req-bfea9c40-746e-4ee0-a6c7-6f9781e193a8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:27.291840 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-78b94661-609e-4a59-8c70-31fce382061d req-bfea9c40-746e-4ee0-a6c7-6f9781e193a8 service nova] Creating event network-vif-plugged:bd20681c-2a18-4c40-b6eb-ea84168bffcb for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:05:27.312073 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-78b94661-609e-4a59-8c70-31fce382061d req-bfea9c40-746e-4ee0-a6c7-6f9781e193a8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240816 Aug 25 13:05:27.315645 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1563/3132] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:28.101469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:28.107268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:28.130216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:28.131950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:28.133249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:28.135027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:28.136322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:28.137556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:28.204790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a54fccb-b0cf-4e4e-80a4-0d4cf9e74be6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:28.206204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a54fccb-b0cf-4e4e-80a4-0d4cf9e74be6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:28.237070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a54fccb-b0cf-4e4e-80a4-0d4cf9e74be6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:28.237922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a54fccb-b0cf-4e4e-80a4-0d4cf9e74be6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:28.239144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a54fccb-b0cf-4e4e-80a4-0d4cf9e74be6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:28.241241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a54fccb-b0cf-4e4e-80a4-0d4cf9e74be6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:28.242760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a54fccb-b0cf-4e4e-80a4-0d4cf9e74be6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:28.243695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a54fccb-b0cf-4e4e-80a4-0d4cf9e74be6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:29.727988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:29.770552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:29.774518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:29.785786 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-daa9ee0b-a579-43ac-99b2-8bafdc5d1d64 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.684255 Aug 25 13:05:29.801653 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1570/3133] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:28 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:29.801653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f20d4a4a-a354-4bfc-bd3f-9cb16fe16a1a req-a04c264a-a3f1-4ad5-922e-ef4330951507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-plugged", "status": "completed", "tag": "f3625622-a332-4f68-bfa8-134a05eaf7d2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:29.810254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5a54fccb-b0cf-4e4e-80a4-0d4cf9e74be6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:29.835923 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a54fccb-b0cf-4e4e-80a4-0d4cf9e74be6 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1316 microversion: 2.1 time: 1.639107 Aug 25 13:05:29.841369 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1564/3134] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:28 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1316 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:29.857926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f20d4a4a-a354-4bfc-bd3f-9cb16fe16a1a req-a04c264a-a3f1-4ad5-922e-ef4330951507 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:29.857926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f20d4a4a-a354-4bfc-bd3f-9cb16fe16a1a req-a04c264a-a3f1-4ad5-922e-ef4330951507 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:29.857926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f20d4a4a-a354-4bfc-bd3f-9cb16fe16a1a req-a04c264a-a3f1-4ad5-922e-ef4330951507 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:29.918672 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f20d4a4a-a354-4bfc-bd3f-9cb16fe16a1a req-a04c264a-a3f1-4ad5-922e-ef4330951507 service nova] Creating event network-vif-plugged:f3625622-a332-4f68-bfa8-134a05eaf7d2 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:05:29.938761 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f20d4a4a-a354-4bfc-bd3f-9cb16fe16a1a req-a04c264a-a3f1-4ad5-922e-ef4330951507 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147898 Aug 25 13:05:29.941778 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1571/3135] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:30.845607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:30.852448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:30.894544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:30.895681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:30.897069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:30.908873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:30.909900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:30.910835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:30.914319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93268a0a-c72f-4c1f-9cf5-dded387b3dfd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:30.919981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-93268a0a-c72f-4c1f-9cf5-dded387b3dfd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:30.956808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93268a0a-c72f-4c1f-9cf5-dded387b3dfd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:30.961795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93268a0a-c72f-4c1f-9cf5-dded387b3dfd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:30.966099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93268a0a-c72f-4c1f-9cf5-dded387b3dfd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:30.972811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93268a0a-c72f-4c1f-9cf5-dded387b3dfd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:30.978790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93268a0a-c72f-4c1f-9cf5-dded387b3dfd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:30.984772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93268a0a-c72f-4c1f-9cf5-dded387b3dfd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:33.132341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:33.165467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:33.175383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:33.182538 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-660f9dfe-5ec9-4efc-86eb-5995257d0f27 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 2.352320 Aug 25 13:05:33.197898 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1565/3136] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:30 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:05:33.225232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d945b606-c07d-4e10-b539-d608bc18c6a5 req-90e23c5c-b346-4bc6-ac29-7a6503c4968e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-plugged", "status": "completed", "tag": "d8ec31a3-80bb-4d7b-bc7a-5a21d51389c7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:33.246178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d945b606-c07d-4e10-b539-d608bc18c6a5 req-90e23c5c-b346-4bc6-ac29-7a6503c4968e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:33.247687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d945b606-c07d-4e10-b539-d608bc18c6a5 req-90e23c5c-b346-4bc6-ac29-7a6503c4968e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:33.248733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d945b606-c07d-4e10-b539-d608bc18c6a5 req-90e23c5c-b346-4bc6-ac29-7a6503c4968e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:33.276862 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d945b606-c07d-4e10-b539-d608bc18c6a5 req-90e23c5c-b346-4bc6-ac29-7a6503c4968e service nova] Creating event network-vif-plugged:d8ec31a3-80bb-4d7b-bc7a-5a21d51389c7 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:05:33.290611 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d945b606-c07d-4e10-b539-d608bc18c6a5 req-90e23c5c-b346-4bc6-ac29-7a6503c4968e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089875 Aug 25 13:05:33.292641 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1566/3137] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:33.481944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93268a0a-c72f-4c1f-9cf5-dded387b3dfd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:33.526518 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-93268a0a-c72f-4c1f-9cf5-dded387b3dfd tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1316 microversion: 2.1 time: 2.643121 Aug 25 13:05:33.534294 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1572/3138] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:30 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1316 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:34.233382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:34.236364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:34.255832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=24 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:34.289110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:34.291538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:34.292330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:34.293966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:34.302410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:34.306433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:34.593798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75bf0a29-1627-44fa-82fb-2e31d4567008 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:34.596711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-75bf0a29-1627-44fa-82fb-2e31d4567008 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:34.682821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75bf0a29-1627-44fa-82fb-2e31d4567008 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:34.693808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75bf0a29-1627-44fa-82fb-2e31d4567008 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:34.695008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75bf0a29-1627-44fa-82fb-2e31d4567008 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:34.700145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75bf0a29-1627-44fa-82fb-2e31d4567008 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:34.700994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75bf0a29-1627-44fa-82fb-2e31d4567008 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:34.701847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75bf0a29-1627-44fa-82fb-2e31d4567008 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:35.947985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:36.004527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:36.017449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:36.023212 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d030d99b-8c99-4670-8479-240eb70773e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.798150 Aug 25 13:05:36.046807 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1567/3139] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:34 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:36.051089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-75bf0a29-1627-44fa-82fb-2e31d4567008 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:36.094166 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-75bf0a29-1627-44fa-82fb-2e31d4567008 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1316 microversion: 2.1 time: 1.517015 Aug 25 13:05:36.118085 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1573/3140] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:34 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1316 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:36.709249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-e6b674d5-4a67-4f97-9850-bdf6332903e0 req-942d4fb7-3fb8-480d-91d8-886895673819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-plugged", "status": "completed", "tag": "2220c4ad-2d43-43af-8e24-1c7cdc12d117"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:36.763901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e6b674d5-4a67-4f97-9850-bdf6332903e0 req-942d4fb7-3fb8-480d-91d8-886895673819 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:36.782223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e6b674d5-4a67-4f97-9850-bdf6332903e0 req-942d4fb7-3fb8-480d-91d8-886895673819 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:36.783377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e6b674d5-4a67-4f97-9850-bdf6332903e0 req-942d4fb7-3fb8-480d-91d8-886895673819 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:36.829463 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-e6b674d5-4a67-4f97-9850-bdf6332903e0 req-942d4fb7-3fb8-480d-91d8-886895673819 service nova] Creating event network-vif-plugged:2220c4ad-2d43-43af-8e24-1c7cdc12d117 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:05:36.856782 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-e6b674d5-4a67-4f97-9850-bdf6332903e0 req-942d4fb7-3fb8-480d-91d8-886895673819 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.807344 Aug 25 13:05:36.860759 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1568/3141] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:37.094558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:37.101393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:37.125538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:37.126998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:37.128306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:37.130595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:37.132223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:37.133457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:37.182333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fdd27db3-0cbc-4d40-b7c9-37c66bb466f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:37.188591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fdd27db3-0cbc-4d40-b7c9-37c66bb466f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:37.214383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd27db3-0cbc-4d40-b7c9-37c66bb466f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:37.221754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd27db3-0cbc-4d40-b7c9-37c66bb466f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:37.223410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd27db3-0cbc-4d40-b7c9-37c66bb466f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:37.226973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd27db3-0cbc-4d40-b7c9-37c66bb466f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:37.233663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd27db3-0cbc-4d40-b7c9-37c66bb466f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:37.235122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd27db3-0cbc-4d40-b7c9-37c66bb466f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:39.237773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fdd27db3-0cbc-4d40-b7c9-37c66bb466f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:39.265182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:39.273040 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fdd27db3-0cbc-4d40-b7c9-37c66bb466f7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1316 microversion: 2.1 time: 2.100545 Aug 25 13:05:39.278254 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1569/3142] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:37 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1316 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:39.299032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a3ef9458-1b0b-403a-b913-0a63b346d965 req-aacef61f-aa1d-49bc-9da2-f0d21c17b51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35e2416-c483-461e-a814-a81ef7debcc8", "name": "network-vif-plugged", "status": "completed", "tag": "c18cc499-b9cf-4473-b272-3c082e05498b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:39.329558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:39.341555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:39.344383 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-76b61b59-3075-49d4-8ed1-6376cb632f75 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 2.271493 Aug 25 13:05:39.346067 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1574/3143] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:37 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:39.350651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a3ef9458-1b0b-403a-b913-0a63b346d965 req-aacef61f-aa1d-49bc-9da2-f0d21c17b51c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:39.351541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a3ef9458-1b0b-403a-b913-0a63b346d965 req-aacef61f-aa1d-49bc-9da2-f0d21c17b51c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:39.352289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a3ef9458-1b0b-403a-b913-0a63b346d965 req-aacef61f-aa1d-49bc-9da2-f0d21c17b51c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:39.417441 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a3ef9458-1b0b-403a-b913-0a63b346d965 req-aacef61f-aa1d-49bc-9da2-f0d21c17b51c service nova] Creating event network-vif-plugged:c18cc499-b9cf-4473-b272-3c082e05498b for instance a35e2416-c483-461e-a814-a81ef7debcc8 on n-h2-852771-8 Aug 25 13:05:39.444624 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a3ef9458-1b0b-403a-b913-0a63b346d965 req-aacef61f-aa1d-49bc-9da2-f0d21c17b51c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159872 Aug 25 13:05:39.446602 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1570/3144] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:40.330060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0d3ad58b-99fc-4a8a-9dd4-7f7c2af2ec84 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:40.331304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0d3ad58b-99fc-4a8a-9dd4-7f7c2af2ec84 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:40.358766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d3ad58b-99fc-4a8a-9dd4-7f7c2af2ec84 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:40.359695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d3ad58b-99fc-4a8a-9dd4-7f7c2af2ec84 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:40.360650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d3ad58b-99fc-4a8a-9dd4-7f7c2af2ec84 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:40.372820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d3ad58b-99fc-4a8a-9dd4-7f7c2af2ec84 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:40.374052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d3ad58b-99fc-4a8a-9dd4-7f7c2af2ec84 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:40.375261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d3ad58b-99fc-4a8a-9dd4-7f7c2af2ec84 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:40.416238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:40.418070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:40.476061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:40.477672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:40.478841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:40.483735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:40.487271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:40.494900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:41.221037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0d3ad58b-99fc-4a8a-9dd4-7f7c2af2ec84 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:41.244500 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0d3ad58b-99fc-4a8a-9dd4-7f7c2af2ec84 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1316 microversion: 2.1 time: 0.921803 Aug 25 13:05:41.258111 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1575/3145] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:40 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1316 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:41.423260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:41.445319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:41.448995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:41.452019 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a2253559-b8f5-4cf5-adc0-11d6da48d0fc tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1874 microversion: 2.42 time: 1.061779 Aug 25 13:05:41.452882 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1571/3146] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:40 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1874 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:05:42.280535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ac3cb0d-8c1f-43f1-93e7-9579797e314b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:42.293981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4ac3cb0d-8c1f-43f1-93e7-9579797e314b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:42.314391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ac3cb0d-8c1f-43f1-93e7-9579797e314b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:42.315277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ac3cb0d-8c1f-43f1-93e7-9579797e314b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:42.316420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ac3cb0d-8c1f-43f1-93e7-9579797e314b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:42.335129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ac3cb0d-8c1f-43f1-93e7-9579797e314b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:42.335856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ac3cb0d-8c1f-43f1-93e7-9579797e314b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:42.336881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ac3cb0d-8c1f-43f1-93e7-9579797e314b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:42.507966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:42.511880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:42.562937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:42.564379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:42.565499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:42.570719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:42.571732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:42.572450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:43.331097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4ac3cb0d-8c1f-43f1-93e7-9579797e314b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:43.360082 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ac3cb0d-8c1f-43f1-93e7-9579797e314b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1466 microversion: 2.1 time: 1.086794 Aug 25 13:05:43.361168 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1576/3147] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:42 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1466 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:43.400187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2483453e-0286-4f09-96c5-4c08d15d8622 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:43.401364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2483453e-0286-4f09-96c5-4c08d15d8622 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:43.415445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2483453e-0286-4f09-96c5-4c08d15d8622 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:43.416401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2483453e-0286-4f09-96c5-4c08d15d8622 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:43.417234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2483453e-0286-4f09-96c5-4c08d15d8622 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:43.418603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2483453e-0286-4f09-96c5-4c08d15d8622 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:43.419460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2483453e-0286-4f09-96c5-4c08d15d8622 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:43.421409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2483453e-0286-4f09-96c5-4c08d15d8622 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:43.980813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:44.007735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:44.015332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:44.019182 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5926df2e-8f1a-4a16-ace4-fdf3339c4a14 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 2832 microversion: 2.42 time: 1.522638 Aug 25 13:05:44.049464 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1572/3148] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:42 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 2832 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:44.101953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-370efb95-1ad5-4c63-8029-891c998c21b8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:44.103877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-370efb95-1ad5-4c63-8029-891c998c21b8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:44.125016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370efb95-1ad5-4c63-8029-891c998c21b8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.126940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370efb95-1ad5-4c63-8029-891c998c21b8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.128966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370efb95-1ad5-4c63-8029-891c998c21b8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.133893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370efb95-1ad5-4c63-8029-891c998c21b8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.135706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370efb95-1ad5-4c63-8029-891c998c21b8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.137297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370efb95-1ad5-4c63-8029-891c998c21b8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:45.115917 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-370efb95-1ad5-4c63-8029-891c998c21b8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a/os-interface" status: 200 len: 1831 microversion: 2.42 time: 1.035199 Aug 25 13:05:45.117536 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1573/3149] 10.222.0.70 () {60 vars in 1316 bytes} [Thu Aug 25 13:05:44 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a/os-interface => generated 1831 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:05:45.201827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2483453e-0286-4f09-96c5-4c08d15d8622 tempest-ServersOnMultiNodesTest-586448419 tempest-ServersOnMultiNodesTest-586448419-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1617 microversion: 2.1 time: 1.808419 Aug 25 13:05:45.207727 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1577/3150] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:43 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1617 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:45.264278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-73851b26-3ae2-4b0d-8c44-82bd23ea48ad tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:45.266772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-73851b26-3ae2-4b0d-8c44-82bd23ea48ad tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:45.294972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73851b26-3ae2-4b0d-8c44-82bd23ea48ad tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:45.298998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73851b26-3ae2-4b0d-8c44-82bd23ea48ad tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:45.303884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73851b26-3ae2-4b0d-8c44-82bd23ea48ad tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:45.308799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73851b26-3ae2-4b0d-8c44-82bd23ea48ad tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:45.312623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73851b26-3ae2-4b0d-8c44-82bd23ea48ad tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:45.314108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73851b26-3ae2-4b0d-8c44-82bd23ea48ad tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:45.447015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-73851b26-3ae2-4b0d-8c44-82bd23ea48ad tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:05:45.473167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-878521042", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:45.762027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] validate_networks() for [('d43beb4c-f709-43d3-b78d-aab45a4a0953', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:05:45.801468 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-73851b26-3ae2-4b0d-8c44-82bd23ea48ad tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 204 len: 0 microversion: 2.1 time: 0.544472 Aug 25 13:05:45.803854 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1578/3151] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:05:45 2022] DELETE /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:05:45.829972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bd806995-5b0c-4dfd-aade-2e80f48fc131 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:45.831824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bd806995-5b0c-4dfd-aade-2e80f48fc131 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:45.848626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd806995-5b0c-4dfd-aade-2e80f48fc131 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:45.851989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd806995-5b0c-4dfd-aade-2e80f48fc131 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:45.853558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd806995-5b0c-4dfd-aade-2e80f48fc131 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:45.856489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd806995-5b0c-4dfd-aade-2e80f48fc131 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:45.858010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd806995-5b0c-4dfd-aade-2e80f48fc131 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:45.860322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd806995-5b0c-4dfd-aade-2e80f48fc131 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:47.222933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bd806995-5b0c-4dfd-aade-2e80f48fc131 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:47.254611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:47.267669 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bd806995-5b0c-4dfd-aade-2e80f48fc131 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1472 microversion: 2.1 time: 1.456204 Aug 25 13:05:47.272058 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1579/3152] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:45 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1472 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:47.940509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f79fa141-5a8c-4e3b-a5c8-1dc8a73f38b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:47.950605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f79fa141-5a8c-4e3b-a5c8-1dc8a73f38b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:47.969360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:48.008611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f79fa141-5a8c-4e3b-a5c8-1dc8a73f38b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:48.013445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f79fa141-5a8c-4e3b-a5c8-1dc8a73f38b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:48.015390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f79fa141-5a8c-4e3b-a5c8-1dc8a73f38b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:48.018202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f79fa141-5a8c-4e3b-a5c8-1dc8a73f38b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:48.019686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f79fa141-5a8c-4e3b-a5c8-1dc8a73f38b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:48.022193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f79fa141-5a8c-4e3b-a5c8-1dc8a73f38b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:50.874737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f79fa141-5a8c-4e3b-a5c8-1dc8a73f38b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:50.909312 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f79fa141-5a8c-4e3b-a5c8-1dc8a73f38b8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.978383 Aug 25 13:05:50.914218 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1580/3153] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:47 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:50.938748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-621b0566-86f3-4884-aecf-ba58038b3ee0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:50.942798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-621b0566-86f3-4884-aecf-ba58038b3ee0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:50.968831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621b0566-86f3-4884-aecf-ba58038b3ee0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:50.970657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621b0566-86f3-4884-aecf-ba58038b3ee0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:50.971299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621b0566-86f3-4884-aecf-ba58038b3ee0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:50.972307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621b0566-86f3-4884-aecf-ba58038b3ee0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:50.972932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621b0566-86f3-4884-aecf-ba58038b3ee0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:50.975377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621b0566-86f3-4884-aecf-ba58038b3ee0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:52.345041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:05:52.347710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:05:52.350051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:05:52.354961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:05:52.356224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:05:52.384820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:52.386275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:52.388546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:52.390776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:52.392829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:52.394474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:52.436043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=72 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:52.465429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Getting quotas for project cb30d93b30ac4a8a9caa759b49182412. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:05:52.482540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Getting quotas for user 4946d6cd1da64db3b3c845cffac626e3 and project cb30d93b30ac4a8a9caa759b49182412. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:05:52.518640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:05:52.524930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:05:52.680597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-621b0566-86f3-4884-aecf-ba58038b3ee0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:52.700169 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3d4eccd8-1cb3-4311-bbb8-b56ae43843a1 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.580406 Aug 25 13:05:52.707178 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1574/3154] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 7589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:05:52.734419 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-621b0566-86f3-4884-aecf-ba58038b3ee0 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1472 microversion: 2.1 time: 1.816140 Aug 25 13:05:52.735429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-78aa0e3f-4d5e-4d41-ad1d-ed06c1292f6d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:52.736289 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1581/3155] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:50 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1472 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:52.742204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-78aa0e3f-4d5e-4d41-ad1d-ed06c1292f6d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:52.767860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3c944053-ee00-4bd6-9d0f-17afb6ea9ede tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:52.769723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3c944053-ee00-4bd6-9d0f-17afb6ea9ede tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:52.789707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78aa0e3f-4d5e-4d41-ad1d-ed06c1292f6d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:52.793304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78aa0e3f-4d5e-4d41-ad1d-ed06c1292f6d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:52.795821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78aa0e3f-4d5e-4d41-ad1d-ed06c1292f6d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:52.798185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78aa0e3f-4d5e-4d41-ad1d-ed06c1292f6d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:52.803961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78aa0e3f-4d5e-4d41-ad1d-ed06c1292f6d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:52.805178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78aa0e3f-4d5e-4d41-ad1d-ed06c1292f6d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:53.134111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3c944053-ee00-4bd6-9d0f-17afb6ea9ede tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:53.169611 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3c944053-ee00-4bd6-9d0f-17afb6ea9ede tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1223 microversion: 2.1 time: 0.429429 Aug 25 13:05:53.178179 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1582/3156] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:52 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1223 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:53.787455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dd1feda8-3c15-4e4b-a6d2-c6dbe78575b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:53.789007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dd1feda8-3c15-4e4b-a6d2-c6dbe78575b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:53.827982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd1feda8-3c15-4e4b-a6d2-c6dbe78575b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:53.829333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd1feda8-3c15-4e4b-a6d2-c6dbe78575b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:53.831421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd1feda8-3c15-4e4b-a6d2-c6dbe78575b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:53.836502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd1feda8-3c15-4e4b-a6d2-c6dbe78575b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:53.838389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd1feda8-3c15-4e4b-a6d2-c6dbe78575b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:53.840612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd1feda8-3c15-4e4b-a6d2-c6dbe78575b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:55.900224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dd1feda8-3c15-4e4b-a6d2-c6dbe78575b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:55.931553 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dd1feda8-3c15-4e4b-a6d2-c6dbe78575b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1472 microversion: 2.1 time: 2.151890 Aug 25 13:05:55.935082 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1583/3157] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:53 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1472 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:55.961425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9af79423-e8e2-4871-b4c3-0d18e8a4febc tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:55.968911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9af79423-e8e2-4871-b4c3-0d18e8a4febc tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:55.998352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9af79423-e8e2-4871-b4c3-0d18e8a4febc tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:55.999539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9af79423-e8e2-4871-b4c3-0d18e8a4febc tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:56.000140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9af79423-e8e2-4871-b4c3-0d18e8a4febc tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:56.001766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9af79423-e8e2-4871-b4c3-0d18e8a4febc tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:56.016004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9af79423-e8e2-4871-b4c3-0d18e8a4febc tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:56.018671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9af79423-e8e2-4871-b4c3-0d18e8a4febc tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:56.133603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-78aa0e3f-4d5e-4d41-ad1d-ed06c1292f6d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:56.196302 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-78aa0e3f-4d5e-4d41-ad1d-ed06c1292f6d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 3.477871 Aug 25 13:05:56.197481 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1575/3158] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:52 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 3488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:56.253800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-058ab4d8-dfd6-4d12-a857-61eebb625131 req-b46e1112-1961-4b66-bac6-0fd5a92cebea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35e2416-c483-461e-a814-a81ef7debcc8", "name": "network-vif-deleted", "tag": "c18cc499-b9cf-4473-b272-3c082e05498b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:56.318876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-058ab4d8-dfd6-4d12-a857-61eebb625131 req-b46e1112-1961-4b66-bac6-0fd5a92cebea service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:56.319991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-058ab4d8-dfd6-4d12-a857-61eebb625131 req-b46e1112-1961-4b66-bac6-0fd5a92cebea service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:56.320830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-058ab4d8-dfd6-4d12-a857-61eebb625131 req-b46e1112-1961-4b66-bac6-0fd5a92cebea service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:56.376110 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-058ab4d8-dfd6-4d12-a857-61eebb625131 req-b46e1112-1961-4b66-bac6-0fd5a92cebea service nova] Creating event network-vif-deleted:c18cc499-b9cf-4473-b272-3c082e05498b for instance a35e2416-c483-461e-a814-a81ef7debcc8 on n-h2-852771-8 Aug 25 13:05:56.420517 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-058ab4d8-dfd6-4d12-a857-61eebb625131 req-b46e1112-1961-4b66-bac6-0fd5a92cebea service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204254 Aug 25 13:05:56.422601 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1576/3159] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:56.446827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-56a038fc-6989-48d2-9415-3fadfdbe0a26 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:56.459683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-56a038fc-6989-48d2-9415-3fadfdbe0a26 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:56.511773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56a038fc-6989-48d2-9415-3fadfdbe0a26 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:56.512523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56a038fc-6989-48d2-9415-3fadfdbe0a26 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:56.513600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56a038fc-6989-48d2-9415-3fadfdbe0a26 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:56.514997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56a038fc-6989-48d2-9415-3fadfdbe0a26 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:56.515918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56a038fc-6989-48d2-9415-3fadfdbe0a26 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:56.516671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56a038fc-6989-48d2-9415-3fadfdbe0a26 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:56.862542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9af79423-e8e2-4871-b4c3-0d18e8a4febc tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:56.892495 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9af79423-e8e2-4871-b4c3-0d18e8a4febc tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1275 microversion: 2.1 time: 0.950799 Aug 25 13:05:56.912247 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1584/3160] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:55 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1275 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:56.979892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:56.980653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:57.008950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:57.009900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:57.012875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:57.017126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:57.018483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:57.019637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:57.167296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:57.168296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:57.168877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:57.169445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lazy-loading 'fault' on Instance uuid a35e2416-c483-461e-a814-a81ef7debcc8 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:05:57.750928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:57.782272 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-18b28017-a242-4004-b403-34c18eddf47e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 200 len: 1306 microversion: 2.1 time: 0.811883 Aug 25 13:05:57.826141 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1585/3161] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:56 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 1306 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:57.939354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4f14cb0f-ef64-4aa4-a4bd-57fb28bb9f31 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:57.940569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4f14cb0f-ef64-4aa4-a4bd-57fb28bb9f31 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:57.962136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f14cb0f-ef64-4aa4-a4bd-57fb28bb9f31 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:57.963373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f14cb0f-ef64-4aa4-a4bd-57fb28bb9f31 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:57.965600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f14cb0f-ef64-4aa4-a4bd-57fb28bb9f31 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:57.967465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f14cb0f-ef64-4aa4-a4bd-57fb28bb9f31 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:57.970116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f14cb0f-ef64-4aa4-a4bd-57fb28bb9f31 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:57.971424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f14cb0f-ef64-4aa4-a4bd-57fb28bb9f31 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.704665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-56a038fc-6989-48d2-9415-3fadfdbe0a26 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:58.748342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4f14cb0f-ef64-4aa4-a4bd-57fb28bb9f31 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:58.759910 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-56a038fc-6989-48d2-9415-3fadfdbe0a26 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.329330 Aug 25 13:05:58.770229 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1577/3162] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:56 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:58.794040 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4f14cb0f-ef64-4aa4-a4bd-57fb28bb9f31 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1281 microversion: 2.1 time: 0.863514 Aug 25 13:05:58.797420 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1586/3163] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:57 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1281 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:58.840390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:58.843820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b2b13704-6bc1-480a-a363-03242421ff9e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-50812899"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:58.854914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: a35e2416-c483-461e-a814-a81ef7debcc8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:58.864455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b2b13704-6bc1-480a-a363-03242421ff9e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:58.885945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2b13704-6bc1-480a-a363-03242421ff9e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.886665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.887660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.888562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.889635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2b13704-6bc1-480a-a363-03242421ff9e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.891049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2b13704-6bc1-480a-a363-03242421ff9e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.893032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2b13704-6bc1-480a-a363-03242421ff9e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.894382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2b13704-6bc1-480a-a363-03242421ff9e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.897144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.898625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.900622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2b13704-6bc1-480a-a363-03242421ff9e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.902495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.982538 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] HTTP exception thrown: Instance a35e2416-c483-461e-a814-a81ef7debcc8 could not be found. Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Request method failure captured: Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 HTTP/1.1 Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3KYheFWQpDMnBWap2dke1KjY2MzTVNN-lZSrvYz_8gtYdnVtMITJ9j8KhUKRnT6ssdJ9Fv54kQkZLhuOhT1Cu0qmHGwrlwuEyuhP6dRhxXMWsJAcpa38Mhv90T5cifKtZVpIIpbWYSzf4UaW41mPFg2SJy1EB6863aMXqzBDlAz89I Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b864a9e1e6b4c2f9552a9e167d71e14", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}] Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a98046249f4e4b8fbe18ed2747d6ed6b Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance a35e2416-c483-461e-a814-a81ef7debcc8 could not be found. Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'a35e2416-c483-461e-a814-a81ef7debcc8'} Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a35e2416-c483-461e-a814-a81ef7debcc8 could not be found. Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a35e2416-c483-461e-a814-a81ef7debcc8 could not be found. Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:58.986156 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:05:58.996599 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:58.996599 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:58.996599 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:58.996599 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:05:58.996599 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:05:58.996599 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a35e2416-c483-461e-a814-a81ef7debcc8 could not be found. Aug 25 13:05:58.996599 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:05:58.996599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Returning 404 to user: Instance a35e2416-c483-461e-a814-a81ef7debcc8 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:05:58.996599 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5096e69-c782-437b-bbd4-15d2f85babf4 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8" status: 404 len: 111 microversion: 2.1 time: 0.157633 Aug 25 13:05:58.999461 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1587/3164] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:58 2022] GET /compute/v2.1/servers/a35e2416-c483-461e-a814-a81ef7debcc8 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:05:59.035965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-812d8b97-a4cf-482a-95fc-48745d30b157 req-97a5b7d2-8826-4789-a7ee-201f035fc0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "tag": "dd23ef5c-d8a0-4337-97d4-d03bd3e7954e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:59.073938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-812d8b97-a4cf-482a-95fc-48745d30b157 req-97a5b7d2-8826-4789-a7ee-201f035fc0cd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.074633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-812d8b97-a4cf-482a-95fc-48745d30b157 req-97a5b7d2-8826-4789-a7ee-201f035fc0cd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.075525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-812d8b97-a4cf-482a-95fc-48745d30b157 req-97a5b7d2-8826-4789-a7ee-201f035fc0cd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:59.133865 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-812d8b97-a4cf-482a-95fc-48745d30b157 req-97a5b7d2-8826-4789-a7ee-201f035fc0cd service nova] Creating event network-changed:dd23ef5c-d8a0-4337-97d4-d03bd3e7954e for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:05:59.149418 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-812d8b97-a4cf-482a-95fc-48745d30b157 req-97a5b7d2-8826-4789-a7ee-201f035fc0cd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133176 Aug 25 13:05:59.154171 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1588/3165] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:59.162813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70962723-7685-415e-a34c-2e92dd8df578 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:59.163366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70962723-7685-415e-a34c-2e92dd8df578 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:59.199037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70962723-7685-415e-a34c-2e92dd8df578 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.199888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70962723-7685-415e-a34c-2e92dd8df578 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.200718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70962723-7685-415e-a34c-2e92dd8df578 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:59.205935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70962723-7685-415e-a34c-2e92dd8df578 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.206996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70962723-7685-415e-a34c-2e92dd8df578 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.208883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70962723-7685-415e-a34c-2e92dd8df578 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:59.314337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70962723-7685-415e-a34c-2e92dd8df578 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:05:59.639612 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70962723-7685-415e-a34c-2e92dd8df578 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "DELETE /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 204 len: 0 microversion: 2.1 time: 0.483521 Aug 25 13:05:59.642644 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1589/3166] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:05:59 2022] DELETE /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:05:59.668356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b83cacfe-71e7-4e2c-bb40-3460b9857a1b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:59.676545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b83cacfe-71e7-4e2c-bb40-3460b9857a1b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:59.697493 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b2b13704-6bc1-480a-a363-03242421ff9e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.882822 Aug 25 13:05:59.700733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b83cacfe-71e7-4e2c-bb40-3460b9857a1b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.711008 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1578/3167] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:58 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 25 13:05:59.725955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b83cacfe-71e7-4e2c-bb40-3460b9857a1b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.727749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b83cacfe-71e7-4e2c-bb40-3460b9857a1b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:59.734982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b83cacfe-71e7-4e2c-bb40-3460b9857a1b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.743898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b83cacfe-71e7-4e2c-bb40-3460b9857a1b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.744725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b83cacfe-71e7-4e2c-bb40-3460b9857a1b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:59.846347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e2b097dc-c31a-4892-b661-186cfbbb8f3a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:59.852309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e2b097dc-c31a-4892-b661-186cfbbb8f3a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:59.881662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2b097dc-c31a-4892-b661-186cfbbb8f3a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.883158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2b097dc-c31a-4892-b661-186cfbbb8f3a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.884283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2b097dc-c31a-4892-b661-186cfbbb8f3a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:59.886110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2b097dc-c31a-4892-b661-186cfbbb8f3a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.887603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2b097dc-c31a-4892-b661-186cfbbb8f3a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.888731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2b097dc-c31a-4892-b661-186cfbbb8f3a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:02.436184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:02.505431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:03.160662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:03.607392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e2b097dc-c31a-4892-b661-186cfbbb8f3a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:03.693545 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e2b097dc-c31a-4892-b661-186cfbbb8f3a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 3.860682 Aug 25 13:06:03.698985 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1579/3168] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:59 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 3871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:04.261085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b83cacfe-71e7-4e2c-bb40-3460b9857a1b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:04.281131 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b83cacfe-71e7-4e2c-bb40-3460b9857a1b tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1472 microversion: 2.1 time: 4.630377 Aug 25 13:06:04.288291 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1590/3169] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:59 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1472 bytes in 4640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:04.748041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c557aa14-8d67-4c77-ac16-be54c5225625 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:04.749273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c557aa14-8d67-4c77-ac16-be54c5225625 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:04.771860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:04.792903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c557aa14-8d67-4c77-ac16-be54c5225625 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:04.794099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c557aa14-8d67-4c77-ac16-be54c5225625 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:04.795259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c557aa14-8d67-4c77-ac16-be54c5225625 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:04.801925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c557aa14-8d67-4c77-ac16-be54c5225625 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:04.806150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c557aa14-8d67-4c77-ac16-be54c5225625 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:04.807490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c557aa14-8d67-4c77-ac16-be54c5225625 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:05.340506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-959ba4e1-45a5-49d3-ac10-f052c0f08120 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:05.347989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-959ba4e1-45a5-49d3-ac10-f052c0f08120 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:05.374950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-959ba4e1-45a5-49d3-ac10-f052c0f08120 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:05.381402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-959ba4e1-45a5-49d3-ac10-f052c0f08120 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:05.383787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-959ba4e1-45a5-49d3-ac10-f052c0f08120 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:05.385266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-959ba4e1-45a5-49d3-ac10-f052c0f08120 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:05.386263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-959ba4e1-45a5-49d3-ac10-f052c0f08120 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:05.387062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-959ba4e1-45a5-49d3-ac10-f052c0f08120 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:05.934932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c557aa14-8d67-4c77-ac16-be54c5225625 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:05.968912 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c557aa14-8d67-4c77-ac16-be54c5225625 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.231581 Aug 25 13:06:05.975987 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1580/3170] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:04 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:07.023780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a03c4793-1790-4347-bb34-c809d0ce6406 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:07.028225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a03c4793-1790-4347-bb34-c809d0ce6406 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:07.086163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a03c4793-1790-4347-bb34-c809d0ce6406 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:07.087847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a03c4793-1790-4347-bb34-c809d0ce6406 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:07.088714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a03c4793-1790-4347-bb34-c809d0ce6406 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:07.097095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a03c4793-1790-4347-bb34-c809d0ce6406 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:07.099281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a03c4793-1790-4347-bb34-c809d0ce6406 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:07.103722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a03c4793-1790-4347-bb34-c809d0ce6406 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:07.863710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-959ba4e1-45a5-49d3-ac10-f052c0f08120 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:07.914093 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-959ba4e1-45a5-49d3-ac10-f052c0f08120 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1472 microversion: 2.1 time: 2.580385 Aug 25 13:06:07.917043 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1591/3171] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:05 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1472 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:08.749167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-960131ae-dbb1-4885-a225-9cca10197d06 req-e589882e-d82d-4fb1-b9a0-2888da44d0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d5dd89-fdf8-45cf-9f02-fd21356777cd", "tag": "7b6e4795-8e73-494f-ac2b-b80687f601b2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:08.795751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-960131ae-dbb1-4885-a225-9cca10197d06 req-e589882e-d82d-4fb1-b9a0-2888da44d0e6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:08.796741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-960131ae-dbb1-4885-a225-9cca10197d06 req-e589882e-d82d-4fb1-b9a0-2888da44d0e6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:08.797639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-960131ae-dbb1-4885-a225-9cca10197d06 req-e589882e-d82d-4fb1-b9a0-2888da44d0e6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:08.837942 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-960131ae-dbb1-4885-a225-9cca10197d06 req-e589882e-d82d-4fb1-b9a0-2888da44d0e6 service nova] Creating event network-changed:7b6e4795-8e73-494f-ac2b-b80687f601b2 for instance c3d5dd89-fdf8-45cf-9f02-fd21356777cd on n-h1-852771-8 Aug 25 13:06:08.852876 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-960131ae-dbb1-4885-a225-9cca10197d06 req-e589882e-d82d-4fb1-b9a0-2888da44d0e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.932474 Aug 25 13:06:08.857838 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1592/3172] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:08.869135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a03c4793-1790-4347-bb34-c809d0ce6406 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:08.931150 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a03c4793-1790-4347-bb34-c809d0ce6406 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.910369 Aug 25 13:06:08.931478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-7119fbdf-124c-444e-86a5-c42a27f0257f req-1cd4fa03-874a-4a34-bfa0-88c03468e2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232ef74e-cf0e-48a4-bcef-40ba42bff597", "name": "network-vif-deleted", "tag": "9821267d-e9f4-4ac5-bbc2-badbc3cdda86"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:08.977419 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1581/3173] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:07 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:08.991950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-41c3853a-6915-4313-858c-8efc782af2c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:08.993132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-41c3853a-6915-4313-858c-8efc782af2c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:09.010227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7119fbdf-124c-444e-86a5-c42a27f0257f req-1cd4fa03-874a-4a34-bfa0-88c03468e2c7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:09.010624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41c3853a-6915-4313-858c-8efc782af2c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:09.011197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41c3853a-6915-4313-858c-8efc782af2c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:09.012417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41c3853a-6915-4313-858c-8efc782af2c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:09.012713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7119fbdf-124c-444e-86a5-c42a27f0257f req-1cd4fa03-874a-4a34-bfa0-88c03468e2c7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:09.013469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7119fbdf-124c-444e-86a5-c42a27f0257f req-1cd4fa03-874a-4a34-bfa0-88c03468e2c7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:09.015002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41c3853a-6915-4313-858c-8efc782af2c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:09.016217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41c3853a-6915-4313-858c-8efc782af2c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:09.017373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41c3853a-6915-4313-858c-8efc782af2c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:09.049032 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-7119fbdf-124c-444e-86a5-c42a27f0257f req-1cd4fa03-874a-4a34-bfa0-88c03468e2c7 service nova] Creating event network-vif-deleted:9821267d-e9f4-4ac5-bbc2-badbc3cdda86 for instance 232ef74e-cf0e-48a4-bcef-40ba42bff597 on n-h1-852771-8 Aug 25 13:06:09.090214 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-7119fbdf-124c-444e-86a5-c42a27f0257f req-1cd4fa03-874a-4a34-bfa0-88c03468e2c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182969 Aug 25 13:06:09.092865 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1593/3174] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:09.352250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-41c3853a-6915-4313-858c-8efc782af2c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:09.439949 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-41c3853a-6915-4313-858c-8efc782af2c8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1301 microversion: 2.1 time: 0.459985 Aug 25 13:06:09.441254 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1582/3175] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:08 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1301 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:09.995623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-321ada65-eec0-4a6d-9bf6-9bc9c0cff9bb tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:10.002182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-321ada65-eec0-4a6d-9bf6-9bc9c0cff9bb tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:10.048018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-321ada65-eec0-4a6d-9bf6-9bc9c0cff9bb tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:10.048906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-321ada65-eec0-4a6d-9bf6-9bc9c0cff9bb tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:10.055523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-321ada65-eec0-4a6d-9bf6-9bc9c0cff9bb tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:10.059017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-321ada65-eec0-4a6d-9bf6-9bc9c0cff9bb tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:10.061560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-321ada65-eec0-4a6d-9bf6-9bc9c0cff9bb tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:10.064004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-321ada65-eec0-4a6d-9bf6-9bc9c0cff9bb tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:10.504462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:10.509938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:10.569907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:10.575323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:10.578828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:10.581003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:10.582202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:10.583898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:10.747604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:10.748584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:10.752220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:10.753541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lazy-loading 'fault' on Instance uuid 232ef74e-cf0e-48a4-bcef-40ba42bff597 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:06:11.019332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:11.050328 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-af91f9d8-e685-440c-a7cf-13a97405b664 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 200 len: 1306 microversion: 2.1 time: 0.570060 Aug 25 13:06:11.072168 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1583/3176] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:10 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 1306 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:11.383080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-321ada65-eec0-4a6d-9bf6-9bc9c0cff9bb tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:11.415958 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-321ada65-eec0-4a6d-9bf6-9bc9c0cff9bb tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.433803 Aug 25 13:06:11.433341 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1594/3177] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:09 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:12.100302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:12.105544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 232ef74e-cf0e-48a4-bcef-40ba42bff597] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:12.137783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:12.138651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:12.139491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:12.140853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:12.141778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:12.142676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:12.191314 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] HTTP exception thrown: Instance 232ef74e-cf0e-48a4-bcef-40ba42bff597 could not be found. Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Request method failure captured: Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 HTTP/1.1 Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3KYheFWQpDMnBWap2dke1KjY2MzTVNN-lZSrvYz_8gtYdnVtMITJ9j8KhUKRnT6ssdJ9Fv54kQkZLhuOhT1Cu0qmHGwrlwuEyuhP6dRhxXMWsJAcpa38Mhv90T5cifKtZVpIIpbWYSzf4UaW41mPFg2SJy1EB6863aMXqzBDlAz89I Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b864a9e1e6b4c2f9552a9e167d71e14", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}] Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a98046249f4e4b8fbe18ed2747d6ed6b Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 232ef74e-cf0e-48a4-bcef-40ba42bff597 could not be found. Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '232ef74e-cf0e-48a4-bcef-40ba42bff597'} Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 232ef74e-cf0e-48a4-bcef-40ba42bff597 could not be found. Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 232ef74e-cf0e-48a4-bcef-40ba42bff597 could not be found. Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:12.196992 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:12.212243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:12.212243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:12.212243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:12.212243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:12.212243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:12.212243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 232ef74e-cf0e-48a4-bcef-40ba42bff597 could not be found. Aug 25 13:06:12.212243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:12.212243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Returning 404 to user: Instance 232ef74e-cf0e-48a4-bcef-40ba42bff597 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:12.215791 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44ed47ec-07af-4cb0-8e1a-90b0e4af0586 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597" status: 404 len: 111 microversion: 2.1 time: 0.124462 Aug 25 13:06:12.224355 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1584/3178] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:12 2022] GET /compute/v2.1/servers/232ef74e-cf0e-48a4-bcef-40ba42bff597 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:12.244753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-57a3560f-bbe8-4e3c-b58a-b64726e62ec7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:12.246100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-57a3560f-bbe8-4e3c-b58a-b64726e62ec7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:12.293590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a3560f-bbe8-4e3c-b58a-b64726e62ec7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:12.293590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a3560f-bbe8-4e3c-b58a-b64726e62ec7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:12.294344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a3560f-bbe8-4e3c-b58a-b64726e62ec7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:12.304697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a3560f-bbe8-4e3c-b58a-b64726e62ec7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:12.308772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a3560f-bbe8-4e3c-b58a-b64726e62ec7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:12.312612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a3560f-bbe8-4e3c-b58a-b64726e62ec7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:12.469431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-57a3560f-bbe8-4e3c-b58a-b64726e62ec7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:06:12.472209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a4aac75-d7f1-4927-95a0-1b53acaadc89 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:12.474257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a4aac75-d7f1-4927-95a0-1b53acaadc89 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:12.496716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4aac75-d7f1-4927-95a0-1b53acaadc89 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:12.503187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4aac75-d7f1-4927-95a0-1b53acaadc89 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:12.504642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4aac75-d7f1-4927-95a0-1b53acaadc89 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:12.508146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4aac75-d7f1-4927-95a0-1b53acaadc89 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:12.510614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4aac75-d7f1-4927-95a0-1b53acaadc89 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:12.514423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4aac75-d7f1-4927-95a0-1b53acaadc89 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:12.858198 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-57a3560f-bbe8-4e3c-b58a-b64726e62ec7 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "DELETE /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 204 len: 0 microversion: 2.1 time: 0.631941 Aug 25 13:06:12.860257 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1595/3179] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:12 2022] DELETE /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:12.885109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-09d2968e-32e0-4f1b-b180-883ef85040bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:12.886826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-09d2968e-32e0-4f1b-b180-883ef85040bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:12.917631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d2968e-32e0-4f1b-b180-883ef85040bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:12.918422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d2968e-32e0-4f1b-b180-883ef85040bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:12.919221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d2968e-32e0-4f1b-b180-883ef85040bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:12.920551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d2968e-32e0-4f1b-b180-883ef85040bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:12.921413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d2968e-32e0-4f1b-b180-883ef85040bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:12.922209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d2968e-32e0-4f1b-b180-883ef85040bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:13.015729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:13.699073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a4aac75-d7f1-4927-95a0-1b53acaadc89 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:13.734381 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a4aac75-d7f1-4927-95a0-1b53acaadc89 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.274026 Aug 25 13:06:13.735545 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1585/3180] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:12 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:13.870198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-09d2968e-32e0-4f1b-b180-883ef85040bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:13.912977 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-09d2968e-32e0-4f1b-b180-883ef85040bc tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1472 microversion: 2.1 time: 1.043328 Aug 25 13:06:13.919354 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1596/3181] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:12 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1472 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:14.788433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9d8a9e87-d0db-4d07-a754-520573ae316e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:14.792106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9d8a9e87-d0db-4d07-a754-520573ae316e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:14.827089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d8a9e87-d0db-4d07-a754-520573ae316e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:14.828005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d8a9e87-d0db-4d07-a754-520573ae316e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:14.828833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d8a9e87-d0db-4d07-a754-520573ae316e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:14.830363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d8a9e87-d0db-4d07-a754-520573ae316e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:14.831187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d8a9e87-d0db-4d07-a754-520573ae316e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:14.831881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d8a9e87-d0db-4d07-a754-520573ae316e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:14.962293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-87d19a9a-7fbd-43c3-b798-505962b50b7d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:14.984569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-87d19a9a-7fbd-43c3-b798-505962b50b7d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:15.029567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87d19a9a-7fbd-43c3-b798-505962b50b7d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:15.038941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87d19a9a-7fbd-43c3-b798-505962b50b7d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:15.041565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87d19a9a-7fbd-43c3-b798-505962b50b7d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:15.044662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87d19a9a-7fbd-43c3-b798-505962b50b7d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:15.049696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87d19a9a-7fbd-43c3-b798-505962b50b7d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:15.052136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87d19a9a-7fbd-43c3-b798-505962b50b7d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:16.601385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9d8a9e87-d0db-4d07-a754-520573ae316e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:16.636980 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9d8a9e87-d0db-4d07-a754-520573ae316e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.858557 Aug 25 13:06:16.645258 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1586/3182] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:14 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:17.268024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-87d19a9a-7fbd-43c3-b798-505962b50b7d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:17.340317 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-87d19a9a-7fbd-43c3-b798-505962b50b7d tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1472 microversion: 2.1 time: 2.387048 Aug 25 13:06:17.342738 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1597/3183] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:14 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1472 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:17.695351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-61322473-e064-4413-89a4-999b66618b0a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:17.700580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-61322473-e064-4413-89a4-999b66618b0a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:17.753666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ef18847b-0172-47b2-a2af-1bbf309831d3 req-68a108ba-8d80-4d42-a827-795184b9cada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b4b807-bb57-49f1-bce8-6267ce7f6b63", "name": "network-vif-deleted", "tag": "56eca57d-dec8-464e-92c2-d15ebfe3657f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:17.792956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61322473-e064-4413-89a4-999b66618b0a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:17.796009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61322473-e064-4413-89a4-999b66618b0a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:17.798993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61322473-e064-4413-89a4-999b66618b0a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:17.807736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61322473-e064-4413-89a4-999b66618b0a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:17.810574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61322473-e064-4413-89a4-999b66618b0a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:17.813552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61322473-e064-4413-89a4-999b66618b0a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:17.846776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ef18847b-0172-47b2-a2af-1bbf309831d3 req-68a108ba-8d80-4d42-a827-795184b9cada service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:17.851388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ef18847b-0172-47b2-a2af-1bbf309831d3 req-68a108ba-8d80-4d42-a827-795184b9cada service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:17.853021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ef18847b-0172-47b2-a2af-1bbf309831d3 req-68a108ba-8d80-4d42-a827-795184b9cada service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:17.922979 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ef18847b-0172-47b2-a2af-1bbf309831d3 req-68a108ba-8d80-4d42-a827-795184b9cada service nova] Creating event network-vif-deleted:56eca57d-dec8-464e-92c2-d15ebfe3657f for instance 82b4b807-bb57-49f1-bce8-6267ce7f6b63 on n-h1-852771-8 Aug 25 13:06:17.970731 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ef18847b-0172-47b2-a2af-1bbf309831d3 req-68a108ba-8d80-4d42-a827-795184b9cada service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.443357 Aug 25 13:06:17.982157 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1587/3184] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:18.391273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:18.397697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:18.430653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:18.431923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:18.433037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:18.441816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:18.446106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:18.447461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:18.630980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:18.632646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:18.633827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:18.634971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lazy-loading 'fault' on Instance uuid 82b4b807-bb57-49f1-bce8-6267ce7f6b63 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:06:19.045582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:19.089005 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fbedd909-6987-4fab-b895-08e519686f7c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 200 len: 1306 microversion: 2.1 time: 0.702820 Aug 25 13:06:19.091728 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1588/3185] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:18 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 1306 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:19.252467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-61322473-e064-4413-89a4-999b66618b0a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:19.290755 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-61322473-e064-4413-89a4-999b66618b0a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.603174 Aug 25 13:06:19.309696 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1598/3186] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:17 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:20.146095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:20.148730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 82b4b807-bb57-49f1-bce8-6267ce7f6b63] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:20.226126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:20.231757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:20.241544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:20.244081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:20.246008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:20.252676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:20.348312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dbea8728-7b64-4c25-80e1-8c0e19dd54ce tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:20.362230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dbea8728-7b64-4c25-80e1-8c0e19dd54ce tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:20.389937 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] HTTP exception thrown: Instance 82b4b807-bb57-49f1-bce8-6267ce7f6b63 could not be found. Aug 25 13:06:20.400022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Request method failure captured: Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 HTTP/1.1 Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3KYheFWQpDMnBWap2dke1KjY2MzTVNN-lZSrvYz_8gtYdnVtMITJ9j8KhUKRnT6ssdJ9Fv54kQkZLhuOhT1Cu0qmHGwrlwuEyuhP6dRhxXMWsJAcpa38Mhv90T5cifKtZVpIIpbWYSzf4UaW41mPFg2SJy1EB6863aMXqzBDlAz89I Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b864a9e1e6b4c2f9552a9e167d71e14", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}] Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a98046249f4e4b8fbe18ed2747d6ed6b Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 82b4b807-bb57-49f1-bce8-6267ce7f6b63 could not be found. Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '82b4b807-bb57-49f1-bce8-6267ce7f6b63'} Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b4b807-bb57-49f1-bce8-6267ce7f6b63 could not be found. Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b4b807-bb57-49f1-bce8-6267ce7f6b63 could not be found. Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:20.403715 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:20.413045 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:20.413045 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:20.413045 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:20.413045 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:20.413045 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:20.413045 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b4b807-bb57-49f1-bce8-6267ce7f6b63 could not be found. Aug 25 13:06:20.413045 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:20.415099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Returning 404 to user: Instance 82b4b807-bb57-49f1-bce8-6267ce7f6b63 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:20.419907 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72dfe5ec-b827-4aee-ab2e-c1047a59006c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63" status: 404 len: 111 microversion: 2.1 time: 0.285217 Aug 25 13:06:20.427419 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1589/3187] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:20 2022] GET /compute/v2.1/servers/82b4b807-bb57-49f1-bce8-6267ce7f6b63 => generated 111 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:20.428745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbea8728-7b64-4c25-80e1-8c0e19dd54ce tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:20.429688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbea8728-7b64-4c25-80e1-8c0e19dd54ce tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:20.430528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbea8728-7b64-4c25-80e1-8c0e19dd54ce tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:20.437958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbea8728-7b64-4c25-80e1-8c0e19dd54ce tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:20.438171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbea8728-7b64-4c25-80e1-8c0e19dd54ce tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:20.438867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbea8728-7b64-4c25-80e1-8c0e19dd54ce tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:20.454175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4ac31a51-f928-45ec-8588-2b176a5cc6cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:20.455664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4ac31a51-f928-45ec-8588-2b176a5cc6cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: c9221961-b954-4113-b962-f35e65e91f36] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:20.476332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ac31a51-f928-45ec-8588-2b176a5cc6cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:20.490586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ac31a51-f928-45ec-8588-2b176a5cc6cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:20.496825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ac31a51-f928-45ec-8588-2b176a5cc6cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:20.499295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ac31a51-f928-45ec-8588-2b176a5cc6cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:20.500821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ac31a51-f928-45ec-8588-2b176a5cc6cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:20.504012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ac31a51-f928-45ec-8588-2b176a5cc6cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:20.639596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4ac31a51-f928-45ec-8588-2b176a5cc6cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: c9221961-b954-4113-b962-f35e65e91f36] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:06:20.822803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:20.979694 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4ac31a51-f928-45ec-8588-2b176a5cc6cf tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36" status: 204 len: 0 microversion: 2.1 time: 0.541757 Aug 25 13:06:20.986958 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1590/3188] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:20 2022] DELETE /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:06:21.017220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3a6171c7-616a-4e72-89ae-8a4ba24c25b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:21.021943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3a6171c7-616a-4e72-89ae-8a4ba24c25b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:21.056235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a6171c7-616a-4e72-89ae-8a4ba24c25b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:21.058434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a6171c7-616a-4e72-89ae-8a4ba24c25b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:21.064012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a6171c7-616a-4e72-89ae-8a4ba24c25b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:21.066521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a6171c7-616a-4e72-89ae-8a4ba24c25b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:21.067720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a6171c7-616a-4e72-89ae-8a4ba24c25b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:21.071899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a6171c7-616a-4e72-89ae-8a4ba24c25b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:21.195769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3a6171c7-616a-4e72-89ae-8a4ba24c25b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:06:21.621574 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3a6171c7-616a-4e72-89ae-8a4ba24c25b1 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 204 len: 0 microversion: 2.1 time: 0.626065 Aug 25 13:06:21.627398 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1591/3189] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:20 2022] DELETE /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:21.647957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-12d3b74b-492b-4abf-8fda-61a5e7d84b47 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:21.649907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-12d3b74b-492b-4abf-8fda-61a5e7d84b47 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: c9221961-b954-4113-b962-f35e65e91f36] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:21.678008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12d3b74b-492b-4abf-8fda-61a5e7d84b47 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:21.683950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12d3b74b-492b-4abf-8fda-61a5e7d84b47 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:21.685145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12d3b74b-492b-4abf-8fda-61a5e7d84b47 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:21.688402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12d3b74b-492b-4abf-8fda-61a5e7d84b47 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:21.689456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12d3b74b-492b-4abf-8fda-61a5e7d84b47 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:21.691479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12d3b74b-492b-4abf-8fda-61a5e7d84b47 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:21.797561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dbea8728-7b64-4c25-80e1-8c0e19dd54ce tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:21.863019 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dbea8728-7b64-4c25-80e1-8c0e19dd54ce tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.519057 Aug 25 13:06:21.879117 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1599/3190] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:20 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:22.676798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-12d3b74b-492b-4abf-8fda-61a5e7d84b47 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:22.752052 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-12d3b74b-492b-4abf-8fda-61a5e7d84b47 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36" status: 200 len: 1475 microversion: 2.1 time: 1.106244 Aug 25 13:06:22.756106 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1592/3191] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:21 2022] GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36 => generated 1475 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:22.921840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c2514a5d-3ddb-4fc8-a271-5b299f24eba3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:22.925013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c2514a5d-3ddb-4fc8-a271-5b299f24eba3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:22.968065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2514a5d-3ddb-4fc8-a271-5b299f24eba3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:22.972882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2514a5d-3ddb-4fc8-a271-5b299f24eba3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:22.977272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2514a5d-3ddb-4fc8-a271-5b299f24eba3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:22.980443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2514a5d-3ddb-4fc8-a271-5b299f24eba3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:22.993669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2514a5d-3ddb-4fc8-a271-5b299f24eba3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:23.013398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2514a5d-3ddb-4fc8-a271-5b299f24eba3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:23.807584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c2514a5d-3ddb-4fc8-a271-5b299f24eba3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:23.823015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cb2b4f8a-0799-4b5f-a776-a2d1dfc0cb3c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:23.824390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cb2b4f8a-0799-4b5f-a776-a2d1dfc0cb3c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: c9221961-b954-4113-b962-f35e65e91f36] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:23.846280 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c2514a5d-3ddb-4fc8-a271-5b299f24eba3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 0.940239 Aug 25 13:06:23.870333 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1600/3192] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:22 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:23.872389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb2b4f8a-0799-4b5f-a776-a2d1dfc0cb3c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:23.887058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb2b4f8a-0799-4b5f-a776-a2d1dfc0cb3c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:23.888480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb2b4f8a-0799-4b5f-a776-a2d1dfc0cb3c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:23.891707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb2b4f8a-0799-4b5f-a776-a2d1dfc0cb3c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:23.893396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb2b4f8a-0799-4b5f-a776-a2d1dfc0cb3c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:23.895601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb2b4f8a-0799-4b5f-a776-a2d1dfc0cb3c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:24.096333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4913affb-f532-4aa9-b409-f4696e467c02 req-248406d9-48e6-4b5f-be9d-58f71ceda18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3eccca-1677-409a-bcf9-99d321525b2b", "name": "network-vif-plugged", "status": "completed", "tag": "4d308beb-5849-4af8-9677-9649024147e8"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:24.142009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4913affb-f532-4aa9-b409-f4696e467c02 req-248406d9-48e6-4b5f-be9d-58f71ceda18c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:24.143123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4913affb-f532-4aa9-b409-f4696e467c02 req-248406d9-48e6-4b5f-be9d-58f71ceda18c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:24.144048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4913affb-f532-4aa9-b409-f4696e467c02 req-248406d9-48e6-4b5f-be9d-58f71ceda18c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:24.178617 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4913affb-f532-4aa9-b409-f4696e467c02 req-248406d9-48e6-4b5f-be9d-58f71ceda18c service nova] Creating event network-vif-plugged:4d308beb-5849-4af8-9677-9649024147e8 for instance fe3eccca-1677-409a-bcf9-99d321525b2b on n-h2-852771-8 Aug 25 13:06:24.211100 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4913affb-f532-4aa9-b409-f4696e467c02 req-248406d9-48e6-4b5f-be9d-58f71ceda18c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129200 Aug 25 13:06:24.224038 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1601/3193] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:24.912934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1db92224-ce48-4b0a-b260-d916e25c5a5d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:24.916839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1db92224-ce48-4b0a-b260-d916e25c5a5d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:24.934962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1db92224-ce48-4b0a-b260-d916e25c5a5d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:24.935463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1db92224-ce48-4b0a-b260-d916e25c5a5d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:24.938485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1db92224-ce48-4b0a-b260-d916e25c5a5d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:24.945166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1db92224-ce48-4b0a-b260-d916e25c5a5d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:24.946155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1db92224-ce48-4b0a-b260-d916e25c5a5d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:24.946873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1db92224-ce48-4b0a-b260-d916e25c5a5d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:26.431267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1db92224-ce48-4b0a-b260-d916e25c5a5d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:26.510906 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1db92224-ce48-4b0a-b260-d916e25c5a5d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.606050 Aug 25 13:06:26.518821 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1602/3194] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:24 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:26.868784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c03ecf3d-577b-4ac0-845d-46a26dc165d7 req-f7bc92e7-fb38-4dee-b9e5-e4485fdf955a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9221961-b954-4113-b962-f35e65e91f36", "name": "network-vif-deleted", "tag": "0ab2e9a6-9dec-4ada-8adc-c03de8b4fa09"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:26.984455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c03ecf3d-577b-4ac0-845d-46a26dc165d7 req-f7bc92e7-fb38-4dee-b9e5-e4485fdf955a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:26.989227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c03ecf3d-577b-4ac0-845d-46a26dc165d7 req-f7bc92e7-fb38-4dee-b9e5-e4485fdf955a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:26.995798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cb2b4f8a-0799-4b5f-a776-a2d1dfc0cb3c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:26.996747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c03ecf3d-577b-4ac0-845d-46a26dc165d7 req-f7bc92e7-fb38-4dee-b9e5-e4485fdf955a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:27.015736 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cb2b4f8a-0799-4b5f-a776-a2d1dfc0cb3c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36" status: 200 len: 1475 microversion: 2.1 time: 3.214340 Aug 25 13:06:27.017917 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1593/3195] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:23 2022] GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36 => generated 1475 bytes in 3218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:27.097370 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c03ecf3d-577b-4ac0-845d-46a26dc165d7 req-f7bc92e7-fb38-4dee-b9e5-e4485fdf955a service nova] Creating event network-vif-deleted:0ab2e9a6-9dec-4ada-8adc-c03de8b4fa09 for instance c9221961-b954-4113-b962-f35e65e91f36 on n-h2-852771-8 Aug 25 13:06:27.124701 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c03ecf3d-577b-4ac0-845d-46a26dc165d7 req-f7bc92e7-fb38-4dee-b9e5-e4485fdf955a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278224 Aug 25 13:06:27.128873 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1603/3196] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:27.564948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-32b62efd-8e57-4b41-a7d2-4b862b90d655 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:27.567004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-32b62efd-8e57-4b41-a7d2-4b862b90d655 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:27.640543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32b62efd-8e57-4b41-a7d2-4b862b90d655 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:27.641592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32b62efd-8e57-4b41-a7d2-4b862b90d655 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:27.642437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32b62efd-8e57-4b41-a7d2-4b862b90d655 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:27.643819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32b62efd-8e57-4b41-a7d2-4b862b90d655 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:27.644697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32b62efd-8e57-4b41-a7d2-4b862b90d655 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:27.645568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-32b62efd-8e57-4b41-a7d2-4b862b90d655 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.084759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:28.093271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: c9221961-b954-4113-b962-f35e65e91f36] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:28.137315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.139303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.140839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.143894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.145674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.147261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.478665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.488658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.490390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.496333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lazy-loading 'fault' on Instance uuid c9221961-b954-4113-b962-f35e65e91f36 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:06:28.828530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:28.913701 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a69f08f9-fe4d-4ce5-8b44-6fef97d6500a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36" status: 200 len: 1309 microversion: 2.1 time: 0.853264 Aug 25 13:06:28.923372 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1604/3197] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:28 2022] GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36 => generated 1309 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:28.956533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8a686b84-72b3-407c-9f12-a76bd13ebb19 req-9e028950-447f-46ec-bd0a-a4dca1ba6dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a97f70b-4323-4b49-b4dc-fa5c78170ae9", "name": "network-vif-deleted", "tag": "0a9a7acf-80db-4e80-a571-b66bd271a714"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:28.997832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8a686b84-72b3-407c-9f12-a76bd13ebb19 req-9e028950-447f-46ec-bd0a-a4dca1ba6dd4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.999499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8a686b84-72b3-407c-9f12-a76bd13ebb19 req-9e028950-447f-46ec-bd0a-a4dca1ba6dd4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:29.006450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8a686b84-72b3-407c-9f12-a76bd13ebb19 req-9e028950-447f-46ec-bd0a-a4dca1ba6dd4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:29.082675 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8a686b84-72b3-407c-9f12-a76bd13ebb19 req-9e028950-447f-46ec-bd0a-a4dca1ba6dd4 service nova] Creating event network-vif-deleted:0a9a7acf-80db-4e80-a571-b66bd271a714 for instance 5a97f70b-4323-4b49-b4dc-fa5c78170ae9 on n-h1-852771-8 Aug 25 13:06:29.101715 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8a686b84-72b3-407c-9f12-a76bd13ebb19 req-9e028950-447f-46ec-bd0a-a4dca1ba6dd4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172427 Aug 25 13:06:29.112029 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1605/3198] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:29.364758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-32b62efd-8e57-4b41-a7d2-4b862b90d655 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:29.408142 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-32b62efd-8e57-4b41-a7d2-4b862b90d655 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.851004 Aug 25 13:06:29.431755 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1594/3199] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:27 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:29.987479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:29.991257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: c9221961-b954-4113-b962-f35e65e91f36] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:30.026706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.043217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.044358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.045928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.047150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.049769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.145042 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] HTTP exception thrown: Instance c9221961-b954-4113-b962-f35e65e91f36 could not be found. Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Request method failure captured: Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36 HTTP/1.1 Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3KYheFWQpDMnBWap2dke1KjY2MzTVNN-lZSrvYz_8gtYdnVtMITJ9j8KhUKRnT6ssdJ9Fv54kQkZLhuOhT1Cu0qmHGwrlwuEyuhP6dRhxXMWsJAcpa38Mhv90T5cifKtZVpIIpbWYSzf4UaW41mPFg2SJy1EB6863aMXqzBDlAz89I Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b864a9e1e6b4c2f9552a9e167d71e14", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}] Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a98046249f4e4b8fbe18ed2747d6ed6b Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance c9221961-b954-4113-b962-f35e65e91f36 could not be found. Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'c9221961-b954-4113-b962-f35e65e91f36'} Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9221961-b954-4113-b962-f35e65e91f36 could not be found. Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9221961-b954-4113-b962-f35e65e91f36 could not be found. Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:30.151320 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:30.165849 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:30.165849 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:30.165849 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:30.165849 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:30.165849 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:30.165849 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9221961-b954-4113-b962-f35e65e91f36 could not be found. Aug 25 13:06:30.165849 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:30.165849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Returning 404 to user: Instance c9221961-b954-4113-b962-f35e65e91f36 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:30.165849 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7eaa762e-08cf-4e51-a8d6-cc535058cdbb tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36" status: 404 len: 111 microversion: 2.1 time: 0.188416 Aug 25 13:06:30.165849 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1606/3200] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:29 2022] GET /compute/v2.1/servers/c9221961-b954-4113-b962-f35e65e91f36 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:30.183815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:30.186114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 5a97f70b-4323-4b49-b4dc-fa5c78170ae9] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:30.210208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.212061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.213616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.215433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.216754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.218655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.325239 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] HTTP exception thrown: Instance 5a97f70b-4323-4b49-b4dc-fa5c78170ae9 could not be found. Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Request method failure captured: Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 HTTP/1.1 Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3KYheFWQpDMnBWap2dke1KjY2MzTVNN-lZSrvYz_8gtYdnVtMITJ9j8KhUKRnT6ssdJ9Fv54kQkZLhuOhT1Cu0qmHGwrlwuEyuhP6dRhxXMWsJAcpa38Mhv90T5cifKtZVpIIpbWYSzf4UaW41mPFg2SJy1EB6863aMXqzBDlAz89I Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b864a9e1e6b4c2f9552a9e167d71e14", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}] Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a98046249f4e4b8fbe18ed2747d6ed6b Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 5a97f70b-4323-4b49-b4dc-fa5c78170ae9 could not be found. Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '5a97f70b-4323-4b49-b4dc-fa5c78170ae9'} Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a97f70b-4323-4b49-b4dc-fa5c78170ae9 could not be found. Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a97f70b-4323-4b49-b4dc-fa5c78170ae9 could not be found. Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:30.346868 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:30.358093 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:30.358093 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:30.358093 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:30.358093 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:30.358093 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:30.358093 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a97f70b-4323-4b49-b4dc-fa5c78170ae9 could not be found. Aug 25 13:06:30.358093 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:30.366937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Returning 404 to user: Instance 5a97f70b-4323-4b49-b4dc-fa5c78170ae9 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:30.375228 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-34927111-dccd-47c4-90fa-4ba4e4b304c2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9" status: 404 len: 111 microversion: 2.1 time: 0.204572 Aug 25 13:06:30.387857 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1595/3201] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:30 2022] GET /compute/v2.1/servers/5a97f70b-4323-4b49-b4dc-fa5c78170ae9 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:30.410745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cd029779-56fe-405e-8599-ba6bb203f392 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:30.466598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3a29f078-0816-4040-9d18-7cc6c5065a08 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:30.475695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3a29f078-0816-4040-9d18-7cc6c5065a08 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:30.505917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a29f078-0816-4040-9d18-7cc6c5065a08 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.512124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a29f078-0816-4040-9d18-7cc6c5065a08 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.515329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a29f078-0816-4040-9d18-7cc6c5065a08 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.518748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a29f078-0816-4040-9d18-7cc6c5065a08 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.523358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a29f078-0816-4040-9d18-7cc6c5065a08 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.525094 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cd029779-56fe-405e-8599-ba6bb203f392 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/50550a82-1963-47e3-a5ff-1df9ddff4278" status: 204 len: 0 microversion: 2.1 time: 0.130271 Aug 25 13:06:30.526879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a29f078-0816-4040-9d18-7cc6c5065a08 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.531920 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1607/3202] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:30 2022] DELETE /compute/v2.1/os-server-groups/50550a82-1963-47e3-a5ff-1df9ddff4278 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:06:30.552799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-36c6b392-85f4-4dba-9461-c60f849b5738 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:30.556908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-36c6b392-85f4-4dba-9461-c60f849b5738 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 1eaf403a-3a50-4864-845c-340bf0a70683] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:30.592868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36c6b392-85f4-4dba-9461-c60f849b5738 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.594505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36c6b392-85f4-4dba-9461-c60f849b5738 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.595744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36c6b392-85f4-4dba-9461-c60f849b5738 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.599917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36c6b392-85f4-4dba-9461-c60f849b5738 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.605411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36c6b392-85f4-4dba-9461-c60f849b5738 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.606777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-36c6b392-85f4-4dba-9461-c60f849b5738 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.743080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-36c6b392-85f4-4dba-9461-c60f849b5738 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 1eaf403a-3a50-4864-845c-340bf0a70683] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:06:31.120618 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-36c6b392-85f4-4dba-9461-c60f849b5738 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683" status: 204 len: 0 microversion: 2.1 time: 0.584043 Aug 25 13:06:31.122575 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1608/3203] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:30 2022] DELETE /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:06:31.149130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6c364bb8-8a26-4439-9d95-29ba7b2cbe1a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:31.156435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6c364bb8-8a26-4439-9d95-29ba7b2cbe1a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:31.188085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c364bb8-8a26-4439-9d95-29ba7b2cbe1a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:31.189198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c364bb8-8a26-4439-9d95-29ba7b2cbe1a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:31.191866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c364bb8-8a26-4439-9d95-29ba7b2cbe1a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:31.198611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c364bb8-8a26-4439-9d95-29ba7b2cbe1a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:31.199998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c364bb8-8a26-4439-9d95-29ba7b2cbe1a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:31.201301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c364bb8-8a26-4439-9d95-29ba7b2cbe1a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:31.305428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6c364bb8-8a26-4439-9d95-29ba7b2cbe1a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:06:31.730677 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6c364bb8-8a26-4439-9d95-29ba7b2cbe1a tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 204 len: 0 microversion: 2.1 time: 0.573625 Aug 25 13:06:31.739026 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1609/3204] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:31 2022] DELETE /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:31.782418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3a29f078-0816-4040-9d18-7cc6c5065a08 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:31.800305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6963b5b-1c48-47d9-ab9d-34405f4bc10c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:31.811756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c6963b5b-1c48-47d9-ab9d-34405f4bc10c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 1eaf403a-3a50-4864-845c-340bf0a70683] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:31.834339 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3a29f078-0816-4040-9d18-7cc6c5065a08 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.375680 Aug 25 13:06:31.844876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6963b5b-1c48-47d9-ab9d-34405f4bc10c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:31.857624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6963b5b-1c48-47d9-ab9d-34405f4bc10c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:31.857624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6963b5b-1c48-47d9-ab9d-34405f4bc10c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:31.858158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6963b5b-1c48-47d9-ab9d-34405f4bc10c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:31.859395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6963b5b-1c48-47d9-ab9d-34405f4bc10c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:31.860337 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1596/3205] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:30 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:31.869597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6963b5b-1c48-47d9-ab9d-34405f4bc10c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:32.894287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-94433f05-858b-4ad3-8dae-72f6c021709a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:32.910190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-94433f05-858b-4ad3-8dae-72f6c021709a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:32.979251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94433f05-858b-4ad3-8dae-72f6c021709a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:32.980109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94433f05-858b-4ad3-8dae-72f6c021709a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:32.991925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94433f05-858b-4ad3-8dae-72f6c021709a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:32.993570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94433f05-858b-4ad3-8dae-72f6c021709a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:33.011382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94433f05-858b-4ad3-8dae-72f6c021709a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:33.016778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94433f05-858b-4ad3-8dae-72f6c021709a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:34.316464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c6963b5b-1c48-47d9-ab9d-34405f4bc10c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:34.357732 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6963b5b-1c48-47d9-ab9d-34405f4bc10c tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683" status: 200 len: 1473 microversion: 2.1 time: 2.598761 Aug 25 13:06:34.359336 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1610/3206] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:31 2022] GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683 => generated 1473 bytes in 2614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:35.404977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c59c736d-6379-4745-98cd-e1c8be3cdc8e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:35.406726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c59c736d-6379-4745-98cd-e1c8be3cdc8e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 1eaf403a-3a50-4864-845c-340bf0a70683] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:35.452632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c59c736d-6379-4745-98cd-e1c8be3cdc8e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:35.458869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c59c736d-6379-4745-98cd-e1c8be3cdc8e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:35.460392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c59c736d-6379-4745-98cd-e1c8be3cdc8e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:35.462426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c59c736d-6379-4745-98cd-e1c8be3cdc8e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:35.469896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c59c736d-6379-4745-98cd-e1c8be3cdc8e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:35.471397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c59c736d-6379-4745-98cd-e1c8be3cdc8e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:35.814338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-94433f05-858b-4ad3-8dae-72f6c021709a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:35.884430 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-94433f05-858b-4ad3-8dae-72f6c021709a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 2.994650 Aug 25 13:06:35.889232 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1597/3207] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:32 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 3009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:36.481789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1755873198", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "aeb70bcf-5e49-4907-a868-82f35331b05a"}, {"uuid": "11da043f-68f7-4557-a028-4e1a8495a609"}, {"uuid": "aeb70bcf-5e49-4907-a868-82f35331b05a"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:36.546764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:36.888083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] validate_networks() for [('aeb70bcf-5e49-4907-a868-82f35331b05a', None, None, None, None, None), ('11da043f-68f7-4557-a028-4e1a8495a609', None, None, None, None, None), ('aeb70bcf-5e49-4907-a868-82f35331b05a', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:06:38.748856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c59c736d-6379-4745-98cd-e1c8be3cdc8e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:38.806121 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c59c736d-6379-4745-98cd-e1c8be3cdc8e tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683" status: 200 len: 1473 microversion: 2.1 time: 3.410850 Aug 25 13:06:38.827036 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1611/3208] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:35 2022] GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683 => generated 1473 bytes in 3416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:38.876050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-30471df7-30a9-4a84-9b9d-6b3bc0e77e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:38.878166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-30471df7-30a9-4a84-9b9d-6b3bc0e77e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:38.934054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30471df7-30a9-4a84-9b9d-6b3bc0e77e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:38.939247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30471df7-30a9-4a84-9b9d-6b3bc0e77e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:38.941115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30471df7-30a9-4a84-9b9d-6b3bc0e77e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:38.943816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30471df7-30a9-4a84-9b9d-6b3bc0e77e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:38.960169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30471df7-30a9-4a84-9b9d-6b3bc0e77e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:38.985631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30471df7-30a9-4a84-9b9d-6b3bc0e77e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:41.429303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-30471df7-30a9-4a84-9b9d-6b3bc0e77e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:41.463263 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-30471df7-30a9-4a84-9b9d-6b3bc0e77e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 2.631455 Aug 25 13:06:41.498071 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1612/3209] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:38 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 2669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:41.538562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-239872a7-40dd-43af-9bbd-93c590618408 req-39ed769f-f00d-4335-ac0f-74b67af76ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b109be4f-78d3-4756-baad-da4d207af9d6", "name": "network-vif-deleted", "tag": "b1739094-bd39-4996-a2e1-43a8b97c716f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:41.649096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-239872a7-40dd-43af-9bbd-93c590618408 req-39ed769f-f00d-4335-ac0f-74b67af76ae2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:41.658056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-239872a7-40dd-43af-9bbd-93c590618408 req-39ed769f-f00d-4335-ac0f-74b67af76ae2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:41.659285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-239872a7-40dd-43af-9bbd-93c590618408 req-39ed769f-f00d-4335-ac0f-74b67af76ae2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:41.668908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:41.756210 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-239872a7-40dd-43af-9bbd-93c590618408 req-39ed769f-f00d-4335-ac0f-74b67af76ae2 service nova] Creating event network-vif-deleted:b1739094-bd39-4996-a2e1-43a8b97c716f for instance b109be4f-78d3-4756-baad-da4d207af9d6 on n-h2-852771-8 Aug 25 13:06:41.769010 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-239872a7-40dd-43af-9bbd-93c590618408 req-39ed769f-f00d-4335-ac0f-74b67af76ae2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267812 Aug 25 13:06:41.771817 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1613/3210] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:41.782701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-51c3cf97-890d-4a85-9137-a4d4b73c4310 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:41.785773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-51c3cf97-890d-4a85-9137-a4d4b73c4310 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 1eaf403a-3a50-4864-845c-340bf0a70683] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:41.803706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51c3cf97-890d-4a85-9137-a4d4b73c4310 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:41.812663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51c3cf97-890d-4a85-9137-a4d4b73c4310 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:41.813979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51c3cf97-890d-4a85-9137-a4d4b73c4310 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:41.815703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51c3cf97-890d-4a85-9137-a4d4b73c4310 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:41.816992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51c3cf97-890d-4a85-9137-a4d4b73c4310 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:41.819630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51c3cf97-890d-4a85-9137-a4d4b73c4310 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:42.191333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-51c3cf97-890d-4a85-9137-a4d4b73c4310 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:42.236787 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-51c3cf97-890d-4a85-9137-a4d4b73c4310 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683" status: 200 len: 1431 microversion: 2.1 time: 0.462298 Aug 25 13:06:42.246368 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1614/3211] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:41 2022] GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683 => generated 1431 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:42.291329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f3e372ac-fde4-469a-ae09-e545395bb7db req-9380f106-2b15-41e3-9af0-c03462693c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaf403a-3a50-4864-845c-340bf0a70683", "name": "network-vif-deleted", "tag": "b5ebb407-44f3-4334-8a0d-f16b9fd1b1a0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:42.353486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f3e372ac-fde4-469a-ae09-e545395bb7db req-9380f106-2b15-41e3-9af0-c03462693c82 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:42.357043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f3e372ac-fde4-469a-ae09-e545395bb7db req-9380f106-2b15-41e3-9af0-c03462693c82 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:42.359900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f3e372ac-fde4-469a-ae09-e545395bb7db req-9380f106-2b15-41e3-9af0-c03462693c82 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:42.447661 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f3e372ac-fde4-469a-ae09-e545395bb7db req-9380f106-2b15-41e3-9af0-c03462693c82 service nova] Creating event network-vif-deleted:b5ebb407-44f3-4334-8a0d-f16b9fd1b1a0 for instance 1eaf403a-3a50-4864-845c-340bf0a70683 on n-h2-852771-8 Aug 25 13:06:42.513846 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f3e372ac-fde4-469a-ae09-e545395bb7db req-9380f106-2b15-41e3-9af0-c03462693c82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245645 Aug 25 13:06:42.517365 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1615/3212] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:42.549908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d5b16a1-dd07-43b3-af50-003f6091b151 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:42.554996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9d5b16a1-dd07-43b3-af50-003f6091b151 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:42.590859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d5b16a1-dd07-43b3-af50-003f6091b151 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:42.606094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d5b16a1-dd07-43b3-af50-003f6091b151 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:42.618361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d5b16a1-dd07-43b3-af50-003f6091b151 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:42.631747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d5b16a1-dd07-43b3-af50-003f6091b151 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:42.634649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d5b16a1-dd07-43b3-af50-003f6091b151 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:42.637985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d5b16a1-dd07-43b3-af50-003f6091b151 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:44.763346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d5b16a1-dd07-43b3-af50-003f6091b151 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:44.834643 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d5b16a1-dd07-43b3-af50-003f6091b151 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 2.304123 Aug 25 13:06:44.847734 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1616/3213] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:42 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:44.881209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:44.883012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 1eaf403a-3a50-4864-845c-340bf0a70683] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:44.929563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:44.939140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:44.945859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:44.970899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:44.972809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:44.976239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:45.073324 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] HTTP exception thrown: Instance 1eaf403a-3a50-4864-845c-340bf0a70683 could not be found. Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Request method failure captured: Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683 HTTP/1.1 Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3KYheFWQpDMnBWap2dke1KjY2MzTVNN-lZSrvYz_8gtYdnVtMITJ9j8KhUKRnT6ssdJ9Fv54kQkZLhuOhT1Cu0qmHGwrlwuEyuhP6dRhxXMWsJAcpa38Mhv90T5cifKtZVpIIpbWYSzf4UaW41mPFg2SJy1EB6863aMXqzBDlAz89I Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b864a9e1e6b4c2f9552a9e167d71e14", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}] Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a98046249f4e4b8fbe18ed2747d6ed6b Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 1eaf403a-3a50-4864-845c-340bf0a70683 could not be found. Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '1eaf403a-3a50-4864-845c-340bf0a70683'} Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eaf403a-3a50-4864-845c-340bf0a70683 could not be found. Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eaf403a-3a50-4864-845c-340bf0a70683 could not be found. Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:45.077459 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:45.103943 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:45.103943 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:45.103943 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:45.103943 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:45.103943 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:45.103943 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eaf403a-3a50-4864-845c-340bf0a70683 could not be found. Aug 25 13:06:45.103943 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:45.103943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Returning 404 to user: Instance 1eaf403a-3a50-4864-845c-340bf0a70683 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:45.103943 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3bc41560-41c4-4f70-8097-cb50776848ed tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683" status: 404 len: 111 microversion: 2.1 time: 0.229140 Aug 25 13:06:45.103943 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1617/3214] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:44 2022] GET /compute/v2.1/servers/1eaf403a-3a50-4864-845c-340bf0a70683 => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:45.108425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:45.108425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: b109be4f-78d3-4756-baad-da4d207af9d6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:45.158581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:45.159460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:45.160241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:45.161712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:45.162937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:45.163762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:45.276390 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] HTTP exception thrown: Instance b109be4f-78d3-4756-baad-da4d207af9d6 could not be found. Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Request method failure captured: Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 HTTP/1.1 Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3KYheFWQpDMnBWap2dke1KjY2MzTVNN-lZSrvYz_8gtYdnVtMITJ9j8KhUKRnT6ssdJ9Fv54kQkZLhuOhT1Cu0qmHGwrlwuEyuhP6dRhxXMWsJAcpa38Mhv90T5cifKtZVpIIpbWYSzf4UaW41mPFg2SJy1EB6863aMXqzBDlAz89I Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b864a9e1e6b4c2f9552a9e167d71e14", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}] Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a98046249f4e4b8fbe18ed2747d6ed6b Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b109be4f-78d3-4756-baad-da4d207af9d6 could not be found. Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b109be4f-78d3-4756-baad-da4d207af9d6'} Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b109be4f-78d3-4756-baad-da4d207af9d6 could not be found. Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b109be4f-78d3-4756-baad-da4d207af9d6 could not be found. Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:45.294301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:45.304205 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:45.304205 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:45.304205 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:45.304205 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:45.304205 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:45.304205 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b109be4f-78d3-4756-baad-da4d207af9d6 could not be found. Aug 25 13:06:45.304205 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:45.304205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Returning 404 to user: Instance b109be4f-78d3-4756-baad-da4d207af9d6 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:45.306378 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66bd7fe5-3075-4ba2-9912-6d3903d95999 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6" status: 404 len: 111 microversion: 2.1 time: 0.202015 Aug 25 13:06:45.314257 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1618/3215] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:45 2022] GET /compute/v2.1/servers/b109be4f-78d3-4756-baad-da4d207af9d6 => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:45.331946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0af2356a-f78f-45c9-a4c8-653249a34992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:45.437009 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0af2356a-f78f-45c9-a4c8-653249a34992 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/ad9da14b-a14d-4fbb-8c0f-d848b3ab02d8" status: 204 len: 0 microversion: 2.1 time: 0.120028 Aug 25 13:06:45.450501 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1619/3216] 10.222.0.70 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:45 2022] DELETE /compute/v2.1/os-server-groups/ad9da14b-a14d-4fbb-8c0f-d848b3ab02d8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:45.504801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9831ab90-72fb-4b32-a391-bd0d2e6ddb92 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:45.512310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9831ab90-72fb-4b32-a391-bd0d2e6ddb92 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:45.560041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9831ab90-72fb-4b32-a391-bd0d2e6ddb92 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:45.573416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9831ab90-72fb-4b32-a391-bd0d2e6ddb92 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:45.578936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9831ab90-72fb-4b32-a391-bd0d2e6ddb92 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:45.584017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9831ab90-72fb-4b32-a391-bd0d2e6ddb92 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:45.586701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9831ab90-72fb-4b32-a391-bd0d2e6ddb92 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:45.588201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9831ab90-72fb-4b32-a391-bd0d2e6ddb92 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:45.822132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:45.872409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9831ab90-72fb-4b32-a391-bd0d2e6ddb92 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:06:46.484370 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9831ab90-72fb-4b32-a391-bd0d2e6ddb92 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "DELETE /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 204 len: 0 microversion: 2.1 time: 1.026130 Aug 25 13:06:46.485500 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1620/3217] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:45 2022] DELETE /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 0 bytes in 1029 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:46.510403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a0a9dd05-cf99-4139-a6de-e5b4cb3ac67e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:46.512384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a0a9dd05-cf99-4139-a6de-e5b4cb3ac67e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:46.528761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0a9dd05-cf99-4139-a6de-e5b4cb3ac67e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:46.530323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0a9dd05-cf99-4139-a6de-e5b4cb3ac67e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:46.532027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0a9dd05-cf99-4139-a6de-e5b4cb3ac67e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:46.533933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0a9dd05-cf99-4139-a6de-e5b4cb3ac67e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:46.535368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0a9dd05-cf99-4139-a6de-e5b4cb3ac67e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:46.537470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0a9dd05-cf99-4139-a6de-e5b4cb3ac67e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:46.617821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:46.945466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:06:46.948080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:06:46.949479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:06:46.951011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:06:46.952142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:06:46.993864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:46.997819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:46.999136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.002118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.007145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.013936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.100190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Getting quotas for project d45cd11baec04239813f9d36160ec4ac. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:47.136557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Getting quotas for user a6404bb298fe405c8d2b782c83544a58 and project d45cd11baec04239813f9d36160ec4ac. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:47.189810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:06:47.193481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:06:47.408768 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-425606d8-3f9f-4b9b-bd96-32a84079cf3e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.935340 Aug 25 13:06:47.422093 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1598/3218] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 10950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:06:47.431778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7aabf8fc-33c3-442a-8ff7-a565ba0c6d78 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:47.440367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7aabf8fc-33c3-442a-8ff7-a565ba0c6d78 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:47.477361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aabf8fc-33c3-442a-8ff7-a565ba0c6d78 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.478805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aabf8fc-33c3-442a-8ff7-a565ba0c6d78 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.479919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aabf8fc-33c3-442a-8ff7-a565ba0c6d78 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.481634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aabf8fc-33c3-442a-8ff7-a565ba0c6d78 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.482888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aabf8fc-33c3-442a-8ff7-a565ba0c6d78 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.484420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aabf8fc-33c3-442a-8ff7-a565ba0c6d78 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:48.241706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a0a9dd05-cf99-4139-a6de-e5b4cb3ac67e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:48.290550 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a0a9dd05-cf99-4139-a6de-e5b4cb3ac67e tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.801257 Aug 25 13:06:48.311699 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1621/3219] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:46 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:48.355662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-77a36610-53b7-4234-9268-326c1e65ecb3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:48.358035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-77a36610-53b7-4234-9268-326c1e65ecb3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:49.013963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77a36610-53b7-4234-9268-326c1e65ecb3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:49.045048 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-77a36610-53b7-4234-9268-326c1e65ecb3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1213 microversion: 2.1 time: 0.722878 Aug 25 13:06:49.055092 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1622/3220] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:48 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1213 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:49.070771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:49.077422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:49.102334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7aabf8fc-33c3-442a-8ff7-a565ba0c6d78 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:49.111428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:49.112360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:49.113209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:49.118453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:49.126150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:49.128930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:49.179191 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7aabf8fc-33c3-442a-8ff7-a565ba0c6d78 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1472 microversion: 2.1 time: 1.742720 Aug 25 13:06:49.183983 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1599/3221] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:47 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1472 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:49.234074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c6b425b7-231e-4ec1-ba26-c7f57a4b75c1 req-5c15a25c-2f8e-4530-81ef-19e8507fe0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d5dd89-fdf8-45cf-9f02-fd21356777cd", "name": "network-vif-plugged", "status": "completed", "tag": "7b6e4795-8e73-494f-ac2b-b80687f601b2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:49.355105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c6b425b7-231e-4ec1-ba26-c7f57a4b75c1 req-5c15a25c-2f8e-4530-81ef-19e8507fe0c9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:49.365106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c6b425b7-231e-4ec1-ba26-c7f57a4b75c1 req-5c15a25c-2f8e-4530-81ef-19e8507fe0c9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:49.367711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c6b425b7-231e-4ec1-ba26-c7f57a4b75c1 req-5c15a25c-2f8e-4530-81ef-19e8507fe0c9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:49.481406 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c6b425b7-231e-4ec1-ba26-c7f57a4b75c1 req-5c15a25c-2f8e-4530-81ef-19e8507fe0c9 service nova] Creating event network-vif-plugged:7b6e4795-8e73-494f-ac2b-b80687f601b2 for instance c3d5dd89-fdf8-45cf-9f02-fd21356777cd on n-h1-852771-8 Aug 25 13:06:49.556382 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c6b425b7-231e-4ec1-ba26-c7f57a4b75c1 req-5c15a25c-2f8e-4530-81ef-19e8507fe0c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.358986 Aug 25 13:06:49.560596 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1600/3222] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:49.578309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5fb712e7-cfec-4180-bac1-ae0229985538 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:49.579951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5fb712e7-cfec-4180-bac1-ae0229985538 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:49.602520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb712e7-cfec-4180-bac1-ae0229985538 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:49.604052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb712e7-cfec-4180-bac1-ae0229985538 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:49.610190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb712e7-cfec-4180-bac1-ae0229985538 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:49.612515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb712e7-cfec-4180-bac1-ae0229985538 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:49.616181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb712e7-cfec-4180-bac1-ae0229985538 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:49.618065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb712e7-cfec-4180-bac1-ae0229985538 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:50.631524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5fb712e7-cfec-4180-bac1-ae0229985538 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:50.674199 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5fb712e7-cfec-4180-bac1-ae0229985538 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1323 microversion: 2.1 time: 1.114116 Aug 25 13:06:50.677418 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1601/3223] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:49 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1323 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:50.711785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5aae0a2f-ec82-4494-a519-d39eeb066616 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:50.715402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5aae0a2f-ec82-4494-a519-d39eeb066616 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:50.746111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aae0a2f-ec82-4494-a519-d39eeb066616 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:50.755066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aae0a2f-ec82-4494-a519-d39eeb066616 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:50.756478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aae0a2f-ec82-4494-a519-d39eeb066616 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:50.759609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aae0a2f-ec82-4494-a519-d39eeb066616 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:50.761088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aae0a2f-ec82-4494-a519-d39eeb066616 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:50.769195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aae0a2f-ec82-4494-a519-d39eeb066616 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:51.251019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:51.297426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:51.311291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:51.326986 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-576f37f0-d8d9-4a8e-8b79-d2d018e3281d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 2949 microversion: 2.42 time: 2.269804 Aug 25 13:06:51.345244 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1623/3224] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:49 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 2949 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:51.422679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f9c4fba-6e6f-4399-a819-fcf4725c733f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:51.430179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3f9c4fba-6e6f-4399-a819-fcf4725c733f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:51.458047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5aae0a2f-ec82-4494-a519-d39eeb066616 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:51.476159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=6,nova_api:UPDATE=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:51.513194 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5aae0a2f-ec82-4494-a519-d39eeb066616 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1209 microversion: 2.1 time: 0.831498 Aug 25 13:06:51.531139 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1602/3225] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:50 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1209 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:51.557667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f2534374-eb5f-412e-aa4c-bde9619f8509 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:51.560762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f9c4fba-6e6f-4399-a819-fcf4725c733f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:51.560762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f9c4fba-6e6f-4399-a819-fcf4725c733f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:51.566452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f9c4fba-6e6f-4399-a819-fcf4725c733f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:51.566792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f2534374-eb5f-412e-aa4c-bde9619f8509 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:51.568762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f9c4fba-6e6f-4399-a819-fcf4725c733f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:51.569220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f9c4fba-6e6f-4399-a819-fcf4725c733f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:51.593741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f9c4fba-6e6f-4399-a819-fcf4725c733f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:51.633284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2534374-eb5f-412e-aa4c-bde9619f8509 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:51.635741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2534374-eb5f-412e-aa4c-bde9619f8509 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:51.639072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2534374-eb5f-412e-aa4c-bde9619f8509 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:51.669534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2534374-eb5f-412e-aa4c-bde9619f8509 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:51.675580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2534374-eb5f-412e-aa4c-bde9619f8509 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:51.677229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2534374-eb5f-412e-aa4c-bde9619f8509 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:52.817487 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f2534374-eb5f-412e-aa4c-bde9619f8509 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a/os-interface" status: 200 len: 1831 microversion: 2.42 time: 1.283342 Aug 25 13:06:52.820643 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1603/3226] 10.222.0.70 () {60 vars in 1316 bytes} [Thu Aug 25 13:06:51 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a/os-interface => generated 1831 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:52.843256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0e336186-e2ab-4b3c-b34d-503c40d805b0 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:52.846727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0e336186-e2ab-4b3c-b34d-503c40d805b0 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:52.892454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e336186-e2ab-4b3c-b34d-503c40d805b0 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:52.897265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e336186-e2ab-4b3c-b34d-503c40d805b0 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:52.905280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e336186-e2ab-4b3c-b34d-503c40d805b0 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:52.907409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e336186-e2ab-4b3c-b34d-503c40d805b0 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:52.909352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e336186-e2ab-4b3c-b34d-503c40d805b0 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:52.912476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e336186-e2ab-4b3c-b34d-503c40d805b0 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:52.974936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f9c4fba-6e6f-4399-a819-fcf4725c733f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:53.041113 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f9c4fba-6e6f-4399-a819-fcf4725c733f tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1472 microversion: 2.1 time: 1.675102 Aug 25 13:06:53.046873 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1624/3227] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:51 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1472 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:53.080580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-87b468d4-c6a4-468e-9152-431e9a34ab70 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:53.085807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-87b468d4-c6a4-468e-9152-431e9a34ab70 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:53.104036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87b468d4-c6a4-468e-9152-431e9a34ab70 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:53.105162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87b468d4-c6a4-468e-9152-431e9a34ab70 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:53.106360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87b468d4-c6a4-468e-9152-431e9a34ab70 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:53.109869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87b468d4-c6a4-468e-9152-431e9a34ab70 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:53.111167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87b468d4-c6a4-468e-9152-431e9a34ab70 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:53.112650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87b468d4-c6a4-468e-9152-431e9a34ab70 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:53.453760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-87b468d4-c6a4-468e-9152-431e9a34ab70 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:53.500151 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-87b468d4-c6a4-468e-9152-431e9a34ab70 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1271 microversion: 2.1 time: 0.449067 Aug 25 13:06:53.516989 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1625/3228] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:53 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1271 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:53.908441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0e336186-e2ab-4b3c-b34d-503c40d805b0 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:53.960054 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0e336186-e2ab-4b3c-b34d-503c40d805b0 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1518 microversion: 2.1 time: 1.133515 Aug 25 13:06:53.964778 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1604/3229] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:52 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1518 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:54.099593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f60169db-e83c-47bf-9043-73778a042ea8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:54.100948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f60169db-e83c-47bf-9043-73778a042ea8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:54.151897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f60169db-e83c-47bf-9043-73778a042ea8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:54.175661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f60169db-e83c-47bf-9043-73778a042ea8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:54.183992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f60169db-e83c-47bf-9043-73778a042ea8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:54.195005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f60169db-e83c-47bf-9043-73778a042ea8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:54.198876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f60169db-e83c-47bf-9043-73778a042ea8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:54.201970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f60169db-e83c-47bf-9043-73778a042ea8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:54.463693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-893a03fb-3b45-4d54-bd37-ce29e8aa6815 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-898469813", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-893a03fb-3b45-4d54-bd37-ce29e8aa6815 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Request method failure captured: Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 242 Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3OozjgOjdIjjGDFYlcToSesXNgc44r68DG0y1MZj_bVB7VIM9yk8FXOIJTcHHnjMJjaDPGKkhMlr_2UPhlMoxeXwmBhq5FWm356G-oCXaQ4O-ELmNqJZ4vGUxRiA4swytVap7-kUUzFlgbakySzVrndf59jiNLX7IAhg5fIW07Gz6k Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cb30d93b30ac4a8a9caa759b49182412", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}] Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 4946d6cd1da64db3b3c845cffac626e3 Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-898469813", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-898469813', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'd43beb4c-f709-43d3-b78d-aab45a4a0953'}]}}} Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:54.535347 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.545316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-893a03fb-3b45-4d54-bd37-ce29e8aa6815 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:54.552216 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-893a03fb-3b45-4d54-bd37-ce29e8aa6815 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.111291 Aug 25 13:06:54.564645 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1605/3230] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:06:54 2022] POST /compute/v2.1/servers => generated 175 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:06:54.581370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8c71e1fb-6fae-4922-95dc-7e2ab2741d75 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:54.597571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8c71e1fb-6fae-4922-95dc-7e2ab2741d75 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:54.633550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c71e1fb-6fae-4922-95dc-7e2ab2741d75 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:54.635398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c71e1fb-6fae-4922-95dc-7e2ab2741d75 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:54.641642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c71e1fb-6fae-4922-95dc-7e2ab2741d75 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:54.643131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c71e1fb-6fae-4922-95dc-7e2ab2741d75 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:54.644325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c71e1fb-6fae-4922-95dc-7e2ab2741d75 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:54.644899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c71e1fb-6fae-4922-95dc-7e2ab2741d75 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:54.753995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f60169db-e83c-47bf-9043-73778a042ea8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:54.802252 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f60169db-e83c-47bf-9043-73778a042ea8 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1430 microversion: 2.1 time: 0.702430 Aug 25 13:06:54.810056 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1626/3231] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:54 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1430 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:54.854419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2de0f823-083f-454f-9a94-482fbad09ea6 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:54.855405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2de0f823-083f-454f-9a94-482fbad09ea6 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: 34a2067e-0f5e-471c-ae4d-295261c4c4e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:54.896004 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-2de0f823-083f-454f-9a94-482fbad09ea6 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] HTTP exception thrown: Instance 34a2067e-0f5e-471c-ae4d-295261c4c4e2 could not be found. Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2de0f823-083f-454f-9a94-482fbad09ea6 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Request method failure captured: Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/34a2067e-0f5e-471c-ae4d-295261c4c4e2/metadata HTTP/1.1 Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3OozjgOjdIjjGDFYlcToSesXNgc44r68DG0y1MZj_bVB7VIM9yk8FXOIJTcHHnjMJjaDPGKkhMlr_2UPhlMoxeXwmBhq5FWm356G-oCXaQ4O-ELmNqJZ4vGUxRiA4swytVap7-kUUzFlgbakySzVrndf59jiNLX7IAhg5fIW07Gz6k Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cb30d93b30ac4a8a9caa759b49182412", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}] Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 4946d6cd1da64db3b3c845cffac626e3 Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 34a2067e-0f5e-471c-ae4d-295261c4c4e2 could not be found. Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': '34a2067e-0f5e-471c-ae4d-295261c4c4e2'} Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a2067e-0f5e-471c-ae4d-295261c4c4e2 could not be found. Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a2067e-0f5e-471c-ae4d-295261c4c4e2 could not be found. Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:54.938544 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:54.956238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:54.956238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:54.956238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a2067e-0f5e-471c-ae4d-295261c4c4e2 could not be found. Aug 25 13:06:54.956238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:54.958342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2de0f823-083f-454f-9a94-482fbad09ea6 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Returning 404 to user: Instance 34a2067e-0f5e-471c-ae4d-295261c4c4e2 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:54.961247 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2de0f823-083f-454f-9a94-482fbad09ea6 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/34a2067e-0f5e-471c-ae4d-295261c4c4e2/metadata" status: 404 len: 111 microversion: 2.1 time: 0.148174 Aug 25 13:06:55.001630 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1627/3232] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 13:06:54 2022] GET /compute/v2.1/servers/34a2067e-0f5e-471c-ae4d-295261c4c4e2/metadata => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:55.036046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b4bf7307-85ee-4d94-bfc0-c61101223b8a req-65005a53-9c8f-4d02-82dc-fae2dd6098a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c46524-70ff-4c0a-9fce-afaacf9d2ba5", "name": "network-vif-deleted", "tag": "b79d7cd8-5914-4ce2-9c72-b63b5435b25c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:55.074707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8c71e1fb-6fae-4922-95dc-7e2ab2741d75 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:55.133826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b4bf7307-85ee-4d94-bfc0-c61101223b8a req-65005a53-9c8f-4d02-82dc-fae2dd6098a0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:55.139139 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8c71e1fb-6fae-4922-95dc-7e2ab2741d75 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1271 microversion: 2.1 time: 0.571995 Aug 25 13:06:55.140830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b4bf7307-85ee-4d94-bfc0-c61101223b8a req-65005a53-9c8f-4d02-82dc-fae2dd6098a0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:55.143775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b4bf7307-85ee-4d94-bfc0-c61101223b8a req-65005a53-9c8f-4d02-82dc-fae2dd6098a0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:55.151720 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1606/3233] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:54 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1271 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:55.279569 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b4bf7307-85ee-4d94-bfc0-c61101223b8a req-65005a53-9c8f-4d02-82dc-fae2dd6098a0 service nova] Creating event network-vif-deleted:b79d7cd8-5914-4ce2-9c72-b63b5435b25c for instance 34c46524-70ff-4c0a-9fce-afaacf9d2ba5 on n-h2-852771-8 Aug 25 13:06:55.335235 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b4bf7307-85ee-4d94-bfc0-c61101223b8a req-65005a53-9c8f-4d02-82dc-fae2dd6098a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321788 Aug 25 13:06:55.347522 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1628/3234] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:55.363711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d86c2f39-1532-4b03-a868-45ff21b86268 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-891803685", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d86c2f39-1532-4b03-a868-45ff21b86268 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Request method failure captured: Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 498 Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3OozjgOjdIjjGDFYlcToSesXNgc44r68DG0y1MZj_bVB7VIM9yk8FXOIJTcHHnjMJjaDPGKkhMlr_2UPhlMoxeXwmBhq5FWm356G-oCXaQ4O-ELmNqJZ4vGUxRiA4swytVap7-kUUzFlgbakySzVrndf59jiNLX7IAhg5fIW07Gz6k Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cb30d93b30ac4a8a9caa759b49182412", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}] Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 4946d6cd1da64db3b3c845cffac626e3 Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-891803685", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-891803685', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd43beb4c-f709-43d3-b78d-aab45a4a0953'}]}}} Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 13:06:55.384016 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.390730 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.399239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d86c2f39-1532-4b03-a868-45ff21b86268 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:55.401584 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d86c2f39-1532-4b03-a868-45ff21b86268 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.070243 Aug 25 13:06:55.403940 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1607/3235] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:06:55 2022] POST /compute/v2.1/servers => generated 687 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:06:55.632122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f2035cfb-b056-4824-8acb-ad9a58ccf2fa tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-421883735", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f2035cfb-b056-4824-8acb-ad9a58ccf2fa tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Request method failure captured: Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 499 Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3OozjgOjdIjjGDFYlcToSesXNgc44r68DG0y1MZj_bVB7VIM9yk8FXOIJTcHHnjMJjaDPGKkhMlr_2UPhlMoxeXwmBhq5FWm356G-oCXaQ4O-ELmNqJZ4vGUxRiA4swytVap7-kUUzFlgbakySzVrndf59jiNLX7IAhg5fIW07Gz6k Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cb30d93b30ac4a8a9caa759b49182412", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}] Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 4946d6cd1da64db3b3c845cffac626e3 Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-421883735", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-421883735', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd43beb4c-f709-43d3-b78d-aab45a4a0953'}]}}} Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 13:06:55.671283 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.678428 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.689277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f2035cfb-b056-4824-8acb-ad9a58ccf2fa tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:55.691970 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f2035cfb-b056-4824-8acb-ad9a58ccf2fa tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.082210 Aug 25 13:06:55.695611 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1629/3236] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:06:55 2022] POST /compute/v2.1/servers => generated 689 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:06:55.838747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-98c8461a-2557-4753-a24b-40cdfd8f63dd tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1193274580", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:55.866481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:55.869136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-98c8461a-2557-4753-a24b-40cdfd8f63dd tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Request method failure captured: Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 754 Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3OozjgOjdIjjGDFYlcToSesXNgc44r68DG0y1MZj_bVB7VIM9yk8FXOIJTcHHnjMJjaDPGKkhMlr_2UPhlMoxeXwmBhq5FWm356G-oCXaQ4O-ELmNqJZ4vGUxRiA4swytVap7-kUUzFlgbakySzVrndf59jiNLX7IAhg5fIW07Gz6k Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cb30d93b30ac4a8a9caa759b49182412", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}] Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 4946d6cd1da64db3b3c845cffac626e3 Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1193274580", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1193274580', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd43beb4c-f709-43d3-b78d-aab45a4a0953'}]}}} Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:06:55.901671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:06:55.914165 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:06:55.925807 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:55.925807 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:55.932835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-98c8461a-2557-4753-a24b-40cdfd8f63dd tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:55.937753 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-98c8461a-2557-4753-a24b-40cdfd8f63dd tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.109962 Aug 25 13:06:55.938887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:55.942323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:55.945694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:55.946669 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1608/3237] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:06:55 2022] POST /compute/v2.1/servers => generated 1197 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 25 13:06:55.950138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:55.951696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:55.952989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:56.103699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:56.105465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:56.107528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:56.110103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lazy-loading 'fault' on Instance uuid 34c46524-70ff-4c0a-9fce-afaacf9d2ba5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:06:56.166673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e47bb34c-da99-40e4-bab3-d5e50869424a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-305198258", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e47bb34c-da99-40e4-bab3-d5e50869424a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Request method failure captured: Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 1265 Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3OozjgOjdIjjGDFYlcToSesXNgc44r68DG0y1MZj_bVB7VIM9yk8FXOIJTcHHnjMJjaDPGKkhMlr_2UPhlMoxeXwmBhq5FWm356G-oCXaQ4O-ELmNqJZ4vGUxRiA4swytVap7-kUUzFlgbakySzVrndf59jiNLX7IAhg5fIW07Gz6k Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cb30d93b30ac4a8a9caa759b49182412", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}] Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 4946d6cd1da64db3b3c845cffac626e3 Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-305198258", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d43beb4c-f709-43d3-b78d-aab45a4a0953"}]}} Aug 25 13:06:56.190735 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-305198258', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd43beb4c-f709-43d3-b78d-aab45a4a0953'}]}}} Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.196836 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:06:56.198220 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:06:56.211636 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 13:06:56.211636 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.215034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e47bb34c-da99-40e4-bab3-d5e50869424a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:56.217003 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e47bb34c-da99-40e4-bab3-d5e50869424a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.065926 Aug 25 13:06:56.218477 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1609/3238] 10.222.0.70 () {60 vars in 1148 bytes} [Thu Aug 25 13:06:56 2022] POST /compute/v2.1/servers => generated 2221 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 25 13:06:56.230137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3b5757dc-5a09-4d6a-be9f-685f0169848a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:56.231574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3b5757dc-5a09-4d6a-be9f-685f0169848a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:56.250537 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:06:56.251456 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 13:06:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 (ip 10.222.0.70) !!! Aug 25 13:06:56.258141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b5757dc-5a09-4d6a-be9f-685f0169848a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:56.259637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b5757dc-5a09-4d6a-be9f-685f0169848a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:56.261560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b5757dc-5a09-4d6a-be9f-685f0169848a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:56.263625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b5757dc-5a09-4d6a-be9f-685f0169848a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:56.267145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b5757dc-5a09-4d6a-be9f-685f0169848a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:56.274442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b5757dc-5a09-4d6a-be9f-685f0169848a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:56.324468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98046249f4e4b8fbe18ed2747d6ed6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b864a9e1e6b4c2f9552a9e167d71e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:56.344141 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2b8b6d85-8052-423f-ab07-9bdebb736be2 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 200 len: 1307 microversion: 2.1 time: 0.499695 Aug 25 13:06:56.362356 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1630/3239] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:55 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 1307 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:56.392624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6b66818-757e-4383-9317-b4949141afb9 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:56.393382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d6b66818-757e-4383-9317-b4949141afb9 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: ecf3097f-3151-4e80-b895-2864e07f80c9] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:56.425095 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-d6b66818-757e-4383-9317-b4949141afb9 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] HTTP exception thrown: Instance ecf3097f-3151-4e80-b895-2864e07f80c9 could not be found. Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6b66818-757e-4383-9317-b4949141afb9 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Request method failure captured: Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/ecf3097f-3151-4e80-b895-2864e07f80c9/metadata/test2 HTTP/1.1 Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3OozjgOjdIjjGDFYlcToSesXNgc44r68DG0y1MZj_bVB7VIM9yk8FXOIJTcHHnjMJjaDPGKkhMlr_2UPhlMoxeXwmBhq5FWm356G-oCXaQ4O-ELmNqJZ4vGUxRiA4swytVap7-kUUzFlgbakySzVrndf59jiNLX7IAhg5fIW07Gz6k Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cb30d93b30ac4a8a9caa759b49182412", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}] Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 4946d6cd1da64db3b3c845cffac626e3 Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance ecf3097f-3151-4e80-b895-2864e07f80c9 could not be found. Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': 'ecf3097f-3151-4e80-b895-2864e07f80c9', 'id': 'test2'} Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf3097f-3151-4e80-b895-2864e07f80c9 could not be found. Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf3097f-3151-4e80-b895-2864e07f80c9 could not be found. Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:56.428238 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:56.443712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:56.443712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:56.443712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf3097f-3151-4e80-b895-2864e07f80c9 could not be found. Aug 25 13:06:56.443712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:56.445901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6b66818-757e-4383-9317-b4949141afb9 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Returning 404 to user: Instance ecf3097f-3151-4e80-b895-2864e07f80c9 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:56.463294 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d6b66818-757e-4383-9317-b4949141afb9 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf3097f-3151-4e80-b895-2864e07f80c9/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.099349 Aug 25 13:06:56.478529 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1631/3240] 10.222.0.70 () {58 vars in 1281 bytes} [Thu Aug 25 13:06:56 2022] GET /compute/v2.1/servers/ecf3097f-3151-4e80-b895-2864e07f80c9/metadata/test2 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:56.532065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10c5691c-e3d0-4799-a430-5c699acf7348 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:56.534331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-10c5691c-e3d0-4799-a430-5c699acf7348 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:56.559099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3b5757dc-5a09-4d6a-be9f-685f0169848a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:56.565838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10c5691c-e3d0-4799-a430-5c699acf7348 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:56.566792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10c5691c-e3d0-4799-a430-5c699acf7348 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:56.568190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10c5691c-e3d0-4799-a430-5c699acf7348 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:56.569564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10c5691c-e3d0-4799-a430-5c699acf7348 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:56.570420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10c5691c-e3d0-4799-a430-5c699acf7348 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:56.571441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10c5691c-e3d0-4799-a430-5c699acf7348 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:56.594526 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3b5757dc-5a09-4d6a-be9f-685f0169848a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1271 microversion: 2.1 time: 0.367493 Aug 25 13:06:56.595720 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1610/3241] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:56 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1271 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:56.743590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-10c5691c-e3d0-4799-a430-5c699acf7348 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:06:57.111020 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-10c5691c-e3d0-4799-a430-5c699acf7348 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 204 len: 0 microversion: 2.1 time: 0.586103 Aug 25 13:06:57.112466 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1632/3242] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:56 2022] DELETE /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:57.142410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b3e79a37-c74c-467d-b6ea-12654249bb8d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:57.144687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b3e79a37-c74c-467d-b6ea-12654249bb8d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:57.162558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:57.166516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e79a37-c74c-467d-b6ea-12654249bb8d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:57.168311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e79a37-c74c-467d-b6ea-12654249bb8d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:57.170560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e79a37-c74c-467d-b6ea-12654249bb8d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:57.173690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e79a37-c74c-467d-b6ea-12654249bb8d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:57.175362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e79a37-c74c-467d-b6ea-12654249bb8d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:57.177652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e79a37-c74c-467d-b6ea-12654249bb8d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:57.180244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:57.404792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:57.407462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] [instance: 34c46524-70ff-4c0a-9fce-afaacf9d2ba5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:57.434169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:57.473093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:57.476395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:57.487377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:57.490220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:57.492980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:57.538935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b3e79a37-c74c-467d-b6ea-12654249bb8d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:57.559111 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b3e79a37-c74c-467d-b6ea-12654249bb8d tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1524 microversion: 2.1 time: 0.438310 Aug 25 13:06:57.561094 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1611/3243] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:57 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1524 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:57.568922 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] HTTP exception thrown: Instance 34c46524-70ff-4c0a-9fce-afaacf9d2ba5 could not be found. Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Request method failure captured: Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 HTTP/1.1 Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3KYheFWQpDMnBWap2dke1KjY2MzTVNN-lZSrvYz_8gtYdnVtMITJ9j8KhUKRnT6ssdJ9Fv54kQkZLhuOhT1Cu0qmHGwrlwuEyuhP6dRhxXMWsJAcpa38Mhv90T5cifKtZVpIIpbWYSzf4UaW41mPFg2SJy1EB6863aMXqzBDlAz89I Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b864a9e1e6b4c2f9552a9e167d71e14", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b864a9e1e6b4c2f9552a9e167d71e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b864a9e1e6b4c2f9552a9e167d71e14"}]}] Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5b864a9e1e6b4c2f9552a9e167d71e14 Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1572881697 Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a98046249f4e4b8fbe18ed2747d6ed6b Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersOnMultiNodesTest-1572881697-project Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 34c46524-70ff-4c0a-9fce-afaacf9d2ba5 could not be found. Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '34c46524-70ff-4c0a-9fce-afaacf9d2ba5'} Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c46524-70ff-4c0a-9fce-afaacf9d2ba5 could not be found. Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c46524-70ff-4c0a-9fce-afaacf9d2ba5 could not be found. Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:57.580391 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:57.589860 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:57.589860 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:57.589860 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:57.589860 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:57.589860 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:57.589860 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c46524-70ff-4c0a-9fce-afaacf9d2ba5 could not be found. Aug 25 13:06:57.589860 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:06:57.593085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] Returning 404 to user: Instance 34c46524-70ff-4c0a-9fce-afaacf9d2ba5 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:57.596000 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f35fac0a-ae0e-4d29-b81a-80a6ee1f37d3 tempest-ServersOnMultiNodesTest-1572881697 tempest-ServersOnMultiNodesTest-1572881697-project] 10.222.0.70 "GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5" status: 404 len: 111 microversion: 2.1 time: 0.207526 Aug 25 13:06:57.601896 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1633/3244] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:57 2022] GET /compute/v2.1/servers/34c46524-70ff-4c0a-9fce-afaacf9d2ba5 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:57.647731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54696a9b-dcde-4c2a-808b-404f908f0eee tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:57.649159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-54696a9b-dcde-4c2a-808b-404f908f0eee tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:57.678644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54696a9b-dcde-4c2a-808b-404f908f0eee tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:57.680407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54696a9b-dcde-4c2a-808b-404f908f0eee tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:57.693403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54696a9b-dcde-4c2a-808b-404f908f0eee tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:57.697238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54696a9b-dcde-4c2a-808b-404f908f0eee tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:57.701788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54696a9b-dcde-4c2a-808b-404f908f0eee tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:57.703712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54696a9b-dcde-4c2a-808b-404f908f0eee tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:58.033036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54696a9b-dcde-4c2a-808b-404f908f0eee tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:58.064600 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-54696a9b-dcde-4c2a-808b-404f908f0eee tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1271 microversion: 2.1 time: 0.425559 Aug 25 13:06:58.092325 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1612/3245] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:57 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1271 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:58.625768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2b513bf5-1ebd-4519-8740-d9035b862e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:58.649840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2b513bf5-1ebd-4519-8740-d9035b862e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:58.738824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b513bf5-1ebd-4519-8740-d9035b862e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:58.739797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b513bf5-1ebd-4519-8740-d9035b862e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:58.740617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b513bf5-1ebd-4519-8740-d9035b862e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:58.742041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b513bf5-1ebd-4519-8740-d9035b862e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:58.742794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b513bf5-1ebd-4519-8740-d9035b862e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:58.743477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2b513bf5-1ebd-4519-8740-d9035b862e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:59.029196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:59.120198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8457278f-465b-4dbe-aa8d-dca3318d4aba tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:59.124015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8457278f-465b-4dbe-aa8d-dca3318d4aba tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:59.179747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8457278f-465b-4dbe-aa8d-dca3318d4aba tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:59.181471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8457278f-465b-4dbe-aa8d-dca3318d4aba tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:59.196752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8457278f-465b-4dbe-aa8d-dca3318d4aba tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:59.198792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8457278f-465b-4dbe-aa8d-dca3318d4aba tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:59.200285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8457278f-465b-4dbe-aa8d-dca3318d4aba tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:59.206708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8457278f-465b-4dbe-aa8d-dca3318d4aba tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:59.584025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2b513bf5-1ebd-4519-8740-d9035b862e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:59.653189 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2b513bf5-1ebd-4519-8740-d9035b862e81 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1524 microversion: 2.1 time: 1.057120 Aug 25 13:06:59.664247 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1634/3246] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:58 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1524 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:59.821023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8457278f-465b-4dbe-aa8d-dca3318d4aba tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:59.868581 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8457278f-465b-4dbe-aa8d-dca3318d4aba tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1271 microversion: 2.1 time: 0.753756 Aug 25 13:06:59.886747 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1613/3247] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:59 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1271 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:00.698230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12366598-91e4-4bde-947d-dcc10ebdb95a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:00.703879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12366598-91e4-4bde-947d-dcc10ebdb95a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:00.766446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12366598-91e4-4bde-947d-dcc10ebdb95a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:00.771548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12366598-91e4-4bde-947d-dcc10ebdb95a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:00.774911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12366598-91e4-4bde-947d-dcc10ebdb95a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:00.780629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12366598-91e4-4bde-947d-dcc10ebdb95a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:00.789814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12366598-91e4-4bde-947d-dcc10ebdb95a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:00.794099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12366598-91e4-4bde-947d-dcc10ebdb95a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:00.939053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c71ebf93-d9ef-4347-8793-c0aa91d21dc0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:00.949306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c71ebf93-d9ef-4347-8793-c0aa91d21dc0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:01.088358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71ebf93-d9ef-4347-8793-c0aa91d21dc0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:01.144352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71ebf93-d9ef-4347-8793-c0aa91d21dc0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:01.146160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71ebf93-d9ef-4347-8793-c0aa91d21dc0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:01.168340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71ebf93-d9ef-4347-8793-c0aa91d21dc0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:01.171138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:01.183936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71ebf93-d9ef-4347-8793-c0aa91d21dc0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:01.189344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71ebf93-d9ef-4347-8793-c0aa91d21dc0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:02.000510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c71ebf93-d9ef-4347-8793-c0aa91d21dc0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:02.132660 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c71ebf93-d9ef-4347-8793-c0aa91d21dc0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1271 microversion: 2.1 time: 1.206025 Aug 25 13:07:02.172951 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1614/3248] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:00 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1271 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:02.523732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12366598-91e4-4bde-947d-dcc10ebdb95a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:02.574206 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12366598-91e4-4bde-947d-dcc10ebdb95a tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1524 microversion: 2.1 time: 1.884121 Aug 25 13:07:02.585632 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1635/3249] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:00 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1524 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:03.182720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6ad5d1dd-dd2b-4151-9f50-6a1a075c0a97 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:03.183895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6ad5d1dd-dd2b-4151-9f50-6a1a075c0a97 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:03.229079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad5d1dd-dd2b-4151-9f50-6a1a075c0a97 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:03.229614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad5d1dd-dd2b-4151-9f50-6a1a075c0a97 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:03.231776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad5d1dd-dd2b-4151-9f50-6a1a075c0a97 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:03.232801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad5d1dd-dd2b-4151-9f50-6a1a075c0a97 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:03.234625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad5d1dd-dd2b-4151-9f50-6a1a075c0a97 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:03.235361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad5d1dd-dd2b-4151-9f50-6a1a075c0a97 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:03.628077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-31aaeb49-3a2c-4604-a265-0e66b0c5ae9b tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:03.631775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-31aaeb49-3a2c-4604-a265-0e66b0c5ae9b tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:03.691677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31aaeb49-3a2c-4604-a265-0e66b0c5ae9b tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:03.693189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31aaeb49-3a2c-4604-a265-0e66b0c5ae9b tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:03.703603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31aaeb49-3a2c-4604-a265-0e66b0c5ae9b tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:03.707198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31aaeb49-3a2c-4604-a265-0e66b0c5ae9b tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:03.709297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31aaeb49-3a2c-4604-a265-0e66b0c5ae9b tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:03.712868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31aaeb49-3a2c-4604-a265-0e66b0c5ae9b tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:04.183109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6ad5d1dd-dd2b-4151-9f50-6a1a075c0a97 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:04.262362 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6ad5d1dd-dd2b-4151-9f50-6a1a075c0a97 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1271 microversion: 2.1 time: 1.084753 Aug 25 13:07:04.264105 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1615/3250] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:03 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1271 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:05.314809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0e54a95a-35c5-43c3-955c-499167a016f3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:05.316911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0e54a95a-35c5-43c3-955c-499167a016f3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:05.366276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e54a95a-35c5-43c3-955c-499167a016f3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:05.372506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e54a95a-35c5-43c3-955c-499167a016f3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:05.375584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e54a95a-35c5-43c3-955c-499167a016f3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:05.384942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e54a95a-35c5-43c3-955c-499167a016f3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:05.386634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e54a95a-35c5-43c3-955c-499167a016f3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:05.391633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e54a95a-35c5-43c3-955c-499167a016f3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:06.071384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-31aaeb49-3a2c-4604-a265-0e66b0c5ae9b tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:06.112749 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-31aaeb49-3a2c-4604-a265-0e66b0c5ae9b tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1524 microversion: 2.1 time: 2.507222 Aug 25 13:07:06.133308 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1636/3251] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:03 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1524 bytes in 2528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:06.175021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d762e202-7e5a-458c-80f4-3252a869d923 req-bed3aed4-5f28-4871-83a3-9e230b29bda1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d5dd89-fdf8-45cf-9f02-fd21356777cd", "name": "network-vif-unplugged", "status": "completed", "tag": "7b6e4795-8e73-494f-ac2b-b80687f601b2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:06.222316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d762e202-7e5a-458c-80f4-3252a869d923 req-bed3aed4-5f28-4871-83a3-9e230b29bda1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:06.227460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d762e202-7e5a-458c-80f4-3252a869d923 req-bed3aed4-5f28-4871-83a3-9e230b29bda1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:06.233797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d762e202-7e5a-458c-80f4-3252a869d923 req-bed3aed4-5f28-4871-83a3-9e230b29bda1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:06.341113 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d762e202-7e5a-458c-80f4-3252a869d923 req-bed3aed4-5f28-4871-83a3-9e230b29bda1 service nova] Creating event network-vif-unplugged:7b6e4795-8e73-494f-ac2b-b80687f601b2 for instance c3d5dd89-fdf8-45cf-9f02-fd21356777cd on n-h1-852771-8 Aug 25 13:07:06.376587 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d762e202-7e5a-458c-80f4-3252a869d923 req-bed3aed4-5f28-4871-83a3-9e230b29bda1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.238715 Aug 25 13:07:06.383360 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1637/3252] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:06.472739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7ab1a8e-66a5-4356-bce2-5e2b140c996a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:06.474997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a7ab1a8e-66a5-4356-bce2-5e2b140c996a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:06.604648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ab1a8e-66a5-4356-bce2-5e2b140c996a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:06.607604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ab1a8e-66a5-4356-bce2-5e2b140c996a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:06.616105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ab1a8e-66a5-4356-bce2-5e2b140c996a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:06.628598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ab1a8e-66a5-4356-bce2-5e2b140c996a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:06.630742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ab1a8e-66a5-4356-bce2-5e2b140c996a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:06.650246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ab1a8e-66a5-4356-bce2-5e2b140c996a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:07.590888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a7ab1a8e-66a5-4356-bce2-5e2b140c996a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:07.681134 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a7ab1a8e-66a5-4356-bce2-5e2b140c996a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 1.234321 Aug 25 13:07:07.687643 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1638/3253] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:06 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:07.781198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8644e1e4-d39a-4032-ba3a-2f46b2dc6c67 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:07.811724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8644e1e4-d39a-4032-ba3a-2f46b2dc6c67 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:07.876347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8644e1e4-d39a-4032-ba3a-2f46b2dc6c67 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:07.878781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8644e1e4-d39a-4032-ba3a-2f46b2dc6c67 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:07.887675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8644e1e4-d39a-4032-ba3a-2f46b2dc6c67 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:07.893001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8644e1e4-d39a-4032-ba3a-2f46b2dc6c67 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:07.909241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8644e1e4-d39a-4032-ba3a-2f46b2dc6c67 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:07.913142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8644e1e4-d39a-4032-ba3a-2f46b2dc6c67 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:08.016321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0e54a95a-35c5-43c3-955c-499167a016f3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:08.071006 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0e54a95a-35c5-43c3-955c-499167a016f3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1313 microversion: 2.1 time: 2.765530 Aug 25 13:07:08.079250 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1616/3254] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:05 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1313 bytes in 2775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:08.119736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d9bc139d-bb86-416f-982c-5566029e0349 req-139f127a-7003-4163-8d83-987f1dbe43fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d5dd89-fdf8-45cf-9f02-fd21356777cd", "name": "network-vif-deleted", "tag": "7b6e4795-8e73-494f-ac2b-b80687f601b2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:08.184230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d9bc139d-bb86-416f-982c-5566029e0349 req-139f127a-7003-4163-8d83-987f1dbe43fc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:08.185270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d9bc139d-bb86-416f-982c-5566029e0349 req-139f127a-7003-4163-8d83-987f1dbe43fc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:08.192852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d9bc139d-bb86-416f-982c-5566029e0349 req-139f127a-7003-4163-8d83-987f1dbe43fc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:08.361592 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d9bc139d-bb86-416f-982c-5566029e0349 req-139f127a-7003-4163-8d83-987f1dbe43fc service nova] Creating event network-vif-deleted:7b6e4795-8e73-494f-ac2b-b80687f601b2 for instance c3d5dd89-fdf8-45cf-9f02-fd21356777cd on n-h1-852771-8 Aug 25 13:07:08.404921 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d9bc139d-bb86-416f-982c-5566029e0349 req-139f127a-7003-4163-8d83-987f1dbe43fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321879 Aug 25 13:07:08.411513 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1617/3255] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:08.678190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8644e1e4-d39a-4032-ba3a-2f46b2dc6c67 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4946d6cd1da64db3b3c845cffac626e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb30d93b30ac4a8a9caa759b49182412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:08.758849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-80a5586d-da09-4961-9caa-f889e9b495e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:08.768786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-80a5586d-da09-4961-9caa-f889e9b495e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:08.771713 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8644e1e4-d39a-4032-ba3a-2f46b2dc6c67 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 200 len: 1482 microversion: 2.1 time: 1.075459 Aug 25 13:07:08.784471 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1639/3256] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:07 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 1482 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:08.838659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a5586d-da09-4961-9caa-f889e9b495e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:08.844588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a5586d-da09-4961-9caa-f889e9b495e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:08.846855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a5586d-da09-4961-9caa-f889e9b495e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:08.848517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a5586d-da09-4961-9caa-f889e9b495e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:08.849364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a5586d-da09-4961-9caa-f889e9b495e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:08.857529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80a5586d-da09-4961-9caa-f889e9b495e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:09.149891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2ed033f-c119-49e5-84d8-02047d311bea tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:09.152777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e2ed033f-c119-49e5-84d8-02047d311bea tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:09.229154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ed033f-c119-49e5-84d8-02047d311bea tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:09.238088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ed033f-c119-49e5-84d8-02047d311bea tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:09.243028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ed033f-c119-49e5-84d8-02047d311bea tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:09.244512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ed033f-c119-49e5-84d8-02047d311bea tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:09.255397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ed033f-c119-49e5-84d8-02047d311bea tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:09.272246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ed033f-c119-49e5-84d8-02047d311bea tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:12.241005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2ed033f-c119-49e5-84d8-02047d311bea tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:12.268998 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e2ed033f-c119-49e5-84d8-02047d311bea tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1334 microversion: 2.1 time: 3.137489 Aug 25 13:07:12.273201 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1640/3257] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:09 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1334 bytes in 3144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:12.293103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:12.303436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-80a5586d-da09-4961-9caa-f889e9b495e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:12.315507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] [instance: c3d5dd89-fdf8-45cf-9f02-fd21356777cd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:12.356261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:12.357208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:12.358099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:12.359506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:12.360816 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-80a5586d-da09-4961-9caa-f889e9b495e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 3.603807 Aug 25 13:07:12.369547 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1618/3258] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:08 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 3622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:12.380180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:12.384259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:12.395857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-cefca4a2-875e-44e5-8194-d22ea7260c68 req-d049f15a-d72d-4f1f-ba6c-21dfac80c23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3eccca-1677-409a-bcf9-99d321525b2b", "name": "network-vif-unplugged", "status": "completed", "tag": "4d308beb-5849-4af8-9677-9649024147e8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:12.426281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cefca4a2-875e-44e5-8194-d22ea7260c68 req-d049f15a-d72d-4f1f-ba6c-21dfac80c23f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:12.430427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cefca4a2-875e-44e5-8194-d22ea7260c68 req-d049f15a-d72d-4f1f-ba6c-21dfac80c23f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:12.434521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cefca4a2-875e-44e5-8194-d22ea7260c68 req-d049f15a-d72d-4f1f-ba6c-21dfac80c23f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:12.507706 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] HTTP exception thrown: Instance c3d5dd89-fdf8-45cf-9f02-fd21356777cd could not be found. Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Request method failure captured: Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd HTTP/1.1 Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3OozjgOjdIjjGDFYlcToSesXNgc44r68DG0y1MZj_bVB7VIM9yk8FXOIJTcHHnjMJjaDPGKkhMlr_2UPhlMoxeXwmBhq5FWm356G-oCXaQ4O-ELmNqJZ4vGUxRiA4swytVap7-kUUzFlgbakySzVrndf59jiNLX7IAhg5fIW07Gz6k Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cb30d93b30ac4a8a9caa759b49182412", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cb30d93b30ac4a8a9caa759b49182412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cb30d93b30ac4a8a9caa759b49182412"}]}] Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: cb30d93b30ac4a8a9caa759b49182412 Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1653240356 Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 4946d6cd1da64db3b3c845cffac626e3 Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1653240356-project Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance c3d5dd89-fdf8-45cf-9f02-fd21356777cd could not be found. Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'c3d5dd89-fdf8-45cf-9f02-fd21356777cd'} Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d5dd89-fdf8-45cf-9f02-fd21356777cd could not be found. Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d5dd89-fdf8-45cf-9f02-fd21356777cd could not be found. Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:07:12.511612 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:12.528189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:07:12.528189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:12.528189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:12.528189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:12.528189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:07:12.528189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:07:12.528189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d5dd89-fdf8-45cf-9f02-fd21356777cd could not be found. Aug 25 13:07:12.528189 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:07:12.528189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] Returning 404 to user: Instance c3d5dd89-fdf8-45cf-9f02-fd21356777cd could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:07:12.530873 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-cefca4a2-875e-44e5-8194-d22ea7260c68 req-d049f15a-d72d-4f1f-ba6c-21dfac80c23f service nova] Creating event network-vif-unplugged:4d308beb-5849-4af8-9677-9649024147e8 for instance fe3eccca-1677-409a-bcf9-99d321525b2b on n-h2-852771-8 Aug 25 13:07:12.546667 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3e419f51-f627-4a2a-9d1d-8dc756472aa3 tempest-ServerMetadataNegativeTestJSON-1653240356 tempest-ServerMetadataNegativeTestJSON-1653240356-project] 10.222.0.70 "GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd" status: 404 len: 111 microversion: 2.1 time: 0.237967 Aug 25 13:07:12.553686 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1641/3259] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:12 2022] GET /compute/v2.1/servers/c3d5dd89-fdf8-45cf-9f02-fd21356777cd => generated 111 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:07:12.584084 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-cefca4a2-875e-44e5-8194-d22ea7260c68 req-d049f15a-d72d-4f1f-ba6c-21dfac80c23f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.209206 Aug 25 13:07:12.587631 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1619/3260] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:12.589979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ca38d600-0aaf-4881-a8e2-2e3155fc822f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-2107392887"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:12.594888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ca38d600-0aaf-4881-a8e2-2e3155fc822f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:12.631253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca38d600-0aaf-4881-a8e2-2e3155fc822f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:12.632113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca38d600-0aaf-4881-a8e2-2e3155fc822f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:13.463376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca38d600-0aaf-4881-a8e2-2e3155fc822f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:13.463376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca38d600-0aaf-4881-a8e2-2e3155fc822f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:13.463376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca38d600-0aaf-4881-a8e2-2e3155fc822f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:13.463376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca38d600-0aaf-4881-a8e2-2e3155fc822f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:13.477151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e16592f2-6a36-4c14-9663-7a87a2b0c489 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:13.477151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e16592f2-6a36-4c14-9663-7a87a2b0c489 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:13.477151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e16592f2-6a36-4c14-9663-7a87a2b0c489 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:13.477151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e16592f2-6a36-4c14-9663-7a87a2b0c489 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:13.477151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e16592f2-6a36-4c14-9663-7a87a2b0c489 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:13.477151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e16592f2-6a36-4c14-9663-7a87a2b0c489 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:13.477151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e16592f2-6a36-4c14-9663-7a87a2b0c489 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:13.477151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e16592f2-6a36-4c14-9663-7a87a2b0c489 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:14.039500 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ca38d600-0aaf-4881-a8e2-2e3155fc822f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 1.469872 Aug 25 13:07:14.052881 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1642/3261] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:07:12 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 25 13:07:15.753763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e16592f2-6a36-4c14-9663-7a87a2b0c489 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:15.796091 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e16592f2-6a36-4c14-9663-7a87a2b0c489 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1334 microversion: 2.1 time: 2.491407 Aug 25 13:07:15.810219 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1620/3262] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:13 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1334 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:16.844223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0b20ea4e-25f4-41fe-b028-d0e831da6ee3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:16.849764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0b20ea4e-25f4-41fe-b028-d0e831da6ee3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:16.876965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b20ea4e-25f4-41fe-b028-d0e831da6ee3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:16.884325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b20ea4e-25f4-41fe-b028-d0e831da6ee3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:16.886081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b20ea4e-25f4-41fe-b028-d0e831da6ee3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:16.888004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b20ea4e-25f4-41fe-b028-d0e831da6ee3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:16.898316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b20ea4e-25f4-41fe-b028-d0e831da6ee3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:16.899185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b20ea4e-25f4-41fe-b028-d0e831da6ee3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.923188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0b20ea4e-25f4-41fe-b028-d0e831da6ee3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:17.968202 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0b20ea4e-25f4-41fe-b028-d0e831da6ee3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 1.131337 Aug 25 13:07:17.969409 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1643/3263] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:16 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:19.013262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10dc3d40-372d-4d7e-b8fa-e3b533b5ee68 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:19.018724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-10dc3d40-372d-4d7e-b8fa-e3b533b5ee68 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:19.042686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:19.052877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10dc3d40-372d-4d7e-b8fa-e3b533b5ee68 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:19.058403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10dc3d40-372d-4d7e-b8fa-e3b533b5ee68 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:19.059639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10dc3d40-372d-4d7e-b8fa-e3b533b5ee68 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:19.068194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10dc3d40-372d-4d7e-b8fa-e3b533b5ee68 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:19.070221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10dc3d40-372d-4d7e-b8fa-e3b533b5ee68 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:19.071105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10dc3d40-372d-4d7e-b8fa-e3b533b5ee68 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:19.189869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:19.533978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10dc3d40-372d-4d7e-b8fa-e3b533b5ee68 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:19.580712 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-10dc3d40-372d-4d7e-b8fa-e3b533b5ee68 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 0.576006 Aug 25 13:07:19.597253 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1621/3264] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:19 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:19.665101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4e72ae56-a0bd-4ac7-87b6-a8a3184367c1 req-57eb5d77-01bd-4cc8-8165-d7748fa1b7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff52b3c-3863-430f-8d5d-a61f84d4b803", "tag": "0d51eaca-3abd-4e01-9f98-d3e55f0a31d3"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:19.724875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4e72ae56-a0bd-4ac7-87b6-a8a3184367c1 req-57eb5d77-01bd-4cc8-8165-d7748fa1b7f7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:19.730950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4e72ae56-a0bd-4ac7-87b6-a8a3184367c1 req-57eb5d77-01bd-4cc8-8165-d7748fa1b7f7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:19.733722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4e72ae56-a0bd-4ac7-87b6-a8a3184367c1 req-57eb5d77-01bd-4cc8-8165-d7748fa1b7f7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:19.833335 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4e72ae56-a0bd-4ac7-87b6-a8a3184367c1 req-57eb5d77-01bd-4cc8-8165-d7748fa1b7f7 service nova] Creating event network-changed:0d51eaca-3abd-4e01-9f98-d3e55f0a31d3 for instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 on n-h2-852771-8 Aug 25 13:07:19.847477 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4e72ae56-a0bd-4ac7-87b6-a8a3184367c1 req-57eb5d77-01bd-4cc8-8165-d7748fa1b7f7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202915 Aug 25 13:07:19.850773 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1644/3265] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:20.643027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ac4d5a91-b45f-4dd9-ba0a-35870d783358 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:20.644253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ac4d5a91-b45f-4dd9-ba0a-35870d783358 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:20.681827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac4d5a91-b45f-4dd9-ba0a-35870d783358 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:20.685239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac4d5a91-b45f-4dd9-ba0a-35870d783358 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:20.686783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac4d5a91-b45f-4dd9-ba0a-35870d783358 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:20.694221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac4d5a91-b45f-4dd9-ba0a-35870d783358 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:20.704010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac4d5a91-b45f-4dd9-ba0a-35870d783358 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:20.706615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac4d5a91-b45f-4dd9-ba0a-35870d783358 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:21.610288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ac4d5a91-b45f-4dd9-ba0a-35870d783358 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:21.644577 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ac4d5a91-b45f-4dd9-ba0a-35870d783358 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 1.010306 Aug 25 13:07:21.670265 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1622/3266] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:20 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:22.729323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9e171251-c9de-439e-b00a-790747d8f33f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:22.738722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9e171251-c9de-439e-b00a-790747d8f33f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:22.774441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:22.794036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e171251-c9de-439e-b00a-790747d8f33f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:22.797011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e171251-c9de-439e-b00a-790747d8f33f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:22.798877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e171251-c9de-439e-b00a-790747d8f33f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:22.804151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e171251-c9de-439e-b00a-790747d8f33f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:22.807216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e171251-c9de-439e-b00a-790747d8f33f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:22.809106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e171251-c9de-439e-b00a-790747d8f33f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:23.781147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9e171251-c9de-439e-b00a-790747d8f33f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:23.815796 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9e171251-c9de-439e-b00a-790747d8f33f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 1.121915 Aug 25 13:07:23.819097 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1645/3267] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:22 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:24.810224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d7c2d7dd-7f62-4cf5-8f42-206489f82ec7 req-91f13e27-9f13-4a80-ac54-9e6476344360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff52b3c-3863-430f-8d5d-a61f84d4b803", "tag": "48720914-340b-4441-8162-238d61a8acb0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:24.857310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f1d05e03-7e6a-4d3e-8b64-5fb0a09052fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:24.869694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f1d05e03-7e6a-4d3e-8b64-5fb0a09052fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:24.917630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d7c2d7dd-7f62-4cf5-8f42-206489f82ec7 req-91f13e27-9f13-4a80-ac54-9e6476344360 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:24.923802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d7c2d7dd-7f62-4cf5-8f42-206489f82ec7 req-91f13e27-9f13-4a80-ac54-9e6476344360 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:24.929221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d7c2d7dd-7f62-4cf5-8f42-206489f82ec7 req-91f13e27-9f13-4a80-ac54-9e6476344360 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:24.959650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d05e03-7e6a-4d3e-8b64-5fb0a09052fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:24.964516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d05e03-7e6a-4d3e-8b64-5fb0a09052fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:24.970210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d05e03-7e6a-4d3e-8b64-5fb0a09052fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:24.975293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d05e03-7e6a-4d3e-8b64-5fb0a09052fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:24.981711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d05e03-7e6a-4d3e-8b64-5fb0a09052fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:24.997537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1d05e03-7e6a-4d3e-8b64-5fb0a09052fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:25.033986 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d7c2d7dd-7f62-4cf5-8f42-206489f82ec7 req-91f13e27-9f13-4a80-ac54-9e6476344360 service nova] Creating event network-changed:48720914-340b-4441-8162-238d61a8acb0 for instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 on n-h2-852771-8 Aug 25 13:07:25.085095 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d7c2d7dd-7f62-4cf5-8f42-206489f82ec7 req-91f13e27-9f13-4a80-ac54-9e6476344360 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282873 Aug 25 13:07:25.094688 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1623/3268] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:07:27.662741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f1d05e03-7e6a-4d3e-8b64-5fb0a09052fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:27.712768 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f1d05e03-7e6a-4d3e-8b64-5fb0a09052fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 2.863600 Aug 25 13:07:27.719512 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1646/3269] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:24 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 2872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:28.170044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d65aaf1f-02c2-4a7e-927e-a7c651fd187a req-3e741556-41a7-4172-b683-75a39bba3dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3eccca-1677-409a-bcf9-99d321525b2b", "name": "network-vif-plugged", "status": "completed", "tag": "4d308beb-5849-4af8-9677-9649024147e8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:28.283613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d65aaf1f-02c2-4a7e-927e-a7c651fd187a req-3e741556-41a7-4172-b683-75a39bba3dc9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:28.288331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d65aaf1f-02c2-4a7e-927e-a7c651fd187a req-3e741556-41a7-4172-b683-75a39bba3dc9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:28.292244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d65aaf1f-02c2-4a7e-927e-a7c651fd187a req-3e741556-41a7-4172-b683-75a39bba3dc9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:28.424879 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d65aaf1f-02c2-4a7e-927e-a7c651fd187a req-3e741556-41a7-4172-b683-75a39bba3dc9 service nova] Creating event network-vif-plugged:4d308beb-5849-4af8-9677-9649024147e8 for instance fe3eccca-1677-409a-bcf9-99d321525b2b on n-h2-852771-8 Aug 25 13:07:28.465382 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d65aaf1f-02c2-4a7e-927e-a7c651fd187a req-3e741556-41a7-4172-b683-75a39bba3dc9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310817 Aug 25 13:07:28.476040 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1624/3270] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:28.758152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e1ba471-96a7-4896-b107-6f740f60fa4e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:28.767198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6e1ba471-96a7-4896-b107-6f740f60fa4e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:28.818893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e1ba471-96a7-4896-b107-6f740f60fa4e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:28.822144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e1ba471-96a7-4896-b107-6f740f60fa4e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:28.824558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e1ba471-96a7-4896-b107-6f740f60fa4e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:28.842299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e1ba471-96a7-4896-b107-6f740f60fa4e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:28.844225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e1ba471-96a7-4896-b107-6f740f60fa4e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:28.853988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e1ba471-96a7-4896-b107-6f740f60fa4e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:30.884501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6e1ba471-96a7-4896-b107-6f740f60fa4e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:30.916609 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e1ba471-96a7-4896-b107-6f740f60fa4e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 2.167639 Aug 25 13:07:30.918448 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1647/3271] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:28 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:31.489674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-eb37d1f7-836a-4f3b-91e3-8274799c00a5 req-78d738e3-3beb-4854-aed5-68c17be6a2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff52b3c-3863-430f-8d5d-a61f84d4b803", "tag": "8824ad2c-abc2-4158-aa6d-0f6647975ab3"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:31.575974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-eb37d1f7-836a-4f3b-91e3-8274799c00a5 req-78d738e3-3beb-4854-aed5-68c17be6a2bf service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:31.577368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-eb37d1f7-836a-4f3b-91e3-8274799c00a5 req-78d738e3-3beb-4854-aed5-68c17be6a2bf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:31.578582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-eb37d1f7-836a-4f3b-91e3-8274799c00a5 req-78d738e3-3beb-4854-aed5-68c17be6a2bf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:31.620329 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-eb37d1f7-836a-4f3b-91e3-8274799c00a5 req-78d738e3-3beb-4854-aed5-68c17be6a2bf service nova] Creating event network-changed:8824ad2c-abc2-4158-aa6d-0f6647975ab3 for instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 on n-h2-852771-8 Aug 25 13:07:31.639234 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-eb37d1f7-836a-4f3b-91e3-8274799c00a5 req-78d738e3-3beb-4854-aed5-68c17be6a2bf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172277 Aug 25 13:07:31.641486 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1625/3272] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:31.970969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fb62623c-9aae-4f9e-9b7a-ed412a7eab9e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:31.982225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fb62623c-9aae-4f9e-9b7a-ed412a7eab9e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:32.049959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb62623c-9aae-4f9e-9b7a-ed412a7eab9e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:32.061841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb62623c-9aae-4f9e-9b7a-ed412a7eab9e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:32.078080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb62623c-9aae-4f9e-9b7a-ed412a7eab9e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:32.080071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb62623c-9aae-4f9e-9b7a-ed412a7eab9e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:32.081306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb62623c-9aae-4f9e-9b7a-ed412a7eab9e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:32.082560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb62623c-9aae-4f9e-9b7a-ed412a7eab9e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:32.160099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:35.466535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fb62623c-9aae-4f9e-9b7a-ed412a7eab9e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:35.496666 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fb62623c-9aae-4f9e-9b7a-ed412a7eab9e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 3.534863 Aug 25 13:07:35.503242 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1648/3273] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:31 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 3543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:36.555283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86d3b66b-cb93-4dbc-917b-bfd849a197ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:36.559021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-86d3b66b-cb93-4dbc-917b-bfd849a197ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:36.595026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d3b66b-cb93-4dbc-917b-bfd849a197ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:36.596710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d3b66b-cb93-4dbc-917b-bfd849a197ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:36.598030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d3b66b-cb93-4dbc-917b-bfd849a197ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:36.604341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d3b66b-cb93-4dbc-917b-bfd849a197ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:36.606084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d3b66b-cb93-4dbc-917b-bfd849a197ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:36.608113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86d3b66b-cb93-4dbc-917b-bfd849a197ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:37.676491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86d3b66b-cb93-4dbc-917b-bfd849a197ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:37.719840 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-86d3b66b-cb93-4dbc-917b-bfd849a197ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 1.177952 Aug 25 13:07:37.738109 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1626/3274] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:36 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:38.769555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-399b8a50-6f2a-4d5b-805e-dc82c4a84df3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:38.776947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-399b8a50-6f2a-4d5b-805e-dc82c4a84df3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:38.836928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-399b8a50-6f2a-4d5b-805e-dc82c4a84df3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:38.846802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-399b8a50-6f2a-4d5b-805e-dc82c4a84df3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:38.848353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-399b8a50-6f2a-4d5b-805e-dc82c4a84df3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:38.850418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-399b8a50-6f2a-4d5b-805e-dc82c4a84df3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:38.851863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-399b8a50-6f2a-4d5b-805e-dc82c4a84df3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:38.853194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-399b8a50-6f2a-4d5b-805e-dc82c4a84df3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:41.052131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-399b8a50-6f2a-4d5b-805e-dc82c4a84df3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:41.102805 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-399b8a50-6f2a-4d5b-805e-dc82c4a84df3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 2.344805 Aug 25 13:07:41.107840 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1649/3275] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:38 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:42.219941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f2b7a802-12e7-407d-952f-24d915cfe01a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:42.221766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f2b7a802-12e7-407d-952f-24d915cfe01a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:42.262379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2b7a802-12e7-407d-952f-24d915cfe01a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:42.263313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2b7a802-12e7-407d-952f-24d915cfe01a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:42.264158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2b7a802-12e7-407d-952f-24d915cfe01a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:42.270754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2b7a802-12e7-407d-952f-24d915cfe01a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:42.272446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2b7a802-12e7-407d-952f-24d915cfe01a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:42.278314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2b7a802-12e7-407d-952f-24d915cfe01a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:44.276646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f2b7a802-12e7-407d-952f-24d915cfe01a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:44.327101 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f2b7a802-12e7-407d-952f-24d915cfe01a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 2.178327 Aug 25 13:07:44.352703 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1627/3276] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:42 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:45.376750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c30ce1e3-7e4f-4c76-b217-4bc1626d8ce2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:45.381191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c30ce1e3-7e4f-4c76-b217-4bc1626d8ce2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:45.415531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30ce1e3-7e4f-4c76-b217-4bc1626d8ce2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:45.426963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30ce1e3-7e4f-4c76-b217-4bc1626d8ce2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:45.428372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30ce1e3-7e4f-4c76-b217-4bc1626d8ce2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:45.431875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30ce1e3-7e4f-4c76-b217-4bc1626d8ce2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:45.433209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30ce1e3-7e4f-4c76-b217-4bc1626d8ce2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:45.438780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c30ce1e3-7e4f-4c76-b217-4bc1626d8ce2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:47.360271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c30ce1e3-7e4f-4c76-b217-4bc1626d8ce2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:47.393927 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c30ce1e3-7e4f-4c76-b217-4bc1626d8ce2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 2.027060 Aug 25 13:07:47.397999 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1650/3277] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:45 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:48.451857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dadb5ba6-619d-4211-a523-54da21ce537f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:48.456282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dadb5ba6-619d-4211-a523-54da21ce537f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:48.488239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dadb5ba6-619d-4211-a523-54da21ce537f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:48.495974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dadb5ba6-619d-4211-a523-54da21ce537f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:48.497472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dadb5ba6-619d-4211-a523-54da21ce537f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:48.501010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dadb5ba6-619d-4211-a523-54da21ce537f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:48.506098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dadb5ba6-619d-4211-a523-54da21ce537f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:48.507621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dadb5ba6-619d-4211-a523-54da21ce537f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:53.561867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dadb5ba6-619d-4211-a523-54da21ce537f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:53.612292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=34 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:53.647953 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dadb5ba6-619d-4211-a523-54da21ce537f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 5.199442 Aug 25 13:07:53.688200 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1628/3278] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:48 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 5245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:54.703924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-982de028-8f88-4497-b067-39cdaf412b45 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:54.717646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-982de028-8f88-4497-b067-39cdaf412b45 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:54.748947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=12 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:54.757815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982de028-8f88-4497-b067-39cdaf412b45 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:54.763819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982de028-8f88-4497-b067-39cdaf412b45 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:54.765049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982de028-8f88-4497-b067-39cdaf412b45 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:54.772387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982de028-8f88-4497-b067-39cdaf412b45 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:54.775711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982de028-8f88-4497-b067-39cdaf412b45 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:54.777958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-982de028-8f88-4497-b067-39cdaf412b45 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:56.451979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-982de028-8f88-4497-b067-39cdaf412b45 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:56.523577 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-982de028-8f88-4497-b067-39cdaf412b45 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 1.817564 Aug 25 13:07:56.525265 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1651/3279] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:54 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:57.595593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-daf7bbe4-d861-45ba-b1a2-68552a54db8c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:57.611363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-daf7bbe4-d861-45ba-b1a2-68552a54db8c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:57.635999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=16 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:57.683257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf7bbe4-d861-45ba-b1a2-68552a54db8c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:57.686118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf7bbe4-d861-45ba-b1a2-68552a54db8c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:57.692070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf7bbe4-d861-45ba-b1a2-68552a54db8c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:57.698812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf7bbe4-d861-45ba-b1a2-68552a54db8c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:57.707069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf7bbe4-d861-45ba-b1a2-68552a54db8c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:57.713773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf7bbe4-d861-45ba-b1a2-68552a54db8c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:59.306871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-daf7bbe4-d861-45ba-b1a2-68552a54db8c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:59.372518 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-daf7bbe4-d861-45ba-b1a2-68552a54db8c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 1.798847 Aug 25 13:07:59.403952 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1629/3280] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:57 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:00.456287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-148da4c9-6e47-4cda-9f9e-f23bab548ba0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:00.460535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-148da4c9-6e47-4cda-9f9e-f23bab548ba0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:00.512280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148da4c9-6e47-4cda-9f9e-f23bab548ba0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:00.530254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148da4c9-6e47-4cda-9f9e-f23bab548ba0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:00.531831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148da4c9-6e47-4cda-9f9e-f23bab548ba0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:00.533265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148da4c9-6e47-4cda-9f9e-f23bab548ba0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:00.534079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148da4c9-6e47-4cda-9f9e-f23bab548ba0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:00.534799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-148da4c9-6e47-4cda-9f9e-f23bab548ba0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:01.076158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-148da4c9-6e47-4cda-9f9e-f23bab548ba0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:01.102448 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-148da4c9-6e47-4cda-9f9e-f23bab548ba0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 0.661843 Aug 25 13:08:01.134561 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1652/3281] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:00 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:02.162196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aab5a587-0534-4982-a80e-72691c555235 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:02.167569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aab5a587-0534-4982-a80e-72691c555235 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:02.224494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aab5a587-0534-4982-a80e-72691c555235 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:02.230535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aab5a587-0534-4982-a80e-72691c555235 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:02.232345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aab5a587-0534-4982-a80e-72691c555235 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:02.234180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aab5a587-0534-4982-a80e-72691c555235 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:02.235656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aab5a587-0534-4982-a80e-72691c555235 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:02.238394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aab5a587-0534-4982-a80e-72691c555235 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:02.946651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aab5a587-0534-4982-a80e-72691c555235 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:02.986148 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aab5a587-0534-4982-a80e-72691c555235 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 0.841958 Aug 25 13:08:02.988306 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1630/3282] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:02 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:04.047954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b493748-f156-40b9-9b4d-8d988b667ddf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:04.050349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b493748-f156-40b9-9b4d-8d988b667ddf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:04.089361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b493748-f156-40b9-9b4d-8d988b667ddf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:04.090034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b493748-f156-40b9-9b4d-8d988b667ddf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:04.096573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b493748-f156-40b9-9b4d-8d988b667ddf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:04.098390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b493748-f156-40b9-9b4d-8d988b667ddf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:04.099366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b493748-f156-40b9-9b4d-8d988b667ddf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:04.100162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b493748-f156-40b9-9b4d-8d988b667ddf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:04.216004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=30 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:04.682733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b493748-f156-40b9-9b4d-8d988b667ddf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:04.718608 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b493748-f156-40b9-9b4d-8d988b667ddf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 0.690747 Aug 25 13:08:04.720248 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1653/3283] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:04 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:05.765278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa8bcfe8-4dab-4727-b3dc-03758ad848d9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:05.775112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa8bcfe8-4dab-4727-b3dc-03758ad848d9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:05.840101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8bcfe8-4dab-4727-b3dc-03758ad848d9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:05.841065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8bcfe8-4dab-4727-b3dc-03758ad848d9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:05.841986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8bcfe8-4dab-4727-b3dc-03758ad848d9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:05.843351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8bcfe8-4dab-4727-b3dc-03758ad848d9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:05.844227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8bcfe8-4dab-4727-b3dc-03758ad848d9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:05.845050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8bcfe8-4dab-4727-b3dc-03758ad848d9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:08.445610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fa8bcfe8-4dab-4727-b3dc-03758ad848d9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:08.543919 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa8bcfe8-4dab-4727-b3dc-03758ad848d9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 2.786004 Aug 25 13:08:08.582488 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1631/3284] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:05 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 2826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:09.621173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d85a8fa-415a-4855-a492-199b408b0ec0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:09.633236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5d85a8fa-415a-4855-a492-199b408b0ec0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:09.714448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d85a8fa-415a-4855-a492-199b408b0ec0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:09.725756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d85a8fa-415a-4855-a492-199b408b0ec0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:09.727038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d85a8fa-415a-4855-a492-199b408b0ec0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:09.743635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d85a8fa-415a-4855-a492-199b408b0ec0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:09.748284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d85a8fa-415a-4855-a492-199b408b0ec0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:09.763720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d85a8fa-415a-4855-a492-199b408b0ec0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:11.233055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5d85a8fa-415a-4855-a492-199b408b0ec0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:11.264719 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5d85a8fa-415a-4855-a492-199b408b0ec0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 1.671918 Aug 25 13:08:11.265849 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1654/3285] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:09 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:12.319273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-410dc1c3-927b-456a-98bd-e569388a6c76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:12.325177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-410dc1c3-927b-456a-98bd-e569388a6c76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:12.361493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-410dc1c3-927b-456a-98bd-e569388a6c76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:12.377306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-410dc1c3-927b-456a-98bd-e569388a6c76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:12.381847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-410dc1c3-927b-456a-98bd-e569388a6c76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:12.387132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-410dc1c3-927b-456a-98bd-e569388a6c76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:12.396893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-410dc1c3-927b-456a-98bd-e569388a6c76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:12.408628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-410dc1c3-927b-456a-98bd-e569388a6c76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:13.274784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ed25d163-f008-4fd5-b55d-b0f6de13fbdc req-eff0e25a-f7ae-4294-81a1-79466a8b2698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff52b3c-3863-430f-8d5d-a61f84d4b803", "name": "network-vif-plugged", "status": "completed", "tag": "0d51eaca-3abd-4e01-9f98-d3e55f0a31d3"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:13.321129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ed25d163-f008-4fd5-b55d-b0f6de13fbdc req-eff0e25a-f7ae-4294-81a1-79466a8b2698 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:13.325407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ed25d163-f008-4fd5-b55d-b0f6de13fbdc req-eff0e25a-f7ae-4294-81a1-79466a8b2698 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:13.326809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ed25d163-f008-4fd5-b55d-b0f6de13fbdc req-eff0e25a-f7ae-4294-81a1-79466a8b2698 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:13.387416 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ed25d163-f008-4fd5-b55d-b0f6de13fbdc req-eff0e25a-f7ae-4294-81a1-79466a8b2698 service nova] Creating event network-vif-plugged:0d51eaca-3abd-4e01-9f98-d3e55f0a31d3 for instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 on n-h2-852771-8 Aug 25 13:08:13.407742 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ed25d163-f008-4fd5-b55d-b0f6de13fbdc req-eff0e25a-f7ae-4294-81a1-79466a8b2698 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144171 Aug 25 13:08:13.408868 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1655/3286] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:14.463441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-410dc1c3-927b-456a-98bd-e569388a6c76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:14.521027 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-410dc1c3-927b-456a-98bd-e569388a6c76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 2.203419 Aug 25 13:08:14.522696 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1632/3287] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:12 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:15.576140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fcf9f1e3-4860-4222-bde5-f61878c271dc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:15.580485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fcf9f1e3-4860-4222-bde5-f61878c271dc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:15.632010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcf9f1e3-4860-4222-bde5-f61878c271dc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:15.634806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcf9f1e3-4860-4222-bde5-f61878c271dc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:15.641409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcf9f1e3-4860-4222-bde5-f61878c271dc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:15.664448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcf9f1e3-4860-4222-bde5-f61878c271dc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:15.665267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcf9f1e3-4860-4222-bde5-f61878c271dc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:15.667955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcf9f1e3-4860-4222-bde5-f61878c271dc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:16.473027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fcf9f1e3-4860-4222-bde5-f61878c271dc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:16.518816 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fcf9f1e3-4860-4222-bde5-f61878c271dc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 0.956236 Aug 25 13:08:16.524610 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1656/3288] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:15 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:17.561786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4cb6e096-5928-47b4-bb52-d379cd07ebe7 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:17.562932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4cb6e096-5928-47b4-bb52-d379cd07ebe7 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:17.593549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cb6e096-5928-47b4-bb52-d379cd07ebe7 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:17.593549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cb6e096-5928-47b4-bb52-d379cd07ebe7 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:17.593549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cb6e096-5928-47b4-bb52-d379cd07ebe7 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:17.593549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cb6e096-5928-47b4-bb52-d379cd07ebe7 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:17.606835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cb6e096-5928-47b4-bb52-d379cd07ebe7 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:17.607997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4cb6e096-5928-47b4-bb52-d379cd07ebe7 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:18.156675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-31b8fe32-2de2-43cf-ba44-91ce37e828a7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:18.157850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-31b8fe32-2de2-43cf-ba44-91ce37e828a7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:18.186544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31b8fe32-2de2-43cf-ba44-91ce37e828a7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:18.188386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31b8fe32-2de2-43cf-ba44-91ce37e828a7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:18.189677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31b8fe32-2de2-43cf-ba44-91ce37e828a7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:18.191415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31b8fe32-2de2-43cf-ba44-91ce37e828a7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:18.193564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31b8fe32-2de2-43cf-ba44-91ce37e828a7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:18.195420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31b8fe32-2de2-43cf-ba44-91ce37e828a7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:18.464561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4cb6e096-5928-47b4-bb52-d379cd07ebe7 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:18.491677 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4cb6e096-5928-47b4-bb52-d379cd07ebe7 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 0.937380 Aug 25 13:08:18.510101 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1633/3289] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:17 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:18.736409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-31b8fe32-2de2-43cf-ba44-91ce37e828a7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:18.754133 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-31b8fe32-2de2-43cf-ba44-91ce37e828a7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.603922 Aug 25 13:08:18.770433 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1657/3290] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:18 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:18.802198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8b1bd6d9-6eea-4092-af05-491af83b4447 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1700552450"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:18.809576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8b1bd6d9-6eea-4092-af05-491af83b4447 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:18.825858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b1bd6d9-6eea-4092-af05-491af83b4447 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:18.827473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b1bd6d9-6eea-4092-af05-491af83b4447 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:18.828871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b1bd6d9-6eea-4092-af05-491af83b4447 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:18.830643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b1bd6d9-6eea-4092-af05-491af83b4447 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:18.831823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b1bd6d9-6eea-4092-af05-491af83b4447 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:18.832928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b1bd6d9-6eea-4092-af05-491af83b4447 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:19.454649 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8b1bd6d9-6eea-4092-af05-491af83b4447 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.657666 Aug 25 13:08:19.462090 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1634/3291] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:08:18 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 25 13:08:19.477775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6bd97d1-5c60-4742-aff9-12401ed9ad6e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:19.478982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c6bd97d1-5c60-4742-aff9-12401ed9ad6e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:19.502355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6bd97d1-5c60-4742-aff9-12401ed9ad6e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:19.503921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6bd97d1-5c60-4742-aff9-12401ed9ad6e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:19.506941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6bd97d1-5c60-4742-aff9-12401ed9ad6e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:19.509433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6bd97d1-5c60-4742-aff9-12401ed9ad6e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:19.512585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6bd97d1-5c60-4742-aff9-12401ed9ad6e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:19.514100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6bd97d1-5c60-4742-aff9-12401ed9ad6e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:19.546647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f13f7ec4-294c-4958-b663-df96bc151835 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:19.550725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f13f7ec4-294c-4958-b663-df96bc151835 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:19.604122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f13f7ec4-294c-4958-b663-df96bc151835 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:19.608123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f13f7ec4-294c-4958-b663-df96bc151835 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:19.624720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f13f7ec4-294c-4958-b663-df96bc151835 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:19.627053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f13f7ec4-294c-4958-b663-df96bc151835 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:19.628802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f13f7ec4-294c-4958-b663-df96bc151835 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:19.636677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f13f7ec4-294c-4958-b663-df96bc151835 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:20.514522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f13f7ec4-294c-4958-b663-df96bc151835 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:20.555176 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f13f7ec4-294c-4958-b663-df96bc151835 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 1.029580 Aug 25 13:08:20.562930 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1635/3292] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:19 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:20.573498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-70f97ed9-6228-4a62-b7c2-f681b510aef1 req-284b0103-db06-446a-a17d-e8ed7459d9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff52b3c-3863-430f-8d5d-a61f84d4b803", "name": "network-vif-plugged", "status": "completed", "tag": "48720914-340b-4441-8162-238d61a8acb0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:20.630372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-70f97ed9-6228-4a62-b7c2-f681b510aef1 req-284b0103-db06-446a-a17d-e8ed7459d9b2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:20.632912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-70f97ed9-6228-4a62-b7c2-f681b510aef1 req-284b0103-db06-446a-a17d-e8ed7459d9b2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:20.634392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-70f97ed9-6228-4a62-b7c2-f681b510aef1 req-284b0103-db06-446a-a17d-e8ed7459d9b2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:20.697250 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-70f97ed9-6228-4a62-b7c2-f681b510aef1 req-284b0103-db06-446a-a17d-e8ed7459d9b2 service nova] Creating event network-vif-plugged:48720914-340b-4441-8162-238d61a8acb0 for instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 on n-h2-852771-8 Aug 25 13:08:20.727095 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-70f97ed9-6228-4a62-b7c2-f681b510aef1 req-284b0103-db06-446a-a17d-e8ed7459d9b2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160599 Aug 25 13:08:20.729341 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1636/3293] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:21.062486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c6bd97d1-5c60-4742-aff9-12401ed9ad6e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:21.117950 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6bd97d1-5c60-4742-aff9-12401ed9ad6e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 1.642576 Aug 25 13:08:21.119751 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1658/3294] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:19 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:21.622428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2cd4ed8-9233-44f9-9ce9-4a4389828129 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:21.638136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a2cd4ed8-9233-44f9-9ce9-4a4389828129 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:21.670305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2cd4ed8-9233-44f9-9ce9-4a4389828129 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:21.671234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2cd4ed8-9233-44f9-9ce9-4a4389828129 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:21.672054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2cd4ed8-9233-44f9-9ce9-4a4389828129 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:21.683547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2cd4ed8-9233-44f9-9ce9-4a4389828129 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:21.691363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2cd4ed8-9233-44f9-9ce9-4a4389828129 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:21.694849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2cd4ed8-9233-44f9-9ce9-4a4389828129 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:22.167520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-96c54a60-1a07-4e40-aaf8-65c1bd5cda74 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:22.172271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-96c54a60-1a07-4e40-aaf8-65c1bd5cda74 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:22.204476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96c54a60-1a07-4e40-aaf8-65c1bd5cda74 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:22.206146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96c54a60-1a07-4e40-aaf8-65c1bd5cda74 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:22.208277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96c54a60-1a07-4e40-aaf8-65c1bd5cda74 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:22.211627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96c54a60-1a07-4e40-aaf8-65c1bd5cda74 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:22.213042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96c54a60-1a07-4e40-aaf8-65c1bd5cda74 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:22.230347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96c54a60-1a07-4e40-aaf8-65c1bd5cda74 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:23.553600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-96c54a60-1a07-4e40-aaf8-65c1bd5cda74 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:23.674300 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-96c54a60-1a07-4e40-aaf8-65c1bd5cda74 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 1.484223 Aug 25 13:08:23.692478 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1659/3295] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:22 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:23.730081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a2cd4ed8-9233-44f9-9ce9-4a4389828129 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:23.747854 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a2cd4ed8-9233-44f9-9ce9-4a4389828129 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 2.137968 Aug 25 13:08:23.761635 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1637/3296] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:21 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:24.736466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-44ab933d-d6e2-4233-b0ff-2e3f99e9b362 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:24.749285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-44ab933d-d6e2-4233-b0ff-2e3f99e9b362 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:24.796986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ab933d-d6e2-4233-b0ff-2e3f99e9b362 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:24.800598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ab933d-d6e2-4233-b0ff-2e3f99e9b362 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:24.802407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ab933d-d6e2-4233-b0ff-2e3f99e9b362 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:24.807301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fd35fe25-8c2c-4a37-9d61-61042f8ff425 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:24.813604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fd35fe25-8c2c-4a37-9d61-61042f8ff425 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:24.814530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ab933d-d6e2-4233-b0ff-2e3f99e9b362 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:24.815656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ab933d-d6e2-4233-b0ff-2e3f99e9b362 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:24.816669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ab933d-d6e2-4233-b0ff-2e3f99e9b362 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:24.861694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd35fe25-8c2c-4a37-9d61-61042f8ff425 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:24.871504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd35fe25-8c2c-4a37-9d61-61042f8ff425 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:24.876838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd35fe25-8c2c-4a37-9d61-61042f8ff425 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:24.879527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd35fe25-8c2c-4a37-9d61-61042f8ff425 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:24.886889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd35fe25-8c2c-4a37-9d61-61042f8ff425 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:24.888420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd35fe25-8c2c-4a37-9d61-61042f8ff425 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:26.978720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fd35fe25-8c2c-4a37-9d61-61042f8ff425 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:27.007342 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fd35fe25-8c2c-4a37-9d61-61042f8ff425 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 2.212711 Aug 25 13:08:27.015768 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1638/3297] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:24 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:27.029580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9b598799-4e6b-40b3-8084-ea81a9fc860f req-db1372b9-c578-4582-9f6e-889e8b849644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff52b3c-3863-430f-8d5d-a61f84d4b803", "name": "network-vif-plugged", "status": "completed", "tag": "8824ad2c-abc2-4158-aa6d-0f6647975ab3"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:27.062093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9b598799-4e6b-40b3-8084-ea81a9fc860f req-db1372b9-c578-4582-9f6e-889e8b849644 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:27.063759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9b598799-4e6b-40b3-8084-ea81a9fc860f req-db1372b9-c578-4582-9f6e-889e8b849644 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:27.078633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9b598799-4e6b-40b3-8084-ea81a9fc860f req-db1372b9-c578-4582-9f6e-889e8b849644 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:27.112037 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9b598799-4e6b-40b3-8084-ea81a9fc860f req-db1372b9-c578-4582-9f6e-889e8b849644 service nova] Creating event network-vif-plugged:8824ad2c-abc2-4158-aa6d-0f6647975ab3 for instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 on n-h2-852771-8 Aug 25 13:08:27.125104 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9b598799-4e6b-40b3-8084-ea81a9fc860f req-db1372b9-c578-4582-9f6e-889e8b849644 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106276 Aug 25 13:08:27.127804 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1639/3298] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:27.177572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-44ab933d-d6e2-4233-b0ff-2e3f99e9b362 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:27.229618 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-44ab933d-d6e2-4233-b0ff-2e3f99e9b362 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1685 microversion: 2.1 time: 2.510895 Aug 25 13:08:27.231416 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1660/3299] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:24 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1685 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:28.087490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-35d0b262-4439-4d26-b57e-b3c86bc4730e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:28.102012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-35d0b262-4439-4d26-b57e-b3c86bc4730e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:28.138082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=22 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:28.141838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35d0b262-4439-4d26-b57e-b3c86bc4730e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:28.157023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35d0b262-4439-4d26-b57e-b3c86bc4730e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:28.157980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35d0b262-4439-4d26-b57e-b3c86bc4730e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:28.159599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35d0b262-4439-4d26-b57e-b3c86bc4730e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:28.168659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35d0b262-4439-4d26-b57e-b3c86bc4730e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:28.170951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35d0b262-4439-4d26-b57e-b3c86bc4730e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:28.192155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:28.328435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea841370-093b-4d54-8107-8760dc13b000 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:28.334884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ea841370-093b-4d54-8107-8760dc13b000 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:28.382492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=20 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:28.397082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea841370-093b-4d54-8107-8760dc13b000 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:28.398758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea841370-093b-4d54-8107-8760dc13b000 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:28.400372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea841370-093b-4d54-8107-8760dc13b000 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:28.402569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea841370-093b-4d54-8107-8760dc13b000 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:28.404458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea841370-093b-4d54-8107-8760dc13b000 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:28.406967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea841370-093b-4d54-8107-8760dc13b000 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:30.197087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-35d0b262-4439-4d26-b57e-b3c86bc4730e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:30.231783 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-35d0b262-4439-4d26-b57e-b3c86bc4730e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1355 microversion: 2.1 time: 2.168931 Aug 25 13:08:30.237347 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1640/3300] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:28 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1355 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:31.054021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ea841370-093b-4d54-8107-8760dc13b000 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:31.100584 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ea841370-093b-4d54-8107-8760dc13b000 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 2.817385 Aug 25 13:08:31.116372 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1661/3301] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:28 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 2840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:31.280652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99b639a9-d64e-4989-b941-4989ef2cafb0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:31.283962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-99b639a9-d64e-4989-b941-4989ef2cafb0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:31.331250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99b639a9-d64e-4989-b941-4989ef2cafb0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:31.332635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99b639a9-d64e-4989-b941-4989ef2cafb0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:31.333852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99b639a9-d64e-4989-b941-4989ef2cafb0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:31.335928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99b639a9-d64e-4989-b941-4989ef2cafb0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:31.337251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99b639a9-d64e-4989-b941-4989ef2cafb0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:31.338435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99b639a9-d64e-4989-b941-4989ef2cafb0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:32.153273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c28d2c0c-469c-46a3-846b-ce847d576db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:32.158773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c28d2c0c-469c-46a3-846b-ce847d576db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:32.188969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c28d2c0c-469c-46a3-846b-ce847d576db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:32.189977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c28d2c0c-469c-46a3-846b-ce847d576db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:32.190854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c28d2c0c-469c-46a3-846b-ce847d576db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:32.205325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c28d2c0c-469c-46a3-846b-ce847d576db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:32.206930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c28d2c0c-469c-46a3-846b-ce847d576db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:32.208755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c28d2c0c-469c-46a3-846b-ce847d576db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:32.822359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99b639a9-d64e-4989-b941-4989ef2cafb0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:32.871872 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-99b639a9-d64e-4989-b941-4989ef2cafb0 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1805 microversion: 2.1 time: 1.596390 Aug 25 13:08:32.875435 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1641/3302] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:31 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1805 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:32.938248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2e231f92-2083-43f2-9a2c-62d48b4f78e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:32.950475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2e231f92-2083-43f2-9a2c-62d48b4f78e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:32.994310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e231f92-2083-43f2-9a2c-62d48b4f78e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:33.008851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e231f92-2083-43f2-9a2c-62d48b4f78e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:33.010394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e231f92-2083-43f2-9a2c-62d48b4f78e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:33.012489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e231f92-2083-43f2-9a2c-62d48b4f78e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:33.014172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e231f92-2083-43f2-9a2c-62d48b4f78e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:33.017545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e231f92-2083-43f2-9a2c-62d48b4f78e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:33.150713 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2e231f92-2083-43f2-9a2c-62d48b4f78e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803/ips" status: 200 len: 218 microversion: 2.1 time: 0.233116 Aug 25 13:08:33.153006 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1642/3303] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:08:32 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803/ips => generated 218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:33.168006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21c4fe7b-3cb7-495d-867e-930f42bfeac2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Action: 'create', calling method: .version_select at 0x7f3a2e714430>, body: {"keypair": {"name": "tempest-keypair-334852066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO6MUXIk0xYuIFkwJsO2vs+MebbRujZANw8ZyZN6ro+lvyckFaF+Su7ys1SCzWRrKJjnhwUvaK+C2nq4h964H8Y8mvWOdcT6nKkVzrEILMWBCxGHaZKnDZRMoMsJezM5Q=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:33.212058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-21c4fe7b-3cb7-495d-867e-930f42bfeac2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Getting quotas for project 5c3fdc36fbf645e681d7dd47dfb8ffc0. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:08:33.226094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-21c4fe7b-3cb7-495d-867e-930f42bfeac2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Getting quotas for user d2b54fcd2e6d42e18576f9051c939b41 and project 5c3fdc36fbf645e681d7dd47dfb8ffc0. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:08:33.328219 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-21c4fe7b-3cb7-495d-867e-930f42bfeac2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.172356 Aug 25 13:08:33.333132 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1643/3304] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Aug 25 13:08:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 13:08:33.359982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-30c3e737-cbc1-48cb-bdca-ca9ada5d4cfd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:33.363799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-30c3e737-cbc1-48cb-bdca-ca9ada5d4cfd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:33.395577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c3e737-cbc1-48cb-bdca-ca9ada5d4cfd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:33.399370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c3e737-cbc1-48cb-bdca-ca9ada5d4cfd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:33.400796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c3e737-cbc1-48cb-bdca-ca9ada5d4cfd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:33.404983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c3e737-cbc1-48cb-bdca-ca9ada5d4cfd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:33.407386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c3e737-cbc1-48cb-bdca-ca9ada5d4cfd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:33.411853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c3e737-cbc1-48cb-bdca-ca9ada5d4cfd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:33.520564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-30c3e737-cbc1-48cb-bdca-ca9ada5d4cfd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:08:33.883417 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-30c3e737-cbc1-48cb-bdca-ca9ada5d4cfd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 204 len: 0 microversion: 2.1 time: 0.547218 Aug 25 13:08:33.899338 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1644/3305] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:08:33 2022] DELETE /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:08:33.912038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-db23cb5e-d7ab-4615-aa8d-c839496d266c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:33.913694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-db23cb5e-d7ab-4615-aa8d-c839496d266c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:33.982974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db23cb5e-d7ab-4615-aa8d-c839496d266c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:33.984071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db23cb5e-d7ab-4615-aa8d-c839496d266c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:33.984916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db23cb5e-d7ab-4615-aa8d-c839496d266c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:33.997112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db23cb5e-d7ab-4615-aa8d-c839496d266c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:34.007665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db23cb5e-d7ab-4615-aa8d-c839496d266c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:34.009559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db23cb5e-d7ab-4615-aa8d-c839496d266c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:35.215524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c28d2c0c-469c-46a3-846b-ce847d576db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:35.258943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=54 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:35.327010 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c28d2c0c-469c-46a3-846b-ce847d576db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 3.154378 Aug 25 13:08:35.352512 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1662/3306] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:32 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 3193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:08:36.084780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-334964608", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:37.729300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-db23cb5e-d7ab-4615-aa8d-c839496d266c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:37.772763 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-db23cb5e-d7ab-4615-aa8d-c839496d266c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1811 microversion: 2.1 time: 3.870720 Aug 25 13:08:37.788543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1645/3307] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:33 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1811 bytes in 3886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:08:37.815983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b23b5a0-360f-436d-8864-55dc21a0282e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:37.830074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b23b5a0-360f-436d-8864-55dc21a0282e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:37.860284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b23b5a0-360f-436d-8864-55dc21a0282e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:37.881692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b23b5a0-360f-436d-8864-55dc21a0282e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:37.883245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b23b5a0-360f-436d-8864-55dc21a0282e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:37.888641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b23b5a0-360f-436d-8864-55dc21a0282e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:37.892847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b23b5a0-360f-436d-8864-55dc21a0282e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:37.904074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b23b5a0-360f-436d-8864-55dc21a0282e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:41.626266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b23b5a0-360f-436d-8864-55dc21a0282e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:41.761442 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b23b5a0-360f-436d-8864-55dc21a0282e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 3.969857 Aug 25 13:08:41.777880 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1646/3308] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:37 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 3988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:41.823165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-67bf0d78-90f3-4930-a8a9-4328fafac587 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:41.832346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-67bf0d78-90f3-4930-a8a9-4328fafac587 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:41.914009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67bf0d78-90f3-4930-a8a9-4328fafac587 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:41.925287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67bf0d78-90f3-4930-a8a9-4328fafac587 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:41.930708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67bf0d78-90f3-4930-a8a9-4328fafac587 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:41.935116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67bf0d78-90f3-4930-a8a9-4328fafac587 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:41.941494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67bf0d78-90f3-4930-a8a9-4328fafac587 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:41.947219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67bf0d78-90f3-4930-a8a9-4328fafac587 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:43.254618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:44.361883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-67bf0d78-90f3-4930-a8a9-4328fafac587 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:44.408775 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-67bf0d78-90f3-4930-a8a9-4328fafac587 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1790 microversion: 2.1 time: 2.623066 Aug 25 13:08:44.432168 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1647/3309] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:41 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1790 bytes in 2653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:44.494582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b95436f6-6e73-4f05-9a52-f31fd6f2458d req-d662cc1e-a8cd-466b-a086-f540da9d456b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3eccca-1677-409a-bcf9-99d321525b2b", "name": "network-vif-plugged", "status": "completed", "tag": "4d308beb-5849-4af8-9677-9649024147e8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:44.501898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] validate_networks() for [('83c51425-0208-4ecf-9ac9-35434c20aad6', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:08:44.541196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b95436f6-6e73-4f05-9a52-f31fd6f2458d req-d662cc1e-a8cd-466b-a086-f540da9d456b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:44.544160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b95436f6-6e73-4f05-9a52-f31fd6f2458d req-d662cc1e-a8cd-466b-a086-f540da9d456b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:44.545474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b95436f6-6e73-4f05-9a52-f31fd6f2458d req-d662cc1e-a8cd-466b-a086-f540da9d456b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:44.622367 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b95436f6-6e73-4f05-9a52-f31fd6f2458d req-d662cc1e-a8cd-466b-a086-f540da9d456b service nova] Creating event network-vif-plugged:4d308beb-5849-4af8-9677-9649024147e8 for instance fe3eccca-1677-409a-bcf9-99d321525b2b on n-h2-852771-8 Aug 25 13:08:44.667560 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b95436f6-6e73-4f05-9a52-f31fd6f2458d req-d662cc1e-a8cd-466b-a086-f540da9d456b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232550 Aug 25 13:08:44.693952 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1648/3310] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:44.733094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d030c282-aa19-4d65-834a-f940ea8ddea1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:44.753639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d030c282-aa19-4d65-834a-f940ea8ddea1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:44.818618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030c282-aa19-4d65-834a-f940ea8ddea1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:44.819671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030c282-aa19-4d65-834a-f940ea8ddea1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:44.828674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030c282-aa19-4d65-834a-f940ea8ddea1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:44.829992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030c282-aa19-4d65-834a-f940ea8ddea1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:44.837292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030c282-aa19-4d65-834a-f940ea8ddea1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:44.846100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d030c282-aa19-4d65-834a-f940ea8ddea1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:45.357619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:46.268158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=5 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:46.575478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d030c282-aa19-4d65-834a-f940ea8ddea1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:46.641627 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d030c282-aa19-4d65-834a-f940ea8ddea1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 1.935907 Aug 25 13:08:46.679259 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1649/3311] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:44 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:46.707199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8bc43f3e-4197-4b91-b7d4-a0c0c3e717c5 req-778faa13-5a23-4aab-ad92-4405a29cbd98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff52b3c-3863-430f-8d5d-a61f84d4b803", "name": "network-vif-deleted", "tag": "0d51eaca-3abd-4e01-9f98-d3e55f0a31d3"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:46.793238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8bc43f3e-4197-4b91-b7d4-a0c0c3e717c5 req-778faa13-5a23-4aab-ad92-4405a29cbd98 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:46.794179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8bc43f3e-4197-4b91-b7d4-a0c0c3e717c5 req-778faa13-5a23-4aab-ad92-4405a29cbd98 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:46.794997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8bc43f3e-4197-4b91-b7d4-a0c0c3e717c5 req-778faa13-5a23-4aab-ad92-4405a29cbd98 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:46.922405 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8bc43f3e-4197-4b91-b7d4-a0c0c3e717c5 req-778faa13-5a23-4aab-ad92-4405a29cbd98 service nova] Creating event network-vif-deleted:0d51eaca-3abd-4e01-9f98-d3e55f0a31d3 for instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 on n-h2-852771-8 Aug 25 13:08:46.963105 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8bc43f3e-4197-4b91-b7d4-a0c0c3e717c5 req-778faa13-5a23-4aab-ad92-4405a29cbd98 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272637 Aug 25 13:08:46.992663 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1650/3312] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:47.051515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d02a4de4-b7db-4954-b5fa-c011343a7fbf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:47.062188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d02a4de4-b7db-4954-b5fa-c011343a7fbf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:47.104414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d02a4de4-b7db-4954-b5fa-c011343a7fbf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:47.105373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d02a4de4-b7db-4954-b5fa-c011343a7fbf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:47.125086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d02a4de4-b7db-4954-b5fa-c011343a7fbf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:47.126912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d02a4de4-b7db-4954-b5fa-c011343a7fbf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:47.127846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d02a4de4-b7db-4954-b5fa-c011343a7fbf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:47.128674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d02a4de4-b7db-4954-b5fa-c011343a7fbf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:49.446540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d02a4de4-b7db-4954-b5fa-c011343a7fbf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:49.450881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:08:49.452085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:08:49.453097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:08:49.454211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:08:49.455477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:08:49.495467 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d02a4de4-b7db-4954-b5fa-c011343a7fbf tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1654 microversion: 2.1 time: 2.499162 Aug 25 13:08:49.514518 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1651/3313] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:46 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1654 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:49.533719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:49.536736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:49.538620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:49.540857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:49.549682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:49.553269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:49.565354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1c97cf08-3057-4768-979f-cea8cd3bd8c2 req-8f6f0e7b-8035-4449-ba2a-dfd06f574609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff52b3c-3863-430f-8d5d-a61f84d4b803", "name": "network-vif-unplugged", "status": "completed", "tag": "48720914-340b-4441-8162-238d61a8acb0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:49.637568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1c97cf08-3057-4768-979f-cea8cd3bd8c2 req-8f6f0e7b-8035-4449-ba2a-dfd06f574609 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:49.639965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1c97cf08-3057-4768-979f-cea8cd3bd8c2 req-8f6f0e7b-8035-4449-ba2a-dfd06f574609 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:49.674953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1c97cf08-3057-4768-979f-cea8cd3bd8c2 req-8f6f0e7b-8035-4449-ba2a-dfd06f574609 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:49.727741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Getting quotas for project 47a0144c8345403bb4c6728543a34076. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:08:49.784736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Getting quotas for user e7fbb17c9f8e4220ac149cf51502fd20 and project 47a0144c8345403bb4c6728543a34076. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:08:49.794348 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1c97cf08-3057-4768-979f-cea8cd3bd8c2 req-8f6f0e7b-8035-4449-ba2a-dfd06f574609 service nova] Creating event network-vif-unplugged:48720914-340b-4441-8162-238d61a8acb0 for instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 on n-h2-852771-8 Aug 25 13:08:49.855159 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1c97cf08-3057-4768-979f-cea8cd3bd8c2 req-8f6f0e7b-8035-4449-ba2a-dfd06f574609 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.329161 Aug 25 13:08:49.862779 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1652/3314] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:49.939712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:08:49.946495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5f1d9d1-3b9e-4856-9cb5-1202f6e0a618 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:49.971997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b5f1d9d1-3b9e-4856-9cb5-1202f6e0a618 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:49.986647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:08:50.042279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5f1d9d1-3b9e-4856-9cb5-1202f6e0a618 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:50.044564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5f1d9d1-3b9e-4856-9cb5-1202f6e0a618 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:50.053961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5f1d9d1-3b9e-4856-9cb5-1202f6e0a618 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:50.058676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5f1d9d1-3b9e-4856-9cb5-1202f6e0a618 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:50.065744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5f1d9d1-3b9e-4856-9cb5-1202f6e0a618 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:50.071366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5f1d9d1-3b9e-4856-9cb5-1202f6e0a618 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:50.537552 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12db4105-b428-484b-b2f4-05201ec3b3c7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 15.193790 Aug 25 13:08:50.573697 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1663/3315] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:08:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 15229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:08:50.592985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5672094d-8541-4a13-aedb-3e6cd79ce268 req-ed28ddfe-d97c-4441-8bc9-2026f258988e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff52b3c-3863-430f-8d5d-a61f84d4b803", "name": "network-vif-deleted", "tag": "8824ad2c-abc2-4158-aa6d-0f6647975ab3"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:50.717499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5672094d-8541-4a13-aedb-3e6cd79ce268 req-ed28ddfe-d97c-4441-8bc9-2026f258988e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:50.736956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5672094d-8541-4a13-aedb-3e6cd79ce268 req-ed28ddfe-d97c-4441-8bc9-2026f258988e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:50.737894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5672094d-8541-4a13-aedb-3e6cd79ce268 req-ed28ddfe-d97c-4441-8bc9-2026f258988e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:50.815277 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5672094d-8541-4a13-aedb-3e6cd79ce268 req-ed28ddfe-d97c-4441-8bc9-2026f258988e service nova] Creating event network-vif-deleted:8824ad2c-abc2-4158-aa6d-0f6647975ab3 for instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 on n-h2-852771-8 Aug 25 13:08:50.859437 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5672094d-8541-4a13-aedb-3e6cd79ce268 req-ed28ddfe-d97c-4441-8bc9-2026f258988e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276504 Aug 25 13:08:50.866606 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1664/3316] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:50.920849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b8ed975-17b5-4c99-bf3b-3b58f6452b68 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:50.931587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b8ed975-17b5-4c99-bf3b-3b58f6452b68 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:51.843086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b8ed975-17b5-4c99-bf3b-3b58f6452b68 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:51.903111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b5f1d9d1-3b9e-4856-9cb5-1202f6e0a618 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:51.917950 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b8ed975-17b5-4c99-bf3b-3b58f6452b68 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1213 microversion: 2.1 time: 1.039849 Aug 25 13:08:51.952341 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1665/3317] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:50 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1213 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:51.993894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d3aaceed-48fe-4059-941b-a952f193cc76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:51.999338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d3aaceed-48fe-4059-941b-a952f193cc76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:52.010189 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b5f1d9d1-3b9e-4856-9cb5-1202f6e0a618 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 2.139476 Aug 25 13:08:52.011330 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1653/3318] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:49 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:52.118582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3aaceed-48fe-4059-941b-a952f193cc76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:52.123861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3aaceed-48fe-4059-941b-a952f193cc76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:52.126935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3aaceed-48fe-4059-941b-a952f193cc76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:52.133027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3aaceed-48fe-4059-941b-a952f193cc76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:52.142539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3aaceed-48fe-4059-941b-a952f193cc76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:52.158199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3aaceed-48fe-4059-941b-a952f193cc76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:52.711765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d3aaceed-48fe-4059-941b-a952f193cc76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:52.796074 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d3aaceed-48fe-4059-941b-a952f193cc76 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1454 microversion: 2.1 time: 0.832352 Aug 25 13:08:52.829673 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1666/3319] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:51 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1454 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:52.999143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-15c10588-f4dd-466a-92a2-f14112496513 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:53.007898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-15c10588-f4dd-466a-92a2-f14112496513 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:53.077572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f9bee5f-cffc-40cc-b11d-297d300ffa6a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:53.138757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f9bee5f-cffc-40cc-b11d-297d300ffa6a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:53.215441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9bee5f-cffc-40cc-b11d-297d300ffa6a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:53.234720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9bee5f-cffc-40cc-b11d-297d300ffa6a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:53.235670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9bee5f-cffc-40cc-b11d-297d300ffa6a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:53.237045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9bee5f-cffc-40cc-b11d-297d300ffa6a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:53.238002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9bee5f-cffc-40cc-b11d-297d300ffa6a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:53.238839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9bee5f-cffc-40cc-b11d-297d300ffa6a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:53.568655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-15c10588-f4dd-466a-92a2-f14112496513 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:53.678945 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-15c10588-f4dd-466a-92a2-f14112496513 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1213 microversion: 2.1 time: 0.676445 Aug 25 13:08:53.686011 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1654/3320] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:52 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1213 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:53.884020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ddb9eb2-e376-4909-893f-b08f2bde5b7f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:53.885325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ddb9eb2-e376-4909-893f-b08f2bde5b7f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:53.960808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddb9eb2-e376-4909-893f-b08f2bde5b7f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:53.961816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddb9eb2-e376-4909-893f-b08f2bde5b7f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:53.962692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddb9eb2-e376-4909-893f-b08f2bde5b7f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:53.985279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddb9eb2-e376-4909-893f-b08f2bde5b7f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:53.995073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddb9eb2-e376-4909-893f-b08f2bde5b7f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:53.995957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ddb9eb2-e376-4909-893f-b08f2bde5b7f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:54.787404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f9bee5f-cffc-40cc-b11d-297d300ffa6a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:54.862340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1ddb9eb2-e376-4909-893f-b08f2bde5b7f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:54.869825 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f9bee5f-cffc-40cc-b11d-297d300ffa6a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 1.787428 Aug 25 13:08:54.890196 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1667/3321] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:53 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:54.946888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-635332a6-d14b-4228-b938-cbd20b3244c1 req-4e1524ce-298a-4460-8de0-f6263c4d647a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff52b3c-3863-430f-8d5d-a61f84d4b803", "name": "network-vif-deleted", "tag": "48720914-340b-4441-8162-238d61a8acb0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:54.976172 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ddb9eb2-e376-4909-893f-b08f2bde5b7f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1454 microversion: 2.1 time: 1.099829 Aug 25 13:08:54.979784 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1655/3322] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:53 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1454 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:55.024584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-342bf97e-9dbd-45aa-8bb8-222903b9296e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:55.035231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-342bf97e-9dbd-45aa-8bb8-222903b9296e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:55.051769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-635332a6-d14b-4228-b938-cbd20b3244c1 req-4e1524ce-298a-4460-8de0-f6263c4d647a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:55.058493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-635332a6-d14b-4228-b938-cbd20b3244c1 req-4e1524ce-298a-4460-8de0-f6263c4d647a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:55.068073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-635332a6-d14b-4228-b938-cbd20b3244c1 req-4e1524ce-298a-4460-8de0-f6263c4d647a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:55.090221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342bf97e-9dbd-45aa-8bb8-222903b9296e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:55.095034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342bf97e-9dbd-45aa-8bb8-222903b9296e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:55.100820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342bf97e-9dbd-45aa-8bb8-222903b9296e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:55.114977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342bf97e-9dbd-45aa-8bb8-222903b9296e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:55.119090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342bf97e-9dbd-45aa-8bb8-222903b9296e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:55.126180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342bf97e-9dbd-45aa-8bb8-222903b9296e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:55.178974 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-635332a6-d14b-4228-b938-cbd20b3244c1 req-4e1524ce-298a-4460-8de0-f6263c4d647a service nova] Creating event network-vif-deleted:48720914-340b-4441-8162-238d61a8acb0 for instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 on n-h2-852771-8 Aug 25 13:08:55.228467 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-635332a6-d14b-4228-b938-cbd20b3244c1 req-4e1524ce-298a-4460-8de0-f6263c4d647a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315490 Aug 25 13:08:55.241189 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1668/3323] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:55.942450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4356bd4e-defb-443d-9455-0b22992ab6ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:55.953643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4356bd4e-defb-443d-9455-0b22992ab6ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:56.058436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4356bd4e-defb-443d-9455-0b22992ab6ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:56.071798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4356bd4e-defb-443d-9455-0b22992ab6ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:56.080160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4356bd4e-defb-443d-9455-0b22992ab6ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:56.087995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4356bd4e-defb-443d-9455-0b22992ab6ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:56.098835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4356bd4e-defb-443d-9455-0b22992ab6ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:56.112165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4356bd4e-defb-443d-9455-0b22992ab6ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:56.113404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-342bf97e-9dbd-45aa-8bb8-222903b9296e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:56.171374 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-342bf97e-9dbd-45aa-8bb8-222903b9296e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1209 microversion: 2.1 time: 1.182920 Aug 25 13:08:56.191083 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1656/3324] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:54 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1209 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:56.239608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:56.247922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:56.299128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:56.303560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:56.305022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:56.311747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:56.321733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:56.323828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:56.517588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:56.521202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:56.522590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:56.526189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lazy-loading 'fault' on Instance uuid 5ff52b3c-3863-430f-8d5d-a61f84d4b803 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:08:57.210109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:57.246740 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f997695b-23ec-466d-b932-6bd782a1cf1c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 200 len: 1303 microversion: 2.1 time: 1.040941 Aug 25 13:08:57.251016 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1657/3325] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:56 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 1303 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:57.289597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1236218042", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5a85d56a-08d6-41fa-9046-31ed5c33cbfc"}, {"port": "5ef83c87-8cc0-47a2-bbb9-0e65f095a703", "tag": "port-1"}, {"port": "3d6b512c-f6c6-4653-ac20-613fdfd4cfd3", "tag": "port-2"}, {"uuid": "fd6df116-3b27-47bf-95f7-9ee6addc3c13", "tag": "net-1"}, {"uuid": "fd6df116-3b27-47bf-95f7-9ee6addc3c13"}, {"uuid": "0f81eeae-1513-4e70-8469-f4c7e287908c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0f81eeae-1513-4e70-8469-f4c7e287908c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4e6da80e-595d-43bd-b304-b768b8514385", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "0ef73d5b-95df-4a0c-a1c2-398154b2d243", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "bac802fb-6255-4c0e-9dcc-86570dc50b1f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1899979695"}], "key_name": "tempest-keypair-334852066", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:57.717916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4356bd4e-defb-443d-9455-0b22992ab6ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:57.776479 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4356bd4e-defb-443d-9455-0b22992ab6ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 1.840434 Aug 25 13:08:57.778575 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1669/3326] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:55 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:57.795475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f104c96-18b4-47ba-982a-22c7772e205e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:57.804073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3f104c96-18b4-47ba-982a-22c7772e205e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:57.855040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f104c96-18b4-47ba-982a-22c7772e205e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:57.856048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f104c96-18b4-47ba-982a-22c7772e205e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:57.861369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f104c96-18b4-47ba-982a-22c7772e205e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:57.869287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f104c96-18b4-47ba-982a-22c7772e205e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:57.874396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f104c96-18b4-47ba-982a-22c7772e205e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:57.875796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f104c96-18b4-47ba-982a-22c7772e205e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:58.424407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f104c96-18b4-47ba-982a-22c7772e205e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:58.462412 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f104c96-18b4-47ba-982a-22c7772e205e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1271 microversion: 2.1 time: 0.679131 Aug 25 13:08:58.464350 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1670/3327] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:57 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1271 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:58.493568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:58.497463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:58.529151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:58.532952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:58.540395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:58.544545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:58.548837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:58.552503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:58.590904 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] HTTP exception thrown: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Request method failure captured: Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 HTTP/1.1 Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3POXNRKd0tvHJaCM_MnchLdTIdvihPGNW0Rhj-FWNq7R6OlXJbvYd3sYUXr4B_6gNZ7d4eWfyTqE240ftu8M9vU00dK6FwI_2OZsOjcmPp8fqpOwXWsxn3g3pfwcj77amgNOlf5CPDmdyrhz6XR-J7H6XunLvP6TCzZAGZ_zPMwxXM Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d45cd11baec04239813f9d36160ec4ac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}] Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestMultiNic-702527879 Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestMultiNic-702527879-project Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a6404bb298fe405c8d2b782c83544a58 Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestMultiNic-702527879-project Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '5ff52b3c-3863-430f-8d5d-a61f84d4b803'} Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:58.596826 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:08:58.612048 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:58.612048 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:58.612048 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:58.612048 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:08:58.612048 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:08:58.612048 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:08:58.612048 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:08:58.612048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Returning 404 to user: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:08:58.616071 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-27667d3b-5dfa-4265-afa3-5fd8d0937cd2 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 404 len: 111 microversion: 2.1 time: 0.145747 Aug 25 13:08:58.619160 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1671/3328] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:58 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:08:58.837193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3020408f-e6e1-4430-a879-af6e04b610e0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:58.845095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3020408f-e6e1-4430-a879-af6e04b610e0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:58.876534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3020408f-e6e1-4430-a879-af6e04b610e0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:58.880311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3020408f-e6e1-4430-a879-af6e04b610e0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:58.882511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3020408f-e6e1-4430-a879-af6e04b610e0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:58.887351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3020408f-e6e1-4430-a879-af6e04b610e0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:58.890855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3020408f-e6e1-4430-a879-af6e04b610e0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:58.893127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3020408f-e6e1-4430-a879-af6e04b610e0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:59.595608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:00.083806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3020408f-e6e1-4430-a879-af6e04b610e0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:00.128417 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3020408f-e6e1-4430-a879-af6e04b610e0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 1.299666 Aug 25 13:09:00.167874 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1672/3329] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:58 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:00.187813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d63bafc-3b9c-4cc8-af3b-7edf7dc142ec tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:00.190692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9d63bafc-3b9c-4cc8-af3b-7edf7dc142ec tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:00.218156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d63bafc-3b9c-4cc8-af3b-7edf7dc142ec tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:00.222421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d63bafc-3b9c-4cc8-af3b-7edf7dc142ec tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:00.224234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d63bafc-3b9c-4cc8-af3b-7edf7dc142ec tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:00.229483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d63bafc-3b9c-4cc8-af3b-7edf7dc142ec tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:00.231694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d63bafc-3b9c-4cc8-af3b-7edf7dc142ec tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:00.236223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d63bafc-3b9c-4cc8-af3b-7edf7dc142ec tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:01.127803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d63bafc-3b9c-4cc8-af3b-7edf7dc142ec tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:01.172112 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d63bafc-3b9c-4cc8-af3b-7edf7dc142ec tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1271 microversion: 2.1 time: 1.002051 Aug 25 13:09:01.173237 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1673/3330] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:00 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1271 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:01.204549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d37aa37-0293-41dd-be5e-d045831f3f4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:01.217226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4d37aa37-0293-41dd-be5e-d045831f3f4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:01.265484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d37aa37-0293-41dd-be5e-d045831f3f4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:01.268939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d37aa37-0293-41dd-be5e-d045831f3f4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:01.277498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d37aa37-0293-41dd-be5e-d045831f3f4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:01.279485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d37aa37-0293-41dd-be5e-d045831f3f4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:01.286594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d37aa37-0293-41dd-be5e-d045831f3f4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:01.292898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d37aa37-0293-41dd-be5e-d045831f3f4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:01.896553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:02.347285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4d37aa37-0293-41dd-be5e-d045831f3f4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:02.381483 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d37aa37-0293-41dd-be5e-d045831f3f4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 1.192409 Aug 25 13:09:02.386362 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1674/3331] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:01 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:02.409960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e757d16b-5010-4e71-8d64-bf2b8e8ce765 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:02.415279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e757d16b-5010-4e71-8d64-bf2b8e8ce765 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:02.442721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e757d16b-5010-4e71-8d64-bf2b8e8ce765 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:02.444081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e757d16b-5010-4e71-8d64-bf2b8e8ce765 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:02.449115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e757d16b-5010-4e71-8d64-bf2b8e8ce765 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:02.451115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e757d16b-5010-4e71-8d64-bf2b8e8ce765 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:02.453223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e757d16b-5010-4e71-8d64-bf2b8e8ce765 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:02.462389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e757d16b-5010-4e71-8d64-bf2b8e8ce765 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:02.903429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e757d16b-5010-4e71-8d64-bf2b8e8ce765 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:02.949666 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e757d16b-5010-4e71-8d64-bf2b8e8ce765 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1313 microversion: 2.1 time: 0.560460 Aug 25 13:09:02.955871 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1675/3332] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:02 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:02.977064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f55a9b98-0e6f-411e-9f16-0c023e675906 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:02.983149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f55a9b98-0e6f-411e-9f16-0c023e675906 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:03.007458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f55a9b98-0e6f-411e-9f16-0c023e675906 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:03.009245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f55a9b98-0e6f-411e-9f16-0c023e675906 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:03.010590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f55a9b98-0e6f-411e-9f16-0c023e675906 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:03.015174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f55a9b98-0e6f-411e-9f16-0c023e675906 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:03.016511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f55a9b98-0e6f-411e-9f16-0c023e675906 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:03.021150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f55a9b98-0e6f-411e-9f16-0c023e675906 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:03.174200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f55a9b98-0e6f-411e-9f16-0c023e675906 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:09:03.639398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:03.659175 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f55a9b98-0e6f-411e-9f16-0c023e675906 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "DELETE /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 204 len: 0 microversion: 2.42 time: 0.699895 Aug 25 13:09:03.663213 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1676/3333] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:09:02 2022] DELETE /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 0 bytes in 706 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:09:03.704639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0ec62168-f9d0-4e5e-b72c-d0cfcf8d4b0f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:03.710419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0ec62168-f9d0-4e5e-b72c-d0cfcf8d4b0f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:03.750895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ec62168-f9d0-4e5e-b72c-d0cfcf8d4b0f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:03.754989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ec62168-f9d0-4e5e-b72c-d0cfcf8d4b0f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:03.758482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ec62168-f9d0-4e5e-b72c-d0cfcf8d4b0f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:03.763358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ec62168-f9d0-4e5e-b72c-d0cfcf8d4b0f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:03.766928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ec62168-f9d0-4e5e-b72c-d0cfcf8d4b0f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:03.768175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ec62168-f9d0-4e5e-b72c-d0cfcf8d4b0f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:05.073233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ec62168-f9d0-4e5e-b72c-d0cfcf8d4b0f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:05.102989 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0ec62168-f9d0-4e5e-b72c-d0cfcf8d4b0f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 1.436961 Aug 25 13:09:05.110254 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1677/3334] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:03 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:05.133977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:05.138746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:05.179872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:05.186139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:05.191520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:05.200933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:05.209900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:05.211451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:07.221404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:07.401444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:07.691274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:07.766674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:07.787796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:07.793953 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d1841097-47f7-42c1-9373-de3aaba92122 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 2955 microversion: 2.42 time: 2.678766 Aug 25 13:09:07.802091 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1678/3335] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:05 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 2955 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:07.835954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5154566-daa0-4665-a169-2ab30bbe7cf7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:07.848401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5154566-daa0-4665-a169-2ab30bbe7cf7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:07.869752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5154566-daa0-4665-a169-2ab30bbe7cf7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:07.871500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5154566-daa0-4665-a169-2ab30bbe7cf7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:07.875648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5154566-daa0-4665-a169-2ab30bbe7cf7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:07.879667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5154566-daa0-4665-a169-2ab30bbe7cf7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:07.889277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5154566-daa0-4665-a169-2ab30bbe7cf7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:07.895254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5154566-daa0-4665-a169-2ab30bbe7cf7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:09.993659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5154566-daa0-4665-a169-2ab30bbe7cf7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:10.028998 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5154566-daa0-4665-a169-2ab30bbe7cf7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1313 microversion: 2.1 time: 2.219301 Aug 25 13:09:10.039994 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1679/3336] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:07 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1313 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:10.087418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f207268-e9e4-4ab6-9121-7857102f7f96 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:10.116850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0f207268-e9e4-4ab6-9121-7857102f7f96 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:10.142499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f207268-e9e4-4ab6-9121-7857102f7f96 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:10.155805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f207268-e9e4-4ab6-9121-7857102f7f96 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:10.157285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f207268-e9e4-4ab6-9121-7857102f7f96 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:10.161047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f207268-e9e4-4ab6-9121-7857102f7f96 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:10.162709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f207268-e9e4-4ab6-9121-7857102f7f96 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:10.166014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f207268-e9e4-4ab6-9121-7857102f7f96 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:13.757574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f207268-e9e4-4ab6-9121-7857102f7f96 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:13.785902 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0f207268-e9e4-4ab6-9121-7857102f7f96 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 3.743274 Aug 25 13:09:13.801559 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1680/3337] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:10 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 3753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:13.801890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:13.802497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:13.826697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:13.837719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:13.840564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:13.848558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:13.850009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:13.851136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:13.993653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:16.398533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:16.459875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:16.483939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:16.497622 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c4bd849-3d9f-4521-81ed-1313cf4703ae tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 2955 microversion: 2.42 time: 2.691314 Aug 25 13:09:16.499370 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1681/3338] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:13 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 2955 bytes in 2705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:16.523057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a1fa731-8af8-4279-be1a-0bb4f3982e84 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:16.524316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7a1fa731-8af8-4279-be1a-0bb4f3982e84 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:16.577858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:16.595874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1fa731-8af8-4279-be1a-0bb4f3982e84 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:16.607209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1fa731-8af8-4279-be1a-0bb4f3982e84 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:16.608343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1fa731-8af8-4279-be1a-0bb4f3982e84 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:16.610909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1fa731-8af8-4279-be1a-0bb4f3982e84 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:16.611793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1fa731-8af8-4279-be1a-0bb4f3982e84 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:16.617002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a1fa731-8af8-4279-be1a-0bb4f3982e84 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:18.007934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7a1fa731-8af8-4279-be1a-0bb4f3982e84 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:18.052043 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a1fa731-8af8-4279-be1a-0bb4f3982e84 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1313 microversion: 2.1 time: 1.550502 Aug 25 13:09:18.083144 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1682/3339] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:16 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1313 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:18.111256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-499ca5a0-af42-4302-b261-53dfb0cdd5ff req-32ab7d31-c183-4496-b5bd-d23b5d512e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-unplugged", "status": "completed", "tag": "ed5bbca5-cf27-4cc2-9c60-a1ffe6539741"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:18.181738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-499ca5a0-af42-4302-b261-53dfb0cdd5ff req-32ab7d31-c183-4496-b5bd-d23b5d512e07 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:18.182612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-499ca5a0-af42-4302-b261-53dfb0cdd5ff req-32ab7d31-c183-4496-b5bd-d23b5d512e07 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:18.184053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-499ca5a0-af42-4302-b261-53dfb0cdd5ff req-32ab7d31-c183-4496-b5bd-d23b5d512e07 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:18.225386 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-499ca5a0-af42-4302-b261-53dfb0cdd5ff req-32ab7d31-c183-4496-b5bd-d23b5d512e07 service nova] Creating event network-vif-unplugged:ed5bbca5-cf27-4cc2-9c60-a1ffe6539741 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:09:18.260765 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-499ca5a0-af42-4302-b261-53dfb0cdd5ff req-32ab7d31-c183-4496-b5bd-d23b5d512e07 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174500 Aug 25 13:09:18.261994 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1683/3340] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:18.287002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-22459651-cbc0-42e5-8df4-5333650a2668 req-d6e4239c-7bc2-4eb2-bcc5-88bdab47a8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18298dec-561e-48d1-a00c-d1704f098b69", "tag": "e960576e-e63f-4e71-b5fe-c700497e49cd"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:18.344251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-22459651-cbc0-42e5-8df4-5333650a2668 req-d6e4239c-7bc2-4eb2-bcc5-88bdab47a8e9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:18.348666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-22459651-cbc0-42e5-8df4-5333650a2668 req-d6e4239c-7bc2-4eb2-bcc5-88bdab47a8e9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:18.350132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-22459651-cbc0-42e5-8df4-5333650a2668 req-d6e4239c-7bc2-4eb2-bcc5-88bdab47a8e9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:18.401572 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-22459651-cbc0-42e5-8df4-5333650a2668 req-d6e4239c-7bc2-4eb2-bcc5-88bdab47a8e9 service nova] Creating event network-changed:e960576e-e63f-4e71-b5fe-c700497e49cd for instance 18298dec-561e-48d1-a00c-d1704f098b69 on n-h1-852771-8 Aug 25 13:09:18.422545 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-22459651-cbc0-42e5-8df4-5333650a2668 req-d6e4239c-7bc2-4eb2-bcc5-88bdab47a8e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155544 Aug 25 13:09:18.428906 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1684/3341] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:18.449816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2e7ca19e-cbbb-4f4d-bf91-e77721b3cc72 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:18.455366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2e7ca19e-cbbb-4f4d-bf91-e77721b3cc72 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:18.479514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e7ca19e-cbbb-4f4d-bf91-e77721b3cc72 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:18.485108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e7ca19e-cbbb-4f4d-bf91-e77721b3cc72 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:18.488143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e7ca19e-cbbb-4f4d-bf91-e77721b3cc72 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:18.493835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e7ca19e-cbbb-4f4d-bf91-e77721b3cc72 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:18.499378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e7ca19e-cbbb-4f4d-bf91-e77721b3cc72 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:18.502508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e7ca19e-cbbb-4f4d-bf91-e77721b3cc72 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:19.684229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] validate_networks() for [('5a85d56a-08d6-41fa-9046-31ed5c33cbfc', None, None, None, None, None), (None, None, '5ef83c87-8cc0-47a2-bbb9-0e65f095a703', None, None, None), (None, None, '3d6b512c-f6c6-4653-ac20-613fdfd4cfd3', None, None, None), ('fd6df116-3b27-47bf-95f7-9ee6addc3c13', None, None, None, None, None), ('fd6df116-3b27-47bf-95f7-9ee6addc3c13', None, None, None, None, None), ('0f81eeae-1513-4e70-8469-f4c7e287908c', '10.2.2.100', None, None, None, None), ('0f81eeae-1513-4e70-8469-f4c7e287908c', '10.2.2.200', None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:09:20.012022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2e7ca19e-cbbb-4f4d-bf91-e77721b3cc72 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:20.044594 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2e7ca19e-cbbb-4f4d-bf91-e77721b3cc72 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1680 microversion: 2.1 time: 1.612873 Aug 25 13:09:20.047240 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1685/3342] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:18 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1680 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:20.060236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:20.061977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:20.090394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:20.092756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:20.094334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:20.096078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:20.097255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:20.099015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:22.104836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:22.181263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:22.196137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:22.199237 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2e99c832-5ca4-456d-8d72-fc22ea6b88c8 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 2913 microversion: 2.42 time: 2.149324 Aug 25 13:09:22.200885 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1686/3343] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:20 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 2913 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:22.229911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9b253cba-cbd0-4ab3-a31e-244788bf0a18 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:22.236886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9b253cba-cbd0-4ab3-a31e-244788bf0a18 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:22.284337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b253cba-cbd0-4ab3-a31e-244788bf0a18 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:22.287599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b253cba-cbd0-4ab3-a31e-244788bf0a18 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:22.289276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b253cba-cbd0-4ab3-a31e-244788bf0a18 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:22.292109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b253cba-cbd0-4ab3-a31e-244788bf0a18 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:22.293457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b253cba-cbd0-4ab3-a31e-244788bf0a18 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:22.294910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b253cba-cbd0-4ab3-a31e-244788bf0a18 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:25.208430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9b253cba-cbd0-4ab3-a31e-244788bf0a18 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:25.255519 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9b253cba-cbd0-4ab3-a31e-244788bf0a18 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1313 microversion: 2.1 time: 3.049694 Aug 25 13:09:25.262628 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1687/3344] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:22 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1313 bytes in 3061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:25.297774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c66a0479-8ab1-457b-8c14-7954ff24cab1 req-622f5a3f-5071-465e-9076-3799ef71d837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-unplugged", "status": "completed", "tag": "dd23ef5c-d8a0-4337-97d4-d03bd3e7954e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:25.337844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c66a0479-8ab1-457b-8c14-7954ff24cab1 req-622f5a3f-5071-465e-9076-3799ef71d837 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:25.339555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c66a0479-8ab1-457b-8c14-7954ff24cab1 req-622f5a3f-5071-465e-9076-3799ef71d837 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:25.341144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c66a0479-8ab1-457b-8c14-7954ff24cab1 req-622f5a3f-5071-465e-9076-3799ef71d837 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:25.401476 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c66a0479-8ab1-457b-8c14-7954ff24cab1 req-622f5a3f-5071-465e-9076-3799ef71d837 service nova] Creating event network-vif-unplugged:dd23ef5c-d8a0-4337-97d4-d03bd3e7954e for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:09:25.422365 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c66a0479-8ab1-457b-8c14-7954ff24cab1 req-622f5a3f-5071-465e-9076-3799ef71d837 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142427 Aug 25 13:09:25.427999 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1688/3345] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:25.470600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ee95fcd-6162-4bed-a78d-16d9cf6a3620 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:25.476227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3ee95fcd-6162-4bed-a78d-16d9cf6a3620 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:25.533286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ee95fcd-6162-4bed-a78d-16d9cf6a3620 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:25.536496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ee95fcd-6162-4bed-a78d-16d9cf6a3620 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:25.540793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ee95fcd-6162-4bed-a78d-16d9cf6a3620 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:25.550169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ee95fcd-6162-4bed-a78d-16d9cf6a3620 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:25.552885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ee95fcd-6162-4bed-a78d-16d9cf6a3620 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:25.556949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ee95fcd-6162-4bed-a78d-16d9cf6a3620 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:26.883605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3ee95fcd-6162-4bed-a78d-16d9cf6a3620 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:26.937329 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3ee95fcd-6162-4bed-a78d-16d9cf6a3620 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.502238 Aug 25 13:09:26.942278 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1689/3346] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:25 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:26.965264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:26.971109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:26.998737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:27.002298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:27.003480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:27.006009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:27.015780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:27.016839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:29.153015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:29.198893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:29.204525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:29.207786 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-406589cb-d975-47ef-931e-3c92fa4906e0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 2821 microversion: 2.42 time: 2.251797 Aug 25 13:09:29.221553 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1690/3347] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:26 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 2821 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:29.221553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2e895931-bfad-4686-a4e9-3f7acdb1fc09 req-645eab7e-d1dc-4231-94d7-4502f4c5751b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-deleted", "tag": "2220c4ad-2d43-43af-8e24-1c7cdc12d117"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:29.242897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2e895931-bfad-4686-a4e9-3f7acdb1fc09 req-645eab7e-d1dc-4231-94d7-4502f4c5751b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:29.242897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2e895931-bfad-4686-a4e9-3f7acdb1fc09 req-645eab7e-d1dc-4231-94d7-4502f4c5751b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:29.242897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2e895931-bfad-4686-a4e9-3f7acdb1fc09 req-645eab7e-d1dc-4231-94d7-4502f4c5751b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:29.279326 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2e895931-bfad-4686-a4e9-3f7acdb1fc09 req-645eab7e-d1dc-4231-94d7-4502f4c5751b service nova] Creating event network-vif-deleted:2220c4ad-2d43-43af-8e24-1c7cdc12d117 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:09:29.319462 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2e895931-bfad-4686-a4e9-3f7acdb1fc09 req-645eab7e-d1dc-4231-94d7-4502f4c5751b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107652 Aug 25 13:09:29.322730 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1691/3348] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:29.334289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8795681b-3bce-4a9b-ad67-69a9c5356c96 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:29.337128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8795681b-3bce-4a9b-ad67-69a9c5356c96 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:29.351088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8795681b-3bce-4a9b-ad67-69a9c5356c96 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:29.353219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8795681b-3bce-4a9b-ad67-69a9c5356c96 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:29.354648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8795681b-3bce-4a9b-ad67-69a9c5356c96 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:29.356324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8795681b-3bce-4a9b-ad67-69a9c5356c96 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:29.357486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8795681b-3bce-4a9b-ad67-69a9c5356c96 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:29.358663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8795681b-3bce-4a9b-ad67-69a9c5356c96 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:30.459115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8795681b-3bce-4a9b-ad67-69a9c5356c96 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:30.488290 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8795681b-3bce-4a9b-ad67-69a9c5356c96 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1313 microversion: 2.1 time: 1.162776 Aug 25 13:09:30.497726 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1692/3349] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:29 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1313 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:30.516174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-501f9f89-98ad-4d5a-88c8-26049324c848 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:30.522256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-501f9f89-98ad-4d5a-88c8-26049324c848 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:30.557038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-501f9f89-98ad-4d5a-88c8-26049324c848 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:30.563929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-501f9f89-98ad-4d5a-88c8-26049324c848 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:30.565247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-501f9f89-98ad-4d5a-88c8-26049324c848 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:30.573121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-501f9f89-98ad-4d5a-88c8-26049324c848 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:30.574548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-501f9f89-98ad-4d5a-88c8-26049324c848 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:30.575696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-501f9f89-98ad-4d5a-88c8-26049324c848 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:32.437806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-501f9f89-98ad-4d5a-88c8-26049324c848 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:32.509346 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-501f9f89-98ad-4d5a-88c8-26049324c848 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.009557 Aug 25 13:09:32.545726 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1693/3350] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:30 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:32.574263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9fa14c73-e05a-4e9b-af34-318870e8dfc0 req-5b703895-e7c2-47cd-91fd-b7afa0dbd903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-unplugged", "status": "completed", "tag": "bd20681c-2a18-4c40-b6eb-ea84168bffcb"}, {"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-unplugged", "status": "completed", "tag": "f3625622-a332-4f68-bfa8-134a05eaf7d2"}, {"server_uuid": "fe3eccca-1677-409a-bcf9-99d321525b2b", "name": "network-vif-unplugged", "status": "completed", "tag": "4d308beb-5849-4af8-9677-9649024147e8"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:32.624836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9fa14c73-e05a-4e9b-af34-318870e8dfc0 req-5b703895-e7c2-47cd-91fd-b7afa0dbd903 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:32.625648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9fa14c73-e05a-4e9b-af34-318870e8dfc0 req-5b703895-e7c2-47cd-91fd-b7afa0dbd903 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:32.626467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9fa14c73-e05a-4e9b-af34-318870e8dfc0 req-5b703895-e7c2-47cd-91fd-b7afa0dbd903 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:32.723364 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9fa14c73-e05a-4e9b-af34-318870e8dfc0 req-5b703895-e7c2-47cd-91fd-b7afa0dbd903 service nova] Creating event network-vif-unplugged:bd20681c-2a18-4c40-b6eb-ea84168bffcb for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:09:32.727566 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9fa14c73-e05a-4e9b-af34-318870e8dfc0 req-5b703895-e7c2-47cd-91fd-b7afa0dbd903 service nova] Creating event network-vif-unplugged:f3625622-a332-4f68-bfa8-134a05eaf7d2 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:09:32.732858 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9fa14c73-e05a-4e9b-af34-318870e8dfc0 req-5b703895-e7c2-47cd-91fd-b7afa0dbd903 service nova] Creating event network-vif-unplugged:4d308beb-5849-4af8-9677-9649024147e8 for instance fe3eccca-1677-409a-bcf9-99d321525b2b on n-h2-852771-8 Aug 25 13:09:32.775186 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9fa14c73-e05a-4e9b-af34-318870e8dfc0 req-5b703895-e7c2-47cd-91fd-b7afa0dbd903 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.226422 Aug 25 13:09:32.777703 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1694/3351] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:32.799824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:32.801793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:32.825317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:32.830762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:32.832823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:32.841761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:32.843915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:32.845083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:34.406799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:34.449251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:34.455559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:34.463868 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-88c32cae-519a-46a9-b8a4-8de6653ef2d2 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 2662 microversion: 2.42 time: 1.683430 Aug 25 13:09:34.467949 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1695/3352] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:32 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 2662 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:34.489378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3c4f5d68-3698-444b-9959-85c33f51b56e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:34.491042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3c4f5d68-3698-444b-9959-85c33f51b56e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:34.518585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c4f5d68-3698-444b-9959-85c33f51b56e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:34.520436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c4f5d68-3698-444b-9959-85c33f51b56e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:34.523493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c4f5d68-3698-444b-9959-85c33f51b56e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:34.528309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c4f5d68-3698-444b-9959-85c33f51b56e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:34.529864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c4f5d68-3698-444b-9959-85c33f51b56e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:34.530981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c4f5d68-3698-444b-9959-85c33f51b56e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:36.314333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3c4f5d68-3698-444b-9959-85c33f51b56e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:36.383144 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3c4f5d68-3698-444b-9959-85c33f51b56e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1313 microversion: 2.1 time: 1.908784 Aug 25 13:09:36.393020 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1696/3353] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:34 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1313 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:36.422524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4962d768-10db-4c74-819e-0722cc8106c4 req-67087b59-6e55-4f44-bdc0-cb5be687d7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-deleted", "tag": "ed5bbca5-cf27-4cc2-9c60-a1ffe6539741"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:36.474223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:36.476067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4962d768-10db-4c74-819e-0722cc8106c4 req-67087b59-6e55-4f44-bdc0-cb5be687d7c5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:36.477029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4962d768-10db-4c74-819e-0722cc8106c4 req-67087b59-6e55-4f44-bdc0-cb5be687d7c5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:36.486085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4962d768-10db-4c74-819e-0722cc8106c4 req-67087b59-6e55-4f44-bdc0-cb5be687d7c5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:36.543126 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4962d768-10db-4c74-819e-0722cc8106c4 req-67087b59-6e55-4f44-bdc0-cb5be687d7c5 service nova] Creating event network-vif-deleted:ed5bbca5-cf27-4cc2-9c60-a1ffe6539741 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:09:36.574404 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4962d768-10db-4c74-819e-0722cc8106c4 req-67087b59-6e55-4f44-bdc0-cb5be687d7c5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175706 Aug 25 13:09:36.578861 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1697/3354] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:36.605947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1022255568", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "12ad781a-0a79-4b36-9a34-1c84378b6a34"}, {"uuid": "5e2aa989-3878-4400-a322-599074b7be1d"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:36.878092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] validate_networks() for [('12ad781a-0a79-4b36-9a34-1c84378b6a34', None, None, None, None, None), ('5e2aa989-3878-4400-a322-599074b7be1d', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:09:44.080154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:09:44.081226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:09:44.082779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:09:44.083587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:09:44.085798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:09:44.128678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:44.131218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:44.132519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:44.134819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:44.136897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:44.138703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:44.166261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=75 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:44.191360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Getting quotas for project d45cd11baec04239813f9d36160ec4ac. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:09:44.206479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Getting quotas for user a6404bb298fe405c8d2b782c83544a58 and project d45cd11baec04239813f9d36160ec4ac. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:09:44.265149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:09:44.271175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:09:44.484181 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43a058a0-28a9-4e1f-885c-c24c070e82fa tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.900087 Aug 25 13:09:44.486449 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1698/3355] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 7905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:09:44.522585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-880fb3a3-7981-407e-89b7-b01cec0acb47 req-2d1bdb73-24ac-4112-91ca-dbeaf0e4232e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18298dec-561e-48d1-a00c-d1704f098b69", "name": "network-vif-plugged", "status": "completed", "tag": "e960576e-e63f-4e71-b5fe-c700497e49cd"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:44.557399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:09:44.559964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:09:44.561283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:09:44.562648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:09:44.567235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:09:44.580692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-880fb3a3-7981-407e-89b7-b01cec0acb47 req-2d1bdb73-24ac-4112-91ca-dbeaf0e4232e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:44.585296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-880fb3a3-7981-407e-89b7-b01cec0acb47 req-2d1bdb73-24ac-4112-91ca-dbeaf0e4232e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:44.588608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-880fb3a3-7981-407e-89b7-b01cec0acb47 req-2d1bdb73-24ac-4112-91ca-dbeaf0e4232e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:44.622322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:44.623257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:44.624102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:44.625677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:44.626584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:44.627414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:44.701556 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-880fb3a3-7981-407e-89b7-b01cec0acb47 req-2d1bdb73-24ac-4112-91ca-dbeaf0e4232e service nova] Creating event network-vif-plugged:e960576e-e63f-4e71-b5fe-c700497e49cd for instance 18298dec-561e-48d1-a00c-d1704f098b69 on n-h1-852771-8 Aug 25 13:09:44.742149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Getting quotas for project 5c3fdc36fbf645e681d7dd47dfb8ffc0. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:09:44.754703 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-880fb3a3-7981-407e-89b7-b01cec0acb47 req-2d1bdb73-24ac-4112-91ca-dbeaf0e4232e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264134 Aug 25 13:09:44.765217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Getting quotas for user d2b54fcd2e6d42e18576f9051c939b41 and project 5c3fdc36fbf645e681d7dd47dfb8ffc0. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:09:44.766319 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1699/3356] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:44.793401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:44.796209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:44.849643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:44.859321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:44.860537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:44.862518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:44.864997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:44.867005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:45.198204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:45.231075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:45.241413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:45.248474 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-99452732-ae19-4efd-98ae-f5364c1acf6e tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 2435 microversion: 2.42 time: 0.478846 Aug 25 13:09:45.252695 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1700/3357] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:44 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 2435 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:45.263360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a79ee9a1-af15-40c5-a557-a9eb502b6751 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:45.264969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a79ee9a1-af15-40c5-a557-a9eb502b6751 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:45.317449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a79ee9a1-af15-40c5-a557-a9eb502b6751 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:45.325746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a79ee9a1-af15-40c5-a557-a9eb502b6751 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:45.326031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a79ee9a1-af15-40c5-a557-a9eb502b6751 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:45.330831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a79ee9a1-af15-40c5-a557-a9eb502b6751 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:45.339665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a79ee9a1-af15-40c5-a557-a9eb502b6751 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:45.340450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a79ee9a1-af15-40c5-a557-a9eb502b6751 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:45.669193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:09:45.681882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4e6da80e-595d-43bd-b304-b768b8514385',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='0ef73d5b-95df-4a0c-a1c2-398154b2d243',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bac802fb-6255-4c0e-9dcc-86570dc50b1f',volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:09:46.768533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a79ee9a1-af15-40c5-a557-a9eb502b6751 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:46.794081 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a79ee9a1-af15-40c5-a557-a9eb502b6751 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.538596 Aug 25 13:09:46.796216 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1701/3358] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:45 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:47.344205 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0450d5d7-4e03-43b3-9306-e9a4e2673c68 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 50.088918 Aug 25 13:09:47.354441 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1658/3359] 10.222.0.70 () {62 vars in 1189 bytes} [Thu Aug 25 13:08:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 50102 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:09:47.394177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-75aa8dfc-a24f-45a7-adf0-389a13796d87 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:47.398852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-75aa8dfc-a24f-45a7-adf0-389a13796d87 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:47.450308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75aa8dfc-a24f-45a7-adf0-389a13796d87 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:47.452129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75aa8dfc-a24f-45a7-adf0-389a13796d87 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:47.454532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75aa8dfc-a24f-45a7-adf0-389a13796d87 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:47.460274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75aa8dfc-a24f-45a7-adf0-389a13796d87 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:47.463095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75aa8dfc-a24f-45a7-adf0-389a13796d87 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:47.469672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75aa8dfc-a24f-45a7-adf0-389a13796d87 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:47.528872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ceb0779a-e664-48df-93b8-b9ca22454281 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Action: 'create', calling method: .version_select at 0x7f3a2e879550>, body: {"keypair": {"name": "tempest-keypair-1057297451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcn7bZJLhiYFu3zJ7u9bA1INVBJ/UZnFv1xGbfy1pXcLTP9H7XbFFtzfeC1hQ2hpRUuObEQs8rSmbstR5Isd/EuHAbeT2y/PMZ5KY0TZ4oRvzcdpklQLSnpf4tqPKnZRg=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:47.564496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:47.683899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ceb0779a-e664-48df-93b8-b9ca22454281 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Getting quotas for project bafd8cfabac543a6b7377b7cd451c693. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:09:47.736478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ceb0779a-e664-48df-93b8-b9ca22454281 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Getting quotas for user e8531c673eba41deac6429590dd70a6f and project bafd8cfabac543a6b7377b7cd451c693. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:09:47.891171 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ceb0779a-e664-48df-93b8-b9ca22454281 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.072123 Aug 25 13:09:47.908866 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1702/3360] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:09:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:47.927362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ceeb5c27-b6e2-4312-9039-d2b3e5aaefcf req-98ef7f0b-a5db-4186-8d43-ebf9a935341c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-deleted", "tag": "bd20681c-2a18-4c40-b6eb-ea84168bffcb"}, {"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-deleted", "tag": "f3625622-a332-4f68-bfa8-134a05eaf7d2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:47.984443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ceeb5c27-b6e2-4312-9039-d2b3e5aaefcf req-98ef7f0b-a5db-4186-8d43-ebf9a935341c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:47.986451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ceeb5c27-b6e2-4312-9039-d2b3e5aaefcf req-98ef7f0b-a5db-4186-8d43-ebf9a935341c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:47.989723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ceeb5c27-b6e2-4312-9039-d2b3e5aaefcf req-98ef7f0b-a5db-4186-8d43-ebf9a935341c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:48.041448 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ceeb5c27-b6e2-4312-9039-d2b3e5aaefcf req-98ef7f0b-a5db-4186-8d43-ebf9a935341c service nova] Creating event network-vif-deleted:bd20681c-2a18-4c40-b6eb-ea84168bffcb for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:09:48.042941 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ceeb5c27-b6e2-4312-9039-d2b3e5aaefcf req-98ef7f0b-a5db-4186-8d43-ebf9a935341c service nova] Creating event network-vif-deleted:f3625622-a332-4f68-bfa8-134a05eaf7d2 for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:09:48.070923 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ceeb5c27-b6e2-4312-9039-d2b3e5aaefcf req-98ef7f0b-a5db-4186-8d43-ebf9a935341c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.169619 Aug 25 13:09:48.074633 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1703/3361] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:48.099601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70472700-aebe-44ed-9ea1-7a03c82fa11d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:48.104530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70472700-aebe-44ed-9ea1-7a03c82fa11d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:48.135974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70472700-aebe-44ed-9ea1-7a03c82fa11d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:48.143282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70472700-aebe-44ed-9ea1-7a03c82fa11d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:48.145090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70472700-aebe-44ed-9ea1-7a03c82fa11d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:48.151920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70472700-aebe-44ed-9ea1-7a03c82fa11d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:48.155288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70472700-aebe-44ed-9ea1-7a03c82fa11d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:48.158208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70472700-aebe-44ed-9ea1-7a03c82fa11d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:48.809437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70472700-aebe-44ed-9ea1-7a03c82fa11d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:48.828356 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70472700-aebe-44ed-9ea1-7a03c82fa11d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1283 microversion: 2.1 time: 0.749602 Aug 25 13:09:48.837654 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1704/3362] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:48 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1283 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:48.855626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:48.856351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:48.869267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:48.870176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:48.870958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:48.872219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:48.873183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:48.874549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:49.383045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:49.422075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:49.434907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-75aa8dfc-a24f-45a7-adf0-389a13796d87 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:49.443960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:49.447153 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-81d7ce2c-a6e0-460b-8847-c30ab3f55cd7 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.607529 Aug 25 13:09:49.462025 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1705/3363] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:48 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:49.484029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-307aec31-a412-4360-8125-556a3033c4e2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:49.491490 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-75aa8dfc-a24f-45a7-adf0-389a13796d87 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1313 microversion: 2.1 time: 2.131407 Aug 25 13:09:49.492999 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1659/3364] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:47 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1313 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:49.497034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-307aec31-a412-4360-8125-556a3033c4e2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:49.528621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e303b127-524d-4f22-bbc5-a03aa88ad556 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:49.536763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e303b127-524d-4f22-bbc5-a03aa88ad556 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:49.544036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-307aec31-a412-4360-8125-556a3033c4e2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:49.545376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-307aec31-a412-4360-8125-556a3033c4e2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:49.549342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-307aec31-a412-4360-8125-556a3033c4e2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:49.553688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-307aec31-a412-4360-8125-556a3033c4e2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:49.555267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-307aec31-a412-4360-8125-556a3033c4e2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:49.556345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-307aec31-a412-4360-8125-556a3033c4e2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:49.905708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e303b127-524d-4f22-bbc5-a03aa88ad556 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:49.938520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e303b127-524d-4f22-bbc5-a03aa88ad556 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:49.962038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e303b127-524d-4f22-bbc5-a03aa88ad556 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:49.964884 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e303b127-524d-4f22-bbc5-a03aa88ad556 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1285 microversion: 2.32 time: 0.465123 Aug 25 13:09:49.977810 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1660/3365] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:49 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1285 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:49.998753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0db3721e-c61b-4e3e-9295-a4ae28695efc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:49.999637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0db3721e-c61b-4e3e-9295-a4ae28695efc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:50.043648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0db3721e-c61b-4e3e-9295-a4ae28695efc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:50.044591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0db3721e-c61b-4e3e-9295-a4ae28695efc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:50.045449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0db3721e-c61b-4e3e-9295-a4ae28695efc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:50.059631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0db3721e-c61b-4e3e-9295-a4ae28695efc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:50.060562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0db3721e-c61b-4e3e-9295-a4ae28695efc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:50.061418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0db3721e-c61b-4e3e-9295-a4ae28695efc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:50.455472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0db3721e-c61b-4e3e-9295-a4ae28695efc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:50.484542 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0db3721e-c61b-4e3e-9295-a4ae28695efc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1271 microversion: 2.1 time: 0.504548 Aug 25 13:09:50.493721 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1661/3366] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:49 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1271 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:50.507750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8e9d61b3-ae10-4ff3-810e-0f091ba43501 req-5f0479cd-5f7c-45d8-807c-eb036c8ac551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec1bd7-9479-44e9-82f8-7db70ccd668a", "name": "network-vif-deleted", "tag": "dd23ef5c-d8a0-4337-97d4-d03bd3e7954e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:50.587588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8e9d61b3-ae10-4ff3-810e-0f091ba43501 req-5f0479cd-5f7c-45d8-807c-eb036c8ac551 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:50.589120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8e9d61b3-ae10-4ff3-810e-0f091ba43501 req-5f0479cd-5f7c-45d8-807c-eb036c8ac551 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:50.590441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8e9d61b3-ae10-4ff3-810e-0f091ba43501 req-5f0479cd-5f7c-45d8-807c-eb036c8ac551 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:50.698379 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8e9d61b3-ae10-4ff3-810e-0f091ba43501 req-5f0479cd-5f7c-45d8-807c-eb036c8ac551 service nova] Creating event network-vif-deleted:dd23ef5c-d8a0-4337-97d4-d03bd3e7954e for instance faec1bd7-9479-44e9-82f8-7db70ccd668a on n-h2-852771-8 Aug 25 13:09:50.728025 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8e9d61b3-ae10-4ff3-810e-0f091ba43501 req-5f0479cd-5f7c-45d8-807c-eb036c8ac551 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231690 Aug 25 13:09:50.730558 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1662/3367] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:50.749900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:50.756433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:50.790007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:50.791337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:50.792463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:50.794226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:50.795370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:50.797175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:51.089317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-307aec31-a412-4360-8125-556a3033c4e2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:51.115208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:51.121370 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-307aec31-a412-4360-8125-556a3033c4e2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.656500 Aug 25 13:09:51.127006 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1706/3368] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:49 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:51.149591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-296b84d8-3c32-466d-8d17-0d85f0e17605 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:51.151571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-296b84d8-3c32-466d-8d17-0d85f0e17605 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:51.174541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:51.179456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-296b84d8-3c32-466d-8d17-0d85f0e17605 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:51.180834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-296b84d8-3c32-466d-8d17-0d85f0e17605 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:51.182858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-296b84d8-3c32-466d-8d17-0d85f0e17605 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:51.187310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:51.189871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-296b84d8-3c32-466d-8d17-0d85f0e17605 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:51.190464 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e2ba94a-40c2-4af1-810c-db9b4b47c3e1 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.457188 Aug 25 13:09:51.192142 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1663/3369] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:50 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:51.203436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-296b84d8-3c32-466d-8d17-0d85f0e17605 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:51.205860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-296b84d8-3c32-466d-8d17-0d85f0e17605 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:51.233800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dcc4fec3-0a99-471f-96a7-8615bb9b5582 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:51.235265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dcc4fec3-0a99-471f-96a7-8615bb9b5582 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:51.473886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dcc4fec3-0a99-471f-96a7-8615bb9b5582 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:51.512321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dcc4fec3-0a99-471f-96a7-8615bb9b5582 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:51.517921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dcc4fec3-0a99-471f-96a7-8615bb9b5582 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:51.522281 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dcc4fec3-0a99-471f-96a7-8615bb9b5582 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1285 microversion: 2.32 time: 0.311280 Aug 25 13:09:51.534194 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1664/3370] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:51 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1285 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:51.549369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bbfab82b-d311-493c-918a-d525bfd4194d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:51.560935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bbfab82b-d311-493c-918a-d525bfd4194d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:51.604808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbfab82b-d311-493c-918a-d525bfd4194d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:51.606384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbfab82b-d311-493c-918a-d525bfd4194d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:51.607731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbfab82b-d311-493c-918a-d525bfd4194d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:51.609942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbfab82b-d311-493c-918a-d525bfd4194d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:51.611415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbfab82b-d311-493c-918a-d525bfd4194d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:51.612973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbfab82b-d311-493c-918a-d525bfd4194d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:53.982271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-296b84d8-3c32-466d-8d17-0d85f0e17605 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:54.028303 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-296b84d8-3c32-466d-8d17-0d85f0e17605 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1500 microversion: 2.1 time: 2.898783 Aug 25 13:09:54.035885 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1707/3371] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:51 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1500 bytes in 2908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:54.051430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d1da87e-af5b-420e-87f7-a2cbf8ed68f9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:54.053197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4d1da87e-af5b-420e-87f7-a2cbf8ed68f9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:54.126343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1da87e-af5b-420e-87f7-a2cbf8ed68f9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:54.170363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1da87e-af5b-420e-87f7-a2cbf8ed68f9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:54.173131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1da87e-af5b-420e-87f7-a2cbf8ed68f9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:54.177404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1da87e-af5b-420e-87f7-a2cbf8ed68f9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:54.178976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1da87e-af5b-420e-87f7-a2cbf8ed68f9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:54.181022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d1da87e-af5b-420e-87f7-a2cbf8ed68f9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:54.183057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:54.258811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bbfab82b-d311-493c-918a-d525bfd4194d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:54.292434 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bbfab82b-d311-493c-918a-d525bfd4194d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.750269 Aug 25 13:09:54.294059 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1665/3372] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:51 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:54.308411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:54.319762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:54.368018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:54.368825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:54.377675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:54.379783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:54.380589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:54.386985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:54.505210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4d1da87e-af5b-420e-87f7-a2cbf8ed68f9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:54.549573 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d1da87e-af5b-420e-87f7-a2cbf8ed68f9 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1271 microversion: 2.1 time: 0.503913 Aug 25 13:09:54.563682 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1708/3373] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:54 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1271 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:54.593980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:54.600523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:54.638372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:54.646507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:54.651864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:54.658496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:54.658496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:54.662744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:54.693334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:54.980354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:55.031517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:55.039376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:55.045746 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a626a423-aa7b-402a-93c5-e1051aa162ce tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.745935 Aug 25 13:09:55.047016 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1666/3374] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:54 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:55.048508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:55.067750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-71346ef2-df8e-4702-9181-c5ae528f78a7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:55.079974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-71346ef2-df8e-4702-9181-c5ae528f78a7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:55.103024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:55.106588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71346ef2-df8e-4702-9181-c5ae528f78a7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:55.110756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71346ef2-df8e-4702-9181-c5ae528f78a7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:55.112193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71346ef2-df8e-4702-9181-c5ae528f78a7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:55.117033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:55.119497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71346ef2-df8e-4702-9181-c5ae528f78a7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:55.120855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71346ef2-df8e-4702-9181-c5ae528f78a7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:55.122022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71346ef2-df8e-4702-9181-c5ae528f78a7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:55.122857 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-69c1101e-2cba-4a99-bb5d-1d068c3378e8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1593 microversion: 2.32 time: 0.562795 Aug 25 13:09:55.126567 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1709/3375] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:54 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1593 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:55.168792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7deaaa2f-e27f-41be-bb7c-20dca863b4ea tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:55.186879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7deaaa2f-e27f-41be-bb7c-20dca863b4ea tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:55.220504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7deaaa2f-e27f-41be-bb7c-20dca863b4ea tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:55.224947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7deaaa2f-e27f-41be-bb7c-20dca863b4ea tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:55.229110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7deaaa2f-e27f-41be-bb7c-20dca863b4ea tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:55.231741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7deaaa2f-e27f-41be-bb7c-20dca863b4ea tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:55.243142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7deaaa2f-e27f-41be-bb7c-20dca863b4ea tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:55.244216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7deaaa2f-e27f-41be-bb7c-20dca863b4ea tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:55.286365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-71346ef2-df8e-4702-9181-c5ae528f78a7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lazy-loading 'flavor' on Instance uuid 18298dec-561e-48d1-a00c-d1704f098b69 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:09:55.664076 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7deaaa2f-e27f-41be-bb7c-20dca863b4ea tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.527411 Aug 25 13:09:55.671677 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1710/3376] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:09:55 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:09:55.719787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-392d0a90-381a-47e5-954d-105488ecea93 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:55.724350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-392d0a90-381a-47e5-954d-105488ecea93 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:55.798129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-392d0a90-381a-47e5-954d-105488ecea93 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:55.799512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-392d0a90-381a-47e5-954d-105488ecea93 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:55.809243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-392d0a90-381a-47e5-954d-105488ecea93 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:55.810418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-392d0a90-381a-47e5-954d-105488ecea93 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:55.811169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-392d0a90-381a-47e5-954d-105488ecea93 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:55.814644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-392d0a90-381a-47e5-954d-105488ecea93 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:56.033908 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-71346ef2-df8e-4702-9181-c5ae528f78a7 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "POST /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69/action" status: 200 len: 32 microversion: 2.1 time: 0.964029 Aug 25 13:09:56.040426 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1667/3377] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:09:55 2022] POST /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69/action => generated 32 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:09:56.067951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1a499eee-f58a-4212-b7b2-3c3078021ed9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:56.074365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1a499eee-f58a-4212-b7b2-3c3078021ed9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:56.121658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a499eee-f58a-4212-b7b2-3c3078021ed9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:56.125537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a499eee-f58a-4212-b7b2-3c3078021ed9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:56.126931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a499eee-f58a-4212-b7b2-3c3078021ed9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:56.128669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a499eee-f58a-4212-b7b2-3c3078021ed9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:56.130730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a499eee-f58a-4212-b7b2-3c3078021ed9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:56.141221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a499eee-f58a-4212-b7b2-3c3078021ed9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:57.309428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-392d0a90-381a-47e5-954d-105488ecea93 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:57.328002 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-392d0a90-381a-47e5-954d-105488ecea93 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1313 microversion: 2.1 time: 1.652782 Aug 25 13:09:57.329698 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1711/3378] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:55 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1313 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:57.341173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-95052e5d-8c78-4825-9703-09da0b8bd189 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:57.342974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-95052e5d-8c78-4825-9703-09da0b8bd189 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:57.348693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1a499eee-f58a-4212-b7b2-3c3078021ed9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:57.358297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95052e5d-8c78-4825-9703-09da0b8bd189 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:57.360044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95052e5d-8c78-4825-9703-09da0b8bd189 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:57.361232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95052e5d-8c78-4825-9703-09da0b8bd189 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:57.363325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95052e5d-8c78-4825-9703-09da0b8bd189 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:57.366030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95052e5d-8c78-4825-9703-09da0b8bd189 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:57.367447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95052e5d-8c78-4825-9703-09da0b8bd189 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:57.393860 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1a499eee-f58a-4212-b7b2-3c3078021ed9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1669 microversion: 2.1 time: 1.344953 Aug 25 13:09:57.397007 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1668/3379] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:56 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1669 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:57.420712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:57.422714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:57.452237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:57.453897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:57.455423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:57.462068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:57.463728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:57.464993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:57.790311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:57.959039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:57.990329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:57.993821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:58.008438 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f271b741-94bb-4dff-8d34-a7bbb67c2584 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.605735 Aug 25 13:09:58.010499 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1669/3380] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:57 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:58.021360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:58.029566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:58.051822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:58.053230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:58.054472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:58.055937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:58.056765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:58.057492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:58.116531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-95052e5d-8c78-4825-9703-09da0b8bd189 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:58.162266 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-95052e5d-8c78-4825-9703-09da0b8bd189 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1506 microversion: 2.1 time: 0.829995 Aug 25 13:09:58.180530 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1712/3381] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:57 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1506 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:58.383846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:58.390366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e1d5366a-6f8b-475c-ae82-ab1780dc213d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:58.399423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e1d5366a-6f8b-475c-ae82-ab1780dc213d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:58.415572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:58.421632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:58.427737 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-40cf4d02-a206-4ca7-a08a-459045b8201d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1593 microversion: 2.32 time: 0.412380 Aug 25 13:09:58.428126 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1670/3382] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:58 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1593 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:58.444444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52475a24-7f35-4fc3-8de9-e3387861af89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:58.446030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52475a24-7f35-4fc3-8de9-e3387861af89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:58.458752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d5366a-6f8b-475c-ae82-ab1780dc213d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:58.460181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d5366a-6f8b-475c-ae82-ab1780dc213d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:58.461743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52475a24-7f35-4fc3-8de9-e3387861af89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:58.463210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52475a24-7f35-4fc3-8de9-e3387861af89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:58.464753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52475a24-7f35-4fc3-8de9-e3387861af89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:58.466160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d5366a-6f8b-475c-ae82-ab1780dc213d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:58.466779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52475a24-7f35-4fc3-8de9-e3387861af89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:58.468112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52475a24-7f35-4fc3-8de9-e3387861af89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:58.469226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52475a24-7f35-4fc3-8de9-e3387861af89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:58.470342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d5366a-6f8b-475c-ae82-ab1780dc213d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:58.477039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d5366a-6f8b-475c-ae82-ab1780dc213d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:58.478433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d5366a-6f8b-475c-ae82-ab1780dc213d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:59.739624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e1d5366a-6f8b-475c-ae82-ab1780dc213d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:59.767237 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e1d5366a-6f8b-475c-ae82-ab1780dc213d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1313 microversion: 2.1 time: 1.389660 Aug 25 13:09:59.773682 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1713/3383] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:58 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1313 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:59.795140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:59.797064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:59.828790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:59.834990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:59.836464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:59.843548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:59.844830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:59.846079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:00.199972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52475a24-7f35-4fc3-8de9-e3387861af89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:00.299551 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52475a24-7f35-4fc3-8de9-e3387861af89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1669 microversion: 2.1 time: 1.863500 Aug 25 13:10:00.305823 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1671/3384] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:58 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1669 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:00.332921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-91e8a5f2-87bf-4c23-a308-39e9b9b6646e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:00.338748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-91e8a5f2-87bf-4c23-a308-39e9b9b6646e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:00.384535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e8a5f2-87bf-4c23-a308-39e9b9b6646e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:00.388278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e8a5f2-87bf-4c23-a308-39e9b9b6646e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:00.390597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e8a5f2-87bf-4c23-a308-39e9b9b6646e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:00.398872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e8a5f2-87bf-4c23-a308-39e9b9b6646e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:00.401398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e8a5f2-87bf-4c23-a308-39e9b9b6646e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:00.404815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e8a5f2-87bf-4c23-a308-39e9b9b6646e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:00.444944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:00.487238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:00.497357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:00.509741 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5a3430a7-90ce-45f1-a021-ca1dd491d131 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.725728 Aug 25 13:10:00.512409 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1714/3385] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:59 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:00.544299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:00.546212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:00.577591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:00.580427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:00.582772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:00.586175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:00.588070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:00.591024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:01.318351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-91e8a5f2-87bf-4c23-a308-39e9b9b6646e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:01.373438 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-91e8a5f2-87bf-4c23-a308-39e9b9b6646e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1506 microversion: 2.1 time: 1.057859 Aug 25 13:10:01.377050 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1672/3386] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:00 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1506 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:01.396374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1634156495", "imageRef": "fbd63ae1-0016-47bf-85f5-e5714a90d659", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ac488b3c-b46f-4af4-9170-27c1d4da672d"}], "security_groups": [{"name": "tempest-securitygroup--575876913"}], "key_name": "tempest-keypair-1057297451", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:01.532179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:01.876467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:01.916103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:01.937288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:01.940048 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bb2619b5-9016-4ca9-84e3-ccc2695494c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1661 microversion: 2.32 time: 1.424508 Aug 25 13:10:01.942284 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1715/3387] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:00 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1661 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:01.969425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1c3d264-eacb-46c3-85df-6cba7d02b329 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:01.979983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c1c3d264-eacb-46c3-85df-6cba7d02b329 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:02.004503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1c3d264-eacb-46c3-85df-6cba7d02b329 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:02.014317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1c3d264-eacb-46c3-85df-6cba7d02b329 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:02.015720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1c3d264-eacb-46c3-85df-6cba7d02b329 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:02.022833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1c3d264-eacb-46c3-85df-6cba7d02b329 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:02.026862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1c3d264-eacb-46c3-85df-6cba7d02b329 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:02.027947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1c3d264-eacb-46c3-85df-6cba7d02b329 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:02.974788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] validate_networks() for [('ac488b3c-b46f-4af4-9170-27c1d4da672d', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:10:03.750305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1c3d264-eacb-46c3-85df-6cba7d02b329 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:03.755526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:03.793038 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c1c3d264-eacb-46c3-85df-6cba7d02b329 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1334 microversion: 2.1 time: 1.842373 Aug 25 13:10:03.794058 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1716/3388] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:01 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1334 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:03.835518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b055f5f8-8697-48f5-87fe-43f10c77b3d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:03.837601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b055f5f8-8697-48f5-87fe-43f10c77b3d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:03.886659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b055f5f8-8697-48f5-87fe-43f10c77b3d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:03.888359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b055f5f8-8697-48f5-87fe-43f10c77b3d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:03.889655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b055f5f8-8697-48f5-87fe-43f10c77b3d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:03.891328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b055f5f8-8697-48f5-87fe-43f10c77b3d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:03.903223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b055f5f8-8697-48f5-87fe-43f10c77b3d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:03.905460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b055f5f8-8697-48f5-87fe-43f10c77b3d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.282382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b055f5f8-8697-48f5-87fe-43f10c77b3d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:06.310540 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b055f5f8-8697-48f5-87fe-43f10c77b3d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.514468 Aug 25 13:10:06.349700 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1717/3389] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:03 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:06.368313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:06.369434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:06.382349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.384178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.385361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.390058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.391496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.392704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.605404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:06.651817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:06.659723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:06.673047 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f004c4f1-1fc5-4fbd-9f45-289bbab98bff tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.313087 Aug 25 13:10:06.678046 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1718/3390] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:06 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:06.692831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d140506b-4493-41d0-813d-6796e2720fcd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:06.694793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d140506b-4493-41d0-813d-6796e2720fcd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:06.712422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d140506b-4493-41d0-813d-6796e2720fcd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.714188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d140506b-4493-41d0-813d-6796e2720fcd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.715787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d140506b-4493-41d0-813d-6796e2720fcd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.718043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d140506b-4493-41d0-813d-6796e2720fcd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.719480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d140506b-4493-41d0-813d-6796e2720fcd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.720713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d140506b-4493-41d0-813d-6796e2720fcd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.038815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:10:08.042104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:10:08.045417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:10:08.050152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:10:08.052227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:10:08.072110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:08.126352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.129275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.136767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.138331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.139222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.140055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.184797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:08.191545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d140506b-4493-41d0-813d-6796e2720fcd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:08.267292 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d140506b-4493-41d0-813d-6796e2720fcd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1506 microversion: 2.1 time: 1.581643 Aug 25 13:10:08.273016 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1719/3391] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:06 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1506 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:08.280679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Getting quotas for project bafd8cfabac543a6b7377b7cd451c693. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:10:08.295725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:08.314638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:08.337308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Getting quotas for user e8531c673eba41deac6429590dd70a6f and project bafd8cfabac543a6b7377b7cd451c693. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:10:08.355816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.358401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.361910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.364267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.368186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.368917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.425425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:10:08.438029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbd63ae1-0016-47bf-85f5-e5714a90d659',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:10:08.641966 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d04c10af-a7d3-4968-bcc1-dcced2e8ccdf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 7.262493 Aug 25 13:10:08.647482 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1673/3392] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:10:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 7270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:10:08.682755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d332209-f4f5-4c6b-b022-d80051290915 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:08.684841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4d332209-f4f5-4c6b-b022-d80051290915 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:08.708587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d332209-f4f5-4c6b-b022-d80051290915 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.713842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d332209-f4f5-4c6b-b022-d80051290915 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.718614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d332209-f4f5-4c6b-b022-d80051290915 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.720641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d332209-f4f5-4c6b-b022-d80051290915 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.723371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d332209-f4f5-4c6b-b022-d80051290915 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.729198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d332209-f4f5-4c6b-b022-d80051290915 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:09.819666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:09.860829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:09.866035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:09.871894 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9408af62-ffa8-4a74-a506-a767fbb2bf29 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1755 microversion: 2.32 time: 1.593445 Aug 25 13:10:09.915776 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1720/3393] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:08 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1755 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:09.922678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-801f491d-e875-4860-b7ac-e2173379aa1f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:09.929548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-801f491d-e875-4860-b7ac-e2173379aa1f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:09.943590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-801f491d-e875-4860-b7ac-e2173379aa1f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:09.952377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-801f491d-e875-4860-b7ac-e2173379aa1f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:09.953584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-801f491d-e875-4860-b7ac-e2173379aa1f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:09.954955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-801f491d-e875-4860-b7ac-e2173379aa1f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:09.961838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-801f491d-e875-4860-b7ac-e2173379aa1f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:09.964393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-801f491d-e875-4860-b7ac-e2173379aa1f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.043724 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-801f491d-e875-4860-b7ac-e2173379aa1f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 200 len: 324 microversion: 2.1 time: 0.125956 Aug 25 13:10:10.044990 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1721/3394] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:10:09 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 324 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:10.058384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4d332209-f4f5-4c6b-b022-d80051290915 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:10.060331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:10.064686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:10.077864 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4d332209-f4f5-4c6b-b022-d80051290915 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1334 microversion: 2.1 time: 1.428147 Aug 25 13:10:10.078754 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1674/3395] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:08 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1334 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:10.090650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.091790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.092606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.094676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.095517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.096241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.097559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-13e35345-cc4b-4b84-a773-67faf25385c5 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:10.103585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-13e35345-cc4b-4b84-a773-67faf25385c5 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:10.119024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13e35345-cc4b-4b84-a773-67faf25385c5 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.125483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13e35345-cc4b-4b84-a773-67faf25385c5 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.126361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13e35345-cc4b-4b84-a773-67faf25385c5 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.127442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13e35345-cc4b-4b84-a773-67faf25385c5 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.128202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13e35345-cc4b-4b84-a773-67faf25385c5 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.131204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13e35345-cc4b-4b84-a773-67faf25385c5 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.631921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:10.683293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-13e35345-cc4b-4b84-a773-67faf25385c5 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:10.696984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:10.700605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:10.703126 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cf84737b-a85b-43e4-9f6d-6cdd5e76e26a tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.655762 Aug 25 13:10:10.718517 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-13e35345-cc4b-4b84-a773-67faf25385c5 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1250 microversion: 2.1 time: 0.637859 Aug 25 13:10:10.724894 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1675/3396] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:10 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1250 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:10.754962 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1722/3397] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:10 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:10.756068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1df84eec-c136-4ce8-8e6f-c7fd500ae739 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:10.761891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1df84eec-c136-4ce8-8e6f-c7fd500ae739 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:10.780407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5d2a1383-015b-46b0-a20c-159fbd5eb160 req-f54b2c11-889d-4bac-936a-4fdee5fc9dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd72616-bd88-48a3-b762-5c0cc614454c", "tag": "ccfa3144-9718-4f11-aa8c-66a23b23629e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:10.791304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1df84eec-c136-4ce8-8e6f-c7fd500ae739 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.797736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1df84eec-c136-4ce8-8e6f-c7fd500ae739 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.800821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1df84eec-c136-4ce8-8e6f-c7fd500ae739 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.803897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1df84eec-c136-4ce8-8e6f-c7fd500ae739 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.806248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1df84eec-c136-4ce8-8e6f-c7fd500ae739 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.818313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1df84eec-c136-4ce8-8e6f-c7fd500ae739 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.828352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5d2a1383-015b-46b0-a20c-159fbd5eb160 req-f54b2c11-889d-4bac-936a-4fdee5fc9dda service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.829207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5d2a1383-015b-46b0-a20c-159fbd5eb160 req-f54b2c11-889d-4bac-936a-4fdee5fc9dda service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.830030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5d2a1383-015b-46b0-a20c-159fbd5eb160 req-f54b2c11-889d-4bac-936a-4fdee5fc9dda service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.874716 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5d2a1383-015b-46b0-a20c-159fbd5eb160 req-f54b2c11-889d-4bac-936a-4fdee5fc9dda service nova] Creating event network-changed:ccfa3144-9718-4f11-aa8c-66a23b23629e for instance ddd72616-bd88-48a3-b762-5c0cc614454c on n-h2-852771-8 Aug 25 13:10:10.898968 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5d2a1383-015b-46b0-a20c-159fbd5eb160 req-f54b2c11-889d-4bac-936a-4fdee5fc9dda service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141775 Aug 25 13:10:10.901096 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1723/3398] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:10.934192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9ccfb9f5-fd29-4a89-b015-b9cc36c2274d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:10.936777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9ccfb9f5-fd29-4a89-b015-b9cc36c2274d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:10.956636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ccfb9f5-fd29-4a89-b015-b9cc36c2274d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.964510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ccfb9f5-fd29-4a89-b015-b9cc36c2274d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.981336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ccfb9f5-fd29-4a89-b015-b9cc36c2274d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.982517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ccfb9f5-fd29-4a89-b015-b9cc36c2274d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.983408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ccfb9f5-fd29-4a89-b015-b9cc36c2274d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.984243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ccfb9f5-fd29-4a89-b015-b9cc36c2274d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:13.767578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1df84eec-c136-4ce8-8e6f-c7fd500ae739 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:13.820451 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1df84eec-c136-4ce8-8e6f-c7fd500ae739 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1506 microversion: 2.1 time: 3.091050 Aug 25 13:10:13.828680 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1676/3399] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:10 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1506 bytes in 3103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:13.881099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:13.885893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:13.917248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:13.918742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:13.920115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:13.922126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:13.923524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:13.924676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:14.225428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9ccfb9f5-fd29-4a89-b015-b9cc36c2274d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:14.242437 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9ccfb9f5-fd29-4a89-b015-b9cc36c2274d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 3.339068 Aug 25 13:10:14.250109 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1724/3400] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:10 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 3345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:14.266631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62519247-9d59-4f35-bc4c-88fa6670702e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:14.268679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-62519247-9d59-4f35-bc4c-88fa6670702e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:14.318554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62519247-9d59-4f35-bc4c-88fa6670702e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:14.326597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62519247-9d59-4f35-bc4c-88fa6670702e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:14.328191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62519247-9d59-4f35-bc4c-88fa6670702e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:14.334208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62519247-9d59-4f35-bc4c-88fa6670702e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:14.346225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62519247-9d59-4f35-bc4c-88fa6670702e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:14.347898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62519247-9d59-4f35-bc4c-88fa6670702e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:15.554507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:15.611024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:15.624470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:15.625973 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8ff1986e-97df-4939-8ae6-c4b96fbbcebf tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1849 microversion: 2.32 time: 1.794440 Aug 25 13:10:15.634575 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1677/3401] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:13 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1849 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:15.660372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:15.662183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:15.711429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:15.714693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:15.715649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:15.740981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:15.742138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:15.743013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:15.933170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62519247-9d59-4f35-bc4c-88fa6670702e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:15.962171 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-62519247-9d59-4f35-bc4c-88fa6670702e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1334 microversion: 2.1 time: 1.709868 Aug 25 13:10:15.963396 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1725/3402] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:14 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1334 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:16.010288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d9cb3992-0582-4d03-bb86-45ffab7893bc tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:16.011605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d9cb3992-0582-4d03-bb86-45ffab7893bc tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:16.044331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9cb3992-0582-4d03-bb86-45ffab7893bc tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:16.054925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9cb3992-0582-4d03-bb86-45ffab7893bc tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:16.056235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9cb3992-0582-4d03-bb86-45ffab7893bc tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:16.057957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9cb3992-0582-4d03-bb86-45ffab7893bc tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:16.059166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9cb3992-0582-4d03-bb86-45ffab7893bc tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:16.060554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9cb3992-0582-4d03-bb86-45ffab7893bc tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:16.243818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:16.297861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:16.310073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:16.320276 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-82c98bbf-3e60-4a06-8b90-1d998751f7db tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.680522 Aug 25 13:10:16.329101 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1678/3403] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:15 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:16.353362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19e3a65e-31b3-4e7a-b01b-dc2235ff0f61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:16.355363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-19e3a65e-31b3-4e7a-b01b-dc2235ff0f61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:16.392971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19e3a65e-31b3-4e7a-b01b-dc2235ff0f61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:16.395217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19e3a65e-31b3-4e7a-b01b-dc2235ff0f61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:16.398819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19e3a65e-31b3-4e7a-b01b-dc2235ff0f61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:16.400541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19e3a65e-31b3-4e7a-b01b-dc2235ff0f61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:16.414291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19e3a65e-31b3-4e7a-b01b-dc2235ff0f61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:16.415642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19e3a65e-31b3-4e7a-b01b-dc2235ff0f61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:17.290430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d9cb3992-0582-4d03-bb86-45ffab7893bc tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:17.332316 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d9cb3992-0582-4d03-bb86-45ffab7893bc tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1371 microversion: 2.1 time: 1.363135 Aug 25 13:10:17.359467 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1726/3404] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:15 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1371 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:17.392592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1bb4fdb3-c8bd-486f-bdf8-3b50b53906a5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:17.395336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1bb4fdb3-c8bd-486f-bdf8-3b50b53906a5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:17.476072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bb4fdb3-c8bd-486f-bdf8-3b50b53906a5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:17.491305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bb4fdb3-c8bd-486f-bdf8-3b50b53906a5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:17.492392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bb4fdb3-c8bd-486f-bdf8-3b50b53906a5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:17.494834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bb4fdb3-c8bd-486f-bdf8-3b50b53906a5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:17.511941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bb4fdb3-c8bd-486f-bdf8-3b50b53906a5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:17.516480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bb4fdb3-c8bd-486f-bdf8-3b50b53906a5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:17.767570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-19e3a65e-31b3-4e7a-b01b-dc2235ff0f61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:17.807763 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19e3a65e-31b3-4e7a-b01b-dc2235ff0f61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.475427 Aug 25 13:10:17.815657 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1679/3405] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:16 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:17.850508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:17.855533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:17.881552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:17.896526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:17.897349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:17.899042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:17.899991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:17.900699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:18.186512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:18.395943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:19.401737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:19.439837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:19.455252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:19.458378 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c9c40305-32d6-45e6-a090-3ee87ce62cce tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1849 microversion: 2.32 time: 1.639091 Aug 25 13:10:19.459762 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1680/3406] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:17 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1849 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:19.477958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8fc4cb67-7be6-4306-9d19-6bfbfa74fe1f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:19.479372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8fc4cb67-7be6-4306-9d19-6bfbfa74fe1f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:19.494623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc4cb67-7be6-4306-9d19-6bfbfa74fe1f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:19.495518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc4cb67-7be6-4306-9d19-6bfbfa74fe1f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:19.496486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc4cb67-7be6-4306-9d19-6bfbfa74fe1f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:19.504536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc4cb67-7be6-4306-9d19-6bfbfa74fe1f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:19.506660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc4cb67-7be6-4306-9d19-6bfbfa74fe1f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:19.507817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc4cb67-7be6-4306-9d19-6bfbfa74fe1f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:20.050429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1bb4fdb3-c8bd-486f-bdf8-3b50b53906a5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:20.087623 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1bb4fdb3-c8bd-486f-bdf8-3b50b53906a5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1506 microversion: 2.1 time: 2.719179 Aug 25 13:10:20.092227 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1727/3407] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:17 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1506 bytes in 2732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:20.131384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:20.132676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:20.171466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:20.176533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:20.177411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:20.184467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:20.193645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:20.195331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:20.197755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:20.705468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:20.856936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:20.862632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:20.868863 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2eeb2d7e-8258-41c8-bd04-762c175ed7b0 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.774275 Aug 25 13:10:20.897125 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1728/3408] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:20 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:20.920361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-7e84e8b8-ba3f-4b02-9ad8-95591a0a8efa req-15e86d9d-fea2-4459-ba25-9429c4b7b60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd72616-bd88-48a3-b762-5c0cc614454c", "tag": "9ae1b8b4-a711-4456-a821-46e24d3556b9"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:20.981117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7e84e8b8-ba3f-4b02-9ad8-95591a0a8efa req-15e86d9d-fea2-4459-ba25-9429c4b7b60c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:20.991627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7e84e8b8-ba3f-4b02-9ad8-95591a0a8efa req-15e86d9d-fea2-4459-ba25-9429c4b7b60c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:20.994870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7e84e8b8-ba3f-4b02-9ad8-95591a0a8efa req-15e86d9d-fea2-4459-ba25-9429c4b7b60c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:21.063269 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-7e84e8b8-ba3f-4b02-9ad8-95591a0a8efa req-15e86d9d-fea2-4459-ba25-9429c4b7b60c service nova] Creating event network-changed:9ae1b8b4-a711-4456-a821-46e24d3556b9 for instance ddd72616-bd88-48a3-b762-5c0cc614454c on n-h2-852771-8 Aug 25 13:10:21.088410 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-7e84e8b8-ba3f-4b02-9ad8-95591a0a8efa req-15e86d9d-fea2-4459-ba25-9429c4b7b60c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186328 Aug 25 13:10:21.091829 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1729/3409] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:21.117064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5309f9b-8e8e-4516-8e99-9f6c61836e54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:21.124970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5309f9b-8e8e-4516-8e99-9f6c61836e54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:21.153159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5309f9b-8e8e-4516-8e99-9f6c61836e54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:21.161804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5309f9b-8e8e-4516-8e99-9f6c61836e54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:21.163373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5309f9b-8e8e-4516-8e99-9f6c61836e54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:21.165299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5309f9b-8e8e-4516-8e99-9f6c61836e54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:21.166796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5309f9b-8e8e-4516-8e99-9f6c61836e54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:21.168055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5309f9b-8e8e-4516-8e99-9f6c61836e54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:22.554815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8fc4cb67-7be6-4306-9d19-6bfbfa74fe1f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:22.616895 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8fc4cb67-7be6-4306-9d19-6bfbfa74fe1f tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1334 microversion: 2.1 time: 3.155159 Aug 25 13:10:22.626479 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1681/3410] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:19 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1334 bytes in 3166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:22.675468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-dd1df5f5-886e-4890-b1a3-8b68381518a0 req-3daed9b9-239c-45c1-bc56-9d59c4aeb8ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "tag": "e440bc76-ba2a-47fc-ba6a-494656b6f798"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:22.726956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-dd1df5f5-886e-4890-b1a3-8b68381518a0 req-3daed9b9-239c-45c1-bc56-9d59c4aeb8ec service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:22.727958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-dd1df5f5-886e-4890-b1a3-8b68381518a0 req-3daed9b9-239c-45c1-bc56-9d59c4aeb8ec service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:22.728991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-dd1df5f5-886e-4890-b1a3-8b68381518a0 req-3daed9b9-239c-45c1-bc56-9d59c4aeb8ec service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:22.783251 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-dd1df5f5-886e-4890-b1a3-8b68381518a0 req-3daed9b9-239c-45c1-bc56-9d59c4aeb8ec service nova] Creating event network-changed:e440bc76-ba2a-47fc-ba6a-494656b6f798 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:10:22.824656 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-dd1df5f5-886e-4890-b1a3-8b68381518a0 req-3daed9b9-239c-45c1-bc56-9d59c4aeb8ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189257 Aug 25 13:10:22.828510 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1682/3411] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:22.929880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0a52c36-afa5-4227-b226-762020a6e0cf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:22.941004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c0a52c36-afa5-4227-b226-762020a6e0cf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:22.964605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a52c36-afa5-4227-b226-762020a6e0cf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:22.968209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a52c36-afa5-4227-b226-762020a6e0cf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:22.971122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a52c36-afa5-4227-b226-762020a6e0cf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:22.973575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a52c36-afa5-4227-b226-762020a6e0cf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:22.974822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a52c36-afa5-4227-b226-762020a6e0cf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:22.976636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a52c36-afa5-4227-b226-762020a6e0cf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:23.542520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5309f9b-8e8e-4516-8e99-9f6c61836e54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:23.598604 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5309f9b-8e8e-4516-8e99-9f6c61836e54 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.502352 Aug 25 13:10:23.604839 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1730/3412] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:21 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:23.628493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:23.631580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:23.746937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:23.748174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:23.755029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:23.757745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:23.758962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:23.762126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:25.132364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c0a52c36-afa5-4227-b226-762020a6e0cf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:25.172012 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0a52c36-afa5-4227-b226-762020a6e0cf tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1371 microversion: 2.1 time: 2.335680 Aug 25 13:10:25.181586 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1683/3413] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:22 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1371 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:25.219299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2dc2ca79-5973-46ad-a4c5-4f3320a9e753 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:25.221090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2dc2ca79-5973-46ad-a4c5-4f3320a9e753 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:25.236492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dc2ca79-5973-46ad-a4c5-4f3320a9e753 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:25.237931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dc2ca79-5973-46ad-a4c5-4f3320a9e753 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:25.239667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dc2ca79-5973-46ad-a4c5-4f3320a9e753 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:25.241495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dc2ca79-5973-46ad-a4c5-4f3320a9e753 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:25.242686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dc2ca79-5973-46ad-a4c5-4f3320a9e753 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:25.244237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dc2ca79-5973-46ad-a4c5-4f3320a9e753 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:27.428810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2dc2ca79-5973-46ad-a4c5-4f3320a9e753 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:27.462937 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2dc2ca79-5973-46ad-a4c5-4f3320a9e753 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1486 microversion: 2.1 time: 2.278902 Aug 25 13:10:27.474776 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1684/3414] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:25 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1486 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:27.507806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:27.515431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:27.542509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:27.544020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:27.546643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:27.549873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:27.552020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:27.553035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:27.764937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:27.785063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:27.788443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:27.791452 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5650ec67-0449-45a1-b693-f87f8556d311 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1870 microversion: 2.32 time: 4.183867 Aug 25 13:10:27.793551 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1731/3415] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:23 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1870 bytes in 4188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:27.803821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b34c2b25-11cd-4538-b693-abfdd9b6305e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:27.805421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b34c2b25-11cd-4538-b693-abfdd9b6305e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:27.819797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b34c2b25-11cd-4538-b693-abfdd9b6305e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:27.821073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b34c2b25-11cd-4538-b693-abfdd9b6305e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:27.822178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b34c2b25-11cd-4538-b693-abfdd9b6305e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:27.823966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b34c2b25-11cd-4538-b693-abfdd9b6305e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:27.825172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b34c2b25-11cd-4538-b693-abfdd9b6305e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:27.826279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b34c2b25-11cd-4538-b693-abfdd9b6305e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:27.963565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:28.070799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:28.104701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:28.107343 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-16eed678-9397-4b91-9e10-700bf4584c9b tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.630218 Aug 25 13:10:28.126736 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1685/3416] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:27 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:28.173756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6ae83ece-fb5c-4b04-968d-2bcbf57944f1 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:28.176922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6ae83ece-fb5c-4b04-968d-2bcbf57944f1 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:28.205340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ae83ece-fb5c-4b04-968d-2bcbf57944f1 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:28.206347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ae83ece-fb5c-4b04-968d-2bcbf57944f1 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:28.207019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ae83ece-fb5c-4b04-968d-2bcbf57944f1 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:28.208158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ae83ece-fb5c-4b04-968d-2bcbf57944f1 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:28.213789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ae83ece-fb5c-4b04-968d-2bcbf57944f1 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:28.215049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ae83ece-fb5c-4b04-968d-2bcbf57944f1 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:28.590527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b34c2b25-11cd-4538-b693-abfdd9b6305e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:28.625282 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b34c2b25-11cd-4538-b693-abfdd9b6305e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.829443 Aug 25 13:10:28.689623 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1732/3417] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:27 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:28.707874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9224434d-c90c-47ad-a2d7-d0aa023e3b74 req-c11e2512-100f-4e47-a8e5-f93622184335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a51c80a-6c87-4026-9025-4630451ff316", "tag": "293e697b-408f-4624-b636-1dbb45a2380c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:28.754628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9224434d-c90c-47ad-a2d7-d0aa023e3b74 req-c11e2512-100f-4e47-a8e5-f93622184335 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:28.755868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9224434d-c90c-47ad-a2d7-d0aa023e3b74 req-c11e2512-100f-4e47-a8e5-f93622184335 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:28.761246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9224434d-c90c-47ad-a2d7-d0aa023e3b74 req-c11e2512-100f-4e47-a8e5-f93622184335 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:28.890294 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9224434d-c90c-47ad-a2d7-d0aa023e3b74 req-c11e2512-100f-4e47-a8e5-f93622184335 service nova] Creating event network-changed:293e697b-408f-4624-b636-1dbb45a2380c for instance 9a51c80a-6c87-4026-9025-4630451ff316 on n-h2-852771-8 Aug 25 13:10:28.944836 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9224434d-c90c-47ad-a2d7-d0aa023e3b74 req-c11e2512-100f-4e47-a8e5-f93622184335 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252581 Aug 25 13:10:28.948609 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1733/3418] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:29.028835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c14d4244-5ce4-471c-95dd-35a436715017 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:29.038888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c14d4244-5ce4-471c-95dd-35a436715017 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:29.090714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14d4244-5ce4-471c-95dd-35a436715017 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:29.092904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14d4244-5ce4-471c-95dd-35a436715017 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:29.093497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14d4244-5ce4-471c-95dd-35a436715017 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:29.096112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14d4244-5ce4-471c-95dd-35a436715017 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:29.101302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14d4244-5ce4-471c-95dd-35a436715017 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:29.102446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c14d4244-5ce4-471c-95dd-35a436715017 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:29.969017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c14d4244-5ce4-471c-95dd-35a436715017 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:30.023446 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c14d4244-5ce4-471c-95dd-35a436715017 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1371 microversion: 2.1 time: 1.065925 Aug 25 13:10:30.028650 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1734/3419] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:28 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1371 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:30.053146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1381934209", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:30.060949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6ae83ece-fb5c-4b04-968d-2bcbf57944f1 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:30.154803 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6ae83ece-fb5c-4b04-968d-2bcbf57944f1 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1334 microversion: 2.1 time: 2.011134 Aug 25 13:10:30.168036 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1686/3420] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:28 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1334 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:30.210410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:30.223197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:30.283270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:30.287046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:30.287996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] validate_networks() for [('83c51425-0208-4ecf-9ac9-35434c20aad6', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:10:30.293767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:30.298378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:30.299535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:30.300471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:32.157069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.179642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.185709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.188835 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-71eac93e-bb70-4fa1-a517-e9001279d977 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1891 microversion: 2.32 time: 2.018826 Aug 25 13:10:32.210559 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1687/3421] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:30 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1891 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:32.251817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:32.253479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:32.284280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:32.285734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:32.286915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:32.288728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:32.290116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:32.292134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:32.568042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.611187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.615304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.619817 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2fccb32-9e8e-4d29-99b8-05187c6c5a5d tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.405145 Aug 25 13:10:32.641798 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1688/3422] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:32 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:32.669132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1729276977", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "7c492fa6-6e78-453d-bf88-c7f9aac830a1"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:32.913680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] validate_networks() for [('7c492fa6-6e78-453d-bf88-c7f9aac830a1', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:10:33.390009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:10:33.390875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:10:33.391781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:10:33.392608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:10:33.395915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:10:33.444990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:33.447793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:33.449499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:33.455619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:33.458086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:33.459861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:33.534450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Getting quotas for project 47a0144c8345403bb4c6728543a34076. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:10:33.557708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Getting quotas for user e7fbb17c9f8e4220ac149cf51502fd20 and project 47a0144c8345403bb4c6728543a34076. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:10:33.600469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:10:33.610564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:10:33.744656 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-792e802a-2c7b-4ac8-8a79-b999be484c93 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.711599 Aug 25 13:10:33.747140 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1735/3423] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:10:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 3717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:10:33.760014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c71d06f6-3c5e-4e18-9095-3467b8db9327 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:33.762016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c71d06f6-3c5e-4e18-9095-3467b8db9327 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:33.781634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c71d06f6-3c5e-4e18-9095-3467b8db9327 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:33.784196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c71d06f6-3c5e-4e18-9095-3467b8db9327 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:33.786412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c71d06f6-3c5e-4e18-9095-3467b8db9327 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:33.789348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c71d06f6-3c5e-4e18-9095-3467b8db9327 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:33.791593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c71d06f6-3c5e-4e18-9095-3467b8db9327 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:33.793864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c71d06f6-3c5e-4e18-9095-3467b8db9327 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:33.861053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:34.497329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c71d06f6-3c5e-4e18-9095-3467b8db9327 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:34.534377 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c71d06f6-3c5e-4e18-9095-3467b8db9327 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1371 microversion: 2.1 time: 0.782337 Aug 25 13:10:34.536916 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1736/3424] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:33 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1371 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:34.587344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:10:34.589386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:10:34.590554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:10:34.594308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc15290d-d09a-4061-8127-bb777c4f2b82 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:34.594617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:10:34.598218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc15290d-d09a-4061-8127-bb777c4f2b82 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:34.600894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:10:34.624515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc15290d-d09a-4061-8127-bb777c4f2b82 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:34.630514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc15290d-d09a-4061-8127-bb777c4f2b82 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:34.634672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc15290d-d09a-4061-8127-bb777c4f2b82 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:34.639633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc15290d-d09a-4061-8127-bb777c4f2b82 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:34.640964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc15290d-d09a-4061-8127-bb777c4f2b82 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:34.642231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc15290d-d09a-4061-8127-bb777c4f2b82 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:34.685749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:34.688918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:34.694574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:34.701360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:34.702378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:34.707231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:34.823111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:10:34.849230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for user e320ccc6c0624541895fc42bf681da76 and project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:10:34.887857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:10:34.893177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:10:35.030024 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f3dbddb9-a4db-4f84-abf0-56fcc15f3074 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.380789 Aug 25 13:10:35.041475 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1689/3425] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:10:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:10:35.041475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d6974adf-599a-4779-918d-d478a64f9a0d req-fdec0e96-a54b-4b5a-8c43-bc5af5d87e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "tag": "5ef83c87-8cc0-47a2-bbb9-0e65f095a703"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:35.073574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d6974adf-599a-4779-918d-d478a64f9a0d req-fdec0e96-a54b-4b5a-8c43-bc5af5d87e80 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:35.086461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d6974adf-599a-4779-918d-d478a64f9a0d req-fdec0e96-a54b-4b5a-8c43-bc5af5d87e80 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:35.087661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d6974adf-599a-4779-918d-d478a64f9a0d req-fdec0e96-a54b-4b5a-8c43-bc5af5d87e80 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:35.148915 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d6974adf-599a-4779-918d-d478a64f9a0d req-fdec0e96-a54b-4b5a-8c43-bc5af5d87e80 service nova] Creating event network-changed:5ef83c87-8cc0-47a2-bbb9-0e65f095a703 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:10:35.162180 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d6974adf-599a-4779-918d-d478a64f9a0d req-fdec0e96-a54b-4b5a-8c43-bc5af5d87e80 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128093 Aug 25 13:10:35.164333 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1690/3426] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:35.181422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:35.184278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:35.204150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:35.206593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:35.208993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:35.211363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:35.213012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:35.214914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:36.755332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc15290d-d09a-4061-8127-bb777c4f2b82 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:36.833031 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc15290d-d09a-4061-8127-bb777c4f2b82 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1334 microversion: 2.1 time: 2.259016 Aug 25 13:10:36.865445 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1737/3427] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:34 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1334 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:36.887587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:36.904910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:36.932512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:36.938777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:36.941671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:36.948649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:36.957759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:36.963828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:37.446902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.470050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.481113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.490391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.506793 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3634bd8d-1930-44bc-ad5c-22ce1d2506dc tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1891 microversion: 2.32 time: 2.339787 Aug 25 13:10:37.508153 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1691/3428] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:35 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1891 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:37.515878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7a4ac2bb-2405-4bff-bad9-9a25e6d520f0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:37.518995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7a4ac2bb-2405-4bff-bad9-9a25e6d520f0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:37.545348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a4ac2bb-2405-4bff-bad9-9a25e6d520f0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:37.546638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a4ac2bb-2405-4bff-bad9-9a25e6d520f0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:37.547516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a4ac2bb-2405-4bff-bad9-9a25e6d520f0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:37.555310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a4ac2bb-2405-4bff-bad9-9a25e6d520f0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:37.556273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a4ac2bb-2405-4bff-bad9-9a25e6d520f0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:37.556849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.557556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a4ac2bb-2405-4bff-bad9-9a25e6d520f0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:37.569844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.576252 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2de95d2-f5eb-4294-9f38-6f5617a0d856 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1604 microversion: 2.42 time: 0.708539 Aug 25 13:10:37.579681 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1738/3429] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:36 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1604 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:37.617731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1ec236fd-84a3-4fe4-b717-6c05beccc268 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:37.624964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1ec236fd-84a3-4fe4-b717-6c05beccc268 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:37.638266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:37.666331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec236fd-84a3-4fe4-b717-6c05beccc268 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:37.667616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec236fd-84a3-4fe4-b717-6c05beccc268 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:37.668089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec236fd-84a3-4fe4-b717-6c05beccc268 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:37.669561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec236fd-84a3-4fe4-b717-6c05beccc268 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:37.670415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec236fd-84a3-4fe4-b717-6c05beccc268 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:37.673630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ec236fd-84a3-4fe4-b717-6c05beccc268 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:37.946427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7a4ac2bb-2405-4bff-bad9-9a25e6d520f0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.956356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1ec236fd-84a3-4fe4-b717-6c05beccc268 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.977189 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7a4ac2bb-2405-4bff-bad9-9a25e6d520f0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1272 microversion: 2.1 time: 0.466968 Aug 25 13:10:37.979730 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1692/3430] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:37 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1272 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:37.990542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9d028ff6-0f22-44c1-a7c9-899d5748c424 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:37.992777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9d028ff6-0f22-44c1-a7c9-899d5748c424 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:37.997380 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1ec236fd-84a3-4fe4-b717-6c05beccc268 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1267 microversion: 2.1 time: 0.403640 Aug 25 13:10:38.011331 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1739/3431] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:37 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1267 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:38.023905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-efc8b64f-2d07-456a-b141-2a28b79690e6 req-53a30535-d689-4d87-b902-292054db3463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "tag": "3d6b512c-f6c6-4653-ac20-613fdfd4cfd3"}, {"name": "network-changed", "server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "tag": "67845e42-86bc-468e-af48-e1b8969e1ce8"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:38.026273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d028ff6-0f22-44c1-a7c9-899d5748c424 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:38.027760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d028ff6-0f22-44c1-a7c9-899d5748c424 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:38.039943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d028ff6-0f22-44c1-a7c9-899d5748c424 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:38.046589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-efc8b64f-2d07-456a-b141-2a28b79690e6 req-53a30535-d689-4d87-b902-292054db3463 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:38.048624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-efc8b64f-2d07-456a-b141-2a28b79690e6 req-53a30535-d689-4d87-b902-292054db3463 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:38.049687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d028ff6-0f22-44c1-a7c9-899d5748c424 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:38.050214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-efc8b64f-2d07-456a-b141-2a28b79690e6 req-53a30535-d689-4d87-b902-292054db3463 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:38.052661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d028ff6-0f22-44c1-a7c9-899d5748c424 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:38.054689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d028ff6-0f22-44c1-a7c9-899d5748c424 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:38.092086 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-efc8b64f-2d07-456a-b141-2a28b79690e6 req-53a30535-d689-4d87-b902-292054db3463 service nova] Creating event network-changed:3d6b512c-f6c6-4653-ac20-613fdfd4cfd3 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:10:38.098260 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-efc8b64f-2d07-456a-b141-2a28b79690e6 req-53a30535-d689-4d87-b902-292054db3463 service nova] Creating event network-changed:67845e42-86bc-468e-af48-e1b8969e1ce8 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:10:38.142238 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-efc8b64f-2d07-456a-b141-2a28b79690e6 req-53a30535-d689-4d87-b902-292054db3463 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.123668 Aug 25 13:10:38.145905 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1740/3432] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:38.170008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9a2403f8-59d5-4844-8511-4442fe3cd6ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:38.175687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9a2403f8-59d5-4844-8511-4442fe3cd6ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:38.205787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a2403f8-59d5-4844-8511-4442fe3cd6ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:38.211308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a2403f8-59d5-4844-8511-4442fe3cd6ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:38.213611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a2403f8-59d5-4844-8511-4442fe3cd6ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:38.218004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a2403f8-59d5-4844-8511-4442fe3cd6ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:38.224308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a2403f8-59d5-4844-8511-4442fe3cd6ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:38.225628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a2403f8-59d5-4844-8511-4442fe3cd6ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:39.451018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9d028ff6-0f22-44c1-a7c9-899d5748c424 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:39.482874 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9d028ff6-0f22-44c1-a7c9-899d5748c424 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1371 microversion: 2.1 time: 1.497848 Aug 25 13:10:39.487108 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1693/3433] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:37 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1371 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:39.534705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:39.539181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:39.555952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:39.562276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:39.565905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:39.568905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:39.572123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:39.574474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:39.576196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:40.504750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9a2403f8-59d5-4844-8511-4442fe3cd6ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:40.549930 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9a2403f8-59d5-4844-8511-4442fe3cd6ac tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1334 microversion: 2.1 time: 2.395980 Aug 25 13:10:40.557597 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1741/3434] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:38 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1334 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:40.577566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:40.586581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:40.603098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:40.625260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:40.626140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:40.627532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:40.628439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:40.629870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:40.792571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:40.793453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:40.794422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:40.795277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lazy-loading 'fault' on Instance uuid faec1bd7-9479-44e9-82f8-7db70ccd668a {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:41.101010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:41.118245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:41.131653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:41.135881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2af4362b4f9e40deb004983ba8cd43a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8cc27316e7c44e0a1b9d1f608ee22cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:41.142174 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-01e1cda5-0d67-4adc-8dfa-218b0f4f0c81 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 200 len: 1371 microversion: 2.42 time: 0.572942 Aug 25 13:10:41.152455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:41.160193 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1742/3435] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:40 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 1371 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:41.163557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:41.166427 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7dab72bc-07c7-4cc5-9b53-22b1f43f4877 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1891 microversion: 2.32 time: 1.676352 Aug 25 13:10:41.169343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9984626-206d-473e-abd2-146c20126012 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:41.184734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b9984626-206d-473e-abd2-146c20126012 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:41.202007 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1694/3436] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:39 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1891 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:41.217592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9984626-206d-473e-abd2-146c20126012 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.219484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9984626-206d-473e-abd2-146c20126012 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.220572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9984626-206d-473e-abd2-146c20126012 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:41.222248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9984626-206d-473e-abd2-146c20126012 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.223900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d6a1f09c-91c7-43e4-99aa-65b553319edb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:41.225080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d6a1f09c-91c7-43e4-99aa-65b553319edb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:41.226235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9984626-206d-473e-abd2-146c20126012 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.227415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9984626-206d-473e-abd2-146c20126012 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:41.281220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6a1f09c-91c7-43e4-99aa-65b553319edb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.287019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6a1f09c-91c7-43e4-99aa-65b553319edb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.288100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6a1f09c-91c7-43e4-99aa-65b553319edb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:41.292326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6a1f09c-91c7-43e4-99aa-65b553319edb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.296315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6a1f09c-91c7-43e4-99aa-65b553319edb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.300454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6a1f09c-91c7-43e4-99aa-65b553319edb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:41.552967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b9984626-206d-473e-abd2-146c20126012 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:41.585400 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9984626-206d-473e-abd2-146c20126012 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1272 microversion: 2.1 time: 0.419632 Aug 25 13:10:41.586862 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1743/3437] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:41 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1272 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:41.605108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b1f5526-8ea9-4e4f-9b6a-e91e208409dd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:41.616755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b1f5526-8ea9-4e4f-9b6a-e91e208409dd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:41.627890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1f5526-8ea9-4e4f-9b6a-e91e208409dd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.631967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1f5526-8ea9-4e4f-9b6a-e91e208409dd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.634930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1f5526-8ea9-4e4f-9b6a-e91e208409dd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:41.636257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1f5526-8ea9-4e4f-9b6a-e91e208409dd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.636825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d6a1f09c-91c7-43e4-99aa-65b553319edb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:41.672266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1f5526-8ea9-4e4f-9b6a-e91e208409dd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.673693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1f5526-8ea9-4e4f-9b6a-e91e208409dd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:41.673883 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d6a1f09c-91c7-43e4-99aa-65b553319edb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1273 microversion: 2.1 time: 0.467517 Aug 25 13:10:41.677424 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1695/3438] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:41 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1273 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:41.700689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9fca8efb-70ee-4143-b05c-fcbbab17ad2b tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:41.702022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9fca8efb-70ee-4143-b05c-fcbbab17ad2b tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:41.724825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fca8efb-70ee-4143-b05c-fcbbab17ad2b tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.725760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fca8efb-70ee-4143-b05c-fcbbab17ad2b tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.726591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fca8efb-70ee-4143-b05c-fcbbab17ad2b tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:41.727982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fca8efb-70ee-4143-b05c-fcbbab17ad2b tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.728844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fca8efb-70ee-4143-b05c-fcbbab17ad2b tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.729654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fca8efb-70ee-4143-b05c-fcbbab17ad2b tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:42.998155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b1f5526-8ea9-4e4f-9b6a-e91e208409dd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:43.026443 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b1f5526-8ea9-4e4f-9b6a-e91e208409dd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1371 microversion: 2.1 time: 1.436851 Aug 25 13:10:43.032962 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1744/3439] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:41 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1371 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:43.044868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9fca8efb-70ee-4143-b05c-fcbbab17ad2b tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:43.101186 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9fca8efb-70ee-4143-b05c-fcbbab17ad2b tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1334 microversion: 2.1 time: 1.421607 Aug 25 13:10:43.115920 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1696/3440] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:41 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1334 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:43.157087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:43.159725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:43.202164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:43.203837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:43.209101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.211117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:43.215776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:43.217172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.286462 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] HTTP exception thrown: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Request method failure captured: Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a HTTP/1.1 Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3I0YYEXPMB-EehaLcDwXNWtuSXBwThlmuRGYEJi_BVYbo2ZpX9j_lupuISvUzwsAid65KAPSjpftkjur5qhNvw1D4EFs2QFlwoAK-jUZylmkNu3DhBSltYKGdS2wdHRTb1xNnJgKfIZ77yTruq3DXev8OfDKDCcg5_59f1DGzjJQGA Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Openstack-Nova-Api-Version: 2.42 Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f8cc27316e7c44e0a1b9d1f608ee22cc Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1987852832 Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f8cc27316e7c44e0a1b9d1f608ee22cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f8cc27316e7c44e0a1b9d1f608ee22cc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f8cc27316e7c44e0a1b9d1f608ee22cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f8cc27316e7c44e0a1b9d1f608ee22cc"}]}] Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1987852832 Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f8cc27316e7c44e0a1b9d1f608ee22cc Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1987852832 Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TaggedBootDevicesTest_v242-1987852832-project Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2af4362b4f9e40deb004983ba8cd43a7 Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1987852832-project Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'faec1bd7-9479-44e9-82f8-7db70ccd668a'} Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:10:43.293188 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:10:43.304550 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:10:43.304550 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:10:43.304550 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:10:43.304550 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:10:43.304550 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:10:43.304550 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:10:43.304550 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:10:43.304550 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:10:43.304550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Returning 404 to user: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:10:43.304550 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a28053a7-51be-42ea-ac8f-e13ad0ba3359 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 404 len: 111 microversion: 2.42 time: 0.165628 Aug 25 13:10:43.307946 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1697/3441] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:43 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:10:43.325324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:43.327790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:43.342487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:43.343277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:43.343973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.346712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:43.347183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:43.353678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.498574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:43.583701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:43.684346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b71825fa-5daf-4213-8d04-27c257819087 req-9a12c0b8-d183-4714-8603-925c1e30d0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd72616-bd88-48a3-b762-5c0cc614454c", "name": "network-vif-plugged", "status": "completed", "tag": "9ae1b8b4-a711-4456-a821-46e24d3556b9"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:43.729304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b71825fa-5daf-4213-8d04-27c257819087 req-9a12c0b8-d183-4714-8603-925c1e30d0b3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:43.730805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b71825fa-5daf-4213-8d04-27c257819087 req-9a12c0b8-d183-4714-8603-925c1e30d0b3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:43.731953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b71825fa-5daf-4213-8d04-27c257819087 req-9a12c0b8-d183-4714-8603-925c1e30d0b3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.759720 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b71825fa-5daf-4213-8d04-27c257819087 req-9a12c0b8-d183-4714-8603-925c1e30d0b3 service nova] Creating event network-vif-plugged:9ae1b8b4-a711-4456-a821-46e24d3556b9 for instance ddd72616-bd88-48a3-b762-5c0cc614454c on n-h2-852771-8 Aug 25 13:10:43.782910 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b71825fa-5daf-4213-8d04-27c257819087 req-9a12c0b8-d183-4714-8603-925c1e30d0b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.740887 Aug 25 13:10:43.784622 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1745/3442] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:43.810848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-411e702b-a5f6-447a-bc78-2dbdfb4a6a13 req-c1432fc0-210f-4ee8-bdcb-242c86ac6309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "tag": "2fde30af-7c62-406e-af8d-ea3df7741a85"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:43.860864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-411e702b-a5f6-447a-bc78-2dbdfb4a6a13 req-c1432fc0-210f-4ee8-bdcb-242c86ac6309 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:43.862376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-411e702b-a5f6-447a-bc78-2dbdfb4a6a13 req-c1432fc0-210f-4ee8-bdcb-242c86ac6309 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:43.864343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-411e702b-a5f6-447a-bc78-2dbdfb4a6a13 req-c1432fc0-210f-4ee8-bdcb-242c86ac6309 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.950063 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-411e702b-a5f6-447a-bc78-2dbdfb4a6a13 req-c1432fc0-210f-4ee8-bdcb-242c86ac6309 service nova] Creating event network-changed:2fde30af-7c62-406e-af8d-ea3df7741a85 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:10:43.983635 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-411e702b-a5f6-447a-bc78-2dbdfb4a6a13 req-c1432fc0-210f-4ee8-bdcb-242c86ac6309 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192892 Aug 25 13:10:44.004314 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1746/3443] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:44.041973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e8fa0c8-3a60-413c-be53-a0cd44b7c5eb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:44.045891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5e8fa0c8-3a60-413c-be53-a0cd44b7c5eb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:44.065033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8fa0c8-3a60-413c-be53-a0cd44b7c5eb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:44.067144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8fa0c8-3a60-413c-be53-a0cd44b7c5eb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:44.068395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8fa0c8-3a60-413c-be53-a0cd44b7c5eb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:44.072081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8fa0c8-3a60-413c-be53-a0cd44b7c5eb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:44.073836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8fa0c8-3a60-413c-be53-a0cd44b7c5eb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:44.075217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8fa0c8-3a60-413c-be53-a0cd44b7c5eb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:44.780947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:44.873747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:45.547375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:45.594741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:45.599943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:45.610955 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b7aa2849-d2c4-4a92-8169-8f7c09dd5858 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1891 microversion: 2.32 time: 2.300350 Aug 25 13:10:45.622082 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1698/3444] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:43 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1891 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:45.656338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63837b74-b10d-4fe8-90df-5c2309abd221 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:45.657955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-63837b74-b10d-4fe8-90df-5c2309abd221 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:45.672321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63837b74-b10d-4fe8-90df-5c2309abd221 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:45.673735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63837b74-b10d-4fe8-90df-5c2309abd221 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:45.674911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63837b74-b10d-4fe8-90df-5c2309abd221 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:45.677558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63837b74-b10d-4fe8-90df-5c2309abd221 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:45.678698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63837b74-b10d-4fe8-90df-5c2309abd221 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:45.679717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63837b74-b10d-4fe8-90df-5c2309abd221 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:45.945431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5e8fa0c8-3a60-413c-be53-a0cd44b7c5eb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:45.978191 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5e8fa0c8-3a60-413c-be53-a0cd44b7c5eb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1314 microversion: 2.1 time: 1.966672 Aug 25 13:10:45.979297 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1747/3445] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:44 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1314 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:45.992073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-69ec43c7-84fb-4d7b-a954-c424c3063404 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '.version_select at 0x7f3a2a3a2dc0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:46.073336 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-69ec43c7-84fb-4d7b-a954-c424c3063404 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908816326" status: 204 len: 0 microversion: 2.42 time: 0.083368 Aug 25 13:10:46.074573 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1748/3446] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 13:10:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908816326 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:10:46.093540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-25876229-e286-4c12-8768-29ed387755cd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:46.095094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-25876229-e286-4c12-8768-29ed387755cd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:46.127947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25876229-e286-4c12-8768-29ed387755cd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:46.129491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25876229-e286-4c12-8768-29ed387755cd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:46.145026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25876229-e286-4c12-8768-29ed387755cd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:46.146571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25876229-e286-4c12-8768-29ed387755cd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:46.153431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25876229-e286-4c12-8768-29ed387755cd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:46.154853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25876229-e286-4c12-8768-29ed387755cd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:47.747804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-63837b74-b10d-4fe8-90df-5c2309abd221 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:47.794501 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-63837b74-b10d-4fe8-90df-5c2309abd221 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1315 microversion: 2.1 time: 2.169979 Aug 25 13:10:47.798524 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1699/3447] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:45 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1315 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:47.816892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89a2268a-a13a-49d2-9054-8a1a39f2f60c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:47.821800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89a2268a-a13a-49d2-9054-8a1a39f2f60c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:47.855235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89a2268a-a13a-49d2-9054-8a1a39f2f60c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:47.858588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89a2268a-a13a-49d2-9054-8a1a39f2f60c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:47.861399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89a2268a-a13a-49d2-9054-8a1a39f2f60c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:47.862499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89a2268a-a13a-49d2-9054-8a1a39f2f60c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:47.865952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89a2268a-a13a-49d2-9054-8a1a39f2f60c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:47.867471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89a2268a-a13a-49d2-9054-8a1a39f2f60c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:48.632699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-25876229-e286-4c12-8768-29ed387755cd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:48.712394 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-25876229-e286-4c12-8768-29ed387755cd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1371 microversion: 2.1 time: 2.635434 Aug 25 13:10:48.713395 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1749/3448] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:46 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1371 bytes in 2638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:48.733562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c22b8604-0cd3-40e4-b2be-3a9d68628acb req-ba586b62-ded6-46e0-9361-b4ae5cf70918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd72616-bd88-48a3-b762-5c0cc614454c", "name": "network-vif-plugged", "status": "completed", "tag": "ccfa3144-9718-4f11-aa8c-66a23b23629e"}, {"server_uuid": "9a51c80a-6c87-4026-9025-4630451ff316", "name": "network-vif-plugged", "status": "completed", "tag": "293e697b-408f-4624-b636-1dbb45a2380c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:48.796992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c22b8604-0cd3-40e4-b2be-3a9d68628acb req-ba586b62-ded6-46e0-9361-b4ae5cf70918 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:48.804248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c22b8604-0cd3-40e4-b2be-3a9d68628acb req-ba586b62-ded6-46e0-9361-b4ae5cf70918 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:48.805266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c22b8604-0cd3-40e4-b2be-3a9d68628acb req-ba586b62-ded6-46e0-9361-b4ae5cf70918 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:48.857788 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c22b8604-0cd3-40e4-b2be-3a9d68628acb req-ba586b62-ded6-46e0-9361-b4ae5cf70918 service nova] Creating event network-vif-plugged:ccfa3144-9718-4f11-aa8c-66a23b23629e for instance ddd72616-bd88-48a3-b762-5c0cc614454c on n-h2-852771-8 Aug 25 13:10:48.859436 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c22b8604-0cd3-40e4-b2be-3a9d68628acb req-ba586b62-ded6-46e0-9361-b4ae5cf70918 service nova] Creating event network-vif-plugged:293e697b-408f-4624-b636-1dbb45a2380c for instance 9a51c80a-6c87-4026-9025-4630451ff316 on n-h2-852771-8 Aug 25 13:10:48.877041 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c22b8604-0cd3-40e4-b2be-3a9d68628acb req-ba586b62-ded6-46e0-9361-b4ae5cf70918 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.160290 Aug 25 13:10:48.879434 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1750/3449] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:48.907729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:48.913548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:48.954890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:48.955663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:48.956485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:48.958251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:48.958840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:48.959567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:49.473851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89a2268a-a13a-49d2-9054-8a1a39f2f60c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:49.511112 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89a2268a-a13a-49d2-9054-8a1a39f2f60c tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1334 microversion: 2.1 time: 1.705996 Aug 25 13:10:49.514308 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1700/3450] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:47 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1334 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:49.528085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-78e07cae-73da-47d4-8970-69a89781e366 req-7bf6cea5-0eb9-46ee-a3f5-686d3bb20895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7bb552-cda2-4dca-a09f-db46de2fd7ef", "tag": "f522e2ee-e266-42dd-bb31-b3177aff9970"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:49.615786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-78e07cae-73da-47d4-8970-69a89781e366 req-7bf6cea5-0eb9-46ee-a3f5-686d3bb20895 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:49.620031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-78e07cae-73da-47d4-8970-69a89781e366 req-7bf6cea5-0eb9-46ee-a3f5-686d3bb20895 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:49.630243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-78e07cae-73da-47d4-8970-69a89781e366 req-7bf6cea5-0eb9-46ee-a3f5-686d3bb20895 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:49.697924 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-78e07cae-73da-47d4-8970-69a89781e366 req-7bf6cea5-0eb9-46ee-a3f5-686d3bb20895 service nova] Creating event network-changed:f522e2ee-e266-42dd-bb31-b3177aff9970 for instance fb7bb552-cda2-4dca-a09f-db46de2fd7ef on n-h1-852771-8 Aug 25 13:10:49.714025 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-78e07cae-73da-47d4-8970-69a89781e366 req-7bf6cea5-0eb9-46ee-a3f5-686d3bb20895 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196668 Aug 25 13:10:49.717242 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1701/3451] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:49.735616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1a1eddff-b649-4e1d-8b9e-4496bc7ce46a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:49.737563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1a1eddff-b649-4e1d-8b9e-4496bc7ce46a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:49.766433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1eddff-b649-4e1d-8b9e-4496bc7ce46a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:49.767054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1eddff-b649-4e1d-8b9e-4496bc7ce46a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:49.767844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1eddff-b649-4e1d-8b9e-4496bc7ce46a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:49.774679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1eddff-b649-4e1d-8b9e-4496bc7ce46a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:49.775340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1eddff-b649-4e1d-8b9e-4496bc7ce46a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:49.777812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1eddff-b649-4e1d-8b9e-4496bc7ce46a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:50.818185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:50.844831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:50.863315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:50.868337 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-93b9d76a-6b1e-4c78-b4c4-b54e3001099e tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1891 microversion: 2.32 time: 1.985160 Aug 25 13:10:50.873757 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1751/3452] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:48 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1891 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:50.892346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7eb36d1e-32a6-4c52-bb2c-68ca54649e08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:50.894055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7eb36d1e-32a6-4c52-bb2c-68ca54649e08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:50.911270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:50.921691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eb36d1e-32a6-4c52-bb2c-68ca54649e08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:50.925942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eb36d1e-32a6-4c52-bb2c-68ca54649e08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:50.927095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eb36d1e-32a6-4c52-bb2c-68ca54649e08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:50.929358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eb36d1e-32a6-4c52-bb2c-68ca54649e08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:50.930425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eb36d1e-32a6-4c52-bb2c-68ca54649e08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:50.931266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7eb36d1e-32a6-4c52-bb2c-68ca54649e08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:51.165635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1a1eddff-b649-4e1d-8b9e-4496bc7ce46a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:51.194534 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1a1eddff-b649-4e1d-8b9e-4496bc7ce46a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1314 microversion: 2.1 time: 1.471118 Aug 25 13:10:51.196167 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1702/3453] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:49 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1314 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:51.202079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-68ec861f-bb1c-49ca-b3c1-0df5f1fba90a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:51.203380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-68ec861f-bb1c-49ca-b3c1-0df5f1fba90a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:51.212866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68ec861f-bb1c-49ca-b3c1-0df5f1fba90a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:51.213986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68ec861f-bb1c-49ca-b3c1-0df5f1fba90a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:51.214836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68ec861f-bb1c-49ca-b3c1-0df5f1fba90a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:51.215899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68ec861f-bb1c-49ca-b3c1-0df5f1fba90a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:51.216827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68ec861f-bb1c-49ca-b3c1-0df5f1fba90a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:51.217455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68ec861f-bb1c-49ca-b3c1-0df5f1fba90a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:51.801420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7eb36d1e-32a6-4c52-bb2c-68ca54649e08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:51.814337 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7eb36d1e-32a6-4c52-bb2c-68ca54649e08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1315 microversion: 2.1 time: 0.942001 Aug 25 13:10:51.815311 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1752/3454] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:50 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:51.845160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0998e66b-1e34-473c-bfbe-5c12654a4639 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:51.847981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0998e66b-1e34-473c-bfbe-5c12654a4639 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:51.852232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-68ec861f-bb1c-49ca-b3c1-0df5f1fba90a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:51.865896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0998e66b-1e34-473c-bfbe-5c12654a4639 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:51.867248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0998e66b-1e34-473c-bfbe-5c12654a4639 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:51.868320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0998e66b-1e34-473c-bfbe-5c12654a4639 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:51.869153 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-68ec861f-bb1c-49ca-b3c1-0df5f1fba90a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1371 microversion: 2.1 time: 0.671083 Aug 25 13:10:51.870244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0998e66b-1e34-473c-bfbe-5c12654a4639 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:51.871374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0998e66b-1e34-473c-bfbe-5c12654a4639 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:51.872568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0998e66b-1e34-473c-bfbe-5c12654a4639 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:51.881944 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1703/3455] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:51 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1371 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:51.921036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:51.925796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:51.951295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:51.954476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:51.959989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:51.962294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:51.966504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:51.967830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:52.583456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0998e66b-1e34-473c-bfbe-5c12654a4639 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.604767 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0998e66b-1e34-473c-bfbe-5c12654a4639 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1334 microversion: 2.1 time: 0.786220 Aug 25 13:10:52.625548 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1753/3456] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:51 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1334 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:52.625548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-60143eb9-ebee-4477-bcc0-48d8fc8db6ea req-0f55d89f-b332-41eb-9c78-e734ebf1fa6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "tag": "5b7c31c9-60ee-492f-b4f4-8144364f3d01"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:52.641018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-60143eb9-ebee-4477-bcc0-48d8fc8db6ea req-0f55d89f-b332-41eb-9c78-e734ebf1fa6e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.652457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-60143eb9-ebee-4477-bcc0-48d8fc8db6ea req-0f55d89f-b332-41eb-9c78-e734ebf1fa6e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.653576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-60143eb9-ebee-4477-bcc0-48d8fc8db6ea req-0f55d89f-b332-41eb-9c78-e734ebf1fa6e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:52.674667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.695441 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-60143eb9-ebee-4477-bcc0-48d8fc8db6ea req-0f55d89f-b332-41eb-9c78-e734ebf1fa6e service nova] Creating event network-changed:5b7c31c9-60ee-492f-b4f4-8144364f3d01 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:10:52.707173 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-60143eb9-ebee-4477-bcc0-48d8fc8db6ea req-0f55d89f-b332-41eb-9c78-e734ebf1fa6e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098595 Aug 25 13:10:52.708039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.709896 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1754/3457] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:52.713922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.716452 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-92480153-d6f8-43c5-90f9-8caa80a37805 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1891 microversion: 2.32 time: 0.804131 Aug 25 13:10:52.722055 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1704/3458] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:51 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1891 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:52.724368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5137d948-ca80-4b0e-9658-dbd03db7b2fd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:52.725922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5137d948-ca80-4b0e-9658-dbd03db7b2fd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:52.757818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5137d948-ca80-4b0e-9658-dbd03db7b2fd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.759276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5137d948-ca80-4b0e-9658-dbd03db7b2fd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.760887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5137d948-ca80-4b0e-9658-dbd03db7b2fd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:52.764531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5137d948-ca80-4b0e-9658-dbd03db7b2fd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.765906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5137d948-ca80-4b0e-9658-dbd03db7b2fd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.766970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5137d948-ca80-4b0e-9658-dbd03db7b2fd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:52.857487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c4ab16c-e380-4f31-8b57-8f59d1795c94 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:52.859715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0c4ab16c-e380-4f31-8b57-8f59d1795c94 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:52.900295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4ab16c-e380-4f31-8b57-8f59d1795c94 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.901922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4ab16c-e380-4f31-8b57-8f59d1795c94 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.903406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4ab16c-e380-4f31-8b57-8f59d1795c94 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:52.906058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4ab16c-e380-4f31-8b57-8f59d1795c94 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.920289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4ab16c-e380-4f31-8b57-8f59d1795c94 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.921799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4ab16c-e380-4f31-8b57-8f59d1795c94 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:53.717617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5137d948-ca80-4b0e-9658-dbd03db7b2fd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:53.739799 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5137d948-ca80-4b0e-9658-dbd03db7b2fd tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1314 microversion: 2.1 time: 1.026208 Aug 25 13:10:53.741639 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1755/3459] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:52 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1314 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:53.755242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b37cc589-57c0-4eab-9f9d-4058c8283dc9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:53.757916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b37cc589-57c0-4eab-9f9d-4058c8283dc9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:53.788200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b37cc589-57c0-4eab-9f9d-4058c8283dc9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:53.791143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0c4ab16c-e380-4f31-8b57-8f59d1795c94 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:53.795700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b37cc589-57c0-4eab-9f9d-4058c8283dc9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:53.799233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b37cc589-57c0-4eab-9f9d-4058c8283dc9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:53.801683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b37cc589-57c0-4eab-9f9d-4058c8283dc9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:53.802889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b37cc589-57c0-4eab-9f9d-4058c8283dc9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:53.805405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b37cc589-57c0-4eab-9f9d-4058c8283dc9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:53.846010 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0c4ab16c-e380-4f31-8b57-8f59d1795c94 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1315 microversion: 2.1 time: 0.996386 Aug 25 13:10:53.856008 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1705/3460] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:52 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1315 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:53.864397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c8ccccf1-23c6-429e-957d-a153a936caaf req-ba2a3f4e-6fd1-4bc8-aa87-1c099106abdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b134543-2d20-46bb-bcee-9bb6c08477c5", "tag": "fc7efbfc-5b36-4b04-9253-650547862383"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:53.944187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c8ccccf1-23c6-429e-957d-a153a936caaf req-ba2a3f4e-6fd1-4bc8-aa87-1c099106abdc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:53.948314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c8ccccf1-23c6-429e-957d-a153a936caaf req-ba2a3f4e-6fd1-4bc8-aa87-1c099106abdc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:53.954500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c8ccccf1-23c6-429e-957d-a153a936caaf req-ba2a3f4e-6fd1-4bc8-aa87-1c099106abdc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:54.000148 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c8ccccf1-23c6-429e-957d-a153a936caaf req-ba2a3f4e-6fd1-4bc8-aa87-1c099106abdc service nova] Creating event network-changed:fc7efbfc-5b36-4b04-9253-650547862383 for instance 5b134543-2d20-46bb-bcee-9bb6c08477c5 on n-h1-852771-8 Aug 25 13:10:54.028850 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c8ccccf1-23c6-429e-957d-a153a936caaf req-ba2a3f4e-6fd1-4bc8-aa87-1c099106abdc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169302 Aug 25 13:10:54.034597 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1706/3461] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:54.056756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-342ee296-f6fa-47ef-a301-7e9a234efd5d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:54.059568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-342ee296-f6fa-47ef-a301-7e9a234efd5d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:54.086161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342ee296-f6fa-47ef-a301-7e9a234efd5d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:54.087682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342ee296-f6fa-47ef-a301-7e9a234efd5d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:54.090220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342ee296-f6fa-47ef-a301-7e9a234efd5d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:54.093198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342ee296-f6fa-47ef-a301-7e9a234efd5d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:54.096601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342ee296-f6fa-47ef-a301-7e9a234efd5d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:54.098727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-342ee296-f6fa-47ef-a301-7e9a234efd5d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:55.148858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b37cc589-57c0-4eab-9f9d-4058c8283dc9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:55.169712 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b37cc589-57c0-4eab-9f9d-4058c8283dc9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1557 microversion: 2.1 time: 1.425828 Aug 25 13:10:55.181320 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1756/3462] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:53 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1557 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:55.190922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:55.207347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:55.232179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:55.233973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:55.235103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:55.246287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:55.247969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:55.250063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:55.350886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:55.375594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-342ee296-f6fa-47ef-a301-7e9a234efd5d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:55.407013 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-342ee296-f6fa-47ef-a301-7e9a234efd5d tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1670 microversion: 2.1 time: 1.367935 Aug 25 13:10:55.422314 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1707/3463] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:54 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1670 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:55.448884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6011fc0e-4fc2-46ec-ac38-c1746bad5498 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:55.450072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6011fc0e-4fc2-46ec-ac38-c1746bad5498 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:55.464409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6011fc0e-4fc2-46ec-ac38-c1746bad5498 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:55.468697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6011fc0e-4fc2-46ec-ac38-c1746bad5498 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:55.477398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6011fc0e-4fc2-46ec-ac38-c1746bad5498 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:55.480991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6011fc0e-4fc2-46ec-ac38-c1746bad5498 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:55.482180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6011fc0e-4fc2-46ec-ac38-c1746bad5498 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:55.483113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6011fc0e-4fc2-46ec-ac38-c1746bad5498 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:56.323863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6011fc0e-4fc2-46ec-ac38-c1746bad5498 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:56.359490 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6011fc0e-4fc2-46ec-ac38-c1746bad5498 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1314 microversion: 2.1 time: 0.935074 Aug 25 13:10:56.366445 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1708/3464] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:55 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:56.378837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44252902-067c-4dc9-be8e-1a3bb0fe77af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:56.380869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44252902-067c-4dc9-be8e-1a3bb0fe77af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:56.402885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44252902-067c-4dc9-be8e-1a3bb0fe77af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:56.404289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44252902-067c-4dc9-be8e-1a3bb0fe77af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:56.406452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44252902-067c-4dc9-be8e-1a3bb0fe77af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:56.408032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44252902-067c-4dc9-be8e-1a3bb0fe77af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:56.412327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44252902-067c-4dc9-be8e-1a3bb0fe77af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:56.413148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44252902-067c-4dc9-be8e-1a3bb0fe77af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:57.110199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:57.154074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:57.159684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:57.169535 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad8c51cf-a46e-451d-a3e4-21e03a63e8d3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1891 microversion: 2.32 time: 1.981666 Aug 25 13:10:57.171132 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1757/3465] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:55 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1891 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:57.197967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9acee428-d4d1-4730-90e2-a257e8b6bffd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:57.199311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9acee428-d4d1-4730-90e2-a257e8b6bffd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:57.224196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acee428-d4d1-4730-90e2-a257e8b6bffd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:57.233032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acee428-d4d1-4730-90e2-a257e8b6bffd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:57.234543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acee428-d4d1-4730-90e2-a257e8b6bffd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:57.243090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acee428-d4d1-4730-90e2-a257e8b6bffd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:57.245387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acee428-d4d1-4730-90e2-a257e8b6bffd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:57.250180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acee428-d4d1-4730-90e2-a257e8b6bffd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:57.843172 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9acee428-d4d1-4730-90e2-a257e8b6bffd tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.668824 Aug 25 13:10:57.844855 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1758/3466] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:10:57 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-interface => generated 285 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:57.876085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b29b79b5-d1d9-4c73-ae8f-5ea09f20c5fc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:57.889833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b29b79b5-d1d9-4c73-ae8f-5ea09f20c5fc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:57.943952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b29b79b5-d1d9-4c73-ae8f-5ea09f20c5fc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:57.944873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b29b79b5-d1d9-4c73-ae8f-5ea09f20c5fc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:57.952480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b29b79b5-d1d9-4c73-ae8f-5ea09f20c5fc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:57.961728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b29b79b5-d1d9-4c73-ae8f-5ea09f20c5fc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:57.967756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b29b79b5-d1d9-4c73-ae8f-5ea09f20c5fc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:57.969146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b29b79b5-d1d9-4c73-ae8f-5ea09f20c5fc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.076425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44252902-067c-4dc9-be8e-1a3bb0fe77af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:58.142313 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44252902-067c-4dc9-be8e-1a3bb0fe77af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1315 microversion: 2.1 time: 1.770861 Aug 25 13:10:58.147647 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1709/3467] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:56 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1315 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:58.183555 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b29b79b5-d1d9-4c73-ae8f-5ea09f20c5fc tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c/ips" status: 200 len: 180 microversion: 2.1 time: 0.336064 Aug 25 13:10:58.186229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7f61711c-e51e-497d-a6c1-34b3e3ac6b7a req-c9cd8c0a-3c84-4df1-958f-c1382c0b0af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "tag": "577f3d0c-4649-4113-b00f-2661db107775"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:58.194318 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1759/3468] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:10:57 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c/ips => generated 180 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:58.216033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dd9efe94-4ff8-4582-a56d-690fb78d63f4 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:58.219268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dd9efe94-4ff8-4582-a56d-690fb78d63f4 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:58.242797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7f61711c-e51e-497d-a6c1-34b3e3ac6b7a req-c9cd8c0a-3c84-4df1-958f-c1382c0b0af5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.246806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7f61711c-e51e-497d-a6c1-34b3e3ac6b7a req-c9cd8c0a-3c84-4df1-958f-c1382c0b0af5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.247115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9efe94-4ff8-4582-a56d-690fb78d63f4 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.247807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9efe94-4ff8-4582-a56d-690fb78d63f4 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.248812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9efe94-4ff8-4582-a56d-690fb78d63f4 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.250578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7f61711c-e51e-497d-a6c1-34b3e3ac6b7a req-c9cd8c0a-3c84-4df1-958f-c1382c0b0af5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.251156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9efe94-4ff8-4582-a56d-690fb78d63f4 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.253056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9efe94-4ff8-4582-a56d-690fb78d63f4 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.254188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9efe94-4ff8-4582-a56d-690fb78d63f4 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.286323 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7f61711c-e51e-497d-a6c1-34b3e3ac6b7a req-c9cd8c0a-3c84-4df1-958f-c1382c0b0af5 service nova] Creating event network-changed:577f3d0c-4649-4113-b00f-2661db107775 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:10:58.298664 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7f61711c-e51e-497d-a6c1-34b3e3ac6b7a req-c9cd8c0a-3c84-4df1-958f-c1382c0b0af5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144073 Aug 25 13:10:58.304584 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1710/3469] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:58.330970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2fbb38c7-ad02-49e7-9d9a-16f95cea17e6 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:58.334686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2fbb38c7-ad02-49e7-9d9a-16f95cea17e6 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:58.365271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fbb38c7-ad02-49e7-9d9a-16f95cea17e6 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.368034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fbb38c7-ad02-49e7-9d9a-16f95cea17e6 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.371920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fbb38c7-ad02-49e7-9d9a-16f95cea17e6 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.373451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fbb38c7-ad02-49e7-9d9a-16f95cea17e6 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.375067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fbb38c7-ad02-49e7-9d9a-16f95cea17e6 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.378377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fbb38c7-ad02-49e7-9d9a-16f95cea17e6 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.492396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2fbb38c7-ad02-49e7-9d9a-16f95cea17e6 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:10:58.502035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:58.830957 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2fbb38c7-ad02-49e7-9d9a-16f95cea17e6 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 204 len: 0 microversion: 2.1 time: 0.518249 Aug 25 13:10:58.838209 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1711/3470] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:10:58 2022] DELETE /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:10:58.865709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:58.875090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:58.940797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.951103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.952687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.964172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.970566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.971977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:59.053029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dd9efe94-4ff8-4582-a56d-690fb78d63f4 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:59.086929 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dd9efe94-4ff8-4582-a56d-690fb78d63f4 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1314 microversion: 2.1 time: 0.887914 Aug 25 13:10:59.091365 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1760/3471] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:58 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1314 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:59.120580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c4a2847-175e-434b-91aa-17673c1dd4ab tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:59.137365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5c4a2847-175e-434b-91aa-17673c1dd4ab tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:59.171759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a2847-175e-434b-91aa-17673c1dd4ab tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:59.173152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a2847-175e-434b-91aa-17673c1dd4ab tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:59.174486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a2847-175e-434b-91aa-17673c1dd4ab tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:59.178938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a2847-175e-434b-91aa-17673c1dd4ab tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:59.183571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a2847-175e-434b-91aa-17673c1dd4ab tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:59.187007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4a2847-175e-434b-91aa-17673c1dd4ab tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:00.606813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5c4a2847-175e-434b-91aa-17673c1dd4ab tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:00.608893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:00.659564 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c4a2847-175e-434b-91aa-17673c1dd4ab tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1676 microversion: 2.1 time: 1.564882 Aug 25 13:11:00.681567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:00.682454 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1761/3472] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:59 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1676 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:00.683193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:00.686346 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-addbc314-e04d-4ceb-b421-f2d817deb82d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1891 microversion: 2.32 time: 1.847056 Aug 25 13:11:00.688277 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1712/3473] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:58 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1891 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:00.698080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a4de1235-5ddb-466c-b031-68d055386af2 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:00.707895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43ab829c-dbdf-44bf-ba36-35fb4db133f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:00.708970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43ab829c-dbdf-44bf-ba36-35fb4db133f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:00.710176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a4de1235-5ddb-466c-b031-68d055386af2 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:00.744568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43ab829c-dbdf-44bf-ba36-35fb4db133f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:00.745436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43ab829c-dbdf-44bf-ba36-35fb4db133f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:00.746215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43ab829c-dbdf-44bf-ba36-35fb4db133f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:00.747725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43ab829c-dbdf-44bf-ba36-35fb4db133f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:00.748814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43ab829c-dbdf-44bf-ba36-35fb4db133f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:00.749746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43ab829c-dbdf-44bf-ba36-35fb4db133f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:00.756290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4de1235-5ddb-466c-b031-68d055386af2 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:00.757670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4de1235-5ddb-466c-b031-68d055386af2 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:00.758651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4de1235-5ddb-466c-b031-68d055386af2 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:00.762596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4de1235-5ddb-466c-b031-68d055386af2 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:00.765053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4de1235-5ddb-466c-b031-68d055386af2 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:00.766078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4de1235-5ddb-466c-b031-68d055386af2 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:02.403581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a4de1235-5ddb-466c-b031-68d055386af2 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:02.451457 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a4de1235-5ddb-466c-b031-68d055386af2 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1314 microversion: 2.1 time: 1.757868 Aug 25 13:11:02.457601 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1713/3474] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:00 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1314 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:02.487034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7dc4123c-ea4c-47dc-bc8c-3995b770934a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:02.492496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7dc4123c-ea4c-47dc-bc8c-3995b770934a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:02.525906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dc4123c-ea4c-47dc-bc8c-3995b770934a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:02.531471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dc4123c-ea4c-47dc-bc8c-3995b770934a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:02.534437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dc4123c-ea4c-47dc-bc8c-3995b770934a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:02.540734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dc4123c-ea4c-47dc-bc8c-3995b770934a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:02.544526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dc4123c-ea4c-47dc-bc8c-3995b770934a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:02.546706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dc4123c-ea4c-47dc-bc8c-3995b770934a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:04.926360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43ab829c-dbdf-44bf-ba36-35fb4db133f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:04.962381 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43ab829c-dbdf-44bf-ba36-35fb4db133f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1315 microversion: 2.1 time: 4.271554 Aug 25 13:11:04.963981 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1762/3475] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:00 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1315 bytes in 4281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:04.996151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:05.002205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:05.018690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7dc4123c-ea4c-47dc-bc8c-3995b770934a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:05.055380 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7dc4123c-ea4c-47dc-bc8c-3995b770934a tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1676 microversion: 2.1 time: 2.592470 Aug 25 13:11:05.059060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.060506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.067945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.069892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.071333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.072199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.077801 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1714/3476] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:02 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1676 bytes in 2619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:05.131572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3e3835b3-2b29-4930-a0d6-199ee4675c6b req-bae2fb95-f97c-402b-af9f-56e6e4c80763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7bb552-cda2-4dca-a09f-db46de2fd7ef", "name": "network-vif-plugged", "status": "completed", "tag": "f522e2ee-e266-42dd-bb31-b3177aff9970"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:05.212309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e3835b3-2b29-4930-a0d6-199ee4675c6b req-bae2fb95-f97c-402b-af9f-56e6e4c80763 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.213227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e3835b3-2b29-4930-a0d6-199ee4675c6b req-bae2fb95-f97c-402b-af9f-56e6e4c80763 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.214053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e3835b3-2b29-4930-a0d6-199ee4675c6b req-bae2fb95-f97c-402b-af9f-56e6e4c80763 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.303096 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3e3835b3-2b29-4930-a0d6-199ee4675c6b req-bae2fb95-f97c-402b-af9f-56e6e4c80763 service nova] Creating event network-vif-plugged:f522e2ee-e266-42dd-bb31-b3177aff9970 for instance fb7bb552-cda2-4dca-a09f-db46de2fd7ef on n-h1-852771-8 Aug 25 13:11:05.333237 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3e3835b3-2b29-4930-a0d6-199ee4675c6b req-bae2fb95-f97c-402b-af9f-56e6e4c80763 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242639 Aug 25 13:11:05.336284 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1715/3477] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:05.384919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f3ad5dcb-ef4b-4641-a3c3-1cf4322e1deb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:05.386517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f3ad5dcb-ef4b-4641-a3c3-1cf4322e1deb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:05.426283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3ad5dcb-ef4b-4641-a3c3-1cf4322e1deb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.427041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3ad5dcb-ef4b-4641-a3c3-1cf4322e1deb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.433229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3ad5dcb-ef4b-4641-a3c3-1cf4322e1deb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.439200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3ad5dcb-ef4b-4641-a3c3-1cf4322e1deb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.440612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3ad5dcb-ef4b-4641-a3c3-1cf4322e1deb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.448857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3ad5dcb-ef4b-4641-a3c3-1cf4322e1deb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:06.521640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:06.596377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:06.639794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:06.672120 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f14b4723-e08a-40f4-81c9-570b0a889f4a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1891 microversion: 2.32 time: 1.705722 Aug 25 13:11:06.684938 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1763/3478] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:04 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1891 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:06.773822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cd2dcd79-567c-456b-bc9b-5717fe8d01f0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:06.780101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cd2dcd79-567c-456b-bc9b-5717fe8d01f0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:06.857328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2dcd79-567c-456b-bc9b-5717fe8d01f0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:06.870176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2dcd79-567c-456b-bc9b-5717fe8d01f0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:06.871379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2dcd79-567c-456b-bc9b-5717fe8d01f0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:06.872985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2dcd79-567c-456b-bc9b-5717fe8d01f0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:06.874205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2dcd79-567c-456b-bc9b-5717fe8d01f0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:06.875353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd2dcd79-567c-456b-bc9b-5717fe8d01f0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:07.396972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3ad5dcb-ef4b-4641-a3c3-1cf4322e1deb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:07.434005 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f3ad5dcb-ef4b-4641-a3c3-1cf4322e1deb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1314 microversion: 2.1 time: 2.072327 Aug 25 13:11:07.436965 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1716/3479] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:05 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1314 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:07.453011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-127724a5-d15c-4bc5-b47c-64b04895e1fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:07.462421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-127724a5-d15c-4bc5-b47c-64b04895e1fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:07.482782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-127724a5-d15c-4bc5-b47c-64b04895e1fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:07.491517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-127724a5-d15c-4bc5-b47c-64b04895e1fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:07.497913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-127724a5-d15c-4bc5-b47c-64b04895e1fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:07.499989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-127724a5-d15c-4bc5-b47c-64b04895e1fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:07.508158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-127724a5-d15c-4bc5-b47c-64b04895e1fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:07.509810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-127724a5-d15c-4bc5-b47c-64b04895e1fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:07.989892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cd2dcd79-567c-456b-bc9b-5717fe8d01f0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:08.034349 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cd2dcd79-567c-456b-bc9b-5717fe8d01f0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1315 microversion: 2.1 time: 1.314034 Aug 25 13:11:08.039333 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1764/3480] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:06 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1315 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:08.063355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1373f13a-4b26-4191-8a47-b4c53b32ad5a req-9561c346-9126-4ca8-9465-42c41f3d9c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a51c80a-6c87-4026-9025-4630451ff316", "tag": "293e697b-408f-4624-b636-1dbb45a2380c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:08.093661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1373f13a-4b26-4191-8a47-b4c53b32ad5a req-9561c346-9126-4ca8-9465-42c41f3d9c60 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:08.094917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1373f13a-4b26-4191-8a47-b4c53b32ad5a req-9561c346-9126-4ca8-9465-42c41f3d9c60 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:08.096492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1373f13a-4b26-4191-8a47-b4c53b32ad5a req-9561c346-9126-4ca8-9465-42c41f3d9c60 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:08.181065 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1373f13a-4b26-4191-8a47-b4c53b32ad5a req-9561c346-9126-4ca8-9465-42c41f3d9c60 service nova] Creating event network-changed:293e697b-408f-4624-b636-1dbb45a2380c for instance 9a51c80a-6c87-4026-9025-4630451ff316 on n-h2-852771-8 Aug 25 13:11:08.196399 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1373f13a-4b26-4191-8a47-b4c53b32ad5a req-9561c346-9126-4ca8-9465-42c41f3d9c60 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152538 Aug 25 13:11:08.209464 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1765/3481] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:08.235391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:08.240487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:08.271290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:08.273331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:08.279087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:08.280983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:08.282192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:08.287542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:08.677801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-127724a5-d15c-4bc5-b47c-64b04895e1fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:08.729291 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-127724a5-d15c-4bc5-b47c-64b04895e1fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1676 microversion: 2.1 time: 1.289911 Aug 25 13:11:08.771114 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1717/3482] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:07 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1676 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:08.781139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f6897639-2308-4547-a367-7d9447e48267 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:08.805582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f6897639-2308-4547-a367-7d9447e48267 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:08.841807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6897639-2308-4547-a367-7d9447e48267 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:08.846069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6897639-2308-4547-a367-7d9447e48267 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:08.848637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6897639-2308-4547-a367-7d9447e48267 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:08.854072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6897639-2308-4547-a367-7d9447e48267 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:08.855009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6897639-2308-4547-a367-7d9447e48267 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:08.862486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6897639-2308-4547-a367-7d9447e48267 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:10.325115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:10.377945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:10.384061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:10.391333 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d1eac137-2515-4840-b676-9dff50153844 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1891 microversion: 2.32 time: 2.177367 Aug 25 13:11:10.398523 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1766/3483] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:08 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1891 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:10.418065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-879fb580-8560-4d6a-ad44-636067d557f6 req-268f17cf-1955-4a5c-a5df-0779f7388ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd72616-bd88-48a3-b762-5c0cc614454c", "name": "network-vif-unplugged", "status": "completed", "tag": "9ae1b8b4-a711-4456-a821-46e24d3556b9"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:10.501704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-879fb580-8560-4d6a-ad44-636067d557f6 req-268f17cf-1955-4a5c-a5df-0779f7388ec2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:10.503250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-879fb580-8560-4d6a-ad44-636067d557f6 req-268f17cf-1955-4a5c-a5df-0779f7388ec2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:10.515161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-879fb580-8560-4d6a-ad44-636067d557f6 req-268f17cf-1955-4a5c-a5df-0779f7388ec2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:10.578460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f6897639-2308-4547-a367-7d9447e48267 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:10.604785 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-879fb580-8560-4d6a-ad44-636067d557f6 req-268f17cf-1955-4a5c-a5df-0779f7388ec2 service nova] Creating event network-vif-unplugged:9ae1b8b4-a711-4456-a821-46e24d3556b9 for instance ddd72616-bd88-48a3-b762-5c0cc614454c on n-h2-852771-8 Aug 25 13:11:10.625381 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f6897639-2308-4547-a367-7d9447e48267 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1500 microversion: 2.1 time: 1.850761 Aug 25 13:11:10.630067 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-879fb580-8560-4d6a-ad44-636067d557f6 req-268f17cf-1955-4a5c-a5df-0779f7388ec2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.227898 Aug 25 13:11:10.631926 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1767/3484] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:10.637138 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1718/3485] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:08 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1500 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:10.654576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-040d72e0-14f9-42e8-8786-b7a38e18caf4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:10.657092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-82b80baf-88de-4971-9446-92d7956321e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:10.659081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-040d72e0-14f9-42e8-8786-b7a38e18caf4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:10.663949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-82b80baf-88de-4971-9446-92d7956321e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:10.690972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:10.702122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82b80baf-88de-4971-9446-92d7956321e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:10.703758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82b80baf-88de-4971-9446-92d7956321e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:10.713990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d72e0-14f9-42e8-8786-b7a38e18caf4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:10.715736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82b80baf-88de-4971-9446-92d7956321e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:10.716770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d72e0-14f9-42e8-8786-b7a38e18caf4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:10.718126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d72e0-14f9-42e8-8786-b7a38e18caf4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:10.720175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82b80baf-88de-4971-9446-92d7956321e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:10.727752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d72e0-14f9-42e8-8786-b7a38e18caf4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:10.729359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d72e0-14f9-42e8-8786-b7a38e18caf4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:10.730826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d72e0-14f9-42e8-8786-b7a38e18caf4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:10.733152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82b80baf-88de-4971-9446-92d7956321e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:10.735380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82b80baf-88de-4971-9446-92d7956321e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:11.790781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-040d72e0-14f9-42e8-8786-b7a38e18caf4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:11.834738 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-040d72e0-14f9-42e8-8786-b7a38e18caf4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1315 microversion: 2.1 time: 1.199666 Aug 25 13:11:11.836446 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1768/3486] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:10 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1315 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:11.852042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-43d1c8b0-fead-4bc7-bc72-3fb781653e97 req-bf538d0d-24f7-4c84-abf6-930e75b03016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd72616-bd88-48a3-b762-5c0cc614454c", "name": "network-vif-deleted", "tag": "9ae1b8b4-a711-4456-a821-46e24d3556b9"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:11.890888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-43d1c8b0-fead-4bc7-bc72-3fb781653e97 req-bf538d0d-24f7-4c84-abf6-930e75b03016 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:11.891846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-43d1c8b0-fead-4bc7-bc72-3fb781653e97 req-bf538d0d-24f7-4c84-abf6-930e75b03016 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:11.892646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-43d1c8b0-fead-4bc7-bc72-3fb781653e97 req-bf538d0d-24f7-4c84-abf6-930e75b03016 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:11.963731 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-43d1c8b0-fead-4bc7-bc72-3fb781653e97 req-bf538d0d-24f7-4c84-abf6-930e75b03016 service nova] Creating event network-vif-deleted:9ae1b8b4-a711-4456-a821-46e24d3556b9 for instance ddd72616-bd88-48a3-b762-5c0cc614454c on n-h2-852771-8 Aug 25 13:11:11.997485 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-43d1c8b0-fead-4bc7-bc72-3fb781653e97 req-bf538d0d-24f7-4c84-abf6-930e75b03016 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158429 Aug 25 13:11:12.007468 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1769/3487] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:12.057538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b1e4cf2-aa90-46e0-88bf-58e75cdc7a88 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:12.076704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b1e4cf2-aa90-46e0-88bf-58e75cdc7a88 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:12.122810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1e4cf2-aa90-46e0-88bf-58e75cdc7a88 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:12.128373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1e4cf2-aa90-46e0-88bf-58e75cdc7a88 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:12.136056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1e4cf2-aa90-46e0-88bf-58e75cdc7a88 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:12.144745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1e4cf2-aa90-46e0-88bf-58e75cdc7a88 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:12.148788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1e4cf2-aa90-46e0-88bf-58e75cdc7a88 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:12.152607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b1e4cf2-aa90-46e0-88bf-58e75cdc7a88 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:12.357608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-4b1e4cf2-aa90-46e0-88bf-58e75cdc7a88 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lazy-loading 'flavor' on Instance uuid fb7bb552-cda2-4dca-a09f-db46de2fd7ef {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:11:12.672449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-82b80baf-88de-4971-9446-92d7956321e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:12.690414 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b1e4cf2-aa90-46e0-88bf-58e75cdc7a88 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "POST /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef/action" status: 200 len: 32 microversion: 2.1 time: 0.674233 Aug 25 13:11:12.707065 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1770/3488] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:11:12 2022] POST /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef/action => generated 32 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:11:12.714225 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-82b80baf-88de-4971-9446-92d7956321e3 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1655 microversion: 2.1 time: 2.074139 Aug 25 13:11:12.715652 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1719/3489] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:10 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1655 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:12.750658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dc3d2ab8-d528-4c22-b292-ee1758e9bf5d tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:12.752795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dc3d2ab8-d528-4c22-b292-ee1758e9bf5d tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:12.754611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:12.756788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:12.784510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ab8-d528-4c22-b292-ee1758e9bf5d tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:12.786001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ab8-d528-4c22-b292-ee1758e9bf5d tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:12.786395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:12.787634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ab8-d528-4c22-b292-ee1758e9bf5d tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:12.787998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:12.789731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ab8-d528-4c22-b292-ee1758e9bf5d tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:12.790513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:12.791403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ab8-d528-4c22-b292-ee1758e9bf5d tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:12.791998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:12.793088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:12.793884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ab8-d528-4c22-b292-ee1758e9bf5d tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:12.808093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:14.520730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:14.567219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:14.576349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:14.582287 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8ec9a957-556b-4ac1-af86-510fb3af8d08 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.864348 Aug 25 13:11:14.595846 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1771/3490] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:12 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:14.625370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a28f536b-8c21-4cb0-b780-b34af9f3b8ea req-463b903f-4077-4a1e-9210-ea6da2ce35d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd72616-bd88-48a3-b762-5c0cc614454c", "name": "network-vif-unplugged", "status": "completed", "tag": "ccfa3144-9718-4f11-aa8c-66a23b23629e"}, {"server_uuid": "5b134543-2d20-46bb-bcee-9bb6c08477c5", "name": "network-vif-plugged", "status": "completed", "tag": "fc7efbfc-5b36-4b04-9253-650547862383"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:14.726869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dc3d2ab8-d528-4c22-b292-ee1758e9bf5d tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:14.729931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a28f536b-8c21-4cb0-b780-b34af9f3b8ea req-463b903f-4077-4a1e-9210-ea6da2ce35d2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.730787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a28f536b-8c21-4cb0-b780-b34af9f3b8ea req-463b903f-4077-4a1e-9210-ea6da2ce35d2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.732547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a28f536b-8c21-4cb0-b780-b34af9f3b8ea req-463b903f-4077-4a1e-9210-ea6da2ce35d2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:14.797591 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a28f536b-8c21-4cb0-b780-b34af9f3b8ea req-463b903f-4077-4a1e-9210-ea6da2ce35d2 service nova] Creating event network-vif-unplugged:ccfa3144-9718-4f11-aa8c-66a23b23629e for instance ddd72616-bd88-48a3-b762-5c0cc614454c on n-h2-852771-8 Aug 25 13:11:14.797730 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dc3d2ab8-d528-4c22-b292-ee1758e9bf5d tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 2.050139 Aug 25 13:11:14.798419 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a28f536b-8c21-4cb0-b780-b34af9f3b8ea req-463b903f-4077-4a1e-9210-ea6da2ce35d2 service nova] Creating event network-vif-plugged:fc7efbfc-5b36-4b04-9253-650547862383 for instance 5b134543-2d20-46bb-bcee-9bb6c08477c5 on n-h1-852771-8 Aug 25 13:11:14.805190 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1720/3491] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:12 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:14.819568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-33999787-95d5-4950-8b33-ef9b792f11e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:14.821251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-33999787-95d5-4950-8b33-ef9b792f11e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:14.854834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33999787-95d5-4950-8b33-ef9b792f11e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.855798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33999787-95d5-4950-8b33-ef9b792f11e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.856629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33999787-95d5-4950-8b33-ef9b792f11e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:14.866315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33999787-95d5-4950-8b33-ef9b792f11e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.867306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33999787-95d5-4950-8b33-ef9b792f11e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.867787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33999787-95d5-4950-8b33-ef9b792f11e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:14.883464 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a28f536b-8c21-4cb0-b780-b34af9f3b8ea req-463b903f-4077-4a1e-9210-ea6da2ce35d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.284564 Aug 25 13:11:14.888938 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1772/3492] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:14.937249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-23e2cb4b-d8cf-4e4d-85f0-d9962ee0587e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:14.939360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-23e2cb4b-d8cf-4e4d-85f0-d9962ee0587e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:14.976820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23e2cb4b-d8cf-4e4d-85f0-d9962ee0587e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.978434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23e2cb4b-d8cf-4e4d-85f0-d9962ee0587e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.984325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23e2cb4b-d8cf-4e4d-85f0-d9962ee0587e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:14.986930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23e2cb4b-d8cf-4e4d-85f0-d9962ee0587e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.990668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23e2cb4b-d8cf-4e4d-85f0-d9962ee0587e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.992196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23e2cb4b-d8cf-4e4d-85f0-d9962ee0587e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:15.396825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-23e2cb4b-d8cf-4e4d-85f0-d9962ee0587e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6404bb298fe405c8d2b782c83544a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45cd11baec04239813f9d36160ec4ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:15.441823 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-23e2cb4b-d8cf-4e4d-85f0-d9962ee0587e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 200 len: 1455 microversion: 2.1 time: 0.539984 Aug 25 13:11:15.443845 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1773/3493] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:14 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 1455 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:15.463225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:15.464928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:15.515050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:15.516332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:15.520023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:15.520023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:15.523892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:15.525373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:15.593021 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] HTTP exception thrown: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Request method failure captured: Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a HTTP/1.1 Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3I0YYEXPMB-EehaLcDwXNWtuSXBwThlmuRGYEJi_BVYbo2ZpX9j_lupuISvUzwsAid65KAPSjpftkjur5qhNvw1D4EFs2QFlwoAK-jUZylmkNu3DhBSltYKGdS2wdHRTb1xNnJgKfIZ77yTruq3DXev8OfDKDCcg5_59f1DGzjJQGA Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.42 Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f8cc27316e7c44e0a1b9d1f608ee22cc Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1987852832 Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f8cc27316e7c44e0a1b9d1f608ee22cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f8cc27316e7c44e0a1b9d1f608ee22cc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f8cc27316e7c44e0a1b9d1f608ee22cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f8cc27316e7c44e0a1b9d1f608ee22cc"}]}] Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1987852832 Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f8cc27316e7c44e0a1b9d1f608ee22cc Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1987852832 Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TaggedBootDevicesTest_v242-1987852832-project Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2af4362b4f9e40deb004983ba8cd43a7 Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1987852832-project Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'faec1bd7-9479-44e9-82f8-7db70ccd668a'} Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:11:15.597939 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:11:15.606854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:11:15.618989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Returning 404 to user: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:15.620928 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a52ffcef-de4d-4ec2-90b6-8d1178e8dbc9 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "DELETE /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 404 len: 111 microversion: 2.42 time: 0.174728 Aug 25 13:11:15.628538 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1774/3494] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:11:15 2022] DELETE /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:11:15.647428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:15.648882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] [instance: faec1bd7-9479-44e9-82f8-7db70ccd668a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:15.683705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:15.688763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:15.690144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:15.692317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:15.695039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:15.696549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:15.722916 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] HTTP exception thrown: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Request method failure captured: Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a HTTP/1.1 Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3I0YYEXPMB-EehaLcDwXNWtuSXBwThlmuRGYEJi_BVYbo2ZpX9j_lupuISvUzwsAid65KAPSjpftkjur5qhNvw1D4EFs2QFlwoAK-jUZylmkNu3DhBSltYKGdS2wdHRTb1xNnJgKfIZ77yTruq3DXev8OfDKDCcg5_59f1DGzjJQGA Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.42 Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f8cc27316e7c44e0a1b9d1f608ee22cc Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1987852832 Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f8cc27316e7c44e0a1b9d1f608ee22cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f8cc27316e7c44e0a1b9d1f608ee22cc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f8cc27316e7c44e0a1b9d1f608ee22cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f8cc27316e7c44e0a1b9d1f608ee22cc"}]}] Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1987852832 Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f8cc27316e7c44e0a1b9d1f608ee22cc Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1987852832 Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TaggedBootDevicesTest_v242-1987852832-project Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2af4362b4f9e40deb004983ba8cd43a7 Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1987852832-project Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'faec1bd7-9479-44e9-82f8-7db70ccd668a'} Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:11:15.727004 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:15.735712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:11:15.735712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:15.735712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:15.735712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:15.735712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:15.735712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:15.735712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. Aug 25 13:11:15.735712 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:11:15.739528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] Returning 404 to user: Instance faec1bd7-9479-44e9-82f8-7db70ccd668a could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:15.741992 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d4a4455-c977-4031-a37c-bad45187ed02 tempest-TaggedBootDevicesTest_v242-1987852832 tempest-TaggedBootDevicesTest_v242-1987852832-project] 10.222.0.70 "GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a" status: 404 len: 111 microversion: 2.42 time: 0.110417 Aug 25 13:11:15.744004 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1775/3495] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:15 2022] GET /compute/v2.1/servers/faec1bd7-9479-44e9-82f8-7db70ccd668a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:11:15.755349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:15.757753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:15.776839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:15.776839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:15.777817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:15.779633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:15.781009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:15.782225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:15.836833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:16.375997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-33999787-95d5-4950-8b33-ef9b792f11e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:16.411240 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-33999787-95d5-4950-8b33-ef9b792f11e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1315 microversion: 2.1 time: 1.602507 Aug 25 13:11:16.412890 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1721/3496] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:14 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1315 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:16.426322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f2d1997-e069-4b01-9a03-b639dc5f363b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:16.428147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f2d1997-e069-4b01-9a03-b639dc5f363b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:16.446094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f2d1997-e069-4b01-9a03-b639dc5f363b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:16.447526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f2d1997-e069-4b01-9a03-b639dc5f363b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:16.448720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f2d1997-e069-4b01-9a03-b639dc5f363b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:16.450719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f2d1997-e069-4b01-9a03-b639dc5f363b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:16.452240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f2d1997-e069-4b01-9a03-b639dc5f363b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:16.453577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f2d1997-e069-4b01-9a03-b639dc5f363b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:17.723904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:17.752527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:17.763308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f2d1997-e069-4b01-9a03-b639dc5f363b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:17.786839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:17.789208 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f81c484-071b-4557-9f4c-a2e7ded89584 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 2.042945 Aug 25 13:11:17.799013 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1776/3497] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:15 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:17.808808 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f2d1997-e069-4b01-9a03-b639dc5f363b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 1.391390 Aug 25 13:11:17.816391 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1722/3498] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:16 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:17.882039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:17.890608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:17.969162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:17.974243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:17.983993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:17.991993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:17.997120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:18.018347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:18.118669 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] HTTP exception thrown: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Request method failure captured: Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c HTTP/1.1 Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3POXNRKd0tvHJaCM_MnchLdTIdvihPGNW0Rhj-FWNq7R6OlXJbvYd3sYUXr4B_6gNZ7d4eWfyTqE240ftu8M9vU00dK6FwI_2OZsOjcmPp8fqpOwXWsxn3g3pfwcj77amgNOlf5CPDmdyrhz6XR-J7H6XunLvP6TCzZAGZ_zPMwxXM Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d45cd11baec04239813f9d36160ec4ac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}] Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestMultiNic-702527879-project Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a6404bb298fe405c8d2b782c83544a58 Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestMultiNic-702527879-project Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ddd72616-bd88-48a3-b762-5c0cc614454c'} Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:18.133473 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:18.147490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:18.147490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:18.147490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:18.147490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:18.147490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:18.147490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:18.147490 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:18.147490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Returning 404 to user: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:18.147490 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bf58c143-2545-473b-8278-80765185b1c8 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 404 len: 111 microversion: 2.1 time: 0.326907 Aug 25 13:11:18.153819 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1723/3499] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:17 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 111 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:11:18.180289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7a2ee456-7560-4ff4-b1d5-fe879972d8ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:18.190197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7a2ee456-7560-4ff4-b1d5-fe879972d8ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:18.256847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a2ee456-7560-4ff4-b1d5-fe879972d8ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:18.263557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a2ee456-7560-4ff4-b1d5-fe879972d8ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:18.264571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a2ee456-7560-4ff4-b1d5-fe879972d8ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:18.270661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a2ee456-7560-4ff4-b1d5-fe879972d8ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:18.271706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a2ee456-7560-4ff4-b1d5-fe879972d8ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:18.275405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a2ee456-7560-4ff4-b1d5-fe879972d8ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:18.451799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-271737e4-224a-49ed-a267-e15a079579c5 req-a61c7f56-06f2-4d52-867e-99ee282fbfcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd72616-bd88-48a3-b762-5c0cc614454c", "name": "network-vif-deleted", "tag": "ccfa3144-9718-4f11-aa8c-66a23b23629e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:18.521026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-271737e4-224a-49ed-a267-e15a079579c5 req-a61c7f56-06f2-4d52-867e-99ee282fbfcf service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:18.522591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-271737e4-224a-49ed-a267-e15a079579c5 req-a61c7f56-06f2-4d52-867e-99ee282fbfcf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:18.523437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-271737e4-224a-49ed-a267-e15a079579c5 req-a61c7f56-06f2-4d52-867e-99ee282fbfcf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:18.557138 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-271737e4-224a-49ed-a267-e15a079579c5 req-a61c7f56-06f2-4d52-867e-99ee282fbfcf service nova] Creating event network-vif-deleted:ccfa3144-9718-4f11-aa8c-66a23b23629e for instance ddd72616-bd88-48a3-b762-5c0cc614454c on n-h2-852771-8 Aug 25 13:11:18.568724 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-271737e4-224a-49ed-a267-e15a079579c5 req-a61c7f56-06f2-4d52-867e-99ee282fbfcf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.765653 Aug 25 13:11:18.570334 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1777/3500] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:18.932663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cab9730c-68da-4fe6-ad79-f8636d6fba8f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:18.947095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cab9730c-68da-4fe6-ad79-f8636d6fba8f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:18.995970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab9730c-68da-4fe6-ad79-f8636d6fba8f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:18.995970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab9730c-68da-4fe6-ad79-f8636d6fba8f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:18.996828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab9730c-68da-4fe6-ad79-f8636d6fba8f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:19.009739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab9730c-68da-4fe6-ad79-f8636d6fba8f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:19.015326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab9730c-68da-4fe6-ad79-f8636d6fba8f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:19.016167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cab9730c-68da-4fe6-ad79-f8636d6fba8f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:19.334770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7a2ee456-7560-4ff4-b1d5-fe879972d8ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:19.394159 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7a2ee456-7560-4ff4-b1d5-fe879972d8ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1315 microversion: 2.1 time: 1.237009 Aug 25 13:11:19.401176 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1724/3501] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:18 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1315 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:19.438282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:19.439917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:19.463445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:19.464404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:19.474055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:19.479911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:19.489375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:19.494369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:20.419270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cab9730c-68da-4fe6-ad79-f8636d6fba8f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:20.444854 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cab9730c-68da-4fe6-ad79-f8636d6fba8f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 1.552748 Aug 25 13:11:20.446001 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1778/3502] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:18 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:20.484463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-628532aa-4710-42fb-a94e-bfe3a3b4e324 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:20.486224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-628532aa-4710-42fb-a94e-bfe3a3b4e324 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:20.501627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-628532aa-4710-42fb-a94e-bfe3a3b4e324 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:20.505224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-628532aa-4710-42fb-a94e-bfe3a3b4e324 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:20.506528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-628532aa-4710-42fb-a94e-bfe3a3b4e324 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:20.511160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-628532aa-4710-42fb-a94e-bfe3a3b4e324 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:20.513042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-628532aa-4710-42fb-a94e-bfe3a3b4e324 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:20.514187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-628532aa-4710-42fb-a94e-bfe3a3b4e324 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:21.349820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:21.424950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:21.431921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:21.443679 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ce33585b-ec65-41ff-98c8-7587d3cd0d31 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 2.033648 Aug 25 13:11:21.453796 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1725/3503] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:19 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:21.502485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2c954b8c-0727-4ab0-bb04-88450c56bdeb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:21.509987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2c954b8c-0727-4ab0-bb04-88450c56bdeb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:21.545049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c954b8c-0727-4ab0-bb04-88450c56bdeb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:21.546795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c954b8c-0727-4ab0-bb04-88450c56bdeb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:21.547963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c954b8c-0727-4ab0-bb04-88450c56bdeb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:21.549845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c954b8c-0727-4ab0-bb04-88450c56bdeb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:21.552264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c954b8c-0727-4ab0-bb04-88450c56bdeb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:21.558446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c954b8c-0727-4ab0-bb04-88450c56bdeb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:22.181577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-628532aa-4710-42fb-a94e-bfe3a3b4e324 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:22.219656 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-628532aa-4710-42fb-a94e-bfe3a3b4e324 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1502 microversion: 2.1 time: 1.759261 Aug 25 13:11:22.242817 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1779/3504] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:20 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1502 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:22.285301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1a36ab5c-9d76-4ea3-a426-08bcfdf85548 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:22.320051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=56 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:22.326926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a36ab5c-9d76-4ea3-a426-08bcfdf85548 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:22.334478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a36ab5c-9d76-4ea3-a426-08bcfdf85548 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:22.336900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a36ab5c-9d76-4ea3-a426-08bcfdf85548 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:22.446030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1a36ab5c-9d76-4ea3-a426-08bcfdf85548 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Going to try to stop instance {{(pid=129060) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:11:22.548522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2c954b8c-0727-4ab0-bb04-88450c56bdeb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:22.621602 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2c954b8c-0727-4ab0-bb04-88450c56bdeb tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 1.129656 Aug 25 13:11:22.625991 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1726/3505] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:21 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:11:22.649442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:22.655668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:22.664404 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1a36ab5c-9d76-4ea3-a426-08bcfdf85548 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5/action" status: 202 len: 0 microversion: 2.1 time: 0.398319 Aug 25 13:11:22.679405 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1780/3506] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:11:22 2022] POST /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:11:22.687699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:22.689233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:22.694795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:22.698519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:22.702593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:22.707932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:22.715165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2926e491-1b10-40c5-a960-ae5bb702d651 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:22.717964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2926e491-1b10-40c5-a960-ae5bb702d651 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:22.756386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2926e491-1b10-40c5-a960-ae5bb702d651 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:22.757752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2926e491-1b10-40c5-a960-ae5bb702d651 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:22.758642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2926e491-1b10-40c5-a960-ae5bb702d651 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:22.761166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2926e491-1b10-40c5-a960-ae5bb702d651 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:22.762528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2926e491-1b10-40c5-a960-ae5bb702d651 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:22.763644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2926e491-1b10-40c5-a960-ae5bb702d651 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:24.094711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.155416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.171513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.208868 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8b24d71e-592f-4ad4-9473-7bba9d04b7ed tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.580354 Aug 25 13:11:24.226506 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1727/3507] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:22 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:24.251614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1665aaaf-3777-4252-bc14-db2b76ea2f7b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:24.258114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1665aaaf-3777-4252-bc14-db2b76ea2f7b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:24.282406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2926e491-1b10-40c5-a960-ae5bb702d651 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.297223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1665aaaf-3777-4252-bc14-db2b76ea2f7b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:24.303081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1665aaaf-3777-4252-bc14-db2b76ea2f7b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:24.306422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1665aaaf-3777-4252-bc14-db2b76ea2f7b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:24.312779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1665aaaf-3777-4252-bc14-db2b76ea2f7b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:24.321281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1665aaaf-3777-4252-bc14-db2b76ea2f7b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:24.323754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1665aaaf-3777-4252-bc14-db2b76ea2f7b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:24.324724 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2926e491-1b10-40c5-a960-ae5bb702d651 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1512 microversion: 2.1 time: 1.638011 Aug 25 13:11:24.338804 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1781/3508] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:22 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1512 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:24.348773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:25.288679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:25.293043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:25.349168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:25.350536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:25.351716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:25.358193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:25.361901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:25.366453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:26.351223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1665aaaf-3777-4252-bc14-db2b76ea2f7b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:26.383656 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1665aaaf-3777-4252-bc14-db2b76ea2f7b tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 2.154930 Aug 25 13:11:26.398680 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1728/3509] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:24 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:26.462082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b3ca4e73-c349-49ee-82c5-1699a0bd5443 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:26.463250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b3ca4e73-c349-49ee-82c5-1699a0bd5443 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:26.500686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3ca4e73-c349-49ee-82c5-1699a0bd5443 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:26.502086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3ca4e73-c349-49ee-82c5-1699a0bd5443 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:26.514316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3ca4e73-c349-49ee-82c5-1699a0bd5443 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:26.516141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3ca4e73-c349-49ee-82c5-1699a0bd5443 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:26.519509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3ca4e73-c349-49ee-82c5-1699a0bd5443 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:26.557465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3ca4e73-c349-49ee-82c5-1699a0bd5443 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:26.711434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:26.814249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:26.838295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:26.841462 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5a4600f-a05d-4ac4-9458-c32d4a6e6bd5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.570283 Aug 25 13:11:26.862290 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1782/3510] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:25 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:27.430789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-015cdabc-b8dc-42bc-a9f4-cb04740abc7a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:27.434050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-015cdabc-b8dc-42bc-a9f4-cb04740abc7a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:27.461150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-015cdabc-b8dc-42bc-a9f4-cb04740abc7a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:27.466927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-015cdabc-b8dc-42bc-a9f4-cb04740abc7a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:27.474793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-015cdabc-b8dc-42bc-a9f4-cb04740abc7a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:27.476796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-015cdabc-b8dc-42bc-a9f4-cb04740abc7a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:27.478193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-015cdabc-b8dc-42bc-a9f4-cb04740abc7a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:27.479384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-015cdabc-b8dc-42bc-a9f4-cb04740abc7a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:28.937346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b3ca4e73-c349-49ee-82c5-1699a0bd5443 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:29.018490 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b3ca4e73-c349-49ee-82c5-1699a0bd5443 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1512 microversion: 2.1 time: 2.617475 Aug 25 13:11:29.027521 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1729/3511] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:26 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1512 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:29.079608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:29.086082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:29.148094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:29.149686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:29.151651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:29.153757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:29.155282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:29.156510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:29.164725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-015cdabc-b8dc-42bc-a9f4-cb04740abc7a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:29.213943 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-015cdabc-b8dc-42bc-a9f4-cb04740abc7a tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 1.784360 Aug 25 13:11:29.218283 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1783/3512] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:27 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:30.083934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e91cc01-a336-4568-a072-a9db1b38a2ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:30.085721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4e91cc01-a336-4568-a072-a9db1b38a2ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:30.114347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e91cc01-a336-4568-a072-a9db1b38a2ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:30.118985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e91cc01-a336-4568-a072-a9db1b38a2ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:30.120248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e91cc01-a336-4568-a072-a9db1b38a2ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:30.123261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e91cc01-a336-4568-a072-a9db1b38a2ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:30.130980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e91cc01-a336-4568-a072-a9db1b38a2ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:30.137828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e91cc01-a336-4568-a072-a9db1b38a2ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:31.145321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:31.196524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:31.208213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:31.218984 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6c002797-76a1-4b31-b7ab-b6a9c8369569 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 2.179704 Aug 25 13:11:31.220190 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1730/3513] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:29 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:31.237550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-81f8af1e-e19b-454f-b8f2-70563d42c30f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:31.239042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-81f8af1e-e19b-454f-b8f2-70563d42c30f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:31.263995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f8af1e-e19b-454f-b8f2-70563d42c30f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:31.264921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f8af1e-e19b-454f-b8f2-70563d42c30f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:31.265809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f8af1e-e19b-454f-b8f2-70563d42c30f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:31.267408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f8af1e-e19b-454f-b8f2-70563d42c30f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:31.268243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f8af1e-e19b-454f-b8f2-70563d42c30f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:31.268931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f8af1e-e19b-454f-b8f2-70563d42c30f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:31.393727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e91cc01-a336-4568-a072-a9db1b38a2ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:31.449848 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e91cc01-a336-4568-a072-a9db1b38a2ae tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1512 microversion: 2.1 time: 1.383180 Aug 25 13:11:31.451299 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1784/3514] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:30 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1512 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:31.878077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81f8af1e-e19b-454f-b8f2-70563d42c30f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:31.914014 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-81f8af1e-e19b-454f-b8f2-70563d42c30f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 0.686207 Aug 25 13:11:31.915534 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1731/3515] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:31 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:32.282601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:32.284022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:32.320097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:32.321019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:32.321749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:32.328537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:32.329327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:32.330192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:32.499603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7d385889-6e39-4894-b065-9733e4fababb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:32.503518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7d385889-6e39-4894-b065-9733e4fababb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:32.554393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d385889-6e39-4894-b065-9733e4fababb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:32.555320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d385889-6e39-4894-b065-9733e4fababb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:32.562485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d385889-6e39-4894-b065-9733e4fababb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:32.564660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d385889-6e39-4894-b065-9733e4fababb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:32.574548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d385889-6e39-4894-b065-9733e4fababb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:32.575362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7d385889-6e39-4894-b065-9733e4fababb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.129871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:34.206672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:34.210777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:34.213442 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-db567ea4-2b6d-46ca-90c0-a93e03db1117 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.938846 Aug 25 13:11:34.215948 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1785/3516] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:32 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:34.237669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efab9c57-7dac-46d8-8a2c-9d33ea3e608f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:34.239850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-efab9c57-7dac-46d8-8a2c-9d33ea3e608f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:34.251990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efab9c57-7dac-46d8-8a2c-9d33ea3e608f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.253339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efab9c57-7dac-46d8-8a2c-9d33ea3e608f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.254477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efab9c57-7dac-46d8-8a2c-9d33ea3e608f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.256145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efab9c57-7dac-46d8-8a2c-9d33ea3e608f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.259972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efab9c57-7dac-46d8-8a2c-9d33ea3e608f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.261950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efab9c57-7dac-46d8-8a2c-9d33ea3e608f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.330832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7d385889-6e39-4894-b065-9733e4fababb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:34.374078 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7d385889-6e39-4894-b065-9733e4fababb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1512 microversion: 2.1 time: 1.887730 Aug 25 13:11:34.375642 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1732/3517] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:32 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1512 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:11:34.388412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:34.389237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:34.411598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.412693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.413555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.414928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.415765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.416557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.465832 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] HTTP exception thrown: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Request method failure captured: Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c HTTP/1.1 Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3POXNRKd0tvHJaCM_MnchLdTIdvihPGNW0Rhj-FWNq7R6OlXJbvYd3sYUXr4B_6gNZ7d4eWfyTqE240ftu8M9vU00dK6FwI_2OZsOjcmPp8fqpOwXWsxn3g3pfwcj77amgNOlf5CPDmdyrhz6XR-J7H6XunLvP6TCzZAGZ_zPMwxXM Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d45cd11baec04239813f9d36160ec4ac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}] Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestMultiNic-702527879-project Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a6404bb298fe405c8d2b782c83544a58 Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestMultiNic-702527879-project Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ddd72616-bd88-48a3-b762-5c0cc614454c'} Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:11:34.474055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:34.484263 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.489935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Returning 404 to user: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:34.490643 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bff7ca5c-e155-4147-9c9f-f62371d1a0fd tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 404 len: 111 microversion: 2.1 time: 0.109901 Aug 25 13:11:34.492097 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1733/3518] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:11:34 2022] DELETE /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:11:34.510718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:34.516012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: ddd72616-bd88-48a3-b762-5c0cc614454c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:34.552424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.552424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.552424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.552991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.556323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.559668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.623076 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] HTTP exception thrown: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Request method failure captured: Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c HTTP/1.1 Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3POXNRKd0tvHJaCM_MnchLdTIdvihPGNW0Rhj-FWNq7R6OlXJbvYd3sYUXr4B_6gNZ7d4eWfyTqE240ftu8M9vU00dK6FwI_2OZsOjcmPp8fqpOwXWsxn3g3pfwcj77amgNOlf5CPDmdyrhz6XR-J7H6XunLvP6TCzZAGZ_zPMwxXM Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d45cd11baec04239813f9d36160ec4ac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}] Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestMultiNic-702527879-project Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a6404bb298fe405c8d2b782c83544a58 Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestMultiNic-702527879-project Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ddd72616-bd88-48a3-b762-5c0cc614454c'} Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:34.632982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.640685 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.640685 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:34.640685 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:34.640685 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:34.640685 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:34.640685 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. Aug 25 13:11:34.640685 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.654334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Returning 404 to user: Instance ddd72616-bd88-48a3-b762-5c0cc614454c could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:34.654334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fdb5bc09-bb5c-4aa3-a738-c002f981f81e tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c" status: 404 len: 111 microversion: 2.1 time: 0.149080 Aug 25 13:11:34.654334 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1734/3519] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:34 2022] GET /compute/v2.1/servers/ddd72616-bd88-48a3-b762-5c0cc614454c => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:11:34.674356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:34.674356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:34.707286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.711800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.711800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.716133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.717259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.730805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.752992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-efab9c57-7dac-46d8-8a2c-9d33ea3e608f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:34.770388 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] HTTP exception thrown: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Request method failure captured: Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 HTTP/1.1 Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3POXNRKd0tvHJaCM_MnchLdTIdvihPGNW0Rhj-FWNq7R6OlXJbvYd3sYUXr4B_6gNZ7d4eWfyTqE240ftu8M9vU00dK6FwI_2OZsOjcmPp8fqpOwXWsxn3g3pfwcj77amgNOlf5CPDmdyrhz6XR-J7H6XunLvP6TCzZAGZ_zPMwxXM Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d45cd11baec04239813f9d36160ec4ac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}] Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestMultiNic-702527879-project Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a6404bb298fe405c8d2b782c83544a58 Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestMultiNic-702527879-project Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '5ff52b3c-3863-430f-8d5d-a61f84d4b803'} Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:11:34.773892 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:11:34.780439 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.785550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Returning 404 to user: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:34.785550 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff47407f-268a-4473-880a-ca6b304d5151 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 404 len: 111 microversion: 2.1 time: 0.127626 Aug 25 13:11:34.788593 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1735/3520] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:11:34 2022] DELETE /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:11:34.792054 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-efab9c57-7dac-46d8-8a2c-9d33ea3e608f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 0.571255 Aug 25 13:11:34.794078 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1786/3521] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:34 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:34.803850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:34.805360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] [instance: 5ff52b3c-3863-430f-8d5d-a61f84d4b803] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:34.830570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.832827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.834312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.836316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.837573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.838705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.874961 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] HTTP exception thrown: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Request method failure captured: Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 HTTP/1.1 Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3POXNRKd0tvHJaCM_MnchLdTIdvihPGNW0Rhj-FWNq7R6OlXJbvYd3sYUXr4B_6gNZ7d4eWfyTqE240ftu8M9vU00dK6FwI_2OZsOjcmPp8fqpOwXWsxn3g3pfwcj77amgNOlf5CPDmdyrhz6XR-J7H6XunLvP6TCzZAGZ_zPMwxXM Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d45cd11baec04239813f9d36160ec4ac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d45cd11baec04239813f9d36160ec4ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d45cd11baec04239813f9d36160ec4ac"}]}] Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d45cd11baec04239813f9d36160ec4ac Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestMultiNic-702527879 Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestMultiNic-702527879-project Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a6404bb298fe405c8d2b782c83544a58 Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestMultiNic-702527879-project Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '5ff52b3c-3863-430f-8d5d-a61f84d4b803'} Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:34.878366 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.892454 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:34.892454 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:34.892454 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:34.892454 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:34.892454 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:34.892454 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. Aug 25 13:11:34.892454 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:11:34.892454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] Returning 404 to user: Instance 5ff52b3c-3863-430f-8d5d-a61f84d4b803 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:34.892454 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-364071eb-e682-4489-a17d-dddb77612793 tempest-ServersTestMultiNic-702527879 tempest-ServersTestMultiNic-702527879-project] 10.222.0.70 "GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803" status: 404 len: 111 microversion: 2.1 time: 0.085109 Aug 25 13:11:34.892454 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1736/3522] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:34 2022] GET /compute/v2.1/servers/5ff52b3c-3863-430f-8d5d-a61f84d4b803 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:11:35.275247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:35.276454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:35.308357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:35.319023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:35.319863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:35.321252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:35.326300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:35.328057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:35.429866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2cbf1c03-e680-415c-b6ea-67fdc98fc830 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:35.435688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2cbf1c03-e680-415c-b6ea-67fdc98fc830 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:35.499659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbf1c03-e680-415c-b6ea-67fdc98fc830 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:35.501066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbf1c03-e680-415c-b6ea-67fdc98fc830 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:35.502185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbf1c03-e680-415c-b6ea-67fdc98fc830 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:35.510596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbf1c03-e680-415c-b6ea-67fdc98fc830 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:35.513715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbf1c03-e680-415c-b6ea-67fdc98fc830 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:35.516336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cbf1c03-e680-415c-b6ea-67fdc98fc830 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:36.716391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2cbf1c03-e680-415c-b6ea-67fdc98fc830 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:36.763357 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2cbf1c03-e680-415c-b6ea-67fdc98fc830 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1512 microversion: 2.1 time: 1.345401 Aug 25 13:11:36.820172 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1737/3523] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:35 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1512 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:36.823701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:36.842403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:36.845738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:36.848081 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ea9d3c4a-f365-4a30-ab4f-78577fb152f5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.580680 Aug 25 13:11:36.849663 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1787/3524] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:35 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:36.852703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7af98ac6-2d75-4061-b0b8-d07585bba131 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:36.854132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7af98ac6-2d75-4061-b0b8-d07585bba131 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:36.880965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7af98ac6-2d75-4061-b0b8-d07585bba131 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:36.905073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7af98ac6-2d75-4061-b0b8-d07585bba131 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:36.906135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7af98ac6-2d75-4061-b0b8-d07585bba131 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:36.907561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7af98ac6-2d75-4061-b0b8-d07585bba131 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:36.908527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7af98ac6-2d75-4061-b0b8-d07585bba131 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:36.909319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7af98ac6-2d75-4061-b0b8-d07585bba131 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:37.614208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7af98ac6-2d75-4061-b0b8-d07585bba131 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:37.649318 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7af98ac6-2d75-4061-b0b8-d07585bba131 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 0.826472 Aug 25 13:11:37.651728 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1738/3525] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:36 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:37.815175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ecae613-2cbe-4968-920e-cb729ed20aa3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:37.820470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7ecae613-2cbe-4968-920e-cb729ed20aa3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:37.867097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ecae613-2cbe-4968-920e-cb729ed20aa3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:37.871544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ecae613-2cbe-4968-920e-cb729ed20aa3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:37.873928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ecae613-2cbe-4968-920e-cb729ed20aa3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:37.875708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ecae613-2cbe-4968-920e-cb729ed20aa3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:37.877011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ecae613-2cbe-4968-920e-cb729ed20aa3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:37.878950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ecae613-2cbe-4968-920e-cb729ed20aa3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:38.438683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:38.443925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:38.490157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:38.491111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:38.491884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:38.494830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:38.496865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:38.499862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:41.215886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7ecae613-2cbe-4968-920e-cb729ed20aa3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:41.233997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:41.259135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:41.263580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:41.266414 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d577da5-c00f-4338-a620-6710172c29ae tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 3.371268 Aug 25 13:11:41.273171 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ecae613-2cbe-4968-920e-cb729ed20aa3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1512 microversion: 2.1 time: 3.459534 Aug 25 13:11:41.295380 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1788/3527] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:37 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1512 bytes in 3489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:41.295715 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1739/3527] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:37 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 3401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:41.357917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c814fc9-f738-4a31-8c76-85503dd40923 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:41.364135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1c814fc9-f738-4a31-8c76-85503dd40923 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:41.399550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c814fc9-f738-4a31-8c76-85503dd40923 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:41.404584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c814fc9-f738-4a31-8c76-85503dd40923 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:41.408173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c814fc9-f738-4a31-8c76-85503dd40923 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:41.413761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c814fc9-f738-4a31-8c76-85503dd40923 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:41.419143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c814fc9-f738-4a31-8c76-85503dd40923 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:41.420317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c814fc9-f738-4a31-8c76-85503dd40923 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.118969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1c814fc9-f738-4a31-8c76-85503dd40923 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:42.151769 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1c814fc9-f738-4a31-8c76-85503dd40923 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 0.850991 Aug 25 13:11:42.165444 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1789/3528] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:41 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:42.333014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:42.334680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:42.352300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f75d3c8-a83f-4554-b049-7e464e455d3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:42.356306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f75d3c8-a83f-4554-b049-7e464e455d3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:42.358908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=42 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:42.367884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:42.368929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:42.377091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.377091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:42.377091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:42.377091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.395694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f75d3c8-a83f-4554-b049-7e464e455d3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:42.396900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f75d3c8-a83f-4554-b049-7e464e455d3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:42.402392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f75d3c8-a83f-4554-b049-7e464e455d3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.403862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f75d3c8-a83f-4554-b049-7e464e455d3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:42.407417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f75d3c8-a83f-4554-b049-7e464e455d3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:42.411019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f75d3c8-a83f-4554-b049-7e464e455d3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:43.585294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:43.646269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:43.648919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2f75d3c8-a83f-4554-b049-7e464e455d3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:43.684392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:43.693432 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-de866ec5-bc06-4831-b658-dd2f948f1bd7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.370989 Aug 25 13:11:43.694749 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1740/3529] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:42 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:43.721333 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f75d3c8-a83f-4554-b049-7e464e455d3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1512 microversion: 2.1 time: 1.392175 Aug 25 13:11:43.735667 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1790/3530] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:42 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1512 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:11:43.745245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1973738-6fd9-430d-b921-f2dfcb0b31d0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:43.746583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e1973738-6fd9-430d-b921-f2dfcb0b31d0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:43.768933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1973738-6fd9-430d-b921-f2dfcb0b31d0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:43.775935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1973738-6fd9-430d-b921-f2dfcb0b31d0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:43.776925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1973738-6fd9-430d-b921-f2dfcb0b31d0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:43.779957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1973738-6fd9-430d-b921-f2dfcb0b31d0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:43.783891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1973738-6fd9-430d-b921-f2dfcb0b31d0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:43.786361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1973738-6fd9-430d-b921-f2dfcb0b31d0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:44.641491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e1973738-6fd9-430d-b921-f2dfcb0b31d0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:44.696252 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e1973738-6fd9-430d-b921-f2dfcb0b31d0 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 0.987732 Aug 25 13:11:44.723388 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1741/3531] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:43 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:44.748120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:44.759407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:44.797696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d84fc74-2d22-4149-9294-1f35657b1739 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:44.808122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8d84fc74-2d22-4149-9294-1f35657b1739 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:44.856243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d84fc74-2d22-4149-9294-1f35657b1739 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:44.857195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d84fc74-2d22-4149-9294-1f35657b1739 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:44.864656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:44.865026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:44.901815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:44.905830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d84fc74-2d22-4149-9294-1f35657b1739 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:44.907813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:44.914960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:44.916360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d84fc74-2d22-4149-9294-1f35657b1739 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:44.922057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d84fc74-2d22-4149-9294-1f35657b1739 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:44.926444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:44.932863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d84fc74-2d22-4149-9294-1f35657b1739 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:46.302609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:46.381525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:46.396952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:46.415380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:46.418014 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a4845a72-bdb0-42e6-8b86-d2e1bab02f3a tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.677835 Aug 25 13:11:46.426597 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1791/3532] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:44 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:46.460828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2fa8c3da-fc5a-4dbb-b0ef-d73db6aefa8e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:46.474751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2fa8c3da-fc5a-4dbb-b0ef-d73db6aefa8e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:46.527564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2fa8c3da-fc5a-4dbb-b0ef-d73db6aefa8e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:46.535618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2fa8c3da-fc5a-4dbb-b0ef-d73db6aefa8e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:46.542570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2fa8c3da-fc5a-4dbb-b0ef-d73db6aefa8e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:46.544025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2fa8c3da-fc5a-4dbb-b0ef-d73db6aefa8e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:46.544933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2fa8c3da-fc5a-4dbb-b0ef-d73db6aefa8e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:46.559967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2fa8c3da-fc5a-4dbb-b0ef-d73db6aefa8e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:46.689486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d84fc74-2d22-4149-9294-1f35657b1739 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:46.751544 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d84fc74-2d22-4149-9294-1f35657b1739 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1512 microversion: 2.1 time: 1.972186 Aug 25 13:11:46.762649 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1742/3533] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:44 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1512 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:47.475647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:47.482407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:47.523378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:47.526168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:47.527482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:47.532820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:47.535763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:47.545032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:47.689942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2fa8c3da-fc5a-4dbb-b0ef-d73db6aefa8e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:47.734046 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2fa8c3da-fc5a-4dbb-b0ef-d73db6aefa8e tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1486 microversion: 2.1 time: 1.288962 Aug 25 13:11:47.743848 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1792/3534] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:46 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1486 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:47.787549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7cf452b8-a84f-4134-b167-d62e453335ff tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:47.799844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7cf452b8-a84f-4134-b167-d62e453335ff tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:47.853162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cf452b8-a84f-4134-b167-d62e453335ff tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:47.854203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cf452b8-a84f-4134-b167-d62e453335ff tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:47.855017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cf452b8-a84f-4134-b167-d62e453335ff tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:47.856768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cf452b8-a84f-4134-b167-d62e453335ff tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:47.857413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cf452b8-a84f-4134-b167-d62e453335ff tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:47.858245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cf452b8-a84f-4134-b167-d62e453335ff tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:48.367154 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7cf452b8-a84f-4134-b167-d62e453335ff tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "POST /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef/action" status: 202 len: 0 microversion: 2.1 time: 0.566757 Aug 25 13:11:48.370488 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1793/3535] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:11:47 2022] POST /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:11:48.401859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3196a828-a44c-48a0-a926-29d4b405e3fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:48.411726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3196a828-a44c-48a0-a926-29d4b405e3fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:48.459482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3196a828-a44c-48a0-a926-29d4b405e3fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:48.460092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3196a828-a44c-48a0-a926-29d4b405e3fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:48.471360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3196a828-a44c-48a0-a926-29d4b405e3fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:48.478531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3196a828-a44c-48a0-a926-29d4b405e3fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:48.481358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3196a828-a44c-48a0-a926-29d4b405e3fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:48.482208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3196a828-a44c-48a0-a926-29d4b405e3fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:49.719301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:49.763912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:49.782401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:49.793727 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cc4da2a2-74ae-497b-9446-74b649ffeeb9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 2.328182 Aug 25 13:11:49.824725 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1743/3536] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:47 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:49.868614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f6e5658-8587-4d19-93a4-092e0d731bca tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:49.875047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f6e5658-8587-4d19-93a4-092e0d731bca tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:49.897304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f6e5658-8587-4d19-93a4-092e0d731bca tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:49.906808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f6e5658-8587-4d19-93a4-092e0d731bca tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:49.908135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f6e5658-8587-4d19-93a4-092e0d731bca tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:49.910461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f6e5658-8587-4d19-93a4-092e0d731bca tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:49.913554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f6e5658-8587-4d19-93a4-092e0d731bca tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:49.914767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f6e5658-8587-4d19-93a4-092e0d731bca tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:51.390395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3196a828-a44c-48a0-a926-29d4b405e3fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:51.453997 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3196a828-a44c-48a0-a926-29d4b405e3fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1489 microversion: 2.1 time: 3.074437 Aug 25 13:11:51.455181 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1794/3537] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:48 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1489 bytes in 3084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:51.486113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:51.487373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:51.525073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:51.529203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:51.532221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:51.537185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:51.538616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:51.542330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:53.371163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f6e5658-8587-4d19-93a4-092e0d731bca tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:53.413348 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f6e5658-8587-4d19-93a4-092e0d731bca tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1494 microversion: 2.1 time: 3.573793 Aug 25 13:11:53.414501 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1744/3538] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:49 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1494 bytes in 3589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:53.456119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2fb67db6-f6d0-43e3-bc55-7e2dfbcfff14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:53.471874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2fb67db6-f6d0-43e3-bc55-7e2dfbcfff14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:53.522908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fb67db6-f6d0-43e3-bc55-7e2dfbcfff14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:53.528413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fb67db6-f6d0-43e3-bc55-7e2dfbcfff14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:53.529884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fb67db6-f6d0-43e3-bc55-7e2dfbcfff14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:53.536520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fb67db6-f6d0-43e3-bc55-7e2dfbcfff14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:53.537626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fb67db6-f6d0-43e3-bc55-7e2dfbcfff14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:53.538639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fb67db6-f6d0-43e3-bc55-7e2dfbcfff14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:53.744071 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2fb67db6-f6d0-43e3-bc55-7e2dfbcfff14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 200 len: 125 microversion: 2.1 time: 0.311492 Aug 25 13:11:53.755718 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1745/3539] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:11:53 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 125 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:53.789021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-387c682e-368b-450b-b9f1-281c464ab5dc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:53.791071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-387c682e-368b-450b-b9f1-281c464ab5dc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:53.806478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387c682e-368b-450b-b9f1-281c464ab5dc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:53.809192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387c682e-368b-450b-b9f1-281c464ab5dc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:53.810679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387c682e-368b-450b-b9f1-281c464ab5dc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:53.812872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387c682e-368b-450b-b9f1-281c464ab5dc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:53.814640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387c682e-368b-450b-b9f1-281c464ab5dc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:53.816434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-387c682e-368b-450b-b9f1-281c464ab5dc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:54.809597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:54.848969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:54.858004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:54.869699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e00a4b4f-a859-40d4-a177-4afbc2119f45 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 3.411799 Aug 25 13:11:54.871306 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1795/3540] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:51 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 3416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:54.898659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c785b68f-c7f7-4454-9aa6-414449d4ca31 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:54.899988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c785b68f-c7f7-4454-9aa6-414449d4ca31 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:54.916306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=32 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:54.927983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c785b68f-c7f7-4454-9aa6-414449d4ca31 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:54.930499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c785b68f-c7f7-4454-9aa6-414449d4ca31 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:54.935638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c785b68f-c7f7-4454-9aa6-414449d4ca31 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:54.937632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c785b68f-c7f7-4454-9aa6-414449d4ca31 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:54.941182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c785b68f-c7f7-4454-9aa6-414449d4ca31 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:54.945768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c785b68f-c7f7-4454-9aa6-414449d4ca31 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:55.074473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-387c682e-368b-450b-b9f1-281c464ab5dc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:55.085597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=94 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:55.120915 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-387c682e-368b-450b-b9f1-281c464ab5dc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.361702 Aug 25 13:11:55.138514 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1746/3541] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:53 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:55.200498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-832296e7-3d46-4a0a-ae87-710762bcbd49 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:55.201690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-832296e7-3d46-4a0a-ae87-710762bcbd49 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:55.232497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-832296e7-3d46-4a0a-ae87-710762bcbd49 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:55.237867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-832296e7-3d46-4a0a-ae87-710762bcbd49 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:55.240841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-832296e7-3d46-4a0a-ae87-710762bcbd49 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:55.244453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-832296e7-3d46-4a0a-ae87-710762bcbd49 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:55.249849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-832296e7-3d46-4a0a-ae87-710762bcbd49 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:55.251165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-832296e7-3d46-4a0a-ae87-710762bcbd49 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:56.022729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c785b68f-c7f7-4454-9aa6-414449d4ca31 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:56.058345 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c785b68f-c7f7-4454-9aa6-414449d4ca31 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1494 microversion: 2.1 time: 1.181020 Aug 25 13:11:56.060148 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1796/3542] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:54 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1494 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:56.073913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:56.075603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:56.092631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:56.094213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:56.095386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:56.097358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:56.099276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:56.100516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:56.226426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-832296e7-3d46-4a0a-ae87-710762bcbd49 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:56.258511 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-832296e7-3d46-4a0a-ae87-710762bcbd49 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.056588 Aug 25 13:11:56.259689 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1747/3543] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:55 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:11:56.306470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63dba31c-0766-4b68-b818-8a70895750bb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:56.307601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-63dba31c-0766-4b68-b818-8a70895750bb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:56.335774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63dba31c-0766-4b68-b818-8a70895750bb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:56.337051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63dba31c-0766-4b68-b818-8a70895750bb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:56.338124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63dba31c-0766-4b68-b818-8a70895750bb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:56.339749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63dba31c-0766-4b68-b818-8a70895750bb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:56.340906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63dba31c-0766-4b68-b818-8a70895750bb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:56.342105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63dba31c-0766-4b68-b818-8a70895750bb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:57.555743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-63dba31c-0766-4b68-b818-8a70895750bb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:57.570391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:57.599186 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-63dba31c-0766-4b68-b818-8a70895750bb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.300925 Aug 25 13:11:57.605365 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1748/3544] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:56 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:11:57.623482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:57.627332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6c9c431e-d151-45be-8bb7-29cdbde20ed5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:57.638000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6c9c431e-d151-45be-8bb7-29cdbde20ed5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:57.654191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:57.654191 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da28362a-e393-4832-b99c-378c394305b2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.585531 Aug 25 13:11:57.654191 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1797/3545] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:56 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:57.663429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5f5e4f35-77fe-4a34-965e-4f17a4e0fe6f req-7d1bd73a-50a3-4564-9954-487c4a93a53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-plugged", "status": "completed", "tag": "e440bc76-ba2a-47fc-ba6a-494656b6f798"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:57.685017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c9c431e-d151-45be-8bb7-29cdbde20ed5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:57.686549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c9c431e-d151-45be-8bb7-29cdbde20ed5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:57.688050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c9c431e-d151-45be-8bb7-29cdbde20ed5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:57.690632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c9c431e-d151-45be-8bb7-29cdbde20ed5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:57.692323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c9c431e-d151-45be-8bb7-29cdbde20ed5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:57.693327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c9c431e-d151-45be-8bb7-29cdbde20ed5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:57.696912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5f5e4f35-77fe-4a34-965e-4f17a4e0fe6f req-7d1bd73a-50a3-4564-9954-487c4a93a53e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:57.702175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5f5e4f35-77fe-4a34-965e-4f17a4e0fe6f req-7d1bd73a-50a3-4564-9954-487c4a93a53e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:57.703432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5f5e4f35-77fe-4a34-965e-4f17a4e0fe6f req-7d1bd73a-50a3-4564-9954-487c4a93a53e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:57.755871 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5f5e4f35-77fe-4a34-965e-4f17a4e0fe6f req-7d1bd73a-50a3-4564-9954-487c4a93a53e service nova] Creating event network-vif-plugged:e440bc76-ba2a-47fc-ba6a-494656b6f798 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:11:57.796160 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5f5e4f35-77fe-4a34-965e-4f17a4e0fe6f req-7d1bd73a-50a3-4564-9954-487c4a93a53e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143684 Aug 25 13:11:57.806612 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1798/3546] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:57.828975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da7627ed-b497-4b09-93db-598d4a55222f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:57.834628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da7627ed-b497-4b09-93db-598d4a55222f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:57.848125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da7627ed-b497-4b09-93db-598d4a55222f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:57.849759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da7627ed-b497-4b09-93db-598d4a55222f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:57.850977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da7627ed-b497-4b09-93db-598d4a55222f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:57.852951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da7627ed-b497-4b09-93db-598d4a55222f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:57.854317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da7627ed-b497-4b09-93db-598d4a55222f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:57.855254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da7627ed-b497-4b09-93db-598d4a55222f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:58.804915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6c9c431e-d151-45be-8bb7-29cdbde20ed5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:58.826968 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6c9c431e-d151-45be-8bb7-29cdbde20ed5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1494 microversion: 2.1 time: 1.218756 Aug 25 13:11:58.828711 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1749/3547] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:57 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1494 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:58.841176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:58.843894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:58.858506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:58.860201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:58.864942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:58.867791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:58.869188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:58.870529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:58.994044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da7627ed-b497-4b09-93db-598d4a55222f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:59.015454 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da7627ed-b497-4b09-93db-598d4a55222f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.203493 Aug 25 13:11:59.017986 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1799/3548] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:57 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:59.310478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1876010628", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "7c492fa6-6e78-453d-bf88-c7f9aac830a1"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:59.513108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] validate_networks() for [('7c492fa6-6e78-453d-bf88-c7f9aac830a1', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:12:00.680904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:00.759056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:00.762945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:00.767054 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eb6fb667-deb6-404b-8567-eaa872d7a9a2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.934932 Aug 25 13:12:00.770907 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1750/3549] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:58 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:00.799800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26f97523-1e66-4f86-9212-b4b00d116fdf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:00.819864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-26f97523-1e66-4f86-9212-b4b00d116fdf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:00.843095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f97523-1e66-4f86-9212-b4b00d116fdf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:00.844498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f97523-1e66-4f86-9212-b4b00d116fdf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:00.845334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f97523-1e66-4f86-9212-b4b00d116fdf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:00.847134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f97523-1e66-4f86-9212-b4b00d116fdf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:00.848412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f97523-1e66-4f86-9212-b4b00d116fdf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:00.849307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f97523-1e66-4f86-9212-b4b00d116fdf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:02.416667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-26f97523-1e66-4f86-9212-b4b00d116fdf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:02.435111 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-26f97523-1e66-4f86-9212-b4b00d116fdf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1500 microversion: 2.1 time: 1.651825 Aug 25 13:12:02.449975 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1751/3550] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:00 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1500 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:02.467903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b27cbf87-034c-48df-828e-cc6af6891ed0 req-538f773c-b121-4335-91bb-a349d3747b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-plugged", "status": "completed", "tag": "5ef83c87-8cc0-47a2-bbb9-0e65f095a703"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:02.512461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b27cbf87-034c-48df-828e-cc6af6891ed0 req-538f773c-b121-4335-91bb-a349d3747b33 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:02.513305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b27cbf87-034c-48df-828e-cc6af6891ed0 req-538f773c-b121-4335-91bb-a349d3747b33 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:02.514158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b27cbf87-034c-48df-828e-cc6af6891ed0 req-538f773c-b121-4335-91bb-a349d3747b33 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:02.550834 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b27cbf87-034c-48df-828e-cc6af6891ed0 req-538f773c-b121-4335-91bb-a349d3747b33 service nova] Creating event network-vif-plugged:5ef83c87-8cc0-47a2-bbb9-0e65f095a703 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:12:02.565265 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b27cbf87-034c-48df-828e-cc6af6891ed0 req-538f773c-b121-4335-91bb-a349d3747b33 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112277 Aug 25 13:12:02.568276 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1752/3551] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:02.587783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:02.590059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:02.606704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:02.608162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:02.609457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:02.611370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:02.613350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:02.618153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.530442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:12:03.531489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:12:03.532292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:12:03.533032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:12:03.533908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:12:03.618137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.619306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.620200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.627594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.628312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.630210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.647478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:03.711506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:03.731811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:03.735383 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d67dcb40-93c5-455f-a0d2-f3b85a541934 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.161617 Aug 25 13:12:03.771459 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1753/3552] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:02 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:03.777100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:12:03.793923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1755ebf6-2984-46f9-9490-5640620a108f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:03.796823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1755ebf6-2984-46f9-9490-5640620a108f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:03.805216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for user e320ccc6c0624541895fc42bf681da76 and project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:12:03.822439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1755ebf6-2984-46f9-9490-5640620a108f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.823865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1755ebf6-2984-46f9-9490-5640620a108f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.825102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1755ebf6-2984-46f9-9490-5640620a108f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.826837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1755ebf6-2984-46f9-9490-5640620a108f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.828054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1755ebf6-2984-46f9-9490-5640620a108f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.829231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1755ebf6-2984-46f9-9490-5640620a108f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.865850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:12:03.881419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:12:04.078065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1755ebf6-2984-46f9-9490-5640620a108f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:12:04.166742 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-96254889-8281-46d1-8208-e9841ab68731 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.862807 Aug 25 13:12:04.190561 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1800/3553] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:11:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:12:04.215734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8464eb7b-5110-44e7-9e9d-823a9b23913b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:04.216817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8464eb7b-5110-44e7-9e9d-823a9b23913b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:04.590476 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1755ebf6-2984-46f9-9490-5640620a108f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 204 len: 0 microversion: 2.1 time: 0.812553 Aug 25 13:12:04.592103 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1754/3554] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:12:03 2022] DELETE /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 0 bytes in 819 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:12:04.655194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2111ae2-3920-4b6f-aa7b-8c29454f9758 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:04.664689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2111ae2-3920-4b6f-aa7b-8c29454f9758 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:04.712492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2111ae2-3920-4b6f-aa7b-8c29454f9758 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:04.724553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2111ae2-3920-4b6f-aa7b-8c29454f9758 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:04.725534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2111ae2-3920-4b6f-aa7b-8c29454f9758 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:04.728640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2111ae2-3920-4b6f-aa7b-8c29454f9758 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:04.729822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2111ae2-3920-4b6f-aa7b-8c29454f9758 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:04.741130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2111ae2-3920-4b6f-aa7b-8c29454f9758 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:04.790069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8464eb7b-5110-44e7-9e9d-823a9b23913b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:04.820433 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8464eb7b-5110-44e7-9e9d-823a9b23913b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1215 microversion: 2.1 time: 0.624722 Aug 25 13:12:04.825039 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1801/3555] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:04 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1215 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:04.848403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:04.858901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:04.902329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:04.908910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:04.911639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:04.918824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:04.921957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:04.939647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:07.486614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2111ae2-3920-4b6f-aa7b-8c29454f9758 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:07.528320 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2111ae2-3920-4b6f-aa7b-8c29454f9758 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 2.919235 Aug 25 13:12:07.529333 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1755/3556] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:04 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 2927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:07.565605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-023fac76-dc41-4580-a43c-29cba220301d req-2b0753c4-4fd5-4733-914f-2f692ae10af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-plugged", "status": "completed", "tag": "3d6b512c-f6c6-4653-ac20-613fdfd4cfd3"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:07.626166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-023fac76-dc41-4580-a43c-29cba220301d req-2b0753c4-4fd5-4733-914f-2f692ae10af1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:07.627358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-023fac76-dc41-4580-a43c-29cba220301d req-2b0753c4-4fd5-4733-914f-2f692ae10af1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:07.629116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-023fac76-dc41-4580-a43c-29cba220301d req-2b0753c4-4fd5-4733-914f-2f692ae10af1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:07.702062 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-023fac76-dc41-4580-a43c-29cba220301d req-2b0753c4-4fd5-4733-914f-2f692ae10af1 service nova] Creating event network-vif-plugged:3d6b512c-f6c6-4653-ac20-613fdfd4cfd3 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:12:07.729202 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-023fac76-dc41-4580-a43c-29cba220301d req-2b0753c4-4fd5-4733-914f-2f692ae10af1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180695 Aug 25 13:12:07.731209 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1756/3557] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:07.757662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-22a8aafc-83b6-4270-86b4-4801dd4057fc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:07.762262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-22a8aafc-83b6-4270-86b4-4801dd4057fc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:07.792225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22a8aafc-83b6-4270-86b4-4801dd4057fc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:07.796775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22a8aafc-83b6-4270-86b4-4801dd4057fc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:07.797600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22a8aafc-83b6-4270-86b4-4801dd4057fc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:07.806902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22a8aafc-83b6-4270-86b4-4801dd4057fc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:07.807802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22a8aafc-83b6-4270-86b4-4801dd4057fc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:07.811234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22a8aafc-83b6-4270-86b4-4801dd4057fc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:08.464751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-22a8aafc-83b6-4270-86b4-4801dd4057fc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:08.528299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-22a8aafc-83b6-4270-86b4-4801dd4057fc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1267 microversion: 2.1 time: 0.784596 Aug 25 13:12:08.533081 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1757/3558] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:07 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1267 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:08.571612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3364a7c4-9781-4bb5-b617-ee762c1a23cf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:08.599331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3364a7c4-9781-4bb5-b617-ee762c1a23cf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:08.642974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3364a7c4-9781-4bb5-b617-ee762c1a23cf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:08.646830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3364a7c4-9781-4bb5-b617-ee762c1a23cf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:08.654356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3364a7c4-9781-4bb5-b617-ee762c1a23cf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:08.655896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3364a7c4-9781-4bb5-b617-ee762c1a23cf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:08.656832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3364a7c4-9781-4bb5-b617-ee762c1a23cf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:08.657760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3364a7c4-9781-4bb5-b617-ee762c1a23cf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:09.271953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:09.324966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:09.355556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:09.355556 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e9ed5985-ef5e-4153-ad73-d2344ab77ab7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 4.521866 Aug 25 13:12:09.355556 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1802/3559] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:04 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 4528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:09.568395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3364a7c4-9781-4bb5-b617-ee762c1a23cf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:09.601685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3a6ff3a5-580b-405e-a1ad-ca36d18dae9f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:09.601997 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3364a7c4-9781-4bb5-b617-ee762c1a23cf tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 1.039403 Aug 25 13:12:09.603076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3a6ff3a5-580b-405e-a1ad-ca36d18dae9f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:09.606665 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1758/3560] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:08 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:12:09.647502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6ff3a5-580b-405e-a1ad-ca36d18dae9f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:09.649019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6ff3a5-580b-405e-a1ad-ca36d18dae9f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:09.661009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6ff3a5-580b-405e-a1ad-ca36d18dae9f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:09.668483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6ff3a5-580b-405e-a1ad-ca36d18dae9f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:09.676929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6ff3a5-580b-405e-a1ad-ca36d18dae9f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:09.680151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a6ff3a5-580b-405e-a1ad-ca36d18dae9f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:09.886923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ff06dd72-d136-4381-a42c-3fbbf4f55366 req-3aabae1b-bbb7-4f9a-a59f-e690cb8dcfa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-plugged", "status": "completed", "tag": "5b7c31c9-60ee-492f-b4f4-8144364f3d01"}, {"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-plugged", "status": "completed", "tag": "67845e42-86bc-468e-af48-e1b8969e1ce8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:09.953846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ff06dd72-d136-4381-a42c-3fbbf4f55366 req-3aabae1b-bbb7-4f9a-a59f-e690cb8dcfa5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:09.954766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ff06dd72-d136-4381-a42c-3fbbf4f55366 req-3aabae1b-bbb7-4f9a-a59f-e690cb8dcfa5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:09.955599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ff06dd72-d136-4381-a42c-3fbbf4f55366 req-3aabae1b-bbb7-4f9a-a59f-e690cb8dcfa5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:10.011446 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ff06dd72-d136-4381-a42c-3fbbf4f55366 req-3aabae1b-bbb7-4f9a-a59f-e690cb8dcfa5 service nova] Creating event network-vif-plugged:5b7c31c9-60ee-492f-b4f4-8144364f3d01 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:12:10.012790 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ff06dd72-d136-4381-a42c-3fbbf4f55366 req-3aabae1b-bbb7-4f9a-a59f-e690cb8dcfa5 service nova] Creating event network-vif-plugged:67845e42-86bc-468e-af48-e1b8969e1ce8 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:12:10.028883 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ff06dd72-d136-4381-a42c-3fbbf4f55366 req-3aabae1b-bbb7-4f9a-a59f-e690cb8dcfa5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.151527 Aug 25 13:12:10.031336 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1759/3561] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:12:10.043229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9120135d-18f4-4b13-9f88-647d9f5d67ec tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d15b612-3e5f-4c12-ada8-044d3a6ce382"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:10.048058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9120135d-18f4-4b13-9f88-647d9f5d67ec tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:10.079781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9120135d-18f4-4b13-9f88-647d9f5d67ec tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:10.083831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9120135d-18f4-4b13-9f88-647d9f5d67ec tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:10.085260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9120135d-18f4-4b13-9f88-647d9f5d67ec tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:10.089134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9120135d-18f4-4b13-9f88-647d9f5d67ec tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:10.090578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9120135d-18f4-4b13-9f88-647d9f5d67ec tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:10.091805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9120135d-18f4-4b13-9f88-647d9f5d67ec tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:10.382082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3a6ff3a5-580b-405e-a1ad-ca36d18dae9f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:10.417474 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3a6ff3a5-580b-405e-a1ad-ca36d18dae9f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1273 microversion: 2.1 time: 0.831228 Aug 25 13:12:10.425074 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1803/3562] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:09 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1273 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:12:10.465368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:10.471424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:10.510277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:10.514507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:10.519818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:10.522801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:10.525217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:10.530105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:11.064418 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9120135d-18f4-4b13-9f88-647d9f5d67ec tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "POST /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.007997 Aug 25 13:12:11.071648 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1760/3563] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:12:10 2022] POST /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-volume_attachments => generated 194 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:11.114881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89f16bc3-1ac2-4af7-850f-fde7c1efa210 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:11.115834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89f16bc3-1ac2-4af7-850f-fde7c1efa210 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:11.158826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89f16bc3-1ac2-4af7-850f-fde7c1efa210 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:11.159761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89f16bc3-1ac2-4af7-850f-fde7c1efa210 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:11.166959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89f16bc3-1ac2-4af7-850f-fde7c1efa210 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:11.168362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89f16bc3-1ac2-4af7-850f-fde7c1efa210 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:11.178072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89f16bc3-1ac2-4af7-850f-fde7c1efa210 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:11.181124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89f16bc3-1ac2-4af7-850f-fde7c1efa210 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:12.701617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89f16bc3-1ac2-4af7-850f-fde7c1efa210 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:12.735495 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89f16bc3-1ac2-4af7-850f-fde7c1efa210 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1506 microversion: 2.1 time: 1.660474 Aug 25 13:12:12.737423 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1761/3564] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:11 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1506 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:12.768545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ac3b7ef8-263d-4adf-b820-16e9636891a5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:12.775285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ac3b7ef8-263d-4adf-b820-16e9636891a5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:12.779612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:12.820268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac3b7ef8-263d-4adf-b820-16e9636891a5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:12.826554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac3b7ef8-263d-4adf-b820-16e9636891a5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:12.834713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac3b7ef8-263d-4adf-b820-16e9636891a5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:12.843191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac3b7ef8-263d-4adf-b820-16e9636891a5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:12.845100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac3b7ef8-263d-4adf-b820-16e9636891a5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:12.846229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac3b7ef8-263d-4adf-b820-16e9636891a5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:12.911781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:12.944954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:12.989329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:13.001549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:13.007930 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-63ed8ec2-2028-4427-93a8-d6c395ea900d tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 2.578104 Aug 25 13:12:13.010957 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1804/3565] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:10 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 2584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:13.031319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-363365f0-62f0-43e0-bff9-a2a7849dda9e req-273d8038-ed9a-49c5-9a75-b452dabd364c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-plugged", "status": "completed", "tag": "2fde30af-7c62-406e-af8d-ea3df7741a85"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:13.073018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-363365f0-62f0-43e0-bff9-a2a7849dda9e req-273d8038-ed9a-49c5-9a75-b452dabd364c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:13.074600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-363365f0-62f0-43e0-bff9-a2a7849dda9e req-273d8038-ed9a-49c5-9a75-b452dabd364c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:13.075727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-363365f0-62f0-43e0-bff9-a2a7849dda9e req-273d8038-ed9a-49c5-9a75-b452dabd364c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:13.125492 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-363365f0-62f0-43e0-bff9-a2a7849dda9e req-273d8038-ed9a-49c5-9a75-b452dabd364c service nova] Creating event network-vif-plugged:2fde30af-7c62-406e-af8d-ea3df7741a85 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:12:13.147675 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-363365f0-62f0-43e0-bff9-a2a7849dda9e req-273d8038-ed9a-49c5-9a75-b452dabd364c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129271 Aug 25 13:12:13.152881 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1805/3566] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:13.782563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:13.799791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d41144c1-b682-4644-ab5b-a9ad835fb974 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:13.806052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d41144c1-b682-4644-ab5b-a9ad835fb974 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:13.838041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d41144c1-b682-4644-ab5b-a9ad835fb974 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:13.841636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d41144c1-b682-4644-ab5b-a9ad835fb974 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:13.842398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d41144c1-b682-4644-ab5b-a9ad835fb974 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:13.844170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d41144c1-b682-4644-ab5b-a9ad835fb974 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:13.849865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d41144c1-b682-4644-ab5b-a9ad835fb974 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:13.850770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d41144c1-b682-4644-ab5b-a9ad835fb974 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:14.422272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d41144c1-b682-4644-ab5b-a9ad835fb974 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:14.461764 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d41144c1-b682-4644-ab5b-a9ad835fb974 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1464 microversion: 2.1 time: 0.682158 Aug 25 13:12:14.465006 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1806/3567] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:13 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1464 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:12:14.525342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:14.528926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:14.563832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:14.579636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:14.582526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:14.584326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:14.591133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:14.595125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:14.630213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ac3b7ef8-263d-4adf-b820-16e9636891a5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:14.690498 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ac3b7ef8-263d-4adf-b820-16e9636891a5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1315 microversion: 2.1 time: 1.950177 Aug 25 13:12:14.725833 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1762/3568] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:12 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1315 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:14.832125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:15.236902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-669c68b5-ae6f-4f7f-bb82-eac0873eee23 req-f70c8a38-0398-4f35-a737-c2eca4b24cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7bb552-cda2-4dca-a09f-db46de2fd7ef", "name": "network-vif-deleted", "tag": "f522e2ee-e266-42dd-bb31-b3177aff9970"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:15.329373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-669c68b5-ae6f-4f7f-bb82-eac0873eee23 req-f70c8a38-0398-4f35-a737-c2eca4b24cc4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:15.330308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-669c68b5-ae6f-4f7f-bb82-eac0873eee23 req-f70c8a38-0398-4f35-a737-c2eca4b24cc4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:15.346222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-669c68b5-ae6f-4f7f-bb82-eac0873eee23 req-f70c8a38-0398-4f35-a737-c2eca4b24cc4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:15.404181 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-669c68b5-ae6f-4f7f-bb82-eac0873eee23 req-f70c8a38-0398-4f35-a737-c2eca4b24cc4 service nova] Creating event network-vif-deleted:f522e2ee-e266-42dd-bb31-b3177aff9970 for instance fb7bb552-cda2-4dca-a09f-db46de2fd7ef on n-h1-852771-8 Aug 25 13:12:15.433687 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-669c68b5-ae6f-4f7f-bb82-eac0873eee23 req-f70c8a38-0398-4f35-a737-c2eca4b24cc4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229992 Aug 25 13:12:15.435430 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1763/3569] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:12:15.455586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-5f720345-f466-44b5-8325-aaad38a87e15 req-0c353610-b628-4067-862d-f213163b1d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-plugged", "status": "completed", "tag": "577f3d0c-4649-4113-b00f-2661db107775"}, {"server_uuid": "fb7bb552-cda2-4dca-a09f-db46de2fd7ef", "name": "network-vif-unplugged", "status": "completed", "tag": "f522e2ee-e266-42dd-bb31-b3177aff9970"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:15.520260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5f720345-f466-44b5-8325-aaad38a87e15 req-0c353610-b628-4067-862d-f213163b1d91 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:15.534104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5f720345-f466-44b5-8325-aaad38a87e15 req-0c353610-b628-4067-862d-f213163b1d91 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:15.540429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5f720345-f466-44b5-8325-aaad38a87e15 req-0c353610-b628-4067-862d-f213163b1d91 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:15.616773 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5f720345-f466-44b5-8325-aaad38a87e15 req-0c353610-b628-4067-862d-f213163b1d91 service nova] Creating event network-vif-plugged:577f3d0c-4649-4113-b00f-2661db107775 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:12:15.618550 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5f720345-f466-44b5-8325-aaad38a87e15 req-0c353610-b628-4067-862d-f213163b1d91 service nova] Creating event network-vif-unplugged:f522e2ee-e266-42dd-bb31-b3177aff9970 for instance fb7bb552-cda2-4dca-a09f-db46de2fd7ef on n-h1-852771-8 Aug 25 13:12:15.651790 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-5f720345-f466-44b5-8325-aaad38a87e15 req-0c353610-b628-4067-862d-f213163b1d91 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.209726 Aug 25 13:12:15.661868 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1764/3570] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:15.679555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:15.688934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:15.745022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:15.763656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:15.765776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:15.770397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:15.788884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:15.790641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:16.068785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:16.070014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:16.072947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:16.085657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lazy-loading 'fault' on Instance uuid fb7bb552-cda2-4dca-a09f-db46de2fd7ef {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:12:18.102576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:18.127859 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e6140ffc-5cd6-4c6e-ab80-61485e10fd9c tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 200 len: 1304 microversion: 2.1 time: 2.463281 Aug 25 13:12:18.129440 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1765/3571] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:15 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 1304 bytes in 2467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:18.181230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-11c75daa-5ddb-4d7f-a3b3-d9a06a7b4218 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:18.185367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-11c75daa-5ddb-4d7f-a3b3-d9a06a7b4218 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:18.223575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11c75daa-5ddb-4d7f-a3b3-d9a06a7b4218 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:18.224643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11c75daa-5ddb-4d7f-a3b3-d9a06a7b4218 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:18.225738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11c75daa-5ddb-4d7f-a3b3-d9a06a7b4218 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:18.233094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11c75daa-5ddb-4d7f-a3b3-d9a06a7b4218 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:18.235992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11c75daa-5ddb-4d7f-a3b3-d9a06a7b4218 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:18.242344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11c75daa-5ddb-4d7f-a3b3-d9a06a7b4218 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:18.631066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:18.696034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:18.713554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:18.729454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:18.733787 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bf8a25b5-5fcf-4b8a-9b95-24b7f83d9ed4 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 4.252686 Aug 25 13:12:18.739523 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1807/3572] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:14 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 4260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:19.187833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:19.189109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: fb7bb552-cda2-4dca-a09f-db46de2fd7ef] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:19.223258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:19.231651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:19.232500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:19.235810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:19.239978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:19.242529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:19.313715 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] HTTP exception thrown: Instance fb7bb552-cda2-4dca-a09f-db46de2fd7ef could not be found. Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Request method failure captured: Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef HTTP/1.1 Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3RRUBJb6cjcnUSWHdD3qatYAB0sJu3bXtHMefEaabTEbQ2JFtdOtj21kUtIm3wrPLnN4J3oee6VfwIFrCcgLvHp9szCHK75jII4kvCJujO9nivxPDkeBe42nIZ6JPm4B_Gg_ZJkXQY42aMYVanSLRUsxksPceExBkoIaF2E7Dw0qSo Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 47a0144c8345403bb4c6728543a34076 Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerRescueTestJSON-2012645398 Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47a0144c8345403bb4c6728543a34076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47a0144c8345403bb4c6728543a34076", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47a0144c8345403bb4c6728543a34076"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47a0144c8345403bb4c6728543a34076"}]}] Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerRescueTestJSON-2012645398 Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 47a0144c8345403bb4c6728543a34076 Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerRescueTestJSON-2012645398 Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerRescueTestJSON-2012645398-project Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e7fbb17c9f8e4220ac149cf51502fd20 Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerRescueTestJSON-2012645398-project Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance fb7bb552-cda2-4dca-a09f-db46de2fd7ef could not be found. Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'fb7bb552-cda2-4dca-a09f-db46de2fd7ef'} Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7bb552-cda2-4dca-a09f-db46de2fd7ef could not be found. Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7bb552-cda2-4dca-a09f-db46de2fd7ef could not be found. Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:12:19.319162 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:12:19.324818 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:19.324818 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:12:19.324818 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:12:19.324818 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:12:19.324818 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:12:19.324818 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7bb552-cda2-4dca-a09f-db46de2fd7ef could not be found. Aug 25 13:12:19.324818 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:12:19.333695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Returning 404 to user: Instance fb7bb552-cda2-4dca-a09f-db46de2fd7ef could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:12:19.335980 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5d5f9c88-d84d-45ea-be5d-54079e761fa6 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef" status: 404 len: 111 microversion: 2.1 time: 0.169652 Aug 25 13:12:19.338059 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1808/3573] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:19 2022] GET /compute/v2.1/servers/fb7bb552-cda2-4dca-a09f-db46de2fd7ef => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:12:19.360446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff72b90d-0d5f-4b8f-957c-2f534aebcdce tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:19.362035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff72b90d-0d5f-4b8f-957c-2f534aebcdce tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:19.396149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff72b90d-0d5f-4b8f-957c-2f534aebcdce tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:19.399045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff72b90d-0d5f-4b8f-957c-2f534aebcdce tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:19.401471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff72b90d-0d5f-4b8f-957c-2f534aebcdce tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:19.422441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff72b90d-0d5f-4b8f-957c-2f534aebcdce tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:19.431093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff72b90d-0d5f-4b8f-957c-2f534aebcdce tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:19.434776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff72b90d-0d5f-4b8f-957c-2f534aebcdce tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:19.606641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff72b90d-0d5f-4b8f-957c-2f534aebcdce tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:12:19.978717 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff72b90d-0d5f-4b8f-957c-2f534aebcdce tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 204 len: 0 microversion: 2.1 time: 0.633394 Aug 25 13:12:19.980297 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1809/3574] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:12:19 2022] DELETE /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:12:20.000697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:20.013677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:20.037649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:20.038822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:20.039748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:20.042656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:20.043998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:20.045309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:20.669341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-11c75daa-5ddb-4d7f-a3b3-d9a06a7b4218 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:20.734340 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-11c75daa-5ddb-4d7f-a3b3-d9a06a7b4218 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1315 microversion: 2.1 time: 2.567714 Aug 25 13:12:20.735472 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1766/3575] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:18 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1315 bytes in 2574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:20.773162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b573c74-fef0-4ad7-adab-fafd25746029 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:20.774917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b573c74-fef0-4ad7-adab-fafd25746029 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:20.788504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b573c74-fef0-4ad7-adab-fafd25746029 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:20.789948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b573c74-fef0-4ad7-adab-fafd25746029 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:20.791136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b573c74-fef0-4ad7-adab-fafd25746029 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:20.792921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b573c74-fef0-4ad7-adab-fafd25746029 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:20.794254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b573c74-fef0-4ad7-adab-fafd25746029 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:20.795616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b573c74-fef0-4ad7-adab-fafd25746029 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:21.492395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.538973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.543932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.546387 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-490b882a-f71e-482e-9c8d-667f65da8449 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1879 microversion: 2.32 time: 1.563796 Aug 25 13:12:21.547456 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1810/3576] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:19 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1879 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:21.730042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b573c74-fef0-4ad7-adab-fafd25746029 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.758471 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b573c74-fef0-4ad7-adab-fafd25746029 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1492 microversion: 2.1 time: 1.006760 Aug 25 13:12:21.773279 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1767/3577] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:20 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1492 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:21.808265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-65fac35c-53fd-413b-af76-0180ac938d71 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:21.820972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-65fac35c-53fd-413b-af76-0180ac938d71 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:21.862049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65fac35c-53fd-413b-af76-0180ac938d71 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:21.865952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65fac35c-53fd-413b-af76-0180ac938d71 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:21.867479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65fac35c-53fd-413b-af76-0180ac938d71 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:21.870351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65fac35c-53fd-413b-af76-0180ac938d71 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:21.871979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65fac35c-53fd-413b-af76-0180ac938d71 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:21.875795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65fac35c-53fd-413b-af76-0180ac938d71 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:22.397138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-65fac35c-53fd-413b-af76-0180ac938d71 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:22.434828 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-65fac35c-53fd-413b-af76-0180ac938d71 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1315 microversion: 2.1 time: 0.658261 Aug 25 13:12:22.440399 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1811/3578] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:21 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:22.611440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:22.616797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:22.652523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.653973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.662990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:22.665126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.666640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.667806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:22.808056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f9a906b0-3ba0-438a-8832-385652bff0f5 req-f38e191b-f877-4d81-8a2d-c04df11481ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b514b9c8-029c-42f9-a059-b900597e40e2", "tag": "d10c11d8-e29b-4655-9ec0-72079613cd77"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:22.928008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f9a906b0-3ba0-438a-8832-385652bff0f5 req-f38e191b-f877-4d81-8a2d-c04df11481ed service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.928903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f9a906b0-3ba0-438a-8832-385652bff0f5 req-f38e191b-f877-4d81-8a2d-c04df11481ed service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.929756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f9a906b0-3ba0-438a-8832-385652bff0f5 req-f38e191b-f877-4d81-8a2d-c04df11481ed service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:23.002882 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f9a906b0-3ba0-438a-8832-385652bff0f5 req-f38e191b-f877-4d81-8a2d-c04df11481ed service nova] Creating event network-changed:d10c11d8-e29b-4655-9ec0-72079613cd77 for instance b514b9c8-029c-42f9-a059-b900597e40e2 on n-h2-852771-8 Aug 25 13:12:23.017799 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f9a906b0-3ba0-438a-8832-385652bff0f5 req-f38e191b-f877-4d81-8a2d-c04df11481ed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.057688 Aug 25 13:12:23.037665 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1768/3579] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:12:23.053732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ee271c6-bb3e-4b5e-9152-feed4cb3971f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:23.062684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8ee271c6-bb3e-4b5e-9152-feed4cb3971f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:23.078557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee271c6-bb3e-4b5e-9152-feed4cb3971f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:23.079885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee271c6-bb3e-4b5e-9152-feed4cb3971f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:23.081200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee271c6-bb3e-4b5e-9152-feed4cb3971f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:23.084520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee271c6-bb3e-4b5e-9152-feed4cb3971f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:23.085988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee271c6-bb3e-4b5e-9152-feed4cb3971f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:23.087276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ee271c6-bb3e-4b5e-9152-feed4cb3971f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:25.625657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:25.729352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8ee271c6-bb3e-4b5e-9152-feed4cb3971f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:25.737438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:25.751302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:25.761706 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-204f3ccf-ef33-46da-9fbc-ca445eff7eee tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 2831 microversion: 2.32 time: 3.161849 Aug 25 13:12:25.775986 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1812/3580] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:22 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 2831 bytes in 3179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:12:25.792076 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8ee271c6-bb3e-4b5e-9152-feed4cb3971f tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1492 microversion: 2.1 time: 2.754295 Aug 25 13:12:25.793185 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1769/3581] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:23 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1492 bytes in 2765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:25.824199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3afbdda9-07c9-4b37-84e7-2f1d7debc364 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:25.835332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8a65bd4a-8d15-4b8b-a9dc-52e93e017bc7 req-3eab9009-9a46-4cfb-9abc-92767ba45b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18298dec-561e-48d1-a00c-d1704f098b69", "name": "network-vif-deleted", "tag": "e960576e-e63f-4e71-b5fe-c700497e49cd"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:25.836406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3afbdda9-07c9-4b37-84e7-2f1d7debc364 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:25.846515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:25.877902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8a65bd4a-8d15-4b8b-a9dc-52e93e017bc7 req-3eab9009-9a46-4cfb-9abc-92767ba45b26 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:25.880678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8a65bd4a-8d15-4b8b-a9dc-52e93e017bc7 req-3eab9009-9a46-4cfb-9abc-92767ba45b26 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:25.881783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8a65bd4a-8d15-4b8b-a9dc-52e93e017bc7 req-3eab9009-9a46-4cfb-9abc-92767ba45b26 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:25.896300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afbdda9-07c9-4b37-84e7-2f1d7debc364 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:25.906796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afbdda9-07c9-4b37-84e7-2f1d7debc364 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:25.909463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afbdda9-07c9-4b37-84e7-2f1d7debc364 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:25.919837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afbdda9-07c9-4b37-84e7-2f1d7debc364 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:25.925706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afbdda9-07c9-4b37-84e7-2f1d7debc364 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:25.927285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afbdda9-07c9-4b37-84e7-2f1d7debc364 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:25.943663 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8a65bd4a-8d15-4b8b-a9dc-52e93e017bc7 req-3eab9009-9a46-4cfb-9abc-92767ba45b26 service nova] Creating event network-vif-deleted:e960576e-e63f-4e71-b5fe-c700497e49cd for instance 18298dec-561e-48d1-a00c-d1704f098b69 on n-h1-852771-8 Aug 25 13:12:25.973358 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8a65bd4a-8d15-4b8b-a9dc-52e93e017bc7 req-3eab9009-9a46-4cfb-9abc-92767ba45b26 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163954 Aug 25 13:12:25.984960 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1770/3582] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:25.999314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-38b687c6-fd9f-410a-b716-fdca46d5f5d0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:26.016471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-38b687c6-fd9f-410a-b716-fdca46d5f5d0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:26.052713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38b687c6-fd9f-410a-b716-fdca46d5f5d0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:26.056697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38b687c6-fd9f-410a-b716-fdca46d5f5d0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:26.072859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38b687c6-fd9f-410a-b716-fdca46d5f5d0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:26.078656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38b687c6-fd9f-410a-b716-fdca46d5f5d0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:26.082874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38b687c6-fd9f-410a-b716-fdca46d5f5d0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:26.089463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-38b687c6-fd9f-410a-b716-fdca46d5f5d0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:26.822830 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-38b687c6-fd9f-410a-b716-fdca46d5f5d0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.835438 Aug 25 13:12:26.837662 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1771/3583] 10.222.0.70 () {60 vars in 1316 bytes} [Thu Aug 25 13:12:25 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041/os-interface => generated 1830 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:26.882546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:26.888907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:26.933474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:26.940017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:26.942357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:26.948261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:26.949636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:26.956571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:27.138041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:27.139714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:27.140950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:27.142368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lazy-loading 'fault' on Instance uuid 18298dec-561e-48d1-a00c-d1704f098b69 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:12:27.714161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3afbdda9-07c9-4b37-84e7-2f1d7debc364 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:27.756690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fbb17c9f8e4220ac149cf51502fd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a0144c8345403bb4c6728543a34076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:27.788897 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3afbdda9-07c9-4b37-84e7-2f1d7debc364 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1315 microversion: 2.1 time: 2.004780 Aug 25 13:12:27.792170 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1813/3584] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:25 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1315 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:27.797172 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-30bb519e-9d29-48e5-b9ea-354192e015d5 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 200 len: 1303 microversion: 2.1 time: 0.947011 Aug 25 13:12:27.799137 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1772/3585] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:26 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 1303 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:28.833457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec87a1f7-fca6-4034-9792-814bc3c517d3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:28.842332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec87a1f7-fca6-4034-9792-814bc3c517d3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:28.848438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:28.854964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] [instance: 18298dec-561e-48d1-a00c-d1704f098b69] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:28.873734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec87a1f7-fca6-4034-9792-814bc3c517d3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:28.874824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec87a1f7-fca6-4034-9792-814bc3c517d3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:28.875246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec87a1f7-fca6-4034-9792-814bc3c517d3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:28.882817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec87a1f7-fca6-4034-9792-814bc3c517d3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:28.883783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec87a1f7-fca6-4034-9792-814bc3c517d3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:28.885494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:28.886701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec87a1f7-fca6-4034-9792-814bc3c517d3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:28.886889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:28.887563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:28.888955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:28.889806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:28.895925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:28.964530 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] HTTP exception thrown: Instance 18298dec-561e-48d1-a00c-d1704f098b69 could not be found. Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Request method failure captured: Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 HTTP/1.1 Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3RRUBJb6cjcnUSWHdD3qatYAB0sJu3bXtHMefEaabTEbQ2JFtdOtj21kUtIm3wrPLnN4J3oee6VfwIFrCcgLvHp9szCHK75jII4kvCJujO9nivxPDkeBe42nIZ6JPm4B_Gg_ZJkXQY42aMYVanSLRUsxksPceExBkoIaF2E7Dw0qSo Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 47a0144c8345403bb4c6728543a34076 Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerRescueTestJSON-2012645398 Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47a0144c8345403bb4c6728543a34076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47a0144c8345403bb4c6728543a34076", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47a0144c8345403bb4c6728543a34076"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47a0144c8345403bb4c6728543a34076"}]}] Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerRescueTestJSON-2012645398 Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 47a0144c8345403bb4c6728543a34076 Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerRescueTestJSON-2012645398 Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerRescueTestJSON-2012645398-project Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e7fbb17c9f8e4220ac149cf51502fd20 Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerRescueTestJSON-2012645398-project Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 18298dec-561e-48d1-a00c-d1704f098b69 could not be found. Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '18298dec-561e-48d1-a00c-d1704f098b69'} Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18298dec-561e-48d1-a00c-d1704f098b69 could not be found. Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18298dec-561e-48d1-a00c-d1704f098b69 could not be found. Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:12:28.978647 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:12:28.985313 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:28.985313 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:12:28.985313 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:12:28.985313 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:12:28.985313 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:12:28.985313 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18298dec-561e-48d1-a00c-d1704f098b69 could not be found. Aug 25 13:12:28.985313 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:12:28.990036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] Returning 404 to user: Instance 18298dec-561e-48d1-a00c-d1704f098b69 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:12:28.991588 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1564f58d-c1d1-4065-bb40-b177fea13fa8 tempest-ServerRescueTestJSON-2012645398 tempest-ServerRescueTestJSON-2012645398-project] 10.222.0.70 "GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69" status: 404 len: 111 microversion: 2.1 time: 0.151307 Aug 25 13:12:28.993605 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1773/3586] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:28 2022] GET /compute/v2.1/servers/18298dec-561e-48d1-a00c-d1704f098b69 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:12:30.417750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec87a1f7-fca6-4034-9792-814bc3c517d3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:30.437626 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ec87a1f7-fca6-4034-9792-814bc3c517d3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1315 microversion: 2.1 time: 1.613861 Aug 25 13:12:30.440090 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1814/3587] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:28 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1315 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:12:31.483025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-24112fc5-f8cb-4925-bdc1-a40511454225 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:31.485070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-24112fc5-f8cb-4925-bdc1-a40511454225 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:31.509120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24112fc5-f8cb-4925-bdc1-a40511454225 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:31.510793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24112fc5-f8cb-4925-bdc1-a40511454225 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:31.512787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24112fc5-f8cb-4925-bdc1-a40511454225 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:31.516218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24112fc5-f8cb-4925-bdc1-a40511454225 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:31.518263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24112fc5-f8cb-4925-bdc1-a40511454225 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:31.520755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24112fc5-f8cb-4925-bdc1-a40511454225 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:32.391301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-24112fc5-f8cb-4925-bdc1-a40511454225 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:32.408154 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-24112fc5-f8cb-4925-bdc1-a40511454225 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1315 microversion: 2.1 time: 0.937751 Aug 25 13:12:32.411294 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1774/3588] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:31 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:32.830076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-7436c0b0-33ec-41cf-a21f-24ea9d6ab5d8 req-4b13b195-c303-4462-93f0-57bb7b44960e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "tag": "e440bc76-ba2a-47fc-ba6a-494656b6f798"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:32.859696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7436c0b0-33ec-41cf-a21f-24ea9d6ab5d8 req-4b13b195-c303-4462-93f0-57bb7b44960e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:32.860942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7436c0b0-33ec-41cf-a21f-24ea9d6ab5d8 req-4b13b195-c303-4462-93f0-57bb7b44960e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:32.862125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7436c0b0-33ec-41cf-a21f-24ea9d6ab5d8 req-4b13b195-c303-4462-93f0-57bb7b44960e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:32.908157 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-7436c0b0-33ec-41cf-a21f-24ea9d6ab5d8 req-4b13b195-c303-4462-93f0-57bb7b44960e service nova] Creating event network-changed:e440bc76-ba2a-47fc-ba6a-494656b6f798 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:12:32.923855 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-7436c0b0-33ec-41cf-a21f-24ea9d6ab5d8 req-4b13b195-c303-4462-93f0-57bb7b44960e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102585 Aug 25 13:12:32.926027 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1815/3589] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:12:33.453424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fdd30bd5-1f99-4e4f-a52f-4149959c5e5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:33.454911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fdd30bd5-1f99-4e4f-a52f-4149959c5e5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:33.494721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd30bd5-1f99-4e4f-a52f-4149959c5e5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:33.496225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd30bd5-1f99-4e4f-a52f-4149959c5e5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:33.498865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd30bd5-1f99-4e4f-a52f-4149959c5e5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:33.507180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd30bd5-1f99-4e4f-a52f-4149959c5e5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:33.508437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd30bd5-1f99-4e4f-a52f-4149959c5e5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:33.509686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdd30bd5-1f99-4e4f-a52f-4149959c5e5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:34.223669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fdd30bd5-1f99-4e4f-a52f-4149959c5e5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:34.260618 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fdd30bd5-1f99-4e4f-a52f-4149959c5e5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1315 microversion: 2.1 time: 0.817783 Aug 25 13:12:34.291417 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1775/3590] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:33 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:34.542609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c385657c-786a-46eb-addb-5b87a88b7aa0 req-2c8ca354-3bc4-41cb-89a9-741900281455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b514b9c8-029c-42f9-a059-b900597e40e2", "name": "network-vif-plugged", "status": "completed", "tag": "d10c11d8-e29b-4655-9ec0-72079613cd77"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:34.592940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c385657c-786a-46eb-addb-5b87a88b7aa0 req-2c8ca354-3bc4-41cb-89a9-741900281455 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:34.594668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c385657c-786a-46eb-addb-5b87a88b7aa0 req-2c8ca354-3bc4-41cb-89a9-741900281455 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:34.600327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c385657c-786a-46eb-addb-5b87a88b7aa0 req-2c8ca354-3bc4-41cb-89a9-741900281455 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:34.652335 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c385657c-786a-46eb-addb-5b87a88b7aa0 req-2c8ca354-3bc4-41cb-89a9-741900281455 service nova] Creating event network-vif-plugged:d10c11d8-e29b-4655-9ec0-72079613cd77 for instance b514b9c8-029c-42f9-a059-b900597e40e2 on n-h2-852771-8 Aug 25 13:12:34.670756 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c385657c-786a-46eb-addb-5b87a88b7aa0 req-2c8ca354-3bc4-41cb-89a9-741900281455 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146316 Aug 25 13:12:34.672191 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1816/3591] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:35.304463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e4c0c64-a5d5-4257-ad0b-c999561dbf29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:35.308101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e4c0c64-a5d5-4257-ad0b-c999561dbf29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:35.369029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e4c0c64-a5d5-4257-ad0b-c999561dbf29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:35.372381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e4c0c64-a5d5-4257-ad0b-c999561dbf29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:35.374872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e4c0c64-a5d5-4257-ad0b-c999561dbf29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:35.380161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e4c0c64-a5d5-4257-ad0b-c999561dbf29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:35.382267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e4c0c64-a5d5-4257-ad0b-c999561dbf29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:35.382922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e4c0c64-a5d5-4257-ad0b-c999561dbf29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:36.249852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e4c0c64-a5d5-4257-ad0b-c999561dbf29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:36.282326 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e4c0c64-a5d5-4257-ad0b-c999561dbf29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1315 microversion: 2.1 time: 0.987318 Aug 25 13:12:36.290577 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1776/3592] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:35 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1315 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:36.951428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b9e5497-4433-4e07-921f-f144ef5e293a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:36.966996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b9e5497-4433-4e07-921f-f144ef5e293a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:36.999882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9e5497-4433-4e07-921f-f144ef5e293a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:37.002001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9e5497-4433-4e07-921f-f144ef5e293a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:37.003787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9e5497-4433-4e07-921f-f144ef5e293a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:37.006124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9e5497-4433-4e07-921f-f144ef5e293a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:37.007509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9e5497-4433-4e07-921f-f144ef5e293a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:37.008803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9e5497-4433-4e07-921f-f144ef5e293a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:37.160376 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b9e5497-4433-4e07-921f-f144ef5e293a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220387 Aug 25 13:12:37.164052 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1817/3593] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:12:36 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:37.186844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72dad088-b958-4d01-be79-c2bc099291e4 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:37.193433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-72dad088-b958-4d01-be79-c2bc099291e4 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:37.229057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dad088-b958-4d01-be79-c2bc099291e4 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:37.245375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dad088-b958-4d01-be79-c2bc099291e4 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:37.246879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dad088-b958-4d01-be79-c2bc099291e4 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:37.248697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dad088-b958-4d01-be79-c2bc099291e4 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:37.251171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dad088-b958-4d01-be79-c2bc099291e4 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:37.252396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72dad088-b958-4d01-be79-c2bc099291e4 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:37.351236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d3fc53b5-e6a3-4dbb-8993-c20eb8ff98fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:37.352504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d3fc53b5-e6a3-4dbb-8993-c20eb8ff98fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:37.401031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc53b5-e6a3-4dbb-8993-c20eb8ff98fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:37.402665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc53b5-e6a3-4dbb-8993-c20eb8ff98fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:37.403216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc53b5-e6a3-4dbb-8993-c20eb8ff98fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:37.406463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc53b5-e6a3-4dbb-8993-c20eb8ff98fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:37.407457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc53b5-e6a3-4dbb-8993-c20eb8ff98fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:37.408276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc53b5-e6a3-4dbb-8993-c20eb8ff98fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:37.666201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-72dad088-b958-4d01-be79-c2bc099291e4 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lazy-loading 'services' on Instance uuid 9a51c80a-6c87-4026-9025-4630451ff316 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:12:38.033256 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72dad088-b958-4d01-be79-c2bc099291e4 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-volume_attachments/7d15b612-3e5f-4c12-ada8-044d3a6ce382" status: 202 len: 0 microversion: 2.1 time: 0.857244 Aug 25 13:12:38.043289 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1777/3594] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:12:37 2022] DELETE /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-volume_attachments/7d15b612-3e5f-4c12-ada8-044d3a6ce382 => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:12:38.516350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d3fc53b5-e6a3-4dbb-8993-c20eb8ff98fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:38.592420 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d3fc53b5-e6a3-4dbb-8993-c20eb8ff98fe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1315 microversion: 2.1 time: 1.265483 Aug 25 13:12:38.609936 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1818/3595] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:37 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1315 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:12:39.642335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-48ac11ed-ddfe-4c6d-9ce6-d2b12cf067af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:39.646479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-48ac11ed-ddfe-4c6d-9ce6-d2b12cf067af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:39.662917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48ac11ed-ddfe-4c6d-9ce6-d2b12cf067af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:39.664313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48ac11ed-ddfe-4c6d-9ce6-d2b12cf067af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:39.665442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48ac11ed-ddfe-4c6d-9ce6-d2b12cf067af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:39.667427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48ac11ed-ddfe-4c6d-9ce6-d2b12cf067af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:39.668677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48ac11ed-ddfe-4c6d-9ce6-d2b12cf067af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:39.670032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48ac11ed-ddfe-4c6d-9ce6-d2b12cf067af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:42.279321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-48ac11ed-ddfe-4c6d-9ce6-d2b12cf067af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:42.315687 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-48ac11ed-ddfe-4c6d-9ce6-d2b12cf067af tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1503 microversion: 2.1 time: 2.686721 Aug 25 13:12:42.317428 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1778/3596] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:39 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1503 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:42.366928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b0979d7-6a64-4310-be54-99c2aac1c24e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:42.383007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5b0979d7-6a64-4310-be54-99c2aac1c24e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:42.430938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b0979d7-6a64-4310-be54-99c2aac1c24e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:42.434309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b0979d7-6a64-4310-be54-99c2aac1c24e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:42.436887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b0979d7-6a64-4310-be54-99c2aac1c24e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:42.444195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b0979d7-6a64-4310-be54-99c2aac1c24e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:42.445456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b0979d7-6a64-4310-be54-99c2aac1c24e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:42.447124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b0979d7-6a64-4310-be54-99c2aac1c24e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:42.593565 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b0979d7-6a64-4310-be54-99c2aac1c24e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action" status: 200 len: 14 microversion: 2.1 time: 0.240319 Aug 25 13:12:42.603438 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1819/3597] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:12:42 2022] POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action => generated 14 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 13:12:43.642797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6ad6fab3-c6ca-441a-a98a-8e120296c872 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:43.672297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6ad6fab3-c6ca-441a-a98a-8e120296c872 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:43.758273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=38 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:43.768586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad6fab3-c6ca-441a-a98a-8e120296c872 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:43.778156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad6fab3-c6ca-441a-a98a-8e120296c872 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:43.779680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad6fab3-c6ca-441a-a98a-8e120296c872 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:43.781307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad6fab3-c6ca-441a-a98a-8e120296c872 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:43.785715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad6fab3-c6ca-441a-a98a-8e120296c872 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:43.790033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ad6fab3-c6ca-441a-a98a-8e120296c872 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:43.814461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:44.010394 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6ad6fab3-c6ca-441a-a98a-8e120296c872 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action" status: 200 len: 14 microversion: 2.1 time: 0.393789 Aug 25 13:12:44.011955 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1779/3598] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:12:43 2022] POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action => generated 14 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 13:12:45.039004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0bb12d7d-bd98-4e1d-956b-829b407edacd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:45.051393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0bb12d7d-bd98-4e1d-956b-829b407edacd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:45.098125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bb12d7d-bd98-4e1d-956b-829b407edacd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:45.104861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bb12d7d-bd98-4e1d-956b-829b407edacd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:45.109119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bb12d7d-bd98-4e1d-956b-829b407edacd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:45.115203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bb12d7d-bd98-4e1d-956b-829b407edacd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:45.119628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bb12d7d-bd98-4e1d-956b-829b407edacd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:45.123881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bb12d7d-bd98-4e1d-956b-829b407edacd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:45.269922 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0bb12d7d-bd98-4e1d-956b-829b407edacd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action" status: 200 len: 14 microversion: 2.1 time: 0.242645 Aug 25 13:12:45.274700 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1820/3599] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:12:45 2022] POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action => generated 14 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:12:46.293182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8a0b6b9b-6d06-4bfe-8b58-22bfb746633a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:46.303744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8a0b6b9b-6d06-4bfe-8b58-22bfb746633a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:46.365418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a0b6b9b-6d06-4bfe-8b58-22bfb746633a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:46.373274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a0b6b9b-6d06-4bfe-8b58-22bfb746633a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:46.379280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a0b6b9b-6d06-4bfe-8b58-22bfb746633a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:46.381334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a0b6b9b-6d06-4bfe-8b58-22bfb746633a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:46.387557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a0b6b9b-6d06-4bfe-8b58-22bfb746633a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:46.393217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a0b6b9b-6d06-4bfe-8b58-22bfb746633a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:46.592865 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8a0b6b9b-6d06-4bfe-8b58-22bfb746633a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action" status: 200 len: 14 microversion: 2.1 time: 0.308165 Aug 25 13:12:46.598314 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1780/3600] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:12:46 2022] POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action => generated 14 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 13:12:47.621064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7cd27faf-ea3b-480c-af0a-42d8c52202df tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:47.635347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7cd27faf-ea3b-480c-af0a-42d8c52202df tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:47.695686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cd27faf-ea3b-480c-af0a-42d8c52202df tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:47.702862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cd27faf-ea3b-480c-af0a-42d8c52202df tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:47.712911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cd27faf-ea3b-480c-af0a-42d8c52202df tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:47.714674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cd27faf-ea3b-480c-af0a-42d8c52202df tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:47.716352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cd27faf-ea3b-480c-af0a-42d8c52202df tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:47.717401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cd27faf-ea3b-480c-af0a-42d8c52202df tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:47.886382 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7cd27faf-ea3b-480c-af0a-42d8c52202df tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action" status: 200 len: 14 microversion: 2.1 time: 0.275796 Aug 25 13:12:47.887993 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1821/3601] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:12:47 2022] POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action => generated 14 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:12:48.937403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19eb71c5-2dba-484b-927f-01a17ade2db0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:48.966967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-19eb71c5-2dba-484b-927f-01a17ade2db0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:49.029957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19eb71c5-2dba-484b-927f-01a17ade2db0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:49.036627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19eb71c5-2dba-484b-927f-01a17ade2db0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:49.046729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19eb71c5-2dba-484b-927f-01a17ade2db0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:49.049933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19eb71c5-2dba-484b-927f-01a17ade2db0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:49.056698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19eb71c5-2dba-484b-927f-01a17ade2db0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:49.058187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19eb71c5-2dba-484b-927f-01a17ade2db0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:49.295826 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19eb71c5-2dba-484b-927f-01a17ade2db0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action" status: 200 len: 14 microversion: 2.1 time: 0.395456 Aug 25 13:12:49.302395 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1781/3602] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:12:48 2022] POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action => generated 14 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:12:50.325974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ba2cd5bb-1ee4-4095-b245-d3a6b189ed9a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:50.340191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ba2cd5bb-1ee4-4095-b245-d3a6b189ed9a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:50.391431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba2cd5bb-1ee4-4095-b245-d3a6b189ed9a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:50.399926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba2cd5bb-1ee4-4095-b245-d3a6b189ed9a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:50.400995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba2cd5bb-1ee4-4095-b245-d3a6b189ed9a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:50.403485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba2cd5bb-1ee4-4095-b245-d3a6b189ed9a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:50.414854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba2cd5bb-1ee4-4095-b245-d3a6b189ed9a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:50.416950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba2cd5bb-1ee4-4095-b245-d3a6b189ed9a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:50.438940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:50.644077 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ba2cd5bb-1ee4-4095-b245-d3a6b189ed9a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action" status: 200 len: 14 microversion: 2.1 time: 0.331936 Aug 25 13:12:50.656874 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1822/3603] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:12:50 2022] POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action => generated 14 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:12:51.679501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-67b4bfcf-3e10-469b-bd09-fd1f4a4a6f81 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:51.693816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-67b4bfcf-3e10-469b-bd09-fd1f4a4a6f81 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:51.750691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b4bfcf-3e10-469b-bd09-fd1f4a4a6f81 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:51.753169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b4bfcf-3e10-469b-bd09-fd1f4a4a6f81 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:51.757663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b4bfcf-3e10-469b-bd09-fd1f4a4a6f81 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:51.778917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b4bfcf-3e10-469b-bd09-fd1f4a4a6f81 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:51.783703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b4bfcf-3e10-469b-bd09-fd1f4a4a6f81 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:51.789549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67b4bfcf-3e10-469b-bd09-fd1f4a4a6f81 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:52.025297 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-67b4bfcf-3e10-469b-bd09-fd1f4a4a6f81 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action" status: 200 len: 8208 microversion: 2.1 time: 0.362540 Aug 25 13:12:52.027339 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1782/3604] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:12:51 2022] POST /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2/action => generated 8208 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:52.064687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02cc6129-f727-4f6e-99c9-f71079381f2e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:52.068199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02cc6129-f727-4f6e-99c9-f71079381f2e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:52.119721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02cc6129-f727-4f6e-99c9-f71079381f2e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:52.122537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02cc6129-f727-4f6e-99c9-f71079381f2e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:52.126986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02cc6129-f727-4f6e-99c9-f71079381f2e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:52.132951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02cc6129-f727-4f6e-99c9-f71079381f2e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:52.137227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02cc6129-f727-4f6e-99c9-f71079381f2e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:52.138254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02cc6129-f727-4f6e-99c9-f71079381f2e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:54.343167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02cc6129-f727-4f6e-99c9-f71079381f2e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:54.381195 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02cc6129-f727-4f6e-99c9-f71079381f2e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.340055 Aug 25 13:12:54.382418 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1823/3605] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:52 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:54.446585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a0e7ce6a-acba-4e1e-8800-03362b50abd7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:54.473177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a0e7ce6a-acba-4e1e-8800-03362b50abd7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:54.515211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0e7ce6a-acba-4e1e-8800-03362b50abd7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:54.516625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0e7ce6a-acba-4e1e-8800-03362b50abd7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:54.517707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0e7ce6a-acba-4e1e-8800-03362b50abd7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:54.519150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0e7ce6a-acba-4e1e-8800-03362b50abd7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:54.525258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0e7ce6a-acba-4e1e-8800-03362b50abd7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:54.526678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0e7ce6a-acba-4e1e-8800-03362b50abd7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:55.827526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a0e7ce6a-acba-4e1e-8800-03362b50abd7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:55.902926 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a0e7ce6a-acba-4e1e-8800-03362b50abd7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.467141 Aug 25 13:12:55.904768 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1783/3606] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:54 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:55.974998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b084ba4b-e17a-4b38-8201-c36b9d4b5147 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:55.984548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b084ba4b-e17a-4b38-8201-c36b9d4b5147 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:56.020860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b084ba4b-e17a-4b38-8201-c36b9d4b5147 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:56.021174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b084ba4b-e17a-4b38-8201-c36b9d4b5147 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:56.022508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b084ba4b-e17a-4b38-8201-c36b9d4b5147 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:56.026836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b084ba4b-e17a-4b38-8201-c36b9d4b5147 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:56.040379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b084ba4b-e17a-4b38-8201-c36b9d4b5147 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:56.042999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b084ba4b-e17a-4b38-8201-c36b9d4b5147 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:56.314785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1575099836", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "eaa0e1cd-0707-403f-bb26-38f0aaabd34e"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:56.396707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=22 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:56.598611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] validate_networks() for [('eaa0e1cd-0707-403f-bb26-38f0aaabd34e', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:12:57.994876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b084ba4b-e17a-4b38-8201-c36b9d4b5147 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:58.024675 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b084ba4b-e17a-4b38-8201-c36b9d4b5147 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.058813 Aug 25 13:12:58.036396 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1784/3607] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:55 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:58.046834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2b6e2e2-f1c2-4ee8-86ef-e21b7f427706 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:58.064685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2b6e2e2-f1c2-4ee8-86ef-e21b7f427706 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:58.096806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b6e2e2-f1c2-4ee8-86ef-e21b7f427706 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:58.100597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b6e2e2-f1c2-4ee8-86ef-e21b7f427706 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:58.106360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b6e2e2-f1c2-4ee8-86ef-e21b7f427706 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:58.108513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b6e2e2-f1c2-4ee8-86ef-e21b7f427706 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:58.110040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b6e2e2-f1c2-4ee8-86ef-e21b7f427706 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:58.115848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b6e2e2-f1c2-4ee8-86ef-e21b7f427706 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:58.259344 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2b6e2e2-f1c2-4ee8-86ef-e21b7f427706 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.220356 Aug 25 13:12:58.269746 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1785/3608] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:12:58 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-volume_attachments => generated 25 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:12:58.290691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8a9c09e2-ac3c-448a-b0c5-925521718825 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:58.292655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8a9c09e2-ac3c-448a-b0c5-925521718825 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:58.314639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a9c09e2-ac3c-448a-b0c5-925521718825 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:58.321362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a9c09e2-ac3c-448a-b0c5-925521718825 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:58.328894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a9c09e2-ac3c-448a-b0c5-925521718825 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:58.332630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a9c09e2-ac3c-448a-b0c5-925521718825 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:58.334094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a9c09e2-ac3c-448a-b0c5-925521718825 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:58.336049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a9c09e2-ac3c-448a-b0c5-925521718825 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:59.392224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:12:59.396510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:12:59.399011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:12:59.400182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:12:59.405238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:12:59.456753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:59.458400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:59.461945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:59.467685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:59.469013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:59.472065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:59.532465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Getting quotas for project ed50639abe0441eeb560767783042d56. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:12:59.548533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Getting quotas for user ec8ffcf7b70e4318959163ddb52a2c12 and project ed50639abe0441eeb560767783042d56. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:12:59.619214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:12:59.634584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:12:59.806460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8a9c09e2-ac3c-448a-b0c5-925521718825 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:59.833399 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8a9c09e2-ac3c-448a-b0c5-925521718825 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.560912 Aug 25 13:12:59.840318 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1786/3609] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:58 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:59.854659 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2117a4ef-96db-4034-9081-b466c25c78fd tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.332580 Aug 25 13:12:59.856206 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1824/3610] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 13:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4337 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 25 13:12:59.897053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e85593d6-0974-43de-a44f-85548ce6c294 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:59.903242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e85593d6-0974-43de-a44f-85548ce6c294 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:59.905924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0fcd5468-cd7c-4557-8f54-a8c271db0e8a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:59.907326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0fcd5468-cd7c-4557-8f54-a8c271db0e8a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:59.938359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85593d6-0974-43de-a44f-85548ce6c294 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:59.944714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85593d6-0974-43de-a44f-85548ce6c294 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:59.956359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85593d6-0974-43de-a44f-85548ce6c294 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:59.958449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85593d6-0974-43de-a44f-85548ce6c294 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:59.962258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85593d6-0974-43de-a44f-85548ce6c294 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:59.964815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e85593d6-0974-43de-a44f-85548ce6c294 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:00.223266 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e85593d6-0974-43de-a44f-85548ce6c294 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.361604 Aug 25 13:13:00.225104 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1787/3611] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:12:59 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316/os-volume_attachments => generated 25 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:13:00.243229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-959409b4-4669-4884-84e8-04f55a747b4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:00.250158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-959409b4-4669-4884-84e8-04f55a747b4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:00.289991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-959409b4-4669-4884-84e8-04f55a747b4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:00.296671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-959409b4-4669-4884-84e8-04f55a747b4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:00.300247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-959409b4-4669-4884-84e8-04f55a747b4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:00.321338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-959409b4-4669-4884-84e8-04f55a747b4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:00.322416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-959409b4-4669-4884-84e8-04f55a747b4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:00.327032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-959409b4-4669-4884-84e8-04f55a747b4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:00.556969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-959409b4-4669-4884-84e8-04f55a747b4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Locking {{(pid=129059) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 25 13:13:00.749133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0fcd5468-cd7c-4557-8f54-a8c271db0e8a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:00.792177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0fcd5468-cd7c-4557-8f54-a8c271db0e8a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:00.797421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0fcd5468-cd7c-4557-8f54-a8c271db0e8a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:00.813779 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0fcd5468-cd7c-4557-8f54-a8c271db0e8a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1259 microversion: 2.21 time: 0.937169 Aug 25 13:13:00.818469 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1825/3612] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:59 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1259 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:00.855252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-770be2a5-feba-4af3-946c-76dc190a065b tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:00.859593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-770be2a5-feba-4af3-946c-76dc190a065b tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:00.863153 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-959409b4-4669-4884-84e8-04f55a747b4b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.633865 Aug 25 13:13:00.865944 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1788/3613] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:13:00 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:13:00.905049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f046eedb-73ab-432f-bb41-242cec9c8d36 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:00.907064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-770be2a5-feba-4af3-946c-76dc190a065b tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:00.914121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f046eedb-73ab-432f-bb41-242cec9c8d36 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:00.920124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-770be2a5-feba-4af3-946c-76dc190a065b tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:00.921423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-770be2a5-feba-4af3-946c-76dc190a065b tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:00.926199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-770be2a5-feba-4af3-946c-76dc190a065b tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:00.933632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-770be2a5-feba-4af3-946c-76dc190a065b tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:00.937270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-770be2a5-feba-4af3-946c-76dc190a065b tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:00.956030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f046eedb-73ab-432f-bb41-242cec9c8d36 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:00.970697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f046eedb-73ab-432f-bb41-242cec9c8d36 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:00.974630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f046eedb-73ab-432f-bb41-242cec9c8d36 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:00.976516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f046eedb-73ab-432f-bb41-242cec9c8d36 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:00.978682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f046eedb-73ab-432f-bb41-242cec9c8d36 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:00.981357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f046eedb-73ab-432f-bb41-242cec9c8d36 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:01.122527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-770be2a5-feba-4af3-946c-76dc190a065b tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:13:01.698266 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-770be2a5-feba-4af3-946c-76dc190a065b tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 204 len: 0 microversion: 2.1 time: 0.871155 Aug 25 13:13:01.700625 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1826/3614] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:13:00 2022] DELETE /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 0 bytes in 875 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:13:01.732758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-89f689f4-8d00-49ef-9e5e-2d92534637fa tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:01.734216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-89f689f4-8d00-49ef-9e5e-2d92534637fa tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:01.782482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89f689f4-8d00-49ef-9e5e-2d92534637fa tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:01.787126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89f689f4-8d00-49ef-9e5e-2d92534637fa tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:01.789491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89f689f4-8d00-49ef-9e5e-2d92534637fa tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:01.797026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89f689f4-8d00-49ef-9e5e-2d92534637fa tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:01.799835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89f689f4-8d00-49ef-9e5e-2d92534637fa tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:01.819413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89f689f4-8d00-49ef-9e5e-2d92534637fa tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:03.126740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f046eedb-73ab-432f-bb41-242cec9c8d36 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:03.162450 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f046eedb-73ab-432f-bb41-242cec9c8d36 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.289978 Aug 25 13:13:03.182314 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1789/3615] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:00 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:03.235645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:03.241580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:03.290927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:03.296312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:03.299724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:03.310976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:03.323786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:03.327882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:03.423407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-89f689f4-8d00-49ef-9e5e-2d92534637fa tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:03.525649 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-89f689f4-8d00-49ef-9e5e-2d92534637fa tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1681 microversion: 2.1 time: 1.811176 Aug 25 13:13:03.536982 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1827/3616] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:01 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1681 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:13:03.576868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a87e70b-0603-40ad-b896-5393587f74b4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:03.620037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a87e70b-0603-40ad-b896-5393587f74b4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:03.623543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a87e70b-0603-40ad-b896-5393587f74b4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:03.624869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a87e70b-0603-40ad-b896-5393587f74b4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:03.780664 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-7a87e70b-0603-40ad-b896-5393587f74b4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] HTTP exception thrown: Instance fe3eccca-1677-409a-bcf9-99d321525b2b is locked Aug 25 13:13:03.784109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a87e70b-0603-40ad-b896-5393587f74b4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Request method failure captured: Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action HTTP/1.1 Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 15 Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3Mr9cWgACYm-JJJ3jtHrhjTUF1SZTk5SfB-onmYg_dkoF9Umi4EcFGUk_Hxt1tkajZlvH92Le8pKZsZ_x3nzluflBOJ0M8UYE0mStiqoLa4TCWq76ZCTPEE_7qbDlcr456ZSpBTxR3-8SWamaTMIPsT_5mpLgXenA2keElRqYPMqBw Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8de71f9e1804c46ab8f18f48a5fff42", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}] Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-997153903 Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e320ccc6c0624541895fc42bf681da76 Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: {"os-stop": {}} Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance fe3eccca-1677-409a-bcf9-99d321525b2b is locked Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'fe3eccca-1677-409a-bcf9-99d321525b2b', 'body': {'os-stop': {}}} Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance fe3eccca-1677-409a-bcf9-99d321525b2b is locked Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance fe3eccca-1677-409a-bcf9-99d321525b2b is locked Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe3eccca-1677-409a-bcf9-99d321525b2b is locked Aug 25 13:13:03.792217 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:03.823069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a87e70b-0603-40ad-b896-5393587f74b4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Returning 409 to user: Instance fe3eccca-1677-409a-bcf9-99d321525b2b is locked {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:03.830216 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a87e70b-0603-40ad-b896-5393587f74b4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 409 len: 107 microversion: 2.1 time: 0.287930 Aug 25 13:13:03.833050 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1828/3617] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:13:03 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 107 bytes in 295 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:13:03.838669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:03.841167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:03.843583 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-10f3ecbe-6d6e-4d8e-b084-77a3ce01116b tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1311 microversion: 2.21 time: 0.647297 Aug 25 13:13:03.844484 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1790/3618] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:03 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1311 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:03.860987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c282c568-299e-4bab-92cc-87592b901f04 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:03.865194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c282c568-299e-4bab-92cc-87592b901f04 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:03.894331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c282c568-299e-4bab-92cc-87592b901f04 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:03.898300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c282c568-299e-4bab-92cc-87592b901f04 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:03.900695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c282c568-299e-4bab-92cc-87592b901f04 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:03.906515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c282c568-299e-4bab-92cc-87592b901f04 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:03.907498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c282c568-299e-4bab-92cc-87592b901f04 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:03.908304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c282c568-299e-4bab-92cc-87592b901f04 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:04.112415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c282c568-299e-4bab-92cc-87592b901f04 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Unlocking {{(pid=129060) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 25 13:13:04.348052 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c282c568-299e-4bab-92cc-87592b901f04 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.505759 Aug 25 13:13:04.349292 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1829/3619] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:13:03 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:13:04.376325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0f5bc9a-0a25-42a1-862f-f6565c317217 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:04.399471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0f5bc9a-0a25-42a1-862f-f6565c317217 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:04.400411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0f5bc9a-0a25-42a1-862f-f6565c317217 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:04.401253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0f5bc9a-0a25-42a1-862f-f6565c317217 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:04.505491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c0f5bc9a-0a25-42a1-862f-f6565c317217 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Going to try to stop instance {{(pid=129059) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:13:04.577586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ce9f7fc-35fc-4146-8ce4-a7a8347d0c56 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:04.581971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4ce9f7fc-35fc-4146-8ce4-a7a8347d0c56 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:04.634076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ce9f7fc-35fc-4146-8ce4-a7a8347d0c56 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:04.635043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ce9f7fc-35fc-4146-8ce4-a7a8347d0c56 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:04.636084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ce9f7fc-35fc-4146-8ce4-a7a8347d0c56 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:04.637240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ce9f7fc-35fc-4146-8ce4-a7a8347d0c56 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:04.655678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ce9f7fc-35fc-4146-8ce4-a7a8347d0c56 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:04.658166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ce9f7fc-35fc-4146-8ce4-a7a8347d0c56 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:04.803026 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0f5bc9a-0a25-42a1-862f-f6565c317217 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.424619 Aug 25 13:13:04.804178 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1791/3620] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:13:04 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:13:04.855816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f0990843-c96d-4929-9057-ab59b530bb84 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:04.870853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f0990843-c96d-4929-9057-ab59b530bb84 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:04.884046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0990843-c96d-4929-9057-ab59b530bb84 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:04.885626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0990843-c96d-4929-9057-ab59b530bb84 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:04.886930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0990843-c96d-4929-9057-ab59b530bb84 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:04.889102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0990843-c96d-4929-9057-ab59b530bb84 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:04.890538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0990843-c96d-4929-9057-ab59b530bb84 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:04.892849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0990843-c96d-4929-9057-ab59b530bb84 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:06.080457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f0990843-c96d-4929-9057-ab59b530bb84 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:06.106883 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f0990843-c96d-4929-9057-ab59b530bb84 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 1.282731 Aug 25 13:13:06.108534 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1792/3621] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:04 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:06.127529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:06.129168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:06.160915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:06.163060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:06.163971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:06.165431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:06.166422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:06.167118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:06.244782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:06.489091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4ce9f7fc-35fc-4146-8ce4-a7a8347d0c56 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:06.527604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:06.542954 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ce9f7fc-35fc-4146-8ce4-a7a8347d0c56 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1681 microversion: 2.1 time: 1.974337 Aug 25 13:13:06.544070 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1830/3622] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:04 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1681 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:13:06.574828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:06.591925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:06.596118 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-401418e8-b6d5-4938-bad9-715cad085720 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1317 microversion: 2.21 time: 0.484814 Aug 25 13:13:06.599017 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1793/3623] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:06 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:07.165572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-904b3cf4-c282-4561-866f-cad97279b1b0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:07.167051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-904b3cf4-c282-4561-866f-cad97279b1b0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:07.197374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-904b3cf4-c282-4561-866f-cad97279b1b0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:07.207316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-904b3cf4-c282-4561-866f-cad97279b1b0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:07.208222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-904b3cf4-c282-4561-866f-cad97279b1b0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:07.209655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-904b3cf4-c282-4561-866f-cad97279b1b0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:07.210653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-904b3cf4-c282-4561-866f-cad97279b1b0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:07.211306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-904b3cf4-c282-4561-866f-cad97279b1b0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:07.326272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ddcd148e-0e68-4252-b309-be21d162b50b req-ba4fb89e-7503-4762-b6a2-5f6cc5e5b88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a51c80a-6c87-4026-9025-4630451ff316", "name": "network-vif-unplugged", "status": "completed", "tag": "293e697b-408f-4624-b636-1dbb45a2380c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:07.363562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ddcd148e-0e68-4252-b309-be21d162b50b req-ba4fb89e-7503-4762-b6a2-5f6cc5e5b88f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:07.365132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ddcd148e-0e68-4252-b309-be21d162b50b req-ba4fb89e-7503-4762-b6a2-5f6cc5e5b88f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:07.366205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ddcd148e-0e68-4252-b309-be21d162b50b req-ba4fb89e-7503-4762-b6a2-5f6cc5e5b88f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:07.401689 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ddcd148e-0e68-4252-b309-be21d162b50b req-ba4fb89e-7503-4762-b6a2-5f6cc5e5b88f service nova] Creating event network-vif-unplugged:293e697b-408f-4624-b636-1dbb45a2380c for instance 9a51c80a-6c87-4026-9025-4630451ff316 on n-h2-852771-8 Aug 25 13:13:07.411745 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ddcd148e-0e68-4252-b309-be21d162b50b req-ba4fb89e-7503-4762-b6a2-5f6cc5e5b88f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093643 Aug 25 13:13:07.414222 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1794/3624] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:07.595986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-66ead9ea-7912-4e29-8c13-3591a3330a39 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:07.604267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-66ead9ea-7912-4e29-8c13-3591a3330a39 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:07.658192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66ead9ea-7912-4e29-8c13-3591a3330a39 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:07.661903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66ead9ea-7912-4e29-8c13-3591a3330a39 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:07.663223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66ead9ea-7912-4e29-8c13-3591a3330a39 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:07.667240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66ead9ea-7912-4e29-8c13-3591a3330a39 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:07.716549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66ead9ea-7912-4e29-8c13-3591a3330a39 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:07.719471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66ead9ea-7912-4e29-8c13-3591a3330a39 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:08.115691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-904b3cf4-c282-4561-866f-cad97279b1b0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:08.196265 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-904b3cf4-c282-4561-866f-cad97279b1b0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 1.036727 Aug 25 13:13:08.218571 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1831/3625] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:07 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:08.264363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:08.268381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:08.308167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:08.312379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:08.320029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:08.322470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:08.324704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:08.326149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:08.709382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:08.729073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-66ead9ea-7912-4e29-8c13-3591a3330a39 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:08.749454 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-66ead9ea-7912-4e29-8c13-3591a3330a39 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1681 microversion: 2.1 time: 1.163169 Aug 25 13:13:08.760232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:08.764483 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1795/3626] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:07 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1681 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:13:08.781957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:08.781957 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0f492c1b-3b2e-4b73-9f58-ac4fd9752fcc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1317 microversion: 2.21 time: 0.558816 Aug 25 13:13:08.801546 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1832/3627] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:08 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:09.287434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-096fb18a-c9ba-4582-bfcb-bdee0803a86f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:09.303689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-096fb18a-c9ba-4582-bfcb-bdee0803a86f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:09.354817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-096fb18a-c9ba-4582-bfcb-bdee0803a86f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:09.358016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-096fb18a-c9ba-4582-bfcb-bdee0803a86f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:09.363267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-096fb18a-c9ba-4582-bfcb-bdee0803a86f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:09.368038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-096fb18a-c9ba-4582-bfcb-bdee0803a86f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:09.382127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-096fb18a-c9ba-4582-bfcb-bdee0803a86f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:09.384070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-096fb18a-c9ba-4582-bfcb-bdee0803a86f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:09.483561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1503493094", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": "none"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:09.516363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:09.667615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:13:09.668369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:13:09.669282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:13:09.695227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:13:09.696124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:13:09.729830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:09.732444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:09.735440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:09.738590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:09.739834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:09.740882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:09.783556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Getting quotas for project 497c528bbe1742539fdb67bf89bfa217. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:13:09.823634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Getting quotas for user cca5bce92e65489b8612d870b86057c6 and project 497c528bbe1742539fdb67bf89bfa217. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:13:09.884136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:13:09.914724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:13:10.157047 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87b31f11-76aa-40a7-9176-e5ead3d6ce3b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.242116 Aug 25 13:13:10.163659 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1796/3628] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 13:13:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1251 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:13:10.185931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-092ea198-d857-4779-bf60-a088fbf1c984 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:10.195306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-092ea198-d857-4779-bf60-a088fbf1c984 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:10.223617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-092ea198-d857-4779-bf60-a088fbf1c984 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:10.231373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-092ea198-d857-4779-bf60-a088fbf1c984 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:10.233095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-092ea198-d857-4779-bf60-a088fbf1c984 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:10.235074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-092ea198-d857-4779-bf60-a088fbf1c984 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:10.236280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-092ea198-d857-4779-bf60-a088fbf1c984 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:10.241569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-092ea198-d857-4779-bf60-a088fbf1c984 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:10.632383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-096fb18a-c9ba-4582-bfcb-bdee0803a86f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:10.677902 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-096fb18a-c9ba-4582-bfcb-bdee0803a86f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 1.417484 Aug 25 13:13:10.680711 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1833/3629] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:09 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:10.739949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:10.741290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:10.764502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:10.809328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:10.810592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:10.811539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:10.812840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:10.814352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:10.815706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:10.853853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-092ea198-d857-4779-bf60-a088fbf1c984 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:10.900502 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-092ea198-d857-4779-bf60-a088fbf1c984 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1614 microversion: 2.1 time: 0.734315 Aug 25 13:13:10.922927 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1797/3630] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:10 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1614 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:10.952926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0ddf32bc-270f-4358-bdbd-a09fdbe0a606 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:10.968902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ddf32bc-270f-4358-bdbd-a09fdbe0a606 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:12.413409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ddf32bc-270f-4358-bdbd-a09fdbe0a606 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:12.432990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ddf32bc-270f-4358-bdbd-a09fdbe0a606 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:12.436749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ddf32bc-270f-4358-bdbd-a09fdbe0a606 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:12.440124 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0ddf32bc-270f-4358-bdbd-a09fdbe0a606 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1278 microversion: 2.54 time: 1.514970 Aug 25 13:13:12.445764 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1798/3631] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:10 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1278 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:12.465298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c63e5d55-c7a9-4d19-a5b0-d1b94e2be478 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:12.471303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c63e5d55-c7a9-4d19-a5b0-d1b94e2be478 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:12.493942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c63e5d55-c7a9-4d19-a5b0-d1b94e2be478 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:12.503050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c63e5d55-c7a9-4d19-a5b0-d1b94e2be478 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:12.504478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c63e5d55-c7a9-4d19-a5b0-d1b94e2be478 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:12.505813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c63e5d55-c7a9-4d19-a5b0-d1b94e2be478 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:12.511588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c63e5d55-c7a9-4d19-a5b0-d1b94e2be478 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:12.512625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c63e5d55-c7a9-4d19-a5b0-d1b94e2be478 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:13.530153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:13.602646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:13.622543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:13.632751 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-839db082-6d26-4f18-bf59-ded2321e4a96 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1359 microversion: 2.21 time: 2.947132 Aug 25 13:13:13.634554 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1834/3632] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:10 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1359 bytes in 2953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:13.656473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:13.658043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:13.688226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:13.692579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:13.696617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:13.698706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:13.705080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:13.707385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:13.882705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:13.885699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:13.895752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:13.898041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lazy-loading 'fault' on Instance uuid 9a51c80a-6c87-4026-9025-4630451ff316 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:13:14.199805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c63e5d55-c7a9-4d19-a5b0-d1b94e2be478 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:14.205904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8531c673eba41deac6429590dd70a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafd8cfabac543a6b7377b7cd451c693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:14.224489 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c63e5d55-c7a9-4d19-a5b0-d1b94e2be478 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 1.776747 Aug 25 13:13:14.239556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1799/3633] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:12 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:14.247175 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-238071e9-0775-49b2-9d73-9bb68742c6a0 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 200 len: 1332 microversion: 2.1 time: 0.605148 Aug 25 13:13:14.248352 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1835/3634] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:13 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 1332 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:14.275407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d8aaafe1-f499-4777-b177-f5363eb2864d req-10ef488a-353f-4c92-a302-23ff3a17dc46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a51c80a-6c87-4026-9025-4630451ff316", "name": "network-vif-deleted", "tag": "293e697b-408f-4624-b636-1dbb45a2380c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:14.286914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:14.288092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:14.308723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:14.329963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:14.331097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:14.334577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:14.337388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d8aaafe1-f499-4777-b177-f5363eb2864d req-10ef488a-353f-4c92-a302-23ff3a17dc46 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:14.340245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:14.342589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d8aaafe1-f499-4777-b177-f5363eb2864d req-10ef488a-353f-4c92-a302-23ff3a17dc46 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:14.344503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:14.345186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:14.347090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d8aaafe1-f499-4777-b177-f5363eb2864d req-10ef488a-353f-4c92-a302-23ff3a17dc46 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:14.416862 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d8aaafe1-f499-4777-b177-f5363eb2864d req-10ef488a-353f-4c92-a302-23ff3a17dc46 service nova] Creating event network-vif-deleted:293e697b-408f-4624-b636-1dbb45a2380c for instance 9a51c80a-6c87-4026-9025-4630451ff316 on n-h2-852771-8 Aug 25 13:13:14.427548 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d8aaafe1-f499-4777-b177-f5363eb2864d req-10ef488a-353f-4c92-a302-23ff3a17dc46 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180587 Aug 25 13:13:14.430195 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1800/3635] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:14.466134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:14.709887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:14.712470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:14.743076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:14.750187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:14.751462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:14.752750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:14.758594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:14.759939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:14.789613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:14.842244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:14.853059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:14.860124 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-78d0e6ec-2b73-481e-ab69-928072196275 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1336 microversion: 2.54 time: 0.602110 Aug 25 13:13:14.866461 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1836/3636] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:14 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1336 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:15.289820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-884146d3-1601-4562-b6b0-349bff28ed2c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:15.291009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-884146d3-1601-4562-b6b0-349bff28ed2c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:15.341363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-884146d3-1601-4562-b6b0-349bff28ed2c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:15.345109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-884146d3-1601-4562-b6b0-349bff28ed2c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:15.346598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-884146d3-1601-4562-b6b0-349bff28ed2c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:15.350988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-884146d3-1601-4562-b6b0-349bff28ed2c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:15.357999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-884146d3-1601-4562-b6b0-349bff28ed2c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:15.362982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-884146d3-1601-4562-b6b0-349bff28ed2c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:15.666599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:15.738680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:15.754084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:15.766050 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb206ce6-2e2f-4b0c-854b-b9eff12eb86c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1359 microversion: 2.21 time: 1.076775 Aug 25 13:13:15.777059 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1801/3637] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:14 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1359 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:13:15.799678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:15.806607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:15.830261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:15.831146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:15.832947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:15.834395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:15.835271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:15.841985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:15.907996 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] HTTP exception thrown: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Request method failure captured: Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 HTTP/1.1 Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3QwCHOsaB6PwQ6FEx3Nik_pV-I9rFnyzAb6scawCD5tCbdg9RkAFiqjHR8cGt7ftj2LCIM2e9LUm1PvNyVqb86ucbxfszbns81WVKpWEs_PvkJs8G6SBmIH7AYj4Wi2eZHmUi5gKO7stfiOqdYtzj2p1e9IzEZuVrZimP1-zNFIQ2Y Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: bafd8cfabac543a6b7377b7cd451c693 Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1622263850 Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bafd8cfabac543a6b7377b7cd451c693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bafd8cfabac543a6b7377b7cd451c693", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bafd8cfabac543a6b7377b7cd451c693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bafd8cfabac543a6b7377b7cd451c693"}]}] Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1622263850 Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: bafd8cfabac543a6b7377b7cd451c693 Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1622263850 Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachSCSIVolumeTestJSON-1622263850-project Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e8531c673eba41deac6429590dd70a6f Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1622263850-project Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '9a51c80a-6c87-4026-9025-4630451ff316'} Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:15.916375 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:15.925174 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:15.925174 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:15.925174 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:15.925174 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:15.925174 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:15.925174 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:15.925174 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:15.925174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Returning 404 to user: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:15.925174 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8a298bf5-c621-4da5-99eb-7936290f9c2c tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 404 len: 111 microversion: 2.1 time: 0.143600 Aug 25 13:13:15.934215 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1802/3638] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:15 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:13:15.945974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:15.947958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:15.963875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:15.964772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:15.965904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:15.974169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:15.975219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:15.976083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:16.357157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:16.398610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:16.412008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:16.414539 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8fd8ce0b-e80a-4050-afd0-2e82290efda7 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1336 microversion: 2.54 time: 0.477282 Aug 25 13:13:16.415631 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1803/3639] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:15 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1336 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:16.452475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4f07d4a7-5e14-438a-a5b3-d0b10913a81d tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '.version_select at 0x7f3a2e774dc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:16.481835 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f07d4a7-5e14-438a-a5b3-d0b10913a81d tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:13:16.595460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-884146d3-1601-4562-b6b0-349bff28ed2c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:16.641269 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-884146d3-1601-4562-b6b0-349bff28ed2c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 1.360940 Aug 25 13:13:16.682269 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1837/3640] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:15 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:16.709772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-09de4eba-232e-4717-a47c-8e29e0e04f31 req-32e7cf64-0889-4bd3-9dc0-85e76f58b8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b14a1b53-7a3f-4980-b855-03ba584cc997", "tag": "3c38fd78-50ab-4299-86a9-2b89e8bfd528"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:16.730994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-09de4eba-232e-4717-a47c-8e29e0e04f31 req-32e7cf64-0889-4bd3-9dc0-85e76f58b8a0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:16.731981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-09de4eba-232e-4717-a47c-8e29e0e04f31 req-32e7cf64-0889-4bd3-9dc0-85e76f58b8a0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:16.732958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-09de4eba-232e-4717-a47c-8e29e0e04f31 req-32e7cf64-0889-4bd3-9dc0-85e76f58b8a0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:16.761258 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-09de4eba-232e-4717-a47c-8e29e0e04f31 req-32e7cf64-0889-4bd3-9dc0-85e76f58b8a0 service nova] Creating event network-changed:3c38fd78-50ab-4299-86a9-2b89e8bfd528 for instance b14a1b53-7a3f-4980-b855-03ba584cc997 on n-h1-852771-8 Aug 25 13:13:16.773160 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-09de4eba-232e-4717-a47c-8e29e0e04f31 req-32e7cf64-0889-4bd3-9dc0-85e76f58b8a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088247 Aug 25 13:13:16.775120 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1838/3641] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:16.828147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:16.831745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:16.850417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:16.853205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:16.855306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:16.857218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:16.858727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:16.860185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:17.393037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:17.418103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:17.422610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:17.426135 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b4f35dfd-a10e-4ff4-add4-e2bd1be876c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1359 microversion: 2.21 time: 0.606206 Aug 25 13:13:17.428930 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1839/3642] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:16 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1359 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:17.499866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:17.502026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:17.512990 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [None req-4f07d4a7-5e14-438a-a5b3-d0b10913a81d tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 42380. Aug 25 13:13:17.533845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:17.535784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:17.541381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:17.545478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:17.546857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:17.549834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:17.589608 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4f07d4a7-5e14-438a-a5b3-d0b10913a81d tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057297451" status: 202 len: 0 microversion: 2.1 time: 1.162446 Aug 25 13:13:17.591221 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1804/3643] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 13:13:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057297451 => generated 0 bytes in 1168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:13:17.717354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00553365-115b-4662-9be2-0f5b37f0f6d9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:17.719077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-00553365-115b-4662-9be2-0f5b37f0f6d9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:17.734177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00553365-115b-4662-9be2-0f5b37f0f6d9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:17.736375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00553365-115b-4662-9be2-0f5b37f0f6d9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:17.737350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:17.739889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00553365-115b-4662-9be2-0f5b37f0f6d9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:17.741897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00553365-115b-4662-9be2-0f5b37f0f6d9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:17.743196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00553365-115b-4662-9be2-0f5b37f0f6d9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:17.744506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00553365-115b-4662-9be2-0f5b37f0f6d9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:17.759916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:17.764553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:17.767999 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-838df072-2896-4aa9-b525-708310714693 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1336 microversion: 2.54 time: 0.300441 Aug 25 13:13:17.771145 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1840/3644] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:17 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1336 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:18.282935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-00553365-115b-4662-9be2-0f5b37f0f6d9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:18.315649 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-00553365-115b-4662-9be2-0f5b37f0f6d9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1654 microversion: 2.1 time: 0.605571 Aug 25 13:13:18.317312 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1805/3645] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:17 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1654 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:13:18.363984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-67f6199b-4902-4857-88ef-1375e61c24ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:18.381199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67f6199b-4902-4857-88ef-1375e61c24ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:18.382650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67f6199b-4902-4857-88ef-1375e61c24ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:18.384172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67f6199b-4902-4857-88ef-1375e61c24ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:18.451094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-67f6199b-4902-4857-88ef-1375e61c24ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Going to try to start instance {{(pid=129060) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 13:13:18.492292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:18.499470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:18.554457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:18.555477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:18.566911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:18.571646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:18.577559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:18.580030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:18.608196 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-67f6199b-4902-4857-88ef-1375e61c24ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.253713 Aug 25 13:13:18.612262 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1841/3646] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:13:18 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:13:18.626152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c009dbc1-3f63-4a98-a91b-8721caa41733 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:18.627873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c009dbc1-3f63-4a98-a91b-8721caa41733 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:18.669026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c009dbc1-3f63-4a98-a91b-8721caa41733 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:18.670122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c009dbc1-3f63-4a98-a91b-8721caa41733 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:18.671115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c009dbc1-3f63-4a98-a91b-8721caa41733 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:18.672647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c009dbc1-3f63-4a98-a91b-8721caa41733 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:18.673577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c009dbc1-3f63-4a98-a91b-8721caa41733 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:18.674392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c009dbc1-3f63-4a98-a91b-8721caa41733 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:19.537266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.560484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.570568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.573031 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-54318796-b6c0-4d55-9788-f63e519885c4 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1359 microversion: 2.21 time: 1.093380 Aug 25 13:13:19.575170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c009dbc1-3f63-4a98-a91b-8721caa41733 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.577343 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1806/3647] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:18 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1359 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:13:19.588021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:19.588947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:19.603714 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c009dbc1-3f63-4a98-a91b-8721caa41733 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1663 microversion: 2.1 time: 0.986840 Aug 25 13:13:19.620952 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1842/3648] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:18 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1663 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:19.626267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:19.627413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:19.629071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:19.637127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:19.639355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:19.641954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:19.774900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:19.961322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.980466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.984647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.987685 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89d358ce-0c77-4c38-b0f7-be973035d5e0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1357 microversion: 2.54 time: 0.408291 Aug 25 13:13:19.989762 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1807/3649] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:19 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1357 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:20.056072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce8bc7ac-164f-465b-a80c-8dc556ea607a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Action: 'create', calling method: .version_select at 0x7f3a2990a5e0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1757057110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn7eCAS2Ta4CO4csz/bM+lN3iAiVbQ7kKQ7m9RFPPPfI2RHoKVXmUHxukd4S/nMtAMk05pYhq33uAeVYVr+WzuI75CX/winJssNHlRwyj9d0MHKewoNBkIijPNqy4K/AA=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:20.095891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ce8bc7ac-164f-465b-a80c-8dc556ea607a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Getting quotas for project 497c528bbe1742539fdb67bf89bfa217. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:13:20.113033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ce8bc7ac-164f-465b-a80c-8dc556ea607a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Getting quotas for user cca5bce92e65489b8612d870b86057c6 and project 497c528bbe1742539fdb67bf89bfa217. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:13:20.157853 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ce8bc7ac-164f-465b-a80c-8dc556ea607a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:13:20.637761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:20.658117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:20.716842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:20.721216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:20.723590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:20.725224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:20.729615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:20.731152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:21.181206 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [None req-ce8bc7ac-164f-465b-a80c-8dc556ea607a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 42430. Aug 25 13:13:21.260639 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce8bc7ac-164f-465b-a80c-8dc556ea607a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 1.217589 Aug 25 13:13:21.273775 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1843/3650] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Aug 25 13:13:20 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 1231 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 13:13:21.289089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-26e0d7b6-6c01-4b26-8150-34a975f63bce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:21.291290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-26e0d7b6-6c01-4b26-8150-34a975f63bce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:21.313413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e0d7b6-6c01-4b26-8150-34a975f63bce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:21.316311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e0d7b6-6c01-4b26-8150-34a975f63bce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:21.317707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e0d7b6-6c01-4b26-8150-34a975f63bce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:21.320170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e0d7b6-6c01-4b26-8150-34a975f63bce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:21.322378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e0d7b6-6c01-4b26-8150-34a975f63bce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:21.325044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-26e0d7b6-6c01-4b26-8150-34a975f63bce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:21.329365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:21.384572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:21.388213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:21.399557 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-54159675-e727-40db-b189-b23d3701138a tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1359 microversion: 2.21 time: 0.770513 Aug 25 13:13:21.403884 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1808/3651] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:20 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1359 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:13:21.447952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1757057110", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:21.463710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:21.492353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:21.496676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:21.498257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:21.505674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:21.507379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:21.508346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:22.041771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-26e0d7b6-6c01-4b26-8150-34a975f63bce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:22.055529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:13:22.062251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:13:22.084683 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-26e0d7b6-6c01-4b26-8150-34a975f63bce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1663 microversion: 2.1 time: 0.799675 Aug 25 13:13:22.087959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:13:22.091176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:13:22.094415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:13:22.094948 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1844/3652] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:21 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1663 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:22.158606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:22.160141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:22.186258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:22.188803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:22.190338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:22.194287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:22.197058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:22.199505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:22.463600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:22.562113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:22.605738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:22.611577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:22.615712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:22.620978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:22.628056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:22.630440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:22.778113 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-491d22cc-04f2-48aa-b321-c0e5b0e57690 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "POST /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10/action" status: 202 len: 1140 microversion: 2.54 time: 1.371746 Aug 25 13:13:22.780746 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1809/3653] 10.222.0.70 () {62 vars in 1320 bytes} [Thu Aug 25 13:13:21 2022] POST /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10/action => generated 1140 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 25 13:13:22.814642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:22.822172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:22.855868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:22.859275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:22.868199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:22.870336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:22.872120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:22.874761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:23.309944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:23.356923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:23.381995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:23.388449 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e12009cf-f006-43bd-99c8-2fba79285147 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 2949 microversion: 2.32 time: 1.274698 Aug 25 13:13:23.416660 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1845/3654] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:22 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 2949 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:23.468240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:23.469244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:23.528504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:23.536059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:23.541847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:23.549175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:23.552487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:23.553919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:23.982874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:24.026802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:24.037881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:24.046008 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0ab66603-21d5-415a-9543-95e50a28400b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.621693 Aug 25 13:13:24.052902 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1846/3655] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:23 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:24.071057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06b61f51-aa8b-4ae7-8c9a-b6423ccdc606 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:24.077755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-06b61f51-aa8b-4ae7-8c9a-b6423ccdc606 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:24.108177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06b61f51-aa8b-4ae7-8c9a-b6423ccdc606 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:24.109048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06b61f51-aa8b-4ae7-8c9a-b6423ccdc606 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:24.109866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06b61f51-aa8b-4ae7-8c9a-b6423ccdc606 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:24.115122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06b61f51-aa8b-4ae7-8c9a-b6423ccdc606 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:24.116012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06b61f51-aa8b-4ae7-8c9a-b6423ccdc606 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:24.116545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06b61f51-aa8b-4ae7-8c9a-b6423ccdc606 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:24.842258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:24.885106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:24.904759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:24.907116 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2ffc56e6-299b-4d5d-81c2-6b1a9c41fabf tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1359 microversion: 2.21 time: 2.123959 Aug 25 13:13:24.911989 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1810/3656] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:22 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1359 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:24.931449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dc3e435d-9699-41c8-9f73-9a4fecd0a672 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:24.935246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dc3e435d-9699-41c8-9f73-9a4fecd0a672 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:24.989879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3e435d-9699-41c8-9f73-9a4fecd0a672 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:24.991115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3e435d-9699-41c8-9f73-9a4fecd0a672 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:24.994165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3e435d-9699-41c8-9f73-9a4fecd0a672 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:24.997750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3e435d-9699-41c8-9f73-9a4fecd0a672 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:25.000331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3e435d-9699-41c8-9f73-9a4fecd0a672 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:25.015493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc3e435d-9699-41c8-9f73-9a4fecd0a672 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:26.224173 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dc3e435d-9699-41c8-9f73-9a4fecd0a672 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041/os-interface" status: 200 len: 1830 microversion: 2.32 time: 1.309493 Aug 25 13:13:26.227251 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1811/3657] 10.222.0.70 () {60 vars in 1316 bytes} [Thu Aug 25 13:13:24 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041/os-interface => generated 1830 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:26.245636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:26.252482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:26.284050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:26.285656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:26.286740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:26.288337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:26.289609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:26.291132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:26.386566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-06b61f51-aa8b-4ae7-8c9a-b6423ccdc606 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:26.412458 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-06b61f51-aa8b-4ae7-8c9a-b6423ccdc606 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.357328 Aug 25 13:13:26.414438 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1847/3658] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:24 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:26.427086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:26.429189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:26.460099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:26.461898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:26.463085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:26.465138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:26.471144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:26.472484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:27.103280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:27.116850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:27.162726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:27.170215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:27.177395 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-88b9a734-32db-4791-bb5d-54fefa7c9513 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.943641 Aug 25 13:13:27.179123 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1812/3659] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:26 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:27.200209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c2f10cb-15d8-4ff6-b6a9-9457977d56c6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:27.206016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0c2f10cb-15d8-4ff6-b6a9-9457977d56c6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:27.255309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c2f10cb-15d8-4ff6-b6a9-9457977d56c6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:27.258748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c2f10cb-15d8-4ff6-b6a9-9457977d56c6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:27.261159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c2f10cb-15d8-4ff6-b6a9-9457977d56c6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:27.263451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c2f10cb-15d8-4ff6-b6a9-9457977d56c6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:27.265260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c2f10cb-15d8-4ff6-b6a9-9457977d56c6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:27.266533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c2f10cb-15d8-4ff6-b6a9-9457977d56c6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:28.055266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0c2f10cb-15d8-4ff6-b6a9-9457977d56c6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:28.087408 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0c2f10cb-15d8-4ff6-b6a9-9457977d56c6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.904148 Aug 25 13:13:28.093139 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1813/3660] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:27 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:28.148013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-33d0be5f-5f01-44b5-ba2b-77e6c1c4bd19 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:28.155760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-33d0be5f-5f01-44b5-ba2b-77e6c1c4bd19 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:28.187161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d0be5f-5f01-44b5-ba2b-77e6c1c4bd19 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:28.191685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d0be5f-5f01-44b5-ba2b-77e6c1c4bd19 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:28.196363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d0be5f-5f01-44b5-ba2b-77e6c1c4bd19 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:28.204193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d0be5f-5f01-44b5-ba2b-77e6c1c4bd19 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:28.207666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d0be5f-5f01-44b5-ba2b-77e6c1c4bd19 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:28.211045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d0be5f-5f01-44b5-ba2b-77e6c1c4bd19 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:28.492236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-33d0be5f-5f01-44b5-ba2b-77e6c1c4bd19 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Unlocking {{(pid=129059) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 25 13:13:28.823094 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-33d0be5f-5f01-44b5-ba2b-77e6c1c4bd19 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.682360 Aug 25 13:13:28.825062 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1814/3661] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:13:28 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:13:28.856393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:28.861404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:28.899245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:28.902116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:28.902998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:28.909448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:28.910611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:28.911444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:28.911755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:28.948145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:28.968531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:28.994840 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-199a571c-fba5-4774-8d94-ed1a31ed4f7c tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1359 microversion: 2.21 time: 2.571088 Aug 25 13:13:29.000891 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1848/3662] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:26 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1359 bytes in 2585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:29.034423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66056b81-7650-4946-95d3-b64311bc7f2a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:29.037806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66056b81-7650-4946-95d3-b64311bc7f2a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:29.048987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:29.064006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66056b81-7650-4946-95d3-b64311bc7f2a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:29.077091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66056b81-7650-4946-95d3-b64311bc7f2a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:29.078984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66056b81-7650-4946-95d3-b64311bc7f2a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:29.081016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66056b81-7650-4946-95d3-b64311bc7f2a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:29.083023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66056b81-7650-4946-95d3-b64311bc7f2a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:29.084428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66056b81-7650-4946-95d3-b64311bc7f2a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:29.648411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:29.753027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:29.767089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:29.782164 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4282b1f8-8c9e-4b04-be53-d93b890344a0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.948951 Aug 25 13:13:29.790729 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1815/3663] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:28 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:29.808347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3a26a248-01dc-49c8-94fd-52f5fa1cbb33 req-94a4b500-71d9-4c00-b4e6-99b44a96bbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b14a1b53-7a3f-4980-b855-03ba584cc997", "name": "network-vif-plugged", "status": "completed", "tag": "3c38fd78-50ab-4299-86a9-2b89e8bfd528"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:29.897259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3a26a248-01dc-49c8-94fd-52f5fa1cbb33 req-94a4b500-71d9-4c00-b4e6-99b44a96bbf6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:29.899476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3a26a248-01dc-49c8-94fd-52f5fa1cbb33 req-94a4b500-71d9-4c00-b4e6-99b44a96bbf6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:29.905286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3a26a248-01dc-49c8-94fd-52f5fa1cbb33 req-94a4b500-71d9-4c00-b4e6-99b44a96bbf6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:29.961109 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3a26a248-01dc-49c8-94fd-52f5fa1cbb33 req-94a4b500-71d9-4c00-b4e6-99b44a96bbf6 service nova] Creating event network-vif-plugged:3c38fd78-50ab-4299-86a9-2b89e8bfd528 for instance b14a1b53-7a3f-4980-b855-03ba584cc997 on n-h1-852771-8 Aug 25 13:13:30.002448 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3a26a248-01dc-49c8-94fd-52f5fa1cbb33 req-94a4b500-71d9-4c00-b4e6-99b44a96bbf6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205278 Aug 25 13:13:30.003846 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1816/3664] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:30.055728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:30.078039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:30.115261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:30.118284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:30.119672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:30.124718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:30.129227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:30.130905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:30.133232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:30.779856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-66056b81-7650-4946-95d3-b64311bc7f2a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:30.832862 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66056b81-7650-4946-95d3-b64311bc7f2a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.826388 Aug 25 13:13:30.841847 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1849/3665] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:29 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:30.858604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:30.871680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:30.906128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:30.913778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:30.916428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:30.918367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:30.924531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:30.934977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:31.359697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:31.390885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:31.402877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:31.408672 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-be6bab78-b9f2-4f32-8f46-0f67b5e69a97 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.561183 Aug 25 13:13:31.413113 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1850/3666] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:30 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:31.435926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-038c3e74-ca69-43da-96f1-41f6f91d23e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:31.445120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-038c3e74-ca69-43da-96f1-41f6f91d23e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:31.476054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-038c3e74-ca69-43da-96f1-41f6f91d23e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:31.476986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-038c3e74-ca69-43da-96f1-41f6f91d23e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:31.477857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-038c3e74-ca69-43da-96f1-41f6f91d23e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:31.479230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-038c3e74-ca69-43da-96f1-41f6f91d23e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:31.489579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-038c3e74-ca69-43da-96f1-41f6f91d23e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:31.490733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-038c3e74-ca69-43da-96f1-41f6f91d23e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:31.557962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:31.587575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:31.592043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:31.594891 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-39b89655-f440-4318-8835-a5931ee45ce7 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1359 microversion: 2.21 time: 1.549547 Aug 25 13:13:31.601658 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1817/3667] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:30 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1359 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:13:32.361298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-038c3e74-ca69-43da-96f1-41f6f91d23e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:32.383979 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-038c3e74-ca69-43da-96f1-41f6f91d23e1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.968249 Aug 25 13:13:32.385384 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1851/3668] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:31 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:32.434989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-422fb27b-d250-4405-ac14-17598fc0dff6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:32.439078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-422fb27b-d250-4405-ac14-17598fc0dff6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:32.472948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:32.477296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:32.492271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-422fb27b-d250-4405-ac14-17598fc0dff6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:32.493106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-422fb27b-d250-4405-ac14-17598fc0dff6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:32.493990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-422fb27b-d250-4405-ac14-17598fc0dff6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:32.501435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-422fb27b-d250-4405-ac14-17598fc0dff6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:32.502466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-422fb27b-d250-4405-ac14-17598fc0dff6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:32.504659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:32.506832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-422fb27b-d250-4405-ac14-17598fc0dff6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:32.512044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:32.513350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:32.515080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:32.517873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:32.522182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:33.171088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:33.205911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:33.209918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:33.212397 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e5597e78-dca0-4a98-8f14-22cc5476eb0b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.748773 Aug 25 13:13:33.226943 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1852/3669] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:32 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:33.273651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:33.275402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:33.289831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:33.291162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:33.292260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:33.294042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:33.295268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:33.296779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:33.735732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-422fb27b-d250-4405-ac14-17598fc0dff6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:33.768124 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-422fb27b-d250-4405-ac14-17598fc0dff6 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.341124 Aug 25 13:13:33.773115 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1818/3670] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:32 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:33.794259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:33.795256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:33.839239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:33.840322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:33.841111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:33.847670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:33.849215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:33.850138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:33.930548 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] HTTP exception thrown: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Request method failure captured: Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 HTTP/1.1 Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3QwCHOsaB6PwQ6FEx3Nik_pV-I9rFnyzAb6scawCD5tCbdg9RkAFiqjHR8cGt7ftj2LCIM2e9LUm1PvNyVqb86ucbxfszbns81WVKpWEs_PvkJs8G6SBmIH7AYj4Wi2eZHmUi5gKO7stfiOqdYtzj2p1e9IzEZuVrZimP1-zNFIQ2Y Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: bafd8cfabac543a6b7377b7cd451c693 Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1622263850 Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bafd8cfabac543a6b7377b7cd451c693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bafd8cfabac543a6b7377b7cd451c693", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bafd8cfabac543a6b7377b7cd451c693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bafd8cfabac543a6b7377b7cd451c693"}]}] Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1622263850 Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: bafd8cfabac543a6b7377b7cd451c693 Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1622263850 Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachSCSIVolumeTestJSON-1622263850-project Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e8531c673eba41deac6429590dd70a6f Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1622263850-project Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '9a51c80a-6c87-4026-9025-4630451ff316'} Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:33.940739 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:33.948940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:33.953963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Returning 404 to user: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:33.957090 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-26f965cb-dc84-4e46-a9f1-8d4d0239535a tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 404 len: 111 microversion: 2.1 time: 0.179023 Aug 25 13:13:33.959040 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1819/3671] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:13:33 2022] DELETE /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:13:33.970875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f87e005f-b11d-4c90-81f9-11d8171a3da8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:33.975221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f87e005f-b11d-4c90-81f9-11d8171a3da8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:33.986611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87e005f-b11d-4c90-81f9-11d8171a3da8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:33.988825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87e005f-b11d-4c90-81f9-11d8171a3da8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:33.990260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87e005f-b11d-4c90-81f9-11d8171a3da8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:33.992254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87e005f-b11d-4c90-81f9-11d8171a3da8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:33.993644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87e005f-b11d-4c90-81f9-11d8171a3da8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:33.994744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87e005f-b11d-4c90-81f9-11d8171a3da8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:34.060925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:34.076986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:34.118217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:34.127932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:34.135403 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e082ab92-2303-450d-ae00-905d0ad7d4c0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1551 microversion: 2.21 time: 0.874286 Aug 25 13:13:34.142465 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1853/3672] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:33 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1551 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:34.177323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:34.179839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] [instance: 9a51c80a-6c87-4026-9025-4630451ff316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:34.216147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:34.217965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:34.219460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:34.223631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:34.227437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:34.228781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:34.239935 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f87e005f-b11d-4c90-81f9-11d8171a3da8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.276825 Aug 25 13:13:34.244818 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1820/3673] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:13:33 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:13:34.261194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4fd7eb2c-a6ae-4fcb-bd17-99a63870e9f1 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:34.264571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4fd7eb2c-a6ae-4fcb-bd17-99a63870e9f1 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:34.309219 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] HTTP exception thrown: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Request method failure captured: Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 HTTP/1.1 Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3QwCHOsaB6PwQ6FEx3Nik_pV-I9rFnyzAb6scawCD5tCbdg9RkAFiqjHR8cGt7ftj2LCIM2e9LUm1PvNyVqb86ucbxfszbns81WVKpWEs_PvkJs8G6SBmIH7AYj4Wi2eZHmUi5gKO7stfiOqdYtzj2p1e9IzEZuVrZimP1-zNFIQ2Y Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: bafd8cfabac543a6b7377b7cd451c693 Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1622263850 Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bafd8cfabac543a6b7377b7cd451c693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bafd8cfabac543a6b7377b7cd451c693", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bafd8cfabac543a6b7377b7cd451c693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bafd8cfabac543a6b7377b7cd451c693"}]}] Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1622263850 Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: bafd8cfabac543a6b7377b7cd451c693 Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1622263850 Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachSCSIVolumeTestJSON-1622263850-project Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e8531c673eba41deac6429590dd70a6f Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1622263850-project Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '9a51c80a-6c87-4026-9025-4630451ff316'} Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:34.313541 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:34.335525 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:34.335525 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:34.335525 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:34.335525 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:34.335525 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:34.335525 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. Aug 25 13:13:34.335525 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:34.342434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4fd7eb2c-a6ae-4fcb-bd17-99a63870e9f1 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:34.342434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4fd7eb2c-a6ae-4fcb-bd17-99a63870e9f1 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:34.342434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4fd7eb2c-a6ae-4fcb-bd17-99a63870e9f1 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:34.343194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] Returning 404 to user: Instance 9a51c80a-6c87-4026-9025-4630451ff316 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:34.343194 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff746f80-f2b1-49eb-b509-e4bab3791fe9 tempest-AttachSCSIVolumeTestJSON-1622263850 tempest-AttachSCSIVolumeTestJSON-1622263850-project] 10.222.0.70 "GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316" status: 404 len: 111 microversion: 2.1 time: 0.156366 Aug 25 13:13:34.343957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4fd7eb2c-a6ae-4fcb-bd17-99a63870e9f1 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:34.344201 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1854/3674] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:34 2022] GET /compute/v2.1/servers/9a51c80a-6c87-4026-9025-4630451ff316 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:13:34.344443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4fd7eb2c-a6ae-4fcb-bd17-99a63870e9f1 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:34.344443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4fd7eb2c-a6ae-4fcb-bd17-99a63870e9f1 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:34.344947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-806104ab-0c65-4e48-b9c4-f6a0398f5246 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:34.344947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-806104ab-0c65-4e48-b9c4-f6a0398f5246 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:34.359846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-806104ab-0c65-4e48-b9c4-f6a0398f5246 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:34.361115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-806104ab-0c65-4e48-b9c4-f6a0398f5246 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:34.361977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-806104ab-0c65-4e48-b9c4-f6a0398f5246 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:34.363844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-806104ab-0c65-4e48-b9c4-f6a0398f5246 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:34.364745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-806104ab-0c65-4e48-b9c4-f6a0398f5246 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:34.365717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-806104ab-0c65-4e48-b9c4-f6a0398f5246 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:34.404818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4fd7eb2c-a6ae-4fcb-bd17-99a63870e9f1 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:13:34.677874 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4fd7eb2c-a6ae-4fcb-bd17-99a63870e9f1 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 204 len: 0 microversion: 2.21 time: 0.428542 Aug 25 13:13:34.680241 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1821/3675] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:13:34 2022] DELETE /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:13:34.713137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:34.714981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:34.740000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:34.741100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:34.741825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:34.743210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:34.744077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:34.752711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:34.997112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:35.031157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:35.040138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:35.045817 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87d2e1b3-8304-426d-a48e-aaabcea6ebe0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.357154 Aug 25 13:13:35.047160 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1822/3676] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:34 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:35.070345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:35.071556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:35.088903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-806104ab-0c65-4e48-b9c4-f6a0398f5246 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:35.098509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:35.099341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:35.100172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:35.101442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:35.102288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:35.111736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:35.119566 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-806104ab-0c65-4e48-b9c4-f6a0398f5246 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1672 microversion: 2.1 time: 0.790213 Aug 25 13:13:35.128520 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1855/3677] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:34 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1672 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:35.650997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:35.683664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:35.689598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:35.693199 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a338a538-d5d8-4e88-8c85-026889f27d2d tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1557 microversion: 2.21 time: 0.644410 Aug 25 13:13:35.709632 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1823/3678] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:35 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1557 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:36.098038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:36.099890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:36.110840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:36.113423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:36.115123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:36.116212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:36.117000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:36.117752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:36.171047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-62c48dc3-a869-41b2-8e4b-490068ae4db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:36.173270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-62c48dc3-a869-41b2-8e4b-490068ae4db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:36.191906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62c48dc3-a869-41b2-8e4b-490068ae4db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:36.193161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62c48dc3-a869-41b2-8e4b-490068ae4db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:36.194394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62c48dc3-a869-41b2-8e4b-490068ae4db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:36.196164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62c48dc3-a869-41b2-8e4b-490068ae4db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:36.197432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62c48dc3-a869-41b2-8e4b-490068ae4db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:36.198581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62c48dc3-a869-41b2-8e4b-490068ae4db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:36.276685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:36.304959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:36.308789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:36.311749 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fe6e2340-5d28-4a84-ac38-672e163b65fa tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.222480 Aug 25 13:13:36.313344 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1856/3679] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:36 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:36.748006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:36.749307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:36.760489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:36.761739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:36.762882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:36.765214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:36.766379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:36.767502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:36.790284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-62c48dc3-a869-41b2-8e4b-490068ae4db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:36.809469 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-62c48dc3-a869-41b2-8e4b-490068ae4db2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1652 microversion: 2.1 time: 0.646882 Aug 25 13:13:36.819323 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1824/3680] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:36 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1652 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:36.863084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8cf7d623-2bdb-4bb7-92a3-9672676c7df3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:36.864561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8cf7d623-2bdb-4bb7-92a3-9672676c7df3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:36.879166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8cf7d623-2bdb-4bb7-92a3-9672676c7df3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:36.880757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8cf7d623-2bdb-4bb7-92a3-9672676c7df3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:36.881949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8cf7d623-2bdb-4bb7-92a3-9672676c7df3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:36.883722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8cf7d623-2bdb-4bb7-92a3-9672676c7df3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:36.884982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8cf7d623-2bdb-4bb7-92a3-9672676c7df3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:36.886133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8cf7d623-2bdb-4bb7-92a3-9672676c7df3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:37.019797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:37.120587 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8cf7d623-2bdb-4bb7-92a3-9672676c7df3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.260451 Aug 25 13:13:37.125695 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1825/3681] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:13:36 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:13:37.202831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:37.210231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-57ffef12-002c-4ef9-a369-b646f06b41d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:37.218718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-57ffef12-002c-4ef9-a369-b646f06b41d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:37.237606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:37.244523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:37.251921 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f69363b-80ce-4935-af8e-c6416e9f4ec0 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1557 microversion: 2.21 time: 0.509825 Aug 25 13:13:37.269661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57ffef12-002c-4ef9-a369-b646f06b41d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:37.269661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57ffef12-002c-4ef9-a369-b646f06b41d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:37.270645 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1857/3682] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:36 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1557 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:37.271434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57ffef12-002c-4ef9-a369-b646f06b41d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:37.285547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57ffef12-002c-4ef9-a369-b646f06b41d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:37.285547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57ffef12-002c-4ef9-a369-b646f06b41d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:37.285547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57ffef12-002c-4ef9-a369-b646f06b41d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:37.378461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:37.379605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:37.399769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:37.400882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:37.403809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:37.406691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:37.408631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:37.410390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:38.212642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:38.243430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:38.248227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:38.251077 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7cb07cf0-2054-43d1-bf9a-c6fe119cc9d0 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.896691 Aug 25 13:13:38.253494 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1858/3683] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:37 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:38.318919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:38.319902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:38.332024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:38.333351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:38.334573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:38.336496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:38.337670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:38.338748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:38.652625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-57ffef12-002c-4ef9-a369-b646f06b41d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:38.681442 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-57ffef12-002c-4ef9-a369-b646f06b41d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1659 microversion: 2.1 time: 1.548039 Aug 25 13:13:38.682807 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1826/3684] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:37 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1659 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:39.146070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:39.191315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:39.221722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8ffcf7b70e4318959163ddb52a2c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50639abe0441eeb560767783042d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:39.228767 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-371b05ce-d2c2-4eb5-b086-48b49d5b1536 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 200 len: 1557 microversion: 2.21 time: 0.919235 Aug 25 13:13:39.232099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-577b467b-2760-499e-8bb1-4f72db273aa4 req-1ce06089-4ee4-4eb9-b7a1-00913ec07338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b14a1b53-7a3f-4980-b855-03ba584cc997", "name": "network-vif-deleted", "tag": "3c38fd78-50ab-4299-86a9-2b89e8bfd528"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:39.258158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1859/3685] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:38 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 1557 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:39.272978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-577b467b-2760-499e-8bb1-4f72db273aa4 req-1ce06089-4ee4-4eb9-b7a1-00913ec07338 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:39.286797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-577b467b-2760-499e-8bb1-4f72db273aa4 req-1ce06089-4ee4-4eb9-b7a1-00913ec07338 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:39.289419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-577b467b-2760-499e-8bb1-4f72db273aa4 req-1ce06089-4ee4-4eb9-b7a1-00913ec07338 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:39.303700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:39.308911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:39.341298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:39.343077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:39.344364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:39.346224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:39.365678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:39.367037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:39.369809 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-577b467b-2760-499e-8bb1-4f72db273aa4 req-1ce06089-4ee4-4eb9-b7a1-00913ec07338 service nova] Creating event network-vif-deleted:3c38fd78-50ab-4299-86a9-2b89e8bfd528 for instance b14a1b53-7a3f-4980-b855-03ba584cc997 on n-h1-852771-8 Aug 25 13:13:39.414548 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-577b467b-2760-499e-8bb1-4f72db273aa4 req-1ce06089-4ee4-4eb9-b7a1-00913ec07338 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193073 Aug 25 13:13:39.418113 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1827/3686] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:39.615898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:39.636926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:39.641036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:39.647124 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ea55b65c-3178-46de-952f-923799d0e74d tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.348293 Aug 25 13:13:39.651450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1860/3687] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:39 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:40.225957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-29b422d2-74af-47ec-90c9-76edc57de767 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:40.229046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-29b422d2-74af-47ec-90c9-76edc57de767 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:40.261063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b422d2-74af-47ec-90c9-76edc57de767 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:40.262285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b422d2-74af-47ec-90c9-76edc57de767 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:40.268119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b422d2-74af-47ec-90c9-76edc57de767 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:40.269164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b422d2-74af-47ec-90c9-76edc57de767 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:40.271581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b422d2-74af-47ec-90c9-76edc57de767 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:40.272413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29b422d2-74af-47ec-90c9-76edc57de767 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:40.295585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:40.297770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:40.326981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:40.328503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:40.330841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:40.354879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:40.358843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:40.360232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:40.403197 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] HTTP exception thrown: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Request method failure captured: Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 HTTP/1.1 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3VWgoq_oHMJ0MJvaCPzcsTw38gvRDQZNarVBw_EN8oHr992j1nWCs6TePWjgi6lHAGaSwQLYtWJSM4Iz_ViPoer8k_H_cc7pXJjaoIJtU1zIhEWoz8_WFELRM-xLalmOnMB8bHsZMvGAWJT8dZXqYugaxrhQ-RhDn1FR9zCas1CRIw Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.21 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: ed50639abe0441eeb560767783042d56 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1698738221 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ed50639abe0441eeb560767783042d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ed50639abe0441eeb560767783042d56", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ed50639abe0441eeb560767783042d56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ed50639abe0441eeb560767783042d56"}]}] Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-InstanceActionsV221TestJSON-1698738221 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: ed50639abe0441eeb560767783042d56 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1698738221 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-InstanceActionsV221TestJSON-1698738221-project Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: ec8ffcf7b70e4318959163ddb52a2c12 Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-InstanceActionsV221TestJSON-1698738221-project Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b14a1b53-7a3f-4980-b855-03ba584cc997'} Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:40.408093 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:40.423722 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:40.423722 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:40.423722 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:40.423722 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:40.423722 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:40.423722 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:40.423722 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:40.423722 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:40.423722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Returning 404 to user: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:40.435987 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a355282e-9a21-4270-91c9-56369a7aad68 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 404 len: 111 microversion: 2.21 time: 0.154233 Aug 25 13:13:40.444624 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1861/3688] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:40 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 25 13:13:40.470934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-de0d47a9-94a0-4dc1-bcd3-febb124871cc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '.version_select at 0x7f3a29ba5d30>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:40.472508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-de0d47a9-94a0-4dc1-bcd3-febb124871cc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:40.491988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de0d47a9-94a0-4dc1-bcd3-febb124871cc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:40.492856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de0d47a9-94a0-4dc1-bcd3-febb124871cc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:40.493668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de0d47a9-94a0-4dc1-bcd3-febb124871cc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:40.500449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de0d47a9-94a0-4dc1-bcd3-febb124871cc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:40.501589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de0d47a9-94a0-4dc1-bcd3-febb124871cc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:40.502432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de0d47a9-94a0-4dc1-bcd3-febb124871cc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:40.736462 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-de0d47a9-94a0-4dc1-bcd3-febb124871cc tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.281234 Aug 25 13:13:40.742207 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1862/3689] 10.222.0.70 () {60 vars in 1337 bytes} [Thu Aug 25 13:13:40 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997/os-instance-actions => generated 611 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:13:40.763036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:40.764973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:40.792016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:40.795480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:40.798708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:40.803766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:40.804911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-29b422d2-74af-47ec-90c9-76edc57de767 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:40.805898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:40.809055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:40.850026 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-29b422d2-74af-47ec-90c9-76edc57de767 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.131937 Aug 25 13:13:40.852073 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1828/3690] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:39 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:40.872417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:40.873477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:40.893260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:40.894698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:40.895390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:40.896735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:40.910639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:40.911603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:40.966102 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] HTTP exception thrown: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Request method failure captured: Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 HTTP/1.1 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3VWgoq_oHMJ0MJvaCPzcsTw38gvRDQZNarVBw_EN8oHr992j1nWCs6TePWjgi6lHAGaSwQLYtWJSM4Iz_ViPoer8k_H_cc7pXJjaoIJtU1zIhEWoz8_WFELRM-xLalmOnMB8bHsZMvGAWJT8dZXqYugaxrhQ-RhDn1FR9zCas1CRIw Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Openstack-Nova-Api-Version: 2.21 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: ed50639abe0441eeb560767783042d56 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1698738221 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ed50639abe0441eeb560767783042d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ed50639abe0441eeb560767783042d56", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ed50639abe0441eeb560767783042d56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ed50639abe0441eeb560767783042d56"}]}] Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-InstanceActionsV221TestJSON-1698738221 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: ed50639abe0441eeb560767783042d56 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1698738221 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-InstanceActionsV221TestJSON-1698738221-project Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: ec8ffcf7b70e4318959163ddb52a2c12 Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-InstanceActionsV221TestJSON-1698738221-project Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'b14a1b53-7a3f-4980-b855-03ba584cc997'} Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:40.972848 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:40.978899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:13:40.984481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Returning 404 to user: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:40.986974 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f33a6f9-9afa-41f0-8d14-106e586d90c8 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 404 len: 111 microversion: 2.21 time: 0.128148 Aug 25 13:13:40.989118 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1829/3691] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:13:40 2022] DELETE /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:13:41.016906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:41.024803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7d9ac42-23b7-47e8-9936-bf5cbad49849 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:41.024803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a7d9ac42-23b7-47e8-9936-bf5cbad49849 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:41.054453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7d9ac42-23b7-47e8-9936-bf5cbad49849 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:41.061640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7d9ac42-23b7-47e8-9936-bf5cbad49849 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:41.064567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7d9ac42-23b7-47e8-9936-bf5cbad49849 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:41.064889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:41.068618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:41.069552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7d9ac42-23b7-47e8-9936-bf5cbad49849 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:41.070871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7d9ac42-23b7-47e8-9936-bf5cbad49849 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:41.071076 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-432b5693-424a-4b0a-b881-67570b0985fe tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.326548 Aug 25 13:13:41.072375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7d9ac42-23b7-47e8-9936-bf5cbad49849 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:41.094098 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1863/3692] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:40 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:41.113186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:41.114444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] [instance: b14a1b53-7a3f-4980-b855-03ba584cc997] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:41.126421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:41.127680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:41.129129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:41.131012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:41.131857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:41.132922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:41.180399 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] HTTP exception thrown: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Request method failure captured: Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 HTTP/1.1 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3VWgoq_oHMJ0MJvaCPzcsTw38gvRDQZNarVBw_EN8oHr992j1nWCs6TePWjgi6lHAGaSwQLYtWJSM4Iz_ViPoer8k_H_cc7pXJjaoIJtU1zIhEWoz8_WFELRM-xLalmOnMB8bHsZMvGAWJT8dZXqYugaxrhQ-RhDn1FR9zCas1CRIw Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.21 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: ed50639abe0441eeb560767783042d56 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1698738221 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ed50639abe0441eeb560767783042d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ed50639abe0441eeb560767783042d56", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ed50639abe0441eeb560767783042d56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ed50639abe0441eeb560767783042d56"}]}] Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-InstanceActionsV221TestJSON-1698738221 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: ed50639abe0441eeb560767783042d56 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1698738221 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-InstanceActionsV221TestJSON-1698738221-project Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: ec8ffcf7b70e4318959163ddb52a2c12 Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-InstanceActionsV221TestJSON-1698738221-project Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b14a1b53-7a3f-4980-b855-03ba584cc997'} Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:41.184123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:41.188237 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:41.188237 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:41.188237 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:41.188237 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:41.188237 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:41.188237 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:41.188237 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. Aug 25 13:13:41.188237 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:13:41.194106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] Returning 404 to user: Instance b14a1b53-7a3f-4980-b855-03ba584cc997 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:41.196140 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e8ec07e1-f7c1-457d-94c1-b55c370ef452 tempest-InstanceActionsV221TestJSON-1698738221 tempest-InstanceActionsV221TestJSON-1698738221-project] 10.222.0.70 "GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997" status: 404 len: 111 microversion: 2.21 time: 0.100015 Aug 25 13:13:41.198943 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1864/3693] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:41 2022] GET /compute/v2.1/servers/b14a1b53-7a3f-4980-b855-03ba584cc997 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:13:41.798529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a7d9ac42-23b7-47e8-9936-bf5cbad49849 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:41.905615 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a7d9ac42-23b7-47e8-9936-bf5cbad49849 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.911444 Aug 25 13:13:41.910295 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1830/3694] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:40 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:41.963684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c8890251-7ed1-440e-9f25-fbf83637a2ff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:41.974406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c8890251-7ed1-440e-9f25-fbf83637a2ff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:41.997584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8890251-7ed1-440e-9f25-fbf83637a2ff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:41.999111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8890251-7ed1-440e-9f25-fbf83637a2ff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:42.000561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8890251-7ed1-440e-9f25-fbf83637a2ff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:42.002330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8890251-7ed1-440e-9f25-fbf83637a2ff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:42.004417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8890251-7ed1-440e-9f25-fbf83637a2ff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:42.006220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8890251-7ed1-440e-9f25-fbf83637a2ff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:42.147869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:42.155692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:42.197180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:42.205181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:42.208759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:42.210622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:42.218385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:42.219395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:42.527232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:42.585390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:42.593885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:42.600136 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cc3fcb51-bbc8-4935-8aba-37179328c63c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.480928 Aug 25 13:13:42.603126 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1831/3695] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:42 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:42.661311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c8890251-7ed1-440e-9f25-fbf83637a2ff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:42.708798 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c8890251-7ed1-440e-9f25-fbf83637a2ff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.758872 Aug 25 13:13:42.711640 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1865/3696] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:41 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:42.764687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dd96a0a9-f2c7-4dc2-9103-6f4291ff5e8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:42.766367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dd96a0a9-f2c7-4dc2-9103-6f4291ff5e8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:42.792453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd96a0a9-f2c7-4dc2-9103-6f4291ff5e8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:42.799277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd96a0a9-f2c7-4dc2-9103-6f4291ff5e8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:42.801996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd96a0a9-f2c7-4dc2-9103-6f4291ff5e8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:42.806136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd96a0a9-f2c7-4dc2-9103-6f4291ff5e8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:42.810445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd96a0a9-f2c7-4dc2-9103-6f4291ff5e8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:42.811324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd96a0a9-f2c7-4dc2-9103-6f4291ff5e8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:43.230647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-768039770", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "bb30aeaa-0ef9-4952-8b97-be1437e2314a"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:43.408153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] validate_networks() for [('bb30aeaa-0ef9-4952-8b97-be1437e2314a', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:13:43.978315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dd96a0a9-f2c7-4dc2-9103-6f4291ff5e8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:44.017890 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dd96a0a9-f2c7-4dc2-9103-6f4291ff5e8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.269083 Aug 25 13:13:44.021147 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1866/3697] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:42 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:13:44.035878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:44.039168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:44.057485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:44.060414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:44.063927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:44.065054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:44.069695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:44.071396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:44.276199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:44.303190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:44.308849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:44.313928 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c1291a2b-7fc6-493b-a268-122a3eb9526b tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.289922 Aug 25 13:13:44.317181 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1867/3698] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:44 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:44.331312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-132e952f-5228-4de2-b373-11f527b8089f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:44.336645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-132e952f-5228-4de2-b373-11f527b8089f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:44.368671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132e952f-5228-4de2-b373-11f527b8089f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:44.370237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132e952f-5228-4de2-b373-11f527b8089f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:44.371756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132e952f-5228-4de2-b373-11f527b8089f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:44.373852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132e952f-5228-4de2-b373-11f527b8089f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:44.375154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132e952f-5228-4de2-b373-11f527b8089f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:44.378201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-132e952f-5228-4de2-b373-11f527b8089f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:45.339354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-132e952f-5228-4de2-b373-11f527b8089f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:45.368671 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-132e952f-5228-4de2-b373-11f527b8089f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.048622 Aug 25 13:13:45.369424 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1868/3699] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:44 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:45.385852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:45.387193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:45.412933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:45.415803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:45.418818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:45.422792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:45.434152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:45.435393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:45.679976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:45.708092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:45.713361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:45.718054 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12f6eada-4dcc-4b5d-9735-65ec1b55fb31 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.344700 Aug 25 13:13:45.739629 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1869/3700] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:45 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:45.757855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fcb3703a-3728-4474-92f7-a1c381ce00bc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:45.765310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fcb3703a-3728-4474-92f7-a1c381ce00bc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:45.787931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb3703a-3728-4474-92f7-a1c381ce00bc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:45.789974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb3703a-3728-4474-92f7-a1c381ce00bc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:45.793680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb3703a-3728-4474-92f7-a1c381ce00bc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:45.795586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb3703a-3728-4474-92f7-a1c381ce00bc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:45.797276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb3703a-3728-4474-92f7-a1c381ce00bc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:45.798852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb3703a-3728-4474-92f7-a1c381ce00bc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:46.090527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:13:46.091249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:13:46.091808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:13:46.093443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:13:46.094609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:13:46.108193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:46.146955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:46.148522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:46.149750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:46.151860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:46.153119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:46.154490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:46.217123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Getting quotas for project cd519c9d05ff438284c759675ac89baf. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:13:46.235323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Getting quotas for user bcf781b69f67454dae3d3b4115983d23 and project cd519c9d05ff438284c759675ac89baf. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:13:46.270702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:13:46.276076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:13:46.447155 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b4a6a355-c475-4b44-af6e-68baf1cd826f tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.774617 Aug 25 13:13:46.465905 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1832/3701] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:13:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:13:46.497940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6312a3db-ab76-44f6-8f35-14d9ca75a672 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:46.501283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6312a3db-ab76-44f6-8f35-14d9ca75a672 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:46.863144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6312a3db-ab76-44f6-8f35-14d9ca75a672 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:46.899526 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6312a3db-ab76-44f6-8f35-14d9ca75a672 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1213 microversion: 2.1 time: 0.427620 Aug 25 13:13:46.909600 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1833/3702] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:46 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1213 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:46.933644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:46.935010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:46.960516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:46.961732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:46.977041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:46.982429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:46.983401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:46.984429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:47.055709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fcb3703a-3728-4474-92f7-a1c381ce00bc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:47.075008 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fcb3703a-3728-4474-92f7-a1c381ce00bc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.335393 Aug 25 13:13:47.076861 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1870/3703] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:45 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:47.342037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:47.383875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:47.387160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:47.397492 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0a7497c-bdbd-47ba-b856-57c40180cb19 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.487731 Aug 25 13:13:47.403688 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1834/3704] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:46 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:47.946195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f23699a-7bf5-41c8-8a8c-b5653bd471f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:47.947379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f23699a-7bf5-41c8-8a8c-b5653bd471f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:48.146763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2f23699a-7bf5-41c8-8a8c-b5653bd471f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:48.175643 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f23699a-7bf5-41c8-8a8c-b5653bd471f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1213 microversion: 2.1 time: 0.236508 Aug 25 13:13:48.177961 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1871/3705] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:47 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:48.459426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:48.460691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:48.490001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:48.490790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:48.491578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:48.501801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:48.503935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:48.505169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:49.531829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1797460378", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "9dbcd1aa-ce04-43a7-b93f-d1b96ddcbf97"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:49.766917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:49.834390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:49.838624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] validate_networks() for [('9dbcd1aa-ce04-43a7-b93f-d1b96ddcbf97', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:13:49.839735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:49.842848 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a0dfc8f6-73c5-491d-a532-ef6412b37e12 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 1.397739 Aug 25 13:13:49.844803 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1835/3706] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:48 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:49.873113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-db6390df-4ee0-40da-b203-b0581c7ea700 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:49.875641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-db6390df-4ee0-40da-b203-b0581c7ea700 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:49.926442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6390df-4ee0-40da-b203-b0581c7ea700 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:49.932737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6390df-4ee0-40da-b203-b0581c7ea700 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:49.941645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6390df-4ee0-40da-b203-b0581c7ea700 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:49.947836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6390df-4ee0-40da-b203-b0581c7ea700 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:49.951762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6390df-4ee0-40da-b203-b0581c7ea700 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:49.955873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db6390df-4ee0-40da-b203-b0581c7ea700 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:50.336142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-db6390df-4ee0-40da-b203-b0581c7ea700 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:50.368795 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-db6390df-4ee0-40da-b203-b0581c7ea700 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1283 microversion: 2.1 time: 0.513093 Aug 25 13:13:50.371645 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1836/3707] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:49 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1283 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:50.898695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:50.906691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:50.941399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:50.953241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:50.955041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:50.962513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:50.963820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:50.964979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:51.682754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:51.709277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:51.713594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:51.716522 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-61650983-4a2e-44eb-9494-acaa7116039a tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.827997 Aug 25 13:13:51.734429 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1837/3708] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:50 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:13:51.761667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f391dddf-18f9-4d4f-8d9d-659acc773dff tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:51.763646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f391dddf-18f9-4d4f-8d9d-659acc773dff tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:51.777138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f391dddf-18f9-4d4f-8d9d-659acc773dff tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:51.778539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f391dddf-18f9-4d4f-8d9d-659acc773dff tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:51.779781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f391dddf-18f9-4d4f-8d9d-659acc773dff tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:51.781556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f391dddf-18f9-4d4f-8d9d-659acc773dff tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:51.784047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f391dddf-18f9-4d4f-8d9d-659acc773dff tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:51.786939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f391dddf-18f9-4d4f-8d9d-659acc773dff tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:52.187693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f391dddf-18f9-4d4f-8d9d-659acc773dff tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:52.217470 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f391dddf-18f9-4d4f-8d9d-659acc773dff tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1271 microversion: 2.1 time: 0.477196 Aug 25 13:13:52.219291 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1838/3709] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:51 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1271 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:52.444572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:13:52.446892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:13:52.449863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:13:52.451242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:13:52.452720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:13:52.498146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:52.502650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:52.508241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:52.514177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:52.516498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:52.517943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:52.608621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Getting quotas for project d978026db2964d8dbc4c511631c892c2. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:13:52.641153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Getting quotas for user 1cc53ee05ac640d6acf5aea6da0bde26 and project d978026db2964d8dbc4c511631c892c2. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:13:52.708173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:13:52.715917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:13:52.772000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:52.777201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:52.817072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:52.828952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:52.834080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:52.835636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:52.844380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:52.849702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:52.893288 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-20c7e669-5854-456b-a1c1-83b43172eb12 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.834067 Aug 25 13:13:52.898759 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1872/3710] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:13:52.941338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2221f412-e76a-45a0-b038-af072eb0a01f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:52.945068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2221f412-e76a-45a0-b038-af072eb0a01f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:53.204801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2221f412-e76a-45a0-b038-af072eb0a01f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:53.268006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:53.277626 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2221f412-e76a-45a0-b038-af072eb0a01f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1218 microversion: 2.1 time: 0.359977 Aug 25 13:13:53.298115 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1873/3711] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:52 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1218 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:53.310132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e947c40-c9ea-4947-b2e5-c88820984eda tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:53.311159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6e947c40-c9ea-4947-b2e5-c88820984eda tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:53.318940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:53.322371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:53.324840 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eb36339f-0a8d-4bdb-902a-2ca574c12348 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.561035 Aug 25 13:13:53.327088 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1839/3712] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:52 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:53.367910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e947c40-c9ea-4947-b2e5-c88820984eda tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:53.369486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e947c40-c9ea-4947-b2e5-c88820984eda tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:53.370351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e947c40-c9ea-4947-b2e5-c88820984eda tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:53.371674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e947c40-c9ea-4947-b2e5-c88820984eda tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:53.372614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e947c40-c9ea-4947-b2e5-c88820984eda tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:53.373327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e947c40-c9ea-4947-b2e5-c88820984eda tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:54.003573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6e947c40-c9ea-4947-b2e5-c88820984eda tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:54.032966 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e947c40-c9ea-4947-b2e5-c88820984eda tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1313 microversion: 2.1 time: 0.732898 Aug 25 13:13:54.036660 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1874/3713] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:53 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:54.324202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b600e22-1df9-4419-82d9-579726059a63 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:54.325442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6b600e22-1df9-4419-82d9-579726059a63 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:54.377541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:54.379982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:54.421363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:54.422741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:54.426418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:54.430539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:54.431604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:54.432717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:54.455958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:54.588526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6b600e22-1df9-4419-82d9-579726059a63 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:54.613299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6b600e22-1df9-4419-82d9-579726059a63 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1218 microversion: 2.1 time: 0.303816 Aug 25 13:13:54.614810 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1840/3714] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:54 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1218 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:54.809542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:54.844788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:54.851867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:54.860867 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-53eb5d5b-55c8-4311-b4c7-36a3c69f547c tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1409 microversion: 2.54 time: 0.487849 Aug 25 13:13:54.866111 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1875/3715] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:54 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1409 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:55.090722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4565b7d9-0555-4d42-b525-d1bbaff3f30d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:55.095101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4565b7d9-0555-4d42-b525-d1bbaff3f30d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:55.124627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4565b7d9-0555-4d42-b525-d1bbaff3f30d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:55.125991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4565b7d9-0555-4d42-b525-d1bbaff3f30d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:55.127016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4565b7d9-0555-4d42-b525-d1bbaff3f30d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:55.129295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4565b7d9-0555-4d42-b525-d1bbaff3f30d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:55.131423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4565b7d9-0555-4d42-b525-d1bbaff3f30d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:55.132779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4565b7d9-0555-4d42-b525-d1bbaff3f30d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:55.673683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c86fd7b0-b7f9-4a7a-b9a8-681218aaaa0f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:55.677429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c86fd7b0-b7f9-4a7a-b9a8-681218aaaa0f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:55.707886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c86fd7b0-b7f9-4a7a-b9a8-681218aaaa0f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:55.708958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c86fd7b0-b7f9-4a7a-b9a8-681218aaaa0f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:55.709841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c86fd7b0-b7f9-4a7a-b9a8-681218aaaa0f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:55.711229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c86fd7b0-b7f9-4a7a-b9a8-681218aaaa0f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:55.712095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c86fd7b0-b7f9-4a7a-b9a8-681218aaaa0f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:55.712917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c86fd7b0-b7f9-4a7a-b9a8-681218aaaa0f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:55.963920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c86fd7b0-b7f9-4a7a-b9a8-681218aaaa0f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:55.991604 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c86fd7b0-b7f9-4a7a-b9a8-681218aaaa0f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1270 microversion: 2.1 time: 0.342045 Aug 25 13:13:55.992674 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1876/3716] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:55 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1270 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:56.040806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4565b7d9-0555-4d42-b525-d1bbaff3f30d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:56.041806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:56.042529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:56.066354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:56.068049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:56.069362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:56.071195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:56.072462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:56.073902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:56.088064 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4565b7d9-0555-4d42-b525-d1bbaff3f30d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1313 microversion: 2.1 time: 1.014661 Aug 25 13:13:56.092011 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1841/3717] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:55 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1313 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:56.426777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:56.462144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:56.470003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:56.473659 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b6f1652f-d986-4397-bb2e-26b77b4893e5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1415 microversion: 2.54 time: 0.461890 Aug 25 13:13:56.476011 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1877/3718] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:55 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1415 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:57.030682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:57.051736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-146a859e-c20f-481c-b939-6206fc60c5d1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:57.054754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-146a859e-c20f-481c-b939-6206fc60c5d1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:57.070261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146a859e-c20f-481c-b939-6206fc60c5d1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:57.071652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146a859e-c20f-481c-b939-6206fc60c5d1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:57.072783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146a859e-c20f-481c-b939-6206fc60c5d1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:57.074943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146a859e-c20f-481c-b939-6206fc60c5d1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:57.076304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146a859e-c20f-481c-b939-6206fc60c5d1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:57.084796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146a859e-c20f-481c-b939-6206fc60c5d1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:57.139310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b8854b1c-4b95-4257-b5bf-37487c27084d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:57.141844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b8854b1c-4b95-4257-b5bf-37487c27084d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:57.162346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8854b1c-4b95-4257-b5bf-37487c27084d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:57.175616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8854b1c-4b95-4257-b5bf-37487c27084d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:57.176980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8854b1c-4b95-4257-b5bf-37487c27084d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:57.178847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8854b1c-4b95-4257-b5bf-37487c27084d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:57.180126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8854b1c-4b95-4257-b5bf-37487c27084d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:57.181232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8854b1c-4b95-4257-b5bf-37487c27084d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:57.414595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-146a859e-c20f-481c-b939-6206fc60c5d1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:57.467462 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-146a859e-c20f-481c-b939-6206fc60c5d1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1276 microversion: 2.1 time: 0.436563 Aug 25 13:13:57.471551 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1842/3719] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:57 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1276 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:57.524346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:57.526283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:57.539526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:57.540943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:57.542314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:57.544282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:57.545617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:57.546662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:57.906689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:57.938030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:57.948547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:57.952238 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d57dfa63-c2ad-424a-9bcd-8e218d33f6cc tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1415 microversion: 2.54 time: 0.436109 Aug 25 13:13:57.969409 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1843/3720] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:57 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1415 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:58.084604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b8854b1c-4b95-4257-b5bf-37487c27084d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:58.103828 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b8854b1c-4b95-4257-b5bf-37487c27084d tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1313 microversion: 2.1 time: 0.975110 Aug 25 13:13:58.104942 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1878/3721] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:57 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1313 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:58.518498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c455a55-7ca0-47a7-a975-43b74c0b09e0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:58.520376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3c455a55-7ca0-47a7-a975-43b74c0b09e0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:58.538513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455a55-7ca0-47a7-a975-43b74c0b09e0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:58.539170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455a55-7ca0-47a7-a975-43b74c0b09e0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:58.539828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455a55-7ca0-47a7-a975-43b74c0b09e0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:58.540794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455a55-7ca0-47a7-a975-43b74c0b09e0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:58.541902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455a55-7ca0-47a7-a975-43b74c0b09e0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:58.542933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455a55-7ca0-47a7-a975-43b74c0b09e0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:59.014305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:59.019379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:59.047478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:59.051668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:59.053686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:59.059311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:59.060211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:59.061042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:59.095407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3c455a55-7ca0-47a7-a975-43b74c0b09e0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:59.157132 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3c455a55-7ca0-47a7-a975-43b74c0b09e0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1276 microversion: 2.1 time: 0.645280 Aug 25 13:13:59.158899 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1844/3722] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:58 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1276 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:59.169950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-fc9aa8cf-59f0-4b36-b173-5daa3772178a req-b80b4303-c0d7-4c91-af9f-20830320520c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ed5efd0-ede4-4734-9fb2-ed6b45a87378", "tag": "5089f640-307f-4fd9-88e9-71c9032dd72e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:59.195024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fc9aa8cf-59f0-4b36-b173-5daa3772178a req-b80b4303-c0d7-4c91-af9f-20830320520c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:59.196276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fc9aa8cf-59f0-4b36-b173-5daa3772178a req-b80b4303-c0d7-4c91-af9f-20830320520c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:59.197418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fc9aa8cf-59f0-4b36-b173-5daa3772178a req-b80b4303-c0d7-4c91-af9f-20830320520c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:59.246375 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-fc9aa8cf-59f0-4b36-b173-5daa3772178a req-b80b4303-c0d7-4c91-af9f-20830320520c service nova] Creating event network-changed:5089f640-307f-4fd9-88e9-71c9032dd72e for instance 8ed5efd0-ede4-4734-9fb2-ed6b45a87378 on n-h1-852771-8 Aug 25 13:13:59.260329 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-fc9aa8cf-59f0-4b36-b173-5daa3772178a req-b80b4303-c0d7-4c91-af9f-20830320520c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097588 Aug 25 13:13:59.264389 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1845/3723] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:59.281955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-12be7f33-752e-4b4e-89ea-e4b4db810e54 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:59.283827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-12be7f33-752e-4b4e-89ea-e4b4db810e54 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:59.308365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12be7f33-752e-4b4e-89ea-e4b4db810e54 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:59.310881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12be7f33-752e-4b4e-89ea-e4b4db810e54 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:59.313425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12be7f33-752e-4b4e-89ea-e4b4db810e54 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:59.315562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12be7f33-752e-4b4e-89ea-e4b4db810e54 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:59.318157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12be7f33-752e-4b4e-89ea-e4b4db810e54 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:59.318859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12be7f33-752e-4b4e-89ea-e4b4db810e54 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:59.366344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:59.383395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:59.420023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:59.424803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:59.428560 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-340eb8fb-a72d-4326-b5f1-60abfa1b1bd6 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1415 microversion: 2.54 time: 0.428420 Aug 25 13:13:59.430835 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1879/3724] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:58 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1415 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:00.206622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b009ee9-7e89-449d-9734-0bf9c08a2270 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:00.208676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b009ee9-7e89-449d-9734-0bf9c08a2270 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:00.213582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:00.229037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b009ee9-7e89-449d-9734-0bf9c08a2270 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:00.230011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b009ee9-7e89-449d-9734-0bf9c08a2270 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:00.231248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b009ee9-7e89-449d-9734-0bf9c08a2270 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:00.233261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b009ee9-7e89-449d-9734-0bf9c08a2270 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:00.233886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b009ee9-7e89-449d-9734-0bf9c08a2270 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:00.234955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b009ee9-7e89-449d-9734-0bf9c08a2270 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:00.492622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-12be7f33-752e-4b4e-89ea-e4b4db810e54 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:00.513865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b009ee9-7e89-449d-9734-0bf9c08a2270 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:00.519038 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-12be7f33-752e-4b4e-89ea-e4b4db810e54 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1313 microversion: 2.1 time: 1.250372 Aug 25 13:14:00.520404 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1846/3725] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:59 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1313 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:00.539721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:00.541544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:00.546551 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b009ee9-7e89-449d-9734-0bf9c08a2270 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1276 microversion: 2.1 time: 0.345990 Aug 25 13:14:00.548405 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1880/3726] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:00 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1276 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:00.559023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:00.559959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:00.561114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:00.562640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:00.563575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:00.566628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:00.875443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:00.898001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:00.903051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:00.905747 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5c503fa9-7689-412b-9747-9c463b635999 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1415 microversion: 2.54 time: 0.376528 Aug 25 13:14:00.905747 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1847/3727] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:00 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1415 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:01.590710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4287a8fe-f17c-428b-9391-2f0b3b28d656 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:01.594069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4287a8fe-f17c-428b-9391-2f0b3b28d656 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:01.611855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4287a8fe-f17c-428b-9391-2f0b3b28d656 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:01.613934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4287a8fe-f17c-428b-9391-2f0b3b28d656 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:01.615733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4287a8fe-f17c-428b-9391-2f0b3b28d656 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:01.616124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1a41310e-2769-4621-aa37-ab85c28f1e77 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:01.616932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4287a8fe-f17c-428b-9391-2f0b3b28d656 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:01.618039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4287a8fe-f17c-428b-9391-2f0b3b28d656 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:01.619841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4287a8fe-f17c-428b-9391-2f0b3b28d656 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:01.620363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1a41310e-2769-4621-aa37-ab85c28f1e77 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:01.660720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a41310e-2769-4621-aa37-ab85c28f1e77 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:01.662188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a41310e-2769-4621-aa37-ab85c28f1e77 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:01.663415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a41310e-2769-4621-aa37-ab85c28f1e77 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:01.665146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a41310e-2769-4621-aa37-ab85c28f1e77 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:01.667587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a41310e-2769-4621-aa37-ab85c28f1e77 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:01.672783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a41310e-2769-4621-aa37-ab85c28f1e77 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:02.483990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1a41310e-2769-4621-aa37-ab85c28f1e77 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:02.504076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4287a8fe-f17c-428b-9391-2f0b3b28d656 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:02.531460 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1a41310e-2769-4621-aa37-ab85c28f1e77 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1318 microversion: 2.1 time: 0.944599 Aug 25 13:14:02.533006 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1848/3728] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:01 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1318 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:02.544878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:02.547637 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4287a8fe-f17c-428b-9391-2f0b3b28d656 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1313 microversion: 2.1 time: 0.991698 Aug 25 13:14:02.548849 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1881/3729] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:01 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1313 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:02.549829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:02.571744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:02.572579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:02.573303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:02.579071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:02.579965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:02.580742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:02.926442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:02.949562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:02.954745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:02.959864 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3ff3928e-453b-4578-a990-d5765b55d7be tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1400 microversion: 2.54 time: 0.422161 Aug 25 13:14:02.961873 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1849/3730] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:02 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1400 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:03.023925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-596b0c78-4aa7-44a4-b6f6-af787a70f442 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '.version_select at 0x7f3a2a2595e0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:03.036002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:03.116816 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-596b0c78-4aa7-44a4-b6f6-af787a70f442 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1757057110" status: 204 len: 0 microversion: 2.54 time: 0.105397 Aug 25 13:14:03.122241 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1882/3731] 10.222.0.70 () {60 vars in 1319 bytes} [Thu Aug 25 13:14:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1757057110 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 13:14:03.153932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1af901d2-fb2b-4a3c-98e9-db7b25a75135 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:03.155657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1af901d2-fb2b-4a3c-98e9-db7b25a75135 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:03.169661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1af901d2-fb2b-4a3c-98e9-db7b25a75135 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:03.171249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1af901d2-fb2b-4a3c-98e9-db7b25a75135 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:03.172827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1af901d2-fb2b-4a3c-98e9-db7b25a75135 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:03.175867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1af901d2-fb2b-4a3c-98e9-db7b25a75135 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:03.177399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1af901d2-fb2b-4a3c-98e9-db7b25a75135 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:03.178891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1af901d2-fb2b-4a3c-98e9-db7b25a75135 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:03.244450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1af901d2-fb2b-4a3c-98e9-db7b25a75135 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:14:03.505303 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1af901d2-fb2b-4a3c-98e9-db7b25a75135 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 204 len: 0 microversion: 2.54 time: 0.347035 Aug 25 13:14:03.514255 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1850/3732] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:14:03 2022] DELETE /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:14:03.528765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:03.562280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:03.579822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:03.589860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-84786ec9-983b-4d78-8a48-9b857cfa2780 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:03.601548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-84786ec9-983b-4d78-8a48-9b857cfa2780 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:03.634644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:03.635699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:03.636634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:03.640930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:03.642020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:03.642930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:03.650472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84786ec9-983b-4d78-8a48-9b857cfa2780 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:03.654230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84786ec9-983b-4d78-8a48-9b857cfa2780 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:03.655331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84786ec9-983b-4d78-8a48-9b857cfa2780 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:03.662031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84786ec9-983b-4d78-8a48-9b857cfa2780 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:03.663041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84786ec9-983b-4d78-8a48-9b857cfa2780 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:03.664785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84786ec9-983b-4d78-8a48-9b857cfa2780 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:04.097854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:04.133349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:04.138447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:04.141442 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-62c2cc53-be53-4b96-96e8-ef8f441606a5 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1406 microversion: 2.54 time: 0.613768 Aug 25 13:14:04.170400 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1883/3733] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:03 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1406 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:04.190828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a5d621c-5a1f-4e37-80d1-46290379a449 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:04.192573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a5d621c-5a1f-4e37-80d1-46290379a449 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:04.210414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a5d621c-5a1f-4e37-80d1-46290379a449 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:04.214379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a5d621c-5a1f-4e37-80d1-46290379a449 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:04.218256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a5d621c-5a1f-4e37-80d1-46290379a449 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:04.223736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a5d621c-5a1f-4e37-80d1-46290379a449 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:04.235553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a5d621c-5a1f-4e37-80d1-46290379a449 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:04.241252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a5d621c-5a1f-4e37-80d1-46290379a449 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:04.605097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:04.778123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-84786ec9-983b-4d78-8a48-9b857cfa2780 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:04.809380 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-84786ec9-983b-4d78-8a48-9b857cfa2780 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1318 microversion: 2.1 time: 1.238585 Aug 25 13:14:04.830320 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1851/3734] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:03 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1318 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:05.198498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:05.200031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:05.212559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:05.213882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:05.214925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:05.216474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:05.217570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:05.218758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:05.324246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a5d621c-5a1f-4e37-80d1-46290379a449 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:05.354860 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a5d621c-5a1f-4e37-80d1-46290379a449 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1313 microversion: 2.1 time: 1.181967 Aug 25 13:14:05.388870 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1884/3735] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:04 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1313 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:05.426951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:05.447738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:05.451268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca5bce92e65489b8612d870b86057c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c528bbe1742539fdb67bf89bfa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:05.454147 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ac24193-3320-4c1c-9815-fd41802a2328 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 200 len: 1406 microversion: 2.54 time: 0.264005 Aug 25 13:14:05.455800 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1852/3736] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:05 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:05.855533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ecb95c85-dd10-4dd9-b172-fd1e57e5d74f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:05.858751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ecb95c85-dd10-4dd9-b172-fd1e57e5d74f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:05.898538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb95c85-dd10-4dd9-b172-fd1e57e5d74f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:05.899573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb95c85-dd10-4dd9-b172-fd1e57e5d74f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:05.906004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb95c85-dd10-4dd9-b172-fd1e57e5d74f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:05.907648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb95c85-dd10-4dd9-b172-fd1e57e5d74f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:05.908735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb95c85-dd10-4dd9-b172-fd1e57e5d74f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:05.910520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb95c85-dd10-4dd9-b172-fd1e57e5d74f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:05.919168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1399103588", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": "none"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:06.111079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:14:06.112471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:14:06.113889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:14:06.115392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:14:06.122924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:14:06.176689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:06.183076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:06.184212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:06.186176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:06.188614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:06.193996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:06.268302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Getting quotas for project 5ba333f6082f4988a01972c8543701d9. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:14:06.285699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Getting quotas for user 96ac24dc05e94521af9ec67e929e405f and project 5ba333f6082f4988a01972c8543701d9. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:14:06.324033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:14:06.329809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:14:06.435795 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e696681b-aa75-447b-b4e1-2fce928ddb06 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.935088 Aug 25 13:14:06.447318 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1885/3737] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 13:14:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:14:06.451919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3c456e6b-72d0-48a1-881b-4a17ca7ae226 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:06.452782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3c456e6b-72d0-48a1-881b-4a17ca7ae226 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:06.465419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c456e6b-72d0-48a1-881b-4a17ca7ae226 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:06.466452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c456e6b-72d0-48a1-881b-4a17ca7ae226 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:06.467359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c456e6b-72d0-48a1-881b-4a17ca7ae226 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:06.469883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c456e6b-72d0-48a1-881b-4a17ca7ae226 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:06.471031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c456e6b-72d0-48a1-881b-4a17ca7ae226 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:06.472381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c456e6b-72d0-48a1-881b-4a17ca7ae226 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:07.329020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ecb95c85-dd10-4dd9-b172-fd1e57e5d74f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:07.359959 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ecb95c85-dd10-4dd9-b172-fd1e57e5d74f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1318 microversion: 2.1 time: 1.514021 Aug 25 13:14:07.376142 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1853/3738] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:05 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1318 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:07.381167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fec96087-59dd-4cdb-8adc-e00510fabdac tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:07.382946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fec96087-59dd-4cdb-8adc-e00510fabdac tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:07.496443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3c456e6b-72d0-48a1-881b-4a17ca7ae226 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:07.514302 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3c456e6b-72d0-48a1-881b-4a17ca7ae226 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1313 microversion: 2.1 time: 1.073476 Aug 25 13:14:07.516421 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1886/3739] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:06 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1313 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:07.536613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:07.541560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] [instance: fb577741-689d-4683-a344-341279db4a10] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:07.558604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:07.560117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:07.561384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:07.563550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:07.564522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:07.566565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:07.602332 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] HTTP exception thrown: Instance fb577741-689d-4683-a344-341279db4a10 could not be found. Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Request method failure captured: Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 HTTP/1.1 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3VkrSHhK6Zl1bfO9ZxALtR3_4gf5RXflgExV_qJKBEse54nerjAvOTGzruag7BFJThUhqQOkbq5IdtlsXt0JK5KVYdbE3u3OL1vhLE3hhPQpgKPpiLsZ-8G7MXuiEr7Nbm-JFXZx9c_gVUdh77x6DQa02J1gwdyMQQuGnncAEiAOzE Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.54 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 497c528bbe1742539fdb67bf89bfa217 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerShowV254Test-1199296728 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/497c528bbe1742539fdb67bf89bfa217"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_497c528bbe1742539fdb67bf89bfa217", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/497c528bbe1742539fdb67bf89bfa217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/497c528bbe1742539fdb67bf89bfa217"}]}] Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerShowV254Test-1199296728 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 497c528bbe1742539fdb67bf89bfa217 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerShowV254Test-1199296728 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerShowV254Test-1199296728-project Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: cca5bce92e65489b8612d870b86057c6 Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerShowV254Test-1199296728-project Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance fb577741-689d-4683-a344-341279db4a10 could not be found. Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'fb577741-689d-4683-a344-341279db4a10'} Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb577741-689d-4683-a344-341279db4a10 could not be found. Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb577741-689d-4683-a344-341279db4a10 could not be found. Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:14:07.607343 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:07.615630 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:07.615630 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:14:07.615630 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:14:07.615630 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:14:07.615630 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:14:07.615630 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb577741-689d-4683-a344-341279db4a10 could not be found. Aug 25 13:14:07.615630 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:07.615630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] Returning 404 to user: Instance fb577741-689d-4683-a344-341279db4a10 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:14:07.615630 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff45f273-9f70-4f38-bf05-ad33622642d3 tempest-ServerShowV254Test-1199296728 tempest-ServerShowV254Test-1199296728-project] 10.222.0.70 "GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10" status: 404 len: 111 microversion: 2.54 time: 0.091571 Aug 25 13:14:07.618973 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1887/3740] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:07 2022] GET /compute/v2.1/servers/fb577741-689d-4683-a344-341279db4a10 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:14:07.624932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-acd7507c-f8b4-4390-be2f-c8d95def0234 req-947d207e-cafe-4d34-a749-2930abbb974d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed5efd0-ede4-4734-9fb2-ed6b45a87378", "name": "network-vif-plugged", "status": "completed", "tag": "5089f640-307f-4fd9-88e9-71c9032dd72e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:07.649171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-acd7507c-f8b4-4390-be2f-c8d95def0234 req-947d207e-cafe-4d34-a749-2930abbb974d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:07.650781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-acd7507c-f8b4-4390-be2f-c8d95def0234 req-947d207e-cafe-4d34-a749-2930abbb974d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:07.652571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-acd7507c-f8b4-4390-be2f-c8d95def0234 req-947d207e-cafe-4d34-a749-2930abbb974d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:07.691671 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-acd7507c-f8b4-4390-be2f-c8d95def0234 req-947d207e-cafe-4d34-a749-2930abbb974d service nova] Creating event network-vif-plugged:5089f640-307f-4fd9-88e9-71c9032dd72e for instance 8ed5efd0-ede4-4734-9fb2-ed6b45a87378 on n-h1-852771-8 Aug 25 13:14:07.708500 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-acd7507c-f8b4-4390-be2f-c8d95def0234 req-947d207e-cafe-4d34-a749-2930abbb974d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087703 Aug 25 13:14:07.710157 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1888/3741] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:07.736148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-18a5a37f-1bf6-45a0-a76e-a963bbcae2cd req-4ea14e3f-e1cd-49ba-ae38-c2714f5cc4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7", "tag": "aa171f0d-a313-43dc-9f2d-ed2a01bbd0c6"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:07.781264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-18a5a37f-1bf6-45a0-a76e-a963bbcae2cd req-4ea14e3f-e1cd-49ba-ae38-c2714f5cc4c6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:07.783091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-18a5a37f-1bf6-45a0-a76e-a963bbcae2cd req-4ea14e3f-e1cd-49ba-ae38-c2714f5cc4c6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:07.785241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-18a5a37f-1bf6-45a0-a76e-a963bbcae2cd req-4ea14e3f-e1cd-49ba-ae38-c2714f5cc4c6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:07.809235 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-18a5a37f-1bf6-45a0-a76e-a963bbcae2cd req-4ea14e3f-e1cd-49ba-ae38-c2714f5cc4c6 service nova] Creating event network-changed:aa171f0d-a313-43dc-9f2d-ed2a01bbd0c6 for instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 on n-h1-852771-8 Aug 25 13:14:07.820541 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-18a5a37f-1bf6-45a0-a76e-a963bbcae2cd req-4ea14e3f-e1cd-49ba-ae38-c2714f5cc4c6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099982 Aug 25 13:14:07.822198 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1889/3742] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:07.900741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fec96087-59dd-4cdb-8adc-e00510fabdac tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:07.930070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fec96087-59dd-4cdb-8adc-e00510fabdac tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:07.932771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fec96087-59dd-4cdb-8adc-e00510fabdac tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:07.941875 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fec96087-59dd-4cdb-8adc-e00510fabdac tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 200 len: 1281 microversion: 2.47 time: 0.576781 Aug 25 13:14:07.943313 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1854/3743] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:07 2022] GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 1281 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:08.416947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a957ec86-703c-4f53-8c35-578f5bd53a58 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:08.423480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a957ec86-703c-4f53-8c35-578f5bd53a58 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:08.451171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a957ec86-703c-4f53-8c35-578f5bd53a58 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:08.455664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a957ec86-703c-4f53-8c35-578f5bd53a58 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:08.466201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a957ec86-703c-4f53-8c35-578f5bd53a58 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:08.468316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a957ec86-703c-4f53-8c35-578f5bd53a58 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:08.470196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a957ec86-703c-4f53-8c35-578f5bd53a58 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:08.471500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a957ec86-703c-4f53-8c35-578f5bd53a58 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:08.556416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-be8aab87-f0e6-4a59-8d3a-3050fad4774b tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:08.559982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-be8aab87-f0e6-4a59-8d3a-3050fad4774b tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:08.594798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8aab87-f0e6-4a59-8d3a-3050fad4774b tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:08.595542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8aab87-f0e6-4a59-8d3a-3050fad4774b tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:08.596304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8aab87-f0e6-4a59-8d3a-3050fad4774b tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:08.598341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8aab87-f0e6-4a59-8d3a-3050fad4774b tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:08.605736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8aab87-f0e6-4a59-8d3a-3050fad4774b tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:08.606849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be8aab87-f0e6-4a59-8d3a-3050fad4774b tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:09.285565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a957ec86-703c-4f53-8c35-578f5bd53a58 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:09.309979 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a957ec86-703c-4f53-8c35-578f5bd53a58 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1318 microversion: 2.1 time: 0.914294 Aug 25 13:14:09.322078 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1890/3744] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:08 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1318 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:09.361689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:09.363726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:09.377545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:09.384168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:09.385012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:09.386427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:09.387592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:09.388657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:09.432215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-be8aab87-f0e6-4a59-8d3a-3050fad4774b tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:09.465188 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-be8aab87-f0e6-4a59-8d3a-3050fad4774b tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1313 microversion: 2.1 time: 0.915632 Aug 25 13:14:09.481603 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1855/3745] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:08 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1313 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:09.734940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:09.773725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:09.777413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:09.780132 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-77b95119-dde1-4af2-b4c3-0bdd8d434a1d tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 200 len: 1339 microversion: 2.47 time: 0.446281 Aug 25 13:14:09.781935 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1891/3746] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:09 2022] GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 1339 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:10.371822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f89d2b7b-502e-440a-a4c8-85716e71be0c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:10.373048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f89d2b7b-502e-440a-a4c8-85716e71be0c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:10.410829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d2b7b-502e-440a-a4c8-85716e71be0c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:10.412177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d2b7b-502e-440a-a4c8-85716e71be0c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:10.413289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d2b7b-502e-440a-a4c8-85716e71be0c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:10.415005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d2b7b-502e-440a-a4c8-85716e71be0c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:10.416397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d2b7b-502e-440a-a4c8-85716e71be0c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:10.417471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f89d2b7b-502e-440a-a4c8-85716e71be0c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:10.524209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-809c5085-f9e6-41a3-bcad-5a59e8b46a58 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:10.526187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-809c5085-f9e6-41a3-bcad-5a59e8b46a58 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:10.557894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809c5085-f9e6-41a3-bcad-5a59e8b46a58 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:10.558793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809c5085-f9e6-41a3-bcad-5a59e8b46a58 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:10.559721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809c5085-f9e6-41a3-bcad-5a59e8b46a58 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:10.562120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809c5085-f9e6-41a3-bcad-5a59e8b46a58 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:10.563420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809c5085-f9e6-41a3-bcad-5a59e8b46a58 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:10.564205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-809c5085-f9e6-41a3-bcad-5a59e8b46a58 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:11.152647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f89d2b7b-502e-440a-a4c8-85716e71be0c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:11.174555 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f89d2b7b-502e-440a-a4c8-85716e71be0c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1318 microversion: 2.1 time: 0.814518 Aug 25 13:14:11.176538 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1856/3747] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:10 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1318 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:11.189258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:11.191670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:11.209233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-809c5085-f9e6-41a3-bcad-5a59e8b46a58 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:11.211145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:11.212208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:11.213388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:11.215068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:11.216370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:11.217748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:11.243543 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-809c5085-f9e6-41a3-bcad-5a59e8b46a58 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1496 microversion: 2.1 time: 0.729066 Aug 25 13:14:11.245149 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1892/3748] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:10 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1496 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:11.509488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:11.536986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:11.540716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:11.543597 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-063d0bb1-97dc-498c-8e60-8a419fb5f838 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 200 len: 1339 microversion: 2.47 time: 0.363697 Aug 25 13:14:11.545955 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1857/3749] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:11 2022] GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 1339 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:12.232180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-828b90a3-36cb-4b37-9ec6-37348a77dbdf tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:12.240580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-828b90a3-36cb-4b37-9ec6-37348a77dbdf tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:12.294794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-828b90a3-36cb-4b37-9ec6-37348a77dbdf tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:12.297771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-828b90a3-36cb-4b37-9ec6-37348a77dbdf tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:12.299359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-828b90a3-36cb-4b37-9ec6-37348a77dbdf tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:12.307529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-828b90a3-36cb-4b37-9ec6-37348a77dbdf tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:12.308456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-828b90a3-36cb-4b37-9ec6-37348a77dbdf tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:12.309269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-828b90a3-36cb-4b37-9ec6-37348a77dbdf tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:12.618925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:12.623230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:12.683800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:12.692212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:12.693592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:12.698663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:12.700928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:12.702348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:13.063539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:13.113709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:13.131751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:13.135243 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bad70cc0-082d-443b-b542-7b47c0817172 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 200 len: 1339 microversion: 2.47 time: 0.535426 Aug 25 13:14:13.165560 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1858/3750] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:12 2022] GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 1339 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:13.327239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-828b90a3-36cb-4b37-9ec6-37348a77dbdf tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:13.383682 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-828b90a3-36cb-4b37-9ec6-37348a77dbdf tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1318 microversion: 2.1 time: 1.163831 Aug 25 13:14:13.385494 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1893/3751] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:12 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1318 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:14.182629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:14.183870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:14.211647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:14.213481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:14.223810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:14.225727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:14.226896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:14.230246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:14.446410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f2f46762-4e4f-4d6f-8d08-87ef2a82ae02 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:14.452313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f2f46762-4e4f-4d6f-8d08-87ef2a82ae02 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:14.477294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2f46762-4e4f-4d6f-8d08-87ef2a82ae02 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:14.486164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2f46762-4e4f-4d6f-8d08-87ef2a82ae02 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:14.489080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2f46762-4e4f-4d6f-8d08-87ef2a82ae02 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:14.491119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2f46762-4e4f-4d6f-8d08-87ef2a82ae02 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:14.492278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2f46762-4e4f-4d6f-8d08-87ef2a82ae02 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:14.494354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2f46762-4e4f-4d6f-8d08-87ef2a82ae02 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:14.998783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:15.031450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:15.034692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:15.038187 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1d3e1a66-90ef-45cc-a8d9-77630de4b4ee tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 200 len: 1360 microversion: 2.47 time: 0.863607 Aug 25 13:14:15.040138 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1859/3752] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:14 2022] GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 1360 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:14:15.094463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-56d4ee1a-1f2f-4094-8269-d2b3333f21c8 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-390010975"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:15.109687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-56d4ee1a-1f2f-4094-8269-d2b3333f21c8 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:15.135193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56d4ee1a-1f2f-4094-8269-d2b3333f21c8 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:15.136152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56d4ee1a-1f2f-4094-8269-d2b3333f21c8 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:15.136866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56d4ee1a-1f2f-4094-8269-d2b3333f21c8 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:15.138346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56d4ee1a-1f2f-4094-8269-d2b3333f21c8 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:15.139436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56d4ee1a-1f2f-4094-8269-d2b3333f21c8 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:15.140244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56d4ee1a-1f2f-4094-8269-d2b3333f21c8 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:15.352602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f2f46762-4e4f-4d6f-8d08-87ef2a82ae02 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:15.401435 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f2f46762-4e4f-4d6f-8d08-87ef2a82ae02 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1318 microversion: 2.1 time: 0.969317 Aug 25 13:14:15.402431 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1894/3753] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:14 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1318 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:15.882983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:15.962150 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-56d4ee1a-1f2f-4094-8269-d2b3333f21c8 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "POST /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a/action" status: 202 len: 52 microversion: 2.47 time: 0.869815 Aug 25 13:14:15.966856 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1860/3754] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 13:14:15 2022] POST /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a/action => generated 52 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Aug 25 13:14:15.998808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-49365de1-3d99-4b5f-98ee-f4d5333ae933 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:16.005301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-49365de1-3d99-4b5f-98ee-f4d5333ae933 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:16.048810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49365de1-3d99-4b5f-98ee-f4d5333ae933 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:16.050262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49365de1-3d99-4b5f-98ee-f4d5333ae933 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:16.051543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49365de1-3d99-4b5f-98ee-f4d5333ae933 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:16.058407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49365de1-3d99-4b5f-98ee-f4d5333ae933 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:16.061618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49365de1-3d99-4b5f-98ee-f4d5333ae933 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:16.063211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49365de1-3d99-4b5f-98ee-f4d5333ae933 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:16.163583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:16.201641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-49365de1-3d99-4b5f-98ee-f4d5333ae933 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:14:16.381104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:16.385526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:16.455162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ca96cfb0-fd01-423a-918d-4811f4c90c2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:16.458431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca96cfb0-fd01-423a-918d-4811f4c90c2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:16.500770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:16.513471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca96cfb0-fd01-423a-918d-4811f4c90c2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:16.515857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca96cfb0-fd01-423a-918d-4811f4c90c2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:16.522560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca96cfb0-fd01-423a-918d-4811f4c90c2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:16.530153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca96cfb0-fd01-423a-918d-4811f4c90c2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:16.541199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca96cfb0-fd01-423a-918d-4811f4c90c2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:16.544441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca96cfb0-fd01-423a-918d-4811f4c90c2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:16.559474 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-49365de1-3d99-4b5f-98ee-f4d5333ae933 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 204 len: 0 microversion: 2.47 time: 0.569509 Aug 25 13:14:16.561320 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1895/3755] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:14:15 2022] DELETE /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:14:16.580157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:16.586596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:16.611516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:16.613465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:16.619560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:16.621278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:16.622544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:16.623603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:16.927951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:16.953351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:16.972759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:16.985854 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5e90b1f5-ffc7-4e05-8fb6-d0586c3da542 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 200 len: 1366 microversion: 2.47 time: 0.405397 Aug 25 13:14:16.985854 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1896/3756] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:16 2022] GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:17.279570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ca96cfb0-fd01-423a-918d-4811f4c90c2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:17.326957 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ca96cfb0-fd01-423a-918d-4811f4c90c2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1318 microversion: 2.1 time: 0.878862 Aug 25 13:14:17.328117 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1861/3757] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:16 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1318 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:17.828481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d2f5116c-9d1d-4d1d-b347-ebdbee3f725d req-94e1c693-a5ea-4ddf-8d2c-7ac47168a699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7", "name": "network-vif-plugged", "status": "completed", "tag": "aa171f0d-a313-43dc-9f2d-ed2a01bbd0c6"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:17.871350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d2f5116c-9d1d-4d1d-b347-ebdbee3f725d req-94e1c693-a5ea-4ddf-8d2c-7ac47168a699 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:17.872654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d2f5116c-9d1d-4d1d-b347-ebdbee3f725d req-94e1c693-a5ea-4ddf-8d2c-7ac47168a699 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:17.872952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d2f5116c-9d1d-4d1d-b347-ebdbee3f725d req-94e1c693-a5ea-4ddf-8d2c-7ac47168a699 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:17.918615 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d2f5116c-9d1d-4d1d-b347-ebdbee3f725d req-94e1c693-a5ea-4ddf-8d2c-7ac47168a699 service nova] Creating event network-vif-plugged:aa171f0d-a313-43dc-9f2d-ed2a01bbd0c6 for instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 on n-h1-852771-8 Aug 25 13:14:17.940233 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d2f5116c-9d1d-4d1d-b347-ebdbee3f725d req-94e1c693-a5ea-4ddf-8d2c-7ac47168a699 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121786 Aug 25 13:14:17.952847 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1897/3758] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:18.027631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:18.039048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:18.060840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:18.064215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:18.065495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:18.066865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:18.069093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:18.076167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:18.076689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:18.386019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6a290f03-f0e8-4146-b416-5f87e3424c81 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:18.401688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6a290f03-f0e8-4146-b416-5f87e3424c81 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:18.421575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a290f03-f0e8-4146-b416-5f87e3424c81 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:18.423925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a290f03-f0e8-4146-b416-5f87e3424c81 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:18.425236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a290f03-f0e8-4146-b416-5f87e3424c81 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:18.427826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a290f03-f0e8-4146-b416-5f87e3424c81 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:18.428735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a290f03-f0e8-4146-b416-5f87e3424c81 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:18.429668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a290f03-f0e8-4146-b416-5f87e3424c81 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:19.138976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:19.172570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:19.176118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:19.179855 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d05e0a25-9596-4993-a86b-edb3cba39871 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 200 len: 1366 microversion: 2.47 time: 1.159548 Aug 25 13:14:19.194863 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1862/3759] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:18 2022] GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 1366 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:19.930371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6a290f03-f0e8-4146-b416-5f87e3424c81 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:19.965144 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6a290f03-f0e8-4146-b416-5f87e3424c81 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1318 microversion: 2.1 time: 1.591701 Aug 25 13:14:19.975544 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1898/3760] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:18 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1318 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:20.131880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0449c4f2-e59b-496e-8608-254e619930ef tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:20.133278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0449c4f2-e59b-496e-8608-254e619930ef tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:20.149625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0449c4f2-e59b-496e-8608-254e619930ef tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:20.151689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0449c4f2-e59b-496e-8608-254e619930ef tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:20.153894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0449c4f2-e59b-496e-8608-254e619930ef tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:20.155684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0449c4f2-e59b-496e-8608-254e619930ef tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:20.156847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0449c4f2-e59b-496e-8608-254e619930ef tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:20.158028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0449c4f2-e59b-496e-8608-254e619930ef tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:20.232741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0449c4f2-e59b-496e-8608-254e619930ef tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:14:20.262093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:20.275602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:20.341295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:20.344830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:20.347005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:20.369860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:20.382007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:20.386884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:20.555258 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0449c4f2-e59b-496e-8608-254e619930ef tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 204 len: 0 microversion: 2.1 time: 0.433515 Aug 25 13:14:20.556560 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1863/3761] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:14:20 2022] DELETE /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:14:20.571553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0d946ba-60a6-483c-9eb7-f0e165f9f277 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:20.572849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e0d946ba-60a6-483c-9eb7-f0e165f9f277 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:20.584431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d946ba-60a6-483c-9eb7-f0e165f9f277 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:20.585697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d946ba-60a6-483c-9eb7-f0e165f9f277 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:20.586948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d946ba-60a6-483c-9eb7-f0e165f9f277 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:20.588633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d946ba-60a6-483c-9eb7-f0e165f9f277 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:20.589819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d946ba-60a6-483c-9eb7-f0e165f9f277 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:20.592765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d946ba-60a6-483c-9eb7-f0e165f9f277 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:20.759949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:20.788125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:20.793393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:20.796269 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c390b1e5-e2bc-43be-8e7a-ef35e0df56bb tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 200 len: 1366 microversion: 2.47 time: 0.540894 Aug 25 13:14:20.798288 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1899/3762] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:20 2022] GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 1366 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:14:21.008725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-25a526fe-8af4-4d85-a6e5-d389c9f07202 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:21.009996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-25a526fe-8af4-4d85-a6e5-d389c9f07202 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:21.052874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25a526fe-8af4-4d85-a6e5-d389c9f07202 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:21.057852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25a526fe-8af4-4d85-a6e5-d389c9f07202 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:21.059217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25a526fe-8af4-4d85-a6e5-d389c9f07202 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:21.061031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25a526fe-8af4-4d85-a6e5-d389c9f07202 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:21.062791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25a526fe-8af4-4d85-a6e5-d389c9f07202 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:21.064127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25a526fe-8af4-4d85-a6e5-d389c9f07202 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:21.356546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e0d946ba-60a6-483c-9eb7-f0e165f9f277 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:21.396573 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0d946ba-60a6-483c-9eb7-f0e165f9f277 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1502 microversion: 2.1 time: 0.833445 Aug 25 13:14:21.397725 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1864/3763] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:20 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1502 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:21.589796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-25a526fe-8af4-4d85-a6e5-d389c9f07202 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:21.616699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-25a526fe-8af4-4d85-a6e5-d389c9f07202 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1318 microversion: 2.1 time: 0.618402 Aug 25 13:14:21.631890 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1900/3764] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:20 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:21.849357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:21.855232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:21.915297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:21.917604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:21.919128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:21.921101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:21.922370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:21.923481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:22.228434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:22.256050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:22.264241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ac24dc05e94521af9ec67e929e405f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba333f6082f4988a01972c8543701d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:22.266813 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-96c7d29f-06a9-4441-bbda-fff901653e50 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 200 len: 1366 microversion: 2.47 time: 0.427140 Aug 25 13:14:22.267930 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1865/3765] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:21 2022] GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:22.440837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b32118d3-9175-4841-85ca-08acb3e7acbd tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:22.443554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b32118d3-9175-4841-85ca-08acb3e7acbd tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:22.456686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b32118d3-9175-4841-85ca-08acb3e7acbd tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:22.458085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b32118d3-9175-4841-85ca-08acb3e7acbd tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:22.459355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b32118d3-9175-4841-85ca-08acb3e7acbd tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:22.461228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b32118d3-9175-4841-85ca-08acb3e7acbd tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:22.462406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b32118d3-9175-4841-85ca-08acb3e7acbd tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:22.463076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b32118d3-9175-4841-85ca-08acb3e7acbd tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:22.683412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c7571e3-47c8-41ce-8a4a-07b08c41705a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:22.689102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9c7571e3-47c8-41ce-8a4a-07b08c41705a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:22.726839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c7571e3-47c8-41ce-8a4a-07b08c41705a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:22.735327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c7571e3-47c8-41ce-8a4a-07b08c41705a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:22.736192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c7571e3-47c8-41ce-8a4a-07b08c41705a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:22.738052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c7571e3-47c8-41ce-8a4a-07b08c41705a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:22.739470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c7571e3-47c8-41ce-8a4a-07b08c41705a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:22.740602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c7571e3-47c8-41ce-8a4a-07b08c41705a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:23.867888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b32118d3-9175-4841-85ca-08acb3e7acbd tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:23.885948 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b32118d3-9175-4841-85ca-08acb3e7acbd tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1502 microversion: 2.1 time: 1.453354 Aug 25 13:14:23.902603 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1901/3766] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:22 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1502 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:23.924541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:23.925812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] [instance: 4b257fad-d1be-4105-9ed4-ef4eeab9de8a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:23.937447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:23.939093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:23.940219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:23.942688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:23.943839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:23.944936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:23.978148 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] HTTP exception thrown: Instance 4b257fad-d1be-4105-9ed4-ef4eeab9de8a could not be found. Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Request method failure captured: Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a HTTP/1.1 Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3WdfprCqz6sjvoQU8koDBAq4_jx1uDetx4HM27cTYP4ndRr_7cFiglZfvHpbGGq8IFFJkRYe2Aq1UZ9LJACULoXe_ixVvcj7H-_UJfNbHFgnqanAsnx7qR3RR5ZlZt5hogoK3zMt9hga3YCnpp-EbBwPWpqf3VtXILLzwxm0lT-luk Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.47 Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5ba333f6082f4988a01972c8543701d9 Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersAaction247Test-1036698114 Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5ba333f6082f4988a01972c8543701d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5ba333f6082f4988a01972c8543701d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5ba333f6082f4988a01972c8543701d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5ba333f6082f4988a01972c8543701d9"}]}] Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersAaction247Test-1036698114 Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5ba333f6082f4988a01972c8543701d9 Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersAaction247Test-1036698114 Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersAaction247Test-1036698114-project Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 96ac24dc05e94521af9ec67e929e405f Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersAaction247Test-1036698114-project Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 4b257fad-d1be-4105-9ed4-ef4eeab9de8a could not be found. Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '4b257fad-d1be-4105-9ed4-ef4eeab9de8a'} Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b257fad-d1be-4105-9ed4-ef4eeab9de8a could not be found. Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b257fad-d1be-4105-9ed4-ef4eeab9de8a could not be found. Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:23.983183 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:14:23.991045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:23.991045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:23.991045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:14:23.991045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:14:23.991045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:14:23.991045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:14:23.991045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b257fad-d1be-4105-9ed4-ef4eeab9de8a could not be found. Aug 25 13:14:23.991045 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:23.994166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] Returning 404 to user: Instance 4b257fad-d1be-4105-9ed4-ef4eeab9de8a could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:14:23.996167 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-320c7695-a380-41ab-befb-66b7abbed005 tempest-ServersAaction247Test-1036698114 tempest-ServersAaction247Test-1036698114-project] 10.222.0.70 "GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a" status: 404 len: 111 microversion: 2.47 time: 0.091116 Aug 25 13:14:24.003568 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1902/3767] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:23 2022] GET /compute/v2.1/servers/4b257fad-d1be-4105-9ed4-ef4eeab9de8a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:14:24.045707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9c7571e3-47c8-41ce-8a4a-07b08c41705a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:24.078934 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c7571e3-47c8-41ce-8a4a-07b08c41705a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1509 microversion: 2.1 time: 1.424649 Aug 25 13:14:24.082358 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1866/3768] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:22 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1509 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:24.134470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1313eeb4-e140-414e-81da-100749b28e3f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:24.136291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1313eeb4-e140-414e-81da-100749b28e3f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:24.161265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1313eeb4-e140-414e-81da-100749b28e3f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:24.162724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1313eeb4-e140-414e-81da-100749b28e3f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:24.164869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1313eeb4-e140-414e-81da-100749b28e3f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:24.166709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1313eeb4-e140-414e-81da-100749b28e3f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:24.169175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1313eeb4-e140-414e-81da-100749b28e3f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:24.170388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1313eeb4-e140-414e-81da-100749b28e3f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:24.833165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1313eeb4-e140-414e-81da-100749b28e3f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:24.853934 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1313eeb4-e140-414e-81da-100749b28e3f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1509 microversion: 2.1 time: 0.732353 Aug 25 13:14:24.856003 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1903/3769] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:24 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1509 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:24.898372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "OS-DCF:diskConfig": "AUTO"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:24.903949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:24.921088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:24.923024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:24.924332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:24.926211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:24.927528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:24.928583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:24.938342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df870fc8-c0c6-4d91-9f46-13dde6b3aab8 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:24.939624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-df870fc8-c0c6-4d91-9f46-13dde6b3aab8 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:24.976915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df870fc8-c0c6-4d91-9f46-13dde6b3aab8 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:24.979698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df870fc8-c0c6-4d91-9f46-13dde6b3aab8 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:24.983702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df870fc8-c0c6-4d91-9f46-13dde6b3aab8 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:24.988593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df870fc8-c0c6-4d91-9f46-13dde6b3aab8 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:24.990444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df870fc8-c0c6-4d91-9f46-13dde6b3aab8 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:24.992720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df870fc8-c0c6-4d91-9f46-13dde6b3aab8 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:25.182795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:14:25.184707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:14:25.186030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:14:25.187112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:14:25.188371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:14:25.345045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:25.361685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:25.363842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:25.365043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:25.368189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:25.369890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:25.371549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:25.463824 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9a5c3fec-2efb-446f-bdad-d06b8b38ae15 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "POST /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7/action" status: 202 len: 1111 microversion: 2.1 time: 0.573629 Aug 25 13:14:25.465935 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1867/3770] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:14:24 2022] POST /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7/action => generated 1111 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 25 13:14:25.510202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e2bd5b84-6dc5-4f23-93f4-c9d68ef10bd9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:25.511439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e2bd5b84-6dc5-4f23-93f4-c9d68ef10bd9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:25.525090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2bd5b84-6dc5-4f23-93f4-c9d68ef10bd9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:25.526525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2bd5b84-6dc5-4f23-93f4-c9d68ef10bd9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:25.527729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2bd5b84-6dc5-4f23-93f4-c9d68ef10bd9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:25.529551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2bd5b84-6dc5-4f23-93f4-c9d68ef10bd9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:25.530858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2bd5b84-6dc5-4f23-93f4-c9d68ef10bd9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:25.532062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2bd5b84-6dc5-4f23-93f4-c9d68ef10bd9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:25.868550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df870fc8-c0c6-4d91-9f46-13dde6b3aab8 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:25.905083 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-df870fc8-c0c6-4d91-9f46-13dde6b3aab8 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1502 microversion: 2.1 time: 0.978756 Aug 25 13:14:25.918130 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1904/3771] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:24 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1502 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:26.126271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1b872065-e690-4a7e-999d-0db150ed7e1c req-48001a42-ccf6-47e3-8c93-19384d958900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed5efd0-ede4-4734-9fb2-ed6b45a87378", "name": "network-vif-deleted", "tag": "5089f640-307f-4fd9-88e9-71c9032dd72e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:26.181056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1b872065-e690-4a7e-999d-0db150ed7e1c req-48001a42-ccf6-47e3-8c93-19384d958900 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:26.186859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1b872065-e690-4a7e-999d-0db150ed7e1c req-48001a42-ccf6-47e3-8c93-19384d958900 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:26.189228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1b872065-e690-4a7e-999d-0db150ed7e1c req-48001a42-ccf6-47e3-8c93-19384d958900 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:26.227107 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1b872065-e690-4a7e-999d-0db150ed7e1c req-48001a42-ccf6-47e3-8c93-19384d958900 service nova] Creating event network-vif-deleted:5089f640-307f-4fd9-88e9-71c9032dd72e for instance 8ed5efd0-ede4-4734-9fb2-ed6b45a87378 on n-h1-852771-8 Aug 25 13:14:26.242557 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1b872065-e690-4a7e-999d-0db150ed7e1c req-48001a42-ccf6-47e3-8c93-19384d958900 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130301 Aug 25 13:14:26.244924 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1905/3772] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:14:26.990759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:26.994560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:27.030155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:27.038794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:27.040089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:27.042511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:27.052618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:27.054262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:27.214669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:27.219358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:27.220758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:27.221770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lazy-loading 'fault' on Instance uuid 8ed5efd0-ede4-4734-9fb2-ed6b45a87378 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:14:27.477068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e2bd5b84-6dc5-4f23-93f4-c9d68ef10bd9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:27.508625 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e2bd5b84-6dc5-4f23-93f4-c9d68ef10bd9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 2.007866 Aug 25 13:14:27.522772 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1868/3773] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:25 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:27.561000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf781b69f67454dae3d3b4115983d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd519c9d05ff438284c759675ac89baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:27.586226 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-121f06e5-428a-4e58-a234-0dab46b2e7f4 tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 200 len: 1303 microversion: 2.1 time: 0.629837 Aug 25 13:14:27.603418 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1906/3774] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:26 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 1303 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:28.576662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-736cf4d4-6ba0-4083-9318-75ff1d0b9f4f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:28.585542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-736cf4d4-6ba0-4083-9318-75ff1d0b9f4f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:28.631552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:28.640129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] [instance: 8ed5efd0-ede4-4734-9fb2-ed6b45a87378] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:28.645424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-736cf4d4-6ba0-4083-9318-75ff1d0b9f4f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:28.654912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-736cf4d4-6ba0-4083-9318-75ff1d0b9f4f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:28.658729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-736cf4d4-6ba0-4083-9318-75ff1d0b9f4f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:28.665301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-736cf4d4-6ba0-4083-9318-75ff1d0b9f4f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:28.680111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-736cf4d4-6ba0-4083-9318-75ff1d0b9f4f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:28.682688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-736cf4d4-6ba0-4083-9318-75ff1d0b9f4f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:28.686903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:28.696886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:28.701410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:28.703381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:28.712512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:28.714157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:28.810504 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] HTTP exception thrown: Instance 8ed5efd0-ede4-4734-9fb2-ed6b45a87378 could not be found. Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Request method failure captured: Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 HTTP/1.1 Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3V87JKD7mo_pIwN_8U4ERjWNB3hfsGerOTXput982eonCRIlL_GhCHPXc4xhWX4TZQ8jgml5oVz2wvQcbiVbjx2uQfIlIRWbhTZk9bX97B-szKV5CPFNZggRvzEE_VS2cybw2XjsE042XsRrxy9cinKFQhAygcFCfcjowrth-eLP4I Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: cd519c9d05ff438284c759675ac89baf Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesActionsTest-1864216278 Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd519c9d05ff438284c759675ac89baf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd519c9d05ff438284c759675ac89baf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd519c9d05ff438284c759675ac89baf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd519c9d05ff438284c759675ac89baf"}]}] Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesActionsTest-1864216278 Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: cd519c9d05ff438284c759675ac89baf Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesActionsTest-1864216278 Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesActionsTest-1864216278-project Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bcf781b69f67454dae3d3b4115983d23 Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesActionsTest-1864216278-project Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 8ed5efd0-ede4-4734-9fb2-ed6b45a87378 could not be found. Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '8ed5efd0-ede4-4734-9fb2-ed6b45a87378'} Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed5efd0-ede4-4734-9fb2-ed6b45a87378 could not be found. Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed5efd0-ede4-4734-9fb2-ed6b45a87378 could not be found. Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:14:28.814864 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:28.823878 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:28.823878 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:14:28.823878 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:14:28.823878 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:14:28.823878 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:14:28.823878 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed5efd0-ede4-4734-9fb2-ed6b45a87378 could not be found. Aug 25 13:14:28.823878 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:14:28.823878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] Returning 404 to user: Instance 8ed5efd0-ede4-4734-9fb2-ed6b45a87378 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:14:28.823878 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0bbd2c71-a0ff-4527-b52a-1348dc1094ac tempest-VolumesActionsTest-1864216278 tempest-VolumesActionsTest-1864216278-project] 10.222.0.70 "GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378" status: 404 len: 111 microversion: 2.1 time: 0.194946 Aug 25 13:14:28.823878 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1907/3775] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:28 2022] GET /compute/v2.1/servers/8ed5efd0-ede4-4734-9fb2-ed6b45a87378 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:14:29.984250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-736cf4d4-6ba0-4083-9318-75ff1d0b9f4f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:30.037726 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-736cf4d4-6ba0-4083-9318-75ff1d0b9f4f tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 1.479138 Aug 25 13:14:30.043530 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1869/3776] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:28 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:30.618635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a428583-d36a-4645-a573-e7e8ac4dc4d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:30.629925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a428583-d36a-4645-a573-e7e8ac4dc4d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:30.658407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:30.758325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a428583-d36a-4645-a573-e7e8ac4dc4d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:30.763561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a428583-d36a-4645-a573-e7e8ac4dc4d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:30.767118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a428583-d36a-4645-a573-e7e8ac4dc4d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:30.780891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a428583-d36a-4645-a573-e7e8ac4dc4d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:30.793905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a428583-d36a-4645-a573-e7e8ac4dc4d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:30.795021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a428583-d36a-4645-a573-e7e8ac4dc4d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:31.090855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f786a73c-635c-4fee-8fa8-587f4d050fdc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:31.102509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f786a73c-635c-4fee-8fa8-587f4d050fdc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:31.157927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f786a73c-635c-4fee-8fa8-587f4d050fdc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:31.182533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f786a73c-635c-4fee-8fa8-587f4d050fdc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:31.183380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f786a73c-635c-4fee-8fa8-587f4d050fdc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:31.184824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f786a73c-635c-4fee-8fa8-587f4d050fdc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:31.196449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f786a73c-635c-4fee-8fa8-587f4d050fdc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:31.198022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f786a73c-635c-4fee-8fa8-587f4d050fdc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:31.460889 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a428583-d36a-4645-a573-e7e8ac4dc4d0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.833160 Aug 25 13:14:31.468810 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1908/3777] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:14:30 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:14:31.555976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-771a3f72-2938-4940-a1db-1631cdfd0c8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:31.562632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-771a3f72-2938-4940-a1db-1631cdfd0c8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:31.647744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771a3f72-2938-4940-a1db-1631cdfd0c8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:31.648828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771a3f72-2938-4940-a1db-1631cdfd0c8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:31.649721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771a3f72-2938-4940-a1db-1631cdfd0c8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:31.674280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771a3f72-2938-4940-a1db-1631cdfd0c8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:31.677381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771a3f72-2938-4940-a1db-1631cdfd0c8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:31.679009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771a3f72-2938-4940-a1db-1631cdfd0c8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:33.021851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-771a3f72-2938-4940-a1db-1631cdfd0c8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:33.060843 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-771a3f72-2938-4940-a1db-1631cdfd0c8e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1669 microversion: 2.1 time: 1.578987 Aug 25 13:14:33.061963 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1909/3778] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:31 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1669 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:33.294724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f786a73c-635c-4fee-8fa8-587f4d050fdc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:33.344768 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f786a73c-635c-4fee-8fa8-587f4d050fdc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 2.258001 Aug 25 13:14:33.367244 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1870/3779] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:31 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:34.113061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f1b0114-238c-421b-9e99-9f757333d047 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:34.119057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f1b0114-238c-421b-9e99-9f757333d047 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:34.160442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1b0114-238c-421b-9e99-9f757333d047 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:34.165579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1b0114-238c-421b-9e99-9f757333d047 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:34.169335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1b0114-238c-421b-9e99-9f757333d047 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:34.171161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1b0114-238c-421b-9e99-9f757333d047 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:34.176524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1b0114-238c-421b-9e99-9f757333d047 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:34.177590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1b0114-238c-421b-9e99-9f757333d047 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:34.401855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ee44094-8bb2-4fad-8fca-5b042758566a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:34.407664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5ee44094-8bb2-4fad-8fca-5b042758566a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:34.470449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ee44094-8bb2-4fad-8fca-5b042758566a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:34.477094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ee44094-8bb2-4fad-8fca-5b042758566a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:34.483621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ee44094-8bb2-4fad-8fca-5b042758566a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:34.491080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ee44094-8bb2-4fad-8fca-5b042758566a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:34.493290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ee44094-8bb2-4fad-8fca-5b042758566a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:34.494318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ee44094-8bb2-4fad-8fca-5b042758566a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:35.069820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f1b0114-238c-421b-9e99-9f757333d047 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:35.099090 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f1b0114-238c-421b-9e99-9f757333d047 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1669 microversion: 2.1 time: 0.993104 Aug 25 13:14:35.104117 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1910/3780] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:34 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1669 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:35.581646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5ee44094-8bb2-4fad-8fca-5b042758566a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:35.605914 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ee44094-8bb2-4fad-8fca-5b042758566a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 1.223712 Aug 25 13:14:35.630879 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1871/3781] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:34 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:36.151577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e6569697-5209-4e93-a980-1b78d3b0c533 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:36.157181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e6569697-5209-4e93-a980-1b78d3b0c533 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:36.190832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6569697-5209-4e93-a980-1b78d3b0c533 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:36.192441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6569697-5209-4e93-a980-1b78d3b0c533 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:36.196302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6569697-5209-4e93-a980-1b78d3b0c533 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:36.199061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6569697-5209-4e93-a980-1b78d3b0c533 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:36.204278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6569697-5209-4e93-a980-1b78d3b0c533 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:36.206988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6569697-5209-4e93-a980-1b78d3b0c533 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:36.663616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b58540f7-162c-47ed-b584-659320da9568 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:36.669995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b58540f7-162c-47ed-b584-659320da9568 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:36.708241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58540f7-162c-47ed-b584-659320da9568 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:36.709678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58540f7-162c-47ed-b584-659320da9568 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:36.712443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58540f7-162c-47ed-b584-659320da9568 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:36.715451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58540f7-162c-47ed-b584-659320da9568 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:36.725372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58540f7-162c-47ed-b584-659320da9568 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:36.726793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b58540f7-162c-47ed-b584-659320da9568 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:37.002499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e6569697-5209-4e93-a980-1b78d3b0c533 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:37.046235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:37.068474 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e6569697-5209-4e93-a980-1b78d3b0c533 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1669 microversion: 2.1 time: 0.926404 Aug 25 13:14:37.080994 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1911/3782] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:36 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1669 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:37.417294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b58540f7-162c-47ed-b584-659320da9568 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:37.457206 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b58540f7-162c-47ed-b584-659320da9568 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 0.800624 Aug 25 13:14:37.462191 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1872/3783] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:36 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:38.115703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0647e3af-6781-46bc-92c1-b93d9e599527 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:38.140728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0647e3af-6781-46bc-92c1-b93d9e599527 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:38.178529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0647e3af-6781-46bc-92c1-b93d9e599527 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:38.179409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0647e3af-6781-46bc-92c1-b93d9e599527 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:38.193043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0647e3af-6781-46bc-92c1-b93d9e599527 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:38.198284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0647e3af-6781-46bc-92c1-b93d9e599527 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:38.205615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0647e3af-6781-46bc-92c1-b93d9e599527 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:38.207195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0647e3af-6781-46bc-92c1-b93d9e599527 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:38.499143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3fa321a-d803-471f-8025-8320392e6c8b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:38.504286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c3fa321a-d803-471f-8025-8320392e6c8b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:38.536480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3fa321a-d803-471f-8025-8320392e6c8b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:38.537479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3fa321a-d803-471f-8025-8320392e6c8b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:38.538325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3fa321a-d803-471f-8025-8320392e6c8b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:38.539719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3fa321a-d803-471f-8025-8320392e6c8b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:38.541188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3fa321a-d803-471f-8025-8320392e6c8b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:38.548623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3fa321a-d803-471f-8025-8320392e6c8b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:39.369262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0647e3af-6781-46bc-92c1-b93d9e599527 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:39.395957 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0647e3af-6781-46bc-92c1-b93d9e599527 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.291606 Aug 25 13:14:39.397037 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1912/3784] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:38 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:39.550709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3fa321a-d803-471f-8025-8320392e6c8b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:39.556165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:39.613745 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3fa321a-d803-471f-8025-8320392e6c8b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 1.106014 Aug 25 13:14:39.615238 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1873/3785] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:38 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:40.680593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-da73500a-4223-4e85-a6a9-2543ae2e6f59 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:40.683320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-da73500a-4223-4e85-a6a9-2543ae2e6f59 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:40.695159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da73500a-4223-4e85-a6a9-2543ae2e6f59 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:40.701371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da73500a-4223-4e85-a6a9-2543ae2e6f59 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:40.702658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da73500a-4223-4e85-a6a9-2543ae2e6f59 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:40.709136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da73500a-4223-4e85-a6a9-2543ae2e6f59 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:40.710364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da73500a-4223-4e85-a6a9-2543ae2e6f59 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:40.711403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da73500a-4223-4e85-a6a9-2543ae2e6f59 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:40.952537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-16888396", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:41.249123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] validate_networks() for [('a93c3507-9ff2-4777-a7c1-69c8a703a9b6', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:14:43.081985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-da73500a-4223-4e85-a6a9-2543ae2e6f59 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:43.107398 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-da73500a-4223-4e85-a6a9-2543ae2e6f59 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 2.451035 Aug 25 13:14:43.118589 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1874/3786] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:40 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 2464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:44.178680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2418307-cd4b-46fb-8153-e8aa6d19e45a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:44.179945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2418307-cd4b-46fb-8153-e8aa6d19e45a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:44.203601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2418307-cd4b-46fb-8153-e8aa6d19e45a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:44.205090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2418307-cd4b-46fb-8153-e8aa6d19e45a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:44.205292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2418307-cd4b-46fb-8153-e8aa6d19e45a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:44.206757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2418307-cd4b-46fb-8153-e8aa6d19e45a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:44.207621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2418307-cd4b-46fb-8153-e8aa6d19e45a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:44.214541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2418307-cd4b-46fb-8153-e8aa6d19e45a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:46.490737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2418307-cd4b-46fb-8153-e8aa6d19e45a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:46.602551 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2418307-cd4b-46fb-8153-e8aa6d19e45a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 2.443507 Aug 25 13:14:46.609900 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1875/3787] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:44 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:46.841768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:14:46.842668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:14:46.843380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:14:46.845606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:14:46.850070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:14:46.877346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:46.887587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:46.889236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:46.894490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:46.898703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:46.900267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:46.986146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Getting quotas for project f9c8fc08eb5b483a90fa0ef5bc79b8cd. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:14:47.005439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Getting quotas for user acdd3d6ee64a4a3d8182c73efb372e6c and project f9c8fc08eb5b483a90fa0ef5bc79b8cd. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:14:47.069933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:14:47.081794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:14:47.389442 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-05ad12cf-f72f-4880-94ff-8f64c93030d9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.984665 Aug 25 13:14:47.404805 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1913/3788] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:14:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 7998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:14:47.421124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d9c2e55e-7f0b-4f22-b889-a9e2cdc06ff7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:47.430119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d9c2e55e-7f0b-4f22-b889-a9e2cdc06ff7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:47.463498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:47.653971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-37a749cf-ad8f-4774-ae4d-1d3582c8764d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:47.655146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-37a749cf-ad8f-4774-ae4d-1d3582c8764d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:47.720071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37a749cf-ad8f-4774-ae4d-1d3582c8764d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:47.720964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37a749cf-ad8f-4774-ae4d-1d3582c8764d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:47.730904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37a749cf-ad8f-4774-ae4d-1d3582c8764d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:47.738676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37a749cf-ad8f-4774-ae4d-1d3582c8764d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:47.739807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37a749cf-ad8f-4774-ae4d-1d3582c8764d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:47.744067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37a749cf-ad8f-4774-ae4d-1d3582c8764d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:48.559002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d9c2e55e-7f0b-4f22-b889-a9e2cdc06ff7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:48.622164 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d9c2e55e-7f0b-4f22-b889-a9e2cdc06ff7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1215 microversion: 2.1 time: 1.218473 Aug 25 13:14:48.623134 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1876/3789] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:47 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1215 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:49.022325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-37a749cf-ad8f-4774-ae4d-1d3582c8764d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:49.072072 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-37a749cf-ad8f-4774-ae4d-1d3582c8764d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 1.425697 Aug 25 13:14:49.077625 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1914/3790] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:47 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:49.665753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ece7bb48-903e-4404-91ff-385d729077da tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:49.666786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ece7bb48-903e-4404-91ff-385d729077da tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:50.100048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ece7bb48-903e-4404-91ff-385d729077da tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:50.125296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-58a22314-baef-4146-91d6-850ac182223d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:50.128628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-58a22314-baef-4146-91d6-850ac182223d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:50.164838 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ece7bb48-903e-4404-91ff-385d729077da tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1215 microversion: 2.1 time: 0.504111 Aug 25 13:14:50.178768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58a22314-baef-4146-91d6-850ac182223d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:50.182299 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1877/3791] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:49 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1215 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:50.186139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58a22314-baef-4146-91d6-850ac182223d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:50.192237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58a22314-baef-4146-91d6-850ac182223d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:50.195102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58a22314-baef-4146-91d6-850ac182223d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:50.196556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58a22314-baef-4146-91d6-850ac182223d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:50.197851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-58a22314-baef-4146-91d6-850ac182223d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:50.806502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-58a22314-baef-4146-91d6-850ac182223d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:50.833452 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-58a22314-baef-4146-91d6-850ac182223d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 0.716013 Aug 25 13:14:50.834817 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1915/3792] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:50 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:51.229847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ac8d493f-efe1-4e86-8320-d3de6a5bb6f6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:51.243934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ac8d493f-efe1-4e86-8320-d3de6a5bb6f6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:51.342750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac8d493f-efe1-4e86-8320-d3de6a5bb6f6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:51.349618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac8d493f-efe1-4e86-8320-d3de6a5bb6f6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:51.354075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac8d493f-efe1-4e86-8320-d3de6a5bb6f6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:51.358482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac8d493f-efe1-4e86-8320-d3de6a5bb6f6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:51.370746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac8d493f-efe1-4e86-8320-d3de6a5bb6f6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:51.374266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac8d493f-efe1-4e86-8320-d3de6a5bb6f6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:51.784762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ac8d493f-efe1-4e86-8320-d3de6a5bb6f6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:51.842857 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ac8d493f-efe1-4e86-8320-d3de6a5bb6f6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1285 microversion: 2.1 time: 0.634114 Aug 25 13:14:51.870150 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1878/3793] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:51 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1285 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:51.895878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4e63b591-d01e-48f8-a281-e3fb362f6792 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:51.898753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4e63b591-d01e-48f8-a281-e3fb362f6792 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:51.932010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e63b591-d01e-48f8-a281-e3fb362f6792 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:51.934879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e63b591-d01e-48f8-a281-e3fb362f6792 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:51.937733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e63b591-d01e-48f8-a281-e3fb362f6792 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:51.941052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e63b591-d01e-48f8-a281-e3fb362f6792 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:51.942899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e63b591-d01e-48f8-a281-e3fb362f6792 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:51.950061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e63b591-d01e-48f8-a281-e3fb362f6792 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:52.619904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4e63b591-d01e-48f8-a281-e3fb362f6792 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:52.652962 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4e63b591-d01e-48f8-a281-e3fb362f6792 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1516 microversion: 2.1 time: 0.779177 Aug 25 13:14:52.659448 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1879/3794] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:51 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1516 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:52.897598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aeae795f-97b3-451a-9e99-8f31519753c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:52.898389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aeae795f-97b3-451a-9e99-8f31519753c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:52.907995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-55298978", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "80839a59-142e-4d1d-8902-89cc3d6af65b"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:52.938719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeae795f-97b3-451a-9e99-8f31519753c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:52.940102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeae795f-97b3-451a-9e99-8f31519753c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:52.940299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeae795f-97b3-451a-9e99-8f31519753c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:52.953391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeae795f-97b3-451a-9e99-8f31519753c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:52.958874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeae795f-97b3-451a-9e99-8f31519753c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:52.961432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aeae795f-97b3-451a-9e99-8f31519753c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:53.188234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] validate_networks() for [('80839a59-142e-4d1d-8902-89cc3d6af65b', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:14:53.698676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aeae795f-97b3-451a-9e99-8f31519753c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:53.734092 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aeae795f-97b3-451a-9e99-8f31519753c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1273 microversion: 2.1 time: 0.847451 Aug 25 13:14:53.746391 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1880/3795] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:52 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1273 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:53.779399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eca61242-f832-44fc-aaf2-6d8f82ce5e6e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:53.780884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eca61242-f832-44fc-aaf2-6d8f82ce5e6e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:53.819135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eca61242-f832-44fc-aaf2-6d8f82ce5e6e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:53.821986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eca61242-f832-44fc-aaf2-6d8f82ce5e6e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:53.823722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eca61242-f832-44fc-aaf2-6d8f82ce5e6e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:53.826434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eca61242-f832-44fc-aaf2-6d8f82ce5e6e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:53.835061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eca61242-f832-44fc-aaf2-6d8f82ce5e6e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:53.837008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eca61242-f832-44fc-aaf2-6d8f82ce5e6e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:55.221020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eca61242-f832-44fc-aaf2-6d8f82ce5e6e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:55.250884 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eca61242-f832-44fc-aaf2-6d8f82ce5e6e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1522 microversion: 2.1 time: 1.502442 Aug 25 13:14:55.266111 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1881/3796] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:53 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1522 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:55.276509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-35af96cb-3f28-4d2d-980f-68be2a7ed107 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:55.288086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-35af96cb-3f28-4d2d-980f-68be2a7ed107 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:55.318205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35af96cb-3f28-4d2d-980f-68be2a7ed107 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:55.326395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35af96cb-3f28-4d2d-980f-68be2a7ed107 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:55.327572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35af96cb-3f28-4d2d-980f-68be2a7ed107 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:55.334461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35af96cb-3f28-4d2d-980f-68be2a7ed107 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:55.335526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35af96cb-3f28-4d2d-980f-68be2a7ed107 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:55.336335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35af96cb-3f28-4d2d-980f-68be2a7ed107 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:55.474523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:14:55.475229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:14:55.476107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:14:55.476940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:14:55.477747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:14:55.524735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:55.527565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:55.534932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:55.536977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:55.544787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:55.546307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:55.634619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Getting quotas for project d8b38448af0648bb8bb595ef7cf8592b. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:14:55.662949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Getting quotas for user dbd0b7a9d42d44df875ee755f862ba96 and project d8b38448af0648bb8bb595ef7cf8592b. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:14:55.762233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:14:55.766826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:14:55.850435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-35af96cb-3f28-4d2d-980f-68be2a7ed107 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:55.892628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-35af96cb-3f28-4d2d-980f-68be2a7ed107 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1315 microversion: 2.1 time: 0.624495 Aug 25 13:14:55.914811 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1882/3797] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:55 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:56.032545 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f1fe54aa-ac77-4dca-9c30-c037e7abe8e6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.317907 Aug 25 13:14:56.039796 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1916/3798] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:14:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:14:56.060210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-def43e15-3f64-41dc-b9d2-0f19d39157f6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:56.061371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-def43e15-3f64-41dc-b9d2-0f19d39157f6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:56.272827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-def43e15-3f64-41dc-b9d2-0f19d39157f6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:56.297846 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-def43e15-3f64-41dc-b9d2-0f19d39157f6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1230 microversion: 2.1 time: 0.244718 Aug 25 13:14:56.306800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-282d925d-3475-4eed-8090-807a4c32f0ca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:56.307990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-282d925d-3475-4eed-8090-807a4c32f0ca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:56.315005 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1883/3799] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:56 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1230 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:56.344671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282d925d-3475-4eed-8090-807a4c32f0ca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:56.345582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282d925d-3475-4eed-8090-807a4c32f0ca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:56.346352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282d925d-3475-4eed-8090-807a4c32f0ca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:56.348304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282d925d-3475-4eed-8090-807a4c32f0ca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:56.349135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282d925d-3475-4eed-8090-807a4c32f0ca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:56.350003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282d925d-3475-4eed-8090-807a4c32f0ca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:56.953840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-282d925d-3475-4eed-8090-807a4c32f0ca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:56.957156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0016a56-8762-4f3c-a917-9e4c8b62321b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:56.965667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c0016a56-8762-4f3c-a917-9e4c8b62321b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:56.995894 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-282d925d-3475-4eed-8090-807a4c32f0ca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1522 microversion: 2.1 time: 0.696792 Aug 25 13:14:56.998444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0016a56-8762-4f3c-a917-9e4c8b62321b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:56.999246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0016a56-8762-4f3c-a917-9e4c8b62321b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:56.999734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0016a56-8762-4f3c-a917-9e4c8b62321b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:57.000893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0016a56-8762-4f3c-a917-9e4c8b62321b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:57.006676 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1917/3800] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:56 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:57.029980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0016a56-8762-4f3c-a917-9e4c8b62321b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:57.033919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0016a56-8762-4f3c-a917-9e4c8b62321b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:57.350577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dcdd8dc9-5f92-4939-aff5-9a11308f15d2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:57.356120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dcdd8dc9-5f92-4939-aff5-9a11308f15d2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:57.881989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dcdd8dc9-5f92-4939-aff5-9a11308f15d2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:57.933556 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dcdd8dc9-5f92-4939-aff5-9a11308f15d2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1230 microversion: 2.1 time: 0.589132 Aug 25 13:14:57.933556 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1918/3801] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:57 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1230 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:57.968254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d631e16c-0996-4e5f-81a9-88e88a5dfbdd req-b49fdfac-355e-475e-b8e4-6dd00ef0ebc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6362fd-0197-4636-8a8d-6814ba103aed", "tag": "221908ac-54e5-4185-a673-1a922869d2b5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:58.017715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d631e16c-0996-4e5f-81a9-88e88a5dfbdd req-b49fdfac-355e-475e-b8e4-6dd00ef0ebc1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:58.019244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d631e16c-0996-4e5f-81a9-88e88a5dfbdd req-b49fdfac-355e-475e-b8e4-6dd00ef0ebc1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:58.024290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d631e16c-0996-4e5f-81a9-88e88a5dfbdd req-b49fdfac-355e-475e-b8e4-6dd00ef0ebc1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:58.101584 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d631e16c-0996-4e5f-81a9-88e88a5dfbdd req-b49fdfac-355e-475e-b8e4-6dd00ef0ebc1 service nova] Creating event network-changed:221908ac-54e5-4185-a673-1a922869d2b5 for instance cc6362fd-0197-4636-8a8d-6814ba103aed on n-h2-852771-8 Aug 25 13:14:58.131718 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d631e16c-0996-4e5f-81a9-88e88a5dfbdd req-b49fdfac-355e-475e-b8e4-6dd00ef0ebc1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190532 Aug 25 13:14:58.150836 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1919/3802] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:58.169926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-adaaf632-d0c3-419c-84e0-1a3e00f37d7c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:58.171343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-adaaf632-d0c3-419c-84e0-1a3e00f37d7c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:58.209134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adaaf632-d0c3-419c-84e0-1a3e00f37d7c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:58.226351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adaaf632-d0c3-419c-84e0-1a3e00f37d7c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:58.227288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adaaf632-d0c3-419c-84e0-1a3e00f37d7c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:58.228690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adaaf632-d0c3-419c-84e0-1a3e00f37d7c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:58.229609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adaaf632-d0c3-419c-84e0-1a3e00f37d7c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:58.230407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adaaf632-d0c3-419c-84e0-1a3e00f37d7c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:58.682930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c0016a56-8762-4f3c-a917-9e4c8b62321b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:58.710996 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0016a56-8762-4f3c-a917-9e4c8b62321b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1315 microversion: 2.1 time: 1.762536 Aug 25 13:14:58.725906 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1884/3803] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:56 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1315 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:58.740195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8c2198e8-1269-4aff-9732-807e483fa35f req-67c87af7-2865-49df-9938-d17434f4013f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7", "name": "network-vif-unplugged", "status": "completed", "tag": "aa171f0d-a313-43dc-9f2d-ed2a01bbd0c6"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:58.786785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8c2198e8-1269-4aff-9732-807e483fa35f req-67c87af7-2865-49df-9938-d17434f4013f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:58.788589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8c2198e8-1269-4aff-9732-807e483fa35f req-67c87af7-2865-49df-9938-d17434f4013f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:58.792254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8c2198e8-1269-4aff-9732-807e483fa35f req-67c87af7-2865-49df-9938-d17434f4013f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:58.847826 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8c2198e8-1269-4aff-9732-807e483fa35f req-67c87af7-2865-49df-9938-d17434f4013f service nova] Creating event network-vif-unplugged:aa171f0d-a313-43dc-9f2d-ed2a01bbd0c6 for instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 on n-h1-852771-8 Aug 25 13:14:58.877631 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8c2198e8-1269-4aff-9732-807e483fa35f req-67c87af7-2865-49df-9938-d17434f4013f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151308 Aug 25 13:14:58.884370 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1885/3804] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:58.966391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f139591-ad97-4747-a248-8881ad033e69 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:58.967811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f139591-ad97-4747-a248-8881ad033e69 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:59.008583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f139591-ad97-4747-a248-8881ad033e69 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:59.009269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f139591-ad97-4747-a248-8881ad033e69 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:59.025873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f139591-ad97-4747-a248-8881ad033e69 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:59.030041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f139591-ad97-4747-a248-8881ad033e69 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:59.036740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f139591-ad97-4747-a248-8881ad033e69 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:59.042238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f139591-ad97-4747-a248-8881ad033e69 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:59.173267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-adaaf632-d0c3-419c-84e0-1a3e00f37d7c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:59.205461 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-adaaf632-d0c3-419c-84e0-1a3e00f37d7c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1522 microversion: 2.1 time: 1.052083 Aug 25 13:14:59.207869 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1920/3805] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:58 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1522 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:59.515158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2f139591-ad97-4747-a248-8881ad033e69 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:59.544310 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f139591-ad97-4747-a248-8881ad033e69 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1282 microversion: 2.1 time: 0.585874 Aug 25 13:14:59.559057 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1886/3806] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:58 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1282 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:59.774137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5635606f-420f-4ded-b499-abe3350ad703 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:59.777191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5635606f-420f-4ded-b499-abe3350ad703 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:59.810511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5635606f-420f-4ded-b499-abe3350ad703 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:59.811850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5635606f-420f-4ded-b499-abe3350ad703 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:59.822811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5635606f-420f-4ded-b499-abe3350ad703 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:59.834479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5635606f-420f-4ded-b499-abe3350ad703 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:59.835477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5635606f-420f-4ded-b499-abe3350ad703 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:59.838087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5635606f-420f-4ded-b499-abe3350ad703 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:00.266529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-676b1ac8-a1b0-4366-9e4a-711c50b1241b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:00.267790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-676b1ac8-a1b0-4366-9e4a-711c50b1241b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:00.322312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-676b1ac8-a1b0-4366-9e4a-711c50b1241b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:00.323169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-676b1ac8-a1b0-4366-9e4a-711c50b1241b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:00.323922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-676b1ac8-a1b0-4366-9e4a-711c50b1241b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:00.334700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-676b1ac8-a1b0-4366-9e4a-711c50b1241b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:00.335735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-676b1ac8-a1b0-4366-9e4a-711c50b1241b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:00.336558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-676b1ac8-a1b0-4366-9e4a-711c50b1241b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:00.636259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5635606f-420f-4ded-b499-abe3350ad703 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:00.681460 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5635606f-420f-4ded-b499-abe3350ad703 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1315 microversion: 2.1 time: 0.924749 Aug 25 13:15:00.710452 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1921/3807] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:59 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1315 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:00.738318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43817608-26e5-4ada-b295-8742f60eba91 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:00.743453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43817608-26e5-4ada-b295-8742f60eba91 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:00.776922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43817608-26e5-4ada-b295-8742f60eba91 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:00.777863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43817608-26e5-4ada-b295-8742f60eba91 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:00.778609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43817608-26e5-4ada-b295-8742f60eba91 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:00.803205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43817608-26e5-4ada-b295-8742f60eba91 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:00.804082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43817608-26e5-4ada-b295-8742f60eba91 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:00.808041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43817608-26e5-4ada-b295-8742f60eba91 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:01.204816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43817608-26e5-4ada-b295-8742f60eba91 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:01.236258 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43817608-26e5-4ada-b295-8742f60eba91 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1288 microversion: 2.1 time: 0.524163 Aug 25 13:15:01.237940 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1922/3808] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:00 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1288 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:01.390904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-676b1ac8-a1b0-4366-9e4a-711c50b1241b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:01.423829 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-676b1ac8-a1b0-4366-9e4a-711c50b1241b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1522 microversion: 2.1 time: 1.159858 Aug 25 13:15:01.425882 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1887/3809] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:00 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1522 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:01.733454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f6d763b9-2236-4a83-a56a-1fba700acf76 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:01.740796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f6d763b9-2236-4a83-a56a-1fba700acf76 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:01.759149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:01.781129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6d763b9-2236-4a83-a56a-1fba700acf76 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:01.786612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6d763b9-2236-4a83-a56a-1fba700acf76 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:01.790761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6d763b9-2236-4a83-a56a-1fba700acf76 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:01.794152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6d763b9-2236-4a83-a56a-1fba700acf76 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:01.795028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6d763b9-2236-4a83-a56a-1fba700acf76 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:01.795810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6d763b9-2236-4a83-a56a-1fba700acf76 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:02.281976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1d0332e5-13ad-43a4-8404-3a9dae92f39c tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:02.282962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1d0332e5-13ad-43a4-8404-3a9dae92f39c tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:02.326244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d0332e5-13ad-43a4-8404-3a9dae92f39c tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:02.327168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d0332e5-13ad-43a4-8404-3a9dae92f39c tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:02.330756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d0332e5-13ad-43a4-8404-3a9dae92f39c tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:02.336794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d0332e5-13ad-43a4-8404-3a9dae92f39c tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:02.341888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d0332e5-13ad-43a4-8404-3a9dae92f39c tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:02.353721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d0332e5-13ad-43a4-8404-3a9dae92f39c tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:02.365954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f6d763b9-2236-4a83-a56a-1fba700acf76 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:02.427569 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f6d763b9-2236-4a83-a56a-1fba700acf76 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1315 microversion: 2.1 time: 0.701411 Aug 25 13:15:02.443510 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1923/3810] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:01 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:02.476703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a93809fa-0841-4d5d-8f33-49056830a91d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:02.490201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a93809fa-0841-4d5d-8f33-49056830a91d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:02.515141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a93809fa-0841-4d5d-8f33-49056830a91d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:02.517542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a93809fa-0841-4d5d-8f33-49056830a91d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:02.522410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a93809fa-0841-4d5d-8f33-49056830a91d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:02.532237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a93809fa-0841-4d5d-8f33-49056830a91d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:02.545259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a93809fa-0841-4d5d-8f33-49056830a91d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:02.553313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a93809fa-0841-4d5d-8f33-49056830a91d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:02.857849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1d0332e5-13ad-43a4-8404-3a9dae92f39c tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:02.900045 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1d0332e5-13ad-43a4-8404-3a9dae92f39c tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1288 microversion: 2.1 time: 0.626287 Aug 25 13:15:02.906079 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1888/3811] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:02 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1288 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:03.299772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a93809fa-0841-4d5d-8f33-49056830a91d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:03.363097 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a93809fa-0841-4d5d-8f33-49056830a91d tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1522 microversion: 2.1 time: 0.895717 Aug 25 13:15:03.377705 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1924/3812] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:02 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1522 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:03.484498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cb1e178f-58b5-458c-b10b-0dfd9baa541c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:03.490492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cb1e178f-58b5-458c-b10b-0dfd9baa541c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:03.519669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb1e178f-58b5-458c-b10b-0dfd9baa541c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:03.530779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb1e178f-58b5-458c-b10b-0dfd9baa541c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:03.532363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb1e178f-58b5-458c-b10b-0dfd9baa541c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:03.534770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb1e178f-58b5-458c-b10b-0dfd9baa541c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:03.536039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb1e178f-58b5-458c-b10b-0dfd9baa541c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:03.537175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb1e178f-58b5-458c-b10b-0dfd9baa541c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:03.956577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f73756e8-9492-4682-8c30-51e831efdd30 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:03.964006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f73756e8-9492-4682-8c30-51e831efdd30 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:04.031428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f73756e8-9492-4682-8c30-51e831efdd30 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:04.032617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f73756e8-9492-4682-8c30-51e831efdd30 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:04.033466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f73756e8-9492-4682-8c30-51e831efdd30 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:04.041149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f73756e8-9492-4682-8c30-51e831efdd30 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:04.046717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f73756e8-9492-4682-8c30-51e831efdd30 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:04.053715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f73756e8-9492-4682-8c30-51e831efdd30 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:04.385349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cb1e178f-58b5-458c-b10b-0dfd9baa541c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:04.441987 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cb1e178f-58b5-458c-b10b-0dfd9baa541c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1315 microversion: 2.1 time: 0.973883 Aug 25 13:15:04.478516 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1889/3813] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:03 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1315 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:04.525369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7a1b806c-6aab-45e4-86e7-9eb7b19b2739 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:04.538200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7a1b806c-6aab-45e4-86e7-9eb7b19b2739 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:04.577819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1b806c-6aab-45e4-86e7-9eb7b19b2739 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:04.579522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1b806c-6aab-45e4-86e7-9eb7b19b2739 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:04.583807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1b806c-6aab-45e4-86e7-9eb7b19b2739 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:04.585997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1b806c-6aab-45e4-86e7-9eb7b19b2739 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:04.587756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1b806c-6aab-45e4-86e7-9eb7b19b2739 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:04.589131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1b806c-6aab-45e4-86e7-9eb7b19b2739 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:05.139592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f73756e8-9492-4682-8c30-51e831efdd30 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:05.186586 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f73756e8-9492-4682-8c30-51e831efdd30 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1330 microversion: 2.1 time: 1.242442 Aug 25 13:15:05.196010 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1925/3814] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:03 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1330 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:05.321571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7a1b806c-6aab-45e4-86e7-9eb7b19b2739 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:05.358357 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7a1b806c-6aab-45e4-86e7-9eb7b19b2739 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1522 microversion: 2.1 time: 0.855560 Aug 25 13:15:05.363723 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1890/3815] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:04 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1522 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:05.506566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ecc57b5-93c7-4da1-b9ee-253000aa3e04 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:05.509249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4ecc57b5-93c7-4da1-b9ee-253000aa3e04 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:05.538696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ecc57b5-93c7-4da1-b9ee-253000aa3e04 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:05.543206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ecc57b5-93c7-4da1-b9ee-253000aa3e04 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:05.544195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ecc57b5-93c7-4da1-b9ee-253000aa3e04 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:05.545695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ecc57b5-93c7-4da1-b9ee-253000aa3e04 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:05.550788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ecc57b5-93c7-4da1-b9ee-253000aa3e04 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:05.552070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ecc57b5-93c7-4da1-b9ee-253000aa3e04 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:05.622055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:06.071141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4ecc57b5-93c7-4da1-b9ee-253000aa3e04 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:06.107178 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ecc57b5-93c7-4da1-b9ee-253000aa3e04 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1315 microversion: 2.1 time: 0.609023 Aug 25 13:15:06.111164 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1926/3816] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:05 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:06.213647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-97e4c890-d610-44fb-8117-5cb5359edfdc req-b35ee22e-253b-4b97-8fae-eced3755327a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7", "name": "network-vif-plugged", "status": "completed", "tag": "aa171f0d-a313-43dc-9f2d-ed2a01bbd0c6"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:06.261886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a57d7586-98c8-4e44-9277-fe56f81de331 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:06.264545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a57d7586-98c8-4e44-9277-fe56f81de331 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:06.308629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:06.325088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a57d7586-98c8-4e44-9277-fe56f81de331 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:06.329819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a57d7586-98c8-4e44-9277-fe56f81de331 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:06.332417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-97e4c890-d610-44fb-8117-5cb5359edfdc req-b35ee22e-253b-4b97-8fae-eced3755327a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:06.335652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a57d7586-98c8-4e44-9277-fe56f81de331 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:06.337536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a57d7586-98c8-4e44-9277-fe56f81de331 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:06.339881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-97e4c890-d610-44fb-8117-5cb5359edfdc req-b35ee22e-253b-4b97-8fae-eced3755327a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:06.346017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a57d7586-98c8-4e44-9277-fe56f81de331 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:06.347506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-97e4c890-d610-44fb-8117-5cb5359edfdc req-b35ee22e-253b-4b97-8fae-eced3755327a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:06.351006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a57d7586-98c8-4e44-9277-fe56f81de331 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:06.440144 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-97e4c890-d610-44fb-8117-5cb5359edfdc req-b35ee22e-253b-4b97-8fae-eced3755327a service nova] Creating event network-vif-plugged:aa171f0d-a313-43dc-9f2d-ed2a01bbd0c6 for instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 on n-h1-852771-8 Aug 25 13:15:06.486531 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-97e4c890-d610-44fb-8117-5cb5359edfdc req-b35ee22e-253b-4b97-8fae-eced3755327a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280987 Aug 25 13:15:06.521618 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1891/3817] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:06.561942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87bac662-a5ac-439f-bc46-47d3a89c06db tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:06.564402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-87bac662-a5ac-439f-bc46-47d3a89c06db tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:06.630434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bac662-a5ac-439f-bc46-47d3a89c06db tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:06.631173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bac662-a5ac-439f-bc46-47d3a89c06db tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:06.632019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bac662-a5ac-439f-bc46-47d3a89c06db tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:06.633390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bac662-a5ac-439f-bc46-47d3a89c06db tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:06.634298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bac662-a5ac-439f-bc46-47d3a89c06db tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:06.642950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bac662-a5ac-439f-bc46-47d3a89c06db tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:07.511120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a57d7586-98c8-4e44-9277-fe56f81de331 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:07.551287 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a57d7586-98c8-4e44-9277-fe56f81de331 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1330 microversion: 2.1 time: 1.313721 Aug 25 13:15:07.553211 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1927/3818] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:06 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1330 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:07.592486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5a2181fe-c9c3-4d49-a367-2106b7897922 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:07.594082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5a2181fe-c9c3-4d49-a367-2106b7897922 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:07.608994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a2181fe-c9c3-4d49-a367-2106b7897922 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:07.610222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a2181fe-c9c3-4d49-a367-2106b7897922 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:07.611344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a2181fe-c9c3-4d49-a367-2106b7897922 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:07.613438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a2181fe-c9c3-4d49-a367-2106b7897922 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:07.614808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a2181fe-c9c3-4d49-a367-2106b7897922 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:07.615819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a2181fe-c9c3-4d49-a367-2106b7897922 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:07.896173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=14 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:08.411512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-87bac662-a5ac-439f-bc46-47d3a89c06db tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:08.459734 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87bac662-a5ac-439f-bc46-47d3a89c06db tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1522 microversion: 2.1 time: 1.932076 Aug 25 13:15:08.478083 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1892/3819] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:06 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1522 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:08.542376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-56360852-b178-46ce-a8eb-87494651f542 req-c80b0ab8-ff2e-4273-8e43-2f34e70c3a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ee6897-bbd1-4ead-b5ba-eeba8fc6469e", "tag": "e7ec10ef-f422-46b6-b9a3-65d2d19b3172"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:08.645583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-56360852-b178-46ce-a8eb-87494651f542 req-c80b0ab8-ff2e-4273-8e43-2f34e70c3a6e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:08.653217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-56360852-b178-46ce-a8eb-87494651f542 req-c80b0ab8-ff2e-4273-8e43-2f34e70c3a6e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:08.664365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-56360852-b178-46ce-a8eb-87494651f542 req-c80b0ab8-ff2e-4273-8e43-2f34e70c3a6e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:08.741958 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-56360852-b178-46ce-a8eb-87494651f542 req-c80b0ab8-ff2e-4273-8e43-2f34e70c3a6e service nova] Creating event network-changed:e7ec10ef-f422-46b6-b9a3-65d2d19b3172 for instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e on n-h1-852771-8 Aug 25 13:15:08.769567 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-56360852-b178-46ce-a8eb-87494651f542 req-c80b0ab8-ff2e-4273-8e43-2f34e70c3a6e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236751 Aug 25 13:15:08.775506 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1893/3820] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:15:08.794656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ba5780ed-9f89-487b-baba-b9e6259362c9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:08.804748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ba5780ed-9f89-487b-baba-b9e6259362c9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:08.832500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba5780ed-9f89-487b-baba-b9e6259362c9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:08.834792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba5780ed-9f89-487b-baba-b9e6259362c9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:08.836825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba5780ed-9f89-487b-baba-b9e6259362c9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:08.847308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba5780ed-9f89-487b-baba-b9e6259362c9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:08.856100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba5780ed-9f89-487b-baba-b9e6259362c9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:08.861500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba5780ed-9f89-487b-baba-b9e6259362c9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:09.461399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5a2181fe-c9c3-4d49-a367-2106b7897922 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:09.474015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=83 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:09.512555 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5a2181fe-c9c3-4d49-a367-2106b7897922 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1315 microversion: 2.1 time: 1.939674 Aug 25 13:15:09.515959 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1928/3821] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:07 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1315 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:09.529928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-3c9da5bc-278b-4639-ba2e-63c8230168e6 req-11f60f93-7c7a-4445-ad60-f7715faa3f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6362fd-0197-4636-8a8d-6814ba103aed", "name": "network-vif-plugged", "status": "completed", "tag": "221908ac-54e5-4185-a673-1a922869d2b5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:09.552446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ba5780ed-9f89-487b-baba-b9e6259362c9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:09.572918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3c9da5bc-278b-4639-ba2e-63c8230168e6 req-11f60f93-7c7a-4445-ad60-f7715faa3f3d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:09.575164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3c9da5bc-278b-4639-ba2e-63c8230168e6 req-11f60f93-7c7a-4445-ad60-f7715faa3f3d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:09.576003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3c9da5bc-278b-4639-ba2e-63c8230168e6 req-11f60f93-7c7a-4445-ad60-f7715faa3f3d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:09.586595 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ba5780ed-9f89-487b-baba-b9e6259362c9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1330 microversion: 2.1 time: 0.808302 Aug 25 13:15:09.588209 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1894/3822] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:08 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1330 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:09.606536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a60a7830-898b-434d-8e0d-69c5a276c3f2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:09.608024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a60a7830-898b-434d-8e0d-69c5a276c3f2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:09.630357 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-3c9da5bc-278b-4639-ba2e-63c8230168e6 req-11f60f93-7c7a-4445-ad60-f7715faa3f3d service nova] Creating event network-vif-plugged:221908ac-54e5-4185-a673-1a922869d2b5 for instance cc6362fd-0197-4636-8a8d-6814ba103aed on n-h2-852771-8 Aug 25 13:15:09.631305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a60a7830-898b-434d-8e0d-69c5a276c3f2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:09.632272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a60a7830-898b-434d-8e0d-69c5a276c3f2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:09.632819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a60a7830-898b-434d-8e0d-69c5a276c3f2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:09.641219 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-3c9da5bc-278b-4639-ba2e-63c8230168e6 req-11f60f93-7c7a-4445-ad60-f7715faa3f3d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121664 Aug 25 13:15:09.643056 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1929/3823] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:09.648514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a60a7830-898b-434d-8e0d-69c5a276c3f2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:09.649686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a60a7830-898b-434d-8e0d-69c5a276c3f2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:09.660047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a60a7830-898b-434d-8e0d-69c5a276c3f2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:09.757009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:10.250353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a60a7830-898b-434d-8e0d-69c5a276c3f2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:10.291466 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a60a7830-898b-434d-8e0d-69c5a276c3f2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1522 microversion: 2.1 time: 0.701270 Aug 25 13:15:10.319013 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1895/3824] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:09 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1522 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:10.569602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4cd60598-b789-4043-919a-cd614067c2ad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:10.573111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4cd60598-b789-4043-919a-cd614067c2ad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:10.597921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cd60598-b789-4043-919a-cd614067c2ad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:10.598965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cd60598-b789-4043-919a-cd614067c2ad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:10.599791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cd60598-b789-4043-919a-cd614067c2ad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:10.601125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cd60598-b789-4043-919a-cd614067c2ad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:10.613071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cd60598-b789-4043-919a-cd614067c2ad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:10.614009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cd60598-b789-4043-919a-cd614067c2ad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:10.632815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4315fe9d-4530-499d-a45d-a793bc22f277 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:10.634095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4315fe9d-4530-499d-a45d-a793bc22f277 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:10.690098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4315fe9d-4530-499d-a45d-a793bc22f277 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:10.692826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4315fe9d-4530-499d-a45d-a793bc22f277 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:10.705788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4315fe9d-4530-499d-a45d-a793bc22f277 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:10.708335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4315fe9d-4530-499d-a45d-a793bc22f277 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:10.709499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4315fe9d-4530-499d-a45d-a793bc22f277 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:10.710689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4315fe9d-4530-499d-a45d-a793bc22f277 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:11.189157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4cd60598-b789-4043-919a-cd614067c2ad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:11.210171 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4cd60598-b789-4043-919a-cd614067c2ad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1315 microversion: 2.1 time: 0.663440 Aug 25 13:15:11.212252 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1930/3825] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:10 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:11.324524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4315fe9d-4530-499d-a45d-a793bc22f277 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:11.355296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3a466f86-f672-43be-bbd1-519fb2ad3de9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:11.357720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3a466f86-f672-43be-bbd1-519fb2ad3de9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:11.367635 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4315fe9d-4530-499d-a45d-a793bc22f277 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1330 microversion: 2.1 time: 0.743782 Aug 25 13:15:11.382821 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1896/3826] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:10 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1330 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:11.383720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a466f86-f672-43be-bbd1-519fb2ad3de9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:11.385112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a466f86-f672-43be-bbd1-519fb2ad3de9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:11.386163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a466f86-f672-43be-bbd1-519fb2ad3de9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:11.388498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a466f86-f672-43be-bbd1-519fb2ad3de9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:11.390807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a466f86-f672-43be-bbd1-519fb2ad3de9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:11.392100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a466f86-f672-43be-bbd1-519fb2ad3de9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:12.257166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-850ddba9-43f1-4ae1-972d-e1d48757af78 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:12.259784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-850ddba9-43f1-4ae1-972d-e1d48757af78 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:12.280695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-850ddba9-43f1-4ae1-972d-e1d48757af78 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:12.282387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-850ddba9-43f1-4ae1-972d-e1d48757af78 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:12.287209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-850ddba9-43f1-4ae1-972d-e1d48757af78 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:12.293810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-850ddba9-43f1-4ae1-972d-e1d48757af78 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:12.296725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-850ddba9-43f1-4ae1-972d-e1d48757af78 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:12.298600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-850ddba9-43f1-4ae1-972d-e1d48757af78 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:12.312478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3a466f86-f672-43be-bbd1-519fb2ad3de9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:12.336764 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3a466f86-f672-43be-bbd1-519fb2ad3de9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1507 microversion: 2.1 time: 0.988674 Aug 25 13:15:12.341439 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1931/3827] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:11 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1507 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:12.376260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6d1fc435-96b8-443c-aa6b-9a942630f101 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:12.376803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6d1fc435-96b8-443c-aa6b-9a942630f101 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:12.390790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1fc435-96b8-443c-aa6b-9a942630f101 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:12.392230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1fc435-96b8-443c-aa6b-9a942630f101 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:12.393289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1fc435-96b8-443c-aa6b-9a942630f101 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:12.395076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1fc435-96b8-443c-aa6b-9a942630f101 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:12.396251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1fc435-96b8-443c-aa6b-9a942630f101 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:12.397288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1fc435-96b8-443c-aa6b-9a942630f101 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:12.915999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-850ddba9-43f1-4ae1-972d-e1d48757af78 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:12.946237 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-850ddba9-43f1-4ae1-972d-e1d48757af78 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.698599 Aug 25 13:15:12.950304 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1897/3828] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:12 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:12.960468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6d1fc435-96b8-443c-aa6b-9a942630f101 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:12.963486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3e83a34d-2f5a-4f08-a8c5-55516b940d01 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:12.966055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3e83a34d-2f5a-4f08-a8c5-55516b940d01 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:12.982367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e83a34d-2f5a-4f08-a8c5-55516b940d01 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:12.983667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e83a34d-2f5a-4f08-a8c5-55516b940d01 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:12.985005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e83a34d-2f5a-4f08-a8c5-55516b940d01 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:12.987776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e83a34d-2f5a-4f08-a8c5-55516b940d01 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:12.989135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e83a34d-2f5a-4f08-a8c5-55516b940d01 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:12.990736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e83a34d-2f5a-4f08-a8c5-55516b940d01 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:13.017922 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6d1fc435-96b8-443c-aa6b-9a942630f101 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 200 len: 1507 microversion: 2.1 time: 0.640295 Aug 25 13:15:13.039606 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1932/3829] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:12 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 1507 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:13.091586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3065885-196b-49b4-bcf5-8fee97eaf9a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:13.099867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a3065885-196b-49b4-bcf5-8fee97eaf9a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:13.115448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3065885-196b-49b4-bcf5-8fee97eaf9a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:13.116599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3065885-196b-49b4-bcf5-8fee97eaf9a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:13.118539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3065885-196b-49b4-bcf5-8fee97eaf9a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:13.120600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3065885-196b-49b4-bcf5-8fee97eaf9a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:13.124117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3065885-196b-49b4-bcf5-8fee97eaf9a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:13.130303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3065885-196b-49b4-bcf5-8fee97eaf9a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:13.249227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a3065885-196b-49b4-bcf5-8fee97eaf9a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:15:13.502283 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a3065885-196b-49b4-bcf5-8fee97eaf9a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 204 len: 0 microversion: 2.1 time: 0.426679 Aug 25 13:15:13.510680 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1933/3830] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:15:13 2022] DELETE /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:15:13.556561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3e83a34d-2f5a-4f08-a8c5-55516b940d01 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:13.584393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1378050374", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:13.647657 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3e83a34d-2f5a-4f08-a8c5-55516b940d01 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1330 microversion: 2.1 time: 0.694967 Aug 25 13:15:13.660761 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1898/3831] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:12 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1330 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:13.953021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] validate_networks() for [('a93c3507-9ff2-4777-a7c1-69c8a703a9b6', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:15:14.201735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-392606629", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "9dbcd1aa-ce04-43a7-b93f-d1b96ddcbf97"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:14.397893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] validate_networks() for [('9dbcd1aa-ce04-43a7-b93f-d1b96ddcbf97', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:15:16.807697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:15:16.809101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:15:16.810022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:15:16.812628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:15:16.814356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:15:16.874459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:16.875671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:16.876360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:16.878501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:16.879409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:16.890058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:16.962090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Getting quotas for project f9c8fc08eb5b483a90fa0ef5bc79b8cd. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:15:16.983686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Getting quotas for user acdd3d6ee64a4a3d8182c73efb372e6c and project f9c8fc08eb5b483a90fa0ef5bc79b8cd. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:15:17.021380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:15:17.027851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:15:17.159756 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3e498240-686e-45f8-b7ac-d90876b0e728 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.623178 Aug 25 13:15:17.163388 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1934/3832] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:15:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:15:17.187545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9bc44318-5a11-4443-99ff-2c5d96e48fb2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:17.192487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9bc44318-5a11-4443-99ff-2c5d96e48fb2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:17.229231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bc44318-5a11-4443-99ff-2c5d96e48fb2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:17.231747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bc44318-5a11-4443-99ff-2c5d96e48fb2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:17.234426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bc44318-5a11-4443-99ff-2c5d96e48fb2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:17.236333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bc44318-5a11-4443-99ff-2c5d96e48fb2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:17.239664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bc44318-5a11-4443-99ff-2c5d96e48fb2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:17.241316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bc44318-5a11-4443-99ff-2c5d96e48fb2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:17.962392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9bc44318-5a11-4443-99ff-2c5d96e48fb2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:17.994301 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9bc44318-5a11-4443-99ff-2c5d96e48fb2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1330 microversion: 2.1 time: 0.825740 Aug 25 13:15:17.997852 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1935/3833] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:17 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1330 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:18.011756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-210caf97-6bab-44b7-8b90-435355bbf33b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:18.025109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-210caf97-6bab-44b7-8b90-435355bbf33b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:18.371801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:15:18.375757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:15:18.377700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:15:18.381008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:15:18.384893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:15:18.396071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=54 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:18.410834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:18.414036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:18.416828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:18.419081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:18.420440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:18.421615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:18.441311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-210caf97-6bab-44b7-8b90-435355bbf33b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:18.463457 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-210caf97-6bab-44b7-8b90-435355bbf33b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1217 microversion: 2.1 time: 0.463122 Aug 25 13:15:18.464914 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1936/3834] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:17 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1217 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:18.490720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Getting quotas for project d978026db2964d8dbc4c511631c892c2. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:15:18.530798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Getting quotas for user 1cc53ee05ac640d6acf5aea6da0bde26 and project d978026db2964d8dbc4c511631c892c2. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:15:18.635718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:15:18.647907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:15:18.921682 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0022be80-c2c1-4c5a-9c38-83f1830730a2 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.725766 Aug 25 13:15:18.960121 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1899/3835] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:15:18.963555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3b1871f-30c8-4368-8abc-bf6b068e9c2c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:18.968265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c3b1871f-30c8-4368-8abc-bf6b068e9c2c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:19.046732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a91173a8-2964-46a9-b393-4e9e5b3d34c6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:19.050317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a91173a8-2964-46a9-b393-4e9e5b3d34c6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:19.099379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91173a8-2964-46a9-b393-4e9e5b3d34c6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:19.105712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91173a8-2964-46a9-b393-4e9e5b3d34c6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:19.107399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91173a8-2964-46a9-b393-4e9e5b3d34c6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:19.113438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91173a8-2964-46a9-b393-4e9e5b3d34c6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:19.116115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91173a8-2964-46a9-b393-4e9e5b3d34c6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:19.120539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91173a8-2964-46a9-b393-4e9e5b3d34c6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:19.367489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c3b1871f-30c8-4368-8abc-bf6b068e9c2c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:19.404407 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3b1871f-30c8-4368-8abc-bf6b068e9c2c tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1217 microversion: 2.1 time: 0.455101 Aug 25 13:15:19.411712 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1937/3836] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:18 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1217 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:19.457450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4d3a64e7-20a1-4385-a593-0ca8a791c286 req-7312a22e-e269-4894-a160-41d13ec0a1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7", "name": "network-vif-deleted", "tag": "aa171f0d-a313-43dc-9f2d-ed2a01bbd0c6"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:19.491302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4d3a64e7-20a1-4385-a593-0ca8a791c286 req-7312a22e-e269-4894-a160-41d13ec0a1f6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:19.492461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4d3a64e7-20a1-4385-a593-0ca8a791c286 req-7312a22e-e269-4894-a160-41d13ec0a1f6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:19.498111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4d3a64e7-20a1-4385-a593-0ca8a791c286 req-7312a22e-e269-4894-a160-41d13ec0a1f6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:19.575793 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4d3a64e7-20a1-4385-a593-0ca8a791c286 req-7312a22e-e269-4894-a160-41d13ec0a1f6 service nova] Creating event network-vif-deleted:aa171f0d-a313-43dc-9f2d-ed2a01bbd0c6 for instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 on n-h1-852771-8 Aug 25 13:15:19.602380 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4d3a64e7-20a1-4385-a593-0ca8a791c286 req-7312a22e-e269-4894-a160-41d13ec0a1f6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155606 Aug 25 13:15:19.604737 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1938/3837] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:19.627047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0b19d4a8-0639-4273-814f-1fe2a6a24da3 req-10d8dc10-a4b3-468f-9460-e52b0007b733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ee6897-bbd1-4ead-b5ba-eeba8fc6469e", "name": "network-vif-plugged", "status": "completed", "tag": "e7ec10ef-f422-46b6-b9a3-65d2d19b3172"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:19.714222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0b19d4a8-0639-4273-814f-1fe2a6a24da3 req-10d8dc10-a4b3-468f-9460-e52b0007b733 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:19.719452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0b19d4a8-0639-4273-814f-1fe2a6a24da3 req-10d8dc10-a4b3-468f-9460-e52b0007b733 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:19.720418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0b19d4a8-0639-4273-814f-1fe2a6a24da3 req-10d8dc10-a4b3-468f-9460-e52b0007b733 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:19.777132 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0b19d4a8-0639-4273-814f-1fe2a6a24da3 req-10d8dc10-a4b3-468f-9460-e52b0007b733 service nova] Creating event network-vif-plugged:e7ec10ef-f422-46b6-b9a3-65d2d19b3172 for instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e on n-h1-852771-8 Aug 25 13:15:19.801881 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0b19d4a8-0639-4273-814f-1fe2a6a24da3 req-10d8dc10-a4b3-468f-9460-e52b0007b733 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189593 Aug 25 13:15:19.803184 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1939/3838] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:19.822813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c4e740c-2634-442a-aafe-003bfaa1f936 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:19.826511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c4e740c-2634-442a-aafe-003bfaa1f936 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:19.844891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4e740c-2634-442a-aafe-003bfaa1f936 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:19.845743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4e740c-2634-442a-aafe-003bfaa1f936 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:19.846457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4e740c-2634-442a-aafe-003bfaa1f936 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:19.847938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4e740c-2634-442a-aafe-003bfaa1f936 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:19.848712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4e740c-2634-442a-aafe-003bfaa1f936 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:19.854369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c4e740c-2634-442a-aafe-003bfaa1f936 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:20.029411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a91173a8-2964-46a9-b393-4e9e5b3d34c6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:20.121263 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a91173a8-2964-46a9-b393-4e9e5b3d34c6 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1330 microversion: 2.1 time: 1.083650 Aug 25 13:15:20.141352 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1900/3839] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:19 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1330 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:20.209075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0c4e740c-2634-442a-aafe-003bfaa1f936 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:20.250671 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c4e740c-2634-442a-aafe-003bfaa1f936 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1213 microversion: 2.1 time: 0.445054 Aug 25 13:15:20.252650 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1940/3840] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:19 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1213 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:20.459541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-31623986-c275-4c04-9e71-a96fded34127 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:20.471261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-31623986-c275-4c04-9e71-a96fded34127 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:20.849389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-31623986-c275-4c04-9e71-a96fded34127 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:20.868455 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-31623986-c275-4c04-9e71-a96fded34127 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1217 microversion: 2.1 time: 0.416845 Aug 25 13:15:20.872760 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1901/3841] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:20 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1217 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:21.188212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85c6df14-3477-4e28-98aa-82d588d4d0ad tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:21.199137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85c6df14-3477-4e28-98aa-82d588d4d0ad tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:21.230090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85c6df14-3477-4e28-98aa-82d588d4d0ad tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:21.234032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85c6df14-3477-4e28-98aa-82d588d4d0ad tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:21.239893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85c6df14-3477-4e28-98aa-82d588d4d0ad tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:21.243257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85c6df14-3477-4e28-98aa-82d588d4d0ad tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:21.246493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85c6df14-3477-4e28-98aa-82d588d4d0ad tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:21.251694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85c6df14-3477-4e28-98aa-82d588d4d0ad tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:21.287547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00d7e799-0d68-451b-a2ee-aa0474fc6891 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:21.288573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-00d7e799-0d68-451b-a2ee-aa0474fc6891 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:21.349335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d7e799-0d68-451b-a2ee-aa0474fc6891 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:21.352463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d7e799-0d68-451b-a2ee-aa0474fc6891 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:21.356652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d7e799-0d68-451b-a2ee-aa0474fc6891 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:21.361803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d7e799-0d68-451b-a2ee-aa0474fc6891 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:21.366020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d7e799-0d68-451b-a2ee-aa0474fc6891 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:21.367874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00d7e799-0d68-451b-a2ee-aa0474fc6891 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:21.657020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-00d7e799-0d68-451b-a2ee-aa0474fc6891 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:21.689965 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-00d7e799-0d68-451b-a2ee-aa0474fc6891 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1287 microversion: 2.1 time: 0.409048 Aug 25 13:15:21.710413 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1902/3842] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:21 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1287 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:21.915157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1d6b6e9-0fa7-4c49-bec4-047e32b1a3a0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:21.926317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b1d6b6e9-0fa7-4c49-bec4-047e32b1a3a0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:21.942820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1d6b6e9-0fa7-4c49-bec4-047e32b1a3a0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:21.949343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1d6b6e9-0fa7-4c49-bec4-047e32b1a3a0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:21.950247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1d6b6e9-0fa7-4c49-bec4-047e32b1a3a0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:21.951600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1d6b6e9-0fa7-4c49-bec4-047e32b1a3a0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:21.952500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1d6b6e9-0fa7-4c49-bec4-047e32b1a3a0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:21.953311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1d6b6e9-0fa7-4c49-bec4-047e32b1a3a0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:22.228282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-85c6df14-3477-4e28-98aa-82d588d4d0ad tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:22.264555 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85c6df14-3477-4e28-98aa-82d588d4d0ad tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1330 microversion: 2.1 time: 1.085353 Aug 25 13:15:22.270554 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1941/3843] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:21 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1330 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:22.343652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b1d6b6e9-0fa7-4c49-bec4-047e32b1a3a0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:22.385578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b1d6b6e9-0fa7-4c49-bec4-047e32b1a3a0 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1213 microversion: 2.1 time: 0.476933 Aug 25 13:15:22.391235 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1903/3844] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:21 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1213 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:22.736859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e68338d6-cacb-4be4-89e8-e293727a4952 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:22.740994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e68338d6-cacb-4be4-89e8-e293727a4952 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:22.763592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e68338d6-cacb-4be4-89e8-e293727a4952 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:22.765078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e68338d6-cacb-4be4-89e8-e293727a4952 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:22.766232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e68338d6-cacb-4be4-89e8-e293727a4952 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:22.767875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e68338d6-cacb-4be4-89e8-e293727a4952 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:22.782613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e68338d6-cacb-4be4-89e8-e293727a4952 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:22.786127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e68338d6-cacb-4be4-89e8-e293727a4952 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:23.018353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e68338d6-cacb-4be4-89e8-e293727a4952 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:23.074090 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e68338d6-cacb-4be4-89e8-e293727a4952 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1275 microversion: 2.1 time: 0.339959 Aug 25 13:15:23.078325 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1942/3845] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:22 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1275 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:23.313853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d8f9e057-4a97-46d7-8915-011728ae2823 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:23.320662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d8f9e057-4a97-46d7-8915-011728ae2823 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:23.368982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8f9e057-4a97-46d7-8915-011728ae2823 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:23.371903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8f9e057-4a97-46d7-8915-011728ae2823 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:23.379119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8f9e057-4a97-46d7-8915-011728ae2823 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:23.384999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8f9e057-4a97-46d7-8915-011728ae2823 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:23.390412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8f9e057-4a97-46d7-8915-011728ae2823 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:23.393311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8f9e057-4a97-46d7-8915-011728ae2823 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:23.433039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a812f1d1-a624-49c3-abba-7bdc2612b6bb tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:23.454061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a812f1d1-a624-49c3-abba-7bdc2612b6bb tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:23.517865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a812f1d1-a624-49c3-abba-7bdc2612b6bb tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:23.518999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a812f1d1-a624-49c3-abba-7bdc2612b6bb tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:23.519806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a812f1d1-a624-49c3-abba-7bdc2612b6bb tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:23.534065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a812f1d1-a624-49c3-abba-7bdc2612b6bb tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:23.534065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a812f1d1-a624-49c3-abba-7bdc2612b6bb tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:23.534065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a812f1d1-a624-49c3-abba-7bdc2612b6bb tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:23.985110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a812f1d1-a624-49c3-abba-7bdc2612b6bb tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:24.020625 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a812f1d1-a624-49c3-abba-7bdc2612b6bb tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1275 microversion: 2.1 time: 0.594181 Aug 25 13:15:24.024718 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1943/3846] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:23 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1275 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:24.120630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5a4348f2-4f88-402f-a343-8fa062c0daa4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:24.122069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5a4348f2-4f88-402f-a343-8fa062c0daa4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:24.160831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a4348f2-4f88-402f-a343-8fa062c0daa4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:24.161280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a4348f2-4f88-402f-a343-8fa062c0daa4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:24.162100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a4348f2-4f88-402f-a343-8fa062c0daa4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:24.165391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a4348f2-4f88-402f-a343-8fa062c0daa4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:24.172370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a4348f2-4f88-402f-a343-8fa062c0daa4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:24.173965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a4348f2-4f88-402f-a343-8fa062c0daa4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:24.851199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d8f9e057-4a97-46d7-8915-011728ae2823 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:24.889628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d8f9e057-4a97-46d7-8915-011728ae2823 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1535 microversion: 2.1 time: 1.584907 Aug 25 13:15:24.896378 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1904/3847] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:23 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1535 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:24.944800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1c889e30-ec8a-4b7a-bff1-39d00415b31e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Action: 'create', calling method: .version_select at 0x7f3a297099d0>, body: {"pool": "08e51fcb-b6e4-4dd9-a40f-e2e61213f366"} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:25.519388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5a4348f2-4f88-402f-a343-8fa062c0daa4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:25.544528 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5a4348f2-4f88-402f-a343-8fa062c0daa4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1317 microversion: 2.1 time: 1.432278 Aug 25 13:15:25.568558 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1944/3848] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:24 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1317 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:25.615522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-534b40be-ba66-4eb4-8427-730f263452dd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:25.621492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-534b40be-ba66-4eb4-8427-730f263452dd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:25.673113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-534b40be-ba66-4eb4-8427-730f263452dd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:25.676250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-534b40be-ba66-4eb4-8427-730f263452dd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:25.679360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-534b40be-ba66-4eb4-8427-730f263452dd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:25.686856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-534b40be-ba66-4eb4-8427-730f263452dd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:25.687994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-534b40be-ba66-4eb4-8427-730f263452dd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:25.691658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-534b40be-ba66-4eb4-8427-730f263452dd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:26.926330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:27.858459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-534b40be-ba66-4eb4-8427-730f263452dd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:27.895980 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-534b40be-ba66-4eb4-8427-730f263452dd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1317 microversion: 2.1 time: 2.320997 Aug 25 13:15:27.898044 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1945/3849] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:25 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1317 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:27.923443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4deca738-9e04-45c5-8093-65dfe8bd64e7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:27.926203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4deca738-9e04-45c5-8093-65dfe8bd64e7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:27.990544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4deca738-9e04-45c5-8093-65dfe8bd64e7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:27.993367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4deca738-9e04-45c5-8093-65dfe8bd64e7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:28.001147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4deca738-9e04-45c5-8093-65dfe8bd64e7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:28.003620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4deca738-9e04-45c5-8093-65dfe8bd64e7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:28.005332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4deca738-9e04-45c5-8093-65dfe8bd64e7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:28.006575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4deca738-9e04-45c5-8093-65dfe8bd64e7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:28.448214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:29.384435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:30.012005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4deca738-9e04-45c5-8093-65dfe8bd64e7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:30.051544 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4deca738-9e04-45c5-8093-65dfe8bd64e7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1317 microversion: 2.1 time: 2.148591 Aug 25 13:15:30.053450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1946/3850] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:27 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1317 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:30.112013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-cd0e6b56-00a4-4a75-aab8-d57f3b7b79e1 req-713087ae-dff9-47ce-859b-522602025992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ab7070-d556-43aa-98dc-d78a45fd1b9c", "tag": "b5c44b23-585e-4be6-85fe-3a35a84befb2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:30.157771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cd0e6b56-00a4-4a75-aab8-d57f3b7b79e1 req-713087ae-dff9-47ce-859b-522602025992 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:30.160669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cd0e6b56-00a4-4a75-aab8-d57f3b7b79e1 req-713087ae-dff9-47ce-859b-522602025992 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:30.162113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cd0e6b56-00a4-4a75-aab8-d57f3b7b79e1 req-713087ae-dff9-47ce-859b-522602025992 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:30.247638 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-cd0e6b56-00a4-4a75-aab8-d57f3b7b79e1 req-713087ae-dff9-47ce-859b-522602025992 service nova] Creating event network-changed:b5c44b23-585e-4be6-85fe-3a35a84befb2 for instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c on n-h2-852771-8 Aug 25 13:15:30.294303 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-cd0e6b56-00a4-4a75-aab8-d57f3b7b79e1 req-713087ae-dff9-47ce-859b-522602025992 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236208 Aug 25 13:15:30.296530 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1947/3851] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:30.329367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74b6b149-20f1-4fb3-8241-ddf87027e01a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:30.338161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74b6b149-20f1-4fb3-8241-ddf87027e01a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:30.355268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74b6b149-20f1-4fb3-8241-ddf87027e01a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:30.357350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74b6b149-20f1-4fb3-8241-ddf87027e01a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:30.358517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74b6b149-20f1-4fb3-8241-ddf87027e01a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:30.362874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74b6b149-20f1-4fb3-8241-ddf87027e01a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:30.365413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74b6b149-20f1-4fb3-8241-ddf87027e01a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:30.367265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74b6b149-20f1-4fb3-8241-ddf87027e01a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:30.867275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:31.119468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74b6b149-20f1-4fb3-8241-ddf87027e01a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:31.145896 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74b6b149-20f1-4fb3-8241-ddf87027e01a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1317 microversion: 2.1 time: 0.843929 Aug 25 13:15:31.146992 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1948/3852] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:30 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1317 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:31.167455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a69f2cd7-fb12-4813-a823-5ac87b4bf4a4 req-b8d48731-8eeb-4fdd-9e15-0e8da145e98e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5304090-4e5b-4154-b954-a46f3b514bd1", "tag": "0c8d4e5e-d3da-4701-8691-2c87b134b408"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:31.184288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a69f2cd7-fb12-4813-a823-5ac87b4bf4a4 req-b8d48731-8eeb-4fdd-9e15-0e8da145e98e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:31.185476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a69f2cd7-fb12-4813-a823-5ac87b4bf4a4 req-b8d48731-8eeb-4fdd-9e15-0e8da145e98e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:31.186203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a69f2cd7-fb12-4813-a823-5ac87b4bf4a4 req-b8d48731-8eeb-4fdd-9e15-0e8da145e98e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:31.208646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:31.213550 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a69f2cd7-fb12-4813-a823-5ac87b4bf4a4 req-b8d48731-8eeb-4fdd-9e15-0e8da145e98e service nova] Creating event network-changed:0c8d4e5e-d3da-4701-8691-2c87b134b408 for instance c5304090-4e5b-4154-b954-a46f3b514bd1 on n-h2-852771-8 Aug 25 13:15:31.226306 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a69f2cd7-fb12-4813-a823-5ac87b4bf4a4 req-b8d48731-8eeb-4fdd-9e15-0e8da145e98e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065330 Aug 25 13:15:31.228255 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1949/3853] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:31.243556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9b1f11a3-4ef2-4b15-9325-5e43cd480030 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:31.246275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9b1f11a3-4ef2-4b15-9325-5e43cd480030 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:31.270384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b1f11a3-4ef2-4b15-9325-5e43cd480030 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:31.271784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b1f11a3-4ef2-4b15-9325-5e43cd480030 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:31.272954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b1f11a3-4ef2-4b15-9325-5e43cd480030 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:31.274441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b1f11a3-4ef2-4b15-9325-5e43cd480030 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:31.276829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b1f11a3-4ef2-4b15-9325-5e43cd480030 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:31.278022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b1f11a3-4ef2-4b15-9325-5e43cd480030 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:32.084963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9b1f11a3-4ef2-4b15-9325-5e43cd480030 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:32.131417 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9b1f11a3-4ef2-4b15-9325-5e43cd480030 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1317 microversion: 2.1 time: 0.896166 Aug 25 13:15:32.132600 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1950/3854] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:31 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1317 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:32.192594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-810fc2ab-b7b9-4762-95b6-399e658705cd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:32.195431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-810fc2ab-b7b9-4762-95b6-399e658705cd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:32.209815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:32.234663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810fc2ab-b7b9-4762-95b6-399e658705cd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:32.238635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810fc2ab-b7b9-4762-95b6-399e658705cd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:32.240881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810fc2ab-b7b9-4762-95b6-399e658705cd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:32.245053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810fc2ab-b7b9-4762-95b6-399e658705cd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:32.248247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810fc2ab-b7b9-4762-95b6-399e658705cd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:32.249381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810fc2ab-b7b9-4762-95b6-399e658705cd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:33.042078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-810fc2ab-b7b9-4762-95b6-399e658705cd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:33.059210 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-810fc2ab-b7b9-4762-95b6-399e658705cd tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1317 microversion: 2.1 time: 0.874465 Aug 25 13:15:33.061354 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1951/3855] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:32 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1317 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:33.102266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac68cdcc-cdcc-4274-8a8b-72af081a6eb5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:33.103858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ac68cdcc-cdcc-4274-8a8b-72af081a6eb5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:33.120591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac68cdcc-cdcc-4274-8a8b-72af081a6eb5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:33.127187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac68cdcc-cdcc-4274-8a8b-72af081a6eb5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:33.130209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac68cdcc-cdcc-4274-8a8b-72af081a6eb5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:33.130209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac68cdcc-cdcc-4274-8a8b-72af081a6eb5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:33.133939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac68cdcc-cdcc-4274-8a8b-72af081a6eb5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:33.134989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac68cdcc-cdcc-4274-8a8b-72af081a6eb5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:33.234362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ac68cdcc-cdcc-4274-8a8b-72af081a6eb5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:15:33.353129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:33.517330 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ac68cdcc-cdcc-4274-8a8b-72af081a6eb5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "DELETE /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 204 len: 0 microversion: 2.32 time: 0.452793 Aug 25 13:15:33.519193 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1952/3856] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:15:33 2022] DELETE /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:15:33.529036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-299c82b9-0257-4d4e-8063-86f3950b6a24 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:33.530868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-299c82b9-0257-4d4e-8063-86f3950b6a24 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:33.556619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-299c82b9-0257-4d4e-8063-86f3950b6a24 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:33.557569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-299c82b9-0257-4d4e-8063-86f3950b6a24 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:33.558472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-299c82b9-0257-4d4e-8063-86f3950b6a24 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:33.560409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-299c82b9-0257-4d4e-8063-86f3950b6a24 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:33.560689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-299c82b9-0257-4d4e-8063-86f3950b6a24 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:33.561486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-299c82b9-0257-4d4e-8063-86f3950b6a24 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:34.879169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=47 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:35.095275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-299c82b9-0257-4d4e-8063-86f3950b6a24 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:35.137426 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-299c82b9-0257-4d4e-8063-86f3950b6a24 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1317 microversion: 2.1 time: 1.615170 Aug 25 13:15:35.153175 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1953/3857] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:33 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1317 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:35.163517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:35.164964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:35.194493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:35.204829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:35.205849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:35.207642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:35.208865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:35.210130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:35.514712 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1c889e30-ec8a-4b7a-bff1-39d00415b31e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 10.580752 Aug 25 13:15:35.520634 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1905/3858] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 13:15:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 10589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:35.537096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-60a87699-bcf8-489d-bcad-f04c2561a039 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:35.541224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-60a87699-bcf8-489d-bcad-f04c2561a039 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:35.572774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60a87699-bcf8-489d-bcad-f04c2561a039 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:35.574472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60a87699-bcf8-489d-bcad-f04c2561a039 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:35.575853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60a87699-bcf8-489d-bcad-f04c2561a039 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:35.578539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60a87699-bcf8-489d-bcad-f04c2561a039 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:35.579926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60a87699-bcf8-489d-bcad-f04c2561a039 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:35.582000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60a87699-bcf8-489d-bcad-f04c2561a039 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:36.330398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60a87699-bcf8-489d-bcad-f04c2561a039 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:36.375102 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-60a87699-bcf8-489d-bcad-f04c2561a039 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1317 microversion: 2.1 time: 0.848709 Aug 25 13:15:36.376295 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1906/3859] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:35 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1317 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:36.407816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.88"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:36.414435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:36.428339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:36.430638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:36.432544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:36.434790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:36.437962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:36.439404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:36.507136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 13:15:36.511000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquired lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 13:15:36.683648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:36.711974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:36.725656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:36.732420 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b395b29e-9987-4f0f-87fe-e5cace210bd2 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 2955 microversion: 2.32 time: 1.577130 Aug 25 13:15:36.733953 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1954/3860] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:35 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 2955 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:36.752671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-acbd6f8d-1c67-44a0-8b42-e318f9dabe49 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:36.762302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-acbd6f8d-1c67-44a0-8b42-e318f9dabe49 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:36.784817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbd6f8d-1c67-44a0-8b42-e318f9dabe49 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:36.797782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbd6f8d-1c67-44a0-8b42-e318f9dabe49 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:36.797782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbd6f8d-1c67-44a0-8b42-e318f9dabe49 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:36.797782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbd6f8d-1c67-44a0-8b42-e318f9dabe49 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:36.798750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbd6f8d-1c67-44a0-8b42-e318f9dabe49 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:36.800351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acbd6f8d-1c67-44a0-8b42-e318f9dabe49 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:38.266714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-acbd6f8d-1c67-44a0-8b42-e318f9dabe49 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:38.321411 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-acbd6f8d-1c67-44a0-8b42-e318f9dabe49 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1317 microversion: 2.1 time: 1.584559 Aug 25 13:15:38.326707 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1955/3861] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:36 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1317 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:38.376999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e3a51e4-805c-4ae9-9075-ffe89a7b2b54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:38.379366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4e3a51e4-805c-4ae9-9075-ffe89a7b2b54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:38.403992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e3a51e4-805c-4ae9-9075-ffe89a7b2b54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:38.405437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e3a51e4-805c-4ae9-9075-ffe89a7b2b54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:38.406421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e3a51e4-805c-4ae9-9075-ffe89a7b2b54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:38.407776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e3a51e4-805c-4ae9-9075-ffe89a7b2b54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:38.408921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e3a51e4-805c-4ae9-9075-ffe89a7b2b54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:38.410473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e3a51e4-805c-4ae9-9075-ffe89a7b2b54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:40.217092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e3a51e4-805c-4ae9-9075-ffe89a7b2b54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:40.250264 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e3a51e4-805c-4ae9-9075-ffe89a7b2b54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1317 microversion: 2.1 time: 1.901726 Aug 25 13:15:40.252686 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1956/3862] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:38 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1317 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:40.273427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-25fe0cc1-767b-4159-95f7-48d976df2ab1 req-4ba20969-5870-466d-9de0-be62496caec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ab7070-d556-43aa-98dc-d78a45fd1b9c", "name": "network-vif-plugged", "status": "completed", "tag": "b5c44b23-585e-4be6-85fe-3a35a84befb2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:40.319989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-25fe0cc1-767b-4159-95f7-48d976df2ab1 req-4ba20969-5870-466d-9de0-be62496caec2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:40.321439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-25fe0cc1-767b-4159-95f7-48d976df2ab1 req-4ba20969-5870-466d-9de0-be62496caec2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:40.327338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-25fe0cc1-767b-4159-95f7-48d976df2ab1 req-4ba20969-5870-466d-9de0-be62496caec2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:40.380579 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-25fe0cc1-767b-4159-95f7-48d976df2ab1 req-4ba20969-5870-466d-9de0-be62496caec2 service nova] Creating event network-vif-plugged:b5c44b23-585e-4be6-85fe-3a35a84befb2 for instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c on n-h2-852771-8 Aug 25 13:15:40.423415 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-25fe0cc1-767b-4159-95f7-48d976df2ab1 req-4ba20969-5870-466d-9de0-be62496caec2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167312 Aug 25 13:15:40.435423 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1957/3863] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:40.472538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:40.474412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:40.515601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:40.530456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:40.531845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:40.545664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:40.547408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:40.548575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:43.040856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:43.111844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:43.120215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:43.135261 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-64cad092-6b52-4ddf-b04d-adb7b97e3111 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 2934 microversion: 2.32 time: 2.685333 Aug 25 13:15:43.140544 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1958/3864] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:40 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 2934 bytes in 2704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:43.167915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-771725ec-fcf6-424b-b87b-fca96fabb97e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:43.171251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-771725ec-fcf6-424b-b87b-fca96fabb97e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:43.198370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771725ec-fcf6-424b-b87b-fca96fabb97e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:43.224751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771725ec-fcf6-424b-b87b-fca96fabb97e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:43.242826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771725ec-fcf6-424b-b87b-fca96fabb97e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:43.250364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771725ec-fcf6-424b-b87b-fca96fabb97e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:43.253943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771725ec-fcf6-424b-b87b-fca96fabb97e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:43.263501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-771725ec-fcf6-424b-b87b-fca96fabb97e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:45.455158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-771725ec-fcf6-424b-b87b-fca96fabb97e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:45.489319 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-771725ec-fcf6-424b-b87b-fca96fabb97e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1317 microversion: 2.1 time: 2.346261 Aug 25 13:15:45.495094 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1959/3865] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:43 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1317 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:45.517853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-35e631fc-bf36-4bc1-9787-c4b024423d80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:45.523446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-35e631fc-bf36-4bc1-9787-c4b024423d80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:45.577558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e631fc-bf36-4bc1-9787-c4b024423d80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:45.582369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e631fc-bf36-4bc1-9787-c4b024423d80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:45.584101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e631fc-bf36-4bc1-9787-c4b024423d80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:45.588221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e631fc-bf36-4bc1-9787-c4b024423d80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:45.590751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e631fc-bf36-4bc1-9787-c4b024423d80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:45.595154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e631fc-bf36-4bc1-9787-c4b024423d80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:46.421673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:46.489572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:46.885728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Building network info cache for instance {{(pid=129059) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 13:15:47.079986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-35e631fc-bf36-4bc1-9787-c4b024423d80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:47.131412 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-35e631fc-bf36-4bc1-9787-c4b024423d80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1507 microversion: 2.1 time: 1.630239 Aug 25 13:15:47.159538 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1960/3866] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:45 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1507 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:47.189303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22fb0ba2-d351-4052-8630-f731d7a3a8c9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:47.192234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-22fb0ba2-d351-4052-8630-f731d7a3a8c9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:47.286959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22fb0ba2-d351-4052-8630-f731d7a3a8c9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:47.288651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22fb0ba2-d351-4052-8630-f731d7a3a8c9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:47.296199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22fb0ba2-d351-4052-8630-f731d7a3a8c9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:47.303044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22fb0ba2-d351-4052-8630-f731d7a3a8c9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:47.304064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22fb0ba2-d351-4052-8630-f731d7a3a8c9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:47.304894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22fb0ba2-d351-4052-8630-f731d7a3a8c9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:49.779147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-22fb0ba2-d351-4052-8630-f731d7a3a8c9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:49.843675 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22fb0ba2-d351-4052-8630-f731d7a3a8c9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.671974 Aug 25 13:15:49.844863 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1961/3867] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:47 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:50.319044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2a1ba27d-f106-440a-86ce-928b23a4a986 req-391dbebf-5626-4d71-b5f7-51592ab17a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-unplugged", "status": "completed", "tag": "e440bc76-ba2a-47fc-ba6a-494656b6f798"}, {"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-unplugged", "status": "completed", "tag": "5ef83c87-8cc0-47a2-bbb9-0e65f095a703"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:50.349043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a1ba27d-f106-440a-86ce-928b23a4a986 req-391dbebf-5626-4d71-b5f7-51592ab17a90 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:50.350457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a1ba27d-f106-440a-86ce-928b23a4a986 req-391dbebf-5626-4d71-b5f7-51592ab17a90 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:50.351377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a1ba27d-f106-440a-86ce-928b23a4a986 req-391dbebf-5626-4d71-b5f7-51592ab17a90 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:50.378463 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2a1ba27d-f106-440a-86ce-928b23a4a986 req-391dbebf-5626-4d71-b5f7-51592ab17a90 service nova] Creating event network-vif-unplugged:e440bc76-ba2a-47fc-ba6a-494656b6f798 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:15:50.382732 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2a1ba27d-f106-440a-86ce-928b23a4a986 req-391dbebf-5626-4d71-b5f7-51592ab17a90 service nova] Creating event network-vif-unplugged:5ef83c87-8cc0-47a2-bbb9-0e65f095a703 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:15:50.394921 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2a1ba27d-f106-440a-86ce-928b23a4a986 req-391dbebf-5626-4d71-b5f7-51592ab17a90 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.532950 Aug 25 13:15:50.403657 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1962/3868] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:50.416190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:50.418034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:50.432154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:50.433415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:50.434508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:50.436120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:50.437278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:50.438350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:51.759903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:51.828832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:51.856497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:51.860059 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bea3af1c-5351-49fa-bc90-04398f921ef0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 2819 microversion: 2.32 time: 1.453576 Aug 25 13:15:51.863746 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1963/3869] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:50 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 2819 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:51.876482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fa9edb7f-ad26-40e0-b3cd-538f9377b79c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:51.879340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fa9edb7f-ad26-40e0-b3cd-538f9377b79c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:51.899235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa9edb7f-ad26-40e0-b3cd-538f9377b79c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:51.901248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa9edb7f-ad26-40e0-b3cd-538f9377b79c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:51.903616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa9edb7f-ad26-40e0-b3cd-538f9377b79c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:51.913810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa9edb7f-ad26-40e0-b3cd-538f9377b79c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:51.915250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa9edb7f-ad26-40e0-b3cd-538f9377b79c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:51.916542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa9edb7f-ad26-40e0-b3cd-538f9377b79c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:51.929749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Updating instance_info_cache with network_info: [{"id": "e7ec10ef-f422-46b6-b9a3-65d2d19b3172", "address": "fa:16:3e:4a:cc:0f", "network": {"id": "80839a59-142e-4d1d-8902-89cc3d6af65b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1562757631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d8b38448af0648bb8bb595ef7cf8592b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape7ec10ef-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129059) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 13:15:51.973683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Releasing lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 13:15:51.978012 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a35c416a-d452-4bf8-99a5-809a4f04b18e tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action" status: 202 len: 0 microversion: 2.1 time: 15.595749 Aug 25 13:15:51.979364 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1907/3870] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:15:36 2022] POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action => generated 0 bytes in 15602 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 13:15:52.001346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0138ec6d-1ed7-49c6-8ced-a2334ac2a9f5 req-5ce6cd98-9e28-487a-a865-95855e6f25fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-deleted", "tag": "67845e42-86bc-468e-af48-e1b8969e1ce8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:52.043285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0138ec6d-1ed7-49c6-8ced-a2334ac2a9f5 req-5ce6cd98-9e28-487a-a865-95855e6f25fa service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:52.044974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0138ec6d-1ed7-49c6-8ced-a2334ac2a9f5 req-5ce6cd98-9e28-487a-a865-95855e6f25fa service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:52.046268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0138ec6d-1ed7-49c6-8ced-a2334ac2a9f5 req-5ce6cd98-9e28-487a-a865-95855e6f25fa service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:52.072508 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-0138ec6d-1ed7-49c6-8ced-a2334ac2a9f5 req-5ce6cd98-9e28-487a-a865-95855e6f25fa service nova] Creating event network-vif-deleted:67845e42-86bc-468e-af48-e1b8969e1ce8 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:15:52.106152 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0138ec6d-1ed7-49c6-8ced-a2334ac2a9f5 req-5ce6cd98-9e28-487a-a865-95855e6f25fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115455 Aug 25 13:15:52.109716 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1908/3871] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:52.132551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2a4a9376-a8d6-465c-bb8d-d60474ac44a1 req-29d4b1a0-1d40-4952-8104-6fe5e9c95234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ee6897-bbd1-4ead-b5ba-eeba8fc6469e", "tag": "e7ec10ef-f422-46b6-b9a3-65d2d19b3172"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:52.162782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2a4a9376-a8d6-465c-bb8d-d60474ac44a1 req-29d4b1a0-1d40-4952-8104-6fe5e9c95234 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:52.163950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2a4a9376-a8d6-465c-bb8d-d60474ac44a1 req-29d4b1a0-1d40-4952-8104-6fe5e9c95234 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:52.164927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2a4a9376-a8d6-465c-bb8d-d60474ac44a1 req-29d4b1a0-1d40-4952-8104-6fe5e9c95234 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:52.197334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2a4a9376-a8d6-465c-bb8d-d60474ac44a1 req-29d4b1a0-1d40-4952-8104-6fe5e9c95234 service nova] Creating event network-changed:e7ec10ef-f422-46b6-b9a3-65d2d19b3172 for instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e on n-h1-852771-8 Aug 25 13:15:52.210211 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2a4a9376-a8d6-465c-bb8d-d60474ac44a1 req-29d4b1a0-1d40-4952-8104-6fe5e9c95234 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094663 Aug 25 13:15:52.212797 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1909/3872] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:52.228672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-37753a89-2437-4614-a36a-6f50c76bb6c8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:52.234680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-37753a89-2437-4614-a36a-6f50c76bb6c8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:52.263461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37753a89-2437-4614-a36a-6f50c76bb6c8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:52.265034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37753a89-2437-4614-a36a-6f50c76bb6c8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:52.266511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37753a89-2437-4614-a36a-6f50c76bb6c8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:52.281962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37753a89-2437-4614-a36a-6f50c76bb6c8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:52.283324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37753a89-2437-4614-a36a-6f50c76bb6c8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:52.285313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37753a89-2437-4614-a36a-6f50c76bb6c8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:53.163218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fa9edb7f-ad26-40e0-b3cd-538f9377b79c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:53.202751 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fa9edb7f-ad26-40e0-b3cd-538f9377b79c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1317 microversion: 2.1 time: 1.335957 Aug 25 13:15:53.207069 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1964/3873] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:51 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1317 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:53.230117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6a95ba5d-efca-46aa-aa08-498de0609254 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:53.232810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6a95ba5d-efca-46aa-aa08-498de0609254 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:53.260296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a95ba5d-efca-46aa-aa08-498de0609254 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:53.263553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a95ba5d-efca-46aa-aa08-498de0609254 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:53.266011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a95ba5d-efca-46aa-aa08-498de0609254 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:53.268930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a95ba5d-efca-46aa-aa08-498de0609254 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:53.275093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a95ba5d-efca-46aa-aa08-498de0609254 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:53.289680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6a95ba5d-efca-46aa-aa08-498de0609254 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:53.358061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37753a89-2437-4614-a36a-6f50c76bb6c8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:53.392852 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-37753a89-2437-4614-a36a-6f50c76bb6c8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1507 microversion: 2.1 time: 1.174142 Aug 25 13:15:53.395123 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1910/3874] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:52 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1507 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:53.423699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f7f2cb6-786c-4cf1-81d4-205cf56efec2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Action: 'create', calling method: .version_select at 0x7f3a2975fca0>, body: {"pool": "08e51fcb-b6e4-4dd9-a40f-e2e61213f366"} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:55.192563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6a95ba5d-efca-46aa-aa08-498de0609254 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:55.224859 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6a95ba5d-efca-46aa-aa08-498de0609254 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.012536 Aug 25 13:15:55.226977 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1965/3875] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:53 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:55.236669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d9ed0316-6102-4039-b6e8-74b48d2820a8 req-a3977a37-0507-420f-8abb-815bb81deeae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-unplugged", "status": "completed", "tag": "5b7c31c9-60ee-492f-b4f4-8144364f3d01"}, {"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-unplugged", "status": "completed", "tag": "67845e42-86bc-468e-af48-e1b8969e1ce8"}, {"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-unplugged", "status": "completed", "tag": "2fde30af-7c62-406e-af8d-ea3df7741a85"}, {"server_uuid": "c5304090-4e5b-4154-b954-a46f3b514bd1", "name": "network-vif-plugged", "status": "completed", "tag": "0c8d4e5e-d3da-4701-8691-2c87b134b408"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:55.289877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d9ed0316-6102-4039-b6e8-74b48d2820a8 req-a3977a37-0507-420f-8abb-815bb81deeae service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:55.292656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d9ed0316-6102-4039-b6e8-74b48d2820a8 req-a3977a37-0507-420f-8abb-815bb81deeae service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:55.297318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d9ed0316-6102-4039-b6e8-74b48d2820a8 req-a3977a37-0507-420f-8abb-815bb81deeae service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:55.340495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:55.350640 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d9ed0316-6102-4039-b6e8-74b48d2820a8 req-a3977a37-0507-420f-8abb-815bb81deeae service nova] Creating event network-vif-unplugged:5b7c31c9-60ee-492f-b4f4-8144364f3d01 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:15:55.351370 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d9ed0316-6102-4039-b6e8-74b48d2820a8 req-a3977a37-0507-420f-8abb-815bb81deeae service nova] Creating event network-vif-unplugged:67845e42-86bc-468e-af48-e1b8969e1ce8 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:15:55.352197 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d9ed0316-6102-4039-b6e8-74b48d2820a8 req-a3977a37-0507-420f-8abb-815bb81deeae service nova] Creating event network-vif-unplugged:2fde30af-7c62-406e-af8d-ea3df7741a85 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:15:55.353532 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d9ed0316-6102-4039-b6e8-74b48d2820a8 req-a3977a37-0507-420f-8abb-815bb81deeae service nova] Creating event network-vif-plugged:0c8d4e5e-d3da-4701-8691-2c87b134b408 for instance c5304090-4e5b-4154-b954-a46f3b514bd1 on n-h2-852771-8 Aug 25 13:15:55.384057 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d9ed0316-6102-4039-b6e8-74b48d2820a8 req-a3977a37-0507-420f-8abb-815bb81deeae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.154082 Aug 25 13:15:55.387715 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1966/3876] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:55.408498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:55.411273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:55.435344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:55.437743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:55.438976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:55.441470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:55.442742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:55.444030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:57.222157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:57.278543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:57.289463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:57.294819 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d5facbfd-1fe4-4781-a1e5-53b4e6433257 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 2611 microversion: 2.32 time: 1.895883 Aug 25 13:15:57.298127 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1967/3877] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:55 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 2611 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:57.316137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dece064e-08a3-494b-923f-0f9af0f1f0df tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:57.322341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dece064e-08a3-494b-923f-0f9af0f1f0df tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:57.336071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dece064e-08a3-494b-923f-0f9af0f1f0df tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:57.337196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dece064e-08a3-494b-923f-0f9af0f1f0df tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:57.340516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dece064e-08a3-494b-923f-0f9af0f1f0df tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:57.342223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dece064e-08a3-494b-923f-0f9af0f1f0df tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:57.343362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dece064e-08a3-494b-923f-0f9af0f1f0df tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:57.344227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dece064e-08a3-494b-923f-0f9af0f1f0df tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:57.585131 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dece064e-08a3-494b-923f-0f9af0f1f0df tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "PUT /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1079 microversion: 2.1 time: 0.279219 Aug 25 13:15:57.604942 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1968/3878] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Aug 25 13:15:57 2022] PUT /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1079 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:57.635872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1a2f4f24-5180-480a-b6f1-89b5c061723d req-088a15cf-60f7-4ef7-8a7c-5a0629e4cf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-deleted", "tag": "577f3d0c-4649-4113-b00f-2661db107775"}, {"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-deleted", "tag": "5b7c31c9-60ee-492f-b4f4-8144364f3d01"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:57.672142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a2f4f24-5180-480a-b6f1-89b5c061723d req-088a15cf-60f7-4ef7-8a7c-5a0629e4cf5f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:57.673057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a2f4f24-5180-480a-b6f1-89b5c061723d req-088a15cf-60f7-4ef7-8a7c-5a0629e4cf5f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:57.686196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a2f4f24-5180-480a-b6f1-89b5c061723d req-088a15cf-60f7-4ef7-8a7c-5a0629e4cf5f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:57.729676 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1a2f4f24-5180-480a-b6f1-89b5c061723d req-088a15cf-60f7-4ef7-8a7c-5a0629e4cf5f service nova] Creating event network-vif-deleted:577f3d0c-4649-4113-b00f-2661db107775 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:15:57.731338 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1a2f4f24-5180-480a-b6f1-89b5c061723d req-088a15cf-60f7-4ef7-8a7c-5a0629e4cf5f service nova] Creating event network-vif-deleted:5b7c31c9-60ee-492f-b4f4-8144364f3d01 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:15:57.743105 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1a2f4f24-5180-480a-b6f1-89b5c061723d req-088a15cf-60f7-4ef7-8a7c-5a0629e4cf5f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.124871 Aug 25 13:15:57.745070 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1969/3879] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:57.756619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eadc5c1a-9f31-4cb4-916b-eaa655b9cef1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:57.758839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eadc5c1a-9f31-4cb4-916b-eaa655b9cef1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:57.785955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eadc5c1a-9f31-4cb4-916b-eaa655b9cef1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:57.792260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eadc5c1a-9f31-4cb4-916b-eaa655b9cef1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:57.794330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eadc5c1a-9f31-4cb4-916b-eaa655b9cef1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:57.795288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eadc5c1a-9f31-4cb4-916b-eaa655b9cef1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:57.796396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eadc5c1a-9f31-4cb4-916b-eaa655b9cef1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:57.801119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eadc5c1a-9f31-4cb4-916b-eaa655b9cef1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:59.016786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eadc5c1a-9f31-4cb4-916b-eaa655b9cef1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:59.047844 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eadc5c1a-9f31-4cb4-916b-eaa655b9cef1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1317 microversion: 2.1 time: 1.300043 Aug 25 13:15:59.071508 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1970/3880] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:57 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1317 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:59.127529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b4bc1a7e-05cb-4805-9676-18b4f90db72c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:59.136463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b4bc1a7e-05cb-4805-9676-18b4f90db72c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:59.161715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4bc1a7e-05cb-4805-9676-18b4f90db72c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:59.164792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4bc1a7e-05cb-4805-9676-18b4f90db72c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:59.177968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4bc1a7e-05cb-4805-9676-18b4f90db72c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:59.185307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4bc1a7e-05cb-4805-9676-18b4f90db72c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:59.186781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4bc1a7e-05cb-4805-9676-18b4f90db72c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:59.190716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4bc1a7e-05cb-4805-9676-18b4f90db72c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:00.190960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b4bc1a7e-05cb-4805-9676-18b4f90db72c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:00.233794 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b4bc1a7e-05cb-4805-9676-18b4f90db72c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.133437 Aug 25 13:16:00.234972 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1971/3881] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:59 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:00.255672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-539b58ed-b6a5-4e78-b063-be04f2bda64e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:00.257289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-539b58ed-b6a5-4e78-b063-be04f2bda64e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:00.280742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-539b58ed-b6a5-4e78-b063-be04f2bda64e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:00.282201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-539b58ed-b6a5-4e78-b063-be04f2bda64e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:00.283330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-539b58ed-b6a5-4e78-b063-be04f2bda64e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:00.295035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-539b58ed-b6a5-4e78-b063-be04f2bda64e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:00.296435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-539b58ed-b6a5-4e78-b063-be04f2bda64e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:00.297688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-539b58ed-b6a5-4e78-b063-be04f2bda64e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:01.154791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-539b58ed-b6a5-4e78-b063-be04f2bda64e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:01.200723 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-539b58ed-b6a5-4e78-b063-be04f2bda64e tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1505 microversion: 2.1 time: 0.958388 Aug 25 13:16:01.213742 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1972/3882] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:00 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1505 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:01.236156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:01.238743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:01.256985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:01.258327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:01.259476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:01.276755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:01.280021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:01.285407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:01.765068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:01.808406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:01.810632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:01.812821 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b65f5daa-06e9-4f21-9357-f02d214e3c6f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.596953 Aug 25 13:16:01.818180 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1973/3883] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:01 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:01.864259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-45298a2e-a309-4df2-84f5-f5548279a87f req-6310313e-4c01-4240-8bb2-e74b95e02e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-deleted", "tag": "e440bc76-ba2a-47fc-ba6a-494656b6f798"}, {"server_uuid": "58ba2cb0-d580-4c72-9404-4a05535d6041", "name": "network-vif-deleted", "tag": "2fde30af-7c62-406e-af8d-ea3df7741a85"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:01.869389 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f7f2cb6-786c-4cf1-81d4-205cf56efec2 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.467342 Aug 25 13:16:01.871652 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1911/3884] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 13:15:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:01.902232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5fea46eb-f0d7-4df6-af25-b0835abd1ed9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:01.903576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-45298a2e-a309-4df2-84f5-f5548279a87f req-6310313e-4c01-4240-8bb2-e74b95e02e65 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:01.904212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5fea46eb-f0d7-4df6-af25-b0835abd1ed9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:01.904515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-45298a2e-a309-4df2-84f5-f5548279a87f req-6310313e-4c01-4240-8bb2-e74b95e02e65 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:01.905390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-45298a2e-a309-4df2-84f5-f5548279a87f req-6310313e-4c01-4240-8bb2-e74b95e02e65 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:01.923362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fea46eb-f0d7-4df6-af25-b0835abd1ed9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:01.923362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fea46eb-f0d7-4df6-af25-b0835abd1ed9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:01.923362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fea46eb-f0d7-4df6-af25-b0835abd1ed9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:01.932147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fea46eb-f0d7-4df6-af25-b0835abd1ed9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:01.932147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fea46eb-f0d7-4df6-af25-b0835abd1ed9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:01.932147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fea46eb-f0d7-4df6-af25-b0835abd1ed9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:01.960986 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-45298a2e-a309-4df2-84f5-f5548279a87f req-6310313e-4c01-4240-8bb2-e74b95e02e65 service nova] Creating event network-vif-deleted:e440bc76-ba2a-47fc-ba6a-494656b6f798 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:16:01.962525 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-45298a2e-a309-4df2-84f5-f5548279a87f req-6310313e-4c01-4240-8bb2-e74b95e02e65 service nova] Creating event network-vif-deleted:2fde30af-7c62-406e-af8d-ea3df7741a85 for instance 58ba2cb0-d580-4c72-9404-4a05535d6041 on n-h1-852771-8 Aug 25 13:16:01.976434 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-45298a2e-a309-4df2-84f5-f5548279a87f req-6310313e-4c01-4240-8bb2-e74b95e02e65 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.143655 Aug 25 13:16:01.982706 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1974/3885] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:02.001672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5a75fd5-8793-4442-8cd4-02945934d60a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:02.004599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5a75fd5-8793-4442-8cd4-02945934d60a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:02.022413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a75fd5-8793-4442-8cd4-02945934d60a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:02.023729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a75fd5-8793-4442-8cd4-02945934d60a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:02.024911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a75fd5-8793-4442-8cd4-02945934d60a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:02.027514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a75fd5-8793-4442-8cd4-02945934d60a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:02.031057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a75fd5-8793-4442-8cd4-02945934d60a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:02.032354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5a75fd5-8793-4442-8cd4-02945934d60a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:02.632067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5a75fd5-8793-4442-8cd4-02945934d60a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:02.668346 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5a75fd5-8793-4442-8cd4-02945934d60a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.678575 Aug 25 13:16:02.682708 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1975/3886] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:01 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:02.736805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e4739d8-ff4c-4dd5-a3ba-7c4cf85d39aa tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:02.738964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4e4739d8-ff4c-4dd5-a3ba-7c4cf85d39aa tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:02.749298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:02.752107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e4739d8-ff4c-4dd5-a3ba-7c4cf85d39aa tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:02.753800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e4739d8-ff4c-4dd5-a3ba-7c4cf85d39aa tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:02.755001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e4739d8-ff4c-4dd5-a3ba-7c4cf85d39aa tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:02.756772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e4739d8-ff4c-4dd5-a3ba-7c4cf85d39aa tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:02.758058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e4739d8-ff4c-4dd5-a3ba-7c4cf85d39aa tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:02.758817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e4739d8-ff4c-4dd5-a3ba-7c4cf85d39aa tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:02.783212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5fea46eb-f0d7-4df6-af25-b0835abd1ed9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:02.815949 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5fea46eb-f0d7-4df6-af25-b0835abd1ed9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1506 microversion: 2.1 time: 0.924349 Aug 25 13:16:02.834345 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1912/3887] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:01 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1506 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:02.868041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.184"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:02.881374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:02.916095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:02.921364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:02.924366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:02.932744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:02.933771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:02.939025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:03.085883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 13:16:03.086795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquired lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 13:16:03.466829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e4739d8-ff4c-4dd5-a3ba-7c4cf85d39aa tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:03.512699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e4739d8-ff4c-4dd5-a3ba-7c4cf85d39aa tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1505 microversion: 2.1 time: 0.816348 Aug 25 13:16:03.514669 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1976/3888] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:02 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1505 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:03.557108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-38a658e6-0e58-45e2-8aa6-e18afe037ac9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:03.564029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-38a658e6-0e58-45e2-8aa6-e18afe037ac9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:03.590856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38a658e6-0e58-45e2-8aa6-e18afe037ac9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:03.591377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38a658e6-0e58-45e2-8aa6-e18afe037ac9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:03.592348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38a658e6-0e58-45e2-8aa6-e18afe037ac9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:03.609219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38a658e6-0e58-45e2-8aa6-e18afe037ac9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:03.611307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38a658e6-0e58-45e2-8aa6-e18afe037ac9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:03.612961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38a658e6-0e58-45e2-8aa6-e18afe037ac9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:03.778235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-38a658e6-0e58-45e2-8aa6-e18afe037ac9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:16:04.077113 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-38a658e6-0e58-45e2-8aa6-e18afe037ac9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 204 len: 0 microversion: 2.1 time: 0.559533 Aug 25 13:16:04.087483 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1977/3889] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:16:03 2022] DELETE /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:16:04.107128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:04.108501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:04.120693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:04.121609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:04.122369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:04.123628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:04.124431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:04.125181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:04.318731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:04.350645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:04.361595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:04.371564 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-769e3df2-51ff-4f2f-a954-e4ce8deceb72 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.280469 Aug 25 13:16:04.373391 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1978/3890] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:04 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:04.422026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1608893933", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "7c492fa6-6e78-453d-bf88-c7f9aac830a1"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:04.612737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] validate_networks() for [('7c492fa6-6e78-453d-bf88-c7f9aac830a1', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:16:04.632753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG neutronclient.v2_0.client [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.184 (2f0ae86f-e4eb-43ea-8c55-7a5823447dc2) with port e7ec10ef-f422-46b6-b9a3-65d2d19b3172 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 08e51fcb-b6e4-4dd9-a40f-e2e61213f366.", "detail": ""}} {{(pid=129059) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 13:16:04.633867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Releasing lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 13:16:04.635213 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.184 (2f0ae86f-e4eb-43ea-8c55-7a5823447dc2) with port e7ec10ef-f422-46b6-b9a3-65d2d19b3172 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 08e51fcb-b6e4-4dd9-a40f-e2e61213f366. Aug 25 13:16:04.635213 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-29d210a3-ff9b-4092-915e-21bc658a8cb0'] Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Request method failure captured: Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action HTTP/1.1 Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 46 Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3XKJ5btzYd3SI6mHNlzWcUv8U17GEKteIYpl9lgvEn1BNjzMMaDcsZkkrHi61hnQQVf7ZzF9RQQ3WplhopiGENtTNGichBtt6EEhqmGU_-AOhWKI3NCtYV_xd3f0VifmcN1lqpPx5FBCSCoPwD6z-v3NqTpaoxLm9j8R9A-4BBKtVo Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d8b38448af0648bb8bb595ef7cf8592b Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8b38448af0648bb8bb595ef7cf8592b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d8b38448af0648bb8bb595ef7cf8592b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d8b38448af0648bb8bb595ef7cf8592b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8b38448af0648bb8bb595ef7cf8592b"}]}] Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d8b38448af0648bb8bb595ef7cf8592b Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dbd0b7a9d42d44df875ee755f862ba96 Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: {"addFloatingIp": {"address": "172.25.1.184"}} Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: exception: Cannot associate floating IP 172.25.1.184 (2f0ae86f-e4eb-43ea-8c55-7a5823447dc2) with port e7ec10ef-f422-46b6-b9a3-65d2d19b3172 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 08e51fcb-b6e4-4dd9-a40f-e2e61213f366. Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-29d210a3-ff9b-4092-915e-21bc658a8cb0'] Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '95ee6897-bbd1-4ead-b5ba-eeba8fc6469e', 'body': {'addFloatingIp': {'address': '172.25.1.184'}}} Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 13:16:04.639477 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.184 (2f0ae86f-e4eb-43ea-8c55-7a5823447dc2) with port e7ec10ef-f422-46b6-b9a3-65d2d19b3172 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 08e51fcb-b6e4-4dd9-a40f-e2e61213f366. Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d210a3-ff9b-4092-915e-21bc658a8cb0'] Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.184 (2f0ae86f-e4eb-43ea-8c55-7a5823447dc2) with port e7ec10ef-f422-46b6-b9a3-65d2d19b3172 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 08e51fcb-b6e4-4dd9-a40f-e2e61213f366. Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d210a3-ff9b-4092-915e-21bc658a8cb0'] Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.184 (2f0ae86f-e4eb-43ea-8c55-7a5823447dc2) with port e7ec10ef-f422-46b6-b9a3-65d2d19b3172 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 08e51fcb-b6e4-4dd9-a40f-e2e61213f366. Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d210a3-ff9b-4092-915e-21bc658a8cb0'] Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.184 (2f0ae86f-e4eb-43ea-8c55-7a5823447dc2) with port e7ec10ef-f422-46b6-b9a3-65d2d19b3172 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 08e51fcb-b6e4-4dd9-a40f-e2e61213f366. Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d210a3-ff9b-4092-915e-21bc658a8cb0'] Aug 25 13:16:04.649008 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:04.655476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Returning 400 to user: Cannot associate floating IP 172.25.1.184 (2f0ae86f-e4eb-43ea-8c55-7a5823447dc2) with port e7ec10ef-f422-46b6-b9a3-65d2d19b3172 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 08e51fcb-b6e4-4dd9-a40f-e2e61213f366. Aug 25 13:16:04.655476 n-d-852771-8 devstack@n-api.service[129059]: Neutron server returns request_ids: ['req-29d210a3-ff9b-4092-915e-21bc658a8cb0'] {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:04.663827 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9ae13e49-8b3e-4cef-99b8-e9972928b9cd tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action" status: 400 len: 382 microversion: 2.1 time: 1.804144 Aug 25 13:16:04.665118 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1913/3891] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:16:02 2022] POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action => generated 382 bytes in 1841 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:16:04.687141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:04.696951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:04.743646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:04.744560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:04.745564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:04.747136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:04.748253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:04.749059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:04.994508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:16:04.995315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:16:04.996211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:16:04.996946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:16:04.998070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:16:05.263452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:05.298325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:05.302497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:05.303527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:05.304883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:05.305760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:05.306590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:05.415962 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1e4e1159-3457-4f28-8042-3daecd690ec7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "POST /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c/action" status: 202 len: 1111 microversion: 2.1 time: 0.744928 Aug 25 13:16:05.444339 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1914/3892] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:16:04 2022] POST /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c/action => generated 1111 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 25 13:16:05.464130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0cf78192-0cf8-4ab9-b1df-0b7a28762cba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:05.465452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0cf78192-0cf8-4ab9-b1df-0b7a28762cba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:05.478519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cf78192-0cf8-4ab9-b1df-0b7a28762cba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:05.479764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cf78192-0cf8-4ab9-b1df-0b7a28762cba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:05.480686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cf78192-0cf8-4ab9-b1df-0b7a28762cba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:05.482216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cf78192-0cf8-4ab9-b1df-0b7a28762cba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:05.483387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cf78192-0cf8-4ab9-b1df-0b7a28762cba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:05.484633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cf78192-0cf8-4ab9-b1df-0b7a28762cba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:06.751461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:16:06.754085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:16:06.754426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:16:06.760733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:16:06.764193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:16:06.832640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0cf78192-0cf8-4ab9-b1df-0b7a28762cba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:06.844507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:06.848670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:06.848670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:06.854575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:06.860166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:06.862767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:06.865782 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0cf78192-0cf8-4ab9-b1df-0b7a28762cba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1512 microversion: 2.1 time: 1.418638 Aug 25 13:16:06.867412 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1915/3893] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:05 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1512 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:06.877162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b1a4872-553e-4f75-8da1-cda701e971fb tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '.version_select at 0x7f3a29722700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:06.956932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:16:06.972543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for user e320ccc6c0624541895fc42bf681da76 and project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:16:07.006521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:16:07.011744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:16:07.171979 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b517a5e9-2084-4779-bd50-cba7f5ae1939 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.792134 Aug 25 13:16:07.182862 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1979/3894] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:16:07.214942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:07.216256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:07.234631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:07.234631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:07.235587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:07.236953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:07.239737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:07.240512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:08.218163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:08.288190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:08.295231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:08.312880 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb7f4d18-f9e8-4926-b21b-1655f8cb9486 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 1.107670 Aug 25 13:16:08.330078 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1980/3895] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:07 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:08.377827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aa367390-1c9a-487f-84fb-8c9ff6abbc17 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:08.386757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-aa367390-1c9a-487f-84fb-8c9ff6abbc17 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:08.416914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa367390-1c9a-487f-84fb-8c9ff6abbc17 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:08.429670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa367390-1c9a-487f-84fb-8c9ff6abbc17 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:08.434540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa367390-1c9a-487f-84fb-8c9ff6abbc17 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:08.436092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa367390-1c9a-487f-84fb-8c9ff6abbc17 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:08.438326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa367390-1c9a-487f-84fb-8c9ff6abbc17 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:08.439193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa367390-1c9a-487f-84fb-8c9ff6abbc17 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:09.897543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-aa367390-1c9a-487f-84fb-8c9ff6abbc17 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:09.938982 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aa367390-1c9a-487f-84fb-8c9ff6abbc17 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1516 microversion: 2.1 time: 1.603201 Aug 25 13:16:09.943431 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1981/3896] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:08 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1516 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:09.957095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aeff7118-372b-45e0-bdcc-7bfa75576a3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:09.959909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-aeff7118-372b-45e0-bdcc-7bfa75576a3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:10.001062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeff7118-372b-45e0-bdcc-7bfa75576a3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:10.005338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeff7118-372b-45e0-bdcc-7bfa75576a3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:10.006808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeff7118-372b-45e0-bdcc-7bfa75576a3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:10.012990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeff7118-372b-45e0-bdcc-7bfa75576a3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:10.017624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeff7118-372b-45e0-bdcc-7bfa75576a3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:10.022563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aeff7118-372b-45e0-bdcc-7bfa75576a3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:10.359669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-aeff7118-372b-45e0-bdcc-7bfa75576a3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:10.388178 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aeff7118-372b-45e0-bdcc-7bfa75576a3b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1267 microversion: 2.1 time: 0.441406 Aug 25 13:16:10.396758 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1982/3897] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:09 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1267 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:10.416515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3af8937d-3c20-4df7-843e-248e879671ef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:10.427615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3af8937d-3c20-4df7-843e-248e879671ef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:10.449476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3af8937d-3c20-4df7-843e-248e879671ef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:10.454987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3af8937d-3c20-4df7-843e-248e879671ef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:10.457998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3af8937d-3c20-4df7-843e-248e879671ef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:10.463226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3af8937d-3c20-4df7-843e-248e879671ef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:10.468272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3af8937d-3c20-4df7-843e-248e879671ef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:10.469566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3af8937d-3c20-4df7-843e-248e879671ef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:10.490474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:11.056072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3af8937d-3c20-4df7-843e-248e879671ef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:11.103203 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3af8937d-3c20-4df7-843e-248e879671ef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 200 len: 1470 microversion: 2.1 time: 0.701619 Aug 25 13:16:11.119181 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1983/3898] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:10 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 1470 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:11.159817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:11.162980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:11.204969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:11.214188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:11.220326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:11.224509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:11.233105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:11.234748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:12.220522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:12.260155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:12.264893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:12.269715 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a0e5d4e-5861-471c-afd9-16913b991733 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 1.134395 Aug 25 13:16:12.273529 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1984/3899] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:11 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:12.297856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4f87e5c7-1524-422c-b67b-0ed3c59dfd86 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:12.304302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4f87e5c7-1524-422c-b67b-0ed3c59dfd86 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:12.336594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f87e5c7-1524-422c-b67b-0ed3c59dfd86 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:12.343148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f87e5c7-1524-422c-b67b-0ed3c59dfd86 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:12.344882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f87e5c7-1524-422c-b67b-0ed3c59dfd86 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:12.354017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f87e5c7-1524-422c-b67b-0ed3c59dfd86 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:12.355644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f87e5c7-1524-422c-b67b-0ed3c59dfd86 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:12.359232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f87e5c7-1524-422c-b67b-0ed3c59dfd86 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:12.545922 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b1a4872-553e-4f75-8da1-cda701e971fb tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/2f0ae86f-e4eb-43ea-8c55-7a5823447dc2" status: 202 len: 0 microversion: 2.1 time: 5.676045 Aug 25 13:16:12.548446 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1916/3900] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 13:16:06 2022] DELETE /compute/v2.1/os-floating-ips/2f0ae86f-e4eb-43ea-8c55-7a5823447dc2 => generated 0 bytes in 5680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:16:12.574131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6866c6ed-f474-402a-820a-126af020f416 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:12.575773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6866c6ed-f474-402a-820a-126af020f416 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:12.619439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6866c6ed-f474-402a-820a-126af020f416 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:12.627437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6866c6ed-f474-402a-820a-126af020f416 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:12.629258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6866c6ed-f474-402a-820a-126af020f416 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:12.636883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6866c6ed-f474-402a-820a-126af020f416 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:12.639406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6866c6ed-f474-402a-820a-126af020f416 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:12.647881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6866c6ed-f474-402a-820a-126af020f416 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:12.816982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4f87e5c7-1524-422c-b67b-0ed3c59dfd86 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:12.866158 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4f87e5c7-1524-422c-b67b-0ed3c59dfd86 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1516 microversion: 2.1 time: 0.585799 Aug 25 13:16:12.869365 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1985/3901] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:12 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1516 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:12.898102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-095e5277-87b8-4e2d-b348-6100ef8f4337 req-1698d783-3435-4253-9d53-983e6c9c62e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5304090-4e5b-4154-b954-a46f3b514bd1", "name": "network-vif-deleted", "tag": "0c8d4e5e-d3da-4701-8691-2c87b134b408"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:12.944694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-095e5277-87b8-4e2d-b348-6100ef8f4337 req-1698d783-3435-4253-9d53-983e6c9c62e7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:12.966508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-095e5277-87b8-4e2d-b348-6100ef8f4337 req-1698d783-3435-4253-9d53-983e6c9c62e7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:12.973652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-095e5277-87b8-4e2d-b348-6100ef8f4337 req-1698d783-3435-4253-9d53-983e6c9c62e7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:13.015264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6866c6ed-f474-402a-820a-126af020f416 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:13.045154 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6866c6ed-f474-402a-820a-126af020f416 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1273 microversion: 2.1 time: 0.493342 Aug 25 13:16:13.080006 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-095e5277-87b8-4e2d-b348-6100ef8f4337 req-1698d783-3435-4253-9d53-983e6c9c62e7 service nova] Creating event network-vif-deleted:0c8d4e5e-d3da-4701-8691-2c87b134b408 for instance c5304090-4e5b-4154-b954-a46f3b514bd1 on n-h2-852771-8 Aug 25 13:16:13.082771 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1917/3902] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:12 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1273 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:13.109788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:13.127118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:13.144534 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-095e5277-87b8-4e2d-b348-6100ef8f4337 req-1698d783-3435-4253-9d53-983e6c9c62e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259152 Aug 25 13:16:13.150838 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1986/3903] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:13.185036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:13.188672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.88"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:13.195637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:13.198149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:13.200172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:13.201034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:13.202051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:13.322743 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 HTTP/1.1 Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'c5304090-4e5b-4154-b954-a46f3b514bd1'} Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:13.328189 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:13.343986 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:13.343986 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:13.343986 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:13.343986 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:16:13.343986 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:16:13.343986 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:16:13.343986 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:13.343986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:13.343986 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-049ae387-61b9-4c6a-9d86-de9f5376135c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 404 len: 111 microversion: 2.1 time: 0.246121 Aug 25 13:16:13.354460 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1918/3904] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:13 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 111 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:16:13.374600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:13.375705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:13.420287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:13.421269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:13.421968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:13.423311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:13.447309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:13.451385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:13.720364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:13.766194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:13.770764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:13.775586 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4c970425-4184-4b79-bf8e-5654cb7dc9f0 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.414721 Aug 25 13:16:13.777296 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1919/3905] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:13 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:13.803306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:13.824158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:13.824939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:13.826513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:13.838822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:13.841404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:13.842795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:13.867254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-82e7ce4b-a1b8-4f10-9532-a533cccdb808 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:13.868716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-82e7ce4b-a1b8-4f10-9532-a533cccdb808 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:13.894581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e7ce4b-a1b8-4f10-9532-a533cccdb808 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:13.895598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e7ce4b-a1b8-4f10-9532-a533cccdb808 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:13.896451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e7ce4b-a1b8-4f10-9532-a533cccdb808 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:13.897877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e7ce4b-a1b8-4f10-9532-a533cccdb808 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:13.898729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e7ce4b-a1b8-4f10-9532-a533cccdb808 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:13.899588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e7ce4b-a1b8-4f10-9532-a533cccdb808 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:14.802018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-82e7ce4b-a1b8-4f10-9532-a533cccdb808 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:14.857813 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-82e7ce4b-a1b8-4f10-9532-a533cccdb808 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.041799 Aug 25 13:16:14.863479 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1920/3906] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:13 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:14.898299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dcc949bd-455a-450e-8199-5150a2e40aec tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:14.905214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dcc949bd-455a-450e-8199-5150a2e40aec tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:14.968560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcc949bd-455a-450e-8199-5150a2e40aec tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:14.981737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcc949bd-455a-450e-8199-5150a2e40aec tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:14.984742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcc949bd-455a-450e-8199-5150a2e40aec tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:14.986435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcc949bd-455a-450e-8199-5150a2e40aec tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:14.990971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcc949bd-455a-450e-8199-5150a2e40aec tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:14.994206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcc949bd-455a-450e-8199-5150a2e40aec tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:15.226826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 13:16:15.229442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquired lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 13:16:16.288430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dcc949bd-455a-450e-8199-5150a2e40aec tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:16.333009 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dcc949bd-455a-450e-8199-5150a2e40aec tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1516 microversion: 2.1 time: 1.461652 Aug 25 13:16:16.334646 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1921/3907] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:14 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1516 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:16.358003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b861380f-2731-43dc-97d2-d845c0f046f2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:16.359395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b861380f-2731-43dc-97d2-d845c0f046f2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:16.413285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b861380f-2731-43dc-97d2-d845c0f046f2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:16.416176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b861380f-2731-43dc-97d2-d845c0f046f2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:16.428524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b861380f-2731-43dc-97d2-d845c0f046f2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:16.430070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b861380f-2731-43dc-97d2-d845c0f046f2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:16.434057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b861380f-2731-43dc-97d2-d845c0f046f2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:16.435050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b861380f-2731-43dc-97d2-d845c0f046f2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:16.539681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=73,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:16.915592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:16.992375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:17.155299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b861380f-2731-43dc-97d2-d845c0f046f2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:17.192742 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b861380f-2731-43dc-97d2-d845c0f046f2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1315 microversion: 2.1 time: 0.853823 Aug 25 13:16:17.196975 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1922/3908] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:16 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1315 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:17.222421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:17.224213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:17.235505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=31 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:17.256905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:17.258015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:17.258914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:17.263741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:17.264962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:17.269087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:17.655477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:17.687382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:17.702710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:17.705426 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c06aa5fc-75d0-4a16-993f-f62f3e475340 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.504777 Aug 25 13:16:17.707422 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1923/3909] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:17 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:17.743037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2d32658d-7845-4aca-9d28-7032ff9f70a6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2d32658d-7845-4aca-9d28-7032ff9f70a6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 163 Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": 12345, "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi 12345 Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:16:17.758082 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 25 13:16:17.766720 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:17.773980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2d32658d-7845-4aca-9d28-7032ff9f70a6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:17.773980 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2d32658d-7845-4aca-9d28-7032ff9f70a6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.054164 Aug 25 13:16:17.773980 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1924/3910] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:16:17 2022] POST /compute/v2.1/servers => generated 127 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:16:17.795727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a90f457e-a0a5-4578-8119-9a167b8012d3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:17.810143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a90f457e-a0a5-4578-8119-9a167b8012d3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:17.842212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a90f457e-a0a5-4578-8119-9a167b8012d3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:17.845133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a90f457e-a0a5-4578-8119-9a167b8012d3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:17.851792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a90f457e-a0a5-4578-8119-9a167b8012d3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:17.853845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a90f457e-a0a5-4578-8119-9a167b8012d3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:17.856392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a90f457e-a0a5-4578-8119-9a167b8012d3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:17.880583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a90f457e-a0a5-4578-8119-9a167b8012d3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:18.885407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a90f457e-a0a5-4578-8119-9a167b8012d3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:18.913115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Building network info cache for instance {{(pid=129060) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 13:16:18.930544 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a90f457e-a0a5-4578-8119-9a167b8012d3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1516 microversion: 2.1 time: 1.147263 Aug 25 13:16:18.958978 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1925/3911] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:17 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1516 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:18.992741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-afd8f6b8-873c-49c5-ae13-2512a92f1c29 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:18.995631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-afd8f6b8-873c-49c5-ae13-2512a92f1c29 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:19.039351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afd8f6b8-873c-49c5-ae13-2512a92f1c29 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:19.042864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afd8f6b8-873c-49c5-ae13-2512a92f1c29 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:19.047002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afd8f6b8-873c-49c5-ae13-2512a92f1c29 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:19.048627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afd8f6b8-873c-49c5-ae13-2512a92f1c29 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:19.053136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afd8f6b8-873c-49c5-ae13-2512a92f1c29 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:19.056352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afd8f6b8-873c-49c5-ae13-2512a92f1c29 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:20.167443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-afd8f6b8-873c-49c5-ae13-2512a92f1c29 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:20.200665 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-afd8f6b8-873c-49c5-ae13-2512a92f1c29 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.236010 Aug 25 13:16:20.205665 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1926/3912] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:18 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:20.231575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-5b317e0c-ea68-4a7a-a8ae-9464755e5a66 req-1d1d0fe2-a9c6-450f-aaeb-53ef7049ef8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a353f482-b83b-4141-b007-9cbc0b515891", "tag": "ecb82332-c8f8-4b42-923a-450c852e5cca"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:20.281760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5b317e0c-ea68-4a7a-a8ae-9464755e5a66 req-1d1d0fe2-a9c6-450f-aaeb-53ef7049ef8c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:20.283992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5b317e0c-ea68-4a7a-a8ae-9464755e5a66 req-1d1d0fe2-a9c6-450f-aaeb-53ef7049ef8c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:20.288162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5b317e0c-ea68-4a7a-a8ae-9464755e5a66 req-1d1d0fe2-a9c6-450f-aaeb-53ef7049ef8c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:20.392072 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5b317e0c-ea68-4a7a-a8ae-9464755e5a66 req-1d1d0fe2-a9c6-450f-aaeb-53ef7049ef8c service nova] Creating event network-changed:ecb82332-c8f8-4b42-923a-450c852e5cca for instance a353f482-b83b-4141-b007-9cbc0b515891 on n-h1-852771-8 Aug 25 13:16:20.422248 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-5b317e0c-ea68-4a7a-a8ae-9464755e5a66 req-1d1d0fe2-a9c6-450f-aaeb-53ef7049ef8c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205508 Aug 25 13:16:20.423931 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1927/3913] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:20.443287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9874c061-bb97-43fe-81b1-94feceb10b61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:20.446095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9874c061-bb97-43fe-81b1-94feceb10b61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:20.461492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9874c061-bb97-43fe-81b1-94feceb10b61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:20.464187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9874c061-bb97-43fe-81b1-94feceb10b61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:20.465733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9874c061-bb97-43fe-81b1-94feceb10b61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:20.467324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9874c061-bb97-43fe-81b1-94feceb10b61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:20.468659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9874c061-bb97-43fe-81b1-94feceb10b61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:20.469761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9874c061-bb97-43fe-81b1-94feceb10b61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:21.696016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9874c061-bb97-43fe-81b1-94feceb10b61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:21.717355 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9874c061-bb97-43fe-81b1-94feceb10b61 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1315 microversion: 2.1 time: 1.289102 Aug 25 13:16:21.758119 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1928/3914] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:20 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1315 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:21.802903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:21.804578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:21.844389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:21.845220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:21.846140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:21.848245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:21.849191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:21.868348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:22.002250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Updating instance_info_cache with network_info: [{"id": "e7ec10ef-f422-46b6-b9a3-65d2d19b3172", "address": "fa:16:3e:4a:cc:0f", "network": {"id": "80839a59-142e-4d1d-8902-89cc3d6af65b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1562757631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d8b38448af0648bb8bb595ef7cf8592b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape7ec10ef-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129060) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 13:16:22.076854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Releasing lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 13:16:22.079484 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-60283c1e-0d1f-4e83-bec0-2f444e0ea2d9 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action" status: 202 len: 0 microversion: 2.1 time: 8.923661 Aug 25 13:16:22.085576 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1987/3915] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:16:13 2022] POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action => generated 0 bytes in 8931 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 13:16:22.260532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:22.354213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:22.362039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:22.402805 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-78b49d04-af50-4823-8a65-4f919e58234c tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.641765 Aug 25 13:16:22.432543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1929/3916] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:21 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:22.475444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f00eea79-9e12-4ded-8d43-9f3a317d3bf1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:22.484095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f00eea79-9e12-4ded-8d43-9f3a317d3bf1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:22.533051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f00eea79-9e12-4ded-8d43-9f3a317d3bf1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:22.535253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f00eea79-9e12-4ded-8d43-9f3a317d3bf1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:22.539570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f00eea79-9e12-4ded-8d43-9f3a317d3bf1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:22.546513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f00eea79-9e12-4ded-8d43-9f3a317d3bf1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:22.549314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f00eea79-9e12-4ded-8d43-9f3a317d3bf1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:22.554714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f00eea79-9e12-4ded-8d43-9f3a317d3bf1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:23.165797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1a7ac4f9-1c7a-4931-ac13-d89219c74c39 req-67f16889-309e-42e6-84c1-73fda1256214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ee6897-bbd1-4ead-b5ba-eeba8fc6469e", "tag": "e7ec10ef-f422-46b6-b9a3-65d2d19b3172"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:23.222942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a7ac4f9-1c7a-4931-ac13-d89219c74c39 req-67f16889-309e-42e6-84c1-73fda1256214 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:23.232566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a7ac4f9-1c7a-4931-ac13-d89219c74c39 req-67f16889-309e-42e6-84c1-73fda1256214 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:23.236195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a7ac4f9-1c7a-4931-ac13-d89219c74c39 req-67f16889-309e-42e6-84c1-73fda1256214 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:23.302494 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1a7ac4f9-1c7a-4931-ac13-d89219c74c39 req-67f16889-309e-42e6-84c1-73fda1256214 service nova] Creating event network-changed:e7ec10ef-f422-46b6-b9a3-65d2d19b3172 for instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e on n-h1-852771-8 Aug 25 13:16:23.342179 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1a7ac4f9-1c7a-4931-ac13-d89219c74c39 req-67f16889-309e-42e6-84c1-73fda1256214 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.247693 Aug 25 13:16:23.359092 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1988/3917] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:23.361768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f00eea79-9e12-4ded-8d43-9f3a317d3bf1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:23.408373 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f00eea79-9e12-4ded-8d43-9f3a317d3bf1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1522 microversion: 2.1 time: 0.972524 Aug 25 13:16:23.417378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a70c8d5e-2565-4c84-af9a-23f1249dd2de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:23.434493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a70c8d5e-2565-4c84-af9a-23f1249dd2de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:23.446503 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1930/3918] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:22 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1522 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:23.477311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6eab2592-1d7c-4dd4-8195-47b309633b14 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '.version_select at 0x7f3a29714310>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:23.502124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a70c8d5e-2565-4c84-af9a-23f1249dd2de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:23.504165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a70c8d5e-2565-4c84-af9a-23f1249dd2de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:23.505301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a70c8d5e-2565-4c84-af9a-23f1249dd2de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:23.512241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a70c8d5e-2565-4c84-af9a-23f1249dd2de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:23.513733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a70c8d5e-2565-4c84-af9a-23f1249dd2de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:23.514893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a70c8d5e-2565-4c84-af9a-23f1249dd2de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:26.367028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a70c8d5e-2565-4c84-af9a-23f1249dd2de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:26.401206 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a70c8d5e-2565-4c84-af9a-23f1249dd2de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 3.010955 Aug 25 13:16:26.417547 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1989/3919] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:23 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 3044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:26.432104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-67801861-029f-4416-b5a5-5cdd9e530cde req-eb196ed3-b9d7-4029-86b4-1e5d5c982dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ab7070-d556-43aa-98dc-d78a45fd1b9c", "name": "network-vif-unplugged", "status": "completed", "tag": "b5c44b23-585e-4be6-85fe-3a35a84befb2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:26.526063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-67801861-029f-4416-b5a5-5cdd9e530cde req-eb196ed3-b9d7-4029-86b4-1e5d5c982dc2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:26.539761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-67801861-029f-4416-b5a5-5cdd9e530cde req-eb196ed3-b9d7-4029-86b4-1e5d5c982dc2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:26.541350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-67801861-029f-4416-b5a5-5cdd9e530cde req-eb196ed3-b9d7-4029-86b4-1e5d5c982dc2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:26.630985 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-67801861-029f-4416-b5a5-5cdd9e530cde req-eb196ed3-b9d7-4029-86b4-1e5d5c982dc2 service nova] Creating event network-vif-unplugged:b5c44b23-585e-4be6-85fe-3a35a84befb2 for instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c on n-h2-852771-8 Aug 25 13:16:26.664904 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-67801861-029f-4416-b5a5-5cdd9e530cde req-eb196ed3-b9d7-4029-86b4-1e5d5c982dc2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.253734 Aug 25 13:16:26.669228 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1990/3920] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:26.699227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-745e2077-648c-4f18-aa9d-126db732b211 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:26.706751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-745e2077-648c-4f18-aa9d-126db732b211 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:26.739457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-745e2077-648c-4f18-aa9d-126db732b211 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:26.745336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-745e2077-648c-4f18-aa9d-126db732b211 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:26.747064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-745e2077-648c-4f18-aa9d-126db732b211 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:26.749184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-745e2077-648c-4f18-aa9d-126db732b211 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:26.750872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-745e2077-648c-4f18-aa9d-126db732b211 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:26.752474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-745e2077-648c-4f18-aa9d-126db732b211 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:28.288773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-745e2077-648c-4f18-aa9d-126db732b211 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:28.353496 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-745e2077-648c-4f18-aa9d-126db732b211 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1315 microversion: 2.1 time: 1.669025 Aug 25 13:16:28.355235 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1991/3921] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:26 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1315 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:28.428699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:28.430298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:28.475150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:28.476424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:28.477811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:28.480592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:28.496235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:28.497906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:29.200579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:29.279320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:29.292879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:29.309466 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fe1d0762-d4fb-4121-991a-ba7f3db43567 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.940691 Aug 25 13:16:29.314727 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1992/3922] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:28 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:29.357054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a46f3dd4-da94-4d6e-87ed-fefdbc8b3a2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:29.361787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a46f3dd4-da94-4d6e-87ed-fefdbc8b3a2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:29.421335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a46f3dd4-da94-4d6e-87ed-fefdbc8b3a2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:29.428009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a46f3dd4-da94-4d6e-87ed-fefdbc8b3a2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:29.431772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a46f3dd4-da94-4d6e-87ed-fefdbc8b3a2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:29.433811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a46f3dd4-da94-4d6e-87ed-fefdbc8b3a2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:29.442058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a46f3dd4-da94-4d6e-87ed-fefdbc8b3a2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:29.452904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a46f3dd4-da94-4d6e-87ed-fefdbc8b3a2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:30.683175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a46f3dd4-da94-4d6e-87ed-fefdbc8b3a2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:30.717368 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a46f3dd4-da94-4d6e-87ed-fefdbc8b3a2b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1522 microversion: 2.1 time: 1.390405 Aug 25 13:16:30.727330 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1993/3923] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:29 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1522 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:30.757436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3d857f3-d29b-451f-841b-c7b5ee0f1c0a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:30.762338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a3d857f3-d29b-451f-841b-c7b5ee0f1c0a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:30.798811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3d857f3-d29b-451f-841b-c7b5ee0f1c0a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:30.800272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3d857f3-d29b-451f-841b-c7b5ee0f1c0a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:30.801074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3d857f3-d29b-451f-841b-c7b5ee0f1c0a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:30.802417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3d857f3-d29b-451f-841b-c7b5ee0f1c0a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:30.813789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3d857f3-d29b-451f-841b-c7b5ee0f1c0a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:30.817228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3d857f3-d29b-451f-841b-c7b5ee0f1c0a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:30.954503 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6eab2592-1d7c-4dd4-8195-47b309633b14 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/f3297739-5c63-4c94-99ac-b38933e19388" status: 202 len: 0 microversion: 2.1 time: 7.505377 Aug 25 13:16:30.958173 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1931/3924] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 13:16:23 2022] DELETE /compute/v2.1/os-floating-ips/f3297739-5c63-4c94-99ac-b38933e19388 => generated 0 bytes in 7511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:16:31.000520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-973a7bd3-9483-4443-9da4-5e021edbbaa3 req-4d4023a1-1447-46f7-8945-6674f1ec71f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ab7070-d556-43aa-98dc-d78a45fd1b9c", "name": "network-vif-plugged", "status": "completed", "tag": "b5c44b23-585e-4be6-85fe-3a35a84befb2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:31.058126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-973a7bd3-9483-4443-9da4-5e021edbbaa3 req-4d4023a1-1447-46f7-8945-6674f1ec71f6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:31.059090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-973a7bd3-9483-4443-9da4-5e021edbbaa3 req-4d4023a1-1447-46f7-8945-6674f1ec71f6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:31.059940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-973a7bd3-9483-4443-9da4-5e021edbbaa3 req-4d4023a1-1447-46f7-8945-6674f1ec71f6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:31.157225 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-973a7bd3-9483-4443-9da4-5e021edbbaa3 req-4d4023a1-1447-46f7-8945-6674f1ec71f6 service nova] Creating event network-vif-plugged:b5c44b23-585e-4be6-85fe-3a35a84befb2 for instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c on n-h2-852771-8 Aug 25 13:16:31.208512 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-973a7bd3-9483-4443-9da4-5e021edbbaa3 req-4d4023a1-1447-46f7-8945-6674f1ec71f6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235743 Aug 25 13:16:31.233296 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1932/3925] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:31.278579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:31.283487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:31.333123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:31.335172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:31.339075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:31.343638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:31.346919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:31.351076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:31.845622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:31.904624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:31.913363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:31.928123 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0385766c-5c65-4ef3-9e19-1bdd902a82a6 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.684237 Aug 25 13:16:31.933843 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1933/3926] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:31 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:31.937359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a3d857f3-d29b-451f-841b-c7b5ee0f1c0a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:31.961667 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a3d857f3-d29b-451f-841b-c7b5ee0f1c0a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1315 microversion: 2.1 time: 1.231025 Aug 25 13:16:31.964072 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1994/3927] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:30 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1315 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:31.966246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-79a26b47-271e-4d1c-8427-3ab0e15330a8 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:31.979241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a8eff3db-7585-48b3-923e-370fe98856e9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:31.981619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a8eff3db-7585-48b3-923e-370fe98856e9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-79a26b47-271e-4d1c-8427-3ab0e15330a8 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Request method failure captured: Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action HTTP/1.1 Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 34 Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3XKJ5btzYd3SI6mHNlzWcUv8U17GEKteIYpl9lgvEn1BNjzMMaDcsZkkrHi61hnQQVf7ZzF9RQQ3WplhopiGENtTNGichBtt6EEhqmGU_-AOhWKI3NCtYV_xd3f0VifmcN1lqpPx5FBCSCoPwD6z-v3NqTpaoxLm9j8R9A-4BBKtVo Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d8b38448af0648bb8bb595ef7cf8592b Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8b38448af0648bb8bb595ef7cf8592b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d8b38448af0648bb8bb595ef7cf8592b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d8b38448af0648bb8bb595ef7cf8592b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8b38448af0648bb8bb595ef7cf8592b"}]}] Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d8b38448af0648bb8bb595ef7cf8592b Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dbd0b7a9d42d44df875ee755f862ba96 Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: {"addFloatingIp": {"address": ""}} Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '95ee6897-bbd1-4ead-b5ba-eeba8fc6469e', 'body': {'addFloatingIp': {'address': ''}}} Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi '' Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:16:31.989904 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 25 13:16:32.000234 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:32.005637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-79a26b47-271e-4d1c-8427-3ab0e15330a8 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:32.008179 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-79a26b47-271e-4d1c-8427-3ab0e15330a8 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action" status: 400 len: 142 microversion: 2.1 time: 0.072118 Aug 25 13:16:32.013979 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1934/3928] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:16:31 2022] POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action => generated 142 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:16:32.035245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8eff3db-7585-48b3-923e-370fe98856e9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:32.039319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8eff3db-7585-48b3-923e-370fe98856e9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:32.039891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8eff3db-7585-48b3-923e-370fe98856e9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:32.041205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8eff3db-7585-48b3-923e-370fe98856e9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:32.044885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:32.055749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8eff3db-7585-48b3-923e-370fe98856e9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:32.056685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8eff3db-7585-48b3-923e-370fe98856e9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:32.059294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:32.104687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:32.108076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:32.112090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:32.115293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:32.123325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:32.126334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:32.285554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 13:16:32.287611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquired lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 13:16:32.869097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a8eff3db-7585-48b3-923e-370fe98856e9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:32.942333 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a8eff3db-7585-48b3-923e-370fe98856e9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1522 microversion: 2.1 time: 0.971208 Aug 25 13:16:32.947674 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1995/3929] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:31 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1522 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:32.989209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:32.993928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:33.009731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:33.027027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:33.036650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:33.038244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:33.045029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:33.046655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:33.047804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:33.281633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Releasing lock "refresh_cache-95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" {{(pid=129059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 13:16:33.281633 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] HTTP exception thrown: floating IP not found Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Request method failure captured: Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action HTTP/1.1 Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 41 Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3XKJ5btzYd3SI6mHNlzWcUv8U17GEKteIYpl9lgvEn1BNjzMMaDcsZkkrHi61hnQQVf7ZzF9RQQ3WplhopiGENtTNGichBtt6EEhqmGU_-AOhWKI3NCtYV_xd3f0VifmcN1lqpPx5FBCSCoPwD6z-v3NqTpaoxLm9j8R9A-4BBKtVo Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d8b38448af0648bb8bb595ef7cf8592b Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8b38448af0648bb8bb595ef7cf8592b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d8b38448af0648bb8bb595ef7cf8592b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d8b38448af0648bb8bb595ef7cf8592b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8b38448af0648bb8bb595ef7cf8592b"}]}] Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d8b38448af0648bb8bb595ef7cf8592b Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dbd0b7a9d42d44df875ee755f862ba96 Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: exception: floating IP not found Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '95ee6897-bbd1-4ead-b5ba-eeba8fc6469e', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 25 13:16:33.285027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:33.294064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:33.294064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:33.294064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:33.294064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:33.294064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:33.294064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:16:33.294064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:16:33.294064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 25 13:16:33.294064 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:33.308171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Returning 404 to user: floating IP not found {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:33.310115 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-de982acd-7f28-4730-b09a-4d8ed46a4f64 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action" status: 404 len: 67 microversion: 2.1 time: 1.285959 Aug 25 13:16:33.319091 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1935/3930] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:16:32 2022] POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action => generated 67 bytes in 1296 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 25 13:16:33.356832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1107becb-faf8-4f03-a12c-d2074e08cabc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:33.358134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1107becb-faf8-4f03-a12c-d2074e08cabc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:33.405894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1107becb-faf8-4f03-a12c-d2074e08cabc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:33.406877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1107becb-faf8-4f03-a12c-d2074e08cabc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:33.407690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1107becb-faf8-4f03-a12c-d2074e08cabc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:33.426213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1107becb-faf8-4f03-a12c-d2074e08cabc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:33.427294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1107becb-faf8-4f03-a12c-d2074e08cabc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:33.428127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1107becb-faf8-4f03-a12c-d2074e08cabc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:33.507895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:33.551855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:33.560501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:33.571949 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2ec9b6f4-0bca-4e0d-aab5-354d19342181 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.590828 Aug 25 13:16:33.574270 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1996/3931] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:32 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:33.591390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d5c1fdf5-759a-44bf-92cb-aa73f503ced0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-442627882", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f649304f-837b-4c31-bf5e-8c7ba3ed5ac1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:33.969603 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-d5c1fdf5-759a-44bf-92cb-aa73f503ced0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Block Device f649304f-837b-4c31-bf5e-8c7ba3ed5ac1 is not bootable. Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d5c1fdf5-759a-44bf-92cb-aa73f503ced0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 357 Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-442627882", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f649304f-837b-4c31-bf5e-8c7ba3ed5ac1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: exception: Block Device f649304f-837b-4c31-bf5e-8c7ba3ed5ac1 is not bootable. Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-442627882', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f649304f-837b-4c31-bf5e-8c7ba3ed5ac1'}], 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f649304f-837b-4c31-bf5e-8c7ba3ed5ac1 is not bootable. Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:16:33.995027 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f649304f-837b-4c31-bf5e-8c7ba3ed5ac1 is not bootable. Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f649304f-837b-4c31-bf5e-8c7ba3ed5ac1 is not bootable. Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d5c1fdf5-759a-44bf-92cb-aa73f503ced0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Block Device f649304f-837b-4c31-bf5e-8c7ba3ed5ac1 is not bootable. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d5c1fdf5-759a-44bf-92cb-aa73f503ced0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.421487 Aug 25 13:16:34.007178 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1997/3932] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:16:33 2022] POST /compute/v2.1/servers => generated 110 bytes in 424 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:16:34.039278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81671905-4751-4b03-898f-5605270855c0 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:34.319725 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-81671905-4751-4b03-898f-5605270855c0 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81671905-4751-4b03-898f-5605270855c0 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Request method failure captured: Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action HTTP/1.1 Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 44 Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3XKJ5btzYd3SI6mHNlzWcUv8U17GEKteIYpl9lgvEn1BNjzMMaDcsZkkrHi61hnQQVf7ZzF9RQQ3WplhopiGENtTNGichBtt6EEhqmGU_-AOhWKI3NCtYV_xd3f0VifmcN1lqpPx5FBCSCoPwD6z-v3NqTpaoxLm9j8R9A-4BBKtVo Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d8b38448af0648bb8bb595ef7cf8592b Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8b38448af0648bb8bb595ef7cf8592b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d8b38448af0648bb8bb595ef7cf8592b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d8b38448af0648bb8bb595ef7cf8592b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8b38448af0648bb8bb595ef7cf8592b"}]}] Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d8b38448af0648bb8bb595ef7cf8592b Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: dbd0b7a9d42d44df875ee755f862ba96 Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: exception: Floating IP not found for address 0.0.0.0. Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '95ee6897-bbd1-4ead-b5ba-eeba8fc6469e', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 25 13:16:34.323806 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 25 13:16:34.332994 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:34.338794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81671905-4751-4b03-898f-5605270855c0 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:34.339644 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-81671905-4751-4b03-898f-5605270855c0 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action" status: 404 len: 88 microversion: 2.1 time: 0.330908 Aug 25 13:16:34.341657 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1998/3933] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:16:33 2022] POST /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e/action => generated 88 bytes in 342 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:16:34.352069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-17159634-99ff-4da5-8066-e79158674c36 req-d8c0abc8-128d-4561-b9f1-4a18dac2dd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a353f482-b83b-4141-b007-9cbc0b515891", "name": "network-vif-plugged", "status": "completed", "tag": "ecb82332-c8f8-4b42-923a-450c852e5cca"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:34.365633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1107becb-faf8-4f03-a12c-d2074e08cabc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:34.383646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-17159634-99ff-4da5-8066-e79158674c36 req-d8c0abc8-128d-4561-b9f1-4a18dac2dd18 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:34.384903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-17159634-99ff-4da5-8066-e79158674c36 req-d8c0abc8-128d-4561-b9f1-4a18dac2dd18 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:34.385925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-17159634-99ff-4da5-8066-e79158674c36 req-d8c0abc8-128d-4561-b9f1-4a18dac2dd18 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:34.414260 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-17159634-99ff-4da5-8066-e79158674c36 req-d8c0abc8-128d-4561-b9f1-4a18dac2dd18 service nova] Creating event network-vif-plugged:ecb82332-c8f8-4b42-923a-450c852e5cca for instance a353f482-b83b-4141-b007-9cbc0b515891 on n-h1-852771-8 Aug 25 13:16:34.427184 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-17159634-99ff-4da5-8066-e79158674c36 req-d8c0abc8-128d-4561-b9f1-4a18dac2dd18 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082822 Aug 25 13:16:34.433476 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 1999/3934] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:34.451071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a77c0bf-e016-4c85-93d1-8e97748956c4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:34.452234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a77c0bf-e016-4c85-93d1-8e97748956c4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:34.500095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a77c0bf-e016-4c85-93d1-8e97748956c4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:34.509313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a77c0bf-e016-4c85-93d1-8e97748956c4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:34.512233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a77c0bf-e016-4c85-93d1-8e97748956c4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:34.533228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a77c0bf-e016-4c85-93d1-8e97748956c4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:34.534906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a77c0bf-e016-4c85-93d1-8e97748956c4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:34.536068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a77c0bf-e016-4c85-93d1-8e97748956c4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:34.559427 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1107becb-faf8-4f03-a12c-d2074e08cabc tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1315 microversion: 2.1 time: 1.227896 Aug 25 13:16:34.560767 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1936/3935] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:33 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1315 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:34.576790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-617778a8-e360-465d-92ca-03da1a4042b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:34.578209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-617778a8-e360-465d-92ca-03da1a4042b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:34.610213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-617778a8-e360-465d-92ca-03da1a4042b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:34.614958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-617778a8-e360-465d-92ca-03da1a4042b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:34.616400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-617778a8-e360-465d-92ca-03da1a4042b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:34.618470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-617778a8-e360-465d-92ca-03da1a4042b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:34.624362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-617778a8-e360-465d-92ca-03da1a4042b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:34.625912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-617778a8-e360-465d-92ca-03da1a4042b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:35.832321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a77c0bf-e016-4c85-93d1-8e97748956c4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:35.898834 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a77c0bf-e016-4c85-93d1-8e97748956c4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1522 microversion: 2.1 time: 1.462487 Aug 25 13:16:35.908329 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2000/3936] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:34 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1522 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:35.973061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1dcb68d7-ee3c-4b39-abe5-bdc9b0c23f41 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:35.974603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1dcb68d7-ee3c-4b39-abe5-bdc9b0c23f41 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:36.031277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dcb68d7-ee3c-4b39-abe5-bdc9b0c23f41 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:36.032965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dcb68d7-ee3c-4b39-abe5-bdc9b0c23f41 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:36.034393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dcb68d7-ee3c-4b39-abe5-bdc9b0c23f41 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:36.036247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dcb68d7-ee3c-4b39-abe5-bdc9b0c23f41 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:36.042611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dcb68d7-ee3c-4b39-abe5-bdc9b0c23f41 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:36.044490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dcb68d7-ee3c-4b39-abe5-bdc9b0c23f41 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:36.077460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-617778a8-e360-465d-92ca-03da1a4042b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:36.126626 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-617778a8-e360-465d-92ca-03da1a4042b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.559298 Aug 25 13:16:36.164992 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1937/3937] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:34 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:36.183965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:36.188390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:36.212627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:36.214012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:36.215252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:36.216978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:36.218245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:36.219381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:36.266275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1dcb68d7-ee3c-4b39-abe5-bdc9b0c23f41 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:16:36.424151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:36.454201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:36.458718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:36.462053 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-200e1916-258d-4b85-9abc-ffb4077da44f tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.294234 Aug 25 13:16:36.464749 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1938/3938] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:36 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:36.477080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8cb56dc-5f5a-4210-9e7d-fe26c207f1e5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:36.479265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8cb56dc-5f5a-4210-9e7d-fe26c207f1e5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:36.506190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8cb56dc-5f5a-4210-9e7d-fe26c207f1e5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:36.521956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8cb56dc-5f5a-4210-9e7d-fe26c207f1e5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:36.523191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8cb56dc-5f5a-4210-9e7d-fe26c207f1e5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:36.527438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8cb56dc-5f5a-4210-9e7d-fe26c207f1e5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:36.541638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8cb56dc-5f5a-4210-9e7d-fe26c207f1e5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:36.544354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8cb56dc-5f5a-4210-9e7d-fe26c207f1e5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:36.561028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:36.702317 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1dcb68d7-ee3c-4b39-abe5-bdc9b0c23f41 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "DELETE /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 204 len: 0 microversion: 2.1 time: 0.785748 Aug 25 13:16:36.712010 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2001/3939] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:16:35 2022] DELETE /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 0 bytes in 793 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:16:36.746556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f3df05e1-a5f2-4930-8b12-2d64af9e18fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:36.753910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f3df05e1-a5f2-4930-8b12-2d64af9e18fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:36.837764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3df05e1-a5f2-4930-8b12-2d64af9e18fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:36.856803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3df05e1-a5f2-4930-8b12-2d64af9e18fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:36.857837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3df05e1-a5f2-4930-8b12-2d64af9e18fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:36.859246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3df05e1-a5f2-4930-8b12-2d64af9e18fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:36.882199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3df05e1-a5f2-4930-8b12-2d64af9e18fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:36.889266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3df05e1-a5f2-4930-8b12-2d64af9e18fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:37.483624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b8cb56dc-5f5a-4210-9e7d-fe26c207f1e5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:37.532588 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8cb56dc-5f5a-4210-9e7d-fe26c207f1e5 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1315 microversion: 2.1 time: 1.064860 Aug 25 13:16:37.533590 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1939/3940] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:36 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1315 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:37.581304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d93dcc0f-ed0c-476b-ad7d-b6a803b5a722 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:37.586015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d93dcc0f-ed0c-476b-ad7d-b6a803b5a722 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:37.624693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d93dcc0f-ed0c-476b-ad7d-b6a803b5a722 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:37.638991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d93dcc0f-ed0c-476b-ad7d-b6a803b5a722 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:37.639549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d93dcc0f-ed0c-476b-ad7d-b6a803b5a722 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:37.641099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d93dcc0f-ed0c-476b-ad7d-b6a803b5a722 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:37.651104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d93dcc0f-ed0c-476b-ad7d-b6a803b5a722 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:37.669716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d93dcc0f-ed0c-476b-ad7d-b6a803b5a722 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:37.970748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f3df05e1-a5f2-4930-8b12-2d64af9e18fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:38.016659 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f3df05e1-a5f2-4930-8b12-2d64af9e18fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.301670 Aug 25 13:16:38.025154 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2002/3941] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:36 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:38.045376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-835f3539-b795-43b3-815c-4527dabcac95 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:38.047082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-835f3539-b795-43b3-815c-4527dabcac95 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:38.096262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-835f3539-b795-43b3-815c-4527dabcac95 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:38.098018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-835f3539-b795-43b3-815c-4527dabcac95 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:38.102410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-835f3539-b795-43b3-815c-4527dabcac95 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:38.114362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-835f3539-b795-43b3-815c-4527dabcac95 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:38.116168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-835f3539-b795-43b3-815c-4527dabcac95 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:38.117481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-835f3539-b795-43b3-815c-4527dabcac95 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:38.576157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d93dcc0f-ed0c-476b-ad7d-b6a803b5a722 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:38.630116 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d93dcc0f-ed0c-476b-ad7d-b6a803b5a722 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1541 microversion: 2.1 time: 1.086773 Aug 25 13:16:38.631174 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1940/3942] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:37 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1541 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:39.458771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-835f3539-b795-43b3-815c-4527dabcac95 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:39.520768 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-835f3539-b795-43b3-815c-4527dabcac95 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1507 microversion: 2.1 time: 1.488693 Aug 25 13:16:39.523238 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2003/3943] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:38 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1507 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:39.547923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a642f84f-63df-44ad-a8d1-67d68ab84886 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:39.568731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a642f84f-63df-44ad-a8d1-67d68ab84886 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:39.645814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a642f84f-63df-44ad-a8d1-67d68ab84886 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:39.649433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a642f84f-63df-44ad-a8d1-67d68ab84886 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:39.651163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a642f84f-63df-44ad-a8d1-67d68ab84886 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:39.652941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a642f84f-63df-44ad-a8d1-67d68ab84886 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:39.659449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a642f84f-63df-44ad-a8d1-67d68ab84886 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:39.672781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a642f84f-63df-44ad-a8d1-67d68ab84886 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:40.116108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:40.119227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:40.138511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:40.140523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:40.141855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:40.144460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:40.145812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:40.146993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:40.680650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:40.737202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:40.752482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:40.767407 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-54e5c808-1f56-4c4e-8f40-4feedd2c73eb tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 2.124817 Aug 25 13:16:40.771631 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1941/3944] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:38 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:40.799085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1a8b1866-59e8-44c1-b8aa-c9b2394a0c72 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:40.804070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1a8b1866-59e8-44c1-b8aa-c9b2394a0c72 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:40.833057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a8b1866-59e8-44c1-b8aa-c9b2394a0c72 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:40.839185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a8b1866-59e8-44c1-b8aa-c9b2394a0c72 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:40.850679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a8b1866-59e8-44c1-b8aa-c9b2394a0c72 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:40.851157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a642f84f-63df-44ad-a8d1-67d68ab84886 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:40.855887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a8b1866-59e8-44c1-b8aa-c9b2394a0c72 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:40.861855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a8b1866-59e8-44c1-b8aa-c9b2394a0c72 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:40.867725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a8b1866-59e8-44c1-b8aa-c9b2394a0c72 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:40.877632 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a642f84f-63df-44ad-a8d1-67d68ab84886 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1502 microversion: 2.1 time: 1.350700 Aug 25 13:16:40.881297 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2004/3945] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:39 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1502 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:40.903894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e244cde-a799-4cf4-8038-40e116ab6e2a tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:40.905498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e244cde-a799-4cf4-8038-40e116ab6e2a tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:40.929067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e244cde-a799-4cf4-8038-40e116ab6e2a tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:40.930062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e244cde-a799-4cf4-8038-40e116ab6e2a tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:40.934162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e244cde-a799-4cf4-8038-40e116ab6e2a tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:40.936364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e244cde-a799-4cf4-8038-40e116ab6e2a tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:40.943602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e244cde-a799-4cf4-8038-40e116ab6e2a tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:40.944810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e244cde-a799-4cf4-8038-40e116ab6e2a tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:41.478482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e244cde-a799-4cf4-8038-40e116ab6e2a tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd0b7a9d42d44df875ee755f862ba96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b38448af0648bb8bb595ef7cf8592b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:41.569012 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e244cde-a799-4cf4-8038-40e116ab6e2a tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 200 len: 1499 microversion: 2.1 time: 0.685203 Aug 25 13:16:41.570445 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2005/3946] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:40 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 1499 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:41.611020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-59d316f9-0506-4f25-afcd-26cee840bfdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:41.622500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-59d316f9-0506-4f25-afcd-26cee840bfdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:41.663395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59d316f9-0506-4f25-afcd-26cee840bfdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:41.668446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59d316f9-0506-4f25-afcd-26cee840bfdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:41.672609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59d316f9-0506-4f25-afcd-26cee840bfdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:41.678070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59d316f9-0506-4f25-afcd-26cee840bfdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:41.686411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59d316f9-0506-4f25-afcd-26cee840bfdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:41.691954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59d316f9-0506-4f25-afcd-26cee840bfdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:42.546546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1a8b1866-59e8-44c1-b8aa-c9b2394a0c72 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:42.583768 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1a8b1866-59e8-44c1-b8aa-c9b2394a0c72 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 200 len: 1507 microversion: 2.1 time: 1.804592 Aug 25 13:16:42.597294 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1942/3947] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:40 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 1507 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:42.644174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-932212ad-3676-4b42-925d-df7e9cd2d22e req-577f4218-d85b-4679-945c-55e76c36049a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ee6897-bbd1-4ead-b5ba-eeba8fc6469e", "name": "network-vif-deleted", "tag": "e7ec10ef-f422-46b6-b9a3-65d2d19b3172"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:42.688778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-932212ad-3676-4b42-925d-df7e9cd2d22e req-577f4218-d85b-4679-945c-55e76c36049a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:42.692450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-932212ad-3676-4b42-925d-df7e9cd2d22e req-577f4218-d85b-4679-945c-55e76c36049a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:42.696946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-932212ad-3676-4b42-925d-df7e9cd2d22e req-577f4218-d85b-4679-945c-55e76c36049a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:42.767790 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-932212ad-3676-4b42-925d-df7e9cd2d22e req-577f4218-d85b-4679-945c-55e76c36049a service nova] Creating event network-vif-deleted:e7ec10ef-f422-46b6-b9a3-65d2d19b3172 for instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e on n-h1-852771-8 Aug 25 13:16:42.806871 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-932212ad-3676-4b42-925d-df7e9cd2d22e req-577f4218-d85b-4679-945c-55e76c36049a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189383 Aug 25 13:16:42.812957 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1943/3948] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:42.850728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:42.852815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:42.867743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:42.869330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:42.871667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:42.889921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:42.891591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:42.898613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:42.911798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:43.312619 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.network.security_group_api [None req-59d316f9-0506-4f25-afcd-26cee840bfdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Removing security group 5ea7561e-15af-468d-af76-bf836e6363bf from port ecb82332-c8f8-4b42-923a-450c852e5cca Aug 25 13:16:43.912998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:43.945231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:43.954670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:43.963218 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a5306091-0212-4c61-ad6c-5f2f03283029 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 1.145523 Aug 25 13:16:43.965389 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1944/3949] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:42 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:43.988524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:43.990377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] [instance: 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:44.015078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:44.016435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:44.025918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:44.027743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:44.029409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:44.030738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:44.093347 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] HTTP exception thrown: Instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e could not be found. Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Request method failure captured: Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e HTTP/1.1 Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3XKJ5btzYd3SI6mHNlzWcUv8U17GEKteIYpl9lgvEn1BNjzMMaDcsZkkrHi61hnQQVf7ZzF9RQQ3WplhopiGENtTNGichBtt6EEhqmGU_-AOhWKI3NCtYV_xd3f0VifmcN1lqpPx5FBCSCoPwD6z-v3NqTpaoxLm9j8R9A-4BBKtVo Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d8b38448af0648bb8bb595ef7cf8592b Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8b38448af0648bb8bb595ef7cf8592b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d8b38448af0648bb8bb595ef7cf8592b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d8b38448af0648bb8bb595ef7cf8592b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8b38448af0648bb8bb595ef7cf8592b"}]}] Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d8b38448af0648bb8bb595ef7cf8592b Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593 Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dbd0b7a9d42d44df875ee755f862ba96 Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e could not be found. Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '95ee6897-bbd1-4ead-b5ba-eeba8fc6469e'} Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e could not be found. Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e could not be found. Aug 25 13:16:44.097417 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.105902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:44.105902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.105902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:44.105902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:44.105902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:44.105902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:16:44.105902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:16:44.105902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e could not be found. Aug 25 13:16:44.105902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.111719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] Returning 404 to user: Instance 95ee6897-bbd1-4ead-b5ba-eeba8fc6469e could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:44.114349 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c75a4e84-bf78-4ff1-af2a-3473e51bee50 tempest-FloatingIPsAssociationNegativeTestJSON-5096593 tempest-FloatingIPsAssociationNegativeTestJSON-5096593-project] 10.222.0.70 "GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e" status: 404 len: 111 microversion: 2.1 time: 0.140413 Aug 25 13:16:44.116731 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1945/3950] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:43 2022] GET /compute/v2.1/servers/95ee6897-bbd1-4ead-b5ba-eeba8fc6469e => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:16:44.131690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-53ad0304-7161-4439-a893-f7a4f435db01 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:44.133250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-53ad0304-7161-4439-a893-f7a4f435db01 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:44.146284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53ad0304-7161-4439-a893-f7a4f435db01 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:44.147794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53ad0304-7161-4439-a893-f7a4f435db01 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:44.148927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53ad0304-7161-4439-a893-f7a4f435db01 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:44.150707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53ad0304-7161-4439-a893-f7a4f435db01 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:44.152142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53ad0304-7161-4439-a893-f7a4f435db01 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:44.153328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53ad0304-7161-4439-a893-f7a4f435db01 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:44.214432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-53ad0304-7161-4439-a893-f7a4f435db01 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:16:44.615242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-59d316f9-0506-4f25-afcd-26cee840bfdd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891/action" status: 202 len: 0 microversion: 2.1 time: 3.031432 Aug 25 13:16:44.616696 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2006/3951] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:16:41 2022] POST /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891/action => generated 0 bytes in 3034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:16:44.631942 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-53ad0304-7161-4439-a893-f7a4f435db01 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "DELETE /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 204 len: 0 microversion: 2.1 time: 0.490980 Aug 25 13:16:44.634943 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1946/3952] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:16:44 2022] DELETE /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:16:44.684130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bc85a785-4df8-4fa8-b4e5-6626203a52bd tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-18308552", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "destination_type": "local"}, {"source_type": "volume", "uuid": "d98e2f6b-804a-48e7-a902-c8bc9620dffd", "destination_type": "invalid"}], "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:44.755046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b370dd0-b189-4a2f-aa01-e41263c04e28 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:44.765273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6b370dd0-b189-4a2f-aa01-e41263c04e28 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bc85a785-4df8-4fa8-b4e5-6626203a52bd tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 493 Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-18308552", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "destination_type": "local"}, {"source_type": "volume", "uuid": "d98e2f6b-804a-48e7-a902-c8bc9620dffd", "destination_type": "invalid"}], "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-18308552', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd98e2f6b-804a-48e7-a902-c8bc9620dffd', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'invalid' Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:44.772546 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bc85a785-4df8-4fa8-b4e5-6626203a52bd tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:44.783288 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bc85a785-4df8-4fa8-b4e5-6626203a52bd tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.157433 Aug 25 13:16:44.794240 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2007/3953] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:16:44 2022] POST /compute/v2.1/servers => generated 155 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:16:44.828922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b370dd0-b189-4a2f-aa01-e41263c04e28 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:44.829840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b370dd0-b189-4a2f-aa01-e41263c04e28 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:44.830622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b370dd0-b189-4a2f-aa01-e41263c04e28 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:44.832277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-91d22a92-f249-4ca0-8499-a9429cd50754 req-30239a74-fd3a-4cee-9b9d-9b34fb04cbbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a353f482-b83b-4141-b007-9cbc0b515891", "tag": "ecb82332-c8f8-4b42-923a-450c852e5cca"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:44.840536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b370dd0-b189-4a2f-aa01-e41263c04e28 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:44.841495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b370dd0-b189-4a2f-aa01-e41263c04e28 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:44.856366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b370dd0-b189-4a2f-aa01-e41263c04e28 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:44.922635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-91d22a92-f249-4ca0-8499-a9429cd50754 req-30239a74-fd3a-4cee-9b9d-9b34fb04cbbd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:44.930791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-91d22a92-f249-4ca0-8499-a9429cd50754 req-30239a74-fd3a-4cee-9b9d-9b34fb04cbbd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:44.937677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-91d22a92-f249-4ca0-8499-a9429cd50754 req-30239a74-fd3a-4cee-9b9d-9b34fb04cbbd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:44.997648 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-91d22a92-f249-4ca0-8499-a9429cd50754 req-30239a74-fd3a-4cee-9b9d-9b34fb04cbbd service nova] Creating event network-changed:ecb82332-c8f8-4b42-923a-450c852e5cca for instance a353f482-b83b-4141-b007-9cbc0b515891 on n-h1-852771-8 Aug 25 13:16:45.025309 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-91d22a92-f249-4ca0-8499-a9429cd50754 req-30239a74-fd3a-4cee-9b9d-9b34fb04cbbd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227083 Aug 25 13:16:45.032232 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2008/3954] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:45.058636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-602a9693-6c45-4b5c-9b73-a93e6639e1fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:45.063703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-602a9693-6c45-4b5c-9b73-a93e6639e1fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:45.095294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-602a9693-6c45-4b5c-9b73-a93e6639e1fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:45.097131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-602a9693-6c45-4b5c-9b73-a93e6639e1fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:45.098602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-602a9693-6c45-4b5c-9b73-a93e6639e1fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:45.100444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-602a9693-6c45-4b5c-9b73-a93e6639e1fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:45.102085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-602a9693-6c45-4b5c-9b73-a93e6639e1fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:45.106190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-602a9693-6c45-4b5c-9b73-a93e6639e1fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:45.661290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6b370dd0-b189-4a2f-aa01-e41263c04e28 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:45.714128 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6b370dd0-b189-4a2f-aa01-e41263c04e28 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1460 microversion: 2.1 time: 1.025094 Aug 25 13:16:45.718033 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1947/3955] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:44 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1460 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:45.745389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:45.748395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:45.777369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:45.783419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:45.784292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:45.785812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:45.786726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:45.787526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:46.100188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-602a9693-6c45-4b5c-9b73-a93e6639e1fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:46.125220 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-602a9693-6c45-4b5c-9b73-a93e6639e1fc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.088212 Aug 25 13:16:46.129058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:46.130612 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2009/3956] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:45 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:46.141895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1392394220", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "9dbcd1aa-ce04-43a7-b93f-d1b96ddcbf97"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:46.202889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:46.208699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:46.214166 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-294cb48c-8443-4db8-a3b9-f41cfd9d9471 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.492232 Aug 25 13:16:46.225547 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1948/3957] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:45 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:46.226604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44036607-5fbc-409c-9cb4-319a66b1da14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:46.227845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44036607-5fbc-409c-9cb4-319a66b1da14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:46.243489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44036607-5fbc-409c-9cb4-319a66b1da14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:46.245236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44036607-5fbc-409c-9cb4-319a66b1da14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:46.246881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44036607-5fbc-409c-9cb4-319a66b1da14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:46.248945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44036607-5fbc-409c-9cb4-319a66b1da14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:46.250302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44036607-5fbc-409c-9cb4-319a66b1da14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:46.251582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44036607-5fbc-409c-9cb4-319a66b1da14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:46.318898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] validate_networks() for [('9dbcd1aa-ce04-43a7-b93f-d1b96ddcbf97', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:16:47.095644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44036607-5fbc-409c-9cb4-319a66b1da14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:47.132910 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44036607-5fbc-409c-9cb4-319a66b1da14 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.915152 Aug 25 13:16:47.145997 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1949/3958] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:46 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:47.155783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-74e0005b-ecad-4c03-9007-24090ab374d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:47.171235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-74e0005b-ecad-4c03-9007-24090ab374d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:47.215063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74e0005b-ecad-4c03-9007-24090ab374d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:47.216334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74e0005b-ecad-4c03-9007-24090ab374d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:47.223424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74e0005b-ecad-4c03-9007-24090ab374d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:47.224769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74e0005b-ecad-4c03-9007-24090ab374d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:47.225702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74e0005b-ecad-4c03-9007-24090ab374d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:47.226533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74e0005b-ecad-4c03-9007-24090ab374d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:48.680542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-74e0005b-ecad-4c03-9007-24090ab374d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:48.740320 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-74e0005b-ecad-4c03-9007-24090ab374d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.591956 Aug 25 13:16:48.742269 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1950/3959] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:47 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:48.757256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-51e624e2-6692-47de-a7f1-c511c06df03f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:48.767090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-51e624e2-6692-47de-a7f1-c511c06df03f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:48.788708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:48.801922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51e624e2-6692-47de-a7f1-c511c06df03f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:48.804877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51e624e2-6692-47de-a7f1-c511c06df03f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:48.806283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51e624e2-6692-47de-a7f1-c511c06df03f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:48.810226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51e624e2-6692-47de-a7f1-c511c06df03f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:48.814016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51e624e2-6692-47de-a7f1-c511c06df03f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:48.820069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51e624e2-6692-47de-a7f1-c511c06df03f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:50.840509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-51e624e2-6692-47de-a7f1-c511c06df03f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:50.893318 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-51e624e2-6692-47de-a7f1-c511c06df03f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.148411 Aug 25 13:16:50.912526 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1951/3960] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:48 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:50.945981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:50.950965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:51.009379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:51.010454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:51.021050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:51.027850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:51.029035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:51.030176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:51.287958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:16:51.288879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:16:51.289314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:16:51.293684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:16:51.294646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:16:51.350671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:51.353346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:51.354965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:51.358890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:51.362972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:51.366858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:51.439187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Getting quotas for project d978026db2964d8dbc4c511631c892c2. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:16:51.463740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Getting quotas for user 1cc53ee05ac640d6acf5aea6da0bde26 and project d978026db2964d8dbc4c511631c892c2. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:16:51.509224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:16:51.517437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:16:51.628832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:51.704466 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-360fc577-740e-48d5-b2b6-46f57bba4a07 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.556017 Aug 25 13:16:51.710607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:51.728398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:51.729010 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2010/3961] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:16:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 5596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:16:51.739513 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e782955a-4b23-47cb-a9ca-96619befbde5 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1604 microversion: 2.32 time: 0.819012 Aug 25 13:16:51.741051 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1952/3962] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:50 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1604 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:51.748778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d58bad5-9f0a-452c-ac8e-94bf5e76bf19 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-423048044", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d58bad5-9f0a-452c-ac8e-94bf5e76bf19 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 491 Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-423048044", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-423048044', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:51.763339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d58bad5-9f0a-452c-ac8e-94bf5e76bf19 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d58bad5-9f0a-452c-ac8e-94bf5e76bf19 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.032969 Aug 25 13:16:51.773157 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2011/3963] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:16:51 2022] POST /compute/v2.1/servers => generated 624 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:16:51.785714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-48633a39-0d21-41ee-a6aa-d66857ed3cba req-08deb091-6509-43dc-b988-6d72ea4027ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ab7070-d556-43aa-98dc-d78a45fd1b9c", "name": "network-vif-deleted", "tag": "b5c44b23-585e-4be6-85fe-3a35a84befb2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:51.803985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cbcc3c5b-13f0-4a2d-884d-a31921c58b52 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:51.807382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cbcc3c5b-13f0-4a2d-884d-a31921c58b52 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:51.816622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-48633a39-0d21-41ee-a6aa-d66857ed3cba req-08deb091-6509-43dc-b988-6d72ea4027ee service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:51.817677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-48633a39-0d21-41ee-a6aa-d66857ed3cba req-08deb091-6509-43dc-b988-6d72ea4027ee service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:51.818792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-48633a39-0d21-41ee-a6aa-d66857ed3cba req-08deb091-6509-43dc-b988-6d72ea4027ee service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:51.856863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbcc3c5b-13f0-4a2d-884d-a31921c58b52 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:51.858691 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-48633a39-0d21-41ee-a6aa-d66857ed3cba req-08deb091-6509-43dc-b988-6d72ea4027ee service nova] Creating event network-vif-deleted:b5c44b23-585e-4be6-85fe-3a35a84befb2 for instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c on n-h2-852771-8 Aug 25 13:16:51.865271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbcc3c5b-13f0-4a2d-884d-a31921c58b52 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:51.875159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbcc3c5b-13f0-4a2d-884d-a31921c58b52 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:51.878364 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-48633a39-0d21-41ee-a6aa-d66857ed3cba req-08deb091-6509-43dc-b988-6d72ea4027ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103724 Aug 25 13:16:51.881017 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2012/3964] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:51.881670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbcc3c5b-13f0-4a2d-884d-a31921c58b52 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:51.899333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3c54c4d3-6254-4174-8dcf-a7d96eac6dca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:51.900578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbcc3c5b-13f0-4a2d-884d-a31921c58b52 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:51.901161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3c54c4d3-6254-4174-8dcf-a7d96eac6dca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:51.903013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbcc3c5b-13f0-4a2d-884d-a31921c58b52 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:52.609548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3c54c4d3-6254-4174-8dcf-a7d96eac6dca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:52.653901 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3c54c4d3-6254-4174-8dcf-a7d96eac6dca tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1218 microversion: 2.1 time: 0.760483 Aug 25 13:16:52.662219 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2013/3965] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:51 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1218 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:52.691213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-65a17029-62e4-4e5b-9e6f-8d749c29fd91 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:52.702477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-65a17029-62e4-4e5b-9e6f-8d749c29fd91 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:52.750353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65a17029-62e4-4e5b-9e6f-8d749c29fd91 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:52.760680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65a17029-62e4-4e5b-9e6f-8d749c29fd91 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:52.769327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65a17029-62e4-4e5b-9e6f-8d749c29fd91 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:52.790644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65a17029-62e4-4e5b-9e6f-8d749c29fd91 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:52.792210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65a17029-62e4-4e5b-9e6f-8d749c29fd91 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:52.795330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65a17029-62e4-4e5b-9e6f-8d749c29fd91 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:53.581732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cbcc3c5b-13f0-4a2d-884d-a31921c58b52 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:53.616277 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cbcc3c5b-13f0-4a2d-884d-a31921c58b52 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.868290 Aug 25 13:16:53.617729 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1953/3966] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:51 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:53.633980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:53.635314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:53.671596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:53.672975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:53.674178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:53.676392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:53.680196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:53.681047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:53.817119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:53.818156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:53.828253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:53.835357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lazy-loading 'fault' on Instance uuid 58ba2cb0-d580-4c72-9404-4a05535d6041 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:16:53.998944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-65a17029-62e4-4e5b-9e6f-8d749c29fd91 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:54.042101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:54.067771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:54.071505 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-65a17029-62e4-4e5b-9e6f-8d749c29fd91 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.406397 Aug 25 13:16:54.089855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2b54fcd2e6d42e18576f9051c939b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3fdc36fbf645e681d7dd47dfb8ffc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:54.090178 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2014/3967] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:52 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:54.090344 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bbccdcad-9594-4021-9ad1-27962afb5ef9 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 200 len: 1371 microversion: 2.32 time: 0.459240 Aug 25 13:16:54.090344 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1954/3968] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:53 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 1371 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:16:54.091080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8b89c1b-fe68-4ebf-b210-73169413c085 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:54.092988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8b89c1b-fe68-4ebf-b210-73169413c085 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:54.108640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4861b890-b638-4ba4-9f57-6eb1970ecb06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:54.113596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b89c1b-fe68-4ebf-b210-73169413c085 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:54.116382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b89c1b-fe68-4ebf-b210-73169413c085 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:54.118045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b89c1b-fe68-4ebf-b210-73169413c085 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:54.119652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4861b890-b638-4ba4-9f57-6eb1970ecb06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:54.121147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b89c1b-fe68-4ebf-b210-73169413c085 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:54.122541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b89c1b-fe68-4ebf-b210-73169413c085 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:54.123805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8b89c1b-fe68-4ebf-b210-73169413c085 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:54.136318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4861b890-b638-4ba4-9f57-6eb1970ecb06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:54.137406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4861b890-b638-4ba4-9f57-6eb1970ecb06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:54.138309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4861b890-b638-4ba4-9f57-6eb1970ecb06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:54.141046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4861b890-b638-4ba4-9f57-6eb1970ecb06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:54.143902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4861b890-b638-4ba4-9f57-6eb1970ecb06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:54.144865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4861b890-b638-4ba4-9f57-6eb1970ecb06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:54.502724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b8b89c1b-fe68-4ebf-b210-73169413c085 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:54.594200 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8b89c1b-fe68-4ebf-b210-73169413c085 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1214 microversion: 2.1 time: 0.499962 Aug 25 13:16:54.626312 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1955/3969] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:54 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1214 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:54.626312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4aaca890-2fd3-4d94-a08e-0061f6ba7761 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:54.626312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4aaca890-2fd3-4d94-a08e-0061f6ba7761 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:54.666543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aaca890-2fd3-4d94-a08e-0061f6ba7761 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:54.676289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aaca890-2fd3-4d94-a08e-0061f6ba7761 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:54.686241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aaca890-2fd3-4d94-a08e-0061f6ba7761 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:54.687327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aaca890-2fd3-4d94-a08e-0061f6ba7761 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:54.691009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aaca890-2fd3-4d94-a08e-0061f6ba7761 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:54.692169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4aaca890-2fd3-4d94-a08e-0061f6ba7761 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:55.351060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4861b890-b638-4ba4-9f57-6eb1970ecb06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:55.382453 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4861b890-b638-4ba4-9f57-6eb1970ecb06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.303233 Aug 25 13:16:55.388142 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2015/3970] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:54 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:55.443442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:55.452769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:55.530404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:55.531618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:55.537404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:55.538880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:55.544234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:55.547376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:55.708578 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] HTTP exception thrown: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Request method failure captured: Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 HTTP/1.1 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3O58JGGUnZxGHAm6_R5p9tVrLksML2R97jXPxAJE_IR7TJsrY5g1jQZZ3DXSCo1mj-Q_bLiIP27S36gaVU-huccGmj6pSQaQKC__8iS27eH8f7ZT8bRFnedqtdQ7-1SoishaSsanrDJlEV5aaGgbbpFjmiqPwp40xtnm6Qe6f59f5M Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.32 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5c3fdc36fbf645e681d7dd47dfb8ffc0 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TaggedBootDevicesTest-802104728 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c3fdc36fbf645e681d7dd47dfb8ffc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5c3fdc36fbf645e681d7dd47dfb8ffc0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5c3fdc36fbf645e681d7dd47dfb8ffc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c3fdc36fbf645e681d7dd47dfb8ffc0"}]}] Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TaggedBootDevicesTest-802104728 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5c3fdc36fbf645e681d7dd47dfb8ffc0 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TaggedBootDevicesTest-802104728 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TaggedBootDevicesTest-802104728-project Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d2b54fcd2e6d42e18576f9051c939b41 Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TaggedBootDevicesTest-802104728-project Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '58ba2cb0-d580-4c72-9404-4a05535d6041'} Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:55.719363 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:55.731639 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:55.731639 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:55.731639 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:55.731639 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:16:55.731639 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:16:55.731639 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:16:55.731639 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:55.731639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Returning 404 to user: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:55.731639 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3dd57d95-2f71-495a-bb80-eaae68ec42c3 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 404 len: 111 microversion: 2.32 time: 0.331539 Aug 25 13:16:55.734057 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2016/3971] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:16:55 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 111 bytes in 344 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:16:55.753440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d50cc45b-1848-4b12-b6ba-050d1a287ab5 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:55.757251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d50cc45b-1848-4b12-b6ba-050d1a287ab5 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:55.782899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d50cc45b-1848-4b12-b6ba-050d1a287ab5 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:55.783472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d50cc45b-1848-4b12-b6ba-050d1a287ab5 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:55.784867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d50cc45b-1848-4b12-b6ba-050d1a287ab5 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:55.794093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d50cc45b-1848-4b12-b6ba-050d1a287ab5 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:55.795152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d50cc45b-1848-4b12-b6ba-050d1a287ab5 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:55.796123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d50cc45b-1848-4b12-b6ba-050d1a287ab5 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:56.033134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d50cc45b-1848-4b12-b6ba-050d1a287ab5 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:56.040304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4aaca890-2fd3-4d94-a08e-0061f6ba7761 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:56.075308 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4aaca890-2fd3-4d94-a08e-0061f6ba7761 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.472037 Aug 25 13:16:56.093201 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d50cc45b-1848-4b12-b6ba-050d1a287ab5 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1276 microversion: 2.1 time: 0.356890 Aug 25 13:16:56.094752 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2017/3973] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:55 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:56.099738 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1956/3973] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:54 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:56.109749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efdccf05-c871-41c0-b14b-45b527f9deb8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '.version_select at 0x7f3a2e75ff70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:56.131821 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [None req-efdccf05-c871-41c0-b14b-45b527f9deb8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:16:56.154182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-271246106", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "7c492fa6-6e78-453d-bf88-c7f9aac830a1"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:56.346217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] validate_networks() for [('7c492fa6-6e78-453d-bf88-c7f9aac830a1', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:16:57.156644 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [None req-efdccf05-c871-41c0-b14b-45b527f9deb8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 45702. Aug 25 13:16:57.280789 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-efdccf05-c871-41c0-b14b-45b527f9deb8 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-334852066" status: 204 len: 0 microversion: 2.32 time: 1.183863 Aug 25 13:16:57.282875 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2018/3974] 10.222.0.70 () {60 vars in 1259 bytes} [Thu Aug 25 13:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-334852066 => generated 0 bytes in 1187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:16:57.300443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b2e1be0-487c-4372-bdc7-cc9edb76f65c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b2e1be0-487c-4372-bdc7-cc9edb76f65c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 416 Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:57.323526 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:16:57.331824 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:16:57.340825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b2e1be0-487c-4372-bdc7-cc9edb76f65c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:16:57.353655 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3b2e1be0-487c-4372-bdc7-cc9edb76f65c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.052156 Aug 25 13:16:57.376191 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2019/3975] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:16:57 2022] POST /compute/v2.1/servers => generated 619 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:16:57.411079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4cf66943-2155-40b1-8b8d-7a61f62d1313 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:57.416392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4cf66943-2155-40b1-8b8d-7a61f62d1313 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:57.479208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cf66943-2155-40b1-8b8d-7a61f62d1313 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:57.492785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cf66943-2155-40b1-8b8d-7a61f62d1313 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:57.494048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cf66943-2155-40b1-8b8d-7a61f62d1313 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:57.495876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cf66943-2155-40b1-8b8d-7a61f62d1313 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:57.499497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cf66943-2155-40b1-8b8d-7a61f62d1313 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:57.504716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4cf66943-2155-40b1-8b8d-7a61f62d1313 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:57.775395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4cf66943-2155-40b1-8b8d-7a61f62d1313 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:57.810050 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4cf66943-2155-40b1-8b8d-7a61f62d1313 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1276 microversion: 2.1 time: 0.422819 Aug 25 13:16:57.811051 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2020/3976] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:57 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1276 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:57.820379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47f1261e-3e87-4b8c-86ae-3e1471ad98f4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:57.835163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-47f1261e-3e87-4b8c-86ae-3e1471ad98f4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:57.867353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47f1261e-3e87-4b8c-86ae-3e1471ad98f4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:57.868479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47f1261e-3e87-4b8c-86ae-3e1471ad98f4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:57.869418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47f1261e-3e87-4b8c-86ae-3e1471ad98f4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:57.870935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47f1261e-3e87-4b8c-86ae-3e1471ad98f4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:57.875800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47f1261e-3e87-4b8c-86ae-3e1471ad98f4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:57.876930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47f1261e-3e87-4b8c-86ae-3e1471ad98f4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:58.610874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-47f1261e-3e87-4b8c-86ae-3e1471ad98f4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:58.649173 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47f1261e-3e87-4b8c-86ae-3e1471ad98f4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.833211 Aug 25 13:16:58.667896 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2021/3977] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:57 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:58.688727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dfcea557-b7a8-4c9a-b9ee-5c35402baa63 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:58.691055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dfcea557-b7a8-4c9a-b9ee-5c35402baa63 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:58.703143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfcea557-b7a8-4c9a-b9ee-5c35402baa63 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:58.709669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfcea557-b7a8-4c9a-b9ee-5c35402baa63 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:58.710696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfcea557-b7a8-4c9a-b9ee-5c35402baa63 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:58.712078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfcea557-b7a8-4c9a-b9ee-5c35402baa63 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:58.714300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfcea557-b7a8-4c9a-b9ee-5c35402baa63 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:58.720418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfcea557-b7a8-4c9a-b9ee-5c35402baa63 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:59.370491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dfcea557-b7a8-4c9a-b9ee-5c35402baa63 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:59.429812 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dfcea557-b7a8-4c9a-b9ee-5c35402baa63 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.748955 Aug 25 13:16:59.436158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2022/3978] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:58 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:16:59.455940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e63599c-c2e3-4d6f-9b29-ff8268f2717b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:59.459249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6e63599c-c2e3-4d6f-9b29-ff8268f2717b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:59.503798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e63599c-c2e3-4d6f-9b29-ff8268f2717b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:59.508759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e63599c-c2e3-4d6f-9b29-ff8268f2717b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:59.511922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e63599c-c2e3-4d6f-9b29-ff8268f2717b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:59.513769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e63599c-c2e3-4d6f-9b29-ff8268f2717b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:59.516898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e63599c-c2e3-4d6f-9b29-ff8268f2717b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:59.517699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e63599c-c2e3-4d6f-9b29-ff8268f2717b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:59.536297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:16:59.537230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:16:59.538467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:16:59.540120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:16:59.542165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:16:59.625007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:59.634826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:59.641710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:59.644603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:59.650431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:59.654517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:59.746808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:16:59.778276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Getting quotas for user e320ccc6c0624541895fc42bf681da76 and project b8de71f9e1804c46ab8f18f48a5fff42. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:16:59.840737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:16:59.860225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:17:00.057055 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-22da4f54-9d02-43c5-8d67-b7620cc63d40 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.954551 Aug 25 13:17:00.059133 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1957/3979] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:16:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:17:00.070277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e5047a16-5efe-4c70-ab5e-75be91fc8f80 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-163953819", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": -1, "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:00.102343 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-e5047a16-5efe-4c70-ab5e-75be91fc8f80 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Flavor -1 could not be found. Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e5047a16-5efe-4c70-ab5e-75be91fc8f80 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 205 Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-163953819", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": -1, "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: exception: Flavor -1 could not be found. Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-163953819', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': -1, 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:00.118833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 25 13:17:00.127179 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:00.132669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6e63599c-c2e3-4d6f-9b29-ff8268f2717b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:00.134321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e5047a16-5efe-4c70-ab5e-75be91fc8f80 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:00.134321 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e5047a16-5efe-4c70-ab5e-75be91fc8f80 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.070931 Aug 25 13:17:00.140669 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1958/3980] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:17:00 2022] POST /compute/v2.1/servers => generated 73 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 13:17:00.153966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f1520894-7507-447e-8cd8-3283a2c0acc8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:00.155613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f1520894-7507-447e-8cd8-3283a2c0acc8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:00.172468 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e63599c-c2e3-4d6f-9b29-ff8268f2717b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1276 microversion: 2.1 time: 0.732271 Aug 25 13:17:00.184415 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2023/3981] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:59 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1276 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:00.198991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a350cf7-a3ae-4fab-bc30-e74308bd4aa1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:00.200182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a350cf7-a3ae-4fab-bc30-e74308bd4aa1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:00.230337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a350cf7-a3ae-4fab-bc30-e74308bd4aa1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:00.230647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a350cf7-a3ae-4fab-bc30-e74308bd4aa1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:00.231532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a350cf7-a3ae-4fab-bc30-e74308bd4aa1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:00.235294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a350cf7-a3ae-4fab-bc30-e74308bd4aa1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:00.239308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a350cf7-a3ae-4fab-bc30-e74308bd4aa1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:00.240285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a350cf7-a3ae-4fab-bc30-e74308bd4aa1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:00.490164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f1520894-7507-447e-8cd8-3283a2c0acc8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:00.515916 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f1520894-7507-447e-8cd8-3283a2c0acc8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1214 microversion: 2.1 time: 0.371498 Aug 25 13:17:00.528816 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1959/3982] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:00 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1214 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:00.890768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a350cf7-a3ae-4fab-bc30-e74308bd4aa1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:00.948616 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a350cf7-a3ae-4fab-bc30-e74308bd4aa1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.762492 Aug 25 13:17:00.978556 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2024/3983] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:00 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:01.014913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4a69eac5-3b39-4e0a-bef8-cd4c59bea1b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:01.017326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4a69eac5-3b39-4e0a-bef8-cd4c59bea1b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:01.054894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a69eac5-3b39-4e0a-bef8-cd4c59bea1b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:01.058826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a69eac5-3b39-4e0a-bef8-cd4c59bea1b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:01.065068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a69eac5-3b39-4e0a-bef8-cd4c59bea1b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:01.082436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a69eac5-3b39-4e0a-bef8-cd4c59bea1b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:01.090827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a69eac5-3b39-4e0a-bef8-cd4c59bea1b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:01.098409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a69eac5-3b39-4e0a-bef8-cd4c59bea1b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:01.226252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6ed0fd90-c6b4-45d5-8b82-8bc27b53f0a1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:01.232767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6ed0fd90-c6b4-45d5-8b82-8bc27b53f0a1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:01.266757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ed0fd90-c6b4-45d5-8b82-8bc27b53f0a1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:01.277021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ed0fd90-c6b4-45d5-8b82-8bc27b53f0a1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:01.283018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ed0fd90-c6b4-45d5-8b82-8bc27b53f0a1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:01.291033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ed0fd90-c6b4-45d5-8b82-8bc27b53f0a1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:01.293085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ed0fd90-c6b4-45d5-8b82-8bc27b53f0a1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:01.296915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6ed0fd90-c6b4-45d5-8b82-8bc27b53f0a1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:01.409128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:01.774843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6ed0fd90-c6b4-45d5-8b82-8bc27b53f0a1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:01.838191 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6ed0fd90-c6b4-45d5-8b82-8bc27b53f0a1 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1276 microversion: 2.1 time: 0.622626 Aug 25 13:17:01.845180 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2025/3984] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:01 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1276 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:01.885041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f2dab6d-9fe9-4b86-ac06-595a032e92a8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:01.886356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f2dab6d-9fe9-4b86-ac06-595a032e92a8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:01.913479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f2dab6d-9fe9-4b86-ac06-595a032e92a8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:01.914939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f2dab6d-9fe9-4b86-ac06-595a032e92a8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:01.916112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f2dab6d-9fe9-4b86-ac06-595a032e92a8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:01.919755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f2dab6d-9fe9-4b86-ac06-595a032e92a8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:01.924488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f2dab6d-9fe9-4b86-ac06-595a032e92a8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:01.926654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f2dab6d-9fe9-4b86-ac06-595a032e92a8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:02.029899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:02.285479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f2dab6d-9fe9-4b86-ac06-595a032e92a8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:02.328941 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f2dab6d-9fe9-4b86-ac06-595a032e92a8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1218 microversion: 2.1 time: 0.457902 Aug 25 13:17:02.331697 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2026/3985] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:01 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1218 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:02.511735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4a69eac5-3b39-4e0a-bef8-cd4c59bea1b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:02.548598 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4a69eac5-3b39-4e0a-bef8-cd4c59bea1b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.543648 Aug 25 13:17:02.552749 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1960/3986] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:01 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:02.892229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-81a812e5-380a-4904-b380-eceddfed6e7b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:02.893297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-37227d62-e057-4ea0-b42f-cbb3d991031d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1318805441", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:02.896878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-81a812e5-380a-4904-b380-eceddfed6e7b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-37227d62-e057-4ea0-b42f-cbb3d991031d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 173 Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1318805441", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1318805441', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi -1 Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:17:02.905952 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-37227d62-e057-4ea0-b42f-cbb3d991031d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-37227d62-e057-4ea0-b42f-cbb3d991031d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.049016 Aug 25 13:17:02.922377 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2027/3987] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:17:02 2022] POST /compute/v2.1/servers => generated 145 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:17:02.927735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81a812e5-380a-4904-b380-eceddfed6e7b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:02.929570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81a812e5-380a-4904-b380-eceddfed6e7b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:02.931763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81a812e5-380a-4904-b380-eceddfed6e7b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:02.933580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81a812e5-380a-4904-b380-eceddfed6e7b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:02.935838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81a812e5-380a-4904-b380-eceddfed6e7b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:02.937222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81a812e5-380a-4904-b380-eceddfed6e7b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:02.943785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:02.962872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b28789b-2b3a-452b-bc6c-d1c3fa1fd600 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:02.967435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5b28789b-2b3a-452b-bc6c-d1c3fa1fd600 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:03.002822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b28789b-2b3a-452b-bc6c-d1c3fa1fd600 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:03.010898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b28789b-2b3a-452b-bc6c-d1c3fa1fd600 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:03.012991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b28789b-2b3a-452b-bc6c-d1c3fa1fd600 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:03.016770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b28789b-2b3a-452b-bc6c-d1c3fa1fd600 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:03.018811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b28789b-2b3a-452b-bc6c-d1c3fa1fd600 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:03.023061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b28789b-2b3a-452b-bc6c-d1c3fa1fd600 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:04.150223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81a812e5-380a-4904-b380-eceddfed6e7b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:04.201195 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-81a812e5-380a-4904-b380-eceddfed6e7b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1318 microversion: 2.1 time: 1.319000 Aug 25 13:17:04.216187 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1961/3988] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:02 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1318 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:04.248369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1600867-019d-4001-a449-a2ec56511061 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:04.254413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c1600867-019d-4001-a449-a2ec56511061 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:04.285316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1600867-019d-4001-a449-a2ec56511061 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:04.286267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1600867-019d-4001-a449-a2ec56511061 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:04.287063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1600867-019d-4001-a449-a2ec56511061 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:04.288432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1600867-019d-4001-a449-a2ec56511061 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:04.289239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1600867-019d-4001-a449-a2ec56511061 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:04.298707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1600867-019d-4001-a449-a2ec56511061 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:04.316861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:04.850349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b28789b-2b3a-452b-bc6c-d1c3fa1fd600 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:04.869781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c1600867-019d-4001-a449-a2ec56511061 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:04.915924 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b28789b-2b3a-452b-bc6c-d1c3fa1fd600 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.976262 Aug 25 13:17:04.926515 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c1600867-019d-4001-a449-a2ec56511061 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1272 microversion: 2.1 time: 0.707248 Aug 25 13:17:04.931944 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2028/3989] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:02 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:04.946527 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1962/3990] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:04 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1272 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:04.982729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df404d92-0c4a-4c03-85a9-da7b1d1603a8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:04.984306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-df404d92-0c4a-4c03-85a9-da7b1d1603a8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:05.010677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:05.019524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df404d92-0c4a-4c03-85a9-da7b1d1603a8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:05.021549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df404d92-0c4a-4c03-85a9-da7b1d1603a8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:05.027578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df404d92-0c4a-4c03-85a9-da7b1d1603a8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:05.045140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df404d92-0c4a-4c03-85a9-da7b1d1603a8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:05.056965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df404d92-0c4a-4c03-85a9-da7b1d1603a8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:05.061915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df404d92-0c4a-4c03-85a9-da7b1d1603a8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:05.254329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ad5080be-1e88-44a4-a2b8-b1c8576e9a4a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:05.257147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ad5080be-1e88-44a4-a2b8-b1c8576e9a4a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:05.291534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad5080be-1e88-44a4-a2b8-b1c8576e9a4a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:05.299533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad5080be-1e88-44a4-a2b8-b1c8576e9a4a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:05.300689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad5080be-1e88-44a4-a2b8-b1c8576e9a4a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:05.302138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad5080be-1e88-44a4-a2b8-b1c8576e9a4a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:05.313316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad5080be-1e88-44a4-a2b8-b1c8576e9a4a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:05.317253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad5080be-1e88-44a4-a2b8-b1c8576e9a4a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:06.535270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ad5080be-1e88-44a4-a2b8-b1c8576e9a4a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:06.549228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df404d92-0c4a-4c03-85a9-da7b1d1603a8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:06.584688 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ad5080be-1e88-44a4-a2b8-b1c8576e9a4a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1318 microversion: 2.1 time: 1.339199 Aug 25 13:17:06.600226 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-df404d92-0c4a-4c03-85a9-da7b1d1603a8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.624012 Aug 25 13:17:06.601033 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1963/3991] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:05 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1318 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:06.610082 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2029/3992] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:04 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:06.617265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-60995b17-58b4-4d1e-91d2-af4d4070f497 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:06.622921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-60995b17-58b4-4d1e-91d2-af4d4070f497 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:06.663309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60995b17-58b4-4d1e-91d2-af4d4070f497 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:06.664602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60995b17-58b4-4d1e-91d2-af4d4070f497 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:06.665101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60995b17-58b4-4d1e-91d2-af4d4070f497 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:06.667615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60995b17-58b4-4d1e-91d2-af4d4070f497 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:06.668515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60995b17-58b4-4d1e-91d2-af4d4070f497 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:06.669339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60995b17-58b4-4d1e-91d2-af4d4070f497 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:07.081132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4c67a0dc-da78-4ff2-9c03-c7d10da9829a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1780208861", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:07.101418 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-4c67a0dc-da78-4ff2-9c03-c7d10da9829a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4c67a0dc-da78-4ff2-9c03-c7d10da9829a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 216 Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1780208861", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1780208861', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:07.120924 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:07.130752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:07.130752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:07.130752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:07.130752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:07.130752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:07.130752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:07.130752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 25 13:17:07.130752 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:07.136434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4c67a0dc-da78-4ff2-9c03-c7d10da9829a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:07.136434 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4c67a0dc-da78-4ff2-9c03-c7d10da9829a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.072515 Aug 25 13:17:07.136434 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2030/3993] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:17:07 2022] POST /compute/v2.1/servers => generated 123 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:17:07.155803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0622a823-2293-42ef-be68-ea407ac2587c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:07.156505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60995b17-58b4-4d1e-91d2-af4d4070f497 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:07.169970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0622a823-2293-42ef-be68-ea407ac2587c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:07.192359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0622a823-2293-42ef-be68-ea407ac2587c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:07.193807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0622a823-2293-42ef-be68-ea407ac2587c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:07.194798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0622a823-2293-42ef-be68-ea407ac2587c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:07.199905 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-60995b17-58b4-4d1e-91d2-af4d4070f497 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1272 microversion: 2.1 time: 0.596523 Aug 25 13:17:07.200989 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1964/3994] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:06 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1272 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:07.222833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0622a823-2293-42ef-be68-ea407ac2587c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:07.223629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0622a823-2293-42ef-be68-ea407ac2587c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:07.228542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0622a823-2293-42ef-be68-ea407ac2587c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:07.648762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-11184d11-3d2e-4e34-8fe6-3b9c1fc10781 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:07.652798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-11184d11-3d2e-4e34-8fe6-3b9c1fc10781 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:07.706593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11184d11-3d2e-4e34-8fe6-3b9c1fc10781 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:07.710256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11184d11-3d2e-4e34-8fe6-3b9c1fc10781 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:07.711907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11184d11-3d2e-4e34-8fe6-3b9c1fc10781 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:07.724369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11184d11-3d2e-4e34-8fe6-3b9c1fc10781 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:07.727270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11184d11-3d2e-4e34-8fe6-3b9c1fc10781 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:07.729325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11184d11-3d2e-4e34-8fe6-3b9c1fc10781 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:09.242335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-11184d11-3d2e-4e34-8fe6-3b9c1fc10781 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:09.277461 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-11184d11-3d2e-4e34-8fe6-3b9c1fc10781 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1318 microversion: 2.1 time: 1.636208 Aug 25 13:17:09.282202 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1965/3995] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:07 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1318 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:09.320609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c3933816-5a84-44b2-90c2-ae40744a5afe req-4d258b91-6b05-4f7a-85a8-d20f20c55346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cdc93a4-11c5-42fb-a18e-099ac3ad75ab", "tag": "7cb5f4c0-63ce-414c-b8f2-e4a8360aed9d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:09.353164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c3933816-5a84-44b2-90c2-ae40744a5afe req-4d258b91-6b05-4f7a-85a8-d20f20c55346 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:09.356782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c3933816-5a84-44b2-90c2-ae40744a5afe req-4d258b91-6b05-4f7a-85a8-d20f20c55346 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:09.358511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c3933816-5a84-44b2-90c2-ae40744a5afe req-4d258b91-6b05-4f7a-85a8-d20f20c55346 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:09.447284 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c3933816-5a84-44b2-90c2-ae40744a5afe req-4d258b91-6b05-4f7a-85a8-d20f20c55346 service nova] Creating event network-changed:7cb5f4c0-63ce-414c-b8f2-e4a8360aed9d for instance 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab on n-h2-852771-8 Aug 25 13:17:09.475749 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c3933816-5a84-44b2-90c2-ae40744a5afe req-4d258b91-6b05-4f7a-85a8-d20f20c55346 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183343 Aug 25 13:17:09.482243 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1966/3996] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:17:09.507606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19bb5173-f900-49d9-bc8b-eafa4f709fa9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:09.508537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-19bb5173-f900-49d9-bc8b-eafa4f709fa9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:09.530338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19bb5173-f900-49d9-bc8b-eafa4f709fa9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:09.535734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19bb5173-f900-49d9-bc8b-eafa4f709fa9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:09.537085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19bb5173-f900-49d9-bc8b-eafa4f709fa9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:09.538726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19bb5173-f900-49d9-bc8b-eafa4f709fa9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:09.540047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19bb5173-f900-49d9-bc8b-eafa4f709fa9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:09.541273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19bb5173-f900-49d9-bc8b-eafa4f709fa9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:09.717815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:09.780702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0622a823-2293-42ef-be68-ea407ac2587c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:09.820289 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0622a823-2293-42ef-be68-ea407ac2587c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 2.665045 Aug 25 13:17:09.823841 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2031/3997] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:07 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 2680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:17:09.869665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8686a37e-1dad-4e81-926b-ba15cedf3260 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:09.876003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8686a37e-1dad-4e81-926b-ba15cedf3260 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:09.906201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8686a37e-1dad-4e81-926b-ba15cedf3260 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:09.908511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8686a37e-1dad-4e81-926b-ba15cedf3260 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:09.913297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8686a37e-1dad-4e81-926b-ba15cedf3260 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:09.918886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8686a37e-1dad-4e81-926b-ba15cedf3260 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:09.922026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8686a37e-1dad-4e81-926b-ba15cedf3260 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:09.925967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8686a37e-1dad-4e81-926b-ba15cedf3260 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:10.501554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:11.014954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-19bb5173-f900-49d9-bc8b-eafa4f709fa9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:11.038520 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19bb5173-f900-49d9-bc8b-eafa4f709fa9 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1314 microversion: 2.1 time: 1.549812 Aug 25 13:17:11.048160 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1967/3998] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:09 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1314 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:11.069364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d3e0efbf-19f5-4ae0-8cc5-2f8dcda32497 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:11.087406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d3e0efbf-19f5-4ae0-8cc5-2f8dcda32497 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:11.115971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3e0efbf-19f5-4ae0-8cc5-2f8dcda32497 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:11.116780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3e0efbf-19f5-4ae0-8cc5-2f8dcda32497 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:11.123576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3e0efbf-19f5-4ae0-8cc5-2f8dcda32497 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:11.125191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3e0efbf-19f5-4ae0-8cc5-2f8dcda32497 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:11.126770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3e0efbf-19f5-4ae0-8cc5-2f8dcda32497 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:11.127615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3e0efbf-19f5-4ae0-8cc5-2f8dcda32497 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:12.110352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8686a37e-1dad-4e81-926b-ba15cedf3260 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:12.153444 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8686a37e-1dad-4e81-926b-ba15cedf3260 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 2.293120 Aug 25 13:17:12.165740 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2032/3999] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:09 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:17:12.195121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9dae0f3a-af85-401e-b243-5e7a692fca46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:12.196965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9dae0f3a-af85-401e-b243-5e7a692fca46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:12.228119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dae0f3a-af85-401e-b243-5e7a692fca46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:12.234702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dae0f3a-af85-401e-b243-5e7a692fca46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:12.236956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dae0f3a-af85-401e-b243-5e7a692fca46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:12.248576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dae0f3a-af85-401e-b243-5e7a692fca46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:12.256331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dae0f3a-af85-401e-b243-5e7a692fca46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:12.259308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9dae0f3a-af85-401e-b243-5e7a692fca46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:12.453169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d3e0efbf-19f5-4ae0-8cc5-2f8dcda32497 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:12.507675 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d3e0efbf-19f5-4ae0-8cc5-2f8dcda32497 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1318 microversion: 2.1 time: 1.444905 Aug 25 13:17:12.510560 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1968/4000] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:11 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1318 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:12.776747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77146ac8-bc50-4a76-8732-17a96c0f9858 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1780910349", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "key_name": "tempest-key-1042591277", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:13.098117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-77146ac8-bc50-4a76-8732-17a96c0f9858 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] validate_networks() for [('a93c3507-9ff2-4777-a7c1-69c8a703a9b6', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:17:13.226275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9dae0f3a-af85-401e-b243-5e7a692fca46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:13.284576 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9dae0f3a-af85-401e-b243-5e7a692fca46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1314 microversion: 2.1 time: 1.108017 Aug 25 13:17:13.292269 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2033/4001] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:12 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1314 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:13.316959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c157f3f6-d886-4e95-8857-a23f9ca166bf req-7ee59f5a-dfcb-46a6-9277-fcc1528a4871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7077e0f1-eda0-4e8e-8f81-a64989f35696", "tag": "a659e858-0072-4d47-b4ff-36f0aab011f7"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:13.357090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c157f3f6-d886-4e95-8857-a23f9ca166bf req-7ee59f5a-dfcb-46a6-9277-fcc1528a4871 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:13.357904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c157f3f6-d886-4e95-8857-a23f9ca166bf req-7ee59f5a-dfcb-46a6-9277-fcc1528a4871 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:13.358697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c157f3f6-d886-4e95-8857-a23f9ca166bf req-7ee59f5a-dfcb-46a6-9277-fcc1528a4871 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:13.416732 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c157f3f6-d886-4e95-8857-a23f9ca166bf req-7ee59f5a-dfcb-46a6-9277-fcc1528a4871 service nova] Creating event network-changed:a659e858-0072-4d47-b4ff-36f0aab011f7 for instance 7077e0f1-eda0-4e8e-8f81-a64989f35696 on n-h1-852771-8 Aug 25 13:17:13.427614 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c157f3f6-d886-4e95-8857-a23f9ca166bf req-7ee59f5a-dfcb-46a6-9277-fcc1528a4871 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133336 Aug 25 13:17:13.428760 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2034/4002] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:17:13.559068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b486154-9177-4037-adb8-a63cdaca88dc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:13.567192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b486154-9177-4037-adb8-a63cdaca88dc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:13.605019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b486154-9177-4037-adb8-a63cdaca88dc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:13.605968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b486154-9177-4037-adb8-a63cdaca88dc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:13.606697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b486154-9177-4037-adb8-a63cdaca88dc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:13.608053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b486154-9177-4037-adb8-a63cdaca88dc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:13.608877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b486154-9177-4037-adb8-a63cdaca88dc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:13.625986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b486154-9177-4037-adb8-a63cdaca88dc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:14.736506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b486154-9177-4037-adb8-a63cdaca88dc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:14.760693 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b486154-9177-4037-adb8-a63cdaca88dc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1318 microversion: 2.1 time: 1.215128 Aug 25 13:17:14.775664 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2035/4003] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:13 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1318 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:17:14.793058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e90357f9-7fdf-40bf-8ff8-88fd8b939a89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:14.794966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e90357f9-7fdf-40bf-8ff8-88fd8b939a89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:14.817157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e90357f9-7fdf-40bf-8ff8-88fd8b939a89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:14.822858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e90357f9-7fdf-40bf-8ff8-88fd8b939a89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:14.824298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e90357f9-7fdf-40bf-8ff8-88fd8b939a89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:14.830576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e90357f9-7fdf-40bf-8ff8-88fd8b939a89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:14.832112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e90357f9-7fdf-40bf-8ff8-88fd8b939a89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:14.833394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e90357f9-7fdf-40bf-8ff8-88fd8b939a89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:15.015892 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-77146ac8-bc50-4a76-8732-17a96c0f9858 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Invalid key_name provided. Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77146ac8-bc50-4a76-8732-17a96c0f9858 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 247 Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1780910349", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "key_name": "tempest-key-1042591277", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid key_name provided. Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1780910349', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'key_name': 'tempest-key-1042591277', 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1042591277 not found for user acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:15.035999 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77146ac8-bc50-4a76-8732-17a96c0f9858 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid key_name provided. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:15.048612 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-77146ac8-bc50-4a76-8732-17a96c0f9858 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 2.293875 Aug 25 13:17:15.056645 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1969/4004] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:17:12 2022] POST /compute/v2.1/servers => generated 70 bytes in 2306 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 13:17:15.092153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5eaaf386-fdf3-4be6-8dba-192f56e70427 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:15.114613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5eaaf386-fdf3-4be6-8dba-192f56e70427 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:15.168757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eaaf386-fdf3-4be6-8dba-192f56e70427 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:15.172745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eaaf386-fdf3-4be6-8dba-192f56e70427 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:15.179033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eaaf386-fdf3-4be6-8dba-192f56e70427 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:15.180491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eaaf386-fdf3-4be6-8dba-192f56e70427 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:15.181394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eaaf386-fdf3-4be6-8dba-192f56e70427 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:15.186810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eaaf386-fdf3-4be6-8dba-192f56e70427 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:17.472421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e90357f9-7fdf-40bf-8ff8-88fd8b939a89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:17.525469 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e90357f9-7fdf-40bf-8ff8-88fd8b939a89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1314 microversion: 2.1 time: 2.747510 Aug 25 13:17:17.526889 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2036/4005] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:14 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1314 bytes in 2750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:17.554162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43a57f50-ae84-4394-8a07-f7ecfb62cae9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:17.555602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43a57f50-ae84-4394-8a07-f7ecfb62cae9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:17.575412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5eaaf386-fdf3-4be6-8dba-192f56e70427 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:17.601648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a57f50-ae84-4394-8a07-f7ecfb62cae9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:17.602543 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5eaaf386-fdf3-4be6-8dba-192f56e70427 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 2.537764 Aug 25 13:17:17.602839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a57f50-ae84-4394-8a07-f7ecfb62cae9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:17.603692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a57f50-ae84-4394-8a07-f7ecfb62cae9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:17.605062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a57f50-ae84-4394-8a07-f7ecfb62cae9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:17.605966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a57f50-ae84-4394-8a07-f7ecfb62cae9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:17.606825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a57f50-ae84-4394-8a07-f7ecfb62cae9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:17.618766 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1970/4006] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:15 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 2565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:17.690328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d2322dfe-4600-46be-9a50-055fe89d65ea tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:17.697463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d2322dfe-4600-46be-9a50-055fe89d65ea tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:17.747777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2322dfe-4600-46be-9a50-055fe89d65ea tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:17.752344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2322dfe-4600-46be-9a50-055fe89d65ea tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:17.755331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2322dfe-4600-46be-9a50-055fe89d65ea tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:17.761255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2322dfe-4600-46be-9a50-055fe89d65ea tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:17.763318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2322dfe-4600-46be-9a50-055fe89d65ea tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:17.764214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2322dfe-4600-46be-9a50-055fe89d65ea tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:19.659486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43a57f50-ae84-4394-8a07-f7ecfb62cae9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:19.706686 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43a57f50-ae84-4394-8a07-f7ecfb62cae9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1318 microversion: 2.1 time: 2.167662 Aug 25 13:17:19.711646 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2037/4007] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:17 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1318 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:19.748331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-261c7879-6f8f-4950-9066-1c7d403547be tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:19.751534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-261c7879-6f8f-4950-9066-1c7d403547be tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:19.788972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-261c7879-6f8f-4950-9066-1c7d403547be tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:19.790464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-261c7879-6f8f-4950-9066-1c7d403547be tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:19.793414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-261c7879-6f8f-4950-9066-1c7d403547be tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:19.795285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-261c7879-6f8f-4950-9066-1c7d403547be tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:19.802753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-261c7879-6f8f-4950-9066-1c7d403547be tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:19.804440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-261c7879-6f8f-4950-9066-1c7d403547be tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:19.929442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d2322dfe-4600-46be-9a50-055fe89d65ea tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:19.977373 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d2322dfe-4600-46be-9a50-055fe89d65ea tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 2.332213 Aug 25 13:17:20.014307 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1971/4008] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:17 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:20.237094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86e0d1b8-ba9a-41bf-8838-bc77fb9554de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1978990915", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:20.300452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:20.896894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.security_group_api [None req-86e0d1b8-ba9a-41bf-8838-bc77fb9554de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Neutron security group does_not_exist not found {{(pid=129059) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 25 13:17:20.910682 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-86e0d1b8-ba9a-41bf-8838-bc77fb9554de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:17:20.914173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-261c7879-6f8f-4950-9066-1c7d403547be tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86e0d1b8-ba9a-41bf-8838-bc77fb9554de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 258 Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1978990915", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1978990915', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 25 13:17:20.938065 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:17:20.950943 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:20.961721 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-261c7879-6f8f-4950-9066-1c7d403547be tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1314 microversion: 2.1 time: 1.227118 Aug 25 13:17:20.962005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86e0d1b8-ba9a-41bf-8838-bc77fb9554de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:20.962251 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2038/4009] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:19 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1314 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:20.963607 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-86e0d1b8-ba9a-41bf-8838-bc77fb9554de tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.724563 Aug 25 13:17:20.964591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ce0534af-1337-4fd1-b47f-6cdbfc8424b6 req-ef41ecfc-378c-45a7-8510-c6640fb6e930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdc93a4-11c5-42fb-a18e-099ac3ad75ab", "name": "network-vif-plugged", "status": "completed", "tag": "7cb5f4c0-63ce-414c-b8f2-e4a8360aed9d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:20.967470 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1972/4010] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:17:20 2022] POST /compute/v2.1/servers => generated 106 bytes in 741 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:17:20.984885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d460ca30-57bb-4c99-be38-55a63c380e3a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:20.986036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d460ca30-57bb-4c99-be38-55a63c380e3a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:21.007109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d460ca30-57bb-4c99-be38-55a63c380e3a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.008521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d460ca30-57bb-4c99-be38-55a63c380e3a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.009576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d460ca30-57bb-4c99-be38-55a63c380e3a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.012421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d460ca30-57bb-4c99-be38-55a63c380e3a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.013851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d460ca30-57bb-4c99-be38-55a63c380e3a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.014853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d460ca30-57bb-4c99-be38-55a63c380e3a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.017809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ce0534af-1337-4fd1-b47f-6cdbfc8424b6 req-ef41ecfc-378c-45a7-8510-c6640fb6e930 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.018640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ce0534af-1337-4fd1-b47f-6cdbfc8424b6 req-ef41ecfc-378c-45a7-8510-c6640fb6e930 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.019368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ce0534af-1337-4fd1-b47f-6cdbfc8424b6 req-ef41ecfc-378c-45a7-8510-c6640fb6e930 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.076859 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ce0534af-1337-4fd1-b47f-6cdbfc8424b6 req-ef41ecfc-378c-45a7-8510-c6640fb6e930 service nova] Creating event network-vif-plugged:7cb5f4c0-63ce-414c-b8f2-e4a8360aed9d for instance 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab on n-h2-852771-8 Aug 25 13:17:21.110827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ce0534af-1337-4fd1-b47f-6cdbfc8424b6 req-ef41ecfc-378c-45a7-8510-c6640fb6e930 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155620 Aug 25 13:17:21.111898 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2039/4011] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:17:21.159001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:21.161390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:21.178724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.179515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.180319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.186208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.187384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.188735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.229432 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] HTTP exception thrown: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Request method failure captured: Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 HTTP/1.1 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3O58JGGUnZxGHAm6_R5p9tVrLksML2R97jXPxAJE_IR7TJsrY5g1jQZZ3DXSCo1mj-Q_bLiIP27S36gaVU-huccGmj6pSQaQKC__8iS27eH8f7ZT8bRFnedqtdQ7-1SoishaSsanrDJlEV5aaGgbbpFjmiqPwp40xtnm6Qe6f59f5M Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.32 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5c3fdc36fbf645e681d7dd47dfb8ffc0 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TaggedBootDevicesTest-802104728 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c3fdc36fbf645e681d7dd47dfb8ffc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5c3fdc36fbf645e681d7dd47dfb8ffc0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5c3fdc36fbf645e681d7dd47dfb8ffc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c3fdc36fbf645e681d7dd47dfb8ffc0"}]}] Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TaggedBootDevicesTest-802104728 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5c3fdc36fbf645e681d7dd47dfb8ffc0 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TaggedBootDevicesTest-802104728 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TaggedBootDevicesTest-802104728-project Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: d2b54fcd2e6d42e18576f9051c939b41 Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TaggedBootDevicesTest-802104728-project Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '58ba2cb0-d580-4c72-9404-4a05535d6041'} Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:21.249456 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Returning 404 to user: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f51e93d2-28ff-4520-8006-99dc4511c8c7 tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "DELETE /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 404 len: 111 microversion: 2.32 time: 0.141440 Aug 25 13:17:21.268025 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2040/4012] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:17:21 2022] DELETE /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:17:21.291595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62393967-c3eb-407a-a02a-ac61d9e1baa9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:21.294589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-62393967-c3eb-407a-a02a-ac61d9e1baa9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:21.315296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62393967-c3eb-407a-a02a-ac61d9e1baa9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.316316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62393967-c3eb-407a-a02a-ac61d9e1baa9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.317153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62393967-c3eb-407a-a02a-ac61d9e1baa9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.318576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62393967-c3eb-407a-a02a-ac61d9e1baa9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.319478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62393967-c3eb-407a-a02a-ac61d9e1baa9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.320565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62393967-c3eb-407a-a02a-ac61d9e1baa9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.605467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d460ca30-57bb-4c99-be38-55a63c380e3a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:21.637480 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d460ca30-57bb-4c99-be38-55a63c380e3a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1318 microversion: 2.1 time: 0.667586 Aug 25 13:17:21.646999 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1973/4013] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:20 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:21.665238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:21.677480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] [instance: 58ba2cb0-d580-4c72-9404-4a05535d6041] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:21.730650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.731584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.732418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.742418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.743377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.744279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.773543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62393967-c3eb-407a-a02a-ac61d9e1baa9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:21.804382 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-62393967-c3eb-407a-a02a-ac61d9e1baa9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.540905 Aug 25 13:17:21.810348 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2041/4014] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:21 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:21.822084 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] HTTP exception thrown: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Request method failure captured: Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 HTTP/1.1 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3O58JGGUnZxGHAm6_R5p9tVrLksML2R97jXPxAJE_IR7TJsrY5g1jQZZ3DXSCo1mj-Q_bLiIP27S36gaVU-huccGmj6pSQaQKC__8iS27eH8f7ZT8bRFnedqtdQ7-1SoishaSsanrDJlEV5aaGgbbpFjmiqPwp40xtnm6Qe6f59f5M Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Openstack-Nova-Api-Version: 2.32 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5c3fdc36fbf645e681d7dd47dfb8ffc0 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TaggedBootDevicesTest-802104728 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c3fdc36fbf645e681d7dd47dfb8ffc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5c3fdc36fbf645e681d7dd47dfb8ffc0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5c3fdc36fbf645e681d7dd47dfb8ffc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c3fdc36fbf645e681d7dd47dfb8ffc0"}]}] Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TaggedBootDevicesTest-802104728 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5c3fdc36fbf645e681d7dd47dfb8ffc0 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TaggedBootDevicesTest-802104728 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TaggedBootDevicesTest-802104728-project Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: d2b54fcd2e6d42e18576f9051c939b41 Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TaggedBootDevicesTest-802104728-project Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '58ba2cb0-d580-4c72-9404-4a05535d6041'} Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:21.825573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:21.833317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:21.833317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:21.833317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:21.833317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:21.833317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:21.833317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. Aug 25 13:17:21.833317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:21.836360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] Returning 404 to user: Instance 58ba2cb0-d580-4c72-9404-4a05535d6041 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:21.838280 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9170be8e-b2b8-43df-a0d9-bc1459fd329b tempest-TaggedBootDevicesTest-802104728 tempest-TaggedBootDevicesTest-802104728-project] 10.222.0.70 "GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041" status: 404 len: 111 microversion: 2.32 time: 0.188997 Aug 25 13:17:21.839255 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1974/4015] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:21 2022] GET /compute/v2.1/servers/58ba2cb0-d580-4c72-9404-4a05535d6041 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:17:21.862080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3926ae61-85b1-42d6-9dfd-35e500048424 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:21.864128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3926ae61-85b1-42d6-9dfd-35e500048424 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:21.877483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3926ae61-85b1-42d6-9dfd-35e500048424 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.878538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3926ae61-85b1-42d6-9dfd-35e500048424 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.879481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3926ae61-85b1-42d6-9dfd-35e500048424 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.881089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3926ae61-85b1-42d6-9dfd-35e500048424 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.882264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3926ae61-85b1-42d6-9dfd-35e500048424 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.883448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3926ae61-85b1-42d6-9dfd-35e500048424 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.989637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-45086b6b-3b96-4ed6-b1b8-8eacde861c63 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:21.994285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-45086b6b-3b96-4ed6-b1b8-8eacde861c63 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:22.030508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45086b6b-3b96-4ed6-b1b8-8eacde861c63 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:22.031909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45086b6b-3b96-4ed6-b1b8-8eacde861c63 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:22.035696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45086b6b-3b96-4ed6-b1b8-8eacde861c63 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:22.038968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45086b6b-3b96-4ed6-b1b8-8eacde861c63 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:22.042738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45086b6b-3b96-4ed6-b1b8-8eacde861c63 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:22.044318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45086b6b-3b96-4ed6-b1b8-8eacde861c63 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:23.080256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3926ae61-85b1-42d6-9dfd-35e500048424 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:23.103101 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3926ae61-85b1-42d6-9dfd-35e500048424 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.250133 Aug 25 13:17:23.103893 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2042/4016] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:21 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:23.133427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a1117a31-bd44-41bb-8138-dd36e3c76cf4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:23.135160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a1117a31-bd44-41bb-8138-dd36e3c76cf4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:23.188305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1117a31-bd44-41bb-8138-dd36e3c76cf4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:23.192351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1117a31-bd44-41bb-8138-dd36e3c76cf4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:23.193280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1117a31-bd44-41bb-8138-dd36e3c76cf4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:23.204574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1117a31-bd44-41bb-8138-dd36e3c76cf4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:23.205750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1117a31-bd44-41bb-8138-dd36e3c76cf4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:23.206609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1117a31-bd44-41bb-8138-dd36e3c76cf4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:23.766651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-45086b6b-3b96-4ed6-b1b8-8eacde861c63 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:23.807418 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-45086b6b-3b96-4ed6-b1b8-8eacde861c63 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1314 microversion: 2.1 time: 1.827303 Aug 25 13:17:23.820175 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1975/4017] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:21 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1314 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:23.838474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2d5fafb7-fd2c-4b36-8656-9ff0ba21dd68 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:23.843760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2d5fafb7-fd2c-4b36-8656-9ff0ba21dd68 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: 2887c73e-00c1-4d5e-856f-f8f6d6266afe] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:23.872794 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-2d5fafb7-fd2c-4b36-8656-9ff0ba21dd68 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 2887c73e-00c1-4d5e-856f-f8f6d6266afe could not be found. Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2d5fafb7-fd2c-4b36-8656-9ff0ba21dd68 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/2887c73e-00c1-4d5e-856f-f8f6d6266afe HTTP/1.1 Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 2887c73e-00c1-4d5e-856f-f8f6d6266afe could not be found. Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '2887c73e-00c1-4d5e-856f-f8f6d6266afe'} Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2887c73e-00c1-4d5e-856f-f8f6d6266afe could not be found. Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2887c73e-00c1-4d5e-856f-f8f6d6266afe could not be found. Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:23.884555 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:23.894378 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:23.894378 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:23.894378 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:23.894378 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:23.894378 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:23.894378 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:23.894378 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2887c73e-00c1-4d5e-856f-f8f6d6266afe could not be found. Aug 25 13:17:23.894378 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:23.907883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2d5fafb7-fd2c-4b36-8656-9ff0ba21dd68 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 2887c73e-00c1-4d5e-856f-f8f6d6266afe could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:23.907883 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2d5fafb7-fd2c-4b36-8656-9ff0ba21dd68 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2887c73e-00c1-4d5e-856f-f8f6d6266afe" status: 404 len: 111 microversion: 2.1 time: 0.076746 Aug 25 13:17:23.907883 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1976/4018] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:17:23 2022] DELETE /compute/v2.1/servers/2887c73e-00c1-4d5e-856f-f8f6d6266afe => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:17:23.933749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e05c520-034a-441b-a819-773cdf33684d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:23.942043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e05c520-034a-441b-a819-773cdf33684d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:23.983099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e05c520-034a-441b-a819-773cdf33684d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:23.995545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e05c520-034a-441b-a819-773cdf33684d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:24.000390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e05c520-034a-441b-a819-773cdf33684d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:24.006568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e05c520-034a-441b-a819-773cdf33684d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:24.011881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e05c520-034a-441b-a819-773cdf33684d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:24.025338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e05c520-034a-441b-a819-773cdf33684d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:24.884662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a1117a31-bd44-41bb-8138-dd36e3c76cf4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:24.920140 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a1117a31-bd44-41bb-8138-dd36e3c76cf4 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1318 microversion: 2.1 time: 1.813560 Aug 25 13:17:24.923589 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2043/4019] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:23 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1318 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:24.957815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29902b23-d282-4773-9cef-1aece508c82b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:24.969416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-29902b23-d282-4773-9cef-1aece508c82b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:25.063787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29902b23-d282-4773-9cef-1aece508c82b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:25.064874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29902b23-d282-4773-9cef-1aece508c82b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:25.071617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29902b23-d282-4773-9cef-1aece508c82b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:25.082930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29902b23-d282-4773-9cef-1aece508c82b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:25.086329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29902b23-d282-4773-9cef-1aece508c82b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:25.089265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29902b23-d282-4773-9cef-1aece508c82b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:25.102639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e05c520-034a-441b-a819-773cdf33684d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:25.123000 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e05c520-034a-441b-a819-773cdf33684d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.205299 Aug 25 13:17:25.125696 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1977/4020] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:23 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:25.171508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-173ea32a-db8a-4c80-aaa4-734578b140c6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:25.178143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-173ea32a-db8a-4c80-aaa4-734578b140c6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:25.217324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-173ea32a-db8a-4c80-aaa4-734578b140c6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:25.222879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-173ea32a-db8a-4c80-aaa4-734578b140c6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:25.228142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-173ea32a-db8a-4c80-aaa4-734578b140c6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:25.230144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-173ea32a-db8a-4c80-aaa4-734578b140c6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:25.234156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-173ea32a-db8a-4c80-aaa4-734578b140c6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:25.237640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-173ea32a-db8a-4c80-aaa4-734578b140c6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:27.370931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-29902b23-d282-4773-9cef-1aece508c82b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:27.443162 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29902b23-d282-4773-9cef-1aece508c82b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1314 microversion: 2.1 time: 2.513206 Aug 25 13:17:27.451815 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2044/4021] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:24 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1314 bytes in 2527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:27.481097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c37dc57-e759-4c5e-8c20-786a672c58ab tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:27.490145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c37dc57-e759-4c5e-8c20-786a672c58ab tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:27.526015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-173ea32a-db8a-4c80-aaa4-734578b140c6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:27.555839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c37dc57-e759-4c5e-8c20-786a672c58ab tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:27.559431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c37dc57-e759-4c5e-8c20-786a672c58ab tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:27.564354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c37dc57-e759-4c5e-8c20-786a672c58ab tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:27.579635 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-173ea32a-db8a-4c80-aaa4-734578b140c6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 2.419358 Aug 25 13:17:27.592265 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1978/4022] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:25 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 2434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:17:27.594164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c37dc57-e759-4c5e-8c20-786a672c58ab tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:27.595771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c37dc57-e759-4c5e-8c20-786a672c58ab tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:27.599894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c37dc57-e759-4c5e-8c20-786a672c58ab tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:27.693353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fd8039a6-b961-4a3d-a302-afe10f930b74 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:27.694544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fd8039a6-b961-4a3d-a302-afe10f930b74 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Failed to fetch instance by id 9223372036854775808 {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 13:17:27.695509 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-fd8039a6-b961-4a3d-a302-afe10f930b74 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fd8039a6-b961-4a3d-a302-afe10f930b74 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 9223372036854775808 could not be found. Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '9223372036854775808'} Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:27.713749 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:27.727773 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:27.727773 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:27.727773 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:27.727773 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 25 13:17:27.727773 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:27.727773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fd8039a6-b961-4a3d-a302-afe10f930b74 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:27.727773 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fd8039a6-b961-4a3d-a302-afe10f930b74 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.085055 Aug 25 13:17:27.738684 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1979/4023] 10.222.0.70 () {58 vars in 1188 bytes} [Thu Aug 25 13:17:27 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:17:27.763219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-763fb17e-e0c7-4f1d-9275-bf8fb2251766 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:27.791144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-763fb17e-e0c7-4f1d-9275-bf8fb2251766 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:27.831267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763fb17e-e0c7-4f1d-9275-bf8fb2251766 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:27.838982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763fb17e-e0c7-4f1d-9275-bf8fb2251766 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:27.846676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763fb17e-e0c7-4f1d-9275-bf8fb2251766 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:27.850592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763fb17e-e0c7-4f1d-9275-bf8fb2251766 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:27.854551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763fb17e-e0c7-4f1d-9275-bf8fb2251766 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:27.860614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763fb17e-e0c7-4f1d-9275-bf8fb2251766 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:28.728483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-763fb17e-e0c7-4f1d-9275-bf8fb2251766 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:28.761715 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-763fb17e-e0c7-4f1d-9275-bf8fb2251766 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.011953 Aug 25 13:17:28.766419 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1980/4024] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:27 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:17:28.786546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-221c0b72-9962-48d2-aeca-edb63d68a9b4 req-5fed590e-50b9-4656-8374-9d6985a176ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7077e0f1-eda0-4e8e-8f81-a64989f35696", "name": "network-vif-plugged", "status": "completed", "tag": "a659e858-0072-4d47-b4ff-36f0aab011f7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:28.834609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-221c0b72-9962-48d2-aeca-edb63d68a9b4 req-5fed590e-50b9-4656-8374-9d6985a176ab service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:28.836361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-221c0b72-9962-48d2-aeca-edb63d68a9b4 req-5fed590e-50b9-4656-8374-9d6985a176ab service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:28.837654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-221c0b72-9962-48d2-aeca-edb63d68a9b4 req-5fed590e-50b9-4656-8374-9d6985a176ab service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:28.899405 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-221c0b72-9962-48d2-aeca-edb63d68a9b4 req-5fed590e-50b9-4656-8374-9d6985a176ab service nova] Creating event network-vif-plugged:a659e858-0072-4d47-b4ff-36f0aab011f7 for instance 7077e0f1-eda0-4e8e-8f81-a64989f35696 on n-h1-852771-8 Aug 25 13:17:28.920567 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-221c0b72-9962-48d2-aeca-edb63d68a9b4 req-5fed590e-50b9-4656-8374-9d6985a176ab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151051 Aug 25 13:17:28.926231 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1981/4025] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:17:28.937780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bdffd843-916b-4e9c-ac42-0badc3df6f7d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:28.939068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bdffd843-916b-4e9c-ac42-0badc3df6f7d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:28.967980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdffd843-916b-4e9c-ac42-0badc3df6f7d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:28.969422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdffd843-916b-4e9c-ac42-0badc3df6f7d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:28.970272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdffd843-916b-4e9c-ac42-0badc3df6f7d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:28.971481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdffd843-916b-4e9c-ac42-0badc3df6f7d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:28.972890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdffd843-916b-4e9c-ac42-0badc3df6f7d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:28.973470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdffd843-916b-4e9c-ac42-0badc3df6f7d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:29.198499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0c37dc57-e759-4c5e-8c20-786a672c58ab tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:29.235317 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c37dc57-e759-4c5e-8c20-786a672c58ab tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1508 microversion: 2.1 time: 1.768929 Aug 25 13:17:29.253130 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2045/4026] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:27 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1508 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:29.283937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6a7e0b9-b0a0-485a-9020-2301bf4e0859 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:29.290793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c6a7e0b9-b0a0-485a-9020-2301bf4e0859 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:29.314363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6a7e0b9-b0a0-485a-9020-2301bf4e0859 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:29.317596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6a7e0b9-b0a0-485a-9020-2301bf4e0859 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:29.322770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6a7e0b9-b0a0-485a-9020-2301bf4e0859 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:29.324640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6a7e0b9-b0a0-485a-9020-2301bf4e0859 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:29.325781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6a7e0b9-b0a0-485a-9020-2301bf4e0859 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:29.327019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6a7e0b9-b0a0-485a-9020-2301bf4e0859 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:30.443732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bdffd843-916b-4e9c-ac42-0badc3df6f7d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:30.481671 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bdffd843-916b-4e9c-ac42-0badc3df6f7d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1314 microversion: 2.1 time: 1.548496 Aug 25 13:17:30.484955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c6a7e0b9-b0a0-485a-9020-2301bf4e0859 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:30.485769 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1982/4027] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:28 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1314 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:30.509825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0ce18e4-06b4-4463-8752-a9cb35e2134a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:30.511026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b0ce18e4-06b4-4463-8752-a9cb35e2134a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:30.532717 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6a7e0b9-b0a0-485a-9020-2301bf4e0859 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.265057 Aug 25 13:17:30.541844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0ce18e4-06b4-4463-8752-a9cb35e2134a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:30.544837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0ce18e4-06b4-4463-8752-a9cb35e2134a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:30.545318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0ce18e4-06b4-4463-8752-a9cb35e2134a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:30.559714 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2046/4028] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:29 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:30.606271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0ce18e4-06b4-4463-8752-a9cb35e2134a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:30.607199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0ce18e4-06b4-4463-8752-a9cb35e2134a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.058s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:30.608145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0ce18e4-06b4-4463-8752-a9cb35e2134a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:30.623997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab97ea65-9a55-40ff-bddf-9ca072f0a77c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:30.630621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ab97ea65-9a55-40ff-bddf-9ca072f0a77c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Failed to fetch instance by id -1 {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 13:17:30.632085 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ab97ea65-9a55-40ff-bddf-9ca072f0a77c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance -1 could not be found. Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab97ea65-9a55-40ff-bddf-9ca072f0a77c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance -1 could not be found. Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '-1'} Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:30.645756 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:30.658024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:30.658024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:30.658024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 25 13:17:30.658024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:30.662216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab97ea65-9a55-40ff-bddf-9ca072f0a77c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance -1 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:30.664204 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ab97ea65-9a55-40ff-bddf-9ca072f0a77c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.056326 Aug 25 13:17:30.665861 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2047/4029] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 13:17:30 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:17:30.718408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0cbe112d-a721-4ff1-9dfd-166673832bad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:30.726874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0cbe112d-a721-4ff1-9dfd-166673832bad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:30.765793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cbe112d-a721-4ff1-9dfd-166673832bad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:30.778417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cbe112d-a721-4ff1-9dfd-166673832bad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:30.799602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cbe112d-a721-4ff1-9dfd-166673832bad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:30.801012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cbe112d-a721-4ff1-9dfd-166673832bad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:30.814669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cbe112d-a721-4ff1-9dfd-166673832bad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:30.815564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0cbe112d-a721-4ff1-9dfd-166673832bad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:30.947741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:31.884858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b0ce18e4-06b4-4463-8752-a9cb35e2134a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:31.950442 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b0ce18e4-06b4-4463-8752-a9cb35e2134a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1508 microversion: 2.1 time: 1.461879 Aug 25 13:17:31.952067 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1983/4030] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:30 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1508 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:32.011694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c31e2e38-d737-432e-a391-88feb690a486 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:32.027613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c31e2e38-d737-432e-a391-88feb690a486 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:32.085675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c31e2e38-d737-432e-a391-88feb690a486 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:32.088049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c31e2e38-d737-432e-a391-88feb690a486 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:32.094939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c31e2e38-d737-432e-a391-88feb690a486 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:32.098172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c31e2e38-d737-432e-a391-88feb690a486 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:32.101944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c31e2e38-d737-432e-a391-88feb690a486 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:32.104476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c31e2e38-d737-432e-a391-88feb690a486 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:32.122614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0cbe112d-a721-4ff1-9dfd-166673832bad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:32.166240 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0cbe112d-a721-4ff1-9dfd-166673832bad tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.491478 Aug 25 13:17:32.176625 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2048/4031] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:30 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:32.188836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-378d4b17-7dfb-4cdb-9318-45d6df3df426 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:32.212971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-378d4b17-7dfb-4cdb-9318-45d6df3df426 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:32.252219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-378d4b17-7dfb-4cdb-9318-45d6df3df426 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:32.253249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-378d4b17-7dfb-4cdb-9318-45d6df3df426 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:32.254260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-378d4b17-7dfb-4cdb-9318-45d6df3df426 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:32.273658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-378d4b17-7dfb-4cdb-9318-45d6df3df426 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:32.274410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-378d4b17-7dfb-4cdb-9318-45d6df3df426 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:32.275069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-378d4b17-7dfb-4cdb-9318-45d6df3df426 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:32.651156 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-378d4b17-7dfb-4cdb-9318-45d6df3df426 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "PUT /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1080 microversion: 2.1 time: 0.481624 Aug 25 13:17:32.681037 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2049/4032] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Aug 25 13:17:32 2022] PUT /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1080 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:32.729373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d8f10b00-e9aa-4e72-a3fa-03da2aed88d7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:32.737060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d8f10b00-e9aa-4e72-a3fa-03da2aed88d7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:32.753434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8f10b00-e9aa-4e72-a3fa-03da2aed88d7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:32.755099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8f10b00-e9aa-4e72-a3fa-03da2aed88d7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:32.756862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8f10b00-e9aa-4e72-a3fa-03da2aed88d7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:32.758661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8f10b00-e9aa-4e72-a3fa-03da2aed88d7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:32.759937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8f10b00-e9aa-4e72-a3fa-03da2aed88d7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:32.761377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8f10b00-e9aa-4e72-a3fa-03da2aed88d7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:33.732048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c31e2e38-d737-432e-a391-88feb690a486 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:33.738453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:33.780136 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c31e2e38-d737-432e-a391-88feb690a486 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1314 microversion: 2.1 time: 1.807346 Aug 25 13:17:33.783486 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1984/4033] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:31 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1314 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:33.813354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7eb50568-a410-4baf-bb1a-ddafbdff9a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:33.815960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7eb50568-a410-4baf-bb1a-ddafbdff9a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:33.848440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb50568-a410-4baf-bb1a-ddafbdff9a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:33.853054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb50568-a410-4baf-bb1a-ddafbdff9a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:33.854562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb50568-a410-4baf-bb1a-ddafbdff9a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:33.862589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb50568-a410-4baf-bb1a-ddafbdff9a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:33.864284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb50568-a410-4baf-bb1a-ddafbdff9a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:33.866764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7eb50568-a410-4baf-bb1a-ddafbdff9a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:34.178030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d8f10b00-e9aa-4e72-a3fa-03da2aed88d7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:34.227707 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d8f10b00-e9aa-4e72-a3fa-03da2aed88d7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.523138 Aug 25 13:17:34.238017 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2050/4034] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:32 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:34.291998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8fff78c6-30e4-4dd2-8e53-24814d1569d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:34.293021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8fff78c6-30e4-4dd2-8e53-24814d1569d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: fa7e0cb4-1777-4280-ae91-fbe66a50ee7d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:34.308775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-8fff78c6-30e4-4dd2-8e53-24814d1569d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance fa7e0cb4-1777-4280-ae91-fbe66a50ee7d could not be found. Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8fff78c6-30e4-4dd2-8e53-24814d1569d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/fa7e0cb4-1777-4280-ae91-fbe66a50ee7d/action HTTP/1.1 Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 19 Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: {"forceDelete": {}} Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance fa7e0cb4-1777-4280-ae91-fbe66a50ee7d could not be found. Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'fa7e0cb4-1777-4280-ae91-fbe66a50ee7d', 'body': {'forceDelete': {}}} Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa7e0cb4-1777-4280-ae91-fbe66a50ee7d could not be found. Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa7e0cb4-1777-4280-ae91-fbe66a50ee7d could not be found. Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:34.320099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:34.333326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:34.333326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:34.333326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa7e0cb4-1777-4280-ae91-fbe66a50ee7d could not be found. Aug 25 13:17:34.333326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:34.333326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8fff78c6-30e4-4dd2-8e53-24814d1569d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance fa7e0cb4-1777-4280-ae91-fbe66a50ee7d could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:34.333326 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8fff78c6-30e4-4dd2-8e53-24814d1569d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/fa7e0cb4-1777-4280-ae91-fbe66a50ee7d/action" status: 404 len: 111 microversion: 2.1 time: 0.048958 Aug 25 13:17:34.333326 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2051/4035] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:17:34 2022] POST /compute/v2.1/servers/fa7e0cb4-1777-4280-ae91-fbe66a50ee7d/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:17:34.356518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-196696ea-b771-4f6b-8b5e-472d7de2a1fe tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:34.357783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-196696ea-b771-4f6b-8b5e-472d7de2a1fe tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:34.385316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-196696ea-b771-4f6b-8b5e-472d7de2a1fe tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:34.392947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-196696ea-b771-4f6b-8b5e-472d7de2a1fe tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:34.393852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-196696ea-b771-4f6b-8b5e-472d7de2a1fe tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:34.395323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-196696ea-b771-4f6b-8b5e-472d7de2a1fe tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:34.396239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-196696ea-b771-4f6b-8b5e-472d7de2a1fe tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:34.397067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-196696ea-b771-4f6b-8b5e-472d7de2a1fe tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:34.644085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7eb50568-a410-4baf-bb1a-ddafbdff9a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:34.690739 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7eb50568-a410-4baf-bb1a-ddafbdff9a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1506 microversion: 2.1 time: 0.903663 Aug 25 13:17:34.696381 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1985/4036] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:33 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1506 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:34.760802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f8bfcfb7-7fc2-4cbd-865f-87368bd29fb3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:34.766115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f8bfcfb7-7fc2-4cbd-865f-87368bd29fb3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:34.800192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8bfcfb7-7fc2-4cbd-865f-87368bd29fb3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:34.801408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8bfcfb7-7fc2-4cbd-865f-87368bd29fb3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:34.806481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8bfcfb7-7fc2-4cbd-865f-87368bd29fb3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:34.813164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8bfcfb7-7fc2-4cbd-865f-87368bd29fb3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:34.821143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8bfcfb7-7fc2-4cbd-865f-87368bd29fb3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:34.823818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8bfcfb7-7fc2-4cbd-865f-87368bd29fb3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:35.799084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-196696ea-b771-4f6b-8b5e-472d7de2a1fe tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:35.855383 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-196696ea-b771-4f6b-8b5e-472d7de2a1fe tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.510129 Aug 25 13:17:35.857583 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2052/4037] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:34 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:35.871950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d35c5de0-5646-4d35-bd3b-e992d26d9635 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:35.874351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d35c5de0-5646-4d35-bd3b-e992d26d9635 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:35.887202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=44 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:35.891372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d35c5de0-5646-4d35-bd3b-e992d26d9635 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:35.892816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d35c5de0-5646-4d35-bd3b-e992d26d9635 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:35.894080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d35c5de0-5646-4d35-bd3b-e992d26d9635 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:35.896296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d35c5de0-5646-4d35-bd3b-e992d26d9635 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:35.899160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d35c5de0-5646-4d35-bd3b-e992d26d9635 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:35.900741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d35c5de0-5646-4d35-bd3b-e992d26d9635 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:36.459548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f8bfcfb7-7fc2-4cbd-865f-87368bd29fb3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:36.491223 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f8bfcfb7-7fc2-4cbd-865f-87368bd29fb3 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1506 microversion: 2.1 time: 1.754784 Aug 25 13:17:36.493394 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1986/4038] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:34 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1506 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:17:36.506302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-40a5cabf-bed5-4877-a7f4-4864e7a47767 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:36.507947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-40a5cabf-bed5-4877-a7f4-4864e7a47767 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:36.526278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40a5cabf-bed5-4877-a7f4-4864e7a47767 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:36.527746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40a5cabf-bed5-4877-a7f4-4864e7a47767 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:36.528963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40a5cabf-bed5-4877-a7f4-4864e7a47767 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:36.532944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40a5cabf-bed5-4877-a7f4-4864e7a47767 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:36.534473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40a5cabf-bed5-4877-a7f4-4864e7a47767 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:36.535822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40a5cabf-bed5-4877-a7f4-4864e7a47767 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:36.589703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d35c5de0-5646-4d35-bd3b-e992d26d9635 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:36.643991 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d35c5de0-5646-4d35-bd3b-e992d26d9635 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1502 microversion: 2.1 time: 0.772657 Aug 25 13:17:36.665257 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2053/4039] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:35 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1502 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:36.720273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b5ffb60-fae4-49d7-8919-ec97e1d0c622 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:36.738375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5b5ffb60-fae4-49d7-8919-ec97e1d0c622 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:36.760081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb60-fae4-49d7-8919-ec97e1d0c622 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:36.761537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb60-fae4-49d7-8919-ec97e1d0c622 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:36.762609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb60-fae4-49d7-8919-ec97e1d0c622 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:36.765945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb60-fae4-49d7-8919-ec97e1d0c622 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:36.767826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb60-fae4-49d7-8919-ec97e1d0c622 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:36.769894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb60-fae4-49d7-8919-ec97e1d0c622 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:37.019419 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b5ffb60-fae4-49d7-8919-ec97e1d0c622 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "PUT /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1082 microversion: 2.1 time: 0.338159 Aug 25 13:17:37.021703 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2054/4040] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Aug 25 13:17:36 2022] PUT /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1082 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:37.036876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-557a98c0-ec0a-424e-b221-1eb3c69a9342 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:37.049786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-557a98c0-ec0a-424e-b221-1eb3c69a9342 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:37.081025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-557a98c0-ec0a-424e-b221-1eb3c69a9342 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:37.082906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-557a98c0-ec0a-424e-b221-1eb3c69a9342 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:37.083983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-557a98c0-ec0a-424e-b221-1eb3c69a9342 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:37.088417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-557a98c0-ec0a-424e-b221-1eb3c69a9342 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:37.089688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-557a98c0-ec0a-424e-b221-1eb3c69a9342 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:37.097751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-557a98c0-ec0a-424e-b221-1eb3c69a9342 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:37.275644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-40a5cabf-bed5-4877-a7f4-4864e7a47767 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:37.348549 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-40a5cabf-bed5-4877-a7f4-4864e7a47767 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.852423 Aug 25 13:17:37.362455 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1987/4041] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:36 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:37.383539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-017acd28-c167-41d2-b24d-4c726bd87c54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:37.385082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-017acd28-c167-41d2-b24d-4c726bd87c54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:37.399206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017acd28-c167-41d2-b24d-4c726bd87c54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:37.400710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017acd28-c167-41d2-b24d-4c726bd87c54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:37.402120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017acd28-c167-41d2-b24d-4c726bd87c54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:37.403696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017acd28-c167-41d2-b24d-4c726bd87c54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:37.404769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017acd28-c167-41d2-b24d-4c726bd87c54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:37.406386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-017acd28-c167-41d2-b24d-4c726bd87c54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:37.564917 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-557a98c0-ec0a-424e-b221-1eb3c69a9342 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696/action" status: 202 len: 0 microversion: 2.1 time: 0.532109 Aug 25 13:17:37.575054 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2055/4042] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:17:37 2022] POST /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:17:37.614922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a83346aa-809d-4e7b-949e-b037bff6c16f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:37.630653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a83346aa-809d-4e7b-949e-b037bff6c16f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: 41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:37.679847 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a83346aa-809d-4e7b-949e-b037bff6c16f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4 could not be found. Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a83346aa-809d-4e7b-949e-b037bff6c16f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4/action HTTP/1.1 Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 39 Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: {"os-getConsoleOutput": {"length": 10}} Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4 could not be found. Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4 could not be found. Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4 could not be found. Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:37.701439 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:37.716307 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:37.716307 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:37.716307 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:37.716307 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:37.716307 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4 could not be found. Aug 25 13:17:37.716307 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:37.716307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a83346aa-809d-4e7b-949e-b037bff6c16f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:37.716307 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a83346aa-809d-4e7b-949e-b037bff6c16f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4/action" status: 404 len: 111 microversion: 2.1 time: 0.129194 Aug 25 13:17:37.720203 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2056/4043] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:17:37 2022] POST /compute/v2.1/servers/41c5ef68-b7f1-4e6d-bdf7-23263aeb90c4/action => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:17:37.761488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43bb468e-2d20-4045-80e3-b86cb82b65ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:37.766318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43bb468e-2d20-4045-80e3-b86cb82b65ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:37.839211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43bb468e-2d20-4045-80e3-b86cb82b65ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:37.840397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43bb468e-2d20-4045-80e3-b86cb82b65ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:37.849631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43bb468e-2d20-4045-80e3-b86cb82b65ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:37.851493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43bb468e-2d20-4045-80e3-b86cb82b65ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:37.852487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43bb468e-2d20-4045-80e3-b86cb82b65ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:37.857288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43bb468e-2d20-4045-80e3-b86cb82b65ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:38.054075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-017acd28-c167-41d2-b24d-4c726bd87c54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:38.101362 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-017acd28-c167-41d2-b24d-4c726bd87c54 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1508 microversion: 2.1 time: 0.745966 Aug 25 13:17:38.105111 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1988/4044] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:37 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1508 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:38.129186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ab0c8edd-6c8e-4dbf-8695-afef1ae255a0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:38.138827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ab0c8edd-6c8e-4dbf-8695-afef1ae255a0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:38.180606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab0c8edd-6c8e-4dbf-8695-afef1ae255a0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:38.181170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab0c8edd-6c8e-4dbf-8695-afef1ae255a0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:38.182604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab0c8edd-6c8e-4dbf-8695-afef1ae255a0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:38.184456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab0c8edd-6c8e-4dbf-8695-afef1ae255a0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:38.185423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab0c8edd-6c8e-4dbf-8695-afef1ae255a0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:38.186417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ab0c8edd-6c8e-4dbf-8695-afef1ae255a0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:38.800237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ab0c8edd-6c8e-4dbf-8695-afef1ae255a0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:38.834350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43bb468e-2d20-4045-80e3-b86cb82b65ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:38.865435 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ab0c8edd-6c8e-4dbf-8695-afef1ae255a0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.758206 Aug 25 13:17:38.876894 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1989/4045] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:38 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:38.883381 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43bb468e-2d20-4045-80e3-b86cb82b65ba tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1507 microversion: 2.1 time: 1.161409 Aug 25 13:17:38.912282 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2057/4046] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:37 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1507 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:38.928036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cc8a0b48-b176-4980-8aba-e847e194d0a8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:38.935384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cc8a0b48-b176-4980-8aba-e847e194d0a8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:38.945097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22f204da-6075-40a8-9622-926fa8c4ef15 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:38.948660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-22f204da-6075-40a8-9622-926fa8c4ef15 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:38.963598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc8a0b48-b176-4980-8aba-e847e194d0a8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:38.971485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc8a0b48-b176-4980-8aba-e847e194d0a8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:38.973463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc8a0b48-b176-4980-8aba-e847e194d0a8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:38.977485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc8a0b48-b176-4980-8aba-e847e194d0a8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:38.979421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc8a0b48-b176-4980-8aba-e847e194d0a8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:38.997814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc8a0b48-b176-4980-8aba-e847e194d0a8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:38.999960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22f204da-6075-40a8-9622-926fa8c4ef15 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:39.002481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22f204da-6075-40a8-9622-926fa8c4ef15 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:39.008447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22f204da-6075-40a8-9622-926fa8c4ef15 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:39.012929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22f204da-6075-40a8-9622-926fa8c4ef15 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:39.019361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22f204da-6075-40a8-9622-926fa8c4ef15 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:39.022172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22f204da-6075-40a8-9622-926fa8c4ef15 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:39.764800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cc8a0b48-b176-4980-8aba-e847e194d0a8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:39.803494 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cc8a0b48-b176-4980-8aba-e847e194d0a8 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1508 microversion: 2.1 time: 0.923816 Aug 25 13:17:39.810176 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1990/4047] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:38 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1508 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:39.850940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a50c77e-1a99-47d6-b85c-04d38d8d2513 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:39.851981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a50c77e-1a99-47d6-b85c-04d38d8d2513 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:39.862937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-22f204da-6075-40a8-9622-926fa8c4ef15 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:39.887722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a50c77e-1a99-47d6-b85c-04d38d8d2513 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:39.888726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a50c77e-1a99-47d6-b85c-04d38d8d2513 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:39.892442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a50c77e-1a99-47d6-b85c-04d38d8d2513 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:39.899322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a50c77e-1a99-47d6-b85c-04d38d8d2513 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:39.901697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a50c77e-1a99-47d6-b85c-04d38d8d2513 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:39.904097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a50c77e-1a99-47d6-b85c-04d38d8d2513 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:39.904356 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22f204da-6075-40a8-9622-926fa8c4ef15 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.977746 Aug 25 13:17:39.929568 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2058/4048] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:38 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:39.959552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7d8eaaed-d859-4c15-b636-32bd9e825056 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:39.972059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7d8eaaed-d859-4c15-b636-32bd9e825056 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:39.980770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a50c77e-1a99-47d6-b85c-04d38d8d2513 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:17:40.025682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d8eaaed-d859-4c15-b636-32bd9e825056 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:40.032060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d8eaaed-d859-4c15-b636-32bd9e825056 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:40.035865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d8eaaed-d859-4c15-b636-32bd9e825056 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:40.042851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d8eaaed-d859-4c15-b636-32bd9e825056 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:40.050269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d8eaaed-d859-4c15-b636-32bd9e825056 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:40.053495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d8eaaed-d859-4c15-b636-32bd9e825056 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:40.521038 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a50c77e-1a99-47d6-b85c-04d38d8d2513 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 204 len: 0 microversion: 2.1 time: 0.668987 Aug 25 13:17:40.525056 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1991/4049] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:17:39 2022] DELETE /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 0 bytes in 684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:17:40.572074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52523a5b-2e61-45a2-b5cd-e643b1719b34 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:40.574296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52523a5b-2e61-45a2-b5cd-e643b1719b34 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: 22548ada-c2e3-4e66-9ca2-b6a94e5e3be8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:40.614726 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-52523a5b-2e61-45a2-b5cd-e643b1719b34 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 22548ada-c2e3-4e66-9ca2-b6a94e5e3be8 could not be found. Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52523a5b-2e61-45a2-b5cd-e643b1719b34 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/22548ada-c2e3-4e66-9ca2-b6a94e5e3be8 HTTP/1.1 Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 22548ada-c2e3-4e66-9ca2-b6a94e5e3be8 could not be found. Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '22548ada-c2e3-4e66-9ca2-b6a94e5e3be8'} Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22548ada-c2e3-4e66-9ca2-b6a94e5e3be8 could not be found. Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22548ada-c2e3-4e66-9ca2-b6a94e5e3be8 could not be found. Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:40.626902 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:40.635905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:40.635905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:40.635905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:40.635905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22548ada-c2e3-4e66-9ca2-b6a94e5e3be8 could not be found. Aug 25 13:17:40.635905 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:40.640519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52523a5b-2e61-45a2-b5cd-e643b1719b34 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 22548ada-c2e3-4e66-9ca2-b6a94e5e3be8 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:40.650464 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52523a5b-2e61-45a2-b5cd-e643b1719b34 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/22548ada-c2e3-4e66-9ca2-b6a94e5e3be8" status: 404 len: 111 microversion: 2.1 time: 0.116904 Aug 25 13:17:40.654318 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1992/4050] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:40 2022] GET /compute/v2.1/servers/22548ada-c2e3-4e66-9ca2-b6a94e5e3be8 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:17:40.685246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:40.686833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:40.709771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:40.711190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:40.712615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:40.714765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:40.716516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:40.721758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:40.785907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7d8eaaed-d859-4c15-b636-32bd9e825056 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:40.820085 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7d8eaaed-d859-4c15-b636-32bd9e825056 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1487 microversion: 2.1 time: 0.884758 Aug 25 13:17:40.836068 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2059/4051] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:39 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1487 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:40.851520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:17:40.868341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f719f068-e8c3-4b32-a21a-bb0709a69150 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:40.870577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f719f068-e8c3-4b32-a21a-bb0709a69150 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:40.887242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f719f068-e8c3-4b32-a21a-bb0709a69150 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:40.888754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f719f068-e8c3-4b32-a21a-bb0709a69150 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:40.891082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f719f068-e8c3-4b32-a21a-bb0709a69150 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:40.892972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f719f068-e8c3-4b32-a21a-bb0709a69150 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:40.895715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f719f068-e8c3-4b32-a21a-bb0709a69150 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:40.897110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f719f068-e8c3-4b32-a21a-bb0709a69150 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:41.163620 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.compute.api [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Instance is already in deleting state, ignoring this request Aug 25 13:17:41.167014 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e3a7cb48-f9f6-403f-b84b-9b4279cb1c5b tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 204 len: 0 microversion: 2.1 time: 0.505175 Aug 25 13:17:41.169399 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1993/4052] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:17:40 2022] DELETE /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:17:41.197100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-71b55f9f-965d-4a5c-b540-395d25a8d495 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:41.199302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-71b55f9f-965d-4a5c-b540-395d25a8d495 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:41.223589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b55f9f-965d-4a5c-b540-395d25a8d495 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:41.225594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b55f9f-965d-4a5c-b540-395d25a8d495 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:41.227741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b55f9f-965d-4a5c-b540-395d25a8d495 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:41.231008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b55f9f-965d-4a5c-b540-395d25a8d495 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:41.234553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b55f9f-965d-4a5c-b540-395d25a8d495 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:41.235879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-71b55f9f-965d-4a5c-b540-395d25a8d495 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:41.363505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-71b55f9f-965d-4a5c-b540-395d25a8d495 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lazy-loading 'flavor' on Instance uuid 7077e0f1-eda0-4e8e-8f81-a64989f35696 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:17:41.555364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f719f068-e8c3-4b32-a21a-bb0709a69150 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:41.598242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f719f068-e8c3-4b32-a21a-bb0709a69150 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.752095 Aug 25 13:17:41.599371 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2060/4053] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:40 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:41.677994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4f5cbd3d-d5f4-474d-90e3-40c367e27096 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:41.685110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4f5cbd3d-d5f4-474d-90e3-40c367e27096 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:41.724636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f5cbd3d-d5f4-474d-90e3-40c367e27096 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:41.732238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f5cbd3d-d5f4-474d-90e3-40c367e27096 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:41.733275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f5cbd3d-d5f4-474d-90e3-40c367e27096 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:41.734901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f5cbd3d-d5f4-474d-90e3-40c367e27096 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:41.735750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f5cbd3d-d5f4-474d-90e3-40c367e27096 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:41.737704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f5cbd3d-d5f4-474d-90e3-40c367e27096 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:42.429820 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-71b55f9f-965d-4a5c-b540-395d25a8d495 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696/action" status: 202 len: 0 microversion: 2.1 time: 1.256665 Aug 25 13:17:42.438328 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1994/4054] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:17:41 2022] POST /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696/action => generated 0 bytes in 1268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:17:42.480399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0920d4b5-b518-453b-8c14-0e09eca5a323 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:42.481930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0920d4b5-b518-453b-8c14-0e09eca5a323 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:42.516313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4f5cbd3d-d5f4-474d-90e3-40c367e27096 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:42.539954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0920d4b5-b518-453b-8c14-0e09eca5a323 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:42.552588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0920d4b5-b518-453b-8c14-0e09eca5a323 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:42.555083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0920d4b5-b518-453b-8c14-0e09eca5a323 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:42.563407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0920d4b5-b518-453b-8c14-0e09eca5a323 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:42.568874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0920d4b5-b518-453b-8c14-0e09eca5a323 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:42.577190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0920d4b5-b518-453b-8c14-0e09eca5a323 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:42.595851 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4f5cbd3d-d5f4-474d-90e3-40c367e27096 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1514 microversion: 2.1 time: 0.960678 Aug 25 13:17:42.637074 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2061/4055] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:41 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1514 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:42.677836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c7ca128-343f-48d6-8fec-7c3f17daf65f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:42.697719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1c7ca128-343f-48d6-8fec-7c3f17daf65f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:42.767468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c7ca128-343f-48d6-8fec-7c3f17daf65f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:42.771260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c7ca128-343f-48d6-8fec-7c3f17daf65f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:42.791314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c7ca128-343f-48d6-8fec-7c3f17daf65f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:42.793179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c7ca128-343f-48d6-8fec-7c3f17daf65f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:42.794356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c7ca128-343f-48d6-8fec-7c3f17daf65f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:42.796357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c7ca128-343f-48d6-8fec-7c3f17daf65f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:43.559290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0920d4b5-b518-453b-8c14-0e09eca5a323 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:43.580847 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0920d4b5-b518-453b-8c14-0e09eca5a323 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.132850 Aug 25 13:17:43.600499 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1995/4056] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:42 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:43.665358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e590d70a-222f-47cf-ae8e-ff1dc694ef80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:43.667637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e590d70a-222f-47cf-ae8e-ff1dc694ef80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:43.706269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e590d70a-222f-47cf-ae8e-ff1dc694ef80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:43.707223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e590d70a-222f-47cf-ae8e-ff1dc694ef80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:43.733369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e590d70a-222f-47cf-ae8e-ff1dc694ef80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:43.746134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e590d70a-222f-47cf-ae8e-ff1dc694ef80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:43.749950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e590d70a-222f-47cf-ae8e-ff1dc694ef80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:43.750858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e590d70a-222f-47cf-ae8e-ff1dc694ef80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:43.808713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1c7ca128-343f-48d6-8fec-7c3f17daf65f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:43.867675 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1c7ca128-343f-48d6-8fec-7c3f17daf65f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1493 microversion: 2.1 time: 1.228500 Aug 25 13:17:43.879232 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2062/4057] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:42 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1493 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:44.183653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b088180-5f95-4ecf-9371-af7bdd153625 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1476323748", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b088180-5f95-4ecf-9371-af7bdd153625 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 238 Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1476323748", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1476323748', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:44.227750 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 25 13:17:44.238528 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:44.244863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b088180-5f95-4ecf-9371-af7bdd153625 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:44.247022 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b088180-5f95-4ecf-9371-af7bdd153625 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.073649 Aug 25 13:17:44.250283 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2063/4058] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:17:44 2022] POST /compute/v2.1/servers => generated 139 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 13:17:44.286205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0745bdcd-7d26-43df-9c88-874be2549a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:44.295645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0745bdcd-7d26-43df-9c88-874be2549a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:44.354749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0745bdcd-7d26-43df-9c88-874be2549a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:44.356499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0745bdcd-7d26-43df-9c88-874be2549a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:44.361144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0745bdcd-7d26-43df-9c88-874be2549a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:44.362988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0745bdcd-7d26-43df-9c88-874be2549a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:44.367596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0745bdcd-7d26-43df-9c88-874be2549a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:44.372493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0745bdcd-7d26-43df-9c88-874be2549a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:45.534742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0745bdcd-7d26-43df-9c88-874be2549a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:45.566585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e590d70a-222f-47cf-ae8e-ff1dc694ef80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:45.590760 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0745bdcd-7d26-43df-9c88-874be2549a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.327290 Aug 25 13:17:45.605464 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e590d70a-222f-47cf-ae8e-ff1dc694ef80 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1514 microversion: 2.1 time: 1.958578 Aug 25 13:17:45.608488 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1996/4060] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:43 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1514 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:45.618311 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2064/4060] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:44 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:17:45.635162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e156c064-d57c-425d-ab15-d8b8fd9811dd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:45.641391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e156c064-d57c-425d-ab15-d8b8fd9811dd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:45.666074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab27a773-c603-4f60-87ba-bbd4b6e0982f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:45.673358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ab27a773-c603-4f60-87ba-bbd4b6e0982f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:45.709588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e156c064-d57c-425d-ab15-d8b8fd9811dd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:45.720102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e156c064-d57c-425d-ab15-d8b8fd9811dd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:45.720943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e156c064-d57c-425d-ab15-d8b8fd9811dd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:45.722405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e156c064-d57c-425d-ab15-d8b8fd9811dd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:45.723332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e156c064-d57c-425d-ab15-d8b8fd9811dd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:45.724168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e156c064-d57c-425d-ab15-d8b8fd9811dd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:45.749694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab27a773-c603-4f60-87ba-bbd4b6e0982f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:45.751281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab27a773-c603-4f60-87ba-bbd4b6e0982f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:45.751979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab27a773-c603-4f60-87ba-bbd4b6e0982f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:45.755917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab27a773-c603-4f60-87ba-bbd4b6e0982f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:45.757395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab27a773-c603-4f60-87ba-bbd4b6e0982f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:45.758672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab27a773-c603-4f60-87ba-bbd4b6e0982f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:45.883033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:45.937577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:46.679449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e156c064-d57c-425d-ab15-d8b8fd9811dd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:46.711252 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e156c064-d57c-425d-ab15-d8b8fd9811dd tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1514 microversion: 2.1 time: 1.098795 Aug 25 13:17:46.719228 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1997/4061] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:45 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1514 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:46.744482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5deae47a-5faf-4541-8a1c-5b75158918ba tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:46.752775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5deae47a-5faf-4541-8a1c-5b75158918ba tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:46.816705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5deae47a-5faf-4541-8a1c-5b75158918ba tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:46.820639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5deae47a-5faf-4541-8a1c-5b75158918ba tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:46.824332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5deae47a-5faf-4541-8a1c-5b75158918ba tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:46.835423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5deae47a-5faf-4541-8a1c-5b75158918ba tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:46.836761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5deae47a-5faf-4541-8a1c-5b75158918ba tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:46.837928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5deae47a-5faf-4541-8a1c-5b75158918ba tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:46.876210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ab27a773-c603-4f60-87ba-bbd4b6e0982f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:46.926269 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ab27a773-c603-4f60-87ba-bbd4b6e0982f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.281633 Aug 25 13:17:46.930238 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2065/4062] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:45 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:47.317948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-855c1026-1735-4f3b-88fb-c38772a44bf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1538760844", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-855c1026-1735-4f3b-88fb-c38772a44bf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 235 Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1538760844", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1538760844', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:47.345697 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 25 13:17:47.365914 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:17:47.380610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-855c1026-1735-4f3b-88fb-c38772a44bf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:47.383567 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-855c1026-1735-4f3b-88fb-c38772a44bf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.076011 Aug 25 13:17:47.385954 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2066/4063] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:17:47 2022] POST /compute/v2.1/servers => generated 133 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 13:17:47.417065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-32bb0d84-b11c-484e-83fd-12dc084bdf64 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:47.418528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-32bb0d84-b11c-484e-83fd-12dc084bdf64 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:47.451555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32bb0d84-b11c-484e-83fd-12dc084bdf64 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:47.454554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32bb0d84-b11c-484e-83fd-12dc084bdf64 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:47.457374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32bb0d84-b11c-484e-83fd-12dc084bdf64 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:47.460057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32bb0d84-b11c-484e-83fd-12dc084bdf64 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:47.463098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32bb0d84-b11c-484e-83fd-12dc084bdf64 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:47.467657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32bb0d84-b11c-484e-83fd-12dc084bdf64 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:47.522439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5deae47a-5faf-4541-8a1c-5b75158918ba tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:47.561359 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5deae47a-5faf-4541-8a1c-5b75158918ba tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1514 microversion: 2.1 time: 0.836662 Aug 25 13:17:47.572859 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1998/4064] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:46 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1514 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:47.772853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f8857dd9-3852-4518-bf42-7f60ef871889 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:47.781672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f8857dd9-3852-4518-bf42-7f60ef871889 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:47.811477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8857dd9-3852-4518-bf42-7f60ef871889 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:47.820229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8857dd9-3852-4518-bf42-7f60ef871889 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:47.828459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8857dd9-3852-4518-bf42-7f60ef871889 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:47.830186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8857dd9-3852-4518-bf42-7f60ef871889 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:47.843831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8857dd9-3852-4518-bf42-7f60ef871889 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:47.845088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f8857dd9-3852-4518-bf42-7f60ef871889 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:48.322423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-32bb0d84-b11c-484e-83fd-12dc084bdf64 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:48.374637 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-32bb0d84-b11c-484e-83fd-12dc084bdf64 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.973855 Aug 25 13:17:48.388139 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2067/4065] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:47 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:48.443422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7ff388b-eba0-4b8d-bfc4-77dbe7f1407e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:48.449764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a7ff388b-eba0-4b8d-bfc4-77dbe7f1407e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:48.475319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ff388b-eba0-4b8d-bfc4-77dbe7f1407e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:48.478681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ff388b-eba0-4b8d-bfc4-77dbe7f1407e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:48.483343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ff388b-eba0-4b8d-bfc4-77dbe7f1407e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:48.487597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ff388b-eba0-4b8d-bfc4-77dbe7f1407e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:48.491748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ff388b-eba0-4b8d-bfc4-77dbe7f1407e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:48.499485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7ff388b-eba0-4b8d-bfc4-77dbe7f1407e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:48.572259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f8857dd9-3852-4518-bf42-7f60ef871889 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:48.632634 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f8857dd9-3852-4518-bf42-7f60ef871889 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1514 microversion: 2.1 time: 0.867947 Aug 25 13:17:48.663546 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 1999/4066] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:47 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1514 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:48.686247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-900c89ce-1d9a-459b-a264-fff4ec8cece7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:48.691267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-900c89ce-1d9a-459b-a264-fff4ec8cece7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:48.706064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-900c89ce-1d9a-459b-a264-fff4ec8cece7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:48.707607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-900c89ce-1d9a-459b-a264-fff4ec8cece7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:48.708943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-900c89ce-1d9a-459b-a264-fff4ec8cece7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:48.711861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-900c89ce-1d9a-459b-a264-fff4ec8cece7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:48.714753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-900c89ce-1d9a-459b-a264-fff4ec8cece7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:48.716260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-900c89ce-1d9a-459b-a264-fff4ec8cece7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:49.152229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-900c89ce-1d9a-459b-a264-fff4ec8cece7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc53ee05ac640d6acf5aea6da0bde26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd978026db2964d8dbc4c511631c892c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:49.261664 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-900c89ce-1d9a-459b-a264-fff4ec8cece7 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 200 len: 1472 microversion: 2.1 time: 0.577657 Aug 25 13:17:49.266127 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2000/4067] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:48 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 1472 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:50.081441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a7ff388b-eba0-4b8d-bfc4-77dbe7f1407e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:50.143106 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a7ff388b-eba0-4b8d-bfc4-77dbe7f1407e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.699701 Aug 25 13:17:50.144955 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2068/4068] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:48 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:50.349423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-bf672f79-86ab-44b2-ac36-348cbffbc293 req-b0d8ba7f-3a52-429f-93c3-e9b64e3b6c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdc93a4-11c5-42fb-a18e-099ac3ad75ab", "name": "network-vif-deleted", "tag": "7cb5f4c0-63ce-414c-b8f2-e4a8360aed9d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:50.394919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:50.442926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-bf672f79-86ab-44b2-ac36-348cbffbc293 req-b0d8ba7f-3a52-429f-93c3-e9b64e3b6c97 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:50.448904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-bf672f79-86ab-44b2-ac36-348cbffbc293 req-b0d8ba7f-3a52-429f-93c3-e9b64e3b6c97 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:50.452945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-bf672f79-86ab-44b2-ac36-348cbffbc293 req-b0d8ba7f-3a52-429f-93c3-e9b64e3b6c97 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:50.523041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aa4e51a9-57ff-4108-99a0-5faa88fc60a7 tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Action: 'create', calling method: .version_select at 0x7f3a2e8bf8b0>, body: {"pool": null} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:50.584492 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-bf672f79-86ab-44b2-ac36-348cbffbc293 req-b0d8ba7f-3a52-429f-93c3-e9b64e3b6c97 service nova] Creating event network-vif-deleted:7cb5f4c0-63ce-414c-b8f2-e4a8360aed9d for instance 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab on n-h2-852771-8 Aug 25 13:17:50.638598 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-bf672f79-86ab-44b2-ac36-348cbffbc293 req-b0d8ba7f-3a52-429f-93c3-e9b64e3b6c97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.352571 Aug 25 13:17:50.649306 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2001/4069] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:17:50.694129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2331bd89-c885-4b68-9fba-d65c055c0f46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:50.697198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2331bd89-c885-4b68-9fba-d65c055c0f46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:50.740248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2331bd89-c885-4b68-9fba-d65c055c0f46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:50.757893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2331bd89-c885-4b68-9fba-d65c055c0f46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:50.767834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2331bd89-c885-4b68-9fba-d65c055c0f46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:50.774464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2331bd89-c885-4b68-9fba-d65c055c0f46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:50.782610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2331bd89-c885-4b68-9fba-d65c055c0f46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:50.788965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2331bd89-c885-4b68-9fba-d65c055c0f46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:52.635366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2331bd89-c885-4b68-9fba-d65c055c0f46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:52.695469 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2331bd89-c885-4b68-9fba-d65c055c0f46 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 2.026243 Aug 25 13:17:52.710188 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2002/4070] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:50 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:52.723978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04ebd63b-f0ca-403d-94b9-03c93c72a659 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:52.726567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-04ebd63b-f0ca-403d-94b9-03c93c72a659 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: 42c8f6d9-8962-4784-861f-d721b1ea0157] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:52.775089 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-04ebd63b-f0ca-403d-94b9-03c93c72a659 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 42c8f6d9-8962-4784-861f-d721b1ea0157 could not be found. Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04ebd63b-f0ca-403d-94b9-03c93c72a659 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/42c8f6d9-8962-4784-861f-d721b1ea0157/action HTTP/1.1 Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 13 Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: {"pause": {}} Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 42c8f6d9-8962-4784-861f-d721b1ea0157 could not be found. Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '42c8f6d9-8962-4784-861f-d721b1ea0157', 'body': {'pause': {}}} Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c8f6d9-8962-4784-861f-d721b1ea0157 could not be found. Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c8f6d9-8962-4784-861f-d721b1ea0157 could not be found. Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:52.790935 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:52.800340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:52.800340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:52.800340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c8f6d9-8962-4784-861f-d721b1ea0157 could not be found. Aug 25 13:17:52.800340 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:52.800340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04ebd63b-f0ca-403d-94b9-03c93c72a659 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 42c8f6d9-8962-4784-861f-d721b1ea0157 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:52.814125 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-04ebd63b-f0ca-403d-94b9-03c93c72a659 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/42c8f6d9-8962-4784-861f-d721b1ea0157/action" status: 404 len: 111 microversion: 2.1 time: 0.090615 Aug 25 13:17:52.821146 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2003/4071] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:17:52 2022] POST /compute/v2.1/servers/42c8f6d9-8962-4784-861f-d721b1ea0157/action => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:17:52.861549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:52.867231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:52.911719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:52.922688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:52.923747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:52.925221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:52.926356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:52.927391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:52.986540 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] HTTP exception thrown: Instance 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab could not be found. Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Request method failure captured: Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab HTTP/1.1 Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3WMSfEiz7tia1eEtQncv5kU6a9r2qwhnNidwj5AA-3DfDRZey4OCBoh7R1uuq8dOUiAHUK_NHQqgKpcKPM8j1ZtSFSPVrOuo7r33sRNQ47AraBrv1Ym7luuBqlqJ4ld509J1ZUSD17m9YzmDLGoEgXcWruOOCHem18hMmMyamQhBso Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d978026db2964d8dbc4c511631c892c2 Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d978026db2964d8dbc4c511631c892c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d978026db2964d8dbc4c511631c892c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d978026db2964d8dbc4c511631c892c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d978026db2964d8dbc4c511631c892c2"}]}] Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d978026db2964d8dbc4c511631c892c2 Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerDiskConfigTestJSON-184357369-project Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1cc53ee05ac640d6acf5aea6da0bde26 Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerDiskConfigTestJSON-184357369-project Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab could not be found. Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7cdc93a4-11c5-42fb-a18e-099ac3ad75ab'} Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab could not be found. Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab could not be found. Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:53.000962 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:53.009123 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:53.009123 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:53.009123 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:53.009123 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:53.009123 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:53.009123 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab could not be found. Aug 25 13:17:53.009123 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:53.011535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Returning 404 to user: Instance 7cdc93a4-11c5-42fb-a18e-099ac3ad75ab could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:53.013769 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3f8e825b-7753-45c8-bcfc-d83080809a1a tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab" status: 404 len: 111 microversion: 2.1 time: 0.189014 Aug 25 13:17:53.015602 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2004/4072] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:52 2022] GET /compute/v2.1/servers/7cdc93a4-11c5-42fb-a18e-099ac3ad75ab => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:17:53.034775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-5438a979-10a9-41e6-b567-61401713effb req-8f5ef21d-29e4-4676-8b46-d145b885c839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7077e0f1-eda0-4e8e-8f81-a64989f35696", "name": "network-vif-plugged", "status": "completed", "tag": "a659e858-0072-4d47-b4ff-36f0aab011f7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:53.072523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5438a979-10a9-41e6-b567-61401713effb req-8f5ef21d-29e4-4676-8b46-d145b885c839 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:53.078591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5438a979-10a9-41e6-b567-61401713effb req-8f5ef21d-29e4-4676-8b46-d145b885c839 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:53.079957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5438a979-10a9-41e6-b567-61401713effb req-8f5ef21d-29e4-4676-8b46-d145b885c839 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:53.133571 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5438a979-10a9-41e6-b567-61401713effb req-8f5ef21d-29e4-4676-8b46-d145b885c839 service nova] Creating event network-vif-plugged:a659e858-0072-4d47-b4ff-36f0aab011f7 for instance 7077e0f1-eda0-4e8e-8f81-a64989f35696 on n-h1-852771-8 Aug 25 13:17:53.179363 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-5438a979-10a9-41e6-b567-61401713effb req-8f5ef21d-29e4-4676-8b46-d145b885c839 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161242 Aug 25 13:17:53.189595 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2005/4073] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:17:53.206872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-355219c6-5714-43e8-9e0f-f690cf4494f1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:53.223014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-355219c6-5714-43e8-9e0f-f690cf4494f1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:53.251852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355219c6-5714-43e8-9e0f-f690cf4494f1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:53.268428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355219c6-5714-43e8-9e0f-f690cf4494f1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:53.269583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355219c6-5714-43e8-9e0f-f690cf4494f1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:53.274249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355219c6-5714-43e8-9e0f-f690cf4494f1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:53.275572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355219c6-5714-43e8-9e0f-f690cf4494f1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:53.276736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-355219c6-5714-43e8-9e0f-f690cf4494f1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:54.948621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-355219c6-5714-43e8-9e0f-f690cf4494f1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:54.990915 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-355219c6-5714-43e8-9e0f-f690cf4494f1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.798795 Aug 25 13:17:55.025791 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2006/4074] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:53 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:55.067434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:55.075286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:55.112982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:55.127245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:55.130669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:55.134319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:55.137327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:55.140790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:55.242208 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] HTTP exception thrown: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Request method failure captured: Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c HTTP/1.1 Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3WMSfEiz7tia1eEtQncv5kU6a9r2qwhnNidwj5AA-3DfDRZey4OCBoh7R1uuq8dOUiAHUK_NHQqgKpcKPM8j1ZtSFSPVrOuo7r33sRNQ47AraBrv1Ym7luuBqlqJ4ld509J1ZUSD17m9YzmDLGoEgXcWruOOCHem18hMmMyamQhBso Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d978026db2964d8dbc4c511631c892c2 Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d978026db2964d8dbc4c511631c892c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d978026db2964d8dbc4c511631c892c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d978026db2964d8dbc4c511631c892c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d978026db2964d8dbc4c511631c892c2"}]}] Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d978026db2964d8dbc4c511631c892c2 Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerDiskConfigTestJSON-184357369-project Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1cc53ee05ac640d6acf5aea6da0bde26 Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerDiskConfigTestJSON-184357369-project Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '09ab7070-d556-43aa-98dc-d78a45fd1b9c'} Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:17:55.254310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. Aug 25 13:17:55.262790 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:17:55.265869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Returning 404 to user: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:17:55.267882 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c5f60cc0-ac28-408d-afe1-999be03fb428 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "DELETE /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 404 len: 111 microversion: 2.1 time: 0.240129 Aug 25 13:17:55.269751 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2007/4075] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:17:55 2022] DELETE /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 111 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:17:55.291209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0a577aac-b37d-471c-b087-fd46d6ab1b66 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:55.296710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0a577aac-b37d-471c-b087-fd46d6ab1b66 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:55.326602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a577aac-b37d-471c-b087-fd46d6ab1b66 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:55.327959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a577aac-b37d-471c-b087-fd46d6ab1b66 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:55.330181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a577aac-b37d-471c-b087-fd46d6ab1b66 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:55.337744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a577aac-b37d-471c-b087-fd46d6ab1b66 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:55.339086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a577aac-b37d-471c-b087-fd46d6ab1b66 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:55.340204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a577aac-b37d-471c-b087-fd46d6ab1b66 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:57.103620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0a577aac-b37d-471c-b087-fd46d6ab1b66 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:57.140473 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0a577aac-b37d-471c-b087-fd46d6ab1b66 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 1.864705 Aug 25 13:17:57.146290 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2008/4076] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:55 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:57.178061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b918cc1e-4213-4bb0-9445-c104cc617639 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:57.182914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b918cc1e-4213-4bb0-9445-c104cc617639 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:57.201794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b918cc1e-4213-4bb0-9445-c104cc617639 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:57.203288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b918cc1e-4213-4bb0-9445-c104cc617639 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:57.204481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b918cc1e-4213-4bb0-9445-c104cc617639 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:57.206382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b918cc1e-4213-4bb0-9445-c104cc617639 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:57.208364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b918cc1e-4213-4bb0-9445-c104cc617639 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:57.209687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b918cc1e-4213-4bb0-9445-c104cc617639 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:58.474811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=27 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:00.087487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b918cc1e-4213-4bb0-9445-c104cc617639 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:00.101179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=14 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:00.130526 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b918cc1e-4213-4bb0-9445-c104cc617639 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 2.979532 Aug 25 13:18:00.144353 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2009/4077] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:57 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 2988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:00.166069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:00.168159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: 09ab7070-d556-43aa-98dc-d78a45fd1b9c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:00.201252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:00.206496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:00.208258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:00.214196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:00.226729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:00.228793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:00.363127 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] HTTP exception thrown: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Request method failure captured: Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c HTTP/1.1 Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3WMSfEiz7tia1eEtQncv5kU6a9r2qwhnNidwj5AA-3DfDRZey4OCBoh7R1uuq8dOUiAHUK_NHQqgKpcKPM8j1ZtSFSPVrOuo7r33sRNQ47AraBrv1Ym7luuBqlqJ4ld509J1ZUSD17m9YzmDLGoEgXcWruOOCHem18hMmMyamQhBso Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d978026db2964d8dbc4c511631c892c2 Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d978026db2964d8dbc4c511631c892c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d978026db2964d8dbc4c511631c892c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d978026db2964d8dbc4c511631c892c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d978026db2964d8dbc4c511631c892c2"}]}] Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d978026db2964d8dbc4c511631c892c2 Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerDiskConfigTestJSON-184357369-project Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1cc53ee05ac640d6acf5aea6da0bde26 Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerDiskConfigTestJSON-184357369-project Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '09ab7070-d556-43aa-98dc-d78a45fd1b9c'} Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:00.376808 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:00.388671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:00.388671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:00.388671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:00.388671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:00.388671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:00.388671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. Aug 25 13:18:00.388671 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:00.388671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Returning 404 to user: Instance 09ab7070-d556-43aa-98dc-d78a45fd1b9c could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:00.390399 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-45bb15d9-16e4-41d2-b5ec-f82924f037d9 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c" status: 404 len: 111 microversion: 2.1 time: 0.250049 Aug 25 13:18:00.404339 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2010/4078] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:00 2022] GET /compute/v2.1/servers/09ab7070-d556-43aa-98dc-d78a45fd1b9c => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:18:00.437389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c90dac10-3aaa-43aa-ba5f-d9954a7adee0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:00.438534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c90dac10-3aaa-43aa-ba5f-d9954a7adee0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:00.501020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c90dac10-3aaa-43aa-ba5f-d9954a7adee0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:00.518540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c90dac10-3aaa-43aa-ba5f-d9954a7adee0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:00.519782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c90dac10-3aaa-43aa-ba5f-d9954a7adee0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:00.525973 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aa4e51a9-57ff-4108-99a0-5faa88fc60a7 tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 10.378511 Aug 25 13:18:00.533846 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2069/4079] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 13:17:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 10381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:18:00.534523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c90dac10-3aaa-43aa-ba5f-d9954a7adee0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:00.534523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c90dac10-3aaa-43aa-ba5f-d9954a7adee0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:00.534523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c90dac10-3aaa-43aa-ba5f-d9954a7adee0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:00.572584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e75084a9-d8c6-4dbc-8d3d-7568a9676ec5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:00.580489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e75084a9-d8c6-4dbc-8d3d-7568a9676ec5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:00.619503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e75084a9-d8c6-4dbc-8d3d-7568a9676ec5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:00.628260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e75084a9-d8c6-4dbc-8d3d-7568a9676ec5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:00.629582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e75084a9-d8c6-4dbc-8d3d-7568a9676ec5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:00.632576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e75084a9-d8c6-4dbc-8d3d-7568a9676ec5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:00.635123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e75084a9-d8c6-4dbc-8d3d-7568a9676ec5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:00.636149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e75084a9-d8c6-4dbc-8d3d-7568a9676ec5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:01.266151 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e75084a9-d8c6-4dbc-8d3d-7568a9676ec5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 202 len: 0 microversion: 2.1 time: 0.715203 Aug 25 13:18:01.271765 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2070/4080] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:00 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:18:01.364979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:01.374683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:01.450027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:01.471583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:01.472418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:01.489642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:01.497627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:01.503495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:01.747341 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] HTTP exception thrown: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Request method failure captured: Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 HTTP/1.1 Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3WMSfEiz7tia1eEtQncv5kU6a9r2qwhnNidwj5AA-3DfDRZey4OCBoh7R1uuq8dOUiAHUK_NHQqgKpcKPM8j1ZtSFSPVrOuo7r33sRNQ47AraBrv1Ym7luuBqlqJ4ld509J1ZUSD17m9YzmDLGoEgXcWruOOCHem18hMmMyamQhBso Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: d978026db2964d8dbc4c511631c892c2 Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d978026db2964d8dbc4c511631c892c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d978026db2964d8dbc4c511631c892c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d978026db2964d8dbc4c511631c892c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d978026db2964d8dbc4c511631c892c2"}]}] Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: d978026db2964d8dbc4c511631c892c2 Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerDiskConfigTestJSON-184357369-project Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1cc53ee05ac640d6acf5aea6da0bde26 Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerDiskConfigTestJSON-184357369-project Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7'} Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:18:01.760141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. Aug 25 13:18:01.772327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:01.782035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Returning 404 to user: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:01.792166 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d11b3e9b-92b0-413c-ab23-8f10da6be425 tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 404 len: 111 microversion: 2.1 time: 0.515052 Aug 25 13:18:01.795915 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2071/4081] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:18:01 2022] DELETE /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 111 bytes in 523 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:18:01.813975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-267a0d63-a400-4a33-a5d3-d74c4bbc783d tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Action: 'create', calling method: .version_select at 0x7f3a2aac7af0>, body: {"pool": null} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:02.628624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c90dac10-3aaa-43aa-ba5f-d9954a7adee0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:02.658530 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c90dac10-3aaa-43aa-ba5f-d9954a7adee0 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 2.242498 Aug 25 13:18:02.674121 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2011/4082] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:00 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:02.692981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f2adc458-4ed9-4201-87dd-4f52b053abd8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:02.706501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f2adc458-4ed9-4201-87dd-4f52b053abd8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:02.748584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2adc458-4ed9-4201-87dd-4f52b053abd8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:02.749488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2adc458-4ed9-4201-87dd-4f52b053abd8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:02.750355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2adc458-4ed9-4201-87dd-4f52b053abd8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:02.751715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2adc458-4ed9-4201-87dd-4f52b053abd8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:02.752579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2adc458-4ed9-4201-87dd-4f52b053abd8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:02.769841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2adc458-4ed9-4201-87dd-4f52b053abd8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:03.555167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f2adc458-4ed9-4201-87dd-4f52b053abd8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:03.627497 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f2adc458-4ed9-4201-87dd-4f52b053abd8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1490 microversion: 2.1 time: 0.939978 Aug 25 13:18:03.638784 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2012/4083] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:02 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1490 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:03.679539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:03.681183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] [instance: a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:03.726019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:03.729605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:03.732365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:03.737296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:03.738262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:03.739114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:03.844305 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] HTTP exception thrown: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Request method failure captured: Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 HTTP/1.1 Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3WMSfEiz7tia1eEtQncv5kU6a9r2qwhnNidwj5AA-3DfDRZey4OCBoh7R1uuq8dOUiAHUK_NHQqgKpcKPM8j1ZtSFSPVrOuo7r33sRNQ47AraBrv1Ym7luuBqlqJ4ld509J1ZUSD17m9YzmDLGoEgXcWruOOCHem18hMmMyamQhBso Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: d978026db2964d8dbc4c511631c892c2 Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d978026db2964d8dbc4c511631c892c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d978026db2964d8dbc4c511631c892c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d978026db2964d8dbc4c511631c892c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d978026db2964d8dbc4c511631c892c2"}]}] Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: d978026db2964d8dbc4c511631c892c2 Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-184357369 Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerDiskConfigTestJSON-184357369-project Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1cc53ee05ac640d6acf5aea6da0bde26 Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerDiskConfigTestJSON-184357369-project Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7'} Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:03.850819 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:03.860674 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:03.860674 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:03.860674 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:03.860674 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:03.860674 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:03.860674 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. Aug 25 13:18:03.860674 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:03.863692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] Returning 404 to user: Instance a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:03.869935 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bd2e69cd-5e30-49ed-ac60-58aff16b1fcc tempest-ServerDiskConfigTestJSON-184357369 tempest-ServerDiskConfigTestJSON-184357369-project] 10.222.0.70 "GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7" status: 404 len: 111 microversion: 2.1 time: 0.221701 Aug 25 13:18:03.882107 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2013/4084] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:03 2022] GET /compute/v2.1/servers/a9b9fe28-ccbb-46a2-a48b-ebf233c5ffe7 => generated 111 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:18:03.914174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:03.918606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:03.976613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:03.977548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:03.993647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:03.996055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:03.997972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:03.999099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:04.118183 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Cannot 'pause' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state paused Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action HTTP/1.1 Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 13 Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: {"pause": {}} Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: exception: Cannot 'pause' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state paused Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'cc6362fd-0197-4636-8a8d-6814ba103aed', 'body': {'pause': {}}} Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc6362fd-0197-4636-8a8d-6814ba103aed in vm_state paused. Cannot pause while the instance is in this state. Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state paused Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:04.122389 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:04.143899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:04.143899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:04.143899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:04.143899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state paused Aug 25 13:18:04.143899 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:04.147269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 409 to user: Cannot 'pause' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state paused {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:04.159399 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b28fcab4-5bed-4a96-9a3b-665bde103de4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 409 len: 143 microversion: 2.1 time: 0.268405 Aug 25 13:18:04.160911 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2014/4085] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:03 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 143 bytes in 278 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:18:04.184367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-731f9bb5-5be4-4a81-bc20-bcb9bb9e22c4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:04.187220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-731f9bb5-5be4-4a81-bc20-bcb9bb9e22c4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:04.204266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731f9bb5-5be4-4a81-bc20-bcb9bb9e22c4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:04.206290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731f9bb5-5be4-4a81-bc20-bcb9bb9e22c4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:04.208037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731f9bb5-5be4-4a81-bc20-bcb9bb9e22c4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:04.209993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731f9bb5-5be4-4a81-bc20-bcb9bb9e22c4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:04.211716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731f9bb5-5be4-4a81-bc20-bcb9bb9e22c4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:04.217147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731f9bb5-5be4-4a81-bc20-bcb9bb9e22c4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:05.226648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-731f9bb5-5be4-4a81-bc20-bcb9bb9e22c4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:05.282567 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-731f9bb5-5be4-4a81-bc20-bcb9bb9e22c4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 1.095302 Aug 25 13:18:05.286375 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2015/4086] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:04 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:05.307955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-24ae3675-0c63-4e95-b150-ec2ff22e30c2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:05.309090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-24ae3675-0c63-4e95-b150-ec2ff22e30c2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:05.366617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24ae3675-0c63-4e95-b150-ec2ff22e30c2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:05.368021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24ae3675-0c63-4e95-b150-ec2ff22e30c2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:05.370376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24ae3675-0c63-4e95-b150-ec2ff22e30c2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:05.374669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24ae3675-0c63-4e95-b150-ec2ff22e30c2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:05.380887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24ae3675-0c63-4e95-b150-ec2ff22e30c2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:05.388652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24ae3675-0c63-4e95-b150-ec2ff22e30c2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:05.778771 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-24ae3675-0c63-4e95-b150-ec2ff22e30c2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 202 len: 0 microversion: 2.1 time: 0.488053 Aug 25 13:18:05.789378 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2016/4087] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:05 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:18:05.802568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10f26b78-a8b7-4de2-988c-7ab54a6a3318 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:05.804044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-10f26b78-a8b7-4de2-988c-7ab54a6a3318 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:05.819430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f26b78-a8b7-4de2-988c-7ab54a6a3318 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:05.821990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f26b78-a8b7-4de2-988c-7ab54a6a3318 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:05.822591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f26b78-a8b7-4de2-988c-7ab54a6a3318 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:05.825327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f26b78-a8b7-4de2-988c-7ab54a6a3318 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:05.826568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f26b78-a8b7-4de2-988c-7ab54a6a3318 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:05.827760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f26b78-a8b7-4de2-988c-7ab54a6a3318 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:06.836659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10f26b78-a8b7-4de2-988c-7ab54a6a3318 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:06.868779 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-10f26b78-a8b7-4de2-988c-7ab54a6a3318 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1497 microversion: 2.1 time: 1.076746 Aug 25 13:18:06.872920 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2017/4088] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:05 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1497 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:06.895191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ef9f48c-e304-465b-b5d1-36b5622cb72e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:06.903625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5ef9f48c-e304-465b-b5d1-36b5622cb72e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:06.925589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ef9f48c-e304-465b-b5d1-36b5622cb72e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:06.930581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ef9f48c-e304-465b-b5d1-36b5622cb72e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:06.931830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ef9f48c-e304-465b-b5d1-36b5622cb72e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:06.942666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ef9f48c-e304-465b-b5d1-36b5622cb72e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:06.944075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ef9f48c-e304-465b-b5d1-36b5622cb72e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:06.945142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5ef9f48c-e304-465b-b5d1-36b5622cb72e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:07.024750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:07.450597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5ef9f48c-e304-465b-b5d1-36b5622cb72e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:07.486729 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ef9f48c-e304-465b-b5d1-36b5622cb72e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 0.606715 Aug 25 13:18:07.490556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2018/4089] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:06 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:07.927815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d64bd7c7-728a-42ad-a292-66c5c41f5f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:07.935794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d64bd7c7-728a-42ad-a292-66c5c41f5f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:07.992008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d64bd7c7-728a-42ad-a292-66c5c41f5f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:07.992979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d64bd7c7-728a-42ad-a292-66c5c41f5f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:07.993885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d64bd7c7-728a-42ad-a292-66c5c41f5f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:07.999135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d64bd7c7-728a-42ad-a292-66c5c41f5f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:08.000136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d64bd7c7-728a-42ad-a292-66c5c41f5f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:08.000917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d64bd7c7-728a-42ad-a292-66c5c41f5f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:08.330679 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-267a0d63-a400-4a33-a5d3-d74c4bbc783d tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.532040 Aug 25 13:18:08.333776 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2072/4090] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 13:18:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:18:08.356493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae55ec4f-95b0-4c73-a472-5b9f28482567 tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Action: 'create', calling method: .version_select at 0x7f3a2e8bfe50>, body: {"pool": null} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:08.804217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d64bd7c7-728a-42ad-a292-66c5c41f5f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:08.838852 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d64bd7c7-728a-42ad-a292-66c5c41f5f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.918013 Aug 25 13:18:08.840763 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2019/4091] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:07 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:08.850272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a9f14270-ad7c-4e25-91ef-1f779141f957 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:08.858582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a9f14270-ad7c-4e25-91ef-1f779141f957 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:08.882155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f14270-ad7c-4e25-91ef-1f779141f957 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:08.891672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f14270-ad7c-4e25-91ef-1f779141f957 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:08.892886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f14270-ad7c-4e25-91ef-1f779141f957 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:08.894695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f14270-ad7c-4e25-91ef-1f779141f957 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:08.896027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f14270-ad7c-4e25-91ef-1f779141f957 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:08.897244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f14270-ad7c-4e25-91ef-1f779141f957 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:09.465333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9f14270-ad7c-4e25-91ef-1f779141f957 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:09.500481 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a9f14270-ad7c-4e25-91ef-1f779141f957 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 0.653095 Aug 25 13:18:09.502654 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2020/4092] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:08 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:09.522198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-182b65af-ec67-406a-b17f-f89ad1a2faf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:09.530378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-182b65af-ec67-406a-b17f-f89ad1a2faf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:09.553900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-182b65af-ec67-406a-b17f-f89ad1a2faf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:09.558772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-182b65af-ec67-406a-b17f-f89ad1a2faf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:09.561671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-182b65af-ec67-406a-b17f-f89ad1a2faf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:09.566274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-182b65af-ec67-406a-b17f-f89ad1a2faf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:09.571979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-182b65af-ec67-406a-b17f-f89ad1a2faf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:09.573546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-182b65af-ec67-406a-b17f-f89ad1a2faf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:10.835773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-182b65af-ec67-406a-b17f-f89ad1a2faf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:10.872991 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-182b65af-ec67-406a-b17f-f89ad1a2faf3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.366906 Aug 25 13:18:10.880547 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2021/4093] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:09 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:10.909875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d1f6f98-41b5-48bb-a828-a35d752e7b08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:10.911602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4d1f6f98-41b5-48bb-a828-a35d752e7b08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:10.948074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d1f6f98-41b5-48bb-a828-a35d752e7b08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:10.949829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d1f6f98-41b5-48bb-a828-a35d752e7b08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:10.951112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d1f6f98-41b5-48bb-a828-a35d752e7b08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:10.953418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d1f6f98-41b5-48bb-a828-a35d752e7b08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:10.954625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d1f6f98-41b5-48bb-a828-a35d752e7b08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:10.955749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d1f6f98-41b5-48bb-a828-a35d752e7b08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:11.449796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:11.708671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4d1f6f98-41b5-48bb-a828-a35d752e7b08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:11.732399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:11.785034 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4d1f6f98-41b5-48bb-a828-a35d752e7b08 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 0.896337 Aug 25 13:18:11.810050 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2022/4094] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:10 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:11.852643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:11.868749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:11.903002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:11.906812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:11.909729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:11.911155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:11.924019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:11.927016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:12.023028 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1/action HTTP/1.1 Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 28 Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: {"reboot": {"type": "SOFT"}} Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'c5304090-4e5b-4154-b954-a46f3b514bd1', 'body': {'reboot': {'type': 'SOFT'}}} Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:18:12.037027 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:12.048243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:12.049321 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a4c1f4e3-4458-4e08-b650-905a2c2ba730 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1/action" status: 404 len: 111 microversion: 2.1 time: 0.221010 Aug 25 13:18:12.059675 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2023/4095] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:11 2022] POST /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1/action => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:18:12.085456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a63b624c-e05f-432c-9c15-afd1c796f450 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:12.091653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a63b624c-e05f-432c-9c15-afd1c796f450 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:12.122069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a63b624c-e05f-432c-9c15-afd1c796f450 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:12.125012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a63b624c-e05f-432c-9c15-afd1c796f450 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:12.129963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a63b624c-e05f-432c-9c15-afd1c796f450 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:12.134548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a63b624c-e05f-432c-9c15-afd1c796f450 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:12.135526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a63b624c-e05f-432c-9c15-afd1c796f450 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:12.136881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a63b624c-e05f-432c-9c15-afd1c796f450 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:13.447178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a63b624c-e05f-432c-9c15-afd1c796f450 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:13.476601 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a63b624c-e05f-432c-9c15-afd1c796f450 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.412307 Aug 25 13:18:13.478274 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2024/4096] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:12 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:13.490976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ded5daf5-e778-4867-a084-ad3c6b0581d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:13.495158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ded5daf5-e778-4867-a084-ad3c6b0581d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:13.526580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ded5daf5-e778-4867-a084-ad3c6b0581d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:13.530306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ded5daf5-e778-4867-a084-ad3c6b0581d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:13.536028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ded5daf5-e778-4867-a084-ad3c6b0581d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:13.539324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ded5daf5-e778-4867-a084-ad3c6b0581d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:13.546717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ded5daf5-e778-4867-a084-ad3c6b0581d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:13.565773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ded5daf5-e778-4867-a084-ad3c6b0581d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:13.929683 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ae55ec4f-95b0-4c73-a472-5b9f28482567 tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.581751 Aug 25 13:18:13.946014 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2073/4097] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 13:18:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:18:13.959754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5cd040e-2626-4d69-b408-94a18a179825 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:13.967788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b5cd040e-2626-4d69-b408-94a18a179825 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:14.002084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5cd040e-2626-4d69-b408-94a18a179825 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:14.005051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5cd040e-2626-4d69-b408-94a18a179825 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:14.012914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5cd040e-2626-4d69-b408-94a18a179825 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:14.025573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5cd040e-2626-4d69-b408-94a18a179825 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:14.027129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5cd040e-2626-4d69-b408-94a18a179825 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:14.028294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5cd040e-2626-4d69-b408-94a18a179825 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:14.499385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ded5daf5-e778-4867-a084-ad3c6b0581d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:14.533586 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ded5daf5-e778-4867-a084-ad3c6b0581d1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 1.052945 Aug 25 13:18:14.540109 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2025/4098] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:13 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:14.562198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d8275ff1-11b1-4af1-ae81-5b0086603a8c tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Action: 'create', calling method: .version_select at 0x7f3a2991fdc0>, body: {"pool": null} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:14.614797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b5cd040e-2626-4d69-b408-94a18a179825 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:14.647838 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b5cd040e-2626-4d69-b408-94a18a179825 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.699782 Aug 25 13:18:14.666014 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2074/4099] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:13 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:14.695008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d0942bd4-56d5-4307-a362-f736842e8550 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:14.730820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d0942bd4-56d5-4307-a362-f736842e8550 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: dc9da7f8-c2b7-42ad-bfa2-e59899570830] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:14.773418 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-d0942bd4-56d5-4307-a362-f736842e8550 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance dc9da7f8-c2b7-42ad-bfa2-e59899570830 could not be found. Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d0942bd4-56d5-4307-a362-f736842e8550 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/dc9da7f8-c2b7-42ad-bfa2-e59899570830/action HTTP/1.1 Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 28 Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: {"reboot": {"type": "SOFT"}} Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance dc9da7f8-c2b7-42ad-bfa2-e59899570830 could not be found. Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'dc9da7f8-c2b7-42ad-bfa2-e59899570830', 'body': {'reboot': {'type': 'SOFT'}}} Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc9da7f8-c2b7-42ad-bfa2-e59899570830 could not be found. Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc9da7f8-c2b7-42ad-bfa2-e59899570830 could not be found. Aug 25 13:18:14.802258 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc9da7f8-c2b7-42ad-bfa2-e59899570830 could not be found. Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d0942bd4-56d5-4307-a362-f736842e8550 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance dc9da7f8-c2b7-42ad-bfa2-e59899570830 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:14.820020 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d0942bd4-56d5-4307-a362-f736842e8550 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/dc9da7f8-c2b7-42ad-bfa2-e59899570830/action" status: 404 len: 111 microversion: 2.1 time: 0.131009 Aug 25 13:18:14.824606 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2075/4100] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:14 2022] POST /compute/v2.1/servers/dc9da7f8-c2b7-42ad-bfa2-e59899570830/action => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:18:14.852226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-100bc6b9-149b-4770-abca-8359d56b7827 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:14.854023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-100bc6b9-149b-4770-abca-8359d56b7827 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:14.871328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-100bc6b9-149b-4770-abca-8359d56b7827 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:14.872868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-100bc6b9-149b-4770-abca-8359d56b7827 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:14.874210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-100bc6b9-149b-4770-abca-8359d56b7827 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:14.876049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-100bc6b9-149b-4770-abca-8359d56b7827 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:14.879397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-100bc6b9-149b-4770-abca-8359d56b7827 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:14.881052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-100bc6b9-149b-4770-abca-8359d56b7827 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:15.618872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-100bc6b9-149b-4770-abca-8359d56b7827 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:15.645558 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-100bc6b9-149b-4770-abca-8359d56b7827 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.804316 Aug 25 13:18:15.697823 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2076/4101] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:14 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:15.719848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6db2e3b0-8a42-42cc-af18-42929bcea3b7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:15.727085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6db2e3b0-8a42-42cc-af18-42929bcea3b7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:15.776039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6db2e3b0-8a42-42cc-af18-42929bcea3b7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:15.799025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6db2e3b0-8a42-42cc-af18-42929bcea3b7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:15.799920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6db2e3b0-8a42-42cc-af18-42929bcea3b7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:15.801350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6db2e3b0-8a42-42cc-af18-42929bcea3b7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:15.806879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6db2e3b0-8a42-42cc-af18-42929bcea3b7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:15.820526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6db2e3b0-8a42-42cc-af18-42929bcea3b7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:18.404336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6db2e3b0-8a42-42cc-af18-42929bcea3b7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:18.454875 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6db2e3b0-8a42-42cc-af18-42929bcea3b7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 2.754863 Aug 25 13:18:18.455959 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2077/4102] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:15 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 2758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:18.503484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c7340326-f0ce-448b-b86b-86965d05168a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:18.505417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c7340326-f0ce-448b-b86b-86965d05168a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:18.525450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7340326-f0ce-448b-b86b-86965d05168a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:18.531281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7340326-f0ce-448b-b86b-86965d05168a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:18.532207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7340326-f0ce-448b-b86b-86965d05168a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:18.533250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7340326-f0ce-448b-b86b-86965d05168a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:18.534153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7340326-f0ce-448b-b86b-86965d05168a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:18.536610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7340326-f0ce-448b-b86b-86965d05168a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:19.033281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c7340326-f0ce-448b-b86b-86965d05168a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:19.065914 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c7340326-f0ce-448b-b86b-86965d05168a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.582015 Aug 25 13:18:19.068485 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2078/4103] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:18 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:19.121702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:19.137523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:19.178177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:19.179224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:19.180457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:19.184169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:19.186547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:19.189635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:19.282180 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1/action HTTP/1.1 Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 65 Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'c5304090-4e5b-4154-b954-a46f3b514bd1', 'body': {'rebuild': {'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca'}}} Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 25 13:18:19.288608 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:18:19.298006 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:19.304770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:19.315064 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4a846970-9483-400f-b869-ac57a43c283c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1/action" status: 404 len: 111 microversion: 2.1 time: 0.210726 Aug 25 13:18:19.317651 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2079/4104] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:19 2022] POST /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1/action => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:18:19.339084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a9fc34d-8aa5-42e5-aa37-cf40d967112d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:19.344606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a9fc34d-8aa5-42e5-aa37-cf40d967112d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:19.376707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fc34d-8aa5-42e5-aa37-cf40d967112d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:19.380104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fc34d-8aa5-42e5-aa37-cf40d967112d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:19.381066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fc34d-8aa5-42e5-aa37-cf40d967112d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:19.385280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fc34d-8aa5-42e5-aa37-cf40d967112d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:19.390595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fc34d-8aa5-42e5-aa37-cf40d967112d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:19.391725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fc34d-8aa5-42e5-aa37-cf40d967112d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:21.145738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a9fc34d-8aa5-42e5-aa37-cf40d967112d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:21.183499 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a9fc34d-8aa5-42e5-aa37-cf40d967112d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.858308 Aug 25 13:18:21.186782 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2080/4105] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:19 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:18:21.208683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-37d2771d-15ad-4bc3-a15e-864619741af7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:21.210574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-37d2771d-15ad-4bc3-a15e-864619741af7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:21.253898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37d2771d-15ad-4bc3-a15e-864619741af7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:21.262905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37d2771d-15ad-4bc3-a15e-864619741af7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:21.263931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37d2771d-15ad-4bc3-a15e-864619741af7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:21.265320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37d2771d-15ad-4bc3-a15e-864619741af7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:21.286032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37d2771d-15ad-4bc3-a15e-864619741af7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:21.290524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37d2771d-15ad-4bc3-a15e-864619741af7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:23.025182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-37d2771d-15ad-4bc3-a15e-864619741af7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:23.055338 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-37d2771d-15ad-4bc3-a15e-864619741af7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 1.866450 Aug 25 13:18:23.070264 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2081/4106] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:21 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:23.097815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fea2023f-b390-4ce7-af04-3be10047e2e3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:23.098146 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d8275ff1-11b1-4af1-ae81-5b0086603a8c tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.555280 Aug 25 13:18:23.099776 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2026/4107] 10.222.0.70 () {60 vars in 1170 bytes} [Thu Aug 25 13:18:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:18:23.100984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fea2023f-b390-4ce7-af04-3be10047e2e3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:23.116581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fea2023f-b390-4ce7-af04-3be10047e2e3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:23.118624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fea2023f-b390-4ce7-af04-3be10047e2e3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:23.120014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fea2023f-b390-4ce7-af04-3be10047e2e3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:23.121830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fea2023f-b390-4ce7-af04-3be10047e2e3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:23.123315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fea2023f-b390-4ce7-af04-3be10047e2e3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:23.124571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fea2023f-b390-4ce7-af04-3be10047e2e3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:23.126547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb0c7f80-6c9d-446d-897a-acc7a71c409c tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Calling method '.version_select at 0x7f3a2a093ca0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:23.534171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=49 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:23.988544 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb0c7f80-6c9d-446d-897a-acc7a71c409c tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/e9382d76-8cdf-4864-865b-fc93007d8187" status: 200 len: 142 microversion: 2.1 time: 0.870666 Aug 25 13:18:23.990986 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2027/4108] 10.222.0.70 () {58 vars in 1260 bytes} [Thu Aug 25 13:18:23 2022] GET /compute/v2.1/os-floating-ips/e9382d76-8cdf-4864-865b-fc93007d8187 => generated 142 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:18:24.019235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3e75ae62-9efe-488f-821f-b04a38996515 tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Calling method '.version_select at 0x7f3a2e8314c0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:24.508451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=41 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:24.846955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fea2023f-b390-4ce7-af04-3be10047e2e3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:24.908465 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fea2023f-b390-4ce7-af04-3be10047e2e3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.835620 Aug 25 13:18:24.924587 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2082/4109] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:23 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:24.945642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e5d2e26a-6cde-49fb-9a55-4ebfb917c9a3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:24.962489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e5d2e26a-6cde-49fb-9a55-4ebfb917c9a3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:24.994534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d2e26a-6cde-49fb-9a55-4ebfb917c9a3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:25.001648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d2e26a-6cde-49fb-9a55-4ebfb917c9a3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:25.004724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d2e26a-6cde-49fb-9a55-4ebfb917c9a3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:25.018286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d2e26a-6cde-49fb-9a55-4ebfb917c9a3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:25.019405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d2e26a-6cde-49fb-9a55-4ebfb917c9a3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:25.020349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d2e26a-6cde-49fb-9a55-4ebfb917c9a3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:26.514247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e5d2e26a-6cde-49fb-9a55-4ebfb917c9a3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:26.561920 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e5d2e26a-6cde-49fb-9a55-4ebfb917c9a3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 1.634951 Aug 25 13:18:26.593758 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2083/4110] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:24 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:26.631416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-403844f8-9a06-49f2-97ad-49220aefb8b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:26.676498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-403844f8-9a06-49f2-97ad-49220aefb8b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: 7492aad7-10fd-4a51-88db-37010c04e983] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:26.718726 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-403844f8-9a06-49f2-97ad-49220aefb8b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 7492aad7-10fd-4a51-88db-37010c04e983 could not be found. Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-403844f8-9a06-49f2-97ad-49220aefb8b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/7492aad7-10fd-4a51-88db-37010c04e983/action HTTP/1.1 Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 65 Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 7492aad7-10fd-4a51-88db-37010c04e983 could not be found. Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '7492aad7-10fd-4a51-88db-37010c04e983', 'body': {'rebuild': {'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca'}}} Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7492aad7-10fd-4a51-88db-37010c04e983 could not be found. Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 13:18:26.722736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7492aad7-10fd-4a51-88db-37010c04e983 could not be found. Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7492aad7-10fd-4a51-88db-37010c04e983 could not be found. Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-403844f8-9a06-49f2-97ad-49220aefb8b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 7492aad7-10fd-4a51-88db-37010c04e983 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:26.731446 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-403844f8-9a06-49f2-97ad-49220aefb8b9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/7492aad7-10fd-4a51-88db-37010c04e983/action" status: 404 len: 111 microversion: 2.1 time: 0.125944 Aug 25 13:18:26.738095 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2084/4111] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:26 2022] POST /compute/v2.1/servers/7492aad7-10fd-4a51-88db-37010c04e983/action => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:18:26.770091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f0fd7545-c6df-4903-80cc-696138ce9fbc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:26.776038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f0fd7545-c6df-4903-80cc-696138ce9fbc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:26.790617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0fd7545-c6df-4903-80cc-696138ce9fbc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:26.793882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0fd7545-c6df-4903-80cc-696138ce9fbc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:26.796037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0fd7545-c6df-4903-80cc-696138ce9fbc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:26.798021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0fd7545-c6df-4903-80cc-696138ce9fbc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:26.800004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0fd7545-c6df-4903-80cc-696138ce9fbc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:26.801579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0fd7545-c6df-4903-80cc-696138ce9fbc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:29.239014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f0fd7545-c6df-4903-80cc-696138ce9fbc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:29.274983 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f0fd7545-c6df-4903-80cc-696138ce9fbc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 2.527501 Aug 25 13:18:29.282885 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2085/4112] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:26 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 2537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:29.305368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae4294a3-2068-44fa-92c7-6e3a584288e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:29.307708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ae4294a3-2068-44fa-92c7-6e3a584288e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:29.331985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae4294a3-2068-44fa-92c7-6e3a584288e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:29.341090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae4294a3-2068-44fa-92c7-6e3a584288e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:29.342997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae4294a3-2068-44fa-92c7-6e3a584288e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:29.345433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae4294a3-2068-44fa-92c7-6e3a584288e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:29.347116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae4294a3-2068-44fa-92c7-6e3a584288e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:29.361616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae4294a3-2068-44fa-92c7-6e3a584288e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:30.678285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ae4294a3-2068-44fa-92c7-6e3a584288e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:30.737727 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ae4294a3-2068-44fa-92c7-6e3a584288e3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 1.452379 Aug 25 13:18:30.746156 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2086/4113] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:29 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:30.781469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d2ec3765-50b7-48bd-bc0a-23d640aa4bba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:30.786643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d2ec3765-50b7-48bd-bc0a-23d640aa4bba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:30.820744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ec3765-50b7-48bd-bc0a-23d640aa4bba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:30.829630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ec3765-50b7-48bd-bc0a-23d640aa4bba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:30.832344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ec3765-50b7-48bd-bc0a-23d640aa4bba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:30.838535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ec3765-50b7-48bd-bc0a-23d640aa4bba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:30.840063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ec3765-50b7-48bd-bc0a-23d640aa4bba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:30.843724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ec3765-50b7-48bd-bc0a-23d640aa4bba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:31.597777 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3e75ae62-9efe-488f-821f-b04a38996515 tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/e9382d76-8cdf-4864-865b-fc93007d8187" status: 202 len: 0 microversion: 2.1 time: 7.591389 Aug 25 13:18:31.613584 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2028/4114] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 13:18:24 2022] DELETE /compute/v2.1/os-floating-ips/e9382d76-8cdf-4864-865b-fc93007d8187 => generated 0 bytes in 7606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:18:31.624381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0ca3029-30d7-4d73-b25a-700a10349d4f tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Calling method '.version_select at 0x7f3a2a0938b0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:32.816661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d2ec3765-50b7-48bd-bc0a-23d640aa4bba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:32.843946 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d2ec3765-50b7-48bd-bc0a-23d640aa4bba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 2.093073 Aug 25 13:18:32.846027 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2087/4115] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:30 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:32.872960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3c1bf41-11f8-4b00-ba87-7339552db7d7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:32.877593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c3c1bf41-11f8-4b00-ba87-7339552db7d7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:32.910457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3c1bf41-11f8-4b00-ba87-7339552db7d7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:32.911361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3c1bf41-11f8-4b00-ba87-7339552db7d7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:32.918469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3c1bf41-11f8-4b00-ba87-7339552db7d7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:32.925620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3c1bf41-11f8-4b00-ba87-7339552db7d7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:32.926591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3c1bf41-11f8-4b00-ba87-7339552db7d7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:32.929933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3c1bf41-11f8-4b00-ba87-7339552db7d7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:33.217337 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0ca3029-30d7-4d73-b25a-700a10349d4f tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.602355 Aug 25 13:18:33.237430 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2029/4116] 10.222.0.70 () {58 vars in 1164 bytes} [Thu Aug 25 13:18:31 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:18:33.248722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7ab7589-0286-49eb-9364-59572ac50e05 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:33.249761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a7ab7589-0286-49eb-9364-59572ac50e05 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: f3c079c7-6ea5-4d6e-93b3-877bc35d6306] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:33.265111 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a7ab7589-0286-49eb-9364-59572ac50e05 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance f3c079c7-6ea5-4d6e-93b3-877bc35d6306 could not be found. Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7ab7589-0286-49eb-9364-59572ac50e05 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/f3c079c7-6ea5-4d6e-93b3-877bc35d6306/action HTTP/1.1 Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 15 Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: {"restore": {}} Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance f3c079c7-6ea5-4d6e-93b3-877bc35d6306 could not be found. Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'f3c079c7-6ea5-4d6e-93b3-877bc35d6306', 'body': {'restore': {}}} Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c079c7-6ea5-4d6e-93b3-877bc35d6306 could not be found. Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c079c7-6ea5-4d6e-93b3-877bc35d6306 could not be found. Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:33.268734 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:33.285431 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:33.285431 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:33.285431 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c079c7-6ea5-4d6e-93b3-877bc35d6306 could not be found. Aug 25 13:18:33.285431 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:33.285431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7ab7589-0286-49eb-9364-59572ac50e05 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance f3c079c7-6ea5-4d6e-93b3-877bc35d6306 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:33.285431 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a7ab7589-0286-49eb-9364-59572ac50e05 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/f3c079c7-6ea5-4d6e-93b3-877bc35d6306/action" status: 404 len: 111 microversion: 2.1 time: 0.033167 Aug 25 13:18:33.285431 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2030/4117] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:33 2022] POST /compute/v2.1/servers/f3c079c7-6ea5-4d6e-93b3-877bc35d6306/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:18:33.285431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dabe6161-3276-4ebe-8704-4390de5f1241 tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Calling method '.version_select at 0x7f3a297179d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:34.210579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c3c1bf41-11f8-4b00-ba87-7339552db7d7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:34.256792 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3c1bf41-11f8-4b00-ba87-7339552db7d7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 1.405257 Aug 25 13:18:34.277561 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2088/4118] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:32 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:34.294576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a5361991-907b-4166-8043-11a87d071332 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:34.300925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a5361991-907b-4166-8043-11a87d071332 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:34.318613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5361991-907b-4166-8043-11a87d071332 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:34.319450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5361991-907b-4166-8043-11a87d071332 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:34.331536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5361991-907b-4166-8043-11a87d071332 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:34.332161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5361991-907b-4166-8043-11a87d071332 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:34.332953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5361991-907b-4166-8043-11a87d071332 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:34.333710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5361991-907b-4166-8043-11a87d071332 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:34.535934 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dabe6161-3276-4ebe-8704-4390de5f1241 tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.259144 Aug 25 13:18:34.537211 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2031/4119] 10.222.0.70 () {58 vars in 1149 bytes} [Thu Aug 25 13:18:33 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:18:34.578145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-423f57d6-e3c0-4f8c-8404-fe489e728957 tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Calling method '.version_select at 0x7f3a2e8311f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:35.188377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a5361991-907b-4166-8043-11a87d071332 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:35.232313 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a5361991-907b-4166-8043-11a87d071332 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.969921 Aug 25 13:18:35.250521 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2089/4120] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:34 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:35.309295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9e045c35-c4bb-4c58-9ef1-9360ce0c3def tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:35.310682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9e045c35-c4bb-4c58-9ef1-9360ce0c3def tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:35.339804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e045c35-c4bb-4c58-9ef1-9360ce0c3def tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:35.340672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e045c35-c4bb-4c58-9ef1-9360ce0c3def tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:35.346038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e045c35-c4bb-4c58-9ef1-9360ce0c3def tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:35.347626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e045c35-c4bb-4c58-9ef1-9360ce0c3def tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:35.348563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e045c35-c4bb-4c58-9ef1-9360ce0c3def tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:35.349625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e045c35-c4bb-4c58-9ef1-9360ce0c3def tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:36.410760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9e045c35-c4bb-4c58-9ef1-9360ce0c3def tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:36.436879 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9e045c35-c4bb-4c58-9ef1-9360ce0c3def tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.141501 Aug 25 13:18:36.449472 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2090/4121] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:35 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:36.450050 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:18:36.450824 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 13:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-floating-ips/dc6c5dcb-11ed-4425-9b3b-1a75a6dd1a2a (ip 10.222.0.70) !!! Aug 25 13:18:36.463829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-27ba8754-b4df-4ce3-8475-e43aa8371646 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:36.465075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-27ba8754-b4df-4ce3-8475-e43aa8371646 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:36.490353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27ba8754-b4df-4ce3-8475-e43aa8371646 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:36.495587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27ba8754-b4df-4ce3-8475-e43aa8371646 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:36.497174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27ba8754-b4df-4ce3-8475-e43aa8371646 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:36.499219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27ba8754-b4df-4ce3-8475-e43aa8371646 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:36.502679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27ba8754-b4df-4ce3-8475-e43aa8371646 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:36.503531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27ba8754-b4df-4ce3-8475-e43aa8371646 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:37.420368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-27ba8754-b4df-4ce3-8475-e43aa8371646 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:37.459068 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-27ba8754-b4df-4ce3-8475-e43aa8371646 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1509 microversion: 2.1 time: 0.997398 Aug 25 13:18:37.465598 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2091/4122] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:36 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1509 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:37.497671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:37.502083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:37.542848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:37.548214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:37.552034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:37.557963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:37.564993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:37.566942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:37.728156 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Cannot 'restore' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action HTTP/1.1 Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 15 Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: {"restore": {}} Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: exception: Cannot 'restore' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'cc6362fd-0197-4636-8a8d-6814ba103aed', 'body': {'restore': {}}} Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc6362fd-0197-4636-8a8d-6814ba103aed in vm_state active. Cannot restore while the instance is in this state. Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:37.732067 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:37.745589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:37.745589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:37.745589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:37.745589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:18:37.745589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:37.749954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 409 to user: Cannot 'restore' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:37.753002 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c070df30-6b6d-46cb-8ed6-bdc13ae457b6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 409 len: 145 microversion: 2.1 time: 0.279341 Aug 25 13:18:37.754612 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2092/4123] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:37 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 145 bytes in 288 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:18:37.779152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-361ec94b-e7a8-4b60-83af-a245b65c37e1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:37.779482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-361ec94b-e7a8-4b60-83af-a245b65c37e1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:37.822801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-361ec94b-e7a8-4b60-83af-a245b65c37e1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:37.823928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-361ec94b-e7a8-4b60-83af-a245b65c37e1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:37.825454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-361ec94b-e7a8-4b60-83af-a245b65c37e1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:37.828692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-361ec94b-e7a8-4b60-83af-a245b65c37e1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:37.829758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-361ec94b-e7a8-4b60-83af-a245b65c37e1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:37.830590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-361ec94b-e7a8-4b60-83af-a245b65c37e1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:37.939507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:38.813650 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-423f57d6-e3c0-4f8c-8404-fe489e728957 tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/dc6c5dcb-11ed-4425-9b3b-1a75a6dd1a2a" status: 202 len: 0 microversion: 2.1 time: 4.250937 Aug 25 13:18:38.816865 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2032/4124] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 13:18:34 2022] DELETE /compute/v2.1/os-floating-ips/dc6c5dcb-11ed-4425-9b3b-1a75a6dd1a2a => generated 0 bytes in 4257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:18:38.844593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7fec6a4-c566-4b21-b6ad-ecbeb3ece323 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:38.851582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a7fec6a4-c566-4b21-b6ad-ecbeb3ece323 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:38.874571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7fec6a4-c566-4b21-b6ad-ecbeb3ece323 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:38.876198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7fec6a4-c566-4b21-b6ad-ecbeb3ece323 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:38.877633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7fec6a4-c566-4b21-b6ad-ecbeb3ece323 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:38.879646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7fec6a4-c566-4b21-b6ad-ecbeb3ece323 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:38.881621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7fec6a4-c566-4b21-b6ad-ecbeb3ece323 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:38.883731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7fec6a4-c566-4b21-b6ad-ecbeb3ece323 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:39.207879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-361ec94b-e7a8-4b60-83af-a245b65c37e1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:39.230195 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-361ec94b-e7a8-4b60-83af-a245b65c37e1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.465364 Aug 25 13:18:39.267000 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2093/4125] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:37 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:39.288897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9ef26c2e-75b3-4696-834e-b7171400bb6d tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Calling method '.version_select at 0x7f3a2a1b6040>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:40.822300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a7fec6a4-c566-4b21-b6ad-ecbeb3ece323 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:40.855029 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a7fec6a4-c566-4b21-b6ad-ecbeb3ece323 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1506 microversion: 2.1 time: 2.033804 Aug 25 13:18:40.856196 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2033/4126] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:38 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1506 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:40.875373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2dd68b05-ef4d-4a4c-adb7-42d60f3e525d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:40.877154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2dd68b05-ef4d-4a4c-adb7-42d60f3e525d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:40.920854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dd68b05-ef4d-4a4c-adb7-42d60f3e525d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:40.934055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dd68b05-ef4d-4a4c-adb7-42d60f3e525d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:40.935054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dd68b05-ef4d-4a4c-adb7-42d60f3e525d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:40.936442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dd68b05-ef4d-4a4c-adb7-42d60f3e525d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:40.937324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dd68b05-ef4d-4a4c-adb7-42d60f3e525d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:40.938183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dd68b05-ef4d-4a4c-adb7-42d60f3e525d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:41.677113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2dd68b05-ef4d-4a4c-adb7-42d60f3e525d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:41.713879 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2dd68b05-ef4d-4a4c-adb7-42d60f3e525d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.855400 Aug 25 13:18:41.714997 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2034/4127] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:40 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:41.767344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25322d25-f7b2-4bdc-ac40-71e7d198443d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:41.768376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-25322d25-f7b2-4bdc-ac40-71e7d198443d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: 8a42846a-8404-4a21-a575-4c81fbf9e985] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:41.801493 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-25322d25-f7b2-4bdc-ac40-71e7d198443d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 8a42846a-8404-4a21-a575-4c81fbf9e985 could not be found. Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25322d25-f7b2-4bdc-ac40-71e7d198443d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/8a42846a-8404-4a21-a575-4c81fbf9e985/action HTTP/1.1 Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 14 Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: {"resume": {}} Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 8a42846a-8404-4a21-a575-4c81fbf9e985 could not be found. Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '8a42846a-8404-4a21-a575-4c81fbf9e985', 'body': {'resume': {}}} Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a42846a-8404-4a21-a575-4c81fbf9e985 could not be found. Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a42846a-8404-4a21-a575-4c81fbf9e985 could not be found. Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:41.811603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:41.827131 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:41.827131 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:41.827131 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a42846a-8404-4a21-a575-4c81fbf9e985 could not be found. Aug 25 13:18:41.827131 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:41.827131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25322d25-f7b2-4bdc-ac40-71e7d198443d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 8a42846a-8404-4a21-a575-4c81fbf9e985 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:41.827131 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-25322d25-f7b2-4bdc-ac40-71e7d198443d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/8a42846a-8404-4a21-a575-4c81fbf9e985/action" status: 404 len: 111 microversion: 2.1 time: 0.056606 Aug 25 13:18:41.827131 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2035/4128] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:41 2022] POST /compute/v2.1/servers/8a42846a-8404-4a21-a575-4c81fbf9e985/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:18:41.835865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8139fd0-2334-48fc-86d5-40ffa374290f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:41.837701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8139fd0-2334-48fc-86d5-40ffa374290f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:41.850656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8139fd0-2334-48fc-86d5-40ffa374290f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:41.851576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8139fd0-2334-48fc-86d5-40ffa374290f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:41.852444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8139fd0-2334-48fc-86d5-40ffa374290f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:41.854534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8139fd0-2334-48fc-86d5-40ffa374290f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:41.855283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8139fd0-2334-48fc-86d5-40ffa374290f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:41.856090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8139fd0-2334-48fc-86d5-40ffa374290f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:42.507419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b8139fd0-2334-48fc-86d5-40ffa374290f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:42.543239 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8139fd0-2334-48fc-86d5-40ffa374290f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.717925 Aug 25 13:18:42.558505 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2036/4129] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:41 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:42.585892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d49183bc-a9e9-48e4-bed5-b52fe2a663ed tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:42.596474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d49183bc-a9e9-48e4-bed5-b52fe2a663ed tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:42.619626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d49183bc-a9e9-48e4-bed5-b52fe2a663ed tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:42.622347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d49183bc-a9e9-48e4-bed5-b52fe2a663ed tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:42.625019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d49183bc-a9e9-48e4-bed5-b52fe2a663ed tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:42.628238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d49183bc-a9e9-48e4-bed5-b52fe2a663ed tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:42.629262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d49183bc-a9e9-48e4-bed5-b52fe2a663ed tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:42.633313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d49183bc-a9e9-48e4-bed5-b52fe2a663ed tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:43.260320 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9ef26c2e-75b3-4696-834e-b7171400bb6d tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/283dcb45-238b-4ca1-94e3-847621514f1e" status: 202 len: 0 microversion: 2.1 time: 3.986521 Aug 25 13:18:43.283987 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2094/4130] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 13:18:39 2022] DELETE /compute/v2.1/os-floating-ips/283dcb45-238b-4ca1-94e3-847621514f1e => generated 0 bytes in 4004 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:18:43.305023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-19dfa0e7-d50c-4f15-b276-aa624116eaec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:43.307475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-19dfa0e7-d50c-4f15-b276-aa624116eaec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:43.326327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=41 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:43.331370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19dfa0e7-d50c-4f15-b276-aa624116eaec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:43.332888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19dfa0e7-d50c-4f15-b276-aa624116eaec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:43.335549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19dfa0e7-d50c-4f15-b276-aa624116eaec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:43.339419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19dfa0e7-d50c-4f15-b276-aa624116eaec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:43.340931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19dfa0e7-d50c-4f15-b276-aa624116eaec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:43.342215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19dfa0e7-d50c-4f15-b276-aa624116eaec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:43.468786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d49183bc-a9e9-48e4-bed5-b52fe2a663ed tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:43.499302 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d49183bc-a9e9-48e4-bed5-b52fe2a663ed tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1506 microversion: 2.1 time: 0.932159 Aug 25 13:18:43.521936 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2037/4131] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:42 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1506 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:43.553731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-76fc7694-d814-4d6f-a1ae-c6e0cb1de1b7 req-3db9d497-ed5c-4fe6-abe8-176e678d2674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7077e0f1-eda0-4e8e-8f81-a64989f35696", "name": "network-vif-unplugged", "status": "completed", "tag": "a659e858-0072-4d47-b4ff-36f0aab011f7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:43.624706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-76fc7694-d814-4d6f-a1ae-c6e0cb1de1b7 req-3db9d497-ed5c-4fe6-abe8-176e678d2674 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:43.626071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-76fc7694-d814-4d6f-a1ae-c6e0cb1de1b7 req-3db9d497-ed5c-4fe6-abe8-176e678d2674 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:43.627268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-76fc7694-d814-4d6f-a1ae-c6e0cb1de1b7 req-3db9d497-ed5c-4fe6-abe8-176e678d2674 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:43.678075 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-76fc7694-d814-4d6f-a1ae-c6e0cb1de1b7 req-3db9d497-ed5c-4fe6-abe8-176e678d2674 service nova] Creating event network-vif-unplugged:a659e858-0072-4d47-b4ff-36f0aab011f7 for instance 7077e0f1-eda0-4e8e-8f81-a64989f35696 on n-h1-852771-8 Aug 25 13:18:43.697071 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-76fc7694-d814-4d6f-a1ae-c6e0cb1de1b7 req-3db9d497-ed5c-4fe6-abe8-176e678d2674 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172289 Aug 25 13:18:43.703663 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2038/4132] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:18:43.730092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9962ffe9-b84d-4a80-bb75-beb169d8d48e tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] Calling method '.version_select at 0x7f3a2e9800d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:44.325038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-19dfa0e7-d50c-4f15-b276-aa624116eaec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:44.361354 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-19dfa0e7-d50c-4f15-b276-aa624116eaec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.073967 Aug 25 13:18:44.363757 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2095/4133] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:43 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:44.409008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:44.410698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:44.433384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:44.438836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:44.442120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:44.443973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:44.445842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:44.447251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:44.503586 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Cannot 'resume' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action HTTP/1.1 Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 14 Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: {"resume": {}} Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: exception: Cannot 'resume' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'cc6362fd-0197-4636-8a8d-6814ba103aed', 'body': {'resume': {}}} Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc6362fd-0197-4636-8a8d-6814ba103aed in vm_state active. Cannot resume while the instance is in this state. Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:44.507800 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:44.520198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:44.520198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:44.520198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:44.520198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:44.520198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:44.520198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:18:44.520198 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:44.521891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 409 to user: Cannot 'resume' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:44.524812 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-349d8d65-bda1-4058-9c76-aba092901e22 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 409 len: 144 microversion: 2.1 time: 0.126293 Aug 25 13:18:44.527010 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2096/4134] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:44 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 144 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 25 13:18:44.548626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c6c9553-549b-4f3c-9c09-69334841ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:44.550064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c6c9553-549b-4f3c-9c09-69334841ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:44.576643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c6c9553-549b-4f3c-9c09-69334841ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:44.577860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c6c9553-549b-4f3c-9c09-69334841ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:44.579014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c6c9553-549b-4f3c-9c09-69334841ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:44.580448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c6c9553-549b-4f3c-9c09-69334841ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:44.581563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c6c9553-549b-4f3c-9c09-69334841ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:44.582487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c6c9553-549b-4f3c-9c09-69334841ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:46.267946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0c6c9553-549b-4f3c-9c09-69334841ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:46.304642 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c6c9553-549b-4f3c-9c09-69334841ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.771328 Aug 25 13:18:46.310160 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2097/4135] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:44 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:46.332941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ca5d7e35-e1e7-458e-9f78-48fcca3a4565 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:46.337489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ca5d7e35-e1e7-458e-9f78-48fcca3a4565 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:46.372505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca5d7e35-e1e7-458e-9f78-48fcca3a4565 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:46.380999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca5d7e35-e1e7-458e-9f78-48fcca3a4565 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:46.382214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca5d7e35-e1e7-458e-9f78-48fcca3a4565 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:46.384527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca5d7e35-e1e7-458e-9f78-48fcca3a4565 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:46.386060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca5d7e35-e1e7-458e-9f78-48fcca3a4565 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:46.387313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca5d7e35-e1e7-458e-9f78-48fcca3a4565 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:47.216978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ca5d7e35-e1e7-458e-9f78-48fcca3a4565 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:47.249463 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ca5d7e35-e1e7-458e-9f78-48fcca3a4565 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 200 len: 1449 microversion: 2.1 time: 0.928313 Aug 25 13:18:47.253382 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2098/4136] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:46 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 1449 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:47.476637 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9962ffe9-b84d-4a80-bb75-beb169d8d48e tempest-FloatingIPDetailsTestJSON-1875722341 tempest-FloatingIPDetailsTestJSON-1875722341-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/b78a98a2-68c3-4b64-b044-9e1f13cb12ec" status: 202 len: 0 microversion: 2.1 time: 3.770192 Aug 25 13:18:47.479143 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2039/4137] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 13:18:43 2022] DELETE /compute/v2.1/os-floating-ips/b78a98a2-68c3-4b64-b044-9e1f13cb12ec => generated 0 bytes in 3775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:18:47.499412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00c4ff3a-3b02-4c64-8e33-15949bc0cd90 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:47.506293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-00c4ff3a-3b02-4c64-8e33-15949bc0cd90 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:47.522626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-872474963", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "f4575f2a-1883-47f8-bde0-61c9eb3d0f0c"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:47.548814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00c4ff3a-3b02-4c64-8e33-15949bc0cd90 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:47.549735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00c4ff3a-3b02-4c64-8e33-15949bc0cd90 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:47.550603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00c4ff3a-3b02-4c64-8e33-15949bc0cd90 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:47.552024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00c4ff3a-3b02-4c64-8e33-15949bc0cd90 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:47.552860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00c4ff3a-3b02-4c64-8e33-15949bc0cd90 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:47.553695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00c4ff3a-3b02-4c64-8e33-15949bc0cd90 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:47.726980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] validate_networks() for [('f4575f2a-1883-47f8-bde0-61c9eb3d0f0c', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:18:48.236286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-00c4ff3a-3b02-4c64-8e33-15949bc0cd90 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:48.277418 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-00c4ff3a-3b02-4c64-8e33-15949bc0cd90 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.795430 Aug 25 13:18:48.279329 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2040/4138] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:47 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:48.290595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f25ddb49-880a-4d56-9556-349ce39ab66b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:48.292630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f25ddb49-880a-4d56-9556-349ce39ab66b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:48.309266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f25ddb49-880a-4d56-9556-349ce39ab66b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:48.311348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f25ddb49-880a-4d56-9556-349ce39ab66b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:48.315484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f25ddb49-880a-4d56-9556-349ce39ab66b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:48.317926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f25ddb49-880a-4d56-9556-349ce39ab66b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:48.319475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f25ddb49-880a-4d56-9556-349ce39ab66b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:48.320768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f25ddb49-880a-4d56-9556-349ce39ab66b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:49.115261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f25ddb49-880a-4d56-9556-349ce39ab66b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:49.162831 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f25ddb49-880a-4d56-9556-349ce39ab66b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.879070 Aug 25 13:18:49.166806 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2041/4139] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:48 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:49.231538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-09a1141a-1092-4143-a80a-8a729cf0d3f8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-09a1141a-1092-4143-a80a-8a729cf0d3f8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 160 Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a93c3507-9ff2-4777-a7c1-69c8a703a9b6"}]}} Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'body': {'server': {'name': '', 'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca', 'flavorRef': '452', 'networks': [{'uuid': 'a93c3507-9ff2-4777-a7c1-69c8a703a9b6'}]}}} Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi '' Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:18:49.250718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-09a1141a-1092-4143-a80a-8a729cf0d3f8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-09a1141a-1092-4143-a80a-8a729cf0d3f8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.083830 Aug 25 13:18:49.271265 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2042/4140] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:18:49 2022] POST /compute/v2.1/servers => generated 108 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:18:49.296627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-91504511-c285-4713-955c-cbdd301339fb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:49.301481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-91504511-c285-4713-955c-cbdd301339fb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:49.380534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91504511-c285-4713-955c-cbdd301339fb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:49.381478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91504511-c285-4713-955c-cbdd301339fb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:49.388636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91504511-c285-4713-955c-cbdd301339fb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:49.394239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91504511-c285-4713-955c-cbdd301339fb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:49.404406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91504511-c285-4713-955c-cbdd301339fb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:49.405762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91504511-c285-4713-955c-cbdd301339fb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:49.782363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:18:49.783356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:18:49.784704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:18:49.785924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:18:49.787834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:18:49.838262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:49.842858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:49.845689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:49.848959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:49.853121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:49.858433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:49.976027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Getting quotas for project 15dcef23255440f4b9f150820a8afd2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:18:49.989707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Getting quotas for user 94b6aafa5bc44f2badea5620d7714b3a and project 15dcef23255440f4b9f150820a8afd2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:18:50.031333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:18:50.044822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:18:50.177435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-91504511-c285-4713-955c-cbdd301339fb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:50.202987 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-91504511-c285-4713-955c-cbdd301339fb tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.944741 Aug 25 13:18:50.205136 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2043/4141] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:49 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:50.226140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-db799e5e-b5dc-46a4-ab0b-6a83ebc48458 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:50.228953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-db799e5e-b5dc-46a4-ab0b-6a83ebc48458 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:50.231533 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-721273cb-b815-4a7f-9ff8-5b6c05528d04 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.975009 Aug 25 13:18:50.235823 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2099/4142] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:18:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:18:50.270399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c86e8cf-21c7-4fa7-905e-5ce0fd9d66a4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:50.271197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db799e5e-b5dc-46a4-ab0b-6a83ebc48458 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:50.272491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db799e5e-b5dc-46a4-ab0b-6a83ebc48458 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:50.276099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db799e5e-b5dc-46a4-ab0b-6a83ebc48458 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:50.278405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db799e5e-b5dc-46a4-ab0b-6a83ebc48458 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:50.279681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db799e5e-b5dc-46a4-ab0b-6a83ebc48458 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:50.280053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c86e8cf-21c7-4fa7-905e-5ce0fd9d66a4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:50.281807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db799e5e-b5dc-46a4-ab0b-6a83ebc48458 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:50.345610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c86e8cf-21c7-4fa7-905e-5ce0fd9d66a4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:50.350172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c86e8cf-21c7-4fa7-905e-5ce0fd9d66a4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:50.355908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c86e8cf-21c7-4fa7-905e-5ce0fd9d66a4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:50.358993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c86e8cf-21c7-4fa7-905e-5ce0fd9d66a4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:50.360212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c86e8cf-21c7-4fa7-905e-5ce0fd9d66a4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:50.361262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c86e8cf-21c7-4fa7-905e-5ce0fd9d66a4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:50.749550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-db799e5e-b5dc-46a4-ab0b-6a83ebc48458 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:50.779216 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-db799e5e-b5dc-46a4-ab0b-6a83ebc48458 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.571673 Aug 25 13:18:50.814298 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2044/4143] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:50 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:50.848400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-135643258", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "f4575f2a-1883-47f8-bde0-61c9eb3d0f0c"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:50.956966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0c86e8cf-21c7-4fa7-905e-5ce0fd9d66a4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:50.987571 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c86e8cf-21c7-4fa7-905e-5ce0fd9d66a4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.737243 Aug 25 13:18:51.009640 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2100/4144] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:50 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:18:51.036615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ef124bc-e76b-47dc-9434-14d14ce7c12f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:51.042944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7ef124bc-e76b-47dc-9434-14d14ce7c12f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:51.104984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ef124bc-e76b-47dc-9434-14d14ce7c12f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:51.106996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ef124bc-e76b-47dc-9434-14d14ce7c12f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:51.110608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ef124bc-e76b-47dc-9434-14d14ce7c12f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:51.112512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ef124bc-e76b-47dc-9434-14d14ce7c12f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:51.113888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ef124bc-e76b-47dc-9434-14d14ce7c12f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:51.115020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ef124bc-e76b-47dc-9434-14d14ce7c12f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:51.122916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] validate_networks() for [('f4575f2a-1883-47f8-bde0-61c9eb3d0f0c', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:18:52.304487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7ef124bc-e76b-47dc-9434-14d14ce7c12f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:52.344110 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ef124bc-e76b-47dc-9434-14d14ce7c12f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.325831 Aug 25 13:18:52.354326 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2101/4145] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:51 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:52.378578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-deb31796-b0eb-4060-b898-80199ebcce5f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:52.391700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-deb31796-b0eb-4060-b898-80199ebcce5f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:52.419754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-deb31796-b0eb-4060-b898-80199ebcce5f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:52.423784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-deb31796-b0eb-4060-b898-80199ebcce5f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:52.431516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-deb31796-b0eb-4060-b898-80199ebcce5f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:52.435730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-deb31796-b0eb-4060-b898-80199ebcce5f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:52.437056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-deb31796-b0eb-4060-b898-80199ebcce5f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:52.437859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-deb31796-b0eb-4060-b898-80199ebcce5f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:53.969574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-deb31796-b0eb-4060-b898-80199ebcce5f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:54.015981 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-deb31796-b0eb-4060-b898-80199ebcce5f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.656895 Aug 25 13:18:54.018540 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2102/4146] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:52 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:54.049332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a436b0b-b527-45e9-8f3b-2ea60a5731be tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:54.051488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2a436b0b-b527-45e9-8f3b-2ea60a5731be tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: 015e4eab-7866-4122-8e83-045e49382ada] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:54.089640 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-2a436b0b-b527-45e9-8f3b-2ea60a5731be tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 015e4eab-7866-4122-8e83-045e49382ada could not be found. Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a436b0b-b527-45e9-8f3b-2ea60a5731be tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/015e4eab-7866-4122-8e83-045e49382ada/action HTTP/1.1 Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 14 Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: {"shelve": {}} Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 015e4eab-7866-4122-8e83-045e49382ada could not be found. Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '015e4eab-7866-4122-8e83-045e49382ada', 'body': {'shelve': {}}} Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015e4eab-7866-4122-8e83-045e49382ada could not be found. Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015e4eab-7866-4122-8e83-045e49382ada could not be found. Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:18:54.109628 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:18:54.128129 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:18:54.128129 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:18:54.128129 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015e4eab-7866-4122-8e83-045e49382ada could not be found. Aug 25 13:18:54.128129 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:18:54.128129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a436b0b-b527-45e9-8f3b-2ea60a5731be tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 015e4eab-7866-4122-8e83-045e49382ada could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:18:54.128129 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a436b0b-b527-45e9-8f3b-2ea60a5731be tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/015e4eab-7866-4122-8e83-045e49382ada/action" status: 404 len: 111 microversion: 2.1 time: 0.091609 Aug 25 13:18:54.128129 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2103/4147] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:54 2022] POST /compute/v2.1/servers/015e4eab-7866-4122-8e83-045e49382ada/action => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:18:54.167252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b6dd152-b6da-471e-a69f-16b28fe55174 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:54.187880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b6dd152-b6da-471e-a69f-16b28fe55174 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:54.188726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b6dd152-b6da-471e-a69f-16b28fe55174 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:54.189494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b6dd152-b6da-471e-a69f-16b28fe55174 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:54.305753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b6dd152-b6da-471e-a69f-16b28fe55174 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Going to try to stop instance {{(pid=129060) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:18:54.488825 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b6dd152-b6da-471e-a69f-16b28fe55174 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.372257 Aug 25 13:18:54.490526 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2104/4148] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:54 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:18:54.504004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae49ca73-6819-42bb-9560-f1f330cf5196 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:54.506989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ae49ca73-6819-42bb-9560-f1f330cf5196 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:54.529555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae49ca73-6819-42bb-9560-f1f330cf5196 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:54.530924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae49ca73-6819-42bb-9560-f1f330cf5196 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:54.535804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae49ca73-6819-42bb-9560-f1f330cf5196 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:54.538722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae49ca73-6819-42bb-9560-f1f330cf5196 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:54.547055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae49ca73-6819-42bb-9560-f1f330cf5196 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:54.548319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae49ca73-6819-42bb-9560-f1f330cf5196 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:55.048968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:18:55.052930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:18:55.056077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:18:55.060011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:18:55.061386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:18:55.096586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=25 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:55.155848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:55.160060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:55.162098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:55.171338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:55.216100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.046s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:55.220902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:55.313067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Getting quotas for project 15dcef23255440f4b9f150820a8afd2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:18:55.340612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Getting quotas for user 94b6aafa5bc44f2badea5620d7714b3a and project 15dcef23255440f4b9f150820a8afd2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:18:55.374868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ae49ca73-6819-42bb-9560-f1f330cf5196 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:55.398057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:18:55.404076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: 613a86a8-72d2-47f7-ac9d-4151e827126c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:18:55.444435 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ae49ca73-6819-42bb-9560-f1f330cf5196 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.949087 Aug 25 13:18:55.453085 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2105/4149] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:54 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:55.498579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f14be146-8712-4232-9c67-ab0cc751b18f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:55.503585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f14be146-8712-4232-9c67-ab0cc751b18f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:55.531888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14be146-8712-4232-9c67-ab0cc751b18f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:55.541053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14be146-8712-4232-9c67-ab0cc751b18f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:55.547518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14be146-8712-4232-9c67-ab0cc751b18f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:55.557262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14be146-8712-4232-9c67-ab0cc751b18f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:55.558629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14be146-8712-4232-9c67-ab0cc751b18f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:55.559316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f14be146-8712-4232-9c67-ab0cc751b18f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:55.566377 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c6176b20-dc4f-4912-b796-3f8ee388c63a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.749589 Aug 25 13:18:55.568828 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2045/4150] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:18:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:18:55.580746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e8920d4b-8f9b-4752-9778-307720c43151 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:55.582263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e8920d4b-8f9b-4752-9778-307720c43151 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:55.595351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8920d4b-8f9b-4752-9778-307720c43151 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:55.599282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8920d4b-8f9b-4752-9778-307720c43151 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:55.601165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8920d4b-8f9b-4752-9778-307720c43151 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:55.603259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8920d4b-8f9b-4752-9778-307720c43151 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:55.604562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8920d4b-8f9b-4752-9778-307720c43151 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:55.605850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8920d4b-8f9b-4752-9778-307720c43151 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:56.910624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f14be146-8712-4232-9c67-ab0cc751b18f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:56.965611 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f14be146-8712-4232-9c67-ab0cc751b18f tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 1.510560 Aug 25 13:18:56.982322 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2106/4151] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:55 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:57.006764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1959379064", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "451", "networks": [{"uuid": "f4575f2a-1883-47f8-bde0-61c9eb3d0f0c"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:57.192324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] validate_networks() for [('f4575f2a-1883-47f8-bde0-61c9eb3d0f0c', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:18:57.293597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e8920d4b-8f9b-4752-9778-307720c43151 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:57.324264 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e8920d4b-8f9b-4752-9778-307720c43151 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.750930 Aug 25 13:18:57.325273 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2046/4152] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:55 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:57.387551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-97b51091-3573-465a-bf8f-1067b4c70e7f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:57.389153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-97b51091-3573-465a-bf8f-1067b4c70e7f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:57.426617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b51091-3573-465a-bf8f-1067b4c70e7f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:57.433393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b51091-3573-465a-bf8f-1067b4c70e7f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:57.436411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b51091-3573-465a-bf8f-1067b4c70e7f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:57.441822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b51091-3573-465a-bf8f-1067b4c70e7f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:57.444338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b51091-3573-465a-bf8f-1067b4c70e7f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:57.447245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b51091-3573-465a-bf8f-1067b4c70e7f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:57.578143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-97b51091-3573-465a-bf8f-1067b4c70e7f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lazy-loading 'flavor' on Instance uuid cc6362fd-0197-4636-8a8d-6814ba103aed {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:18:58.267658 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-97b51091-3573-465a-bf8f-1067b4c70e7f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 202 len: 0 microversion: 2.1 time: 0.906798 Aug 25 13:18:58.273757 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2047/4153] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:57 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:18:58.289780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3a55d0a4-7352-4408-9742-e9d78bd44f69 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:58.294064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3a55d0a4-7352-4408-9742-e9d78bd44f69 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:58.318837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a55d0a4-7352-4408-9742-e9d78bd44f69 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:58.321845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a55d0a4-7352-4408-9742-e9d78bd44f69 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:58.323886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a55d0a4-7352-4408-9742-e9d78bd44f69 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:58.325981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a55d0a4-7352-4408-9742-e9d78bd44f69 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:58.327292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a55d0a4-7352-4408-9742-e9d78bd44f69 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:58.328529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a55d0a4-7352-4408-9742-e9d78bd44f69 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:58.816830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3a55d0a4-7352-4408-9742-e9d78bd44f69 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:58.854445 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3a55d0a4-7352-4408-9742-e9d78bd44f69 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 0.576994 Aug 25 13:18:58.869579 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2048/4154] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:58 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:58.881595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-84850bc1-8b48-42f5-b23c-5e55ad98b47c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:58.889979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-84850bc1-8b48-42f5-b23c-5e55ad98b47c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:58.922003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84850bc1-8b48-42f5-b23c-5e55ad98b47c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:58.924578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84850bc1-8b48-42f5-b23c-5e55ad98b47c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:58.927713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84850bc1-8b48-42f5-b23c-5e55ad98b47c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:58.953939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84850bc1-8b48-42f5-b23c-5e55ad98b47c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:58.954851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84850bc1-8b48-42f5-b23c-5e55ad98b47c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:58.955639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84850bc1-8b48-42f5-b23c-5e55ad98b47c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:59.569368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:18:59.571933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:18:59.573293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:18:59.574661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:18:59.587189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:18:59.617282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:59.630841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:59.632221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:59.635108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:59.636625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:59.637894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:59.742223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Getting quotas for project 15dcef23255440f4b9f150820a8afd2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:18:59.768410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Getting quotas for user 94b6aafa5bc44f2badea5620d7714b3a and project 15dcef23255440f4b9f150820a8afd2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:18:59.834158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-84850bc1-8b48-42f5-b23c-5e55ad98b47c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:59.837744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:18:59.843163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:18:59.864629 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-84850bc1-8b48-42f5-b23c-5e55ad98b47c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1511 microversion: 2.1 time: 1.002171 Aug 25 13:18:59.876763 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2049/4155] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:58 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1511 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:59.926278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f87c26e1-9343-4107-a0cf-bd35a05ce178 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:59.927859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f87c26e1-9343-4107-a0cf-bd35a05ce178 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:59.948509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87c26e1-9343-4107-a0cf-bd35a05ce178 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:59.949270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87c26e1-9343-4107-a0cf-bd35a05ce178 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:59.962450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87c26e1-9343-4107-a0cf-bd35a05ce178 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:59.964330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87c26e1-9343-4107-a0cf-bd35a05ce178 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:59.967895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87c26e1-9343-4107-a0cf-bd35a05ce178 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:59.971357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f87c26e1-9343-4107-a0cf-bd35a05ce178 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:00.083386 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0605b4a8-8c00-451f-a862-5519800bdc9a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.095073 Aug 25 13:19:00.097156 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2107/4156] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:18:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:19:00.110420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e362df6-40e9-4dcb-949a-c2d991cdbfd3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:00.112093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3e362df6-40e9-4dcb-949a-c2d991cdbfd3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:00.735664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f87c26e1-9343-4107-a0cf-bd35a05ce178 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:00.756480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3e362df6-40e9-4dcb-949a-c2d991cdbfd3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:00.766848 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f87c26e1-9343-4107-a0cf-bd35a05ce178 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 0.856977 Aug 25 13:19:00.776573 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2050/4157] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:59 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:00.808592 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3e362df6-40e9-4dcb-949a-c2d991cdbfd3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1221 microversion: 2.1 time: 0.709056 Aug 25 13:19:00.810415 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2108/4158] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:00 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1221 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:00.923076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-31a90eba-86a8-405b-948d-cb87aefa913c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:00.931676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-31a90eba-86a8-405b-948d-cb87aefa913c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:00.955609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31a90eba-86a8-405b-948d-cb87aefa913c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:00.960148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31a90eba-86a8-405b-948d-cb87aefa913c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:00.961651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31a90eba-86a8-405b-948d-cb87aefa913c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:00.963580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31a90eba-86a8-405b-948d-cb87aefa913c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:00.964468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31a90eba-86a8-405b-948d-cb87aefa913c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:00.965655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31a90eba-86a8-405b-948d-cb87aefa913c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:01.828696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ffc20705-e470-4db8-bde1-c26527375d0e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:01.834533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ffc20705-e470-4db8-bde1-c26527375d0e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:01.884306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffc20705-e470-4db8-bde1-c26527375d0e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:01.888456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffc20705-e470-4db8-bde1-c26527375d0e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:01.891871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffc20705-e470-4db8-bde1-c26527375d0e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:01.896414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffc20705-e470-4db8-bde1-c26527375d0e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:01.902286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffc20705-e470-4db8-bde1-c26527375d0e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:01.903729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffc20705-e470-4db8-bde1-c26527375d0e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:02.130466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-31a90eba-86a8-405b-948d-cb87aefa913c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:02.141296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:02.179488 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-31a90eba-86a8-405b-948d-cb87aefa913c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1511 microversion: 2.1 time: 1.267073 Aug 25 13:19:02.211318 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2051/4159] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:00 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1511 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:02.235830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-18796864-847f-4427-8b30-4392ed87b3d4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:02.237085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-18796864-847f-4427-8b30-4392ed87b3d4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:02.253944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18796864-847f-4427-8b30-4392ed87b3d4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:02.256236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18796864-847f-4427-8b30-4392ed87b3d4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:02.258228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18796864-847f-4427-8b30-4392ed87b3d4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:02.260076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18796864-847f-4427-8b30-4392ed87b3d4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:02.261258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18796864-847f-4427-8b30-4392ed87b3d4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:02.262316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18796864-847f-4427-8b30-4392ed87b3d4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:04.560656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-18796864-847f-4427-8b30-4392ed87b3d4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:04.596160 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-18796864-847f-4427-8b30-4392ed87b3d4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1217 microversion: 2.1 time: 2.382563 Aug 25 13:19:04.602035 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2052/4160] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:02 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1217 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:04.631137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f764788-95e4-4edb-bc79-620fe6f84c85 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:04.632846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f764788-95e4-4edb-bc79-620fe6f84c85 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:04.666488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f764788-95e4-4edb-bc79-620fe6f84c85 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:04.667820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f764788-95e4-4edb-bc79-620fe6f84c85 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:04.672983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f764788-95e4-4edb-bc79-620fe6f84c85 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:04.674909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f764788-95e4-4edb-bc79-620fe6f84c85 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:04.677130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f764788-95e4-4edb-bc79-620fe6f84c85 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:04.682833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f764788-95e4-4edb-bc79-620fe6f84c85 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:05.182018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ffc20705-e470-4db8-bde1-c26527375d0e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:05.242876 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ffc20705-e470-4db8-bde1-c26527375d0e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1677 microversion: 2.1 time: 3.417048 Aug 25 13:19:05.255042 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2109/4161] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:01 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1677 bytes in 3437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:05.278706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:05.366375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:05.646510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5696f349-b8f3-4e17-9892-fbd9801d18e2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:05.649284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5696f349-b8f3-4e17-9892-fbd9801d18e2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:05.712836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5696f349-b8f3-4e17-9892-fbd9801d18e2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:05.719869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5696f349-b8f3-4e17-9892-fbd9801d18e2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:05.721092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5696f349-b8f3-4e17-9892-fbd9801d18e2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:05.722954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5696f349-b8f3-4e17-9892-fbd9801d18e2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:05.726839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5696f349-b8f3-4e17-9892-fbd9801d18e2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:05.728071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5696f349-b8f3-4e17-9892-fbd9801d18e2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:06.146912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5696f349-b8f3-4e17-9892-fbd9801d18e2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:06.201580 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5696f349-b8f3-4e17-9892-fbd9801d18e2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1279 microversion: 2.1 time: 0.561819 Aug 25 13:19:06.209135 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2110/4162] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:05 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1279 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:06.303245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-33fb8ae3-04a6-4c56-8d26-bc71cd91a365 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:06.305778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-33fb8ae3-04a6-4c56-8d26-bc71cd91a365 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:06.317860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33fb8ae3-04a6-4c56-8d26-bc71cd91a365 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:06.319674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33fb8ae3-04a6-4c56-8d26-bc71cd91a365 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:06.322468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33fb8ae3-04a6-4c56-8d26-bc71cd91a365 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:06.324225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33fb8ae3-04a6-4c56-8d26-bc71cd91a365 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:06.325924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33fb8ae3-04a6-4c56-8d26-bc71cd91a365 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:06.326942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33fb8ae3-04a6-4c56-8d26-bc71cd91a365 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:06.429545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f764788-95e4-4edb-bc79-620fe6f84c85 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:06.460489 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f764788-95e4-4edb-bc79-620fe6f84c85 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1511 microversion: 2.1 time: 1.855240 Aug 25 13:19:06.462652 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2053/4163] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:04 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1511 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:07.262497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-88aa1d17-6b92-4ac5-b125-09470de52642 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:07.263467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-88aa1d17-6b92-4ac5-b125-09470de52642 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:07.281845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88aa1d17-6b92-4ac5-b125-09470de52642 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:07.283206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88aa1d17-6b92-4ac5-b125-09470de52642 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:07.284378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88aa1d17-6b92-4ac5-b125-09470de52642 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:07.286277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88aa1d17-6b92-4ac5-b125-09470de52642 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:07.287573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88aa1d17-6b92-4ac5-b125-09470de52642 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:07.291031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88aa1d17-6b92-4ac5-b125-09470de52642 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:07.904066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-88aa1d17-6b92-4ac5-b125-09470de52642 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:07.984943 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-88aa1d17-6b92-4ac5-b125-09470de52642 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1279 microversion: 2.1 time: 0.734164 Aug 25 13:19:08.012691 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2054/4164] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:07 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1279 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:08.025832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-33fb8ae3-04a6-4c56-8d26-bc71cd91a365 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:08.042816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e450d834-b16d-43cc-a8d1-27ea5b68227b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:08.045736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e450d834-b16d-43cc-a8d1-27ea5b68227b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:08.056534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:08.061259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e450d834-b16d-43cc-a8d1-27ea5b68227b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:08.062355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e450d834-b16d-43cc-a8d1-27ea5b68227b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:08.063952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e450d834-b16d-43cc-a8d1-27ea5b68227b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:08.066987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e450d834-b16d-43cc-a8d1-27ea5b68227b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:08.068386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e450d834-b16d-43cc-a8d1-27ea5b68227b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:08.070284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e450d834-b16d-43cc-a8d1-27ea5b68227b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:08.086945 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-33fb8ae3-04a6-4c56-8d26-bc71cd91a365 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1654 microversion: 2.1 time: 1.800168 Aug 25 13:19:08.104910 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2111/4165] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:06 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1654 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:08.182372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ea1ffa00-f03c-43c5-ab90-8f96e4222466 req-75019fdc-b494-4ebd-879d-a3e47d51141b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb397fbc-b7a9-4839-9780-0699382d3575", "tag": "e86480d8-b7d2-4b3a-bc3f-9cc6f5f5501e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:08.233430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ea1ffa00-f03c-43c5-ab90-8f96e4222466 req-75019fdc-b494-4ebd-879d-a3e47d51141b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:08.239242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ea1ffa00-f03c-43c5-ab90-8f96e4222466 req-75019fdc-b494-4ebd-879d-a3e47d51141b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:08.240802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ea1ffa00-f03c-43c5-ab90-8f96e4222466 req-75019fdc-b494-4ebd-879d-a3e47d51141b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:08.279115 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ea1ffa00-f03c-43c5-ab90-8f96e4222466 req-75019fdc-b494-4ebd-879d-a3e47d51141b service nova] Creating event network-changed:e86480d8-b7d2-4b3a-bc3f-9cc6f5f5501e for instance eb397fbc-b7a9-4839-9780-0699382d3575 on n-h1-852771-8 Aug 25 13:19:08.292525 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ea1ffa00-f03c-43c5-ab90-8f96e4222466 req-75019fdc-b494-4ebd-879d-a3e47d51141b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183863 Aug 25 13:19:08.296071 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2112/4166] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:19:08.313321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d8ca01e4-96eb-4acf-9b05-06e35986b96c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:08.329756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8ca01e4-96eb-4acf-9b05-06e35986b96c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:08.331035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8ca01e4-96eb-4acf-9b05-06e35986b96c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:08.332227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8ca01e4-96eb-4acf-9b05-06e35986b96c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:08.415761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d8ca01e4-96eb-4acf-9b05-06e35986b96c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Going to try to start instance {{(pid=129060) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 13:19:08.580675 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d8ca01e4-96eb-4acf-9b05-06e35986b96c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.281337 Aug 25 13:19:08.583043 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2113/4167] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:19:08 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:19:08.606645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d48820dd-8d0c-40f3-81e4-3c94643cc0f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:08.608911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d48820dd-8d0c-40f3-81e4-3c94643cc0f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:08.628612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d48820dd-8d0c-40f3-81e4-3c94643cc0f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:08.631231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d48820dd-8d0c-40f3-81e4-3c94643cc0f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:08.634044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d48820dd-8d0c-40f3-81e4-3c94643cc0f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:08.637346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d48820dd-8d0c-40f3-81e4-3c94643cc0f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:08.638527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d48820dd-8d0c-40f3-81e4-3c94643cc0f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:08.639558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d48820dd-8d0c-40f3-81e4-3c94643cc0f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:09.495320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e450d834-b16d-43cc-a8d1-27ea5b68227b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:09.529910 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e450d834-b16d-43cc-a8d1-27ea5b68227b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1511 microversion: 2.1 time: 1.512885 Aug 25 13:19:09.532492 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2055/4168] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:08 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1511 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:09.560561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-45bfcfbb-b9bb-4f50-b684-01b34474ef06 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:09.562404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-45bfcfbb-b9bb-4f50-b684-01b34474ef06 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:09.579398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bfcfbb-b9bb-4f50-b684-01b34474ef06 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:09.581473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bfcfbb-b9bb-4f50-b684-01b34474ef06 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:09.582892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bfcfbb-b9bb-4f50-b684-01b34474ef06 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:09.584635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bfcfbb-b9bb-4f50-b684-01b34474ef06 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:09.586854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bfcfbb-b9bb-4f50-b684-01b34474ef06 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:09.590902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45bfcfbb-b9bb-4f50-b684-01b34474ef06 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:09.694346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:09.844299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d48820dd-8d0c-40f3-81e4-3c94643cc0f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:09.879930 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d48820dd-8d0c-40f3-81e4-3c94643cc0f4 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1663 microversion: 2.1 time: 1.286105 Aug 25 13:19:09.884931 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2114/4169] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:08 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1663 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:10.047462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-45bfcfbb-b9bb-4f50-b684-01b34474ef06 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:10.074519 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-45bfcfbb-b9bb-4f50-b684-01b34474ef06 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1279 microversion: 2.1 time: 0.537805 Aug 25 13:19:10.097368 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2056/4170] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:09 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1279 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:10.447354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5a4f6921-d8e9-4f85-8408-2344c5a23dbf req-8ba51ba7-63cb-414b-a439-b8d64bcef954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "613a86a8-72d2-47f7-ac9d-4151e827126c", "tag": "c21e142d-de3c-412b-8332-d9a4448c0226"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:10.492711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5a4f6921-d8e9-4f85-8408-2344c5a23dbf req-8ba51ba7-63cb-414b-a439-b8d64bcef954 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:10.495031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5a4f6921-d8e9-4f85-8408-2344c5a23dbf req-8ba51ba7-63cb-414b-a439-b8d64bcef954 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:10.496300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5a4f6921-d8e9-4f85-8408-2344c5a23dbf req-8ba51ba7-63cb-414b-a439-b8d64bcef954 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:10.522646 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5a4f6921-d8e9-4f85-8408-2344c5a23dbf req-8ba51ba7-63cb-414b-a439-b8d64bcef954 service nova] Creating event network-changed:c21e142d-de3c-412b-8332-d9a4448c0226 for instance 613a86a8-72d2-47f7-ac9d-4151e827126c on n-h2-852771-8 Aug 25 13:19:10.533590 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5a4f6921-d8e9-4f85-8408-2344c5a23dbf req-8ba51ba7-63cb-414b-a439-b8d64bcef954 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108687 Aug 25 13:19:10.535829 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2115/4171] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:19:10.578440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8573ab23-98f7-446a-96ae-087d396f3984 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:10.581890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8573ab23-98f7-446a-96ae-087d396f3984 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:10.626215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8573ab23-98f7-446a-96ae-087d396f3984 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:10.631902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8573ab23-98f7-446a-96ae-087d396f3984 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:10.633599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8573ab23-98f7-446a-96ae-087d396f3984 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:10.637337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8573ab23-98f7-446a-96ae-087d396f3984 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:10.642919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8573ab23-98f7-446a-96ae-087d396f3984 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:10.648472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8573ab23-98f7-446a-96ae-087d396f3984 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:10.927749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-436adbd6-126d-4123-9ae2-b01d327fbf0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:10.939559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-436adbd6-126d-4123-9ae2-b01d327fbf0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:10.953597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=14 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:10.985721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-436adbd6-126d-4123-9ae2-b01d327fbf0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:10.987002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-436adbd6-126d-4123-9ae2-b01d327fbf0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:10.987845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-436adbd6-126d-4123-9ae2-b01d327fbf0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:10.989672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-436adbd6-126d-4123-9ae2-b01d327fbf0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:10.996186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-436adbd6-126d-4123-9ae2-b01d327fbf0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:10.997659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-436adbd6-126d-4123-9ae2-b01d327fbf0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:12.283269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8573ab23-98f7-446a-96ae-087d396f3984 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:12.330051 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8573ab23-98f7-446a-96ae-087d396f3984 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1532 microversion: 2.1 time: 1.764295 Aug 25 13:19:12.332309 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2057/4172] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:10 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1532 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:12.346309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d56954a5-c948-431d-9fc8-117fbe1a5938 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:12.348551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d56954a5-c948-431d-9fc8-117fbe1a5938 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:12.366620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d56954a5-c948-431d-9fc8-117fbe1a5938 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:12.368148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d56954a5-c948-431d-9fc8-117fbe1a5938 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:12.369015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d56954a5-c948-431d-9fc8-117fbe1a5938 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:12.370645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d56954a5-c948-431d-9fc8-117fbe1a5938 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:12.371803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d56954a5-c948-431d-9fc8-117fbe1a5938 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:12.372919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d56954a5-c948-431d-9fc8-117fbe1a5938 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:12.452479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-436adbd6-126d-4123-9ae2-b01d327fbf0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:12.499772 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-436adbd6-126d-4123-9ae2-b01d327fbf0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1663 microversion: 2.1 time: 1.568840 Aug 25 13:19:12.501180 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2116/4173] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:10 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1663 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:13.379385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eac507df-5df1-42d6-8660-7d2cb1933ecb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:13.381087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eac507df-5df1-42d6-8660-7d2cb1933ecb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:13.388054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:13.400603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eac507df-5df1-42d6-8660-7d2cb1933ecb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:13.402003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eac507df-5df1-42d6-8660-7d2cb1933ecb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:13.403106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eac507df-5df1-42d6-8660-7d2cb1933ecb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:13.404725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eac507df-5df1-42d6-8660-7d2cb1933ecb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:13.405968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eac507df-5df1-42d6-8660-7d2cb1933ecb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:13.407057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eac507df-5df1-42d6-8660-7d2cb1933ecb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:13.985633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d56954a5-c948-431d-9fc8-117fbe1a5938 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:14.012244 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d56954a5-c948-431d-9fc8-117fbe1a5938 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1321 microversion: 2.1 time: 1.677961 Aug 25 13:19:14.041694 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2058/4174] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:12 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1321 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:14.052702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6104eb4b-12fb-43b4-801a-da88348faf5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:14.055156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6104eb4b-12fb-43b4-801a-da88348faf5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:14.068077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6104eb4b-12fb-43b4-801a-da88348faf5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:14.070732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6104eb4b-12fb-43b4-801a-da88348faf5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:14.072902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6104eb4b-12fb-43b4-801a-da88348faf5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:14.075248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6104eb4b-12fb-43b4-801a-da88348faf5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:14.076481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6104eb4b-12fb-43b4-801a-da88348faf5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:14.077618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6104eb4b-12fb-43b4-801a-da88348faf5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:15.007146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eac507df-5df1-42d6-8660-7d2cb1933ecb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:15.042879 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eac507df-5df1-42d6-8660-7d2cb1933ecb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1532 microversion: 2.1 time: 1.666786 Aug 25 13:19:15.071793 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2117/4175] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:13 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1532 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:15.092773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0d730729-7289-4d1b-b006-76bbca129208 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:15.094159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0d730729-7289-4d1b-b006-76bbca129208 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:15.108465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d730729-7289-4d1b-b006-76bbca129208 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:15.109468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d730729-7289-4d1b-b006-76bbca129208 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:15.110688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d730729-7289-4d1b-b006-76bbca129208 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:15.115637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d730729-7289-4d1b-b006-76bbca129208 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:15.116916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d730729-7289-4d1b-b006-76bbca129208 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:15.118023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d730729-7289-4d1b-b006-76bbca129208 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:15.861461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6104eb4b-12fb-43b4-801a-da88348faf5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:15.897842 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6104eb4b-12fb-43b4-801a-da88348faf5b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1663 microversion: 2.1 time: 1.851858 Aug 25 13:19:15.922454 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2059/4176] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:14 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1663 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:16.103012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d5653075-4799-49cf-9375-104ad344ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:16.124813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d5653075-4799-49cf-9375-104ad344ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:16.156919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5653075-4799-49cf-9375-104ad344ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:16.160522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5653075-4799-49cf-9375-104ad344ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:16.165352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5653075-4799-49cf-9375-104ad344ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:16.167955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5653075-4799-49cf-9375-104ad344ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:16.170355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5653075-4799-49cf-9375-104ad344ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:16.172450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5653075-4799-49cf-9375-104ad344ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:17.637391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0d730729-7289-4d1b-b006-76bbca129208 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:17.681678 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0d730729-7289-4d1b-b006-76bbca129208 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1321 microversion: 2.1 time: 2.598358 Aug 25 13:19:17.683800 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2118/4177] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:15 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1321 bytes in 2611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:17.719812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5ae66bf-9c37-4790-a6ec-4866375f87c8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:17.740084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b5ae66bf-9c37-4790-a6ec-4866375f87c8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:17.762236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ae66bf-9c37-4790-a6ec-4866375f87c8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:17.769421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ae66bf-9c37-4790-a6ec-4866375f87c8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:17.771860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ae66bf-9c37-4790-a6ec-4866375f87c8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:17.780444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ae66bf-9c37-4790-a6ec-4866375f87c8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:17.783669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ae66bf-9c37-4790-a6ec-4866375f87c8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:17.787017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5ae66bf-9c37-4790-a6ec-4866375f87c8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:18.747222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d5653075-4799-49cf-9375-104ad344ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:18.786362 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d5653075-4799-49cf-9375-104ad344ae83 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1532 microversion: 2.1 time: 2.698449 Aug 25 13:19:18.787873 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2060/4178] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:16 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1532 bytes in 2703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:18.803033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cfab0566-ef68-4e8e-a370-06d15437b8d2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:18.813187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cfab0566-ef68-4e8e-a370-06d15437b8d2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:18.853292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfab0566-ef68-4e8e-a370-06d15437b8d2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:18.858010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfab0566-ef68-4e8e-a370-06d15437b8d2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:18.860169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfab0566-ef68-4e8e-a370-06d15437b8d2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:18.866273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfab0566-ef68-4e8e-a370-06d15437b8d2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:18.869526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfab0566-ef68-4e8e-a370-06d15437b8d2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:18.873425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfab0566-ef68-4e8e-a370-06d15437b8d2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:20.202285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b5ae66bf-9c37-4790-a6ec-4866375f87c8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:20.274209 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b5ae66bf-9c37-4790-a6ec-4866375f87c8 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1663 microversion: 2.1 time: 2.579626 Aug 25 13:19:20.281496 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2119/4179] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:17 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1663 bytes in 2596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:20.316626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f43eaea-90d9-4229-a1d5-f75fc71e866a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:20.317803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f43eaea-90d9-4229-a1d5-f75fc71e866a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:20.374833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f43eaea-90d9-4229-a1d5-f75fc71e866a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:20.376109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f43eaea-90d9-4229-a1d5-f75fc71e866a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:20.376912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f43eaea-90d9-4229-a1d5-f75fc71e866a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:20.384371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f43eaea-90d9-4229-a1d5-f75fc71e866a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:20.391682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f43eaea-90d9-4229-a1d5-f75fc71e866a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:20.392489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f43eaea-90d9-4229-a1d5-f75fc71e866a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:20.722108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cfab0566-ef68-4e8e-a370-06d15437b8d2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:20.780039 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cfab0566-ef68-4e8e-a370-06d15437b8d2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1321 microversion: 2.1 time: 1.988368 Aug 25 13:19:20.786754 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2061/4180] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:18 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1321 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:21.336608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2e807882-da35-4a33-8228-ff42a5d87ea3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:21.351075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2e807882-da35-4a33-8228-ff42a5d87ea3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:21.368781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e807882-da35-4a33-8228-ff42a5d87ea3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:21.371809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e807882-da35-4a33-8228-ff42a5d87ea3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:21.376457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e807882-da35-4a33-8228-ff42a5d87ea3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:21.378726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e807882-da35-4a33-8228-ff42a5d87ea3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:21.380209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e807882-da35-4a33-8228-ff42a5d87ea3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:21.381729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2e807882-da35-4a33-8228-ff42a5d87ea3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:22.706369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f43eaea-90d9-4229-a1d5-f75fc71e866a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:22.774791 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f43eaea-90d9-4229-a1d5-f75fc71e866a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 2.491238 Aug 25 13:19:22.788937 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2120/4181] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:20 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:22.798463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-6b194986-69ca-4590-a383-294b8528731d req-92b33e6d-2fa5-4500-b2d5-cb422acdd71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6362fd-0197-4636-8a8d-6814ba103aed", "name": "network-vif-plugged", "status": "completed", "tag": "221908ac-54e5-4185-a673-1a922869d2b5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:22.850288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6b194986-69ca-4590-a383-294b8528731d req-92b33e6d-2fa5-4500-b2d5-cb422acdd71c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:22.855651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6b194986-69ca-4590-a383-294b8528731d req-92b33e6d-2fa5-4500-b2d5-cb422acdd71c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:22.856890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6b194986-69ca-4590-a383-294b8528731d req-92b33e6d-2fa5-4500-b2d5-cb422acdd71c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:22.908739 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-6b194986-69ca-4590-a383-294b8528731d req-92b33e6d-2fa5-4500-b2d5-cb422acdd71c service nova] Creating event network-vif-plugged:221908ac-54e5-4185-a673-1a922869d2b5 for instance cc6362fd-0197-4636-8a8d-6814ba103aed on n-h2-852771-8 Aug 25 13:19:22.931176 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-6b194986-69ca-4590-a383-294b8528731d req-92b33e6d-2fa5-4500-b2d5-cb422acdd71c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139604 Aug 25 13:19:22.934471 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2121/4182] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:19:22.950753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3fca444d-278c-4c2e-982e-5b7ae2b909d7 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:22.952520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3fca444d-278c-4c2e-982e-5b7ae2b909d7 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:22.977565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fca444d-278c-4c2e-982e-5b7ae2b909d7 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:22.980018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fca444d-278c-4c2e-982e-5b7ae2b909d7 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:22.981212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fca444d-278c-4c2e-982e-5b7ae2b909d7 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:22.986983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fca444d-278c-4c2e-982e-5b7ae2b909d7 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:22.988288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fca444d-278c-4c2e-982e-5b7ae2b909d7 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:22.989488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fca444d-278c-4c2e-982e-5b7ae2b909d7 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:23.559404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2e807882-da35-4a33-8228-ff42a5d87ea3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:23.593898 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2e807882-da35-4a33-8228-ff42a5d87ea3 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.270292 Aug 25 13:19:23.720829 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2062/4183] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:21 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:19:23.744505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8bda09a8-8603-4db8-b14f-0be0170caff6 req-dac58a6e-fc65-4134-9777-58bf8cd772c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a51c4138-b024-45b6-88ca-222fdfe3d9dd", "tag": "db9db7f2-e3de-4f8c-969c-7d089b1349af"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:23.780657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8bda09a8-8603-4db8-b14f-0be0170caff6 req-dac58a6e-fc65-4134-9777-58bf8cd772c8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:23.791653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8bda09a8-8603-4db8-b14f-0be0170caff6 req-dac58a6e-fc65-4134-9777-58bf8cd772c8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:23.796935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8bda09a8-8603-4db8-b14f-0be0170caff6 req-dac58a6e-fc65-4134-9777-58bf8cd772c8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:23.900142 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8bda09a8-8603-4db8-b14f-0be0170caff6 req-dac58a6e-fc65-4134-9777-58bf8cd772c8 service nova] Creating event network-changed:db9db7f2-e3de-4f8c-969c-7d089b1349af for instance a51c4138-b024-45b6-88ca-222fdfe3d9dd on n-h1-852771-8 Aug 25 13:19:23.931317 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8bda09a8-8603-4db8-b14f-0be0170caff6 req-dac58a6e-fc65-4134-9777-58bf8cd772c8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207631 Aug 25 13:19:23.945858 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2063/4184] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:19:23.965936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6ec8a220-efc5-4ca6-951c-6c2b7e0caa27 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:23.967336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6ec8a220-efc5-4ca6-951c-6c2b7e0caa27 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:24.036124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ec8a220-efc5-4ca6-951c-6c2b7e0caa27 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:24.037080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ec8a220-efc5-4ca6-951c-6c2b7e0caa27 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:24.038229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ec8a220-efc5-4ca6-951c-6c2b7e0caa27 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:24.039657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ec8a220-efc5-4ca6-951c-6c2b7e0caa27 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:24.058177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ec8a220-efc5-4ca6-951c-6c2b7e0caa27 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:24.068703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ec8a220-efc5-4ca6-951c-6c2b7e0caa27 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:24.673287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3fca444d-278c-4c2e-982e-5b7ae2b909d7 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:24.717960 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3fca444d-278c-4c2e-982e-5b7ae2b909d7 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1321 microversion: 2.1 time: 1.780852 Aug 25 13:19:24.719105 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2122/4185] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:22 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1321 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:24.762051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9e872bfc-2737-4520-98ab-4d551f70de45 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:24.781549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9e872bfc-2737-4520-98ab-4d551f70de45 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:24.851027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e872bfc-2737-4520-98ab-4d551f70de45 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:24.855645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e872bfc-2737-4520-98ab-4d551f70de45 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:24.858585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e872bfc-2737-4520-98ab-4d551f70de45 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:24.862548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e872bfc-2737-4520-98ab-4d551f70de45 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:24.864095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e872bfc-2737-4520-98ab-4d551f70de45 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:24.865363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e872bfc-2737-4520-98ab-4d551f70de45 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:26.394437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6ec8a220-efc5-4ca6-951c-6c2b7e0caa27 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:26.438785 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6ec8a220-efc5-4ca6-951c-6c2b7e0caa27 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.490147 Aug 25 13:19:26.448360 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2064/4186] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:23 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:26.477915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8876a935-3a0e-46ad-82ac-1c56f44827da req-5662a1e6-cc67-46b5-9f64-cd321f970ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb397fbc-b7a9-4839-9780-0699382d3575", "name": "network-vif-plugged", "status": "completed", "tag": "e86480d8-b7d2-4b3a-bc3f-9cc6f5f5501e"}, {"server_uuid": "613a86a8-72d2-47f7-ac9d-4151e827126c", "name": "network-vif-plugged", "status": "completed", "tag": "c21e142d-de3c-412b-8332-d9a4448c0226"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:26.563969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:26.604365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8876a935-3a0e-46ad-82ac-1c56f44827da req-5662a1e6-cc67-46b5-9f64-cd321f970ef3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:26.605775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8876a935-3a0e-46ad-82ac-1c56f44827da req-5662a1e6-cc67-46b5-9f64-cd321f970ef3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:26.606661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8876a935-3a0e-46ad-82ac-1c56f44827da req-5662a1e6-cc67-46b5-9f64-cd321f970ef3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:26.668182 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8876a935-3a0e-46ad-82ac-1c56f44827da req-5662a1e6-cc67-46b5-9f64-cd321f970ef3 service nova] Creating event network-vif-plugged:e86480d8-b7d2-4b3a-bc3f-9cc6f5f5501e for instance eb397fbc-b7a9-4839-9780-0699382d3575 on n-h1-852771-8 Aug 25 13:19:26.668984 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8876a935-3a0e-46ad-82ac-1c56f44827da req-5662a1e6-cc67-46b5-9f64-cd321f970ef3 service nova] Creating event network-vif-plugged:c21e142d-de3c-412b-8332-d9a4448c0226 for instance 613a86a8-72d2-47f7-ac9d-4151e827126c on n-h2-852771-8 Aug 25 13:19:26.743414 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8876a935-3a0e-46ad-82ac-1c56f44827da req-5662a1e6-cc67-46b5-9f64-cd321f970ef3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.292303 Aug 25 13:19:26.757693 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2065/4187] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:19:26.814002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c43eb5a9-de7d-41b4-8f79-adbfdcc03892 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:26.820209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c43eb5a9-de7d-41b4-8f79-adbfdcc03892 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:26.879073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c43eb5a9-de7d-41b4-8f79-adbfdcc03892 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:26.879989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c43eb5a9-de7d-41b4-8f79-adbfdcc03892 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:26.890815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c43eb5a9-de7d-41b4-8f79-adbfdcc03892 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:26.898871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c43eb5a9-de7d-41b4-8f79-adbfdcc03892 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:26.900861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c43eb5a9-de7d-41b4-8f79-adbfdcc03892 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:26.909004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c43eb5a9-de7d-41b4-8f79-adbfdcc03892 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:27.692429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9e872bfc-2737-4520-98ab-4d551f70de45 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:27.725864 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9e872bfc-2737-4520-98ab-4d551f70de45 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 2.992920 Aug 25 13:19:27.728466 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2123/4188] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:24 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 3009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:27.747200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e924bba7-609d-479c-a8f3-364d23183eaf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:27.752573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e924bba7-609d-479c-a8f3-364d23183eaf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:27.781650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e924bba7-609d-479c-a8f3-364d23183eaf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:27.790004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e924bba7-609d-479c-a8f3-364d23183eaf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:27.791361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e924bba7-609d-479c-a8f3-364d23183eaf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:27.793032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e924bba7-609d-479c-a8f3-364d23183eaf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:27.799305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e924bba7-609d-479c-a8f3-364d23183eaf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:27.800667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e924bba7-609d-479c-a8f3-364d23183eaf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:28.398997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c43eb5a9-de7d-41b4-8f79-adbfdcc03892 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:28.429048 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c43eb5a9-de7d-41b4-8f79-adbfdcc03892 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1321 microversion: 2.1 time: 1.663567 Aug 25 13:19:28.458243 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2066/4189] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:26 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1321 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:28.473280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e924bba7-609d-479c-a8f3-364d23183eaf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:28.503879 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e924bba7-609d-479c-a8f3-364d23183eaf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 0.763970 Aug 25 13:19:28.510523 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2124/4190] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:27 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:28.560360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-597c5cdb-78cd-48a0-b9b4-264357d9e715 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:28.562020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-597c5cdb-78cd-48a0-b9b4-264357d9e715 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:28.574589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597c5cdb-78cd-48a0-b9b4-264357d9e715 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:28.575922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597c5cdb-78cd-48a0-b9b4-264357d9e715 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:28.576978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597c5cdb-78cd-48a0-b9b4-264357d9e715 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:28.578803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597c5cdb-78cd-48a0-b9b4-264357d9e715 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:28.579983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597c5cdb-78cd-48a0-b9b4-264357d9e715 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:28.581192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597c5cdb-78cd-48a0-b9b4-264357d9e715 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:28.777033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0898afaf-41b2-4610-bf84-7176ece4e602 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:28.783241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0898afaf-41b2-4610-bf84-7176ece4e602 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:28.821119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0898afaf-41b2-4610-bf84-7176ece4e602 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:28.827188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0898afaf-41b2-4610-bf84-7176ece4e602 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:28.828641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0898afaf-41b2-4610-bf84-7176ece4e602 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:28.832924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0898afaf-41b2-4610-bf84-7176ece4e602 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:28.839839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0898afaf-41b2-4610-bf84-7176ece4e602 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:28.841247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0898afaf-41b2-4610-bf84-7176ece4e602 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:29.965211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0898afaf-41b2-4610-bf84-7176ece4e602 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:29.997971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-597c5cdb-78cd-48a0-b9b4-264357d9e715 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:30.003888 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0898afaf-41b2-4610-bf84-7176ece4e602 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 1.235298 Aug 25 13:19:30.009434 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2125/4191] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:28 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:19:30.033002 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-597c5cdb-78cd-48a0-b9b4-264357d9e715 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.481121 Aug 25 13:19:30.034646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-68107017-11e9-457a-b696-d1f748c3d6ef tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:30.037186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-68107017-11e9-457a-b696-d1f748c3d6ef tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:30.046253 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2067/4192] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:28 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:30.063637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68107017-11e9-457a-b696-d1f748c3d6ef tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:30.070475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68107017-11e9-457a-b696-d1f748c3d6ef tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:30.072005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68107017-11e9-457a-b696-d1f748c3d6ef tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:30.078533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68107017-11e9-457a-b696-d1f748c3d6ef tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:30.079807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68107017-11e9-457a-b696-d1f748c3d6ef tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:30.080918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68107017-11e9-457a-b696-d1f748c3d6ef tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:30.088641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-126178ab-3ce2-49bc-9976-507f332b9d32 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:30.090446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-126178ab-3ce2-49bc-9976-507f332b9d32 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:30.119905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126178ab-3ce2-49bc-9976-507f332b9d32 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:30.126488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126178ab-3ce2-49bc-9976-507f332b9d32 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:30.128856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126178ab-3ce2-49bc-9976-507f332b9d32 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:30.135274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126178ab-3ce2-49bc-9976-507f332b9d32 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:30.136943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126178ab-3ce2-49bc-9976-507f332b9d32 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:30.140714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-126178ab-3ce2-49bc-9976-507f332b9d32 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:32.170956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-126178ab-3ce2-49bc-9976-507f332b9d32 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:32.203412 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-126178ab-3ce2-49bc-9976-507f332b9d32 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 2.126308 Aug 25 13:19:32.242105 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2068/4193] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:30 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:19:32.267316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-96490577-6c5e-472d-9a6c-7f504b48e0e0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:32.272152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-96490577-6c5e-472d-9a6c-7f504b48e0e0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:32.291966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96490577-6c5e-472d-9a6c-7f504b48e0e0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:32.293422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96490577-6c5e-472d-9a6c-7f504b48e0e0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:32.295313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96490577-6c5e-472d-9a6c-7f504b48e0e0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:32.297267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96490577-6c5e-472d-9a6c-7f504b48e0e0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:32.298698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96490577-6c5e-472d-9a6c-7f504b48e0e0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:32.301850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96490577-6c5e-472d-9a6c-7f504b48e0e0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:32.360716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=95 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:32.967268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-68107017-11e9-457a-b696-d1f748c3d6ef tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:33.016035 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-68107017-11e9-457a-b696-d1f748c3d6ef tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1321 microversion: 2.1 time: 3.000796 Aug 25 13:19:33.029302 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2126/4194] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:30 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1321 bytes in 3019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:33.044699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-033cc00a-fa60-4d18-a8f7-126c46b6da89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:33.057781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-033cc00a-fa60-4d18-a8f7-126c46b6da89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:33.091150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-033cc00a-fa60-4d18-a8f7-126c46b6da89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:33.096482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-033cc00a-fa60-4d18-a8f7-126c46b6da89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:33.098935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-033cc00a-fa60-4d18-a8f7-126c46b6da89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:33.101290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-033cc00a-fa60-4d18-a8f7-126c46b6da89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:33.106376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-033cc00a-fa60-4d18-a8f7-126c46b6da89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:33.108066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-033cc00a-fa60-4d18-a8f7-126c46b6da89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:33.239771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-033cc00a-fa60-4d18-a8f7-126c46b6da89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lazy-loading 'flavor' on Instance uuid fe3eccca-1677-409a-bcf9-99d321525b2b {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:19:33.503762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:33.577724 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-033cc00a-fa60-4d18-a8f7-126c46b6da89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.545513 Aug 25 13:19:33.587823 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2127/4195] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:19:33 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:19:33.648625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-254a5ba7-da43-4b53-bf98-424d0ff01bff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:33.662161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-254a5ba7-da43-4b53-bf98-424d0ff01bff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:33.701154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-254a5ba7-da43-4b53-bf98-424d0ff01bff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:33.720151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-254a5ba7-da43-4b53-bf98-424d0ff01bff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:33.720151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-254a5ba7-da43-4b53-bf98-424d0ff01bff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:33.720151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-254a5ba7-da43-4b53-bf98-424d0ff01bff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:33.720151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-254a5ba7-da43-4b53-bf98-424d0ff01bff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:33.720151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-254a5ba7-da43-4b53-bf98-424d0ff01bff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:35.375802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-254a5ba7-da43-4b53-bf98-424d0ff01bff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:35.421290 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-254a5ba7-da43-4b53-bf98-424d0ff01bff tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1675 microversion: 2.1 time: 1.824778 Aug 25 13:19:35.425178 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2128/4196] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:33 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1675 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:35.459832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2410f637-6bda-428a-8c9c-cbaddfd7f971 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:35.465918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2410f637-6bda-428a-8c9c-cbaddfd7f971 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:35.488643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2410f637-6bda-428a-8c9c-cbaddfd7f971 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:35.491596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2410f637-6bda-428a-8c9c-cbaddfd7f971 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:35.493564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2410f637-6bda-428a-8c9c-cbaddfd7f971 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:35.495694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2410f637-6bda-428a-8c9c-cbaddfd7f971 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:35.497414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2410f637-6bda-428a-8c9c-cbaddfd7f971 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:35.499111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2410f637-6bda-428a-8c9c-cbaddfd7f971 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:37.641108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-96490577-6c5e-472d-9a6c-7f504b48e0e0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:37.682269 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-96490577-6c5e-472d-9a6c-7f504b48e0e0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 5.429770 Aug 25 13:19:37.684506 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2069/4197] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:32 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 5441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:37.701038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9b3ac37d-4873-4452-9737-8cde4b588b67 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:37.706807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9b3ac37d-4873-4452-9737-8cde4b588b67 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:37.732799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b3ac37d-4873-4452-9737-8cde4b588b67 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:37.737581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b3ac37d-4873-4452-9737-8cde4b588b67 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:37.741411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b3ac37d-4873-4452-9737-8cde4b588b67 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:37.746447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b3ac37d-4873-4452-9737-8cde4b588b67 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:37.747894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b3ac37d-4873-4452-9737-8cde4b588b67 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:37.751631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b3ac37d-4873-4452-9737-8cde4b588b67 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:38.342209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2410f637-6bda-428a-8c9c-cbaddfd7f971 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:38.373543 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2410f637-6bda-428a-8c9c-cbaddfd7f971 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1321 microversion: 2.1 time: 2.943094 Aug 25 13:19:38.378421 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2129/4198] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:35 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1321 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:38.732860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-803e8aa2-d0c6-48af-b22d-64f93ea5e2b4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:38.734706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-803e8aa2-d0c6-48af-b22d-64f93ea5e2b4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:38.751304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-803e8aa2-d0c6-48af-b22d-64f93ea5e2b4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:38.752842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-803e8aa2-d0c6-48af-b22d-64f93ea5e2b4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:38.754146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-803e8aa2-d0c6-48af-b22d-64f93ea5e2b4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:38.756604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-803e8aa2-d0c6-48af-b22d-64f93ea5e2b4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:38.758812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-803e8aa2-d0c6-48af-b22d-64f93ea5e2b4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:38.760314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-803e8aa2-d0c6-48af-b22d-64f93ea5e2b4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:39.241929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9b3ac37d-4873-4452-9737-8cde4b588b67 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:39.290533 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9b3ac37d-4873-4452-9737-8cde4b588b67 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1658 microversion: 2.1 time: 1.603088 Aug 25 13:19:39.291683 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2070/4199] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:37 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1658 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:39.400645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-efe46290-92f9-43f9-ac9c-d142a46b221b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:39.430538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-efe46290-92f9-43f9-ac9c-d142a46b221b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:39.467072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efe46290-92f9-43f9-ac9c-d142a46b221b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:39.468859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efe46290-92f9-43f9-ac9c-d142a46b221b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:39.471044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efe46290-92f9-43f9-ac9c-d142a46b221b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:39.479380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efe46290-92f9-43f9-ac9c-d142a46b221b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:39.482179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efe46290-92f9-43f9-ac9c-d142a46b221b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:39.483624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efe46290-92f9-43f9-ac9c-d142a46b221b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:40.138741 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-efe46290-92f9-43f9-ac9c-d142a46b221b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action" status: 202 len: 0 microversion: 2.1 time: 0.759896 Aug 25 13:19:40.153789 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2071/4200] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:19:39 2022] POST /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:19:40.193774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-924c3fa5-36d8-45a3-a97f-a6531143fb99 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:40.200415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-924c3fa5-36d8-45a3-a97f-a6531143fb99 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:40.234200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924c3fa5-36d8-45a3-a97f-a6531143fb99 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:40.235171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924c3fa5-36d8-45a3-a97f-a6531143fb99 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:40.245563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924c3fa5-36d8-45a3-a97f-a6531143fb99 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:40.245563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924c3fa5-36d8-45a3-a97f-a6531143fb99 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:40.247932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924c3fa5-36d8-45a3-a97f-a6531143fb99 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:40.248817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-924c3fa5-36d8-45a3-a97f-a6531143fb99 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:40.697175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-803e8aa2-d0c6-48af-b22d-64f93ea5e2b4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:40.743783 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-803e8aa2-d0c6-48af-b22d-64f93ea5e2b4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 2.024560 Aug 25 13:19:40.745838 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2130/4201] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:38 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:40.755709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43958cc1-f3b0-4d28-8263-652a76482836 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:40.757633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43958cc1-f3b0-4d28-8263-652a76482836 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:40.790988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43958cc1-f3b0-4d28-8263-652a76482836 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:40.795539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43958cc1-f3b0-4d28-8263-652a76482836 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:40.799954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43958cc1-f3b0-4d28-8263-652a76482836 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:40.812444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43958cc1-f3b0-4d28-8263-652a76482836 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:40.814114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43958cc1-f3b0-4d28-8263-652a76482836 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:40.815152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43958cc1-f3b0-4d28-8263-652a76482836 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:42.560539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43958cc1-f3b0-4d28-8263-652a76482836 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:42.615024 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43958cc1-f3b0-4d28-8263-652a76482836 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1664 microversion: 2.1 time: 1.866134 Aug 25 13:19:42.633601 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2131/4202] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:40 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1664 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:43.300295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-924c3fa5-36d8-45a3-a97f-a6531143fb99 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:43.356852 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-924c3fa5-36d8-45a3-a97f-a6531143fb99 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1321 microversion: 2.1 time: 3.199316 Aug 25 13:19:43.371261 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2072/4203] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:40 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1321 bytes in 3217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:43.398960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-fbe04c97-8ee0-424d-89d3-8bc0a66aa794 req-ef0d6843-a92c-4d73-98bb-b207ecf18db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51c4138-b024-45b6-88ca-222fdfe3d9dd", "name": "network-vif-plugged", "status": "completed", "tag": "db9db7f2-e3de-4f8c-969c-7d089b1349af"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:43.458069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fbe04c97-8ee0-424d-89d3-8bc0a66aa794 req-ef0d6843-a92c-4d73-98bb-b207ecf18db0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:43.472479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fbe04c97-8ee0-424d-89d3-8bc0a66aa794 req-ef0d6843-a92c-4d73-98bb-b207ecf18db0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:43.479130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-fbe04c97-8ee0-424d-89d3-8bc0a66aa794 req-ef0d6843-a92c-4d73-98bb-b207ecf18db0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:43.595270 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-fbe04c97-8ee0-424d-89d3-8bc0a66aa794 req-ef0d6843-a92c-4d73-98bb-b207ecf18db0 service nova] Creating event network-vif-plugged:db9db7f2-e3de-4f8c-969c-7d089b1349af for instance a51c4138-b024-45b6-88ca-222fdfe3d9dd on n-h1-852771-8 Aug 25 13:19:43.623389 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-fbe04c97-8ee0-424d-89d3-8bc0a66aa794 req-ef0d6843-a92c-4d73-98bb-b207ecf18db0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248469 Aug 25 13:19:43.625101 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2073/4204] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:19:43.683953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8c0ad559-0c69-4549-9c20-9a83b3ddadc7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:43.686264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8c0ad559-0c69-4549-9c20-9a83b3ddadc7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:43.711170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c0ad559-0c69-4549-9c20-9a83b3ddadc7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:43.714399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c0ad559-0c69-4549-9c20-9a83b3ddadc7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:43.715852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c0ad559-0c69-4549-9c20-9a83b3ddadc7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:43.723712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c0ad559-0c69-4549-9c20-9a83b3ddadc7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:43.725303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c0ad559-0c69-4549-9c20-9a83b3ddadc7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:43.726430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c0ad559-0c69-4549-9c20-9a83b3ddadc7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:43.984623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4502c7e1-90f8-4c43-988f-c606a8f3de4c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:43.991130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4502c7e1-90f8-4c43-988f-c606a8f3de4c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:44.015066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=30 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:44.043476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4502c7e1-90f8-4c43-988f-c606a8f3de4c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:44.044128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4502c7e1-90f8-4c43-988f-c606a8f3de4c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:44.055978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4502c7e1-90f8-4c43-988f-c606a8f3de4c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:44.057834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4502c7e1-90f8-4c43-988f-c606a8f3de4c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:44.062054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4502c7e1-90f8-4c43-988f-c606a8f3de4c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:44.070753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4502c7e1-90f8-4c43-988f-c606a8f3de4c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:45.670487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8c0ad559-0c69-4549-9c20-9a83b3ddadc7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:45.730165 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8c0ad559-0c69-4549-9c20-9a83b3ddadc7 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1664 microversion: 2.1 time: 2.059314 Aug 25 13:19:45.747868 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2074/4205] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:43 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1664 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:19:45.765739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0fb6ad8-f0af-4272-ad83-46c5685f4a2f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:45.788389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d0fb6ad8-f0af-4272-ad83-46c5685f4a2f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:45.806856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0fb6ad8-f0af-4272-ad83-46c5685f4a2f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:45.808229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0fb6ad8-f0af-4272-ad83-46c5685f4a2f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:45.809854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0fb6ad8-f0af-4272-ad83-46c5685f4a2f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:45.812829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0fb6ad8-f0af-4272-ad83-46c5685f4a2f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:45.814282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0fb6ad8-f0af-4272-ad83-46c5685f4a2f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:45.815393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0fb6ad8-f0af-4272-ad83-46c5685f4a2f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:46.310626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4502c7e1-90f8-4c43-988f-c606a8f3de4c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:46.337724 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4502c7e1-90f8-4c43-988f-c606a8f3de4c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 3.700169 Aug 25 13:19:46.350276 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2132/4206] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:42 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 3714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:46.794101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b581d9e2-a907-42a0-a095-b43ff627da12 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:46.797707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b581d9e2-a907-42a0-a095-b43ff627da12 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:46.825444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b581d9e2-a907-42a0-a095-b43ff627da12 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:46.827479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b581d9e2-a907-42a0-a095-b43ff627da12 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:46.829399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b581d9e2-a907-42a0-a095-b43ff627da12 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:46.831479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b581d9e2-a907-42a0-a095-b43ff627da12 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:46.833000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b581d9e2-a907-42a0-a095-b43ff627da12 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:46.835772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b581d9e2-a907-42a0-a095-b43ff627da12 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:47.451863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d0fb6ad8-f0af-4272-ad83-46c5685f4a2f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:47.480309 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d0fb6ad8-f0af-4272-ad83-46c5685f4a2f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1321 microversion: 2.1 time: 1.729679 Aug 25 13:19:47.513860 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2075/4207] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:45 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1321 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:47.528911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa923a35-7d8a-4cc4-87ca-d2378ff180c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:47.536176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa923a35-7d8a-4cc4-87ca-d2378ff180c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:47.567251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa923a35-7d8a-4cc4-87ca-d2378ff180c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:47.568695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa923a35-7d8a-4cc4-87ca-d2378ff180c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:47.569929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa923a35-7d8a-4cc4-87ca-d2378ff180c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:47.571686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa923a35-7d8a-4cc4-87ca-d2378ff180c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:47.575104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa923a35-7d8a-4cc4-87ca-d2378ff180c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:47.576474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa923a35-7d8a-4cc4-87ca-d2378ff180c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:50.524001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fa923a35-7d8a-4cc4-87ca-d2378ff180c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:50.547624 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa923a35-7d8a-4cc4-87ca-d2378ff180c3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 3.031245 Aug 25 13:19:50.549789 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2076/4208] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:47 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 3035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:50.567599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d54eb37b-5f81-4884-a5ae-1044b00b628b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:50.569395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d54eb37b-5f81-4884-a5ae-1044b00b628b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:50.608833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54eb37b-5f81-4884-a5ae-1044b00b628b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:50.616077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54eb37b-5f81-4884-a5ae-1044b00b628b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:50.617563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54eb37b-5f81-4884-a5ae-1044b00b628b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:50.621882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54eb37b-5f81-4884-a5ae-1044b00b628b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:50.630844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54eb37b-5f81-4884-a5ae-1044b00b628b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:50.632323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54eb37b-5f81-4884-a5ae-1044b00b628b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:50.898918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b581d9e2-a907-42a0-a095-b43ff627da12 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:50.932601 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b581d9e2-a907-42a0-a095-b43ff627da12 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1664 microversion: 2.1 time: 4.146131 Aug 25 13:19:50.950356 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2133/4209] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:46 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1664 bytes in 4165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:51.598089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12c75ad2-86d0-4a96-916e-29f4948b669c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:51.598089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12c75ad2-86d0-4a96-916e-29f4948b669c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:51.649048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c75ad2-86d0-4a96-916e-29f4948b669c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:51.664859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c75ad2-86d0-4a96-916e-29f4948b669c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:51.667960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c75ad2-86d0-4a96-916e-29f4948b669c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:51.669369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c75ad2-86d0-4a96-916e-29f4948b669c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:51.670248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c75ad2-86d0-4a96-916e-29f4948b669c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:51.671033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12c75ad2-86d0-4a96-916e-29f4948b669c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:52.216872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d54eb37b-5f81-4884-a5ae-1044b00b628b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:52.273700 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d54eb37b-5f81-4884-a5ae-1044b00b628b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1510 microversion: 2.1 time: 1.715562 Aug 25 13:19:52.275804 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2077/4210] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:50 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1510 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:52.290884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bde0d69d-b1f0-4281-bd83-d34f8b959016 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:52.294401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bde0d69d-b1f0-4281-bd83-d34f8b959016 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:52.313393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bde0d69d-b1f0-4281-bd83-d34f8b959016 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:52.316509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bde0d69d-b1f0-4281-bd83-d34f8b959016 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:52.318762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bde0d69d-b1f0-4281-bd83-d34f8b959016 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:52.321907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bde0d69d-b1f0-4281-bd83-d34f8b959016 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:52.323149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bde0d69d-b1f0-4281-bd83-d34f8b959016 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:52.338027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bde0d69d-b1f0-4281-bd83-d34f8b959016 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:53.169268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12c75ad2-86d0-4a96-916e-29f4948b669c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:53.220655 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12c75ad2-86d0-4a96-916e-29f4948b669c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 1.630842 Aug 25 13:19:53.246479 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2134/4211] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:51 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:53.268020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce4a2b8d-51ab-492e-86e8-99be0429451d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:53.270292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ce4a2b8d-51ab-492e-86e8-99be0429451d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:53.288704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce4a2b8d-51ab-492e-86e8-99be0429451d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:53.291020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce4a2b8d-51ab-492e-86e8-99be0429451d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:53.292424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce4a2b8d-51ab-492e-86e8-99be0429451d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:53.294161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce4a2b8d-51ab-492e-86e8-99be0429451d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:53.295282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce4a2b8d-51ab-492e-86e8-99be0429451d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:53.296355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce4a2b8d-51ab-492e-86e8-99be0429451d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:53.323731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bde0d69d-b1f0-4281-bd83-d34f8b959016 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:53.356629 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bde0d69d-b1f0-4281-bd83-d34f8b959016 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.075795 Aug 25 13:19:53.358362 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2078/4212] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:52 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:53.415935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a636407c-bdd3-4301-ba43-b0543ac435ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:53.427456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a636407c-bdd3-4301-ba43-b0543ac435ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:53.495698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a636407c-bdd3-4301-ba43-b0543ac435ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:53.496736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a636407c-bdd3-4301-ba43-b0543ac435ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:53.507277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a636407c-bdd3-4301-ba43-b0543ac435ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:53.508887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a636407c-bdd3-4301-ba43-b0543ac435ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:53.509848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a636407c-bdd3-4301-ba43-b0543ac435ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:53.510677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a636407c-bdd3-4301-ba43-b0543ac435ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:54.687675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ce4a2b8d-51ab-492e-86e8-99be0429451d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:54.725964 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce4a2b8d-51ab-492e-86e8-99be0429451d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1510 microversion: 2.1 time: 1.476678 Aug 25 13:19:54.735860 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2135/4213] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:53 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1510 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:54.758856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a636407c-bdd3-4301-ba43-b0543ac435ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:54.766954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b5d893e-93e2-444b-ab85-2750b5627023 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:54.768166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b5d893e-93e2-444b-ab85-2750b5627023 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:54.801112 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a636407c-bdd3-4301-ba43-b0543ac435ce tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1667 microversion: 2.1 time: 1.397480 Aug 25 13:19:54.808143 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2079/4214] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:53 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1667 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:54.826273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5d893e-93e2-444b-ab85-2750b5627023 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:54.828010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5d893e-93e2-444b-ab85-2750b5627023 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:54.833411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5d893e-93e2-444b-ab85-2750b5627023 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:54.843846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5d893e-93e2-444b-ab85-2750b5627023 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:54.843846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5d893e-93e2-444b-ab85-2750b5627023 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:54.845482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-097dbdbd-c0d3-4e45-9b10-2a7ada8f6b8d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:54.847618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-097dbdbd-c0d3-4e45-9b10-2a7ada8f6b8d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: 613a86a8-72d2-47f7-ac9d-4151e827126c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:54.855238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5d893e-93e2-444b-ab85-2750b5627023 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:54.886048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-097dbdbd-c0d3-4e45-9b10-2a7ada8f6b8d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:54.888777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-097dbdbd-c0d3-4e45-9b10-2a7ada8f6b8d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:54.898097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-097dbdbd-c0d3-4e45-9b10-2a7ada8f6b8d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:54.904807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-097dbdbd-c0d3-4e45-9b10-2a7ada8f6b8d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:54.913070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-097dbdbd-c0d3-4e45-9b10-2a7ada8f6b8d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:54.922716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-097dbdbd-c0d3-4e45-9b10-2a7ada8f6b8d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:55.560510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b5d893e-93e2-444b-ab85-2750b5627023 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:55.622046 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b5d893e-93e2-444b-ab85-2750b5627023 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 0.879269 Aug 25 13:19:55.632675 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2136/4215] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:54 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:55.650930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:55.652428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:55.676790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:55.678387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:55.679521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:55.681194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:55.682735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:55.684179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:55.718626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-097dbdbd-c0d3-4e45-9b10-2a7ada8f6b8d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:55.761882 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-097dbdbd-c0d3-4e45-9b10-2a7ada8f6b8d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c" status: 200 len: 1509 microversion: 2.1 time: 0.945634 Aug 25 13:19:55.763163 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2080/4216] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:54 2022] GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c => generated 1509 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:55.804656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:55.818356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:19:55.827371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:55.840517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:19:55.848521 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.compute.api [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Working on deleting snapshot 7b0fba20-5685-48de-ad00-4eb63332eb1a from shelved instance... Aug 25 13:19:55.901903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:55.903560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:55.905946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:55.913621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:55.915280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:55.916444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:56.587771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:19:57.015176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:57.049236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:57.056232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:57.069603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:58.008425 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-08325658-58dd-472b-8232-e054dd9533a4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 2.212533 Aug 25 13:19:58.011203 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2081/4217] 10.222.0.70 () {58 vars in 1167 bytes} [Thu Aug 25 13:19:55 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:19:58.052881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2678f4e4-5e49-4d5d-8b50-576c8c085dde tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:58.054188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2678f4e4-5e49-4d5d-8b50-576c8c085dde tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:58.096114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=38 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:58.161497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2678f4e4-5e49-4d5d-8b50-576c8c085dde tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:58.162725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2678f4e4-5e49-4d5d-8b50-576c8c085dde tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:58.163677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2678f4e4-5e49-4d5d-8b50-576c8c085dde tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:58.165284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2678f4e4-5e49-4d5d-8b50-576c8c085dde tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:58.171673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2678f4e4-5e49-4d5d-8b50-576c8c085dde tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:58.172910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2678f4e4-5e49-4d5d-8b50-576c8c085dde tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:58.854413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Doing local delete in cell 638d90be-ffdb-4b61-b94a-775c50a724be(cell1) {{(pid=129060) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 25 13:19:58.858637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:58.860191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:58.861596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:58.863026 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.compute.api [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 25 13:19:58.870579 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:19:59.073419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2678f4e4-5e49-4d5d-8b50-576c8c085dde tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:59.094517 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2678f4e4-5e49-4d5d-8b50-576c8c085dde tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 1.079624 Aug 25 13:19:59.096330 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2082/4218] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:58 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:59.108294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:59.121963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:59.124448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-872474963', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:19:59.138181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:59.139574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:59.140758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:59.142699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:59.145112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:59.147283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:59.597700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:19:59.896506 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 47688. Aug 25 13:19:59.920186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] deallocate_for_instance() {{(pid=129060) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 25 13:19:59.957110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:59.993363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:59.994428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:59.995287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:00.706091 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-97a23dec-e5c3-4c95-8a4b-23616dae8522 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-872474963" status: 200 len: 1513 microversion: 2.1 time: 1.606380 Aug 25 13:20:00.709125 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2083/4219] 10.222.0.70 () {58 vars in 1261 bytes} [Thu Aug 25 13:19:59 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-872474963 => generated 1513 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:00.719800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a07e3514-c05e-4206-883d-ad06ded801d6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:00.725682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a07e3514-c05e-4206-883d-ad06ded801d6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:00.746577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a07e3514-c05e-4206-883d-ad06ded801d6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:00.752114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a07e3514-c05e-4206-883d-ad06ded801d6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:00.753741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a07e3514-c05e-4206-883d-ad06ded801d6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:00.764519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a07e3514-c05e-4206-883d-ad06ded801d6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:00.767231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a07e3514-c05e-4206-883d-ad06ded801d6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:00.769154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a07e3514-c05e-4206-883d-ad06ded801d6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:00.873960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:01.373074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a07e3514-c05e-4206-883d-ad06ded801d6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:01.393135 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a07e3514-c05e-4206-883d-ad06ded801d6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 0.681724 Aug 25 13:20:01.405968 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2084/4220] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:00 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:01.444684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:01.495654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:01.497557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:01.537829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:01.538578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:01.539383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:01.547325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:01.548362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:01.549168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:02.150989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:20:02.571133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:02.605278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:02.606609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:02.607535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:02.722461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Updating instance_info_cache with network_info: [] {{(pid=129060) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 13:20:03.870697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=77,nova_cell1:UPDATE=5,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:04.184117 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85b24ccc-fea2-420c-b05c-3cb3d9d74652 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 204 len: 0 microversion: 2.1 time: 8.548757 Aug 25 13:20:04.196594 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2137/4221] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:19:55 2022] DELETE /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 0 bytes in 8555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:20:04.224366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce0c7593-b1d9-407e-8b1f-79247a965cd6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:04.226054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ce0c7593-b1d9-407e-8b1f-79247a965cd6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:04.259769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0c7593-b1d9-407e-8b1f-79247a965cd6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:04.262055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0c7593-b1d9-407e-8b1f-79247a965cd6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:04.265976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0c7593-b1d9-407e-8b1f-79247a965cd6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:04.266637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0c7593-b1d9-407e-8b1f-79247a965cd6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:04.272565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0c7593-b1d9-407e-8b1f-79247a965cd6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:04.273955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0c7593-b1d9-407e-8b1f-79247a965cd6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:04.844098 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c22f4ebb-dd21-4798-ba7a-1b5616b75b9c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4512 microversion: 2.1 time: 3.434294 Aug 25 13:20:04.846938 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2085/4222] 10.222.0.70 () {58 vars in 1173 bytes} [Thu Aug 25 13:20:01 2022] GET /compute/v2.1/servers/detail?status=active => generated 4512 bytes in 3440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:04.863623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a063b956-8505-41c4-994b-aec20d51b901 req-054ae64f-72d3-4934-a6bd-e398f3f1750b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7077e0f1-eda0-4e8e-8f81-a64989f35696", "name": "network-vif-deleted", "tag": "a659e858-0072-4d47-b4ff-36f0aab011f7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:04.914864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a063b956-8505-41c4-994b-aec20d51b901 req-054ae64f-72d3-4934-a6bd-e398f3f1750b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:04.916375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a063b956-8505-41c4-994b-aec20d51b901 req-054ae64f-72d3-4934-a6bd-e398f3f1750b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:04.920273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a063b956-8505-41c4-994b-aec20d51b901 req-054ae64f-72d3-4934-a6bd-e398f3f1750b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:04.979981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.server_external_events [req-a063b956-8505-41c4-994b-aec20d51b901 req-054ae64f-72d3-4934-a6bd-e398f3f1750b service nova] Unable to find a host for instance 7077e0f1-eda0-4e8e-8f81-a64989f35696. Dropping event network-vif-deleted {{(pid=129059) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 13:20:04.983237 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a063b956-8505-41c4-994b-aec20d51b901 req-054ae64f-72d3-4934-a6bd-e398f3f1750b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.132982 Aug 25 13:20:04.994247 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2086/4223] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 146 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 13:20:05.013604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:05.019356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 7077e0f1-eda0-4e8e-8f81-a64989f35696] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:05.047709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:05.049034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:05.050905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:05.052482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:05.057084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:05.058461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:05.125547 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] HTTP exception thrown: Instance 7077e0f1-eda0-4e8e-8f81-a64989f35696 could not be found. Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Request method failure captured: Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 HTTP/1.1 Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3Mr9cWgACYm-JJJ3jtHrhjTUF1SZTk5SfB-onmYg_dkoF9Umi4EcFGUk_Hxt1tkajZlvH92Le8pKZsZ_x3nzluflBOJ0M8UYE0mStiqoLa4TCWq76ZCTPEE_7qbDlcr456ZSpBTxR3-8SWamaTMIPsT_5mpLgXenA2keElRqYPMqBw Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8de71f9e1804c46ab8f18f48a5fff42", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}] Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e320ccc6c0624541895fc42bf681da76 Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7077e0f1-eda0-4e8e-8f81-a64989f35696 could not be found. Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7077e0f1-eda0-4e8e-8f81-a64989f35696'} Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7077e0f1-eda0-4e8e-8f81-a64989f35696 could not be found. Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7077e0f1-eda0-4e8e-8f81-a64989f35696 could not be found. Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:05.140032 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:05.149240 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:05.149240 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:05.149240 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:05.149240 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:20:05.149240 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:20:05.149240 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7077e0f1-eda0-4e8e-8f81-a64989f35696 could not be found. Aug 25 13:20:05.149240 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:05.153102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Returning 404 to user: Instance 7077e0f1-eda0-4e8e-8f81-a64989f35696 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:20:05.155083 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c64dab7d-ed9a-4f72-aa49-7a547db60981 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696" status: 404 len: 111 microversion: 2.1 time: 0.158552 Aug 25 13:20:05.177299 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2087/4224] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:04 2022] GET /compute/v2.1/servers/7077e0f1-eda0-4e8e-8f81-a64989f35696 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:20:05.201018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:05.238106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:05.244111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.servers [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Removing options 'limit' from query {{(pid=129059) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 25 13:20:05.249837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:05.280884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:05.282035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:05.286047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:05.294176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:05.295496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:05.300366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:05.469440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:05.483159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:05.484641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:05.488731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:06.091645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ce0c7593-b1d9-407e-8b1f-79247a965cd6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:06.141948 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce0c7593-b1d9-407e-8b1f-79247a965cd6 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 1.936807 Aug 25 13:20:06.180478 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2138/4225] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:04 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:06.207158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-343dc195-1a24-4e9a-9c8e-cd5ed5d87e0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:06.212472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-343dc195-1a24-4e9a-9c8e-cd5ed5d87e0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:06.251846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-343dc195-1a24-4e9a-9c8e-cd5ed5d87e0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:06.256275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-343dc195-1a24-4e9a-9c8e-cd5ed5d87e0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:06.261098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-343dc195-1a24-4e9a-9c8e-cd5ed5d87e0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:06.267422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-343dc195-1a24-4e9a-9c8e-cd5ed5d87e0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:06.278042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-343dc195-1a24-4e9a-9c8e-cd5ed5d87e0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:06.279708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-343dc195-1a24-4e9a-9c8e-cd5ed5d87e0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:06.510605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-343dc195-1a24-4e9a-9c8e-cd5ed5d87e0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:20:07.083259 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-343dc195-1a24-4e9a-9c8e-cd5ed5d87e0d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 204 len: 0 microversion: 2.1 time: 0.899468 Aug 25 13:20:07.089619 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2139/4226] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:20:06 2022] DELETE /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 0 bytes in 903 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:20:07.109927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ed15a057-c81d-4c92-b6e7-a618cde2c70e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:07.114896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ed15a057-c81d-4c92-b6e7-a618cde2c70e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:07.141422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed15a057-c81d-4c92-b6e7-a618cde2c70e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:07.148520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed15a057-c81d-4c92-b6e7-a618cde2c70e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:07.149721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed15a057-c81d-4c92-b6e7-a618cde2c70e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:07.151672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed15a057-c81d-4c92-b6e7-a618cde2c70e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:07.156559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed15a057-c81d-4c92-b6e7-a618cde2c70e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:07.157771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed15a057-c81d-4c92-b6e7-a618cde2c70e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:07.676401 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3b7b05f3-8206-48fc-87ac-7deb4bbc4766 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 2.496010 Aug 25 13:20:07.677977 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2088/4227] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 13:20:05 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 2500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:07.687411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e93990d9-79d4-4136-bbfb-74c132ad4054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:07.697697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e93990d9-79d4-4136-bbfb-74c132ad4054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:07.719889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ed15a057-c81d-4c92-b6e7-a618cde2c70e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:07.731459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e93990d9-79d4-4136-bbfb-74c132ad4054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:07.732499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e93990d9-79d4-4136-bbfb-74c132ad4054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:07.733287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e93990d9-79d4-4136-bbfb-74c132ad4054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:07.739184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e93990d9-79d4-4136-bbfb-74c132ad4054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:07.740045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e93990d9-79d4-4136-bbfb-74c132ad4054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:07.740806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e93990d9-79d4-4136-bbfb-74c132ad4054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:07.757887 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ed15a057-c81d-4c92-b6e7-a618cde2c70e tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1466 microversion: 2.1 time: 0.665613 Aug 25 13:20:07.759673 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2140/4228] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:07 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1466 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:07.790796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:07.804478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:07.811311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:07.842917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:07.844002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:07.850025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:07.854959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:07.859078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:07.860032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:08.384302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:20:08.867495 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fb27f8cb-0fe6-4dc8-88d0-4e96deee05b0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 1.105695 Aug 25 13:20:08.885738 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2141/4229] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 13:20:07 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:08.920427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1abb467-802a-417f-8f30-fc8fe6957b29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:08.921493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c1abb467-802a-417f-8f30-fc8fe6957b29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:08.968388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1abb467-802a-417f-8f30-fc8fe6957b29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:08.969328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1abb467-802a-417f-8f30-fc8fe6957b29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:08.980211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1abb467-802a-417f-8f30-fc8fe6957b29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:08.988709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1abb467-802a-417f-8f30-fc8fe6957b29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:08.990293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1abb467-802a-417f-8f30-fc8fe6957b29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:08.991705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1abb467-802a-417f-8f30-fc8fe6957b29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:11.020138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e93990d9-79d4-4136-bbfb-74c132ad4054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:11.082273 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e93990d9-79d4-4136-bbfb-74c132ad4054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 3.390940 Aug 25 13:20:11.102845 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2089/4230] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:07 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 3423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:11.159767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:11.160380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1abb467-802a-417f-8f30-fc8fe6957b29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:11.171565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:11.172958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.servers [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Removing options 'limit' from query {{(pid=129059) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 25 13:20:11.192360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:11.197198 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c1abb467-802a-417f-8f30-fc8fe6957b29 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1466 microversion: 2.1 time: 2.317230 Aug 25 13:20:11.207710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:11.209225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:11.210731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:11.222227 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2142/4231] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:08 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1466 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:11.227250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:11.228703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:11.231040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:11.349969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:20:11.610762 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72cc8f99-6e57-4564-95a5-bdf53a68c4fc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.474330 Aug 25 13:20:11.612763 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2090/4232] 10.222.0.70 () {58 vars in 1150 bytes} [Thu Aug 25 13:20:11 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:11.655047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:11.682583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:11.686080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:11.732979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:11.739113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:11.744138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:11.753744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:11.756679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:11.767275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:11.871937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:20:11.965122 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b73d2b5c-33a9-4f91-8b3f-5fb9b2a9b0d9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.321193 Aug 25 13:20:11.967522 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2143/4233] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 13:20:11 2022] GET /compute/v2.1/servers => generated 1010 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:11.995186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:12.026440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:12.027968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:12.073439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:12.083132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:12.083886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:12.085611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:12.086816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:12.087881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:12.135883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e3e3111a-55d4-403b-99da-3b7727710500 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:12.139828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e3e3111a-55d4-403b-99da-3b7727710500 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:12.180269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3e3111a-55d4-403b-99da-3b7727710500 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:12.183978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3e3111a-55d4-403b-99da-3b7727710500 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:12.184893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3e3111a-55d4-403b-99da-3b7727710500 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:12.191212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3e3111a-55d4-403b-99da-3b7727710500 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:12.192173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3e3111a-55d4-403b-99da-3b7727710500 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:12.192954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3e3111a-55d4-403b-99da-3b7727710500 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:12.464977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:20:12.870791 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6e654c56-e093-4e78-940d-8b270b570814 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.889186 Aug 25 13:20:12.887817 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2091/4234] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 13:20:11 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:12.921832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-362e6c99-cf04-4055-8915-c5457ad7c938 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:12.924372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-362e6c99-cf04-4055-8915-c5457ad7c938 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:12.973636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-362e6c99-cf04-4055-8915-c5457ad7c938 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:12.982984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-362e6c99-cf04-4055-8915-c5457ad7c938 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:12.985922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-362e6c99-cf04-4055-8915-c5457ad7c938 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:12.988094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-362e6c99-cf04-4055-8915-c5457ad7c938 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:13.008327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-362e6c99-cf04-4055-8915-c5457ad7c938 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:13.009942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-362e6c99-cf04-4055-8915-c5457ad7c938 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:13.664548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-362e6c99-cf04-4055-8915-c5457ad7c938 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:13.702046 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-362e6c99-cf04-4055-8915-c5457ad7c938 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1466 microversion: 2.1 time: 0.809997 Aug 25 13:20:13.717902 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2092/4235] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:12 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1466 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:13.763274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:13.785456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:13.787117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.compute.servers [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Removing options 'limit' from query {{(pid=129059) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 25 13:20:13.790474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:13.837128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:13.840392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:13.841680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:13.843596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:13.844839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:13.847189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:13.927671 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-da122a73-80a4-453f-910c-d2d512c988f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.200078 Aug 25 13:20:13.945647 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2093/4236] 10.222.0.70 () {58 vars in 1140 bytes} [Thu Aug 25 13:20:13 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:14.156352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e3e3111a-55d4-403b-99da-3b7727710500 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:14.194428 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e3e3111a-55d4-403b-99da-3b7727710500 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1527 microversion: 2.1 time: 2.072384 Aug 25 13:20:14.200054 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2144/4237] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:12 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1527 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:20:14.256776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:14.295532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:14.305081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-872474963', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:14.318536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:14.351275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:14.352182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:14.352959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:14.365806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:14.367143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:14.368738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:14.876280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:20:14.906906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-950173614", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "7629e4b6-7722-4456-9a35-5ff4bf3b1bcd"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:15.166204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] validate_networks() for [('7629e4b6-7722-4456-9a35-5ff4bf3b1bcd', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:20:15.202471 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b5da661-1279-4b95-b841-905dcda0fb29 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-872474963" status: 200 len: 345 microversion: 2.1 time: 0.985768 Aug 25 13:20:15.203937 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2145/4238] 10.222.0.70 () {58 vars in 1240 bytes} [Thu Aug 25 13:20:14 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-872474963 => generated 345 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:15.218243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-05f70dda-b332-4320-a457-01dd3fc200c2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:15.219573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-05f70dda-b332-4320-a457-01dd3fc200c2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:15.233297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05f70dda-b332-4320-a457-01dd3fc200c2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:15.234331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05f70dda-b332-4320-a457-01dd3fc200c2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:15.235432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05f70dda-b332-4320-a457-01dd3fc200c2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:15.237491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05f70dda-b332-4320-a457-01dd3fc200c2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:15.238615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05f70dda-b332-4320-a457-01dd3fc200c2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:15.239218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-05f70dda-b332-4320-a457-01dd3fc200c2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:15.459970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:16.497778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-05f70dda-b332-4320-a457-01dd3fc200c2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:16.517564 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-05f70dda-b332-4320-a457-01dd3fc200c2 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 200 len: 1466 microversion: 2.1 time: 1.308985 Aug 25 13:20:16.519480 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2146/4239] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:15 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 1466 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:16.581750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2ee7f801-f043-4b92-bacc-0b83e5e2e583 req-4d97588e-2e40-44dd-9791-3b003ca98352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a353f482-b83b-4141-b007-9cbc0b515891", "name": "network-vif-unplugged", "status": "completed", "tag": "ecb82332-c8f8-4b42-923a-450c852e5cca"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:16.612862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2ee7f801-f043-4b92-bacc-0b83e5e2e583 req-4d97588e-2e40-44dd-9791-3b003ca98352 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:16.614589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2ee7f801-f043-4b92-bacc-0b83e5e2e583 req-4d97588e-2e40-44dd-9791-3b003ca98352 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:16.615418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2ee7f801-f043-4b92-bacc-0b83e5e2e583 req-4d97588e-2e40-44dd-9791-3b003ca98352 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:16.651846 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2ee7f801-f043-4b92-bacc-0b83e5e2e583 req-4d97588e-2e40-44dd-9791-3b003ca98352 service nova] Creating event network-vif-unplugged:ecb82332-c8f8-4b42-923a-450c852e5cca for instance a353f482-b83b-4141-b007-9cbc0b515891 on n-h1-852771-8 Aug 25 13:20:16.677260 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2ee7f801-f043-4b92-bacc-0b83e5e2e583 req-4d97588e-2e40-44dd-9791-3b003ca98352 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128214 Aug 25 13:20:16.679333 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2147/4240] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:16.706167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d2391d65-f192-43cf-afbf-945f013f5d8b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:16.732465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2391d65-f192-43cf-afbf-945f013f5d8b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:16.733936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2391d65-f192-43cf-afbf-945f013f5d8b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:16.735585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2391d65-f192-43cf-afbf-945f013f5d8b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:16.800834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d2391d65-f192-43cf-afbf-945f013f5d8b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Going to try to stop instance {{(pid=129060) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:20:16.925644 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d2391d65-f192-43cf-afbf-945f013f5d8b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "POST /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575/action" status: 202 len: 0 microversion: 2.1 time: 0.238916 Aug 25 13:20:16.927708 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2148/4241] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:16 2022] POST /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:20:16.958169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9053b35-113c-4b96-85f4-b27e57c56866 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:16.961125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b9053b35-113c-4b96-85f4-b27e57c56866 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:17.007972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9053b35-113c-4b96-85f4-b27e57c56866 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:17.009192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9053b35-113c-4b96-85f4-b27e57c56866 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:17.016001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9053b35-113c-4b96-85f4-b27e57c56866 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:17.021893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9053b35-113c-4b96-85f4-b27e57c56866 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:17.022993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9053b35-113c-4b96-85f4-b27e57c56866 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:17.024136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9053b35-113c-4b96-85f4-b27e57c56866 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:17.057780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:19.416877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b9053b35-113c-4b96-85f4-b27e57c56866 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:19.449428 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9053b35-113c-4b96-85f4-b27e57c56866 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1509 microversion: 2.1 time: 2.515003 Aug 25 13:20:19.453108 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2149/4242] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:16 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1509 bytes in 2524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:19.484119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6992042b-29f1-43fe-a072-0a31cf9aa220 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:19.487739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6992042b-29f1-43fe-a072-0a31cf9aa220 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:19.500952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6992042b-29f1-43fe-a072-0a31cf9aa220 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:19.502268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6992042b-29f1-43fe-a072-0a31cf9aa220 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:19.503349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6992042b-29f1-43fe-a072-0a31cf9aa220 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:19.505061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6992042b-29f1-43fe-a072-0a31cf9aa220 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:19.506324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6992042b-29f1-43fe-a072-0a31cf9aa220 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:19.507691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6992042b-29f1-43fe-a072-0a31cf9aa220 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:20.358609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6992042b-29f1-43fe-a072-0a31cf9aa220 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:20.386646 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6992042b-29f1-43fe-a072-0a31cf9aa220 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1520 microversion: 2.1 time: 0.930252 Aug 25 13:20:20.393666 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2150/4243] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:19 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1520 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:20.425897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:20.428579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: a353f482-b83b-4141-b007-9cbc0b515891] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:20.440944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:20.441821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:20.443756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:20.445759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:20.447026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:20.448352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:20.539196 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] HTTP exception thrown: Instance a353f482-b83b-4141-b007-9cbc0b515891 could not be found. Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Request method failure captured: Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 HTTP/1.1 Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3Mr9cWgACYm-JJJ3jtHrhjTUF1SZTk5SfB-onmYg_dkoF9Umi4EcFGUk_Hxt1tkajZlvH92Le8pKZsZ_x3nzluflBOJ0M8UYE0mStiqoLa4TCWq76ZCTPEE_7qbDlcr456ZSpBTxR3-8SWamaTMIPsT_5mpLgXenA2keElRqYPMqBw Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8de71f9e1804c46ab8f18f48a5fff42", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}] Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e320ccc6c0624541895fc42bf681da76 Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance a353f482-b83b-4141-b007-9cbc0b515891 could not be found. Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'a353f482-b83b-4141-b007-9cbc0b515891'} Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a353f482-b83b-4141-b007-9cbc0b515891 could not be found. Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a353f482-b83b-4141-b007-9cbc0b515891 could not be found. Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:20.542909 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:20.555186 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:20.555186 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:20.555186 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:20.555186 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:20:20.555186 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:20:20.555186 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a353f482-b83b-4141-b007-9cbc0b515891 could not be found. Aug 25 13:20:20.555186 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:20.558874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Returning 404 to user: Instance a353f482-b83b-4141-b007-9cbc0b515891 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:20:20.559383 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3e39bba0-1703-4c51-b162-9939cab1191d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891" status: 404 len: 111 microversion: 2.1 time: 0.162514 Aug 25 13:20:20.561896 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2151/4244] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:20 2022] GET /compute/v2.1/servers/a353f482-b83b-4141-b007-9cbc0b515891 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:20:20.590000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-78d2b2bd-3756-4a7e-a7e4-4f4b1b436274 req-8ec1c471-5454-4617-9783-3b70e7fc2dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a353f482-b83b-4141-b007-9cbc0b515891", "name": "network-vif-deleted", "tag": "ecb82332-c8f8-4b42-923a-450c852e5cca"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:20.618088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-78d2b2bd-3756-4a7e-a7e4-4f4b1b436274 req-8ec1c471-5454-4617-9783-3b70e7fc2dd5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:20.620672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:20:20.622020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-78d2b2bd-3756-4a7e-a7e4-4f4b1b436274 req-8ec1c471-5454-4617-9783-3b70e7fc2dd5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:20.622601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:20:20.623776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:20:20.624811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:20:20.625007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-78d2b2bd-3756-4a7e-a7e4-4f4b1b436274 req-8ec1c471-5454-4617-9783-3b70e7fc2dd5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:20.626129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:20:20.648745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:20.649972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:20.650893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:20.652435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:20.653385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:20.654823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:20.713593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Getting quotas for project 4567bd5b7ed04fb39936d8dbdeee3f4f. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:20:20.725479 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-78d2b2bd-3756-4a7e-a7e4-4f4b1b436274 req-8ec1c471-5454-4617-9783-3b70e7fc2dd5 service nova] Creating event network-vif-deleted:ecb82332-c8f8-4b42-923a-450c852e5cca for instance a353f482-b83b-4141-b007-9cbc0b515891 on n-h1-852771-8 Aug 25 13:20:20.731401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Getting quotas for user 89a71464f97c46139287885454256eed and project 4567bd5b7ed04fb39936d8dbdeee3f4f. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:20:20.754319 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-78d2b2bd-3756-4a7e-a7e4-4f4b1b436274 req-8ec1c471-5454-4617-9783-3b70e7fc2dd5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187835 Aug 25 13:20:20.756194 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2152/4245] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:20.773492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-bc2add0d-5b82-40f7-bdc0-67473a2bdda1 req-3844d1ce-0dd2-46a8-912d-5958bdd33c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6362fd-0197-4636-8a8d-6814ba103aed", "name": "network-vif-unplugged", "status": "completed", "tag": "221908ac-54e5-4185-a673-1a922869d2b5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:20.796436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-bc2add0d-5b82-40f7-bdc0-67473a2bdda1 req-3844d1ce-0dd2-46a8-912d-5958bdd33c08 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:20.797254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-bc2add0d-5b82-40f7-bdc0-67473a2bdda1 req-3844d1ce-0dd2-46a8-912d-5958bdd33c08 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:20.806718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-bc2add0d-5b82-40f7-bdc0-67473a2bdda1 req-3844d1ce-0dd2-46a8-912d-5958bdd33c08 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:20.820029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:20:20.829081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:20:20.837554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.compute.server_external_events [req-bc2add0d-5b82-40f7-bdc0-67473a2bdda1 req-3844d1ce-0dd2-46a8-912d-5958bdd33c08 service nova] Unable to find a host for instance cc6362fd-0197-4636-8a8d-6814ba103aed. Dropping event network-vif-unplugged {{(pid=129060) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 13:20:20.843764 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-bc2add0d-5b82-40f7-bdc0-67473a2bdda1 req-3844d1ce-0dd2-46a8-912d-5958bdd33c08 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.084765 Aug 25 13:20:20.849696 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2153/4246] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 89 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 13:20:20.882818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6224317f-a264-4e67-9107-3c34ce8ff80e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:20.885940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6224317f-a264-4e67-9107-3c34ce8ff80e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:20.915881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6224317f-a264-4e67-9107-3c34ce8ff80e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:20.917165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6224317f-a264-4e67-9107-3c34ce8ff80e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:20.918017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6224317f-a264-4e67-9107-3c34ce8ff80e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:20.919426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6224317f-a264-4e67-9107-3c34ce8ff80e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:20.934180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6224317f-a264-4e67-9107-3c34ce8ff80e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:20.935369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6224317f-a264-4e67-9107-3c34ce8ff80e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:21.014913 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3c48ceab-eba8-4736-86c1-ad53a26ebc7e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.057707 Aug 25 13:20:21.021107 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2094/4247] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:20:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 7075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:20:21.069275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cfcd14ec-a26a-47d6-8812-fc72f646c3cf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:21.075171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cfcd14ec-a26a-47d6-8812-fc72f646c3cf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:21.101650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfcd14ec-a26a-47d6-8812-fc72f646c3cf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:21.103027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfcd14ec-a26a-47d6-8812-fc72f646c3cf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:21.110457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfcd14ec-a26a-47d6-8812-fc72f646c3cf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:21.112767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfcd14ec-a26a-47d6-8812-fc72f646c3cf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:21.114213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfcd14ec-a26a-47d6-8812-fc72f646c3cf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:21.116376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cfcd14ec-a26a-47d6-8812-fc72f646c3cf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:21.231738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cfcd14ec-a26a-47d6-8812-fc72f646c3cf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:20:21.469397 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cfcd14ec-a26a-47d6-8812-fc72f646c3cf tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 204 len: 0 microversion: 2.1 time: 0.439024 Aug 25 13:20:21.477171 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2095/4248] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:20:21 2022] DELETE /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:20:21.497659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-50f208ba-63e4-4d09-b4c4-349118c30388 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:21.513244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-50f208ba-63e4-4d09-b4c4-349118c30388 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:22.108704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-50f208ba-63e4-4d09-b4c4-349118c30388 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:22.158983 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-50f208ba-63e4-4d09-b4c4-349118c30388 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1224 microversion: 2.1 time: 0.675101 Aug 25 13:20:22.187053 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2096/4249] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:21 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1224 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:22.217929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3e058b55-b2a7-4326-a2f8-74bd4411e97b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:22.219906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3e058b55-b2a7-4326-a2f8-74bd4411e97b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:22.253937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e058b55-b2a7-4326-a2f8-74bd4411e97b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:22.254996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e058b55-b2a7-4326-a2f8-74bd4411e97b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:22.261464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e058b55-b2a7-4326-a2f8-74bd4411e97b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:22.263136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e058b55-b2a7-4326-a2f8-74bd4411e97b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:22.264041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e058b55-b2a7-4326-a2f8-74bd4411e97b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:22.264878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e058b55-b2a7-4326-a2f8-74bd4411e97b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:23.311397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6224317f-a264-4e67-9107-3c34ce8ff80e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:23.336005 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6224317f-a264-4e67-9107-3c34ce8ff80e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1452 microversion: 2.1 time: 2.484066 Aug 25 13:20:23.358338 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2154/4250] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:20 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1452 bytes in 2508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:23.382422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae8cb0a4-43e8-4980-8e8d-4030f51b400a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:23.384306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ae8cb0a4-43e8-4980-8e8d-4030f51b400a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:23.396791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae8cb0a4-43e8-4980-8e8d-4030f51b400a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:23.398211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae8cb0a4-43e8-4980-8e8d-4030f51b400a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:23.399393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae8cb0a4-43e8-4980-8e8d-4030f51b400a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:23.402244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae8cb0a4-43e8-4980-8e8d-4030f51b400a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:23.403501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae8cb0a4-43e8-4980-8e8d-4030f51b400a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:23.404834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae8cb0a4-43e8-4980-8e8d-4030f51b400a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:24.156858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3e058b55-b2a7-4326-a2f8-74bd4411e97b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:24.193847 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3e058b55-b2a7-4326-a2f8-74bd4411e97b tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1520 microversion: 2.1 time: 1.994825 Aug 25 13:20:24.195476 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2097/4251] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:22 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1520 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:24.205832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e5e72fa-8865-4502-a75f-e3a77cbc1338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:24.215166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5e5e72fa-8865-4502-a75f-e3a77cbc1338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:24.238455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e5e72fa-8865-4502-a75f-e3a77cbc1338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:24.253128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e5e72fa-8865-4502-a75f-e3a77cbc1338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:24.254184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e5e72fa-8865-4502-a75f-e3a77cbc1338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:24.255538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e5e72fa-8865-4502-a75f-e3a77cbc1338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:24.256371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e5e72fa-8865-4502-a75f-e3a77cbc1338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:24.274356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e5e72fa-8865-4502-a75f-e3a77cbc1338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:24.578627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:24.825744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5e5e72fa-8865-4502-a75f-e3a77cbc1338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:24.865165 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5e5e72fa-8865-4502-a75f-e3a77cbc1338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1294 microversion: 2.1 time: 0.667271 Aug 25 13:20:24.872677 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2098/4252] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:24 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1294 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:24.897030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c594278e-3204-4569-9adb-5978de7eb884 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:24.901321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c594278e-3204-4569-9adb-5978de7eb884 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:24.905427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ae8cb0a4-43e8-4980-8e8d-4030f51b400a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:24.931318 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ae8cb0a4-43e8-4980-8e8d-4030f51b400a tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1509 microversion: 2.1 time: 1.570556 Aug 25 13:20:24.942955 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2155/4253] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:23 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1509 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:24.953956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c594278e-3204-4569-9adb-5978de7eb884 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:24.955698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c594278e-3204-4569-9adb-5978de7eb884 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:24.958054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c594278e-3204-4569-9adb-5978de7eb884 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:24.964184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c594278e-3204-4569-9adb-5978de7eb884 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:24.966789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c594278e-3204-4569-9adb-5978de7eb884 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:24.967557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c594278e-3204-4569-9adb-5978de7eb884 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:25.588450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-92774da3-cdb2-449b-abce-17ba565ba5bc tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1240363654", "availability_zone": "foo_zone"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:25.632924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.aggregate [None req-92774da3-cdb2-449b-abce-17ba565ba5bc tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Generated uuid 1cdb4730-acaf-48fd-b7ca-52313fccfd60 for aggregate {{(pid=129060) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 13:20:25.751928 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-92774da3-cdb2-449b-abce-17ba565ba5bc tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.800833 Aug 25 13:20:25.767614 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2156/4254] 10.222.0.70 () {60 vars in 1164 bytes} [Thu Aug 25 13:20:24 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:25.785860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7466a332-dfae-4c88-80a6-701e10c98854 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:25.789373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7466a332-dfae-4c88-80a6-701e10c98854 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:25.826738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7466a332-dfae-4c88-80a6-701e10c98854 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:25.829676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7466a332-dfae-4c88-80a6-701e10c98854 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:25.836583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7466a332-dfae-4c88-80a6-701e10c98854 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:25.843531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7466a332-dfae-4c88-80a6-701e10c98854 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:25.847429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7466a332-dfae-4c88-80a6-701e10c98854 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:25.850130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7466a332-dfae-4c88-80a6-701e10c98854 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:26.161768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c594278e-3204-4569-9adb-5978de7eb884 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:26.188932 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c594278e-3204-4569-9adb-5978de7eb884 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1452 microversion: 2.1 time: 1.309656 Aug 25 13:20:26.195143 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2099/4255] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:24 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1452 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:26.216486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52098604-d28c-47ba-b95e-af8fbfa48208 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:26.356317 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52098604-d28c-47ba-b95e-af8fbfa48208 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.158660 Aug 25 13:20:26.362479 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2100/4256] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 13:20:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:26.383316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee38cdf6-d048-4c7a-8c5f-a2008120008e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:26.384483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee38cdf6-d048-4c7a-8c5f-a2008120008e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:26.422156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee38cdf6-d048-4c7a-8c5f-a2008120008e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:26.423481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee38cdf6-d048-4c7a-8c5f-a2008120008e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:26.424342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee38cdf6-d048-4c7a-8c5f-a2008120008e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:26.425767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee38cdf6-d048-4c7a-8c5f-a2008120008e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:26.437870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee38cdf6-d048-4c7a-8c5f-a2008120008e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:26.439201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee38cdf6-d048-4c7a-8c5f-a2008120008e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:26.635192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7466a332-dfae-4c88-80a6-701e10c98854 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:26.671132 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7466a332-dfae-4c88-80a6-701e10c98854 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1520 microversion: 2.1 time: 0.893375 Aug 25 13:20:26.690249 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2157/4257] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:25 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1520 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:26.708030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e0a3d09-dee2-4988-a8b1-9f1439aecbad tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:26.713114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e0a3d09-dee2-4988-a8b1-9f1439aecbad tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:26.739586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e0a3d09-dee2-4988-a8b1-9f1439aecbad tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:26.742196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e0a3d09-dee2-4988-a8b1-9f1439aecbad tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:26.746335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e0a3d09-dee2-4988-a8b1-9f1439aecbad tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:26.750988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e0a3d09-dee2-4988-a8b1-9f1439aecbad tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:26.752863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e0a3d09-dee2-4988-a8b1-9f1439aecbad tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:26.756488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e0a3d09-dee2-4988-a8b1-9f1439aecbad tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:26.866527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ee38cdf6-d048-4c7a-8c5f-a2008120008e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:26.894732 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee38cdf6-d048-4c7a-8c5f-a2008120008e tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1282 microversion: 2.1 time: 0.528866 Aug 25 13:20:26.926221 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2101/4258] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:26 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1282 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:26.944957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff7f3038-080f-42eb-a20f-925d5e77fe9c tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:26.966933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff7f3038-080f-42eb-a20f-925d5e77fe9c tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:26.967839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff7f3038-080f-42eb-a20f-925d5e77fe9c tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:26.968663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff7f3038-080f-42eb-a20f-925d5e77fe9c tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:26.970413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff7f3038-080f-42eb-a20f-925d5e77fe9c tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:26.971336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff7f3038-080f-42eb-a20f-925d5e77fe9c tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:26.972529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff7f3038-080f-42eb-a20f-925d5e77fe9c tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:27.007553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=17 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:27.120418 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff7f3038-080f-42eb-a20f-925d5e77fe9c tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.192166 Aug 25 13:20:27.130147 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2102/4259] 10.222.0.70 () {58 vars in 1176 bytes} [Thu Aug 25 13:20:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:27.148211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:27.149245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:27.169335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e0a3d09-dee2-4988-a8b1-9f1439aecbad tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:27.175268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:27.186453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:27.187544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:27.189435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:27.200705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:27.201710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:27.205997 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e0a3d09-dee2-4988-a8b1-9f1439aecbad tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 200 len: 1467 microversion: 2.1 time: 0.513246 Aug 25 13:20:27.216177 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2158/4260] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:26 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 1467 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:27.234956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1492acff-e646-4aad-b472-cb7681d027b9 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:27.275992 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1492acff-e646-4aad-b472-cb7681d027b9 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.055693 Aug 25 13:20:27.277967 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2159/4261] 10.222.0.70 () {58 vars in 1143 bytes} [Thu Aug 25 13:20:27 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:27.299667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-59806ed1-1814-4de6-9abf-4047484927c3 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852771-8"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:27.301820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:27.321484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lazy-loading 'flavor' on Instance uuid cc6362fd-0197-4636-8a8d-6814ba103aed {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:20:27.349938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59806ed1-1814-4de6-9abf-4047484927c3 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:27.351634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59806ed1-1814-4de6-9abf-4047484927c3 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:27.354904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59806ed1-1814-4de6-9abf-4047484927c3 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:27.380155 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Cannot 'shelve' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state shelved_offloaded Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action HTTP/1.1 Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 14 Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: {"shelve": {}} Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: exception: Cannot 'shelve' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state shelved_offloaded Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'cc6362fd-0197-4636-8a8d-6814ba103aed', 'body': {'shelve': {}}} Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc6362fd-0197-4636-8a8d-6814ba103aed in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:20:27.401679 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state shelved_offloaded Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state shelved_offloaded Aug 25 13:20:27.414589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:27.435045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 409 to user: Cannot 'shelve' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state shelved_offloaded {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:20:27.445681 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e6b731ca-2f3c-4a5e-b577-400a8d4cc5b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 409 len: 155 microversion: 2.1 time: 0.305403 Aug 25 13:20:27.451852 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2103/4262] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:27 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 155 bytes in 321 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:20:27.507967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-146dccb6-fca4-4d90-a7ff-5ac07361cfb5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:27.509800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-146dccb6-fca4-4d90-a7ff-5ac07361cfb5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:27.544624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146dccb6-fca4-4d90-a7ff-5ac07361cfb5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:27.571314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146dccb6-fca4-4d90-a7ff-5ac07361cfb5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:27.581965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146dccb6-fca4-4d90-a7ff-5ac07361cfb5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:27.591946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146dccb6-fca4-4d90-a7ff-5ac07361cfb5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:27.593587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146dccb6-fca4-4d90-a7ff-5ac07361cfb5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:27.596328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146dccb6-fca4-4d90-a7ff-5ac07361cfb5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:27.848388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-146dccb6-fca4-4d90-a7ff-5ac07361cfb5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129059) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 13:20:28.118846 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-59806ed1-1814-4de6-9abf-4047484927c3 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.812720 Aug 25 13:20:28.123044 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2160/4263] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 13:20:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:28.159107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-079fadb8-f0ac-4241-8c81-88e3cf302cf2 req-a3412674-62d9-47dd-8be6-a2a15b953007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b514b9c8-029c-42f9-a059-b900597e40e2", "name": "network-vif-deleted", "tag": "d10c11d8-e29b-4655-9ec0-72079613cd77"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:28.190922 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-146dccb6-fca4-4d90-a7ff-5ac07361cfb5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 202 len: 0 microversion: 2.1 time: 0.729213 Aug 25 13:20:28.195780 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2104/4264] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:27 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:20:28.218506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e3b15b58-5a57-4e90-816f-c0c4326d1b8e tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:28.226936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e3b15b58-5a57-4e90-816f-c0c4326d1b8e tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:28.259216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-079fadb8-f0ac-4241-8c81-88e3cf302cf2 req-a3412674-62d9-47dd-8be6-a2a15b953007 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:28.260525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-079fadb8-f0ac-4241-8c81-88e3cf302cf2 req-a3412674-62d9-47dd-8be6-a2a15b953007 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:28.268455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:28.282774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-079fadb8-f0ac-4241-8c81-88e3cf302cf2 req-a3412674-62d9-47dd-8be6-a2a15b953007 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:28.286917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b15b58-5a57-4e90-816f-c0c4326d1b8e tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:28.291561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b15b58-5a57-4e90-816f-c0c4326d1b8e tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:28.314346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b15b58-5a57-4e90-816f-c0c4326d1b8e tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:28.324355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b15b58-5a57-4e90-816f-c0c4326d1b8e tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:28.326682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b15b58-5a57-4e90-816f-c0c4326d1b8e tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:28.331079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b15b58-5a57-4e90-816f-c0c4326d1b8e tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:28.392699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-079fadb8-f0ac-4241-8c81-88e3cf302cf2 req-a3412674-62d9-47dd-8be6-a2a15b953007 service nova] Creating event network-vif-deleted:d10c11d8-e29b-4655-9ec0-72079613cd77 for instance b514b9c8-029c-42f9-a059-b900597e40e2 on n-h2-852771-8 Aug 25 13:20:28.424332 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-079fadb8-f0ac-4241-8c81-88e3cf302cf2 req-a3412674-62d9-47dd-8be6-a2a15b953007 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289765 Aug 25 13:20:28.427671 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2161/4265] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:28.526445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-125b3ed1-f526-4c05-a6be-621d79f688c9 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:28.533574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-125b3ed1-f526-4c05-a6be-621d79f688c9 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:28.646133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-125b3ed1-f526-4c05-a6be-621d79f688c9 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:28.647002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-125b3ed1-f526-4c05-a6be-621d79f688c9 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:28.662523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-125b3ed1-f526-4c05-a6be-621d79f688c9 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:28.664582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-125b3ed1-f526-4c05-a6be-621d79f688c9 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:28.665481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-125b3ed1-f526-4c05-a6be-621d79f688c9 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:28.666329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-125b3ed1-f526-4c05-a6be-621d79f688c9 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:29.386274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-125b3ed1-f526-4c05-a6be-621d79f688c9 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:29.414760 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-125b3ed1-f526-4c05-a6be-621d79f688c9 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1328 microversion: 2.1 time: 0.980725 Aug 25 13:20:29.416205 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2162/4266] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:28 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1328 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:29.433560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-24f3551b-9f3a-4203-8b30-e17f3a08b0ac tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:29.451191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e3b15b58-5a57-4e90-816f-c0c4326d1b8e tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:29.504174 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e3b15b58-5a57-4e90-816f-c0c4326d1b8e tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1497 microversion: 2.1 time: 1.305784 Aug 25 13:20:29.535073 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2105/4267] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:28 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1497 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:29.545728 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-24f3551b-9f3a-4203-8b30-e17f3a08b0ac tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.090707 Aug 25 13:20:29.553969 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2163/4268] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 13:20:29 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:29.595583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-892784ee-b1de-4088-bccc-5e9618399c0c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:29.596991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:29.598754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-892784ee-b1de-4088-bccc-5e9618399c0c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:29.601369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: b514b9c8-029c-42f9-a059-b900597e40e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:29.631354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892784ee-b1de-4088-bccc-5e9618399c0c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:29.632277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892784ee-b1de-4088-bccc-5e9618399c0c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:29.633066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892784ee-b1de-4088-bccc-5e9618399c0c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:29.634430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892784ee-b1de-4088-bccc-5e9618399c0c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:29.635269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892784ee-b1de-4088-bccc-5e9618399c0c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:29.636033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-892784ee-b1de-4088-bccc-5e9618399c0c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:29.646012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:29.647532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:29.648749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:29.652133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:29.653869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:29.655746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:29.703635 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] HTTP exception thrown: Instance b514b9c8-029c-42f9-a059-b900597e40e2 could not be found. Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Request method failure captured: Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 HTTP/1.1 Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3Mr9cWgACYm-JJJ3jtHrhjTUF1SZTk5SfB-onmYg_dkoF9Umi4EcFGUk_Hxt1tkajZlvH92Le8pKZsZ_x3nzluflBOJ0M8UYE0mStiqoLa4TCWq76ZCTPEE_7qbDlcr456ZSpBTxR3-8SWamaTMIPsT_5mpLgXenA2keElRqYPMqBw Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8de71f9e1804c46ab8f18f48a5fff42", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}] Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e320ccc6c0624541895fc42bf681da76 Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b514b9c8-029c-42f9-a059-b900597e40e2 could not be found. Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b514b9c8-029c-42f9-a059-b900597e40e2'} Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b514b9c8-029c-42f9-a059-b900597e40e2 could not be found. Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b514b9c8-029c-42f9-a059-b900597e40e2 could not be found. Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:29.713267 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:29.724059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:29.724059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:29.724059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:29.724059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:20:29.724059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:20:29.724059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b514b9c8-029c-42f9-a059-b900597e40e2 could not be found. Aug 25 13:20:29.724059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:29.728021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Returning 404 to user: Instance b514b9c8-029c-42f9-a059-b900597e40e2 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:20:29.730417 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-acc44554-b1c7-4812-b6da-d1dcc391f24c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2" status: 404 len: 111 microversion: 2.1 time: 0.173685 Aug 25 13:20:29.739014 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2164/4269] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:29 2022] GET /compute/v2.1/servers/b514b9c8-029c-42f9-a059-b900597e40e2 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:20:29.761287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:29.780305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:29.787091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:29.808903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:29.809776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:29.810535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:29.824079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:29.826361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:29.827456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:29.972029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:20:30.082287 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d10f9dea-fe9c-40a5-a318-4ad84d738338 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.342097 Aug 25 13:20:30.084113 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2165/4270] 10.222.0.70 () {58 vars in 1154 bytes} [Thu Aug 25 13:20:29 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:30.095047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e9b380d-7ddb-49c8-ba3b-c47fc930baa6 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1073809922", "availability_zone": "foo_zone"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:30.523101 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e9b380d-7ddb-49c8-ba3b-c47fc930baa6 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.429797 Aug 25 13:20:30.568893 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2166/4271] 10.222.0.70 () {60 vars in 1173 bytes} [Thu Aug 25 13:20:30 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:30.593408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6800a0da-d69c-4eb1-a591-475a4fe9616d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:30.600481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6800a0da-d69c-4eb1-a591-475a4fe9616d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:30.647893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6800a0da-d69c-4eb1-a591-475a4fe9616d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:30.651075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6800a0da-d69c-4eb1-a591-475a4fe9616d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:30.652429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6800a0da-d69c-4eb1-a591-475a4fe9616d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:30.654570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6800a0da-d69c-4eb1-a591-475a4fe9616d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:30.656031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6800a0da-d69c-4eb1-a591-475a4fe9616d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:30.659064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6800a0da-d69c-4eb1-a591-475a4fe9616d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:30.751485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6800a0da-d69c-4eb1-a591-475a4fe9616d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:20:30.942155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-892784ee-b1de-4088-bccc-5e9618399c0c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:30.978699 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-892784ee-b1de-4088-bccc-5e9618399c0c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1460 microversion: 2.1 time: 1.443844 Aug 25 13:20:30.983640 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2106/4272] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:29 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1460 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:31.010524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-538b738f-d89b-4c7f-8f6c-684e5aa7ecca tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:31.054405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-538b738f-d89b-4c7f-8f6c-684e5aa7ecca tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:31.060571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-538b738f-d89b-4c7f-8f6c-684e5aa7ecca tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:31.066845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-538b738f-d89b-4c7f-8f6c-684e5aa7ecca tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:31.144754 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6800a0da-d69c-4eb1-a591-475a4fe9616d tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 204 len: 0 microversion: 2.1 time: 0.572926 Aug 25 13:20:31.145702 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2167/4273] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:20:30 2022] DELETE /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:20:31.165940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a164120d-7d48-4ca4-86fc-f339289f2ca7 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:31.167051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a164120d-7d48-4ca4-86fc-f339289f2ca7 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:31.174641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-538b738f-d89b-4c7f-8f6c-684e5aa7ecca tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Going to try to start instance {{(pid=129059) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 13:20:31.184427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a164120d-7d48-4ca4-86fc-f339289f2ca7 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:31.185339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a164120d-7d48-4ca4-86fc-f339289f2ca7 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:31.202496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a164120d-7d48-4ca4-86fc-f339289f2ca7 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:31.204510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a164120d-7d48-4ca4-86fc-f339289f2ca7 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:31.205814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a164120d-7d48-4ca4-86fc-f339289f2ca7 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:31.207219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a164120d-7d48-4ca4-86fc-f339289f2ca7 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:31.342750 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-538b738f-d89b-4c7f-8f6c-684e5aa7ecca tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "POST /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575/action" status: 202 len: 0 microversion: 2.1 time: 0.355041 Aug 25 13:20:31.346288 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2107/4274] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:30 2022] POST /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:20:31.367323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ec9bde0-a57a-47ac-9d30-890f810a5a46 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:31.550551 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ec9bde0-a57a-47ac-9d30-890f810a5a46 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.198793 Aug 25 13:20:31.552622 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2108/4275] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 13:20:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:31.590934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-afb1d055-ee6a-412e-becd-20b77bc0ee89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:31.601126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-afb1d055-ee6a-412e-becd-20b77bc0ee89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:31.685974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb1d055-ee6a-412e-becd-20b77bc0ee89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:31.691547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb1d055-ee6a-412e-becd-20b77bc0ee89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:31.692665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb1d055-ee6a-412e-becd-20b77bc0ee89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:31.694008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb1d055-ee6a-412e-becd-20b77bc0ee89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:31.694894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb1d055-ee6a-412e-becd-20b77bc0ee89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:31.704891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afb1d055-ee6a-412e-becd-20b77bc0ee89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:32.153736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:32.539912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-afb1d055-ee6a-412e-becd-20b77bc0ee89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:32.589337 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-afb1d055-ee6a-412e-becd-20b77bc0ee89 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1495 microversion: 2.1 time: 1.032770 Aug 25 13:20:32.605545 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2109/4276] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:31 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1495 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:32.607250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de816870-00cb-4e31-a8d4-c4c967cb2c48 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:32.622283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-de816870-00cb-4e31-a8d4-c4c967cb2c48 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:32.702949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de816870-00cb-4e31-a8d4-c4c967cb2c48 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:32.704815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de816870-00cb-4e31-a8d4-c4c967cb2c48 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:32.706843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de816870-00cb-4e31-a8d4-c4c967cb2c48 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:32.708836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de816870-00cb-4e31-a8d4-c4c967cb2c48 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:32.710838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de816870-00cb-4e31-a8d4-c4c967cb2c48 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:32.713840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de816870-00cb-4e31-a8d4-c4c967cb2c48 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:32.756458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a164120d-7d48-4ca4-86fc-f339289f2ca7 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:32.799924 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a164120d-7d48-4ca4-86fc-f339289f2ca7 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1328 microversion: 2.1 time: 1.651857 Aug 25 13:20:32.813975 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2168/4277] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:31 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1328 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:32.836889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-229778dc-7430-4657-8929-89e7e5d0cf68 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:32.878629 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-229778dc-7430-4657-8929-89e7e5d0cf68 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.061887 Aug 25 13:20:32.895499 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2169/4278] 10.222.0.70 () {58 vars in 1152 bytes} [Thu Aug 25 13:20:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:32.905672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2759cd92-4b7c-4e08-8747-56f513569381 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:32.907207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2759cd92-4b7c-4e08-8747-56f513569381 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:32.919444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2759cd92-4b7c-4e08-8747-56f513569381 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:32.921662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2759cd92-4b7c-4e08-8747-56f513569381 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:32.924548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2759cd92-4b7c-4e08-8747-56f513569381 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:32.926646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2759cd92-4b7c-4e08-8747-56f513569381 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:32.944901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2759cd92-4b7c-4e08-8747-56f513569381 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:32.947227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2759cd92-4b7c-4e08-8747-56f513569381 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:34.548822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-de816870-00cb-4e31-a8d4-c4c967cb2c48 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:34.604065 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-de816870-00cb-4e31-a8d4-c4c967cb2c48 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1506 microversion: 2.1 time: 2.008477 Aug 25 13:20:34.606685 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2110/4279] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:32 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1506 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:34.635901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87f31a26-7a4f-432c-bb5d-107ac8996efd tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852771-8"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:34.699536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87f31a26-7a4f-432c-bb5d-107ac8996efd tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:34.700627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87f31a26-7a4f-432c-bb5d-107ac8996efd tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:34.701254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87f31a26-7a4f-432c-bb5d-107ac8996efd tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:35.317906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2759cd92-4b7c-4e08-8747-56f513569381 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:35.354504 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2759cd92-4b7c-4e08-8747-56f513569381 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1462 microversion: 2.1 time: 2.456496 Aug 25 13:20:35.388811 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2170/4280] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:32 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1462 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:35.434288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2efd1566-cc27-4259-a93f-ed04e630b450 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:35.441183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2efd1566-cc27-4259-a93f-ed04e630b450 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:35.480905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efd1566-cc27-4259-a93f-ed04e630b450 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:35.484345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efd1566-cc27-4259-a93f-ed04e630b450 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:35.487247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efd1566-cc27-4259-a93f-ed04e630b450 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:35.491504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efd1566-cc27-4259-a93f-ed04e630b450 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:35.494590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efd1566-cc27-4259-a93f-ed04e630b450 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:35.497531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2efd1566-cc27-4259-a93f-ed04e630b450 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:36.054338 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87f31a26-7a4f-432c-bb5d-107ac8996efd tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 1.442637 Aug 25 13:20:36.055843 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2111/4281] 10.222.0.70 () {60 vars in 1194 bytes} [Thu Aug 25 13:20:34 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:36.081114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-413d93a9-664d-4e56-8a78-d140b48a3d88 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:36.085454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-413d93a9-664d-4e56-8a78-d140b48a3d88 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:36.145224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-413d93a9-664d-4e56-8a78-d140b48a3d88 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:36.148913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-413d93a9-664d-4e56-8a78-d140b48a3d88 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:36.153459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-413d93a9-664d-4e56-8a78-d140b48a3d88 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:36.160405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-413d93a9-664d-4e56-8a78-d140b48a3d88 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:36.161534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-413d93a9-664d-4e56-8a78-d140b48a3d88 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:36.162462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-413d93a9-664d-4e56-8a78-d140b48a3d88 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:36.943884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2efd1566-cc27-4259-a93f-ed04e630b450 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:36.972409 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2efd1566-cc27-4259-a93f-ed04e630b450 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 200 len: 1495 microversion: 2.1 time: 1.565752 Aug 25 13:20:36.991139 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2171/4282] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:35 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 1495 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:37.076737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:37.203849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-162805411", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "66dbee4c-31a0-43d2-aa28-0a2c055a94f3"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:37.348413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-413d93a9-664d-4e56-8a78-d140b48a3d88 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:37.386368 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-413d93a9-664d-4e56-8a78-d140b48a3d88 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1324 microversion: 2.1 time: 1.328633 Aug 25 13:20:37.387457 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2112/4283] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:36 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1324 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:37.432964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b0837e27-fc0a-4721-baee-2964b8061b60 req-b28ea728-5494-4cb2-b44f-88e8a0083a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756ef34e-d2ca-403d-b71c-3ab3c20141d1", "tag": "342751b4-25e1-44e2-bfae-118f47f56c8a"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:37.446379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] validate_networks() for [('66dbee4c-31a0-43d2-aa28-0a2c055a94f3', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:20:37.460703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b0837e27-fc0a-4721-baee-2964b8061b60 req-b28ea728-5494-4cb2-b44f-88e8a0083a35 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:37.461744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b0837e27-fc0a-4721-baee-2964b8061b60 req-b28ea728-5494-4cb2-b44f-88e8a0083a35 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:37.462523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b0837e27-fc0a-4721-baee-2964b8061b60 req-b28ea728-5494-4cb2-b44f-88e8a0083a35 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:37.515712 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b0837e27-fc0a-4721-baee-2964b8061b60 req-b28ea728-5494-4cb2-b44f-88e8a0083a35 service nova] Creating event network-changed:342751b4-25e1-44e2-bfae-118f47f56c8a for instance 756ef34e-d2ca-403d-b71c-3ab3c20141d1 on n-h2-852771-8 Aug 25 13:20:37.536576 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b0837e27-fc0a-4721-baee-2964b8061b60 req-b28ea728-5494-4cb2-b44f-88e8a0083a35 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132485 Aug 25 13:20:37.539498 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2113/4284] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:37.547801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1a241f3d-b7db-4c05-968d-ce15f5338b33 req-0fa913ad-cf73-4858-9e4f-20c56a019e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b134543-2d20-46bb-bcee-9bb6c08477c5", "name": "network-vif-unplugged", "status": "completed", "tag": "fc7efbfc-5b36-4b04-9253-650547862383"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:37.591718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1a241f3d-b7db-4c05-968d-ce15f5338b33 req-0fa913ad-cf73-4858-9e4f-20c56a019e51 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:37.595314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1a241f3d-b7db-4c05-968d-ce15f5338b33 req-0fa913ad-cf73-4858-9e4f-20c56a019e51 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:37.596619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1a241f3d-b7db-4c05-968d-ce15f5338b33 req-0fa913ad-cf73-4858-9e4f-20c56a019e51 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:37.640365 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1a241f3d-b7db-4c05-968d-ce15f5338b33 req-0fa913ad-cf73-4858-9e4f-20c56a019e51 service nova] Creating event network-vif-unplugged:fc7efbfc-5b36-4b04-9253-650547862383 for instance 5b134543-2d20-46bb-bcee-9bb6c08477c5 on n-h1-852771-8 Aug 25 13:20:37.658245 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1a241f3d-b7db-4c05-968d-ce15f5338b33 req-0fa913ad-cf73-4858-9e4f-20c56a019e51 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117617 Aug 25 13:20:37.660986 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2114/4285] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:37.672691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c7a9e336-89b9-4aca-9bda-0e30c9d600c9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:37.674670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c7a9e336-89b9-4aca-9bda-0e30c9d600c9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:37.700646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7a9e336-89b9-4aca-9bda-0e30c9d600c9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:37.701471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7a9e336-89b9-4aca-9bda-0e30c9d600c9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:37.714806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7a9e336-89b9-4aca-9bda-0e30c9d600c9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:37.721027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7a9e336-89b9-4aca-9bda-0e30c9d600c9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:37.723589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7a9e336-89b9-4aca-9bda-0e30c9d600c9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:37.724620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7a9e336-89b9-4aca-9bda-0e30c9d600c9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:39.036812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c7a9e336-89b9-4aca-9bda-0e30c9d600c9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:39.061749 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c7a9e336-89b9-4aca-9bda-0e30c9d600c9 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1510 microversion: 2.1 time: 1.397308 Aug 25 13:20:39.064471 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2115/4286] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:37 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1510 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:39.076267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d6ca022-980d-4ecc-b756-37ef844509f7 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:39.155262 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5d6ca022-980d-4ecc-b756-37ef844509f7 tempest-TestAggregatesBasicOps-1142046494 tempest-TestAggregatesBasicOps-1142046494-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.087802 Aug 25 13:20:39.159312 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2116/4287] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 13:20:39 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 13:20:39.189129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-85512820-8110-4fb6-acc1-f28c2d2e63c7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:39.190884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-85512820-8110-4fb6-acc1-f28c2d2e63c7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:39.213298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85512820-8110-4fb6-acc1-f28c2d2e63c7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:39.215562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85512820-8110-4fb6-acc1-f28c2d2e63c7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:39.217325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85512820-8110-4fb6-acc1-f28c2d2e63c7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:39.221459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85512820-8110-4fb6-acc1-f28c2d2e63c7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:39.222874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85512820-8110-4fb6-acc1-f28c2d2e63c7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:39.224083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85512820-8110-4fb6-acc1-f28c2d2e63c7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:39.870909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:40.381806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-85512820-8110-4fb6-acc1-f28c2d2e63c7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:40.404993 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-85512820-8110-4fb6-acc1-f28c2d2e63c7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.233417 Aug 25 13:20:40.418871 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2117/4288] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:39 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:40.448454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:40.458428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: 5b134543-2d20-46bb-bcee-9bb6c08477c5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:40.500077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:40.501217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:40.502104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:40.503820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:40.505120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:40.506198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:40.568990 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] HTTP exception thrown: Instance 5b134543-2d20-46bb-bcee-9bb6c08477c5 could not be found. Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Request method failure captured: Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 HTTP/1.1 Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3Mr9cWgACYm-JJJ3jtHrhjTUF1SZTk5SfB-onmYg_dkoF9Umi4EcFGUk_Hxt1tkajZlvH92Le8pKZsZ_x3nzluflBOJ0M8UYE0mStiqoLa4TCWq76ZCTPEE_7qbDlcr456ZSpBTxR3-8SWamaTMIPsT_5mpLgXenA2keElRqYPMqBw Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8de71f9e1804c46ab8f18f48a5fff42", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}] Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e320ccc6c0624541895fc42bf681da76 Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 5b134543-2d20-46bb-bcee-9bb6c08477c5 could not be found. Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '5b134543-2d20-46bb-bcee-9bb6c08477c5'} Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b134543-2d20-46bb-bcee-9bb6c08477c5 could not be found. Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b134543-2d20-46bb-bcee-9bb6c08477c5 could not be found. Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:40.575284 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:40.583091 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:40.583091 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:40.583091 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:40.583091 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:20:40.583091 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:20:40.583091 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b134543-2d20-46bb-bcee-9bb6c08477c5 could not be found. Aug 25 13:20:40.583091 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:40.589688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Returning 404 to user: Instance 5b134543-2d20-46bb-bcee-9bb6c08477c5 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:20:40.591912 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f774aaa-28b7-429b-8262-0b3ffce6594b tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5" status: 404 len: 111 microversion: 2.1 time: 0.170864 Aug 25 13:20:40.593597 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2118/4289] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:40 2022] GET /compute/v2.1/servers/5b134543-2d20-46bb-bcee-9bb6c08477c5 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:20:40.604631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0d478d9-6adf-4571-8dcd-223b505ee772 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:40.610585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e0d478d9-6adf-4571-8dcd-223b505ee772 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:40.636212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d478d9-6adf-4571-8dcd-223b505ee772 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:40.637893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d478d9-6adf-4571-8dcd-223b505ee772 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:40.639107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d478d9-6adf-4571-8dcd-223b505ee772 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:40.641539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d478d9-6adf-4571-8dcd-223b505ee772 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:40.643033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d478d9-6adf-4571-8dcd-223b505ee772 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:40.644206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0d478d9-6adf-4571-8dcd-223b505ee772 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:40.749012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:20:40.749672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:20:40.751987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:20:40.753174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:20:40.755016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:20:40.789959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:40.790906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:40.792166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:40.793887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:40.801699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:40.803636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:40.918591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Getting quotas for project f7f12e87bcc940aa874f0ae0c91d4b2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:20:40.935863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Getting quotas for user a7d1271d41fe49d3b9d18a64877e76a9 and project f7f12e87bcc940aa874f0ae0c91d4b2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:20:40.970662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:20:40.976207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:20:41.011998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:41.183503 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-72017975-52c3-4d9e-8a1b-7ff8521c28d4 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.189885 Aug 25 13:20:41.191179 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2172/4290] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:20:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:20:41.216441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c3b49d57-f9fd-4f93-aad8-27741bc223db req-2716df7a-2700-41a8-bcfd-65021dea1c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b134543-2d20-46bb-bcee-9bb6c08477c5", "name": "network-vif-deleted", "tag": "fc7efbfc-5b36-4b04-9253-650547862383"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:41.279635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c3b49d57-f9fd-4f93-aad8-27741bc223db req-2716df7a-2700-41a8-bcfd-65021dea1c82 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.280710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c3b49d57-f9fd-4f93-aad8-27741bc223db req-2716df7a-2700-41a8-bcfd-65021dea1c82 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.282340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c3b49d57-f9fd-4f93-aad8-27741bc223db req-2716df7a-2700-41a8-bcfd-65021dea1c82 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:41.290971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:41.310042 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c3b49d57-f9fd-4f93-aad8-27741bc223db req-2716df7a-2700-41a8-bcfd-65021dea1c82 service nova] Creating event network-vif-deleted:fc7efbfc-5b36-4b04-9253-650547862383 for instance 5b134543-2d20-46bb-bcee-9bb6c08477c5 on n-h1-852771-8 Aug 25 13:20:41.320477 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c3b49d57-f9fd-4f93-aad8-27741bc223db req-2716df7a-2700-41a8-bcfd-65021dea1c82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125820 Aug 25 13:20:41.321885 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2173/4291] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:41.331956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:41.345937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:41.346897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.compute.servers [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Removing options 'limit' from query {{(pid=129060) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 25 13:20:41.348405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:41.356563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.357423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.358581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:41.361130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.362274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.363082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:41.366961 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d2bf2f70-099b-4f60-9876-51bf68fa7dcd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.043106 Aug 25 13:20:41.380313 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2174/4292] 10.222.0.70 () {58 vars in 1140 bytes} [Thu Aug 25 13:20:41 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:20:41.380313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dc730e1b-36b0-4ad0-aac7-8aed5eb28efe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:41.380799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dc730e1b-36b0-4ad0-aac7-8aed5eb28efe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:41.395588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc730e1b-36b0-4ad0-aac7-8aed5eb28efe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.396778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc730e1b-36b0-4ad0-aac7-8aed5eb28efe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.397939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc730e1b-36b0-4ad0-aac7-8aed5eb28efe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:41.399650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc730e1b-36b0-4ad0-aac7-8aed5eb28efe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.400542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc730e1b-36b0-4ad0-aac7-8aed5eb28efe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.401525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc730e1b-36b0-4ad0-aac7-8aed5eb28efe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:41.401731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e0d478d9-6adf-4571-8dcd-223b505ee772 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:41.430279 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0d478d9-6adf-4571-8dcd-223b505ee772 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1324 microversion: 2.1 time: 0.833346 Aug 25 13:20:41.454336 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2119/4293] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:40 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1324 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:41.459106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f67b4c42-20ab-4038-85ea-5e72ce9761af tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:41.463487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f67b4c42-20ab-4038-85ea-5e72ce9761af tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:41.479370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dc730e1b-36b0-4ad0-aac7-8aed5eb28efe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:20:41.704081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f67b4c42-20ab-4038-85ea-5e72ce9761af tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:41.730743 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dc730e1b-36b0-4ad0-aac7-8aed5eb28efe tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 204 len: 0 microversion: 2.1 time: 0.359062 Aug 25 13:20:41.736050 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2175/4294] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:20:41 2022] DELETE /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:20:41.742001 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f67b4c42-20ab-4038-85ea-5e72ce9761af tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1227 microversion: 2.1 time: 0.300371 Aug 25 13:20:41.743758 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2120/4295] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:41 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1227 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:41.757025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-18f3acfc-71fd-45f6-9ce5-df17cf077946 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:41.759796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-18f3acfc-71fd-45f6-9ce5-df17cf077946 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:41.762919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a5e6f189-8cd3-477c-8fbb-cf2fa6585654 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:41.767613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a5e6f189-8cd3-477c-8fbb-cf2fa6585654 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:41.788446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18f3acfc-71fd-45f6-9ce5-df17cf077946 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.792052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5e6f189-8cd3-477c-8fbb-cf2fa6585654 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.792860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5e6f189-8cd3-477c-8fbb-cf2fa6585654 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.795377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5e6f189-8cd3-477c-8fbb-cf2fa6585654 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:41.795640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18f3acfc-71fd-45f6-9ce5-df17cf077946 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.795640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18f3acfc-71fd-45f6-9ce5-df17cf077946 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:41.796827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18f3acfc-71fd-45f6-9ce5-df17cf077946 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.798402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18f3acfc-71fd-45f6-9ce5-df17cf077946 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.800342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5e6f189-8cd3-477c-8fbb-cf2fa6585654 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.801086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5e6f189-8cd3-477c-8fbb-cf2fa6585654 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.801911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5e6f189-8cd3-477c-8fbb-cf2fa6585654 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:41.806402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18f3acfc-71fd-45f6-9ce5-df17cf077946 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:43.129023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-18f3acfc-71fd-45f6-9ce5-df17cf077946 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:43.137459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5e6f189-8cd3-477c-8fbb-cf2fa6585654 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:43.150967 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-18f3acfc-71fd-45f6-9ce5-df17cf077946 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1510 microversion: 2.1 time: 1.411275 Aug 25 13:20:43.165341 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2176/4296] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:41 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1510 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:43.179097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2214c2c5-23a8-4ee7-ae84-0376be51bf06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:43.180956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2214c2c5-23a8-4ee7-ae84-0376be51bf06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:43.194839 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a5e6f189-8cd3-477c-8fbb-cf2fa6585654 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.448631 Aug 25 13:20:43.197262 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2121/4297] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:41 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:43.208760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-18410bdb-755b-4140-8b52-dce82836e4a3 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:43.214374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-18410bdb-755b-4140-8b52-dce82836e4a3 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:43.226744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2214c2c5-23a8-4ee7-ae84-0376be51bf06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:43.227936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2214c2c5-23a8-4ee7-ae84-0376be51bf06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:43.228587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2214c2c5-23a8-4ee7-ae84-0376be51bf06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:43.229683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2214c2c5-23a8-4ee7-ae84-0376be51bf06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:43.230601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2214c2c5-23a8-4ee7-ae84-0376be51bf06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:43.231483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2214c2c5-23a8-4ee7-ae84-0376be51bf06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:43.238503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18410bdb-755b-4140-8b52-dce82836e4a3 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:43.239380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18410bdb-755b-4140-8b52-dce82836e4a3 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:43.240814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18410bdb-755b-4140-8b52-dce82836e4a3 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:43.243377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18410bdb-755b-4140-8b52-dce82836e4a3 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:43.244753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18410bdb-755b-4140-8b52-dce82836e4a3 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:43.246341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18410bdb-755b-4140-8b52-dce82836e4a3 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:43.715616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2214c2c5-23a8-4ee7-ae84-0376be51bf06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:43.747670 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2214c2c5-23a8-4ee7-ae84-0376be51bf06 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1673 microversion: 2.1 time: 0.579320 Aug 25 13:20:43.758503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-18410bdb-755b-4140-8b52-dce82836e4a3 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:43.764079 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2177/4298] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:43 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1673 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:43.775657 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-18410bdb-755b-4140-8b52-dce82836e4a3 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1324 microversion: 2.1 time: 0.575929 Aug 25 13:20:43.777359 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2122/4299] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:43 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1324 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:43.801395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-39eff467-9676-4111-b847-799fdf54d0c3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:43.802573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-39eff467-9676-4111-b847-799fdf54d0c3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: 613a86a8-72d2-47f7-ac9d-4151e827126c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:43.802864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ce974e9-d7df-499d-8a23-7bafc055dde9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:43.804009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7ce974e9-d7df-499d-8a23-7bafc055dde9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:43.816372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39eff467-9676-4111-b847-799fdf54d0c3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:43.817865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ce974e9-d7df-499d-8a23-7bafc055dde9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:43.818117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39eff467-9676-4111-b847-799fdf54d0c3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:43.818708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39eff467-9676-4111-b847-799fdf54d0c3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:43.820072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ce974e9-d7df-499d-8a23-7bafc055dde9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:43.821291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ce974e9-d7df-499d-8a23-7bafc055dde9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:43.823461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ce974e9-d7df-499d-8a23-7bafc055dde9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:43.824365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ce974e9-d7df-499d-8a23-7bafc055dde9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:43.825802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ce974e9-d7df-499d-8a23-7bafc055dde9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:43.832917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39eff467-9676-4111-b847-799fdf54d0c3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:43.833872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39eff467-9676-4111-b847-799fdf54d0c3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:43.834693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39eff467-9676-4111-b847-799fdf54d0c3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:43.855149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:44.267062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7ce974e9-d7df-499d-8a23-7bafc055dde9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:44.318494 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ce974e9-d7df-499d-8a23-7bafc055dde9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1287 microversion: 2.1 time: 0.550794 Aug 25 13:20:44.366847 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2178/4300] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:43 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1287 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:44.391612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-afc55ad6-2271-43ed-ade5-cc060956a17a req-d158b33d-8d3b-4398-94c2-c84448d5394b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6362fd-0197-4636-8a8d-6814ba103aed", "tag": "221908ac-54e5-4185-a673-1a922869d2b5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:44.442156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-afc55ad6-2271-43ed-ade5-cc060956a17a req-d158b33d-8d3b-4398-94c2-c84448d5394b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:44.449360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-afc55ad6-2271-43ed-ade5-cc060956a17a req-d158b33d-8d3b-4398-94c2-c84448d5394b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:44.450388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-afc55ad6-2271-43ed-ade5-cc060956a17a req-d158b33d-8d3b-4398-94c2-c84448d5394b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:44.519732 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-afc55ad6-2271-43ed-ade5-cc060956a17a req-d158b33d-8d3b-4398-94c2-c84448d5394b service nova] Creating event network-changed:221908ac-54e5-4185-a673-1a922869d2b5 for instance cc6362fd-0197-4636-8a8d-6814ba103aed on n-h1-852771-8 Aug 25 13:20:44.548261 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-afc55ad6-2271-43ed-ade5-cc060956a17a req-d158b33d-8d3b-4398-94c2-c84448d5394b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178464 Aug 25 13:20:44.549565 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2179/4301] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:44.594628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66f6c1ca-57ff-4e9e-a2dd-99074bfb6f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:44.602238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66f6c1ca-57ff-4e9e-a2dd-99074bfb6f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:44.645951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66f6c1ca-57ff-4e9e-a2dd-99074bfb6f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:44.647187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66f6c1ca-57ff-4e9e-a2dd-99074bfb6f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:44.654249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66f6c1ca-57ff-4e9e-a2dd-99074bfb6f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:44.656497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66f6c1ca-57ff-4e9e-a2dd-99074bfb6f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:44.661278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66f6c1ca-57ff-4e9e-a2dd-99074bfb6f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:44.662498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66f6c1ca-57ff-4e9e-a2dd-99074bfb6f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:46.196139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-39eff467-9676-4111-b847-799fdf54d0c3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:46.239648 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-39eff467-9676-4111-b847-799fdf54d0c3 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c" status: 200 len: 1509 microversion: 2.1 time: 2.456038 Aug 25 13:20:46.243146 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2123/4302] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:43 2022] GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c => generated 1509 bytes in 2465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:46.312782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b1a06b64-bdf6-42c0-91d4-32dc6b68801d req-d4306092-4bf7-4d3b-9b37-de963430780a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756ef34e-d2ca-403d-b71c-3ab3c20141d1", "name": "network-vif-plugged", "status": "completed", "tag": "342751b4-25e1-44e2-bfae-118f47f56c8a"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:46.361002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b1a06b64-bdf6-42c0-91d4-32dc6b68801d req-d4306092-4bf7-4d3b-9b37-de963430780a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:46.362365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b1a06b64-bdf6-42c0-91d4-32dc6b68801d req-d4306092-4bf7-4d3b-9b37-de963430780a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:46.363180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b1a06b64-bdf6-42c0-91d4-32dc6b68801d req-d4306092-4bf7-4d3b-9b37-de963430780a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:46.420178 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b1a06b64-bdf6-42c0-91d4-32dc6b68801d req-d4306092-4bf7-4d3b-9b37-de963430780a service nova] Creating event network-vif-plugged:342751b4-25e1-44e2-bfae-118f47f56c8a for instance 756ef34e-d2ca-403d-b71c-3ab3c20141d1 on n-h2-852771-8 Aug 25 13:20:46.448501 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b1a06b64-bdf6-42c0-91d4-32dc6b68801d req-d4306092-4bf7-4d3b-9b37-de963430780a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176464 Aug 25 13:20:46.452931 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2124/4303] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:46.479603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d9d4538e-6128-403a-bae9-4ac18741add1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:46.483342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d9d4538e-6128-403a-bae9-4ac18741add1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:46.513434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9d4538e-6128-403a-bae9-4ac18741add1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:46.515059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9d4538e-6128-403a-bae9-4ac18741add1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:46.516051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9d4538e-6128-403a-bae9-4ac18741add1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:46.518949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9d4538e-6128-403a-bae9-4ac18741add1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:46.524725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9d4538e-6128-403a-bae9-4ac18741add1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:46.525812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9d4538e-6128-403a-bae9-4ac18741add1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:47.508843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d9d4538e-6128-403a-bae9-4ac18741add1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:47.538770 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d9d4538e-6128-403a-bae9-4ac18741add1 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1608 microversion: 2.1 time: 1.075680 Aug 25 13:20:47.539947 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2125/4304] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:46 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1608 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:47.586791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4f606a96-0fba-4ac7-90e7-3cb67038f02a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:47.590695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4f606a96-0fba-4ac7-90e7-3cb67038f02a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:47.626096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f606a96-0fba-4ac7-90e7-3cb67038f02a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:47.627464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f606a96-0fba-4ac7-90e7-3cb67038f02a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:47.628296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f606a96-0fba-4ac7-90e7-3cb67038f02a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:47.631583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f606a96-0fba-4ac7-90e7-3cb67038f02a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:47.632657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f606a96-0fba-4ac7-90e7-3cb67038f02a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:47.633614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f606a96-0fba-4ac7-90e7-3cb67038f02a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:48.405320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-66f6c1ca-57ff-4e9e-a2dd-99074bfb6f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:48.459496 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66f6c1ca-57ff-4e9e-a2dd-99074bfb6f26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 3.900277 Aug 25 13:20:48.494207 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2180/4305] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:44 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 3940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:48.509998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-77adadaa-0784-4966-af77-7bb513162f1f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:48.527067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-77adadaa-0784-4966-af77-7bb513162f1f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:48.549124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77adadaa-0784-4966-af77-7bb513162f1f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:48.557934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77adadaa-0784-4966-af77-7bb513162f1f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:48.558701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77adadaa-0784-4966-af77-7bb513162f1f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:48.560509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77adadaa-0784-4966-af77-7bb513162f1f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:48.561624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77adadaa-0784-4966-af77-7bb513162f1f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:48.563525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77adadaa-0784-4966-af77-7bb513162f1f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:49.278102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77adadaa-0784-4966-af77-7bb513162f1f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:49.310706 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-77adadaa-0784-4966-af77-7bb513162f1f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1285 microversion: 2.1 time: 0.811884 Aug 25 13:20:49.327092 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2181/4306] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:48 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1285 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:49.436012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c8398964-948c-4af9-9eb4-71ecfc75de3f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:49.441134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c8398964-948c-4af9-9eb4-71ecfc75de3f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:49.472178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8398964-948c-4af9-9eb4-71ecfc75de3f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:49.475882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8398964-948c-4af9-9eb4-71ecfc75de3f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:49.478687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8398964-948c-4af9-9eb4-71ecfc75de3f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:49.481135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8398964-948c-4af9-9eb4-71ecfc75de3f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:49.482846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8398964-948c-4af9-9eb4-71ecfc75de3f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:49.485162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8398964-948c-4af9-9eb4-71ecfc75de3f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:49.489032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4f606a96-0fba-4ac7-90e7-3cb67038f02a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:49.542447 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4f606a96-0fba-4ac7-90e7-3cb67038f02a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1324 microversion: 2.1 time: 1.988344 Aug 25 13:20:49.544001 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2126/4307] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:47 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1324 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:49.577803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b911c466-88d1-4576-9897-c822161d0aef tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:49.582939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b911c466-88d1-4576-9897-c822161d0aef tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:49.623983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b911c466-88d1-4576-9897-c822161d0aef tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:49.625614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b911c466-88d1-4576-9897-c822161d0aef tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:49.626506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b911c466-88d1-4576-9897-c822161d0aef tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:49.638608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b911c466-88d1-4576-9897-c822161d0aef tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:49.640763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b911c466-88d1-4576-9897-c822161d0aef tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:49.646031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b911c466-88d1-4576-9897-c822161d0aef tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:50.663152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b911c466-88d1-4576-9897-c822161d0aef tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e320ccc6c0624541895fc42bf681da76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de71f9e1804c46ab8f18f48a5fff42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:50.699916 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b911c466-88d1-4576-9897-c822161d0aef tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 200 len: 1323 microversion: 2.1 time: 1.153691 Aug 25 13:20:50.723174 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2127/4308] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:49 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 1323 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:50.758569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f00e975c-1cea-4c0d-ad07-ccefc425ac1b req-884bfc55-0419-4b21-9d80-2040e402701e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3eccca-1677-409a-bcf9-99d321525b2b", "name": "network-vif-deleted", "tag": "4d308beb-5849-4af8-9677-9649024147e8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:50.807126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f00e975c-1cea-4c0d-ad07-ccefc425ac1b req-884bfc55-0419-4b21-9d80-2040e402701e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:50.809205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f00e975c-1cea-4c0d-ad07-ccefc425ac1b req-884bfc55-0419-4b21-9d80-2040e402701e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:50.812123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f00e975c-1cea-4c0d-ad07-ccefc425ac1b req-884bfc55-0419-4b21-9d80-2040e402701e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:50.844078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:50.873697 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f00e975c-1cea-4c0d-ad07-ccefc425ac1b req-884bfc55-0419-4b21-9d80-2040e402701e service nova] Creating event network-vif-deleted:4d308beb-5849-4af8-9677-9649024147e8 for instance fe3eccca-1677-409a-bcf9-99d321525b2b on n-h2-852771-8 Aug 25 13:20:50.909778 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f00e975c-1cea-4c0d-ad07-ccefc425ac1b req-884bfc55-0419-4b21-9d80-2040e402701e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183821 Aug 25 13:20:50.922856 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2128/4309] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:50.953977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:50.966008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2a7a03f5-83cb-4357-9bf1-80921709ac5d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:50.968237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a7a03f5-83cb-4357-9bf1-80921709ac5d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:50.996732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7a03f5-83cb-4357-9bf1-80921709ac5d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:50.998524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7a03f5-83cb-4357-9bf1-80921709ac5d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:51.001809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7a03f5-83cb-4357-9bf1-80921709ac5d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:51.006616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7a03f5-83cb-4357-9bf1-80921709ac5d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:51.011669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7a03f5-83cb-4357-9bf1-80921709ac5d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:51.018010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a7a03f5-83cb-4357-9bf1-80921709ac5d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:51.474093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c8398964-948c-4af9-9eb4-71ecfc75de3f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:51.528014 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c8398964-948c-4af9-9eb4-71ecfc75de3f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1510 microversion: 2.1 time: 2.176973 Aug 25 13:20:51.534617 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2182/4310] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:49 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1510 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:51.556095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-91384877-d44c-4896-9aee-20c7d6f53ff7 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:51.564810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-91384877-d44c-4896-9aee-20c7d6f53ff7 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:51.583187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91384877-d44c-4896-9aee-20c7d6f53ff7 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:51.587011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91384877-d44c-4896-9aee-20c7d6f53ff7 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:51.591986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91384877-d44c-4896-9aee-20c7d6f53ff7 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:51.597392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91384877-d44c-4896-9aee-20c7d6f53ff7 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:51.603029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91384877-d44c-4896-9aee-20c7d6f53ff7 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:51.604449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91384877-d44c-4896-9aee-20c7d6f53ff7 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:51.712483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:52.141878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2a7a03f5-83cb-4357-9bf1-80921709ac5d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:52.175902 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2a7a03f5-83cb-4357-9bf1-80921709ac5d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.250880 Aug 25 13:20:52.193630 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2129/4311] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:50 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:52.223099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-96830a18-10da-4949-84be-762bc8c5ea9a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:52.225453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-96830a18-10da-4949-84be-762bc8c5ea9a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:52.255608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96830a18-10da-4949-84be-762bc8c5ea9a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:52.257208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96830a18-10da-4949-84be-762bc8c5ea9a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:52.258449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96830a18-10da-4949-84be-762bc8c5ea9a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:52.263508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96830a18-10da-4949-84be-762bc8c5ea9a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:52.265388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96830a18-10da-4949-84be-762bc8c5ea9a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:52.271273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96830a18-10da-4949-84be-762bc8c5ea9a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:52.540304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-91384877-d44c-4896-9aee-20c7d6f53ff7 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:52.582359 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-91384877-d44c-4896-9aee-20c7d6f53ff7 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1327 microversion: 2.1 time: 1.045512 Aug 25 13:20:52.583251 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2183/4312] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:51 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1327 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:52.642557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:52.648957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:52.666107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:20:53.606036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:53.607403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:53.608395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:53.619162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:53.635096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:53.636217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:53.652968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-96830a18-10da-4949-84be-762bc8c5ea9a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:53.690720 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-96830a18-10da-4949-84be-762bc8c5ea9a tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1522 microversion: 2.1 time: 1.493134 Aug 25 13:20:53.695949 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2130/4313] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:52 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1522 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:53.747495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:53.760561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] [instance: fe3eccca-1677-409a-bcf9-99d321525b2b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:53.799886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:53.805697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:53.825444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:53.833949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:53.835538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:53.837004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:53.934184 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] HTTP exception thrown: Instance fe3eccca-1677-409a-bcf9-99d321525b2b could not be found. Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Request method failure captured: Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b HTTP/1.1 Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3Mr9cWgACYm-JJJ3jtHrhjTUF1SZTk5SfB-onmYg_dkoF9Umi4EcFGUk_Hxt1tkajZlvH92Le8pKZsZ_x3nzluflBOJ0M8UYE0mStiqoLa4TCWq76ZCTPEE_7qbDlcr456ZSpBTxR3-8SWamaTMIPsT_5mpLgXenA2keElRqYPMqBw Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8de71f9e1804c46ab8f18f48a5fff42", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8de71f9e1804c46ab8f18f48a5fff42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8de71f9e1804c46ab8f18f48a5fff42"}]}] Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b8de71f9e1804c46ab8f18f48a5fff42 Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-997153903 Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: e320ccc6c0624541895fc42bf681da76 Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-997153903-project Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance fe3eccca-1677-409a-bcf9-99d321525b2b could not be found. Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'fe3eccca-1677-409a-bcf9-99d321525b2b'} Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe3eccca-1677-409a-bcf9-99d321525b2b could not be found. Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe3eccca-1677-409a-bcf9-99d321525b2b could not be found. Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:53.945682 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:53.955418 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:53.955418 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:53.955418 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:53.955418 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:20:53.955418 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:20:53.955418 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe3eccca-1677-409a-bcf9-99d321525b2b could not be found. Aug 25 13:20:53.955418 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:53.960538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Returning 404 to user: Instance fe3eccca-1677-409a-bcf9-99d321525b2b could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:20:53.962951 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0de6a39a-63f3-4395-a2c6-ec727f42ad4c tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b" status: 404 len: 111 microversion: 2.1 time: 0.237735 Aug 25 13:20:53.965259 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2131/4314] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:53 2022] GET /compute/v2.1/servers/fe3eccca-1677-409a-bcf9-99d321525b2b => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:20:53.989279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-15486d71-a274-4d70-a11a-1e6c1474db38 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:53.993203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-15486d71-a274-4d70-a11a-1e6c1474db38 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:54.031763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15486d71-a274-4d70-a11a-1e6c1474db38 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:54.034545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15486d71-a274-4d70-a11a-1e6c1474db38 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:54.038221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15486d71-a274-4d70-a11a-1e6c1474db38 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:54.041665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15486d71-a274-4d70-a11a-1e6c1474db38 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:54.042854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15486d71-a274-4d70-a11a-1e6c1474db38 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:54.043858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15486d71-a274-4d70-a11a-1e6c1474db38 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:54.255239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:20:54.587434 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-38d643f8-0e59-4549-9588-bb234324b2bd tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 345 microversion: 2.1 time: 1.968740 Aug 25 13:20:54.594507 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2184/4315] 10.222.0.70 () {58 vars in 1154 bytes} [Thu Aug 25 13:20:52 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 345 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:54.610764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f9972bd5-35b2-4037-9566-0a40da000333 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:54.619498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f9972bd5-35b2-4037-9566-0a40da000333 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:54.675410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9972bd5-35b2-4037-9566-0a40da000333 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:54.676689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9972bd5-35b2-4037-9566-0a40da000333 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:54.678766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9972bd5-35b2-4037-9566-0a40da000333 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:54.683365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9972bd5-35b2-4037-9566-0a40da000333 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:54.684607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9972bd5-35b2-4037-9566-0a40da000333 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:54.689062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9972bd5-35b2-4037-9566-0a40da000333 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:55.366560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-15486d71-a274-4d70-a11a-1e6c1474db38 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:55.400209 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-15486d71-a274-4d70-a11a-1e6c1474db38 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.431517 Aug 25 13:20:55.407176 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2132/4316] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:53 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:55.433548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:55.440965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:55.506177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:55.508013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:55.512663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:55.514750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:55.518948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:55.534731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:55.691688 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] HTTP exception thrown: Action 999 not found Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Request method failure captured: Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1/os-instance-actions/999 HTTP/1.1 Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3cL8HM5PnYLhHUsVnZ-kBfZZJpffwWNBplUL4QgQHVczGOWBk4Ncd8MPlHBjblkt18wAgmNXs_BSvFkqTFz8jOzHuXXi0NbLeFVEZ0CDCZpexaqltJT-aY3zhol--gDY1K34ZHlWzh7ZozFWSSrgSgysbqFFr2Qkh-hqWawW3UgHdg Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 4567bd5b7ed04fb39936d8dbdeee3f4f Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1574268668 Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4567bd5b7ed04fb39936d8dbdeee3f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4567bd5b7ed04fb39936d8dbdeee3f4f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4567bd5b7ed04fb39936d8dbdeee3f4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4567bd5b7ed04fb39936d8dbdeee3f4f"}]}] Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1574268668 Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 4567bd5b7ed04fb39936d8dbdeee3f4f Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1574268668 Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-InstanceActionsNegativeTestJSON-1574268668-project Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 89a71464f97c46139287885454256eed Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1574268668-project Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: exception: Action 999 not found Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'server_id': '756ef34e-d2ca-403d-b71c-3ab3c20141d1', 'id': '999'} Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 25 13:20:55.717151 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:20:55.726141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Returning 404 to user: Action 999 not found {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:20:55.729333 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-763bf86a-bd3a-4d3f-b3b3-e8a4c6b6b103 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.318717 Aug 25 13:20:55.731148 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2133/4317] 10.222.0.70 () {58 vars in 1308 bytes} [Thu Aug 25 13:20:55 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1/os-instance-actions/999 => generated 66 bytes in 323 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:20:55.749039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-626e60ff-b99c-4453-a8c0-f1cb25070299 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] Calling method '.version_select at 0x7f3a2e717550>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:55.834408 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-626e60ff-b99c-4453-a8c0-f1cb25070299 tempest-ServerActionsTestJSON-997153903 tempest-ServerActionsTestJSON-997153903-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-269775316" status: 202 len: 0 microversion: 2.1 time: 0.100181 Aug 25 13:20:55.849482 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2134/4318] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 13:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-269775316 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:20:55.877940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-47168517-8510-46b4-9ea6-f9fbf9bb4f95 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:55.881979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-47168517-8510-46b4-9ea6-f9fbf9bb4f95 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:55.897554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47168517-8510-46b4-9ea6-f9fbf9bb4f95 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:55.899527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47168517-8510-46b4-9ea6-f9fbf9bb4f95 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:55.922438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47168517-8510-46b4-9ea6-f9fbf9bb4f95 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:55.938276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47168517-8510-46b4-9ea6-f9fbf9bb4f95 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:55.945691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47168517-8510-46b4-9ea6-f9fbf9bb4f95 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:55.949692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47168517-8510-46b4-9ea6-f9fbf9bb4f95 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:55.969276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f9972bd5-35b2-4037-9566-0a40da000333 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:56.010991 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f9972bd5-35b2-4037-9566-0a40da000333 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1327 microversion: 2.1 time: 1.409172 Aug 25 13:20:56.016554 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2185/4319] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:54 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1327 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:56.057166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-754d5127-42ec-43ef-9448-2080a5994338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '.version_select at 0x7f3a29bdbf70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:56.063121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-754d5127-42ec-43ef-9448-2080a5994338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 8e3ab24d-92fc-4f4f-ab86-2542b0976f47] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:56.091088 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-754d5127-42ec-43ef-9448-2080a5994338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] HTTP exception thrown: Instance 8e3ab24d-92fc-4f4f-ab86-2542b0976f47 could not be found. Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-754d5127-42ec-43ef-9448-2080a5994338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Request method failure captured: Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/8e3ab24d-92fc-4f4f-ab86-2542b0976f47/os-instance-actions HTTP/1.1 Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3cL8HM5PnYLhHUsVnZ-kBfZZJpffwWNBplUL4QgQHVczGOWBk4Ncd8MPlHBjblkt18wAgmNXs_BSvFkqTFz8jOzHuXXi0NbLeFVEZ0CDCZpexaqltJT-aY3zhol--gDY1K34ZHlWzh7ZozFWSSrgSgysbqFFr2Qkh-hqWawW3UgHdg Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 4567bd5b7ed04fb39936d8dbdeee3f4f Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1574268668 Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4567bd5b7ed04fb39936d8dbdeee3f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4567bd5b7ed04fb39936d8dbdeee3f4f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4567bd5b7ed04fb39936d8dbdeee3f4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4567bd5b7ed04fb39936d8dbdeee3f4f"}]}] Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1574268668 Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 4567bd5b7ed04fb39936d8dbdeee3f4f Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1574268668 Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-InstanceActionsNegativeTestJSON-1574268668-project Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 89a71464f97c46139287885454256eed Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1574268668-project Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 8e3ab24d-92fc-4f4f-ab86-2542b0976f47 could not be found. Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': '8e3ab24d-92fc-4f4f-ab86-2542b0976f47'} Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3ab24d-92fc-4f4f-ab86-2542b0976f47 could not be found. Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:20:56.104463 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3ab24d-92fc-4f4f-ab86-2542b0976f47 could not be found. Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3ab24d-92fc-4f4f-ab86-2542b0976f47 could not be found. Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:20:56.114868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-754d5127-42ec-43ef-9448-2080a5994338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Returning 404 to user: Instance 8e3ab24d-92fc-4f4f-ab86-2542b0976f47 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:20:56.119564 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-754d5127-42ec-43ef-9448-2080a5994338 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/8e3ab24d-92fc-4f4f-ab86-2542b0976f47/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.084776 Aug 25 13:20:56.129077 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2186/4320] 10.222.0.70 () {58 vars in 1296 bytes} [Thu Aug 25 13:20:56 2022] GET /compute/v2.1/servers/8e3ab24d-92fc-4f4f-ab86-2542b0976f47/os-instance-actions => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:20:56.151964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ef9d04d0-0351-456d-9daa-4996deb39620 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:56.154823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ef9d04d0-0351-456d-9daa-4996deb39620 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:56.186103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef9d04d0-0351-456d-9daa-4996deb39620 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:56.197112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef9d04d0-0351-456d-9daa-4996deb39620 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:56.198495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef9d04d0-0351-456d-9daa-4996deb39620 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:56.200334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef9d04d0-0351-456d-9daa-4996deb39620 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:56.207785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef9d04d0-0351-456d-9daa-4996deb39620 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:56.209150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef9d04d0-0351-456d-9daa-4996deb39620 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:56.366523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ef9d04d0-0351-456d-9daa-4996deb39620 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:20:56.725935 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ef9d04d0-0351-456d-9daa-4996deb39620 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "DELETE /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 204 len: 0 microversion: 2.1 time: 0.593668 Aug 25 13:20:56.727198 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2187/4321] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:20:56 2022] DELETE /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:20:56.759124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e01f7d39-63d3-4bc2-8c21-80e79b5cdb16 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:56.761236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e01f7d39-63d3-4bc2-8c21-80e79b5cdb16 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:56.787894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e01f7d39-63d3-4bc2-8c21-80e79b5cdb16 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:56.806946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e01f7d39-63d3-4bc2-8c21-80e79b5cdb16 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:56.808236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e01f7d39-63d3-4bc2-8c21-80e79b5cdb16 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:56.813124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e01f7d39-63d3-4bc2-8c21-80e79b5cdb16 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:56.818844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e01f7d39-63d3-4bc2-8c21-80e79b5cdb16 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:56.820295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e01f7d39-63d3-4bc2-8c21-80e79b5cdb16 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:56.884427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-47168517-8510-46b4-9ea6-f9fbf9bb4f95 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:56.922426 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-47168517-8510-46b4-9ea6-f9fbf9bb4f95 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1510 microversion: 2.1 time: 1.070948 Aug 25 13:20:56.930311 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2135/4322] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:55 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1510 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:56.973741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e738ccfe-4d55-4d0a-91b4-b975dab89db6 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:56.977035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e738ccfe-4d55-4d0a-91b4-b975dab89db6 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:56.991551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e738ccfe-4d55-4d0a-91b4-b975dab89db6 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:56.993238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e738ccfe-4d55-4d0a-91b4-b975dab89db6 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:56.994700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e738ccfe-4d55-4d0a-91b4-b975dab89db6 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:56.996703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e738ccfe-4d55-4d0a-91b4-b975dab89db6 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:56.998247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e738ccfe-4d55-4d0a-91b4-b975dab89db6 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:57.000664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e738ccfe-4d55-4d0a-91b4-b975dab89db6 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:57.827798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e01f7d39-63d3-4bc2-8c21-80e79b5cdb16 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:57.868813 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e01f7d39-63d3-4bc2-8c21-80e79b5cdb16 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.138718 Aug 25 13:20:57.870924 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2188/4323] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:56 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:57.883305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8057430a-e248-4393-9997-37f0e18e4a8f req-1f4f2dba-1208-4877-8098-080ef7e9c99a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05c50a6-1d03-497c-bca8-06ea3c3dbd41", "tag": "2fca692a-d96c-47e3-a96d-bff53dbb21a6"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:57.955766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8057430a-e248-4393-9997-37f0e18e4a8f req-1f4f2dba-1208-4877-8098-080ef7e9c99a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:57.957396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8057430a-e248-4393-9997-37f0e18e4a8f req-1f4f2dba-1208-4877-8098-080ef7e9c99a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:57.959962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8057430a-e248-4393-9997-37f0e18e4a8f req-1f4f2dba-1208-4877-8098-080ef7e9c99a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:58.023616 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8057430a-e248-4393-9997-37f0e18e4a8f req-1f4f2dba-1208-4877-8098-080ef7e9c99a service nova] Creating event network-changed:2fca692a-d96c-47e3-a96d-bff53dbb21a6 for instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 on n-h1-852771-8 Aug 25 13:20:58.023945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e738ccfe-4d55-4d0a-91b4-b975dab89db6 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:58.059236 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8057430a-e248-4393-9997-37f0e18e4a8f req-1f4f2dba-1208-4877-8098-080ef7e9c99a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182501 Aug 25 13:20:58.059550 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e738ccfe-4d55-4d0a-91b4-b975dab89db6 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1528 microversion: 2.1 time: 1.119197 Aug 25 13:20:58.064091 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2136/4324] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:56 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1528 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:58.065799 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2189/4325] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:58.077067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3128f0c3-0d4f-4875-a8d8-ee3901fcc6f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:58.079946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3128f0c3-0d4f-4875-a8d8-ee3901fcc6f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: 613a86a8-72d2-47f7-ac9d-4151e827126c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:58.115196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3128f0c3-0d4f-4875-a8d8-ee3901fcc6f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:58.116569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3128f0c3-0d4f-4875-a8d8-ee3901fcc6f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:58.117928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3128f0c3-0d4f-4875-a8d8-ee3901fcc6f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:58.120055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3128f0c3-0d4f-4875-a8d8-ee3901fcc6f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:58.122991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3128f0c3-0d4f-4875-a8d8-ee3901fcc6f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:58.131070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3128f0c3-0d4f-4875-a8d8-ee3901fcc6f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:58.132127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f5a3b58-1031-4f0e-a760-7ccbf9b3fc7b tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:58.143257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3f5a3b58-1031-4f0e-a760-7ccbf9b3fc7b tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:58.178635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f5a3b58-1031-4f0e-a760-7ccbf9b3fc7b tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:58.187007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f5a3b58-1031-4f0e-a760-7ccbf9b3fc7b tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:58.203477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f5a3b58-1031-4f0e-a760-7ccbf9b3fc7b tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:58.205850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f5a3b58-1031-4f0e-a760-7ccbf9b3fc7b tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:58.207293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f5a3b58-1031-4f0e-a760-7ccbf9b3fc7b tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:58.208427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f5a3b58-1031-4f0e-a760-7ccbf9b3fc7b tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:58.221492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:59.228830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3128f0c3-0d4f-4875-a8d8-ee3901fcc6f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:59.261541 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3128f0c3-0d4f-4875-a8d8-ee3901fcc6f5 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c" status: 200 len: 1509 microversion: 2.1 time: 1.190044 Aug 25 13:20:59.277553 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2137/4326] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:58 2022] GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c => generated 1509 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:59.306853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-01f15c38-c818-4c04-b892-8e909a704abf tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:59.309691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-01f15c38-c818-4c04-b892-8e909a704abf tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:59.329719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:DELETE=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:59.345065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01f15c38-c818-4c04-b892-8e909a704abf tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:59.348240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01f15c38-c818-4c04-b892-8e909a704abf tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:59.350025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01f15c38-c818-4c04-b892-8e909a704abf tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:59.352923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01f15c38-c818-4c04-b892-8e909a704abf tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:59.354297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01f15c38-c818-4c04-b892-8e909a704abf tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:59.355358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01f15c38-c818-4c04-b892-8e909a704abf tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:00.696451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f5a3b58-1031-4f0e-a760-7ccbf9b3fc7b tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:00.718972 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f5a3b58-1031-4f0e-a760-7ccbf9b3fc7b tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1327 microversion: 2.1 time: 2.647027 Aug 25 13:21:00.720817 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2190/4327] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:58 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1327 bytes in 2654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:00.775136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-49bdd6c8-8249-4250-8f96-1977c8d8d47d tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:00.782238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-49bdd6c8-8249-4250-8f96-1977c8d8d47d tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:00.813544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49bdd6c8-8249-4250-8f96-1977c8d8d47d tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:00.826956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49bdd6c8-8249-4250-8f96-1977c8d8d47d tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:00.828674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49bdd6c8-8249-4250-8f96-1977c8d8d47d tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:00.830671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49bdd6c8-8249-4250-8f96-1977c8d8d47d tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:00.832228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49bdd6c8-8249-4250-8f96-1977c8d8d47d tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:00.833659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49bdd6c8-8249-4250-8f96-1977c8d8d47d tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:01.062342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-49bdd6c8-8249-4250-8f96-1977c8d8d47d tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a71464f97c46139287885454256eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4567bd5b7ed04fb39936d8dbdeee3f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:01.089553 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-49bdd6c8-8249-4250-8f96-1977c8d8d47d tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 200 len: 1486 microversion: 2.1 time: 0.321124 Aug 25 13:21:01.102880 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2191/4328] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:00 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 1486 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:01.131515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d2a8ad0-eb6d-463b-8cfc-42693b43ed78 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:01.133080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d2a8ad0-eb6d-463b-8cfc-42693b43ed78 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:01.147187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2a8ad0-eb6d-463b-8cfc-42693b43ed78 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:01.149910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2a8ad0-eb6d-463b-8cfc-42693b43ed78 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:01.151001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2a8ad0-eb6d-463b-8cfc-42693b43ed78 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:01.152526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2a8ad0-eb6d-463b-8cfc-42693b43ed78 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:01.153818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2a8ad0-eb6d-463b-8cfc-42693b43ed78 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:01.155174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d2a8ad0-eb6d-463b-8cfc-42693b43ed78 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:01.682405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-01f15c38-c818-4c04-b892-8e909a704abf tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:01.709183 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-01f15c38-c818-4c04-b892-8e909a704abf tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 2.442722 Aug 25 13:21:01.713426 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2138/4329] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:59 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 2449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:01.727935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-49cdb688-fee4-4b3e-bafc-502ea0e51cbf req-32ecd6b8-a32b-46a8-be03-56241763fcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756ef34e-d2ca-403d-b71c-3ab3c20141d1", "name": "network-vif-deleted", "tag": "342751b4-25e1-44e2-bfae-118f47f56c8a"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:01.763353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-49cdb688-fee4-4b3e-bafc-502ea0e51cbf req-32ecd6b8-a32b-46a8-be03-56241763fcf2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:01.765035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-49cdb688-fee4-4b3e-bafc-502ea0e51cbf req-32ecd6b8-a32b-46a8-be03-56241763fcf2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:01.766757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-49cdb688-fee4-4b3e-bafc-502ea0e51cbf req-32ecd6b8-a32b-46a8-be03-56241763fcf2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:01.823019 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-49cdb688-fee4-4b3e-bafc-502ea0e51cbf req-32ecd6b8-a32b-46a8-be03-56241763fcf2 service nova] Creating event network-vif-deleted:342751b4-25e1-44e2-bfae-118f47f56c8a for instance 756ef34e-d2ca-403d-b71c-3ab3c20141d1 on n-h2-852771-8 Aug 25 13:21:01.846078 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-49cdb688-fee4-4b3e-bafc-502ea0e51cbf req-32ecd6b8-a32b-46a8-be03-56241763fcf2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129388 Aug 25 13:21:01.848766 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2139/4330] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:01.861299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a01c549b-c88c-4b34-8df6-ee0b44d7fe7f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:01.862886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a01c549b-c88c-4b34-8df6-ee0b44d7fe7f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:01.878621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a01c549b-c88c-4b34-8df6-ee0b44d7fe7f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:01.879434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a01c549b-c88c-4b34-8df6-ee0b44d7fe7f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:01.882288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a01c549b-c88c-4b34-8df6-ee0b44d7fe7f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:01.883787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a01c549b-c88c-4b34-8df6-ee0b44d7fe7f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:01.885356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a01c549b-c88c-4b34-8df6-ee0b44d7fe7f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:01.886725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a01c549b-c88c-4b34-8df6-ee0b44d7fe7f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:02.012537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d2a8ad0-eb6d-463b-8cfc-42693b43ed78 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:02.051177 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d2a8ad0-eb6d-463b-8cfc-42693b43ed78 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1510 microversion: 2.1 time: 0.935545 Aug 25 13:21:02.052908 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2192/4331] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:01 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1510 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:02.106488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:02.117950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:02.120441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:21:02.133780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:02.134890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:02.136233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:02.139347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:02.140501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:02.152733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:02.234086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:21:02.367244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:02.406931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:02.409652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:02.410925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:02.723834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a01c549b-c88c-4b34-8df6-ee0b44d7fe7f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:02.782566 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a01c549b-c88c-4b34-8df6-ee0b44d7fe7f tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1327 microversion: 2.1 time: 0.928272 Aug 25 13:21:02.818109 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2140/4332] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:01 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1327 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:02.832512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:02.834367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] [instance: 756ef34e-d2ca-403d-b71c-3ab3c20141d1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:02.854060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:02.855623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:02.856888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:02.859701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:02.860669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:02.861480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:02.907978 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2320561a-1dc8-4947-a4d0-bca5b04c311c tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 4512 microversion: 2.1 time: 0.810627 Aug 25 13:21:02.909489 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2193/4333] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 13:21:02 2022] GET /compute/v2.1/servers/detail => generated 4512 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:02.921793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b829c47e-a751-4e89-b787-c993d78c6d5a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:02.923497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b829c47e-a751-4e89-b787-c993d78c6d5a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:02.935493 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] HTTP exception thrown: Instance 756ef34e-d2ca-403d-b71c-3ab3c20141d1 could not be found. Aug 25 13:21:02.938341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b829c47e-a751-4e89-b787-c993d78c6d5a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:02.942161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b829c47e-a751-4e89-b787-c993d78c6d5a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:02.945682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b829c47e-a751-4e89-b787-c993d78c6d5a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:02.948169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b829c47e-a751-4e89-b787-c993d78c6d5a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Request method failure captured: Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 HTTP/1.1 Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3cL8HM5PnYLhHUsVnZ-kBfZZJpffwWNBplUL4QgQHVczGOWBk4Ncd8MPlHBjblkt18wAgmNXs_BSvFkqTFz8jOzHuXXi0NbLeFVEZ0CDCZpexaqltJT-aY3zhol--gDY1K34ZHlWzh7ZozFWSSrgSgysbqFFr2Qkh-hqWawW3UgHdg Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 4567bd5b7ed04fb39936d8dbdeee3f4f Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1574268668 Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4567bd5b7ed04fb39936d8dbdeee3f4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4567bd5b7ed04fb39936d8dbdeee3f4f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4567bd5b7ed04fb39936d8dbdeee3f4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4567bd5b7ed04fb39936d8dbdeee3f4f"}]}] Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1574268668 Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 4567bd5b7ed04fb39936d8dbdeee3f4f Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1574268668 Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-InstanceActionsNegativeTestJSON-1574268668-project Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 89a71464f97c46139287885454256eed Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1574268668-project Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 756ef34e-d2ca-403d-b71c-3ab3c20141d1 could not be found. Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '756ef34e-d2ca-403d-b71c-3ab3c20141d1'} Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756ef34e-d2ca-403d-b71c-3ab3c20141d1 could not be found. Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756ef34e-d2ca-403d-b71c-3ab3c20141d1 could not be found. Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:02.948967 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:02.957754 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:02.957754 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:02.957754 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:02.957754 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:02.957754 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:02.957754 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:02.957754 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756ef34e-d2ca-403d-b71c-3ab3c20141d1 could not be found. Aug 25 13:21:02.957754 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:02.957754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] Returning 404 to user: Instance 756ef34e-d2ca-403d-b71c-3ab3c20141d1 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:02.957754 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b5157ff1-c74a-4634-8480-73247346c405 tempest-InstanceActionsNegativeTestJSON-1574268668 tempest-InstanceActionsNegativeTestJSON-1574268668-project] 10.222.0.70 "GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1" status: 404 len: 111 microversion: 2.1 time: 0.133500 Aug 25 13:21:02.962223 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2141/4334] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:02 2022] GET /compute/v2.1/servers/756ef34e-d2ca-403d-b71c-3ab3c20141d1 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:21:02.965902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b829c47e-a751-4e89-b787-c993d78c6d5a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:02.967054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b829c47e-a751-4e89-b787-c993d78c6d5a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:02.988159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:03.020079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:03.021691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:21:03.334418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:03.335767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:03.337237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:03.340944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:03.342123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:03.343689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:03.568204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:21:03.712776 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c4f18a8d-e0c8-4242-b3c3-f95759e34d39 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.748451 Aug 25 13:21:03.726456 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2142/4335] 10.222.0.70 () {58 vars in 1150 bytes} [Thu Aug 25 13:21:02 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:03.752294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:03.761403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:03.762532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:21:03.771521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:03.772398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:03.773175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:03.774951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:03.776133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:03.777907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:03.784522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b829c47e-a751-4e89-b787-c993d78c6d5a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:03.810511 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b829c47e-a751-4e89-b787-c993d78c6d5a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 0.898265 Aug 25 13:21:03.814278 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2194/4336] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:02 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:03.851430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-164b3d5b-076b-45c7-a0c3-5c2c919e33ba tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:03.854972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-164b3d5b-076b-45c7-a0c3-5c2c919e33ba tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:03.867975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164b3d5b-076b-45c7-a0c3-5c2c919e33ba tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:03.869671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164b3d5b-076b-45c7-a0c3-5c2c919e33ba tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:03.871343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164b3d5b-076b-45c7-a0c3-5c2c919e33ba tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:03.874493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164b3d5b-076b-45c7-a0c3-5c2c919e33ba tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:03.891450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164b3d5b-076b-45c7-a0c3-5c2c919e33ba tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:03.897597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-164b3d5b-076b-45c7-a0c3-5c2c919e33ba tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:04.005696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:21:04.025533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:04.210517 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2330f4d5-360c-459c-bf79-618a92607cd1 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.472034 Aug 25 13:21:04.215587 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2143/4337] 10.222.0.70 () {58 vars in 1212 bytes} [Thu Aug 25 13:21:03 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:04.241181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:04.262458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:04.262458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:21:04.279239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:04.280513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:04.281860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:04.283965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:04.286349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:04.290932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:04.556083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-164b3d5b-076b-45c7-a0c3-5c2c919e33ba tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:04.586960 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-164b3d5b-076b-45c7-a0c3-5c2c919e33ba tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1327 microversion: 2.1 time: 0.736789 Aug 25 13:21:04.598785 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2195/4338] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:03 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1327 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:04.641863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:21:04.777830 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ca82da25-12a0-4cef-8e9d-dc095a31ed59 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.545072 Aug 25 13:21:04.779072 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2144/4339] 10.222.0.70 () {58 vars in 1196 bytes} [Thu Aug 25 13:21:04 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:04.799442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:04.817243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:04.819307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'name': '-872474963', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:21:04.834022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:04.835431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:04.836615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:04.840192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:04.841713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:04.842966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:04.854655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aac73435-8ca7-437c-b371-ca99fbe589d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:04.855741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aac73435-8ca7-437c-b371-ca99fbe589d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:04.886139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aac73435-8ca7-437c-b371-ca99fbe589d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:04.886822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aac73435-8ca7-437c-b371-ca99fbe589d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:04.887359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aac73435-8ca7-437c-b371-ca99fbe589d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:04.888206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aac73435-8ca7-437c-b371-ca99fbe589d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:04.888740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aac73435-8ca7-437c-b371-ca99fbe589d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:04.889297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aac73435-8ca7-437c-b371-ca99fbe589d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:05.117893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:21:05.329956 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cf72338c-843e-4baa-a4a0-6eb2558bee5f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?name=-872474963" status: 200 len: 345 microversion: 2.1 time: 0.538108 Aug 25 13:21:05.331631 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2196/4340] 10.222.0.70 () {58 vars in 1156 bytes} [Thu Aug 25 13:21:04 2022] GET /compute/v2.1/servers?name=-872474963 => generated 345 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:05.360780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:05.373131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:05.374749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:21:05.387598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:05.390867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:05.392258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:05.395311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:05.398378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:05.399210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:05.619354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aac73435-8ca7-437c-b371-ca99fbe589d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:05.635947 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aac73435-8ca7-437c-b371-ca99fbe589d1 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 0.789953 Aug 25 13:21:05.638029 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2145/4341] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:04 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:05.646356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:21:05.649808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df219556-27cf-464e-8adf-9e8ac2cd8ac9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:05.651599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df219556-27cf-464e-8adf-9e8ac2cd8ac9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:05.669236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df219556-27cf-464e-8adf-9e8ac2cd8ac9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:05.671276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df219556-27cf-464e-8adf-9e8ac2cd8ac9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:05.672552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df219556-27cf-464e-8adf-9e8ac2cd8ac9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:05.677332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df219556-27cf-464e-8adf-9e8ac2cd8ac9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:05.677332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df219556-27cf-464e-8adf-9e8ac2cd8ac9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:05.677332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df219556-27cf-464e-8adf-9e8ac2cd8ac9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:05.876828 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b5399f1b-1187-48e9-b650-069cef1fd978 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.524892 Aug 25 13:21:05.885931 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2197/4342] 10.222.0.70 () {58 vars in 1154 bytes} [Thu Aug 25 13:21:05 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:05.911772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:05.927046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:05.929971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-87247496', 'deleted': False, 'project_id': '15dcef23255440f4b9f150820a8afd2d'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:21:05.944421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:05.945481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:05.946717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:05.948084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:05.950208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:05.951111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:06.183615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:21:06.347002 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-957251a8-961a-429c-a60c-705833d2f92f tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-87247496" status: 200 len: 345 microversion: 2.1 time: 0.443143 Aug 25 13:21:06.350109 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2198/4343] 10.222.0.70 () {58 vars in 1226 bytes} [Thu Aug 25 13:21:05 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-87247496 => generated 345 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:06.374824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b99f9f4-1de0-4dbc-96a2-fd3fbee7a3a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:06.376206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3b99f9f4-1de0-4dbc-96a2-fd3fbee7a3a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:06.393568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b99f9f4-1de0-4dbc-96a2-fd3fbee7a3a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:06.395357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b99f9f4-1de0-4dbc-96a2-fd3fbee7a3a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:06.396346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b99f9f4-1de0-4dbc-96a2-fd3fbee7a3a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:06.397890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b99f9f4-1de0-4dbc-96a2-fd3fbee7a3a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:06.398746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b99f9f4-1de0-4dbc-96a2-fd3fbee7a3a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:06.399435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b99f9f4-1de0-4dbc-96a2-fd3fbee7a3a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:06.448894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df219556-27cf-464e-8adf-9e8ac2cd8ac9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:06.469452 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df219556-27cf-464e-8adf-9e8ac2cd8ac9 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1327 microversion: 2.1 time: 0.828759 Aug 25 13:21:06.483417 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2146/4344] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:05 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1327 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:06.506581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3b99f9f4-1de0-4dbc-96a2-fd3fbee7a3a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:21:06.682866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77d5205f-8f59-47a1-954b-e577a8b318bb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:06.687280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-77d5205f-8f59-47a1-954b-e577a8b318bb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:06.732240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77d5205f-8f59-47a1-954b-e577a8b318bb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:06.734935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77d5205f-8f59-47a1-954b-e577a8b318bb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:06.735815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77d5205f-8f59-47a1-954b-e577a8b318bb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:06.737136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77d5205f-8f59-47a1-954b-e577a8b318bb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:06.737987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77d5205f-8f59-47a1-954b-e577a8b318bb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:06.738730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77d5205f-8f59-47a1-954b-e577a8b318bb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:06.866328 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3b99f9f4-1de0-4dbc-96a2-fd3fbee7a3a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 204 len: 0 microversion: 2.1 time: 0.498904 Aug 25 13:21:06.872128 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2199/4345] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:21:06 2022] DELETE /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:21:06.886945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6d585d1-01f1-4c4f-af20-fe8254e67c87 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:06.889828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d6d585d1-01f1-4c4f-af20-fe8254e67c87 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:06.905207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d585d1-01f1-4c4f-af20-fe8254e67c87 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:06.906233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d585d1-01f1-4c4f-af20-fe8254e67c87 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:06.907184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d585d1-01f1-4c4f-af20-fe8254e67c87 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:06.909176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d585d1-01f1-4c4f-af20-fe8254e67c87 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:06.910733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d585d1-01f1-4c4f-af20-fe8254e67c87 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:06.911828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d585d1-01f1-4c4f-af20-fe8254e67c87 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:07.664590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-77d5205f-8f59-47a1-954b-e577a8b318bb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:07.683968 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-77d5205f-8f59-47a1-954b-e577a8b318bb tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.007576 Aug 25 13:21:07.686617 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2147/4346] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:06 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:07.706829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e2267b2c-b625-4464-824d-76037ab3b069 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:07.708053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e2267b2c-b625-4464-824d-76037ab3b069 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:07.726532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2267b2c-b625-4464-824d-76037ab3b069 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:07.727923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2267b2c-b625-4464-824d-76037ab3b069 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:07.729273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2267b2c-b625-4464-824d-76037ab3b069 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:07.731453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2267b2c-b625-4464-824d-76037ab3b069 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:07.732848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2267b2c-b625-4464-824d-76037ab3b069 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:07.734309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2267b2c-b625-4464-824d-76037ab3b069 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:07.771723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d6d585d1-01f1-4c4f-af20-fe8254e67c87 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:07.805493 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d6d585d1-01f1-4c4f-af20-fe8254e67c87 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1516 microversion: 2.1 time: 0.926944 Aug 25 13:21:07.810216 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2200/4347] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:06 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1516 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:08.732926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-03dcae38-e6ff-4334-8399-e73ec7edc06d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:08.735053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-03dcae38-e6ff-4334-8399-e73ec7edc06d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:08.753296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03dcae38-e6ff-4334-8399-e73ec7edc06d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:08.754468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03dcae38-e6ff-4334-8399-e73ec7edc06d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:08.755341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03dcae38-e6ff-4334-8399-e73ec7edc06d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:08.756866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03dcae38-e6ff-4334-8399-e73ec7edc06d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:08.757790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03dcae38-e6ff-4334-8399-e73ec7edc06d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:08.758683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03dcae38-e6ff-4334-8399-e73ec7edc06d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:09.390048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e2267b2c-b625-4464-824d-76037ab3b069 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:09.455216 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e2267b2c-b625-4464-824d-76037ab3b069 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1327 microversion: 2.1 time: 1.758701 Aug 25 13:21:09.457601 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2148/4348] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:07 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1327 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:09.507765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8f451caa-d9e5-4def-9a40-0c031ba9dfbc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:09.509251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8f451caa-d9e5-4def-9a40-0c031ba9dfbc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:09.525199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f451caa-d9e5-4def-9a40-0c031ba9dfbc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:09.526741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f451caa-d9e5-4def-9a40-0c031ba9dfbc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:09.527937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f451caa-d9e5-4def-9a40-0c031ba9dfbc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:09.530291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f451caa-d9e5-4def-9a40-0c031ba9dfbc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:09.531877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f451caa-d9e5-4def-9a40-0c031ba9dfbc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:09.533324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f451caa-d9e5-4def-9a40-0c031ba9dfbc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:09.794296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-03dcae38-e6ff-4334-8399-e73ec7edc06d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:09.830883 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-03dcae38-e6ff-4334-8399-e73ec7edc06d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.109428 Aug 25 13:21:09.832369 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2201/4349] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:08 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:10.356646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d4a555aa-96ee-4ff6-813c-3a37201fdc38 req-fc49206f-880d-421d-93c6-a4bcce17de98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05c50a6-1d03-497c-bca8-06ea3c3dbd41", "name": "network-vif-plugged", "status": "completed", "tag": "2fca692a-d96c-47e3-a96d-bff53dbb21a6"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:10.381328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d4a555aa-96ee-4ff6-813c-3a37201fdc38 req-fc49206f-880d-421d-93c6-a4bcce17de98 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:10.382289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d4a555aa-96ee-4ff6-813c-3a37201fdc38 req-fc49206f-880d-421d-93c6-a4bcce17de98 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:10.383097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d4a555aa-96ee-4ff6-813c-3a37201fdc38 req-fc49206f-880d-421d-93c6-a4bcce17de98 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:10.407180 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d4a555aa-96ee-4ff6-813c-3a37201fdc38 req-fc49206f-880d-421d-93c6-a4bcce17de98 service nova] Creating event network-vif-plugged:2fca692a-d96c-47e3-a96d-bff53dbb21a6 for instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 on n-h1-852771-8 Aug 25 13:21:10.417871 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d4a555aa-96ee-4ff6-813c-3a37201fdc38 req-fc49206f-880d-421d-93c6-a4bcce17de98 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.569871 Aug 25 13:21:10.419220 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2202/4350] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:10.502943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8c31486c-a8be-4f62-8ef6-ea28710586ed tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:10.506570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8c31486c-a8be-4f62-8ef6-ea28710586ed tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:10.528478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c31486c-a8be-4f62-8ef6-ea28710586ed tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:10.530448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c31486c-a8be-4f62-8ef6-ea28710586ed tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:10.531563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c31486c-a8be-4f62-8ef6-ea28710586ed tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:10.533401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c31486c-a8be-4f62-8ef6-ea28710586ed tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:10.534826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c31486c-a8be-4f62-8ef6-ea28710586ed tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:10.536217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c31486c-a8be-4f62-8ef6-ea28710586ed tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:11.331047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8f451caa-d9e5-4def-9a40-0c031ba9dfbc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:11.347084 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8f451caa-d9e5-4def-9a40-0c031ba9dfbc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1516 microversion: 2.1 time: 1.879071 Aug 25 13:21:11.348362 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2149/4351] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:09 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1516 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:11.357264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa06e01c-9c46-4d87-9fd2-e5d4a5997d50 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:11.358776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa06e01c-9c46-4d87-9fd2-e5d4a5997d50 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:11.387289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa06e01c-9c46-4d87-9fd2-e5d4a5997d50 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:11.388199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa06e01c-9c46-4d87-9fd2-e5d4a5997d50 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:11.389895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa06e01c-9c46-4d87-9fd2-e5d4a5997d50 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:11.390763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa06e01c-9c46-4d87-9fd2-e5d4a5997d50 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:11.402142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa06e01c-9c46-4d87-9fd2-e5d4a5997d50 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:11.403096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa06e01c-9c46-4d87-9fd2-e5d4a5997d50 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:12.282739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8c31486c-a8be-4f62-8ef6-ea28710586ed tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:12.300079 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8c31486c-a8be-4f62-8ef6-ea28710586ed tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1327 microversion: 2.1 time: 1.804901 Aug 25 13:21:12.301166 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2203/4352] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:10 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1327 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:12.390891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7127cf5e-ba11-44a0-a96f-38e13db6c5c0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:12.392459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7127cf5e-ba11-44a0-a96f-38e13db6c5c0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:12.396794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:12.398113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=76,nova_api:UPDATE=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:12.413318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7127cf5e-ba11-44a0-a96f-38e13db6c5c0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:12.414293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7127cf5e-ba11-44a0-a96f-38e13db6c5c0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:12.415117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7127cf5e-ba11-44a0-a96f-38e13db6c5c0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:12.416470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7127cf5e-ba11-44a0-a96f-38e13db6c5c0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:12.417658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7127cf5e-ba11-44a0-a96f-38e13db6c5c0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:12.418627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7127cf5e-ba11-44a0-a96f-38e13db6c5c0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:12.430984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:12.834407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fa06e01c-9c46-4d87-9fd2-e5d4a5997d50 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:12.866708 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa06e01c-9c46-4d87-9fd2-e5d4a5997d50 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.516195 Aug 25 13:21:12.869874 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2150/4353] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:11 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:13.347227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fde52f04-e767-4415-ba27-39ab8b9e4211 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:13.348868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fde52f04-e767-4415-ba27-39ab8b9e4211 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:13.366662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde52f04-e767-4415-ba27-39ab8b9e4211 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:13.368001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde52f04-e767-4415-ba27-39ab8b9e4211 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:13.368947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde52f04-e767-4415-ba27-39ab8b9e4211 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:13.370350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde52f04-e767-4415-ba27-39ab8b9e4211 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:13.371584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde52f04-e767-4415-ba27-39ab8b9e4211 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:13.372536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fde52f04-e767-4415-ba27-39ab8b9e4211 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:14.396145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:14.713171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7127cf5e-ba11-44a0-a96f-38e13db6c5c0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:14.730117 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7127cf5e-ba11-44a0-a96f-38e13db6c5c0 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1516 microversion: 2.1 time: 2.347816 Aug 25 13:21:14.731640 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2204/4354] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:12 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1516 bytes in 2351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:14.742217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce2b56bb-b81b-42ac-a6f2-66fdeaf5a249 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:14.743851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ce2b56bb-b81b-42ac-a6f2-66fdeaf5a249 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:14.758999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce2b56bb-b81b-42ac-a6f2-66fdeaf5a249 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:14.760434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce2b56bb-b81b-42ac-a6f2-66fdeaf5a249 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:14.761687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce2b56bb-b81b-42ac-a6f2-66fdeaf5a249 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:14.763401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce2b56bb-b81b-42ac-a6f2-66fdeaf5a249 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:14.765131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce2b56bb-b81b-42ac-a6f2-66fdeaf5a249 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:14.766414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce2b56bb-b81b-42ac-a6f2-66fdeaf5a249 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:15.690209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fde52f04-e767-4415-ba27-39ab8b9e4211 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:15.711520 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fde52f04-e767-4415-ba27-39ab8b9e4211 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1526 microversion: 2.1 time: 2.376567 Aug 25 13:21:15.727166 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2151/4355] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:13 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1526 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:15.727166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f0696105-96ea-4bfe-bd7d-a1831d4c7684 req-3b53a4a4-7822-473d-846a-764cea53bf4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51c4138-b024-45b6-88ca-222fdfe3d9dd", "name": "network-vif-unplugged", "status": "completed", "tag": "db9db7f2-e3de-4f8c-969c-7d089b1349af"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:15.749715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f0696105-96ea-4bfe-bd7d-a1831d4c7684 req-3b53a4a4-7822-473d-846a-764cea53bf4f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:15.751922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f0696105-96ea-4bfe-bd7d-a1831d4c7684 req-3b53a4a4-7822-473d-846a-764cea53bf4f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:15.753131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f0696105-96ea-4bfe-bd7d-a1831d4c7684 req-3b53a4a4-7822-473d-846a-764cea53bf4f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:15.778731 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f0696105-96ea-4bfe-bd7d-a1831d4c7684 req-3b53a4a4-7822-473d-846a-764cea53bf4f service nova] Creating event network-vif-unplugged:db9db7f2-e3de-4f8c-969c-7d089b1349af for instance a51c4138-b024-45b6-88ca-222fdfe3d9dd on n-h1-852771-8 Aug 25 13:21:15.790582 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f0696105-96ea-4bfe-bd7d-a1831d4c7684 req-3b53a4a4-7822-473d-846a-764cea53bf4f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075037 Aug 25 13:21:15.792017 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2152/4356] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:15.806686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4753c02c-72a5-4249-bfcd-8ca199f529ab tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:15.807916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4753c02c-72a5-4249-bfcd-8ca199f529ab tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:15.820204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4753c02c-72a5-4249-bfcd-8ca199f529ab tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:15.821371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4753c02c-72a5-4249-bfcd-8ca199f529ab tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:15.822710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4753c02c-72a5-4249-bfcd-8ca199f529ab tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:15.824019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4753c02c-72a5-4249-bfcd-8ca199f529ab tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:15.824711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4753c02c-72a5-4249-bfcd-8ca199f529ab tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:15.825317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4753c02c-72a5-4249-bfcd-8ca199f529ab tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:15.856000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ce2b56bb-b81b-42ac-a6f2-66fdeaf5a249 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:15.885375 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce2b56bb-b81b-42ac-a6f2-66fdeaf5a249 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.151481 Aug 25 13:21:15.887400 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2205/4357] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:14 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:15.899358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-77337afb-da9b-43bf-8320-a60498360201 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:15.901193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-77337afb-da9b-43bf-8320-a60498360201 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:15.914385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77337afb-da9b-43bf-8320-a60498360201 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:15.915193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77337afb-da9b-43bf-8320-a60498360201 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:15.915933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77337afb-da9b-43bf-8320-a60498360201 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:15.917197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77337afb-da9b-43bf-8320-a60498360201 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:15.917972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77337afb-da9b-43bf-8320-a60498360201 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:15.918624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77337afb-da9b-43bf-8320-a60498360201 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:16.036130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:16.289876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77337afb-da9b-43bf-8320-a60498360201 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:16.310955 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-77337afb-da9b-43bf-8320-a60498360201 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 200 len: 1474 microversion: 2.1 time: 0.419664 Aug 25 13:21:16.312928 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2206/4358] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:15 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 1474 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:16.926638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da85f892-9cda-439f-a3a0-5f527e601a7b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:16.927760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da85f892-9cda-439f-a3a0-5f527e601a7b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:16.942276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da85f892-9cda-439f-a3a0-5f527e601a7b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:16.943077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da85f892-9cda-439f-a3a0-5f527e601a7b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:16.944121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da85f892-9cda-439f-a3a0-5f527e601a7b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:16.945692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da85f892-9cda-439f-a3a0-5f527e601a7b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:16.946435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da85f892-9cda-439f-a3a0-5f527e601a7b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:16.947033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da85f892-9cda-439f-a3a0-5f527e601a7b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:17.285454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4753c02c-72a5-4249-bfcd-8ca199f529ab tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:17.303495 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4753c02c-72a5-4249-bfcd-8ca199f529ab tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1526 microversion: 2.1 time: 1.503896 Aug 25 13:21:17.304596 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2153/4359] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:15 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1526 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:17.340359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-4607a174-65e9-4001-9c75-f66053b53564 req-a3a4e2c7-8c79-46e4-b729-18dd7f1f7222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51c4138-b024-45b6-88ca-222fdfe3d9dd", "name": "network-vif-deleted", "tag": "db9db7f2-e3de-4f8c-969c-7d089b1349af"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:17.360250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4607a174-65e9-4001-9c75-f66053b53564 req-a3a4e2c7-8c79-46e4-b729-18dd7f1f7222 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:17.361161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4607a174-65e9-4001-9c75-f66053b53564 req-a3a4e2c7-8c79-46e4-b729-18dd7f1f7222 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:17.362077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4607a174-65e9-4001-9c75-f66053b53564 req-a3a4e2c7-8c79-46e4-b729-18dd7f1f7222 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:17.398900 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-4607a174-65e9-4001-9c75-f66053b53564 req-a3a4e2c7-8c79-46e4-b729-18dd7f1f7222 service nova] Creating event network-vif-deleted:db9db7f2-e3de-4f8c-969c-7d089b1349af for instance a51c4138-b024-45b6-88ca-222fdfe3d9dd on n-h1-852771-8 Aug 25 13:21:17.410077 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-4607a174-65e9-4001-9c75-f66053b53564 req-a3a4e2c7-8c79-46e4-b729-18dd7f1f7222 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089004 Aug 25 13:21:17.411130 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2154/4360] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:17.704769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:17.706145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:17.719993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:17.722633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:17.723962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:17.725679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:17.727122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:17.728445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:17.773240 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] HTTP exception thrown: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Request method failure captured: Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 HTTP/1.1 Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3chNXp-kSKGpsGBzJOGJXoC9T7XNGfu2ObaXRuxuPcAZQHY82_LO50fFkmbyHuUnlaw1cZR9uno2DBmD6WVd6WJtQ1O_jRLaZNS2OozHqfpKrPAkMr8-BnxcNLlXEFMs2LNSeIOWDrDslzYsr7FXeLuJA4hJWvzO9OAWSpg-9gtiuU Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5c03d373f39f4616879b0da945a87865 Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1640748663 Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c03d373f39f4616879b0da945a87865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5c03d373f39f4616879b0da945a87865", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5c03d373f39f4616879b0da945a87865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c03d373f39f4616879b0da945a87865"}]}] Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1640748663 Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5c03d373f39f4616879b0da945a87865 Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1640748663 Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1640748663-project Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 45f7abc03f8649dd86f736d551f82249 Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1640748663-project Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'c05c50a6-1d03-497c-bca8-06ea3c3dbd41'} Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:17.778105 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:17.792443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Returning 404 to user: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:17.807965 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ec79e17d-08e8-46ea-b249-5a19f91beaf2 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 404 len: 111 microversion: 2.1 time: 0.371245 Aug 25 13:21:17.807965 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2155/4361] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:21:17 2022] DELETE /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 111 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:21:17.807965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:17.822803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: a51c4138-b024-45b6-88ca-222fdfe3d9dd] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:17.836023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:17.836734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:17.842724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:17.844564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:17.845421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:17.846307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:17.934883 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] HTTP exception thrown: Instance a51c4138-b024-45b6-88ca-222fdfe3d9dd could not be found. Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Request method failure captured: Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd HTTP/1.1 Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3a1m_4TOkJnhOGjWx4H8gQ6Nv9GbeX1lWndj332JtMCZEdoaAuF8Qrxf5GaZa98vEo1cCHKhuLSpZlc9FGIIs1zLdbytRKkX2zFrVZs9apjpQSHEEPxIO0v6Im50Ve2vTsp__-j-mfoGF_u9HkvnY9qoEe8m0LP1nbxrNBgdDLh2uI Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 15dcef23255440f4b9f150820a8afd2d Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ListServerFiltersTestJSON-2050305063 Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15dcef23255440f4b9f150820a8afd2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_15dcef23255440f4b9f150820a8afd2d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/15dcef23255440f4b9f150820a8afd2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15dcef23255440f4b9f150820a8afd2d"}]}] Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ListServerFiltersTestJSON-2050305063 Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 15dcef23255440f4b9f150820a8afd2d Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2050305063 Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ListServerFiltersTestJSON-2050305063-project Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 94b6aafa5bc44f2badea5620d7714b3a Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ListServerFiltersTestJSON-2050305063-project Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance a51c4138-b024-45b6-88ca-222fdfe3d9dd could not be found. Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'a51c4138-b024-45b6-88ca-222fdfe3d9dd'} Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a51c4138-b024-45b6-88ca-222fdfe3d9dd could not be found. Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a51c4138-b024-45b6-88ca-222fdfe3d9dd could not be found. Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:17.950956 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:17.963993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:17.963993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:17.963993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:17.963993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:17.963993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:17.963993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a51c4138-b024-45b6-88ca-222fdfe3d9dd could not be found. Aug 25 13:21:17.963993 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:17.963993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Returning 404 to user: Instance a51c4138-b024-45b6-88ca-222fdfe3d9dd could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:17.963993 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e88d8320-489d-4b2a-85d7-05ddb0a4c190 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd" status: 404 len: 111 microversion: 2.1 time: 0.156185 Aug 25 13:21:17.963993 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2156/4362] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:17 2022] GET /compute/v2.1/servers/a51c4138-b024-45b6-88ca-222fdfe3d9dd => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:21:17.969262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-775945d0-483a-422b-853f-ed8858815b97 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:17.979224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-775945d0-483a-422b-853f-ed8858815b97 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:18.001972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-775945d0-483a-422b-853f-ed8858815b97 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.002903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-775945d0-483a-422b-853f-ed8858815b97 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.003749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-775945d0-483a-422b-853f-ed8858815b97 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.005245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-775945d0-483a-422b-853f-ed8858815b97 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.006140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-775945d0-483a-422b-853f-ed8858815b97 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.006947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-775945d0-483a-422b-853f-ed8858815b97 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.068098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da85f892-9cda-439f-a3a0-5f527e601a7b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:18.109030 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da85f892-9cda-439f-a3a0-5f527e601a7b tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.187681 Aug 25 13:21:18.138657 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2207/4363] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:16 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:18.165602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-59c90db8-c20f-48cc-b82b-f25565430cbf req-a084633c-534b-45b4-a840-e169a89e3ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6362fd-0197-4636-8a8d-6814ba103aed", "name": "network-vif-plugged", "status": "completed", "tag": "221908ac-54e5-4185-a673-1a922869d2b5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:18.190164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-59c90db8-c20f-48cc-b82b-f25565430cbf req-a084633c-534b-45b4-a840-e169a89e3ce1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.191181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-59c90db8-c20f-48cc-b82b-f25565430cbf req-a084633c-534b-45b4-a840-e169a89e3ce1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.191986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-59c90db8-c20f-48cc-b82b-f25565430cbf req-a084633c-534b-45b4-a840-e169a89e3ce1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.240412 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-59c90db8-c20f-48cc-b82b-f25565430cbf req-a084633c-534b-45b4-a840-e169a89e3ce1 service nova] Creating event network-vif-plugged:221908ac-54e5-4185-a673-1a922869d2b5 for instance cc6362fd-0197-4636-8a8d-6814ba103aed on n-h1-852771-8 Aug 25 13:21:18.254126 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-59c90db8-c20f-48cc-b82b-f25565430cbf req-a084633c-534b-45b4-a840-e169a89e3ce1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111793 Aug 25 13:21:18.256367 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2208/4364] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:18.268919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f01d12fb-1d45-46e6-93b8-e6a6fa29ce70 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:18.270670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f01d12fb-1d45-46e6-93b8-e6a6fa29ce70 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: 613a86a8-72d2-47f7-ac9d-4151e827126c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:18.287483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f01d12fb-1d45-46e6-93b8-e6a6fa29ce70 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.289133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f01d12fb-1d45-46e6-93b8-e6a6fa29ce70 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.290707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f01d12fb-1d45-46e6-93b8-e6a6fa29ce70 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.292730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f01d12fb-1d45-46e6-93b8-e6a6fa29ce70 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.293979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f01d12fb-1d45-46e6-93b8-e6a6fa29ce70 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.296239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f01d12fb-1d45-46e6-93b8-e6a6fa29ce70 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.378522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f01d12fb-1d45-46e6-93b8-e6a6fa29ce70 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: 613a86a8-72d2-47f7-ac9d-4151e827126c] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:21:18.651638 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f01d12fb-1d45-46e6-93b8-e6a6fa29ce70 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "DELETE /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c" status: 204 len: 0 microversion: 2.1 time: 0.391006 Aug 25 13:21:18.659863 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2209/4365] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:21:18 2022] DELETE /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:21:18.674765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-869d8e2b-36d1-436e-b26e-fc95d09587aa tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:18.676175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-869d8e2b-36d1-436e-b26e-fc95d09587aa tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: 613a86a8-72d2-47f7-ac9d-4151e827126c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:18.693540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869d8e2b-36d1-436e-b26e-fc95d09587aa tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.695054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869d8e2b-36d1-436e-b26e-fc95d09587aa tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.697090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869d8e2b-36d1-436e-b26e-fc95d09587aa tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.699588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869d8e2b-36d1-436e-b26e-fc95d09587aa tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.702775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869d8e2b-36d1-436e-b26e-fc95d09587aa tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.704362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869d8e2b-36d1-436e-b26e-fc95d09587aa tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.758299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-775945d0-483a-422b-853f-ed8858815b97 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:18.798731 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-775945d0-483a-422b-853f-ed8858815b97 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1526 microversion: 2.1 time: 0.841595 Aug 25 13:21:18.800544 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2157/4366] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:17 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1526 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:18.849714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Action: 'update', calling method: >, body: {"server": {"name": "c05c50a6-1d03-497c-bca8-06ea3c3dbd41_new"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:18.854609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:18.896773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.900271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.903177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.906258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.918983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.920982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.962193 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] HTTP exception thrown: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Request method failure captured: Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 HTTP/1.1 Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 64 Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3chNXp-kSKGpsGBzJOGJXoC9T7XNGfu2ObaXRuxuPcAZQHY82_LO50fFkmbyHuUnlaw1cZR9uno2DBmD6WVd6WJtQ1O_jRLaZNS2OozHqfpKrPAkMr8-BnxcNLlXEFMs2LNSeIOWDrDslzYsr7FXeLuJA4hJWvzO9OAWSpg-9gtiuU Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5c03d373f39f4616879b0da945a87865 Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1640748663 Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c03d373f39f4616879b0da945a87865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5c03d373f39f4616879b0da945a87865", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5c03d373f39f4616879b0da945a87865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c03d373f39f4616879b0da945a87865"}]}] Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1640748663 Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5c03d373f39f4616879b0da945a87865 Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1640748663 Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1640748663-project Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 45f7abc03f8649dd86f736d551f82249 Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1640748663-project Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "c05c50a6-1d03-497c-bca8-06ea3c3dbd41_new"}} Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'c05c50a6-1d03-497c-bca8-06ea3c3dbd41', 'body': {'server': {'name': 'c05c50a6-1d03-497c-bca8-06ea3c3dbd41_new'}}} Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:21:18.971195 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:18.978323 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:18.983924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] Returning 404 to user: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:18.986592 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-51773e95-f565-45be-8f9e-0c02f42fba02 tempest-ServersNegativeTestMultiTenantJSON-1640748663 tempest-ServersNegativeTestMultiTenantJSON-1640748663-project] 10.222.0.70 "PUT /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 404 len: 111 microversion: 2.1 time: 0.148007 Aug 25 13:21:18.988524 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2158/4367] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Aug 25 13:21:18 2022] PUT /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:21:19.003129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eeab30f1-5f4c-42c9-8bab-4666da322ba8 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:19.015100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eeab30f1-5f4c-42c9-8bab-4666da322ba8 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:19.038997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeab30f1-5f4c-42c9-8bab-4666da322ba8 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:19.040099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeab30f1-5f4c-42c9-8bab-4666da322ba8 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:19.041082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeab30f1-5f4c-42c9-8bab-4666da322ba8 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:19.042840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeab30f1-5f4c-42c9-8bab-4666da322ba8 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:19.043897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeab30f1-5f4c-42c9-8bab-4666da322ba8 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:19.056730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eeab30f1-5f4c-42c9-8bab-4666da322ba8 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:19.156210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eeab30f1-5f4c-42c9-8bab-4666da322ba8 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:21:19.478452 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eeab30f1-5f4c-42c9-8bab-4666da322ba8 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 204 len: 0 microversion: 2.1 time: 0.481292 Aug 25 13:21:19.479860 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2159/4368] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:21:18 2022] DELETE /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:21:19.504048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe02b42c-e938-4a4e-86d8-259f54978054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:19.511689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe02b42c-e938-4a4e-86d8-259f54978054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:19.540813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe02b42c-e938-4a4e-86d8-259f54978054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:19.545292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe02b42c-e938-4a4e-86d8-259f54978054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:19.548410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe02b42c-e938-4a4e-86d8-259f54978054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:19.549897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe02b42c-e938-4a4e-86d8-259f54978054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:19.555568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe02b42c-e938-4a4e-86d8-259f54978054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:19.556462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe02b42c-e938-4a4e-86d8-259f54978054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:20.279527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-869d8e2b-36d1-436e-b26e-fc95d09587aa tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:20.313910 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-869d8e2b-36d1-436e-b26e-fc95d09587aa tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c" status: 200 len: 1515 microversion: 2.1 time: 1.650631 Aug 25 13:21:20.321382 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2210/4369] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:18 2022] GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c => generated 1515 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:20.341007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-547daf57-273f-419a-9b60-5b70146c1246 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:20.343468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-547daf57-273f-419a-9b60-5b70146c1246 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:20.375860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-547daf57-273f-419a-9b60-5b70146c1246 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:20.377425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-547daf57-273f-419a-9b60-5b70146c1246 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:20.378726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-547daf57-273f-419a-9b60-5b70146c1246 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:20.380619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-547daf57-273f-419a-9b60-5b70146c1246 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:20.382074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-547daf57-273f-419a-9b60-5b70146c1246 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:20.383310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-547daf57-273f-419a-9b60-5b70146c1246 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:21.401466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fe02b42c-e938-4a4e-86d8-259f54978054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:21.426827 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe02b42c-e938-4a4e-86d8-259f54978054 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 1.944227 Aug 25 13:21:21.427916 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2160/4370] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:19 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:21.452932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3eeeed4d-62d7-4754-9564-d0f1544dd9bc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:21.458106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3eeeed4d-62d7-4754-9564-d0f1544dd9bc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: 613a86a8-72d2-47f7-ac9d-4151e827126c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:21.474986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3eeeed4d-62d7-4754-9564-d0f1544dd9bc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:21.475931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3eeeed4d-62d7-4754-9564-d0f1544dd9bc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:21.477369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3eeeed4d-62d7-4754-9564-d0f1544dd9bc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:21.479189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3eeeed4d-62d7-4754-9564-d0f1544dd9bc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:21.480485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3eeeed4d-62d7-4754-9564-d0f1544dd9bc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:21.483291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3eeeed4d-62d7-4754-9564-d0f1544dd9bc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:21.552869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:22.013981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3eeeed4d-62d7-4754-9564-d0f1544dd9bc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:22.049028 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3eeeed4d-62d7-4754-9564-d0f1544dd9bc tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c" status: 200 len: 1473 microversion: 2.1 time: 0.617275 Aug 25 13:21:22.054685 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2161/4371] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:21 2022] GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c => generated 1473 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:22.092632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-185715d3-16e5-4f13-a910-3691f81f6e00 req-14728032-2bfd-4de6-8469-9f6fdab853d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613a86a8-72d2-47f7-ac9d-4151e827126c", "name": "network-vif-deleted", "tag": "c21e142d-de3c-412b-8332-d9a4448c0226"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:22.158332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-185715d3-16e5-4f13-a910-3691f81f6e00 req-14728032-2bfd-4de6-8469-9f6fdab853d8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:22.159200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-185715d3-16e5-4f13-a910-3691f81f6e00 req-14728032-2bfd-4de6-8469-9f6fdab853d8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:22.160610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-185715d3-16e5-4f13-a910-3691f81f6e00 req-14728032-2bfd-4de6-8469-9f6fdab853d8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:22.229786 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-185715d3-16e5-4f13-a910-3691f81f6e00 req-14728032-2bfd-4de6-8469-9f6fdab853d8 service nova] Creating event network-vif-deleted:c21e142d-de3c-412b-8332-d9a4448c0226 for instance 613a86a8-72d2-47f7-ac9d-4151e827126c on n-h2-852771-8 Aug 25 13:21:22.252388 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-185715d3-16e5-4f13-a910-3691f81f6e00 req-14728032-2bfd-4de6-8469-9f6fdab853d8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195295 Aug 25 13:21:22.253755 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2162/4372] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:22.480952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1e02c519-0a27-4009-9d41-1a5b248143ba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:22.487637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1e02c519-0a27-4009-9d41-1a5b248143ba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:22.526360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e02c519-0a27-4009-9d41-1a5b248143ba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:22.527763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e02c519-0a27-4009-9d41-1a5b248143ba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:22.529817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e02c519-0a27-4009-9d41-1a5b248143ba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:22.537664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e02c519-0a27-4009-9d41-1a5b248143ba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:22.543515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e02c519-0a27-4009-9d41-1a5b248143ba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:22.548425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e02c519-0a27-4009-9d41-1a5b248143ba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:22.996332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-547daf57-273f-419a-9b60-5b70146c1246 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:23.043080 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-547daf57-273f-419a-9b60-5b70146c1246 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1532 microversion: 2.1 time: 2.709072 Aug 25 13:21:23.055760 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2211/4373] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:20 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1532 bytes in 2733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:23.103057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:23.104318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: 613a86a8-72d2-47f7-ac9d-4151e827126c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:23.130897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:23.131813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:23.132645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:23.151497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:23.153649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:23.162037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:23.261458 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] HTTP exception thrown: Instance 613a86a8-72d2-47f7-ac9d-4151e827126c could not be found. Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Request method failure captured: Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c HTTP/1.1 Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3a1m_4TOkJnhOGjWx4H8gQ6Nv9GbeX1lWndj332JtMCZEdoaAuF8Qrxf5GaZa98vEo1cCHKhuLSpZlc9FGIIs1zLdbytRKkX2zFrVZs9apjpQSHEEPxIO0v6Im50Ve2vTsp__-j-mfoGF_u9HkvnY9qoEe8m0LP1nbxrNBgdDLh2uI Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 15dcef23255440f4b9f150820a8afd2d Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ListServerFiltersTestJSON-2050305063 Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15dcef23255440f4b9f150820a8afd2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_15dcef23255440f4b9f150820a8afd2d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/15dcef23255440f4b9f150820a8afd2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15dcef23255440f4b9f150820a8afd2d"}]}] Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ListServerFiltersTestJSON-2050305063 Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 15dcef23255440f4b9f150820a8afd2d Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2050305063 Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ListServerFiltersTestJSON-2050305063-project Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 94b6aafa5bc44f2badea5620d7714b3a Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ListServerFiltersTestJSON-2050305063-project Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 613a86a8-72d2-47f7-ac9d-4151e827126c could not be found. Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '613a86a8-72d2-47f7-ac9d-4151e827126c'} Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613a86a8-72d2-47f7-ac9d-4151e827126c could not be found. Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613a86a8-72d2-47f7-ac9d-4151e827126c could not be found. Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:23.271763 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:23.285478 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:23.285478 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:23.285478 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:23.285478 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:23.285478 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:23.285478 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613a86a8-72d2-47f7-ac9d-4151e827126c could not be found. Aug 25 13:21:23.285478 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:23.288393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Returning 404 to user: Instance 613a86a8-72d2-47f7-ac9d-4151e827126c could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:23.290587 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ba13af98-471b-4730-b7f0-84e406f9094a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c" status: 404 len: 111 microversion: 2.1 time: 0.194991 Aug 25 13:21:23.294387 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2212/4374] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:23 2022] GET /compute/v2.1/servers/613a86a8-72d2-47f7-ac9d-4151e827126c => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:21:23.312312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4c1f0f07-9426-46c4-9063-93279eaac1c4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:23.316470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4c1f0f07-9426-46c4-9063-93279eaac1c4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:23.338571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c1f0f07-9426-46c4-9063-93279eaac1c4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:23.345376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c1f0f07-9426-46c4-9063-93279eaac1c4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:23.349935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c1f0f07-9426-46c4-9063-93279eaac1c4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:23.352675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c1f0f07-9426-46c4-9063-93279eaac1c4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:23.356422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c1f0f07-9426-46c4-9063-93279eaac1c4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:23.358259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c1f0f07-9426-46c4-9063-93279eaac1c4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:23.390950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1e02c519-0a27-4009-9d41-1a5b248143ba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:23.422282 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1e02c519-0a27-4009-9d41-1a5b248143ba tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1518 microversion: 2.1 time: 0.960608 Aug 25 13:21:23.423870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4c1f0f07-9426-46c4-9063-93279eaac1c4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:21:23.438141 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2163/4375] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:22 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1518 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:23.664976 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4c1f0f07-9426-46c4-9063-93279eaac1c4 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "DELETE /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 204 len: 0 microversion: 2.1 time: 0.353439 Aug 25 13:21:23.674238 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2213/4376] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:21:23 2022] DELETE /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:21:23.689027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-60beb4f9-e722-4134-bd93-cdb01b6c01a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:23.694626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-60beb4f9-e722-4134-bd93-cdb01b6c01a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:23.745128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60beb4f9-e722-4134-bd93-cdb01b6c01a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:23.752134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60beb4f9-e722-4134-bd93-cdb01b6c01a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:23.753410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60beb4f9-e722-4134-bd93-cdb01b6c01a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:23.755691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60beb4f9-e722-4134-bd93-cdb01b6c01a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:23.759350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60beb4f9-e722-4134-bd93-cdb01b6c01a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:23.760752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60beb4f9-e722-4134-bd93-cdb01b6c01a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:24.105701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-82d134ca-d67f-4103-87cc-baf34230929d tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:24.116161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-82d134ca-d67f-4103-87cc-baf34230929d tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:24.160384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82d134ca-d67f-4103-87cc-baf34230929d tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:24.171587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82d134ca-d67f-4103-87cc-baf34230929d tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:24.173179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82d134ca-d67f-4103-87cc-baf34230929d tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:24.187723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82d134ca-d67f-4103-87cc-baf34230929d tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:24.189217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82d134ca-d67f-4103-87cc-baf34230929d tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:24.198732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82d134ca-d67f-4103-87cc-baf34230929d tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:25.224678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60beb4f9-e722-4134-bd93-cdb01b6c01a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:25.249274 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-60beb4f9-e722-4134-bd93-cdb01b6c01a2 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1516 microversion: 2.1 time: 1.567749 Aug 25 13:21:25.252021 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2164/4377] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:23 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1516 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:25.276216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6cd53ad3-7ed3-4f55-bc18-cd3bcacb4ee8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:25.277674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6cd53ad3-7ed3-4f55-bc18-cd3bcacb4ee8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:25.288817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd53ad3-7ed3-4f55-bc18-cd3bcacb4ee8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:25.291376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd53ad3-7ed3-4f55-bc18-cd3bcacb4ee8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:25.292633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd53ad3-7ed3-4f55-bc18-cd3bcacb4ee8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:25.294546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd53ad3-7ed3-4f55-bc18-cd3bcacb4ee8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:25.295612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd53ad3-7ed3-4f55-bc18-cd3bcacb4ee8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:25.296626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd53ad3-7ed3-4f55-bc18-cd3bcacb4ee8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:25.522472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-82d134ca-d67f-4103-87cc-baf34230929d tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:25.537298 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-82d134ca-d67f-4103-87cc-baf34230929d tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1532 microversion: 2.1 time: 1.456992 Aug 25 13:21:25.538352 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2214/4378] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:24 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1532 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:26.291401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-92f21c55-4a5f-4556-9787-6f66f1155d2d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:26.293315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-92f21c55-4a5f-4556-9787-6f66f1155d2d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:26.305795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92f21c55-4a5f-4556-9787-6f66f1155d2d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:26.307044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92f21c55-4a5f-4556-9787-6f66f1155d2d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:26.308202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92f21c55-4a5f-4556-9787-6f66f1155d2d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:26.311415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92f21c55-4a5f-4556-9787-6f66f1155d2d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:26.312795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92f21c55-4a5f-4556-9787-6f66f1155d2d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:26.314025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92f21c55-4a5f-4556-9787-6f66f1155d2d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:26.387645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6cd53ad3-7ed3-4f55-bc18-cd3bcacb4ee8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:26.412535 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6cd53ad3-7ed3-4f55-bc18-cd3bcacb4ee8 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.157708 Aug 25 13:21:26.421729 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2165/4379] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:25 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:26.459107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fed77b9a-b42b-40f8-bd39-738ed6bd4955 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:26.460274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fed77b9a-b42b-40f8-bd39-738ed6bd4955 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:26.479406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fed77b9a-b42b-40f8-bd39-738ed6bd4955 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:26.480337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fed77b9a-b42b-40f8-bd39-738ed6bd4955 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:26.481159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fed77b9a-b42b-40f8-bd39-738ed6bd4955 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:26.483355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fed77b9a-b42b-40f8-bd39-738ed6bd4955 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:26.484660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fed77b9a-b42b-40f8-bd39-738ed6bd4955 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:26.484969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fed77b9a-b42b-40f8-bd39-738ed6bd4955 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:27.759703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-92f21c55-4a5f-4556-9787-6f66f1155d2d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:27.780677 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-92f21c55-4a5f-4556-9787-6f66f1155d2d tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1516 microversion: 2.1 time: 1.496028 Aug 25 13:21:27.797181 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2215/4380] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:26 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1516 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:27.819798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:27.820993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:27.833080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:27.834537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:27.835727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:27.837396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:27.839074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:27.840240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:27.975892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:27.976988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:27.977918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:27.986299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lazy-loading 'fault' on Instance uuid c05c50a6-1d03-497c-bca8-06ea3c3dbd41 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:21:28.314031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d1271d41fe49d3b9d18a64877e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f12e87bcc940aa874f0ae0c91d4b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:28.331597 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2ddb33ce-fb52-4eee-ab35-42e908949809 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 200 len: 1317 microversion: 2.1 time: 0.521952 Aug 25 13:21:28.333553 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2216/4381] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:27 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:28.423516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fed77b9a-b42b-40f8-bd39-738ed6bd4955 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:28.463578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fed77b9a-b42b-40f8-bd39-738ed6bd4955 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 2.011992 Aug 25 13:21:28.468867 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2166/4382] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:26 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:28.540661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14a60db8-0ec1-450a-8494-362c2b63c56a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:28.542272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-14a60db8-0ec1-450a-8494-362c2b63c56a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:28.562280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a60db8-0ec1-450a-8494-362c2b63c56a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:28.564579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a60db8-0ec1-450a-8494-362c2b63c56a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:28.566700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a60db8-0ec1-450a-8494-362c2b63c56a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:28.568415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a60db8-0ec1-450a-8494-362c2b63c56a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:28.569558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a60db8-0ec1-450a-8494-362c2b63c56a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:28.570757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a60db8-0ec1-450a-8494-362c2b63c56a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:28.693495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ef385b8b-426e-4e67-8295-92f39656a0fc req-bb7ff613-2e44-4d86-9f6c-08b8622562d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05c50a6-1d03-497c-bca8-06ea3c3dbd41", "name": "network-vif-deleted", "tag": "2fca692a-d96c-47e3-a96d-bff53dbb21a6"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:28.714284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ef385b8b-426e-4e67-8295-92f39656a0fc req-bb7ff613-2e44-4d86-9f6c-08b8622562d6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:28.715748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ef385b8b-426e-4e67-8295-92f39656a0fc req-bb7ff613-2e44-4d86-9f6c-08b8622562d6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:28.717238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ef385b8b-426e-4e67-8295-92f39656a0fc req-bb7ff613-2e44-4d86-9f6c-08b8622562d6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:28.753170 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ef385b8b-426e-4e67-8295-92f39656a0fc req-bb7ff613-2e44-4d86-9f6c-08b8622562d6 service nova] Creating event network-vif-deleted:2fca692a-d96c-47e3-a96d-bff53dbb21a6 for instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 on n-h1-852771-8 Aug 25 13:21:28.767080 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ef385b8b-426e-4e67-8295-92f39656a0fc req-bb7ff613-2e44-4d86-9f6c-08b8622562d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.430363 Aug 25 13:21:28.768617 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2217/4383] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:28.828821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-492dc1cd-885e-4995-a0d8-7d6d16a0ce55 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:28.831314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-492dc1cd-885e-4995-a0d8-7d6d16a0ce55 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:28.848627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-492dc1cd-885e-4995-a0d8-7d6d16a0ce55 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:28.850410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-492dc1cd-885e-4995-a0d8-7d6d16a0ce55 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:28.852035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-492dc1cd-885e-4995-a0d8-7d6d16a0ce55 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:28.854124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-492dc1cd-885e-4995-a0d8-7d6d16a0ce55 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:28.855706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-492dc1cd-885e-4995-a0d8-7d6d16a0ce55 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:28.857211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-492dc1cd-885e-4995-a0d8-7d6d16a0ce55 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:29.189746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-492dc1cd-885e-4995-a0d8-7d6d16a0ce55 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:29.205013 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-492dc1cd-885e-4995-a0d8-7d6d16a0ce55 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1474 microversion: 2.1 time: 0.386589 Aug 25 13:21:29.210223 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2218/4384] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:28 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1474 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:29.375508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:29.377372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] [instance: c05c50a6-1d03-497c-bca8-06ea3c3dbd41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:29.392690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:29.394230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:29.395472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:29.397640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:29.399299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:29.400677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:29.413663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:29.446497 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] HTTP exception thrown: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Request method failure captured: Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 HTTP/1.1 Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3b66PKpYCkqQV0BOhG9gL9IHh8hnrfxEZwORAwOsMcGqbz9yF88m1-z0dEBZMaW4xWkDzOWJJtrYDVqbGVRkb6KTg8X4IrWFOasBQcg3_OYiSaiOkmjxN475N5ov4JzW4AH_mEVcY8jJhUlZqJlazZ5R_lZbMUFVs1L0RgC55_I0ig Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f7f12e87bcc940aa874f0ae0c91d4b2d Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1616812531 Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f12e87bcc940aa874f0ae0c91d4b2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f12e87bcc940aa874f0ae0c91d4b2d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f12e87bcc940aa874f0ae0c91d4b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f12e87bcc940aa874f0ae0c91d4b2d"}]}] Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1616812531 Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f7f12e87bcc940aa874f0ae0c91d4b2d Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1616812531 Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1616812531-project Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a7d1271d41fe49d3b9d18a64877e76a9 Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1616812531-project Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'c05c50a6-1d03-497c-bca8-06ea3c3dbd41'} Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:29.451248 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:29.460736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:29.460736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:29.460736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:29.460736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:29.460736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:29.460736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:29.460736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:29.460736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. Aug 25 13:21:29.460736 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:29.467755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] Returning 404 to user: Instance c05c50a6-1d03-497c-bca8-06ea3c3dbd41 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:29.467755 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a1fbdd3b-33c9-4b89-a153-65d3dfbd9f81 tempest-ServersNegativeTestMultiTenantJSON-1616812531 tempest-ServersNegativeTestMultiTenantJSON-1616812531-project] 10.222.0.70 "GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41" status: 404 len: 111 microversion: 2.1 time: 0.097542 Aug 25 13:21:29.468948 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2219/4385] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:29 2022] GET /compute/v2.1/servers/c05c50a6-1d03-497c-bca8-06ea3c3dbd41 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:21:30.168134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-14a60db8-0ec1-450a-8494-362c2b63c56a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:30.194662 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-14a60db8-0ec1-450a-8494-362c2b63c56a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.671767 Aug 25 13:21:30.196904 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2167/4386] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:28 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:30.245858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c40e1d44-31f3-49ba-adfd-3aeb3fa8c98c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:30.254349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:30.256146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:30.290540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:30.294007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:30.295105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:30.296284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:30.298162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:30.299113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:30.299857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:30.314367 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c40e1d44-31f3-49ba-adfd-3aeb3fa8c98c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 916c7126-b5c7-46c9-8181-df7cb13703a1 has no mapping to a cell. Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c40e1d44-31f3-49ba-adfd-3aeb3fa8c98c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/916c7126-b5c7-46c9-8181-df7cb13703a1/action HTTP/1.1 Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 15 Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: {"os-stop": {}} Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 916c7126-b5c7-46c9-8181-df7cb13703a1 has no mapping to a cell. Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '916c7126-b5c7-46c9-8181-df7cb13703a1', 'body': {'os-stop': {}}} Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 916c7126-b5c7-46c9-8181-df7cb13703a1 has no mapping to a cell. Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:30.348524 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 916c7126-b5c7-46c9-8181-df7cb13703a1 has no mapping to a cell. Aug 25 13:21:30.356850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:30.356850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:30.356850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:30.356850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:30.356850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:30.356850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:30.356850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:30.356850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:30.356850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 916c7126-b5c7-46c9-8181-df7cb13703a1 has no mapping to a cell. Aug 25 13:21:30.356850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:30.363369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c40e1d44-31f3-49ba-adfd-3aeb3fa8c98c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 916c7126-b5c7-46c9-8181-df7cb13703a1 has no mapping to a cell. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:30.363754 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c40e1d44-31f3-49ba-adfd-3aeb3fa8c98c tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/916c7126-b5c7-46c9-8181-df7cb13703a1/action" status: 404 len: 117 microversion: 2.1 time: 0.124527 Aug 25 13:21:30.373687 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2220/4387] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:30 2022] POST /compute/v2.1/servers/916c7126-b5c7-46c9-8181-df7cb13703a1/action => generated 117 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:21:30.386954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5f65ae8-5298-41d6-a852-d11ec3e042f9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:30.389158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b5f65ae8-5298-41d6-a852-d11ec3e042f9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:30.411374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:30.413137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:30.414617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:30.416056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lazy-loading 'fault' on Instance uuid eb397fbc-b7a9-4839-9780-0699382d3575 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:21:30.437136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5f65ae8-5298-41d6-a852-d11ec3e042f9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:30.452580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5f65ae8-5298-41d6-a852-d11ec3e042f9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:30.453564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5f65ae8-5298-41d6-a852-d11ec3e042f9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:30.454942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5f65ae8-5298-41d6-a852-d11ec3e042f9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:30.455807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5f65ae8-5298-41d6-a852-d11ec3e042f9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:30.456619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5f65ae8-5298-41d6-a852-d11ec3e042f9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:30.768284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b6aafa5bc44f2badea5620d7714b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dcef23255440f4b9f150820a8afd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:30.801871 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c7382c70-7c7f-44c2-aeb7-4e5ba0b71d3a tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 200 len: 1310 microversion: 2.1 time: 0.555377 Aug 25 13:21:30.817433 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2168/4388] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:30 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 1310 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:30.949211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-71e9b4c2-d327-4366-89c9-cbf6c4b6f1af req-1da8ee5e-2d73-4270-8275-5b4fe288ae56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb397fbc-b7a9-4839-9780-0699382d3575", "name": "network-vif-deleted", "tag": "e86480d8-b7d2-4b3a-bc3f-9cc6f5f5501e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:30.976626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-71e9b4c2-d327-4366-89c9-cbf6c4b6f1af req-1da8ee5e-2d73-4270-8275-5b4fe288ae56 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:30.978426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-71e9b4c2-d327-4366-89c9-cbf6c4b6f1af req-1da8ee5e-2d73-4270-8275-5b4fe288ae56 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:30.979672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-71e9b4c2-d327-4366-89c9-cbf6c4b6f1af req-1da8ee5e-2d73-4270-8275-5b4fe288ae56 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:31.013488 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-71e9b4c2-d327-4366-89c9-cbf6c4b6f1af req-1da8ee5e-2d73-4270-8275-5b4fe288ae56 service nova] Creating event network-vif-deleted:e86480d8-b7d2-4b3a-bc3f-9cc6f5f5501e for instance eb397fbc-b7a9-4839-9780-0699382d3575 on n-h1-852771-8 Aug 25 13:21:31.026025 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-71e9b4c2-d327-4366-89c9-cbf6c4b6f1af req-1da8ee5e-2d73-4270-8275-5b4fe288ae56 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088287 Aug 25 13:21:31.028319 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2169/4389] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:31.209249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b5f65ae8-5298-41d6-a852-d11ec3e042f9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:31.226962 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b5f65ae8-5298-41d6-a852-d11ec3e042f9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.846693 Aug 25 13:21:31.228158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2221/4390] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:30 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:31.277407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e9b93b2d-2a8c-4f88-8efa-f4ef2586231f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:31.281474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e9b93b2d-2a8c-4f88-8efa-f4ef2586231f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:31.295444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9b93b2d-2a8c-4f88-8efa-f4ef2586231f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:31.296621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9b93b2d-2a8c-4f88-8efa-f4ef2586231f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:31.297439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9b93b2d-2a8c-4f88-8efa-f4ef2586231f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:31.298819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9b93b2d-2a8c-4f88-8efa-f4ef2586231f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:31.299600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9b93b2d-2a8c-4f88-8efa-f4ef2586231f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:31.300662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e9b93b2d-2a8c-4f88-8efa-f4ef2586231f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:31.851746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:31.854308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] [instance: eb397fbc-b7a9-4839-9780-0699382d3575] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:31.870102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:31.871224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:31.873013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:31.874812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:31.876072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:31.877141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:31.907916 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] HTTP exception thrown: Instance eb397fbc-b7a9-4839-9780-0699382d3575 could not be found. Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Request method failure captured: Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 HTTP/1.1 Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3a1m_4TOkJnhOGjWx4H8gQ6Nv9GbeX1lWndj332JtMCZEdoaAuF8Qrxf5GaZa98vEo1cCHKhuLSpZlc9FGIIs1zLdbytRKkX2zFrVZs9apjpQSHEEPxIO0v6Im50Ve2vTsp__-j-mfoGF_u9HkvnY9qoEe8m0LP1nbxrNBgdDLh2uI Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 15dcef23255440f4b9f150820a8afd2d Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ListServerFiltersTestJSON-2050305063 Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15dcef23255440f4b9f150820a8afd2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_15dcef23255440f4b9f150820a8afd2d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/15dcef23255440f4b9f150820a8afd2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15dcef23255440f4b9f150820a8afd2d"}]}] Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ListServerFiltersTestJSON-2050305063 Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 15dcef23255440f4b9f150820a8afd2d Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2050305063 Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ListServerFiltersTestJSON-2050305063-project Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 94b6aafa5bc44f2badea5620d7714b3a Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ListServerFiltersTestJSON-2050305063-project Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance eb397fbc-b7a9-4839-9780-0699382d3575 could not be found. Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'eb397fbc-b7a9-4839-9780-0699382d3575'} Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb397fbc-b7a9-4839-9780-0699382d3575 could not be found. Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb397fbc-b7a9-4839-9780-0699382d3575 could not be found. Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:31.912476 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:31.925331 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:31.925331 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:31.925331 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:31.925331 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:31.925331 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:31.925331 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb397fbc-b7a9-4839-9780-0699382d3575 could not be found. Aug 25 13:21:31.925331 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:31.925331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] Returning 404 to user: Instance eb397fbc-b7a9-4839-9780-0699382d3575 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:31.925331 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74fa0f01-4c2d-45da-944c-e7521f345f57 tempest-ListServerFiltersTestJSON-2050305063 tempest-ListServerFiltersTestJSON-2050305063-project] 10.222.0.70 "GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575" status: 404 len: 111 microversion: 2.1 time: 0.075469 Aug 25 13:21:31.925331 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2222/4391] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:31 2022] GET /compute/v2.1/servers/eb397fbc-b7a9-4839-9780-0699382d3575 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:21:32.301291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e9b93b2d-2a8c-4f88-8efa-f4ef2586231f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:32.333098 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e9b93b2d-2a8c-4f88-8efa-f4ef2586231f tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.070116 Aug 25 13:21:32.350340 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2170/4392] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:31 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:32.380387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c26ef59-7c99-420d-905e-31b7c5366c61 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:32.382176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c26ef59-7c99-420d-905e-31b7c5366c61 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: 551efcc1-8619-4d17-9839-0ab52c50632c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:32.410847 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-0c26ef59-7c99-420d-905e-31b7c5366c61 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 551efcc1-8619-4d17-9839-0ab52c50632c could not be found. Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c26ef59-7c99-420d-905e-31b7c5366c61 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/551efcc1-8619-4d17-9839-0ab52c50632c/action HTTP/1.1 Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 15 Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: {"suspend": {}} Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 551efcc1-8619-4d17-9839-0ab52c50632c could not be found. Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '551efcc1-8619-4d17-9839-0ab52c50632c', 'body': {'suspend': {}}} Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 551efcc1-8619-4d17-9839-0ab52c50632c could not be found. Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 551efcc1-8619-4d17-9839-0ab52c50632c could not be found. Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:32.419585 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:32.435840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:32.435840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:32.435840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 551efcc1-8619-4d17-9839-0ab52c50632c could not be found. Aug 25 13:21:32.435840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:32.435840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c26ef59-7c99-420d-905e-31b7c5366c61 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 551efcc1-8619-4d17-9839-0ab52c50632c could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:32.435840 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c26ef59-7c99-420d-905e-31b7c5366c61 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/551efcc1-8619-4d17-9839-0ab52c50632c/action" status: 404 len: 111 microversion: 2.1 time: 0.054779 Aug 25 13:21:32.435840 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2223/4393] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:32 2022] POST /compute/v2.1/servers/551efcc1-8619-4d17-9839-0ab52c50632c/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:21:32.445479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8523d2ec-eef9-4e94-90fd-aa19ee3467fa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:32.446815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8523d2ec-eef9-4e94-90fd-aa19ee3467fa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:32.467628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8523d2ec-eef9-4e94-90fd-aa19ee3467fa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:32.469110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8523d2ec-eef9-4e94-90fd-aa19ee3467fa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:32.470082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8523d2ec-eef9-4e94-90fd-aa19ee3467fa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:32.475186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8523d2ec-eef9-4e94-90fd-aa19ee3467fa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:32.476471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8523d2ec-eef9-4e94-90fd-aa19ee3467fa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:32.477338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8523d2ec-eef9-4e94-90fd-aa19ee3467fa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:33.829670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8523d2ec-eef9-4e94-90fd-aa19ee3467fa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:33.860153 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8523d2ec-eef9-4e94-90fd-aa19ee3467fa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.421784 Aug 25 13:21:33.863175 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2171/4394] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:32 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:33.905860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7e43ffed-6b2c-43a1-88c7-084ba8e96339 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:33.908348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7e43ffed-6b2c-43a1-88c7-084ba8e96339 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:33.928482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e43ffed-6b2c-43a1-88c7-084ba8e96339 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:33.930089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e43ffed-6b2c-43a1-88c7-084ba8e96339 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:33.931417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e43ffed-6b2c-43a1-88c7-084ba8e96339 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:33.933209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e43ffed-6b2c-43a1-88c7-084ba8e96339 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:33.935570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e43ffed-6b2c-43a1-88c7-084ba8e96339 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:33.936826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e43ffed-6b2c-43a1-88c7-084ba8e96339 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:35.149569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7e43ffed-6b2c-43a1-88c7-084ba8e96339 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:35.201419 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7e43ffed-6b2c-43a1-88c7-084ba8e96339 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.301909 Aug 25 13:21:35.218769 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2224/4395] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:33 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:35.258570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9a7f28ad-9308-4199-bb66-bd10b5c17ae4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:35.260373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9a7f28ad-9308-4199-bb66-bd10b5c17ae4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:35.278914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a7f28ad-9308-4199-bb66-bd10b5c17ae4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:35.279804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a7f28ad-9308-4199-bb66-bd10b5c17ae4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:35.280891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a7f28ad-9308-4199-bb66-bd10b5c17ae4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:35.282748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a7f28ad-9308-4199-bb66-bd10b5c17ae4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:35.283873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a7f28ad-9308-4199-bb66-bd10b5c17ae4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:35.285047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a7f28ad-9308-4199-bb66-bd10b5c17ae4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:35.367956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-9a7f28ad-9308-4199-bb66-bd10b5c17ae4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lazy-loading 'flavor' on Instance uuid cc6362fd-0197-4636-8a8d-6814ba103aed {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:21:35.597840 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9a7f28ad-9308-4199-bb66-bd10b5c17ae4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 202 len: 0 microversion: 2.1 time: 0.346077 Aug 25 13:21:35.611423 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2172/4396] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:35 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:21:35.616182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f06a42fd-d57c-45f5-ba1c-19e3d7e97a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:35.624221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f06a42fd-d57c-45f5-ba1c-19e3d7e97a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:35.656692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f06a42fd-d57c-45f5-ba1c-19e3d7e97a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:35.665326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f06a42fd-d57c-45f5-ba1c-19e3d7e97a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:35.667048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f06a42fd-d57c-45f5-ba1c-19e3d7e97a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:35.670265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f06a42fd-d57c-45f5-ba1c-19e3d7e97a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:35.671957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f06a42fd-d57c-45f5-ba1c-19e3d7e97a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:35.677139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f06a42fd-d57c-45f5-ba1c-19e3d7e97a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:38.052502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f06a42fd-d57c-45f5-ba1c-19e3d7e97a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:38.110490 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f06a42fd-d57c-45f5-ba1c-19e3d7e97a98 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1513 microversion: 2.1 time: 2.503536 Aug 25 13:21:38.113862 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2225/4397] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:35 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1513 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:39.175568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7ec2f4ba-1d90-4043-904b-7ddc666b5b0d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:39.180260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7ec2f4ba-1d90-4043-904b-7ddc666b5b0d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:39.237818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec2f4ba-1d90-4043-904b-7ddc666b5b0d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:39.238721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec2f4ba-1d90-4043-904b-7ddc666b5b0d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:39.242188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec2f4ba-1d90-4043-904b-7ddc666b5b0d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:39.254061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec2f4ba-1d90-4043-904b-7ddc666b5b0d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:39.255553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec2f4ba-1d90-4043-904b-7ddc666b5b0d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:39.270042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec2f4ba-1d90-4043-904b-7ddc666b5b0d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:40.636741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7ec2f4ba-1d90-4043-904b-7ddc666b5b0d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:40.667312 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7ec2f4ba-1d90-4043-904b-7ddc666b5b0d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1496 microversion: 2.1 time: 1.516498 Aug 25 13:21:40.678690 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2173/4398] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:39 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1496 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:40.732251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:40.734990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:40.810523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:40.814438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:40.815869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:40.822580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:40.825450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:40.827276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:40.929423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lazy-loading 'flavor' on Instance uuid cc6362fd-0197-4636-8a8d-6814ba103aed {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:21:40.986249 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Cannot 'suspend' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state suspended Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action HTTP/1.1 Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 15 Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: {"suspend": {}} Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: exception: Cannot 'suspend' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state suspended Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'cc6362fd-0197-4636-8a8d-6814ba103aed', 'body': {'suspend': {}}} Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc6362fd-0197-4636-8a8d-6814ba103aed in vm_state suspended. Cannot suspend while the instance is in this state. Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 25 13:21:41.000056 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state suspended Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state suspended Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 409 to user: Cannot 'suspend' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state suspended {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:41.014724 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ac450b77-5b82-4953-8ac7-10bd3baf7fc2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 409 len: 148 microversion: 2.1 time: 0.293391 Aug 25 13:21:41.017969 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2226/4399] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:40 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 148 bytes in 300 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:21:41.033173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f96d3cd4-4446-45af-b2ad-04161c79ac26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:41.034063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f96d3cd4-4446-45af-b2ad-04161c79ac26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:41.062203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f96d3cd4-4446-45af-b2ad-04161c79ac26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:41.063593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f96d3cd4-4446-45af-b2ad-04161c79ac26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:41.065071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f96d3cd4-4446-45af-b2ad-04161c79ac26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:41.071212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f96d3cd4-4446-45af-b2ad-04161c79ac26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:41.072945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f96d3cd4-4446-45af-b2ad-04161c79ac26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:41.074112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f96d3cd4-4446-45af-b2ad-04161c79ac26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:41.305914 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f96d3cd4-4446-45af-b2ad-04161c79ac26 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 202 len: 0 microversion: 2.1 time: 0.279860 Aug 25 13:21:41.329945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f2102df6-df1b-47c4-a36a-8935f834bcef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:41.334773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f2102df6-df1b-47c4-a36a-8935f834bcef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:41.343006 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2174/4400] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:41 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:21:41.398166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2102df6-df1b-47c4-a36a-8935f834bcef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:41.399303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2102df6-df1b-47c4-a36a-8935f834bcef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:41.400812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2102df6-df1b-47c4-a36a-8935f834bcef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:41.403541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2102df6-df1b-47c4-a36a-8935f834bcef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:41.406520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2102df6-df1b-47c4-a36a-8935f834bcef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:41.421093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2102df6-df1b-47c4-a36a-8935f834bcef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:43.943510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f2102df6-df1b-47c4-a36a-8935f834bcef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:43.973499 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f2102df6-df1b-47c4-a36a-8935f834bcef tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1502 microversion: 2.1 time: 2.651722 Aug 25 13:21:43.976937 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2227/4401] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:41 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1502 bytes in 2658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:45.020408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f375774c-29af-4eb9-bd52-48c578a6aad5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:45.037062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f375774c-29af-4eb9-bd52-48c578a6aad5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:45.083184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f375774c-29af-4eb9-bd52-48c578a6aad5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:45.092673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f375774c-29af-4eb9-bd52-48c578a6aad5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:45.096395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f375774c-29af-4eb9-bd52-48c578a6aad5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:45.098543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f375774c-29af-4eb9-bd52-48c578a6aad5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:45.111024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f375774c-29af-4eb9-bd52-48c578a6aad5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:45.112247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f375774c-29af-4eb9-bd52-48c578a6aad5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:46.187359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f375774c-29af-4eb9-bd52-48c578a6aad5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:46.267301 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f375774c-29af-4eb9-bd52-48c578a6aad5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1502 microversion: 2.1 time: 1.244363 Aug 25 13:21:46.268755 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2175/4402] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:45 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1502 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:46.760405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-76752603", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": "none"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:46.803841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:46.934524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:21:46.936969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:21:46.938640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:21:46.939976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:21:46.941111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:21:46.966812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:46.968392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:46.969594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:46.979452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:46.981076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:46.982302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:47.028161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Getting quotas for project 9dea8b42d7fd4c2d9475ad8c2237d1b0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:21:47.050127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Getting quotas for user 1a02297dd37c4aaf970742f258298aac and project 9dea8b42d7fd4c2d9475ad8c2237d1b0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:21:47.118432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:21:47.125414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: 1b047ee5-a284-40c3-8530-00ea2ba4223d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:21:47.300989 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-627ea407-3cc2-4c05-89f8-eec3a0012259 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.339428 Aug 25 13:21:47.305210 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2228/4403] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 13:21:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:21:47.323938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b6099b0-f355-4c9b-a9c2-3f11bcfb31eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:47.330632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a40a5e33-3153-496f-b19e-d60f0e06467a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:47.334395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5b6099b0-f355-4c9b-a9c2-3f11bcfb31eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: 1b047ee5-a284-40c3-8530-00ea2ba4223d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:47.338264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a40a5e33-3153-496f-b19e-d60f0e06467a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:47.380955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40a5e33-3153-496f-b19e-d60f0e06467a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:47.390371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40a5e33-3153-496f-b19e-d60f0e06467a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:47.394568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40a5e33-3153-496f-b19e-d60f0e06467a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:47.402711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40a5e33-3153-496f-b19e-d60f0e06467a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:47.403898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40a5e33-3153-496f-b19e-d60f0e06467a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:47.411116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a40a5e33-3153-496f-b19e-d60f0e06467a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:47.537539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:47.641141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b6099b0-f355-4c9b-a9c2-3f11bcfb31eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:47.696636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b6099b0-f355-4c9b-a9c2-3f11bcfb31eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:47.702897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b6099b0-f355-4c9b-a9c2-3f11bcfb31eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:47.706451 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b6099b0-f355-4c9b-a9c2-3f11bcfb31eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d" status: 200 len: 1276 microversion: 2.47 time: 0.390018 Aug 25 13:21:47.708659 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2229/4404] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:47 2022] GET /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d => generated 1276 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:48.018180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-843911745", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": "none"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:48.327418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:21:48.328079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:21:48.333325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:21:48.335603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:21:48.336816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:21:48.388795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:48.391551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:48.395691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:48.399697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:48.400690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:48.409002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:48.495321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Getting quotas for project 9dea8b42d7fd4c2d9475ad8c2237d1b0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:21:48.524789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Getting quotas for user 1a02297dd37c4aaf970742f258298aac and project 9dea8b42d7fd4c2d9475ad8c2237d1b0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:21:48.584287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:21:48.600344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:21:48.695154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a40a5e33-3153-496f-b19e-d60f0e06467a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:48.731031 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a40a5e33-3153-496f-b19e-d60f0e06467a tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.414586 Aug 25 13:21:48.736874 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2176/4405] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:47 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:48.782329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-815cb55c-10b5-46e9-a856-9840b304f3bc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:48.783549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-815cb55c-10b5-46e9-a856-9840b304f3bc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:48.787386 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9974d5c-5346-4c57-9863-3347a1f5a4de tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.785230 Aug 25 13:21:48.797869 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2230/4406] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 13:21:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 25 13:21:48.836432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-815cb55c-10b5-46e9-a856-9840b304f3bc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:48.843289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2879c123-a457-4808-8c2e-cd6d3e4d4482 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:48.843663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-815cb55c-10b5-46e9-a856-9840b304f3bc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:48.848633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-815cb55c-10b5-46e9-a856-9840b304f3bc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:48.854664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-815cb55c-10b5-46e9-a856-9840b304f3bc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:48.859558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-815cb55c-10b5-46e9-a856-9840b304f3bc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:48.862104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-815cb55c-10b5-46e9-a856-9840b304f3bc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:48.890041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2879c123-a457-4808-8c2e-cd6d3e4d4482 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:49.150441 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2879c123-a457-4808-8c2e-cd6d3e4d4482 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "PUT /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 991 microversion: 2.47 time: 0.342184 Aug 25 13:21:49.152618 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2231/4407] 10.222.0.70 () {62 vars in 1297 bytes} [Thu Aug 25 13:21:48 2022] PUT /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 991 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:21:49.192885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f41331e-1524-4a64-99fc-4251e9cb2e1b tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:49.194090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0f41331e-1524-4a64-99fc-4251e9cb2e1b tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:50.065785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f41331e-1524-4a64-99fc-4251e9cb2e1b tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:50.119122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f41331e-1524-4a64-99fc-4251e9cb2e1b tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:50.122342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f41331e-1524-4a64-99fc-4251e9cb2e1b tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:50.138149 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0f41331e-1524-4a64-99fc-4251e9cb2e1b tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1277 microversion: 2.47 time: 0.950360 Aug 25 13:21:50.139838 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2232/4408] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:49 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1277 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:50.574843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-815cb55c-10b5-46e9-a856-9840b304f3bc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:50.620205 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-815cb55c-10b5-46e9-a856-9840b304f3bc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.846589 Aug 25 13:21:50.622457 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2177/4409] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:48 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:50.664180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97f33b34-e9f3-4bd0-8ee9-990283084c28 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:50.672601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-97f33b34-e9f3-4bd0-8ee9-990283084c28 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: 9105400e-3160-41df-9f0f-f2260371fa63] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:50.695378 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-97f33b34-e9f3-4bd0-8ee9-990283084c28 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 9105400e-3160-41df-9f0f-f2260371fa63 could not be found. Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97f33b34-e9f3-4bd0-8ee9-990283084c28 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/9105400e-3160-41df-9f0f-f2260371fa63/action HTTP/1.1 Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 15 Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: {"unpause": {}} Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 9105400e-3160-41df-9f0f-f2260371fa63 could not be found. Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '9105400e-3160-41df-9f0f-f2260371fa63', 'body': {'unpause': {}}} Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9105400e-3160-41df-9f0f-f2260371fa63 could not be found. Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9105400e-3160-41df-9f0f-f2260371fa63 could not be found. Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:50.702589 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:50.712960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:50.712960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:50.712960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9105400e-3160-41df-9f0f-f2260371fa63 could not be found. Aug 25 13:21:50.712960 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:50.717779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97f33b34-e9f3-4bd0-8ee9-990283084c28 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 9105400e-3160-41df-9f0f-f2260371fa63 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:50.717779 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-97f33b34-e9f3-4bd0-8ee9-990283084c28 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/9105400e-3160-41df-9f0f-f2260371fa63/action" status: 404 len: 111 microversion: 2.1 time: 0.060987 Aug 25 13:21:50.725017 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2233/4410] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:50 2022] POST /compute/v2.1/servers/9105400e-3160-41df-9f0f-f2260371fa63/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:21:50.742680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3a8a90cb-75a2-4856-8a09-94b6898ff527 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:50.747882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3a8a90cb-75a2-4856-8a09-94b6898ff527 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:50.772513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a8a90cb-75a2-4856-8a09-94b6898ff527 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:50.774239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a8a90cb-75a2-4856-8a09-94b6898ff527 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:50.780621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a8a90cb-75a2-4856-8a09-94b6898ff527 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:50.782583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a8a90cb-75a2-4856-8a09-94b6898ff527 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:50.783885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a8a90cb-75a2-4856-8a09-94b6898ff527 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:50.799844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a8a90cb-75a2-4856-8a09-94b6898ff527 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:51.219403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:51.220623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:51.258078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:51.259099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:51.259912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:51.265721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:51.266643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:51.267507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:52.190458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:52.210616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:52.215531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:52.218492 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a332d942-7825-4a9e-81d8-15b2b37fdfa4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1273 microversion: 2.47 time: 1.036073 Aug 25 13:21:52.220069 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2234/4411] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:51 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1273 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:21:52.261823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3a8a90cb-75a2-4856-8a09-94b6898ff527 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:52.305249 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3a8a90cb-75a2-4856-8a09-94b6898ff527 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.570943 Aug 25 13:21:52.309583 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2178/4412] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:50 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:52.360489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9889667d-034b-431c-a22a-e1c59779e934 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:52.367050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9889667d-034b-431c-a22a-e1c59779e934 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:52.392609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9889667d-034b-431c-a22a-e1c59779e934 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:52.394011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9889667d-034b-431c-a22a-e1c59779e934 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:52.406788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9889667d-034b-431c-a22a-e1c59779e934 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:52.408595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9889667d-034b-431c-a22a-e1c59779e934 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:52.409825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9889667d-034b-431c-a22a-e1c59779e934 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:52.412334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9889667d-034b-431c-a22a-e1c59779e934 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:53.011853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9889667d-034b-431c-a22a-e1c59779e934 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:53.079889 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9889667d-034b-431c-a22a-e1c59779e934 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.730960 Aug 25 13:21:53.083236 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2235/4413] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:52 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:53.131407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:53.132296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:53.180927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:53.182609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:53.184887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:53.187782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:53.192050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:53.193273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:53.268246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:53.271550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:53.300096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:53.304554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:53.305716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:53.307421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:53.311086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:53.314053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:53.336176 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Cannot 'unpause' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action HTTP/1.1 Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 15 Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: {"unpause": {}} Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: exception: Cannot 'unpause' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'cc6362fd-0197-4636-8a8d-6814ba103aed', 'body': {'unpause': {}}} Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc6362fd-0197-4636-8a8d-6814ba103aed in vm_state active. Cannot unpause while the instance is in this state. Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:53.343860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:53.351933 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:53.351933 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:53.351933 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:53.351933 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:21:53.351933 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:53.351933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 409 to user: Cannot 'unpause' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:53.351933 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4902fb0c-bf0a-4c77-998d-8d95cf30b7ec tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 409 len: 145 microversion: 2.1 time: 0.227590 Aug 25 13:21:53.359940 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2179/4414] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:53 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 145 bytes in 230 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:21:53.373861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2c06feaa-136b-4df8-849f-77e87a383484 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:53.379283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2c06feaa-136b-4df8-849f-77e87a383484 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:53.411015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c06feaa-136b-4df8-849f-77e87a383484 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:53.416368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c06feaa-136b-4df8-849f-77e87a383484 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:53.417679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c06feaa-136b-4df8-849f-77e87a383484 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:53.419344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c06feaa-136b-4df8-849f-77e87a383484 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:53.420725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c06feaa-136b-4df8-849f-77e87a383484 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:53.423247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c06feaa-136b-4df8-849f-77e87a383484 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:53.608752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:53.653182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:53.657742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:53.667039 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0624122b-6fb7-43fa-b93f-52b4a0188e7f tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1337 microversion: 2.47 time: 0.404012 Aug 25 13:21:53.678528 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2236/4415] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:53 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1337 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:54.129231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2c06feaa-136b-4df8-849f-77e87a383484 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:54.169146 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2c06feaa-136b-4df8-849f-77e87a383484 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.808335 Aug 25 13:21:54.181547 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2180/4416] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:53 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:54.223526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e9c3efd-aff9-4963-88fb-ca56ebd02164 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:54.231176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e9c3efd-aff9-4963-88fb-ca56ebd02164 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:54.287066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e9c3efd-aff9-4963-88fb-ca56ebd02164 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:54.290269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e9c3efd-aff9-4963-88fb-ca56ebd02164 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:54.292556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e9c3efd-aff9-4963-88fb-ca56ebd02164 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:54.296481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e9c3efd-aff9-4963-88fb-ca56ebd02164 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:54.299527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e9c3efd-aff9-4963-88fb-ca56ebd02164 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:54.300470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e9c3efd-aff9-4963-88fb-ca56ebd02164 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:54.711959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:54.716794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:54.738386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:54.740023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:54.743046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:54.743046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:54.745201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:54.747442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:54.991673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:55.029792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:55.033279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:55.039301 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eaa30c24-b202-4f5b-b331-5e5ec49d8e11 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1335 microversion: 2.47 time: 0.332283 Aug 25 13:21:55.041363 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2181/4417] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:54 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1335 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:55.241328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e9c3efd-aff9-4963-88fb-ca56ebd02164 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:55.270140 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e9c3efd-aff9-4963-88fb-ca56ebd02164 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.061688 Aug 25 13:21:55.286050 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2237/4418] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:54 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:55.342688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-28064061-d6e3-4f32-9f12-9318a4cf3c81 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:55.344425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-28064061-d6e3-4f32-9f12-9318a4cf3c81 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: 7dbc2d55-1fe7-4864-9e50-f4c07caba8ba] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:55.385439 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-28064061-d6e3-4f32-9f12-9318a4cf3c81 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance 7dbc2d55-1fe7-4864-9e50-f4c07caba8ba could not be found. Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-28064061-d6e3-4f32-9f12-9318a4cf3c81 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/7dbc2d55-1fe7-4864-9e50-f4c07caba8ba/action HTTP/1.1 Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 18 Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: {"unshelve": null} Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7dbc2d55-1fe7-4864-9e50-f4c07caba8ba could not be found. Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7dbc2d55-1fe7-4864-9e50-f4c07caba8ba', 'body': {'unshelve': None}} Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dbc2d55-1fe7-4864-9e50-f4c07caba8ba could not be found. Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dbc2d55-1fe7-4864-9e50-f4c07caba8ba could not be found. Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:55.392829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:55.407246 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:55.407246 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:55.407246 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:55.407246 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:55.407246 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:55.407246 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:55.407246 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dbc2d55-1fe7-4864-9e50-f4c07caba8ba could not be found. Aug 25 13:21:55.407246 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:55.407246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-28064061-d6e3-4f32-9f12-9318a4cf3c81 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance 7dbc2d55-1fe7-4864-9e50-f4c07caba8ba could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:55.410779 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-28064061-d6e3-4f32-9f12-9318a4cf3c81 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/7dbc2d55-1fe7-4864-9e50-f4c07caba8ba/action" status: 404 len: 111 microversion: 2.1 time: 0.086832 Aug 25 13:21:55.412714 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2182/4419] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:55 2022] POST /compute/v2.1/servers/7dbc2d55-1fe7-4864-9e50-f4c07caba8ba/action => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:21:55.429972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b10419e-f61a-4c72-b7dd-9fae3d642af0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:55.431155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b10419e-f61a-4c72-b7dd-9fae3d642af0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:55.465464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b10419e-f61a-4c72-b7dd-9fae3d642af0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:55.468756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b10419e-f61a-4c72-b7dd-9fae3d642af0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:55.471425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b10419e-f61a-4c72-b7dd-9fae3d642af0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:55.473591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b10419e-f61a-4c72-b7dd-9fae3d642af0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:55.476024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b10419e-f61a-4c72-b7dd-9fae3d642af0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:55.479147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b10419e-f61a-4c72-b7dd-9fae3d642af0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:56.087882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:56.092402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:56.112714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:56.114326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:56.115594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:56.117629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:56.119040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:56.121052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:56.426117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:56.430626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b10419e-f61a-4c72-b7dd-9fae3d642af0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:56.449021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:56.453420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:56.458565 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cceebd86-75fc-4ba5-b48b-dde0a298d452 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1335 microversion: 2.47 time: 0.376070 Aug 25 13:21:56.461689 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2183/4420] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:56 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1335 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:21:56.481097 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b10419e-f61a-4c72-b7dd-9fae3d642af0 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.059694 Aug 25 13:21:56.482912 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2238/4421] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:55 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:56.546506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a47ad963-e4eb-4fbb-8578-535013e83ac5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:56.556356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a47ad963-e4eb-4fbb-8578-535013e83ac5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:56.578846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a47ad963-e4eb-4fbb-8578-535013e83ac5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:56.581699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a47ad963-e4eb-4fbb-8578-535013e83ac5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:56.583282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a47ad963-e4eb-4fbb-8578-535013e83ac5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:56.585730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a47ad963-e4eb-4fbb-8578-535013e83ac5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:56.587121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a47ad963-e4eb-4fbb-8578-535013e83ac5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:56.588524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a47ad963-e4eb-4fbb-8578-535013e83ac5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:57.469921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a47ad963-e4eb-4fbb-8578-535013e83ac5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:57.507661 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a47ad963-e4eb-4fbb-8578-535013e83ac5 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.971994 Aug 25 13:21:57.508741 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2184/4422] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:56 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:57.555875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:57.558303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:57.563145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:57.563465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:57.599458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:57.602082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:57.603512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:57.607515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:57.614662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:57.618777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:57.627603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:57.629039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:57.629958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:57.634227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:57.635252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:57.636984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:57.772286 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Cannot 'unshelve' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action HTTP/1.1 Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 18 Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: {"unshelve": null} Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: exception: Cannot 'unshelve' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'cc6362fd-0197-4636-8a8d-6814ba103aed', 'body': {'unshelve': None}} Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc6362fd-0197-4636-8a8d-6814ba103aed in vm_state active. Cannot unshelve while the instance is in this state. Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:21:57.779860 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 409 to user: Cannot 'unshelve' instance cc6362fd-0197-4636-8a8d-6814ba103aed while it is in vm_state active {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d20d6b4d-464b-4892-9bc0-c53701546537 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action" status: 409 len: 146 microversion: 2.1 time: 0.240205 Aug 25 13:21:57.793583 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2185/4423] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:57 2022] POST /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed/action => generated 146 bytes in 245 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:21:57.811564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-55b2f416-2b00-42a1-bf75-5e61bc91ad1e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:57.817562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-55b2f416-2b00-42a1-bf75-5e61bc91ad1e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:57.831576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-55b2f416-2b00-42a1-bf75-5e61bc91ad1e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:57.832591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-55b2f416-2b00-42a1-bf75-5e61bc91ad1e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:57.833449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-55b2f416-2b00-42a1-bf75-5e61bc91ad1e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:57.835444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-55b2f416-2b00-42a1-bf75-5e61bc91ad1e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:57.836669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-55b2f416-2b00-42a1-bf75-5e61bc91ad1e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:57.837747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-55b2f416-2b00-42a1-bf75-5e61bc91ad1e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:58.445648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:58.474187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:58.485135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:58.494958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:58.498874 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ec5f36b5-9ea2-4f18-b7ff-8455ec6fd238 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1335 microversion: 2.47 time: 0.959395 Aug 25 13:21:58.500928 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2239/4424] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:57 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1335 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:58.576161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-55b2f416-2b00-42a1-bf75-5e61bc91ad1e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:58.632454 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-55b2f416-2b00-42a1-bf75-5e61bc91ad1e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.829795 Aug 25 13:21:58.632454 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2186/4425] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:57 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:58.676406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dc795ba8-1d4d-4a16-87d0-60f105468c01 tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Action: 'create', calling method: .version_select at 0x7f3a2a6dba60>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:58.687789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-877d66a8-d69b-4319-ab64-99c4787d720d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:58.689099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-877d66a8-d69b-4319-ab64-99c4787d720d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:58.717485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877d66a8-d69b-4319-ab64-99c4787d720d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:58.718497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877d66a8-d69b-4319-ab64-99c4787d720d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:58.719356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877d66a8-d69b-4319-ab64-99c4787d720d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:58.720720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877d66a8-d69b-4319-ab64-99c4787d720d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:58.721663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877d66a8-d69b-4319-ab64-99c4787d720d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:58.722483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877d66a8-d69b-4319-ab64-99c4787d720d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:58.741720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-dc795ba8-1d4d-4a16-87d0-60f105468c01 tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Getting quotas for project 39c3f5093e8e43e48d39816a67f42b25. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:21:58.776308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-dc795ba8-1d4d-4a16-87d0-60f105468c01 tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Getting quotas for user eceb2d24aacb4deeaa00032379a34443 and project 39c3f5093e8e43e48d39816a67f42b25. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:21:58.913747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-dc795ba8-1d4d-4a16-87d0-60f105468c01 tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Getting quotas for project 39c3f5093e8e43e48d39816a67f42b25. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:21:58.938945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-dc795ba8-1d4d-4a16-87d0-60f105468c01 tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Getting quotas for user eceb2d24aacb4deeaa00032379a34443 and project 39c3f5093e8e43e48d39816a67f42b25. Resources: {'server_groups'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:21:58.986344 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dc795ba8-1d4d-4a16-87d0-60f105468c01 tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.482553 Aug 25 13:21:58.989186 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2240/4426] 10.222.0.70 () {62 vars in 1214 bytes} [Thu Aug 25 13:21:58 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:21:59.031442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d06c00ea-0cc6-4fd7-9584-d3a9b01ac1d1 tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:59.134831 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d06c00ea-0cc6-4fd7-9584-d3a9b01ac1d1 tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.127663 Aug 25 13:21:59.145405 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2241/4427] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Aug 25 13:21:59 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:21:59.189243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1822c297-f636-4762-9f74-1073db81426a tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:59.241451 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1822c297-f636-4762-9f74-1073db81426a tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/73e60724-840d-472c-b7af-2d9c546fae7b" status: 200 len: 235 microversion: 2.64 time: 0.068135 Aug 25 13:21:59.262132 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2242/4428] 10.222.0.70 () {60 vars in 1304 bytes} [Thu Aug 25 13:21:59 2022] GET /compute/v2.1/os-server-groups/73e60724-840d-472c-b7af-2d9c546fae7b => generated 235 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:21:59.278923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-218b238d-d57a-43e9-8f47-85980ff23e75 tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:59.373331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:59.388315 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-218b238d-d57a-43e9-8f47-85980ff23e75 tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/73e60724-840d-472c-b7af-2d9c546fae7b" status: 204 len: 0 microversion: 2.64 time: 0.123962 Aug 25 13:21:59.395649 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2243/4429] 10.222.0.70 () {60 vars in 1307 bytes} [Thu Aug 25 13:21:59 2022] DELETE /compute/v2.1/os-server-groups/73e60724-840d-472c-b7af-2d9c546fae7b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:21:59.421378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7bdd4384-a381-482f-99d3-64c1abee359c tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:59.444300 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-7bdd4384-a381-482f-99d3-64c1abee359c tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] HTTP exception thrown: Instance group 73e60724-840d-472c-b7af-2d9c546fae7b could not be found. Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7bdd4384-a381-482f-99d3-64c1abee359c tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Request method failure captured: Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-server-groups/73e60724-840d-472c-b7af-2d9c546fae7b HTTP/1.1 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3d2D2RAu64Za-kmhI8A805AJwqhshOWAdbGw3MPSuT8zzqlFxlEVmmlCBDr-Cj0o5_F2PsGUUMbvTy5I1iyR1PsXzZHXlVpr7heUBf_3FERqhYzJRTwN3Igs2IIErXEJBxOAlLOCVOxVjwDAW52oyftP-dAbRlN4CFL7k8M2NVa7Xw Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.64 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 39c3f5093e8e43e48d39816a67f42b25 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerGroup264TestJSON-1373777521 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39c3f5093e8e43e48d39816a67f42b25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_39c3f5093e8e43e48d39816a67f42b25", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/39c3f5093e8e43e48d39816a67f42b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39c3f5093e8e43e48d39816a67f42b25"}]}] Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerGroup264TestJSON-1373777521 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 39c3f5093e8e43e48d39816a67f42b25 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1373777521 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerGroup264TestJSON-1373777521-project Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: eceb2d24aacb4deeaa00032379a34443 Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerGroup264TestJSON-1373777521-project Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance group 73e60724-840d-472c-b7af-2d9c546fae7b could not be found. Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '73e60724-840d-472c-b7af-2d9c546fae7b'} Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 73e60724-840d-472c-b7af-2d9c546fae7b could not be found. Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 73e60724-840d-472c-b7af-2d9c546fae7b could not be found. Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:59.448089 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:59.462072 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:59.462072 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:59.462072 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:59.462072 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:59.462072 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 73e60724-840d-472c-b7af-2d9c546fae7b could not be found. Aug 25 13:21:59.462072 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:21:59.462072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7bdd4384-a381-482f-99d3-64c1abee359c tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] Returning 404 to user: Instance group 73e60724-840d-472c-b7af-2d9c546fae7b could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:59.462072 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7bdd4384-a381-482f-99d3-64c1abee359c tempest-ServerGroup264TestJSON-1373777521 tempest-ServerGroup264TestJSON-1373777521-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/73e60724-840d-472c-b7af-2d9c546fae7b" status: 404 len: 117 microversion: 2.64 time: 0.063388 Aug 25 13:21:59.471121 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2244/4430] 10.222.0.70 () {60 vars in 1307 bytes} [Thu Aug 25 13:21:59 2022] DELETE /compute/v2.1/os-server-groups/73e60724-840d-472c-b7af-2d9c546fae7b => generated 117 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:21:59.563538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:59.567258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:59.622476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:59.623360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:59.634232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:59.636497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:59.637290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:59.644630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:59.889348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:59.922930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:59.931613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:59.951908 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-addcded8-9208-43bd-adff-c9011172b7cb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1356 microversion: 2.47 time: 0.388236 Aug 25 13:21:59.953407 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2245/4431] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:59 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1356 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:00.119323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-877d66a8-d69b-4319-ab64-99c4787d720d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:00.161534 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-877d66a8-d69b-4319-ab64-99c4787d720d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.484456 Aug 25 13:22:00.162562 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2187/4432] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:58 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:22:00.207443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:00.207775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-2079413797", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "425792fd-221d-41ff-88fd-61f38ef11246"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:00.219442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:00.251595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:00.252883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:00.254736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:00.259300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:00.266955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:00.268513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:00.387883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] validate_networks() for [('425792fd-221d-41ff-88fd-61f38ef11246', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:22:00.575146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=44 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:00.602906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:22:00.603835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:22:00.605840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:22:00.606835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:22:00.617860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:22:00.863986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:00.900882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:00.906191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:00.911186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:00.916598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:00.917942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:00.921065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:01.061132 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2fdddca0-2ce8-4c0e-9da5-cacf331c67e8 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "POST /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3/action" status: 202 len: 1078 microversion: 2.47 time: 0.883871 Aug 25 13:22:01.062374 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2188/4433] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 13:22:00 2022] POST /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3/action => generated 1078 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 25 13:22:01.097441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00961b4d-54fe-4e2b-98f0-2926ea194144 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-38264786_updated"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:01.103373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-00961b4d-54fe-4e2b-98f0-2926ea194144 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c7b44c8f-55ef-48d5-ac89-e3e2f7809358] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:01.128700 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-00961b4d-54fe-4e2b-98f0-2926ea194144 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance c7b44c8f-55ef-48d5-ac89-e3e2f7809358 could not be found. Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00961b4d-54fe-4e2b-98f0-2926ea194144 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: request: PUT /compute/v2.1/servers/c7b44c8f-55ef-48d5-ac89-e3e2f7809358 HTTP/1.1 Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 79 Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-38264786_updated"}} Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance c7b44c8f-55ef-48d5-ac89-e3e2f7809358 could not be found. Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'c7b44c8f-55ef-48d5-ac89-e3e2f7809358', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-38264786_updated'}}} Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b44c8f-55ef-48d5-ac89-e3e2f7809358 could not be found. Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 25 13:22:01.133422 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b44c8f-55ef-48d5-ac89-e3e2f7809358 could not be found. Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b44c8f-55ef-48d5-ac89-e3e2f7809358 could not be found. Aug 25 13:22:01.145963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:22:01.153571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00961b4d-54fe-4e2b-98f0-2926ea194144 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance c7b44c8f-55ef-48d5-ac89-e3e2f7809358 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:01.153571 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-00961b4d-54fe-4e2b-98f0-2926ea194144 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "PUT /compute/v2.1/servers/c7b44c8f-55ef-48d5-ac89-e3e2f7809358" status: 404 len: 111 microversion: 2.1 time: 0.088335 Aug 25 13:22:01.165960 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2189/4434] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Aug 25 13:22:01 2022] PUT /compute/v2.1/servers/c7b44c8f-55ef-48d5-ac89-e3e2f7809358 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:22:01.176945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:01.184235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:01.216412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:01.218002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:01.219644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:01.220339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:01.235661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:01.236497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:01.784962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:01.814672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:01.818059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:01.832387 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-75ca334f-4166-411f-a75f-94fe142eb376 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.663376 Aug 25 13:22:01.833583 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2190/4435] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:01 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:01.849830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b21164df-00d6-4098-bff5-38abe084649d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:01.849830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b21164df-00d6-4098-bff5-38abe084649d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:01.913049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b21164df-00d6-4098-bff5-38abe084649d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:01.914613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b21164df-00d6-4098-bff5-38abe084649d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:01.942719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b21164df-00d6-4098-bff5-38abe084649d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:01.955364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b21164df-00d6-4098-bff5-38abe084649d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:01.956680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b21164df-00d6-4098-bff5-38abe084649d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:01.957776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b21164df-00d6-4098-bff5-38abe084649d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:02.789061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b21164df-00d6-4098-bff5-38abe084649d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:02.831216 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b21164df-00d6-4098-bff5-38abe084649d tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.994786 Aug 25 13:22:02.832851 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2191/4436] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:01 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:02.891488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5cb47116-98ca-4ae6-8009-6c04f5a650c9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:02.893278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5cb47116-98ca-4ae6-8009-6c04f5a650c9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:02.953279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5cb47116-98ca-4ae6-8009-6c04f5a650c9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:02.959301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5cb47116-98ca-4ae6-8009-6c04f5a650c9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:02.964020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5cb47116-98ca-4ae6-8009-6c04f5a650c9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:02.969393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5cb47116-98ca-4ae6-8009-6c04f5a650c9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:02.974053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5cb47116-98ca-4ae6-8009-6c04f5a650c9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:02.978214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5cb47116-98ca-4ae6-8009-6c04f5a650c9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:03.725891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:22:03.728691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:22:03.731011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:22:03.732116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:22:03.735023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:22:03.781112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:03.782562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:03.788975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:03.791492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:03.792968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:03.794129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:03.857004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=79 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:03.926048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Getting quotas for project 6d0432b6cc2b4e35815bf6d5446e9a2c. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:22:03.957752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Getting quotas for user 5f9f71f1609845588d56fe81c2db360e and project 6d0432b6cc2b4e35815bf6d5446e9a2c. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:22:03.961388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5cb47116-98ca-4ae6-8009-6c04f5a650c9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:04.006212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:22:04.011191 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5cb47116-98ca-4ae6-8009-6c04f5a650c9 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 1.131377 Aug 25 13:22:04.013245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:22:04.018496 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2192/4437] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:02 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:04.039810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:04.043109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:04.066131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:04.067665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:04.068780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:04.070824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:04.072329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:04.074308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:04.205955 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2231c552-955c-46f4-89bd-5fd3952848c7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.226073 Aug 25 13:22:04.207823 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2246/4438] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 13:21:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4229 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:22:04.227162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df1253f0-512b-4358-80ba-56e2c414dfd4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df1253f0-512b-4358-80ba-56e2c414dfd4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: request: PUT /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed HTTP/1.1 Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 280 Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'cc6362fd-0197-4636-8a8d-6814ba103aed', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:04.238125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:04.248073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df1253f0-512b-4358-80ba-56e2c414dfd4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:04.266063 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-df1253f0-512b-4358-80ba-56e2c414dfd4 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "PUT /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 400 len: 619 microversion: 2.1 time: 0.040174 Aug 25 13:22:04.274471 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2247/4439] 10.222.0.70 () {60 vars in 1257 bytes} [Thu Aug 25 13:22:04 2022] PUT /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 619 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:22:04.311841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b7812b5-7430-4784-bace-4facb8d6d89d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:04.313766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b7812b5-7430-4784-bace-4facb8d6d89d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:04.320934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:04.357840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:04.367665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:04.372997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:04.377314 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-77fd8d18-e4a0-4089-8514-c0c9b513c373 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.356075 Aug 25 13:22:04.389893 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2193/4440] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:04 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:04.415636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b7e5994e-2bbb-41f8-97f2-204a20e354b7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:04.419735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b7e5994e-2bbb-41f8-97f2-204a20e354b7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:04.454355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7e5994e-2bbb-41f8-97f2-204a20e354b7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:04.460631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7e5994e-2bbb-41f8-97f2-204a20e354b7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:04.462486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7e5994e-2bbb-41f8-97f2-204a20e354b7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:04.481320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7e5994e-2bbb-41f8-97f2-204a20e354b7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:04.487013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7e5994e-2bbb-41f8-97f2-204a20e354b7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:04.488145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b7e5994e-2bbb-41f8-97f2-204a20e354b7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:04.515490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b7812b5-7430-4784-bace-4facb8d6d89d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:04.556020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b7812b5-7430-4784-bace-4facb8d6d89d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:04.559793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b7812b5-7430-4784-bace-4facb8d6d89d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:04.570699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b7812b5-7430-4784-bace-4facb8d6d89d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1262 microversion: 2.26 time: 0.287729 Aug 25 13:22:04.571756 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2248/4441] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:04 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1262 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:05.055003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b7e5994e-2bbb-41f8-97f2-204a20e354b7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:05.093118 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b7e5994e-2bbb-41f8-97f2-204a20e354b7 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.698711 Aug 25 13:22:05.099404 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2194/4442] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:04 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:05.152415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-04e316fd-85b3-4d1a-b8b1-314eedb4a8aa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:05.156468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-04e316fd-85b3-4d1a-b8b1-314eedb4a8aa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:05.193637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04e316fd-85b3-4d1a-b8b1-314eedb4a8aa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:05.195214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04e316fd-85b3-4d1a-b8b1-314eedb4a8aa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:05.196442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04e316fd-85b3-4d1a-b8b1-314eedb4a8aa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:05.199494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04e316fd-85b3-4d1a-b8b1-314eedb4a8aa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:05.201040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04e316fd-85b3-4d1a-b8b1-314eedb4a8aa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:05.202320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04e316fd-85b3-4d1a-b8b1-314eedb4a8aa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:05.445683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:05.451557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:05.495591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:05.500133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:05.503495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:05.513489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:05.515982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:05.524483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:05.910702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:05.957896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:05.971537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:05.974155 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-47bda915-eda2-44c8-bec1-013c2a9d4ae6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.538320 Aug 25 13:22:06.000653 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2195/4443] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:05 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:06.005902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-04e316fd-85b3-4d1a-b8b1-314eedb4a8aa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:06.019720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-30cdcf78-99cf-47f9-ac80-caf4b2bf8f14 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:06.021949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-30cdcf78-99cf-47f9-ac80-caf4b2bf8f14 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:06.047672 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-04e316fd-85b3-4d1a-b8b1-314eedb4a8aa tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.897521 Aug 25 13:22:06.049151 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2249/4444] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:05 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:06.113991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a37271fc-088b-4136-9e14-f8666c14463e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a37271fc-088b-4136-9e14-f8666c14463e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: request: PUT /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed HTTP/1.1 Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 24 Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: {"server": {"name": ""}} Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'cc6362fd-0197-4636-8a8d-6814ba103aed', 'body': {'server': {'name': ''}}} Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi '' Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:22:06.122514 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a37271fc-088b-4136-9e14-f8666c14463e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a37271fc-088b-4136-9e14-f8666c14463e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "PUT /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 400 len: 108 microversion: 2.1 time: 0.033475 Aug 25 13:22:06.138029 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2250/4445] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Aug 25 13:22:06 2022] PUT /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:22:06.156835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-daaa51ee-20cc-4e7e-9b00-11a09bb819f2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:06.166828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-daaa51ee-20cc-4e7e-9b00-11a09bb819f2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:06.192071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa51ee-20cc-4e7e-9b00-11a09bb819f2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:06.192632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa51ee-20cc-4e7e-9b00-11a09bb819f2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:06.193297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa51ee-20cc-4e7e-9b00-11a09bb819f2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:06.206829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa51ee-20cc-4e7e-9b00-11a09bb819f2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:06.207635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa51ee-20cc-4e7e-9b00-11a09bb819f2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:06.208308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa51ee-20cc-4e7e-9b00-11a09bb819f2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:06.282545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-30cdcf78-99cf-47f9-ac80-caf4b2bf8f14 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:06.312497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-30cdcf78-99cf-47f9-ac80-caf4b2bf8f14 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:06.315476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-30cdcf78-99cf-47f9-ac80-caf4b2bf8f14 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:06.340295 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-30cdcf78-99cf-47f9-ac80-caf4b2bf8f14 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1262 microversion: 2.26 time: 0.337528 Aug 25 13:22:06.342154 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2196/4446] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:06 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1262 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:06.751512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-daaa51ee-20cc-4e7e-9b00-11a09bb819f2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:06.802945 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-daaa51ee-20cc-4e7e-9b00-11a09bb819f2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1505 microversion: 2.1 time: 0.645938 Aug 25 13:22:06.805137 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2251/4447] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:06 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1505 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:07.021787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:07.023030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:07.057410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:07.059057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:07.077422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:07.096103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:07.106508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:07.107323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:07.403988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:07.408181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:07.444357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:07.445261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:07.446142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:07.447457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:07.453130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:07.454372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:07.467579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:07.508763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:07.538157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:07.543789 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-63da3580-3df0-4c62-b8d7-edeedde8a7df tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.528853 Aug 25 13:22:07.546148 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2197/4448] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:07 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:07.789298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:07.822104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:07.833770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:07.843987 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0f5aa9a6-d2b8-48f4-b494-b17e27d0a533 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1314 microversion: 2.26 time: 0.454726 Aug 25 13:22:07.846931 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2252/4449] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:07 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:08.607700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:08.615479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:08.640426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:08.643295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:08.644581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:08.646373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:08.647600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:08.650196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:08.899482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:08.908546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:08.938242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:08.946157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:08.949612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:08.951633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:08.966806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:08.968844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:09.007926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:09.056614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:09.063640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:09.065782 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b2b0af2-c472-4dc1-8402-9277e06de7a9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.473314 Aug 25 13:22:09.071555 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2198/4450] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:08 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:09.261397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:09.297337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:09.304017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:09.308676 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b097c483-502c-4436-a7da-1e4c3ad6b1c3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1320 microversion: 2.26 time: 0.423046 Aug 25 13:22:09.326343 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2253/4451] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:08 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:10.136936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:10.143911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:10.176887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:10.181343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:10.185595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:10.187527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:10.193839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:10.195288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:10.360491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:10.366890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:10.399272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:10.400184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:10.405818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:10.408415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:10.411654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:10.412990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:10.517106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:10.558893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:10.562245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:10.578976 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2ef2b1e0-e75b-47c0-85a3-b07b7b7cd553 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.458540 Aug 25 13:22:10.582140 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2199/4452] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:10 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:10.763843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:10.802766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:10.806774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:10.831952 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a5f3621-8d80-44a1-80e5-28723173bb66 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1320 microversion: 2.26 time: 0.479886 Aug 25 13:22:10.841211 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2254/4453] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:10 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1320 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:11.632494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:11.640225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:11.672782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:11.673956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:11.675071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:11.676531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:11.683478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:11.684614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:11.890467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:11.892222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:11.930773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:11.934739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:11.940830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:11.942921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:11.946805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:11.950131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:12.145886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:12.195692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:12.213912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:12.216884 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-81d309ec-e294-4086-a1d9-c790c356275e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.593463 Aug 25 13:22:12.246026 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2200/4454] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:11 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:13.201407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:13.241047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:13.248768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:13.252786 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e80bdf0-b047-48af-a809-352a148267de tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1362 microversion: 2.26 time: 1.374424 Aug 25 13:22:13.273733 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2255/4455] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:11 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1362 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:13.295416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:13.296680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:13.329846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:13.336642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:13.339779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:13.351935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:13.352892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:13.354319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:14.163803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:14.185319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:14.189442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:14.192568 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fc2400b3-f981-41ef-8dd1-6847fb4f207d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.911721 Aug 25 13:22:14.194281 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2201/4456] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:13 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:14.314818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:14.317124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:14.335221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:14.373161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:14.375768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:14.378947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:14.380688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:14.381779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:14.383286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:14.530490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=32 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:15.246092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:15.250811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:15.283921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:15.285220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:15.286635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:15.289322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:15.290588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:15.294008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:16.146541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:16.185021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:16.198501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:16.201118 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d9459555-86ec-4362-9b75-af6607278728 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1362 microversion: 2.26 time: 1.896466 Aug 25 13:22:16.202140 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2256/4457] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:14 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1362 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:16.295163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:16.327698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:16.350390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:16.354879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:16.371921 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6cd06adb-2296-40bd-967a-b9beb596beb2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 1.134380 Aug 25 13:22:16.374983 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2202/4458] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:15 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:17.258277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:17.259440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:17.320283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:17.327797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:17.335330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:17.337040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:17.342440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:17.346742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:17.424208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:17.428552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:17.460770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:17.461967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:17.470920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:17.472557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:17.473443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:17.474825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:17.803719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:17.835960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:17.845898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:17.848145 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-141f163a-7dcc-410c-8457-23ef956e39dc tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.431689 Aug 25 13:22:17.849179 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2203/4459] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:17 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:18.103891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-546c9852-01e5-477e-9c18-527c3ed5dac9 req-734ce795-fb24-4de9-b599-6332a0d21a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5", "tag": "eab4da3f-642f-4c44-bbe9-a8c7a20d4d8a"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:18.168427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-546c9852-01e5-477e-9c18-527c3ed5dac9 req-734ce795-fb24-4de9-b599-6332a0d21a94 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:18.191305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-546c9852-01e5-477e-9c18-527c3ed5dac9 req-734ce795-fb24-4de9-b599-6332a0d21a94 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:18.192898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-546c9852-01e5-477e-9c18-527c3ed5dac9 req-734ce795-fb24-4de9-b599-6332a0d21a94 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:18.257150 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-546c9852-01e5-477e-9c18-527c3ed5dac9 req-734ce795-fb24-4de9-b599-6332a0d21a94 service nova] Creating event network-changed:eab4da3f-642f-4c44-bbe9-a8c7a20d4d8a for instance 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 on n-h1-852771-8 Aug 25 13:22:18.270767 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-546c9852-01e5-477e-9c18-527c3ed5dac9 req-734ce795-fb24-4de9-b599-6332a0d21a94 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183614 Aug 25 13:22:18.272725 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2204/4460] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:22:18.314679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:18.362550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:18.375570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:18.378847 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3dd121ce-cc5f-477c-a1db-3128b5f98dbc tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1362 microversion: 2.26 time: 1.132295 Aug 25 13:22:18.386036 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2257/4461] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:17 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1362 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:18.908583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:18.916769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:18.968819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:18.970198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:18.976403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:18.978318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:18.979547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:18.980748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:19.424011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:19.437381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:19.438465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:19.468024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:19.468893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:19.473274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:19.484453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:19.485661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:19.490346 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a5eb6851-4ca8-46aa-8938-570ff5005170 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.592228 Aug 25 13:22:19.490948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:19.492291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:19.495493 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2205/4462] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:18 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:19.496359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:20.479231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:20.533624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:20.541738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:20.547044 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7aa5877a-3cf0-47a5-af02-dbc657435902 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1362 microversion: 2.26 time: 1.118293 Aug 25 13:22:20.549606 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2258/4463] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:19 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1362 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:20.561918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:20.561918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:20.602472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:20.603064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:20.606197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:20.611813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:20.612704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:20.617142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:20.914670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:20.915593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:20.937724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:20.939152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:20.941182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:20.942964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:20.944090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:20.945093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:20.984302 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 HTTP/1.1 Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'c5304090-4e5b-4154-b954-a46f3b514bd1'} Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:22:20.988854 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:21.002096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:21.005564 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a7f47505-adaf-4618-8369-6a118339edab tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 404 len: 111 microversion: 2.1 time: 0.104144 Aug 25 13:22:21.008891 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2259/4464] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:22:20 2022] DELETE /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:22:21.023205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:21.047799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:21.049532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: c5304090-4e5b-4154-b954-a46f3b514bd1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:21.054594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:21.061098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:21.063673 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-de1e2ede-8a5f-4e0b-81e1-e5a49829d6f2 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.522275 Aug 25 13:22:21.076864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:21.078565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:21.079868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:21.086813 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2206/4465] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:20 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:21.090814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:21.096063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:21.097770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:21.149779 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 HTTP/1.1 Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'c5304090-4e5b-4154-b954-a46f3b514bd1'} Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:21.156938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:21.171825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:21.171825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:21.171825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:21.171825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:22:21.171825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:22:21.171825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. Aug 25 13:22:21.171825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:21.171825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance c5304090-4e5b-4154-b954-a46f3b514bd1 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:21.171825 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22a35edf-2d72-4ef3-b6ac-fb7a521e4c2e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1" status: 404 len: 111 microversion: 2.1 time: 0.149602 Aug 25 13:22:21.171825 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2260/4466] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:21 2022] GET /compute/v2.1/servers/c5304090-4e5b-4154-b954-a46f3b514bd1 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:22:21.184450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-edf62193-c78c-4c05-8b74-9907e43ca345 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:21.185376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-edf62193-c78c-4c05-8b74-9907e43ca345 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:21.199251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edf62193-c78c-4c05-8b74-9907e43ca345 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:21.200064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edf62193-c78c-4c05-8b74-9907e43ca345 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:21.200901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edf62193-c78c-4c05-8b74-9907e43ca345 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:21.202332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edf62193-c78c-4c05-8b74-9907e43ca345 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:21.203187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edf62193-c78c-4c05-8b74-9907e43ca345 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:21.203982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edf62193-c78c-4c05-8b74-9907e43ca345 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:21.265465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-edf62193-c78c-4c05-8b74-9907e43ca345 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:22:21.473725 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-edf62193-c78c-4c05-8b74-9907e43ca345 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 204 len: 0 microversion: 2.1 time: 0.297205 Aug 25 13:22:21.475210 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2207/4467] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:22:21 2022] DELETE /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:22:21.491834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d721cf7a-5bd7-409d-961c-d12c1abf32b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:21.493009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d721cf7a-5bd7-409d-961c-d12c1abf32b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:21.537548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d721cf7a-5bd7-409d-961c-d12c1abf32b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:21.538977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d721cf7a-5bd7-409d-961c-d12c1abf32b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:21.539890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d721cf7a-5bd7-409d-961c-d12c1abf32b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:21.542333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d721cf7a-5bd7-409d-961c-d12c1abf32b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:21.543628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d721cf7a-5bd7-409d-961c-d12c1abf32b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:21.546304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d721cf7a-5bd7-409d-961c-d12c1abf32b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:21.621369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:21.625260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:21.662725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:21.666857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:21.670784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:21.673701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:21.677334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:21.679888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:22.380959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d721cf7a-5bd7-409d-961c-d12c1abf32b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:22.416901 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d721cf7a-5bd7-409d-961c-d12c1abf32b2 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1511 microversion: 2.1 time: 0.931428 Aug 25 13:22:22.431388 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2261/4468] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:21 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1511 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:22.456927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:22.462000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:22.496401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:22.497542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:22.503211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:22.510118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:22.512361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:22.515175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:22.560898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:22.610636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:22.623709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:22.634660 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9100e5a9-90bf-4419-a9a4-671a7df649c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1362 microversion: 2.26 time: 1.027069 Aug 25 13:22:22.639037 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2208/4469] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:21 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1362 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:22.875736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:22.903640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:22.908617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:22.912399 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6818c34c-65a8-47fb-80c9-80aab5257ddd tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.477007 Aug 25 13:22:22.913866 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2262/4470] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:22 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:23.457382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8506cb14-bb4c-4c3b-908c-618ae3bb6af3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:23.458712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8506cb14-bb4c-4c3b-908c-618ae3bb6af3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:23.477805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8506cb14-bb4c-4c3b-908c-618ae3bb6af3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:23.478871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8506cb14-bb4c-4c3b-908c-618ae3bb6af3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:23.479858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8506cb14-bb4c-4c3b-908c-618ae3bb6af3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:23.480871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8506cb14-bb4c-4c3b-908c-618ae3bb6af3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:23.481476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8506cb14-bb4c-4c3b-908c-618ae3bb6af3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:23.482417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8506cb14-bb4c-4c3b-908c-618ae3bb6af3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:23.688768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:23.690043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:23.723243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:23.724223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:23.730907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:23.733315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:23.737928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:23.739277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:25.445697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8506cb14-bb4c-4c3b-908c-618ae3bb6af3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:25.472299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8506cb14-bb4c-4c3b-908c-618ae3bb6af3 tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1511 microversion: 2.1 time: 2.020151 Aug 25 13:22:25.473596 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2209/4471] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:23 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1511 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:25.500974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:25.503681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:25.521875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:25.523434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:25.529738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:25.533834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:25.536357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:25.538655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:25.644955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:25.670515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:25.684802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:25.688038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:25.690355 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ed016237-62e7-4f18-b57b-5c9e756bbcae tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1362 microversion: 2.26 time: 2.009301 Aug 25 13:22:25.696955 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2263/4472] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:23 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1362 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:26.055023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:26.106848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:26.123667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:26.126712 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-810da8d7-1ed7-4776-99e9-e6797d057a72 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.639659 Aug 25 13:22:26.128768 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2210/4473] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:25 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:26.526366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bbf2b7f8-e077-41ea-b4a8-11d7a6803bfc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:26.528068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bbf2b7f8-e077-41ea-b4a8-11d7a6803bfc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:26.549843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbf2b7f8-e077-41ea-b4a8-11d7a6803bfc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:26.550773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbf2b7f8-e077-41ea-b4a8-11d7a6803bfc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:26.551593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbf2b7f8-e077-41ea-b4a8-11d7a6803bfc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:26.555443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbf2b7f8-e077-41ea-b4a8-11d7a6803bfc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:26.562832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbf2b7f8-e077-41ea-b4a8-11d7a6803bfc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:26.564009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bbf2b7f8-e077-41ea-b4a8-11d7a6803bfc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:26.744461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:26.750427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:26.768206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:26.770389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:26.771953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:26.773876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:26.775544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:26.776798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:26.899407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bbf2b7f8-e077-41ea-b4a8-11d7a6803bfc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:26.928014 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bbf2b7f8-e077-41ea-b4a8-11d7a6803bfc tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1469 microversion: 2.1 time: 0.420712 Aug 25 13:22:26.931061 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2264/4474] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:26 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1469 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:27.180918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-09797402-d9f5-473d-927e-27341b83dfbd req-7a6f1cfd-fa3c-4da1-967f-80e1f752f0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6362fd-0197-4636-8a8d-6814ba103aed", "name": "network-vif-deleted", "tag": "221908ac-54e5-4185-a673-1a922869d2b5"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:27.210434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-09797402-d9f5-473d-927e-27341b83dfbd req-7a6f1cfd-fa3c-4da1-967f-80e1f752f0d7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:27.211169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-09797402-d9f5-473d-927e-27341b83dfbd req-7a6f1cfd-fa3c-4da1-967f-80e1f752f0d7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:27.211860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-09797402-d9f5-473d-927e-27341b83dfbd req-7a6f1cfd-fa3c-4da1-967f-80e1f752f0d7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:27.241916 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-09797402-d9f5-473d-927e-27341b83dfbd req-7a6f1cfd-fa3c-4da1-967f-80e1f752f0d7 service nova] Creating event network-vif-deleted:221908ac-54e5-4185-a673-1a922869d2b5 for instance cc6362fd-0197-4636-8a8d-6814ba103aed on n-h1-852771-8 Aug 25 13:22:27.253475 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-09797402-d9f5-473d-927e-27341b83dfbd req-7a6f1cfd-fa3c-4da1-967f-80e1f752f0d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079395 Aug 25 13:22:27.255056 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2265/4475] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:22:27.264346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:27.265539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:27.278271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:27.279608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:27.280894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:27.282549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:27.283996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:27.285170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:27.479356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:27.480870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:27.500583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:27.504683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:27.512584 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-922bffea-1d03-4ef3-b110-aca60990eb82 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1365 microversion: 2.47 time: 0.255073 Aug 25 13:22:27.514556 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2266/4476] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:27 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:27.518241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:27.523126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:27.534352 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1dbb6b9e-c78c-4366-9714-9e0a7221338d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1362 microversion: 2.26 time: 0.796782 Aug 25 13:22:27.536050 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2211/4477] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:26 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1362 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:27.976959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:27.978407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:28.021624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:28.024340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:28.026413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:28.029173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:28.046772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:28.055059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:28.146074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:28.147690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:28.148979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:28.151302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lazy-loading 'fault' on Instance uuid cc6362fd-0197-4636-8a8d-6814ba103aed {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:28.238586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd3d6ee64a4a3d8182c73efb372e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c8fc08eb5b483a90fa0ef5bc79b8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:28.259081 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9393034c-9c58-4946-8ba7-595df699f2af tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 200 len: 1305 microversion: 2.1 time: 0.291319 Aug 25 13:22:28.282494 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2267/4478] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:27 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 1305 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:28.557816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:28.560230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:28.578822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:28.581284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:28.583697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:28.585673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:28.587303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:28.588495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:28.595017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:28.598026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:28.627028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:28.628506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:28.629848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:28.631612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:28.633738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:28.636943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:28.643523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:28.811977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:28.832121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:28.839920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:28.844318 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ea0c7fac-7f87-46d6-b954-1c14dd66acd0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1371 microversion: 2.47 time: 0.295075 Aug 25 13:22:28.848398 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2212/4479] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:28 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:28.988566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:29.008469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:29.013469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:29.016445 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d0f2b6d6-0280-45d3-b455-a360a0428590 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1362 microversion: 2.26 time: 0.435884 Aug 25 13:22:29.017606 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2268/4480] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:28 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:29.303155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:29.307122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] [instance: cc6362fd-0197-4636-8a8d-6814ba103aed] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:29.349186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:29.354279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:29.355311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:29.359835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:29.362804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:29.363659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:29.893021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:29.898647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:29.920142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:29.926391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:29.931700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:29.933365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:29.937680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:29.941574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:29.944235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:30.215740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:30.267744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:30.280259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:30.288758 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e528056c-de09-48d7-8a8f-3a97dc2436d4 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1371 microversion: 2.47 time: 0.399650 Aug 25 13:22:30.292258 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2269/4481] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:29 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1371 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:30.320830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:30.326781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:30.340485 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] HTTP exception thrown: Instance cc6362fd-0197-4636-8a8d-6814ba103aed could not be found. Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Request method failure captured: Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed HTTP/1.1 Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3W-3i0plAZzQfkuVczo7lVbZ4vXSVWWXQGUpSfco6S_bKUsWg4fXMd5h3zXKq8ebyKYk-sRTTxxIi_dmEG4Lyw9wXXbBVz6pJe_iLtm-yZFYMELOQWxRUH_6q_yKdds2-dnOQUhlYXJLJmEg-nw4vAw5YzAfmk5ufNzH2GiNCxELiQ Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9c8fc08eb5b483a90fa0ef5bc79b8cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9c8fc08eb5b483a90fa0ef5bc79b8cd"}]}] Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f9c8fc08eb5b483a90fa0ef5bc79b8cd Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1520843822 Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: acdd3d6ee64a4a3d8182c73efb372e6c Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1520843822-project Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance cc6362fd-0197-4636-8a8d-6814ba103aed could not be found. Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'cc6362fd-0197-4636-8a8d-6814ba103aed'} Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc6362fd-0197-4636-8a8d-6814ba103aed could not be found. Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc6362fd-0197-4636-8a8d-6814ba103aed could not be found. Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:30.343963 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:22:30.352162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:30.352162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:30.352162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:30.352162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:22:30.352162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:22:30.352162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc6362fd-0197-4636-8a8d-6814ba103aed could not be found. Aug 25 13:22:30.352162 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:22:30.352162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] Returning 404 to user: Instance cc6362fd-0197-4636-8a8d-6814ba103aed could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:30.352162 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-48f58078-ee26-4c33-9e74-3477d6601b4e tempest-ServersNegativeTestJSON-1520843822 tempest-ServersNegativeTestJSON-1520843822-project] 10.222.0.70 "GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed" status: 404 len: 111 microversion: 2.1 time: 1.053100 Aug 25 13:22:30.352162 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2213/4482] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:29 2022] GET /compute/v2.1/servers/cc6362fd-0197-4636-8a8d-6814ba103aed => generated 111 bytes in 1056 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:22:30.373161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:30.374772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:30.382591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:30.384044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:30.388081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:30.394953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:31.142539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:31.211082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:31.226820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:31.233356 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3bf40bea-930c-40ef-8ca9-12db365e546e tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1362 microversion: 2.26 time: 0.935682 Aug 25 13:22:31.237652 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2270/4483] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:30 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1362 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:31.351718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:31.355014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:31.384843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:31.391941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-53121f05-c3b2-4c47-b723-bf99fc1aafbd req-2ecbaa73-428b-4804-8ba4-a4f983f3c71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5", "name": "network-vif-plugged", "status": "completed", "tag": "eab4da3f-642f-4c44-bbe9-a8c7a20d4d8a"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:31.401500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:31.403843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:31.409241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:31.411285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:31.414443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:31.416805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:31.448104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-53121f05-c3b2-4c47-b723-bf99fc1aafbd req-2ecbaa73-428b-4804-8ba4-a4f983f3c71d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:31.453941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-53121f05-c3b2-4c47-b723-bf99fc1aafbd req-2ecbaa73-428b-4804-8ba4-a4f983f3c71d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:31.456399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-53121f05-c3b2-4c47-b723-bf99fc1aafbd req-2ecbaa73-428b-4804-8ba4-a4f983f3c71d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:31.538889 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-53121f05-c3b2-4c47-b723-bf99fc1aafbd req-2ecbaa73-428b-4804-8ba4-a4f983f3c71d service nova] Creating event network-vif-plugged:eab4da3f-642f-4c44-bbe9-a8c7a20d4d8a for instance 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 on n-h1-852771-8 Aug 25 13:22:31.562388 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-53121f05-c3b2-4c47-b723-bf99fc1aafbd req-2ecbaa73-428b-4804-8ba4-a4f983f3c71d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178743 Aug 25 13:22:31.564492 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2271/4484] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:22:31.713336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:31.750470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:31.758844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:31.761955 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d5c215a0-6add-4bb1-9dc9-8340bfef66eb tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1371 microversion: 2.47 time: 0.421641 Aug 25 13:22:31.763517 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2214/4485] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:31 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1371 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:32.301849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:32.308829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:32.334400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:32.335528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:32.338492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:32.349163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:32.350122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:32.351187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:32.830674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:32.833915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:32.871932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:32.874612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:32.876137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:32.878848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:32.880359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:32.881802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:33.138996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:33.185129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:33.188546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:33.220751 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bffa844d-ace9-4766-900d-3b06be6c10cf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1362 microversion: 2.26 time: 0.941580 Aug 25 13:22:33.259519 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2272/4486] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:32 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1362 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:33.487707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:33.529985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:33.535523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:33.550774 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-309a497f-a630-4c42-9545-f76121a6b031 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1371 microversion: 2.47 time: 0.738655 Aug 25 13:22:33.554082 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2215/4487] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:32 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1371 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:34.269484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:34.270630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:34.300002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:34.306763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:34.311223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:34.323429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:34.325026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:34.326437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:34.607955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:34.614366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:34.633934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:34.636829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:34.639333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:34.652647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:34.653852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:34.654674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:35.297199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:35.336077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:35.340429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:35.346369 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-837ef74b-1963-42db-8bc8-a63601a7d1a5 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1356 microversion: 2.47 time: 0.749471 Aug 25 13:22:35.358156 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2216/4488] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:34 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1356 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:35.412337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:35.423935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:35.426265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Searching by: {'deleted': False, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:22:35.440602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:35.445369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:35.449371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:35.454961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:35.458358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:35.461546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:35.617128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:35.679849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:35.684323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:35.705455 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5ebd1185-4982-49ac-852a-430d1c1e1a94 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1546 microversion: 2.26 time: 1.442168 Aug 25 13:22:35.706305 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2273/4489] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:34 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1546 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:35.765738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2ad95790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:35.816218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:35.817785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:35.819500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:35.820849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:35.851027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:35.853000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:35.855466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:35.860451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:35.861929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:35.864102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:35.912379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:22:36.005128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.017573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.018691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.100063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.100998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.101858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.225142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:36.316289 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-17df2b47-e0b0-4bc3-bc97-8a5445a3ab1d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1790048441" status: 201 len: 0 microversion: 2.26 time: 0.563277 Aug 25 13:22:36.318728 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2274/4490] 10.222.0.70 () {62 vars in 1380 bytes} [Thu Aug 25 13:22:35 2022] PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1790048441 => generated 0 bytes in 567 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 25 13:22:36.355204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bd56f56b-bfb1-4c27-961f-8589f4dc7e3d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2a541280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:36.371515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:36.397042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd56f56b-bfb1-4c27-961f-8589f4dc7e3d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.398045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd56f56b-bfb1-4c27-961f-8589f4dc7e3d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.398984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd56f56b-bfb1-4c27-961f-8589f4dc7e3d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.403782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.405298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.406744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.438336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:36.447525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:36.452879 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bd56f56b-bfb1-4c27-961f-8589f4dc7e3d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1790048441" status: 204 len: 0 microversion: 2.26 time: 0.123308 Aug 25 13:22:36.458450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2275/4491] 10.222.0.70 () {60 vars in 1361 bytes} [Thu Aug 25 13:22:36 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1790048441 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 13:22:36.481630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2ab07af0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:36.513019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.514906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.516315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.517657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:36.538283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.541614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.543302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.545353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.546872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.549533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.611453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.613479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.614956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.634431 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a9a2c6bb-306a-4de0-9213-072b6136ef86 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 1.234967 Aug 25 13:22:36.636918 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2217/4492] 10.222.0.70 () {60 vars in 1187 bytes} [Thu Aug 25 13:22:35 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:36.684340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:36.713362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7a1db05f-1bfa-4ba5-b293-5e314593592e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:36.717445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7a1db05f-1bfa-4ba5-b293-5e314593592e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:36.764241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1db05f-1bfa-4ba5-b293-5e314593592e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.766203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1db05f-1bfa-4ba5-b293-5e314593592e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.767795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1db05f-1bfa-4ba5-b293-5e314593592e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.769626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1db05f-1bfa-4ba5-b293-5e314593592e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.770962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1db05f-1bfa-4ba5-b293-5e314593592e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.771187 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dea35452-496f-40b1-9f9d-02956e4a1123 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 204 len: 0 microversion: 2.26 time: 0.303247 Aug 25 13:22:36.772238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a1db05f-1bfa-4ba5-b293-5e314593592e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.780124 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2276/4493] 10.222.0.70 () {60 vars in 1295 bytes} [Thu Aug 25 13:22:36 2022] DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 13:22:36.798385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b66b936-5914-4dd7-9e50-d95fc90462e5 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a29b83550>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:36.817074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b66b936-5914-4dd7-9e50-d95fc90462e5 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.818402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b66b936-5914-4dd7-9e50-d95fc90462e5 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.819433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b66b936-5914-4dd7-9e50-d95fc90462e5 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.862341 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b66b936-5914-4dd7-9e50-d95fc90462e5 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 200 len: 12 microversion: 2.26 time: 0.079602 Aug 25 13:22:36.864183 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2277/4494] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Aug 25 13:22:36 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 12 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:36.880557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7a1db05f-1bfa-4ba5-b293-5e314593592e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:22:36.891020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2aa66430>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:36.936317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.937746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.938882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.942003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:36.970687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.972207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.973407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:36.975331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:36.976877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:36.978727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:37.117628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:37.119102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:37.121822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:37.158202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:37.159453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:37.160539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:37.237490 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7a1db05f-1bfa-4ba5-b293-5e314593592e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 204 len: 0 microversion: 2.47 time: 0.520434 Aug 25 13:22:37.241349 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2218/4495] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:22:36 2022] DELETE /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:22:37.265689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:37.271830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:37.273950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:37.295363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:37.296460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:37.299606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:37.300919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:37.301157 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ffb9fbf9-bb3b-484b-a8de-da3f1f242dbf tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1333302955" status: 201 len: 0 microversion: 2.26 time: 0.417985 Aug 25 13:22:37.304167 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2278/4496] 10.222.0.70 () {62 vars in 1380 bytes} [Thu Aug 25 13:22:36 2022] PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1333302955 => generated 0 bytes in 422 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 25 13:22:37.308689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:37.309911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:37.329684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f5dc91a0-d490-44af-b86c-8ae74595d350 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2ab07820>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:37.382905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5dc91a0-d490-44af-b86c-8ae74595d350 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:37.387380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5dc91a0-d490-44af-b86c-8ae74595d350 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:37.388774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5dc91a0-d490-44af-b86c-8ae74595d350 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:37.460388 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f5dc91a0-d490-44af-b86c-8ae74595d350 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 200 len: 36 microversion: 2.26 time: 0.145310 Aug 25 13:22:37.461356 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2279/4497] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Aug 25 13:22:37 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 36 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:37.488877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a29b83dc0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:37.520171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:37.520798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:37.528964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:37.530278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:37.545576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:37.560652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:37.561492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:37.562340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:37.563635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:37.564503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:37.565296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:37.592685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:37.601770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:37.606059 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c28ce453-6365-4ad8-94c4-fab467f4734d tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1362 microversion: 2.47 time: 0.354961 Aug 25 13:22:37.608752 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2219/4498] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:37 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:37.675455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:37.676392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:37.677207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:37.793399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:37.867214 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b444f347-c1b0-400c-8824-f485f3d2fd2d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1333302955" status: 204 len: 0 microversion: 2.26 time: 0.386558 Aug 25 13:22:37.870702 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2280/4499] 10.222.0.70 () {60 vars in 1364 bytes} [Thu Aug 25 13:22:37 2022] DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1333302955 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:22:37.896870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c8c77344-6eaa-4952-b594-724021304021 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2e916ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:37.928953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8c77344-6eaa-4952-b594-724021304021 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:37.934317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8c77344-6eaa-4952-b594-724021304021 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:37.938216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8c77344-6eaa-4952-b594-724021304021 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.043774 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c8c77344-6eaa-4952-b594-724021304021 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 200 len: 12 microversion: 2.26 time: 0.165635 Aug 25 13:22:38.073995 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2220/4500] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Aug 25 13:22:37 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 12 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:38.079605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2a3a2c10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:38.098346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.099855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.101142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.102937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:38.116454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.118560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.119915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.121853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.123280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.124474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.225906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.227453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.228741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.236478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:38.267165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:38.348439 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-48129731-3b66-4777-9794-b3869e2f2832 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 204 len: 0 microversion: 2.26 time: 0.280455 Aug 25 13:22:38.361277 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2281/4501] 10.222.0.70 () {60 vars in 1295 bytes} [Thu Aug 25 13:22:38 2022] DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:22:38.372424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a299308b0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:38.400314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.402118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.403570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.405012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:38.422348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.423825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.425081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.428427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.430081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.431853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.561181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.561754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.563371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.587493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.588289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.589129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.659704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:38.672023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:38.678636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:38.710739 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-97594ea4-9b4d-4dfb-9135-9dc2ce90d58d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1011853" status: 201 len: 0 microversion: 2.26 time: 0.346588 Aug 25 13:22:38.713470 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2221/4502] 10.222.0.70 () {62 vars in 1371 bytes} [Thu Aug 25 13:22:38 2022] PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1011853 => generated 0 bytes in 351 msecs (HTTP/1.1 201) 10 headers in 483 bytes (2 switches on core 0) Aug 25 13:22:38.714547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.715984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.717224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.719033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.720820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.722159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.736772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a29fc91f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:38.776760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.777872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.779426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.780330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:38.805395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.806363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.807637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.808962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.809859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.810622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.896998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.899724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.901359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.906682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:38.932728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:38.935485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:38.937021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:38.947044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:38.950656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:38.957249 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3b4967ee-bad3-4404-8554-2b87070ac285 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1362 microversion: 2.47 time: 0.299631 Aug 25 13:22:38.965699 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2282/4503] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:38 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:39.010445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:39.037755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:39.087917 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d592d5d5-babf-4b34-b244-b9b5a1c70bf3 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1641393897" status: 201 len: 0 microversion: 2.26 time: 0.362101 Aug 25 13:22:39.097048 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2222/4504] 10.222.0.70 () {62 vars in 1380 bytes} [Thu Aug 25 13:22:38 2022] PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1641393897 => generated 0 bytes in 375 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 25 13:22:39.108866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2a259e50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:39.126954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.128576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.129882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.133608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:39.146975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.148560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.150005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.151902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.153297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.154675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.218224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.219816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.221102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.261419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:39.298449 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b503fad6-62a5-4347-ab2d-f580cf572fe1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 204 len: 0 microversion: 2.26 time: 0.198508 Aug 25 13:22:39.309388 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2283/4505] 10.222.0.70 () {60 vars in 1295 bytes} [Thu Aug 25 13:22:39 2022] DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 13:22:39.322220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e22501a-dca6-48f1-87b8-a638549a343d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a29fc9ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:39.343900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e22501a-dca6-48f1-87b8-a638549a343d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.345300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e22501a-dca6-48f1-87b8-a638549a343d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.346471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e22501a-dca6-48f1-87b8-a638549a343d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.376055 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6e22501a-dca6-48f1-87b8-a638549a343d tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 200 len: 12 microversion: 2.26 time: 0.063062 Aug 25 13:22:39.389989 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2223/4506] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Aug 25 13:22:39 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 12 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:39.403274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a29b835e0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:39.422485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.423579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.424496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.425540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:39.449748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.455676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.475535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.482742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.485824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.488406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.596352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.597738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.598909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.626702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:39.665328 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-56e5ec67-2a5f-466c-9d5e-2d98837793b7 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 204 len: 0 microversion: 2.26 time: 0.273521 Aug 25 13:22:39.675217 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2284/4507] 10.222.0.70 () {60 vars in 1295 bytes} [Thu Aug 25 13:22:39 2022] DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:22:39.685257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2994d1f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:39.703625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.704464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.705404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.706436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:39.723115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.725545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.726579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.730021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.731541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.733191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.855005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.855932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.856756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.880093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:39.880980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:39.881838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:39.985972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:40.023668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:40.032005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:40.058998 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c9f74138-5768-4890-99f8-2b591f9494a1 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1454431138" status: 201 len: 0 microversion: 2.26 time: 0.382067 Aug 25 13:22:40.060899 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2224/4508] 10.222.0.70 () {62 vars in 1380 bytes} [Thu Aug 25 13:22:39 2022] PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1454431138 => generated 0 bytes in 385 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 25 13:22:40.075145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.079990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.083681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a29fc9af0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:40.085099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.085571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.089949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.091972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.121993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.124150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.127315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.128332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:40.147114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.148886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.162787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.171751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.173314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.174848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.281200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.284896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.286481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.317075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.318998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.320606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.448015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:40.527709 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1077847179" status: 201 len: 0 microversion: 2.26 time: 0.457115 Aug 25 13:22:40.529048 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2225/4509] 10.222.0.70 () {62 vars in 1380 bytes} [Thu Aug 25 13:22:40 2022] PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags/tempest-tag-1077847179 => generated 0 bytes in 460 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 25 13:22:40.531173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:40.533179 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3ef4c6f0-ed46-42d4-a301-89c7a6c5f1c9 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002417 Aug 25 13:22:40.550580 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2226/4510] 10.222.0.70 () {56 vars in 886 bytes} [Thu Aug 25 13:22:40 2022] GET /compute/ => generated 377 bytes in 21 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 25 13:22:40.560837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Action: 'update_all', calling method: .version_select at 0x7f3a2e9161f0>, body: {"tags": ["tempest-tag-1281776873", "tempest-tag-1288649423"]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:40.608089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.609046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.622712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.623992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:40.646558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.647513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.648389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.649867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.650785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.651619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.753298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.753943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.754808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:40.797147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:40.834705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:40.837642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:40.844345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:40.849579 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aa7c3c25-eed3-4536-bec2-75aed98f46a6 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1362 microversion: 2.47 time: 0.838846 Aug 25 13:22:40.869062 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2285/4511] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:40 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1362 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:40.904396 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f92de059-2693-4265-8d2b-00145fc212fb tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 200 len: 62 microversion: 2.26 time: 0.351664 Aug 25 13:22:40.913953 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2227/4512] 10.222.0.70 () {62 vars in 1312 bytes} [Thu Aug 25 13:22:40 2022] PUT /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 62 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:40.927146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1281b5a-36a6-4bb6-aece-0f9c2c1022ff tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2a259b80>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:40.971744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1281b5a-36a6-4bb6-aece-0f9c2c1022ff tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:40.973179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1281b5a-36a6-4bb6-aece-0f9c2c1022ff tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:40.974401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1281b5a-36a6-4bb6-aece-0f9c2c1022ff tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:41.023583 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c1281b5a-36a6-4bb6-aece-0f9c2c1022ff tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 200 len: 62 microversion: 2.26 time: 0.102000 Aug 25 13:22:41.035835 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2286/4513] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Aug 25 13:22:40 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 62 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:41.054121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '.version_select at 0x7f3a2994db80>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:41.111398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:41.112358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:41.113175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:41.122377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:41.145032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:41.146022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:41.146891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:41.148392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:41.149349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:41.152902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:41.257261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:41.258944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:41.263069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:41.347130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lazy-loading 'flavor' on Instance uuid 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:41.418579 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-47858667-c2f4-4e14-89f0-3cbf50afd529 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags" status: 204 len: 0 microversion: 2.26 time: 0.375353 Aug 25 13:22:41.428316 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2228/4514] 10.222.0.70 () {60 vars in 1295 bytes} [Thu Aug 25 13:22:41 2022] DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5/tags => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 13:22:41.442907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c317942-586f-4707-a65e-911d91ab3451 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:41.444416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9c317942-586f-4707-a65e-911d91ab3451 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:41.481152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c317942-586f-4707-a65e-911d91ab3451 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:41.491727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c317942-586f-4707-a65e-911d91ab3451 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:41.494604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c317942-586f-4707-a65e-911d91ab3451 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:41.496581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c317942-586f-4707-a65e-911d91ab3451 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:41.499572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c317942-586f-4707-a65e-911d91ab3451 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:41.501192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c317942-586f-4707-a65e-911d91ab3451 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:41.570503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9c317942-586f-4707-a65e-911d91ab3451 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:22:41.870655 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c317942-586f-4707-a65e-911d91ab3451 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 204 len: 0 microversion: 2.26 time: 0.437837 Aug 25 13:22:41.894084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:41.895256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:41.897204 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2287/4515] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:22:41 2022] DELETE /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:22:41.926858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:41.935652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:41.939031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:41.951488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:41.953079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:41.956474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:41.958754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:41.960808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:41.963551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:41.964411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:41.965942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:41.967694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:41.977229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:41.979749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:42.147213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:42.152433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:42.154420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:42.155906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lazy-loading 'fault' on Instance uuid d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:42.627192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:42.650861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:42.674203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:42.676849 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74c957a1-87df-4e7d-819e-973cb8bf2fa0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 200 len: 1367 microversion: 2.47 time: 0.768815 Aug 25 13:22:42.677983 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2288/4516] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:41 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 1367 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:43.415575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:43.448589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:43.460082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:43.472504 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6e3e57ac-312a-4fd2-9d6f-a3f14357bb34 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1552 microversion: 2.26 time: 1.577116 Aug 25 13:22:43.482101 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2229/4517] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:41 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1552 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:43.733992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:43.735147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:43.775149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:43.776211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:43.777286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:43.795115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:43.795958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:43.796764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:43.886263 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] HTTP exception thrown: Instance d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 could not be found. Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Request method failure captured: Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 HTTP/1.1 Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3dphR67EUJFC_OB1KieFLL96LvPFcJuU81ZbDOb980vtTQ2nFl2Cmtq3BnPnHEo7V6SqMKH56MIsS-AolL_oI05Ri5R2YUnxI8lgNiBSeSRcXrAds9hjjY6zLjIavyobkx8eK5Z-vhSrZTOph33k2U_WCSaUnwJx0aQnMvJCHVYr1g Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.47 Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 9dea8b42d7fd4c2d9475ad8c2237d1b0 Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerShowV247Test-145624320 Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9dea8b42d7fd4c2d9475ad8c2237d1b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9dea8b42d7fd4c2d9475ad8c2237d1b0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9dea8b42d7fd4c2d9475ad8c2237d1b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9dea8b42d7fd4c2d9475ad8c2237d1b0"}]}] Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerShowV247Test-145624320 Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 9dea8b42d7fd4c2d9475ad8c2237d1b0 Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerShowV247Test-145624320 Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerShowV247Test-145624320-project Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1a02297dd37c4aaf970742f258298aac Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerShowV247Test-145624320-project Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 could not be found. Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'd5c0cdbe-1c03-4510-9f2c-f784f4b94bb3'} Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 could not be found. Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 could not be found. Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:43.900967 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:43.910388 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:43.910388 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:43.910388 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:43.910388 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:22:43.910388 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:22:43.910388 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 could not be found. Aug 25 13:22:43.910388 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:43.921545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Returning 404 to user: Instance d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:43.921545 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-869648ab-9dde-4971-bd48-57de981c83c0 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3" status: 404 len: 111 microversion: 2.47 time: 0.190762 Aug 25 13:22:43.933188 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2289/4518] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:43 2022] GET /compute/v2.1/servers/d5c0cdbe-1c03-4510-9f2c-f784f4b94bb3 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:22:43.938177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ca6b5abb-651e-4a58-8faf-28d710e2638a tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:43.938542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca6b5abb-651e-4a58-8faf-28d710e2638a tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: 1b047ee5-a284-40c3-8530-00ea2ba4223d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:43.971734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca6b5abb-651e-4a58-8faf-28d710e2638a tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:43.975457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca6b5abb-651e-4a58-8faf-28d710e2638a tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:43.978427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca6b5abb-651e-4a58-8faf-28d710e2638a tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:43.991304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca6b5abb-651e-4a58-8faf-28d710e2638a tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:43.997934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca6b5abb-651e-4a58-8faf-28d710e2638a tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:44.000948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ca6b5abb-651e-4a58-8faf-28d710e2638a tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:44.159309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ca6b5abb-651e-4a58-8faf-28d710e2638a tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: 1b047ee5-a284-40c3-8530-00ea2ba4223d] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:22:44.536807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:44.541730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:44.577774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:44.588958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:44.596342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:44.607851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:44.608990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:44.611779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:44.618867 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ca6b5abb-651e-4a58-8faf-28d710e2638a tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d" status: 204 len: 0 microversion: 2.47 time: 0.693563 Aug 25 13:22:44.631928 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2230/4519] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:22:43 2022] DELETE /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:22:44.649915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:44.655434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: 1b047ee5-a284-40c3-8530-00ea2ba4223d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:44.680997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:44.688436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:44.690037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:44.691903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:44.693241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:44.695279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:45.687419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:46.345312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:46.595046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:46.634860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:46.645394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:46.651108 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-189cc196-94bb-4618-9cbb-94199c4eafe1 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d" status: 200 len: 1361 microversion: 2.47 time: 2.009879 Aug 25 13:22:46.689144 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2231/4520] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:44 2022] GET /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d => generated 1361 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:47.709388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:47.731866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: 1b047ee5-a284-40c3-8530-00ea2ba4223d] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:47.784598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:47.785575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:47.786587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:47.787997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:47.788888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:47.806579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:48.041349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:48.046678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:48.047546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:48.048399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lazy-loading 'fault' on Instance uuid 1b047ee5-a284-40c3-8530-00ea2ba4223d {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:22:49.089445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:49.132306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:49.136442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a02297dd37c4aaf970742f258298aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea8b42d7fd4c2d9475ad8c2237d1b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:49.141343 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-86a2079e-79d1-425c-8d69-37320bbf786e tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d" status: 200 len: 1366 microversion: 2.47 time: 1.442139 Aug 25 13:22:49.143901 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2232/4521] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:47 2022] GET /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d => generated 1366 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:49.564804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:49.585389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1316084196", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:49.595820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:49.622010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:49.626613 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-51ca6cd6-6090-404e-b93e-587b354dc0ab tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1552 microversion: 2.26 time: 5.108764 Aug 25 13:22:49.635656 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2290/4522] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:44 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1552 bytes in 5119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:22:49.765336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] validate_networks() for [('654ddcb2-d178-447d-a53e-fa9cabb5cdef', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:22:50.199636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:50.201579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] [instance: 1b047ee5-a284-40c3-8530-00ea2ba4223d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:50.217442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:50.220271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:50.221784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:50.223620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:50.225708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:50.227702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:50.282121 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] HTTP exception thrown: Instance 1b047ee5-a284-40c3-8530-00ea2ba4223d could not be found. Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Request method failure captured: Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d HTTP/1.1 Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3dphR67EUJFC_OB1KieFLL96LvPFcJuU81ZbDOb980vtTQ2nFl2Cmtq3BnPnHEo7V6SqMKH56MIsS-AolL_oI05Ri5R2YUnxI8lgNiBSeSRcXrAds9hjjY6zLjIavyobkx8eK5Z-vhSrZTOph33k2U_WCSaUnwJx0aQnMvJCHVYr1g Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.47 Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 9dea8b42d7fd4c2d9475ad8c2237d1b0 Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerShowV247Test-145624320 Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9dea8b42d7fd4c2d9475ad8c2237d1b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9dea8b42d7fd4c2d9475ad8c2237d1b0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9dea8b42d7fd4c2d9475ad8c2237d1b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9dea8b42d7fd4c2d9475ad8c2237d1b0"}]}] Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerShowV247Test-145624320 Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 9dea8b42d7fd4c2d9475ad8c2237d1b0 Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerShowV247Test-145624320 Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerShowV247Test-145624320-project Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1a02297dd37c4aaf970742f258298aac Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerShowV247Test-145624320-project Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 1b047ee5-a284-40c3-8530-00ea2ba4223d could not be found. Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '1b047ee5-a284-40c3-8530-00ea2ba4223d'} Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b047ee5-a284-40c3-8530-00ea2ba4223d could not be found. Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b047ee5-a284-40c3-8530-00ea2ba4223d could not be found. Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:50.286003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:50.301059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:50.301059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:50.301059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:50.301059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:22:50.301059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:22:50.301059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b047ee5-a284-40c3-8530-00ea2ba4223d could not be found. Aug 25 13:22:50.301059 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:50.304306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] Returning 404 to user: Instance 1b047ee5-a284-40c3-8530-00ea2ba4223d could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:50.307246 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-936b77ca-7943-43dc-b698-a9f2fc18e0e9 tempest-ServerShowV247Test-145624320 tempest-ServerShowV247Test-145624320-project] 10.222.0.70 "GET /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d" status: 404 len: 111 microversion: 2.47 time: 0.116876 Aug 25 13:22:50.309430 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2291/4523] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:50 2022] GET /compute/v2.1/servers/1b047ee5-a284-40c3-8530-00ea2ba4223d => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 25 13:22:50.657152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-cc498b71-0d8f-45c3-adab-f2d92c385521 req-e0028fd2-97e4-42f6-98b3-81e0d7978949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5", "name": "network-vif-deleted", "tag": "eab4da3f-642f-4c44-bbe9-a8c7a20d4d8a"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:50.772445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cc498b71-0d8f-45c3-adab-f2d92c385521 req-e0028fd2-97e4-42f6-98b3-81e0d7978949 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:50.773080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cc498b71-0d8f-45c3-adab-f2d92c385521 req-e0028fd2-97e4-42f6-98b3-81e0d7978949 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:50.774868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cc498b71-0d8f-45c3-adab-f2d92c385521 req-e0028fd2-97e4-42f6-98b3-81e0d7978949 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:50.869446 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-cc498b71-0d8f-45c3-adab-f2d92c385521 req-e0028fd2-97e4-42f6-98b3-81e0d7978949 service nova] Creating event network-vif-deleted:eab4da3f-642f-4c44-bbe9-a8c7a20d4d8a for instance 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 on n-h1-852771-8 Aug 25 13:22:50.939875 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-cc498b71-0d8f-45c3-adab-f2d92c385521 req-e0028fd2-97e4-42f6-98b3-81e0d7978949 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299951 Aug 25 13:22:50.953004 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2292/4524] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:22:50.980543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:50.984485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:51.017707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:51.022144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:51.023113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:51.025403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:51.026381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:51.029106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:51.331769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:51.377559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:51.383232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f9f71f1609845588d56fe81c2db360e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0432b6cc2b4e35815bf6d5446e9a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:51.390918 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cde87a15-a653-4cc7-a765-e3e8d528c1e4 tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 200 len: 1347 microversion: 2.26 time: 0.426602 Aug 25 13:22:51.392594 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2293/4525] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:50 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 1347 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:22:52.270773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:22:52.272724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:22:52.275421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:22:52.278702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:22:52.281321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:22:52.304817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:52.308308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:52.310348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:52.312470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:52.313855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:52.315192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:52.339818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:52.367316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Getting quotas for project dec483f5c53b44c1a52917920b891b9c. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:22:52.386350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Getting quotas for user 1552e098ea6f4d28abd9606fe9433000 and project dec483f5c53b44c1a52917920b891b9c. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:22:52.421024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:22:52.428090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:22:52.441891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:52.443119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] [instance: 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:52.479679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:52.480511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:52.481360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:52.484415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:52.485314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:52.491872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:52.562196 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] HTTP exception thrown: Instance 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 could not be found. Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Request method failure captured: Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 HTTP/1.1 Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3d3plhTvrNlK64GXBnEwUF0XEMpiWshP-fA_ga4EILLY0I_vfpIPOxd8eqZah6HO7iDuFZ_ApVv0l0qU2Z4blo3nhO_BJTGLH0X79p5vFoFenJe4zVB4HpwbUnsiaFhCE3d1Pmpu-hN4sjkgDvCPHNCWrYoYwhARKBsBVprxOeQzLE Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.26 Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 6d0432b6cc2b4e35815bf6d5446e9a2c Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerTagsTestJSON-860683162 Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6d0432b6cc2b4e35815bf6d5446e9a2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6d0432b6cc2b4e35815bf6d5446e9a2c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6d0432b6cc2b4e35815bf6d5446e9a2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6d0432b6cc2b4e35815bf6d5446e9a2c"}]}] Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerTagsTestJSON-860683162 Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 6d0432b6cc2b4e35815bf6d5446e9a2c Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerTagsTestJSON-860683162 Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerTagsTestJSON-860683162-project Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 5f9f71f1609845588d56fe81c2db360e Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerTagsTestJSON-860683162-project Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 could not be found. Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5'} Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 could not be found. Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 could not be found. Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:52.569332 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:52.582568 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:52.582568 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:52.582568 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:52.582568 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:22:52.582568 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:22:52.582568 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 could not be found. Aug 25 13:22:52.582568 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:22:52.582568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] Returning 404 to user: Instance 64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:52.582568 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-75fe970a-4d48-43f0-8b15-538fe6b682fd tempest-ServerTagsTestJSON-860683162 tempest-ServerTagsTestJSON-860683162-project] 10.222.0.70 "GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5" status: 404 len: 111 microversion: 2.26 time: 0.142744 Aug 25 13:22:52.590256 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2294/4526] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:22:52 2022] GET /compute/v2.1/servers/64e5fcf2-9d89-469b-a2d7-5b6ef562bdd5 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:22:52.610628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f917eff9-6e81-40a0-907c-cf18c68fb839 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.463912 Aug 25 13:22:52.626183 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2233/4527] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:22:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:22:52.637043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-904bc310-6974-469e-8782-465261d67986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:52.673342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-904bc310-6974-469e-8782-465261d67986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:53.121425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-904bc310-6974-469e-8782-465261d67986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:53.162844 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-904bc310-6974-469e-8782-465261d67986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1222 microversion: 2.1 time: 0.534722 Aug 25 13:22:53.164698 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2295/4528] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:52 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1222 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:22:53.698208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-286148543", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:53.966843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] validate_networks() for [('654ddcb2-d178-447d-a53e-fa9cabb5cdef', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:22:59.245238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7f3d8c9-480c-406e-b2e7-215d1bc8baac tempest-ComputeTenantNetworksTest-2031991263 tempest-ComputeTenantNetworksTest-2031991263-project] Calling method '.version_select at 0x7f3a2a249700>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:00.407577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:23:00.409100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:23:00.410152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:23:00.411190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:23:00.412554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:23:00.433324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:00.434907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:00.436211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:00.438186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:00.439487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:00.440668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:00.511572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Getting quotas for project dec483f5c53b44c1a52917920b891b9c. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:23:00.530885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Getting quotas for user 1552e098ea6f4d28abd9606fe9433000 and project dec483f5c53b44c1a52917920b891b9c. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:23:00.587602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:23:00.594315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:23:00.739442 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b7f3d8c9-480c-406e-b2e7-215d1bc8baac tempest-ComputeTenantNetworksTest-2031991263 tempest-ComputeTenantNetworksTest-2031991263-project] 10.222.0.70 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.913858 Aug 25 13:23:00.752439 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2296/4529] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 13:22:58 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:23:00.794977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29030e53-59bd-4f27-a894-bf6412821476 tempest-ComputeTenantNetworksTest-2031991263 tempest-ComputeTenantNetworksTest-2031991263-project] Calling method '.version_select at 0x7f3a2a1b65e0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:00.811720 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ed8901b6-afae-4887-b082-52b509f1b57a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.125668 Aug 25 13:23:00.816709 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2234/4530] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:22:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 7133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:23:00.845195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3286cf8f-9760-45fc-adc6-3d7ba13e6c6d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:00.850365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3286cf8f-9760-45fc-adc6-3d7ba13e6c6d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:01.216149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3286cf8f-9760-45fc-adc6-3d7ba13e6c6d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:01.239927 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3286cf8f-9760-45fc-adc6-3d7ba13e6c6d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1221 microversion: 2.1 time: 0.409443 Aug 25 13:23:01.240976 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2235/4531] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:00 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1221 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:01.626841 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29030e53-59bd-4f27-a894-bf6412821476 tempest-ComputeTenantNetworksTest-2031991263 tempest-ComputeTenantNetworksTest-2031991263-project] 10.222.0.70 "GET /compute/v2.1/os-tenant-networks/ec931a1d-879a-4cfe-b6b6-d4554a5946f3" status: 200 len: 140 microversion: 2.1 time: 0.860236 Aug 25 13:23:01.641604 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2297/4532] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 13:23:00 2022] GET /compute/v2.1/os-tenant-networks/ec931a1d-879a-4cfe-b6b6-d4554a5946f3 => generated 140 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:23:02.294640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-059b4824-e1a2-47c1-99db-837c21d61948 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:02.297538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-059b4824-e1a2-47c1-99db-837c21d61948 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:02.317320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:02.323574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-059b4824-e1a2-47c1-99db-837c21d61948 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:02.344106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-059b4824-e1a2-47c1-99db-837c21d61948 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:02.345701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-059b4824-e1a2-47c1-99db-837c21d61948 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:02.348143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-059b4824-e1a2-47c1-99db-837c21d61948 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:02.349617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-059b4824-e1a2-47c1-99db-837c21d61948 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:02.351144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-059b4824-e1a2-47c1-99db-837c21d61948 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:02.713270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-059b4824-e1a2-47c1-99db-837c21d61948 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:02.769556 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-059b4824-e1a2-47c1-99db-837c21d61948 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1225 microversion: 2.1 time: 0.482896 Aug 25 13:23:02.771366 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2236/4533] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:02 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1225 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:03.818571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5e95c89-0b84-4227-834d-bda07b4fb871 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:03.822465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5e95c89-0b84-4227-834d-bda07b4fb871 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:03.841843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=76,nova_cell1:DELETE=3,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:03.843294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:03.845581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:03.880879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5e95c89-0b84-4227-834d-bda07b4fb871 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:03.883794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5e95c89-0b84-4227-834d-bda07b4fb871 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:03.884768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5e95c89-0b84-4227-834d-bda07b4fb871 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:03.885961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5e95c89-0b84-4227-834d-bda07b4fb871 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:03.886714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5e95c89-0b84-4227-834d-bda07b4fb871 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:03.887368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5e95c89-0b84-4227-834d-bda07b4fb871 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:04.230274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5e95c89-0b84-4227-834d-bda07b4fb871 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:04.257739 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5e95c89-0b84-4227-834d-bda07b4fb871 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1291 microversion: 2.1 time: 0.453274 Aug 25 13:23:04.270280 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2298/4534] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:03 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1291 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:05.311516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-811c3d56-0a68-4a49-82a9-49334b7a4da5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:05.317247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-811c3d56-0a68-4a49-82a9-49334b7a4da5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:05.356626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-811c3d56-0a68-4a49-82a9-49334b7a4da5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:05.357583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-811c3d56-0a68-4a49-82a9-49334b7a4da5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:05.358876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-811c3d56-0a68-4a49-82a9-49334b7a4da5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:05.360286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-811c3d56-0a68-4a49-82a9-49334b7a4da5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:05.365828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-811c3d56-0a68-4a49-82a9-49334b7a4da5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:05.366818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-811c3d56-0a68-4a49-82a9-49334b7a4da5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:05.582080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-811c3d56-0a68-4a49-82a9-49334b7a4da5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:05.619881 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-811c3d56-0a68-4a49-82a9-49334b7a4da5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1279 microversion: 2.1 time: 0.314490 Aug 25 13:23:05.623654 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2237/4535] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:05 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1279 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:06.680553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-07e0d81b-3dd9-44a9-98c0-b21423cc7f9f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:06.685114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-07e0d81b-3dd9-44a9-98c0-b21423cc7f9f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:06.703375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07e0d81b-3dd9-44a9-98c0-b21423cc7f9f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:06.706447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07e0d81b-3dd9-44a9-98c0-b21423cc7f9f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:06.707764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07e0d81b-3dd9-44a9-98c0-b21423cc7f9f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:06.712364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07e0d81b-3dd9-44a9-98c0-b21423cc7f9f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:06.713972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07e0d81b-3dd9-44a9-98c0-b21423cc7f9f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:06.715372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07e0d81b-3dd9-44a9-98c0-b21423cc7f9f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:06.958588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-07e0d81b-3dd9-44a9-98c0-b21423cc7f9f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:07.010478 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-07e0d81b-3dd9-44a9-98c0-b21423cc7f9f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1279 microversion: 2.1 time: 0.348098 Aug 25 13:23:07.024844 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2299/4536] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:06 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1279 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:08.118423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df238eb3-7568-4dcb-a298-c4c79b94f28d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:08.123078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df238eb3-7568-4dcb-a298-c4c79b94f28d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:08.174373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df238eb3-7568-4dcb-a298-c4c79b94f28d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:08.176210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df238eb3-7568-4dcb-a298-c4c79b94f28d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:08.187487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df238eb3-7568-4dcb-a298-c4c79b94f28d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:08.191577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df238eb3-7568-4dcb-a298-c4c79b94f28d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:08.193210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df238eb3-7568-4dcb-a298-c4c79b94f28d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:08.194427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df238eb3-7568-4dcb-a298-c4c79b94f28d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:08.845617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df238eb3-7568-4dcb-a298-c4c79b94f28d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:08.863348 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df238eb3-7568-4dcb-a298-c4c79b94f28d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1279 microversion: 2.1 time: 0.804142 Aug 25 13:23:08.874324 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2238/4537] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:08 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1279 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:09.088811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c192bf96-ec04-4927-88c3-fe485307e88d req-18419e23-94f0-44f9-923a-cfaeb78a06b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8", "tag": "cb3c2149-2c1f-4d29-b5ee-72b8a1da7771"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:09.151386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c192bf96-ec04-4927-88c3-fe485307e88d req-18419e23-94f0-44f9-923a-cfaeb78a06b1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:09.152289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c192bf96-ec04-4927-88c3-fe485307e88d req-18419e23-94f0-44f9-923a-cfaeb78a06b1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:09.153111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c192bf96-ec04-4927-88c3-fe485307e88d req-18419e23-94f0-44f9-923a-cfaeb78a06b1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:09.218027 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c192bf96-ec04-4927-88c3-fe485307e88d req-18419e23-94f0-44f9-923a-cfaeb78a06b1 service nova] Creating event network-changed:cb3c2149-2c1f-4d29-b5ee-72b8a1da7771 for instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 on n-h1-852771-8 Aug 25 13:23:09.238567 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c192bf96-ec04-4927-88c3-fe485307e88d req-18419e23-94f0-44f9-923a-cfaeb78a06b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153341 Aug 25 13:23:09.240260 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2300/4538] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:23:09.902709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4d0cce2-b774-47e8-ac6f-d4161058cdef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:09.904551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4d0cce2-b774-47e8-ac6f-d4161058cdef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:09.938951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4d0cce2-b774-47e8-ac6f-d4161058cdef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:09.943825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4d0cce2-b774-47e8-ac6f-d4161058cdef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:09.945274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4d0cce2-b774-47e8-ac6f-d4161058cdef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:09.953122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4d0cce2-b774-47e8-ac6f-d4161058cdef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:09.955375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4d0cce2-b774-47e8-ac6f-d4161058cdef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:09.958279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4d0cce2-b774-47e8-ac6f-d4161058cdef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:10.480888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:11.248253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=14 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:11.277882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d4d0cce2-b774-47e8-ac6f-d4161058cdef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:11.311527 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4d0cce2-b774-47e8-ac6f-d4161058cdef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1321 microversion: 2.1 time: 1.412246 Aug 25 13:23:11.314106 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2239/4539] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:09 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1321 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:12.391825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-24318c5c-9099-43af-8c18-3e6c383fd591 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:12.393270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-24318c5c-9099-43af-8c18-3e6c383fd591 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:12.423165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24318c5c-9099-43af-8c18-3e6c383fd591 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:12.424416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24318c5c-9099-43af-8c18-3e6c383fd591 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:12.425174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24318c5c-9099-43af-8c18-3e6c383fd591 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:12.426572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24318c5c-9099-43af-8c18-3e6c383fd591 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:12.427599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24318c5c-9099-43af-8c18-3e6c383fd591 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:12.429202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24318c5c-9099-43af-8c18-3e6c383fd591 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:13.844372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-49e552de-4f9e-48a1-8f1f-bd891e426ddf req-27ec6963-d6e6-42b2-9f5f-d6988f5b62ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cdaf78-d5c5-415d-a121-b722db7b5bf5", "tag": "4f4ea4aa-c8a1-4675-a961-524e2eed20dc"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:13.876130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-49e552de-4f9e-48a1-8f1f-bd891e426ddf req-27ec6963-d6e6-42b2-9f5f-d6988f5b62ea service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:13.876734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-49e552de-4f9e-48a1-8f1f-bd891e426ddf req-27ec6963-d6e6-42b2-9f5f-d6988f5b62ea service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:13.877260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-49e552de-4f9e-48a1-8f1f-bd891e426ddf req-27ec6963-d6e6-42b2-9f5f-d6988f5b62ea service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:13.904997 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-49e552de-4f9e-48a1-8f1f-bd891e426ddf req-27ec6963-d6e6-42b2-9f5f-d6988f5b62ea service nova] Creating event network-changed:4f4ea4aa-c8a1-4675-a961-524e2eed20dc for instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 on n-h2-852771-8 Aug 25 13:23:13.932454 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-49e552de-4f9e-48a1-8f1f-bd891e426ddf req-27ec6963-d6e6-42b2-9f5f-d6988f5b62ea service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.855651 Aug 25 13:23:13.936184 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2240/4540] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:23:14.441380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-24318c5c-9099-43af-8c18-3e6c383fd591 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:14.478133 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-24318c5c-9099-43af-8c18-3e6c383fd591 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1321 microversion: 2.1 time: 2.126982 Aug 25 13:23:14.501138 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2301/4541] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:12 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1321 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:15.555905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-85a979ed-a2b0-42a8-9e7f-e96b71e9d2c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:15.557088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-85a979ed-a2b0-42a8-9e7f-e96b71e9d2c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:15.597395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85a979ed-a2b0-42a8-9e7f-e96b71e9d2c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:15.598887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85a979ed-a2b0-42a8-9e7f-e96b71e9d2c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:15.600095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85a979ed-a2b0-42a8-9e7f-e96b71e9d2c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:15.603479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85a979ed-a2b0-42a8-9e7f-e96b71e9d2c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:15.605083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85a979ed-a2b0-42a8-9e7f-e96b71e9d2c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:15.606454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85a979ed-a2b0-42a8-9e7f-e96b71e9d2c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:16.211108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-85a979ed-a2b0-42a8-9e7f-e96b71e9d2c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:16.230597 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-85a979ed-a2b0-42a8-9e7f-e96b71e9d2c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1321 microversion: 2.1 time: 0.683652 Aug 25 13:23:16.246888 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2241/4542] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:15 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1321 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:17.271955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-908c582d-c408-4c25-b913-41a3b2667ae2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:17.273254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-908c582d-c408-4c25-b913-41a3b2667ae2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:17.292583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-908c582d-c408-4c25-b913-41a3b2667ae2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:17.293902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-908c582d-c408-4c25-b913-41a3b2667ae2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:17.295029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-908c582d-c408-4c25-b913-41a3b2667ae2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:17.296645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-908c582d-c408-4c25-b913-41a3b2667ae2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:17.297864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-908c582d-c408-4c25-b913-41a3b2667ae2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:17.298901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-908c582d-c408-4c25-b913-41a3b2667ae2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:17.895865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-908c582d-c408-4c25-b913-41a3b2667ae2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:17.954648 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-908c582d-c408-4c25-b913-41a3b2667ae2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1321 microversion: 2.1 time: 0.690342 Aug 25 13:23:17.955818 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2302/4543] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:17 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1321 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:18.994567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9584513c-0c11-4e60-a001-c201a73177ec tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:18.999265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9584513c-0c11-4e60-a001-c201a73177ec tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:19.026179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9584513c-0c11-4e60-a001-c201a73177ec tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:19.027018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9584513c-0c11-4e60-a001-c201a73177ec tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:19.027666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9584513c-0c11-4e60-a001-c201a73177ec tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:19.028757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9584513c-0c11-4e60-a001-c201a73177ec tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:19.029838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9584513c-0c11-4e60-a001-c201a73177ec tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:19.030472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9584513c-0c11-4e60-a001-c201a73177ec tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:19.937399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9584513c-0c11-4e60-a001-c201a73177ec tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:19.981480 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9584513c-0c11-4e60-a001-c201a73177ec tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1321 microversion: 2.1 time: 0.992405 Aug 25 13:23:19.986145 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2242/4544] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:18 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1321 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:21.032782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7fbdb870-a7a7-47e8-ad2b-f736d40ec5a1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:21.039863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7fbdb870-a7a7-47e8-ad2b-f736d40ec5a1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:21.071502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fbdb870-a7a7-47e8-ad2b-f736d40ec5a1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:21.074567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fbdb870-a7a7-47e8-ad2b-f736d40ec5a1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:21.075542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fbdb870-a7a7-47e8-ad2b-f736d40ec5a1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:21.077328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fbdb870-a7a7-47e8-ad2b-f736d40ec5a1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:21.077826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fbdb870-a7a7-47e8-ad2b-f736d40ec5a1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:21.078671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fbdb870-a7a7-47e8-ad2b-f736d40ec5a1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:21.815911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9254a1bc-f3c2-419a-ad53-9d449acbc625 req-3df8e718-af59-4ae5-a845-d9c38c25ee1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8", "name": "network-vif-plugged", "status": "completed", "tag": "cb3c2149-2c1f-4d29-b5ee-72b8a1da7771"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:21.897160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9254a1bc-f3c2-419a-ad53-9d449acbc625 req-3df8e718-af59-4ae5-a845-d9c38c25ee1a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:21.900531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9254a1bc-f3c2-419a-ad53-9d449acbc625 req-3df8e718-af59-4ae5-a845-d9c38c25ee1a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:21.903287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9254a1bc-f3c2-419a-ad53-9d449acbc625 req-3df8e718-af59-4ae5-a845-d9c38c25ee1a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:21.940035 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9254a1bc-f3c2-419a-ad53-9d449acbc625 req-3df8e718-af59-4ae5-a845-d9c38c25ee1a service nova] Creating event network-vif-plugged:cb3c2149-2c1f-4d29-b5ee-72b8a1da7771 for instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 on n-h1-852771-8 Aug 25 13:23:21.994525 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9254a1bc-f3c2-419a-ad53-9d449acbc625 req-3df8e718-af59-4ae5-a845-d9c38c25ee1a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146912 Aug 25 13:23:22.000974 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2243/4545] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:23:22.532306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7fbdb870-a7a7-47e8-ad2b-f736d40ec5a1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:22.570713 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7fbdb870-a7a7-47e8-ad2b-f736d40ec5a1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1321 microversion: 2.1 time: 1.547773 Aug 25 13:23:22.594836 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2303/4546] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:21 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1321 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:22.751742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9254a1bc-f3c2-419a-ad53-9d449acbc625 req-3df8e718-af59-4ae5-a845-d9c38c25ee1a service nova] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:22.753919 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9254a1bc-f3c2-419a-ad53-9d449acbc625 req-3df8e718-af59-4ae5-a845-d9c38c25ee1a service nova] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002457 Aug 25 13:23:22.755115 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2244/4547] 10.222.0.70 () {56 vars in 886 bytes} [Thu Aug 25 13:23:22 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 25 13:23:23.627140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1775f8b3-b96d-491f-964f-ee55443ba176 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:23.636177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1775f8b3-b96d-491f-964f-ee55443ba176 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:23.707052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1775f8b3-b96d-491f-964f-ee55443ba176 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:23.708043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1775f8b3-b96d-491f-964f-ee55443ba176 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:23.708737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1775f8b3-b96d-491f-964f-ee55443ba176 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:23.710573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1775f8b3-b96d-491f-964f-ee55443ba176 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:23.711421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1775f8b3-b96d-491f-964f-ee55443ba176 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:23.712212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1775f8b3-b96d-491f-964f-ee55443ba176 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:24.322878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1775f8b3-b96d-491f-964f-ee55443ba176 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:24.358657 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1775f8b3-b96d-491f-964f-ee55443ba176 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1321 microversion: 2.1 time: 0.746524 Aug 25 13:23:24.364179 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2304/4548] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:23 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1321 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:25.056455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a0d06257-31dc-424e-a3a4-88a4d03d1345 req-2442dd2f-5e15-4bbf-9840-28d00e9ef428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cdaf78-d5c5-415d-a121-b722db7b5bf5", "name": "network-vif-plugged", "status": "completed", "tag": "4f4ea4aa-c8a1-4675-a961-524e2eed20dc"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:25.088937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a0d06257-31dc-424e-a3a4-88a4d03d1345 req-2442dd2f-5e15-4bbf-9840-28d00e9ef428 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:25.090255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a0d06257-31dc-424e-a3a4-88a4d03d1345 req-2442dd2f-5e15-4bbf-9840-28d00e9ef428 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:25.092006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a0d06257-31dc-424e-a3a4-88a4d03d1345 req-2442dd2f-5e15-4bbf-9840-28d00e9ef428 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:25.111489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=43 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:25.143684 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a0d06257-31dc-424e-a3a4-88a4d03d1345 req-2442dd2f-5e15-4bbf-9840-28d00e9ef428 service nova] Creating event network-vif-plugged:4f4ea4aa-c8a1-4675-a961-524e2eed20dc for instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 on n-h2-852771-8 Aug 25 13:23:25.157862 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a0d06257-31dc-424e-a3a4-88a4d03d1345 req-2442dd2f-5e15-4bbf-9840-28d00e9ef428 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122395 Aug 25 13:23:25.161089 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2245/4549] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:23:25.410091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fcb8440a-61f2-4af9-8800-cb71342f0bb9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:25.411290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fcb8440a-61f2-4af9-8800-cb71342f0bb9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:25.455662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb8440a-61f2-4af9-8800-cb71342f0bb9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:25.457874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb8440a-61f2-4af9-8800-cb71342f0bb9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:25.458838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb8440a-61f2-4af9-8800-cb71342f0bb9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:25.460839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb8440a-61f2-4af9-8800-cb71342f0bb9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:25.461717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb8440a-61f2-4af9-8800-cb71342f0bb9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:25.462521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcb8440a-61f2-4af9-8800-cb71342f0bb9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:26.265152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fcb8440a-61f2-4af9-8800-cb71342f0bb9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:26.296227 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fcb8440a-61f2-4af9-8800-cb71342f0bb9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1321 microversion: 2.1 time: 0.893890 Aug 25 13:23:26.297272 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2305/4550] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:25 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1321 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:27.361336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ba3b43f6-37fb-4f57-ae55-2e1c42b3931b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:27.364718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ba3b43f6-37fb-4f57-ae55-2e1c42b3931b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:27.411524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba3b43f6-37fb-4f57-ae55-2e1c42b3931b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:27.417607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba3b43f6-37fb-4f57-ae55-2e1c42b3931b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:27.423070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba3b43f6-37fb-4f57-ae55-2e1c42b3931b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:27.426755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba3b43f6-37fb-4f57-ae55-2e1c42b3931b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:27.433077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba3b43f6-37fb-4f57-ae55-2e1c42b3931b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:27.434574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba3b43f6-37fb-4f57-ae55-2e1c42b3931b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:28.509884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ba3b43f6-37fb-4f57-ae55-2e1c42b3931b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:28.536736 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ba3b43f6-37fb-4f57-ae55-2e1c42b3931b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1514 microversion: 2.1 time: 1.197224 Aug 25 13:23:28.539712 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2246/4551] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:27 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1514 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:28.611904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f4cdb253-3002-4624-98e2-204375c5640b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:28.623646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f4cdb253-3002-4624-98e2-204375c5640b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:28.660260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4cdb253-3002-4624-98e2-204375c5640b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:28.661184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4cdb253-3002-4624-98e2-204375c5640b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:28.662098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4cdb253-3002-4624-98e2-204375c5640b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:28.671043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4cdb253-3002-4624-98e2-204375c5640b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:28.687210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4cdb253-3002-4624-98e2-204375c5640b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:28.688173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4cdb253-3002-4624-98e2-204375c5640b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:28.824367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-f4cdb253-3002-4624-98e2-204375c5640b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lazy-loading 'flavor' on Instance uuid 93cdaf78-d5c5-415d-a121-b722db7b5bf5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:23:29.173422 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f4cdb253-3002-4624-98e2-204375c5640b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5/action" status: 200 len: 32 microversion: 2.1 time: 0.593108 Aug 25 13:23:29.185899 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2306/4552] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:23:28 2022] POST /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5/action => generated 32 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 13:23:29.191482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eed3a7d3-580d-4c3e-9f98-51f4ac7007cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:29.192750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eed3a7d3-580d-4c3e-9f98-51f4ac7007cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:29.232448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed3a7d3-580d-4c3e-9f98-51f4ac7007cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:29.233462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed3a7d3-580d-4c3e-9f98-51f4ac7007cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:29.234353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed3a7d3-580d-4c3e-9f98-51f4ac7007cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:29.239979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed3a7d3-580d-4c3e-9f98-51f4ac7007cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:29.245154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed3a7d3-580d-4c3e-9f98-51f4ac7007cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:29.246563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed3a7d3-580d-4c3e-9f98-51f4ac7007cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:29.886917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eed3a7d3-580d-4c3e-9f98-51f4ac7007cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:29.914495 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eed3a7d3-580d-4c3e-9f98-51f4ac7007cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 0.728166 Aug 25 13:23:29.926667 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2247/4553] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:29 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:30.963756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c60efc26-4392-4189-b4ee-2a719015aa0e tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:30.967887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c60efc26-4392-4189-b4ee-2a719015aa0e tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:30.993179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60efc26-4392-4189-b4ee-2a719015aa0e tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:31.001904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60efc26-4392-4189-b4ee-2a719015aa0e tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:31.003695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60efc26-4392-4189-b4ee-2a719015aa0e tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:31.010197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60efc26-4392-4189-b4ee-2a719015aa0e tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:31.013078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60efc26-4392-4189-b4ee-2a719015aa0e tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:31.017004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60efc26-4392-4189-b4ee-2a719015aa0e tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:31.351812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-94aa2067-202a-4b2c-9a45-f6277521832c tempest-QuotasTestJSON-1992337340 tempest-QuotasTestJSON-1992337340-project] Calling method '.version_select at 0x7f3a29b83a60>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:31.789976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c60efc26-4392-4189-b4ee-2a719015aa0e tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:31.839764 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c60efc26-4392-4189-b4ee-2a719015aa0e tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 0.871781 Aug 25 13:23:31.876736 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2248/4554] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:30 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:32.246473 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-94aa2067-202a-4b2c-9a45-f6277521832c tempest-QuotasTestJSON-1992337340 tempest-QuotasTestJSON-1992337340-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/eb3d0a15587d4ffb932b90edf85433c5/defaults" status: 200 len: 371 microversion: 2.1 time: 1.335568 Aug 25 13:23:32.268570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-130958e0-e468-4579-9940-9cfd1c5ecf31 tempest-QuotasTestJSON-1992337340 tempest-QuotasTestJSON-1992337340-project] Calling method '.version_select at 0x7f3a2a207f70>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:32.274417 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2307/4555] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 13:23:30 2022] GET /compute/v2.1/os-quota-sets/eb3d0a15587d4ffb932b90edf85433c5/defaults => generated 371 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:23:32.911321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad9fb39a-cdb2-4867-b6ac-c7eae76f7b9c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:32.934671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad9fb39a-cdb2-4867-b6ac-c7eae76f7b9c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:32.978516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=24 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:32.982514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad9fb39a-cdb2-4867-b6ac-c7eae76f7b9c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:32.983590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad9fb39a-cdb2-4867-b6ac-c7eae76f7b9c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:32.984340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad9fb39a-cdb2-4867-b6ac-c7eae76f7b9c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:32.985804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad9fb39a-cdb2-4867-b6ac-c7eae76f7b9c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:32.986652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad9fb39a-cdb2-4867-b6ac-c7eae76f7b9c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:32.987413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad9fb39a-cdb2-4867-b6ac-c7eae76f7b9c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:33.026963 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-130958e0-e468-4579-9940-9cfd1c5ecf31 tempest-QuotasTestJSON-1992337340 tempest-QuotasTestJSON-1992337340-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/eb3d0a15587d4ffb932b90edf85433c5" status: 200 len: 371 microversion: 2.1 time: 0.765401 Aug 25 13:23:33.029106 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2249/4556] 10.222.0.70 () {58 vars in 1242 bytes} [Thu Aug 25 13:23:32 2022] GET /compute/v2.1/os-quota-sets/eb3d0a15587d4ffb932b90edf85433c5 => generated 371 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:23:33.065330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2659d48e-b09b-44bb-bcd3-ecb74e774797 tempest-QuotasTestJSON-1992337340 tempest-QuotasTestJSON-1992337340-project] Calling method '.version_select at 0x7f3a2e7b38b0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:33.334875 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2659d48e-b09b-44bb-bcd3-ecb74e774797 tempest-QuotasTestJSON-1992337340 tempest-QuotasTestJSON-1992337340-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/eb3d0a15587d4ffb932b90edf85433c5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.276163 Aug 25 13:23:33.336897 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2250/4557] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 13:23:33 2022] GET /compute/v2.1/os-quota-sets/eb3d0a15587d4ffb932b90edf85433c5/defaults => generated 371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:23:33.371403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a28e5486-d314-4aca-85a4-e34ca9b3c3e2 tempest-QuotasTestJSON-1992337340 tempest-QuotasTestJSON-1992337340-project] Calling method '.version_select at 0x7f3a2a447ee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:33.642898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ad9fb39a-cdb2-4867-b6ac-c7eae76f7b9c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:33.684229 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad9fb39a-cdb2-4867-b6ac-c7eae76f7b9c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 0.800298 Aug 25 13:23:33.688107 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2308/4558] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:32 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:33.694674 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a28e5486-d314-4aca-85a4-e34ca9b3c3e2 tempest-QuotasTestJSON-1992337340 tempest-QuotasTestJSON-1992337340-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/eb3d0a15587d4ffb932b90edf85433c5" status: 200 len: 371 microversion: 2.1 time: 0.337989 Aug 25 13:23:33.709945 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2251/4559] 10.222.0.70 () {58 vars in 1242 bytes} [Thu Aug 25 13:23:33 2022] GET /compute/v2.1/os-quota-sets/eb3d0a15587d4ffb932b90edf85433c5 => generated 371 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:23:33.734320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9bef3343-a35a-4d23-810a-1c7bbdfcf918 tempest-QuotasTestJSON-1992337340 tempest-QuotasTestJSON-1992337340-project] Calling method '.version_select at 0x7f3a2a2490d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:34.360023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ab8584f7-093e-4f1f-828c-2ea76937eefe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Action: 'create', calling method: .version_select at 0x7f3a2a3ef280>, body: {"keypair": {"name": "tempest-keypair-1284137577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc5r109TGEE9Y72+U2iOQv0A7O6K/XrGIM1oNez6wXKJpwXraAp3Aa9vNMn/za24z8ljLBxhmbdOUweyEH9O+jkEJAKQ2F00qr64KTiPz0kpmxhx19FZRFBfx7jbmxxBw=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:34.445046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ab8584f7-093e-4f1f-828c-2ea76937eefe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Getting quotas for project 37ec962b7eb948ffa6ba84d7571087c4. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:23:34.465193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ab8584f7-093e-4f1f-828c-2ea76937eefe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Getting quotas for user b008e1fc747f4b928cac286f7c74d0cf and project 37ec962b7eb948ffa6ba84d7571087c4. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:23:34.545398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=23 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:34.575953 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ab8584f7-093e-4f1f-828c-2ea76937eefe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.439040 Aug 25 13:23:34.577525 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2252/4560] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Aug 25 13:23:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 442 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 25 13:23:34.728755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1c8ae4ab-b686-473d-a9c2-77bc8b6cf64b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:34.734631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1c8ae4ab-b686-473d-a9c2-77bc8b6cf64b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:34.764641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c8ae4ab-b686-473d-a9c2-77bc8b6cf64b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:34.764921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c8ae4ab-b686-473d-a9c2-77bc8b6cf64b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:34.766583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c8ae4ab-b686-473d-a9c2-77bc8b6cf64b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:34.774893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c8ae4ab-b686-473d-a9c2-77bc8b6cf64b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:34.775528 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9bef3343-a35a-4d23-810a-1c7bbdfcf918 tempest-QuotasTestJSON-1992337340 tempest-QuotasTestJSON-1992337340-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/eb3d0a15587d4ffb932b90edf85433c5?user_id=41ae0e0040f0432e87f46288543fa627" status: 200 len: 371 microversion: 2.1 time: 1.032421 Aug 25 13:23:34.776487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c8ae4ab-b686-473d-a9c2-77bc8b6cf64b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:34.779302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c8ae4ab-b686-473d-a9c2-77bc8b6cf64b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:34.783119 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2309/4561] 10.222.0.70 () {58 vars in 1323 bytes} [Thu Aug 25 13:23:33 2022] GET /compute/v2.1/os-quota-sets/eb3d0a15587d4ffb932b90edf85433c5?user_id=41ae0e0040f0432e87f46288543fa627 => generated 371 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:23:35.975104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1c8ae4ab-b686-473d-a9c2-77bc8b6cf64b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:36.007096 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1c8ae4ab-b686-473d-a9c2-77bc8b6cf64b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 1.283747 Aug 25 13:23:36.014120 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2253/4562] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:34 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:37.054506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fd129784-236c-4ab4-a589-125190b3b088 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:37.057142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fd129784-236c-4ab4-a589-125190b3b088 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:37.090244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd129784-236c-4ab4-a589-125190b3b088 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:37.093306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd129784-236c-4ab4-a589-125190b3b088 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:37.096113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd129784-236c-4ab4-a589-125190b3b088 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:37.101688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd129784-236c-4ab4-a589-125190b3b088 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:37.102734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd129784-236c-4ab4-a589-125190b3b088 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:37.103436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd129784-236c-4ab4-a589-125190b3b088 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:37.200688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:37.725145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fd129784-236c-4ab4-a589-125190b3b088 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:37.754853 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fd129784-236c-4ab4-a589-125190b3b088 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 0.710952 Aug 25 13:23:37.755791 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2310/4563] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:37 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:38.811132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff53b935-9abc-42bd-bb2b-ede8f216dfd0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:38.813488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ff53b935-9abc-42bd-bb2b-ede8f216dfd0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:38.870785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff53b935-9abc-42bd-bb2b-ede8f216dfd0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:38.872331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff53b935-9abc-42bd-bb2b-ede8f216dfd0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:38.875847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff53b935-9abc-42bd-bb2b-ede8f216dfd0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:38.877962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff53b935-9abc-42bd-bb2b-ede8f216dfd0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:38.879175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff53b935-9abc-42bd-bb2b-ede8f216dfd0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:38.881421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff53b935-9abc-42bd-bb2b-ede8f216dfd0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:40.028635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ff53b935-9abc-42bd-bb2b-ede8f216dfd0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:40.048343 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff53b935-9abc-42bd-bb2b-ede8f216dfd0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 1.247178 Aug 25 13:23:40.052986 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2254/4564] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:38 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:41.113540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-78fa7164-10ac-41ca-9c36-9dcb4b32f986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:41.121151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-78fa7164-10ac-41ca-9c36-9dcb4b32f986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:41.163500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78fa7164-10ac-41ca-9c36-9dcb4b32f986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:41.167394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78fa7164-10ac-41ca-9c36-9dcb4b32f986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:41.169768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78fa7164-10ac-41ca-9c36-9dcb4b32f986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:41.174406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78fa7164-10ac-41ca-9c36-9dcb4b32f986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:41.176300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78fa7164-10ac-41ca-9c36-9dcb4b32f986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:41.184483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78fa7164-10ac-41ca-9c36-9dcb4b32f986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:41.901534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-78fa7164-10ac-41ca-9c36-9dcb4b32f986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:41.942806 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-78fa7164-10ac-41ca-9c36-9dcb4b32f986 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 0.844326 Aug 25 13:23:41.972555 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2311/4565] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:41 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:43.004337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d9c69377-e551-47b3-9cab-4d77cd45ead9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:43.009931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d9c69377-e551-47b3-9cab-4d77cd45ead9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:43.062787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9c69377-e551-47b3-9cab-4d77cd45ead9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:43.073219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9c69377-e551-47b3-9cab-4d77cd45ead9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:43.076555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9c69377-e551-47b3-9cab-4d77cd45ead9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:43.081325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9c69377-e551-47b3-9cab-4d77cd45ead9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:43.086986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9c69377-e551-47b3-9cab-4d77cd45ead9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:43.091031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9c69377-e551-47b3-9cab-4d77cd45ead9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:44.496845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:45.132058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d9c69377-e551-47b3-9cab-4d77cd45ead9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:45.175714 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d9c69377-e551-47b3-9cab-4d77cd45ead9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 2.180589 Aug 25 13:23:45.213583 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2255/4566] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:42 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:46.230848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a31714b-dd81-428b-86a8-1e431d3ee078 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:46.248892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2a31714b-dd81-428b-86a8-1e431d3ee078 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:46.275835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:46.284610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a31714b-dd81-428b-86a8-1e431d3ee078 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:46.286489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a31714b-dd81-428b-86a8-1e431d3ee078 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:46.289974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a31714b-dd81-428b-86a8-1e431d3ee078 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:46.294917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a31714b-dd81-428b-86a8-1e431d3ee078 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:46.296297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a31714b-dd81-428b-86a8-1e431d3ee078 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:46.300050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a31714b-dd81-428b-86a8-1e431d3ee078 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:48.322699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-290821378", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bd88387-b4d9-4117-809d-b1796b284ea6"}], "security_groups": [{"name": "tempest-securitygroup--1233181393"}], "key_name": "tempest-keypair-1284137577", "user_data": "}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:49.133731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a31714b-dd81-428b-86a8-1e431d3ee078 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:49.181435 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a31714b-dd81-428b-86a8-1e431d3ee078 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 2.964183 Aug 25 13:23:49.195371 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2312/4567] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:46 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 2980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:49.256126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] validate_networks() for [('4bd88387-b4d9-4117-809d-b1796b284ea6', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:23:50.241269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1ccddbf-4741-44f7-8432-21b8f77eff95 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:50.259500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c1ccddbf-4741-44f7-8432-21b8f77eff95 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:50.294363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1ccddbf-4741-44f7-8432-21b8f77eff95 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:50.296206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1ccddbf-4741-44f7-8432-21b8f77eff95 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:50.297561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1ccddbf-4741-44f7-8432-21b8f77eff95 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:50.300182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1ccddbf-4741-44f7-8432-21b8f77eff95 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:50.302434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1ccddbf-4741-44f7-8432-21b8f77eff95 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:50.304776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1ccddbf-4741-44f7-8432-21b8f77eff95 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:51.518727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:23:51.519751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:23:51.521913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:23:51.528031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:23:51.529421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:23:51.584647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:51.591300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:51.596609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:51.601636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:51.605998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:51.607501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:51.669907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c1ccddbf-4741-44f7-8432-21b8f77eff95 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:51.703270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Getting quotas for project 37ec962b7eb948ffa6ba84d7571087c4. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:23:51.706046 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c1ccddbf-4741-44f7-8432-21b8f77eff95 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 1.475146 Aug 25 13:23:51.729109 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2313/4568] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:50 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:51.749384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Getting quotas for user b008e1fc747f4b928cac286f7c74d0cf and project 37ec962b7eb948ffa6ba84d7571087c4. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:23:51.837929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:23:51.855016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:23:52.102012 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8a90cc91-77dc-48df-b75a-5c4a4c311b04 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.797223 Aug 25 13:23:52.104649 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2256/4569] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 13:23:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 3803 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 25 13:23:52.128936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eeeb286d-7a32-4987-9db0-c04591d46f32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:52.136852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eeeb286d-7a32-4987-9db0-c04591d46f32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:52.372793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eeeb286d-7a32-4987-9db0-c04591d46f32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:52.412813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eeeb286d-7a32-4987-9db0-c04591d46f32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:52.423328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eeeb286d-7a32-4987-9db0-c04591d46f32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:52.434234 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eeeb286d-7a32-4987-9db0-c04591d46f32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1281 microversion: 2.20 time: 0.309706 Aug 25 13:23:52.456870 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2314/4570] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:23:52 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1281 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:23:52.763651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-15e21150-981e-487c-ad89-a4d5489cd2d7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:52.767294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-15e21150-981e-487c-ad89-a4d5489cd2d7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:52.813735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15e21150-981e-487c-ad89-a4d5489cd2d7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:52.815802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15e21150-981e-487c-ad89-a4d5489cd2d7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:52.823476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15e21150-981e-487c-ad89-a4d5489cd2d7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:52.825354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15e21150-981e-487c-ad89-a4d5489cd2d7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:52.826678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15e21150-981e-487c-ad89-a4d5489cd2d7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:52.828103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-15e21150-981e-487c-ad89-a4d5489cd2d7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:53.502352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a6c47df-3420-4457-a01a-f45fcd8773a3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:53.503608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a6c47df-3420-4457-a01a-f45fcd8773a3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:53.890513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a6c47df-3420-4457-a01a-f45fcd8773a3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:53.941378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-15e21150-981e-487c-ad89-a4d5489cd2d7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:53.957359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a6c47df-3420-4457-a01a-f45fcd8773a3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:53.978667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a6c47df-3420-4457-a01a-f45fcd8773a3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:53.991438 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a6c47df-3420-4457-a01a-f45fcd8773a3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1281 microversion: 2.20 time: 0.503262 Aug 25 13:23:53.998513 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2315/4571] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:23:53 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1281 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:23:54.013989 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-15e21150-981e-487c-ad89-a4d5489cd2d7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 1.261466 Aug 25 13:23:54.020914 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2257/4572] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:52 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:55.065956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:55.071361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:55.108832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:55.113041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:55.119836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:55.121677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:55.123188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:55.131596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:55.183198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=46 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:55.385731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-787316713", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "0fc430fe-72c2-45e0-a5f2-bac853189a57"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:55.782429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] validate_networks() for [('0fc430fe-72c2-45e0-a5f2-bac853189a57', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:23:56.097998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:56.185237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:56.228134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:56.235402 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-60200329-e258-4af8-aa69-cbaa252d6f0e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1285 microversion: 2.20 time: 1.176784 Aug 25 13:23:56.239421 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2258/4573] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:23:55 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1285 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:23:56.256105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7fb97de9-d8a9-4b05-9e9e-5ee7eba556c6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:56.258006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7fb97de9-d8a9-4b05-9e9e-5ee7eba556c6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:56.285438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fb97de9-d8a9-4b05-9e9e-5ee7eba556c6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:56.288665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fb97de9-d8a9-4b05-9e9e-5ee7eba556c6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:56.295787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fb97de9-d8a9-4b05-9e9e-5ee7eba556c6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:56.297364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fb97de9-d8a9-4b05-9e9e-5ee7eba556c6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:56.306529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fb97de9-d8a9-4b05-9e9e-5ee7eba556c6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:56.307722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fb97de9-d8a9-4b05-9e9e-5ee7eba556c6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:58.003582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7fb97de9-d8a9-4b05-9e9e-5ee7eba556c6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:58.027718 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7fb97de9-d8a9-4b05-9e9e-5ee7eba556c6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 1.785048 Aug 25 13:23:58.042255 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2259/4574] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:56 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:58.086094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:58.087335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:58.107947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:58.108868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:58.109734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:58.111300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:58.112133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:58.112923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:58.552886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:58.634736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:58.668189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:58.679625 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d3cf0988-eefd-491e-a58a-18024bd98887 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1339 microversion: 2.20 time: 0.631855 Aug 25 13:23:58.688457 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2260/4575] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:23:58 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1339 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:23:59.079689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-49396739-f142-46f4-9ddc-1bdf479b3224 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:59.086091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-49396739-f142-46f4-9ddc-1bdf479b3224 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:59.111886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49396739-f142-46f4-9ddc-1bdf479b3224 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:59.122993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49396739-f142-46f4-9ddc-1bdf479b3224 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:59.124133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49396739-f142-46f4-9ddc-1bdf479b3224 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:59.130995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49396739-f142-46f4-9ddc-1bdf479b3224 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:59.132063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49396739-f142-46f4-9ddc-1bdf479b3224 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:59.139474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49396739-f142-46f4-9ddc-1bdf479b3224 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:00.384074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:24:00.385205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:24:00.386485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:24:00.391195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:24:00.392472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:24:00.444340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:00.446460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:00.452659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:00.455377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:00.458997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:00.464350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:00.560214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:24:00.587254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for user bd7b1570a27f4ea8ad560ce25225cf02 and project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:24:00.638979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-49396739-f142-46f4-9ddc-1bdf479b3224 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:00.659455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:24:00.675643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:24:00.722706 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-49396739-f142-46f4-9ddc-1bdf479b3224 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1520 microversion: 2.1 time: 1.651328 Aug 25 13:24:00.726217 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2261/4576] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:59 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1520 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:00.740953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:00.742932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:00.766250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:00.767849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:00.768973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:00.771845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:00.774450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:00.775590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:00.948926 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-be6e13de-7a77-432a-8b31-45d4f38b3217 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.120955 Aug 25 13:24:00.950156 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2316/4577] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:23:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 6124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:24:00.997817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-27f883cd-a830-41ad-95b9-e5851cf8730e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:01.006869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-27f883cd-a830-41ad-95b9-e5851cf8730e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:01.048379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:01.138250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:01.149096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:01.166990 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5138993b-5294-424a-a2b0-738e5c4a1406 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1339 microversion: 2.20 time: 0.422826 Aug 25 13:24:01.168763 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2262/4578] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:00 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1339 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:01.315766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-27f883cd-a830-41ad-95b9-e5851cf8730e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:01.350449 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-27f883cd-a830-41ad-95b9-e5851cf8730e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1192 microversion: 2.1 time: 0.381955 Aug 25 13:24:01.366454 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2317/4579] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:00 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1192 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:01.769094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3aad2196-b598-4483-a128-191c8474caa9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:01.773214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3aad2196-b598-4483-a128-191c8474caa9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:01.793667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:01.800203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:01.839439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aad2196-b598-4483-a128-191c8474caa9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:01.848774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aad2196-b598-4483-a128-191c8474caa9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:01.849177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aad2196-b598-4483-a128-191c8474caa9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:01.865894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aad2196-b598-4483-a128-191c8474caa9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:01.866760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aad2196-b598-4483-a128-191c8474caa9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:01.867502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aad2196-b598-4483-a128-191c8474caa9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:02.263955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:02.270236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:02.318424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:02.320078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:02.321317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:02.328105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:02.328105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:02.328105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:03.086333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:03.131455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:03.139604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:03.142507 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-db816132-085f-4c52-b952-f4cd05488f7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1339 microversion: 2.20 time: 0.921253 Aug 25 13:24:03.144031 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2318/4580] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:02 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1339 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:24:03.164574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-14fd495e-f6e1-4bd3-bc93-2b503b04395f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:03.179696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-14fd495e-f6e1-4bd3-bc93-2b503b04395f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:03.220637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14fd495e-f6e1-4bd3-bc93-2b503b04395f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:03.226082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14fd495e-f6e1-4bd3-bc93-2b503b04395f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:03.227434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14fd495e-f6e1-4bd3-bc93-2b503b04395f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:03.234416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14fd495e-f6e1-4bd3-bc93-2b503b04395f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:03.236137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14fd495e-f6e1-4bd3-bc93-2b503b04395f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:03.240944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14fd495e-f6e1-4bd3-bc93-2b503b04395f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:04.030888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-14fd495e-f6e1-4bd3-bc93-2b503b04395f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:04.074186 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-14fd495e-f6e1-4bd3-bc93-2b503b04395f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1188 microversion: 2.1 time: 0.922687 Aug 25 13:24:04.076297 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2319/4581] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:03 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1188 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:04.103338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3aad2196-b598-4483-a128-191c8474caa9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:04.136258 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3aad2196-b598-4483-a128-191c8474caa9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1500 microversion: 2.1 time: 2.374993 Aug 25 13:24:04.148921 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2263/4582] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:01 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1500 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:04.220396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:04.221790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:04.230325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9937bc02-662f-4387-b38c-28e2659fbeca tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:04.232060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9937bc02-662f-4387-b38c-28e2659fbeca tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:04.257462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:04.278849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:04.282150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:04.282992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:04.284400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:04.285124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:04.295008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9937bc02-662f-4387-b38c-28e2659fbeca tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:04.295917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9937bc02-662f-4387-b38c-28e2659fbeca tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:04.303889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:04.319126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9937bc02-662f-4387-b38c-28e2659fbeca tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:04.329031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9937bc02-662f-4387-b38c-28e2659fbeca tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:04.334681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9937bc02-662f-4387-b38c-28e2659fbeca tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:04.335714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9937bc02-662f-4387-b38c-28e2659fbeca tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:04.934958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:04.986190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:05.010693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:05.013769 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-266df394-30c5-40e1-8fc2-2026bad973cb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1339 microversion: 2.20 time: 0.818046 Aug 25 13:24:05.015539 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2320/4583] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:04 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1339 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:05.125606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-049820e8-1890-4f30-9142-c23cd609d392 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:05.135178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-049820e8-1890-4f30-9142-c23cd609d392 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:05.164584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:05.192551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-049820e8-1890-4f30-9142-c23cd609d392 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:05.195662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-049820e8-1890-4f30-9142-c23cd609d392 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:05.227500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-049820e8-1890-4f30-9142-c23cd609d392 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:05.232565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-049820e8-1890-4f30-9142-c23cd609d392 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:05.243966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-049820e8-1890-4f30-9142-c23cd609d392 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:05.246269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-049820e8-1890-4f30-9142-c23cd609d392 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:06.132845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-049820e8-1890-4f30-9142-c23cd609d392 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:06.172304 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-049820e8-1890-4f30-9142-c23cd609d392 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1250 microversion: 2.1 time: 1.056869 Aug 25 13:24:06.177125 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2321/4584] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:05 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1250 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:06.195341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:06.197966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:06.241268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:06.242317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:06.243197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:06.248224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:06.250747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:06.252128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:06.632686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9937bc02-662f-4387-b38c-28e2659fbeca tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:06.671557 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9937bc02-662f-4387-b38c-28e2659fbeca tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1516 microversion: 2.1 time: 2.475857 Aug 25 13:24:06.677977 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2264/4585] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:04 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1516 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:06.721762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26def617-bd4c-4ccc-a456-bdfdf7e9acf3 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:06.739067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-26def617-bd4c-4ccc-a456-bdfdf7e9acf3 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: e0903a6c-3841-4505-bf76-445d7fcad326] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:06.768411 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-26def617-bd4c-4ccc-a456-bdfdf7e9acf3 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] HTTP exception thrown: Instance e0903a6c-3841-4505-bf76-445d7fcad326 could not be found. Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26def617-bd4c-4ccc-a456-bdfdf7e9acf3 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Request method failure captured: Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/e0903a6c-3841-4505-bf76-445d7fcad326/action HTTP/1.1 Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 14 Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3emkRnp5WsySeZUDuZqp15nFuui5PAZa04O2pdW2hxZe2BKDx44fRGkIEOKF2r11CYee5GPcGik4GpsVJQCgpLsIOIpHtQH9QghePjQ_6mqWpMbkt_tywI60U5M7l4xP6lvwI3wQpC2IoBQiIktCExz3EE3vcgMbQSbvXi9LGsoCek Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dec483f5c53b44c1a52917920b891b9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}] Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1552e098ea6f4d28abd9606fe9433000 Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: {"rescue": {}} Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance e0903a6c-3841-4505-bf76-445d7fcad326 could not be found. Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'e0903a6c-3841-4505-bf76-445d7fcad326', 'body': {'rescue': {}}} Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0903a6c-3841-4505-bf76-445d7fcad326 could not be found. Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0903a6c-3841-4505-bf76-445d7fcad326 could not be found. Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:06.793750 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:06.806916 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:24:06.806916 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:24:06.806916 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:24:06.806916 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:24:06.806916 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0903a6c-3841-4505-bf76-445d7fcad326 could not be found. Aug 25 13:24:06.806916 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:06.806916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26def617-bd4c-4ccc-a456-bdfdf7e9acf3 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Returning 404 to user: Instance e0903a6c-3841-4505-bf76-445d7fcad326 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:24:06.809228 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-26def617-bd4c-4ccc-a456-bdfdf7e9acf3 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/e0903a6c-3841-4505-bf76-445d7fcad326/action" status: 404 len: 111 microversion: 2.1 time: 0.095528 Aug 25 13:24:06.810374 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2265/4586] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:24:06 2022] POST /compute/v2.1/servers/e0903a6c-3841-4505-bf76-445d7fcad326/action => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:24:06.835685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14bd33fc-8d23-4a9a-a89a-38b6546a324c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:06.841968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-14bd33fc-8d23-4a9a-a89a-38b6546a324c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:06.856995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14bd33fc-8d23-4a9a-a89a-38b6546a324c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:06.867004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14bd33fc-8d23-4a9a-a89a-38b6546a324c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:06.868722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14bd33fc-8d23-4a9a-a89a-38b6546a324c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:06.872808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14bd33fc-8d23-4a9a-a89a-38b6546a324c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:06.875768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14bd33fc-8d23-4a9a-a89a-38b6546a324c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:06.876856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14bd33fc-8d23-4a9a-a89a-38b6546a324c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:07.134706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:07.167655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:07.179038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:07.182571 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-81708761-9293-43da-bec6-6bd137f47387 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1407 microversion: 2.20 time: 1.002695 Aug 25 13:24:07.184761 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2322/4587] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:06 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1407 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:07.188443 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-14bd33fc-8d23-4a9a-a89a-38b6546a324c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action" status: 202 len: 0 microversion: 2.1 time: 0.347456 Aug 25 13:24:07.210150 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2266/4588] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:24:06 2022] POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:24:07.227336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a01f1292-79c7-464e-8f03-3bdfbcb0c96b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:07.228459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a01f1292-79c7-464e-8f03-3bdfbcb0c96b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:07.252795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f6f05a11-679b-4210-baf0-8f76c9d73685 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:07.264712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f6f05a11-679b-4210-baf0-8f76c9d73685 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:07.273958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a01f1292-79c7-464e-8f03-3bdfbcb0c96b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:07.275020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a01f1292-79c7-464e-8f03-3bdfbcb0c96b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:07.275589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a01f1292-79c7-464e-8f03-3bdfbcb0c96b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:07.289231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a01f1292-79c7-464e-8f03-3bdfbcb0c96b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:07.290949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a01f1292-79c7-464e-8f03-3bdfbcb0c96b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:07.299708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a01f1292-79c7-464e-8f03-3bdfbcb0c96b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:07.304936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6f05a11-679b-4210-baf0-8f76c9d73685 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:07.311121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6f05a11-679b-4210-baf0-8f76c9d73685 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:07.313376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6f05a11-679b-4210-baf0-8f76c9d73685 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:07.316662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=56 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:07.318034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6f05a11-679b-4210-baf0-8f76c9d73685 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:07.321194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6f05a11-679b-4210-baf0-8f76c9d73685 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:07.322137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6f05a11-679b-4210-baf0-8f76c9d73685 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:07.976288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f6f05a11-679b-4210-baf0-8f76c9d73685 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:08.005954 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f6f05a11-679b-4210-baf0-8f76c9d73685 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1250 microversion: 2.1 time: 0.781846 Aug 25 13:24:08.030845 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2267/4589] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:07 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1250 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:08.245242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:08.246361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:08.301196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:08.301196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:08.309113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:08.314817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:08.315929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:08.317703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:08.792509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a01f1292-79c7-464e-8f03-3bdfbcb0c96b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:08.842090 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a01f1292-79c7-464e-8f03-3bdfbcb0c96b tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1521 microversion: 2.1 time: 1.621920 Aug 25 13:24:08.847336 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2323/4590] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:07 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1521 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:09.070640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-438bd5b3-96ef-48ee-b027-c373ef14fead tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:09.105145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-438bd5b3-96ef-48ee-b027-c373ef14fead tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:09.151308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-438bd5b3-96ef-48ee-b027-c373ef14fead tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:09.152316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-438bd5b3-96ef-48ee-b027-c373ef14fead tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:09.152800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-438bd5b3-96ef-48ee-b027-c373ef14fead tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:09.153817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-438bd5b3-96ef-48ee-b027-c373ef14fead tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:09.154347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-438bd5b3-96ef-48ee-b027-c373ef14fead tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:09.169770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-438bd5b3-96ef-48ee-b027-c373ef14fead tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:10.153735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-438bd5b3-96ef-48ee-b027-c373ef14fead tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:10.186573 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-438bd5b3-96ef-48ee-b027-c373ef14fead tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1292 microversion: 2.1 time: 1.140858 Aug 25 13:24:10.190158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2324/4591] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:09 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1292 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:10.212656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9e91625c-f3ad-47b1-ad2a-e6bf4b7e909d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:10.221101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9e91625c-f3ad-47b1-ad2a-e6bf4b7e909d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:10.241635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e91625c-f3ad-47b1-ad2a-e6bf4b7e909d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:10.249609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e91625c-f3ad-47b1-ad2a-e6bf4b7e909d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:10.252749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e91625c-f3ad-47b1-ad2a-e6bf4b7e909d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:10.258311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e91625c-f3ad-47b1-ad2a-e6bf4b7e909d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:10.259952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e91625c-f3ad-47b1-ad2a-e6bf4b7e909d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:10.264345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e91625c-f3ad-47b1-ad2a-e6bf4b7e909d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:10.338420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:10.374528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:10.379819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:10.383754 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dfadd69e-aed4-40ac-8448-11c14c7b8261 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1407 microversion: 2.20 time: 2.163511 Aug 25 13:24:10.386399 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2268/4592] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:08 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1407 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:10.513183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:11.233490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-619a965f-8967-467e-9aa8-be5b297cd5ae tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:11.236462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-619a965f-8967-467e-9aa8-be5b297cd5ae tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:11.274962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619a965f-8967-467e-9aa8-be5b297cd5ae tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:11.275887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619a965f-8967-467e-9aa8-be5b297cd5ae tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:11.276719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619a965f-8967-467e-9aa8-be5b297cd5ae tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:11.278446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619a965f-8967-467e-9aa8-be5b297cd5ae tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:11.287043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619a965f-8967-467e-9aa8-be5b297cd5ae tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:11.288389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619a965f-8967-467e-9aa8-be5b297cd5ae tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:11.345839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=12 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:11.739676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9e91625c-f3ad-47b1-ad2a-e6bf4b7e909d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:11.811193 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9e91625c-f3ad-47b1-ad2a-e6bf4b7e909d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1501 microversion: 2.1 time: 1.617857 Aug 25 13:24:11.812933 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2325/4593] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:10 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1501 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:11.837407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:11.840972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:11.876420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:11.877540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:11.880476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:11.881866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:11.890402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:11.891204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:13.094834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-619a965f-8967-467e-9aa8-be5b297cd5ae tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:13.125233 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-619a965f-8967-467e-9aa8-be5b297cd5ae tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1292 microversion: 2.1 time: 1.898639 Aug 25 13:24:13.127947 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2269/4594] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:11 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1292 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:13.140332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:13.146606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:13.161302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:13.162769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:13.164365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:13.167448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:13.168613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:13.170078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:13.236966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lazy-loading 'flavor' on Instance uuid 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:24:13.277976 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] HTTP exception thrown: Cannot 'rescue' instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 while it is in vm_state paused Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Request method failure captured: Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action HTTP/1.1 Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 14 Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3emkRnp5WsySeZUDuZqp15nFuui5PAZa04O2pdW2hxZe2BKDx44fRGkIEOKF2r11CYee5GPcGik4GpsVJQCgpLsIOIpHtQH9QghePjQ_6mqWpMbkt_tywI60U5M7l4xP6lvwI3wQpC2IoBQiIktCExz3EE3vcgMbQSbvXi9LGsoCek Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dec483f5c53b44c1a52917920b891b9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}] Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1552e098ea6f4d28abd9606fe9433000 Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: {"rescue": {}} Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: exception: Cannot 'rescue' instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 while it is in vm_state paused Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8', 'body': {'rescue': {}}} Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 in vm_state paused. Cannot rescue while the instance is in this state. Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 while it is in vm_state paused Aug 25 13:24:13.282248 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:13.298436 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:13.298436 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:13.298436 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:13.298436 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:24:13.298436 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:24:13.298436 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:24:13.298436 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:24:13.298436 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 while it is in vm_state paused Aug 25 13:24:13.298436 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:13.300220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:13.301096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Returning 409 to user: Cannot 'rescue' instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 while it is in vm_state paused {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:24:13.301096 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8897555f-3c26-4bf4-a75c-6522b3147c4a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action" status: 409 len: 144 microversion: 2.1 time: 0.165426 Aug 25 13:24:13.302167 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2270/4595] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:24:13 2022] POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action => generated 144 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:24:13.314378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-781d9ce6-bd01-480c-a1ba-ca0ae4f5b71d req-44b0c550-7393-411b-96ab-21d92a677f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d404ff6f-0fad-4c7f-bf95-5c0fe210039b", "tag": "8b68205d-7c61-4adf-ace8-ad7064786841"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:13.338948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-781d9ce6-bd01-480c-a1ba-ca0ae4f5b71d req-44b0c550-7393-411b-96ab-21d92a677f68 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:13.340395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-781d9ce6-bd01-480c-a1ba-ca0ae4f5b71d req-44b0c550-7393-411b-96ab-21d92a677f68 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:13.341678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-781d9ce6-bd01-480c-a1ba-ca0ae4f5b71d req-44b0c550-7393-411b-96ab-21d92a677f68 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:13.357204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:13.366369 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-781d9ce6-bd01-480c-a1ba-ca0ae4f5b71d req-44b0c550-7393-411b-96ab-21d92a677f68 service nova] Creating event network-changed:8b68205d-7c61-4adf-ace8-ad7064786841 for instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b on n-h1-852771-8 Aug 25 13:24:13.371118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:13.373938 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5887e05f-4576-4c14-b0a8-0d5eeb8a8e1d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1407 microversion: 2.20 time: 1.557687 Aug 25 13:24:13.377500 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-781d9ce6-bd01-480c-a1ba-ca0ae4f5b71d req-44b0c550-7393-411b-96ab-21d92a677f68 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072240 Aug 25 13:24:13.381065 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2326/4596] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:11 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1407 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:13.385142 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2271/4597] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:24:13.414408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7bb1ac54-350f-46a5-8a4e-8b7062439e0f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:13.415447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7bb1ac54-350f-46a5-8a4e-8b7062439e0f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:13.455894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bb1ac54-350f-46a5-8a4e-8b7062439e0f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:13.463516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bb1ac54-350f-46a5-8a4e-8b7062439e0f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:13.464757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bb1ac54-350f-46a5-8a4e-8b7062439e0f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:13.469619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bb1ac54-350f-46a5-8a4e-8b7062439e0f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:13.470653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bb1ac54-350f-46a5-8a4e-8b7062439e0f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:13.473679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7bb1ac54-350f-46a5-8a4e-8b7062439e0f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:13.686169 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7bb1ac54-350f-46a5-8a4e-8b7062439e0f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action" status: 202 len: 0 microversion: 2.1 time: 0.301555 Aug 25 13:24:13.688453 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2327/4598] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:24:13 2022] POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:24:13.711665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9abab113-c510-49d2-a5fb-5792a500695a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:13.713667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9abab113-c510-49d2-a5fb-5792a500695a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:13.730959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abab113-c510-49d2-a5fb-5792a500695a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:13.732442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abab113-c510-49d2-a5fb-5792a500695a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:13.733769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abab113-c510-49d2-a5fb-5792a500695a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:13.737232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abab113-c510-49d2-a5fb-5792a500695a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:13.740180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abab113-c510-49d2-a5fb-5792a500695a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:13.741905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9abab113-c510-49d2-a5fb-5792a500695a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:14.176706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b162b7fa-f993-4269-8e72-11899afacc47 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:14.185969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b162b7fa-f993-4269-8e72-11899afacc47 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:14.244751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b162b7fa-f993-4269-8e72-11899afacc47 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:14.245711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b162b7fa-f993-4269-8e72-11899afacc47 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:14.246664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b162b7fa-f993-4269-8e72-11899afacc47 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:14.248511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b162b7fa-f993-4269-8e72-11899afacc47 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:14.249740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b162b7fa-f993-4269-8e72-11899afacc47 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:14.253402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b162b7fa-f993-4269-8e72-11899afacc47 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:15.455990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9abab113-c510-49d2-a5fb-5792a500695a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:15.483646 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9abab113-c510-49d2-a5fb-5792a500695a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1508 microversion: 2.1 time: 1.782172 Aug 25 13:24:15.499491 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2272/4599] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:13 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1508 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:15.539191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7760e0a8-dea3-4120-a46e-52609b721e8f req-5b6c1e8d-82eb-4116-bd39-d78e88ef6555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75342af0-aaf7-41c7-8c05-1a93f39b83e2", "tag": "26cc3030-b525-49ff-8d18-dd81eeb20455"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:15.562787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7760e0a8-dea3-4120-a46e-52609b721e8f req-5b6c1e8d-82eb-4116-bd39-d78e88ef6555 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:15.564101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7760e0a8-dea3-4120-a46e-52609b721e8f req-5b6c1e8d-82eb-4116-bd39-d78e88ef6555 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:15.565806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7760e0a8-dea3-4120-a46e-52609b721e8f req-5b6c1e8d-82eb-4116-bd39-d78e88ef6555 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:15.604294 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7760e0a8-dea3-4120-a46e-52609b721e8f req-5b6c1e8d-82eb-4116-bd39-d78e88ef6555 service nova] Creating event network-changed:26cc3030-b525-49ff-8d18-dd81eeb20455 for instance 75342af0-aaf7-41c7-8c05-1a93f39b83e2 on n-h2-852771-8 Aug 25 13:24:15.612886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b162b7fa-f993-4269-8e72-11899afacc47 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:15.616895 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7760e0a8-dea3-4120-a46e-52609b721e8f req-5b6c1e8d-82eb-4116-bd39-d78e88ef6555 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114673 Aug 25 13:24:15.624027 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2273/4600] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:24:15.638336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:15.640820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:15.655107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:15.656601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:15.657877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:15.660471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:15.661937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:15.663174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:15.664531 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b162b7fa-f993-4269-8e72-11899afacc47 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1292 microversion: 2.1 time: 1.494442 Aug 25 13:24:15.680897 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2328/4601] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:14 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1292 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:16.532692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2751f1b6-1259-480b-a67c-35b3a04cc2c1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:16.534503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2751f1b6-1259-480b-a67c-35b3a04cc2c1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:16.550921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2751f1b6-1259-480b-a67c-35b3a04cc2c1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:16.552579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2751f1b6-1259-480b-a67c-35b3a04cc2c1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:16.553434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2751f1b6-1259-480b-a67c-35b3a04cc2c1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:16.555767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2751f1b6-1259-480b-a67c-35b3a04cc2c1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:16.557091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2751f1b6-1259-480b-a67c-35b3a04cc2c1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:16.558534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2751f1b6-1259-480b-a67c-35b3a04cc2c1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:16.985912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:17.057991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:17.069635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:17.080158 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fab83929-ac0d-4c63-b1b6-18a81a2a1e6b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1407 microversion: 2.20 time: 1.452529 Aug 25 13:24:17.083790 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2274/4602] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:15 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1407 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:17.108658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2751f1b6-1259-480b-a67c-35b3a04cc2c1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:17.110645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b79b2023-96d6-4769-92a0-7043fb9489eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:17.117921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b79b2023-96d6-4769-92a0-7043fb9489eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:17.153778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b79b2023-96d6-4769-92a0-7043fb9489eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:17.154926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b79b2023-96d6-4769-92a0-7043fb9489eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:17.155698 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2751f1b6-1259-480b-a67c-35b3a04cc2c1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1516 microversion: 2.1 time: 0.629064 Aug 25 13:24:17.159450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b79b2023-96d6-4769-92a0-7043fb9489eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:17.161579 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2329/4603] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:16 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1516 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:17.165573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b79b2023-96d6-4769-92a0-7043fb9489eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:17.166628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b79b2023-96d6-4769-92a0-7043fb9489eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:17.168550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b79b2023-96d6-4769-92a0-7043fb9489eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:17.876351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e7de7bd7-cdaf-4229-ac4a-49a774a44db7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'create', calling method: .version_select at 0x7f3a299ca310>, body: {"keypair": {"name": "tempest-keypair-488751786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOczkVnN+rh8z2DaBspEk0gEJBoaITDo5lG0eJIPvZ0vhRaa6JzjmaLqtllqDjSUgOtrPuoHoncfpXO7HbDhOcyx4EitGFSmJF5en3lnFLnebhx2qwrLWOduWVgr65LiKw=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:17.907184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b79b2023-96d6-4769-92a0-7043fb9489eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:17.935848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e7de7bd7-cdaf-4229-ac4a-49a774a44db7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Getting quotas for project 103003f7cdb1448491050c8c627764e0. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:24:17.943934 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b79b2023-96d6-4769-92a0-7043fb9489eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1292 microversion: 2.1 time: 0.853310 Aug 25 13:24:17.958000 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2275/4604] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:17 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1292 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:17.963397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e7de7bd7-cdaf-4229-ac4a-49a774a44db7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Getting quotas for user c8f37e1d986144ccb4ff3523d6b8c226 and project 103003f7cdb1448491050c8c627764e0. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:24:18.053490 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e7de7bd7-cdaf-4229-ac4a-49a774a44db7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.731381 Aug 25 13:24:18.074175 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2330/4605] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:24:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:24:18.137268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:18.139577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:18.202108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:18.203220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:18.204028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:18.205336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:18.213241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:18.214471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:18.231542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:18.995568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-01672a02-fef8-41ab-8273-cc113aef0169 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:19.000884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-01672a02-fef8-41ab-8273-cc113aef0169 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:19.052297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01672a02-fef8-41ab-8273-cc113aef0169 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:19.059876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01672a02-fef8-41ab-8273-cc113aef0169 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:19.064889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01672a02-fef8-41ab-8273-cc113aef0169 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:19.071008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01672a02-fef8-41ab-8273-cc113aef0169 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:19.074802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01672a02-fef8-41ab-8273-cc113aef0169 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:19.083110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01672a02-fef8-41ab-8273-cc113aef0169 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:19.090069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:19.132048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:19.143445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:19.162429 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b6026ff4-6fcd-4c4d-909b-847e80b1d78e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1407 microversion: 2.20 time: 1.032264 Aug 25 13:24:19.163246 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2276/4606] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:18 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1407 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:20.219503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:20.227877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:20.257755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:20.259440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:20.260821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:20.262599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:20.264134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:20.265224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:21.229061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-01672a02-fef8-41ab-8273-cc113aef0169 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:21.252510 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-01672a02-fef8-41ab-8273-cc113aef0169 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1292 microversion: 2.1 time: 2.269542 Aug 25 13:24:21.255231 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2331/4607] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:18 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1292 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:21.281496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5a42ff57-efec-4cf2-9e6f-3485626a1b7c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:21.287229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5a42ff57-efec-4cf2-9e6f-3485626a1b7c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:21.302446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a42ff57-efec-4cf2-9e6f-3485626a1b7c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:21.303806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a42ff57-efec-4cf2-9e6f-3485626a1b7c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:21.304771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a42ff57-efec-4cf2-9e6f-3485626a1b7c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:21.307057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a42ff57-efec-4cf2-9e6f-3485626a1b7c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:21.315198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a42ff57-efec-4cf2-9e6f-3485626a1b7c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:21.319263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a42ff57-efec-4cf2-9e6f-3485626a1b7c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:21.414235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-5a42ff57-efec-4cf2-9e6f-3485626a1b7c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lazy-loading 'flavor' on Instance uuid 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:24:21.714022 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5a42ff57-efec-4cf2-9e6f-3485626a1b7c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action" status: 200 len: 32 microversion: 2.1 time: 0.451323 Aug 25 13:24:21.715793 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2332/4608] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:24:21 2022] POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action => generated 32 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:24:21.744531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b989a287-a009-4b5e-8d8e-cee297080596 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:21.747893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b989a287-a009-4b5e-8d8e-cee297080596 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:21.775215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b989a287-a009-4b5e-8d8e-cee297080596 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:21.778827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b989a287-a009-4b5e-8d8e-cee297080596 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:21.786190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b989a287-a009-4b5e-8d8e-cee297080596 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:21.788060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b989a287-a009-4b5e-8d8e-cee297080596 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:21.789092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b989a287-a009-4b5e-8d8e-cee297080596 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:21.790057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b989a287-a009-4b5e-8d8e-cee297080596 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:21.863278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:21.938354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:21.948566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:21.953155 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e88b13bf-0d78-427e-8ff8-d55e2c0d1524 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1407 microversion: 2.20 time: 1.754884 Aug 25 13:24:21.981167 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2277/4609] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:20 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1407 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:22.292235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8b0c77c2-12fd-4b18-8d20-1404f247e194 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:22.295102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8b0c77c2-12fd-4b18-8d20-1404f247e194 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:22.320854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b0c77c2-12fd-4b18-8d20-1404f247e194 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:22.327422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b0c77c2-12fd-4b18-8d20-1404f247e194 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:22.328615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b0c77c2-12fd-4b18-8d20-1404f247e194 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:22.330291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b0c77c2-12fd-4b18-8d20-1404f247e194 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:22.339588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b0c77c2-12fd-4b18-8d20-1404f247e194 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:22.340794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b0c77c2-12fd-4b18-8d20-1404f247e194 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:23.275810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b989a287-a009-4b5e-8d8e-cee297080596 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:23.308635 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b989a287-a009-4b5e-8d8e-cee297080596 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 1.581438 Aug 25 13:24:23.319330 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2333/4610] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:21 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:23.345156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:23.347086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:23.398489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:23.402757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:23.406766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:23.411695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:23.415553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:23.416366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:23.931405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8b0c77c2-12fd-4b18-8d20-1404f247e194 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:23.959471 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8b0c77c2-12fd-4b18-8d20-1404f247e194 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1292 microversion: 2.1 time: 1.676127 Aug 25 13:24:23.969179 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2278/4611] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:22 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1292 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:24.235393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:24.288291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:24.294853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:24.297334 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c542be8c-cf89-46ac-a699-fbb97878bfbb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1407 microversion: 2.20 time: 0.974536 Aug 25 13:24:24.328039 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2334/4612] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:23 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1407 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:24.353905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-042a1748-3910-4ed8-a052-18d884f51757 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:24.355143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-042a1748-3910-4ed8-a052-18d884f51757 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:24.402546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042a1748-3910-4ed8-a052-18d884f51757 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:24.403818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042a1748-3910-4ed8-a052-18d884f51757 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:24.404616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042a1748-3910-4ed8-a052-18d884f51757 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:24.412105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042a1748-3910-4ed8-a052-18d884f51757 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:24.416806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042a1748-3910-4ed8-a052-18d884f51757 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:24.426797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042a1748-3910-4ed8-a052-18d884f51757 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:24.798739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-6ee8c9e0-945d-4282-a77b-b9449cc78dc6 req-90f8c834-bf12-41a3-8ed5-09bcb19f0847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75342af0-aaf7-41c7-8c05-1a93f39b83e2", "name": "network-vif-plugged", "status": "completed", "tag": "26cc3030-b525-49ff-8d18-dd81eeb20455"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:24.840895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6ee8c9e0-945d-4282-a77b-b9449cc78dc6 req-90f8c834-bf12-41a3-8ed5-09bcb19f0847 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:24.848889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6ee8c9e0-945d-4282-a77b-b9449cc78dc6 req-90f8c834-bf12-41a3-8ed5-09bcb19f0847 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:24.849963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6ee8c9e0-945d-4282-a77b-b9449cc78dc6 req-90f8c834-bf12-41a3-8ed5-09bcb19f0847 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:24.892203 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-6ee8c9e0-945d-4282-a77b-b9449cc78dc6 req-90f8c834-bf12-41a3-8ed5-09bcb19f0847 service nova] Creating event network-vif-plugged:26cc3030-b525-49ff-8d18-dd81eeb20455 for instance 75342af0-aaf7-41c7-8c05-1a93f39b83e2 on n-h2-852771-8 Aug 25 13:24:24.919107 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-6ee8c9e0-945d-4282-a77b-b9449cc78dc6 req-90f8c834-bf12-41a3-8ed5-09bcb19f0847 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127587 Aug 25 13:24:24.925651 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2335/4613] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:24:25.012324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-314f1937-a49f-4a1b-b070-ea21ffc17aef tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:25.018170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-314f1937-a49f-4a1b-b070-ea21ffc17aef tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:25.038296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314f1937-a49f-4a1b-b070-ea21ffc17aef tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:25.051221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314f1937-a49f-4a1b-b070-ea21ffc17aef tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:25.052203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314f1937-a49f-4a1b-b070-ea21ffc17aef tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:25.053461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314f1937-a49f-4a1b-b070-ea21ffc17aef tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:25.054325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314f1937-a49f-4a1b-b070-ea21ffc17aef tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:25.055325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-314f1937-a49f-4a1b-b070-ea21ffc17aef tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:26.060223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-042a1748-3910-4ed8-a052-18d884f51757 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:26.084529 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-042a1748-3910-4ed8-a052-18d884f51757 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 1.741064 Aug 25 13:24:26.086600 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2279/4614] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:24 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:26.098132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:26.099853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:26.116469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:26.117811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:26.118800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:26.122022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:26.125111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:26.129055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:26.243798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-314f1937-a49f-4a1b-b070-ea21ffc17aef tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:26.269878 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-314f1937-a49f-4a1b-b070-ea21ffc17aef tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1292 microversion: 2.1 time: 1.263304 Aug 25 13:24:26.273643 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2336/4615] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:25 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1292 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:26.683175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:26.720846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:26.734799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:26.738007 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-20608569-f591-4283-8b42-929e48ef08f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1407 microversion: 2.20 time: 0.648442 Aug 25 13:24:26.747103 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2280/4616] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:26 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1407 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:26.970365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-993116491", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a4c0468-d3e7-46ab-a86e-24f51de4bb88"}], "security_groups": [{"name": "tempest-securitygroup--1828424939"}], "key_name": "tempest-keypair-488751786", "user_data": "}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:27.139029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3922a740-18da-4d7a-89ff-dc799613a595 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:27.141699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3922a740-18da-4d7a-89ff-dc799613a595 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:27.157309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3922a740-18da-4d7a-89ff-dc799613a595 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:27.159283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3922a740-18da-4d7a-89ff-dc799613a595 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:27.160509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3922a740-18da-4d7a-89ff-dc799613a595 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:27.162328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3922a740-18da-4d7a-89ff-dc799613a595 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:27.163633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3922a740-18da-4d7a-89ff-dc799613a595 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:27.165146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3922a740-18da-4d7a-89ff-dc799613a595 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:27.321960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] validate_networks() for [('9a4c0468-d3e7-46ab-a86e-24f51de4bb88', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:24:27.728884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3922a740-18da-4d7a-89ff-dc799613a595 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:27.755387 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3922a740-18da-4d7a-89ff-dc799613a595 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 0.634998 Aug 25 13:24:27.756364 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2281/4617] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:27 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:27.794953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1b8afd54-1a5d-49d7-af10-ffb75b7d063f req-35516b28-0cee-4b36-a3b1-b155c65581b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d404ff6f-0fad-4c7f-bf95-5c0fe210039b", "name": "network-vif-plugged", "status": "completed", "tag": "8b68205d-7c61-4adf-ace8-ad7064786841"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:27.827475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1b8afd54-1a5d-49d7-af10-ffb75b7d063f req-35516b28-0cee-4b36-a3b1-b155c65581b0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:27.828880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1b8afd54-1a5d-49d7-af10-ffb75b7d063f req-35516b28-0cee-4b36-a3b1-b155c65581b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:27.830094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1b8afd54-1a5d-49d7-af10-ffb75b7d063f req-35516b28-0cee-4b36-a3b1-b155c65581b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:27.860878 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1b8afd54-1a5d-49d7-af10-ffb75b7d063f req-35516b28-0cee-4b36-a3b1-b155c65581b0 service nova] Creating event network-vif-plugged:8b68205d-7c61-4adf-ace8-ad7064786841 for instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b on n-h1-852771-8 Aug 25 13:24:27.873770 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1b8afd54-1a5d-49d7-af10-ffb75b7d063f req-35516b28-0cee-4b36-a3b1-b155c65581b0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114828 Aug 25 13:24:27.875548 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2282/4618] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:24:27.888193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3aa4e680-010e-4542-a9e1-5453ce0c2013 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:27.891371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3aa4e680-010e-4542-a9e1-5453ce0c2013 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:27.909838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa4e680-010e-4542-a9e1-5453ce0c2013 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:27.912509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa4e680-010e-4542-a9e1-5453ce0c2013 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:27.920047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa4e680-010e-4542-a9e1-5453ce0c2013 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:27.922694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa4e680-010e-4542-a9e1-5453ce0c2013 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:27.924130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa4e680-010e-4542-a9e1-5453ce0c2013 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:27.925549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa4e680-010e-4542-a9e1-5453ce0c2013 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:27.996552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:28.866442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3aa4e680-010e-4542-a9e1-5453ce0c2013 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:28.879864 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3aa4e680-010e-4542-a9e1-5453ce0c2013 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1471 microversion: 2.1 time: 1.001678 Aug 25 13:24:28.894154 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2283/4619] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:27 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1471 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:28.894154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:28.894154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:28.906014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:28.907281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:28.908408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:28.911047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:28.912455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:28.913689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:29.043983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:24:29.045837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:24:29.047118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:24:29.048178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:24:29.051766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:24:29.083747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:29.084657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:29.085703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:29.087363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:29.088482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:29.089612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:29.141589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Getting quotas for project 103003f7cdb1448491050c8c627764e0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:24:29.163953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Getting quotas for user c8f37e1d986144ccb4ff3523d6b8c226 and project 103003f7cdb1448491050c8c627764e0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:24:29.207151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:24:29.218197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:24:29.331180 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42125307-676b-4f8b-894a-73b5ee44af94 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.369004 Aug 25 13:24:29.333222 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2337/4620] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:24:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:24:29.344421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f517da2-8337-4340-9763-0cb42eb44196 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:29.346083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0f517da2-8337-4340-9763-0cb42eb44196 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:29.360290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f517da2-8337-4340-9763-0cb42eb44196 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:29.361724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f517da2-8337-4340-9763-0cb42eb44196 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:29.363417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f517da2-8337-4340-9763-0cb42eb44196 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:29.365110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f517da2-8337-4340-9763-0cb42eb44196 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:29.366349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f517da2-8337-4340-9763-0cb42eb44196 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:29.367366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f517da2-8337-4340-9763-0cb42eb44196 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:29.399710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:29.423025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:29.426971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:29.429790 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a4ad3b3-8d62-4e5d-a7e8-c0676f2fab25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1407 microversion: 2.20 time: 0.546422 Aug 25 13:24:29.432323 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2284/4621] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:28 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1407 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:29.444662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1537580543", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:29.576687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] validate_networks() for [('0fc430fe-72c2-45e0-a5f2-bac853189a57', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:24:30.156203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f517da2-8337-4340-9763-0cb42eb44196 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:30.191351 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0f517da2-8337-4340-9763-0cb42eb44196 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 0.854680 Aug 25 13:24:30.219640 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2338/4622] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:29 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:30.238024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d654dd25-e3bd-4083-8c28-746a96c1ff3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:30.240289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d654dd25-e3bd-4083-8c28-746a96c1ff3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:30.488365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d654dd25-e3bd-4083-8c28-746a96c1ff3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:30.528375 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d654dd25-e3bd-4083-8c28-746a96c1ff3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1236 microversion: 2.1 time: 0.302939 Aug 25 13:24:30.533290 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2339/4623] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:30 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1236 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:30.561753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:30.569455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:30.621118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:30.623671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:30.625264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:30.626985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:30.629066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:30.630241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:30.649433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:31.307922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:31.343627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:31.350540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:31.354083 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a525bed9-c94b-446e-832c-e9674a836a50 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1599 microversion: 2.20 time: 0.814163 Aug 25 13:24:31.374241 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2340/4624] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:24:30 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1599 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:24:31.392557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b868d375-2f82-47c2-9fc3-374d0bf22096 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:31.394964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b868d375-2f82-47c2-9fc3-374d0bf22096 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:31.408448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b868d375-2f82-47c2-9fc3-374d0bf22096 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:31.409917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b868d375-2f82-47c2-9fc3-374d0bf22096 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:31.411051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b868d375-2f82-47c2-9fc3-374d0bf22096 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:31.412745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b868d375-2f82-47c2-9fc3-374d0bf22096 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:31.413932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b868d375-2f82-47c2-9fc3-374d0bf22096 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:31.415051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b868d375-2f82-47c2-9fc3-374d0bf22096 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:31.708807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:24:31.709995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:24:31.711251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:24:31.712311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:24:31.715064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:24:31.775819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:31.784191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:31.787287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:31.789591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:31.792476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:31.795584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:31.854060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:24:31.889453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for user bd7b1570a27f4ea8ad560ce25225cf02 and project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:24:31.948510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:24:31.959422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:24:31.975906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b868d375-2f82-47c2-9fc3-374d0bf22096 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:32.019407 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b868d375-2f82-47c2-9fc3-374d0bf22096 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 0.625546 Aug 25 13:24:32.028966 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2341/4625] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:31 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:32.047616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-18be9a13-c90c-410b-bfd9-92a3ad06e4c3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:32.048837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-18be9a13-c90c-410b-bfd9-92a3ad06e4c3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:32.080391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18be9a13-c90c-410b-bfd9-92a3ad06e4c3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:32.093190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18be9a13-c90c-410b-bfd9-92a3ad06e4c3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:32.094207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18be9a13-c90c-410b-bfd9-92a3ad06e4c3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:32.095532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18be9a13-c90c-410b-bfd9-92a3ad06e4c3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:32.096927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18be9a13-c90c-410b-bfd9-92a3ad06e4c3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:32.097789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18be9a13-c90c-410b-bfd9-92a3ad06e4c3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:32.173320 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d6f11955-57b7-48df-94e0-3f1b346b5930 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.738492 Aug 25 13:24:32.198605 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2285/4626] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:24:32.225249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-547fea8e-90d2-4a45-9f8d-3e619e2cf346 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:32.228021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-547fea8e-90d2-4a45-9f8d-3e619e2cf346 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:32.250271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-547fea8e-90d2-4a45-9f8d-3e619e2cf346 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:32.265242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-547fea8e-90d2-4a45-9f8d-3e619e2cf346 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:32.266695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-547fea8e-90d2-4a45-9f8d-3e619e2cf346 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:32.268924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-547fea8e-90d2-4a45-9f8d-3e619e2cf346 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:32.271559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-547fea8e-90d2-4a45-9f8d-3e619e2cf346 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:32.273062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-547fea8e-90d2-4a45-9f8d-3e619e2cf346 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:32.592528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-547fea8e-90d2-4a45-9f8d-3e619e2cf346 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:32.630653 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-547fea8e-90d2-4a45-9f8d-3e619e2cf346 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1306 microversion: 2.1 time: 0.423148 Aug 25 13:24:32.632815 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2286/4627] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:32 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1306 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:32.661838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8cb9e371-5c75-4022-994e-bfb85ff099e4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:32.663282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8cb9e371-5c75-4022-994e-bfb85ff099e4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:32.688036 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-18be9a13-c90c-410b-bfd9-92a3ad06e4c3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.656707 Aug 25 13:24:32.693366 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2342/4628] 10.222.0.70 () {60 vars in 1316 bytes} [Thu Aug 25 13:24:32 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-interface => generated 285 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:24:32.733867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8cb9e371-5c75-4022-994e-bfb85ff099e4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:24:33.083007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9b73733e-cda6-4d0e-a93b-bb87cf2ba702 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:33.083884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9b73733e-cda6-4d0e-a93b-bb87cf2ba702 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:33.139425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b73733e-cda6-4d0e-a93b-bb87cf2ba702 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:33.148317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b73733e-cda6-4d0e-a93b-bb87cf2ba702 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:33.150543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b73733e-cda6-4d0e-a93b-bb87cf2ba702 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:33.162737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b73733e-cda6-4d0e-a93b-bb87cf2ba702 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:33.163622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b73733e-cda6-4d0e-a93b-bb87cf2ba702 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:33.164611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b73733e-cda6-4d0e-a93b-bb87cf2ba702 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:33.169675 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8cb9e371-5c75-4022-994e-bfb85ff099e4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc" status: 204 len: 0 microversion: 2.1 time: 0.534083 Aug 25 13:24:33.172658 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2287/4629] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:24:32 2022] DELETE /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:24:33.202224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c09f52c-cea8-409c-a31b-53fc477f36ff tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:33.204119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0c09f52c-cea8-409c-a31b-53fc477f36ff tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:33.266927 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-0c09f52c-cea8-409c-a31b-53fc477f36ff tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c09f52c-cea8-409c-a31b-53fc477f36ff tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc HTTP/1.1 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc'} Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:24:33.287755 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c09f52c-cea8-409c-a31b-53fc477f36ff tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:24:33.305317 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0c09f52c-cea8-409c-a31b-53fc477f36ff tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc" status: 404 len: 111 microversion: 2.1 time: 0.108833 Aug 25 13:24:33.316515 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2288/4630] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:33 2022] GET /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:24:33.613384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1812315499", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "0fc430fe-72c2-45e0-a5f2-bac853189a57"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:33.869881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] validate_networks() for [('0fc430fe-72c2-45e0-a5f2-bac853189a57', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:24:34.228456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9b73733e-cda6-4d0e-a93b-bb87cf2ba702 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:34.275854 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9b73733e-cda6-4d0e-a93b-bb87cf2ba702 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 1.199748 Aug 25 13:24:34.279665 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2343/4631] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:33 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:34.309486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5f9730bc-0c88-4d19-a2c3-98b7c0e70382 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:34.310773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5f9730bc-0c88-4d19-a2c3-98b7c0e70382 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:34.341746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9730bc-0c88-4d19-a2c3-98b7c0e70382 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:34.342671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9730bc-0c88-4d19-a2c3-98b7c0e70382 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:34.347441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9730bc-0c88-4d19-a2c3-98b7c0e70382 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:34.348572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9730bc-0c88-4d19-a2c3-98b7c0e70382 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:34.351736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9730bc-0c88-4d19-a2c3-98b7c0e70382 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:34.354736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9730bc-0c88-4d19-a2c3-98b7c0e70382 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:34.720364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5f9730bc-0c88-4d19-a2c3-98b7c0e70382 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:34.759032 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5f9730bc-0c88-4d19-a2c3-98b7c0e70382 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1294 microversion: 2.1 time: 0.475832 Aug 25 13:24:34.767644 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2344/4632] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:34 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1294 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:35.314443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-197dc70d-d3a1-4ced-bee9-e8e7a642b605 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:35.325439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-197dc70d-d3a1-4ced-bee9-e8e7a642b605 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:35.352127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-197dc70d-d3a1-4ced-bee9-e8e7a642b605 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:35.357553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-197dc70d-d3a1-4ced-bee9-e8e7a642b605 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:35.358687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-197dc70d-d3a1-4ced-bee9-e8e7a642b605 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:35.366111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-197dc70d-d3a1-4ced-bee9-e8e7a642b605 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:35.367183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-197dc70d-d3a1-4ced-bee9-e8e7a642b605 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:35.368026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-197dc70d-d3a1-4ced-bee9-e8e7a642b605 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:36.781351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-197dc70d-d3a1-4ced-bee9-e8e7a642b605 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:36.811495 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-197dc70d-d3a1-4ced-bee9-e8e7a642b605 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 1.503768 Aug 25 13:24:36.812560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2345/4633] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:35 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:36.838518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d99ebc3-833f-48ec-ae83-a84e7df72541 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:36.840204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d99ebc3-833f-48ec-ae83-a84e7df72541 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:36.845284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:36.858317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d99ebc3-833f-48ec-ae83-a84e7df72541 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:36.859829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d99ebc3-833f-48ec-ae83-a84e7df72541 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:36.861074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d99ebc3-833f-48ec-ae83-a84e7df72541 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:36.862790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d99ebc3-833f-48ec-ae83-a84e7df72541 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:36.864009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d99ebc3-833f-48ec-ae83-a84e7df72541 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:36.865098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d99ebc3-833f-48ec-ae83-a84e7df72541 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:36.963425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:24:36.964452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:24:36.965185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:24:36.965915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:24:36.966678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:24:36.982900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:37.010291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:37.011465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:37.012351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:37.013913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:37.014751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:37.015524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:37.064484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:24:37.077464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for user bd7b1570a27f4ea8ad560ce25225cf02 and project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:24:37.155062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:24:37.169710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:24:37.416026 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d022bbe8-16b5-40bf-9b0a-3dd80fec0379 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.814880 Aug 25 13:24:37.428968 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2289/4634] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:24:37.446790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-024db7b6-40b0-4447-95e5-84aaac603016 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:37.448381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-024db7b6-40b0-4447-95e5-84aaac603016 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:37.966391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-024db7b6-40b0-4447-95e5-84aaac603016 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:37.993652 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-024db7b6-40b0-4447-95e5-84aaac603016 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1221 microversion: 2.1 time: 0.561612 Aug 25 13:24:38.001400 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2290/4635] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:37 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1221 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:38.012772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-cb5a4bc6-71a6-427b-88ee-3ef650de18cf req-8bdad787-7432-480e-93e1-7a3297c5a589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d404ff6f-0fad-4c7f-bf95-5c0fe210039b", "tag": "8b68205d-7c61-4adf-ace8-ad7064786841"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:38.031776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cb5a4bc6-71a6-427b-88ee-3ef650de18cf req-8bdad787-7432-480e-93e1-7a3297c5a589 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:38.033208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cb5a4bc6-71a6-427b-88ee-3ef650de18cf req-8bdad787-7432-480e-93e1-7a3297c5a589 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:38.034738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cb5a4bc6-71a6-427b-88ee-3ef650de18cf req-8bdad787-7432-480e-93e1-7a3297c5a589 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:38.072644 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-cb5a4bc6-71a6-427b-88ee-3ef650de18cf req-8bdad787-7432-480e-93e1-7a3297c5a589 service nova] Creating event network-changed:8b68205d-7c61-4adf-ace8-ad7064786841 for instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b on n-h1-852771-8 Aug 25 13:24:38.088525 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-cb5a4bc6-71a6-427b-88ee-3ef650de18cf req-8bdad787-7432-480e-93e1-7a3297c5a589 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082543 Aug 25 13:24:38.090671 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2291/4636] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:24:38.102941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-37c7a429-bc48-415d-84e3-94a8f4c1a42c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:38.104325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-37c7a429-bc48-415d-84e3-94a8f4c1a42c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:38.121925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37c7a429-bc48-415d-84e3-94a8f4c1a42c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:38.122839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37c7a429-bc48-415d-84e3-94a8f4c1a42c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:38.125723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37c7a429-bc48-415d-84e3-94a8f4c1a42c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:38.131105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37c7a429-bc48-415d-84e3-94a8f4c1a42c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:38.134858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37c7a429-bc48-415d-84e3-94a8f4c1a42c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:38.136451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37c7a429-bc48-415d-84e3-94a8f4c1a42c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:38.246672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d99ebc3-833f-48ec-ae83-a84e7df72541 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:38.275300 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d99ebc3-833f-48ec-ae83-a84e7df72541 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 1.455859 Aug 25 13:24:38.286230 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2346/4637] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:36 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:39.014998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37c7a429-bc48-415d-84e3-94a8f4c1a42c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:39.038098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f213c67-cd0a-4b77-9654-c1340b9073fe tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:39.039358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f213c67-cd0a-4b77-9654-c1340b9073fe tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:39.080049 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-37c7a429-bc48-415d-84e3-94a8f4c1a42c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 0.986548 Aug 25 13:24:39.097833 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2292/4638] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:38 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:39.101183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f213c67-cd0a-4b77-9654-c1340b9073fe tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:39.102166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f213c67-cd0a-4b77-9654-c1340b9073fe tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:39.102986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f213c67-cd0a-4b77-9654-c1340b9073fe tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:39.104253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f213c67-cd0a-4b77-9654-c1340b9073fe tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:39.105129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f213c67-cd0a-4b77-9654-c1340b9073fe tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:39.106058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f213c67-cd0a-4b77-9654-c1340b9073fe tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:39.128211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:39.335379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-23afd3a9-6fd4-48fb-b852-dbb705cc687f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:39.338203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-23afd3a9-6fd4-48fb-b852-dbb705cc687f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:39.358594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23afd3a9-6fd4-48fb-b852-dbb705cc687f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:39.360450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23afd3a9-6fd4-48fb-b852-dbb705cc687f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:39.362653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23afd3a9-6fd4-48fb-b852-dbb705cc687f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:39.371065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23afd3a9-6fd4-48fb-b852-dbb705cc687f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:39.372825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23afd3a9-6fd4-48fb-b852-dbb705cc687f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:39.374309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23afd3a9-6fd4-48fb-b852-dbb705cc687f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:39.677605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2f213c67-cd0a-4b77-9654-c1340b9073fe tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:39.703397 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f213c67-cd0a-4b77-9654-c1340b9073fe tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1225 microversion: 2.1 time: 0.673742 Aug 25 13:24:39.706444 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2347/4639] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:39 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1225 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:40.131064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a1e5b25e-aa77-43bf-8437-d3e381e19ac5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:40.132843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a1e5b25e-aa77-43bf-8437-d3e381e19ac5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:40.159193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e5b25e-aa77-43bf-8437-d3e381e19ac5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:40.165333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e5b25e-aa77-43bf-8437-d3e381e19ac5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:40.166709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e5b25e-aa77-43bf-8437-d3e381e19ac5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:40.168367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e5b25e-aa77-43bf-8437-d3e381e19ac5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:40.169630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e5b25e-aa77-43bf-8437-d3e381e19ac5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:40.170784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a1e5b25e-aa77-43bf-8437-d3e381e19ac5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:40.298133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-23afd3a9-6fd4-48fb-b852-dbb705cc687f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:40.323274 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-23afd3a9-6fd4-48fb-b852-dbb705cc687f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 0.999582 Aug 25 13:24:40.324360 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2293/4640] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:39 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:40.500249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:40.751162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7ec4de3f-3256-4af2-bcab-3161169ae2a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:40.752833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7ec4de3f-3256-4af2-bcab-3161169ae2a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:40.769702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec4de3f-3256-4af2-bcab-3161169ae2a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:40.774981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec4de3f-3256-4af2-bcab-3161169ae2a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:40.777608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec4de3f-3256-4af2-bcab-3161169ae2a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:40.780806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec4de3f-3256-4af2-bcab-3161169ae2a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:40.782615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec4de3f-3256-4af2-bcab-3161169ae2a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:40.785142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ec4de3f-3256-4af2-bcab-3161169ae2a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:40.885993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a1e5b25e-aa77-43bf-8437-d3e381e19ac5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:40.916507 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a1e5b25e-aa77-43bf-8437-d3e381e19ac5 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1502 microversion: 2.1 time: 0.793676 Aug 25 13:24:40.918166 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2348/4641] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:40 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1502 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:40.966976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc006d20-2ae0-4154-ae1a-2d79034f6f88"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:40.981689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:40.999824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:41.000856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:41.001859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:41.004114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:41.005940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:41.006917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:41.066384 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] HTTP exception thrown: Cannot 'attach_volume' instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 while it is in vm_state rescued Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Request method failure captured: Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/os-volume_attachments HTTP/1.1 Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 74 Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3emkRnp5WsySeZUDuZqp15nFuui5PAZa04O2pdW2hxZe2BKDx44fRGkIEOKF2r11CYee5GPcGik4GpsVJQCgpLsIOIpHtQH9QghePjQ_6mqWpMbkt_tywI60U5M7l4xP6lvwI3wQpC2IoBQiIktCExz3EE3vcgMbQSbvXi9LGsoCek Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dec483f5c53b44c1a52917920b891b9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}] Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1552e098ea6f4d28abd9606fe9433000 Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: {"volumeAttachment": {"volumeId": "bc006d20-2ae0-4154-ae1a-2d79034f6f88"}} Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: exception: Cannot 'attach_volume' instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 while it is in vm_state rescued Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': '0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8', 'body': {'volumeAttachment': {'volumeId': 'bc006d20-2ae0-4154-ae1a-2d79034f6f88'}}} Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 25 13:24:41.071707 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 while it is in vm_state rescued Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 while it is in vm_state rescued Aug 25 13:24:41.086016 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:24:41.088826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7ec4de3f-3256-4af2-bcab-3161169ae2a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:41.092322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Returning 409 to user: Cannot 'attach_volume' instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 while it is in vm_state rescued {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:24:41.092322 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1de4f630-4172-4c30-9646-292093343c5a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.134284 Aug 25 13:24:41.094553 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2349/4642] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:24:40 2022] POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/os-volume_attachments => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:24:41.109741 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7ec4de3f-3256-4af2-bcab-3161169ae2a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1279 microversion: 2.1 time: 0.365830 Aug 25 13:24:41.116521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-598c3949-8a7f-45ef-80d0-c94e9bac5612 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:41.117692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-598c3949-8a7f-45ef-80d0-c94e9bac5612 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:41.126579 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2294/4643] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:40 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1279 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:41.133865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598c3949-8a7f-45ef-80d0-c94e9bac5612 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:41.134929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598c3949-8a7f-45ef-80d0-c94e9bac5612 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:41.135824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598c3949-8a7f-45ef-80d0-c94e9bac5612 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:41.137256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598c3949-8a7f-45ef-80d0-c94e9bac5612 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:41.138330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598c3949-8a7f-45ef-80d0-c94e9bac5612 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:41.139250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598c3949-8a7f-45ef-80d0-c94e9bac5612 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:41.306683 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-598c3949-8a7f-45ef-80d0-c94e9bac5612 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action" status: 202 len: 0 microversion: 2.1 time: 0.201891 Aug 25 13:24:41.310028 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2350/4644] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:24:41 2022] POST /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:24:41.344810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f4b36273-86d0-4415-a1ed-35240fb437ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:41.357155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f4b36273-86d0-4415-a1ed-35240fb437ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:41.370340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f4e9248-fa5b-4282-b769-852e8488b234 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:41.371817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f4e9248-fa5b-4282-b769-852e8488b234 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:41.384949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f4e9248-fa5b-4282-b769-852e8488b234 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:41.385903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f4e9248-fa5b-4282-b769-852e8488b234 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:41.386752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f4e9248-fa5b-4282-b769-852e8488b234 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:41.388198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f4e9248-fa5b-4282-b769-852e8488b234 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:41.389129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f4e9248-fa5b-4282-b769-852e8488b234 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:41.390333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f4e9248-fa5b-4282-b769-852e8488b234 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:41.398339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4b36273-86d0-4415-a1ed-35240fb437ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:41.413130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4b36273-86d0-4415-a1ed-35240fb437ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:41.427507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4b36273-86d0-4415-a1ed-35240fb437ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:41.429735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4b36273-86d0-4415-a1ed-35240fb437ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:41.440919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4b36273-86d0-4415-a1ed-35240fb437ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:41.448818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4b36273-86d0-4415-a1ed-35240fb437ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:42.360754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f4b36273-86d0-4415-a1ed-35240fb437ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:42.370804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f4e9248-fa5b-4282-b769-852e8488b234 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:42.396392 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f4b36273-86d0-4415-a1ed-35240fb437ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1510 microversion: 2.1 time: 1.079456 Aug 25 13:24:42.402092 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f4e9248-fa5b-4282-b769-852e8488b234 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 1.042755 Aug 25 13:24:42.415321 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2351/4645] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:41 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:42.418649 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2295/4646] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:41 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1510 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:42.426496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fe57b1ef-a9fa-47eb-a624-33290ca937ce tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:42.439359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fe57b1ef-a9fa-47eb-a624-33290ca937ce tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:42.457808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe57b1ef-a9fa-47eb-a624-33290ca937ce tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:42.467015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe57b1ef-a9fa-47eb-a624-33290ca937ce tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:42.468519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe57b1ef-a9fa-47eb-a624-33290ca937ce tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:42.470165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe57b1ef-a9fa-47eb-a624-33290ca937ce tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:42.471153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe57b1ef-a9fa-47eb-a624-33290ca937ce tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:42.472234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe57b1ef-a9fa-47eb-a624-33290ca937ce tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:42.788940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fe57b1ef-a9fa-47eb-a624-33290ca937ce tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:42.818483 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fe57b1ef-a9fa-47eb-a624-33290ca937ce tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1279 microversion: 2.1 time: 0.400578 Aug 25 13:24:42.824186 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2352/4647] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:42 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1279 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:43.420343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-19bde076-c3db-4e76-bdff-6c5612cc938a req-cfb0d543-09a1-4824-9daf-8dcb6158fcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2166b072-a2e3-469f-b49a-ac99195a5827", "tag": "a1978be4-1d77-48fd-bcc9-8ff374eb81e7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:43.450288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-95130771-ebb3-476e-b4c3-46e9311bc401 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:43.452595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-95130771-ebb3-476e-b4c3-46e9311bc401 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:43.467514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-19bde076-c3db-4e76-bdff-6c5612cc938a req-cfb0d543-09a1-4824-9daf-8dcb6158fcae service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:43.468366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-19bde076-c3db-4e76-bdff-6c5612cc938a req-cfb0d543-09a1-4824-9daf-8dcb6158fcae service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:43.469149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-19bde076-c3db-4e76-bdff-6c5612cc938a req-cfb0d543-09a1-4824-9daf-8dcb6158fcae service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:43.491836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95130771-ebb3-476e-b4c3-46e9311bc401 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:43.495616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95130771-ebb3-476e-b4c3-46e9311bc401 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:43.505941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95130771-ebb3-476e-b4c3-46e9311bc401 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:43.508385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95130771-ebb3-476e-b4c3-46e9311bc401 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:43.509483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95130771-ebb3-476e-b4c3-46e9311bc401 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:43.510779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-95130771-ebb3-476e-b4c3-46e9311bc401 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:43.525928 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-19bde076-c3db-4e76-bdff-6c5612cc938a req-cfb0d543-09a1-4824-9daf-8dcb6158fcae service nova] Creating event network-changed:a1978be4-1d77-48fd-bcc9-8ff374eb81e7 for instance 2166b072-a2e3-469f-b49a-ac99195a5827 on n-h1-852771-8 Aug 25 13:24:43.557826 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-19bde076-c3db-4e76-bdff-6c5612cc938a req-cfb0d543-09a1-4824-9daf-8dcb6158fcae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132164 Aug 25 13:24:43.559001 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2296/4648] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:24:43.569430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ea2a276a-46d6-4289-b3a8-f82a7cb6f5a2 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:43.585271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ea2a276a-46d6-4289-b3a8-f82a7cb6f5a2 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:43.612866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2a276a-46d6-4289-b3a8-f82a7cb6f5a2 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:43.613825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2a276a-46d6-4289-b3a8-f82a7cb6f5a2 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:43.614630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2a276a-46d6-4289-b3a8-f82a7cb6f5a2 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:43.615916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2a276a-46d6-4289-b3a8-f82a7cb6f5a2 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:43.616779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2a276a-46d6-4289-b3a8-f82a7cb6f5a2 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:43.617629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea2a276a-46d6-4289-b3a8-f82a7cb6f5a2 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:44.554123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ea2a276a-46d6-4289-b3a8-f82a7cb6f5a2 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:44.588502 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ea2a276a-46d6-4289-b3a8-f82a7cb6f5a2 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 1.027299 Aug 25 13:24:44.589596 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2297/4649] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:43 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:44.624544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-202310c0-10a0-484c-9b4d-2c5fc88e3a75 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:44.637901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-202310c0-10a0-484c-9b4d-2c5fc88e3a75 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:44.701590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-202310c0-10a0-484c-9b4d-2c5fc88e3a75 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:44.704214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-202310c0-10a0-484c-9b4d-2c5fc88e3a75 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:44.716897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-202310c0-10a0-484c-9b4d-2c5fc88e3a75 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:44.719037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-202310c0-10a0-484c-9b4d-2c5fc88e3a75 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:44.723407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-202310c0-10a0-484c-9b4d-2c5fc88e3a75 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:44.724519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-202310c0-10a0-484c-9b4d-2c5fc88e3a75 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:44.779922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-95130771-ebb3-476e-b4c3-46e9311bc401 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:44.823020 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-95130771-ebb3-476e-b4c3-46e9311bc401 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1510 microversion: 2.1 time: 1.384661 Aug 25 13:24:44.862698 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2353/4650] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:43 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1510 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:45.276756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-202310c0-10a0-484c-9b4d-2c5fc88e3a75 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:45.297193 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-202310c0-10a0-484c-9b4d-2c5fc88e3a75 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1321 microversion: 2.1 time: 0.705697 Aug 25 13:24:45.310532 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2298/4651] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:44 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1321 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:45.666156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8afe9e3-02cf-4f25-b6d1-29870007409a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:45.669919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e8afe9e3-02cf-4f25-b6d1-29870007409a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:45.703803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8afe9e3-02cf-4f25-b6d1-29870007409a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:45.705034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8afe9e3-02cf-4f25-b6d1-29870007409a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:45.707755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8afe9e3-02cf-4f25-b6d1-29870007409a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:45.711936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8afe9e3-02cf-4f25-b6d1-29870007409a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:45.715173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8afe9e3-02cf-4f25-b6d1-29870007409a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:45.726214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8afe9e3-02cf-4f25-b6d1-29870007409a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:45.880481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c5e26f4d-5e9d-44f7-be4c-b75884903ec9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:45.881755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c5e26f4d-5e9d-44f7-be4c-b75884903ec9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:45.895385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5e26f4d-5e9d-44f7-be4c-b75884903ec9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:45.896852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5e26f4d-5e9d-44f7-be4c-b75884903ec9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:45.898131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5e26f4d-5e9d-44f7-be4c-b75884903ec9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:45.899958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5e26f4d-5e9d-44f7-be4c-b75884903ec9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:45.900866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5e26f4d-5e9d-44f7-be4c-b75884903ec9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:45.912257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5e26f4d-5e9d-44f7-be4c-b75884903ec9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:46.019249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:46.859811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e8afe9e3-02cf-4f25-b6d1-29870007409a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:46.913043 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e8afe9e3-02cf-4f25-b6d1-29870007409a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 1.287056 Aug 25 13:24:46.926847 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2354/4652] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:45 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:46.926847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2089e9dc-394b-46de-961f-9c824c4c3627 req-c19ba7ff-62c3-4d41-abc3-43dfc0b70313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "791bf70b-d95d-4584-9f3d-0c74e3a206ad", "tag": "681ad32b-761f-4a0a-b375-208d56229072"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:46.943310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2089e9dc-394b-46de-961f-9c824c4c3627 req-c19ba7ff-62c3-4d41-abc3-43dfc0b70313 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:46.943976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2089e9dc-394b-46de-961f-9c824c4c3627 req-c19ba7ff-62c3-4d41-abc3-43dfc0b70313 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:46.944837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2089e9dc-394b-46de-961f-9c824c4c3627 req-c19ba7ff-62c3-4d41-abc3-43dfc0b70313 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:46.965435 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2089e9dc-394b-46de-961f-9c824c4c3627 req-c19ba7ff-62c3-4d41-abc3-43dfc0b70313 service nova] Creating event network-changed:681ad32b-761f-4a0a-b375-208d56229072 for instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad on n-h2-852771-8 Aug 25 13:24:46.984540 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2089e9dc-394b-46de-961f-9c824c4c3627 req-c19ba7ff-62c3-4d41-abc3-43dfc0b70313 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068370 Aug 25 13:24:46.985853 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2355/4653] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:24:47.008070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c1c5413-36b1-44e5-a3b3-8b041b1f5968 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:47.009435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9c1c5413-36b1-44e5-a3b3-8b041b1f5968 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:47.027682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c1c5413-36b1-44e5-a3b3-8b041b1f5968 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:47.037784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c1c5413-36b1-44e5-a3b3-8b041b1f5968 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:47.038873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c1c5413-36b1-44e5-a3b3-8b041b1f5968 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:47.040449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:47.041232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c1c5413-36b1-44e5-a3b3-8b041b1f5968 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:47.042469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c1c5413-36b1-44e5-a3b3-8b041b1f5968 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:47.043652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c1c5413-36b1-44e5-a3b3-8b041b1f5968 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:47.197038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c5e26f4d-5e9d-44f7-be4c-b75884903ec9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:47.216058 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c5e26f4d-5e9d-44f7-be4c-b75884903ec9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1510 microversion: 2.1 time: 1.346180 Aug 25 13:24:47.217846 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2299/4654] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:45 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1510 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:47.677150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9c1c5413-36b1-44e5-a3b3-8b041b1f5968 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:47.698196 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c1c5413-36b1-44e5-a3b3-8b041b1f5968 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1321 microversion: 2.1 time: 0.707759 Aug 25 13:24:47.714448 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2356/4655] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:46 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1321 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:47.962284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bdfc86cd-9606-49e3-8e66-5d9d624154eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:47.963656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bdfc86cd-9606-49e3-8e66-5d9d624154eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:47.978138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdfc86cd-9606-49e3-8e66-5d9d624154eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:47.979354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdfc86cd-9606-49e3-8e66-5d9d624154eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:47.980630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdfc86cd-9606-49e3-8e66-5d9d624154eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:47.982286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdfc86cd-9606-49e3-8e66-5d9d624154eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:47.983491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdfc86cd-9606-49e3-8e66-5d9d624154eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:47.984707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdfc86cd-9606-49e3-8e66-5d9d624154eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:47.995256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=16 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:48.256618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-519e43ad-055c-4527-8f21-e810a1ef2f3f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:48.259443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-519e43ad-055c-4527-8f21-e810a1ef2f3f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:48.295920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519e43ad-055c-4527-8f21-e810a1ef2f3f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:48.300256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519e43ad-055c-4527-8f21-e810a1ef2f3f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:48.301426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519e43ad-055c-4527-8f21-e810a1ef2f3f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:48.305708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519e43ad-055c-4527-8f21-e810a1ef2f3f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:48.307385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519e43ad-055c-4527-8f21-e810a1ef2f3f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:48.308744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-519e43ad-055c-4527-8f21-e810a1ef2f3f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:48.322574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:48.362932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bdfc86cd-9606-49e3-8e66-5d9d624154eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:48.394943 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bdfc86cd-9606-49e3-8e66-5d9d624154eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 0.443907 Aug 25 13:24:48.397843 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2300/4656] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:47 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:48.690161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-519e43ad-055c-4527-8f21-e810a1ef2f3f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:48.709712 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-519e43ad-055c-4527-8f21-e810a1ef2f3f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1516 microversion: 2.1 time: 0.467267 Aug 25 13:24:48.710854 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2357/4657] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:48 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1516 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:48.750592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0dcc68af-07c2-4fe4-80cf-63b373086196 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:48.754073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0dcc68af-07c2-4fe4-80cf-63b373086196 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:48.766118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dcc68af-07c2-4fe4-80cf-63b373086196 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:48.767563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dcc68af-07c2-4fe4-80cf-63b373086196 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:48.770178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dcc68af-07c2-4fe4-80cf-63b373086196 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:48.773982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dcc68af-07c2-4fe4-80cf-63b373086196 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:48.774999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dcc68af-07c2-4fe4-80cf-63b373086196 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:48.775901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dcc68af-07c2-4fe4-80cf-63b373086196 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:49.462953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-682eb41b-ec9b-4ee3-86dd-df8eb723d672 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:49.464646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-682eb41b-ec9b-4ee3-86dd-df8eb723d672 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:49.485481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0dcc68af-07c2-4fe4-80cf-63b373086196 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:49.515823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-682eb41b-ec9b-4ee3-86dd-df8eb723d672 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:49.521867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-682eb41b-ec9b-4ee3-86dd-df8eb723d672 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:49.526572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-682eb41b-ec9b-4ee3-86dd-df8eb723d672 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:49.529208 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0dcc68af-07c2-4fe4-80cf-63b373086196 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1321 microversion: 2.1 time: 0.799031 Aug 25 13:24:49.532497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-682eb41b-ec9b-4ee3-86dd-df8eb723d672 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:49.538153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-682eb41b-ec9b-4ee3-86dd-df8eb723d672 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:49.573807 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2301/4658] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:48 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1321 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:49.575215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-682eb41b-ec9b-4ee3-86dd-df8eb723d672 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:50.112475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-682eb41b-ec9b-4ee3-86dd-df8eb723d672 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:50.136775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-682eb41b-ec9b-4ee3-86dd-df8eb723d672 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 0.703727 Aug 25 13:24:50.137885 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2358/4659] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:49 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:50.601297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-91213d78-c6af-4536-9db4-82444478288b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:50.603047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-91213d78-c6af-4536-9db4-82444478288b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:50.652056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91213d78-c6af-4536-9db4-82444478288b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:50.653499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91213d78-c6af-4536-9db4-82444478288b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:50.660577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91213d78-c6af-4536-9db4-82444478288b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:50.662850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91213d78-c6af-4536-9db4-82444478288b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:50.666965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91213d78-c6af-4536-9db4-82444478288b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:50.668473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91213d78-c6af-4536-9db4-82444478288b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:51.141223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-91213d78-c6af-4536-9db4-82444478288b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:51.162805 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-91213d78-c6af-4536-9db4-82444478288b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1321 microversion: 2.1 time: 0.572454 Aug 25 13:24:51.176743 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2302/4660] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:50 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1321 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:51.184231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3b2c37a-68b1-40ac-b1b0-a4ff4aa50d7b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:51.191390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c3b2c37a-68b1-40ac-b1b0-a4ff4aa50d7b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:51.216675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b2c37a-68b1-40ac-b1b0-a4ff4aa50d7b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:51.218682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b2c37a-68b1-40ac-b1b0-a4ff4aa50d7b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:51.220221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b2c37a-68b1-40ac-b1b0-a4ff4aa50d7b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:51.222557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b2c37a-68b1-40ac-b1b0-a4ff4aa50d7b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:51.224803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b2c37a-68b1-40ac-b1b0-a4ff4aa50d7b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:51.226236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3b2c37a-68b1-40ac-b1b0-a4ff4aa50d7b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:51.905851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c3b2c37a-68b1-40ac-b1b0-a4ff4aa50d7b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:51.952751 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3b2c37a-68b1-40ac-b1b0-a4ff4aa50d7b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 0.783188 Aug 25 13:24:51.958791 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2359/4661] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:51 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:52.219200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-079f0e37-28dc-462c-9c9f-f7c7a2fdba71 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:52.223322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-079f0e37-28dc-462c-9c9f-f7c7a2fdba71 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:52.246257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079f0e37-28dc-462c-9c9f-f7c7a2fdba71 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:52.247212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079f0e37-28dc-462c-9c9f-f7c7a2fdba71 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:52.247961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079f0e37-28dc-462c-9c9f-f7c7a2fdba71 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:52.254019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079f0e37-28dc-462c-9c9f-f7c7a2fdba71 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:52.254926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079f0e37-28dc-462c-9c9f-f7c7a2fdba71 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:52.257872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-079f0e37-28dc-462c-9c9f-f7c7a2fdba71 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:52.431903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f10a86f6-bae5-4a0b-8fa7-5031b7afe37d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'create', calling method: .version_select at 0x7f3a2e8cd790>, body: {"keypair": {"name": "tempest-keypair-936707663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDU2yPbR8clIxNFCfSOjBbi39y2oK9Y8EQr1qmLngKqnXUvItIRGvWzlkni4Yqw3CVWFUd3Q+xTCY0LH6I9W/fBtpVeLqv8jn/uW5BZ/Tfp4rhzmMke6O73IKMYlaOHiA=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:52.523255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f10a86f6-bae5-4a0b-8fa7-5031b7afe37d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Getting quotas for project dec483f5c53b44c1a52917920b891b9c. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:24:52.536558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-f10a86f6-bae5-4a0b-8fa7-5031b7afe37d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Getting quotas for user 1552e098ea6f4d28abd9606fe9433000 and project dec483f5c53b44c1a52917920b891b9c. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:24:52.620917 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f10a86f6-bae5-4a0b-8fa7-5031b7afe37d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.201297 Aug 25 13:24:52.625650 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2360/4662] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:24:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:24:52.752591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-079f0e37-28dc-462c-9c9f-f7c7a2fdba71 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:52.790702 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-079f0e37-28dc-462c-9c9f-f7c7a2fdba71 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1321 microversion: 2.1 time: 0.579226 Aug 25 13:24:52.794266 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2303/4663] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:52 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1321 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:52.996262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c44ce370-0d14-43e1-bf52-4574e8664a4f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:53.002346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c44ce370-0d14-43e1-bf52-4574e8664a4f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:53.029033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c44ce370-0d14-43e1-bf52-4574e8664a4f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:53.030260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c44ce370-0d14-43e1-bf52-4574e8664a4f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:53.034217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c44ce370-0d14-43e1-bf52-4574e8664a4f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:53.046157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c44ce370-0d14-43e1-bf52-4574e8664a4f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:53.047230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c44ce370-0d14-43e1-bf52-4574e8664a4f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:53.048049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c44ce370-0d14-43e1-bf52-4574e8664a4f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:53.609974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c44ce370-0d14-43e1-bf52-4574e8664a4f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:53.627470 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c44ce370-0d14-43e1-bf52-4574e8664a4f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 0.638747 Aug 25 13:24:53.630063 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2361/4664] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:52 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:53.842414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b5282a8-815e-4744-93df-b4bd316457c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:53.843791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b5282a8-815e-4744-93df-b4bd316457c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:53.861001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5282a8-815e-4744-93df-b4bd316457c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:53.863861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5282a8-815e-4744-93df-b4bd316457c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:53.865356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5282a8-815e-4744-93df-b4bd316457c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:53.867422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5282a8-815e-4744-93df-b4bd316457c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:53.869254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5282a8-815e-4744-93df-b4bd316457c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:53.871858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b5282a8-815e-4744-93df-b4bd316457c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:54.275359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b5282a8-815e-4744-93df-b4bd316457c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:54.310484 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b5282a8-815e-4744-93df-b4bd316457c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1321 microversion: 2.1 time: 0.478181 Aug 25 13:24:54.311601 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2304/4665] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:53 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:54.682223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1286279b-9e92-402d-b17d-9c8f2d2e30b5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:54.683459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1286279b-9e92-402d-b17d-9c8f2d2e30b5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:54.711855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1286279b-9e92-402d-b17d-9c8f2d2e30b5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:54.714090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1286279b-9e92-402d-b17d-9c8f2d2e30b5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:54.716960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1286279b-9e92-402d-b17d-9c8f2d2e30b5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:54.724540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1286279b-9e92-402d-b17d-9c8f2d2e30b5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:54.727646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1286279b-9e92-402d-b17d-9c8f2d2e30b5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:54.733494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1286279b-9e92-402d-b17d-9c8f2d2e30b5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:55.364685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d3805133-a6eb-4235-8cc9-c5a5b9e68816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:55.367159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d3805133-a6eb-4235-8cc9-c5a5b9e68816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:55.385622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3805133-a6eb-4235-8cc9-c5a5b9e68816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:55.386822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3805133-a6eb-4235-8cc9-c5a5b9e68816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:55.387556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3805133-a6eb-4235-8cc9-c5a5b9e68816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:55.387765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1286279b-9e92-402d-b17d-9c8f2d2e30b5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:55.388784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3805133-a6eb-4235-8cc9-c5a5b9e68816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:55.389620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3805133-a6eb-4235-8cc9-c5a5b9e68816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:55.390438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d3805133-a6eb-4235-8cc9-c5a5b9e68816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:55.414029 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1286279b-9e92-402d-b17d-9c8f2d2e30b5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 0.739763 Aug 25 13:24:55.426837 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2362/4666] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:54 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:56.009305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d3805133-a6eb-4235-8cc9-c5a5b9e68816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:56.039270 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d3805133-a6eb-4235-8cc9-c5a5b9e68816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1321 microversion: 2.1 time: 0.690381 Aug 25 13:24:56.043682 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2305/4667] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:55 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1321 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:56.472012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a9fd15f-c380-45f7-a49a-5c38b8b241cc tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:56.473128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a9fd15f-c380-45f7-a49a-5c38b8b241cc tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:56.498132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fd15f-c380-45f7-a49a-5c38b8b241cc tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:56.499538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fd15f-c380-45f7-a49a-5c38b8b241cc tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:56.500624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fd15f-c380-45f7-a49a-5c38b8b241cc tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:56.502622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fd15f-c380-45f7-a49a-5c38b8b241cc tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:56.503848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fd15f-c380-45f7-a49a-5c38b8b241cc tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:56.505019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a9fd15f-c380-45f7-a49a-5c38b8b241cc tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:56.962667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-34927c80-d51b-425f-90a6-e033e5db28a5 req-8f83df19-d17e-480e-ae14-b9ecbf8ba34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791bf70b-d95d-4584-9f3d-0c74e3a206ad", "name": "network-vif-plugged", "status": "completed", "tag": "681ad32b-761f-4a0a-b375-208d56229072"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:57.027733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-34927c80-d51b-425f-90a6-e033e5db28a5 req-8f83df19-d17e-480e-ae14-b9ecbf8ba34d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:57.028064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-34927c80-d51b-425f-90a6-e033e5db28a5 req-8f83df19-d17e-480e-ae14-b9ecbf8ba34d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:57.028813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-34927c80-d51b-425f-90a6-e033e5db28a5 req-8f83df19-d17e-480e-ae14-b9ecbf8ba34d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:57.109672 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-34927c80-d51b-425f-90a6-e033e5db28a5 req-8f83df19-d17e-480e-ae14-b9ecbf8ba34d service nova] Creating event network-vif-plugged:681ad32b-761f-4a0a-b375-208d56229072 for instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad on n-h2-852771-8 Aug 25 13:24:57.136679 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-34927c80-d51b-425f-90a6-e033e5db28a5 req-8f83df19-d17e-480e-ae14-b9ecbf8ba34d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174488 Aug 25 13:24:57.141850 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2306/4668] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:24:57.170315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d7bdcb84-54ee-45e5-8fcb-501145cfde11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:57.174258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d7bdcb84-54ee-45e5-8fcb-501145cfde11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:57.199413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7bdcb84-54ee-45e5-8fcb-501145cfde11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:57.200353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7bdcb84-54ee-45e5-8fcb-501145cfde11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:57.205860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7bdcb84-54ee-45e5-8fcb-501145cfde11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:57.223820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7bdcb84-54ee-45e5-8fcb-501145cfde11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:57.224738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7bdcb84-54ee-45e5-8fcb-501145cfde11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:57.229046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7bdcb84-54ee-45e5-8fcb-501145cfde11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:58.102284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a9fd15f-c380-45f7-a49a-5c38b8b241cc tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:58.110596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d7bdcb84-54ee-45e5-8fcb-501145cfde11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:58.141986 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d7bdcb84-54ee-45e5-8fcb-501145cfde11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1321 microversion: 2.1 time: 0.993074 Aug 25 13:24:58.142877 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a9fd15f-c380-45f7-a49a-5c38b8b241cc tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 1.679182 Aug 25 13:24:58.144969 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2307/4669] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:57 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1321 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:58.158793 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2363/4670] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:56 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:59.191664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-588a7e2e-460f-48b0-932c-927c94f717c1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:59.192662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-92fde4f2-6e48-430d-91b2-1a7b3d1a9ddf tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:59.194198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-588a7e2e-460f-48b0-932c-927c94f717c1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:59.195773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-92fde4f2-6e48-430d-91b2-1a7b3d1a9ddf tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:59.210772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92fde4f2-6e48-430d-91b2-1a7b3d1a9ddf tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:59.212186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92fde4f2-6e48-430d-91b2-1a7b3d1a9ddf tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:59.213393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92fde4f2-6e48-430d-91b2-1a7b3d1a9ddf tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:59.214809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-588a7e2e-460f-48b0-932c-927c94f717c1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:59.215663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92fde4f2-6e48-430d-91b2-1a7b3d1a9ddf tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:59.216480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-588a7e2e-460f-48b0-932c-927c94f717c1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:59.217402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92fde4f2-6e48-430d-91b2-1a7b3d1a9ddf tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:59.217970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-588a7e2e-460f-48b0-932c-927c94f717c1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:59.221233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-588a7e2e-460f-48b0-932c-927c94f717c1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:59.223967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-588a7e2e-460f-48b0-932c-927c94f717c1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:59.226049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-588a7e2e-460f-48b0-932c-927c94f717c1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:59.227372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-92fde4f2-6e48-430d-91b2-1a7b3d1a9ddf tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:59.710514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-92fde4f2-6e48-430d-91b2-1a7b3d1a9ddf tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:59.739548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-588a7e2e-460f-48b0-932c-927c94f717c1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:59.749424 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-92fde4f2-6e48-430d-91b2-1a7b3d1a9ddf tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 0.566543 Aug 25 13:24:59.750596 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2364/4671] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:59 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:59.755539 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-588a7e2e-460f-48b0-932c-927c94f717c1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1321 microversion: 2.1 time: 0.574312 Aug 25 13:24:59.769413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1278248752", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "654ddcb2-d178-447d-a53e-fa9cabb5cdef"}], "security_groups": [{"name": "tempest-securitygroup--1773834955"}], "key_name": "tempest-keypair-936707663", "user_data": "}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:59.777381 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2308/4672] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:59 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:59.788454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-abff60a2-75a2-4847-a040-38e5d69491c9 req-1db48b9a-7793-43c0-8fd5-74208f343d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2166b072-a2e3-469f-b49a-ac99195a5827", "name": "network-vif-plugged", "status": "completed", "tag": "a1978be4-1d77-48fd-bcc9-8ff374eb81e7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:59.810549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-abff60a2-75a2-4847-a040-38e5d69491c9 req-1db48b9a-7793-43c0-8fd5-74208f343d0e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:59.812034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-abff60a2-75a2-4847-a040-38e5d69491c9 req-1db48b9a-7793-43c0-8fd5-74208f343d0e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:59.813400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-abff60a2-75a2-4847-a040-38e5d69491c9 req-1db48b9a-7793-43c0-8fd5-74208f343d0e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:59.838968 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-abff60a2-75a2-4847-a040-38e5d69491c9 req-1db48b9a-7793-43c0-8fd5-74208f343d0e service nova] Creating event network-vif-plugged:a1978be4-1d77-48fd-bcc9-8ff374eb81e7 for instance 2166b072-a2e3-469f-b49a-ac99195a5827 on n-h1-852771-8 Aug 25 13:24:59.849957 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-abff60a2-75a2-4847-a040-38e5d69491c9 req-1db48b9a-7793-43c0-8fd5-74208f343d0e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069968 Aug 25 13:24:59.856867 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2309/4673] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:24:59.996095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] validate_networks() for [('654ddcb2-d178-447d-a53e-fa9cabb5cdef', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:25:00.791031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-93bbab50-de68-44ef-9a92-f48bed6acfa5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:00.792401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-93bbab50-de68-44ef-9a92-f48bed6acfa5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:00.812997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93bbab50-de68-44ef-9a92-f48bed6acfa5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:00.815992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93bbab50-de68-44ef-9a92-f48bed6acfa5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:00.817097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93bbab50-de68-44ef-9a92-f48bed6acfa5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:00.818507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93bbab50-de68-44ef-9a92-f48bed6acfa5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:00.819569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93bbab50-de68-44ef-9a92-f48bed6acfa5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:00.820678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-93bbab50-de68-44ef-9a92-f48bed6acfa5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:01.059200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:25:01.061125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:25:01.062229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:25:01.063890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:25:01.065654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:25:01.100860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:01.103668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:01.104946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:01.107804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:01.109788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:01.112384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:01.194511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-93bbab50-de68-44ef-9a92-f48bed6acfa5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:01.195564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Getting quotas for project dec483f5c53b44c1a52917920b891b9c. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:25:01.210034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Getting quotas for user 1552e098ea6f4d28abd9606fe9433000 and project dec483f5c53b44c1a52917920b891b9c. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:25:01.218741 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-93bbab50-de68-44ef-9a92-f48bed6acfa5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1362 microversion: 2.1 time: 0.436533 Aug 25 13:25:01.220967 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2310/4674] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:00 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:01.248869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e76238e-7b24-462d-9bbc-4eed32b4c145 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:01.250801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e76238e-7b24-462d-9bbc-4eed32b4c145 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:01.271857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e76238e-7b24-462d-9bbc-4eed32b4c145 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:01.277353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:25:01.284026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e76238e-7b24-462d-9bbc-4eed32b4c145 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:01.285268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e76238e-7b24-462d-9bbc-4eed32b4c145 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:01.285684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:25:01.295233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e76238e-7b24-462d-9bbc-4eed32b4c145 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:01.298477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e76238e-7b24-462d-9bbc-4eed32b4c145 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:01.299797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e76238e-7b24-462d-9bbc-4eed32b4c145 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:01.467366 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8cafbf3f-14c1-4548-b00a-d3b8ed6ddeaf tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.713329 Aug 25 13:25:01.469385 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2365/4675] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:24:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:25:01.492970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a2a641d6-d440-482f-a962-f39aeead57cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:01.505271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a2a641d6-d440-482f-a962-f39aeead57cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:01.852153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a2a641d6-d440-482f-a962-f39aeead57cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:01.894136 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a2a641d6-d440-482f-a962-f39aeead57cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1245 microversion: 2.1 time: 0.409111 Aug 25 13:25:01.898847 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2366/4676] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:01 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1245 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:01.995282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e76238e-7b24-462d-9bbc-4eed32b4c145 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:02.043827 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e76238e-7b24-462d-9bbc-4eed32b4c145 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1500 microversion: 2.1 time: 0.817801 Aug 25 13:25:02.047179 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2311/4677] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:01 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1500 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:02.102249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e981f3a1-f20f-42ba-8156-cb63492b2fcc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:02.104658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e981f3a1-f20f-42ba-8156-cb63492b2fcc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:02.133789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e981f3a1-f20f-42ba-8156-cb63492b2fcc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:02.134655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e981f3a1-f20f-42ba-8156-cb63492b2fcc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:02.135454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e981f3a1-f20f-42ba-8156-cb63492b2fcc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:02.149736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e981f3a1-f20f-42ba-8156-cb63492b2fcc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:02.150621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e981f3a1-f20f-42ba-8156-cb63492b2fcc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:02.151616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e981f3a1-f20f-42ba-8156-cb63492b2fcc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:02.318445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-960bd989-a845-4388-8f6e-399c6aa778a5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:02.319891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-960bd989-a845-4388-8f6e-399c6aa778a5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:02.356055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960bd989-a845-4388-8f6e-399c6aa778a5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:02.358424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960bd989-a845-4388-8f6e-399c6aa778a5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:02.360122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960bd989-a845-4388-8f6e-399c6aa778a5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:02.363843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960bd989-a845-4388-8f6e-399c6aa778a5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:02.366153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960bd989-a845-4388-8f6e-399c6aa778a5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:02.367927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960bd989-a845-4388-8f6e-399c6aa778a5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:03.038075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e981f3a1-f20f-42ba-8156-cb63492b2fcc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:03.075362 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e981f3a1-f20f-42ba-8156-cb63492b2fcc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1500 microversion: 2.1 time: 0.984545 Aug 25 13:25:03.081049 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2367/4678] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:02 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1500 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:03.108391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0056f298-aef8-4473-9d65-9b259befe4d3 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:03.115335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0056f298-aef8-4473-9d65-9b259befe4d3 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:03.141447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-960bd989-a845-4388-8f6e-399c6aa778a5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:03.165629 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-960bd989-a845-4388-8f6e-399c6aa778a5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1548 microversion: 2.1 time: 0.889710 Aug 25 13:25:03.195771 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2312/4679] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:02 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1548 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:03.229803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8f96b15-c50c-4143-af4b-8e415b337a3e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:03.231089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8f96b15-c50c-4143-af4b-8e415b337a3e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:03.245061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8f96b15-c50c-4143-af4b-8e415b337a3e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:03.246373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8f96b15-c50c-4143-af4b-8e415b337a3e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:03.247482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8f96b15-c50c-4143-af4b-8e415b337a3e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:03.249976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8f96b15-c50c-4143-af4b-8e415b337a3e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:03.251350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8f96b15-c50c-4143-af4b-8e415b337a3e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:03.252966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8f96b15-c50c-4143-af4b-8e415b337a3e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:03.375892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8f96b15-c50c-4143-af4b-8e415b337a3e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:25:03.395843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0056f298-aef8-4473-9d65-9b259befe4d3 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:03.423775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0056f298-aef8-4473-9d65-9b259befe4d3 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1245 microversion: 2.1 time: 0.340111 Aug 25 13:25:03.425647 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2368/4680] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:03 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1245 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:03.464635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-27951d32-52bd-4ec1-887a-ca7909b66ac8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:03.465610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-27951d32-52bd-4ec1-887a-ca7909b66ac8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:03.486178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27951d32-52bd-4ec1-887a-ca7909b66ac8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:03.487183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27951d32-52bd-4ec1-887a-ca7909b66ac8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:03.487985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27951d32-52bd-4ec1-887a-ca7909b66ac8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:03.489714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27951d32-52bd-4ec1-887a-ca7909b66ac8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:03.491165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27951d32-52bd-4ec1-887a-ca7909b66ac8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:03.492552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27951d32-52bd-4ec1-887a-ca7909b66ac8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:03.679180 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8f96b15-c50c-4143-af4b-8e415b337a3e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 204 len: 0 microversion: 2.1 time: 0.478503 Aug 25 13:25:03.682200 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2313/4681] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:25:03 2022] DELETE /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:25:03.700191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e84e665-9a13-4713-a3e3-1894511196b3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:03.703448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6e84e665-9a13-4713-a3e3-1894511196b3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:03.719070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e84e665-9a13-4713-a3e3-1894511196b3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:03.720554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e84e665-9a13-4713-a3e3-1894511196b3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:03.721876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e84e665-9a13-4713-a3e3-1894511196b3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:03.723783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e84e665-9a13-4713-a3e3-1894511196b3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:03.725050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e84e665-9a13-4713-a3e3-1894511196b3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:03.726262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e84e665-9a13-4713-a3e3-1894511196b3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:03.765816 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-27951d32-52bd-4ec1-887a-ca7909b66ac8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.314903 Aug 25 13:25:03.768017 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2369/4682] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:25:03 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/os-interface => generated 284 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:04.441529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e84e665-9a13-4713-a3e3-1894511196b3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:04.476343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac34f115-1c4e-4b73-b8ab-3decbaecf246 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:04.476343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ac34f115-1c4e-4b73-b8ab-3decbaecf246 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:04.492259 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6e84e665-9a13-4713-a3e3-1894511196b3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1506 microversion: 2.1 time: 0.802809 Aug 25 13:25:04.505747 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2314/4683] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:03 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1506 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:04.514227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac34f115-1c4e-4b73-b8ab-3decbaecf246 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:04.516007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac34f115-1c4e-4b73-b8ab-3decbaecf246 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:04.527114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac34f115-1c4e-4b73-b8ab-3decbaecf246 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:04.530364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac34f115-1c4e-4b73-b8ab-3decbaecf246 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:04.533462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac34f115-1c4e-4b73-b8ab-3decbaecf246 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:04.540497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac34f115-1c4e-4b73-b8ab-3decbaecf246 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:05.018027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ac34f115-1c4e-4b73-b8ab-3decbaecf246 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:05.053719 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ac34f115-1c4e-4b73-b8ab-3decbaecf246 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1297 microversion: 2.1 time: 0.594453 Aug 25 13:25:05.088321 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2370/4684] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:04 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1297 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:05.558197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-891491c1-a066-4033-a87a-1012c54ed226 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:05.563783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-891491c1-a066-4033-a87a-1012c54ed226 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:05.594583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-891491c1-a066-4033-a87a-1012c54ed226 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:05.601560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-891491c1-a066-4033-a87a-1012c54ed226 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:05.606276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-891491c1-a066-4033-a87a-1012c54ed226 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:05.609772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-891491c1-a066-4033-a87a-1012c54ed226 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:05.611129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-891491c1-a066-4033-a87a-1012c54ed226 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:05.614967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-891491c1-a066-4033-a87a-1012c54ed226 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:05.695786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:06.120392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e367959c-d4e1-417e-836e-feb866e1fb69 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:06.128910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e367959c-d4e1-417e-836e-feb866e1fb69 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:06.135292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-891491c1-a066-4033-a87a-1012c54ed226 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:06.162880 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-891491c1-a066-4033-a87a-1012c54ed226 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1506 microversion: 2.1 time: 0.615648 Aug 25 13:25:06.176116 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2315/4685] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:05 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:06.181675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e367959c-d4e1-417e-836e-feb866e1fb69 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:06.183754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e367959c-d4e1-417e-836e-feb866e1fb69 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:06.186019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e367959c-d4e1-417e-836e-feb866e1fb69 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:06.190323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e367959c-d4e1-417e-836e-feb866e1fb69 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:06.195865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e367959c-d4e1-417e-836e-feb866e1fb69 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:06.196077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e367959c-d4e1-417e-836e-feb866e1fb69 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:06.948160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e367959c-d4e1-417e-836e-feb866e1fb69 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:06.966906 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e367959c-d4e1-417e-836e-feb866e1fb69 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1303 microversion: 2.1 time: 0.861579 Aug 25 13:25:06.969101 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2371/4686] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:06 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1303 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:07.221794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-07d07aec-8a24-4208-b460-751a5352e925 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:07.223102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-07d07aec-8a24-4208-b460-751a5352e925 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:07.230111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:07.244934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07d07aec-8a24-4208-b460-751a5352e925 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:07.246864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07d07aec-8a24-4208-b460-751a5352e925 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:07.248207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07d07aec-8a24-4208-b460-751a5352e925 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:07.250682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07d07aec-8a24-4208-b460-751a5352e925 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:07.252677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07d07aec-8a24-4208-b460-751a5352e925 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:07.253666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07d07aec-8a24-4208-b460-751a5352e925 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:07.746806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-07d07aec-8a24-4208-b460-751a5352e925 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:07.763632 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-07d07aec-8a24-4208-b460-751a5352e925 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1506 microversion: 2.1 time: 0.551453 Aug 25 13:25:07.764917 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2316/4687] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:07 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:08.005920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2f25b6c-725f-45ea-88e1-5379e37107d4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:08.007258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b2f25b6c-725f-45ea-88e1-5379e37107d4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:08.019178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:08.022283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2f25b6c-725f-45ea-88e1-5379e37107d4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:08.023694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2f25b6c-725f-45ea-88e1-5379e37107d4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:08.025112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2f25b6c-725f-45ea-88e1-5379e37107d4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:08.027123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2f25b6c-725f-45ea-88e1-5379e37107d4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:08.028393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2f25b6c-725f-45ea-88e1-5379e37107d4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:08.029894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2f25b6c-725f-45ea-88e1-5379e37107d4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:08.832274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b2f25b6c-725f-45ea-88e1-5379e37107d4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:08.837461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-23bde8f4-742e-4f42-aecb-275a7cbe2751 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:08.838828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-23bde8f4-742e-4f42-aecb-275a7cbe2751 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:08.877681 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2f25b6c-725f-45ea-88e1-5379e37107d4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1371 microversion: 2.1 time: 0.878573 Aug 25 13:25:08.878658 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2372/4688] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:07 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1371 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:08.890554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23bde8f4-742e-4f42-aecb-275a7cbe2751 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:08.894596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23bde8f4-742e-4f42-aecb-275a7cbe2751 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:08.896666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23bde8f4-742e-4f42-aecb-275a7cbe2751 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:08.898513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23bde8f4-742e-4f42-aecb-275a7cbe2751 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:08.899865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23bde8f4-742e-4f42-aecb-275a7cbe2751 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:08.911597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23bde8f4-742e-4f42-aecb-275a7cbe2751 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:08.983701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f456fbd9-4186-4f63-920b-a1ad8cd4e2b3 req-deeb4a65-e0b2-4476-94da-46f399b2696e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791bf70b-d95d-4584-9f3d-0c74e3a206ad", "name": "network-vif-deleted", "tag": "681ad32b-761f-4a0a-b375-208d56229072"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:09.055570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f456fbd9-4186-4f63-920b-a1ad8cd4e2b3 req-deeb4a65-e0b2-4476-94da-46f399b2696e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:09.063552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f456fbd9-4186-4f63-920b-a1ad8cd4e2b3 req-deeb4a65-e0b2-4476-94da-46f399b2696e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:09.065331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f456fbd9-4186-4f63-920b-a1ad8cd4e2b3 req-deeb4a65-e0b2-4476-94da-46f399b2696e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:09.125198 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f456fbd9-4186-4f63-920b-a1ad8cd4e2b3 req-deeb4a65-e0b2-4476-94da-46f399b2696e service nova] Creating event network-vif-deleted:681ad32b-761f-4a0a-b375-208d56229072 for instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad on n-h2-852771-8 Aug 25 13:25:09.159809 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f456fbd9-4186-4f63-920b-a1ad8cd4e2b3 req-deeb4a65-e0b2-4476-94da-46f399b2696e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193660 Aug 25 13:25:09.161369 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2373/4689] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 25 13:25:09.352200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-23bde8f4-742e-4f42-aecb-275a7cbe2751 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:09.383440 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-23bde8f4-742e-4f42-aecb-275a7cbe2751 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 200 len: 1306 microversion: 2.1 time: 0.573177 Aug 25 13:25:09.385211 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2317/4690] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:08 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 1306 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:09.940793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cfff7746-4d7d-44ef-86d3-e5c5c335fe84 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:09.946001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cfff7746-4d7d-44ef-86d3-e5c5c335fe84 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:09.970376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfff7746-4d7d-44ef-86d3-e5c5c335fe84 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:09.973672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfff7746-4d7d-44ef-86d3-e5c5c335fe84 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:09.977552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfff7746-4d7d-44ef-86d3-e5c5c335fe84 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:09.982139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfff7746-4d7d-44ef-86d3-e5c5c335fe84 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:09.983075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfff7746-4d7d-44ef-86d3-e5c5c335fe84 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:09.990407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfff7746-4d7d-44ef-86d3-e5c5c335fe84 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:10.435728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:10.442459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:10.478551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:10.479797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:10.484342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:10.491255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:10.493961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:10.497476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:10.574456 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad HTTP/1.1 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '791bf70b-d95d-4584-9f3d-0c74e3a206ad'} Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:25:10.582414 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:25:10.602405 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:25:10.602405 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:25:10.602405 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:25:10.602405 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:25:10.602405 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:25:10.602405 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:25:10.602405 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:25:10.602405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:25:10.602405 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5e85c69e-e487-4493-b83a-7be53926ab58 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 404 len: 111 microversion: 2.1 time: 0.161366 Aug 25 13:25:10.602405 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2318/4691] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:10 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:25:10.630339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72008e5b-594b-4cf1-a661-9d11b6642f0a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'create', calling method: .version_select at 0x7f3a2a41e790>, body: {"keypair": {"name": "tempest-key-1361548709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTpkE3IvtIRTw1lXxhZ+agJhxBhkKS+lmNiccpUDA18KiOBdeiAe9YH8SVZq58WPXS6SeWI8ayGWXyX4yFpXZO2zHGvZ5gQ71w8NU5GWCg4MKGN6CsVKXxEuvMjEn3Bww=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:10.683158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cfff7746-4d7d-44ef-86d3-e5c5c335fe84 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:10.687596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-72008e5b-594b-4cf1-a661-9d11b6642f0a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:25:10.709686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-72008e5b-594b-4cf1-a661-9d11b6642f0a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for user bd7b1570a27f4ea8ad560ce25225cf02 and project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:25:10.710523 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cfff7746-4d7d-44ef-86d3-e5c5c335fe84 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1371 microversion: 2.1 time: 0.784909 Aug 25 13:25:10.734985 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2374/4692] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:09 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1371 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:10.793818 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72008e5b-594b-4cf1-a661-9d11b6642f0a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.188114 Aug 25 13:25:10.797991 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2319/4693] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:25:10 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:10.819675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6df80442-60d9-4ce7-8425-8f34f76b31e0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '.version_select at 0x7f3a2e81e040>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:10.837938 n-d-852771-8 devstack@n-api.service[129060]: WARNING oslo_db.sqlalchemy.utils [None req-6df80442-60d9-4ce7-8425-8f34f76b31e0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 13:25:10.865560 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6df80442-60d9-4ce7-8425-8f34f76b31e0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.057173 Aug 25 13:25:10.868720 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2375/4694] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Aug 25 13:25:10 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:11.014722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-118cab71-edd4-4158-9b53-8ad6f4c19820 req-35768479-d7ee-4eda-b590-96be8d3332d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991f22c6-27c5-471a-b485-90f6ea7d9fcc", "tag": "71d03996-bd44-44cc-ab61-997d2db0e057"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:11.066718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-118cab71-edd4-4158-9b53-8ad6f4c19820 req-35768479-d7ee-4eda-b590-96be8d3332d6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:11.070725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-118cab71-edd4-4158-9b53-8ad6f4c19820 req-35768479-d7ee-4eda-b590-96be8d3332d6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:11.072244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-118cab71-edd4-4158-9b53-8ad6f4c19820 req-35768479-d7ee-4eda-b590-96be8d3332d6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:11.149766 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-118cab71-edd4-4158-9b53-8ad6f4c19820 req-35768479-d7ee-4eda-b590-96be8d3332d6 service nova] Creating event network-changed:71d03996-bd44-44cc-ab61-997d2db0e057 for instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc on n-h1-852771-8 Aug 25 13:25:11.162985 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-118cab71-edd4-4158-9b53-8ad6f4c19820 req-35768479-d7ee-4eda-b590-96be8d3332d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158889 Aug 25 13:25:11.164629 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2320/4695] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:11.276265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-958754026", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "key_name": "tempest-key-1361548709", "networks": [{"uuid": "0fc430fe-72c2-45e0-a5f2-bac853189a57"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:11.297554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6ac41c68-6121-4ba2-aeb4-9c630d01c35b req-e60f79ff-6523-4960-8be8-bc0370d79357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2166b072-a2e3-469f-b49a-ac99195a5827", "tag": "a1978be4-1d77-48fd-bcc9-8ff374eb81e7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:11.343383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6ac41c68-6121-4ba2-aeb4-9c630d01c35b req-e60f79ff-6523-4960-8be8-bc0370d79357 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:11.346139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6ac41c68-6121-4ba2-aeb4-9c630d01c35b req-e60f79ff-6523-4960-8be8-bc0370d79357 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:11.348603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6ac41c68-6121-4ba2-aeb4-9c630d01c35b req-e60f79ff-6523-4960-8be8-bc0370d79357 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:11.367690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:11.423070 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6ac41c68-6121-4ba2-aeb4-9c630d01c35b req-e60f79ff-6523-4960-8be8-bc0370d79357 service nova] Creating event network-changed:a1978be4-1d77-48fd-bcc9-8ff374eb81e7 for instance 2166b072-a2e3-469f-b49a-ac99195a5827 on n-h1-852771-8 Aug 25 13:25:11.450339 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6ac41c68-6121-4ba2-aeb4-9c630d01c35b req-e60f79ff-6523-4960-8be8-bc0370d79357 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167360 Aug 25 13:25:11.457631 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2321/4696] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:11.510945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] validate_networks() for [('0fc430fe-72c2-45e0-a5f2-bac853189a57', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:25:11.764327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d9ed593c-216b-4824-ae7e-b5fa3f718989 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:11.769537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d9ed593c-216b-4824-ae7e-b5fa3f718989 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:11.804961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9ed593c-216b-4824-ae7e-b5fa3f718989 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:11.810667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9ed593c-216b-4824-ae7e-b5fa3f718989 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:11.811521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9ed593c-216b-4824-ae7e-b5fa3f718989 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:11.813763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9ed593c-216b-4824-ae7e-b5fa3f718989 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:11.815438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9ed593c-216b-4824-ae7e-b5fa3f718989 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:11.816697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9ed593c-216b-4824-ae7e-b5fa3f718989 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:12.711852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d9ed593c-216b-4824-ae7e-b5fa3f718989 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:12.755375 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d9ed593c-216b-4824-ae7e-b5fa3f718989 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1371 microversion: 2.1 time: 1.005284 Aug 25 13:25:12.759185 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2322/4697] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:11 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1371 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:13.331189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:25:13.332499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:25:13.333655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:25:13.334912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:25:13.336189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:25:13.357262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:13.359068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:13.361223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:13.363077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:13.364494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:13.366786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:13.421234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:25:13.437558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for user bd7b1570a27f4ea8ad560ce25225cf02 and project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:25:13.480035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:25:13.490594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:25:13.674738 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e6481d9d-cecd-4e5d-8faf-e66b67efe740 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.407691 Aug 25 13:25:13.678894 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2376/4698] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:25:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:25:13.731710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-107d8b8c-c382-4430-9997-c1e7b9bedc11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:13.741838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-107d8b8c-c382-4430-9997-c1e7b9bedc11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:13.795086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d90015f8-fdf2-4637-94bf-435dc9506eb7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:13.796051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d90015f8-fdf2-4637-94bf-435dc9506eb7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:13.820907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d90015f8-fdf2-4637-94bf-435dc9506eb7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:13.821794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d90015f8-fdf2-4637-94bf-435dc9506eb7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:13.822417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d90015f8-fdf2-4637-94bf-435dc9506eb7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:13.823456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d90015f8-fdf2-4637-94bf-435dc9506eb7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:13.824201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d90015f8-fdf2-4637-94bf-435dc9506eb7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:13.824839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d90015f8-fdf2-4637-94bf-435dc9506eb7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:13.978157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-107d8b8c-c382-4430-9997-c1e7b9bedc11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:14.016227 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-107d8b8c-c382-4430-9997-c1e7b9bedc11 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1228 microversion: 2.1 time: 0.321180 Aug 25 13:25:14.036083 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2323/4699] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:13 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1228 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:14.480891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d90015f8-fdf2-4637-94bf-435dc9506eb7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:14.514567 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d90015f8-fdf2-4637-94bf-435dc9506eb7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1371 microversion: 2.1 time: 0.726082 Aug 25 13:25:14.517396 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2377/4700] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:13 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1371 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:15.075847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6aedc853-7646-4d52-ab66-0513935c0d37 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:15.077874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6aedc853-7646-4d52-ab66-0513935c0d37 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:15.098171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6aedc853-7646-4d52-ab66-0513935c0d37 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:15.100463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6aedc853-7646-4d52-ab66-0513935c0d37 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:15.101353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6aedc853-7646-4d52-ab66-0513935c0d37 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:15.103140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6aedc853-7646-4d52-ab66-0513935c0d37 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:15.104012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6aedc853-7646-4d52-ab66-0513935c0d37 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:15.106086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6aedc853-7646-4d52-ab66-0513935c0d37 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:15.338208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6aedc853-7646-4d52-ab66-0513935c0d37 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:15.379035 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6aedc853-7646-4d52-ab66-0513935c0d37 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1232 microversion: 2.1 time: 0.320528 Aug 25 13:25:15.380676 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2324/4701] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:15 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1232 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:15.559260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c653cce-9e7c-4ef9-84d8-6ac8bac3dfbd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:15.561610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1c653cce-9e7c-4ef9-84d8-6ac8bac3dfbd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:15.599987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c653cce-9e7c-4ef9-84d8-6ac8bac3dfbd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:15.602036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c653cce-9e7c-4ef9-84d8-6ac8bac3dfbd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:15.603274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c653cce-9e7c-4ef9-84d8-6ac8bac3dfbd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:15.604991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c653cce-9e7c-4ef9-84d8-6ac8bac3dfbd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:15.606362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c653cce-9e7c-4ef9-84d8-6ac8bac3dfbd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:15.607465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c653cce-9e7c-4ef9-84d8-6ac8bac3dfbd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:16.431870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f427c246-762d-4125-81dc-dd56917dbb76 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:16.437113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f427c246-762d-4125-81dc-dd56917dbb76 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:16.478542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f427c246-762d-4125-81dc-dd56917dbb76 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:16.482784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f427c246-762d-4125-81dc-dd56917dbb76 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:16.487954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f427c246-762d-4125-81dc-dd56917dbb76 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:16.492759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f427c246-762d-4125-81dc-dd56917dbb76 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:16.496581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f427c246-762d-4125-81dc-dd56917dbb76 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:16.500191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f427c246-762d-4125-81dc-dd56917dbb76 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:16.819482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f427c246-762d-4125-81dc-dd56917dbb76 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:16.842487 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f427c246-762d-4125-81dc-dd56917dbb76 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1298 microversion: 2.1 time: 0.424227 Aug 25 13:25:16.843462 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2325/4702] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:16 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1298 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:16.885131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1c653cce-9e7c-4ef9-84d8-6ac8bac3dfbd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:16.913919 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1c653cce-9e7c-4ef9-84d8-6ac8bac3dfbd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1371 microversion: 2.1 time: 1.361554 Aug 25 13:25:16.914987 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2378/4703] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:15 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1371 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:17.892186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3d929b2-9a62-4be4-872b-09b4a22ab0f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:17.893560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c3d929b2-9a62-4be4-872b-09b4a22ab0f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:17.914456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3d929b2-9a62-4be4-872b-09b4a22ab0f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:17.915765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3d929b2-9a62-4be4-872b-09b4a22ab0f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:17.917300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3d929b2-9a62-4be4-872b-09b4a22ab0f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:17.919203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3d929b2-9a62-4be4-872b-09b4a22ab0f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:17.920545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3d929b2-9a62-4be4-872b-09b4a22ab0f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:17.923160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3d929b2-9a62-4be4-872b-09b4a22ab0f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:17.955751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-642b3887-d941-4f56-95d0-18d117ed754c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:17.960244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-642b3887-d941-4f56-95d0-18d117ed754c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:17.984977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-642b3887-d941-4f56-95d0-18d117ed754c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:17.993867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-642b3887-d941-4f56-95d0-18d117ed754c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:17.995348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-642b3887-d941-4f56-95d0-18d117ed754c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:17.997265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-642b3887-d941-4f56-95d0-18d117ed754c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:18.003241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-642b3887-d941-4f56-95d0-18d117ed754c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:18.004009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-642b3887-d941-4f56-95d0-18d117ed754c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:18.186852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3d929b2-9a62-4be4-872b-09b4a22ab0f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:18.208489 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3d929b2-9a62-4be4-872b-09b4a22ab0f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1286 microversion: 2.1 time: 0.322068 Aug 25 13:25:18.237067 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2326/4704] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:17 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1286 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:18.940444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-642b3887-d941-4f56-95d0-18d117ed754c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:18.944554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:18.989658 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-642b3887-d941-4f56-95d0-18d117ed754c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1371 microversion: 2.1 time: 1.043503 Aug 25 13:25:19.014423 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2379/4705] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:17 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1371 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:19.251442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ffb0be94-8711-457f-a334-ea965d3bcc6e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:19.252483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ffb0be94-8711-457f-a334-ea965d3bcc6e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:19.269738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffb0be94-8711-457f-a334-ea965d3bcc6e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:19.270447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffb0be94-8711-457f-a334-ea965d3bcc6e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:19.271956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffb0be94-8711-457f-a334-ea965d3bcc6e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:19.273589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffb0be94-8711-457f-a334-ea965d3bcc6e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:19.279925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffb0be94-8711-457f-a334-ea965d3bcc6e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:19.280967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ffb0be94-8711-457f-a334-ea965d3bcc6e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:19.442291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ffb0be94-8711-457f-a334-ea965d3bcc6e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:19.462058 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ffb0be94-8711-457f-a334-ea965d3bcc6e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1286 microversion: 2.1 time: 0.219112 Aug 25 13:25:19.473755 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2327/4706] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:19 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1286 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:20.048179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2900fc31-7ea0-4dcd-8000-585392b75fe8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:20.052711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2900fc31-7ea0-4dcd-8000-585392b75fe8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:20.101580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2900fc31-7ea0-4dcd-8000-585392b75fe8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:20.103249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2900fc31-7ea0-4dcd-8000-585392b75fe8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:20.104758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2900fc31-7ea0-4dcd-8000-585392b75fe8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:20.106847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2900fc31-7ea0-4dcd-8000-585392b75fe8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:20.108305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2900fc31-7ea0-4dcd-8000-585392b75fe8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:20.109604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2900fc31-7ea0-4dcd-8000-585392b75fe8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:20.512777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d9de8ff8-59d6-4573-a75d-948025d0a485 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:20.526048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d9de8ff8-59d6-4573-a75d-948025d0a485 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:20.539889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9de8ff8-59d6-4573-a75d-948025d0a485 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:20.541295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9de8ff8-59d6-4573-a75d-948025d0a485 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:20.542582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9de8ff8-59d6-4573-a75d-948025d0a485 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:20.544397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9de8ff8-59d6-4573-a75d-948025d0a485 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:20.545794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9de8ff8-59d6-4573-a75d-948025d0a485 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:20.547050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d9de8ff8-59d6-4573-a75d-948025d0a485 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:20.945899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2900fc31-7ea0-4dcd-8000-585392b75fe8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:20.965296 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2900fc31-7ea0-4dcd-8000-585392b75fe8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1371 microversion: 2.1 time: 0.936998 Aug 25 13:25:20.965965 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2380/4707] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:20 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1371 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:21.253254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d9de8ff8-59d6-4573-a75d-948025d0a485 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:21.285071 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d9de8ff8-59d6-4573-a75d-948025d0a485 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1328 microversion: 2.1 time: 0.779330 Aug 25 13:25:21.301696 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2328/4708] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:20 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1328 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:22.009658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1de0d987-dd77-42fb-9171-0b4ab686a3ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:22.012305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1de0d987-dd77-42fb-9171-0b4ab686a3ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:22.029455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de0d987-dd77-42fb-9171-0b4ab686a3ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:22.031457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de0d987-dd77-42fb-9171-0b4ab686a3ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:22.032180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de0d987-dd77-42fb-9171-0b4ab686a3ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:22.034283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de0d987-dd77-42fb-9171-0b4ab686a3ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:22.035601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de0d987-dd77-42fb-9171-0b4ab686a3ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:22.036431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1de0d987-dd77-42fb-9171-0b4ab686a3ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:22.326784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-11cbcc8a-9a6d-42cb-b6b1-a149b65ee7f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:22.327966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-11cbcc8a-9a6d-42cb-b6b1-a149b65ee7f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:22.347924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11cbcc8a-9a6d-42cb-b6b1-a149b65ee7f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:22.348984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11cbcc8a-9a6d-42cb-b6b1-a149b65ee7f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:22.350018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11cbcc8a-9a6d-42cb-b6b1-a149b65ee7f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:22.353360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11cbcc8a-9a6d-42cb-b6b1-a149b65ee7f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:22.355193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11cbcc8a-9a6d-42cb-b6b1-a149b65ee7f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:22.356489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11cbcc8a-9a6d-42cb-b6b1-a149b65ee7f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:23.089732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1de0d987-dd77-42fb-9171-0b4ab686a3ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:23.115855 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1de0d987-dd77-42fb-9171-0b4ab686a3ff tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1371 microversion: 2.1 time: 1.115396 Aug 25 13:25:23.118682 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2381/4709] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:21 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1371 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:23.131600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-3e8745b7-421d-4326-9f20-ce4b9c8d4054 req-aedaf584-b32e-42db-b087-8295f656434e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185a4db0-4145-4faa-8542-357606e516d7", "tag": "a84a85d0-6e81-4d70-a497-b399c197ad2b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:23.155874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3e8745b7-421d-4326-9f20-ce4b9c8d4054 req-aedaf584-b32e-42db-b087-8295f656434e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:23.157378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3e8745b7-421d-4326-9f20-ce4b9c8d4054 req-aedaf584-b32e-42db-b087-8295f656434e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:23.158657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3e8745b7-421d-4326-9f20-ce4b9c8d4054 req-aedaf584-b32e-42db-b087-8295f656434e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:23.188505 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-3e8745b7-421d-4326-9f20-ce4b9c8d4054 req-aedaf584-b32e-42db-b087-8295f656434e service nova] Creating event network-changed:a84a85d0-6e81-4d70-a497-b399c197ad2b for instance 185a4db0-4145-4faa-8542-357606e516d7 on n-h2-852771-8 Aug 25 13:25:23.209088 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-3e8745b7-421d-4326-9f20-ce4b9c8d4054 req-aedaf584-b32e-42db-b087-8295f656434e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084898 Aug 25 13:25:23.212965 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2382/4710] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:23.236483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d2ad7fd1-9d8d-4450-9d16-517b87ab3ac3 req-35229a33-e7cc-4949-8bea-67ea4df032dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991f22c6-27c5-471a-b485-90f6ea7d9fcc", "name": "network-vif-plugged", "status": "completed", "tag": "71d03996-bd44-44cc-ab61-997d2db0e057"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:23.256750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d2ad7fd1-9d8d-4450-9d16-517b87ab3ac3 req-35229a33-e7cc-4949-8bea-67ea4df032dc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:23.257982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d2ad7fd1-9d8d-4450-9d16-517b87ab3ac3 req-35229a33-e7cc-4949-8bea-67ea4df032dc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:23.259098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d2ad7fd1-9d8d-4450-9d16-517b87ab3ac3 req-35229a33-e7cc-4949-8bea-67ea4df032dc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:23.296775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d2ad7fd1-9d8d-4450-9d16-517b87ab3ac3 req-35229a33-e7cc-4949-8bea-67ea4df032dc service nova] Creating event network-vif-plugged:71d03996-bd44-44cc-ab61-997d2db0e057 for instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc on n-h1-852771-8 Aug 25 13:25:23.310296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-11cbcc8a-9a6d-42cb-b6b1-a149b65ee7f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:23.318617 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d2ad7fd1-9d8d-4450-9d16-517b87ab3ac3 req-35229a33-e7cc-4949-8bea-67ea4df032dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090295 Aug 25 13:25:23.323442 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2383/4711] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:23.336237 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-11cbcc8a-9a6d-42cb-b6b1-a149b65ee7f8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1328 microversion: 2.1 time: 1.017849 Aug 25 13:25:23.338441 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2329/4712] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:22 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1328 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:24.169110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae5016b7-48a6-44df-95b8-5a020ce3a11d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:24.170560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ae5016b7-48a6-44df-95b8-5a020ce3a11d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:24.183529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:24.185990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=20 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:24.198221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae5016b7-48a6-44df-95b8-5a020ce3a11d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:24.199160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae5016b7-48a6-44df-95b8-5a020ce3a11d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:24.200003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae5016b7-48a6-44df-95b8-5a020ce3a11d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:24.202527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae5016b7-48a6-44df-95b8-5a020ce3a11d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:24.204044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae5016b7-48a6-44df-95b8-5a020ce3a11d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:24.206003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae5016b7-48a6-44df-95b8-5a020ce3a11d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:24.384742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25c0747a-b203-4e33-b076-2b0a20d644a5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:24.392079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-25c0747a-b203-4e33-b076-2b0a20d644a5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:24.425538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:24.434503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c0747a-b203-4e33-b076-2b0a20d644a5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:24.438537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c0747a-b203-4e33-b076-2b0a20d644a5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:24.441357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c0747a-b203-4e33-b076-2b0a20d644a5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:24.445360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c0747a-b203-4e33-b076-2b0a20d644a5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:24.448304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c0747a-b203-4e33-b076-2b0a20d644a5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:24.449161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c0747a-b203-4e33-b076-2b0a20d644a5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:25.139172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ae5016b7-48a6-44df-95b8-5a020ce3a11d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:25.155643 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ae5016b7-48a6-44df-95b8-5a020ce3a11d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1371 microversion: 2.1 time: 0.996136 Aug 25 13:25:25.158396 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2384/4713] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:24 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1371 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:25.253678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-25c0747a-b203-4e33-b076-2b0a20d644a5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:25.274236 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-25c0747a-b203-4e33-b076-2b0a20d644a5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1328 microversion: 2.1 time: 0.898678 Aug 25 13:25:25.291167 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2330/4714] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:24 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1328 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:26.201350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d314e623-f410-447e-895d-0c6278b48f41 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:26.204282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d314e623-f410-447e-895d-0c6278b48f41 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:26.217693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d314e623-f410-447e-895d-0c6278b48f41 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:26.219143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d314e623-f410-447e-895d-0c6278b48f41 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:26.220362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d314e623-f410-447e-895d-0c6278b48f41 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:26.222071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d314e623-f410-447e-895d-0c6278b48f41 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:26.223318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d314e623-f410-447e-895d-0c6278b48f41 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:26.224451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d314e623-f410-447e-895d-0c6278b48f41 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:26.318160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-693a5fc6-b49e-49d4-8144-83aa88d2c19f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:26.320584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-693a5fc6-b49e-49d4-8144-83aa88d2c19f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:26.333613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-693a5fc6-b49e-49d4-8144-83aa88d2c19f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:26.334551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-693a5fc6-b49e-49d4-8144-83aa88d2c19f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:26.335389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-693a5fc6-b49e-49d4-8144-83aa88d2c19f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:26.336755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-693a5fc6-b49e-49d4-8144-83aa88d2c19f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:26.337616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-693a5fc6-b49e-49d4-8144-83aa88d2c19f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:26.338841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-693a5fc6-b49e-49d4-8144-83aa88d2c19f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:26.846413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-693a5fc6-b49e-49d4-8144-83aa88d2c19f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:26.858914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d314e623-f410-447e-895d-0c6278b48f41 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:26.865912 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-693a5fc6-b49e-49d4-8144-83aa88d2c19f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1328 microversion: 2.1 time: 0.555206 Aug 25 13:25:26.881928 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2331/4715] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:26 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1328 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:26.882476 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d314e623-f410-447e-895d-0c6278b48f41 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1564 microversion: 2.1 time: 0.688832 Aug 25 13:25:26.884996 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2385/4716] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:26 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1564 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:26.926766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2a6e1152-6e50-4aa0-974d-d8c0ed90c7b2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:26.927898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a6e1152-6e50-4aa0-974d-d8c0ed90c7b2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:26.941260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a6e1152-6e50-4aa0-974d-d8c0ed90c7b2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:26.942867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a6e1152-6e50-4aa0-974d-d8c0ed90c7b2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:26.944142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a6e1152-6e50-4aa0-974d-d8c0ed90c7b2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:26.945663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a6e1152-6e50-4aa0-974d-d8c0ed90c7b2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:26.946940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a6e1152-6e50-4aa0-974d-d8c0ed90c7b2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:26.948231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a6e1152-6e50-4aa0-974d-d8c0ed90c7b2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:27.337406 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2a6e1152-6e50-4aa0-974d-d8c0ed90c7b2 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.419004 Aug 25 13:25:27.338675 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2332/4717] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:25:26 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-interface => generated 284 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:27.911919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5f1a419b-573d-44cc-9e35-6fe4fa285015 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:27.914601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5f1a419b-573d-44cc-9e35-6fe4fa285015 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:27.944879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f1a419b-573d-44cc-9e35-6fe4fa285015 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:27.947443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f1a419b-573d-44cc-9e35-6fe4fa285015 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:27.949410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f1a419b-573d-44cc-9e35-6fe4fa285015 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:27.955727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f1a419b-573d-44cc-9e35-6fe4fa285015 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:27.959497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f1a419b-573d-44cc-9e35-6fe4fa285015 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:27.960428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f1a419b-573d-44cc-9e35-6fe4fa285015 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:28.862706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5f1a419b-573d-44cc-9e35-6fe4fa285015 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:28.882069 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5f1a419b-573d-44cc-9e35-6fe4fa285015 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1328 microversion: 2.1 time: 0.977858 Aug 25 13:25:28.883804 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2386/4718] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:27 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1328 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:29.940560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ab9c45d-932a-4ed1-8de7-4d9b1ac87a0c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:29.944134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ab9c45d-932a-4ed1-8de7-4d9b1ac87a0c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:29.965190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ab9c45d-932a-4ed1-8de7-4d9b1ac87a0c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:29.967093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ab9c45d-932a-4ed1-8de7-4d9b1ac87a0c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:29.968043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ab9c45d-932a-4ed1-8de7-4d9b1ac87a0c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:29.970582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ab9c45d-932a-4ed1-8de7-4d9b1ac87a0c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:29.971813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ab9c45d-932a-4ed1-8de7-4d9b1ac87a0c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:29.972822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ab9c45d-932a-4ed1-8de7-4d9b1ac87a0c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:30.662081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1ab9c45d-932a-4ed1-8de7-4d9b1ac87a0c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:30.703424 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ab9c45d-932a-4ed1-8de7-4d9b1ac87a0c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1328 microversion: 2.1 time: 0.782783 Aug 25 13:25:30.710567 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2333/4719] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:29 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1328 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:31.686511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5e800941-2a28-4241-800f-280012fff961 req-d1b28f70-8c0d-4e23-9cdc-b4ec0416a6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991f22c6-27c5-471a-b485-90f6ea7d9fcc", "tag": "71d03996-bd44-44cc-ab61-997d2db0e057"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:31.713169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5e800941-2a28-4241-800f-280012fff961 req-d1b28f70-8c0d-4e23-9cdc-b4ec0416a6f3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:31.714487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5e800941-2a28-4241-800f-280012fff961 req-d1b28f70-8c0d-4e23-9cdc-b4ec0416a6f3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:31.715622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5e800941-2a28-4241-800f-280012fff961 req-d1b28f70-8c0d-4e23-9cdc-b4ec0416a6f3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:31.753196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b456fc04-0483-4bab-8c63-1a7b18c084cc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:31.755607 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5e800941-2a28-4241-800f-280012fff961 req-d1b28f70-8c0d-4e23-9cdc-b4ec0416a6f3 service nova] Creating event network-changed:71d03996-bd44-44cc-ab61-997d2db0e057 for instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc on n-h1-852771-8 Aug 25 13:25:31.757447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b456fc04-0483-4bab-8c63-1a7b18c084cc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:31.773381 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5e800941-2a28-4241-800f-280012fff961 req-d1b28f70-8c0d-4e23-9cdc-b4ec0416a6f3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095092 Aug 25 13:25:31.778875 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2387/4720] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:25:31.783304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b456fc04-0483-4bab-8c63-1a7b18c084cc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:31.787073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b456fc04-0483-4bab-8c63-1a7b18c084cc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:31.788826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b456fc04-0483-4bab-8c63-1a7b18c084cc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:31.790844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b456fc04-0483-4bab-8c63-1a7b18c084cc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:31.792098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b456fc04-0483-4bab-8c63-1a7b18c084cc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:31.793159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b456fc04-0483-4bab-8c63-1a7b18c084cc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:32.272693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5ee14d70-6bb7-4ed6-8767-2d3deb2d8dd9 req-254eb566-505e-4966-be2a-eec76936bbff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185a4db0-4145-4faa-8542-357606e516d7", "name": "network-vif-plugged", "status": "completed", "tag": "a84a85d0-6e81-4d70-a497-b399c197ad2b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:32.319282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5ee14d70-6bb7-4ed6-8767-2d3deb2d8dd9 req-254eb566-505e-4966-be2a-eec76936bbff service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:32.320213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5ee14d70-6bb7-4ed6-8767-2d3deb2d8dd9 req-254eb566-505e-4966-be2a-eec76936bbff service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:32.321026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5ee14d70-6bb7-4ed6-8767-2d3deb2d8dd9 req-254eb566-505e-4966-be2a-eec76936bbff service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:32.332132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b456fc04-0483-4bab-8c63-1a7b18c084cc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:32.371937 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5ee14d70-6bb7-4ed6-8767-2d3deb2d8dd9 req-254eb566-505e-4966-be2a-eec76936bbff service nova] Creating event network-vif-plugged:a84a85d0-6e81-4d70-a497-b399c197ad2b for instance 185a4db0-4145-4faa-8542-357606e516d7 on n-h2-852771-8 Aug 25 13:25:32.374857 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b456fc04-0483-4bab-8c63-1a7b18c084cc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1328 microversion: 2.1 time: 0.630667 Aug 25 13:25:32.379922 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2334/4721] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:31 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1328 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:32.399569 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5ee14d70-6bb7-4ed6-8767-2d3deb2d8dd9 req-254eb566-505e-4966-be2a-eec76936bbff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135550 Aug 25 13:25:32.404491 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2388/4722] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:25:33.431169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-146bb5b0-011e-4738-8d52-430471329f19 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:33.431169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-146bb5b0-011e-4738-8d52-430471329f19 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:33.450930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146bb5b0-011e-4738-8d52-430471329f19 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:33.452084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146bb5b0-011e-4738-8d52-430471329f19 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:33.453781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146bb5b0-011e-4738-8d52-430471329f19 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:33.455158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146bb5b0-011e-4738-8d52-430471329f19 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:33.456392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146bb5b0-011e-4738-8d52-430471329f19 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:33.457803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-146bb5b0-011e-4738-8d52-430471329f19 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:33.932571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-146bb5b0-011e-4738-8d52-430471329f19 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:33.958207 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-146bb5b0-011e-4738-8d52-430471329f19 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1328 microversion: 2.1 time: 0.541441 Aug 25 13:25:33.959448 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2335/4723] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:33 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1328 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:35.002871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6d1ed0e3-5042-434c-8786-b4520e131e20 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:35.005748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6d1ed0e3-5042-434c-8786-b4520e131e20 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:35.019317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0e3-5042-434c-8786-b4520e131e20 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:35.020283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0e3-5042-434c-8786-b4520e131e20 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:35.021116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0e3-5042-434c-8786-b4520e131e20 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:35.023127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0e3-5042-434c-8786-b4520e131e20 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:35.024027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0e3-5042-434c-8786-b4520e131e20 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:35.024857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0e3-5042-434c-8786-b4520e131e20 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:35.489994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6d1ed0e3-5042-434c-8786-b4520e131e20 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:35.508975 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6d1ed0e3-5042-434c-8786-b4520e131e20 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1508 microversion: 2.1 time: 0.516253 Aug 25 13:25:35.510842 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2389/4724] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:34 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1508 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:35.554543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6977ad0f-1e36-4faa-a474-55170e7fe0a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:35.555573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6977ad0f-1e36-4faa-a474-55170e7fe0a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:35.573336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6977ad0f-1e36-4faa-a474-55170e7fe0a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:35.574510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6977ad0f-1e36-4faa-a474-55170e7fe0a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:35.575373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6977ad0f-1e36-4faa-a474-55170e7fe0a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:35.577089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6977ad0f-1e36-4faa-a474-55170e7fe0a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:35.578586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6977ad0f-1e36-4faa-a474-55170e7fe0a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:35.579802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6977ad0f-1e36-4faa-a474-55170e7fe0a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:35.616514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:36.027463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6977ad0f-1e36-4faa-a474-55170e7fe0a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:36.049018 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6977ad0f-1e36-4faa-a474-55170e7fe0a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1508 microversion: 2.1 time: 0.500252 Aug 25 13:25:36.050875 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2336/4725] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:35 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:36.089380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b2015b0-82f2-43c6-8557-f419a4724a3f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:36.095172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b2015b0-82f2-43c6-8557-f419a4724a3f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:36.114103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b2015b0-82f2-43c6-8557-f419a4724a3f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:36.115671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b2015b0-82f2-43c6-8557-f419a4724a3f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:36.117438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b2015b0-82f2-43c6-8557-f419a4724a3f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:36.119772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b2015b0-82f2-43c6-8557-f419a4724a3f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:36.120644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b2015b0-82f2-43c6-8557-f419a4724a3f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:36.122572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b2015b0-82f2-43c6-8557-f419a4724a3f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:36.207073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b2015b0-82f2-43c6-8557-f419a4724a3f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:25:36.415927 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b2015b0-82f2-43c6-8557-f419a4724a3f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 204 len: 0 microversion: 2.1 time: 0.333626 Aug 25 13:25:36.418772 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2390/4726] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:25:36 2022] DELETE /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:25:36.435264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e88ecc97-c188-4a7a-b098-5decc700f982 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:36.438026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e88ecc97-c188-4a7a-b098-5decc700f982 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:36.451537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88ecc97-c188-4a7a-b098-5decc700f982 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:36.452474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88ecc97-c188-4a7a-b098-5decc700f982 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:36.454575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88ecc97-c188-4a7a-b098-5decc700f982 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:36.456518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88ecc97-c188-4a7a-b098-5decc700f982 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:36.457487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88ecc97-c188-4a7a-b098-5decc700f982 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:36.458719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e88ecc97-c188-4a7a-b098-5decc700f982 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:37.258097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e88ecc97-c188-4a7a-b098-5decc700f982 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:37.277600 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e88ecc97-c188-4a7a-b098-5decc700f982 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1514 microversion: 2.1 time: 0.851967 Aug 25 13:25:37.278736 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2337/4727] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:36 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1514 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:38.316672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1fd94db8-c09a-4c66-94b5-3738545fed55 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:38.318473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1fd94db8-c09a-4c66-94b5-3738545fed55 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:38.324008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:38.335341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fd94db8-c09a-4c66-94b5-3738545fed55 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:38.336721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fd94db8-c09a-4c66-94b5-3738545fed55 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:38.337559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fd94db8-c09a-4c66-94b5-3738545fed55 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:38.339129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fd94db8-c09a-4c66-94b5-3738545fed55 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:38.340264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fd94db8-c09a-4c66-94b5-3738545fed55 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:38.341055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fd94db8-c09a-4c66-94b5-3738545fed55 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:38.730739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1fd94db8-c09a-4c66-94b5-3738545fed55 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:38.749338 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1fd94db8-c09a-4c66-94b5-3738545fed55 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1514 microversion: 2.1 time: 0.445496 Aug 25 13:25:38.751093 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2391/4728] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:38 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1514 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:39.236532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-070561c1-4b50-4530-9e01-c7b9e7f8d29a req-85da4e8d-16eb-41d6-b2b5-09b0256489cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185a4db0-4145-4faa-8542-357606e516d7", "name": "network-vif-deleted", "tag": "a84a85d0-6e81-4d70-a497-b399c197ad2b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:39.269369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:39.286080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-070561c1-4b50-4530-9e01-c7b9e7f8d29a req-85da4e8d-16eb-41d6-b2b5-09b0256489cc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:39.287467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-070561c1-4b50-4530-9e01-c7b9e7f8d29a req-85da4e8d-16eb-41d6-b2b5-09b0256489cc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:39.288607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-070561c1-4b50-4530-9e01-c7b9e7f8d29a req-85da4e8d-16eb-41d6-b2b5-09b0256489cc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:39.323480 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-070561c1-4b50-4530-9e01-c7b9e7f8d29a req-85da4e8d-16eb-41d6-b2b5-09b0256489cc service nova] Creating event network-vif-deleted:a84a85d0-6e81-4d70-a497-b399c197ad2b for instance 185a4db0-4145-4faa-8542-357606e516d7 on n-h2-852771-8 Aug 25 13:25:39.334773 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-070561c1-4b50-4530-9e01-c7b9e7f8d29a req-85da4e8d-16eb-41d6-b2b5-09b0256489cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112466 Aug 25 13:25:39.353287 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2338/4729] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:39.793533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:39.795999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:39.812282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:39.813162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:39.814042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:39.815869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:39.816677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:39.817573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:39.892430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:39.893152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:39.893846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:39.894668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lazy-loading 'fault' on Instance uuid 185a4db0-4145-4faa-8542-357606e516d7 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:25:39.969938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:39.997868 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c67bbed1-a5a7-415b-98ce-4f5376b67890 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 200 len: 1318 microversion: 2.1 time: 0.210889 Aug 25 13:25:40.001369 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2392/4730] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:39 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:41.046334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:41.047655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:41.061813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:41.063935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:41.065773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:41.067598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:41.068472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:41.069263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:41.115032 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 HTTP/1.1 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '185a4db0-4145-4faa-8542-357606e516d7'} Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:25:41.120663 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:25:41.130707 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:25:41.130707 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:25:41.130707 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:25:41.130707 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:25:41.130707 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:25:41.130707 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:25:41.130707 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:25:41.131982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:25:41.136142 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8210bb1c-67d0-4496-b7b5-abc53f7a820e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 404 len: 111 microversion: 2.1 time: 0.098646 Aug 25 13:25:41.137370 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2339/4731] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:41 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:25:41.154257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-61187f49-ec2c-4b4a-b17c-37968068f548 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '.version_select at 0x7f3a2e73de50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:41.197873 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-61187f49-ec2c-4b4a-b17c-37968068f548 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-key-1361548709" status: 202 len: 0 microversion: 2.1 time: 0.052422 Aug 25 13:25:41.209805 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2393/4732] 10.222.0.70 () {58 vars in 1209 bytes} [Thu Aug 25 13:25:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1361548709 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:25:41.426596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-358078481", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "0fc430fe-72c2-45e0-a5f2-bac853189a57"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:41.539297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] validate_networks() for [('0fc430fe-72c2-45e0-a5f2-bac853189a57', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:25:43.123620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:25:43.125994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:25:43.125994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:25:43.126882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:25:43.127785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:25:43.148924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:43.149911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:43.150753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:43.152250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:43.153158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:43.154033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:43.198855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:25:43.212189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for user bd7b1570a27f4ea8ad560ce25225cf02 and project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:25:43.243014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:25:43.248139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:25:43.351792 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-43f04900-f81a-4ac9-919d-16e6d69132d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933630 Aug 25 13:25:43.353446 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2340/4733] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:25:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:25:43.373311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d80af65-1092-4ec4-a9eb-294bc6a2ca86 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:43.374400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d80af65-1092-4ec4-a9eb-294bc6a2ca86 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:43.545837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d80af65-1092-4ec4-a9eb-294bc6a2ca86 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:43.579142 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d80af65-1092-4ec4-a9eb-294bc6a2ca86 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1208 microversion: 2.1 time: 0.212198 Aug 25 13:25:43.583998 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2394/4734] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:43 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1208 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:44.627401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe2f1695-f1a2-4ecb-b8a2-fa5ac8ef975c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:44.632764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe2f1695-f1a2-4ecb-b8a2-fa5ac8ef975c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:44.918824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fe2f1695-f1a2-4ecb-b8a2-fa5ac8ef975c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:44.956276 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe2f1695-f1a2-4ecb-b8a2-fa5ac8ef975c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1208 microversion: 2.1 time: 0.337417 Aug 25 13:25:44.957831 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2341/4735] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:44 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1208 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:46.000633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1dc9965e-a6e2-4d8b-8053-59e601fc2654 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:46.003379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1dc9965e-a6e2-4d8b-8053-59e601fc2654 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:46.027260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dc9965e-a6e2-4d8b-8053-59e601fc2654 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:46.040199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dc9965e-a6e2-4d8b-8053-59e601fc2654 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:46.041555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dc9965e-a6e2-4d8b-8053-59e601fc2654 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:46.047231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dc9965e-a6e2-4d8b-8053-59e601fc2654 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:46.047231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dc9965e-a6e2-4d8b-8053-59e601fc2654 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:46.047231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dc9965e-a6e2-4d8b-8053-59e601fc2654 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:46.438127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1dc9965e-a6e2-4d8b-8053-59e601fc2654 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:46.482431 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1dc9965e-a6e2-4d8b-8053-59e601fc2654 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1268 microversion: 2.1 time: 0.488493 Aug 25 13:25:46.483569 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2395/4736] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:45 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1268 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:47.543349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44d6f3fb-565a-4d61-a271-bb523b3be1dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:47.549612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44d6f3fb-565a-4d61-a271-bb523b3be1dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:47.574330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44d6f3fb-565a-4d61-a271-bb523b3be1dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:47.579739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44d6f3fb-565a-4d61-a271-bb523b3be1dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:47.580804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44d6f3fb-565a-4d61-a271-bb523b3be1dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:47.582309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44d6f3fb-565a-4d61-a271-bb523b3be1dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:47.583346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44d6f3fb-565a-4d61-a271-bb523b3be1dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:47.583858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44d6f3fb-565a-4d61-a271-bb523b3be1dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:47.916060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44d6f3fb-565a-4d61-a271-bb523b3be1dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:47.948012 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44d6f3fb-565a-4d61-a271-bb523b3be1dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1266 microversion: 2.1 time: 0.415066 Aug 25 13:25:47.949378 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2342/4737] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:47 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1266 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:48.934116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5eaf8678-8148-49fc-9aef-9d39d20c6e79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:48.935028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5eaf8678-8148-49fc-9aef-9d39d20c6e79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:48.970740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eaf8678-8148-49fc-9aef-9d39d20c6e79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:48.991076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52a32c25-12fb-4ebb-b069-cd21a96e8a87 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:48.992338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eaf8678-8148-49fc-9aef-9d39d20c6e79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:48.992338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eaf8678-8148-49fc-9aef-9d39d20c6e79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:48.992338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eaf8678-8148-49fc-9aef-9d39d20c6e79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:48.992338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eaf8678-8148-49fc-9aef-9d39d20c6e79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:48.992338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eaf8678-8148-49fc-9aef-9d39d20c6e79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:48.994493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52a32c25-12fb-4ebb-b069-cd21a96e8a87 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:49.008363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52a32c25-12fb-4ebb-b069-cd21a96e8a87 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:49.009195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52a32c25-12fb-4ebb-b069-cd21a96e8a87 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:49.009996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52a32c25-12fb-4ebb-b069-cd21a96e8a87 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:49.016449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52a32c25-12fb-4ebb-b069-cd21a96e8a87 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:49.017345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52a32c25-12fb-4ebb-b069-cd21a96e8a87 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:49.018234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52a32c25-12fb-4ebb-b069-cd21a96e8a87 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:49.083993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:49.126364 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5eaf8678-8148-49fc-9aef-9d39d20c6e79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/ips" status: 200 len: 152 microversion: 2.20 time: 0.200305 Aug 25 13:25:49.129037 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2396/4738] 10.222.0.70 () {60 vars in 1289 bytes} [Thu Aug 25 13:25:48 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/ips => generated 152 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:25:50.144827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52a32c25-12fb-4ebb-b069-cd21a96e8a87 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:50.204552 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52a32c25-12fb-4ebb-b069-cd21a96e8a87 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1308 microversion: 2.1 time: 1.225571 Aug 25 13:25:50.206155 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2343/4739] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:48 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1308 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:51.248365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5159a69-968a-4f2a-b89e-5d5a1228fbc4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:51.251304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5159a69-968a-4f2a-b89e-5d5a1228fbc4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:51.264062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5159a69-968a-4f2a-b89e-5d5a1228fbc4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:51.265329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5159a69-968a-4f2a-b89e-5d5a1228fbc4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:51.266389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5159a69-968a-4f2a-b89e-5d5a1228fbc4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:51.268078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5159a69-968a-4f2a-b89e-5d5a1228fbc4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:51.269365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5159a69-968a-4f2a-b89e-5d5a1228fbc4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:51.270203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5159a69-968a-4f2a-b89e-5d5a1228fbc4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:51.823647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5159a69-968a-4f2a-b89e-5d5a1228fbc4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:51.850252 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5159a69-968a-4f2a-b89e-5d5a1228fbc4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1308 microversion: 2.1 time: 0.611252 Aug 25 13:25:51.867168 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2397/4740] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:51 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1308 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:52.472847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3e824310-7a8d-4835-8aec-f2c1d8ff34c6 req-a236306c-7df1-421c-b409-2d9045733a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63b2d77-0fb6-49ad-9466-0a8200df0e4c", "tag": "b382c307-d35c-4195-8a86-d3ef7aacf594"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:52.515774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e824310-7a8d-4835-8aec-f2c1d8ff34c6 req-a236306c-7df1-421c-b409-2d9045733a87 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:52.516619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e824310-7a8d-4835-8aec-f2c1d8ff34c6 req-a236306c-7df1-421c-b409-2d9045733a87 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:52.517397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3e824310-7a8d-4835-8aec-f2c1d8ff34c6 req-a236306c-7df1-421c-b409-2d9045733a87 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:52.544531 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3e824310-7a8d-4835-8aec-f2c1d8ff34c6 req-a236306c-7df1-421c-b409-2d9045733a87 service nova] Creating event network-changed:b382c307-d35c-4195-8a86-d3ef7aacf594 for instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c on n-h2-852771-8 Aug 25 13:25:52.557023 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3e824310-7a8d-4835-8aec-f2c1d8ff34c6 req-a236306c-7df1-421c-b409-2d9045733a87 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094233 Aug 25 13:25:52.559157 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2344/4741] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:52.913792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e97bbb8-4d99-4777-86c9-d43a072a02ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:52.920225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e97bbb8-4d99-4777-86c9-d43a072a02ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:52.939328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e97bbb8-4d99-4777-86c9-d43a072a02ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:52.941301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e97bbb8-4d99-4777-86c9-d43a072a02ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:52.942488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e97bbb8-4d99-4777-86c9-d43a072a02ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:52.944403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e97bbb8-4d99-4777-86c9-d43a072a02ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:52.946176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e97bbb8-4d99-4777-86c9-d43a072a02ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:52.947678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e97bbb8-4d99-4777-86c9-d43a072a02ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:53.330814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:53.346982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b93253f2-e937-4cb3-ac51-206917790a3f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:53.353103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b93253f2-e937-4cb3-ac51-206917790a3f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:53.384650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b93253f2-e937-4cb3-ac51-206917790a3f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:53.386392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b93253f2-e937-4cb3-ac51-206917790a3f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:53.387605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b93253f2-e937-4cb3-ac51-206917790a3f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:53.398354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b93253f2-e937-4cb3-ac51-206917790a3f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:53.399664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b93253f2-e937-4cb3-ac51-206917790a3f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:53.400638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b93253f2-e937-4cb3-ac51-206917790a3f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:53.528259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-b93253f2-e937-4cb3-ac51-206917790a3f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lazy-loading 'flavor' on Instance uuid d404ff6f-0fad-4c7f-bf95-5c0fe210039b {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:25:53.555164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:53.587003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e97bbb8-4d99-4777-86c9-d43a072a02ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:53.619566 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e97bbb8-4d99-4777-86c9-d43a072a02ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1308 microversion: 2.1 time: 0.722560 Aug 25 13:25:53.621188 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2398/4742] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:52 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1308 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:54.206610 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b93253f2-e937-4cb3-ac51-206917790a3f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "POST /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/action" status: 202 len: 0 microversion: 2.20 time: 0.876851 Aug 25 13:25:54.215294 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2345/4743] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 13:25:53 2022] POST /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/action => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:25:54.228248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:54.230403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:54.259953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:54.261819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:54.262953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:54.265017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:54.266887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:54.270465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:54.602522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:54.620679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:54.624880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:54.626739 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a82c551-7d20-42ac-9281-50187807d917 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 0.411940 Aug 25 13:25:54.627755 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2399/4744] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:25:54 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:25:54.669566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-915d8184-66a7-4b28-acba-88149e8c5bb0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:54.673082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-915d8184-66a7-4b28-acba-88149e8c5bb0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:54.690340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-915d8184-66a7-4b28-acba-88149e8c5bb0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:54.691750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-915d8184-66a7-4b28-acba-88149e8c5bb0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:54.692801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-915d8184-66a7-4b28-acba-88149e8c5bb0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:54.695772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-915d8184-66a7-4b28-acba-88149e8c5bb0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:54.697033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-915d8184-66a7-4b28-acba-88149e8c5bb0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:54.698347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-915d8184-66a7-4b28-acba-88149e8c5bb0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:54.934797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:55.051946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-915d8184-66a7-4b28-acba-88149e8c5bb0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:55.072673 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-915d8184-66a7-4b28-acba-88149e8c5bb0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1308 microversion: 2.1 time: 0.414805 Aug 25 13:25:55.074738 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2346/4745] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:54 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:55.676428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:55.677383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:55.693463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:55.694536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:55.695317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:55.697010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:55.697913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:55.699367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:56.006832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:56.024448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:56.027714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:56.031066 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1d91ea8d-d95c-4a25-9dfc-c0988a67b744 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 0.362974 Aug 25 13:25:56.032713 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2400/4746] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:25:55 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:25:56.118555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-97ac22ac-5918-4b86-bae9-9a7064156e82 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:56.120919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-97ac22ac-5918-4b86-bae9-9a7064156e82 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:56.135490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97ac22ac-5918-4b86-bae9-9a7064156e82 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:56.136470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97ac22ac-5918-4b86-bae9-9a7064156e82 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:56.137373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97ac22ac-5918-4b86-bae9-9a7064156e82 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:56.139197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97ac22ac-5918-4b86-bae9-9a7064156e82 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:56.140161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97ac22ac-5918-4b86-bae9-9a7064156e82 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:56.140997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97ac22ac-5918-4b86-bae9-9a7064156e82 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:56.433790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-97ac22ac-5918-4b86-bae9-9a7064156e82 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:56.457340 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-97ac22ac-5918-4b86-bae9-9a7064156e82 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1308 microversion: 2.1 time: 0.340210 Aug 25 13:25:56.458848 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2347/4747] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:56 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:57.072799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:57.079898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:57.111763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:57.117062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:57.118238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:57.119595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:57.120480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:57.121276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:57.506089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77279023-11fd-4b47-b11d-4e8a862c94b7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:57.506089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-77279023-11fd-4b47-b11d-4e8a862c94b7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:57.521113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77279023-11fd-4b47-b11d-4e8a862c94b7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:57.522282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77279023-11fd-4b47-b11d-4e8a862c94b7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:57.523328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77279023-11fd-4b47-b11d-4e8a862c94b7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:57.525003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77279023-11fd-4b47-b11d-4e8a862c94b7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:57.526055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77279023-11fd-4b47-b11d-4e8a862c94b7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:57.527000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77279023-11fd-4b47-b11d-4e8a862c94b7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:57.872638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:57.896128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:57.900433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:57.903160 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0ae8efb1-ea1d-40d1-80b2-e3800540cdfb tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 0.842227 Aug 25 13:25:57.904480 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2401/4748] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:25:57 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:25:58.340938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-77279023-11fd-4b47-b11d-4e8a862c94b7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:58.357681 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-77279023-11fd-4b47-b11d-4e8a862c94b7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1308 microversion: 2.1 time: 0.866057 Aug 25 13:25:58.359019 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2348/4749] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:57 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1308 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:58.953202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:58.954491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:58.978054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:58.979626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:58.981471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:58.982999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:58.984702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:58.986174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:59.413371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:59.441035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:59.458043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19d27ea6-45df-4f14-86c0-c4b430d307aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:59.462018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-19d27ea6-45df-4f14-86c0-c4b430d307aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:59.472754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:59.488361 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bfcd46ea-13f8-4fe2-8a18-24d14cec0bb8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 0.537748 Aug 25 13:25:59.490918 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2402/4750] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:25:58 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:25:59.505715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19d27ea6-45df-4f14-86c0-c4b430d307aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:59.507443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19d27ea6-45df-4f14-86c0-c4b430d307aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:59.508760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19d27ea6-45df-4f14-86c0-c4b430d307aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:59.510821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19d27ea6-45df-4f14-86c0-c4b430d307aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:59.512111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19d27ea6-45df-4f14-86c0-c4b430d307aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:59.513737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19d27ea6-45df-4f14-86c0-c4b430d307aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:00.080052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-19d27ea6-45df-4f14-86c0-c4b430d307aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:00.100502 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19d27ea6-45df-4f14-86c0-c4b430d307aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1308 microversion: 2.1 time: 0.697097 Aug 25 13:26:00.103480 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2349/4751] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:59 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1308 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:00.543304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:00.544498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:00.565569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:00.568290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:00.568290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:00.569834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:00.570812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:00.571724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:01.048749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:01.066664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:01.070775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:01.073319 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-729e6a5d-fe96-4f96-8abf-85b79bced27e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 0.537681 Aug 25 13:26:01.075195 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2403/4752] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:00 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:01.144170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-872392f2-8e9a-447a-8806-4a9f2901e4d3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:01.145287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-872392f2-8e9a-447a-8806-4a9f2901e4d3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:01.160011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-872392f2-8e9a-447a-8806-4a9f2901e4d3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:01.160947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-872392f2-8e9a-447a-8806-4a9f2901e4d3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:01.161838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-872392f2-8e9a-447a-8806-4a9f2901e4d3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:01.163175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-872392f2-8e9a-447a-8806-4a9f2901e4d3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:01.164075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-872392f2-8e9a-447a-8806-4a9f2901e4d3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:01.164865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-872392f2-8e9a-447a-8806-4a9f2901e4d3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:01.943851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-872392f2-8e9a-447a-8806-4a9f2901e4d3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:01.965165 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-872392f2-8e9a-447a-8806-4a9f2901e4d3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1308 microversion: 2.1 time: 0.829290 Aug 25 13:26:01.966547 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2350/4753] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:01 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1308 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:02.125213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:02.128128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:02.144888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:02.146320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:02.147419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:02.149049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:02.149954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:02.151334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:02.547929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:02.574520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:02.581564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:02.584668 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bea6ca82-61b4-4d79-bee0-3b12664e788e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 0.469218 Aug 25 13:26:02.586768 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2404/4754] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:02 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:02.752433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ea23a662-92f4-4db0-b1e1-cf3588cbd29f req-a073d967-009d-4b26-9588-49ab66647dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63b2d77-0fb6-49ad-9466-0a8200df0e4c", "name": "network-vif-plugged", "status": "completed", "tag": "b382c307-d35c-4195-8a86-d3ef7aacf594"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:02.810426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ea23a662-92f4-4db0-b1e1-cf3588cbd29f req-a073d967-009d-4b26-9588-49ab66647dc6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:02.814129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ea23a662-92f4-4db0-b1e1-cf3588cbd29f req-a073d967-009d-4b26-9588-49ab66647dc6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:02.815439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ea23a662-92f4-4db0-b1e1-cf3588cbd29f req-a073d967-009d-4b26-9588-49ab66647dc6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:02.870627 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ea23a662-92f4-4db0-b1e1-cf3588cbd29f req-a073d967-009d-4b26-9588-49ab66647dc6 service nova] Creating event network-vif-plugged:b382c307-d35c-4195-8a86-d3ef7aacf594 for instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c on n-h2-852771-8 Aug 25 13:26:02.881916 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ea23a662-92f4-4db0-b1e1-cf3588cbd29f req-a073d967-009d-4b26-9588-49ab66647dc6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150229 Aug 25 13:26:02.883925 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2351/4755] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:03.035704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-71ca2626-f6e6-4563-9735-ca034ea84f42 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:03.037679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-71ca2626-f6e6-4563-9735-ca034ea84f42 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:03.060357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71ca2626-f6e6-4563-9735-ca034ea84f42 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:03.063902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71ca2626-f6e6-4563-9735-ca034ea84f42 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:03.065108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71ca2626-f6e6-4563-9735-ca034ea84f42 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:03.066893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71ca2626-f6e6-4563-9735-ca034ea84f42 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:03.068606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71ca2626-f6e6-4563-9735-ca034ea84f42 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:03.069811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71ca2626-f6e6-4563-9735-ca034ea84f42 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:03.481814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-71ca2626-f6e6-4563-9735-ca034ea84f42 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:03.500571 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-71ca2626-f6e6-4563-9735-ca034ea84f42 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1308 microversion: 2.1 time: 0.487948 Aug 25 13:26:03.503791 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2405/4756] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:03 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1308 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:03.634216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:03.636156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:03.649691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:03.651409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:03.652975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:03.655610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:03.657296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:03.658604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:03.974052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:03.993219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:03.996941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:04.000143 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ad9dafd9-68b6-45d3-9967-bf984099ce33 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 0.374537 Aug 25 13:26:04.002674 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2352/4757] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:03 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:04.543804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0fcebcde-6f6b-4761-a9ee-d74207a0c3c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:04.545035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0fcebcde-6f6b-4761-a9ee-d74207a0c3c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:04.560568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fcebcde-6f6b-4761-a9ee-d74207a0c3c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:04.562225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fcebcde-6f6b-4761-a9ee-d74207a0c3c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:04.563166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fcebcde-6f6b-4761-a9ee-d74207a0c3c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:04.564406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fcebcde-6f6b-4761-a9ee-d74207a0c3c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:04.565640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fcebcde-6f6b-4761-a9ee-d74207a0c3c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:04.566732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fcebcde-6f6b-4761-a9ee-d74207a0c3c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:04.917578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0fcebcde-6f6b-4761-a9ee-d74207a0c3c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:04.938462 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0fcebcde-6f6b-4761-a9ee-d74207a0c3c3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1308 microversion: 2.1 time: 0.401942 Aug 25 13:26:04.940068 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2406/4758] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:04 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:05.049390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:05.051774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:05.068317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:05.069461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:05.070480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:05.072472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:05.074336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:05.075586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:05.352153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:05.387724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:05.393011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:05.396870 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0cd810b2-8612-4379-a136-837c6205bcf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 0.355634 Aug 25 13:26:05.411314 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2353/4759] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:05 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:05.990822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a41edb79-533f-4a5e-a71e-adea5561245f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:05.992150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a41edb79-533f-4a5e-a71e-adea5561245f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:06.006098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a41edb79-533f-4a5e-a71e-adea5561245f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:06.007972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a41edb79-533f-4a5e-a71e-adea5561245f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:06.008908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a41edb79-533f-4a5e-a71e-adea5561245f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:06.011202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a41edb79-533f-4a5e-a71e-adea5561245f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:06.012554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a41edb79-533f-4a5e-a71e-adea5561245f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:06.013666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a41edb79-533f-4a5e-a71e-adea5561245f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:06.310459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a41edb79-533f-4a5e-a71e-adea5561245f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:06.332688 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a41edb79-533f-4a5e-a71e-adea5561245f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1488 microversion: 2.1 time: 0.349710 Aug 25 13:26:06.334094 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2407/4760] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:05 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1488 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:06.446521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:06.448720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:06.474913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:06.479048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:06.480270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:06.488195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:06.489573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:06.490693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:06.501847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:06.637582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-358078481", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "0fc430fe-72c2-45e0-a5f2-bac853189a57"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:06.823908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] validate_networks() for [('0fc430fe-72c2-45e0-a5f2-bac853189a57', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:26:07.049843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:07.106034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:07.113950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:07.118148 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0808bc4c-d1c5-4be1-9ae8-03d6c2911017 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1745 microversion: 2.20 time: 0.678801 Aug 25 13:26:07.121601 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2354/4761] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:06 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1745 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:07.798308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:26:07.799237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:26:07.799940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:26:07.800959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:26:07.802245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:26:07.824394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:07.827229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:07.832507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:07.835584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:07.835584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:07.836336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:07.949721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:26:07.963987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for user bd7b1570a27f4ea8ad560ce25225cf02 and project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:26:08.003741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:26:08.009353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:26:08.117109 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-143f5768-b272-44aa-bf50-89d97703130a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491987 Aug 25 13:26:08.118748 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2408/4762] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:26:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:26:08.141187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f4848647-fb10-42e7-8d0e-d268e8fde330 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:08.145498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f4848647-fb10-42e7-8d0e-d268e8fde330 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:08.162653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:08.167170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:08.208356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:08.216384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:08.223570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:08.228847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:08.233697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:08.234952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:08.453316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f4848647-fb10-42e7-8d0e-d268e8fde330 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:08.500820 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f4848647-fb10-42e7-8d0e-d268e8fde330 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1208 microversion: 2.1 time: 0.364611 Aug 25 13:26:08.508793 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2355/4763] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:08 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1208 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:08.694772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:08.720021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:08.724859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:08.728094 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-580d6d20-b02d-4cbc-94a2-27391464a001 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1745 microversion: 2.20 time: 0.573763 Aug 25 13:26:08.742660 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2409/4764] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:08 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1745 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:09.574317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0a019d31-5ff8-448b-93ab-591ef5cbced0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:09.576531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0a019d31-5ff8-448b-93ab-591ef5cbced0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:09.587176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:09.705990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0a019d31-5ff8-448b-93ab-591ef5cbced0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:09.738394 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0a019d31-5ff8-448b-93ab-591ef5cbced0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1208 microversion: 2.1 time: 0.173906 Aug 25 13:26:09.758731 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2356/4765] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:09 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1208 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:09.792309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:09.797365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:09.824463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:09.841806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:09.841806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:09.846505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:09.848415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:09.851202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:09.852456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:10.268072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:10.287963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:10.291772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:10.298748 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-55ad8b3e-8b39-4f8b-9805-f6ba1465b48b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1745 microversion: 2.20 time: 0.523123 Aug 25 13:26:10.318216 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2410/4766] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:09 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1745 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:10.797900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9cdc15b6-a17a-4c90-88d1-f18834187409 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:10.803543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9cdc15b6-a17a-4c90-88d1-f18834187409 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:10.822612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cdc15b6-a17a-4c90-88d1-f18834187409 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:10.824775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cdc15b6-a17a-4c90-88d1-f18834187409 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:10.826101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cdc15b6-a17a-4c90-88d1-f18834187409 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:10.829209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cdc15b6-a17a-4c90-88d1-f18834187409 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:10.830459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cdc15b6-a17a-4c90-88d1-f18834187409 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:10.831587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cdc15b6-a17a-4c90-88d1-f18834187409 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:10.999586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9cdc15b6-a17a-4c90-88d1-f18834187409 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:11.018201 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9cdc15b6-a17a-4c90-88d1-f18834187409 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1204 microversion: 2.1 time: 0.229875 Aug 25 13:26:11.019932 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2357/4767] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:10 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1204 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:11.375935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:11.377487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:11.414017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:11.415637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:11.416891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:11.419181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:11.425061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:11.426651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:12.301862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:12.331946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:12.341385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:12.351467 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-781904c9-f0ef-4232-b34f-4173d67cf4fd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1745 microversion: 2.20 time: 1.002774 Aug 25 13:26:12.352852 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2411/4768] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:11 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1745 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:12.376305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fb46287e-ab24-417a-84a7-c21e46b64d7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:12.379898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fb46287e-ab24-417a-84a7-c21e46b64d7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:12.403233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb46287e-ab24-417a-84a7-c21e46b64d7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:12.405493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb46287e-ab24-417a-84a7-c21e46b64d7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:12.406717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb46287e-ab24-417a-84a7-c21e46b64d7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:12.408180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb46287e-ab24-417a-84a7-c21e46b64d7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:12.409210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb46287e-ab24-417a-84a7-c21e46b64d7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:12.410242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb46287e-ab24-417a-84a7-c21e46b64d7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:12.683330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-25069099-f260-4529-bfd5-7918f180f3c3 req-2753ecbb-0f13-44af-a644-8a106547a9fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d404ff6f-0fad-4c7f-bf95-5c0fe210039b", "name": "network-vif-plugged", "status": "completed", "tag": "8b68205d-7c61-4adf-ace8-ad7064786841"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:12.689448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fb46287e-ab24-417a-84a7-c21e46b64d7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:12.713460 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fb46287e-ab24-417a-84a7-c21e46b64d7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1266 microversion: 2.1 time: 0.349923 Aug 25 13:26:12.714756 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2412/4769] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:12 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:12.748886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-25069099-f260-4529-bfd5-7918f180f3c3 req-2753ecbb-0f13-44af-a644-8a106547a9fd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:12.752643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-25069099-f260-4529-bfd5-7918f180f3c3 req-2753ecbb-0f13-44af-a644-8a106547a9fd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:12.753678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-25069099-f260-4529-bfd5-7918f180f3c3 req-2753ecbb-0f13-44af-a644-8a106547a9fd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:12.818816 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-25069099-f260-4529-bfd5-7918f180f3c3 req-2753ecbb-0f13-44af-a644-8a106547a9fd service nova] Creating event network-vif-plugged:8b68205d-7c61-4adf-ace8-ad7064786841 for instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b on n-h1-852771-8 Aug 25 13:26:12.852676 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-25069099-f260-4529-bfd5-7918f180f3c3 req-2753ecbb-0f13-44af-a644-8a106547a9fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.995838 Aug 25 13:26:12.856452 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2358/4770] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:13.409285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:13.411837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:13.446148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:13.447887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:13.449599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:13.456029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:13.457738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:13.459273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:13.765323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bdb251ad-8a43-458f-80c8-099600e779b0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:13.772357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bdb251ad-8a43-458f-80c8-099600e779b0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:13.814651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdb251ad-8a43-458f-80c8-099600e779b0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:13.816065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdb251ad-8a43-458f-80c8-099600e779b0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:13.817253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdb251ad-8a43-458f-80c8-099600e779b0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:13.819001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdb251ad-8a43-458f-80c8-099600e779b0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:13.820281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdb251ad-8a43-458f-80c8-099600e779b0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:13.821477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdb251ad-8a43-458f-80c8-099600e779b0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:14.494153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:14.503351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:14.519005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bdb251ad-8a43-458f-80c8-099600e779b0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:14.550432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:14.554536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:14.557747 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6cd19853-1031-42a2-aab6-46531c417361 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.157944 Aug 25 13:26:14.577737 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2413/4771] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:13 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:14.598267 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bdb251ad-8a43-458f-80c8-099600e779b0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1308 microversion: 2.1 time: 0.838520 Aug 25 13:26:14.600746 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2359/4772] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:13 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1308 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:15.615489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:15.640278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:15.677734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ac270ef2-020e-46d0-9433-f877f6f3a793 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:15.684398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ac270ef2-020e-46d0-9433-f877f6f3a793 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:15.719471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac270ef2-020e-46d0-9433-f877f6f3a793 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:15.720382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac270ef2-020e-46d0-9433-f877f6f3a793 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:15.721235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac270ef2-020e-46d0-9433-f877f6f3a793 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:15.722640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac270ef2-020e-46d0-9433-f877f6f3a793 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:15.736892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac270ef2-020e-46d0-9433-f877f6f3a793 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:15.737464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:15.738932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:15.743999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac270ef2-020e-46d0-9433-f877f6f3a793 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:15.750716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:15.752122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:15.752996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:15.753854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:17.432229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ac270ef2-020e-46d0-9433-f877f6f3a793 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:17.516388 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ac270ef2-020e-46d0-9433-f877f6f3a793 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1308 microversion: 2.1 time: 1.878124 Aug 25 13:26:17.548193 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2360/4773] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:15 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1308 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:17.640298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:17.684830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:17.690747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:17.694115 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-19e4243a-3159-4723-b510-13b47fc17e82 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 2.087412 Aug 25 13:26:17.695684 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2414/4774] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:15 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:18.490722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7780b142-b3b9-4f61-a305-7533e0afd32b req-745b7571-9a07-4a9e-a2fc-d9bd4b722a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232781de-33b4-4703-a5bd-679682200c7e", "tag": "f83df8c0-d8d2-43d3-82e5-62de940a1bf8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:18.581130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f2cc2513-9af2-476b-8bff-be8f79d2a95e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:18.600109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f2cc2513-9af2-476b-8bff-be8f79d2a95e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:18.612805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7780b142-b3b9-4f61-a305-7533e0afd32b req-745b7571-9a07-4a9e-a2fc-d9bd4b722a03 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:18.614510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7780b142-b3b9-4f61-a305-7533e0afd32b req-745b7571-9a07-4a9e-a2fc-d9bd4b722a03 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:18.623986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7780b142-b3b9-4f61-a305-7533e0afd32b req-745b7571-9a07-4a9e-a2fc-d9bd4b722a03 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:18.680527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:18.688285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:18.700644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2cc2513-9af2-476b-8bff-be8f79d2a95e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:18.706499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2cc2513-9af2-476b-8bff-be8f79d2a95e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:18.714598 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7780b142-b3b9-4f61-a305-7533e0afd32b req-745b7571-9a07-4a9e-a2fc-d9bd4b722a03 service nova] Creating event network-changed:f83df8c0-d8d2-43d3-82e5-62de940a1bf8 for instance 232781de-33b4-4703-a5bd-679682200c7e on n-h1-852771-8 Aug 25 13:26:18.718725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2cc2513-9af2-476b-8bff-be8f79d2a95e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:18.720141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2cc2513-9af2-476b-8bff-be8f79d2a95e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:18.721077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2cc2513-9af2-476b-8bff-be8f79d2a95e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:18.721839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2cc2513-9af2-476b-8bff-be8f79d2a95e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:18.741785 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7780b142-b3b9-4f61-a305-7533e0afd32b req-745b7571-9a07-4a9e-a2fc-d9bd4b722a03 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256410 Aug 25 13:26:18.745130 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2361/4775] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:18.764262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:18.772452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:18.791798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:18.793330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:18.794743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:18.796995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:18.798665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:18.799956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:19.720649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:20.499551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:20.519643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:20.523540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:20.526529 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-877ad30f-8b03-4b5e-b3ad-532896abe22c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.778613 Aug 25 13:26:20.528657 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2362/4776] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:18 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:20.685266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f2cc2513-9af2-476b-8bff-be8f79d2a95e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:20.727322 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f2cc2513-9af2-476b-8bff-be8f79d2a95e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1308 microversion: 2.1 time: 2.160982 Aug 25 13:26:20.728937 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2415/4777] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:18 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1308 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:21.594856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:21.595919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:21.610239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:21.611079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:21.611945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:21.613462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:21.613857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:21.614887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:21.780581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e966f750-f60b-481e-9e20-d98eb45aacba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:21.796509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e966f750-f60b-481e-9e20-d98eb45aacba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:21.826879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e966f750-f60b-481e-9e20-d98eb45aacba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:21.835201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e966f750-f60b-481e-9e20-d98eb45aacba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:21.837080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e966f750-f60b-481e-9e20-d98eb45aacba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:21.847290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e966f750-f60b-481e-9e20-d98eb45aacba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:21.848803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e966f750-f60b-481e-9e20-d98eb45aacba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:21.850009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e966f750-f60b-481e-9e20-d98eb45aacba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:22.359205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:22.391574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:22.404012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:22.406503 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b2d02c2-9cb8-487a-b28e-e1371c159ca0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 0.838583 Aug 25 13:26:22.418251 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2363/4778] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:21 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:22.445088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-82e41575-f003-476c-8e5f-f8911eb64e16 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:22.446574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-82e41575-f003-476c-8e5f-f8911eb64e16 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:22.461843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e41575-f003-476c-8e5f-f8911eb64e16 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:22.463100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e41575-f003-476c-8e5f-f8911eb64e16 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:22.464276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e41575-f003-476c-8e5f-f8911eb64e16 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:22.466232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e41575-f003-476c-8e5f-f8911eb64e16 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:22.467916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e41575-f003-476c-8e5f-f8911eb64e16 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:22.469158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e41575-f003-476c-8e5f-f8911eb64e16 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:22.492779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e966f750-f60b-481e-9e20-d98eb45aacba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:22.524503 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-82e41575-f003-476c-8e5f-f8911eb64e16 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/ips" status: 200 len: 146 microversion: 2.1 time: 0.103742 Aug 25 13:26:22.536007 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2364/4779] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:26:22 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/ips => generated 146 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:22.545326 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e966f750-f60b-481e-9e20-d98eb45aacba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1308 microversion: 2.1 time: 0.772839 Aug 25 13:26:22.548202 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2416/4780] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:21 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1308 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:23.467794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:23.524984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:23.524984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:23.524984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:23.524984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:23.524984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:23.524984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:23.524984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:23.613911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-73abb68f-820e-49a2-8570-182dd6877ea1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:23.615826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-73abb68f-820e-49a2-8570-182dd6877ea1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:23.641234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73abb68f-820e-49a2-8570-182dd6877ea1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:23.642792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73abb68f-820e-49a2-8570-182dd6877ea1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:23.644063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73abb68f-820e-49a2-8570-182dd6877ea1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:23.646367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73abb68f-820e-49a2-8570-182dd6877ea1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:23.647704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73abb68f-820e-49a2-8570-182dd6877ea1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:23.649282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-73abb68f-820e-49a2-8570-182dd6877ea1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:24.356093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-73abb68f-820e-49a2-8570-182dd6877ea1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:24.417282 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-73abb68f-820e-49a2-8570-182dd6877ea1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1308 microversion: 2.1 time: 0.818776 Aug 25 13:26:24.423642 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2417/4781] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:23 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1308 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:24.589882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:24.673939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:24.705857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:24.714800 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6e0d0ccf-b680-4f25-9c27-c9d79b4897bd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.254253 Aug 25 13:26:24.721979 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2365/4782] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:23 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:25.482877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4567c9e7-5e35-4246-b7df-479ed64b37ec tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:25.487800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4567c9e7-5e35-4246-b7df-479ed64b37ec tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:25.532016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4567c9e7-5e35-4246-b7df-479ed64b37ec tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:25.542101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4567c9e7-5e35-4246-b7df-479ed64b37ec tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:25.548849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4567c9e7-5e35-4246-b7df-479ed64b37ec tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:25.553700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4567c9e7-5e35-4246-b7df-479ed64b37ec tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:25.572126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4567c9e7-5e35-4246-b7df-479ed64b37ec tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:25.573722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4567c9e7-5e35-4246-b7df-479ed64b37ec tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:25.770339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:25.771569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:25.819989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:25.825295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:25.834131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:25.838230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:25.839062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:25.839808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:26.530308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4567c9e7-5e35-4246-b7df-479ed64b37ec tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:26.569446 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4567c9e7-5e35-4246-b7df-479ed64b37ec tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1308 microversion: 2.1 time: 1.098763 Aug 25 13:26:26.594019 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2418/4783] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:25 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1308 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:26.752056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:26.798941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:26.804283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:26.813377 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6cc1258d-002a-4d9d-82c1-02448813c8c6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.051141 Aug 25 13:26:26.814940 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2366/4784] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:25 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:27.631299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d1c6e85a-12b5-49ba-97cc-d140b6cbe23f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:27.633241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d1c6e85a-12b5-49ba-97cc-d140b6cbe23f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:27.673455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1c6e85a-12b5-49ba-97cc-d140b6cbe23f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:27.674441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1c6e85a-12b5-49ba-97cc-d140b6cbe23f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:27.675285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1c6e85a-12b5-49ba-97cc-d140b6cbe23f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:27.676648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1c6e85a-12b5-49ba-97cc-d140b6cbe23f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:27.677438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1c6e85a-12b5-49ba-97cc-d140b6cbe23f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:27.693079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1c6e85a-12b5-49ba-97cc-d140b6cbe23f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:27.875067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:27.875818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:27.916531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:27.922271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:27.926007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:27.931789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:27.933102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:27.936734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:28.229058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d1c6e85a-12b5-49ba-97cc-d140b6cbe23f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:28.269148 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d1c6e85a-12b5-49ba-97cc-d140b6cbe23f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1308 microversion: 2.1 time: 0.652020 Aug 25 13:26:28.274037 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2419/4785] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:27 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1308 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:28.338442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8555bd7b-6d74-4c4d-9674-0d25b729f635 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edf2edb6-338d-401a-bbe9-18437a6e2124"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:28.344866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8555bd7b-6d74-4c4d-9674-0d25b729f635 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:28.358984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8555bd7b-6d74-4c4d-9674-0d25b729f635 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:28.360576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8555bd7b-6d74-4c4d-9674-0d25b729f635 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:28.361921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8555bd7b-6d74-4c4d-9674-0d25b729f635 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:28.364046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8555bd7b-6d74-4c4d-9674-0d25b729f635 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:28.365377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8555bd7b-6d74-4c4d-9674-0d25b729f635 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:28.366634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8555bd7b-6d74-4c4d-9674-0d25b729f635 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:28.778236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:28.818633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:28.834399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:28.841066 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bdf81eea-33e9-4573-aec9-b83308a9e792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 0.973209 Aug 25 13:26:28.848031 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2367/4786] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:27 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:29.325735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-34216145-284a-44df-80f1-6bfaa91e2466 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:29.329950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-34216145-284a-44df-80f1-6bfaa91e2466 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:29.390610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34216145-284a-44df-80f1-6bfaa91e2466 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:29.401351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34216145-284a-44df-80f1-6bfaa91e2466 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:29.412900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34216145-284a-44df-80f1-6bfaa91e2466 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:29.414067 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8555bd7b-6d74-4c4d-9674-0d25b729f635 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.066965 Aug 25 13:26:29.416611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34216145-284a-44df-80f1-6bfaa91e2466 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:29.437680 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2420/4787] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:26:28 2022] POST /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/os-volume_attachments => generated 194 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:26:29.451828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34216145-284a-44df-80f1-6bfaa91e2466 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:29.453150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34216145-284a-44df-80f1-6bfaa91e2466 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:29.906678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:29.922415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:29.956874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:29.958395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:29.959339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:29.961584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:29.973133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:29.975036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:30.096345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-34216145-284a-44df-80f1-6bfaa91e2466 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:30.141788 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-34216145-284a-44df-80f1-6bfaa91e2466 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1308 microversion: 2.1 time: 0.826688 Aug 25 13:26:30.142894 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2368/4788] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:29 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1308 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:30.430252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:30.478593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:30.486240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:30.493424 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f8a5283-d1b6-49f3-bb2e-36df7c056f1b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 0.600762 Aug 25 13:26:30.515339 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2421/4789] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:29 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:31.199591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7f262b14-4e4c-44d6-b788-6f99e2179bcf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:31.209278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7f262b14-4e4c-44d6-b788-6f99e2179bcf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:31.250809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f262b14-4e4c-44d6-b788-6f99e2179bcf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:31.252303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f262b14-4e4c-44d6-b788-6f99e2179bcf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:31.253840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f262b14-4e4c-44d6-b788-6f99e2179bcf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:31.258247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f262b14-4e4c-44d6-b788-6f99e2179bcf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:31.262079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f262b14-4e4c-44d6-b788-6f99e2179bcf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:31.271392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f262b14-4e4c-44d6-b788-6f99e2179bcf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:31.555040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:31.561237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:31.590127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:31.594710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:31.596640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:31.600954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:31.603661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:31.611590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:32.243603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7f262b14-4e4c-44d6-b788-6f99e2179bcf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:32.290289 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7f262b14-4e4c-44d6-b788-6f99e2179bcf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1308 microversion: 2.1 time: 1.106575 Aug 25 13:26:32.302415 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2369/4790] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:31 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1308 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:32.328153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-edb84946-b15f-4a61-8fc6-b871fdb0d883 req-37e03992-d781-4697-84e5-cf8975e5a18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232781de-33b4-4703-a5bd-679682200c7e", "name": "network-vif-plugged", "status": "completed", "tag": "f83df8c0-d8d2-43d3-82e5-62de940a1bf8"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:32.428944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-edb84946-b15f-4a61-8fc6-b871fdb0d883 req-37e03992-d781-4697-84e5-cf8975e5a18f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:32.436051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-edb84946-b15f-4a61-8fc6-b871fdb0d883 req-37e03992-d781-4697-84e5-cf8975e5a18f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:32.440521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-edb84946-b15f-4a61-8fc6-b871fdb0d883 req-37e03992-d781-4697-84e5-cf8975e5a18f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:32.463232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:32.510133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:32.520953 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-edb84946-b15f-4a61-8fc6-b871fdb0d883 req-37e03992-d781-4697-84e5-cf8975e5a18f service nova] Creating event network-vif-plugged:f83df8c0-d8d2-43d3-82e5-62de940a1bf8 for instance 232781de-33b4-4703-a5bd-679682200c7e on n-h1-852771-8 Aug 25 13:26:32.522075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:32.529643 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7d9c8eb8-7136-4b32-ab39-34027b5100f5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 0.982037 Aug 25 13:26:32.550374 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2422/4791] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:31 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:32.570034 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-edb84946-b15f-4a61-8fc6-b871fdb0d883 req-37e03992-d781-4697-84e5-cf8975e5a18f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264324 Aug 25 13:26:32.572089 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2370/4792] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:33.349591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac9f9130-eaa3-47aa-81c3-a6e803010904 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:33.350724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ac9f9130-eaa3-47aa-81c3-a6e803010904 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:33.396601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac9f9130-eaa3-47aa-81c3-a6e803010904 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:33.398179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac9f9130-eaa3-47aa-81c3-a6e803010904 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:33.400527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac9f9130-eaa3-47aa-81c3-a6e803010904 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:33.402305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac9f9130-eaa3-47aa-81c3-a6e803010904 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:33.404534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac9f9130-eaa3-47aa-81c3-a6e803010904 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:33.412403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac9f9130-eaa3-47aa-81c3-a6e803010904 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:33.617621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:33.630466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:33.686066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:33.695166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:33.701046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:33.703958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:33.708714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:33.712952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:34.114375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ac9f9130-eaa3-47aa-81c3-a6e803010904 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:34.140320 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ac9f9130-eaa3-47aa-81c3-a6e803010904 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1308 microversion: 2.1 time: 0.798546 Aug 25 13:26:34.144760 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2423/4793] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:33 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1308 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:34.221273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:34.242983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:34.254299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:34.257198 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d21b314-8acc-4d30-9363-89dc4b764fae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 0.668524 Aug 25 13:26:34.258550 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2371/4794] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:33 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:35.182958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-de9cf0f7-123d-472a-86aa-8b1d2c987bf7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:35.184060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-de9cf0f7-123d-472a-86aa-8b1d2c987bf7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:35.216687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de9cf0f7-123d-472a-86aa-8b1d2c987bf7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:35.217935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de9cf0f7-123d-472a-86aa-8b1d2c987bf7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:35.218471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de9cf0f7-123d-472a-86aa-8b1d2c987bf7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:35.219966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de9cf0f7-123d-472a-86aa-8b1d2c987bf7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:35.220849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de9cf0f7-123d-472a-86aa-8b1d2c987bf7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:35.221661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-de9cf0f7-123d-472a-86aa-8b1d2c987bf7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:35.310510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:35.320510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:35.358027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:35.359556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:35.361037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:35.362905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:35.374485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:35.375783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:36.125877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-de9cf0f7-123d-472a-86aa-8b1d2c987bf7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:36.158863 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-de9cf0f7-123d-472a-86aa-8b1d2c987bf7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1487 microversion: 2.1 time: 0.983199 Aug 25 13:26:36.161945 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2424/4795] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:35 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1487 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:36.216253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e183e9b7-bfdf-4605-b3fc-e9767c684141 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:36.218303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e183e9b7-bfdf-4605-b3fc-e9767c684141 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:36.229047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:36.267426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e183e9b7-bfdf-4605-b3fc-e9767c684141 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:36.282638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e183e9b7-bfdf-4605-b3fc-e9767c684141 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:36.284810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e183e9b7-bfdf-4605-b3fc-e9767c684141 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:36.287935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e183e9b7-bfdf-4605-b3fc-e9767c684141 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:36.292906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e183e9b7-bfdf-4605-b3fc-e9767c684141 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:36.297634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e183e9b7-bfdf-4605-b3fc-e9767c684141 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:36.307372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:36.315463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:36.322866 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1a1af9f1-e304-4577-800f-aa2a7a0f3e02 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.017241 Aug 25 13:26:36.325223 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2372/4796] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:35 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:36.959886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e183e9b7-bfdf-4605-b3fc-e9767c684141 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:37.004491 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e183e9b7-bfdf-4605-b3fc-e9767c684141 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1488 microversion: 2.1 time: 0.793950 Aug 25 13:26:37.009228 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2425/4797] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:36 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1488 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:37.053411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27bda538-cea6-4a4d-98a0-9fc7799364ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:37.058965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-27bda538-cea6-4a4d-98a0-9fc7799364ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:37.114652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27bda538-cea6-4a4d-98a0-9fc7799364ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:37.115727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27bda538-cea6-4a4d-98a0-9fc7799364ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:37.116590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27bda538-cea6-4a4d-98a0-9fc7799364ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:37.118016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27bda538-cea6-4a4d-98a0-9fc7799364ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:37.118795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27bda538-cea6-4a4d-98a0-9fc7799364ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:37.119574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27bda538-cea6-4a4d-98a0-9fc7799364ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:37.152178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=88 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:37.400001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:37.407105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:37.444249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:37.449257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:37.451316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:37.455525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:37.459524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:37.464465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:38.078114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-27bda538-cea6-4a4d-98a0-9fc7799364ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:38.146176 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-27bda538-cea6-4a4d-98a0-9fc7799364ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1487 microversion: 2.1 time: 1.103857 Aug 25 13:26:38.151446 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2373/4798] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:37 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1487 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:38.207844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ecb6adbb-1000-49ef-901c-699094a745fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:38.214616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ecb6adbb-1000-49ef-901c-699094a745fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:38.293183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb6adbb-1000-49ef-901c-699094a745fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:38.302257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb6adbb-1000-49ef-901c-699094a745fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:38.303308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb6adbb-1000-49ef-901c-699094a745fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:38.309739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb6adbb-1000-49ef-901c-699094a745fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:38.312312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb6adbb-1000-49ef-901c-699094a745fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:38.318035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ecb6adbb-1000-49ef-901c-699094a745fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:38.485571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:38.544371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:38.547843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:38.560874 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c74b9853-8ce2-4629-b8d0-f7f8acb58c65 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.176361 Aug 25 13:26:38.568242 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2426/4799] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:37 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:38.599304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ecb6adbb-1000-49ef-901c-699094a745fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:26:39.129055 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ecb6adbb-1000-49ef-901c-699094a745fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 204 len: 0 microversion: 2.1 time: 0.936538 Aug 25 13:26:39.135148 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2374/4800] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:26:38 2022] DELETE /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 0 bytes in 945 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:26:39.150912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-23d0b52b-2728-423d-b1ef-0aa649f1bd95 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:39.152153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-23d0b52b-2728-423d-b1ef-0aa649f1bd95 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:39.183114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23d0b52b-2728-423d-b1ef-0aa649f1bd95 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:39.184449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23d0b52b-2728-423d-b1ef-0aa649f1bd95 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:39.188959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23d0b52b-2728-423d-b1ef-0aa649f1bd95 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:39.190885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23d0b52b-2728-423d-b1ef-0aa649f1bd95 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:39.192315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23d0b52b-2728-423d-b1ef-0aa649f1bd95 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:39.195268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23d0b52b-2728-423d-b1ef-0aa649f1bd95 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:39.638992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:39.642246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:39.657933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:39.661396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:39.663013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:39.664695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:39.667206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:39.668264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:39.669930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:41.390149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-23d0b52b-2728-423d-b1ef-0aa649f1bd95 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:41.443833 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-23d0b52b-2728-423d-b1ef-0aa649f1bd95 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1493 microversion: 2.1 time: 2.298558 Aug 25 13:26:41.449304 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2427/4801] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:39 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1493 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:41.518886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:41.556540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:41.563764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:41.566110 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c4a7e47e-0b3d-4db1-a9c6-49903001e39d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.954309 Aug 25 13:26:41.581559 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2375/4802] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:39 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:42.506442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2da46d40-7222-4cff-b1b3-df65e056700e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:42.507891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2da46d40-7222-4cff-b1b3-df65e056700e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:42.549394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=36 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:42.571595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2da46d40-7222-4cff-b1b3-df65e056700e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:42.573244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2da46d40-7222-4cff-b1b3-df65e056700e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:42.574791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2da46d40-7222-4cff-b1b3-df65e056700e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:42.585034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2da46d40-7222-4cff-b1b3-df65e056700e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:42.587188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2da46d40-7222-4cff-b1b3-df65e056700e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:42.588815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2da46d40-7222-4cff-b1b3-df65e056700e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:42.619908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:42.627404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:42.717453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:42.725150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:42.727389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:42.734507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:42.743321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:42.747504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:43.357945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2da46d40-7222-4cff-b1b3-df65e056700e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:43.445848 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2da46d40-7222-4cff-b1b3-df65e056700e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 200 len: 1451 microversion: 2.1 time: 0.961047 Aug 25 13:26:43.446989 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2428/4803] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:42 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 1451 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:43.490549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-7632a9fd-7a09-4801-a516-aabf810ccb22 req-96a69082-bc4a-4cf7-b1f4-be13718abc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232781de-33b4-4703-a5bd-679682200c7e", "name": "network-vif-deleted", "tag": "f83df8c0-d8d2-43d3-82e5-62de940a1bf8"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:43.570618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7632a9fd-7a09-4801-a516-aabf810ccb22 req-96a69082-bc4a-4cf7-b1f4-be13718abc08 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:43.574762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7632a9fd-7a09-4801-a516-aabf810ccb22 req-96a69082-bc4a-4cf7-b1f4-be13718abc08 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:43.577784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7632a9fd-7a09-4801-a516-aabf810ccb22 req-96a69082-bc4a-4cf7-b1f4-be13718abc08 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:43.610286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:43.656742 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-7632a9fd-7a09-4801-a516-aabf810ccb22 req-96a69082-bc4a-4cf7-b1f4-be13718abc08 service nova] Creating event network-vif-deleted:f83df8c0-d8d2-43d3-82e5-62de940a1bf8 for instance 232781de-33b4-4703-a5bd-679682200c7e on n-h1-852771-8 Aug 25 13:26:43.693377 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-7632a9fd-7a09-4801-a516-aabf810ccb22 req-96a69082-bc4a-4cf7-b1f4-be13718abc08 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232909 Aug 25 13:26:43.704197 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2429/4804] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:43.744182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:43.783546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:43.798874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:43.801651 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3ba3a0f-bc54-4cd5-9b6c-1337446455fa tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.190679 Aug 25 13:26:43.805327 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2376/4805] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:42 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:44.508572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:44.513489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:44.561816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:44.562703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:44.563615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:44.565946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:44.570212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:44.573483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:44.648931 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e HTTP/1.1 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '232781de-33b4-4703-a5bd-679682200c7e'} Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:26:44.652822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:26:44.668038 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:26:44.668038 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:26:44.668038 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:26:44.668038 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:26:44.668038 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:26:44.668038 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:26:44.668038 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:26:44.668038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:26:44.668038 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43f852cd-ad63-4eae-a9a5-684c26ecdfba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 404 len: 111 microversion: 2.1 time: 0.174706 Aug 25 13:26:44.683350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-45058f9a-046b-4027-b5cb-2cb71377ed25 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:44.686860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-45058f9a-046b-4027-b5cb-2cb71377ed25 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:44.693174 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2430/4806] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:44 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:26:44.717562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45058f9a-046b-4027-b5cb-2cb71377ed25 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:44.718513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45058f9a-046b-4027-b5cb-2cb71377ed25 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:44.719568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45058f9a-046b-4027-b5cb-2cb71377ed25 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:44.720974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45058f9a-046b-4027-b5cb-2cb71377ed25 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:44.721903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45058f9a-046b-4027-b5cb-2cb71377ed25 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:44.734414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45058f9a-046b-4027-b5cb-2cb71377ed25 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:44.834048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-45058f9a-046b-4027-b5cb-2cb71377ed25 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:26:44.859212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:44.863332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:44.961536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:44.962970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:44.967261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:44.968556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:44.976972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:44.979719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:45.217203 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-45058f9a-046b-4027-b5cb-2cb71377ed25 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 204 len: 0 microversion: 2.1 time: 0.540482 Aug 25 13:26:45.219736 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2377/4807] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:26:44 2022] DELETE /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:26:45.249939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14539d15-0a77-415d-aa46-f7727a0117d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:45.252287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-14539d15-0a77-415d-aa46-f7727a0117d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:45.282130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14539d15-0a77-415d-aa46-f7727a0117d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:45.289622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14539d15-0a77-415d-aa46-f7727a0117d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:45.290921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14539d15-0a77-415d-aa46-f7727a0117d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:45.292635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14539d15-0a77-415d-aa46-f7727a0117d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:45.294269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14539d15-0a77-415d-aa46-f7727a0117d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:45.306864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14539d15-0a77-415d-aa46-f7727a0117d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:46.130151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:46.178470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:46.188071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:46.198194 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0fc4dcf3-390b-4c09-9ce5-8f2c78ded7a2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.355917 Aug 25 13:26:46.213376 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2431/4808] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:44 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:46.268168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a62dc836-13fe-4084-aeb0-eb3679be8083 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b2af833-7761-4029-9d55-ce3747b34cfa"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:46.289482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a62dc836-13fe-4084-aeb0-eb3679be8083 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:46.351003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a62dc836-13fe-4084-aeb0-eb3679be8083 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:46.352665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a62dc836-13fe-4084-aeb0-eb3679be8083 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:46.356426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a62dc836-13fe-4084-aeb0-eb3679be8083 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:46.359671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a62dc836-13fe-4084-aeb0-eb3679be8083 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:46.363305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a62dc836-13fe-4084-aeb0-eb3679be8083 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:46.371682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a62dc836-13fe-4084-aeb0-eb3679be8083 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:47.017138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-14539d15-0a77-415d-aa46-f7727a0117d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:47.057069 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-14539d15-0a77-415d-aa46-f7727a0117d1 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1494 microversion: 2.1 time: 1.827030 Aug 25 13:26:47.063645 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2378/4809] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:45 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1494 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:47.257480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:47.265168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:47.292929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:47.295061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:47.296796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:47.299304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:47.300897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:47.302355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:48.674919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:48.709877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:48.715433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:48.719430 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7394e989-5845-42e6-880f-3dc3ae797706 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.469926 Aug 25 13:26:48.722047 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2379/4810] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:47 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:48.756602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ea6798d2-bcf8-4aca-a281-edba5f26571e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:48.761752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ea6798d2-bcf8-4aca-a281-edba5f26571e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:48.786080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea6798d2-bcf8-4aca-a281-edba5f26571e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:48.787571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea6798d2-bcf8-4aca-a281-edba5f26571e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:48.789790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea6798d2-bcf8-4aca-a281-edba5f26571e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:48.804135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea6798d2-bcf8-4aca-a281-edba5f26571e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:48.807544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea6798d2-bcf8-4aca-a281-edba5f26571e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:48.809032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ea6798d2-bcf8-4aca-a281-edba5f26571e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:48.839200 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a62dc836-13fe-4084-aeb0-eb3679be8083 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.617367 Aug 25 13:26:48.854836 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2432/4811] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:26:46 2022] POST /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 194 bytes in 2640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:49.683970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ea6798d2-bcf8-4aca-a281-edba5f26571e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:49.722495 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ea6798d2-bcf8-4aca-a281-edba5f26571e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1494 microversion: 2.1 time: 0.996829 Aug 25 13:26:49.724283 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2380/4812] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:48 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1494 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:49.791250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:49.811798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:49.852249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:49.857822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:49.859050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:49.860790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:49.867266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:49.868475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:50.905961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:50.963546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:50.971249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:50.997725 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-77f24a1f-1e34-4449-89ff-c9cd6439e8bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.215811 Aug 25 13:26:51.003593 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2433/4813] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:49 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:51.083466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-91e2795f-2057-485a-97fe-976ef3d890bd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:51.085549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-91e2795f-2057-485a-97fe-976ef3d890bd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:51.136336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91e2795f-2057-485a-97fe-976ef3d890bd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:51.163771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91e2795f-2057-485a-97fe-976ef3d890bd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:51.167015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91e2795f-2057-485a-97fe-976ef3d890bd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:51.179599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91e2795f-2057-485a-97fe-976ef3d890bd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:51.185144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91e2795f-2057-485a-97fe-976ef3d890bd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:51.190454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-91e2795f-2057-485a-97fe-976ef3d890bd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:51.268527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-00d15335-657f-404b-9c8f-740451637bd1 req-df46858e-fb47-46c4-a8aa-9ab378e128ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63b2d77-0fb6-49ad-9466-0a8200df0e4c", "name": "network-vif-deleted", "tag": "b382c307-d35c-4195-8a86-d3ef7aacf594"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:51.398470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-00d15335-657f-404b-9c8f-740451637bd1 req-df46858e-fb47-46c4-a8aa-9ab378e128ec service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:51.399792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-00d15335-657f-404b-9c8f-740451637bd1 req-df46858e-fb47-46c4-a8aa-9ab378e128ec service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:51.400872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-00d15335-657f-404b-9c8f-740451637bd1 req-df46858e-fb47-46c4-a8aa-9ab378e128ec service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:51.467334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-00d15335-657f-404b-9c8f-740451637bd1 req-df46858e-fb47-46c4-a8aa-9ab378e128ec service nova] Creating event network-vif-deleted:b382c307-d35c-4195-8a86-d3ef7aacf594 for instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c on n-h2-852771-8 Aug 25 13:26:51.503967 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-00d15335-657f-404b-9c8f-740451637bd1 req-df46858e-fb47-46c4-a8aa-9ab378e128ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.732103 Aug 25 13:26:51.507069 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2381/4814] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:51.613111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-91e2795f-2057-485a-97fe-976ef3d890bd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:51.639845 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-91e2795f-2057-485a-97fe-976ef3d890bd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 200 len: 1293 microversion: 2.1 time: 0.629192 Aug 25 13:26:51.658007 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2434/4815] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:51 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 1293 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:52.056245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:52.058627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:52.096305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:52.097367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:52.099843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:52.104475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:52.108376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:52.111519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:52.624750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:52.668203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:52.679499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:52.688089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:52.689312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:52.695534 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-99ec8eba-147e-49b7-afd1-f1b3a70f8d8f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 0.651031 Aug 25 13:26:52.701827 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2382/4816] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:52 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:52.739879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:52.740767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:52.748451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:52.750452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:52.752980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:52.756969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:52.823921 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c HTTP/1.1 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'e63b2d77-0fb6-49ad-9466-0a8200df0e4c'} Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:26:52.831025 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:26:52.839998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:26:52.839998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:26:52.839998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:26:52.839998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:26:52.839998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:26:52.839998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:26:52.839998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:26:52.849542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:26:52.851804 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3deb805a-c752-40f3-a893-8878aea0a4c5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 404 len: 111 microversion: 2.1 time: 0.171566 Aug 25 13:26:52.853411 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2435/4817] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:52 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:26:53.126096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-866160253", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "0fc430fe-72c2-45e0-a5f2-bac853189a57"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:53.352479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] validate_networks() for [('0fc430fe-72c2-45e0-a5f2-bac853189a57', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:26:53.746749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:53.753009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:53.790943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:53.792309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:53.795161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:53.797132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:53.800782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:53.804717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:54.952752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:54.996142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:55.001171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:55.004710 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-546d1e5a-f01b-41a9-9d46-661e1d4f4438 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1740 microversion: 2.20 time: 1.266551 Aug 25 13:26:55.007205 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2436/4818] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:53 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1740 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:26:55.087619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:26:55.088585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:26:55.089544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:26:55.090420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:26:55.091849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:26:55.113588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:55.115040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:55.115862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:55.117692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:55.119133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:55.120763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:55.173737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:26:55.217589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for user bd7b1570a27f4ea8ad560ce25225cf02 and project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:26:55.288589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:26:55.304791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:26:55.534456 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59c6e00e-a119-4590-a31a-4681637d2a06 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.420736 Aug 25 13:26:55.536422 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2383/4819] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:26:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:26:55.578453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d87118e9-b37c-42ca-86b5-78a4b15468eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:55.579687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d87118e9-b37c-42ca-86b5-78a4b15468eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:55.591863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c45c7116-7d03-4b14-8159-0ee2d2a572e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:55.666737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c45c7116-7d03-4b14-8159-0ee2d2a572e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:55.673867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c45c7116-7d03-4b14-8159-0ee2d2a572e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:55.677668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c45c7116-7d03-4b14-8159-0ee2d2a572e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:55.780269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c45c7116-7d03-4b14-8159-0ee2d2a572e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Going to try to stop instance {{(pid=129059) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:26:55.956924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d87118e9-b37c-42ca-86b5-78a4b15468eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:55.976834 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c45c7116-7d03-4b14-8159-0ee2d2a572e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/action" status: 202 len: 0 microversion: 2.1 time: 0.395586 Aug 25 13:26:55.980217 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2384/4820] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:26:55 2022] POST /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:26:55.994158 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d87118e9-b37c-42ca-86b5-78a4b15468eb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1208 microversion: 2.1 time: 0.440806 Aug 25 13:26:55.995384 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2437/4821] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:55 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1208 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:56.019591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-025b2dba-fbb7-41ab-a4ba-44e27d8dbdd5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:56.026135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-025b2dba-fbb7-41ab-a4ba-44e27d8dbdd5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:56.069840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:56.082754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:56.099298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025b2dba-fbb7-41ab-a4ba-44e27d8dbdd5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:56.100274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025b2dba-fbb7-41ab-a4ba-44e27d8dbdd5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:56.110504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025b2dba-fbb7-41ab-a4ba-44e27d8dbdd5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:56.114808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025b2dba-fbb7-41ab-a4ba-44e27d8dbdd5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:56.126102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025b2dba-fbb7-41ab-a4ba-44e27d8dbdd5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:56.127589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025b2dba-fbb7-41ab-a4ba-44e27d8dbdd5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:56.128312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:56.135444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:56.140260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:56.147244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:56.151050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:56.158130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:56.809650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:56.841348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-025b2dba-fbb7-41ab-a4ba-44e27d8dbdd5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:56.844086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:56.847872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:56.851203 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6738a6b5-34ee-4bb4-8046-e2639f63052f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1722 microversion: 2.20 time: 0.807322 Aug 25 13:26:56.866368 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2438/4822] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:56 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1722 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:56.902663 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-025b2dba-fbb7-41ab-a4ba-44e27d8dbdd5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.910581 Aug 25 13:26:56.905708 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2385/4823] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:55 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:57.057942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85d15e7f-e8f4-44c0-b4f7-ecf845aa8b5e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:57.059219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85d15e7f-e8f4-44c0-b4f7-ecf845aa8b5e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:57.913691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:57.925306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-85d15e7f-e8f4-44c0-b4f7-ecf845aa8b5e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:57.930222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:57.988061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:57.989263 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85d15e7f-e8f4-44c0-b4f7-ecf845aa8b5e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1208 microversion: 2.1 time: 0.939635 Aug 25 13:26:57.991769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:57.992454 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2439/4824] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:57 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1208 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:57.999398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:58.004645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:58.005832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:58.008322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:58.022117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-113e7a92-2603-405c-a197-12c885e89b6f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:58.023113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-113e7a92-2603-405c-a197-12c885e89b6f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:58.055474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-113e7a92-2603-405c-a197-12c885e89b6f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:58.060026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-113e7a92-2603-405c-a197-12c885e89b6f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:58.065626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-113e7a92-2603-405c-a197-12c885e89b6f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:58.069944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-113e7a92-2603-405c-a197-12c885e89b6f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:58.075847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-113e7a92-2603-405c-a197-12c885e89b6f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:58.077091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-113e7a92-2603-405c-a197-12c885e89b6f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:58.878273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:58.891179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:58.898071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:58.900686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:58.904885 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-86723430-99ee-480d-8c67-709a5247051e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1722 microversion: 2.20 time: 1.011110 Aug 25 13:26:58.925893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-113e7a92-2603-405c-a197-12c885e89b6f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:58.960408 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2386/4825] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:57 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1722 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:26:58.965781 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-113e7a92-2603-405c-a197-12c885e89b6f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.967360 Aug 25 13:26:58.972971 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2440/4826] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:57 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:59.033318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-58e91836-da54-4c96-ba3e-f2598948b8a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:59.034468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-58e91836-da54-4c96-ba3e-f2598948b8a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:59.065269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58e91836-da54-4c96-ba3e-f2598948b8a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:59.070735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58e91836-da54-4c96-ba3e-f2598948b8a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:59.080280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58e91836-da54-4c96-ba3e-f2598948b8a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:59.082034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58e91836-da54-4c96-ba3e-f2598948b8a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:59.083223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58e91836-da54-4c96-ba3e-f2598948b8a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:59.084357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58e91836-da54-4c96-ba3e-f2598948b8a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:59.320303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-58e91836-da54-4c96-ba3e-f2598948b8a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:59.353291 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-58e91836-da54-4c96-ba3e-f2598948b8a4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1266 microversion: 2.1 time: 0.330364 Aug 25 13:26:59.355362 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2387/4827] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:59 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:59.557124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1fe76a6b-c14d-49f7-b8e0-ff3178ad481e req-2d903c97-1b60-40ba-a34f-c84fff277bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d404ff6f-0fad-4c7f-bf95-5c0fe210039b", "name": "network-vif-unplugged", "status": "completed", "tag": "8b68205d-7c61-4adf-ace8-ad7064786841"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:59.635415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1fe76a6b-c14d-49f7-b8e0-ff3178ad481e req-2d903c97-1b60-40ba-a34f-c84fff277bb1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:59.651570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1fe76a6b-c14d-49f7-b8e0-ff3178ad481e req-2d903c97-1b60-40ba-a34f-c84fff277bb1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:59.652503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1fe76a6b-c14d-49f7-b8e0-ff3178ad481e req-2d903c97-1b60-40ba-a34f-c84fff277bb1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:59.730612 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1fe76a6b-c14d-49f7-b8e0-ff3178ad481e req-2d903c97-1b60-40ba-a34f-c84fff277bb1 service nova] Creating event network-vif-unplugged:8b68205d-7c61-4adf-ace8-ad7064786841 for instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b on n-h1-852771-8 Aug 25 13:26:59.750227 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1fe76a6b-c14d-49f7-b8e0-ff3178ad481e req-2d903c97-1b60-40ba-a34f-c84fff277bb1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.200861 Aug 25 13:26:59.753544 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2441/4828] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:59.963413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:59.963413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:00.000579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:00.001357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:00.003098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:00.004471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:00.005491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:00.006576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:00.022506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df763e61-0ee0-424f-95ff-87293691cde7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:00.031709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-df763e61-0ee0-424f-95ff-87293691cde7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:00.073822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df763e61-0ee0-424f-95ff-87293691cde7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:00.080346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df763e61-0ee0-424f-95ff-87293691cde7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:00.085191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df763e61-0ee0-424f-95ff-87293691cde7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:00.089758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df763e61-0ee0-424f-95ff-87293691cde7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:00.096653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df763e61-0ee0-424f-95ff-87293691cde7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:00.097649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df763e61-0ee0-424f-95ff-87293691cde7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:00.768405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df763e61-0ee0-424f-95ff-87293691cde7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:00.811948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:00.815616 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-df763e61-0ee0-424f-95ff-87293691cde7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.810632 Aug 25 13:27:00.821877 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2442/4829] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:59 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:00.862275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b3a38c25-d7d7-466b-ae00-484a41e26eaf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:00.864078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b3a38c25-d7d7-466b-ae00-484a41e26eaf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:00.876411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:00.885831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:00.894197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a38c25-d7d7-466b-ae00-484a41e26eaf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:00.895218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a38c25-d7d7-466b-ae00-484a41e26eaf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:00.896215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a38c25-d7d7-466b-ae00-484a41e26eaf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:00.898089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a38c25-d7d7-466b-ae00-484a41e26eaf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:00.899883 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d76a24ae-6673-4f60-b308-c2403e287c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1722 microversion: 2.20 time: 0.945461 Aug 25 13:27:00.904879 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2388/4830] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:26:59 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1722 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:00.909566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a38c25-d7d7-466b-ae00-484a41e26eaf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:00.910580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3a38c25-d7d7-466b-ae00-484a41e26eaf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:01.543901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b3a38c25-d7d7-466b-ae00-484a41e26eaf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:01.582884 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b3a38c25-d7d7-466b-ae00-484a41e26eaf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1308 microversion: 2.1 time: 0.753423 Aug 25 13:27:01.592951 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2443/4831] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:00 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1308 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:01.863239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-605cee86-9b50-4478-8648-05353dfe0a5a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:01.864383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-605cee86-9b50-4478-8648-05353dfe0a5a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:01.880133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-605cee86-9b50-4478-8648-05353dfe0a5a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:01.883341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-605cee86-9b50-4478-8648-05353dfe0a5a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:01.885836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-605cee86-9b50-4478-8648-05353dfe0a5a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:01.890090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-605cee86-9b50-4478-8648-05353dfe0a5a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:01.892263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-605cee86-9b50-4478-8648-05353dfe0a5a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:01.893478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-605cee86-9b50-4478-8648-05353dfe0a5a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:01.959700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:01.962118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:01.997671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:01.998561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:02.002257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:02.003672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:02.009134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:02.013623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:02.816282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:02.848149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:02.860503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:02.863549 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-af77def3-a675-4477-86c5-c317b795b6da tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1665 microversion: 2.20 time: 0.916255 Aug 25 13:27:02.866668 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2444/4832] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:01 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1665 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:27:02.879406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c164062-fd90-4074-8443-1a23dda14795 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:02.886616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c164062-fd90-4074-8443-1a23dda14795 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:02.906637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c164062-fd90-4074-8443-1a23dda14795 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:02.909074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c164062-fd90-4074-8443-1a23dda14795 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:02.911060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c164062-fd90-4074-8443-1a23dda14795 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:02.912844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c164062-fd90-4074-8443-1a23dda14795 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:02.914150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c164062-fd90-4074-8443-1a23dda14795 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:02.915306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c164062-fd90-4074-8443-1a23dda14795 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:03.063875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-605cee86-9b50-4478-8648-05353dfe0a5a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:03.097443 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-605cee86-9b50-4478-8648-05353dfe0a5a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 1.241465 Aug 25 13:27:03.098781 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2389/4833] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:01 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:03.122907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-624d7cbd-ea52-4733-98ae-09ffdbc5a979 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12b0c04b-130b-4e9f-875e-2552084150ae"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:03.145544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-624d7cbd-ea52-4733-98ae-09ffdbc5a979 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:03.176334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-624d7cbd-ea52-4733-98ae-09ffdbc5a979 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:03.177237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-624d7cbd-ea52-4733-98ae-09ffdbc5a979 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:03.178104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-624d7cbd-ea52-4733-98ae-09ffdbc5a979 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:03.181973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-624d7cbd-ea52-4733-98ae-09ffdbc5a979 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:03.182846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-624d7cbd-ea52-4733-98ae-09ffdbc5a979 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:03.183662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-624d7cbd-ea52-4733-98ae-09ffdbc5a979 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:03.563755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0c164062-fd90-4074-8443-1a23dda14795 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:03.595985 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c164062-fd90-4074-8443-1a23dda14795 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1308 microversion: 2.1 time: 0.725523 Aug 25 13:27:03.613455 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2445/4834] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:02 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1308 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:04.091733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-de33743f-2a15-4223-b5a4-bd87b1dec1ad req-5e984466-0f10-428e-b816-aed5997f1e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87965976-52e5-4b4b-b38f-ef76c2abdea6", "tag": "2150a293-d499-4ae7-ad16-477e6100ab07"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:04.147398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-de33743f-2a15-4223-b5a4-bd87b1dec1ad req-5e984466-0f10-428e-b816-aed5997f1e4c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:04.148720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-de33743f-2a15-4223-b5a4-bd87b1dec1ad req-5e984466-0f10-428e-b816-aed5997f1e4c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:04.150299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-de33743f-2a15-4223-b5a4-bd87b1dec1ad req-5e984466-0f10-428e-b816-aed5997f1e4c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:04.205128 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-de33743f-2a15-4223-b5a4-bd87b1dec1ad req-5e984466-0f10-428e-b816-aed5997f1e4c service nova] Creating event network-changed:2150a293-d499-4ae7-ad16-477e6100ab07 for instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 on n-h2-852771-8 Aug 25 13:27:04.236150 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-de33743f-2a15-4223-b5a4-bd87b1dec1ad req-5e984466-0f10-428e-b816-aed5997f1e4c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154680 Aug 25 13:27:04.239068 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2446/4835] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:27:04.265167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-812ae490-e309-4817-b45d-242efd8ec72f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:04.272148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-812ae490-e309-4817-b45d-242efd8ec72f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:04.307899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-812ae490-e309-4817-b45d-242efd8ec72f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:04.311700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-812ae490-e309-4817-b45d-242efd8ec72f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:04.315522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-812ae490-e309-4817-b45d-242efd8ec72f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:04.317022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-812ae490-e309-4817-b45d-242efd8ec72f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:04.318004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-812ae490-e309-4817-b45d-242efd8ec72f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:04.323556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-812ae490-e309-4817-b45d-242efd8ec72f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:04.772259 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-624d7cbd-ea52-4733-98ae-09ffdbc5a979 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "POST /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.667882 Aug 25 13:27:04.786003 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2390/4836] 10.222.0.70 () {62 vars in 1364 bytes} [Thu Aug 25 13:27:03 2022] POST /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 188 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:27:04.800062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8374366-3b67-4273-9431-afa6fa39bb2a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:04.801144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8374366-3b67-4273-9431-afa6fa39bb2a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:04.823569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8374366-3b67-4273-9431-afa6fa39bb2a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:04.826858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8374366-3b67-4273-9431-afa6fa39bb2a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:04.827676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8374366-3b67-4273-9431-afa6fa39bb2a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:04.828989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8374366-3b67-4273-9431-afa6fa39bb2a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:04.830024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8374366-3b67-4273-9431-afa6fa39bb2a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:04.830882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8374366-3b67-4273-9431-afa6fa39bb2a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:04.993939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-812ae490-e309-4817-b45d-242efd8ec72f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:05.013667 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-812ae490-e309-4817-b45d-242efd8ec72f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.766105 Aug 25 13:27:05.015082 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2447/4837] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:04 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:05.145746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:05.149411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-663a5dc2-5bc7-4660-ab27-62d3763f4864 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:05.150578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-663a5dc2-5bc7-4660-ab27-62d3763f4864 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:05.164799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-663a5dc2-5bc7-4660-ab27-62d3763f4864 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:05.165678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-663a5dc2-5bc7-4660-ab27-62d3763f4864 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:05.166429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-663a5dc2-5bc7-4660-ab27-62d3763f4864 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:05.167653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-663a5dc2-5bc7-4660-ab27-62d3763f4864 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:05.170007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-663a5dc2-5bc7-4660-ab27-62d3763f4864 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:05.170796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-663a5dc2-5bc7-4660-ab27-62d3763f4864 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:05.250789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:05.285726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-663a5dc2-5bc7-4660-ab27-62d3763f4864 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129060) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 13:27:05.430473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:05.490648 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-663a5dc2-5bc7-4660-ab27-62d3763f4864 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "POST /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/action" status: 202 len: 0 microversion: 2.20 time: 0.349129 Aug 25 13:27:05.497226 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2448/4838] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 13:27:05 2022] POST /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:27:05.512653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:05.514378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:05.532460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:05.533648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:05.534874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:05.536305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:05.539360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:05.541389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:05.578134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b8374366-3b67-4273-9431-afa6fa39bb2a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:05.636738 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8374366-3b67-4273-9431-afa6fa39bb2a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1308 microversion: 2.1 time: 0.849374 Aug 25 13:27:05.638783 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2391/4839] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:04 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1308 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:05.989988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:06.008706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:06.012566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:06.015226 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-39bb3204-410c-41d9-a799-32b3220a585f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1751 microversion: 2.20 time: 0.515036 Aug 25 13:27:06.030087 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2449/4840] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:05 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1751 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:27:06.062306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-09497aeb-ecba-4e0c-b8d9-f0ad1b3c0f7f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:06.063730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-09497aeb-ecba-4e0c-b8d9-f0ad1b3c0f7f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:06.078122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09497aeb-ecba-4e0c-b8d9-f0ad1b3c0f7f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:06.079098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09497aeb-ecba-4e0c-b8d9-f0ad1b3c0f7f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:06.085856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09497aeb-ecba-4e0c-b8d9-f0ad1b3c0f7f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:06.087681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09497aeb-ecba-4e0c-b8d9-f0ad1b3c0f7f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:06.088247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09497aeb-ecba-4e0c-b8d9-f0ad1b3c0f7f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:06.099866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09497aeb-ecba-4e0c-b8d9-f0ad1b3c0f7f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:06.425802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-09497aeb-ecba-4e0c-b8d9-f0ad1b3c0f7f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:06.450163 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-09497aeb-ecba-4e0c-b8d9-f0ad1b3c0f7f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.397288 Aug 25 13:27:06.467248 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2392/4841] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:06 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:06.687001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22ad4f06-7491-461b-a9cb-b0aacae05dc5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:06.688516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-22ad4f06-7491-461b-a9cb-b0aacae05dc5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:06.721802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22ad4f06-7491-461b-a9cb-b0aacae05dc5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:06.724150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22ad4f06-7491-461b-a9cb-b0aacae05dc5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:06.735283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22ad4f06-7491-461b-a9cb-b0aacae05dc5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:06.737395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22ad4f06-7491-461b-a9cb-b0aacae05dc5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:06.742803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22ad4f06-7491-461b-a9cb-b0aacae05dc5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:06.745065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22ad4f06-7491-461b-a9cb-b0aacae05dc5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:07.083193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:07.085950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:07.113906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:07.117745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:07.125461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:07.128009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:07.129544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:07.139225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:07.318545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-22ad4f06-7491-461b-a9cb-b0aacae05dc5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:07.339525 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22ad4f06-7491-461b-a9cb-b0aacae05dc5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1308 microversion: 2.1 time: 0.661105 Aug 25 13:27:07.346582 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2450/4842] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:06 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1308 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:07.499190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-386f992d-0a9a-4099-b9fe-6cbb85b7c9b8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:07.508212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-386f992d-0a9a-4099-b9fe-6cbb85b7c9b8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:07.534534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386f992d-0a9a-4099-b9fe-6cbb85b7c9b8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:07.536332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386f992d-0a9a-4099-b9fe-6cbb85b7c9b8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:07.538158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386f992d-0a9a-4099-b9fe-6cbb85b7c9b8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:07.540396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386f992d-0a9a-4099-b9fe-6cbb85b7c9b8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:07.542548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386f992d-0a9a-4099-b9fe-6cbb85b7c9b8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:07.546095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386f992d-0a9a-4099-b9fe-6cbb85b7c9b8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:07.561726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:07.588918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:07.594747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:07.597490 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d7dc7d58-a20f-4026-953e-ca60aa1b8f2b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1751 microversion: 2.20 time: 0.543253 Aug 25 13:27:07.598838 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2393/4843] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:07 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1751 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:27:07.924720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-386f992d-0a9a-4099-b9fe-6cbb85b7c9b8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:07.950449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:07.972487 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-386f992d-0a9a-4099-b9fe-6cbb85b7c9b8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.482877 Aug 25 13:27:07.973638 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2451/4844] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:07 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:08.408461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b87bd1e-d08d-4dc0-a754-2a46403313a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:08.410700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b87bd1e-d08d-4dc0-a754-2a46403313a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:08.429232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b87bd1e-d08d-4dc0-a754-2a46403313a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:08.432060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b87bd1e-d08d-4dc0-a754-2a46403313a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:08.433399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b87bd1e-d08d-4dc0-a754-2a46403313a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:08.437132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b87bd1e-d08d-4dc0-a754-2a46403313a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:08.439102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b87bd1e-d08d-4dc0-a754-2a46403313a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:08.440322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b87bd1e-d08d-4dc0-a754-2a46403313a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:08.648601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:08.655483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:08.687723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:08.689326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:08.691914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:08.693248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:08.694157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:08.694923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:09.335186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:09.376801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:09.384124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:09.396373 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5fda3d31-892c-4157-aa26-e7d7164fc013 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1753 microversion: 2.20 time: 0.754785 Aug 25 13:27:09.400662 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2452/4845] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:08 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1753 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:09.420813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b87bd1e-d08d-4dc0-a754-2a46403313a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:09.430946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a5f23767-25fe-4414-8d33-93cf508ce4c1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:09.434110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a5f23767-25fe-4414-8d33-93cf508ce4c1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:09.463355 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b87bd1e-d08d-4dc0-a754-2a46403313a6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1308 microversion: 2.1 time: 1.091281 Aug 25 13:27:09.465282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5f23767-25fe-4414-8d33-93cf508ce4c1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:09.469575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5f23767-25fe-4414-8d33-93cf508ce4c1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:09.471713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5f23767-25fe-4414-8d33-93cf508ce4c1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:09.473024 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2394/4846] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:08 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1308 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:09.479639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5f23767-25fe-4414-8d33-93cf508ce4c1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:09.481757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5f23767-25fe-4414-8d33-93cf508ce4c1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:09.482912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5f23767-25fe-4414-8d33-93cf508ce4c1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:10.105086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a5f23767-25fe-4414-8d33-93cf508ce4c1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:10.144684 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a5f23767-25fe-4414-8d33-93cf508ce4c1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.741216 Aug 25 13:27:10.175624 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2453/4847] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:09 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:10.452477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:10.455770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:10.463998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:10.483752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:10.502859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:10.503737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:10.505313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:10.506289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:10.507070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:10.518791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bd4c49fd-f685-4c18-af53-b0d08f870024 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:10.534644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bd4c49fd-f685-4c18-af53-b0d08f870024 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:10.576064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd4c49fd-f685-4c18-af53-b0d08f870024 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:10.580004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd4c49fd-f685-4c18-af53-b0d08f870024 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:10.583748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd4c49fd-f685-4c18-af53-b0d08f870024 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:10.588582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd4c49fd-f685-4c18-af53-b0d08f870024 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:10.589641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd4c49fd-f685-4c18-af53-b0d08f870024 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:10.594621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd4c49fd-f685-4c18-af53-b0d08f870024 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:11.166750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:11.182764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bd4c49fd-f685-4c18-af53-b0d08f870024 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:11.198508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:11.202920 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bd4c49fd-f685-4c18-af53-b0d08f870024 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1308 microversion: 2.1 time: 0.692365 Aug 25 13:27:11.204694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:11.206247 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2454/4848] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:10 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1308 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:11.214432 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-08313fcd-950f-42c1-b82c-c3b1ff5f8475 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1753 microversion: 2.20 time: 0.771782 Aug 25 13:27:11.220099 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2395/4849] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:10 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1753 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:11.234270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d69f0c96-0255-4c07-894d-85a8d07a6901 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:11.241178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d69f0c96-0255-4c07-894d-85a8d07a6901 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:11.244812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1d560dec-612a-4792-bbfe-294291ab3cf0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:11.248922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1d560dec-612a-4792-bbfe-294291ab3cf0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:11.260008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d69f0c96-0255-4c07-894d-85a8d07a6901 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:11.262545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d69f0c96-0255-4c07-894d-85a8d07a6901 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:11.262831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d560dec-612a-4792-bbfe-294291ab3cf0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:11.263433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d69f0c96-0255-4c07-894d-85a8d07a6901 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:11.263698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d560dec-612a-4792-bbfe-294291ab3cf0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:11.264559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d560dec-612a-4792-bbfe-294291ab3cf0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:11.265917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d560dec-612a-4792-bbfe-294291ab3cf0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:11.266282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d69f0c96-0255-4c07-894d-85a8d07a6901 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:11.266780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d560dec-612a-4792-bbfe-294291ab3cf0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:11.267565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1d560dec-612a-4792-bbfe-294291ab3cf0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:11.268314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d69f0c96-0255-4c07-894d-85a8d07a6901 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:11.269568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d69f0c96-0255-4c07-894d-85a8d07a6901 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:11.328437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-d69f0c96-0255-4c07-894d-85a8d07a6901 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lazy-loading 'flavor' on Instance uuid 991f22c6-27c5-471a-b485-90f6ea7d9fcc {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:27:11.568439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1d560dec-612a-4792-bbfe-294291ab3cf0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:11.616945 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1d560dec-612a-4792-bbfe-294291ab3cf0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.390262 Aug 25 13:27:11.629650 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2396/4850] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:11 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:11.749986 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d69f0c96-0255-4c07-894d-85a8d07a6901 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/action" status: 200 len: 32 microversion: 2.1 time: 0.541289 Aug 25 13:27:11.759608 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2455/4851] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:27:11 2022] POST /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/action => generated 32 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:27:11.769398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f1d5c892-70b7-401d-b3bf-4f35ac0aec7f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:11.773569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f1d5c892-70b7-401d-b3bf-4f35ac0aec7f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:11.796567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d5c892-70b7-401d-b3bf-4f35ac0aec7f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:11.802387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d5c892-70b7-401d-b3bf-4f35ac0aec7f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:11.803846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d5c892-70b7-401d-b3bf-4f35ac0aec7f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:11.806554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d5c892-70b7-401d-b3bf-4f35ac0aec7f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:11.809960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d5c892-70b7-401d-b3bf-4f35ac0aec7f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:11.816263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1d5c892-70b7-401d-b3bf-4f35ac0aec7f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:12.258887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08ef87ee-8f25-4cca-872b-75656688eca5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:12.264944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-08ef87ee-8f25-4cca-872b-75656688eca5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:12.333633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08ef87ee-8f25-4cca-872b-75656688eca5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:12.339116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08ef87ee-8f25-4cca-872b-75656688eca5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:12.344061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08ef87ee-8f25-4cca-872b-75656688eca5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:12.352000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08ef87ee-8f25-4cca-872b-75656688eca5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:12.353738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08ef87ee-8f25-4cca-872b-75656688eca5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:12.359426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08ef87ee-8f25-4cca-872b-75656688eca5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:12.718810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f1d5c892-70b7-401d-b3bf-4f35ac0aec7f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:12.748845 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f1d5c892-70b7-401d-b3bf-4f35ac0aec7f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1735 microversion: 2.1 time: 0.988077 Aug 25 13:27:12.755721 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2397/4852] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:11 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1735 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:12.774771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:12.782837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:12.808246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:12.812145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:12.813121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:12.814523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:12.818840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:12.829643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:13.814670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-08ef87ee-8f25-4cca-872b-75656688eca5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:13.851566 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-08ef87ee-8f25-4cca-872b-75656688eca5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1308 microversion: 2.1 time: 1.604911 Aug 25 13:27:13.869800 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2456/4853] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:12 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1308 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:13.890782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-997614fd-b7d8-42d4-9a48-2b78aaebc55a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:13.892616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-997614fd-b7d8-42d4-9a48-2b78aaebc55a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:13.906780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:13.910253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-997614fd-b7d8-42d4-9a48-2b78aaebc55a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:13.911662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-997614fd-b7d8-42d4-9a48-2b78aaebc55a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:13.912760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-997614fd-b7d8-42d4-9a48-2b78aaebc55a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:13.914566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-997614fd-b7d8-42d4-9a48-2b78aaebc55a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:13.915787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-997614fd-b7d8-42d4-9a48-2b78aaebc55a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:13.916882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-997614fd-b7d8-42d4-9a48-2b78aaebc55a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:14.509154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:14.541064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:14.548038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:14.555182 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a404c5fa-a28f-463e-8a12-0acccdb3cd4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1753 microversion: 2.20 time: 1.797097 Aug 25 13:27:14.557004 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2398/4854] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:12 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1753 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:14.568921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ec7fe8c1-5864-424f-857f-a4cb7458a476 req-d9916741-ef0f-4e4d-a2f7-9c5a0d32de6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87965976-52e5-4b4b-b38f-ef76c2abdea6", "name": "network-vif-plugged", "status": "completed", "tag": "2150a293-d499-4ae7-ad16-477e6100ab07"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:14.601626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec7fe8c1-5864-424f-857f-a4cb7458a476 req-d9916741-ef0f-4e4d-a2f7-9c5a0d32de6e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:14.605380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec7fe8c1-5864-424f-857f-a4cb7458a476 req-d9916741-ef0f-4e4d-a2f7-9c5a0d32de6e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:14.607055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec7fe8c1-5864-424f-857f-a4cb7458a476 req-d9916741-ef0f-4e4d-a2f7-9c5a0d32de6e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:14.625251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-997614fd-b7d8-42d4-9a48-2b78aaebc55a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:14.640821 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ec7fe8c1-5864-424f-857f-a4cb7458a476 req-d9916741-ef0f-4e4d-a2f7-9c5a0d32de6e service nova] Creating event network-vif-plugged:2150a293-d499-4ae7-ad16-477e6100ab07 for instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 on n-h2-852771-8 Aug 25 13:27:14.654327 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-997614fd-b7d8-42d4-9a48-2b78aaebc55a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.782390 Aug 25 13:27:14.655461 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2457/4855] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:13 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:14.695005 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ec7fe8c1-5864-424f-857f-a4cb7458a476 req-d9916741-ef0f-4e4d-a2f7-9c5a0d32de6e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134681 Aug 25 13:27:14.696168 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2399/4856] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:27:14.704434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bfd06655-d3da-4a27-86fc-af5aca68a5c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:14.719739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bfd06655-d3da-4a27-86fc-af5aca68a5c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:14.758931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfd06655-d3da-4a27-86fc-af5aca68a5c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:14.759721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfd06655-d3da-4a27-86fc-af5aca68a5c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:14.760549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfd06655-d3da-4a27-86fc-af5aca68a5c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:14.762115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfd06655-d3da-4a27-86fc-af5aca68a5c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:14.762921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfd06655-d3da-4a27-86fc-af5aca68a5c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:14.763931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfd06655-d3da-4a27-86fc-af5aca68a5c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:14.895257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9445bcde-44d2-4a94-884c-0f2696b0759b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:14.896047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9445bcde-44d2-4a94-884c-0f2696b0759b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:14.921765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9445bcde-44d2-4a94-884c-0f2696b0759b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:14.923096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9445bcde-44d2-4a94-884c-0f2696b0759b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:14.926860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9445bcde-44d2-4a94-884c-0f2696b0759b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:14.928355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9445bcde-44d2-4a94-884c-0f2696b0759b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:14.929326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9445bcde-44d2-4a94-884c-0f2696b0759b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:14.939221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9445bcde-44d2-4a94-884c-0f2696b0759b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:15.542117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bfd06655-d3da-4a27-86fc-af5aca68a5c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:15.568270 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bfd06655-d3da-4a27-86fc-af5aca68a5c9 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1735 microversion: 2.1 time: 0.878517 Aug 25 13:27:15.569975 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2458/4857] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:14 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1735 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:15.614482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:15.616064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:15.630673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:15.632728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:15.633958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:15.635665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:15.636896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:15.638123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:15.651253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9445bcde-44d2-4a94-884c-0f2696b0759b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:15.684290 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9445bcde-44d2-4a94-884c-0f2696b0759b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1308 microversion: 2.1 time: 0.793433 Aug 25 13:27:15.688931 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2400/4858] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:14 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1308 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:15.713490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f2b7245-de06-43a7-87cf-814b14bf35fd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:15.717146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f2b7245-de06-43a7-87cf-814b14bf35fd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:15.729385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f2b7245-de06-43a7-87cf-814b14bf35fd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:15.731790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f2b7245-de06-43a7-87cf-814b14bf35fd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:15.735054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f2b7245-de06-43a7-87cf-814b14bf35fd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:15.736830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f2b7245-de06-43a7-87cf-814b14bf35fd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:15.738093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f2b7245-de06-43a7-87cf-814b14bf35fd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:15.739160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f2b7245-de06-43a7-87cf-814b14bf35fd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:15.799002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:16.248584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2f2b7245-de06-43a7-87cf-814b14bf35fd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:16.256100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:16.284762 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f2b7245-de06-43a7-87cf-814b14bf35fd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.579952 Aug 25 13:27:16.290218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:16.292323 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2401/4859] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:15 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:16.294949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:16.298199 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d7c51046-7bad-4df8-a999-dfcc461893c1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1753 microversion: 2.20 time: 0.692690 Aug 25 13:27:16.300353 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2459/4860] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:15 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1753 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:27:16.612177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-80733da1-a4a3-4851-8415-51e72cba7155 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:16.614497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-80733da1-a4a3-4851-8415-51e72cba7155 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:16.635487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80733da1-a4a3-4851-8415-51e72cba7155 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:16.638632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80733da1-a4a3-4851-8415-51e72cba7155 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:16.640380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80733da1-a4a3-4851-8415-51e72cba7155 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:16.657195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80733da1-a4a3-4851-8415-51e72cba7155 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:16.659407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80733da1-a4a3-4851-8415-51e72cba7155 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:16.660476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80733da1-a4a3-4851-8415-51e72cba7155 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:16.737021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7693833f-3fe0-4781-bcba-83d12edad961 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:16.739060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7693833f-3fe0-4781-bcba-83d12edad961 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:16.755923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7693833f-3fe0-4781-bcba-83d12edad961 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:16.757351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7693833f-3fe0-4781-bcba-83d12edad961 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:16.758502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7693833f-3fe0-4781-bcba-83d12edad961 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:16.760096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7693833f-3fe0-4781-bcba-83d12edad961 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:16.761238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7693833f-3fe0-4781-bcba-83d12edad961 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:16.762533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7693833f-3fe0-4781-bcba-83d12edad961 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:18.149258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-80733da1-a4a3-4851-8415-51e72cba7155 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:18.158126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7693833f-3fe0-4781-bcba-83d12edad961 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:18.199761 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-80733da1-a4a3-4851-8415-51e72cba7155 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1735 microversion: 2.1 time: 1.594514 Aug 25 13:27:18.201956 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2402/4861] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:16 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1735 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:18.229855 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7693833f-3fe0-4781-bcba-83d12edad961 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1308 microversion: 2.1 time: 1.497496 Aug 25 13:27:18.234003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9d50600a-b32b-4f37-aa98-784bb8d11ce7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:18.235760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9d50600a-b32b-4f37-aa98-784bb8d11ce7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:18.250158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2460/4862] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:16 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1308 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:18.266739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d50600a-b32b-4f37-aa98-784bb8d11ce7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:18.268113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d50600a-b32b-4f37-aa98-784bb8d11ce7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:18.271277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d50600a-b32b-4f37-aa98-784bb8d11ce7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:18.276395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d50600a-b32b-4f37-aa98-784bb8d11ce7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:18.278444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:18.280260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:18.284371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d50600a-b32b-4f37-aa98-784bb8d11ce7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:18.285861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d50600a-b32b-4f37-aa98-784bb8d11ce7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:18.298919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:18.301329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:18.302648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:18.304680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:18.305939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:18.307284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:18.999453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9d50600a-b32b-4f37-aa98-784bb8d11ce7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:19.028980 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9d50600a-b32b-4f37-aa98-784bb8d11ce7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.822501 Aug 25 13:27:19.035891 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2403/4863] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:18 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:19.265039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7bfb7ac7-20fb-4d38-97df-8b2618e7f219 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:19.268753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7bfb7ac7-20fb-4d38-97df-8b2618e7f219 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:19.286784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bfb7ac7-20fb-4d38-97df-8b2618e7f219 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:19.291189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bfb7ac7-20fb-4d38-97df-8b2618e7f219 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:19.295112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bfb7ac7-20fb-4d38-97df-8b2618e7f219 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:19.298005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bfb7ac7-20fb-4d38-97df-8b2618e7f219 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:19.300679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bfb7ac7-20fb-4d38-97df-8b2618e7f219 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:19.302321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bfb7ac7-20fb-4d38-97df-8b2618e7f219 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:19.304488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:19.335745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:19.346901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:19.349214 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e2731365-5863-4ecd-8a3a-5990721c05c8 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1753 microversion: 2.20 time: 1.096719 Aug 25 13:27:19.354877 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2461/4864] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:18 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1753 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:19.395456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-46153baf-24ff-40cf-8529-5734dbe33648 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:19.396704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-46153baf-24ff-40cf-8529-5734dbe33648 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:19.410790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46153baf-24ff-40cf-8529-5734dbe33648 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:19.411638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46153baf-24ff-40cf-8529-5734dbe33648 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:19.412337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46153baf-24ff-40cf-8529-5734dbe33648 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:19.413658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46153baf-24ff-40cf-8529-5734dbe33648 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:19.414452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46153baf-24ff-40cf-8529-5734dbe33648 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:19.415648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46153baf-24ff-40cf-8529-5734dbe33648 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:20.598000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7bfb7ac7-20fb-4d38-97df-8b2618e7f219 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:20.641920 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7bfb7ac7-20fb-4d38-97df-8b2618e7f219 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1735 microversion: 2.1 time: 1.389079 Aug 25 13:27:20.647685 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2404/4865] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:19 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1735 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:20.685400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-91e5a1a7-36ea-425f-bbaa-e30432da40e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:20.692214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-91e5a1a7-36ea-425f-bbaa-e30432da40e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:20.723162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e5a1a7-36ea-425f-bbaa-e30432da40e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:20.724156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e5a1a7-36ea-425f-bbaa-e30432da40e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:20.729594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e5a1a7-36ea-425f-bbaa-e30432da40e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:20.732477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e5a1a7-36ea-425f-bbaa-e30432da40e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:20.739494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e5a1a7-36ea-425f-bbaa-e30432da40e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:20.740742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91e5a1a7-36ea-425f-bbaa-e30432da40e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:20.793635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-46153baf-24ff-40cf-8529-5734dbe33648 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:20.835739 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-46153baf-24ff-40cf-8529-5734dbe33648 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1488 microversion: 2.1 time: 1.469255 Aug 25 13:27:20.837280 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2462/4866] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:19 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1488 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:20.867452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:20.872883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:20.905469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:20.906455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:20.910870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:20.915892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:20.916869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:20.921406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:21.028803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:21.409004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-91e5a1a7-36ea-425f-bbaa-e30432da40e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:21.441324 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-91e5a1a7-36ea-425f-bbaa-e30432da40e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1723 microversion: 2.1 time: 0.786439 Aug 25 13:27:21.458324 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2405/4867] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:20 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1723 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:21.483409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-138906fc-914b-4184-8974-70d61d19e83a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:21.489630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-138906fc-914b-4184-8974-70d61d19e83a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:21.508869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-138906fc-914b-4184-8974-70d61d19e83a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:21.513127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-138906fc-914b-4184-8974-70d61d19e83a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:21.514765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-138906fc-914b-4184-8974-70d61d19e83a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:21.516455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-138906fc-914b-4184-8974-70d61d19e83a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:21.517451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-138906fc-914b-4184-8974-70d61d19e83a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:21.518686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-138906fc-914b-4184-8974-70d61d19e83a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:21.582265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:21.608584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:21.612318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:21.614703 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5eec92ab-d2ac-4abd-a76a-f713044d6981 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1753 microversion: 2.20 time: 0.775091 Aug 25 13:27:21.615708 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2463/4868] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:20 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1753 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:21.689031 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-138906fc-914b-4184-8974-70d61d19e83a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "PUT /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1083 microversion: 2.1 time: 0.228122 Aug 25 13:27:21.701570 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2406/4869] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Aug 25 13:27:21 2022] PUT /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1083 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:21.701934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42ed273d-9461-4a92-93b6-0d9831152852 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:21.701934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42ed273d-9461-4a92-93b6-0d9831152852 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:21.720771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42ed273d-9461-4a92-93b6-0d9831152852 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:21.722053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42ed273d-9461-4a92-93b6-0d9831152852 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:21.723461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42ed273d-9461-4a92-93b6-0d9831152852 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:21.726636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42ed273d-9461-4a92-93b6-0d9831152852 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:21.729161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42ed273d-9461-4a92-93b6-0d9831152852 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:21.731840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42ed273d-9461-4a92-93b6-0d9831152852 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:21.732384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-46d830cd-ee55-4541-8541-174ec979a488 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:21.735894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-46d830cd-ee55-4541-8541-174ec979a488 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:21.747709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d830cd-ee55-4541-8541-174ec979a488 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:21.749157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d830cd-ee55-4541-8541-174ec979a488 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:21.750419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d830cd-ee55-4541-8541-174ec979a488 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:21.752166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d830cd-ee55-4541-8541-174ec979a488 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:21.753335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d830cd-ee55-4541-8541-174ec979a488 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:21.755494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46d830cd-ee55-4541-8541-174ec979a488 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:22.253002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-42ed273d-9461-4a92-93b6-0d9831152852 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:22.288033 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42ed273d-9461-4a92-93b6-0d9831152852 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1735 microversion: 2.1 time: 0.605165 Aug 25 13:27:22.289134 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2464/4870] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:21 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1735 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:22.320247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-46d830cd-ee55-4541-8541-174ec979a488 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:22.336477 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-46d830cd-ee55-4541-8541-174ec979a488 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1509 microversion: 2.1 time: 0.611743 Aug 25 13:27:22.342746 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2407/4871] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:21 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1509 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:22.374490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d11aa77f-a060-4d00-bb04-3f3c0f3a51f9 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:22.375649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d11aa77f-a060-4d00-bb04-3f3c0f3a51f9 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:22.388683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11aa77f-a060-4d00-bb04-3f3c0f3a51f9 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:22.390110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11aa77f-a060-4d00-bb04-3f3c0f3a51f9 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:22.390869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11aa77f-a060-4d00-bb04-3f3c0f3a51f9 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:22.392200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11aa77f-a060-4d00-bb04-3f3c0f3a51f9 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:22.393462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11aa77f-a060-4d00-bb04-3f3c0f3a51f9 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:22.394283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d11aa77f-a060-4d00-bb04-3f3c0f3a51f9 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:22.496195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-95882482-da52-432e-9bc6-07f75c94f7d5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:22.505467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-95882482-da52-432e-9bc6-07f75c94f7d5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:22.526252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95882482-da52-432e-9bc6-07f75c94f7d5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:22.530082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95882482-da52-432e-9bc6-07f75c94f7d5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:22.531741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95882482-da52-432e-9bc6-07f75c94f7d5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:22.539647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95882482-da52-432e-9bc6-07f75c94f7d5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:22.541484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95882482-da52-432e-9bc6-07f75c94f7d5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:22.546659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95882482-da52-432e-9bc6-07f75c94f7d5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:22.847265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d11aa77f-a060-4d00-bb04-3f3c0f3a51f9 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:22.870229 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d11aa77f-a060-4d00-bb04-3f3c0f3a51f9 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1509 microversion: 2.1 time: 0.501215 Aug 25 13:27:22.874630 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2465/4872] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:22 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1509 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:22.913064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:22.915012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:22.939876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:22.942654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:22.943617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:22.944555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:22.945340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:22.946216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:22.959311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-95882482-da52-432e-9bc6-07f75c94f7d5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:22.987706 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-95882482-da52-432e-9bc6-07f75c94f7d5 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1700 microversion: 2.1 time: 0.509477 Aug 25 13:27:22.990134 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2408/4873] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:22 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1700 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:23.020051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2629f813-7eb4-4fcd-a6d1-c8ea05676b3c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:23.021081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2629f813-7eb4-4fcd-a6d1-c8ea05676b3c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:23.033423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2629f813-7eb4-4fcd-a6d1-c8ea05676b3c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:23.034532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2629f813-7eb4-4fcd-a6d1-c8ea05676b3c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:23.035493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2629f813-7eb4-4fcd-a6d1-c8ea05676b3c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:23.037000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2629f813-7eb4-4fcd-a6d1-c8ea05676b3c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:23.039344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2629f813-7eb4-4fcd-a6d1-c8ea05676b3c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:23.040329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2629f813-7eb4-4fcd-a6d1-c8ea05676b3c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:23.129808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2629f813-7eb4-4fcd-a6d1-c8ea05676b3c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:27:23.336792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:23.362795 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2629f813-7eb4-4fcd-a6d1-c8ea05676b3c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 204 len: 0 microversion: 2.1 time: 0.369318 Aug 25 13:27:23.363948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:23.364189 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2409/4874] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:27:22 2022] DELETE /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:27:23.379022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:23.382648 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d240bdc1-11b5-4e22-aa08-c5babf9bfe25 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.505309 Aug 25 13:27:23.385986 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2466/4875] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:22 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:23.394859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9056664f-1cf6-4c75-84d5-fa8bd21ff444 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:23.403153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b301d740-b25e-4ee9-a3cb-a43da2597648 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:23.405808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b301d740-b25e-4ee9-a3cb-a43da2597648 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:23.421258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b301d740-b25e-4ee9-a3cb-a43da2597648 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:23.422352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9056664f-1cf6-4c75-84d5-fa8bd21ff444 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:23.423248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9056664f-1cf6-4c75-84d5-fa8bd21ff444 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:23.424059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9056664f-1cf6-4c75-84d5-fa8bd21ff444 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:23.424536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b301d740-b25e-4ee9-a3cb-a43da2597648 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:23.425980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b301d740-b25e-4ee9-a3cb-a43da2597648 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:23.429921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b301d740-b25e-4ee9-a3cb-a43da2597648 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:23.431540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b301d740-b25e-4ee9-a3cb-a43da2597648 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:23.432809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b301d740-b25e-4ee9-a3cb-a43da2597648 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:23.493141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9056664f-1cf6-4c75-84d5-fa8bd21ff444 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Going to try to start instance {{(pid=129059) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 13:27:23.628105 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9056664f-1cf6-4c75-84d5-fa8bd21ff444 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/action" status: 202 len: 0 microversion: 2.1 time: 0.260806 Aug 25 13:27:23.629713 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2410/4876] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:27:23 2022] POST /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:27:23.643190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-40d620cb-9ede-4dc6-89a1-445b4e999738 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:23.645033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-40d620cb-9ede-4dc6-89a1-445b4e999738 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:23.659043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d620cb-9ede-4dc6-89a1-445b4e999738 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:23.660303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d620cb-9ede-4dc6-89a1-445b4e999738 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:23.661470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d620cb-9ede-4dc6-89a1-445b4e999738 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:23.663856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d620cb-9ede-4dc6-89a1-445b4e999738 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:23.664689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d620cb-9ede-4dc6-89a1-445b4e999738 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:23.665365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d620cb-9ede-4dc6-89a1-445b4e999738 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:23.912444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b301d740-b25e-4ee9-a3cb-a43da2597648 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:23.942119 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b301d740-b25e-4ee9-a3cb-a43da2597648 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1735 microversion: 2.1 time: 0.551699 Aug 25 13:27:23.944306 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2467/4877] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:23 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1735 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:23.967051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b81a9e9-53b7-441d-9981-3748b9865688 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:23.974041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b81a9e9-53b7-441d-9981-3748b9865688 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:23.999924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b81a9e9-53b7-441d-9981-3748b9865688 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:24.072075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b81a9e9-53b7-441d-9981-3748b9865688 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:24.072075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b81a9e9-53b7-441d-9981-3748b9865688 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:24.072075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b81a9e9-53b7-441d-9981-3748b9865688 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:24.072075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b81a9e9-53b7-441d-9981-3748b9865688 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:24.072075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b81a9e9-53b7-441d-9981-3748b9865688 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:24.445882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-40d620cb-9ede-4dc6-89a1-445b4e999738 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:24.478381 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-40d620cb-9ede-4dc6-89a1-445b4e999738 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1515 microversion: 2.1 time: 0.844787 Aug 25 13:27:24.480219 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2411/4878] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:23 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1515 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:24.489355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:24.502529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:24.546480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:24.547802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:24.548769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:24.550372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:24.551548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:24.552890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:24.974738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b81a9e9-53b7-441d-9981-3748b9865688 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:25.000121 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b81a9e9-53b7-441d-9981-3748b9865688 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1709 microversion: 2.1 time: 1.050837 Aug 25 13:27:25.003653 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2468/4879] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:23 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1709 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:25.022437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6734702-0c8f-4090-9238-affde69ed004 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:25.024298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d6734702-0c8f-4090-9238-affde69ed004 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:25.047153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6734702-0c8f-4090-9238-affde69ed004 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:25.048782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6734702-0c8f-4090-9238-affde69ed004 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:25.049690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6734702-0c8f-4090-9238-affde69ed004 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:25.052018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6734702-0c8f-4090-9238-affde69ed004 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:25.053916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6734702-0c8f-4090-9238-affde69ed004 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:25.055187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6734702-0c8f-4090-9238-affde69ed004 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:25.057669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:25.100726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:25.103986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:25.107268 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9d06691f-3162-44f7-abed-ef0be761c772 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.625401 Aug 25 13:27:25.108301 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2412/4880] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:24 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:25.527192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d4c4072-cd95-4d9c-b89e-90bf59d8b5d5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:25.529146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8d4c4072-cd95-4d9c-b89e-90bf59d8b5d5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:25.557423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d4c4072-cd95-4d9c-b89e-90bf59d8b5d5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:25.561883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d4c4072-cd95-4d9c-b89e-90bf59d8b5d5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:25.563132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d4c4072-cd95-4d9c-b89e-90bf59d8b5d5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:25.564670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d4c4072-cd95-4d9c-b89e-90bf59d8b5d5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:25.571649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d4c4072-cd95-4d9c-b89e-90bf59d8b5d5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:25.572345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d6734702-0c8f-4090-9238-affde69ed004 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:25.572641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d4c4072-cd95-4d9c-b89e-90bf59d8b5d5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:25.597022 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d6734702-0c8f-4090-9238-affde69ed004 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1735 microversion: 2.1 time: 0.583165 Aug 25 13:27:25.605886 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2469/4881] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:25 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1735 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:26.051715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a065a831-4d82-4a2d-a279-b9ccec6ea069 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:26.052955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a065a831-4d82-4a2d-a279-b9ccec6ea069 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:26.070782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a065a831-4d82-4a2d-a279-b9ccec6ea069 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:26.072069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a065a831-4d82-4a2d-a279-b9ccec6ea069 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:26.074622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a065a831-4d82-4a2d-a279-b9ccec6ea069 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:26.076555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a065a831-4d82-4a2d-a279-b9ccec6ea069 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:26.078182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a065a831-4d82-4a2d-a279-b9ccec6ea069 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:26.079255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a065a831-4d82-4a2d-a279-b9ccec6ea069 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:26.110449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d4c4072-cd95-4d9c-b89e-90bf59d8b5d5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:26.143394 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d4c4072-cd95-4d9c-b89e-90bf59d8b5d5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1515 microversion: 2.1 time: 0.623722 Aug 25 13:27:26.161556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2413/4882] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:25 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1515 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:26.187131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:26.188291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:26.218947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:26.224785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:26.225362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:26.226716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:26.227562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:26.228341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:26.858627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a065a831-4d82-4a2d-a279-b9ccec6ea069 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:26.900314 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a065a831-4d82-4a2d-a279-b9ccec6ea069 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1709 microversion: 2.1 time: 0.856219 Aug 25 13:27:26.923303 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2470/4883] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:26 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1709 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:26.936358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6347791d-4071-4203-9127-51b30c1ad1aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:26.937228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6347791d-4071-4203-9127-51b30c1ad1aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:26.966429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6347791d-4071-4203-9127-51b30c1ad1aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:26.968025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6347791d-4071-4203-9127-51b30c1ad1aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:26.970566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6347791d-4071-4203-9127-51b30c1ad1aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:26.973958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6347791d-4071-4203-9127-51b30c1ad1aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:26.975414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6347791d-4071-4203-9127-51b30c1ad1aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:26.977263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6347791d-4071-4203-9127-51b30c1ad1aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:27.106736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:27.112074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:27.145807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:27.150627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:27.154594 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fc66d4d7-8646-4f18-a117-989ba0027bac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.989937 Aug 25 13:27:27.155719 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2414/4884] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:26 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:27.215704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0928633a-ac40-4fd0-85ce-a0a09e89d8dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:27.216789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0928633a-ac40-4fd0-85ce-a0a09e89d8dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:27.248590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0928633a-ac40-4fd0-85ce-a0a09e89d8dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:27.264675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0928633a-ac40-4fd0-85ce-a0a09e89d8dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:27.268275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0928633a-ac40-4fd0-85ce-a0a09e89d8dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:27.275875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0928633a-ac40-4fd0-85ce-a0a09e89d8dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:27.280448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0928633a-ac40-4fd0-85ce-a0a09e89d8dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:27.281928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0928633a-ac40-4fd0-85ce-a0a09e89d8dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:27.866679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0928633a-ac40-4fd0-85ce-a0a09e89d8dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:27.913867 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0928633a-ac40-4fd0-85ce-a0a09e89d8dd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1473 microversion: 2.1 time: 0.731954 Aug 25 13:27:27.922499 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2415/4885] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:27 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1473 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:27.951193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-daeea20d-4403-41ed-bcb5-0230677081b7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:27.954085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-daeea20d-4403-41ed-bcb5-0230677081b7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:28.003375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daeea20d-4403-41ed-bcb5-0230677081b7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:28.005314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daeea20d-4403-41ed-bcb5-0230677081b7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:28.011692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daeea20d-4403-41ed-bcb5-0230677081b7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:28.018590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daeea20d-4403-41ed-bcb5-0230677081b7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:28.022381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daeea20d-4403-41ed-bcb5-0230677081b7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:28.028093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daeea20d-4403-41ed-bcb5-0230677081b7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:28.762460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6347791d-4071-4203-9127-51b30c1ad1aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:28.819366 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6347791d-4071-4203-9127-51b30c1ad1aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1735 microversion: 2.1 time: 1.893854 Aug 25 13:27:28.835402 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2471/4886] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:26 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1735 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:28.867845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:28.869590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:28.884104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:28.885401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:28.886740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:28.890275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:28.892232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:28.893840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:29.188158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-daeea20d-4403-41ed-bcb5-0230677081b7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:29.233811 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-daeea20d-4403-41ed-bcb5-0230677081b7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1709 microversion: 2.1 time: 1.291630 Aug 25 13:27:29.235433 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2416/4887] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:27 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1709 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:29.254839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-5629d9ad-3975-4348-bfae-a3cff1d471a5 req-93a3158d-64d0-4017-9417-ad51a528a7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87965976-52e5-4b4b-b38f-ef76c2abdea6", "name": "network-vif-deleted", "tag": "2150a293-d499-4ae7-ad16-477e6100ab07"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:29.298378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5629d9ad-3975-4348-bfae-a3cff1d471a5 req-93a3158d-64d0-4017-9417-ad51a528a7f5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:29.299872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5629d9ad-3975-4348-bfae-a3cff1d471a5 req-93a3158d-64d0-4017-9417-ad51a528a7f5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:29.303224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5629d9ad-3975-4348-bfae-a3cff1d471a5 req-93a3158d-64d0-4017-9417-ad51a528a7f5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:29.346243 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5629d9ad-3975-4348-bfae-a3cff1d471a5 req-93a3158d-64d0-4017-9417-ad51a528a7f5 service nova] Creating event network-vif-deleted:2150a293-d499-4ae7-ad16-477e6100ab07 for instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 on n-h2-852771-8 Aug 25 13:27:29.381986 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-5629d9ad-3975-4348-bfae-a3cff1d471a5 req-93a3158d-64d0-4017-9417-ad51a528a7f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143467 Aug 25 13:27:29.390861 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2417/4888] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:27:29.405726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:29.411459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:29.443362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:29.444829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:29.446110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:29.452364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:29.453852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:29.455097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:29.620071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:29.623831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:29.624953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:29.625810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:29.630718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lazy-loading 'fault' on Instance uuid 87965976-52e5-4b4b-b38f-ef76c2abdea6 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:27:29.660905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:29.675494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:29.678096 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-08317f61-995f-4b8a-898a-04f87ac0f677 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.840252 Aug 25 13:27:29.725936 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2472/4889] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:28 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:29.825016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:29.850335 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e408c75c-152b-4dde-ac1e-befc12ed2c88 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 200 len: 1319 microversion: 2.1 time: 0.456691 Aug 25 13:27:29.851429 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2418/4890] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:29 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:29.890797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-337e5c27-12d0-41ae-94bd-8916982edfbb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:29.892186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-337e5c27-12d0-41ae-94bd-8916982edfbb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:29.913315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-337e5c27-12d0-41ae-94bd-8916982edfbb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:29.914597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-337e5c27-12d0-41ae-94bd-8916982edfbb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:29.915880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-337e5c27-12d0-41ae-94bd-8916982edfbb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:29.918284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-337e5c27-12d0-41ae-94bd-8916982edfbb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:29.919573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-337e5c27-12d0-41ae-94bd-8916982edfbb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:29.920877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-337e5c27-12d0-41ae-94bd-8916982edfbb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:30.298036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-214d86b8-625a-4743-88fb-e5b00d6b3353 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:30.299409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-214d86b8-625a-4743-88fb-e5b00d6b3353 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:30.346267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-214d86b8-625a-4743-88fb-e5b00d6b3353 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:30.351145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-214d86b8-625a-4743-88fb-e5b00d6b3353 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:30.352147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-214d86b8-625a-4743-88fb-e5b00d6b3353 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:30.358070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-214d86b8-625a-4743-88fb-e5b00d6b3353 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:30.359299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-214d86b8-625a-4743-88fb-e5b00d6b3353 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:30.359685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-214d86b8-625a-4743-88fb-e5b00d6b3353 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:30.627466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-337e5c27-12d0-41ae-94bd-8916982edfbb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:30.694744 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-337e5c27-12d0-41ae-94bd-8916982edfbb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1715 microversion: 2.1 time: 0.821350 Aug 25 13:27:30.697402 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2473/4891] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:29 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1715 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:30.771183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:30.774811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:30.809941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:30.812302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:30.814247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:30.818445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:30.820244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:30.823825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:31.453393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-214d86b8-625a-4743-88fb-e5b00d6b3353 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:31.491193 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-214d86b8-625a-4743-88fb-e5b00d6b3353 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1713 microversion: 2.1 time: 1.208725 Aug 25 13:27:31.492791 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2419/4892] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:30 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1713 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:31.503576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:31.504804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:31.537649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:31.542987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:31.550808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:31.551941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:31.554158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:31.555345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:31.559287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:31.562687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:31.563283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:31.566328 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b0c9ff52-46f5-4035-8d84-4e892d1ee01c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.806021 Aug 25 13:27:31.568082 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2474/4893] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:30 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:27:31.581147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:31.582328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:31.595441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:31.597074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:31.598107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:31.599632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:31.600966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:31.602005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:31.656583 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 HTTP/1.1 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '87965976-52e5-4b4b-b38f-ef76c2abdea6'} Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:27:31.660320 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:27:31.665895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:27:31.665895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:27:31.665895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:27:31.665895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:27:31.665895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:27:31.665895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:27:31.665895 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:27:31.669981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:27:31.671851 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4755728f-541b-4d9a-811a-1a71ca517182 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 404 len: 111 microversion: 2.1 time: 0.177017 Aug 25 13:27:31.672917 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2420/4894] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:31 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:27:32.011468 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] HTTP exception thrown: Cannot 'detach_volume' instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc while it is in vm_state rescued Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Request method failure captured: Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments/5b2af833-7761-4029-9d55-ce3747b34cfa HTTP/1.1 Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3emkRnp5WsySeZUDuZqp15nFuui5PAZa04O2pdW2hxZe2BKDx44fRGkIEOKF2r11CYee5GPcGik4GpsVJQCgpLsIOIpHtQH9QghePjQ_6mqWpMbkt_tywI60U5M7l4xP6lvwI3wQpC2IoBQiIktCExz3EE3vcgMbQSbvXi9LGsoCek Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dec483f5c53b44c1a52917920b891b9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}] Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1552e098ea6f4d28abd9606fe9433000 Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: exception: Cannot 'detach_volume' instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc while it is in vm_state rescued Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': '991f22c6-27c5-471a-b485-90f6ea7d9fcc', 'id': '5b2af833-7761-4029-9d55-ce3747b34cfa'} Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc while it is in vm_state rescued Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:27:32.016825 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:27:32.029548 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:27:32.029548 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:27:32.029548 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:27:32.029548 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:27:32.029548 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc while it is in vm_state rescued Aug 25 13:27:32.029548 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:27:32.034396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Returning 409 to user: Cannot 'detach_volume' instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc while it is in vm_state rescued {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:27:32.038649 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cce4022b-3176-4d69-b5f9-d55176bc1384 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "DELETE /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments/5b2af833-7761-4029-9d55-ce3747b34cfa" status: 409 len: 152 microversion: 2.1 time: 0.467249 Aug 25 13:27:32.044367 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2475/4895] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:27:31 2022] DELETE /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments/5b2af833-7761-4029-9d55-ce3747b34cfa => generated 152 bytes in 473 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:27:32.063326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c5d84f3-cb4d-4868-9c31-f602c1323173 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:32.065551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3c5d84f3-cb4d-4868-9c31-f602c1323173 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:32.091915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c5d84f3-cb4d-4868-9c31-f602c1323173 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:32.096179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c5d84f3-cb4d-4868-9c31-f602c1323173 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:32.102022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c5d84f3-cb4d-4868-9c31-f602c1323173 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:32.106618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c5d84f3-cb4d-4868-9c31-f602c1323173 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:32.110373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c5d84f3-cb4d-4868-9c31-f602c1323173 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:32.112610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c5d84f3-cb4d-4868-9c31-f602c1323173 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:32.175007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-137017808", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "0fc430fe-72c2-45e0-a5f2-bac853189a57"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:32.437782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] validate_networks() for [('0fc430fe-72c2-45e0-a5f2-bac853189a57', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:27:32.441287 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3c5d84f3-cb4d-4868-9c31-f602c1323173 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/action" status: 202 len: 0 microversion: 2.1 time: 0.390011 Aug 25 13:27:32.446668 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2421/4896] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:27:32 2022] POST /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:27:32.486237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0584e2a1-f560-4fe7-8798-4624dab9a6b7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:32.487799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0584e2a1-f560-4fe7-8798-4624dab9a6b7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:32.523938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0584e2a1-f560-4fe7-8798-4624dab9a6b7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:32.524806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0584e2a1-f560-4fe7-8798-4624dab9a6b7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:32.532769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0584e2a1-f560-4fe7-8798-4624dab9a6b7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:32.534931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0584e2a1-f560-4fe7-8798-4624dab9a6b7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:32.537403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0584e2a1-f560-4fe7-8798-4624dab9a6b7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:32.542937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0584e2a1-f560-4fe7-8798-4624dab9a6b7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:34.412472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0584e2a1-f560-4fe7-8798-4624dab9a6b7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:34.479164 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0584e2a1-f560-4fe7-8798-4624dab9a6b7 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1723 microversion: 2.1 time: 2.026244 Aug 25 13:27:34.484401 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2422/4897] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:32 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1723 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:34.493551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:34.498590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:34.514872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:34.516222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:34.517356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:34.519077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:34.520620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:34.521764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:36.313431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:27:36.319288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:27:36.322202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:27:36.325169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:27:36.329978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:27:36.378843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:36.379778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:36.380825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:36.388117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:36.389017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:36.398357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:36.495598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:27:36.521007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Getting quotas for user bd7b1570a27f4ea8ad560ce25225cf02 and project f18e71be67bf4de1aee8c6c6f8aee723. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:27:36.598960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:27:36.607924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:27:36.908222 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1bcd75cf-a80b-4c88-9e83-da802024eb33 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.744171 Aug 25 13:27:36.912968 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2476/4898] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:27:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:27:36.946892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-396904ee-eaa9-4176-8a79-9ef7f83c21dc tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:36.948603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-396904ee-eaa9-4176-8a79-9ef7f83c21dc tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:36.965648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396904ee-eaa9-4176-8a79-9ef7f83c21dc tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:36.967416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396904ee-eaa9-4176-8a79-9ef7f83c21dc tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:36.984355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396904ee-eaa9-4176-8a79-9ef7f83c21dc tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:36.988899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396904ee-eaa9-4176-8a79-9ef7f83c21dc tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:36.992715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396904ee-eaa9-4176-8a79-9ef7f83c21dc tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:36.998566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396904ee-eaa9-4176-8a79-9ef7f83c21dc tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:37.004146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:37.081205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:37.113049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:37.123907 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-16385dcc-1242-4af1-ab99-5358533ab92d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 2.633276 Aug 25 13:27:37.131038 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2423/4899] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:34 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 2646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:37.172621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b6418a89-2567-4c7f-8826-b7bbc3a6cc6f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:37.178811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b6418a89-2567-4c7f-8826-b7bbc3a6cc6f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:37.980242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b6418a89-2567-4c7f-8826-b7bbc3a6cc6f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:38.030034 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b6418a89-2567-4c7f-8826-b7bbc3a6cc6f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1208 microversion: 2.1 time: 0.894703 Aug 25 13:27:38.033167 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2424/4900] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:37 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1208 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:38.218216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:38.222864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:38.264827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:38.266166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:38.269196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:38.284456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:38.291605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:38.293389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:38.365765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-396904ee-eaa9-4176-8a79-9ef7f83c21dc tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:38.399513 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-396904ee-eaa9-4176-8a79-9ef7f83c21dc tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1723 microversion: 2.1 time: 1.474428 Aug 25 13:27:38.415975 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2477/4901] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:36 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1723 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:38.746416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:38.774472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:38.780254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:38.784745 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-73699e6d-b622-4e70-8972-4b718898dbae tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.595559 Aug 25 13:27:38.786806 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2425/4902] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:38 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:39.080848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8e15bf71-0983-43f5-9be3-76fd4c030637 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:39.082052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8e15bf71-0983-43f5-9be3-76fd4c030637 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:39.095041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e15bf71-0983-43f5-9be3-76fd4c030637 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:39.096573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e15bf71-0983-43f5-9be3-76fd4c030637 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:39.097913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e15bf71-0983-43f5-9be3-76fd4c030637 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:39.099702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e15bf71-0983-43f5-9be3-76fd4c030637 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:39.100916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e15bf71-0983-43f5-9be3-76fd4c030637 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:39.102169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e15bf71-0983-43f5-9be3-76fd4c030637 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:39.254744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8e15bf71-0983-43f5-9be3-76fd4c030637 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:39.273037 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8e15bf71-0983-43f5-9be3-76fd4c030637 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1212 microversion: 2.1 time: 0.200143 Aug 25 13:27:39.274436 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2478/4903] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:39 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1212 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:39.478241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6496eb89-cb91-4a62-910c-8054f3438e4f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:39.484292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6496eb89-cb91-4a62-910c-8054f3438e4f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:39.553172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6496eb89-cb91-4a62-910c-8054f3438e4f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:39.554591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6496eb89-cb91-4a62-910c-8054f3438e4f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:39.555422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6496eb89-cb91-4a62-910c-8054f3438e4f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:39.556781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6496eb89-cb91-4a62-910c-8054f3438e4f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:39.558316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6496eb89-cb91-4a62-910c-8054f3438e4f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:39.559173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6496eb89-cb91-4a62-910c-8054f3438e4f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:39.835384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:39.840473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:39.861895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:39.867077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:39.868488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:39.870623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:39.878436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:39.880059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:41.728934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6496eb89-cb91-4a62-910c-8054f3438e4f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:41.751569 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6496eb89-cb91-4a62-910c-8054f3438e4f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1723 microversion: 2.1 time: 2.309479 Aug 25 13:27:41.775593 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2426/4904] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:39 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1723 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:41.795449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5629769b-8b9a-40bd-858c-8b83d27fd527 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:41.797093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5629769b-8b9a-40bd-858c-8b83d27fd527 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:41.805991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:41.827962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5629769b-8b9a-40bd-858c-8b83d27fd527 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:41.830159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5629769b-8b9a-40bd-858c-8b83d27fd527 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:41.831548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5629769b-8b9a-40bd-858c-8b83d27fd527 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:41.832921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5629769b-8b9a-40bd-858c-8b83d27fd527 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:41.833944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5629769b-8b9a-40bd-858c-8b83d27fd527 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:41.835125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5629769b-8b9a-40bd-858c-8b83d27fd527 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:42.359587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5629769b-8b9a-40bd-858c-8b83d27fd527 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:42.408501 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5629769b-8b9a-40bd-858c-8b83d27fd527 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1266 microversion: 2.1 time: 0.628921 Aug 25 13:27:42.411469 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2427/4905] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:41 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1266 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:42.650446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:42.693376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:42.704035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:42.706939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f3d500bd-df41-4b5c-ac8d-e87c724a4eef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 2.879145 Aug 25 13:27:42.714612 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2479/4906] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:39 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 2888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:42.812864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c799e89e-7d52-4bf4-bf88-35f4ed7bfe9a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:42.814231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c799e89e-7d52-4bf4-bf88-35f4ed7bfe9a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:42.855022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c799e89e-7d52-4bf4-bf88-35f4ed7bfe9a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:42.863279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c799e89e-7d52-4bf4-bf88-35f4ed7bfe9a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:42.864474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c799e89e-7d52-4bf4-bf88-35f4ed7bfe9a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:42.866170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c799e89e-7d52-4bf4-bf88-35f4ed7bfe9a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:42.867324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c799e89e-7d52-4bf4-bf88-35f4ed7bfe9a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:42.869673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c799e89e-7d52-4bf4-bf88-35f4ed7bfe9a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:43.467863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-335b0c66-84cc-4056-92bf-80c11a66d8aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:43.471675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-335b0c66-84cc-4056-92bf-80c11a66d8aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:43.518505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-335b0c66-84cc-4056-92bf-80c11a66d8aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:43.523242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-335b0c66-84cc-4056-92bf-80c11a66d8aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:43.526876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-335b0c66-84cc-4056-92bf-80c11a66d8aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:43.529617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-335b0c66-84cc-4056-92bf-80c11a66d8aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:43.530762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-335b0c66-84cc-4056-92bf-80c11a66d8aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:43.531997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-335b0c66-84cc-4056-92bf-80c11a66d8aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:44.131199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c799e89e-7d52-4bf4-bf88-35f4ed7bfe9a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:44.253388 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c799e89e-7d52-4bf4-bf88-35f4ed7bfe9a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1729 microversion: 2.1 time: 1.459955 Aug 25 13:27:44.255407 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2428/4907] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:42 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1729 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:44.267187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:44.270114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:44.289369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:44.290672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:44.291499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:44.296447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:44.297788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:44.302328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:44.393474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-335b0c66-84cc-4056-92bf-80c11a66d8aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:44.429774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:44.435311 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-335b0c66-84cc-4056-92bf-80c11a66d8aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1266 microversion: 2.1 time: 0.984540 Aug 25 13:27:44.454391 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2480/4908] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:43 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1266 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:44.491413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66b7f644-cfc9-4ba3-93b7-cb094fe64ee6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:44.492938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66b7f644-cfc9-4ba3-93b7-cb094fe64ee6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:44.531830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:44.535635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66b7f644-cfc9-4ba3-93b7-cb094fe64ee6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:44.537143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66b7f644-cfc9-4ba3-93b7-cb094fe64ee6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:44.550105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66b7f644-cfc9-4ba3-93b7-cb094fe64ee6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:44.552221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66b7f644-cfc9-4ba3-93b7-cb094fe64ee6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:44.566867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66b7f644-cfc9-4ba3-93b7-cb094fe64ee6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:44.568416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66b7f644-cfc9-4ba3-93b7-cb094fe64ee6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:45.451808 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66b7f644-cfc9-4ba3-93b7-cb094fe64ee6 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.994345 Aug 25 13:27:45.454371 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2481/4909] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:27:44 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-interface => generated 284 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:27:45.504799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0535484a-30a5-4708-b17b-59f337f025cb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:45.514118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0535484a-30a5-4708-b17b-59f337f025cb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:45.545466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0535484a-30a5-4708-b17b-59f337f025cb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:45.546523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0535484a-30a5-4708-b17b-59f337f025cb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:45.547434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0535484a-30a5-4708-b17b-59f337f025cb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:45.547933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:45.551414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0535484a-30a5-4708-b17b-59f337f025cb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:45.552628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0535484a-30a5-4708-b17b-59f337f025cb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:45.555955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0535484a-30a5-4708-b17b-59f337f025cb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:45.587558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:45.595991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:45.598481 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3c516734-7474-4c70-bc0a-47a5918e7624 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 1.340781 Aug 25 13:27:45.599584 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2429/4910] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:44 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:46.105581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0535484a-30a5-4708-b17b-59f337f025cb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:46.138290 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0535484a-30a5-4708-b17b-59f337f025cb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1266 microversion: 2.1 time: 0.644866 Aug 25 13:27:46.142859 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2482/4911] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:45 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1266 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:46.684710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:46.687248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:46.806352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:46.812690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:46.815622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:46.833376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:46.841746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:46.843466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:47.188930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-078d383e-7597-4fb7-b2cd-67281017bbd8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:47.191480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-078d383e-7597-4fb7-b2cd-67281017bbd8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:47.226378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:47.238629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:47.267447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-078d383e-7597-4fb7-b2cd-67281017bbd8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:47.271333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-078d383e-7597-4fb7-b2cd-67281017bbd8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:47.274175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-078d383e-7597-4fb7-b2cd-67281017bbd8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:47.282769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-078d383e-7597-4fb7-b2cd-67281017bbd8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:47.289841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-078d383e-7597-4fb7-b2cd-67281017bbd8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:47.299467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-078d383e-7597-4fb7-b2cd-67281017bbd8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:47.991852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:48.268904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:48.360995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:48.369034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:48.390146 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-868c1b32-f854-42c4-a103-148755915f0b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 1.743810 Aug 25 13:27:48.394740 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2430/4912] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:46 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:48.470802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-078d383e-7597-4fb7-b2cd-67281017bbd8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:48.500938 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-078d383e-7597-4fb7-b2cd-67281017bbd8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1308 microversion: 2.1 time: 1.322473 Aug 25 13:27:48.506570 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2483/4913] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:47 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1308 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:49.060688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1453ad07-a06b-48d8-afe1-891887dda31d req-b015069c-ca0c-4541-9839-1ec175663732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991f22c6-27c5-471a-b485-90f6ea7d9fcc", "tag": "71d03996-bd44-44cc-ab61-997d2db0e057"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:49.115863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1453ad07-a06b-48d8-afe1-891887dda31d req-b015069c-ca0c-4541-9839-1ec175663732 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:49.122332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1453ad07-a06b-48d8-afe1-891887dda31d req-b015069c-ca0c-4541-9839-1ec175663732 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:49.131414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1453ad07-a06b-48d8-afe1-891887dda31d req-b015069c-ca0c-4541-9839-1ec175663732 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:49.176121 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1453ad07-a06b-48d8-afe1-891887dda31d req-b015069c-ca0c-4541-9839-1ec175663732 service nova] Creating event network-changed:71d03996-bd44-44cc-ab61-997d2db0e057 for instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc on n-h1-852771-8 Aug 25 13:27:49.204061 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1453ad07-a06b-48d8-afe1-891887dda31d req-b015069c-ca0c-4541-9839-1ec175663732 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149252 Aug 25 13:27:49.206201 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2431/4914] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:27:49.445584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:49.446834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:49.479509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:49.480538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:49.481235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:49.482647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:49.483532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:49.484340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:49.547507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-447cfe52-54a7-4f21-bbb2-b8799fbede49 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:49.548990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-447cfe52-54a7-4f21-bbb2-b8799fbede49 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:49.586188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-447cfe52-54a7-4f21-bbb2-b8799fbede49 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:49.588916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-447cfe52-54a7-4f21-bbb2-b8799fbede49 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:49.595221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-447cfe52-54a7-4f21-bbb2-b8799fbede49 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:49.598814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-447cfe52-54a7-4f21-bbb2-b8799fbede49 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:49.599754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-447cfe52-54a7-4f21-bbb2-b8799fbede49 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:49.600559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-447cfe52-54a7-4f21-bbb2-b8799fbede49 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:50.618211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-447cfe52-54a7-4f21-bbb2-b8799fbede49 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:50.667249 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-447cfe52-54a7-4f21-bbb2-b8799fbede49 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1308 microversion: 2.1 time: 1.133231 Aug 25 13:27:50.696490 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2432/4915] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:49 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1308 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:50.715047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c9b57d25-ddbe-449c-96f4-0568f56b0822 req-f44ae16b-642b-416c-ba71-565f867dd598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ff1f1a-61c7-4c52-a109-07e667d81e21", "tag": "1ec1cdb0-67dd-4396-93a6-782bf701d6b1"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:50.752759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c9b57d25-ddbe-449c-96f4-0568f56b0822 req-f44ae16b-642b-416c-ba71-565f867dd598 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:50.757925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c9b57d25-ddbe-449c-96f4-0568f56b0822 req-f44ae16b-642b-416c-ba71-565f867dd598 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:50.759537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c9b57d25-ddbe-449c-96f4-0568f56b0822 req-f44ae16b-642b-416c-ba71-565f867dd598 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:50.784283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:50.825013 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c9b57d25-ddbe-449c-96f4-0568f56b0822 req-f44ae16b-642b-416c-ba71-565f867dd598 service nova] Creating event network-changed:1ec1cdb0-67dd-4396-93a6-782bf701d6b1 for instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 on n-h2-852771-8 Aug 25 13:27:50.853764 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c9b57d25-ddbe-449c-96f4-0568f56b0822 req-f44ae16b-642b-416c-ba71-565f867dd598 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152564 Aug 25 13:27:50.859256 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2433/4916] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:27:50.891273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:50.937363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:50.950534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:50.960161 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8cbcf7bd-b8f9-4bbc-84ed-089aaa9d4f09 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 1.516795 Aug 25 13:27:50.961357 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2484/4917] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:49 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:51.240177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c4cc9276-0ab7-45b0-9983-ae08e23295ac req-2389442f-802c-4e1f-8eea-48485a541056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991f22c6-27c5-471a-b485-90f6ea7d9fcc", "tag": "71d03996-bd44-44cc-ab61-997d2db0e057"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:51.285967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c4cc9276-0ab7-45b0-9983-ae08e23295ac req-2389442f-802c-4e1f-8eea-48485a541056 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:51.286867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c4cc9276-0ab7-45b0-9983-ae08e23295ac req-2389442f-802c-4e1f-8eea-48485a541056 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:51.287829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c4cc9276-0ab7-45b0-9983-ae08e23295ac req-2389442f-802c-4e1f-8eea-48485a541056 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:51.311840 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c4cc9276-0ab7-45b0-9983-ae08e23295ac req-2389442f-802c-4e1f-8eea-48485a541056 service nova] Creating event network-changed:71d03996-bd44-44cc-ab61-997d2db0e057 for instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc on n-h1-852771-8 Aug 25 13:27:51.325266 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c4cc9276-0ab7-45b0-9983-ae08e23295ac req-2389442f-802c-4e1f-8eea-48485a541056 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097781 Aug 25 13:27:51.347786 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2434/4918] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:27:51.721171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6544a8ff-6d27-4ff8-aa26-40fe95df973f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:51.730453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6544a8ff-6d27-4ff8-aa26-40fe95df973f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:51.772800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6544a8ff-6d27-4ff8-aa26-40fe95df973f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:51.773740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6544a8ff-6d27-4ff8-aa26-40fe95df973f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:51.774534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6544a8ff-6d27-4ff8-aa26-40fe95df973f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:51.779398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6544a8ff-6d27-4ff8-aa26-40fe95df973f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:51.780307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6544a8ff-6d27-4ff8-aa26-40fe95df973f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:51.781079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6544a8ff-6d27-4ff8-aa26-40fe95df973f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:52.024600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:52.031597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:52.062697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:52.067511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:52.069182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:52.077993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:52.082727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:52.089831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:52.691861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6544a8ff-6d27-4ff8-aa26-40fe95df973f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:52.717270 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6544a8ff-6d27-4ff8-aa26-40fe95df973f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1308 microversion: 2.1 time: 1.006840 Aug 25 13:27:52.718413 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2485/4919] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:51 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1308 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:52.876946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:52.901421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:52.905340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:52.908170 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fbcd68ac-0598-4d60-90ad-08c529b52251 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.899034 Aug 25 13:27:52.909190 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2435/4920] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:52 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:27:53.765122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bf0137f3-eda0-4809-b451-c61a3d6ede78 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:53.779491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bf0137f3-eda0-4809-b451-c61a3d6ede78 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:53.812820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf0137f3-eda0-4809-b451-c61a3d6ede78 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:53.817361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf0137f3-eda0-4809-b451-c61a3d6ede78 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:53.826246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf0137f3-eda0-4809-b451-c61a3d6ede78 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:53.830627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf0137f3-eda0-4809-b451-c61a3d6ede78 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:53.832030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf0137f3-eda0-4809-b451-c61a3d6ede78 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:53.833322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bf0137f3-eda0-4809-b451-c61a3d6ede78 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:53.966064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:53.967390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:53.981943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:53.982894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:53.983732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:53.985145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:53.986083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:53.986927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:54.489342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bf0137f3-eda0-4809-b451-c61a3d6ede78 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:54.516313 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bf0137f3-eda0-4809-b451-c61a3d6ede78 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1308 microversion: 2.1 time: 0.765939 Aug 25 13:27:54.554887 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2486/4921] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:53 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1308 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:54.612771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:54.632883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:54.637061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:54.639738 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e6de148a-6900-4cd4-b437-1e07fcd47bf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.693698 Aug 25 13:27:54.642214 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2436/4922] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:53 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:55.575438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2acf1224-c609-498f-8959-da0fa46e93dc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:55.580428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2acf1224-c609-498f-8959-da0fa46e93dc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:55.601010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2acf1224-c609-498f-8959-da0fa46e93dc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:55.602004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2acf1224-c609-498f-8959-da0fa46e93dc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:55.605458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2acf1224-c609-498f-8959-da0fa46e93dc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:55.606703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2acf1224-c609-498f-8959-da0fa46e93dc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:55.609059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2acf1224-c609-498f-8959-da0fa46e93dc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:55.612293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2acf1224-c609-498f-8959-da0fa46e93dc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:55.691380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:55.695800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:55.728616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:55.734150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:55.736434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:55.738062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:55.739138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:55.740111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:56.395827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2acf1224-c609-498f-8959-da0fa46e93dc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:56.416608 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2acf1224-c609-498f-8959-da0fa46e93dc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1308 microversion: 2.1 time: 0.853454 Aug 25 13:27:56.428886 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2487/4923] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:55 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1308 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:56.437938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:56.485578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:56.490418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:56.493452 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-394ad69b-6241-4e39-b7da-ee1d89360138 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.816494 Aug 25 13:27:56.504811 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2437/4924] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:55 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:27:57.478300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-40d1ffa2-d909-4776-ba34-58e1fcaea8f3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:57.480003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-40d1ffa2-d909-4776-ba34-58e1fcaea8f3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:57.499239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40d1ffa2-d909-4776-ba34-58e1fcaea8f3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:57.500266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40d1ffa2-d909-4776-ba34-58e1fcaea8f3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:57.504547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40d1ffa2-d909-4776-ba34-58e1fcaea8f3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:57.506859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40d1ffa2-d909-4776-ba34-58e1fcaea8f3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:57.507764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40d1ffa2-d909-4776-ba34-58e1fcaea8f3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:57.508714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40d1ffa2-d909-4776-ba34-58e1fcaea8f3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:57.549113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:57.555139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:57.580821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:57.586779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:57.590681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:57.592762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:57.598681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:57.599710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:58.125431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-40d1ffa2-d909-4776-ba34-58e1fcaea8f3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:58.167685 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-40d1ffa2-d909-4776-ba34-58e1fcaea8f3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1308 microversion: 2.1 time: 0.695524 Aug 25 13:27:58.169038 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2488/4925] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:57 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1308 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:58.274427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:58.301431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:58.306236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:58.309176 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-03373c03-27e9-4a05-81f2-ccfa9874eaf6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.767971 Aug 25 13:27:58.312265 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2438/4926] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:57 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:27:59.212814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42fc57fd-e174-4424-914a-967e2203e773 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:59.215253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42fc57fd-e174-4424-914a-967e2203e773 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:59.236723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42fc57fd-e174-4424-914a-967e2203e773 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:59.240607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42fc57fd-e174-4424-914a-967e2203e773 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:59.242594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42fc57fd-e174-4424-914a-967e2203e773 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:59.248611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42fc57fd-e174-4424-914a-967e2203e773 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:59.251171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42fc57fd-e174-4424-914a-967e2203e773 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:59.252853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42fc57fd-e174-4424-914a-967e2203e773 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:59.367459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:59.368531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:59.397106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:59.398487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:59.399446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:59.401699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:59.402621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:59.404015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:59.891395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-42fc57fd-e174-4424-914a-967e2203e773 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:59.923775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42fc57fd-e174-4424-914a-967e2203e773 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1308 microversion: 2.1 time: 0.718137 Aug 25 13:27:59.939072 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2489/4927] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:59 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1308 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:59.999978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-54554e0e-e389-439e-afeb-c8c54beb5ff2 req-58421f5a-9d18-4dda-b75e-7dd296ee7cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ff1f1a-61c7-4c52-a109-07e667d81e21", "name": "network-vif-plugged", "status": "completed", "tag": "1ec1cdb0-67dd-4396-93a6-782bf701d6b1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:00.022277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-54554e0e-e389-439e-afeb-c8c54beb5ff2 req-58421f5a-9d18-4dda-b75e-7dd296ee7cf8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:00.023548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-54554e0e-e389-439e-afeb-c8c54beb5ff2 req-58421f5a-9d18-4dda-b75e-7dd296ee7cf8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:00.024616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-54554e0e-e389-439e-afeb-c8c54beb5ff2 req-58421f5a-9d18-4dda-b75e-7dd296ee7cf8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:00.096448 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-54554e0e-e389-439e-afeb-c8c54beb5ff2 req-58421f5a-9d18-4dda-b75e-7dd296ee7cf8 service nova] Creating event network-vif-plugged:1ec1cdb0-67dd-4396-93a6-782bf701d6b1 for instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 on n-h2-852771-8 Aug 25 13:28:00.098456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:00.128770 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-54554e0e-e389-439e-afeb-c8c54beb5ff2 req-58421f5a-9d18-4dda-b75e-7dd296ee7cf8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140440 Aug 25 13:28:00.130523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:00.138787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:00.141945 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-10d2fef1-4a0d-43ed-ade9-5647669376fe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.792725 Aug 25 13:28:00.145562 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2490/4929] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:00.146269 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2439/4929] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:27:59 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:28:00.986935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cba02408-66d6-4a03-84e0-64d2ad2f89df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:01.008647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cba02408-66d6-4a03-84e0-64d2ad2f89df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:01.033072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cba02408-66d6-4a03-84e0-64d2ad2f89df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:01.034031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cba02408-66d6-4a03-84e0-64d2ad2f89df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:01.035100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cba02408-66d6-4a03-84e0-64d2ad2f89df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:01.036478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cba02408-66d6-4a03-84e0-64d2ad2f89df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:01.037490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cba02408-66d6-4a03-84e0-64d2ad2f89df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:01.038332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cba02408-66d6-4a03-84e0-64d2ad2f89df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:01.193807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:01.196329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:01.212008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:01.214155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:01.215596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:01.217246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:01.218480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:01.219564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:01.299796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cba02408-66d6-4a03-84e0-64d2ad2f89df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:01.319460 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cba02408-66d6-4a03-84e0-64d2ad2f89df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1308 microversion: 2.1 time: 0.343182 Aug 25 13:28:01.321471 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2491/4930] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:00 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:01.535627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:01.575071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:01.578629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:01.581454 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-01b49c4c-f753-42a0-a1cf-c1e6afbcc665 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.394909 Aug 25 13:28:01.583398 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2440/4931] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:28:01 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:28:02.201563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0274820e-3abe-441d-82c1-1b351481ea0d req-f739b35b-ef84-4a12-acb5-6a1687333595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d404ff6f-0fad-4c7f-bf95-5c0fe210039b", "name": "network-vif-plugged", "status": "completed", "tag": "8b68205d-7c61-4adf-ace8-ad7064786841"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:02.229705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0274820e-3abe-441d-82c1-1b351481ea0d req-f739b35b-ef84-4a12-acb5-6a1687333595 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:02.230656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0274820e-3abe-441d-82c1-1b351481ea0d req-f739b35b-ef84-4a12-acb5-6a1687333595 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:02.231455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0274820e-3abe-441d-82c1-1b351481ea0d req-f739b35b-ef84-4a12-acb5-6a1687333595 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:02.256514 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0274820e-3abe-441d-82c1-1b351481ea0d req-f739b35b-ef84-4a12-acb5-6a1687333595 service nova] Creating event network-vif-plugged:8b68205d-7c61-4adf-ace8-ad7064786841 for instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b on n-h1-852771-8 Aug 25 13:28:02.270155 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0274820e-3abe-441d-82c1-1b351481ea0d req-f739b35b-ef84-4a12-acb5-6a1687333595 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083556 Aug 25 13:28:02.272792 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2492/4932] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:02.363842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0f316e87-95a3-492d-b20d-7081cef4f8f0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:02.366048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0f316e87-95a3-492d-b20d-7081cef4f8f0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:02.390829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f316e87-95a3-492d-b20d-7081cef4f8f0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:02.392271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f316e87-95a3-492d-b20d-7081cef4f8f0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:02.393467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f316e87-95a3-492d-b20d-7081cef4f8f0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:02.395054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f316e87-95a3-492d-b20d-7081cef4f8f0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:02.396370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f316e87-95a3-492d-b20d-7081cef4f8f0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:02.396750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0f316e87-95a3-492d-b20d-7081cef4f8f0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:02.636494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:02.641614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:02.671821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:02.675906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:02.682676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:02.683892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:02.684431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:02.684886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:03.141895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:03.161725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0f316e87-95a3-492d-b20d-7081cef4f8f0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:03.163457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:03.165367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:03.167706 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ac710396-bbcb-45cc-b88f-b31ac9d44928 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.542729 Aug 25 13:28:03.169257 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2493/4933] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:28:02 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:28:03.187938 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0f316e87-95a3-492d-b20d-7081cef4f8f0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1487 microversion: 2.1 time: 0.831137 Aug 25 13:28:03.189626 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2441/4934] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:02 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1487 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:03.248977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3955ad3-df19-4538-956e-251576eeb74f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1015606841"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:03.259352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a3955ad3-df19-4538-956e-251576eeb74f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:03.280285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3955ad3-df19-4538-956e-251576eeb74f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:03.281789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3955ad3-df19-4538-956e-251576eeb74f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:03.283155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3955ad3-df19-4538-956e-251576eeb74f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:03.285587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3955ad3-df19-4538-956e-251576eeb74f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:03.286244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3955ad3-df19-4538-956e-251576eeb74f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:03.303964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3955ad3-df19-4538-956e-251576eeb74f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:03.475992 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a3955ad3-df19-4538-956e-251576eeb74f tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "PUT /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1073 microversion: 2.1 time: 0.235016 Aug 25 13:28:03.478034 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2494/4935] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Aug 25 13:28:03 2022] PUT /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1073 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:03.515055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-930f59d5-bc63-4dfb-82ef-af369d1df8c0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:03.517210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-930f59d5-bc63-4dfb-82ef-af369d1df8c0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:03.531375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930f59d5-bc63-4dfb-82ef-af369d1df8c0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:03.532794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930f59d5-bc63-4dfb-82ef-af369d1df8c0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:03.533786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930f59d5-bc63-4dfb-82ef-af369d1df8c0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:03.537612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930f59d5-bc63-4dfb-82ef-af369d1df8c0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:03.538960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930f59d5-bc63-4dfb-82ef-af369d1df8c0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:03.539979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930f59d5-bc63-4dfb-82ef-af369d1df8c0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:03.868865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-930f59d5-bc63-4dfb-82ef-af369d1df8c0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:03.888032 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-930f59d5-bc63-4dfb-82ef-af369d1df8c0 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1499 microversion: 2.1 time: 0.379849 Aug 25 13:28:03.902104 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2442/4936] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:03 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1499 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:03.935741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e670236-070d-4a4f-b33b-86b964f0a208 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:03.937388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e670236-070d-4a4f-b33b-86b964f0a208 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:03.951822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e670236-070d-4a4f-b33b-86b964f0a208 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:03.953565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e670236-070d-4a4f-b33b-86b964f0a208 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:03.957387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e670236-070d-4a4f-b33b-86b964f0a208 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:03.957940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e670236-070d-4a4f-b33b-86b964f0a208 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:03.958737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e670236-070d-4a4f-b33b-86b964f0a208 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:03.959866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e670236-070d-4a4f-b33b-86b964f0a208 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:04.250245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:04.251994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:04.298943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:04.300870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:04.302069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:04.305377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:04.309953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:04.312157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:04.325724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e670236-070d-4a4f-b33b-86b964f0a208 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:04.364419 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e670236-070d-4a4f-b33b-86b964f0a208 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1499 microversion: 2.1 time: 0.425313 Aug 25 13:28:04.364419 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2495/4937] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:03 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1499 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:04.397768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5764dcc-f147-4c86-9528-ea70fc9fb78a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:04.414141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5764dcc-f147-4c86-9528-ea70fc9fb78a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:04.415012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5764dcc-f147-4c86-9528-ea70fc9fb78a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:04.417054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5764dcc-f147-4c86-9528-ea70fc9fb78a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:04.514023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b5764dcc-f147-4c86-9528-ea70fc9fb78a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Going to try to stop instance {{(pid=129060) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:28:04.658667 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b5764dcc-f147-4c86-9528-ea70fc9fb78a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "POST /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21/action" status: 202 len: 0 microversion: 2.1 time: 0.268201 Aug 25 13:28:04.660427 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2496/4938] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:28:04 2022] POST /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:28:04.679202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c91e62d5-3078-4de7-ba0a-fb8a3b455fdd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:04.681152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c91e62d5-3078-4de7-ba0a-fb8a3b455fdd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:04.716686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c91e62d5-3078-4de7-ba0a-fb8a3b455fdd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:04.718051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c91e62d5-3078-4de7-ba0a-fb8a3b455fdd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:04.726083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c91e62d5-3078-4de7-ba0a-fb8a3b455fdd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:04.733985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c91e62d5-3078-4de7-ba0a-fb8a3b455fdd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:04.741331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c91e62d5-3078-4de7-ba0a-fb8a3b455fdd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:04.748199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c91e62d5-3078-4de7-ba0a-fb8a3b455fdd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:04.814360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:04.890395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:04.918036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:04.922753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:04.926866 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ec19a266-2230-4652-84cb-fb345e00b1b2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.685862 Aug 25 13:28:04.945625 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2443/4939] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:28:04 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:28:05.179572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c91e62d5-3078-4de7-ba0a-fb8a3b455fdd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:05.201212 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c91e62d5-3078-4de7-ba0a-fb8a3b455fdd tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.533706 Aug 25 13:28:05.202722 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2497/4940] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:04 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:05.975316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:05.976962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:06.000568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:06.001898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:06.003283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:06.004850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:06.006308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:06.007465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:06.246500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e7674302-761c-4031-8da2-5b3efd3c5ba3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:06.247684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e7674302-761c-4031-8da2-5b3efd3c5ba3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:06.266407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7674302-761c-4031-8da2-5b3efd3c5ba3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:06.267821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7674302-761c-4031-8da2-5b3efd3c5ba3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:06.268871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7674302-761c-4031-8da2-5b3efd3c5ba3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:06.270462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7674302-761c-4031-8da2-5b3efd3c5ba3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:06.271738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7674302-761c-4031-8da2-5b3efd3c5ba3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:06.272717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7674302-761c-4031-8da2-5b3efd3c5ba3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:06.518245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:06.547373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:06.559801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:06.569020 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5d8fa05f-e98c-4401-907b-78c6de021a7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1809 microversion: 2.20 time: 0.602024 Aug 25 13:28:06.570654 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2444/4941] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:28:05 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1809 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:28:06.709760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e7674302-761c-4031-8da2-5b3efd3c5ba3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:06.730527 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e7674302-761c-4031-8da2-5b3efd3c5ba3 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.491906 Aug 25 13:28:06.742387 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2498/4942] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:06 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:07.615861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:07.618174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:07.633784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:07.635553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:07.636964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:07.638590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:07.639878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:07.640854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:07.772794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a153212-1d8a-4cc6-834e-b8bcaac387c4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:07.780051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a153212-1d8a-4cc6-834e-b8bcaac387c4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:07.817569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a153212-1d8a-4cc6-834e-b8bcaac387c4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:07.818182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a153212-1d8a-4cc6-834e-b8bcaac387c4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:07.818756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a153212-1d8a-4cc6-834e-b8bcaac387c4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:07.819859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a153212-1d8a-4cc6-834e-b8bcaac387c4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:07.820457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a153212-1d8a-4cc6-834e-b8bcaac387c4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:07.821121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a153212-1d8a-4cc6-834e-b8bcaac387c4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:08.036576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:08.068857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:08.072720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:08.075208 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9a53538b-1f9e-42c9-b2dc-66210d6b50c2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1796 microversion: 2.20 time: 0.466781 Aug 25 13:28:08.098166 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2445/4943] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:28:07 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1796 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:28:08.280285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a153212-1d8a-4cc6-834e-b8bcaac387c4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:08.299934 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a153212-1d8a-4cc6-834e-b8bcaac387c4 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.536098 Aug 25 13:28:08.301081 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2499/4944] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:07 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:09.352429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d561f796-0f53-4196-9000-59444c9a81df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:09.356623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d561f796-0f53-4196-9000-59444c9a81df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:09.373179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d561f796-0f53-4196-9000-59444c9a81df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:09.374528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d561f796-0f53-4196-9000-59444c9a81df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:09.375619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d561f796-0f53-4196-9000-59444c9a81df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:09.377446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d561f796-0f53-4196-9000-59444c9a81df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:09.378377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d561f796-0f53-4196-9000-59444c9a81df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:09.379448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d561f796-0f53-4196-9000-59444c9a81df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:09.701229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d561f796-0f53-4196-9000-59444c9a81df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:09.720463 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d561f796-0f53-4196-9000-59444c9a81df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.376443 Aug 25 13:28:09.736711 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2446/4945] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:09 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:10.768243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7db1c3d8-2ad5-4171-98a6-89c180f0ff9d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:10.769446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7db1c3d8-2ad5-4171-98a6-89c180f0ff9d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:10.783102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7db1c3d8-2ad5-4171-98a6-89c180f0ff9d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:10.783987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7db1c3d8-2ad5-4171-98a6-89c180f0ff9d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:10.784796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7db1c3d8-2ad5-4171-98a6-89c180f0ff9d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:10.786263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7db1c3d8-2ad5-4171-98a6-89c180f0ff9d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:10.787297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7db1c3d8-2ad5-4171-98a6-89c180f0ff9d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:10.787985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7db1c3d8-2ad5-4171-98a6-89c180f0ff9d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:11.175201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7db1c3d8-2ad5-4171-98a6-89c180f0ff9d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:11.194786 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7db1c3d8-2ad5-4171-98a6-89c180f0ff9d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.433796 Aug 25 13:28:11.195893 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2500/4946] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:10 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:12.240077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0a238e5-ece5-4205-9dc5-eb0094003977 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:12.242801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b0a238e5-ece5-4205-9dc5-eb0094003977 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:12.247127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=40 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:12.259215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0a238e5-ece5-4205-9dc5-eb0094003977 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:12.260961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0a238e5-ece5-4205-9dc5-eb0094003977 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:12.261926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0a238e5-ece5-4205-9dc5-eb0094003977 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:12.263357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0a238e5-ece5-4205-9dc5-eb0094003977 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:12.264476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0a238e5-ece5-4205-9dc5-eb0094003977 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:12.265317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0a238e5-ece5-4205-9dc5-eb0094003977 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:12.612673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b0a238e5-ece5-4205-9dc5-eb0094003977 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:12.641052 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b0a238e5-ece5-4205-9dc5-eb0094003977 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.411487 Aug 25 13:28:12.642200 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2447/4947] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:12 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:13.680752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9acba325-35fe-4bea-b4fe-7699eeedb993 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:13.681573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9acba325-35fe-4bea-b4fe-7699eeedb993 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:13.691064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acba325-35fe-4bea-b4fe-7699eeedb993 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:13.691908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acba325-35fe-4bea-b4fe-7699eeedb993 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:13.692675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acba325-35fe-4bea-b4fe-7699eeedb993 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:13.693992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acba325-35fe-4bea-b4fe-7699eeedb993 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:13.694742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acba325-35fe-4bea-b4fe-7699eeedb993 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:13.695325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9acba325-35fe-4bea-b4fe-7699eeedb993 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:13.997851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9acba325-35fe-4bea-b4fe-7699eeedb993 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:14.020497 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9acba325-35fe-4bea-b4fe-7699eeedb993 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.344837 Aug 25 13:28:14.022560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2501/4948] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:13 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:15.065488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b2225a0d-50f1-4804-802b-acb4fc9236fb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:15.067834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b2225a0d-50f1-4804-802b-acb4fc9236fb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:15.081431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2225a0d-50f1-4804-802b-acb4fc9236fb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:15.082353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2225a0d-50f1-4804-802b-acb4fc9236fb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:15.083139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2225a0d-50f1-4804-802b-acb4fc9236fb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:15.084778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2225a0d-50f1-4804-802b-acb4fc9236fb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:15.085695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2225a0d-50f1-4804-802b-acb4fc9236fb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:15.086455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2225a0d-50f1-4804-802b-acb4fc9236fb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:15.380038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b2225a0d-50f1-4804-802b-acb4fc9236fb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:15.399054 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b2225a0d-50f1-4804-802b-acb4fc9236fb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.342062 Aug 25 13:28:15.400999 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2448/4949] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:15 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:16.443985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e19d003b-14a9-421c-b51e-9f25901aa779 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:16.446269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e19d003b-14a9-421c-b51e-9f25901aa779 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:16.452645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=42 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:16.468381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e19d003b-14a9-421c-b51e-9f25901aa779 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:16.469632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e19d003b-14a9-421c-b51e-9f25901aa779 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:16.470768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e19d003b-14a9-421c-b51e-9f25901aa779 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:16.472348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e19d003b-14a9-421c-b51e-9f25901aa779 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:16.473647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e19d003b-14a9-421c-b51e-9f25901aa779 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:16.475266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e19d003b-14a9-421c-b51e-9f25901aa779 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:16.737462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e19d003b-14a9-421c-b51e-9f25901aa779 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:16.758747 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e19d003b-14a9-421c-b51e-9f25901aa779 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.322837 Aug 25 13:28:16.761138 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2502/4950] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:16 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:17.800971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10ca9b6f-dca5-46e7-a41c-01aa69c7fd56 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:17.802406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-10ca9b6f-dca5-46e7-a41c-01aa69c7fd56 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:17.823626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10ca9b6f-dca5-46e7-a41c-01aa69c7fd56 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:17.824981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10ca9b6f-dca5-46e7-a41c-01aa69c7fd56 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:17.826060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10ca9b6f-dca5-46e7-a41c-01aa69c7fd56 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:17.830035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10ca9b6f-dca5-46e7-a41c-01aa69c7fd56 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:17.834124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10ca9b6f-dca5-46e7-a41c-01aa69c7fd56 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:17.834706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10ca9b6f-dca5-46e7-a41c-01aa69c7fd56 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:18.459530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10ca9b6f-dca5-46e7-a41c-01aa69c7fd56 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:18.485582 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-10ca9b6f-dca5-46e7-a41c-01aa69c7fd56 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.694403 Aug 25 13:28:18.499830 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2449/4951] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:17 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:19.531838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6c3e683-cb60-49d0-a5d2-7c79ca84e034 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:19.533443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b6c3e683-cb60-49d0-a5d2-7c79ca84e034 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:19.552923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6c3e683-cb60-49d0-a5d2-7c79ca84e034 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:19.553989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6c3e683-cb60-49d0-a5d2-7c79ca84e034 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:19.555480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6c3e683-cb60-49d0-a5d2-7c79ca84e034 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:19.557838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6c3e683-cb60-49d0-a5d2-7c79ca84e034 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:19.558943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6c3e683-cb60-49d0-a5d2-7c79ca84e034 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:19.559929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6c3e683-cb60-49d0-a5d2-7c79ca84e034 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:19.935264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b6c3e683-cb60-49d0-a5d2-7c79ca84e034 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:19.957318 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b6c3e683-cb60-49d0-a5d2-7c79ca84e034 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.434233 Aug 25 13:28:19.977122 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2503/4952] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:19 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:21.051075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8afc5ec3-60b5-46e4-815b-1ea593491816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:21.085480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8afc5ec3-60b5-46e4-815b-1ea593491816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:21.110512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8afc5ec3-60b5-46e4-815b-1ea593491816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:21.112594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8afc5ec3-60b5-46e4-815b-1ea593491816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:21.113988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8afc5ec3-60b5-46e4-815b-1ea593491816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:21.115655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8afc5ec3-60b5-46e4-815b-1ea593491816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:21.116845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8afc5ec3-60b5-46e4-815b-1ea593491816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:21.118545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8afc5ec3-60b5-46e4-815b-1ea593491816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:21.462344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8afc5ec3-60b5-46e4-815b-1ea593491816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:21.465344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:21.475140 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8afc5ec3-60b5-46e4-815b-1ea593491816 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.484009 Aug 25 13:28:21.475978 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2450/4953] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:20 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:22.501316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fb004f83-91f1-41e0-893a-6a1099493e08 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:22.502219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fb004f83-91f1-41e0-893a-6a1099493e08 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:22.513183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb004f83-91f1-41e0-893a-6a1099493e08 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:22.514102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb004f83-91f1-41e0-893a-6a1099493e08 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:22.514799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb004f83-91f1-41e0-893a-6a1099493e08 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:22.515786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb004f83-91f1-41e0-893a-6a1099493e08 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:22.516350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb004f83-91f1-41e0-893a-6a1099493e08 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:22.516851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb004f83-91f1-41e0-893a-6a1099493e08 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:22.784955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fb004f83-91f1-41e0-893a-6a1099493e08 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:22.801805 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fb004f83-91f1-41e0-893a-6a1099493e08 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.304941 Aug 25 13:28:22.802941 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2504/4954] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:22 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:23.850806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-05ca4fbc-5779-495e-ba8d-307352d056f2 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:23.854728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-05ca4fbc-5779-495e-ba8d-307352d056f2 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:23.879788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ca4fbc-5779-495e-ba8d-307352d056f2 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:23.882050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ca4fbc-5779-495e-ba8d-307352d056f2 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:23.883249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ca4fbc-5779-495e-ba8d-307352d056f2 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:23.886993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ca4fbc-5779-495e-ba8d-307352d056f2 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:23.888421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ca4fbc-5779-495e-ba8d-307352d056f2 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:23.889839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ca4fbc-5779-495e-ba8d-307352d056f2 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:24.237005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-05ca4fbc-5779-495e-ba8d-307352d056f2 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:24.270470 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-05ca4fbc-5779-495e-ba8d-307352d056f2 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.430657 Aug 25 13:28:24.282224 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2451/4955] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:23 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:25.327374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cdbdcd5a-83e5-4d92-8c64-851cd3494699 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:25.329746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cdbdcd5a-83e5-4d92-8c64-851cd3494699 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:25.343686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdbdcd5a-83e5-4d92-8c64-851cd3494699 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:25.344703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdbdcd5a-83e5-4d92-8c64-851cd3494699 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:25.345630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdbdcd5a-83e5-4d92-8c64-851cd3494699 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:25.347200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdbdcd5a-83e5-4d92-8c64-851cd3494699 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:25.348152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdbdcd5a-83e5-4d92-8c64-851cd3494699 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:25.349283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdbdcd5a-83e5-4d92-8c64-851cd3494699 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:25.699937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cdbdcd5a-83e5-4d92-8c64-851cd3494699 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:25.720116 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cdbdcd5a-83e5-4d92-8c64-851cd3494699 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.400760 Aug 25 13:28:25.721863 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2505/4956] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:25 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:26.762873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8b84107d-bf04-4bfd-92ab-522933862762 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:26.764061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8b84107d-bf04-4bfd-92ab-522933862762 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:26.793537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b84107d-bf04-4bfd-92ab-522933862762 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:26.795465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b84107d-bf04-4bfd-92ab-522933862762 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:26.796588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b84107d-bf04-4bfd-92ab-522933862762 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:26.799905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b84107d-bf04-4bfd-92ab-522933862762 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:26.801254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b84107d-bf04-4bfd-92ab-522933862762 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:26.803705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b84107d-bf04-4bfd-92ab-522933862762 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:27.071130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b275e5fe-59ac-4458-8751-5e25ebb1ae87 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:27.073984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b275e5fe-59ac-4458-8751-5e25ebb1ae87 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:27.089213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b275e5fe-59ac-4458-8751-5e25ebb1ae87 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:27.090802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b275e5fe-59ac-4458-8751-5e25ebb1ae87 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:27.092079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b275e5fe-59ac-4458-8751-5e25ebb1ae87 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:27.093831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b275e5fe-59ac-4458-8751-5e25ebb1ae87 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:27.095024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b275e5fe-59ac-4458-8751-5e25ebb1ae87 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:27.096230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b275e5fe-59ac-4458-8751-5e25ebb1ae87 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:27.169270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8b84107d-bf04-4bfd-92ab-522933862762 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:27.192210 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8b84107d-bf04-4bfd-92ab-522933862762 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.437766 Aug 25 13:28:27.194024 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2452/4957] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:26 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:27.329877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-b275e5fe-59ac-4458-8751-5e25ebb1ae87 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lazy-loading 'services' on Instance uuid 2166b072-a2e3-469f-b49a-ac99195a5827 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:28:27.511283 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b275e5fe-59ac-4458-8751-5e25ebb1ae87 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/os-volume_attachments/edf2edb6-338d-401a-bbe9-18437a6e2124" status: 202 len: 0 microversion: 2.1 time: 0.445823 Aug 25 13:28:27.520246 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2506/4958] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:28:27 2022] DELETE /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/os-volume_attachments/edf2edb6-338d-401a-bbe9-18437a6e2124 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:28:28.245947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-64e8e1dd-dfc8-4500-ae2f-14334bfc865a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:28.247421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-64e8e1dd-dfc8-4500-ae2f-14334bfc865a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:28.262501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e8e1dd-dfc8-4500-ae2f-14334bfc865a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:28.262501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e8e1dd-dfc8-4500-ae2f-14334bfc865a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:28.263518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e8e1dd-dfc8-4500-ae2f-14334bfc865a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:28.264960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e8e1dd-dfc8-4500-ae2f-14334bfc865a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:28.266035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e8e1dd-dfc8-4500-ae2f-14334bfc865a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:28.267075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64e8e1dd-dfc8-4500-ae2f-14334bfc865a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:28.567519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-64e8e1dd-dfc8-4500-ae2f-14334bfc865a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:28.593901 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-64e8e1dd-dfc8-4500-ae2f-14334bfc865a tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.356040 Aug 25 13:28:28.595695 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2453/4959] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:28 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:29.636487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df5d867e-16a7-4338-8502-2d7fad93ce67 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:29.639763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-df5d867e-16a7-4338-8502-2d7fad93ce67 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:29.686040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5d867e-16a7-4338-8502-2d7fad93ce67 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:29.687347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5d867e-16a7-4338-8502-2d7fad93ce67 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:29.688482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5d867e-16a7-4338-8502-2d7fad93ce67 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:29.691028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5d867e-16a7-4338-8502-2d7fad93ce67 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:29.692404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5d867e-16a7-4338-8502-2d7fad93ce67 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:29.693630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df5d867e-16a7-4338-8502-2d7fad93ce67 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:30.059863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df5d867e-16a7-4338-8502-2d7fad93ce67 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:30.090387 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-df5d867e-16a7-4338-8502-2d7fad93ce67 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1509 microversion: 2.1 time: 0.463670 Aug 25 13:28:30.105852 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2507/4960] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:29 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:31.142177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89409e29-ef09-463a-a3fb-abab1adec56d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:31.143402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89409e29-ef09-463a-a3fb-abab1adec56d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:31.157553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89409e29-ef09-463a-a3fb-abab1adec56d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:31.158443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89409e29-ef09-463a-a3fb-abab1adec56d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:31.159243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89409e29-ef09-463a-a3fb-abab1adec56d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:31.160588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89409e29-ef09-463a-a3fb-abab1adec56d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:31.161740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89409e29-ef09-463a-a3fb-abab1adec56d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:31.162794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89409e29-ef09-463a-a3fb-abab1adec56d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:31.500741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89409e29-ef09-463a-a3fb-abab1adec56d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:31.516405 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89409e29-ef09-463a-a3fb-abab1adec56d tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1486 microversion: 2.1 time: 0.385498 Aug 25 13:28:31.517704 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2454/4961] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:31 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1486 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:31.552133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-31917a05-f3d3-4d5c-8c4d-80adcdf3e0bf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1683495536"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:31.558165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-31917a05-f3d3-4d5c-8c4d-80adcdf3e0bf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:31.573032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31917a05-f3d3-4d5c-8c4d-80adcdf3e0bf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:31.574544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31917a05-f3d3-4d5c-8c4d-80adcdf3e0bf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:31.575581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31917a05-f3d3-4d5c-8c4d-80adcdf3e0bf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:31.576998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31917a05-f3d3-4d5c-8c4d-80adcdf3e0bf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:31.578020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31917a05-f3d3-4d5c-8c4d-80adcdf3e0bf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:31.578974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31917a05-f3d3-4d5c-8c4d-80adcdf3e0bf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:31.781760 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-31917a05-f3d3-4d5c-8c4d-80adcdf3e0bf tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "PUT /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1059 microversion: 2.1 time: 0.235631 Aug 25 13:28:31.783510 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2508/4962] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Aug 25 13:28:31 2022] PUT /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1059 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:31.822128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2bf66a64-04ca-47d5-aa4f-fe99b95d4bfb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:31.823297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2bf66a64-04ca-47d5-aa4f-fe99b95d4bfb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:31.836733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bf66a64-04ca-47d5-aa4f-fe99b95d4bfb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:31.838896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bf66a64-04ca-47d5-aa4f-fe99b95d4bfb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:31.840022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bf66a64-04ca-47d5-aa4f-fe99b95d4bfb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:31.841652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bf66a64-04ca-47d5-aa4f-fe99b95d4bfb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:31.842825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bf66a64-04ca-47d5-aa4f-fe99b95d4bfb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:31.844892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bf66a64-04ca-47d5-aa4f-fe99b95d4bfb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:32.148770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2bf66a64-04ca-47d5-aa4f-fe99b95d4bfb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:32.167987 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2bf66a64-04ca-47d5-aa4f-fe99b95d4bfb tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1486 microversion: 2.1 time: 0.357834 Aug 25 13:28:32.169897 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2455/4963] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:31 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1486 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:32.213878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c7a24d87-7b28-40e3-8202-f6d3ee6e48d8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:32.215610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c7a24d87-7b28-40e3-8202-f6d3ee6e48d8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:32.234029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7a24d87-7b28-40e3-8202-f6d3ee6e48d8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:32.236243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7a24d87-7b28-40e3-8202-f6d3ee6e48d8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:32.237243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7a24d87-7b28-40e3-8202-f6d3ee6e48d8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:32.238921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7a24d87-7b28-40e3-8202-f6d3ee6e48d8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:32.239898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7a24d87-7b28-40e3-8202-f6d3ee6e48d8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:32.240732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7a24d87-7b28-40e3-8202-f6d3ee6e48d8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:32.599842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c7a24d87-7b28-40e3-8202-f6d3ee6e48d8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:32.618839 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c7a24d87-7b28-40e3-8202-f6d3ee6e48d8 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1486 microversion: 2.1 time: 0.413990 Aug 25 13:28:32.643284 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2509/4964] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:32 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1486 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:32.667682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-69ae8cad-e15f-4129-8005-d124a02775f5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:32.669134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-69ae8cad-e15f-4129-8005-d124a02775f5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:32.684773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69ae8cad-e15f-4129-8005-d124a02775f5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:32.686297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69ae8cad-e15f-4129-8005-d124a02775f5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:32.687498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69ae8cad-e15f-4129-8005-d124a02775f5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:32.689270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69ae8cad-e15f-4129-8005-d124a02775f5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:32.690751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69ae8cad-e15f-4129-8005-d124a02775f5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:32.691917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69ae8cad-e15f-4129-8005-d124a02775f5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:32.763867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-69ae8cad-e15f-4129-8005-d124a02775f5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:28:32.996723 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-69ae8cad-e15f-4129-8005-d124a02775f5 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 204 len: 0 microversion: 2.1 time: 0.337661 Aug 25 13:28:32.998743 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2456/4965] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:32 2022] DELETE /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:28:33.014227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d3fc1daa-76d0-4cf4-b12c-787d7bd09232 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:33.016032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d3fc1daa-76d0-4cf4-b12c-787d7bd09232 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:33.044977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc1daa-76d0-4cf4-b12c-787d7bd09232 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:33.047415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc1daa-76d0-4cf4-b12c-787d7bd09232 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:33.051006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc1daa-76d0-4cf4-b12c-787d7bd09232 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:33.053897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc1daa-76d0-4cf4-b12c-787d7bd09232 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:33.055349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc1daa-76d0-4cf4-b12c-787d7bd09232 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:33.057640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3fc1daa-76d0-4cf4-b12c-787d7bd09232 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:33.395736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d3fc1daa-76d0-4cf4-b12c-787d7bd09232 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:33.427168 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d3fc1daa-76d0-4cf4-b12c-787d7bd09232 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1492 microversion: 2.1 time: 0.416425 Aug 25 13:28:33.429110 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2510/4966] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:33 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1492 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:34.485929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-baf91810-5f1d-49d8-ac4a-127eb952b6df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:34.488411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-baf91810-5f1d-49d8-ac4a-127eb952b6df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:34.526792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baf91810-5f1d-49d8-ac4a-127eb952b6df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:34.531703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baf91810-5f1d-49d8-ac4a-127eb952b6df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:34.535631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baf91810-5f1d-49d8-ac4a-127eb952b6df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:34.559403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baf91810-5f1d-49d8-ac4a-127eb952b6df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:34.569321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baf91810-5f1d-49d8-ac4a-127eb952b6df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:34.570188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baf91810-5f1d-49d8-ac4a-127eb952b6df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:36.065463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-baf91810-5f1d-49d8-ac4a-127eb952b6df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:36.123890 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-baf91810-5f1d-49d8-ac4a-127eb952b6df tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1492 microversion: 2.1 time: 1.653104 Aug 25 13:28:36.131636 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2457/4967] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:34 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1492 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:36.523226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ddab2fd7-3c32-442f-8569-f92fe6f68f58 req-832373ae-76b4-4d1d-b1dc-9153df629e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ff1f1a-61c7-4c52-a109-07e667d81e21", "name": "network-vif-deleted", "tag": "1ec1cdb0-67dd-4396-93a6-782bf701d6b1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:36.585088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ddab2fd7-3c32-442f-8569-f92fe6f68f58 req-832373ae-76b4-4d1d-b1dc-9153df629e4a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:36.586378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ddab2fd7-3c32-442f-8569-f92fe6f68f58 req-832373ae-76b4-4d1d-b1dc-9153df629e4a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:36.588050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ddab2fd7-3c32-442f-8569-f92fe6f68f58 req-832373ae-76b4-4d1d-b1dc-9153df629e4a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:36.597322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:36.627646 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ddab2fd7-3c32-442f-8569-f92fe6f68f58 req-832373ae-76b4-4d1d-b1dc-9153df629e4a service nova] Creating event network-vif-deleted:1ec1cdb0-67dd-4396-93a6-782bf701d6b1 for instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 on n-h2-852771-8 Aug 25 13:28:36.703510 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ddab2fd7-3c32-442f-8569-f92fe6f68f58 req-832373ae-76b4-4d1d-b1dc-9153df629e4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187197 Aug 25 13:28:36.704677 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2511/4968] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:37.192235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:37.193379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:37.234994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:37.235977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:37.236766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:37.238552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:37.239429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:37.240377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:37.343046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:37.344362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:37.345498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:37.349146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lazy-loading 'fault' on Instance uuid b4ff1f1a-61c7-4c52-a109-07e667d81e21 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:28:37.542788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:37.565978 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b582ab9c-9669-4ab5-8eea-438aa056c7db tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 200 len: 1310 microversion: 2.1 time: 0.387232 Aug 25 13:28:37.578175 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2458/4969] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:37 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 1310 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:38.601667 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:28:38.603202 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 13:28:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 (ip 10.222.0.70) !!! Aug 25 13:28:38.609077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4ebafd3d-c903-4e9c-ac5f-79ec748955ed tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:38.615018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:38.616952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:38.623502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ebafd3d-c903-4e9c-ac5f-79ec748955ed tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.624480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ebafd3d-c903-4e9c-ac5f-79ec748955ed tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.625671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ebafd3d-c903-4e9c-ac5f-79ec748955ed tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:38.634978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.636614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.638348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:38.640114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.641395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.669020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:38.676377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4ebafd3d-c903-4e9c-ac5f-79ec748955ed tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Going to try to stop instance {{(pid=129059) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:28:38.715170 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 HTTP/1.1 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b4ff1f1a-61c7-4c52-a109-07e667d81e21'} Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:38.719279 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.726999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:38.726999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:38.726999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:38.726999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:38.726999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:38.726999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.726999 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.733963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:38.737066 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5433306b-cbdd-450b-b9c2-0d70b237812c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 404 len: 111 microversion: 2.1 time: 0.139647 Aug 25 13:28:38.739606 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2512/4970] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:38 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:38.786175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:38.788394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:38.804541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.808175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.809343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:38.811543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.814597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.815986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:38.856404 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.856801 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4ebafd3d-c903-4e9c-ac5f-79ec748955ed tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/action" status: 202 len: 0 microversion: 2.1 time: 0.255675 Aug 25 13:28:38.858013 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2459/4971] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:28:38 2022] POST /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 HTTP/1.1 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b4ff1f1a-61c7-4c52-a109-07e667d81e21'} Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:38.861637 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.870899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.870899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:38.870899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.870899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:38.870899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:38.870899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:38.870899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:38.870899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:38.870899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.870899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.883117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:38.886807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de6ab471-3a22-4d0f-982b-62f1782ac0d8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:38.888561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-de6ab471-3a22-4d0f-982b-62f1782ac0d8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:38.893998 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-caa3c839-858b-4352-bbcc-f1ca46879f62 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 404 len: 111 microversion: 2.1 time: 0.124300 Aug 25 13:28:38.895549 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2513/4972] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:38 2022] DELETE /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:28:38.907864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de6ab471-3a22-4d0f-982b-62f1782ac0d8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.909534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de6ab471-3a22-4d0f-982b-62f1782ac0d8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.910766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de6ab471-3a22-4d0f-982b-62f1782ac0d8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:38.912601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de6ab471-3a22-4d0f-982b-62f1782ac0d8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.912868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:38.914586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de6ab471-3a22-4d0f-982b-62f1782ac0d8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.915908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: b4ff1f1a-61c7-4c52-a109-07e667d81e21] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:38.917033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de6ab471-3a22-4d0f-982b-62f1782ac0d8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:38.928999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.930455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.931267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:38.933844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.935092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.936115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:38.976225 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 HTTP/1.1 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'b4ff1f1a-61c7-4c52-a109-07e667d81e21'} Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:38.981369 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.995206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:38.995206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:38.995206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:38.995206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:38.995206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:38.995206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. Aug 25 13:28:38.995206 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:38.995206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance b4ff1f1a-61c7-4c52-a109-07e667d81e21 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:38.995206 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7f7f6a5d-8faa-48d9-aa01-c102a687e688 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21" status: 404 len: 111 microversion: 2.1 time: 0.080383 Aug 25 13:28:38.995206 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2514/4973] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:38 2022] GET /compute/v2.1/servers/b4ff1f1a-61c7-4c52-a109-07e667d81e21 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:39.006967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.008076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.037067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.038048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.039124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.041701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.043006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.044121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.082089 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 HTTP/1.1 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '87965976-52e5-4b4b-b38f-ef76c2abdea6'} Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:39.088326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:28:39.095181 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.095181 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.095181 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.095181 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.095181 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.095181 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.095181 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:39.095181 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:39.095181 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:28:39.095181 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.099577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:39.101309 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff89a1a3-3fd4-4622-8ef8-38cf87c15c7e tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 404 len: 111 microversion: 2.1 time: 0.102361 Aug 25 13:28:39.103798 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2515/4974] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:38 2022] DELETE /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:39.118686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.120145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 87965976-52e5-4b4b-b38f-ef76c2abdea6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.133205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.134594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.135828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.137552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.138790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.140092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.191821 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 HTTP/1.1 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '87965976-52e5-4b4b-b38f-ef76c2abdea6'} Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.197088 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.204306 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.204306 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.204306 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.204306 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:39.204306 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:39.204306 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. Aug 25 13:28:39.204306 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.209149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 87965976-52e5-4b4b-b38f-ef76c2abdea6 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:39.212285 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e520e62-6d6d-46b5-9d0a-62dd9bf5257b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6" status: 404 len: 111 microversion: 2.1 time: 0.101022 Aug 25 13:28:39.215750 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2516/4975] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:39 2022] GET /compute/v2.1/servers/87965976-52e5-4b4b-b38f-ef76c2abdea6 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:39.235374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.236184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.272539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.274003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.275890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.277498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.278463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.279281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.320320 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e HTTP/1.1 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '232781de-33b4-4703-a5bd-679682200c7e'} Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:39.323850 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e96673d-ffdb-478a-83e3-5a9e650a81c7 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 404 len: 111 microversion: 2.1 time: 0.105139 Aug 25 13:28:39.333286 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2517/4976] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:39 2022] DELETE /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:39.363181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.366331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 232781de-33b4-4703-a5bd-679682200c7e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.380926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.382168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.383131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.384692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.385882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.386797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.420735 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e HTTP/1.1 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '232781de-33b4-4703-a5bd-679682200c7e'} Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.424326 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.433645 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.433645 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.433645 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.433645 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:39.433645 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:39.433645 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. Aug 25 13:28:39.433645 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.433645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 232781de-33b4-4703-a5bd-679682200c7e could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:39.433645 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b9b9014-b580-4313-8e4e-c6cb70cb0d14 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e" status: 404 len: 111 microversion: 2.1 time: 0.084241 Aug 25 13:28:39.435210 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2518/4977] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:39 2022] GET /compute/v2.1/servers/232781de-33b4-4703-a5bd-679682200c7e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:39.454511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.455691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.476693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.478470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.479081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.481599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.483146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.484269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.490338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-de6ab471-3a22-4d0f-982b-62f1782ac0d8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:39.521989 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-de6ab471-3a22-4d0f-982b-62f1782ac0d8 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1677 microversion: 2.1 time: 0.645880 Aug 25 13:28:39.524850 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2460/4978] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:38 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1677 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:39.539030 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c HTTP/1.1 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'e63b2d77-0fb6-49ad-9466-0a8200df0e4c'} Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:39.544691 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:28:39.550822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.550822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.550822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.550822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.550822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.550822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.550822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:39.550822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:39.550822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:28:39.550822 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.557786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:39.559609 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-603bb285-db8f-455c-bd06-21b2dd29a6e6 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 404 len: 111 microversion: 2.1 time: 0.118273 Aug 25 13:28:39.565753 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2519/4979] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:39 2022] DELETE /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:39.577465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.579457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: e63b2d77-0fb6-49ad-9466-0a8200df0e4c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.594294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.595618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.597248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.599323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.600823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.604290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.635488 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c HTTP/1.1 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'e63b2d77-0fb6-49ad-9466-0a8200df0e4c'} Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.640231 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.647910 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.647910 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.647910 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.647910 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:39.647910 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:39.647910 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. Aug 25 13:28:39.647910 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.647910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance e63b2d77-0fb6-49ad-9466-0a8200df0e4c could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:39.647910 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f24117e2-a729-4c70-859e-e5b31c01eb3b tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c" status: 404 len: 111 microversion: 2.1 time: 0.074568 Aug 25 13:28:39.647910 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2461/4980] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:39 2022] GET /compute/v2.1/servers/e63b2d77-0fb6-49ad-9466-0a8200df0e4c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:39.664098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.666859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.683954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.685395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.686708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.688603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.689945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.691063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.724388 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 HTTP/1.1 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '185a4db0-4145-4faa-8542-357606e516d7'} Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:39.728423 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.734515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:39.737842 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-76544d9c-d370-4d1e-a38b-758bf032f760 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 404 len: 111 microversion: 2.1 time: 0.083065 Aug 25 13:28:39.739832 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2520/4981] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:39 2022] DELETE /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:39.754797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.756768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 185a4db0-4145-4faa-8542-357606e516d7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.779216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.780986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.782278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.783995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.785244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.786516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.824464 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 HTTP/1.1 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '185a4db0-4145-4faa-8542-357606e516d7'} Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.828213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.838021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.838021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.838021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.838021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:39.838021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:39.838021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. Aug 25 13:28:39.838021 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.838021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 185a4db0-4145-4faa-8542-357606e516d7 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:39.838021 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b064e43c-15c7-4cc5-8827-4a5abc064426 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7" status: 404 len: 111 microversion: 2.1 time: 0.085006 Aug 25 13:28:39.839406 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2462/4982] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:39 2022] GET /compute/v2.1/servers/185a4db0-4145-4faa-8542-357606e516d7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:39.850876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.852383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.869039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.870646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.872192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.874027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.875356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.876433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.926477 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad HTTP/1.1 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '791bf70b-d95d-4584-9f3d-0c74e3a206ad'} Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:39.931564 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:28:39.938840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.938840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.938840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.938840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.938840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.938840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.938840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:39.938840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:39.938840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:28:39.938840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.940561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:39.945664 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ec2afb2f-bd82-46ed-bb12-874d0d3000ad tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 404 len: 111 microversion: 2.1 time: 0.099514 Aug 25 13:28:39.954217 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2521/4983] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:39 2022] DELETE /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:28:39.962469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.964545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 791bf70b-d95d-4584-9f3d-0c74e3a206ad] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.977325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.978255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.979073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.980433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.981705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.982589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:40.064722 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad HTTP/1.1 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '791bf70b-d95d-4584-9f3d-0c74e3a206ad'} Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:40.075724 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.083441 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:40.083441 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:40.083441 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:40.083441 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:40.083441 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:40.083441 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. Aug 25 13:28:40.083441 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.083441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 791bf70b-d95d-4584-9f3d-0c74e3a206ad could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:40.083441 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-27372e98-33b7-4171-a2c3-4a0a8f4818ba tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad" status: 404 len: 111 microversion: 2.1 time: 0.124827 Aug 25 13:28:40.083441 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2463/4984] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:39 2022] GET /compute/v2.1/servers/791bf70b-d95d-4584-9f3d-0c74e3a206ad => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:28:40.100291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab645782-9059-4548-aaa7-a9246a9055aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:40.106033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ab645782-9059-4548-aaa7-a9246a9055aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:40.135381 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ab645782-9059-4548-aaa7-a9246a9055aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab645782-9059-4548-aaa7-a9246a9055aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc HTTP/1.1 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc'} Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:40.142606 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.150510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:40.150510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:40.150510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:40.150510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:40.150510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:40.150510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:28:40.150510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.150510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab645782-9059-4548-aaa7-a9246a9055aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:40.150510 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ab645782-9059-4548-aaa7-a9246a9055aa tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc" status: 404 len: 111 microversion: 2.1 time: 0.058059 Aug 25 13:28:40.150510 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2522/4985] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:40 2022] DELETE /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:40.166140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e79f0eb8-6f21-428c-8433-fdef1f65a537 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:40.168486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e79f0eb8-6f21-428c-8433-fdef1f65a537 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:40.180308 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-e79f0eb8-6f21-428c-8433-fdef1f65a537 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e79f0eb8-6f21-428c-8433-fdef1f65a537 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc HTTP/1.1 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc'} Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:40.184462 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:40.191202 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:40.191202 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:40.191202 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:40.191202 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. Aug 25 13:28:40.191202 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:40.194876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e79f0eb8-6f21-428c-8433-fdef1f65a537 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:40.198039 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e79f0eb8-6f21-428c-8433-fdef1f65a537 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc" status: 404 len: 111 microversion: 2.1 time: 0.041232 Aug 25 13:28:40.206271 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2464/4986] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:40 2022] GET /compute/v2.1/servers/f3a3a55a-e6c8-4c8c-9c68-0cb59e225fcc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:40.216458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2864e2ac-d46e-40fa-b2de-ddd0a0fae9fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:40.217354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2864e2ac-d46e-40fa-b2de-ddd0a0fae9fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:40.240663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2864e2ac-d46e-40fa-b2de-ddd0a0fae9fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:40.241684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2864e2ac-d46e-40fa-b2de-ddd0a0fae9fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:40.242489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2864e2ac-d46e-40fa-b2de-ddd0a0fae9fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:40.244476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2864e2ac-d46e-40fa-b2de-ddd0a0fae9fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:40.245342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2864e2ac-d46e-40fa-b2de-ddd0a0fae9fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:40.246194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2864e2ac-d46e-40fa-b2de-ddd0a0fae9fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:40.339403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2864e2ac-d46e-40fa-b2de-ddd0a0fae9fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:28:40.578389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9bcf67c4-5b93-494e-9210-1950e8de104c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:40.580243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9bcf67c4-5b93-494e-9210-1950e8de104c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:40.614212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9bcf67c4-5b93-494e-9210-1950e8de104c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:40.621020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9bcf67c4-5b93-494e-9210-1950e8de104c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:40.628222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9bcf67c4-5b93-494e-9210-1950e8de104c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:40.641266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9bcf67c4-5b93-494e-9210-1950e8de104c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:40.665537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9bcf67c4-5b93-494e-9210-1950e8de104c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:40.671774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9bcf67c4-5b93-494e-9210-1950e8de104c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:40.736368 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2864e2ac-d46e-40fa-b2de-ddd0a0fae9fc tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "DELETE /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 204 len: 0 microversion: 2.1 time: 0.528138 Aug 25 13:28:40.739030 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2523/4987] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:40 2022] DELETE /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:28:40.774446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a2bfd0b-a9b2-4dee-a29a-77152a9be667 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:40.775694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a2bfd0b-a9b2-4dee-a29a-77152a9be667 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:40.813769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a2bfd0b-a9b2-4dee-a29a-77152a9be667 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:40.814911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a2bfd0b-a9b2-4dee-a29a-77152a9be667 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:40.815549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a2bfd0b-a9b2-4dee-a29a-77152a9be667 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:40.816887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a2bfd0b-a9b2-4dee-a29a-77152a9be667 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:40.818151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a2bfd0b-a9b2-4dee-a29a-77152a9be667 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:40.818579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a2bfd0b-a9b2-4dee-a29a-77152a9be667 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:41.347320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9bcf67c4-5b93-494e-9210-1950e8de104c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:41.374750 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9bcf67c4-5b93-494e-9210-1950e8de104c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1677 microversion: 2.1 time: 0.809596 Aug 25 13:28:41.390728 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2465/4988] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:40 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1677 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:41.491548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a2bfd0b-a9b2-4dee-a29a-77152a9be667 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:41.529257 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a2bfd0b-a9b2-4dee-a29a-77152a9be667 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1477 microversion: 2.1 time: 0.779893 Aug 25 13:28:41.530172 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2524/4989] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:40 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1477 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:41.689248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-85b68b40-aa2a-43a4-a85b-bc1454e91513 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:41.690708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-85b68b40-aa2a-43a4-a85b-bc1454e91513 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:41.708008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b68b40-aa2a-43a4-a85b-bc1454e91513 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:41.709127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b68b40-aa2a-43a4-a85b-bc1454e91513 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:41.710129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b68b40-aa2a-43a4-a85b-bc1454e91513 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:41.712860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b68b40-aa2a-43a4-a85b-bc1454e91513 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:41.713956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b68b40-aa2a-43a4-a85b-bc1454e91513 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:41.714921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b68b40-aa2a-43a4-a85b-bc1454e91513 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:41.959061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-85b68b40-aa2a-43a4-a85b-bc1454e91513 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lazy-loading 'services' on Instance uuid 991f22c6-27c5-471a-b485-90f6ea7d9fcc {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:28:42.151854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:42.174856 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-85b68b40-aa2a-43a4-a85b-bc1454e91513 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "DELETE /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments/5b2af833-7761-4029-9d55-ce3747b34cfa" status: 202 len: 0 microversion: 2.1 time: 0.495813 Aug 25 13:28:42.176361 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2466/4990] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:28:41 2022] DELETE /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments/5b2af833-7761-4029-9d55-ce3747b34cfa => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:28:42.189422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e38588c-1f8d-4852-82d2-3824f5842e0d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:42.195441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6e38588c-1f8d-4852-82d2-3824f5842e0d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:42.213187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e38588c-1f8d-4852-82d2-3824f5842e0d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:42.214668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e38588c-1f8d-4852-82d2-3824f5842e0d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:42.215897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e38588c-1f8d-4852-82d2-3824f5842e0d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:42.218545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e38588c-1f8d-4852-82d2-3824f5842e0d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:42.220199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e38588c-1f8d-4852-82d2-3824f5842e0d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:42.221560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e38588c-1f8d-4852-82d2-3824f5842e0d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:42.318774 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e38588c-1f8d-4852-82d2-3824f5842e0d tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134595 Aug 25 13:28:42.320790 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2525/4991] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:42 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:42.434508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b84dbb1-1259-4b90-8e90-fedd7e4c1d80 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:42.435967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b84dbb1-1259-4b90-8e90-fedd7e4c1d80 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:42.459972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:42.482685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b84dbb1-1259-4b90-8e90-fedd7e4c1d80 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:42.483572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b84dbb1-1259-4b90-8e90-fedd7e4c1d80 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:42.496239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b84dbb1-1259-4b90-8e90-fedd7e4c1d80 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:42.498637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b84dbb1-1259-4b90-8e90-fedd7e4c1d80 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:42.499537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b84dbb1-1259-4b90-8e90-fedd7e4c1d80 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:42.505643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b84dbb1-1259-4b90-8e90-fedd7e4c1d80 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:42.578242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22990979-e72d-47f8-8d02-bf47d1a1b781 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:42.582951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-22990979-e72d-47f8-8d02-bf47d1a1b781 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:42.638883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22990979-e72d-47f8-8d02-bf47d1a1b781 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:42.641473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22990979-e72d-47f8-8d02-bf47d1a1b781 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:42.643021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22990979-e72d-47f8-8d02-bf47d1a1b781 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:42.654088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22990979-e72d-47f8-8d02-bf47d1a1b781 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:42.655527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22990979-e72d-47f8-8d02-bf47d1a1b781 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:42.658545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22990979-e72d-47f8-8d02-bf47d1a1b781 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:43.363164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b84dbb1-1259-4b90-8e90-fedd7e4c1d80 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:43.392784 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b84dbb1-1259-4b90-8e90-fedd7e4c1d80 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1677 microversion: 2.1 time: 0.969171 Aug 25 13:28:43.393898 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2467/4992] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:42 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1677 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:43.406024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d11ceae-4139-4931-a18e-8104d6434aa8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:43.413567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d11ceae-4139-4931-a18e-8104d6434aa8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:43.429937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d11ceae-4139-4931-a18e-8104d6434aa8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:43.432119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d11ceae-4139-4931-a18e-8104d6434aa8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:43.433848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d11ceae-4139-4931-a18e-8104d6434aa8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:43.435485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d11ceae-4139-4931-a18e-8104d6434aa8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:43.436584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d11ceae-4139-4931-a18e-8104d6434aa8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:43.440461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d11ceae-4139-4931-a18e-8104d6434aa8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:43.533580 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d11ceae-4139-4931-a18e-8104d6434aa8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137263 Aug 25 13:28:43.535366 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2468/4993] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:43 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:43.581685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-22990979-e72d-47f8-8d02-bf47d1a1b781 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:43.612721 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22990979-e72d-47f8-8d02-bf47d1a1b781 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1477 microversion: 2.1 time: 1.043946 Aug 25 13:28:43.614502 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2526/4994] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:42 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1477 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:44.052923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9c45a691-0ac5-4490-8e4b-3715fb4ccfbc req-9ea25df9-d1ea-4d54-aa3d-6e0f5559c6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75342af0-aaf7-41c7-8c05-1a93f39b83e2", "name": "network-vif-deleted", "tag": "26cc3030-b525-49ff-8d18-dd81eeb20455"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:44.089806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9c45a691-0ac5-4490-8e4b-3715fb4ccfbc req-9ea25df9-d1ea-4d54-aa3d-6e0f5559c6df service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:44.091351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9c45a691-0ac5-4490-8e4b-3715fb4ccfbc req-9ea25df9-d1ea-4d54-aa3d-6e0f5559c6df service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:44.092418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9c45a691-0ac5-4490-8e4b-3715fb4ccfbc req-9ea25df9-d1ea-4d54-aa3d-6e0f5559c6df service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:44.122784 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9c45a691-0ac5-4490-8e4b-3715fb4ccfbc req-9ea25df9-d1ea-4d54-aa3d-6e0f5559c6df service nova] Creating event network-vif-deleted:26cc3030-b525-49ff-8d18-dd81eeb20455 for instance 75342af0-aaf7-41c7-8c05-1a93f39b83e2 on n-h2-852771-8 Aug 25 13:28:44.136864 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9c45a691-0ac5-4490-8e4b-3715fb4ccfbc req-9ea25df9-d1ea-4d54-aa3d-6e0f5559c6df service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096855 Aug 25 13:28:44.138931 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2469/4995] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:44.444137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c0a74c8-c3df-4fdc-8cfd-ed45747476de tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:44.447833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5c0a74c8-c3df-4fdc-8cfd-ed45747476de tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:44.480715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c0a74c8-c3df-4fdc-8cfd-ed45747476de tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:44.482399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c0a74c8-c3df-4fdc-8cfd-ed45747476de tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:44.483703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c0a74c8-c3df-4fdc-8cfd-ed45747476de tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:44.485551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c0a74c8-c3df-4fdc-8cfd-ed45747476de tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:44.486861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c0a74c8-c3df-4fdc-8cfd-ed45747476de tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:44.493994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c0a74c8-c3df-4fdc-8cfd-ed45747476de tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:44.558046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b4145581-9004-49b2-830c-bc87546b06d0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:44.589897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b4145581-9004-49b2-830c-bc87546b06d0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:44.631801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4145581-9004-49b2-830c-bc87546b06d0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:44.640551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4145581-9004-49b2-830c-bc87546b06d0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:44.650381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4145581-9004-49b2-830c-bc87546b06d0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:44.657309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4145581-9004-49b2-830c-bc87546b06d0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:44.660591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4145581-9004-49b2-830c-bc87546b06d0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:44.667373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4145581-9004-49b2-830c-bc87546b06d0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:44.812005 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b4145581-9004-49b2-830c-bc87546b06d0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.261316 Aug 25 13:28:44.818576 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2470/4996] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:44 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:44.846325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:44.847824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:44.875562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:44.876534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:44.892435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:44.898734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:44.906010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:44.909876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:45.087149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:45.092708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:45.094001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:45.095118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lazy-loading 'fault' on Instance uuid 75342af0-aaf7-41c7-8c05-1a93f39b83e2 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:28:45.154628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5c0a74c8-c3df-4fdc-8cfd-ed45747476de tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:45.197566 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c0a74c8-c3df-4fdc-8cfd-ed45747476de tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1677 microversion: 2.1 time: 0.763202 Aug 25 13:28:45.213834 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2527/4997] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:44 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1677 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:45.835190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1bbeb4d8-fefe-42bd-8594-d8ece663a454 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:45.840443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1bbeb4d8-fefe-42bd-8594-d8ece663a454 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:45.885248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bbeb4d8-fefe-42bd-8594-d8ece663a454 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:45.886382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bbeb4d8-fefe-42bd-8594-d8ece663a454 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:45.892784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bbeb4d8-fefe-42bd-8594-d8ece663a454 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:45.894374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bbeb4d8-fefe-42bd-8594-d8ece663a454 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:45.895353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bbeb4d8-fefe-42bd-8594-d8ece663a454 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:45.895842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bbeb4d8-fefe-42bd-8594-d8ece663a454 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:45.939413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b1570a27f4ea8ad560ce25225cf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e71be67bf4de1aee8c6c6f8aee723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:45.970442 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a8422c6c-92e6-44a0-9581-827a6341b356 tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 200 len: 1282 microversion: 2.1 time: 1.149641 Aug 25 13:28:45.971494 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2471/4998] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:44 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 1282 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:46.049041 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1bbeb4d8-fefe-42bd-8594-d8ece663a454 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219612 Aug 25 13:28:46.051265 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2528/4999] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:45 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:28:46.249947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ac16a22-1b83-4418-a2db-d9d8f195a0d1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:46.251150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9ac16a22-1b83-4418-a2db-d9d8f195a0d1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:46.293970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ac16a22-1b83-4418-a2db-d9d8f195a0d1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:46.294940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ac16a22-1b83-4418-a2db-d9d8f195a0d1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:46.295875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ac16a22-1b83-4418-a2db-d9d8f195a0d1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:46.299682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ac16a22-1b83-4418-a2db-d9d8f195a0d1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:46.300633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ac16a22-1b83-4418-a2db-d9d8f195a0d1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:46.301799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ac16a22-1b83-4418-a2db-d9d8f195a0d1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:46.667231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9ac16a22-1b83-4418-a2db-d9d8f195a0d1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:46.697012 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9ac16a22-1b83-4418-a2db-d9d8f195a0d1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1677 microversion: 2.1 time: 0.459175 Aug 25 13:28:46.698586 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2472/5000] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:46 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1677 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:47.036948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:47.038064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] [instance: 75342af0-aaf7-41c7-8c05-1a93f39b83e2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:47.046950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:47.067319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:47.068291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:47.069154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:47.070631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:47.072424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:47.073008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:47.074380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f2986ebe-7e97-4beb-9ff1-764136721750 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:47.078912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f2986ebe-7e97-4beb-9ff1-764136721750 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:47.091364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2986ebe-7e97-4beb-9ff1-764136721750 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:47.092662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2986ebe-7e97-4beb-9ff1-764136721750 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:47.093788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2986ebe-7e97-4beb-9ff1-764136721750 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:47.095435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2986ebe-7e97-4beb-9ff1-764136721750 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:47.096623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2986ebe-7e97-4beb-9ff1-764136721750 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:47.097692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2986ebe-7e97-4beb-9ff1-764136721750 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:47.134973 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] HTTP exception thrown: Instance 75342af0-aaf7-41c7-8c05-1a93f39b83e2 could not be found. Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Request method failure captured: Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 HTTP/1.1 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fqdnSq7KmZGs1CdOreZJ8r-syjZiu1RiSE-qly8StBFq_5yZmzHUhIeHMuHomGmkH6pg0dDueBwMcl9_s4yfu9QiZ0LNVmYETI6wn1PdobmLl0xcatmE4r7Oso-LPw8Rwht4ZsFgjVIeS6PLGH-NHj6Wdw-j4bwh0Eqbtgx9sj4e4 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f18e71be67bf4de1aee8c6c6f8aee723", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f18e71be67bf4de1aee8c6c6f8aee723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f18e71be67bf4de1aee8c6c6f8aee723"}]}] Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersTestJSON-1544537968 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f18e71be67bf4de1aee8c6c6f8aee723 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersTestJSON-1544537968 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: bd7b1570a27f4ea8ad560ce25225cf02 Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersTestJSON-1544537968-project Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 75342af0-aaf7-41c7-8c05-1a93f39b83e2 could not be found. Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '75342af0-aaf7-41c7-8c05-1a93f39b83e2'} Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75342af0-aaf7-41c7-8c05-1a93f39b83e2 could not be found. Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75342af0-aaf7-41c7-8c05-1a93f39b83e2 could not be found. Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:47.142135 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:47.154764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:47.154764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:47.154764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:47.154764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:47.154764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:47.154764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75342af0-aaf7-41c7-8c05-1a93f39b83e2 could not be found. Aug 25 13:28:47.154764 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:47.154764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] Returning 404 to user: Instance 75342af0-aaf7-41c7-8c05-1a93f39b83e2 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:47.157482 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b390ca99-2c46-4fee-bd3d-264276e7b80c tempest-ServersTestJSON-1544537968 tempest-ServersTestJSON-1544537968-project] 10.222.0.70 "GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2" status: 404 len: 111 microversion: 2.1 time: 0.143806 Aug 25 13:28:47.159806 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2529/5001] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:47 2022] GET /compute/v2.1/servers/75342af0-aaf7-41c7-8c05-1a93f39b83e2 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:47.186265 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f2986ebe-7e97-4beb-9ff1-764136721750 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119722 Aug 25 13:28:47.187762 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2473/5002] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:47 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:28:47.741445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b14e300d-44f0-42b5-ac2f-d091fba79630 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:47.755029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b14e300d-44f0-42b5-ac2f-d091fba79630 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:47.767542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b14e300d-44f0-42b5-ac2f-d091fba79630 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:47.768475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b14e300d-44f0-42b5-ac2f-d091fba79630 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:47.782020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b14e300d-44f0-42b5-ac2f-d091fba79630 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:47.783538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b14e300d-44f0-42b5-ac2f-d091fba79630 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:47.784435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b14e300d-44f0-42b5-ac2f-d091fba79630 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:47.785262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b14e300d-44f0-42b5-ac2f-d091fba79630 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:48.208692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7cf4aca9-9419-4805-8eb7-8896afe0f8bd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:48.241841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7cf4aca9-9419-4805-8eb7-8896afe0f8bd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:48.276304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf4aca9-9419-4805-8eb7-8896afe0f8bd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:48.277567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf4aca9-9419-4805-8eb7-8896afe0f8bd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:48.285375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf4aca9-9419-4805-8eb7-8896afe0f8bd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:48.287188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf4aca9-9419-4805-8eb7-8896afe0f8bd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:48.288356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf4aca9-9419-4805-8eb7-8896afe0f8bd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:48.289477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7cf4aca9-9419-4805-8eb7-8896afe0f8bd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:48.442985 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7cf4aca9-9419-4805-8eb7-8896afe0f8bd tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.241843 Aug 25 13:28:48.454017 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2474/5003] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:48 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:28:49.232104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b14e300d-44f0-42b5-ac2f-d091fba79630 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:49.263223 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b14e300d-44f0-42b5-ac2f-d091fba79630 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1677 microversion: 2.1 time: 1.527779 Aug 25 13:28:49.280228 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2530/5004] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:47 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1677 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:49.472196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aec0523f-aec8-48ad-9d5e-e9d79837b4f1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:49.485489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aec0523f-aec8-48ad-9d5e-e9d79837b4f1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:49.515477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aec0523f-aec8-48ad-9d5e-e9d79837b4f1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:49.517549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aec0523f-aec8-48ad-9d5e-e9d79837b4f1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:49.518518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aec0523f-aec8-48ad-9d5e-e9d79837b4f1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:49.520268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aec0523f-aec8-48ad-9d5e-e9d79837b4f1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:49.525633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aec0523f-aec8-48ad-9d5e-e9d79837b4f1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:49.526962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aec0523f-aec8-48ad-9d5e-e9d79837b4f1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:49.623773 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aec0523f-aec8-48ad-9d5e-e9d79837b4f1 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162637 Aug 25 13:28:49.625155 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2475/5005] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:49 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:50.315938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62aa800e-12e8-4359-9258-c0a0cf73e6f0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:50.326402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-62aa800e-12e8-4359-9258-c0a0cf73e6f0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:50.353850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62aa800e-12e8-4359-9258-c0a0cf73e6f0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:50.355389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62aa800e-12e8-4359-9258-c0a0cf73e6f0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:50.356565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62aa800e-12e8-4359-9258-c0a0cf73e6f0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:50.358324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62aa800e-12e8-4359-9258-c0a0cf73e6f0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:50.361747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62aa800e-12e8-4359-9258-c0a0cf73e6f0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:50.363062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62aa800e-12e8-4359-9258-c0a0cf73e6f0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:50.684577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f3a0e48-4b1d-4323-80cb-2c1219a3d444 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:50.698929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f3a0e48-4b1d-4323-80cb-2c1219a3d444 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:50.734532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3a0e48-4b1d-4323-80cb-2c1219a3d444 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:50.735356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3a0e48-4b1d-4323-80cb-2c1219a3d444 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:50.736098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3a0e48-4b1d-4323-80cb-2c1219a3d444 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:50.743531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3a0e48-4b1d-4323-80cb-2c1219a3d444 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:50.747059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3a0e48-4b1d-4323-80cb-2c1219a3d444 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:50.752388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f3a0e48-4b1d-4323-80cb-2c1219a3d444 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:50.906410 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f3a0e48-4b1d-4323-80cb-2c1219a3d444 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.268459 Aug 25 13:28:50.911379 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2476/5006] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:50 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:50.974401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62aa800e-12e8-4359-9258-c0a0cf73e6f0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:51.006145 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-62aa800e-12e8-4359-9258-c0a0cf73e6f0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1654 microversion: 2.1 time: 0.697250 Aug 25 13:28:51.008222 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2531/5007] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:50 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1654 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:51.052190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a29a728-bccc-4b7b-b737-a1d41f0cc07b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:51.077947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a29a728-bccc-4b7b-b737-a1d41f0cc07b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:51.078790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a29a728-bccc-4b7b-b737-a1d41f0cc07b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:51.079599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a29a728-bccc-4b7b-b737-a1d41f0cc07b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:51.179892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a29a728-bccc-4b7b-b737-a1d41f0cc07b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Going to try to start instance {{(pid=129059) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 13:28:51.325578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a29a728-bccc-4b7b-b737-a1d41f0cc07b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/action" status: 202 len: 0 microversion: 2.1 time: 0.285559 Aug 25 13:28:51.328845 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2477/5008] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:28:51 2022] POST /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:28:51.350242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-511836fa-0bc3-4772-9069-0fbcb9203fec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:51.353733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-511836fa-0bc3-4772-9069-0fbcb9203fec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:51.387487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-511836fa-0bc3-4772-9069-0fbcb9203fec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:51.388869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-511836fa-0bc3-4772-9069-0fbcb9203fec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:51.389624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-511836fa-0bc3-4772-9069-0fbcb9203fec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:51.390947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-511836fa-0bc3-4772-9069-0fbcb9203fec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:51.391817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-511836fa-0bc3-4772-9069-0fbcb9203fec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:51.392584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-511836fa-0bc3-4772-9069-0fbcb9203fec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:51.937092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7be70eec-7897-4519-87d2-de4becef4451 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:51.945164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7be70eec-7897-4519-87d2-de4becef4451 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:51.983315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be70eec-7897-4519-87d2-de4becef4451 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:51.984855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be70eec-7897-4519-87d2-de4becef4451 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:51.986199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be70eec-7897-4519-87d2-de4becef4451 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:51.990974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be70eec-7897-4519-87d2-de4becef4451 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:51.994808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be70eec-7897-4519-87d2-de4becef4451 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:51.996800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be70eec-7897-4519-87d2-de4becef4451 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:52.192861 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7be70eec-7897-4519-87d2-de4becef4451 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.244422 Aug 25 13:28:52.210724 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2478/5009] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:51 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:52.910934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-511836fa-0bc3-4772-9069-0fbcb9203fec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:52.943995 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-511836fa-0bc3-4772-9069-0fbcb9203fec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1663 microversion: 2.1 time: 1.608632 Aug 25 13:28:52.954896 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2532/5010] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:51 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1663 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:53.224127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-13608396-5b9d-4c34-b76a-9d27e8e3ab50 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:53.228822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-13608396-5b9d-4c34-b76a-9d27e8e3ab50 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:53.254634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13608396-5b9d-4c34-b76a-9d27e8e3ab50 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:53.258140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13608396-5b9d-4c34-b76a-9d27e8e3ab50 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:53.259447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13608396-5b9d-4c34-b76a-9d27e8e3ab50 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:53.260819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13608396-5b9d-4c34-b76a-9d27e8e3ab50 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:53.261734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13608396-5b9d-4c34-b76a-9d27e8e3ab50 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:53.262551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13608396-5b9d-4c34-b76a-9d27e8e3ab50 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:53.359429 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-13608396-5b9d-4c34-b76a-9d27e8e3ab50 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152959 Aug 25 13:28:53.368450 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2479/5011] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:53 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:53.999416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66e5815e-a812-4395-802a-892c960049a3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:54.003129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66e5815e-a812-4395-802a-892c960049a3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:54.040346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66e5815e-a812-4395-802a-892c960049a3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:54.043538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66e5815e-a812-4395-802a-892c960049a3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:54.046041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66e5815e-a812-4395-802a-892c960049a3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:54.050671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66e5815e-a812-4395-802a-892c960049a3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:54.057759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66e5815e-a812-4395-802a-892c960049a3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:54.060075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66e5815e-a812-4395-802a-892c960049a3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:54.395529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ad1b09e0-96c3-409a-8373-ec4dee1055af tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:54.401845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ad1b09e0-96c3-409a-8373-ec4dee1055af tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:54.415156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad1b09e0-96c3-409a-8373-ec4dee1055af tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:54.418022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad1b09e0-96c3-409a-8373-ec4dee1055af tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:54.419404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad1b09e0-96c3-409a-8373-ec4dee1055af tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:54.421124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad1b09e0-96c3-409a-8373-ec4dee1055af tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:54.422882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad1b09e0-96c3-409a-8373-ec4dee1055af tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:54.424216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad1b09e0-96c3-409a-8373-ec4dee1055af tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:54.578639 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ad1b09e0-96c3-409a-8373-ec4dee1055af tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201483 Aug 25 13:28:54.584429 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2480/5012] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:54 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:54.638986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-66e5815e-a812-4395-802a-892c960049a3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:54.683032 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66e5815e-a812-4395-802a-892c960049a3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1663 microversion: 2.1 time: 0.691676 Aug 25 13:28:54.684973 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2533/5013] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:53 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1663 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:55.603940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0ca16277-70e9-4b6d-a3c3-23238916ce6a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:55.607894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ca16277-70e9-4b6d-a3c3-23238916ce6a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:55.660690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ca16277-70e9-4b6d-a3c3-23238916ce6a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:55.661573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ca16277-70e9-4b6d-a3c3-23238916ce6a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:55.662458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ca16277-70e9-4b6d-a3c3-23238916ce6a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:55.663919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ca16277-70e9-4b6d-a3c3-23238916ce6a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:55.665445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ca16277-70e9-4b6d-a3c3-23238916ce6a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:55.683118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ca16277-70e9-4b6d-a3c3-23238916ce6a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:55.732161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-49de9904-6763-4c3b-867a-ecf5e899af3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:55.733287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-49de9904-6763-4c3b-867a-ecf5e899af3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:55.791910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49de9904-6763-4c3b-867a-ecf5e899af3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:55.792819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49de9904-6763-4c3b-867a-ecf5e899af3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:55.797827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49de9904-6763-4c3b-867a-ecf5e899af3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:55.799422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49de9904-6763-4c3b-867a-ecf5e899af3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:55.800327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49de9904-6763-4c3b-867a-ecf5e899af3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:55.801147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49de9904-6763-4c3b-867a-ecf5e899af3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:55.888310 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0ca16277-70e9-4b6d-a3c3-23238916ce6a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.291661 Aug 25 13:28:55.894686 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2481/5014] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:55 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 197 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:56.471268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-49de9904-6763-4c3b-867a-ecf5e899af3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:56.499314 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-49de9904-6763-4c3b-867a-ecf5e899af3d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1667 microversion: 2.1 time: 0.775090 Aug 25 13:28:56.500462 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2534/5015] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:55 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1667 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:56.918850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b7b0200-e3b6-493b-b3e4-ff7c71e0ec22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:56.926419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b7b0200-e3b6-493b-b3e4-ff7c71e0ec22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:56.952856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7b0200-e3b6-493b-b3e4-ff7c71e0ec22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:56.957118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7b0200-e3b6-493b-b3e4-ff7c71e0ec22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:56.958065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7b0200-e3b6-493b-b3e4-ff7c71e0ec22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:56.959427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7b0200-e3b6-493b-b3e4-ff7c71e0ec22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:56.990266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7b0200-e3b6-493b-b3e4-ff7c71e0ec22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:56.992653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b7b0200-e3b6-493b-b3e4-ff7c71e0ec22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:57.117263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:57.125057 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b7b0200-e3b6-493b-b3e4-ff7c71e0ec22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.216911 Aug 25 13:28:57.127602 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2482/5016] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:28:56 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc/os-volume_attachments => generated 25 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:28:57.706421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:57.729293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:57.774732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:57.776224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:57.777495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:57.779605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:57.783544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:57.784454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:57.794108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:57.852836 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] HTTP exception thrown: Cannot 'reboot' instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 while it is in vm_state rescued Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Request method failure captured: Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5/action HTTP/1.1 Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 28 Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3emkRnp5WsySeZUDuZqp15nFuui5PAZa04O2pdW2hxZe2BKDx44fRGkIEOKF2r11CYee5GPcGik4GpsVJQCgpLsIOIpHtQH9QghePjQ_6mqWpMbkt_tywI60U5M7l4xP6lvwI3wQpC2IoBQiIktCExz3EE3vcgMbQSbvXi9LGsoCek Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dec483f5c53b44c1a52917920b891b9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}] Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1552e098ea6f4d28abd9606fe9433000 Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: {"reboot": {"type": "HARD"}} Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: exception: Cannot 'reboot' instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 while it is in vm_state rescued Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '93cdaf78-d5c5-415d-a121-b722db7b5bf5', 'body': {'reboot': {'type': 'HARD'}}} Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:28:57.857097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 while it is in vm_state rescued Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 while it is in vm_state rescued Aug 25 13:28:57.863301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:28:57.866727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Returning 409 to user: Cannot 'reboot' instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 while it is in vm_state rescued {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:57.870114 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ac988efb-3738-4168-961b-88257c333143 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5/action" status: 409 len: 145 microversion: 2.1 time: 0.183059 Aug 25 13:28:57.872119 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2535/5017] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:28:57 2022] POST /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5/action => generated 145 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:28:57.902202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:57.917886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:57.962618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:57.963671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:57.964326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:57.970768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:57.974770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:57.976016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:58.074225 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] HTTP exception thrown: Cannot 'rebuild' instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 while it is in vm_state rescued Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Request method failure captured: Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5/action HTTP/1.1 Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 65 Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3emkRnp5WsySeZUDuZqp15nFuui5PAZa04O2pdW2hxZe2BKDx44fRGkIEOKF2r11CYee5GPcGik4GpsVJQCgpLsIOIpHtQH9QghePjQ_6mqWpMbkt_tywI60U5M7l4xP6lvwI3wQpC2IoBQiIktCExz3EE3vcgMbQSbvXi9LGsoCek Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dec483f5c53b44c1a52917920b891b9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}] Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1552e098ea6f4d28abd9606fe9433000 Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: exception: Cannot 'rebuild' instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 while it is in vm_state rescued Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '93cdaf78-d5c5-415d-a121-b722db7b5bf5', 'body': {'rebuild': {'imageRef': '63977197-fc12-4c51-9b3a-b2cc8b9977ca'}}} Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:28:58.085171 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 while it is in vm_state rescued Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 while it is in vm_state rescued Aug 25 13:28:58.091718 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:28:58.096814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Returning 409 to user: Cannot 'rebuild' instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 while it is in vm_state rescued {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:58.104622 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7ce41335-ab5e-4119-9181-530aa27a8d14 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "POST /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5/action" status: 409 len: 146 microversion: 2.1 time: 0.217370 Aug 25 13:28:58.117197 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2483/5018] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:28:57 2022] POST /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5/action => generated 146 bytes in 236 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:28:58.128750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4bc1eb7e-3af6-441f-b951-011579111a07 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:58.131947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4bc1eb7e-3af6-441f-b951-011579111a07 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:58.151064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4bc1eb7e-3af6-441f-b951-011579111a07 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:58.153219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4bc1eb7e-3af6-441f-b951-011579111a07 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:58.155041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4bc1eb7e-3af6-441f-b951-011579111a07 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:58.157075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4bc1eb7e-3af6-441f-b951-011579111a07 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:58.158586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4bc1eb7e-3af6-441f-b951-011579111a07 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:58.159736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4bc1eb7e-3af6-441f-b951-011579111a07 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:58.239868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4bc1eb7e-3af6-441f-b951-011579111a07 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:28:58.635076 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4bc1eb7e-3af6-441f-b951-011579111a07 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "DELETE /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 204 len: 0 microversion: 2.1 time: 0.517035 Aug 25 13:28:58.636654 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2536/5019] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:58 2022] DELETE /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:28:58.679167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0de93c6b-756d-47cc-9d4a-96c113384f83 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:58.688335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0de93c6b-756d-47cc-9d4a-96c113384f83 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:58.724466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de93c6b-756d-47cc-9d4a-96c113384f83 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:58.731091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de93c6b-756d-47cc-9d4a-96c113384f83 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:58.732051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de93c6b-756d-47cc-9d4a-96c113384f83 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:58.733494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de93c6b-756d-47cc-9d4a-96c113384f83 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:58.734418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de93c6b-756d-47cc-9d4a-96c113384f83 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:58.735239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0de93c6b-756d-47cc-9d4a-96c113384f83 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:59.365557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0de93c6b-756d-47cc-9d4a-96c113384f83 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:59.407274 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0de93c6b-756d-47cc-9d4a-96c113384f83 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1689 microversion: 2.1 time: 0.763246 Aug 25 13:28:59.430849 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2484/5020] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:58 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1689 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:00.457264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-80e43bbf-e62d-477b-9a84-906fb90081d8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:00.459915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-80e43bbf-e62d-477b-9a84-906fb90081d8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:00.480131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e43bbf-e62d-477b-9a84-906fb90081d8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:00.482041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e43bbf-e62d-477b-9a84-906fb90081d8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:00.483635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e43bbf-e62d-477b-9a84-906fb90081d8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:00.486083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e43bbf-e62d-477b-9a84-906fb90081d8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:00.487319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e43bbf-e62d-477b-9a84-906fb90081d8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:00.488424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-80e43bbf-e62d-477b-9a84-906fb90081d8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:00.832558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-80e43bbf-e62d-477b-9a84-906fb90081d8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:00.850202 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-80e43bbf-e62d-477b-9a84-906fb90081d8 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1689 microversion: 2.1 time: 0.404730 Aug 25 13:29:00.851136 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2537/5021] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:00 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1689 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:01.535344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1287292766", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:01.612962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:29:01.853448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-13c6b20b-aaed-46c1-b0b7-d2ff435165bf tempest-ExtensionsTest-38727413 tempest-ExtensionsTest-38727413-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:01.857835 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-13c6b20b-aaed-46c1-b0b7-d2ff435165bf tempest-ExtensionsTest-38727413 tempest-ExtensionsTest-38727413-project] 10.222.0.70 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.237213 Aug 25 13:29:01.859202 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2538/5022] 10.222.0.70 () {58 vars in 1170 bytes} [Thu Aug 25 13:29:01 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:29:01.879117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-57d0edd6-be1a-4dd5-a145-0301d3343d84 tempest-ExtensionsTest-38727413 tempest-ExtensionsTest-38727413-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:01.883981 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-57d0edd6-be1a-4dd5-a145-0301d3343d84 tempest-ExtensionsTest-38727413 tempest-ExtensionsTest-38727413-project] 10.222.0.70 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.016140 Aug 25 13:29:01.885330 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2539/5023] 10.222.0.70 () {58 vars in 1134 bytes} [Thu Aug 25 13:29:01 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:29:01.895084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-83f55c40-22fc-4a02-a722-c5cdd2e6a54c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:01.896268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-83f55c40-22fc-4a02-a722-c5cdd2e6a54c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:01.908770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83f55c40-22fc-4a02-a722-c5cdd2e6a54c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:01.909775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83f55c40-22fc-4a02-a722-c5cdd2e6a54c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:01.910600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83f55c40-22fc-4a02-a722-c5cdd2e6a54c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:01.911971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83f55c40-22fc-4a02-a722-c5cdd2e6a54c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:01.912802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83f55c40-22fc-4a02-a722-c5cdd2e6a54c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:01.913844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-83f55c40-22fc-4a02-a722-c5cdd2e6a54c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:02.374848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:29:02.375509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:29:02.376159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:29:02.378686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:29:02.380818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:29:02.418313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:02.419711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:02.420648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:02.422275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:02.423246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:02.423870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:02.469548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Getting quotas for project 440a7a2c98d2461dae65d0be95bca7fd. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:29:02.483405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Getting quotas for user 18ba08f030a14bbe986ff00db4b89124 and project 440a7a2c98d2461dae65d0be95bca7fd. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:29:02.491904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-83f55c40-22fc-4a02-a722-c5cdd2e6a54c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:02.511200 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-83f55c40-22fc-4a02-a722-c5cdd2e6a54c tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1689 microversion: 2.1 time: 0.624091 Aug 25 13:29:02.512233 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2540/5024] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:01 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1689 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:02.527333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:29:02.531644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:29:02.647045 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-74217b68-227b-4e67-8b83-04217f5055a8 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.115943 Aug 25 13:29:02.660091 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2485/5025] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:29:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:29:02.674993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-771ab2fc-38df-42fd-b4ad-389e1cb4aad9 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:02.677270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-771ab2fc-38df-42fd-b4ad-389e1cb4aad9 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:02.980625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-771ab2fc-38df-42fd-b4ad-389e1cb4aad9 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:02.995123 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-771ab2fc-38df-42fd-b4ad-389e1cb4aad9 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1215 microversion: 2.1 time: 0.332776 Aug 25 13:29:02.996156 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2541/5026] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:02 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1215 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:29:03.564671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-faba1cc1-fa12-406f-9962-3e11ed56d344 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:03.566360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-faba1cc1-fa12-406f-9962-3e11ed56d344 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:03.588014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faba1cc1-fa12-406f-9962-3e11ed56d344 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:03.589298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faba1cc1-fa12-406f-9962-3e11ed56d344 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:03.590446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faba1cc1-fa12-406f-9962-3e11ed56d344 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:03.592382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faba1cc1-fa12-406f-9962-3e11ed56d344 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:03.593967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faba1cc1-fa12-406f-9962-3e11ed56d344 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:03.595513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faba1cc1-fa12-406f-9962-3e11ed56d344 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:04.044440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-833292cf-39b5-4e16-aee2-97229d53fef5 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:04.046915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-833292cf-39b5-4e16-aee2-97229d53fef5 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:04.067260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-833292cf-39b5-4e16-aee2-97229d53fef5 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:04.068824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-833292cf-39b5-4e16-aee2-97229d53fef5 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:04.070142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-833292cf-39b5-4e16-aee2-97229d53fef5 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:04.073414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-833292cf-39b5-4e16-aee2-97229d53fef5 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:04.074716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-833292cf-39b5-4e16-aee2-97229d53fef5 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:04.075760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-833292cf-39b5-4e16-aee2-97229d53fef5 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:04.341250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-833292cf-39b5-4e16-aee2-97229d53fef5 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:04.372253 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-833292cf-39b5-4e16-aee2-97229d53fef5 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1267 microversion: 2.1 time: 0.337818 Aug 25 13:29:04.389564 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2542/5027] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:04 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1267 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:04.895033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-faba1cc1-fa12-406f-9962-3e11ed56d344 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:04.918234 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-faba1cc1-fa12-406f-9962-3e11ed56d344 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1689 microversion: 2.1 time: 1.367114 Aug 25 13:29:04.924383 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2486/5028] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:03 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1689 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:05.413050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-626996c9-5a36-466f-8733-1941cd8f37c4 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:05.414694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-626996c9-5a36-466f-8733-1941cd8f37c4 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:05.428522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-626996c9-5a36-466f-8733-1941cd8f37c4 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:05.431388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-626996c9-5a36-466f-8733-1941cd8f37c4 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:05.433195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-626996c9-5a36-466f-8733-1941cd8f37c4 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:05.435524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-626996c9-5a36-466f-8733-1941cd8f37c4 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:05.436607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-626996c9-5a36-466f-8733-1941cd8f37c4 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:05.437591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-626996c9-5a36-466f-8733-1941cd8f37c4 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:05.667710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-626996c9-5a36-466f-8733-1941cd8f37c4 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:05.690875 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-626996c9-5a36-466f-8733-1941cd8f37c4 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1273 microversion: 2.1 time: 0.285798 Aug 25 13:29:05.711397 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2543/5029] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:05 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:29:05.971158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-daf98cca-0eea-4f53-b873-a6b0225b4497 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:05.976064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-daf98cca-0eea-4f53-b873-a6b0225b4497 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:06.002647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf98cca-0eea-4f53-b873-a6b0225b4497 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:06.005490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf98cca-0eea-4f53-b873-a6b0225b4497 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:06.007301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf98cca-0eea-4f53-b873-a6b0225b4497 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:06.009700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf98cca-0eea-4f53-b873-a6b0225b4497 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:06.011807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf98cca-0eea-4f53-b873-a6b0225b4497 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:06.013588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-daf98cca-0eea-4f53-b873-a6b0225b4497 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:06.271756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-daf98cca-0eea-4f53-b873-a6b0225b4497 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:06.323009 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-daf98cca-0eea-4f53-b873-a6b0225b4497 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1621 microversion: 2.1 time: 0.367026 Aug 25 13:29:06.340026 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2487/5030] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:05 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1621 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:06.482921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-aae4b532-5086-4977-a43b-dfc8ae59a289 req-3fa59bdc-c958-439f-83ac-434ce006b1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991f22c6-27c5-471a-b485-90f6ea7d9fcc", "name": "network-vif-deleted", "tag": "71d03996-bd44-44cc-ab61-997d2db0e057"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:06.538040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-aae4b532-5086-4977-a43b-dfc8ae59a289 req-3fa59bdc-c958-439f-83ac-434ce006b1fd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:06.540147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-aae4b532-5086-4977-a43b-dfc8ae59a289 req-3fa59bdc-c958-439f-83ac-434ce006b1fd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:06.542356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-aae4b532-5086-4977-a43b-dfc8ae59a289 req-3fa59bdc-c958-439f-83ac-434ce006b1fd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:06.592140 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-aae4b532-5086-4977-a43b-dfc8ae59a289 req-3fa59bdc-c958-439f-83ac-434ce006b1fd service nova] Creating event network-vif-deleted:71d03996-bd44-44cc-ab61-997d2db0e057 for instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc on n-h1-852771-8 Aug 25 13:29:06.604916 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-aae4b532-5086-4977-a43b-dfc8ae59a289 req-3fa59bdc-c958-439f-83ac-434ce006b1fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135379 Aug 25 13:29:06.607377 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2544/5031] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:29:06.748518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b55941d1-fac0-4c5b-bcb3-9401d710b699 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:06.753264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b55941d1-fac0-4c5b-bcb3-9401d710b699 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:06.777751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b55941d1-fac0-4c5b-bcb3-9401d710b699 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:06.778785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b55941d1-fac0-4c5b-bcb3-9401d710b699 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:06.780631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b55941d1-fac0-4c5b-bcb3-9401d710b699 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:06.782103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b55941d1-fac0-4c5b-bcb3-9401d710b699 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:06.791736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b55941d1-fac0-4c5b-bcb3-9401d710b699 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:06.793432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b55941d1-fac0-4c5b-bcb3-9401d710b699 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:07.068600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b55941d1-fac0-4c5b-bcb3-9401d710b699 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:07.093113 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b55941d1-fac0-4c5b-bcb3-9401d710b699 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1273 microversion: 2.1 time: 0.355478 Aug 25 13:29:07.094634 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2488/5032] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:06 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1273 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:07.376075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:07.377483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:07.414187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:07.418187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:07.420577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:07.423822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:07.430613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:07.432294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:07.605926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:07.608087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:07.609659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:07.612417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lazy-loading 'fault' on Instance uuid 991f22c6-27c5-471a-b485-90f6ea7d9fcc {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:29:07.901544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:07.966429 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cf194889-1bf9-450c-9278-eb26e7c02e0a tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 200 len: 1335 microversion: 2.1 time: 0.601386 Aug 25 13:29:07.983872 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2545/5033] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:07 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 1335 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:08.147307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-49a75901-c88a-4b94-8b5d-ed9f711282da tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:08.150051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-49a75901-c88a-4b94-8b5d-ed9f711282da tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:08.199550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a75901-c88a-4b94-8b5d-ed9f711282da tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:08.202051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a75901-c88a-4b94-8b5d-ed9f711282da tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:08.203741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a75901-c88a-4b94-8b5d-ed9f711282da tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:08.205401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a75901-c88a-4b94-8b5d-ed9f711282da tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:08.212620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a75901-c88a-4b94-8b5d-ed9f711282da tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:08.214170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49a75901-c88a-4b94-8b5d-ed9f711282da tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:09.027779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:09.033780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 991f22c6-27c5-471a-b485-90f6ea7d9fcc] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:09.073741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:09.075334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:09.080019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:09.092596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:09.093704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:09.094483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:09.178487 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] HTTP exception thrown: Instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc could not be found. Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Request method failure captured: Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc HTTP/1.1 Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3emkRnp5WsySeZUDuZqp15nFuui5PAZa04O2pdW2hxZe2BKDx44fRGkIEOKF2r11CYee5GPcGik4GpsVJQCgpLsIOIpHtQH9QghePjQ_6mqWpMbkt_tywI60U5M7l4xP6lvwI3wQpC2IoBQiIktCExz3EE3vcgMbQSbvXi9LGsoCek Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dec483f5c53b44c1a52917920b891b9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}] Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1552e098ea6f4d28abd9606fe9433000 Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc could not be found. Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '991f22c6-27c5-471a-b485-90f6ea7d9fcc'} Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc could not be found. Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc could not be found. Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:09.189141 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:09.199511 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:09.199511 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:09.199511 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:09.199511 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:09.199511 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:29:09.199511 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:29:09.199511 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc could not be found. Aug 25 13:29:09.199511 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:09.199511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Returning 404 to user: Instance 991f22c6-27c5-471a-b485-90f6ea7d9fcc could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:29:09.199511 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0865fdb4-e929-4b31-98e3-4d607830c5b0 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc" status: 404 len: 111 microversion: 2.1 time: 0.185805 Aug 25 13:29:09.207098 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2546/5034] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:09 2022] GET /compute/v2.1/servers/991f22c6-27c5-471a-b485-90f6ea7d9fcc => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:29:09.233546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5643f91f-9687-4cba-aa2f-4f249b67b9cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '.version_select at 0x7f3a299f40d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:09.340357 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5643f91f-9687-4cba-aa2f-4f249b67b9cb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-936707663" status: 202 len: 0 microversion: 2.1 time: 0.122339 Aug 25 13:29:09.347092 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2547/5035] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 13:29:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-936707663 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:29:09.605839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-49a75901-c88a-4b94-8b5d-ed9f711282da tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:09.627549 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-49a75901-c88a-4b94-8b5d-ed9f711282da tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1315 microversion: 2.1 time: 1.488893 Aug 25 13:29:09.629585 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2489/5036] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:08 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1315 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:10.597558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-76897a67-427c-41c1-96d8-a17e0c8b134e req-b61f5c53-4393-44cf-b548-5808238d412c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aefd5acf-3e06-4af6-b61e-5ba779a8a7b5", "tag": "b6357758-2691-4a79-a574-c8cee8dd94ca"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:10.674145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f5e23205-1313-4ce0-a2e8-b2f902047d8b tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:10.680275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f5e23205-1313-4ce0-a2e8-b2f902047d8b tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:10.693940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-76897a67-427c-41c1-96d8-a17e0c8b134e req-b61f5c53-4393-44cf-b548-5808238d412c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:10.695655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-76897a67-427c-41c1-96d8-a17e0c8b134e req-b61f5c53-4393-44cf-b548-5808238d412c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:10.696678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-76897a67-427c-41c1-96d8-a17e0c8b134e req-b61f5c53-4393-44cf-b548-5808238d412c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:10.711367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5e23205-1313-4ce0-a2e8-b2f902047d8b tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:10.712386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5e23205-1313-4ce0-a2e8-b2f902047d8b tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:10.713209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5e23205-1313-4ce0-a2e8-b2f902047d8b tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:10.719302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5e23205-1313-4ce0-a2e8-b2f902047d8b tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:10.724248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5e23205-1313-4ce0-a2e8-b2f902047d8b tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:10.728316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5e23205-1313-4ce0-a2e8-b2f902047d8b tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:10.730613 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-76897a67-427c-41c1-96d8-a17e0c8b134e req-b61f5c53-4393-44cf-b548-5808238d412c service nova] Creating event network-changed:b6357758-2691-4a79-a574-c8cee8dd94ca for instance aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 on n-h2-852771-8 Aug 25 13:29:10.745950 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-76897a67-427c-41c1-96d8-a17e0c8b134e req-b61f5c53-4393-44cf-b548-5808238d412c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155184 Aug 25 13:29:10.748810 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2548/5037] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:29:11.315418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f5e23205-1313-4ce0-a2e8-b2f902047d8b tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:11.347663 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f5e23205-1313-4ce0-a2e8-b2f902047d8b tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1315 microversion: 2.1 time: 0.680582 Aug 25 13:29:11.353923 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2490/5038] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:10 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:29:12.394394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e9d02e60-cff1-4809-84d1-1fe6fc4befad tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:12.396863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e9d02e60-cff1-4809-84d1-1fe6fc4befad tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:12.420762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9d02e60-cff1-4809-84d1-1fe6fc4befad tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:12.422361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9d02e60-cff1-4809-84d1-1fe6fc4befad tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:12.423763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9d02e60-cff1-4809-84d1-1fe6fc4befad tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:12.425741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9d02e60-cff1-4809-84d1-1fe6fc4befad tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:12.427636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9d02e60-cff1-4809-84d1-1fe6fc4befad tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:12.429189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9d02e60-cff1-4809-84d1-1fe6fc4befad tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:12.818931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e9d02e60-cff1-4809-84d1-1fe6fc4befad tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:12.836350 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e9d02e60-cff1-4809-84d1-1fe6fc4befad tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1315 microversion: 2.1 time: 0.450689 Aug 25 13:29:12.837453 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2549/5039] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:12 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:13.876196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3cae692-d794-4b8e-9c1d-433eebc5bda7 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:13.877609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c3cae692-d794-4b8e-9c1d-433eebc5bda7 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:13.884118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:13.886603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:13.887827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:13.900367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3cae692-d794-4b8e-9c1d-433eebc5bda7 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:13.913204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3cae692-d794-4b8e-9c1d-433eebc5bda7 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:13.916820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3cae692-d794-4b8e-9c1d-433eebc5bda7 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:13.918139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3cae692-d794-4b8e-9c1d-433eebc5bda7 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:13.918982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3cae692-d794-4b8e-9c1d-433eebc5bda7 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:13.919829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3cae692-d794-4b8e-9c1d-433eebc5bda7 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:14.465065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3cae692-d794-4b8e-9c1d-433eebc5bda7 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:14.484899 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3cae692-d794-4b8e-9c1d-433eebc5bda7 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1315 microversion: 2.1 time: 0.615380 Aug 25 13:29:14.502887 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2491/5040] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:13 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:15.105548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:15.563961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5123e1bf-aa81-4b93-9d60-634851a5834c tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:15.578053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5123e1bf-aa81-4b93-9d60-634851a5834c tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:15.594710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5123e1bf-aa81-4b93-9d60-634851a5834c tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:15.596218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5123e1bf-aa81-4b93-9d60-634851a5834c tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:15.598305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5123e1bf-aa81-4b93-9d60-634851a5834c tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:15.600010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5123e1bf-aa81-4b93-9d60-634851a5834c tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:15.602638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5123e1bf-aa81-4b93-9d60-634851a5834c tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:15.604029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5123e1bf-aa81-4b93-9d60-634851a5834c tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:15.857471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e2994a8-e481-4086-b4fd-03a16cb89e34 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:15.863812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5e2994a8-e481-4086-b4fd-03a16cb89e34 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:15.894269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2994a8-e481-4086-b4fd-03a16cb89e34 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:15.897320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2994a8-e481-4086-b4fd-03a16cb89e34 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:15.899605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2994a8-e481-4086-b4fd-03a16cb89e34 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:15.901948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2994a8-e481-4086-b4fd-03a16cb89e34 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:15.905751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2994a8-e481-4086-b4fd-03a16cb89e34 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:15.907617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2994a8-e481-4086-b4fd-03a16cb89e34 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:16.041727 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5e2994a8-e481-4086-b4fd-03a16cb89e34 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments/12b0c04b-130b-4e9f-875e-2552084150ae" status: 200 len: 194 microversion: 2.20 time: 0.959250 Aug 25 13:29:16.054128 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2550/5041] 10.222.0.70 () {60 vars in 1454 bytes} [Thu Aug 25 13:29:15 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments/12b0c04b-130b-4e9f-875e-2552084150ae => generated 194 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:29:16.099459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5123e1bf-aa81-4b93-9d60-634851a5834c tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:16.122553 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5123e1bf-aa81-4b93-9d60-634851a5834c tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1315 microversion: 2.1 time: 0.600951 Aug 25 13:29:16.134266 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2492/5042] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:15 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:16.287817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1fe25d3f-fb91-43f4-bd64-3bb0eb1bf5d1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:16.288767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1fe25d3f-fb91-43f4-bd64-3bb0eb1bf5d1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:16.302549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fe25d3f-fb91-43f4-bd64-3bb0eb1bf5d1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:16.303761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fe25d3f-fb91-43f4-bd64-3bb0eb1bf5d1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:16.305090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fe25d3f-fb91-43f4-bd64-3bb0eb1bf5d1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:16.307246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fe25d3f-fb91-43f4-bd64-3bb0eb1bf5d1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:16.308166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fe25d3f-fb91-43f4-bd64-3bb0eb1bf5d1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:16.308983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fe25d3f-fb91-43f4-bd64-3bb0eb1bf5d1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:16.540788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-1fe25d3f-fb91-43f4-bd64-3bb0eb1bf5d1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lazy-loading 'services' on Instance uuid d404ff6f-0fad-4c7f-bf95-5c0fe210039b {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:29:16.865230 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1fe25d3f-fb91-43f4-bd64-3bb0eb1bf5d1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments/12b0c04b-130b-4e9f-875e-2552084150ae" status: 202 len: 0 microversion: 2.20 time: 0.583267 Aug 25 13:29:16.875355 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2551/5043] 10.222.0.70 () {60 vars in 1457 bytes} [Thu Aug 25 13:29:16 2022] DELETE /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments/12b0c04b-130b-4e9f-875e-2552084150ae => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:29:16.897499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-28f8dc1e-9822-4db3-9401-160993af0290 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:16.920757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-28f8dc1e-9822-4db3-9401-160993af0290 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:16.962648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28f8dc1e-9822-4db3-9401-160993af0290 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:16.963555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28f8dc1e-9822-4db3-9401-160993af0290 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:16.964406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28f8dc1e-9822-4db3-9401-160993af0290 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:16.971391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28f8dc1e-9822-4db3-9401-160993af0290 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:16.972851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28f8dc1e-9822-4db3-9401-160993af0290 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:16.973898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28f8dc1e-9822-4db3-9401-160993af0290 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:17.171521 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-28f8dc1e-9822-4db3-9401-160993af0290 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.288548 Aug 25 13:29:17.173925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4b25b34a-dbf2-4a25-bdcf-0740ff7ea81e tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:17.177367 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2493/5044] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:16 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:29:17.182124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4b25b34a-dbf2-4a25-bdcf-0740ff7ea81e tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:17.208151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:17.215060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b25b34a-dbf2-4a25-bdcf-0740ff7ea81e tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:17.216474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b25b34a-dbf2-4a25-bdcf-0740ff7ea81e tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:17.217728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b25b34a-dbf2-4a25-bdcf-0740ff7ea81e tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:17.220006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b25b34a-dbf2-4a25-bdcf-0740ff7ea81e tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:17.221289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b25b34a-dbf2-4a25-bdcf-0740ff7ea81e tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:17.222470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4b25b34a-dbf2-4a25-bdcf-0740ff7ea81e tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:17.807426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4b25b34a-dbf2-4a25-bdcf-0740ff7ea81e tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:17.844292 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4b25b34a-dbf2-4a25-bdcf-0740ff7ea81e tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1315 microversion: 2.1 time: 0.690128 Aug 25 13:29:17.848218 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2552/5045] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:17 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:18.207868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ce10b57d-a38b-443e-b973-c4420494ccc3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:18.222713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ce10b57d-a38b-443e-b973-c4420494ccc3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:18.251331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce10b57d-a38b-443e-b973-c4420494ccc3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:18.252991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce10b57d-a38b-443e-b973-c4420494ccc3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:18.270509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce10b57d-a38b-443e-b973-c4420494ccc3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:18.276708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce10b57d-a38b-443e-b973-c4420494ccc3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:18.280460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce10b57d-a38b-443e-b973-c4420494ccc3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:18.287081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce10b57d-a38b-443e-b973-c4420494ccc3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:18.428088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-89988751-dc41-49a0-b1af-88c065ac2c88 req-0da726b8-cb9e-4957-9d6f-87017be22d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aefd5acf-3e06-4af6-b61e-5ba779a8a7b5", "name": "network-vif-plugged", "status": "completed", "tag": "b6357758-2691-4a79-a574-c8cee8dd94ca"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:18.476041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-89988751-dc41-49a0-b1af-88c065ac2c88 req-0da726b8-cb9e-4957-9d6f-87017be22d1d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:18.476856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-89988751-dc41-49a0-b1af-88c065ac2c88 req-0da726b8-cb9e-4957-9d6f-87017be22d1d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:18.483903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-89988751-dc41-49a0-b1af-88c065ac2c88 req-0da726b8-cb9e-4957-9d6f-87017be22d1d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:18.512759 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ce10b57d-a38b-443e-b973-c4420494ccc3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.321940 Aug 25 13:29:18.535682 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2494/5046] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:18 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:29:18.573163 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-89988751-dc41-49a0-b1af-88c065ac2c88 req-0da726b8-cb9e-4957-9d6f-87017be22d1d service nova] Creating event network-vif-plugged:b6357758-2691-4a79-a574-c8cee8dd94ca for instance aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 on n-h2-852771-8 Aug 25 13:29:18.602883 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-89988751-dc41-49a0-b1af-88c065ac2c88 req-0da726b8-cb9e-4957-9d6f-87017be22d1d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174008 Aug 25 13:29:18.608383 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2553/5047] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:29:18.893747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-166ada27-da18-46a7-9db6-08e6db0f87dd tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:18.895019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-166ada27-da18-46a7-9db6-08e6db0f87dd tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:18.933106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-166ada27-da18-46a7-9db6-08e6db0f87dd tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:18.938244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-166ada27-da18-46a7-9db6-08e6db0f87dd tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:18.939121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-166ada27-da18-46a7-9db6-08e6db0f87dd tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:18.941956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-166ada27-da18-46a7-9db6-08e6db0f87dd tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:18.946706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-166ada27-da18-46a7-9db6-08e6db0f87dd tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:18.950673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-166ada27-da18-46a7-9db6-08e6db0f87dd tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:19.557455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f380af39-3663-4287-8d7b-c4c1393a1dbc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:19.561046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-166ada27-da18-46a7-9db6-08e6db0f87dd tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:19.571262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f380af39-3663-4287-8d7b-c4c1393a1dbc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:19.600577 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-166ada27-da18-46a7-9db6-08e6db0f87dd tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1315 microversion: 2.1 time: 0.707624 Aug 25 13:29:19.602192 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2495/5048] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:18 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:19.608327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f380af39-3663-4287-8d7b-c4c1393a1dbc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:19.609310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f380af39-3663-4287-8d7b-c4c1393a1dbc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:19.610171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f380af39-3663-4287-8d7b-c4c1393a1dbc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:19.611511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f380af39-3663-4287-8d7b-c4c1393a1dbc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:19.612362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f380af39-3663-4287-8d7b-c4c1393a1dbc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:19.613174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f380af39-3663-4287-8d7b-c4c1393a1dbc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:19.786080 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f380af39-3663-4287-8d7b-c4c1393a1dbc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.243461 Aug 25 13:29:19.791057 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2554/5049] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:19 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:29:20.656770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c5ca15df-3846-4958-8442-3741c4817d32 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:20.661902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c5ca15df-3846-4958-8442-3741c4817d32 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:20.698404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5ca15df-3846-4958-8442-3741c4817d32 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:20.714013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5ca15df-3846-4958-8442-3741c4817d32 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:20.722930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5ca15df-3846-4958-8442-3741c4817d32 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:20.726506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5ca15df-3846-4958-8442-3741c4817d32 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:20.727558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5ca15df-3846-4958-8442-3741c4817d32 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:20.731324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5ca15df-3846-4958-8442-3741c4817d32 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:20.820218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4f0315eb-41f9-4d33-819e-47a3d382f026 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:20.827874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4f0315eb-41f9-4d33-819e-47a3d382f026 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:20.880924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f0315eb-41f9-4d33-819e-47a3d382f026 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:20.882191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f0315eb-41f9-4d33-819e-47a3d382f026 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:20.883035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f0315eb-41f9-4d33-819e-47a3d382f026 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:20.891099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f0315eb-41f9-4d33-819e-47a3d382f026 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:20.893787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f0315eb-41f9-4d33-819e-47a3d382f026 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:20.899026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f0315eb-41f9-4d33-819e-47a3d382f026 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:21.091732 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4f0315eb-41f9-4d33-819e-47a3d382f026 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.279627 Aug 25 13:29:21.107053 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2555/5050] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:20 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:29:21.383643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c5ca15df-3846-4958-8442-3741c4817d32 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:21.403076 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c5ca15df-3846-4958-8442-3741c4817d32 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1465 microversion: 2.1 time: 0.757814 Aug 25 13:29:21.418793 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2496/5051] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:20 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1465 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:21.560674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb3b21db-766f-4fd0-9807-c2f9509aa88a tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:21.565331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb3b21db-766f-4fd0-9807-c2f9509aa88a tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:21.597088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3b21db-766f-4fd0-9807-c2f9509aa88a tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:21.601621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3b21db-766f-4fd0-9807-c2f9509aa88a tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:21.605237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3b21db-766f-4fd0-9807-c2f9509aa88a tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:21.609351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3b21db-766f-4fd0-9807-c2f9509aa88a tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:21.614166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3b21db-766f-4fd0-9807-c2f9509aa88a tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:21.616152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3b21db-766f-4fd0-9807-c2f9509aa88a tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:21.641038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:21.708094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb3b21db-766f-4fd0-9807-c2f9509aa88a tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:29:22.083717 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb3b21db-766f-4fd0-9807-c2f9509aa88a tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 204 len: 0 microversion: 2.1 time: 0.529790 Aug 25 13:29:22.089595 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2556/5052] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:29:21 2022] DELETE /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:29:22.105242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6ac1ed39-c60e-4dec-bb5d-2b743199c36f tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:22.115705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6ac1ed39-c60e-4dec-bb5d-2b743199c36f tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:22.139411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c47a63e-4680-4183-b08d-26faedaee424 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:22.150905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5c47a63e-4680-4183-b08d-26faedaee424 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:22.157996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ac1ed39-c60e-4dec-bb5d-2b743199c36f tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:22.168396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ac1ed39-c60e-4dec-bb5d-2b743199c36f tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:22.170288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ac1ed39-c60e-4dec-bb5d-2b743199c36f tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:22.172038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ac1ed39-c60e-4dec-bb5d-2b743199c36f tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:22.174260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ac1ed39-c60e-4dec-bb5d-2b743199c36f tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:22.175459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ac1ed39-c60e-4dec-bb5d-2b743199c36f tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:22.180198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c47a63e-4680-4183-b08d-26faedaee424 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:22.182249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c47a63e-4680-4183-b08d-26faedaee424 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:22.185818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c47a63e-4680-4183-b08d-26faedaee424 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:22.189852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c47a63e-4680-4183-b08d-26faedaee424 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:22.191395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c47a63e-4680-4183-b08d-26faedaee424 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:22.198650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c47a63e-4680-4183-b08d-26faedaee424 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:22.405105 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c47a63e-4680-4183-b08d-26faedaee424 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.290699 Aug 25 13:29:22.418830 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2557/5053] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:22 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:29:22.486680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6ac1ed39-c60e-4dec-bb5d-2b743199c36f tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:22.508701 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6ac1ed39-c60e-4dec-bb5d-2b743199c36f tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1471 microversion: 2.1 time: 0.412685 Aug 25 13:29:22.510694 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2497/5054] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:22 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:23.486105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ee399a7e-5110-447b-9135-442ba472a220 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:23.498482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ee399a7e-5110-447b-9135-442ba472a220 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:23.534648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee399a7e-5110-447b-9135-442ba472a220 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:23.535645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee399a7e-5110-447b-9135-442ba472a220 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:23.536463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee399a7e-5110-447b-9135-442ba472a220 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:23.552702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9f9c467c-1adf-4132-bb97-b6e2a3ca3925 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:23.557618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee399a7e-5110-447b-9135-442ba472a220 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:23.558670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee399a7e-5110-447b-9135-442ba472a220 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:23.559826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee399a7e-5110-447b-9135-442ba472a220 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:23.567371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9f9c467c-1adf-4132-bb97-b6e2a3ca3925 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:23.613188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f9c467c-1adf-4132-bb97-b6e2a3ca3925 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:23.614072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f9c467c-1adf-4132-bb97-b6e2a3ca3925 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:23.614849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f9c467c-1adf-4132-bb97-b6e2a3ca3925 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:23.616299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f9c467c-1adf-4132-bb97-b6e2a3ca3925 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:23.642427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f9c467c-1adf-4132-bb97-b6e2a3ca3925 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:23.643546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f9c467c-1adf-4132-bb97-b6e2a3ca3925 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:23.775738 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ee399a7e-5110-447b-9135-442ba472a220 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.352747 Aug 25 13:29:23.780036 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2558/5055] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:23 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:29:24.355582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9f9c467c-1adf-4132-bb97-b6e2a3ca3925 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:24.378247 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9f9c467c-1adf-4132-bb97-b6e2a3ca3925 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1471 microversion: 2.1 time: 0.833419 Aug 25 13:29:24.389402 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2498/5056] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:23 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1471 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:29:24.811709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-11684957-657b-46ac-8b56-3c4cf7b174a0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:24.823955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-11684957-657b-46ac-8b56-3c4cf7b174a0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:24.854065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11684957-657b-46ac-8b56-3c4cf7b174a0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:24.855970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11684957-657b-46ac-8b56-3c4cf7b174a0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:24.857758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11684957-657b-46ac-8b56-3c4cf7b174a0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:24.859607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11684957-657b-46ac-8b56-3c4cf7b174a0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:24.860972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11684957-657b-46ac-8b56-3c4cf7b174a0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:24.862269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11684957-657b-46ac-8b56-3c4cf7b174a0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:25.005618 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-11684957-657b-46ac-8b56-3c4cf7b174a0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.172729 Aug 25 13:29:25.010212 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2559/5057] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:24 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:29:25.429349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-05708e9b-c188-4afa-a40d-c09c3ab7793d tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:25.442418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-05708e9b-c188-4afa-a40d-c09c3ab7793d tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:25.464222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05708e9b-c188-4afa-a40d-c09c3ab7793d tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:25.465442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05708e9b-c188-4afa-a40d-c09c3ab7793d tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:25.466377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05708e9b-c188-4afa-a40d-c09c3ab7793d tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:25.467761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05708e9b-c188-4afa-a40d-c09c3ab7793d tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:25.468650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05708e9b-c188-4afa-a40d-c09c3ab7793d tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:25.469483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05708e9b-c188-4afa-a40d-c09c3ab7793d tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:25.828688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f13cc704-fd73-430d-a750-f20950983885 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:25.834325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f13cc704-fd73-430d-a750-f20950983885 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:25.860801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f13cc704-fd73-430d-a750-f20950983885 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:25.863647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f13cc704-fd73-430d-a750-f20950983885 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:25.865150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f13cc704-fd73-430d-a750-f20950983885 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:25.868177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f13cc704-fd73-430d-a750-f20950983885 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:25.869685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f13cc704-fd73-430d-a750-f20950983885 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:25.872263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f13cc704-fd73-430d-a750-f20950983885 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:26.000334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f13cc704-fd73-430d-a750-f20950983885 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:29:26.238425 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f13cc704-fd73-430d-a750-f20950983885 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "DELETE /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 204 len: 0 microversion: 2.1 time: 0.417624 Aug 25 13:29:26.240171 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2560/5058] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:29:25 2022] DELETE /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:29:26.266612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da39bb9e-9420-403a-abf7-193710c5fec7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:26.277674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da39bb9e-9420-403a-abf7-193710c5fec7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:26.307457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da39bb9e-9420-403a-abf7-193710c5fec7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:26.308705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da39bb9e-9420-403a-abf7-193710c5fec7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:26.309498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da39bb9e-9420-403a-abf7-193710c5fec7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:26.311290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da39bb9e-9420-403a-abf7-193710c5fec7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:26.312666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da39bb9e-9420-403a-abf7-193710c5fec7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:26.316335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da39bb9e-9420-403a-abf7-193710c5fec7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:26.425377 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da39bb9e-9420-403a-abf7-193710c5fec7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.180590 Aug 25 13:29:26.426646 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2561/5059] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:26 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:29:26.449423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c7efe0c-9688-4be8-a28b-309106aa04ef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:26.458400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c7efe0c-9688-4be8-a28b-309106aa04ef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:26.468950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-05708e9b-c188-4afa-a40d-c09c3ab7793d tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:26.475502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7efe0c-9688-4be8-a28b-309106aa04ef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:26.475502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7efe0c-9688-4be8-a28b-309106aa04ef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:26.477016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7efe0c-9688-4be8-a28b-309106aa04ef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:26.477884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7efe0c-9688-4be8-a28b-309106aa04ef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:26.479068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7efe0c-9688-4be8-a28b-309106aa04ef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:26.479892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7efe0c-9688-4be8-a28b-309106aa04ef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:26.525105 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-05708e9b-c188-4afa-a40d-c09c3ab7793d tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1471 microversion: 2.1 time: 1.104148 Aug 25 13:29:26.528209 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2499/5060] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:25 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1471 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:26.752783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-4aad9e87-73dd-4516-8be5-7f841843395c req-60559f33-ae6d-4ec4-af3c-e4f21633c273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aefd5acf-3e06-4af6-b61e-5ba779a8a7b5", "name": "network-vif-deleted", "tag": "b6357758-2691-4a79-a574-c8cee8dd94ca"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:26.786967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4aad9e87-73dd-4516-8be5-7f841843395c req-60559f33-ae6d-4ec4-af3c-e4f21633c273 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:26.789368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4aad9e87-73dd-4516-8be5-7f841843395c req-60559f33-ae6d-4ec4-af3c-e4f21633c273 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:26.790579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4aad9e87-73dd-4516-8be5-7f841843395c req-60559f33-ae6d-4ec4-af3c-e4f21633c273 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:26.826009 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-4aad9e87-73dd-4516-8be5-7f841843395c req-60559f33-ae6d-4ec4-af3c-e4f21633c273 service nova] Creating event network-vif-deleted:b6357758-2691-4a79-a574-c8cee8dd94ca for instance aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 on n-h2-852771-8 Aug 25 13:29:26.840095 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-4aad9e87-73dd-4516-8be5-7f841843395c req-60559f33-ae6d-4ec4-af3c-e4f21633c273 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093946 Aug 25 13:29:26.844270 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2500/5061] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:29:27.204680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7c7efe0c-9688-4be8-a28b-309106aa04ef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:27.224660 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c7efe0c-9688-4be8-a28b-309106aa04ef tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1506 microversion: 2.1 time: 0.795679 Aug 25 13:29:27.227461 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2562/5062] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:26 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1506 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:27.450271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-abd0761a-2765-4dc3-89d2-87c03452bca3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:27.462848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-abd0761a-2765-4dc3-89d2-87c03452bca3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:27.509656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abd0761a-2765-4dc3-89d2-87c03452bca3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:27.514172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abd0761a-2765-4dc3-89d2-87c03452bca3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:27.519269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abd0761a-2765-4dc3-89d2-87c03452bca3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:27.522098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abd0761a-2765-4dc3-89d2-87c03452bca3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:27.524130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abd0761a-2765-4dc3-89d2-87c03452bca3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:27.527390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abd0761a-2765-4dc3-89d2-87c03452bca3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:27.565643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:27.566854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:27.614360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:27.615372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:27.616266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:27.617764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:27.618561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:27.619361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:27.685572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:27.752401 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-abd0761a-2765-4dc3-89d2-87c03452bca3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.311875 Aug 25 13:29:27.768011 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2501/5063] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:27 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:29:27.855589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:27.857054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:27.864591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:27.870714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lazy-loading 'fault' on Instance uuid aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:29:28.268437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6100e83c-231f-4926-99d8-fc68eb3a06bb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:28.269699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6100e83c-231f-4926-99d8-fc68eb3a06bb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:28.292399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6100e83c-231f-4926-99d8-fc68eb3a06bb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:28.295301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6100e83c-231f-4926-99d8-fc68eb3a06bb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:28.297432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6100e83c-231f-4926-99d8-fc68eb3a06bb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:28.299598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6100e83c-231f-4926-99d8-fc68eb3a06bb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:28.301174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6100e83c-231f-4926-99d8-fc68eb3a06bb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:28.302436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6100e83c-231f-4926-99d8-fc68eb3a06bb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:28.429629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba08f030a14bbe986ff00db4b89124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440a7a2c98d2461dae65d0be95bca7fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:28.474743 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-24eebd00-d8f3-4a62-8bcf-fcb76cdd3fcf tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 200 len: 1305 microversion: 2.1 time: 0.916145 Aug 25 13:29:28.483780 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2563/5064] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:27 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 1305 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:28.743366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6100e83c-231f-4926-99d8-fc68eb3a06bb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:28.777085 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6100e83c-231f-4926-99d8-fc68eb3a06bb tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1506 microversion: 2.1 time: 0.516731 Aug 25 13:29:28.779349 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2502/5065] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:28 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:28.811205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cdc0cded-5619-4c73-9b91-1f43b2d0fd18 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:28.816025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cdc0cded-5619-4c73-9b91-1f43b2d0fd18 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:28.831194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdc0cded-5619-4c73-9b91-1f43b2d0fd18 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:28.832612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdc0cded-5619-4c73-9b91-1f43b2d0fd18 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:28.833868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdc0cded-5619-4c73-9b91-1f43b2d0fd18 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:28.837070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdc0cded-5619-4c73-9b91-1f43b2d0fd18 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:28.838643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdc0cded-5619-4c73-9b91-1f43b2d0fd18 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:28.839773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cdc0cded-5619-4c73-9b91-1f43b2d0fd18 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:28.912187 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cdc0cded-5619-4c73-9b91-1f43b2d0fd18 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138191 Aug 25 13:29:28.914835 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2564/5066] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:28 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:29:29.283152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9e2269e7-afc7-45ae-bc92-14073cb1c7c4 req-98534cb5-66d0-47fb-a915-476589cf6463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cdaf78-d5c5-415d-a121-b722db7b5bf5", "name": "network-vif-deleted", "tag": "4f4ea4aa-c8a1-4675-a961-524e2eed20dc"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:29.343050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9e2269e7-afc7-45ae-bc92-14073cb1c7c4 req-98534cb5-66d0-47fb-a915-476589cf6463 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:29.343963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9e2269e7-afc7-45ae-bc92-14073cb1c7c4 req-98534cb5-66d0-47fb-a915-476589cf6463 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:29.344963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9e2269e7-afc7-45ae-bc92-14073cb1c7c4 req-98534cb5-66d0-47fb-a915-476589cf6463 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:29.408850 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9e2269e7-afc7-45ae-bc92-14073cb1c7c4 req-98534cb5-66d0-47fb-a915-476589cf6463 service nova] Creating event network-vif-deleted:4f4ea4aa-c8a1-4675-a961-524e2eed20dc for instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 on n-h2-852771-8 Aug 25 13:29:29.436261 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9e2269e7-afc7-45ae-bc92-14073cb1c7c4 req-98534cb5-66d0-47fb-a915-476589cf6463 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163215 Aug 25 13:29:29.448338 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2503/5067] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:29:29.524086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:29.533552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] [instance: aefd5acf-3e06-4af6-b61e-5ba779a8a7b5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:29.572387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:29.573159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:29.574009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:29.589313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:29.596134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:29.596937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:29.668240 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] HTTP exception thrown: Instance aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 could not be found. Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Request method failure captured: Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 HTTP/1.1 Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3kXVLaH4p_79aJw_llJo_o9rtZ54nleDVmbLyG4U-hJDFEQUnvaCW_bekfC2TNUUIvZObpgM7J1BQckOmcOId3wzpCpdlj1oobv8H4nIb-RZQCzSGrBw6fNRw2J5oceyoG8Ba28ccyJo2ej5HusTLNjskEVojmc0zXLHIvlylJwxQM Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 440a7a2c98d2461dae65d0be95bca7fd Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesNegativeTest-1682909828 Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/440a7a2c98d2461dae65d0be95bca7fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_440a7a2c98d2461dae65d0be95bca7fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/440a7a2c98d2461dae65d0be95bca7fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/440a7a2c98d2461dae65d0be95bca7fd"}]}] Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesNegativeTest-1682909828 Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 440a7a2c98d2461dae65d0be95bca7fd Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesNegativeTest-1682909828 Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesNegativeTest-1682909828-project Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 18ba08f030a14bbe986ff00db4b89124 Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesNegativeTest-1682909828-project Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 could not be found. Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'aefd5acf-3e06-4af6-b61e-5ba779a8a7b5'} Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 could not be found. Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 could not be found. Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:29.671687 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:29.679616 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:29.679616 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:29.679616 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:29.679616 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:29:29.679616 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:29:29.679616 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 could not be found. Aug 25 13:29:29.679616 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:29.679616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] Returning 404 to user: Instance aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:29:29.692574 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-10964930-6067-4a7e-9ce4-52e4eb40ea83 tempest-VolumesNegativeTest-1682909828 tempest-VolumesNegativeTest-1682909828-project] 10.222.0.70 "GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5" status: 404 len: 111 microversion: 2.1 time: 0.169194 Aug 25 13:29:29.694005 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2565/5068] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:29 2022] GET /compute/v2.1/servers/aefd5acf-3e06-4af6-b61e-5ba779a8a7b5 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:29:29.823650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:29.828262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:29.862293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:29.863380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:29.864310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:29.865775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:29.874602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:29.875543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:29.935098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fa1ebafe-0f24-4576-8985-c2e2b80cbf60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:29.941472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fa1ebafe-0f24-4576-8985-c2e2b80cbf60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:29.961323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa1ebafe-0f24-4576-8985-c2e2b80cbf60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:29.964001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa1ebafe-0f24-4576-8985-c2e2b80cbf60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:29.967819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa1ebafe-0f24-4576-8985-c2e2b80cbf60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:29.970288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa1ebafe-0f24-4576-8985-c2e2b80cbf60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:29.971425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa1ebafe-0f24-4576-8985-c2e2b80cbf60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:29.972489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa1ebafe-0f24-4576-8985-c2e2b80cbf60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:30.027649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:30.028905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:30.030083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:30.031152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lazy-loading 'fault' on Instance uuid 93cdaf78-d5c5-415d-a121-b722db7b5bf5 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:29:30.155852 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fa1ebafe-0f24-4576-8985-c2e2b80cbf60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.229658 Aug 25 13:29:30.172280 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2566/5069] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:29 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 197 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:29:30.237532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:30.253774 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8f31d5a3-f410-4fa2-a23b-3b1dfc166313 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 200 len: 1311 microversion: 2.1 time: 0.437968 Aug 25 13:29:30.275378 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2504/5070] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:29 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 1311 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:31.186364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4a2dd9e6-37d1-41ef-a49e-76fa53fc5515 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:31.211233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4a2dd9e6-37d1-41ef-a49e-76fa53fc5515 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:31.246826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a2dd9e6-37d1-41ef-a49e-76fa53fc5515 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.247918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a2dd9e6-37d1-41ef-a49e-76fa53fc5515 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.248478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a2dd9e6-37d1-41ef-a49e-76fa53fc5515 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:31.249906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a2dd9e6-37d1-41ef-a49e-76fa53fc5515 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.250902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a2dd9e6-37d1-41ef-a49e-76fa53fc5515 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.251553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a2dd9e6-37d1-41ef-a49e-76fa53fc5515 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:31.308657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:31.309159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 93cdaf78-d5c5-415d-a121-b722db7b5bf5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:31.356379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.358986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.361915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:31.365430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.373810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.374832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:31.379296 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4a2dd9e6-37d1-41ef-a49e-76fa53fc5515 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.190518 Aug 25 13:29:31.380938 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2567/5071] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:29:31 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b/os-volume_attachments => generated 25 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:29:31.433522 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] HTTP exception thrown: Instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 could not be found. Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Request method failure captured: Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 HTTP/1.1 Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3emkRnp5WsySeZUDuZqp15nFuui5PAZa04O2pdW2hxZe2BKDx44fRGkIEOKF2r11CYee5GPcGik4GpsVJQCgpLsIOIpHtQH9QghePjQ_6mqWpMbkt_tywI60U5M7l4xP6lvwI3wQpC2IoBQiIktCExz3EE3vcgMbQSbvXi9LGsoCek Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dec483f5c53b44c1a52917920b891b9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}] Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1552e098ea6f4d28abd9606fe9433000 Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 could not be found. Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '93cdaf78-d5c5-415d-a121-b722db7b5bf5'} Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 could not be found. Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 could not be found. Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:29:31.449763 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 could not be found. Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Returning 404 to user: Instance 93cdaf78-d5c5-415d-a121-b722db7b5bf5 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a184db0a-2f2b-464c-a992-2aeb538b4a5f tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5" status: 404 len: 111 microversion: 2.1 time: 0.156561 Aug 25 13:29:31.463494 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2505/5072] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:31 2022] GET /compute/v2.1/servers/93cdaf78-d5c5-415d-a121-b722db7b5bf5 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:29:31.474547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-99d0f129-a2cb-4a0d-8619-5aaec7a344ce tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:31.475457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-99d0f129-a2cb-4a0d-8619-5aaec7a344ce tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:31.496454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d0f129-a2cb-4a0d-8619-5aaec7a344ce tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.501909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d0f129-a2cb-4a0d-8619-5aaec7a344ce tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.503990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d0f129-a2cb-4a0d-8619-5aaec7a344ce tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:31.505721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d0f129-a2cb-4a0d-8619-5aaec7a344ce tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.518047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d0f129-a2cb-4a0d-8619-5aaec7a344ce tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.519472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d0f129-a2cb-4a0d-8619-5aaec7a344ce tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:31.593070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-849c2ecb-c064-4b08-a5b8-8b02c2613675 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:31.605393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-849c2ecb-c064-4b08-a5b8-8b02c2613675 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:31.610205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-99d0f129-a2cb-4a0d-8619-5aaec7a344ce tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:29:31.633357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-849c2ecb-c064-4b08-a5b8-8b02c2613675 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.636088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-849c2ecb-c064-4b08-a5b8-8b02c2613675 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.637948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-849c2ecb-c064-4b08-a5b8-8b02c2613675 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:31.640691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-849c2ecb-c064-4b08-a5b8-8b02c2613675 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.642844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-849c2ecb-c064-4b08-a5b8-8b02c2613675 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.643757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-849c2ecb-c064-4b08-a5b8-8b02c2613675 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:31.726223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-849c2ecb-c064-4b08-a5b8-8b02c2613675 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:29:31.733348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:31.920088 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-99d0f129-a2cb-4a0d-8619-5aaec7a344ce tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 204 len: 0 microversion: 2.1 time: 0.445521 Aug 25 13:29:31.921223 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2568/5073] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:29:31 2022] DELETE /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:29:31.948641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f7e97a1-5747-43e6-9016-efae77bc5d22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:31.955576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f7e97a1-5747-43e6-9016-efae77bc5d22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:31.986197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f7e97a1-5747-43e6-9016-efae77bc5d22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.987229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f7e97a1-5747-43e6-9016-efae77bc5d22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.988065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f7e97a1-5747-43e6-9016-efae77bc5d22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:31.989486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f7e97a1-5747-43e6-9016-efae77bc5d22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.990532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f7e97a1-5747-43e6-9016-efae77bc5d22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.991471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f7e97a1-5747-43e6-9016-efae77bc5d22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:32.018260 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-849c2ecb-c064-4b08-a5b8-8b02c2613675 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 204 len: 0 microversion: 2.20 time: 0.435519 Aug 25 13:29:32.019482 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2506/5074] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:29:31 2022] DELETE /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:29:32.036226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:32.037667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:32.049899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:32.051126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:32.051961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:32.053575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:32.054481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:32.055277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:32.500907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f7e97a1-5747-43e6-9016-efae77bc5d22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:32.534743 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f7e97a1-5747-43e6-9016-efae77bc5d22 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 0.601500 Aug 25 13:29:32.537216 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2569/5075] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:31 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:32.568360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:32.589202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:32.593543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:32.596386 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-30c610b2-5a32-43fc-872d-4f5d14d2f24b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 0.568587 Aug 25 13:29:32.597791 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2507/5076] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:32 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:29:33.584818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d682c845-ce27-496c-834c-a57f4d477b77 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:33.586534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d682c845-ce27-496c-834c-a57f4d477b77 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:33.601246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d682c845-ce27-496c-834c-a57f4d477b77 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:33.602926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d682c845-ce27-496c-834c-a57f4d477b77 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:33.604148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d682c845-ce27-496c-834c-a57f4d477b77 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:33.606344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d682c845-ce27-496c-834c-a57f4d477b77 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:33.607803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d682c845-ce27-496c-834c-a57f4d477b77 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:33.609112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d682c845-ce27-496c-834c-a57f4d477b77 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:33.677597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:33.681699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:33.714687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:33.715985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:33.721330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:33.723375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:33.724595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:33.726740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:34.339720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d682c845-ce27-496c-834c-a57f4d477b77 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:34.362305 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d682c845-ce27-496c-834c-a57f4d477b77 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 0.785241 Aug 25 13:29:34.367235 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2570/5077] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:33 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:34.426983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:34.446199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:34.449826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:34.452850 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-612b5c63-3445-4296-8038-9f8ad8ca4c32 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 0.818310 Aug 25 13:29:34.456278 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2508/5078] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:33 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:29:35.409613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e6b7bbf0-8ed9-4b76-834e-c41fe4114851 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:35.411980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e6b7bbf0-8ed9-4b76-834e-c41fe4114851 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:35.445421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6b7bbf0-8ed9-4b76-834e-c41fe4114851 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:35.454570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6b7bbf0-8ed9-4b76-834e-c41fe4114851 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:35.457451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6b7bbf0-8ed9-4b76-834e-c41fe4114851 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:35.464557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6b7bbf0-8ed9-4b76-834e-c41fe4114851 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:35.465954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6b7bbf0-8ed9-4b76-834e-c41fe4114851 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:35.467619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6b7bbf0-8ed9-4b76-834e-c41fe4114851 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:35.510142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:35.511452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:35.542513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:35.543544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:35.544367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:35.547060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:35.548069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:35.548933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:36.443628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e6b7bbf0-8ed9-4b76-834e-c41fe4114851 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:36.470230 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e6b7bbf0-8ed9-4b76-834e-c41fe4114851 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1522 microversion: 2.1 time: 1.067727 Aug 25 13:29:36.471892 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2571/5079] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:35 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1522 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:36.767333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:36.833806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:36.845734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:36.856767 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44a8a2f6-abe3-461b-ae96-51c16ca05892 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1724 microversion: 2.20 time: 1.358636 Aug 25 13:29:36.858822 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2509/5080] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:35 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1724 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:29:37.465272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-70cd3613-19a3-4a8a-a542-5b175d63bec9 req-d64a7e2d-4df0-4525-8456-9597e9530bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8", "name": "network-vif-deleted", "tag": "cb3c2149-2c1f-4d29-b5ee-72b8a1da7771"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:37.521649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b408d8e1-fc29-41c4-8836-ff00459c77aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:37.531557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-70cd3613-19a3-4a8a-a542-5b175d63bec9 req-d64a7e2d-4df0-4525-8456-9597e9530bc9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:37.533071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b408d8e1-fc29-41c4-8836-ff00459c77aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:37.544851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-70cd3613-19a3-4a8a-a542-5b175d63bec9 req-d64a7e2d-4df0-4525-8456-9597e9530bc9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:37.547018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-70cd3613-19a3-4a8a-a542-5b175d63bec9 req-d64a7e2d-4df0-4525-8456-9597e9530bc9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:37.559356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b408d8e1-fc29-41c4-8836-ff00459c77aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:37.560386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b408d8e1-fc29-41c4-8836-ff00459c77aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:37.561600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b408d8e1-fc29-41c4-8836-ff00459c77aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:37.563556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b408d8e1-fc29-41c4-8836-ff00459c77aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:37.571299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b408d8e1-fc29-41c4-8836-ff00459c77aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:37.573837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b408d8e1-fc29-41c4-8836-ff00459c77aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:37.610877 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-70cd3613-19a3-4a8a-a542-5b175d63bec9 req-d64a7e2d-4df0-4525-8456-9597e9530bc9 service nova] Creating event network-vif-deleted:cb3c2149-2c1f-4d29-b5ee-72b8a1da7771 for instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 on n-h1-852771-8 Aug 25 13:29:37.664899 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-70cd3613-19a3-4a8a-a542-5b175d63bec9 req-d64a7e2d-4df0-4525-8456-9597e9530bc9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202066 Aug 25 13:29:37.666467 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2572/5081] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:29:37.915853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b408d8e1-fc29-41c4-8836-ff00459c77aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1552e098ea6f4d28abd9606fe9433000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec483f5c53b44c1a52917920b891b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:37.918785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:37.925544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:37.947611 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b408d8e1-fc29-41c4-8836-ff00459c77aa tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 200 len: 1307 microversion: 2.1 time: 0.436311 Aug 25 13:29:37.961841 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2510/5082] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:37 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 1307 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:37.987772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:37.996048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:37.997075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:37.998517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:37.999396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:38.003368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:38.282083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:38.322790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:38.327167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:38.355622 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f3ae4e45-d40e-4a51-b182-16eb6b223d72 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1656 microversion: 2.20 time: 0.447694 Aug 25 13:29:38.361223 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2573/5083] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:37 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1656 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:29:38.998489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:39.001403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] [instance: 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:39.027881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:39.032635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:39.034785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:39.038648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:39.042540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:39.044788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:39.118935 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] HTTP exception thrown: Instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 could not be found. Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Request method failure captured: Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 HTTP/1.1 Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3emkRnp5WsySeZUDuZqp15nFuui5PAZa04O2pdW2hxZe2BKDx44fRGkIEOKF2r11CYee5GPcGik4GpsVJQCgpLsIOIpHtQH9QghePjQ_6mqWpMbkt_tywI60U5M7l4xP6lvwI3wQpC2IoBQiIktCExz3EE3vcgMbQSbvXi9LGsoCek Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dec483f5c53b44c1a52917920b891b9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dec483f5c53b44c1a52917920b891b9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dec483f5c53b44c1a52917920b891b9c"}]}] Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: dec483f5c53b44c1a52917920b891b9c Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-614407780 Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1552e098ea6f4d28abd9606fe9433000 Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-614407780-project Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 could not be found. Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8'} Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 could not be found. Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 could not be found. Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:39.132966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:39.143945 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:39.143945 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:39.143945 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:39.143945 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:39.143945 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:29:39.143945 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:29:39.143945 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 could not be found. Aug 25 13:29:39.143945 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:29:39.143945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] Returning 404 to user: Instance 0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:29:39.150123 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-678bceb7-f6c6-4337-9ed7-68dbaa4f4ab4 tempest-ServerRescueNegativeTestJSON-614407780 tempest-ServerRescueNegativeTestJSON-614407780-project] 10.222.0.70 "GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8" status: 404 len: 111 microversion: 2.1 time: 0.160515 Aug 25 13:29:39.155506 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2574/5084] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:38 2022] GET /compute/v2.1/servers/0e8b26c6-5d11-4a4a-a2bc-4feec988bfe8 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:29:39.414776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:39.417484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:39.453230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:39.457021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:39.462459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:39.463878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:39.466566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:39.472321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:39.556831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8bbde884-eb31-4414-a219-59a77d95c013 req-305b7ab4-7b57-47ab-a1eb-46a422b44056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d404ff6f-0fad-4c7f-bf95-5c0fe210039b", "name": "network-vif-deleted", "tag": "8b68205d-7c61-4adf-ace8-ad7064786841"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:39.601836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8bbde884-eb31-4414-a219-59a77d95c013 req-305b7ab4-7b57-47ab-a1eb-46a422b44056 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:39.602828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8bbde884-eb31-4414-a219-59a77d95c013 req-305b7ab4-7b57-47ab-a1eb-46a422b44056 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:39.603684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8bbde884-eb31-4414-a219-59a77d95c013 req-305b7ab4-7b57-47ab-a1eb-46a422b44056 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:39.610543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:39.611485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:39.612306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:39.613167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lazy-loading 'fault' on Instance uuid d404ff6f-0fad-4c7f-bf95-5c0fe210039b {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:29:39.653835 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8bbde884-eb31-4414-a219-59a77d95c013 req-305b7ab4-7b57-47ab-a1eb-46a422b44056 service nova] Creating event network-vif-deleted:8b68205d-7c61-4adf-ace8-ad7064786841 for instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b on n-h1-852771-8 Aug 25 13:29:39.702484 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8bbde884-eb31-4414-a219-59a77d95c013 req-305b7ab4-7b57-47ab-a1eb-46a422b44056 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.724002 Aug 25 13:29:39.705710 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2511/5085] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:29:39.751011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:39.786275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:39.789589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:39.800187 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0421fdbf-ad8c-480f-a089-5927bcbf7e60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 200 len: 1371 microversion: 2.20 time: 0.397204 Aug 25 13:29:39.804550 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2575/5086] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:39 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 1371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:29:40.847819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:40.849175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:40.880202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:40.881089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:40.895297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:40.900085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:40.901469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:40.902568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:40.973043 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] HTTP exception thrown: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Request method failure captured: Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b HTTP/1.1 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fV6OqGIovTn6ssVW7eyjeID_7H24QtcYDVhxWGtW-LVK0ojz4OAa3vF6qvzOPN4gt3quTmLBQalSl7DDEdG9Twv_5b_6gKP8gPT2xApkV4rtc4C583wiwdmAXS86Jq5t4N2SyI8Tf9ximYAJ8JEZSHPLiaOqL6_Gq9t2fLV4cA4C0 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_37ec962b7eb948ffa6ba84d7571087c4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}] Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b008e1fc747f4b928cac286f7c74d0cf Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'd404ff6f-0fad-4c7f-bf95-5c0fe210039b'} Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:29:40.985146 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Returning 404 to user: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-526311cf-44dd-4e25-974c-27e8905f20bf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 404 len: 111 microversion: 2.20 time: 0.148874 Aug 25 13:29:41.001833 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2512/5087] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:40 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:29:41.009477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b394971-60d7-488a-8713-3c45ed1bbf3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '.version_select at 0x7f3a29383280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:41.097033 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3b394971-60d7-488a-8713-3c45ed1bbf3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1284137577" status: 204 len: 0 microversion: 2.20 time: 0.095252 Aug 25 13:29:41.098185 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2576/5088] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 13:29:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1284137577 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:29:45.290236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed21062d-c89b-46e1-9be2-151fcf3db527 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Action: 'create', calling method: .version_select at 0x7f3a2e905310>, body: {"keypair": {"name": "tempest-keypair-1848265354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKotw31ONNEcZFSeZ9gibIV7lB9j4hsB4aBRUzO3QgNQnq3AiIm4WQKwAkmpXRf/6XW7VMP1h9sM9YXyFjBdfqnG4ELBKLkypTV+aXK9uCqb2ADXQ9wiNjXi1M4JPomZyQ=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:45.341535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:45.393011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ed21062d-c89b-46e1-9be2-151fcf3db527 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Getting quotas for project 37ec962b7eb948ffa6ba84d7571087c4. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:29:45.437760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-ed21062d-c89b-46e1-9be2-151fcf3db527 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Getting quotas for user b008e1fc747f4b928cac286f7c74d0cf and project 37ec962b7eb948ffa6ba84d7571087c4. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:29:45.516232 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed21062d-c89b-46e1-9be2-151fcf3db527 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:29:46.530258 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed21062d-c89b-46e1-9be2-151fcf3db527 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 55182. Aug 25 13:29:46.586372 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ed21062d-c89b-46e1-9be2-151fcf3db527 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.318557 Aug 25 13:29:46.587518 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2513/5089] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Aug 25 13:29:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1323 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 25 13:29:54.075597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:54.078053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:54.089305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2090183192", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bd88387-b4d9-4117-809d-b1796b284ea6"}], "security_groups": [{"name": "tempest-securitygroup--992492829"}], "key_name": "tempest-keypair-1848265354", "user_data": "}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:54.365224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] validate_networks() for [('4bd88387-b4d9-4117-809d-b1796b284ea6', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:29:55.785408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:29:55.786536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:29:55.787946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:29:55.788928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:29:55.789761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:29:55.809289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:55.810365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:55.811287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:55.812791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:55.813818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:55.814732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:55.854949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Getting quotas for project 37ec962b7eb948ffa6ba84d7571087c4. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:29:55.868272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Getting quotas for user b008e1fc747f4b928cac286f7c74d0cf and project 37ec962b7eb948ffa6ba84d7571087c4. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:29:55.890967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:29:55.895026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:29:55.972157 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c7981b95-726b-487e-ac56-b7954eea3d70 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.900729 Aug 25 13:29:55.973575 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2577/5090] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 13:29:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:29:56.004522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-91931000-efee-41b2-ab0f-a983c94b5482 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:56.007970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-91931000-efee-41b2-ab0f-a983c94b5482 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:56.023239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:56.026523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:56.148641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-91931000-efee-41b2-ab0f-a983c94b5482 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:56.170757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-91931000-efee-41b2-ab0f-a983c94b5482 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:56.175191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-91931000-efee-41b2-ab0f-a983c94b5482 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:56.177431 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-91931000-efee-41b2-ab0f-a983c94b5482 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1282 microversion: 2.20 time: 0.181213 Aug 25 13:29:56.179280 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2514/5091] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:55 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:29:57.228325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:57.233464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:57.260267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:57.262367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:57.263189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:57.264560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:57.265571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:57.266221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:57.441562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:57.458688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:57.462987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:57.465744 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d930709-b54d-4ef0-9551-4982ea7d96a4 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1278 microversion: 2.20 time: 0.249532 Aug 25 13:29:57.467309 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2578/5092] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:57 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1278 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:29:58.370381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1941338914", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": "none"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:58.522684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:58.524843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:29:58.525599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:29:58.526678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:29:58.527197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:29:58.528974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:58.535419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:29:58.555098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:58.556009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:58.556827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:58.561636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:58.562509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:58.563285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:58.573351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:58.576321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:58.583627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:58.586159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:58.592185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:58.593472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:58.635564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Getting quotas for project 7e9505a2c19f4fbb8c5d4202a51f9190. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:29:58.671745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Getting quotas for user 2e4c71f531bb449aa457a56e3179207b and project 7e9505a2c19f4fbb8c5d4202a51f9190. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:29:58.703620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:29:58.709750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:29:58.810753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:58.839890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:58.843610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:58.847431 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-021cf8d0-2ce0-4446-ba4d-8d34803df7d3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1340 microversion: 2.20 time: 0.345086 Aug 25 13:29:58.851416 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2579/5093] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:58 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1340 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:29:58.860229 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4e65420-2227-4c47-bca8-b0904c93f963 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.254931 Aug 25 13:29:58.862420 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2515/5094] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Aug 25 13:29:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:29:58.900589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-57804561-4f2d-4db7-a268-f0fda9d3c812 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:58.902595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-57804561-4f2d-4db7-a268-f0fda9d3c812 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:59.118673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-57804561-4f2d-4db7-a268-f0fda9d3c812 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:59.145542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-57804561-4f2d-4db7-a268-f0fda9d3c812 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:59.154319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-57804561-4f2d-4db7-a268-f0fda9d3c812 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:59.156774 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-57804561-4f2d-4db7-a268-f0fda9d3c812 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1278 microversion: 2.57 time: 0.269976 Aug 25 13:29:59.168577 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2580/5095] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:58 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:29:59.921671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:59.923515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:59.951670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:59.961019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:59.961962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:59.963344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:59.968631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:59.972382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:00.220078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:00.231319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:00.255284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:00.257723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:00.260433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:00.262170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:00.265309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:00.266580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:00.458611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:00.494951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:00.510453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:00.512781 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0ffc3807-227a-4373-a6c4-c1ad559092bc tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1407 microversion: 2.20 time: 0.605591 Aug 25 13:30:00.534437 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2516/5096] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:29:59 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1407 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:30:00.681422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:00.702952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:00.707767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:00.711092 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a5c4e543-4d1c-4cfb-a17c-a72d73829e86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1282 microversion: 2.57 time: 0.499129 Aug 25 13:30:00.712483 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2581/5097] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:00 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1282 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:30:00.825768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89675379-04c5-438a-af41-a43ad2f7f050 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:00.830473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89675379-04c5-438a-af41-a43ad2f7f050 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:00.848013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89675379-04c5-438a-af41-a43ad2f7f050 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:00.848971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89675379-04c5-438a-af41-a43ad2f7f050 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:00.851455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89675379-04c5-438a-af41-a43ad2f7f050 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:00.854000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89675379-04c5-438a-af41-a43ad2f7f050 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:00.855152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89675379-04c5-438a-af41-a43ad2f7f050 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:00.857236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89675379-04c5-438a-af41-a43ad2f7f050 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:00.954228 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89675379-04c5-438a-af41-a43ad2f7f050 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139951 Aug 25 13:30:00.968944 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2517/5098] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:30:00 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:30:01.108892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-170962ba-11eb-483b-84a8-b2ced816b69b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:01.110781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-170962ba-11eb-483b-84a8-b2ced816b69b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:01.131364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-170962ba-11eb-483b-84a8-b2ced816b69b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:01.132900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-170962ba-11eb-483b-84a8-b2ced816b69b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:01.134453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-170962ba-11eb-483b-84a8-b2ced816b69b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:01.137306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-170962ba-11eb-483b-84a8-b2ced816b69b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:01.139199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-170962ba-11eb-483b-84a8-b2ced816b69b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:01.140342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-170962ba-11eb-483b-84a8-b2ced816b69b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:01.247819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-170962ba-11eb-483b-84a8-b2ced816b69b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:30:01.548789 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-170962ba-11eb-483b-84a8-b2ced816b69b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 204 len: 0 microversion: 2.1 time: 0.447585 Aug 25 13:30:01.551409 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2582/5099] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:30:01 2022] DELETE /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:30:01.588707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d9fdea3-80bd-4cfc-bfc8-9148414952e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:01.589011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:01.590043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8d9fdea3-80bd-4cfc-bfc8-9148414952e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:01.590230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:01.602572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:01.603405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:01.604419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:01.606577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:01.607747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:01.608469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:01.646783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d9fdea3-80bd-4cfc-bfc8-9148414952e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:01.652781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d9fdea3-80bd-4cfc-bfc8-9148414952e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:01.655912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d9fdea3-80bd-4cfc-bfc8-9148414952e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:01.673931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d9fdea3-80bd-4cfc-bfc8-9148414952e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:01.675677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d9fdea3-80bd-4cfc-bfc8-9148414952e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:01.676900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d9fdea3-80bd-4cfc-bfc8-9148414952e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:02.414591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:02.445383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:02.447314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d9fdea3-80bd-4cfc-bfc8-9148414952e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:02.451807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:02.455279 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3992d835-51cd-4c58-aa47-90e5db3181e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1407 microversion: 2.20 time: 0.879348 Aug 25 13:30:02.458589 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2583/5100] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:01 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1407 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:30:02.470232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:02.472110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:02.501405 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d9fdea3-80bd-4cfc-bfc8-9148414952e3 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1673 microversion: 2.1 time: 0.938910 Aug 25 13:30:02.501907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:02.504472 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2518/5101] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:01 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1673 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:02.506624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:02.512095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:02.516414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:02.519084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:02.526156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:03.145376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7583c4b0-e2e7-41ad-aec3-1f01495c39c7 req-2f2b92b1-211f-46ed-9d11-7359f575b3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d84654-c8b1-496b-992d-8d0d80b25316", "tag": "76dc1323-87f8-4b14-9fdf-6ed8548e9491"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:03.201329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7583c4b0-e2e7-41ad-aec3-1f01495c39c7 req-2f2b92b1-211f-46ed-9d11-7359f575b3a3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:03.202389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7583c4b0-e2e7-41ad-aec3-1f01495c39c7 req-2f2b92b1-211f-46ed-9d11-7359f575b3a3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:03.203525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7583c4b0-e2e7-41ad-aec3-1f01495c39c7 req-2f2b92b1-211f-46ed-9d11-7359f575b3a3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:03.234436 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7583c4b0-e2e7-41ad-aec3-1f01495c39c7 req-2f2b92b1-211f-46ed-9d11-7359f575b3a3 service nova] Creating event network-changed:76dc1323-87f8-4b14-9fdf-6ed8548e9491 for instance 32d84654-c8b1-496b-992d-8d0d80b25316 on n-h2-852771-8 Aug 25 13:30:03.246369 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7583c4b0-e2e7-41ad-aec3-1f01495c39c7 req-2f2b92b1-211f-46ed-9d11-7359f575b3a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111938 Aug 25 13:30:03.249167 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2519/5102] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:03.352513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:03.368894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:03.372460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:03.375248 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dd77a2a1-cda9-4fbb-ae48-e439cd9cce47 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1348 microversion: 2.57 time: 0.913607 Aug 25 13:30:03.377089 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2584/5103] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:02 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1348 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:03.512813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:03.520640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:03.535074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:03.536478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:03.538218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:03.539920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:03.544206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:03.546504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:03.552329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c4cf098c-1e2a-495c-a7d5-3cd9f312c5d9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:03.566591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c4cf098c-1e2a-495c-a7d5-3cd9f312c5d9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:03.578844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4cf098c-1e2a-495c-a7d5-3cd9f312c5d9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:03.584911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4cf098c-1e2a-495c-a7d5-3cd9f312c5d9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:03.586029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4cf098c-1e2a-495c-a7d5-3cd9f312c5d9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:03.588959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4cf098c-1e2a-495c-a7d5-3cd9f312c5d9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:03.593000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4cf098c-1e2a-495c-a7d5-3cd9f312c5d9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:03.594155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4cf098c-1e2a-495c-a7d5-3cd9f312c5d9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:04.405420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:04.434821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:04.438883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:04.440843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c4cf098c-1e2a-495c-a7d5-3cd9f312c5d9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:04.442895 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fc049b32-257b-456f-a263-076eecdc54c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1407 microversion: 2.20 time: 0.941730 Aug 25 13:30:04.466102 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2520/5104] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:03 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1407 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:04.474412 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c4cf098c-1e2a-495c-a7d5-3cd9f312c5d9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1673 microversion: 2.1 time: 0.928863 Aug 25 13:30:04.481723 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2585/5105] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:03 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1673 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:04.499574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:04.513869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:04.541127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:04.542031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:04.543869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:04.547101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:04.548414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:04.549422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:04.829450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:04.863683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:04.876520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:04.879610 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-346c4bf6-ad4d-47d5-bad7-733f63a94e26 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1336 microversion: 2.57 time: 0.409948 Aug 25 13:30:04.887307 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2521/5106] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:04 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1336 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:05.246692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f81a803e-0e85-434c-bb18-6e22a4599713 req-a5046000-e039-4eba-9ec5-964e6d5bcf6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2166b072-a2e3-469f-b49a-ac99195a5827", "name": "network-vif-deleted", "tag": "a1978be4-1d77-48fd-bcc9-8ff374eb81e7"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:05.287660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f81a803e-0e85-434c-bb18-6e22a4599713 req-a5046000-e039-4eba-9ec5-964e6d5bcf6a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:05.288949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f81a803e-0e85-434c-bb18-6e22a4599713 req-a5046000-e039-4eba-9ec5-964e6d5bcf6a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:05.290200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f81a803e-0e85-434c-bb18-6e22a4599713 req-a5046000-e039-4eba-9ec5-964e6d5bcf6a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:05.328377 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f81a803e-0e85-434c-bb18-6e22a4599713 req-a5046000-e039-4eba-9ec5-964e6d5bcf6a service nova] Creating event network-vif-deleted:a1978be4-1d77-48fd-bcc9-8ff374eb81e7 for instance 2166b072-a2e3-469f-b49a-ac99195a5827 on n-h1-852771-8 Aug 25 13:30:05.341349 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f81a803e-0e85-434c-bb18-6e22a4599713 req-a5046000-e039-4eba-9ec5-964e6d5bcf6a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104692 Aug 25 13:30:05.343408 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2586/5107] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:05.512169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:05.516901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:05.564695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:05.570349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:05.572402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:05.582852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:05.585696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:05.593480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:05.600863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:05.606506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:05.612851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:05.613913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:05.614717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:05.619464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:05.620421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:05.621258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:05.793054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:05.795472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:05.797657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:05.799048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lazy-loading 'fault' on Instance uuid 2166b072-a2e3-469f-b49a-ac99195a5827 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:30:05.832183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:06.174993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:06.219545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:06.222873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:06.225325 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-63740fd0-bb81-48da-a63b-67e6eda874f3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1407 microversion: 2.20 time: 0.737822 Aug 25 13:30:06.241444 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2522/5108] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:05 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1407 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:06.272238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:06.290356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:06.292663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:06.315512 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eaa7ed66-f413-495b-a36e-fc9b7abe0f99 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 200 len: 1326 microversion: 2.1 time: 0.769610 Aug 25 13:30:06.319002 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2587/5109] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:05 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 1326 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:06.333833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:06.336099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:06.337593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:06.339940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:06.341319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:06.342024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:06.520708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:06.543809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:06.547194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:06.549219 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-954150de-6bb6-45de-abc8-c0d8874a21f2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1336 microversion: 2.57 time: 0.305599 Aug 25 13:30:06.561548 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2523/5110] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:06 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1336 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:07.297389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:07.300373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:07.318014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:07.321067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:07.322367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:07.325163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:07.326732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:07.330215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:07.379000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:07.380168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:07.408777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:07.412502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:07.416380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:07.419318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:07.422672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:07.424033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:07.489126 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] HTTP exception thrown: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Request method failure captured: Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 HTTP/1.1 Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3gBLi1uKUWANpYqcbcFYPdnBylKytpfnlg8LFzHfrIdDHosTzM7lfi7yOQMgvQDR6XYW6W4VHoZFCVD_nfVljgVdFk2uvXde6V--Hhjljc6Y9BGZ35h830QFG47V_HO55OgAkrcvaVnOtFo958wKZ3iXfbA4p9btTprzLoKxtOrtFA Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_103003f7cdb1448491050c8c627764e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/103003f7cdb1448491050c8c627764e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}] Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: c8f37e1d986144ccb4ff3523d6b8c226 Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '2166b072-a2e3-469f-b49a-ac99195a5827'} Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:30:07.503051 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:30:07.519475 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:07.519475 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:30:07.519475 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:30:07.519475 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:30:07.519475 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:30:07.519475 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:30:07.519475 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:30:07.519475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Returning 404 to user: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:30:07.519475 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7acab136-c1ba-4fe6-8ffa-832c716b0ba0 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 404 len: 111 microversion: 2.1 time: 0.150167 Aug 25 13:30:07.519475 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2524/5111] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:07 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:30:07.546969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2a301bac-96ca-4466-802b-0c92157ed343 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '.version_select at 0x7f3a2a4273a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:07.643627 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2a301bac-96ca-4466-802b-0c92157ed343 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488751786" status: 202 len: 0 microversion: 2.1 time: 0.118514 Aug 25 13:30:07.645980 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2525/5112] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 13:30:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488751786 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:30:07.685284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:07.687800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:07.732031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:07.733765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:07.738307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:07.741071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:07.745839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:07.752372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:08.043426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:08.087204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:08.090615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:08.093068 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dcbffd96-880a-4fd6-881f-29e0f2644e7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1357 microversion: 2.57 time: 0.443407 Aug 25 13:30:08.106299 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2526/5113] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:07 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1357 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:08.116493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:08.153487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:08.156957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:08.161328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:08.164360 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7fb16ff7-aa48-481b-8057-2ce26a15bcdf tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1407 microversion: 2.20 time: 0.879902 Aug 25 13:30:08.165268 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2588/5114] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:07 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1407 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:08.167029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:08.208166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:08.212363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:08.213316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:08.214773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:08.217870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:08.221078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:08.570735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:30:08.573002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:30:08.574824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:30:08.576408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:30:08.578448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:30:08.690712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:08.696397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:08.803792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:08.820675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:08.822243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:08.823513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:08.825738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:08.828539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:08.831290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:08.975567 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d8ae74cf-9622-40c1-a7c2-93aed9fe45ad tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "POST /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330/action" status: 202 len: 1138 microversion: 2.57 time: 0.824890 Aug 25 13:30:08.991637 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2527/5115] 10.222.0.70 () {62 vars in 1320 bytes} [Thu Aug 25 13:30:08 2022] POST /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330/action => generated 1138 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 25 13:30:09.029151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:09.033415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:09.084664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:09.088697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:09.089952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:09.091332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:09.092198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:09.093033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:09.186096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:09.224747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:09.226352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:09.289624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:09.289624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:09.294334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:09.298616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:09.300083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:09.302129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:09.793850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:09.840424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:09.854424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:09.863427 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ec64df2d-86a8-492f-b447-9c78704d4065 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.839725 Aug 25 13:30:09.867699 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2589/5116] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:09 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:09.984036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:10.004586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:10.008673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:10.011351 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bea0e62b-570a-4b46-8617-87907b9fbe74 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1407 microversion: 2.20 time: 0.796213 Aug 25 13:30:10.013271 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2528/5117] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:09 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1407 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:10.110715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-00f6d262-7fa1-467f-8e1d-62bc0ff45564 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'create', calling method: .version_select at 0x7f3a29337b80>, body: {"keypair": {"name": "tempest-keypair-1519696221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECRoUvCxR2vZCRNz1naCqWsLHurKgFNhTp4W5yjiYQcUKkyZ4m0Fk67vE8h0qiMiOcfXR6lMOjSYzI+IDQfD+MJuUYUxBUVIY87+KCKdNJWfevQYtERwYGJEPw4os9DnQ=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:10.141851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-00f6d262-7fa1-467f-8e1d-62bc0ff45564 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Getting quotas for project 103003f7cdb1448491050c8c627764e0. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:30:10.156323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-00f6d262-7fa1-467f-8e1d-62bc0ff45564 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Getting quotas for user c8f37e1d986144ccb4ff3523d6b8c226 and project 103003f7cdb1448491050c8c627764e0. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:30:10.211677 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-00f6d262-7fa1-467f-8e1d-62bc0ff45564 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108340 Aug 25 13:30:10.214055 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2590/5118] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:30:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:30:10.916456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:10.917662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:10.946409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:10.948041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:10.957949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:10.960071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:10.968545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:10.969497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:11.077552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:11.079232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:11.102159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:11.114172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:11.116708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:11.118004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:11.119288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:11.120058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:11.203504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:11.248533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:11.252657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:11.255470 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e8742d9c-d7b8-45fe-bf7f-53557175a3e6 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.348712 Aug 25 13:30:11.257548 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2529/5119] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:10 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:11.684207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:11.704994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:11.710167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:11.712707 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b75823c-14e3-41b1-a542-dfd7c02ad5ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1407 microversion: 2.20 time: 0.647382 Aug 25 13:30:11.713822 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2591/5120] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:11 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1407 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:30:12.306614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:12.308817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:12.326580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:12.327895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:12.329054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:12.330803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:12.332158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:12.334727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:12.409843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2a77e38b-17be-4bb0-bd84-2445008cd8c8 req-d34c78a3-ded6-4c1d-b637-804a24f1f18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d84654-c8b1-496b-992d-8d0d80b25316", "name": "network-vif-plugged", "status": "completed", "tag": "76dc1323-87f8-4b14-9fdf-6ed8548e9491"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:12.441149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a77e38b-17be-4bb0-bd84-2445008cd8c8 req-d34c78a3-ded6-4c1d-b637-804a24f1f18c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:12.442753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a77e38b-17be-4bb0-bd84-2445008cd8c8 req-d34c78a3-ded6-4c1d-b637-804a24f1f18c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:12.444427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a77e38b-17be-4bb0-bd84-2445008cd8c8 req-d34c78a3-ded6-4c1d-b637-804a24f1f18c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:12.469636 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2a77e38b-17be-4bb0-bd84-2445008cd8c8 req-d34c78a3-ded6-4c1d-b637-804a24f1f18c service nova] Creating event network-vif-plugged:76dc1323-87f8-4b14-9fdf-6ed8548e9491 for instance 32d84654-c8b1-496b-992d-8d0d80b25316 on n-h2-852771-8 Aug 25 13:30:12.482899 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2a77e38b-17be-4bb0-bd84-2445008cd8c8 req-d34c78a3-ded6-4c1d-b637-804a24f1f18c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079411 Aug 25 13:30:12.484894 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2592/5121] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:30:12.512755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:12.535755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:12.540502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:12.545143 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-34770704-1df2-495e-8c50-60fa460e0d90 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.246469 Aug 25 13:30:12.547780 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2530/5122] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:12 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:12.765316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:12.766705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:12.785846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:12.789147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:12.791540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:12.802460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:12.804763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:12.806324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:13.276083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:13.292894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:13.296255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:13.298594 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-24dfe2e2-3b0f-452e-b118-d4ae7e620b48 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1407 microversion: 2.20 time: 0.549322 Aug 25 13:30:13.300575 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2593/5123] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:12 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1407 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:13.598507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:13.601665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:13.619636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:13.620525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:13.621307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:13.623109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:13.624240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:13.626302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:13.789639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:13.797980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1082816234", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a4c0468-d3e7-46ab-a86e-24f51de4bb88"}], "security_groups": [{"name": "tempest-securitygroup--1837096148"}], "key_name": "tempest-keypair-1519696221", "user_data": "}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:13.806670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:13.809849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:13.812293 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-85b7d30c-42df-446e-aa3c-22ecfa6ce5cc tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.221638 Aug 25 13:30:13.813905 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2531/5124] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:13 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:14.008248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] validate_networks() for [('9a4c0468-d3e7-46ab-a86e-24f51de4bb88', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:30:14.357409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:14.359414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:14.375022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:14.375951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:14.376845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:14.378544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:14.379671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:14.380511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:14.427171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:14.914380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:14.935976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:14.940337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:14.944292 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b4497a5d-d80f-40b3-ba66-9bbb1df0564a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1407 microversion: 2.20 time: 0.602389 Aug 25 13:30:14.946238 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2532/5125] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:14 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1407 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:14.965420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:14.966387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:14.983200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:14.989576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:14.989576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:14.989576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:14.989576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:14.991394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:14.997632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:30:14.998499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:30:14.999002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:30:14.999833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:30:15.001176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:30:15.034357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:15.035933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:15.037290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:15.039702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:15.040406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:15.041160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:15.082301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Getting quotas for project 103003f7cdb1448491050c8c627764e0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:30:15.111553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Getting quotas for user c8f37e1d986144ccb4ff3523d6b8c226 and project 103003f7cdb1448491050c8c627764e0. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:30:15.145421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:30:15.152926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:30:15.165235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:15.187423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:15.197296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:15.197838 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d97ddd86-61d6-493c-885c-a61d92102aca tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.249525 Aug 25 13:30:15.199278 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2533/5126] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:14 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:15.287320 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c66a620-03da-485e-9d86-177102409f50 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.496931 Aug 25 13:30:15.288697 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2594/5127] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:30:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:30:15.310105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-82fba8e6-45d6-42ab-b238-7de39750dff1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:15.311318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-82fba8e6-45d6-42ab-b238-7de39750dff1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:15.490424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-82fba8e6-45d6-42ab-b238-7de39750dff1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:15.514940 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-82fba8e6-45d6-42ab-b238-7de39750dff1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1238 microversion: 2.1 time: 0.212460 Aug 25 13:30:15.519626 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2534/5128] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:15 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1238 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:15.990795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:15.992320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:16.019079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:16.023369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:16.027793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:16.028214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:16.029209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:16.031624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:16.254142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:16.258713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:16.278196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:16.282600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:16.284216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:16.285381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:16.288014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:16.289370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:16.291216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:16.499841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:16.556987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:16.560035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:16.573013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:16.576769 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3153c9b3-80a0-426f-af30-74986d792bef tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.332758 Aug 25 13:30:16.581116 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2535/5129] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:16 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:16.585295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:16.589437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:16.592644 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3bb857ec-93e4-497a-8468-df7d79f0b663 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1598 microversion: 2.20 time: 0.608121 Aug 25 13:30:16.594920 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2595/5130] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:15 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1598 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:16.619224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ddbe0ac8-4257-464a-8d59-12ef75644718 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:16.624514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ddbe0ac8-4257-464a-8d59-12ef75644718 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:16.640287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b8b1223f-1afc-4883-85ab-f38f81e19f47 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:16.642397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b8b1223f-1afc-4883-85ab-f38f81e19f47 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:16.661971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8b1223f-1afc-4883-85ab-f38f81e19f47 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:16.663534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8b1223f-1afc-4883-85ab-f38f81e19f47 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:16.665175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8b1223f-1afc-4883-85ab-f38f81e19f47 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:16.666869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8b1223f-1afc-4883-85ab-f38f81e19f47 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:16.667982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8b1223f-1afc-4883-85ab-f38f81e19f47 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:16.669038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8b1223f-1afc-4883-85ab-f38f81e19f47 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:16.679171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:16.793260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ddbe0ac8-4257-464a-8d59-12ef75644718 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:16.814267 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ddbe0ac8-4257-464a-8d59-12ef75644718 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1238 microversion: 2.1 time: 0.217046 Aug 25 13:30:16.837628 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2536/5131] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:16 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1238 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:16.903756 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b8b1223f-1afc-4883-85ab-f38f81e19f47 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.271516 Aug 25 13:30:16.904814 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2596/5132] 10.222.0.70 () {60 vars in 1316 bytes} [Thu Aug 25 13:30:16 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:30:17.629075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:17.630422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:17.650591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:17.651892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:17.653430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:17.655376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:17.656443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:17.657595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:17.862501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-223da8b8-e24b-46c1-8262-e0139f62d740 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:17.863772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-223da8b8-e24b-46c1-8262-e0139f62d740 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:17.890221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-223da8b8-e24b-46c1-8262-e0139f62d740 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:17.895908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-223da8b8-e24b-46c1-8262-e0139f62d740 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:17.897124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-223da8b8-e24b-46c1-8262-e0139f62d740 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:17.898787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-223da8b8-e24b-46c1-8262-e0139f62d740 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:17.910772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:17.919979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-223da8b8-e24b-46c1-8262-e0139f62d740 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:17.921684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-223da8b8-e24b-46c1-8262-e0139f62d740 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:17.946776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:17.956880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:17.962007 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ac7dcded-9ccd-4357-b74e-0a51618394e8 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.337668 Aug 25 13:30:17.966748 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2537/5133] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:17 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:18.682070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-223da8b8-e24b-46c1-8262-e0139f62d740 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:18.698329 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-223da8b8-e24b-46c1-8262-e0139f62d740 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1298 microversion: 2.1 time: 0.844696 Aug 25 13:30:18.700217 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2597/5134] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:17 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1298 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:19.024420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:19.027525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:19.047916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:19.049261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:19.050133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:19.051519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:19.054547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:19.056689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:19.362935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:19.391671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:19.394664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:19.397809 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b1b61abb-eced-4e81-b66a-afe5e103f23d tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.385179 Aug 25 13:30:19.399885 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2538/5135] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:19 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:19.744585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a8386e9-a530-4f7e-bad8-a416f19c1d71 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:19.747304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7a8386e9-a530-4f7e-bad8-a416f19c1d71 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:19.765703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a8386e9-a530-4f7e-bad8-a416f19c1d71 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:19.765703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a8386e9-a530-4f7e-bad8-a416f19c1d71 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:19.767164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a8386e9-a530-4f7e-bad8-a416f19c1d71 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:19.768874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a8386e9-a530-4f7e-bad8-a416f19c1d71 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:19.769781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a8386e9-a530-4f7e-bad8-a416f19c1d71 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:19.770772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a8386e9-a530-4f7e-bad8-a416f19c1d71 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:20.058702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7a8386e9-a530-4f7e-bad8-a416f19c1d71 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:20.075777 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a8386e9-a530-4f7e-bad8-a416f19c1d71 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1296 microversion: 2.1 time: 0.339133 Aug 25 13:30:20.077098 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2598/5136] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:19 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1296 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:20.444452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:20.445585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:20.467723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:20.468645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:20.469455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:20.470788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:20.471539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:20.472288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:20.739771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:20.767768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:20.773050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:20.776430 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6ced7c32-a99f-4ea8-b746-eeb427fbacb5 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.339010 Aug 25 13:30:20.799723 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2539/5137] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:20 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:20.933107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-afe0c7fd-8099-412d-8c29-ec9877cf43df req-f41a6500-eb1f-4caf-9f5c-6499390b8469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d84654-c8b1-496b-992d-8d0d80b25316", "tag": "76dc1323-87f8-4b14-9fdf-6ed8548e9491"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:20.955879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-afe0c7fd-8099-412d-8c29-ec9877cf43df req-f41a6500-eb1f-4caf-9f5c-6499390b8469 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:20.957306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-afe0c7fd-8099-412d-8c29-ec9877cf43df req-f41a6500-eb1f-4caf-9f5c-6499390b8469 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:20.958632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-afe0c7fd-8099-412d-8c29-ec9877cf43df req-f41a6500-eb1f-4caf-9f5c-6499390b8469 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:20.984223 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-afe0c7fd-8099-412d-8c29-ec9877cf43df req-f41a6500-eb1f-4caf-9f5c-6499390b8469 service nova] Creating event network-changed:76dc1323-87f8-4b14-9fdf-6ed8548e9491 for instance 32d84654-c8b1-496b-992d-8d0d80b25316 on n-h2-852771-8 Aug 25 13:30:20.998035 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-afe0c7fd-8099-412d-8c29-ec9877cf43df req-f41a6500-eb1f-4caf-9f5c-6499390b8469 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072463 Aug 25 13:30:21.000351 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2599/5138] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:21.119867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bea2f749-8e65-4a68-b2f3-08f1c154d7be tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:21.121705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bea2f749-8e65-4a68-b2f3-08f1c154d7be tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:21.138463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea2f749-8e65-4a68-b2f3-08f1c154d7be tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:21.140721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea2f749-8e65-4a68-b2f3-08f1c154d7be tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:21.142246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea2f749-8e65-4a68-b2f3-08f1c154d7be tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:21.145321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea2f749-8e65-4a68-b2f3-08f1c154d7be tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:21.148313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea2f749-8e65-4a68-b2f3-08f1c154d7be tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:21.149929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bea2f749-8e65-4a68-b2f3-08f1c154d7be tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:21.355845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bea2f749-8e65-4a68-b2f3-08f1c154d7be tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:21.371060 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bea2f749-8e65-4a68-b2f3-08f1c154d7be tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1296 microversion: 2.1 time: 0.262833 Aug 25 13:30:21.386463 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2540/5139] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:21 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1296 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:21.831669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:21.836668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:21.858640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:21.867729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:21.869097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:21.870392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:21.873115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:21.874391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:21.875413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:22.176203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:22.205830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:22.210496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:22.212876 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e57c76b0-cb02-4380-9fb6-755a151e5303 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.391239 Aug 25 13:30:22.214627 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2600/5140] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:21 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:22.410250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-07cda877-a277-4ad5-a739-3464dea93d46 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:22.411642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-07cda877-a277-4ad5-a739-3464dea93d46 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:22.434186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07cda877-a277-4ad5-a739-3464dea93d46 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:22.435773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07cda877-a277-4ad5-a739-3464dea93d46 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:22.436869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07cda877-a277-4ad5-a739-3464dea93d46 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:22.438612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07cda877-a277-4ad5-a739-3464dea93d46 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:22.439873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07cda877-a277-4ad5-a739-3464dea93d46 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:22.441113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07cda877-a277-4ad5-a739-3464dea93d46 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:23.166050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-07cda877-a277-4ad5-a739-3464dea93d46 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:23.204181 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-07cda877-a277-4ad5-a739-3464dea93d46 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1364 microversion: 2.1 time: 0.801894 Aug 25 13:30:23.210502 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2541/5141] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:22 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1364 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:23.263228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:23.264061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:23.297490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:23.298741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:23.299932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:23.303166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:23.307732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:23.310499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:23.620088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:23.650860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:23.654346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:23.657277 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a9feaea0-a703-47e8-8e8f-d0ca432113e1 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.402470 Aug 25 13:30:23.659206 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2601/5142] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:23 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:24.252452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3e176ee8-49e1-4e5d-96f8-e27bf24b1172 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:24.254820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3e176ee8-49e1-4e5d-96f8-e27bf24b1172 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:24.269974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e176ee8-49e1-4e5d-96f8-e27bf24b1172 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:24.271403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e176ee8-49e1-4e5d-96f8-e27bf24b1172 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:24.272534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e176ee8-49e1-4e5d-96f8-e27bf24b1172 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:24.274242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e176ee8-49e1-4e5d-96f8-e27bf24b1172 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:24.275406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e176ee8-49e1-4e5d-96f8-e27bf24b1172 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:24.276498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e176ee8-49e1-4e5d-96f8-e27bf24b1172 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:24.704010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:24.712504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:24.735414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:24.738351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:24.739671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:24.743008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:24.744198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:24.745567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:24.969272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:24.991102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:24.995539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:24.998779 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12a437e2-4bd9-4bfc-926f-fbc9237837c3 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.302166 Aug 25 13:30:25.000978 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2602/5143] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:24 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:30:25.272349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3e176ee8-49e1-4e5d-96f8-e27bf24b1172 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:25.301597 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3e176ee8-49e1-4e5d-96f8-e27bf24b1172 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1364 microversion: 2.1 time: 1.055808 Aug 25 13:30:25.306816 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2542/5144] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:24 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1364 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:25.553282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-3be2afb2-3ef5-4ec8-bdc5-4e9622d68f9d req-08699014-a6ce-49b3-ac79-1b24e391e3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc60335-156b-4f4a-b26a-9b169d3cf720", "tag": "813c3e05-6360-4f50-9a65-874e99fbf054"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:25.563234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:25.564957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:25.577931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3be2afb2-3ef5-4ec8-bdc5-4e9622d68f9d req-08699014-a6ce-49b3-ac79-1b24e391e3a2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:25.579510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3be2afb2-3ef5-4ec8-bdc5-4e9622d68f9d req-08699014-a6ce-49b3-ac79-1b24e391e3a2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:25.580780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3be2afb2-3ef5-4ec8-bdc5-4e9622d68f9d req-08699014-a6ce-49b3-ac79-1b24e391e3a2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:25.607008 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-3be2afb2-3ef5-4ec8-bdc5-4e9622d68f9d req-08699014-a6ce-49b3-ac79-1b24e391e3a2 service nova] Creating event network-changed:813c3e05-6360-4f50-9a65-874e99fbf054 for instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 on n-h1-852771-8 Aug 25 13:30:25.618505 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-3be2afb2-3ef5-4ec8-bdc5-4e9622d68f9d req-08699014-a6ce-49b3-ac79-1b24e391e3a2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071399 Aug 25 13:30:25.621271 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2603/5145] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:26.043512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:26.044470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:26.055364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:26.056244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:26.056787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:26.057664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:26.058418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:26.059010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:26.235621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:26.252131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:26.254979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:26.258942 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e71eb38-f499-44a9-a039-4c5c6aca5bb2 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.220056 Aug 25 13:30:26.260465 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2543/5146] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:26 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:30:26.341629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c6488a3-021c-4ca0-b9c3-34c674e4c774 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:26.344239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c6488a3-021c-4ca0-b9c3-34c674e4c774 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:26.358505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6488a3-021c-4ca0-b9c3-34c674e4c774 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:26.359678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6488a3-021c-4ca0-b9c3-34c674e4c774 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:26.360525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6488a3-021c-4ca0-b9c3-34c674e4c774 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:26.361491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6488a3-021c-4ca0-b9c3-34c674e4c774 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:26.362263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6488a3-021c-4ca0-b9c3-34c674e4c774 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:26.363130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6488a3-021c-4ca0-b9c3-34c674e4c774 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:26.681070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7c6488a3-021c-4ca0-b9c3-34c674e4c774 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:26.696313 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c6488a3-021c-4ca0-b9c3-34c674e4c774 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1364 microversion: 2.1 time: 0.362547 Aug 25 13:30:26.707635 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2604/5147] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:26 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1364 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:27.305344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:27.306606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:27.311392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:27.325687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:27.326603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:27.328269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:27.329599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:27.330386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:27.331196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:27.468962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:27.485293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:27.488606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:27.491542 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3076c690-dea4-414f-9bfa-e442c7f11651 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.195368 Aug 25 13:30:27.492976 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2544/5148] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:27 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:27.732577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c005b521-4ed8-4a15-9439-070f191e083f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:27.733899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c005b521-4ed8-4a15-9439-070f191e083f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:27.747605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c005b521-4ed8-4a15-9439-070f191e083f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:27.748514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c005b521-4ed8-4a15-9439-070f191e083f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:27.749554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c005b521-4ed8-4a15-9439-070f191e083f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:27.750974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c005b521-4ed8-4a15-9439-070f191e083f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:27.751983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c005b521-4ed8-4a15-9439-070f191e083f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:27.752686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c005b521-4ed8-4a15-9439-070f191e083f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:28.026263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c005b521-4ed8-4a15-9439-070f191e083f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:28.041746 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c005b521-4ed8-4a15-9439-070f191e083f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1364 microversion: 2.1 time: 0.317306 Aug 25 13:30:28.042851 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2605/5149] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:27 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1364 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:28.541817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:28.542707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:28.557065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:28.557983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:28.558805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:28.560114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:28.561118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:28.562153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:28.701199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:28.718338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:28.721793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:28.724565 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2c430d2a-1452-4d7f-bdbc-5b91dcb614e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.192933 Aug 25 13:30:28.725669 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2545/5150] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:28 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:29.085162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63fed40c-8b4a-41db-a0ea-ebe97ffee3f6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:29.086621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-63fed40c-8b4a-41db-a0ea-ebe97ffee3f6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:29.103895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63fed40c-8b4a-41db-a0ea-ebe97ffee3f6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:29.105354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63fed40c-8b4a-41db-a0ea-ebe97ffee3f6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:29.106352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63fed40c-8b4a-41db-a0ea-ebe97ffee3f6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:29.107956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63fed40c-8b4a-41db-a0ea-ebe97ffee3f6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:29.108984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63fed40c-8b4a-41db-a0ea-ebe97ffee3f6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:29.110928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63fed40c-8b4a-41db-a0ea-ebe97ffee3f6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:29.576346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63fed40c-8b4a-41db-a0ea-ebe97ffee3f6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:29.616842 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-63fed40c-8b4a-41db-a0ea-ebe97ffee3f6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1364 microversion: 2.1 time: 0.540823 Aug 25 13:30:29.623371 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2606/5151] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:29 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1364 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:29.772180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:29.779057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:29.804359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:29.812224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:29.813460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:29.815154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:29.816319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:29.829056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:30.102761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:30.128210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:30.133016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:30.135723 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aa593383-2559-41c9-abe2-2b667f2c3177 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.372156 Aug 25 13:30:30.137791 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2546/5152] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:29 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:30.674713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5590b0b9-ab45-4afa-b3e0-55da1bce7268 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:30.676542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5590b0b9-ab45-4afa-b3e0-55da1bce7268 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:30.692001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5590b0b9-ab45-4afa-b3e0-55da1bce7268 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:30.693880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5590b0b9-ab45-4afa-b3e0-55da1bce7268 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:30.694539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5590b0b9-ab45-4afa-b3e0-55da1bce7268 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:30.696156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5590b0b9-ab45-4afa-b3e0-55da1bce7268 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:30.697261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5590b0b9-ab45-4afa-b3e0-55da1bce7268 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:30.698085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5590b0b9-ab45-4afa-b3e0-55da1bce7268 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:30.986965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5590b0b9-ab45-4afa-b3e0-55da1bce7268 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:31.004827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5590b0b9-ab45-4afa-b3e0-55da1bce7268 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1364 microversion: 2.1 time: 0.341134 Aug 25 13:30:31.007909 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2607/5153] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:30 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:31.186871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:31.188456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:31.211020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:31.213183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:31.214789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:31.216451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:31.218042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:31.220837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:31.399125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:31.419574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:31.438960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:31.441788 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6b255a70-f603-439b-bc21-c064c51385da tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.269237 Aug 25 13:30:31.459574 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2547/5154] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:31 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:32.049498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-40898127-0dca-488c-9dce-85f440114b5f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:32.050629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-40898127-0dca-488c-9dce-85f440114b5f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:32.064181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40898127-0dca-488c-9dce-85f440114b5f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:32.065108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40898127-0dca-488c-9dce-85f440114b5f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:32.066091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40898127-0dca-488c-9dce-85f440114b5f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:32.067369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40898127-0dca-488c-9dce-85f440114b5f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:32.068252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40898127-0dca-488c-9dce-85f440114b5f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:32.069067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40898127-0dca-488c-9dce-85f440114b5f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:32.321779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-40898127-0dca-488c-9dce-85f440114b5f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:32.338954 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-40898127-0dca-488c-9dce-85f440114b5f tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1364 microversion: 2.1 time: 0.297224 Aug 25 13:30:32.340083 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2608/5155] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:32 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1364 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:32.482176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:32.483347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:32.497791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:32.500252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:32.501945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:32.503756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:32.506267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:32.507424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:32.791612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:32.824364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:32.828346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:32.831928 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff1a5024-f252-4626-b624-da663c78ad08 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.357452 Aug 25 13:30:32.834977 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2548/5156] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:32 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:32.937489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-84ea06b9-3dba-47be-8463-02a179e83ae8 req-863be8e1-1a45-42a9-9963-89277b625893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc60335-156b-4f4a-b26a-9b169d3cf720", "name": "network-vif-plugged", "status": "completed", "tag": "813c3e05-6360-4f50-9a65-874e99fbf054"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:32.960988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-84ea06b9-3dba-47be-8463-02a179e83ae8 req-863be8e1-1a45-42a9-9963-89277b625893 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:32.961899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-84ea06b9-3dba-47be-8463-02a179e83ae8 req-863be8e1-1a45-42a9-9963-89277b625893 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:32.963052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-84ea06b9-3dba-47be-8463-02a179e83ae8 req-863be8e1-1a45-42a9-9963-89277b625893 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:32.988730 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-84ea06b9-3dba-47be-8463-02a179e83ae8 req-863be8e1-1a45-42a9-9963-89277b625893 service nova] Creating event network-vif-plugged:813c3e05-6360-4f50-9a65-874e99fbf054 for instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 on n-h1-852771-8 Aug 25 13:30:33.000501 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-84ea06b9-3dba-47be-8463-02a179e83ae8 req-863be8e1-1a45-42a9-9963-89277b625893 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068598 Aug 25 13:30:33.002845 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2609/5157] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:33.373315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c019f845-105d-4ca5-9a7f-2549ef1a1ece tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:33.374162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c019f845-105d-4ca5-9a7f-2549ef1a1ece tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:33.382572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c019f845-105d-4ca5-9a7f-2549ef1a1ece tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:33.383160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c019f845-105d-4ca5-9a7f-2549ef1a1ece tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:33.383770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c019f845-105d-4ca5-9a7f-2549ef1a1ece tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:33.384971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c019f845-105d-4ca5-9a7f-2549ef1a1ece tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:33.385576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c019f845-105d-4ca5-9a7f-2549ef1a1ece tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:33.386099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c019f845-105d-4ca5-9a7f-2549ef1a1ece tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:33.569071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c019f845-105d-4ca5-9a7f-2549ef1a1ece tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:33.583978 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c019f845-105d-4ca5-9a7f-2549ef1a1ece tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1364 microversion: 2.1 time: 0.214317 Aug 25 13:30:33.584995 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2549/5158] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:33 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:33.776428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-157072624", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "f22670d8-ef0a-47a7-9a37-cfa9a0598b43"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:33.874390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:33.875387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:33.885029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:33.885780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:33.886361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:33.886535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] validate_networks() for [('f22670d8-ef0a-47a7-9a37-cfa9a0598b43', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:30:33.887451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:33.888080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:33.888670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:34.077477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:34.096904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:34.102048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:34.103189 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-17565dd7-f5f9-4945-89b7-c14f04f6d78c tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.233044 Aug 25 13:30:34.104226 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2550/5159] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:33 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:30:34.611357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a86b01ad-0b46-40f1-9a0a-45224b132ff7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:34.612517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a86b01ad-0b46-40f1-9a0a-45224b132ff7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:34.622910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a86b01ad-0b46-40f1-9a0a-45224b132ff7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:34.623810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a86b01ad-0b46-40f1-9a0a-45224b132ff7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:34.624634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a86b01ad-0b46-40f1-9a0a-45224b132ff7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:34.626156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a86b01ad-0b46-40f1-9a0a-45224b132ff7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:34.627163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a86b01ad-0b46-40f1-9a0a-45224b132ff7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:34.628923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a86b01ad-0b46-40f1-9a0a-45224b132ff7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:34.665174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:34.688251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:30:34.688891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:30:34.690266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:30:34.691000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:30:34.691753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:30:34.725955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:34.726989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:34.727794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:34.729253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:34.730910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:34.731592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:34.772634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Getting quotas for project 71938715cd0d4ecebc1de69c7e858ba9. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:30:34.784887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Getting quotas for user 7c4c1aa837c94cd69e02c8b73744090e and project 71938715cd0d4ecebc1de69c7e858ba9. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:30:34.814416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:30:34.820426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:30:34.917259 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1dd4d298-cb89-4949-956e-487bd18b1727 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151021 Aug 25 13:30:34.918527 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2610/5160] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:30:34.941403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a86b01ad-0b46-40f1-9a0a-45224b132ff7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:34.945656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8371024f-aca5-40e1-b570-a32233dab650 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:34.949050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8371024f-aca5-40e1-b570-a32233dab650 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:34.964694 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a86b01ad-0b46-40f1-9a0a-45224b132ff7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1364 microversion: 2.1 time: 0.360150 Aug 25 13:30:34.967961 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2551/5161] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:34 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1364 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:35.053003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8371024f-aca5-40e1-b570-a32233dab650 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:35.067541 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8371024f-aca5-40e1-b570-a32233dab650 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1213 microversion: 2.1 time: 0.135040 Aug 25 13:30:35.069439 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2611/5162] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:34 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:35.144728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:35.146477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:35.158036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:35.158935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:35.159758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:35.161030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:35.162485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:35.163280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:35.300739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:35.314878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:35.317351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:35.319741 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d1cb09e1-07f4-4d83-865e-43bd6c5e07e4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1366 microversion: 2.57 time: 0.182105 Aug 25 13:30:35.320811 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2552/5163] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:35 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:36.003008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3570407c-ffd7-4246-b44f-385bbef43ab1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:36.004067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3570407c-ffd7-4246-b44f-385bbef43ab1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:36.018027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3570407c-ffd7-4246-b44f-385bbef43ab1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.018711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3570407c-ffd7-4246-b44f-385bbef43ab1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.019261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3570407c-ffd7-4246-b44f-385bbef43ab1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.020274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3570407c-ffd7-4246-b44f-385bbef43ab1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.021790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3570407c-ffd7-4246-b44f-385bbef43ab1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.022400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3570407c-ffd7-4246-b44f-385bbef43ab1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.108498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3cd9a967-3e67-4749-881f-28477eb7ee72 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:36.109575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3cd9a967-3e67-4749-881f-28477eb7ee72 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:36.122982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cd9a967-3e67-4749-881f-28477eb7ee72 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.123886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cd9a967-3e67-4749-881f-28477eb7ee72 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.124757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cd9a967-3e67-4749-881f-28477eb7ee72 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.126270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cd9a967-3e67-4749-881f-28477eb7ee72 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.127187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cd9a967-3e67-4749-881f-28477eb7ee72 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.127914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cd9a967-3e67-4749-881f-28477eb7ee72 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.298093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3cd9a967-3e67-4749-881f-28477eb7ee72 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:36.334498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3570407c-ffd7-4246-b44f-385bbef43ab1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:36.340998 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3cd9a967-3e67-4749-881f-28477eb7ee72 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1265 microversion: 2.1 time: 0.238528 Aug 25 13:30:36.342350 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2553/5164] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:36 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:36.367056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:36.373016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:36.385105 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3570407c-ffd7-4246-b44f-385bbef43ab1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1551 microversion: 2.1 time: 0.384075 Aug 25 13:30:36.387822 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2612/5165] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:35 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1551 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:36.401611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.402841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.403918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.405998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.407165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.409738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.443696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e53b247-43e3-4fa1-b199-fd997afbafe1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:36.446096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6e53b247-43e3-4fa1-b199-fd997afbafe1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:36.460383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e53b247-43e3-4fa1-b199-fd997afbafe1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.462383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e53b247-43e3-4fa1-b199-fd997afbafe1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.463545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e53b247-43e3-4fa1-b199-fd997afbafe1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.465552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e53b247-43e3-4fa1-b199-fd997afbafe1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.467041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e53b247-43e3-4fa1-b199-fd997afbafe1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.468129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e53b247-43e3-4fa1-b199-fd997afbafe1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.723375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:36.750245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:36.753897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:36.758893 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b186838e-659f-4104-bb78-c18d0669d002 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1384 microversion: 2.57 time: 0.412639 Aug 25 13:30:36.760896 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2554/5166] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:36 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1384 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:36.851536 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e53b247-43e3-4fa1-b199-fd997afbafe1 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.425409 Aug 25 13:30:36.853652 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2613/5167] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:30:36 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-interface => generated 285 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:37.379490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e13796c7-c440-4561-bbdf-1967ce47c15f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:37.381732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e13796c7-c440-4561-bbdf-1967ce47c15f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:37.396794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e13796c7-c440-4561-bbdf-1967ce47c15f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:37.398269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e13796c7-c440-4561-bbdf-1967ce47c15f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:37.399332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e13796c7-c440-4561-bbdf-1967ce47c15f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:37.400727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e13796c7-c440-4561-bbdf-1967ce47c15f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:37.401957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e13796c7-c440-4561-bbdf-1967ce47c15f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:37.405473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e13796c7-c440-4561-bbdf-1967ce47c15f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:37.584795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e13796c7-c440-4561-bbdf-1967ce47c15f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:37.601634 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e13796c7-c440-4561-bbdf-1967ce47c15f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1271 microversion: 2.1 time: 0.229177 Aug 25 13:30:37.602646 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2555/5168] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:37 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1271 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:37.805728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:37.806454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:37.815742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:37.816389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:37.816930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:37.818923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:37.821124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:37.821124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:38.004320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:38.022750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:38.025990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:38.028356 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-610cab20-5e98-47c1-8987-290826fb1066 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1372 microversion: 2.57 time: 0.231463 Aug 25 13:30:38.029463 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2614/5169] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:37 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:38.639143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-db1cb797-8ffe-4290-9681-e8ab36c70389 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:38.640349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-db1cb797-8ffe-4290-9681-e8ab36c70389 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:38.664475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db1cb797-8ffe-4290-9681-e8ab36c70389 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:38.666812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db1cb797-8ffe-4290-9681-e8ab36c70389 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:38.668144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db1cb797-8ffe-4290-9681-e8ab36c70389 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:38.672333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db1cb797-8ffe-4290-9681-e8ab36c70389 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:38.673810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db1cb797-8ffe-4290-9681-e8ab36c70389 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:38.680035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db1cb797-8ffe-4290-9681-e8ab36c70389 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:39.079840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:39.082045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:39.126724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:39.129091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-db1cb797-8ffe-4290-9681-e8ab36c70389 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:39.132763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:39.135097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:39.138410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:39.140457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:39.148212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:39.152556 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-db1cb797-8ffe-4290-9681-e8ab36c70389 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1313 microversion: 2.1 time: 0.522824 Aug 25 13:30:39.165916 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2556/5170] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:38 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:39.244604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f7039280-0d26-45c3-9ded-ba6d18d4cff3 req-4b9edbc2-57c2-4a07-aeac-51b8d4d837fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc60335-156b-4f4a-b26a-9b169d3cf720", "tag": "813c3e05-6360-4f50-9a65-874e99fbf054"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:39.277134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f7039280-0d26-45c3-9ded-ba6d18d4cff3 req-4b9edbc2-57c2-4a07-aeac-51b8d4d837fe service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:39.279009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f7039280-0d26-45c3-9ded-ba6d18d4cff3 req-4b9edbc2-57c2-4a07-aeac-51b8d4d837fe service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:39.280184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f7039280-0d26-45c3-9ded-ba6d18d4cff3 req-4b9edbc2-57c2-4a07-aeac-51b8d4d837fe service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:39.307468 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f7039280-0d26-45c3-9ded-ba6d18d4cff3 req-4b9edbc2-57c2-4a07-aeac-51b8d4d837fe service nova] Creating event network-changed:813c3e05-6360-4f50-9a65-874e99fbf054 for instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 on n-h1-852771-8 Aug 25 13:30:39.319380 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f7039280-0d26-45c3-9ded-ba6d18d4cff3 req-4b9edbc2-57c2-4a07-aeac-51b8d4d837fe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080637 Aug 25 13:30:39.321425 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2557/5171] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:30:39.386253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:39.402693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:39.406347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:39.409922 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5075a769-8f88-42e8-ad1d-819bbb870267 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1372 microversion: 2.57 time: 0.337228 Aug 25 13:30:39.411340 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2615/5172] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:39 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1372 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:39.971981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7dff10cb-15ef-4420-8f25-d118987ee492 req-a4c1572e-d275-4140-a545-7ebf80d24724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "501cc82e-1bc1-4333-8c7e-144171567ba1", "tag": "2d5756ee-c4a7-4338-8ba0-ef8c2d03a606"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:40.023601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7dff10cb-15ef-4420-8f25-d118987ee492 req-a4c1572e-d275-4140-a545-7ebf80d24724 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:40.028064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7dff10cb-15ef-4420-8f25-d118987ee492 req-a4c1572e-d275-4140-a545-7ebf80d24724 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:40.028904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7dff10cb-15ef-4420-8f25-d118987ee492 req-a4c1572e-d275-4140-a545-7ebf80d24724 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:40.054960 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7dff10cb-15ef-4420-8f25-d118987ee492 req-a4c1572e-d275-4140-a545-7ebf80d24724 service nova] Creating event network-changed:2d5756ee-c4a7-4338-8ba0-ef8c2d03a606 for instance 501cc82e-1bc1-4333-8c7e-144171567ba1 on n-h2-852771-8 Aug 25 13:30:40.065709 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7dff10cb-15ef-4420-8f25-d118987ee492 req-a4c1572e-d275-4140-a545-7ebf80d24724 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101123 Aug 25 13:30:40.066564 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2558/5173] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:40.217321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0476dbe8-e7c6-4ca2-9d0a-3d0327dbec05 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:40.222809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0476dbe8-e7c6-4ca2-9d0a-3d0327dbec05 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:40.249891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0476dbe8-e7c6-4ca2-9d0a-3d0327dbec05 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:40.251379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0476dbe8-e7c6-4ca2-9d0a-3d0327dbec05 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:40.253911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0476dbe8-e7c6-4ca2-9d0a-3d0327dbec05 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:40.256547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0476dbe8-e7c6-4ca2-9d0a-3d0327dbec05 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:40.258082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0476dbe8-e7c6-4ca2-9d0a-3d0327dbec05 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:40.260251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0476dbe8-e7c6-4ca2-9d0a-3d0327dbec05 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:40.460703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:40.462220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:40.494229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:40.496450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:40.497246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:40.498500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:40.499390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:40.500081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:40.781292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:40.808422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:40.812938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:40.816553 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d76f12e0-40eb-4d6f-92ee-77198a1b6c29 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1372 microversion: 2.57 time: 0.369353 Aug 25 13:30:40.820021 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2559/5174] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:40 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1372 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:30:41.685432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0476dbe8-e7c6-4ca2-9d0a-3d0327dbec05 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:41.704058 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0476dbe8-e7c6-4ca2-9d0a-3d0327dbec05 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1313 microversion: 2.1 time: 1.498399 Aug 25 13:30:41.707503 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2616/5175] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:40 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1313 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:41.866381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:41.867845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:41.883186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:41.884319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:41.885379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:41.886967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:41.887980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:41.888810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:42.051438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:42.069288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:42.072845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:42.075414 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0ac32457-3d3c-4d6e-9e04-3fa5c9a4b580 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1357 microversion: 2.57 time: 0.220793 Aug 25 13:30:42.076543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2560/5176] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:41 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:30:42.130720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-291d49de-a41b-4119-9375-77bc53b51f86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:42.131392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-291d49de-a41b-4119-9375-77bc53b51f86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:42.140852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-291d49de-a41b-4119-9375-77bc53b51f86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:42.142910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-291d49de-a41b-4119-9375-77bc53b51f86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:42.143694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-291d49de-a41b-4119-9375-77bc53b51f86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:42.145126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-291d49de-a41b-4119-9375-77bc53b51f86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:42.146963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-291d49de-a41b-4119-9375-77bc53b51f86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:42.147823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-291d49de-a41b-4119-9375-77bc53b51f86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:42.156974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:42.200625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-291d49de-a41b-4119-9375-77bc53b51f86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:30:42.356322 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-291d49de-a41b-4119-9375-77bc53b51f86 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 204 len: 0 microversion: 2.57 time: 0.232852 Aug 25 13:30:42.357442 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2617/5177] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:30:42 2022] DELETE /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:30:42.370879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:42.372828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:42.385259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:42.386336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:42.387140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:42.388509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:42.389280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:42.390036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:42.575001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:42.598177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:42.607044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:42.610079 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e3c3fa7-ea57-42c4-a8db-c7f19348d0f4 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1363 microversion: 2.57 time: 0.246082 Aug 25 13:30:42.611523 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2561/5178] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:42 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:42.749327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1b1998fc-6c0f-41b3-a556-f7566de7bd37 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:42.750759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1b1998fc-6c0f-41b3-a556-f7566de7bd37 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:42.762508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1998fc-6c0f-41b3-a556-f7566de7bd37 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:42.763426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1998fc-6c0f-41b3-a556-f7566de7bd37 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:42.764227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1998fc-6c0f-41b3-a556-f7566de7bd37 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:42.765602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1998fc-6c0f-41b3-a556-f7566de7bd37 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:42.766824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1998fc-6c0f-41b3-a556-f7566de7bd37 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:42.767595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1998fc-6c0f-41b3-a556-f7566de7bd37 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:43.055879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1b1998fc-6c0f-41b3-a556-f7566de7bd37 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:43.068774 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1b1998fc-6c0f-41b3-a556-f7566de7bd37 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1313 microversion: 2.1 time: 0.326699 Aug 25 13:30:43.070282 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2618/5179] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:42 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:43.657871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:43.660086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:43.677260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:43.679502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:43.681917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:43.683508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:43.684636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:43.685447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:43.829236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:43.846699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:43.850948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:43.853285 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-944626b6-cf93-4d45-900c-8e400aeab319 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1363 microversion: 2.57 time: 0.204002 Aug 25 13:30:43.854456 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2562/5180] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:43 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:44.111955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f9e5ffc-af00-4a31-ba52-d7a4e9e19530 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:44.113130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0f9e5ffc-af00-4a31-ba52-d7a4e9e19530 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:44.126759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f9e5ffc-af00-4a31-ba52-d7a4e9e19530 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:44.127628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f9e5ffc-af00-4a31-ba52-d7a4e9e19530 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:44.128438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f9e5ffc-af00-4a31-ba52-d7a4e9e19530 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:44.131504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f9e5ffc-af00-4a31-ba52-d7a4e9e19530 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:44.132390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f9e5ffc-af00-4a31-ba52-d7a4e9e19530 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:44.133133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f9e5ffc-af00-4a31-ba52-d7a4e9e19530 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:44.659913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0f9e5ffc-af00-4a31-ba52-d7a4e9e19530 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:44.682203 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0f9e5ffc-af00-4a31-ba52-d7a4e9e19530 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1313 microversion: 2.1 time: 0.578020 Aug 25 13:30:44.683273 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2619/5181] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:44 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:44.910597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:44.913343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:44.928076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:44.929904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:44.931051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:44.932695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:44.933911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:44.937313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:45.020221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:45.021853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:45.023055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:45.024211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lazy-loading 'fault' on Instance uuid f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:30:45.147266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:45.166184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:45.170278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4c71f531bb449aa457a56e3179207b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9505a2c19f4fbb8c5d4202a51f9190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:45.173742 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-acbf3fa0-1181-4a8a-b065-3494cda8ac7b tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 200 len: 1368 microversion: 2.57 time: 0.279965 Aug 25 13:30:45.177574 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2563/5182] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:44 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:30:45.727045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02a859d1-92e9-4fbe-a2b6-009ce6412540 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:45.728150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02a859d1-92e9-4fbe-a2b6-009ce6412540 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:45.732358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:45.733637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:45.751100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a859d1-92e9-4fbe-a2b6-009ce6412540 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:45.751950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a859d1-92e9-4fbe-a2b6-009ce6412540 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:45.752757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a859d1-92e9-4fbe-a2b6-009ce6412540 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:45.754146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a859d1-92e9-4fbe-a2b6-009ce6412540 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:45.755060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a859d1-92e9-4fbe-a2b6-009ce6412540 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:45.755877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a859d1-92e9-4fbe-a2b6-009ce6412540 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:46.045796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02a859d1-92e9-4fbe-a2b6-009ce6412540 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:46.064381 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02a859d1-92e9-4fbe-a2b6-009ce6412540 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1313 microversion: 2.1 time: 0.344959 Aug 25 13:30:46.065892 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2620/5183] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:45 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:46.232749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:46.236012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] [instance: f5cae5c0-f1ba-4390-9cc3-eaa7a9493330] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:46.257159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:46.258276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:46.259630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:46.261257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:46.263245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:46.264759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:46.352070 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] HTTP exception thrown: Instance f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 could not be found. Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Request method failure captured: Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 HTTP/1.1 Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3lVtSvD85Yde4FYSTEWmuUQCO9f_EuwAhk7_2ND9jA_z1ctzyc4nZR6ECyDoFxi21hjb2akb7z0hwYXni-jNLK80D7EVNGlddXfTnD9E9sUTaShy61U24l6fdXSH5y4OhR3sSQdnvrnhVWDQfZF0t_ytw3utSVqhYSssdJZzVTsA-E Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Openstack-Nova-Api-Version: 2.57 Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 7e9505a2c19f4fbb8c5d4202a51f9190 Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerShowV257Test-1432571240 Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e9505a2c19f4fbb8c5d4202a51f9190"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e9505a2c19f4fbb8c5d4202a51f9190", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e9505a2c19f4fbb8c5d4202a51f9190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e9505a2c19f4fbb8c5d4202a51f9190"}]}] Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerShowV257Test-1432571240 Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 7e9505a2c19f4fbb8c5d4202a51f9190 Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerShowV257Test-1432571240 Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerShowV257Test-1432571240-project Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2e4c71f531bb449aa457a56e3179207b Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerShowV257Test-1432571240-project Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 could not be found. Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'f5cae5c0-f1ba-4390-9cc3-eaa7a9493330'} Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 could not be found. Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 could not be found. Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:30:46.356482 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:30:46.371743 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:46.371743 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:30:46.371743 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:30:46.371743 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:30:46.371743 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:30:46.371743 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 could not be found. Aug 25 13:30:46.371743 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:30:46.371743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] Returning 404 to user: Instance f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:30:46.375020 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a92179b-c2ff-4739-aeeb-bae755c15dd7 tempest-ServerShowV257Test-1432571240 tempest-ServerShowV257Test-1432571240-project] 10.222.0.70 "GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330" status: 404 len: 111 microversion: 2.57 time: 0.152121 Aug 25 13:30:46.382401 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2564/5184] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:30:46 2022] GET /compute/v2.1/servers/f5cae5c0-f1ba-4390-9cc3-eaa7a9493330 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:30:47.110040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f403db43-4d15-448c-800f-5feb2e157c0f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:47.112291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f403db43-4d15-448c-800f-5feb2e157c0f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:47.126955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f403db43-4d15-448c-800f-5feb2e157c0f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:47.128384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f403db43-4d15-448c-800f-5feb2e157c0f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:47.130281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f403db43-4d15-448c-800f-5feb2e157c0f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:47.132940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f403db43-4d15-448c-800f-5feb2e157c0f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:47.134170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f403db43-4d15-448c-800f-5feb2e157c0f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:47.135172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f403db43-4d15-448c-800f-5feb2e157c0f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:47.469497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f403db43-4d15-448c-800f-5feb2e157c0f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:47.486315 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f403db43-4d15-448c-800f-5feb2e157c0f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1313 microversion: 2.1 time: 0.384029 Aug 25 13:30:47.487455 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2621/5185] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:47 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:48.533425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7c091c27-d756-4b06-b41a-9c5d0b804d86 req-32a5f863-35b0-4f97-b7f8-21feb9e1e510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "501cc82e-1bc1-4333-8c7e-144171567ba1", "name": "network-vif-plugged", "status": "completed", "tag": "2d5756ee-c4a7-4338-8ba0-ef8c2d03a606"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:48.534799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6d4b6cce-6737-4c4d-b9d3-51977ac9f16f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:48.539297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6d4b6cce-6737-4c4d-b9d3-51977ac9f16f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:48.576481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d4b6cce-6737-4c4d-b9d3-51977ac9f16f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:48.578429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d4b6cce-6737-4c4d-b9d3-51977ac9f16f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:48.580139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=64 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:48.581458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d4b6cce-6737-4c4d-b9d3-51977ac9f16f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:48.583783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d4b6cce-6737-4c4d-b9d3-51977ac9f16f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:48.589682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d4b6cce-6737-4c4d-b9d3-51977ac9f16f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:48.591120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d4b6cce-6737-4c4d-b9d3-51977ac9f16f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:48.591958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7c091c27-d756-4b06-b41a-9c5d0b804d86 req-32a5f863-35b0-4f97-b7f8-21feb9e1e510 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:48.593183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7c091c27-d756-4b06-b41a-9c5d0b804d86 req-32a5f863-35b0-4f97-b7f8-21feb9e1e510 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:48.599256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7c091c27-d756-4b06-b41a-9c5d0b804d86 req-32a5f863-35b0-4f97-b7f8-21feb9e1e510 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:48.650605 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7c091c27-d756-4b06-b41a-9c5d0b804d86 req-32a5f863-35b0-4f97-b7f8-21feb9e1e510 service nova] Creating event network-vif-plugged:2d5756ee-c4a7-4338-8ba0-ef8c2d03a606 for instance 501cc82e-1bc1-4333-8c7e-144171567ba1 on n-h2-852771-8 Aug 25 13:30:48.678080 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7c091c27-d756-4b06-b41a-9c5d0b804d86 req-32a5f863-35b0-4f97-b7f8-21feb9e1e510 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177062 Aug 25 13:30:48.683272 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2565/5186] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:49.110381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6d4b6cce-6737-4c4d-b9d3-51977ac9f16f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:49.131666 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6d4b6cce-6737-4c4d-b9d3-51977ac9f16f tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1313 microversion: 2.1 time: 0.609806 Aug 25 13:30:49.134307 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2622/5187] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:48 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:50.172740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-33dfe914-9911-4c70-9d7f-1cfddbc679e6 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:50.174087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-33dfe914-9911-4c70-9d7f-1cfddbc679e6 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:50.187855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33dfe914-9911-4c70-9d7f-1cfddbc679e6 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:50.189675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33dfe914-9911-4c70-9d7f-1cfddbc679e6 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:50.190896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33dfe914-9911-4c70-9d7f-1cfddbc679e6 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:50.193382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33dfe914-9911-4c70-9d7f-1cfddbc679e6 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:50.194714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33dfe914-9911-4c70-9d7f-1cfddbc679e6 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:50.195543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33dfe914-9911-4c70-9d7f-1cfddbc679e6 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:50.570721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-33dfe914-9911-4c70-9d7f-1cfddbc679e6 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:50.611856 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-33dfe914-9911-4c70-9d7f-1cfddbc679e6 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1313 microversion: 2.1 time: 0.449204 Aug 25 13:30:50.612969 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2566/5188] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:50 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:51.660026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9cb88728-68c0-4768-a4d1-c2084fa5aa39 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:51.666851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9cb88728-68c0-4768-a4d1-c2084fa5aa39 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:51.690975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cb88728-68c0-4768-a4d1-c2084fa5aa39 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:51.694285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cb88728-68c0-4768-a4d1-c2084fa5aa39 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:51.695433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cb88728-68c0-4768-a4d1-c2084fa5aa39 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:51.697386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cb88728-68c0-4768-a4d1-c2084fa5aa39 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:51.698945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cb88728-68c0-4768-a4d1-c2084fa5aa39 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:51.700076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cb88728-68c0-4768-a4d1-c2084fa5aa39 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:52.086208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9cb88728-68c0-4768-a4d1-c2084fa5aa39 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:52.102954 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9cb88728-68c0-4768-a4d1-c2084fa5aa39 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1498 microversion: 2.1 time: 0.455839 Aug 25 13:30:52.104483 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2623/5189] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:51 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1498 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:52.865551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-30518dd6-bb67-44ab-a633-f7663dde4d7a tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a290cb4c0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:52.932389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52c7932f-7b5a-4108-a2ca-b5916bf5f4bc tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:52.934778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-52c7932f-7b5a-4108-a2ca-b5916bf5f4bc tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:52.941210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:52.952890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c7932f-7b5a-4108-a2ca-b5916bf5f4bc tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:52.953979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c7932f-7b5a-4108-a2ca-b5916bf5f4bc tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:52.955071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c7932f-7b5a-4108-a2ca-b5916bf5f4bc tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:52.957105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c7932f-7b5a-4108-a2ca-b5916bf5f4bc tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:52.958735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c7932f-7b5a-4108-a2ca-b5916bf5f4bc tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:52.959682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52c7932f-7b5a-4108-a2ca-b5916bf5f4bc tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:52.974564 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-30518dd6-bb67-44ab-a633-f7663dde4d7a tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/ac9b395a-ba7f-49bd-8722-6423d984a9a3" status: 200 len: 351 microversion: 2.1 time: 0.116377 Aug 25 13:30:52.978742 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2567/5190] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:30:52 2022] GET /compute/v2.1/os-volumes/ac9b395a-ba7f-49bd-8722-6423d984a9a3 => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:53.038437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-52c7932f-7b5a-4108-a2ca-b5916bf5f4bc tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:30:53.213821 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-52c7932f-7b5a-4108-a2ca-b5916bf5f4bc tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "DELETE /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 204 len: 0 microversion: 2.1 time: 0.291542 Aug 25 13:30:53.216440 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2624/5191] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:30:52 2022] DELETE /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:30:53.232426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b42f7bbd-4475-43bf-a7e4-b54a38b98dff tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:53.234065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b42f7bbd-4475-43bf-a7e4-b54a38b98dff tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:53.248495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b42f7bbd-4475-43bf-a7e4-b54a38b98dff tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:53.249490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b42f7bbd-4475-43bf-a7e4-b54a38b98dff tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:53.250424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b42f7bbd-4475-43bf-a7e4-b54a38b98dff tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:53.253179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b42f7bbd-4475-43bf-a7e4-b54a38b98dff tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:53.255365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b42f7bbd-4475-43bf-a7e4-b54a38b98dff tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:53.256592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b42f7bbd-4475-43bf-a7e4-b54a38b98dff tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:53.594546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b42f7bbd-4475-43bf-a7e4-b54a38b98dff tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:53.615358 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b42f7bbd-4475-43bf-a7e4-b54a38b98dff tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1504 microversion: 2.1 time: 0.390478 Aug 25 13:30:53.616776 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2568/5192] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:53 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:54.670230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ae39c2b8-4836-47a5-ab9e-8500cc12dd21 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:54.673237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ae39c2b8-4836-47a5-ab9e-8500cc12dd21 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:54.690631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae39c2b8-4836-47a5-ab9e-8500cc12dd21 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:54.691559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae39c2b8-4836-47a5-ab9e-8500cc12dd21 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:54.692938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae39c2b8-4836-47a5-ab9e-8500cc12dd21 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:54.694692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae39c2b8-4836-47a5-ab9e-8500cc12dd21 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:54.695820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae39c2b8-4836-47a5-ab9e-8500cc12dd21 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:54.696834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ae39c2b8-4836-47a5-ab9e-8500cc12dd21 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:55.325071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ae39c2b8-4836-47a5-ab9e-8500cc12dd21 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:55.342077 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ae39c2b8-4836-47a5-ab9e-8500cc12dd21 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1504 microversion: 2.1 time: 0.692556 Aug 25 13:30:55.362687 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2625/5193] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:54 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1504 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:55.922606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-4e8af515-eb93-4e73-bd0e-09cc2462df99 req-738db5f9-d0d0-4b84-9aa3-d6b68a14c2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "501cc82e-1bc1-4333-8c7e-144171567ba1", "name": "network-vif-deleted", "tag": "2d5756ee-c4a7-4338-8ba0-ef8c2d03a606"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:55.968910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4e8af515-eb93-4e73-bd0e-09cc2462df99 req-738db5f9-d0d0-4b84-9aa3-d6b68a14c2b4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:55.974491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4e8af515-eb93-4e73-bd0e-09cc2462df99 req-738db5f9-d0d0-4b84-9aa3-d6b68a14c2b4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:55.978279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4e8af515-eb93-4e73-bd0e-09cc2462df99 req-738db5f9-d0d0-4b84-9aa3-d6b68a14c2b4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:56.027811 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-4e8af515-eb93-4e73-bd0e-09cc2462df99 req-738db5f9-d0d0-4b84-9aa3-d6b68a14c2b4 service nova] Creating event network-vif-deleted:2d5756ee-c4a7-4338-8ba0-ef8c2d03a606 for instance 501cc82e-1bc1-4333-8c7e-144171567ba1 on n-h2-852771-8 Aug 25 13:30:56.045808 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-4e8af515-eb93-4e73-bd0e-09cc2462df99 req-738db5f9-d0d0-4b84-9aa3-d6b68a14c2b4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130407 Aug 25 13:30:56.058186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bac709ef-3f27-4d4e-89ab-7d2f9e4faa83 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a29326ee0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:56.061785 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2569/5194] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:56.178064 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bac709ef-3f27-4d4e-89ab-7d2f9e4faa83 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/82677e02-91d0-4d0f-a505-6b2a16ef2d43" status: 200 len: 351 microversion: 2.1 time: 0.129707 Aug 25 13:30:56.194222 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2626/5195] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:30:56 2022] GET /compute/v2.1/os-volumes/82677e02-91d0-4d0f-a505-6b2a16ef2d43 => generated 351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:56.389564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:56.394609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:56.418489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:56.420577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:56.421890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:56.423630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:56.425746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:56.427379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:56.506744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:56.508050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:56.508912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:56.509841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lazy-loading 'fault' on Instance uuid 501cc82e-1bc1-4333-8c7e-144171567ba1 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:30:56.649282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:56.670210 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4f61b2be-1eb3-4f5d-96cb-a645de3c2a9c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 200 len: 1303 microversion: 2.1 time: 0.290598 Aug 25 13:30:56.672490 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2570/5196] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:56 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:57.732548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:57.733818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 501cc82e-1bc1-4333-8c7e-144171567ba1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:57.748780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:57.750196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:57.751294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:57.753335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:57.754573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:57.755664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:57.785246 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] HTTP exception thrown: Instance 501cc82e-1bc1-4333-8c7e-144171567ba1 could not be found. Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Request method failure captured: Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 HTTP/1.1 Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3l2wWUm0f_aCemg9N3C0zw-peQK9NSob9zQiKm7d5MrPw_RXIK0eYsyUb3BrrS-sjA9mi1XyF89JeE4muHUAMjbezz6THhmOjdjX9pMJVtpb17-2UcZx1QS1fSF0SgQ5Vc1PzRpWMF8P2G8ygvd1txnPLGPCmLl52Gfvv8Z5jy4X9M Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 71938715cd0d4ecebc1de69c7e858ba9 Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesActionsTest-1903405692 Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71938715cd0d4ecebc1de69c7e858ba9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_71938715cd0d4ecebc1de69c7e858ba9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/71938715cd0d4ecebc1de69c7e858ba9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71938715cd0d4ecebc1de69c7e858ba9"}]}] Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesActionsTest-1903405692 Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 71938715cd0d4ecebc1de69c7e858ba9 Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesActionsTest-1903405692 Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesActionsTest-1903405692-project Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 7c4c1aa837c94cd69e02c8b73744090e Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesActionsTest-1903405692-project Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 501cc82e-1bc1-4333-8c7e-144171567ba1 could not be found. Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '501cc82e-1bc1-4333-8c7e-144171567ba1'} Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 501cc82e-1bc1-4333-8c7e-144171567ba1 could not be found. Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 501cc82e-1bc1-4333-8c7e-144171567ba1 could not be found. Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:30:57.790098 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:30:57.798105 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:57.798105 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:30:57.798105 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:30:57.798105 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:30:57.798105 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:30:57.798105 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 501cc82e-1bc1-4333-8c7e-144171567ba1 could not be found. Aug 25 13:30:57.798105 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:30:57.802110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Returning 404 to user: Instance 501cc82e-1bc1-4333-8c7e-144171567ba1 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:30:57.804283 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b86d7b8d-941e-4547-875d-ac283a2b6464 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1" status: 404 len: 111 microversion: 2.1 time: 0.080935 Aug 25 13:30:57.805582 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2627/5197] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:57 2022] GET /compute/v2.1/servers/501cc82e-1bc1-4333-8c7e-144171567ba1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:30:58.046005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-779428573", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "f22670d8-ef0a-47a7-9a37-cfa9a0598b43"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:58.164535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] validate_networks() for [('f22670d8-ef0a-47a7-9a37-cfa9a0598b43', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:30:59.235559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:30:59.236688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:30:59.241530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:30:59.242656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:30:59.244402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:30:59.249674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e474e4f9-c779-448c-8ac5-3da0ea81c342 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a2933f0d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:59.269318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:59.271127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:59.272149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:59.274120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:59.275183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:59.276281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:59.319998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Getting quotas for project 71938715cd0d4ecebc1de69c7e858ba9. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:30:59.332003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Getting quotas for user 7c4c1aa837c94cd69e02c8b73744090e and project 71938715cd0d4ecebc1de69c7e858ba9. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:30:59.353949 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e474e4f9-c779-448c-8ac5-3da0ea81c342 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/43862a93-feb5-45f8-b1b4-773fa54b046c" status: 200 len: 351 microversion: 2.1 time: 0.111537 Aug 25 13:30:59.354950 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2628/5198] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:30:59 2022] GET /compute/v2.1/os-volumes/43862a93-feb5-45f8-b1b4-773fa54b046c => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:30:59.369788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:30:59.369788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:30:59.380763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-57d7a96f-c08c-4950-ab71-2fd2533ad1ab tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a29337dc0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:59.480632 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2cb5efc8-47df-4022-ab0c-9c5b143ea9fb tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.443089 Aug 25 13:30:59.485950 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2571/5199] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:30:59.505613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-61a4d718-ff11-46ff-aba9-282b25189491 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:59.507226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-61a4d718-ff11-46ff-aba9-282b25189491 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:59.601179 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-57d7a96f-c08c-4950-ab71-2fd2533ad1ab tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.227942 Aug 25 13:30:59.616588 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2629/5200] 10.222.0.70 () {58 vars in 1134 bytes} [Thu Aug 25 13:30:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:59.636449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-551138ee-f704-4158-ae6e-a46a00d08b69 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a2933f940>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:59.638938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-61a4d718-ff11-46ff-aba9-282b25189491 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:59.654178 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-61a4d718-ff11-46ff-aba9-282b25189491 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1213 microversion: 2.1 time: 0.157480 Aug 25 13:30:59.656067 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2572/5201] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:59 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:59.827953 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-551138ee-f704-4158-ae6e-a46a00d08b69 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.203177 Aug 25 13:30:59.843295 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2630/5202] 10.222.0.70 () {58 vars in 1149 bytes} [Thu Aug 25 13:30:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:30:59.859601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b41f3d2-ab73-42dd-892f-18cce89f911a tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a290db3a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:00.042224 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6b41f3d2-ab73-42dd-892f-18cce89f911a tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.188968 Aug 25 13:31:00.044008 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2573/5203] 10.222.0.70 () {58 vars in 1134 bytes} [Thu Aug 25 13:30:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:00.065651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c4221d3f-485c-485b-9975-29986252e913 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a29337310>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:00.275910 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c4221d3f-485c-485b-9975-29986252e913 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.216797 Aug 25 13:31:00.278198 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2631/5204] 10.222.0.70 () {58 vars in 1167 bytes} [Thu Aug 25 13:31:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:00.304169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2d9c1b0-058e-429b-87f8-f13fc54f0aa7 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a2911a670>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:00.499518 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a2d9c1b0-058e-429b-87f8-f13fc54f0aa7 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.204824 Aug 25 13:31:00.509416 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2574/5205] 10.222.0.70 () {58 vars in 1170 bytes} [Thu Aug 25 13:31:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:00.536668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3cd5d62-0e9a-4d69-b8c0-c399388df682 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a29337550>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:00.699550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-57fdb061-f40a-44f9-99f4-ca858d46cbf3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:00.700826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-57fdb061-f40a-44f9-99f4-ca858d46cbf3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:00.716330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57fdb061-f40a-44f9-99f4-ca858d46cbf3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:00.717344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57fdb061-f40a-44f9-99f4-ca858d46cbf3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:00.718043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57fdb061-f40a-44f9-99f4-ca858d46cbf3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:00.719398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57fdb061-f40a-44f9-99f4-ca858d46cbf3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:00.720272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57fdb061-f40a-44f9-99f4-ca858d46cbf3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:00.721355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-57fdb061-f40a-44f9-99f4-ca858d46cbf3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:00.731737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:00.736622 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3cd5d62-0e9a-4d69-b8c0-c399388df682 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.208854 Aug 25 13:31:00.754028 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2632/5206] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 13:31:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:00.764320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a92e23a7-4297-4e4c-90f5-f794164cadd8 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a2933fdc0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:00.881092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-57fdb061-f40a-44f9-99f4-ca858d46cbf3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:00.900046 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-57fdb061-f40a-44f9-99f4-ca858d46cbf3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1217 microversion: 2.1 time: 0.209580 Aug 25 13:31:00.901788 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2575/5207] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:00 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1217 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:00.993994 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a92e23a7-4297-4e4c-90f5-f794164cadd8 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.237206 Aug 25 13:31:00.995782 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2633/5208] 10.222.0.70 () {58 vars in 1188 bytes} [Thu Aug 25 13:31:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:01.029116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f70aa713-c322-41af-b4e1-c3137a5d0c65 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] Calling method '.version_select at 0x7f3a29807430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:01.240276 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f70aa713-c322-41af-b4e1-c3137a5d0c65 tempest-VolumesTestJSON-2106925020 tempest-VolumesTestJSON-2106925020-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.221418 Aug 25 13:31:01.241830 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2576/5209] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Aug 25 13:31:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:01.948357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9a0e4141-90cd-497e-9198-9da4cf38e4ae tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:01.949552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9a0e4141-90cd-497e-9198-9da4cf38e4ae tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:01.971913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0e4141-90cd-497e-9198-9da4cf38e4ae tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:01.974075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0e4141-90cd-497e-9198-9da4cf38e4ae tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:01.976128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0e4141-90cd-497e-9198-9da4cf38e4ae tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:01.980015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0e4141-90cd-497e-9198-9da4cf38e4ae tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:01.980015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0e4141-90cd-497e-9198-9da4cf38e4ae tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:01.981650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a0e4141-90cd-497e-9198-9da4cf38e4ae tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:02.166683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9a0e4141-90cd-497e-9198-9da4cf38e4ae tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:02.195253 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9a0e4141-90cd-497e-9198-9da4cf38e4ae tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1271 microversion: 2.1 time: 0.259001 Aug 25 13:31:02.199286 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2634/5210] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:01 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:03.243153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7de1aa86-5e3f-4a10-985a-a143b3aabdf8 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:03.245208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7de1aa86-5e3f-4a10-985a-a143b3aabdf8 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:03.258704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7de1aa86-5e3f-4a10-985a-a143b3aabdf8 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:03.259950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7de1aa86-5e3f-4a10-985a-a143b3aabdf8 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:03.260932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7de1aa86-5e3f-4a10-985a-a143b3aabdf8 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:03.262518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7de1aa86-5e3f-4a10-985a-a143b3aabdf8 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:03.263605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7de1aa86-5e3f-4a10-985a-a143b3aabdf8 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:03.265023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7de1aa86-5e3f-4a10-985a-a143b3aabdf8 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:03.883554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7de1aa86-5e3f-4a10-985a-a143b3aabdf8 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:03.901575 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7de1aa86-5e3f-4a10-985a-a143b3aabdf8 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1313 microversion: 2.1 time: 0.666863 Aug 25 13:31:03.903424 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2577/5211] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:03 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1313 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:04.425749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-6ea316fc-ffc2-445f-98aa-659c38c5e3f8 req-7166855f-0c8d-42db-82bd-1df85c54749e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "571b165e-2e16-48bc-9a73-8c5cc45da51a", "tag": "e12499c8-6f53-44cb-9147-8437d533228c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:04.451039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6ea316fc-ffc2-445f-98aa-659c38c5e3f8 req-7166855f-0c8d-42db-82bd-1df85c54749e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:04.454150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6ea316fc-ffc2-445f-98aa-659c38c5e3f8 req-7166855f-0c8d-42db-82bd-1df85c54749e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:04.456072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6ea316fc-ffc2-445f-98aa-659c38c5e3f8 req-7166855f-0c8d-42db-82bd-1df85c54749e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:04.489922 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-6ea316fc-ffc2-445f-98aa-659c38c5e3f8 req-7166855f-0c8d-42db-82bd-1df85c54749e service nova] Creating event network-changed:e12499c8-6f53-44cb-9147-8437d533228c for instance 571b165e-2e16-48bc-9a73-8c5cc45da51a on n-h1-852771-8 Aug 25 13:31:04.506402 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-6ea316fc-ffc2-445f-98aa-659c38c5e3f8 req-7166855f-0c8d-42db-82bd-1df85c54749e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087034 Aug 25 13:31:04.509880 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2635/5212] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:04.949049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89b5161a-93a1-42e9-a7e5-fdb036f2b8e0 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:04.950810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89b5161a-93a1-42e9-a7e5-fdb036f2b8e0 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:04.968819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b5161a-93a1-42e9-a7e5-fdb036f2b8e0 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:04.970237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b5161a-93a1-42e9-a7e5-fdb036f2b8e0 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:04.971801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b5161a-93a1-42e9-a7e5-fdb036f2b8e0 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:04.975567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b5161a-93a1-42e9-a7e5-fdb036f2b8e0 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:04.976824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b5161a-93a1-42e9-a7e5-fdb036f2b8e0 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:04.978119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b5161a-93a1-42e9-a7e5-fdb036f2b8e0 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:05.299201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89b5161a-93a1-42e9-a7e5-fdb036f2b8e0 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:05.317772 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89b5161a-93a1-42e9-a7e5-fdb036f2b8e0 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1313 microversion: 2.1 time: 0.381250 Aug 25 13:31:05.325611 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2578/5213] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:04 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:06.364630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3982570a-1e53-4d70-b354-07dd1d265452 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:06.374744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3982570a-1e53-4d70-b354-07dd1d265452 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:06.392613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3982570a-1e53-4d70-b354-07dd1d265452 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:06.395294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3982570a-1e53-4d70-b354-07dd1d265452 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:06.396529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3982570a-1e53-4d70-b354-07dd1d265452 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:06.398963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3982570a-1e53-4d70-b354-07dd1d265452 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:06.400559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3982570a-1e53-4d70-b354-07dd1d265452 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:06.401793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3982570a-1e53-4d70-b354-07dd1d265452 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:06.753428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3982570a-1e53-4d70-b354-07dd1d265452 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:06.773085 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3982570a-1e53-4d70-b354-07dd1d265452 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1313 microversion: 2.1 time: 0.419401 Aug 25 13:31:06.775517 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2636/5214] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:06 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:07.815379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-07707b70-2c36-4113-88b0-95e6da8b99b9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:07.818904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-07707b70-2c36-4113-88b0-95e6da8b99b9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:07.835698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07707b70-2c36-4113-88b0-95e6da8b99b9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:07.837185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07707b70-2c36-4113-88b0-95e6da8b99b9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:07.838535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07707b70-2c36-4113-88b0-95e6da8b99b9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:07.840443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07707b70-2c36-4113-88b0-95e6da8b99b9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:07.841754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07707b70-2c36-4113-88b0-95e6da8b99b9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:07.843029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-07707b70-2c36-4113-88b0-95e6da8b99b9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:08.217123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-07707b70-2c36-4113-88b0-95e6da8b99b9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:08.237091 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-07707b70-2c36-4113-88b0-95e6da8b99b9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1313 microversion: 2.1 time: 0.430319 Aug 25 13:31:08.256369 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2579/5215] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:07 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:09.282587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-131369f6-7b81-4241-82cf-77fd85eeb7da tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:09.283854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-131369f6-7b81-4241-82cf-77fd85eeb7da tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:09.298985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-131369f6-7b81-4241-82cf-77fd85eeb7da tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:09.299920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-131369f6-7b81-4241-82cf-77fd85eeb7da tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:09.301480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-131369f6-7b81-4241-82cf-77fd85eeb7da tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:09.302937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-131369f6-7b81-4241-82cf-77fd85eeb7da tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:09.304625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-131369f6-7b81-4241-82cf-77fd85eeb7da tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:09.305742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-131369f6-7b81-4241-82cf-77fd85eeb7da tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:09.680259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-131369f6-7b81-4241-82cf-77fd85eeb7da tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:09.702339 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-131369f6-7b81-4241-82cf-77fd85eeb7da tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1313 microversion: 2.1 time: 0.427516 Aug 25 13:31:09.703552 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2637/5216] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:09 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:10.742002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:10.743330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:10.763397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7ca25109-9f3d-4fe6-a316-826cab97f146 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:10.765951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7ca25109-9f3d-4fe6-a316-826cab97f146 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:10.779285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ca25109-9f3d-4fe6-a316-826cab97f146 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:10.784526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ca25109-9f3d-4fe6-a316-826cab97f146 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:10.785942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ca25109-9f3d-4fe6-a316-826cab97f146 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:10.787670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ca25109-9f3d-4fe6-a316-826cab97f146 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:10.788845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ca25109-9f3d-4fe6-a316-826cab97f146 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:10.789962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ca25109-9f3d-4fe6-a316-826cab97f146 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:11.186727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-207ec0f3-52be-4896-b544-2b7133565a7f req-f4df6e97-ca83-4b07-b10f-731eb21beec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "571b165e-2e16-48bc-9a73-8c5cc45da51a", "name": "network-vif-plugged", "status": "completed", "tag": "e12499c8-6f53-44cb-9147-8437d533228c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:11.230073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-207ec0f3-52be-4896-b544-2b7133565a7f req-f4df6e97-ca83-4b07-b10f-731eb21beec4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:11.234587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-207ec0f3-52be-4896-b544-2b7133565a7f req-f4df6e97-ca83-4b07-b10f-731eb21beec4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:11.239386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-207ec0f3-52be-4896-b544-2b7133565a7f req-f4df6e97-ca83-4b07-b10f-731eb21beec4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:11.272193 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-207ec0f3-52be-4896-b544-2b7133565a7f req-f4df6e97-ca83-4b07-b10f-731eb21beec4 service nova] Creating event network-vif-plugged:e12499c8-6f53-44cb-9147-8437d533228c for instance 571b165e-2e16-48bc-9a73-8c5cc45da51a on n-h1-852771-8 Aug 25 13:31:11.283975 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-207ec0f3-52be-4896-b544-2b7133565a7f req-f4df6e97-ca83-4b07-b10f-731eb21beec4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105608 Aug 25 13:31:11.287407 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2638/5217] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:31:11.350432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7ca25109-9f3d-4fe6-a316-826cab97f146 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:11.423210 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7ca25109-9f3d-4fe6-a316-826cab97f146 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1313 microversion: 2.1 time: 0.683311 Aug 25 13:31:11.428973 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2580/5218] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:10 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1313 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:12.478960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75c02234-4bc4-4df4-a2fb-2bcca3ba9272 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:12.481027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-75c02234-4bc4-4df4-a2fb-2bcca3ba9272 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:12.497152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75c02234-4bc4-4df4-a2fb-2bcca3ba9272 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:12.498506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75c02234-4bc4-4df4-a2fb-2bcca3ba9272 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:12.500530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75c02234-4bc4-4df4-a2fb-2bcca3ba9272 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:12.502086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75c02234-4bc4-4df4-a2fb-2bcca3ba9272 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:12.503074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75c02234-4bc4-4df4-a2fb-2bcca3ba9272 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:12.505629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75c02234-4bc4-4df4-a2fb-2bcca3ba9272 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:12.516393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:12.854354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-75c02234-4bc4-4df4-a2fb-2bcca3ba9272 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:12.870488 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-75c02234-4bc4-4df4-a2fb-2bcca3ba9272 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1313 microversion: 2.1 time: 0.399850 Aug 25 13:31:12.871806 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2639/5219] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:12 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:13.912531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b38fb50-ef2a-487d-92b3-6f285309945b tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:13.915248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b38fb50-ef2a-487d-92b3-6f285309945b tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:13.928952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b38fb50-ef2a-487d-92b3-6f285309945b tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:13.930320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b38fb50-ef2a-487d-92b3-6f285309945b tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:13.931350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b38fb50-ef2a-487d-92b3-6f285309945b tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:13.933089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b38fb50-ef2a-487d-92b3-6f285309945b tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:13.934377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b38fb50-ef2a-487d-92b3-6f285309945b tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:13.935281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b38fb50-ef2a-487d-92b3-6f285309945b tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:14.239928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b38fb50-ef2a-487d-92b3-6f285309945b tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:14.259256 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b38fb50-ef2a-487d-92b3-6f285309945b tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1497 microversion: 2.1 time: 0.355422 Aug 25 13:31:14.260373 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2581/5220] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:13 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1497 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:15.385467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3645a3f2-d274-44ab-9d01-9273d258cde9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:15.386602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3645a3f2-d274-44ab-9d01-9273d258cde9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:15.399833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3645a3f2-d274-44ab-9d01-9273d258cde9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:15.401032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3645a3f2-d274-44ab-9d01-9273d258cde9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:15.402068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3645a3f2-d274-44ab-9d01-9273d258cde9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:15.403619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3645a3f2-d274-44ab-9d01-9273d258cde9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:15.404668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3645a3f2-d274-44ab-9d01-9273d258cde9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:15.405533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3645a3f2-d274-44ab-9d01-9273d258cde9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:15.477740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3645a3f2-d274-44ab-9d01-9273d258cde9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:31:15.726590 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3645a3f2-d274-44ab-9d01-9273d258cde9 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "DELETE /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 204 len: 0 microversion: 2.1 time: 0.348554 Aug 25 13:31:15.730188 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2640/5221] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:31:15 2022] DELETE /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:31:15.753150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa076c33-e716-42ef-97ba-2bddd2d24db3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:15.755808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa076c33-e716-42ef-97ba-2bddd2d24db3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:15.769766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa076c33-e716-42ef-97ba-2bddd2d24db3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:15.771649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa076c33-e716-42ef-97ba-2bddd2d24db3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:15.772930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa076c33-e716-42ef-97ba-2bddd2d24db3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:15.774684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa076c33-e716-42ef-97ba-2bddd2d24db3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:15.775963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa076c33-e716-42ef-97ba-2bddd2d24db3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:15.776738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa076c33-e716-42ef-97ba-2bddd2d24db3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:16.147063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fa076c33-e716-42ef-97ba-2bddd2d24db3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:16.164550 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa076c33-e716-42ef-97ba-2bddd2d24db3 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1503 microversion: 2.1 time: 0.428181 Aug 25 13:31:16.166182 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2582/5222] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:15 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1503 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:17.217655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d4587c5-8f97-474a-a2b0-5a553f564f5e tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:17.226345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4d4587c5-8f97-474a-a2b0-5a553f564f5e tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:17.257160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4587c5-8f97-474a-a2b0-5a553f564f5e tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:17.258158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4587c5-8f97-474a-a2b0-5a553f564f5e tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:17.259453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4587c5-8f97-474a-a2b0-5a553f564f5e tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:17.260820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4587c5-8f97-474a-a2b0-5a553f564f5e tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:17.262622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4587c5-8f97-474a-a2b0-5a553f564f5e tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:17.263409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4587c5-8f97-474a-a2b0-5a553f564f5e tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:17.578182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4d4587c5-8f97-474a-a2b0-5a553f564f5e tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:17.603913 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d4587c5-8f97-474a-a2b0-5a553f564f5e tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1503 microversion: 2.1 time: 0.398646 Aug 25 13:31:17.605330 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2641/5223] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:17 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1503 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:18.427193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1b2d751e-769d-4881-ac47-219cbcfbb59f req-ab4c7120-a244-4b53-aca3-a3e4138b7162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "571b165e-2e16-48bc-9a73-8c5cc45da51a", "name": "network-vif-deleted", "tag": "e12499c8-6f53-44cb-9147-8437d533228c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:18.473331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1b2d751e-769d-4881-ac47-219cbcfbb59f req-ab4c7120-a244-4b53-aca3-a3e4138b7162 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:18.477104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1b2d751e-769d-4881-ac47-219cbcfbb59f req-ab4c7120-a244-4b53-aca3-a3e4138b7162 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:18.478251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1b2d751e-769d-4881-ac47-219cbcfbb59f req-ab4c7120-a244-4b53-aca3-a3e4138b7162 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:18.499765 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1b2d751e-769d-4881-ac47-219cbcfbb59f req-ab4c7120-a244-4b53-aca3-a3e4138b7162 service nova] Creating event network-vif-deleted:e12499c8-6f53-44cb-9147-8437d533228c for instance 571b165e-2e16-48bc-9a73-8c5cc45da51a on n-h1-852771-8 Aug 25 13:31:18.510640 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1b2d751e-769d-4881-ac47-219cbcfbb59f req-ab4c7120-a244-4b53-aca3-a3e4138b7162 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090272 Aug 25 13:31:18.512950 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2583/5224] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:18.644645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:18.646981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:18.661331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:18.662687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:18.663892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:18.665652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:18.666908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:18.668251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:18.763105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:18.764699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:18.766679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:18.767419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lazy-loading 'fault' on Instance uuid 571b165e-2e16-48bc-9a73-8c5cc45da51a {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:31:18.865730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4c1aa837c94cd69e02c8b73744090e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71938715cd0d4ecebc1de69c7e858ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:18.883312 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ae073d3-39f4-4a64-8847-2bf7bc173186 tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 200 len: 1303 microversion: 2.1 time: 0.246529 Aug 25 13:31:18.884477 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2642/5225] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:18 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 1303 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:19.938194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:19.942621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] [instance: 571b165e-2e16-48bc-9a73-8c5cc45da51a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:19.948912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:19.969313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:19.970367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:19.971335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:19.973707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:19.974946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:19.975940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:20.019973 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] HTTP exception thrown: Instance 571b165e-2e16-48bc-9a73-8c5cc45da51a could not be found. Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Request method failure captured: Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a HTTP/1.1 Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3l2wWUm0f_aCemg9N3C0zw-peQK9NSob9zQiKm7d5MrPw_RXIK0eYsyUb3BrrS-sjA9mi1XyF89JeE4muHUAMjbezz6THhmOjdjX9pMJVtpb17-2UcZx1QS1fSF0SgQ5Vc1PzRpWMF8P2G8ygvd1txnPLGPCmLl52Gfvv8Z5jy4X9M Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 71938715cd0d4ecebc1de69c7e858ba9 Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-VolumesActionsTest-1903405692 Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71938715cd0d4ecebc1de69c7e858ba9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_71938715cd0d4ecebc1de69c7e858ba9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/71938715cd0d4ecebc1de69c7e858ba9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71938715cd0d4ecebc1de69c7e858ba9"}]}] Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-VolumesActionsTest-1903405692 Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 71938715cd0d4ecebc1de69c7e858ba9 Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-VolumesActionsTest-1903405692 Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-VolumesActionsTest-1903405692-project Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 7c4c1aa837c94cd69e02c8b73744090e Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-VolumesActionsTest-1903405692-project Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 571b165e-2e16-48bc-9a73-8c5cc45da51a could not be found. Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '571b165e-2e16-48bc-9a73-8c5cc45da51a'} Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571b165e-2e16-48bc-9a73-8c5cc45da51a could not be found. Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571b165e-2e16-48bc-9a73-8c5cc45da51a could not be found. Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:31:20.023829 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.036397 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:20.036397 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:31:20.036397 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:31:20.036397 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:31:20.036397 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:31:20.036397 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571b165e-2e16-48bc-9a73-8c5cc45da51a could not be found. Aug 25 13:31:20.036397 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.036397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] Returning 404 to user: Instance 571b165e-2e16-48bc-9a73-8c5cc45da51a could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:31:20.036397 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ae8a1d8c-13ab-46ec-bd0c-61202c77c35c tempest-VolumesActionsTest-1903405692 tempest-VolumesActionsTest-1903405692-project] 10.222.0.70 "GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a" status: 404 len: 111 microversion: 2.1 time: 0.106255 Aug 25 13:31:20.036397 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2584/5226] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:19 2022] GET /compute/v2.1/servers/571b165e-2e16-48bc-9a73-8c5cc45da51a => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:31:24.267132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7b9bbe32-e0c9-457b-930e-6aa897eed7e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:24.273052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7b9bbe32-e0c9-457b-930e-6aa897eed7e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:24.302483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:24.324826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b9bbe32-e0c9-457b-930e-6aa897eed7e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:24.332572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b9bbe32-e0c9-457b-930e-6aa897eed7e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:24.333874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b9bbe32-e0c9-457b-930e-6aa897eed7e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:24.335399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b9bbe32-e0c9-457b-930e-6aa897eed7e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:24.345808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b9bbe32-e0c9-457b-930e-6aa897eed7e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:24.348067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7b9bbe32-e0c9-457b-930e-6aa897eed7e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:24.464524 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7b9bbe32-e0c9-457b-930e-6aa897eed7e3 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/ips" status: 200 len: 151 microversion: 2.20 time: 0.205255 Aug 25 13:31:24.465768 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2643/5227] 10.222.0.70 () {60 vars in 1289 bytes} [Thu Aug 25 13:31:24 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/ips => generated 151 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:31:29.711374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3601bd75-3eee-48c0-97ab-db9f6ac25729 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:29.714088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3601bd75-3eee-48c0-97ab-db9f6ac25729 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:29.730223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3601bd75-3eee-48c0-97ab-db9f6ac25729 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:29.731451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3601bd75-3eee-48c0-97ab-db9f6ac25729 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:29.732502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3601bd75-3eee-48c0-97ab-db9f6ac25729 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:29.734593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3601bd75-3eee-48c0-97ab-db9f6ac25729 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:29.736147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3601bd75-3eee-48c0-97ab-db9f6ac25729 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:29.737926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3601bd75-3eee-48c0-97ab-db9f6ac25729 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:29.834372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-3601bd75-3eee-48c0-97ab-db9f6ac25729 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lazy-loading 'flavor' on Instance uuid 32d84654-c8b1-496b-992d-8d0d80b25316 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:31:30.585701 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3601bd75-3eee-48c0-97ab-db9f6ac25729 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "POST /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/action" status: 202 len: 0 microversion: 2.20 time: 0.886178 Aug 25 13:31:30.589608 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2585/5228] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 13:31:29 2022] POST /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:31:30.613727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:30.627237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:30.702943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:30.710127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:30.713679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:30.715988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:30.718213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:30.719919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:31.107665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:31.127696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:31.131979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:31.134905 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-414bdb20-ebc0-4951-954d-3a9e7b15c9d6 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 0.540966 Aug 25 13:31:31.136408 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2644/5229] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:30 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:32.195070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:32.196607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:32.211779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:32.212804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:32.213695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:32.216309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:32.218892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:32.220068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:32.280525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:32.602952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:32.622778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:32.626426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:32.629192 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b548639-a21b-4d2f-b19c-b6ca6985ad7a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 0.453237 Aug 25 13:31:32.631325 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2586/5230] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:32 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:33.682519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:33.686325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:33.757015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:33.758169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:33.770352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:33.771831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:33.774510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:33.775389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:34.312113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:34.350233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:34.359464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:34.364874 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-feaabf4b-7882-4f91-a33f-3c864877c5f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 0.689692 Aug 25 13:31:34.373108 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2645/5231] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:33 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:35.421814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:35.431583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:35.447107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:35.447919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:35.449027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:35.450789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:35.451928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:35.452951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:36.187425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:36.234715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:36.241212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:36.243620 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3d69a00f-b192-4e6c-893f-5aed70d85fe5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 0.828955 Aug 25 13:31:36.246274 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2587/5232] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:35 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:37.304846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:37.309147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:37.342820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:37.346270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:37.348927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:37.351422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:37.353366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:37.355570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:37.754707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:37.786562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:37.790837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:37.795481 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9391c413-f0db-4f78-975b-4ce85bf0cc49 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 0.512344 Aug 25 13:31:37.798009 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2646/5233] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:37 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:38.853683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:38.864920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:38.888526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:38.888526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:38.890511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:38.895230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:38.897651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:38.904255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:39.848943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:39.909443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:39.913931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:39.922145 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d12243b5-f8ca-41b5-81f6-d339cab8286f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 1.075833 Aug 25 13:31:39.933395 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2588/5234] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:38 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:31:40.988127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:40.989276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:41.017134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:41.018014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:41.019563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:41.021494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:41.022608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:41.023993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:41.715246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:41.738599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:41.749003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:41.751321 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ef0ffcb7-8dab-4d57-b39f-679d15d83364 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 0.770520 Aug 25 13:31:41.767778 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2647/5235] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:40 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:42.814620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:42.817985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:42.854474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:42.858352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:42.859788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:42.864158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:42.868449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:42.872773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:43.360409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8cb35dd0-8544-4cbc-9bad-72df6bf3cd57 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:43.363854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8cb35dd0-8544-4cbc-9bad-72df6bf3cd57 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:43.423450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cb35dd0-8544-4cbc-9bad-72df6bf3cd57 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:43.428003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cb35dd0-8544-4cbc-9bad-72df6bf3cd57 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:43.434645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cb35dd0-8544-4cbc-9bad-72df6bf3cd57 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:43.438682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cb35dd0-8544-4cbc-9bad-72df6bf3cd57 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:43.450004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cb35dd0-8544-4cbc-9bad-72df6bf3cd57 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:43.455708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8cb35dd0-8544-4cbc-9bad-72df6bf3cd57 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:43.472123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:43.543670 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8cb35dd0-8544-4cbc-9bad-72df6bf3cd57 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/ips" status: 200 len: 147 microversion: 2.1 time: 0.193637 Aug 25 13:31:43.545989 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2648/5236] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:31:43 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/ips => generated 147 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:43.947507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:43.987871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:44.002925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:44.010375 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c8edc7e3-5f14-4e0e-80fa-8efee6e8fa57 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 1.206825 Aug 25 13:31:44.015025 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2589/5237] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:42 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:45.087730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:45.091662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:45.144273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:45.145058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:45.145999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:45.151675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:45.152600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:45.153444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:47.642066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:47.689100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:47.697261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:47.702634 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-89b40cb3-9d92-44dd-8220-130c78403bff tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 2.638658 Aug 25 13:31:47.705310 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2649/5238] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:45 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 2652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:48.529126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25b94753-f7a9-468b-a36c-90a4bbcc1d98 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "402c2a86-7353-48e8-963e-fa87b89f2bc5"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:48.561767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-25b94753-f7a9-468b-a36c-90a4bbcc1d98 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:48.639812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b94753-f7a9-468b-a36c-90a4bbcc1d98 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:48.652857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b94753-f7a9-468b-a36c-90a4bbcc1d98 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:48.654495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b94753-f7a9-468b-a36c-90a4bbcc1d98 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:48.660451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b94753-f7a9-468b-a36c-90a4bbcc1d98 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:48.663084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b94753-f7a9-468b-a36c-90a4bbcc1d98 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:48.667172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b94753-f7a9-468b-a36c-90a4bbcc1d98 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:48.757153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:48.764105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:48.819084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:48.824850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:48.825984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:48.829414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:48.837559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:48.839263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:49.789281 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-25b94753-f7a9-468b-a36c-90a4bbcc1d98 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.279701 Aug 25 13:31:49.842641 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2590/5239] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:31:48 2022] POST /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments => generated 194 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:49.858204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:49.911217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:49.919352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:49.926237 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-27738ec2-7f86-4cb5-94a0-060b12e4277b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1744 microversion: 2.20 time: 1.177997 Aug 25 13:31:49.942373 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2650/5240] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:48 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1744 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:31:50.994966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:51.014542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:51.060093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=14 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:51.087826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:51.101636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:51.103900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:51.108360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:51.112818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:51.126735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:51.936624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:51.995965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:52.002875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:52.006944 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7743d2ce-ec7b-4e52-b978-9092a9f2d32b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1744 microversion: 2.20 time: 1.029195 Aug 25 13:31:52.008932 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2591/5241] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:50 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1744 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:52.164715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-84965dfe-c7e8-48b2-9580-f740e49acfd5 req-8121e1c0-9677-47fc-96a2-9c8a1fb435f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d84654-c8b1-496b-992d-8d0d80b25316", "name": "network-vif-plugged", "status": "completed", "tag": "76dc1323-87f8-4b14-9fdf-6ed8548e9491"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:52.222478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-84965dfe-c7e8-48b2-9580-f740e49acfd5 req-8121e1c0-9677-47fc-96a2-9c8a1fb435f4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:52.224085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-84965dfe-c7e8-48b2-9580-f740e49acfd5 req-8121e1c0-9677-47fc-96a2-9c8a1fb435f4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:52.233485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-84965dfe-c7e8-48b2-9580-f740e49acfd5 req-8121e1c0-9677-47fc-96a2-9c8a1fb435f4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:52.294839 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-84965dfe-c7e8-48b2-9580-f740e49acfd5 req-8121e1c0-9677-47fc-96a2-9c8a1fb435f4 service nova] Creating event network-vif-plugged:76dc1323-87f8-4b14-9fdf-6ed8548e9491 for instance 32d84654-c8b1-496b-992d-8d0d80b25316 on n-h2-852771-8 Aug 25 13:31:52.313658 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-84965dfe-c7e8-48b2-9580-f740e49acfd5 req-8121e1c0-9677-47fc-96a2-9c8a1fb435f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.948542 Aug 25 13:31:52.316544 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2651/5242] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:31:53.062714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:53.068223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:53.090115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:53.094680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:53.098410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:53.102973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:53.109993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:53.111639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:54.051068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:54.082517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:54.091995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:54.100609 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-970df2fc-af66-4978-b65f-22ffbff61c7f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 1.046064 Aug 25 13:31:54.107361 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2592/5243] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:53 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:55.173318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:55.187900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:55.199471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=18 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:55.274592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:55.275593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:55.276387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:55.295033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:55.296632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:55.317418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:56.200223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:56.235349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:56.240459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:56.243444 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a08127a0-5e49-459c-94b4-5153c8998308 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 1.084058 Aug 25 13:31:56.245365 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2652/5244] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:55 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:57.315784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:57.330169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:57.390234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:57.396907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:57.397798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:57.402839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:57.410824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:57.411987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:58.339454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:58.442069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:58.448899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:58.466347 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2145680a-8c45-4c32-a5d0-2184de6e1c85 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 1.174382 Aug 25 13:31:58.472920 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2593/5245] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:57 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:31:59.551517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:59.553053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:59.609095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:59.625544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:59.627085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:59.628682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:59.629629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:59.630451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:01.021696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:01.062376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:01.085149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:01.088051 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74bd2dec-32fe-4c6c-af7e-8383b048a265 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 1.572460 Aug 25 13:32:01.103840 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2653/5246] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:31:59 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:02.159869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:02.161213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:02.180120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:02.181307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:02.182314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:02.183765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:02.184730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:02.185647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:03.935086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:03.952027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:03.973109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:03.978196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:03.991503 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52aebe01-6b2f-40d5-bbdc-71f569ecea97 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 1.834151 Aug 25 13:32:04.009587 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2594/5247] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:02 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:05.037893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:05.043159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:05.075753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:05.090326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:05.093174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:05.097618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:05.100656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:05.106815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:06.260111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:06.349108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:06.355057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:06.361330 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f312d146-1cd7-4822-bb58-edee9cd957ef tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 1.331022 Aug 25 13:32:06.366621 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2654/5248] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:05 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:07.422064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:07.426251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:07.493393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:07.499370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:07.506901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:07.515907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:07.523631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:07.526699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:08.223692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:08.250743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:08.254741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:08.259166 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c8a4416d-759c-4973-8502-e3571a36a332 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 0.852706 Aug 25 13:32:08.260928 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2595/5249] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:07 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:32:09.316246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:09.321126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:09.351444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:09.353016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:09.358651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:09.386504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:09.387408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:09.388171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:10.347575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:10.412013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:10.416698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:10.431174 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e6574e2-4c40-4e76-a8aa-489a55ed67f7 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 1.128535 Aug 25 13:32:10.486152 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2655/5250] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:09 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:32:11.537753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:11.539393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:11.555167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:11.556262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:11.557226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:11.559009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:11.560157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:11.561131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:12.045734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:12.091146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:12.096434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:12.099439 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a644c560-8f85-4fd6-84db-06f68b984b79 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 0.578477 Aug 25 13:32:12.114212 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2596/5251] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:11 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:13.151989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:13.154715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:13.178319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:13.180203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:13.182831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:13.186777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:13.189074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:13.191054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:14.326247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:14.350987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=46 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:14.371946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:14.380287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:14.386489 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ebcc025e-a122-4bde-9985-d85e4ff8d569 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 1.246586 Aug 25 13:32:14.391262 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2656/5252] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:13 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:15.439084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:15.441476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:15.458536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:15.461047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:15.462738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:15.465015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:15.467154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:15.469487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:16.318711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:16.351324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:16.355463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:16.368130 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-86559e63-c7f0-429a-829a-03a87e270afe tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 0.938757 Aug 25 13:32:16.370388 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2597/5253] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:15 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:17.178315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f2a55b48-43af-433b-beec-909aae5fa497 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:17.199645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f2a55b48-43af-433b-beec-909aae5fa497 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:17.249942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a55b48-43af-433b-beec-909aae5fa497 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:17.250772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a55b48-43af-433b-beec-909aae5fa497 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:17.254063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a55b48-43af-433b-beec-909aae5fa497 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:17.259240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a55b48-43af-433b-beec-909aae5fa497 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:17.260723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a55b48-43af-433b-beec-909aae5fa497 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:17.263706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2a55b48-43af-433b-beec-909aae5fa497 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:17.400769 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f2a55b48-43af-433b-beec-909aae5fa497 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.236581 Aug 25 13:32:17.406906 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2657/5254] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:32:17 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:32:17.441235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:17.444982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:17.453006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-acdb790e-0228-45ab-b094-c4dad2dde7c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:17.453725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-acdb790e-0228-45ab-b094-c4dad2dde7c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:17.492742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:17.495022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdb790e-0228-45ab-b094-c4dad2dde7c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:17.498307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdb790e-0228-45ab-b094-c4dad2dde7c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:17.499190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdb790e-0228-45ab-b094-c4dad2dde7c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:17.500085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:17.501030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdb790e-0228-45ab-b094-c4dad2dde7c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:17.502775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:17.506702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdb790e-0228-45ab-b094-c4dad2dde7c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:17.507720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-acdb790e-0228-45ab-b094-c4dad2dde7c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:17.514199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:17.515990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:17.519984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:17.653969 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-acdb790e-0228-45ab-b094-c4dad2dde7c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments/402c2a86-7353-48e8-963e-fa87b89f2bc5" status: 200 len: 194 microversion: 2.1 time: 0.221425 Aug 25 13:32:17.655528 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2658/5255] 10.222.0.70 () {58 vars in 1413 bytes} [Thu Aug 25 13:32:17 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments/402c2a86-7353-48e8-963e-fa87b89f2bc5 => generated 194 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:32:18.084210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:18.112891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:18.117754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:18.122895 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5f539a83-a798-4678-9ee3-84821d8f096e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 0.704396 Aug 25 13:32:18.125019 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2598/5256] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:17 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:19.175634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:19.176832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:19.228172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:19.233323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:19.234760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:19.243531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:19.244736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:19.249500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:19.775374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:19.841376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:19.855098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:19.860983 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5e8b191f-8faf-4fe4-bc17-5e1de1f07761 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 0.694778 Aug 25 13:32:19.863194 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2659/5257] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:19 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:20.909119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:20.915106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:20.942839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:20.950334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:20.954677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:20.957276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:20.961292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:20.966490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:22.094176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:22.130678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:22.134493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:22.137604 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e94f34d8-9ffd-4e46-912c-131f85a54f46 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1739 microversion: 2.20 time: 1.237054 Aug 25 13:32:22.139751 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2599/5258] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:20 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1739 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:22.428341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0ae3dc33-40cf-4ec4-8f08-56fad7b05f6b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dadd4a4d-8322-473a-8f5b-03215740ba51"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:32:22.433256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0ae3dc33-40cf-4ec4-8f08-56fad7b05f6b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:22.447757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae3dc33-40cf-4ec4-8f08-56fad7b05f6b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:22.448961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae3dc33-40cf-4ec4-8f08-56fad7b05f6b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:22.449964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae3dc33-40cf-4ec4-8f08-56fad7b05f6b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:22.451438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae3dc33-40cf-4ec4-8f08-56fad7b05f6b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:22.452454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae3dc33-40cf-4ec4-8f08-56fad7b05f6b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:22.453411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ae3dc33-40cf-4ec4-8f08-56fad7b05f6b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:23.208575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:23.210262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:23.227109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=18 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:23.235318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:23.249935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:23.251606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:23.253953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:23.255162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:23.257376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:23.282131 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0ae3dc33-40cf-4ec4-8f08-56fad7b05f6b tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "POST /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862434 Aug 25 13:32:23.284460 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2660/5259] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:32:22 2022] POST /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:32:24.547473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:24.592907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:24.596853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:24.599673 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef30b676-342f-4649-9250-d4b2a2245c69 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1721 microversion: 2.20 time: 1.421133 Aug 25 13:32:24.608977 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2600/5260] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:23 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1721 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:25.657007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:25.664203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:25.683615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=18 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:25.700015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:25.701403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:25.704265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:25.714489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:25.715417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:25.716268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:26.710909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:26.756345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:26.759638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:26.782104 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a6880df3-1678-46be-a474-ff3da8eb5cb5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1721 microversion: 2.20 time: 1.115851 Aug 25 13:32:26.799564 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2661/5261] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:25 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1721 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:32:27.062996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1eaa2c93-19c8-43d7-a72e-c2323edfabb9 req-aba57b19-53da-41a3-ba6f-d2499d16c496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d84654-c8b1-496b-992d-8d0d80b25316", "name": "network-vif-unplugged", "status": "completed", "tag": "76dc1323-87f8-4b14-9fdf-6ed8548e9491"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:32:27.141943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1eaa2c93-19c8-43d7-a72e-c2323edfabb9 req-aba57b19-53da-41a3-ba6f-d2499d16c496 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:27.143343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1eaa2c93-19c8-43d7-a72e-c2323edfabb9 req-aba57b19-53da-41a3-ba6f-d2499d16c496 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:27.149439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1eaa2c93-19c8-43d7-a72e-c2323edfabb9 req-aba57b19-53da-41a3-ba6f-d2499d16c496 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:27.232292 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1eaa2c93-19c8-43d7-a72e-c2323edfabb9 req-aba57b19-53da-41a3-ba6f-d2499d16c496 service nova] Creating event network-vif-unplugged:76dc1323-87f8-4b14-9fdf-6ed8548e9491 for instance 32d84654-c8b1-496b-992d-8d0d80b25316 on n-h2-852771-8 Aug 25 13:32:27.265213 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1eaa2c93-19c8-43d7-a72e-c2323edfabb9 req-aba57b19-53da-41a3-ba6f-d2499d16c496 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.209470 Aug 25 13:32:27.272556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2601/5262] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:32:27.835242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:27.836496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:27.872071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:27.876568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:27.879841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:27.885728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:27.888938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:27.920690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:28.421076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:28.464509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:28.473455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:28.485405 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b083e387-46ff-4983-bf6c-78ce486eae4c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1721 microversion: 2.20 time: 0.659046 Aug 25 13:32:28.487246 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2662/5263] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:27 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1721 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:29.547566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:29.568340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:29.591130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:29.591998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:29.599605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:29.601407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:29.607146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:29.607952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:30.040629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:30.070582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:30.073757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:30.076455 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-41dbed9f-4b6c-437a-8523-9b47049acaa2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1721 microversion: 2.20 time: 0.543701 Aug 25 13:32:30.098929 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2602/5264] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:29 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1721 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:31.131669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:31.135267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:31.165317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:31.166855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:31.170845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:31.175500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:31.176326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:31.177386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:31.646346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:31.664646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:31.668400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:31.671622 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-091a494c-8177-4dac-bdd9-320d13e8d8ba tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1724 microversion: 2.20 time: 0.549204 Aug 25 13:32:31.674759 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2663/5265] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:31 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1724 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:32:31.734330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9dce62ed-1714-4b98-9bee-e996ae342d53 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cc39cea-a296-4504-8eb0-b66a198e0e80"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:32:31.740484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9dce62ed-1714-4b98-9bee-e996ae342d53 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:31.755649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dce62ed-1714-4b98-9bee-e996ae342d53 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:31.756617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dce62ed-1714-4b98-9bee-e996ae342d53 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:31.757416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dce62ed-1714-4b98-9bee-e996ae342d53 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:31.759130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dce62ed-1714-4b98-9bee-e996ae342d53 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:31.760010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dce62ed-1714-4b98-9bee-e996ae342d53 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:31.760789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dce62ed-1714-4b98-9bee-e996ae342d53 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:33.992973 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9dce62ed-1714-4b98-9bee-e996ae342d53 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "POST /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.276509 Aug 25 13:32:33.994807 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2603/5266] 10.222.0.70 () {62 vars in 1364 bytes} [Thu Aug 25 13:32:31 2022] POST /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/os-volume_attachments => generated 188 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:32:34.348237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-55d9ce31-e365-442e-920f-d57cf11d078a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:34.349098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-55d9ce31-e365-442e-920f-d57cf11d078a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:34.366834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55d9ce31-e365-442e-920f-d57cf11d078a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:34.368141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55d9ce31-e365-442e-920f-d57cf11d078a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:34.369176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55d9ce31-e365-442e-920f-d57cf11d078a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:34.371041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55d9ce31-e365-442e-920f-d57cf11d078a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:34.372185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55d9ce31-e365-442e-920f-d57cf11d078a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:34.373190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55d9ce31-e365-442e-920f-d57cf11d078a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:35.304642 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-55d9ce31-e365-442e-920f-d57cf11d078a tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "DELETE /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/os-volume_attachments/2cc39cea-a296-4504-8eb0-b66a198e0e80" status: 202 len: 0 microversion: 2.20 time: 0.964453 Aug 25 13:32:35.310398 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2664/5267] 10.222.0.70 () {60 vars in 1457 bytes} [Thu Aug 25 13:32:34 2022] DELETE /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/os-volume_attachments/2cc39cea-a296-4504-8eb0-b66a198e0e80 => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:32:35.472459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-374d1600-bd50-436f-950e-d514509ac990 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:32:35.475430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-374d1600-bd50-436f-950e-d514509ac990 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:35.510592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-374d1600-bd50-436f-950e-d514509ac990 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:35.512240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-374d1600-bd50-436f-950e-d514509ac990 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:35.516650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-374d1600-bd50-436f-950e-d514509ac990 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:35.530136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-374d1600-bd50-436f-950e-d514509ac990 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:35.542274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-374d1600-bd50-436f-950e-d514509ac990 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:35.543370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-374d1600-bd50-436f-950e-d514509ac990 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:35.709073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-374d1600-bd50-436f-950e-d514509ac990 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129059) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 13:32:35.979486 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-374d1600-bd50-436f-950e-d514509ac990 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "POST /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/action" status: 202 len: 0 microversion: 2.20 time: 0.520741 Aug 25 13:32:35.980641 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2604/5268] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Aug 25 13:32:35 2022] POST /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:32:35.999972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:36.001253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:36.019225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:36.020374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:36.021129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:36.022892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:36.023481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:36.026369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:37.027106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:37.084551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:37.087918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:37.107234 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cbec59cb-e4ce-4029-a9da-f032e3725720 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1672 microversion: 2.20 time: 1.100031 Aug 25 13:32:37.116106 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2665/5269] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:35 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1672 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:38.162965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:38.164088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:38.196385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:38.199165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:38.199956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:38.201617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:38.203431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:38.207182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:38.281045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:38.693272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:38.717146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:38.722905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:38.725697 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b23c67c6-c057-4dcc-acc2-eb90acc97164 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1672 microversion: 2.20 time: 0.570839 Aug 25 13:32:38.727685 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2605/5270] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:38 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1672 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:39.786535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:39.787881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:39.806436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:39.807363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:39.808691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:39.810454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:39.811346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:39.812104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:40.182421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:40.202305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:40.207864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:40.211023 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74cb78b7-9164-452e-92c8-f68e6cf1b7d9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1672 microversion: 2.20 time: 0.441223 Aug 25 13:32:40.212482 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2666/5271] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:39 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1672 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:41.258481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:41.261474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:41.286847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:41.288320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:41.295649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:41.297593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:41.299622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:41.301072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:42.026652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:42.099465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:42.114515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:42.140056 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cb53208b-4348-47fc-9ad2-82b029c24a1c tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1672 microversion: 2.20 time: 0.873036 Aug 25 13:32:42.149887 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2606/5272] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:41 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1672 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:43.194202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:43.195445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:43.228560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:43.236925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:43.238321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:43.240805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:43.242026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:43.243064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:43.608471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c110074-c774-4ab4-85e6-73995b6dd108 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:43.615020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9c110074-c774-4ab4-85e6-73995b6dd108 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:43.631456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c110074-c774-4ab4-85e6-73995b6dd108 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:43.633641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c110074-c774-4ab4-85e6-73995b6dd108 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:43.635396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c110074-c774-4ab4-85e6-73995b6dd108 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:43.636576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c110074-c774-4ab4-85e6-73995b6dd108 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:43.637460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c110074-c774-4ab4-85e6-73995b6dd108 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:43.638401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c110074-c774-4ab4-85e6-73995b6dd108 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:43.738051 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c110074-c774-4ab4-85e6-73995b6dd108 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.139587 Aug 25 13:32:43.740292 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2607/5273] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:32:43 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments => generated 371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:32:43.904950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-05ec5d0a-6a0b-4eda-8747-995d556e07ab tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:43.906087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-05ec5d0a-6a0b-4eda-8747-995d556e07ab tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:43.933461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ec5d0a-6a0b-4eda-8747-995d556e07ab tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:43.939594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:43.946167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ec5d0a-6a0b-4eda-8747-995d556e07ab tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:43.947226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ec5d0a-6a0b-4eda-8747-995d556e07ab tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:43.948617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ec5d0a-6a0b-4eda-8747-995d556e07ab tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:43.949444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ec5d0a-6a0b-4eda-8747-995d556e07ab tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:43.950310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ec5d0a-6a0b-4eda-8747-995d556e07ab tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:43.963238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:43.980861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:43.983263 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ceb6fb8f-d4e4-4016-9813-061111e26370 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 0.799253 Aug 25 13:32:43.984768 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2667/5274] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:43 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:44.055124 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-05ec5d0a-6a0b-4eda-8747-995d556e07ab tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments/402c2a86-7353-48e8-963e-fa87b89f2bc5" status: 200 len: 194 microversion: 2.1 time: 0.157503 Aug 25 13:32:44.057208 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2608/5275] 10.222.0.70 () {58 vars in 1413 bytes} [Thu Aug 25 13:32:43 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments/402c2a86-7353-48e8-963e-fa87b89f2bc5 => generated 194 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:32:44.076972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8df437d6-b935-4a24-82f4-cdc87805a46a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:44.078110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8df437d6-b935-4a24-82f4-cdc87805a46a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:44.091082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8df437d6-b935-4a24-82f4-cdc87805a46a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:44.092429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8df437d6-b935-4a24-82f4-cdc87805a46a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:44.093608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8df437d6-b935-4a24-82f4-cdc87805a46a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:44.097937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8df437d6-b935-4a24-82f4-cdc87805a46a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:44.099433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8df437d6-b935-4a24-82f4-cdc87805a46a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:44.100570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8df437d6-b935-4a24-82f4-cdc87805a46a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:44.303255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-8df437d6-b935-4a24-82f4-cdc87805a46a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lazy-loading 'services' on Instance uuid 4fc60335-156b-4f4a-b26a-9b169d3cf720 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:32:44.551836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:44.586696 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8df437d6-b935-4a24-82f4-cdc87805a46a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments/402c2a86-7353-48e8-963e-fa87b89f2bc5" status: 202 len: 0 microversion: 2.1 time: 0.516110 Aug 25 13:32:44.588052 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2668/5276] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:32:44 2022] DELETE /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments/402c2a86-7353-48e8-963e-fa87b89f2bc5 => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:32:45.036213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:45.037365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:45.064906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:45.065747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:45.066605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:45.068005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:45.076481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:45.077395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:45.782308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:45.808249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:45.812344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:45.818403 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b858b06-3f2d-4dbb-beed-7b7e9e8e06b0 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 0.789047 Aug 25 13:32:45.827819 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2609/5277] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:45 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:46.871501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:46.872997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:46.907459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:46.909312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:46.910960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:46.912570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:46.913715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:46.915183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:47.540565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:47.576908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:47.582145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:47.584507 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff0575d5-bd2b-49f5-9eff-cbe68ab35e9f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 0.727257 Aug 25 13:32:47.593309 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2669/5278] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:46 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:48.659986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:48.661020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:48.690116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:48.691325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:48.691934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:48.693309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:48.699791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:48.700942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:49.408912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:49.466256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:49.476009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:49.482001 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-90f5c253-7635-4462-9471-41c72fcfd792 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 0.838504 Aug 25 13:32:49.485101 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2610/5279] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:48 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:50.546733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:50.551335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:50.597825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:50.600832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:50.607656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:50.609250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:50.610482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:50.611451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:51.263704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:51.289784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:51.301543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:51.309699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fef1f2f1-caed-4007-aa1c-aef9c39e12dd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 0.775288 Aug 25 13:32:51.334363 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2670/5280] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:50 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:52.386841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:52.394341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:52.439505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:52.440369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:52.448533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:52.453117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:52.454311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:52.459152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:53.503554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:53.557907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:53.566694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:53.576061 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f6a9891f-7aa2-475d-82f5-6f78fa6bb136 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 1.201383 Aug 25 13:32:53.582591 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2611/5281] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:52 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:54.642537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:54.644011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:54.678273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:54.682822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:54.685813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:54.698775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:54.700333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:54.701905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:56.108329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:56.218280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:56.233937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:56.241880 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-90cfdf98-f4bb-4dd6-9118-9a9399c02796 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 1.609520 Aug 25 13:32:56.249623 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2671/5282] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:54 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:57.319851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:57.324232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:57.365473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:57.384789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:57.390251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:57.403006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:57.423578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:57.431151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:57.436029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:58.328341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:58.389147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:58.393769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:58.416891 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ede84e38-829e-4047-9bd3-a0120d956025 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 1.103481 Aug 25 13:32:58.418670 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2612/5283] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:57 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:32:59.496147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:59.499298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:59.542276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=22 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:59.553586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:59.557983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:59.562228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:59.571488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:59.573310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:59.578620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:01.435713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:01.484456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:01.504501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:01.507862 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-522c0673-07eb-4e75-90a8-c61dde0bffc2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 2.036188 Aug 25 13:33:01.546347 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2672/5284] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:32:59 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:33:02.581427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:02.581427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:02.627395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:02.628598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:02.629945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:02.635286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:02.636608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:02.638230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:03.732714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:03.806526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:03.825199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:03.846052 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9aff70e7-5288-4b33-bba0-a7fc0eb0fc13 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 1.259198 Aug 25 13:33:03.847301 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2613/5285] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:02 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:33:04.895836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:04.896945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:04.978643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:04.980085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:04.982661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:04.991857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:04.998799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:04.999859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:06.046515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:06.067724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:06.071527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:06.074597 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-081cab2c-1f0a-413f-8617-4c18631622ab tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 1.188328 Aug 25 13:33:06.087589 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2673/5286] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:04 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:33:07.122905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:07.125470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:07.140196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:07.142474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:07.143890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:07.145835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:07.147292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:07.148462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:07.642249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:07.682867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:07.686409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:07.689425 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-18118f5e-298e-4185-8a6f-2544fd5486f1 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 0.573907 Aug 25 13:33:07.704551 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2614/5287] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:07 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:33:07.980053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ce78972-0fc1-4292-9ca3-4dffa9dabda9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:07.980960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ce78972-0fc1-4292-9ca3-4dffa9dabda9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:08.015884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ce78972-0fc1-4292-9ca3-4dffa9dabda9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:08.021854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ce78972-0fc1-4292-9ca3-4dffa9dabda9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:08.023042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ce78972-0fc1-4292-9ca3-4dffa9dabda9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:08.033136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ce78972-0fc1-4292-9ca3-4dffa9dabda9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:08.034212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ce78972-0fc1-4292-9ca3-4dffa9dabda9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:08.041382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ce78972-0fc1-4292-9ca3-4dffa9dabda9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:08.182917 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2ce78972-0fc1-4292-9ca3-4dffa9dabda9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments/dadd4a4d-8322-473a-8f5b-03215740ba51" status: 200 len: 194 microversion: 2.1 time: 0.209821 Aug 25 13:33:08.184689 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2674/5288] 10.222.0.70 () {58 vars in 1413 bytes} [Thu Aug 25 13:33:07 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments/dadd4a4d-8322-473a-8f5b-03215740ba51 => generated 194 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:33:08.213619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-78eb7e00-d1f7-40f7-95c4-c37247ceafdd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:08.218801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-78eb7e00-d1f7-40f7-95c4-c37247ceafdd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:08.253117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78eb7e00-d1f7-40f7-95c4-c37247ceafdd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:08.254368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78eb7e00-d1f7-40f7-95c4-c37247ceafdd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:08.255529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78eb7e00-d1f7-40f7-95c4-c37247ceafdd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:08.257271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78eb7e00-d1f7-40f7-95c4-c37247ceafdd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:08.261723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78eb7e00-d1f7-40f7-95c4-c37247ceafdd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:08.262653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78eb7e00-d1f7-40f7-95c4-c37247ceafdd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:08.473752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=64 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:08.479645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-78eb7e00-d1f7-40f7-95c4-c37247ceafdd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lazy-loading 'services' on Instance uuid 4fc60335-156b-4f4a-b26a-9b169d3cf720 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:33:08.687813 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-78eb7e00-d1f7-40f7-95c4-c37247ceafdd tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments/dadd4a4d-8322-473a-8f5b-03215740ba51" status: 202 len: 0 microversion: 2.1 time: 0.485754 Aug 25 13:33:08.693589 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2615/5289] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:33:08 2022] DELETE /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments/dadd4a4d-8322-473a-8f5b-03215740ba51 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:33:08.764889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:08.774096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:08.798208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:08.800188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:08.808368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:08.814753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:08.815807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:08.821026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:09.687009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:09.708138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:09.712802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:09.715840 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-56458616-18b4-4c29-abc3-2855b4ceacf5 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 0.972018 Aug 25 13:33:09.717262 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2675/5290] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:08 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:33:10.769713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:10.773329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:10.794131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:10.795833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:10.796949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:10.799484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:10.802158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:10.803091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:11.371038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:11.402903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:11.406476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:11.410919 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-327c6d7f-64ea-4168-a872-5dfbdced3c60 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 0.655547 Aug 25 13:33:11.413174 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2616/5291] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:10 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:33:12.464309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:12.479533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:12.513272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:12.514605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:12.515858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:12.519612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:12.521634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:12.523175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:13.259611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:13.295806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:13.303861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:13.319472 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-61e02f42-a06d-43c0-8627-a94822e36afd tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 0.863010 Aug 25 13:33:13.325802 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2676/5292] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:12 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:33:14.384529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:14.393743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:14.417772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:14.418929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:14.419931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:14.423864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:14.427482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:14.434477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:16.108377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:16.160975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:16.173279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:16.179300 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1f2fb058-18a6-47f0-b7ef-8dea8a00ab3d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 1.802880 Aug 25 13:33:16.199458 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2617/5293] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:14 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:33:17.281764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:17.299276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:17.393106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:17.399542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:17.400382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:17.403800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:17.405714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:17.417581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:17.534779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=49 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:17.743163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d5fda894-02ee-4b0b-b23d-2b158c55eebb req-e27ed1c9-21b7-406f-9bc8-5fc6eee81bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d84654-c8b1-496b-992d-8d0d80b25316", "name": "network-vif-plugged", "status": "completed", "tag": "76dc1323-87f8-4b14-9fdf-6ed8548e9491"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:33:17.831805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d5fda894-02ee-4b0b-b23d-2b158c55eebb req-e27ed1c9-21b7-406f-9bc8-5fc6eee81bb7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:17.833267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d5fda894-02ee-4b0b-b23d-2b158c55eebb req-e27ed1c9-21b7-406f-9bc8-5fc6eee81bb7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:17.835306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d5fda894-02ee-4b0b-b23d-2b158c55eebb req-e27ed1c9-21b7-406f-9bc8-5fc6eee81bb7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:17.953552 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d5fda894-02ee-4b0b-b23d-2b158c55eebb req-e27ed1c9-21b7-406f-9bc8-5fc6eee81bb7 service nova] Creating event network-vif-plugged:76dc1323-87f8-4b14-9fdf-6ed8548e9491 for instance 32d84654-c8b1-496b-992d-8d0d80b25316 on n-h2-852771-8 Aug 25 13:33:17.989261 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d5fda894-02ee-4b0b-b23d-2b158c55eebb req-e27ed1c9-21b7-406f-9bc8-5fc6eee81bb7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259615 Aug 25 13:33:18.025566 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2618/5294] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:33:18.647670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:18.688974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:18.709113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:18.711920 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff2e04a5-4bc7-4855-841b-d2ce3f3e4119 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 1.469997 Aug 25 13:33:18.713593 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2677/5295] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:17 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:33:19.768055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:19.775622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:19.802421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:19.803238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:19.804046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:19.827555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:19.828519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:19.830763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:21.428653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:21.464980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:21.478505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:21.486754 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7aad9fa4-c701-4380-99e5-6bbbcfafd039 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 1.738665 Aug 25 13:33:21.489932 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2619/5296] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:19 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:33:22.558193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:22.560731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:22.585878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:22.586749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:22.587586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:22.596754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:22.598820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:22.600029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:23.474762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:23.510811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:23.514919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:23.518071 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-175bbf42-0140-407b-9d52-c36b42a2e6f2 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1730 microversion: 2.20 time: 0.980597 Aug 25 13:33:23.531148 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2678/5297] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:22 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1730 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:33:24.576494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:24.579501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:24.595977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:24.597450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:24.598320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:24.599792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:24.600966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:24.602540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:24.919633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:24.952225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:24.958559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:24.967143 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5f022f4c-771f-43bb-9c1e-01db2c3ce9ac tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1717 microversion: 2.20 time: 0.398939 Aug 25 13:33:24.988693 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2620/5298] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:33:24 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1717 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:33:25.135809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6cee3d62-4fab-4ed3-ae77-d7c68a2acfb7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:25.140952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6cee3d62-4fab-4ed3-ae77-d7c68a2acfb7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:25.156332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cee3d62-4fab-4ed3-ae77-d7c68a2acfb7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:25.157715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cee3d62-4fab-4ed3-ae77-d7c68a2acfb7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:25.158845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cee3d62-4fab-4ed3-ae77-d7c68a2acfb7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:25.160505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cee3d62-4fab-4ed3-ae77-d7c68a2acfb7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:25.161599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cee3d62-4fab-4ed3-ae77-d7c68a2acfb7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:25.162952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cee3d62-4fab-4ed3-ae77-d7c68a2acfb7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:25.240657 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6cee3d62-4fab-4ed3-ae77-d7c68a2acfb7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114248 Aug 25 13:33:25.242149 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2679/5299] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:33:25 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:33:25.512878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dea32698-a749-4187-bdd8-a651892ce4f7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:25.517749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dea32698-a749-4187-bdd8-a651892ce4f7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:25.529639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dea32698-a749-4187-bdd8-a651892ce4f7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:25.531513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dea32698-a749-4187-bdd8-a651892ce4f7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:25.533609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dea32698-a749-4187-bdd8-a651892ce4f7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:25.535256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dea32698-a749-4187-bdd8-a651892ce4f7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:25.536002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dea32698-a749-4187-bdd8-a651892ce4f7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:25.536623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dea32698-a749-4187-bdd8-a651892ce4f7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:25.597121 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dea32698-a749-4187-bdd8-a651892ce4f7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090449 Aug 25 13:33:25.598356 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2621/5300] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:33:25 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:33:25.748007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-079e5a25-a93b-492d-917f-b448a9faaa7c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:25.749307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-079e5a25-a93b-492d-917f-b448a9faaa7c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:25.761695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-079e5a25-a93b-492d-917f-b448a9faaa7c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:25.762632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-079e5a25-a93b-492d-917f-b448a9faaa7c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:25.763419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-079e5a25-a93b-492d-917f-b448a9faaa7c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:25.764796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-079e5a25-a93b-492d-917f-b448a9faaa7c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:25.765732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-079e5a25-a93b-492d-917f-b448a9faaa7c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:25.767094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-079e5a25-a93b-492d-917f-b448a9faaa7c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:25.842588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-079e5a25-a93b-492d-917f-b448a9faaa7c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:33:26.052407 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-079e5a25-a93b-492d-917f-b448a9faaa7c tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 204 len: 0 microversion: 2.1 time: 0.312319 Aug 25 13:33:26.071377 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2680/5301] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:33:25 2022] DELETE /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:33:26.075132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-256bbad6-1637-4931-ab18-852a8ff87ce6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:26.076362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-256bbad6-1637-4931-ab18-852a8ff87ce6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:26.090681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256bbad6-1637-4931-ab18-852a8ff87ce6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:26.092767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256bbad6-1637-4931-ab18-852a8ff87ce6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:26.093250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256bbad6-1637-4931-ab18-852a8ff87ce6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:26.095325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256bbad6-1637-4931-ab18-852a8ff87ce6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:26.096518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256bbad6-1637-4931-ab18-852a8ff87ce6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:26.097378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-256bbad6-1637-4931-ab18-852a8ff87ce6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:26.397603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-256bbad6-1637-4931-ab18-852a8ff87ce6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:26.421496 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-256bbad6-1637-4931-ab18-852a8ff87ce6 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1676 microversion: 2.1 time: 0.357751 Aug 25 13:33:26.437579 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2622/5302] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:26 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1676 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:27.481972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e838d030-1957-49eb-9002-e06c1c107cec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:27.483462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e838d030-1957-49eb-9002-e06c1c107cec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:27.498543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e838d030-1957-49eb-9002-e06c1c107cec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:27.499485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e838d030-1957-49eb-9002-e06c1c107cec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:27.501388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e838d030-1957-49eb-9002-e06c1c107cec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:27.503245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e838d030-1957-49eb-9002-e06c1c107cec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:27.504173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e838d030-1957-49eb-9002-e06c1c107cec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:27.504997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e838d030-1957-49eb-9002-e06c1c107cec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:27.786940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e838d030-1957-49eb-9002-e06c1c107cec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:27.812399 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e838d030-1957-49eb-9002-e06c1c107cec tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1676 microversion: 2.1 time: 0.350899 Aug 25 13:33:27.814524 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2681/5303] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:27 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1676 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:28.852799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-26e0e8e0-4332-4fa9-b182-3f86042100eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:28.853733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-26e0e8e0-4332-4fa9-b182-3f86042100eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:28.862927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=22 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:28.866915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26e0e8e0-4332-4fa9-b182-3f86042100eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:28.867455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26e0e8e0-4332-4fa9-b182-3f86042100eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:28.867915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26e0e8e0-4332-4fa9-b182-3f86042100eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:28.868742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26e0e8e0-4332-4fa9-b182-3f86042100eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:28.869274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26e0e8e0-4332-4fa9-b182-3f86042100eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:28.869859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-26e0e8e0-4332-4fa9-b182-3f86042100eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:29.169624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-26e0e8e0-4332-4fa9-b182-3f86042100eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:29.194738 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-26e0e8e0-4332-4fa9-b182-3f86042100eb tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1676 microversion: 2.1 time: 0.347849 Aug 25 13:33:29.196778 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2623/5304] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:28 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1676 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:30.249295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-45445282-8a87-471f-8d94-6210b880db75 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:30.252253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-45445282-8a87-471f-8d94-6210b880db75 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:30.257907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:30.273445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45445282-8a87-471f-8d94-6210b880db75 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:30.274898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45445282-8a87-471f-8d94-6210b880db75 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:30.276220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45445282-8a87-471f-8d94-6210b880db75 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:30.278134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45445282-8a87-471f-8d94-6210b880db75 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:30.279650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45445282-8a87-471f-8d94-6210b880db75 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:30.281695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45445282-8a87-471f-8d94-6210b880db75 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:30.619694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-45445282-8a87-471f-8d94-6210b880db75 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:30.638260 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-45445282-8a87-471f-8d94-6210b880db75 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1676 microversion: 2.1 time: 0.398595 Aug 25 13:33:30.639557 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2682/5305] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:30 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1676 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:31.707188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb6766da-f237-412f-b277-6a16f57c8b1e tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:31.708646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fb6766da-f237-412f-b277-6a16f57c8b1e tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:31.726880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb6766da-f237-412f-b277-6a16f57c8b1e tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:31.727810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb6766da-f237-412f-b277-6a16f57c8b1e tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:31.728766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb6766da-f237-412f-b277-6a16f57c8b1e tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:31.730272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb6766da-f237-412f-b277-6a16f57c8b1e tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:31.731113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb6766da-f237-412f-b277-6a16f57c8b1e tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:31.731867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb6766da-f237-412f-b277-6a16f57c8b1e tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:31.943154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fb6766da-f237-412f-b277-6a16f57c8b1e tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:31.982602 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb6766da-f237-412f-b277-6a16f57c8b1e tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1608 microversion: 2.1 time: 0.296257 Aug 25 13:33:31.992121 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2624/5306] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:31 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1608 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:32.906106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5e4d0e35-59ad-43f6-92cb-9cbde41b2471 req-1d83bd3a-bec0-4408-a644-efb174e2f32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc60335-156b-4f4a-b26a-9b169d3cf720", "name": "network-vif-deleted", "tag": "813c3e05-6360-4f50-9a65-874e99fbf054"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:33:32.942130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5e4d0e35-59ad-43f6-92cb-9cbde41b2471 req-1d83bd3a-bec0-4408-a644-efb174e2f32d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:32.943448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5e4d0e35-59ad-43f6-92cb-9cbde41b2471 req-1d83bd3a-bec0-4408-a644-efb174e2f32d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:32.944417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5e4d0e35-59ad-43f6-92cb-9cbde41b2471 req-1d83bd3a-bec0-4408-a644-efb174e2f32d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:32.990912 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5e4d0e35-59ad-43f6-92cb-9cbde41b2471 req-1d83bd3a-bec0-4408-a644-efb174e2f32d service nova] Creating event network-vif-deleted:813c3e05-6360-4f50-9a65-874e99fbf054 for instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 on n-h1-852771-8 Aug 25 13:33:33.008916 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5e4d0e35-59ad-43f6-92cb-9cbde41b2471 req-1d83bd3a-bec0-4408-a644-efb174e2f32d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116569 Aug 25 13:33:33.011606 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2683/5307] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:33:33.032414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c27b0349-5303-4ff7-ba07-739099344da9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:33.033861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c27b0349-5303-4ff7-ba07-739099344da9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:33.064495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c27b0349-5303-4ff7-ba07-739099344da9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:33.065460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c27b0349-5303-4ff7-ba07-739099344da9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:33.066365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c27b0349-5303-4ff7-ba07-739099344da9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:33.098476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c27b0349-5303-4ff7-ba07-739099344da9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:33.099434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c27b0349-5303-4ff7-ba07-739099344da9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:33.100246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c27b0349-5303-4ff7-ba07-739099344da9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:33.356928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c27b0349-5303-4ff7-ba07-739099344da9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f37e1d986144ccb4ff3523d6b8c226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103003f7cdb1448491050c8c627764e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:33.385358 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c27b0349-5303-4ff7-ba07-739099344da9 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 200 len: 1323 microversion: 2.1 time: 0.362432 Aug 25 13:33:33.387438 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2625/5308] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:33 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 1323 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:34.442484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:34.443969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:34.488161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:34.489665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:34.490757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:34.492962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:34.494928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:34.497449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:34.556646 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] HTTP exception thrown: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Request method failure captured: Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 HTTP/1.1 Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3gBLi1uKUWANpYqcbcFYPdnBylKytpfnlg8LFzHfrIdDHosTzM7lfi7yOQMgvQDR6XYW6W4VHoZFCVD_nfVljgVdFk2uvXde6V--Hhjljc6Y9BGZ35h830QFG47V_HO55OgAkrcvaVnOtFo958wKZ3iXfbA4p9btTprzLoKxtOrtFA Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_103003f7cdb1448491050c8c627764e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/103003f7cdb1448491050c8c627764e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}] Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c8f37e1d986144ccb4ff3523d6b8c226 Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '4fc60335-156b-4f4a-b26a-9b169d3cf720'} Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:33:34.565938 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:33:34.595026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:33:34.595026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:33:34.595026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:33:34.595026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:33:34.595026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:33:34.595026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:34.595026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:33:34.596693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Returning 404 to user: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:33:34.600108 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f21b4520-7ffe-4ded-803e-d7bb04b3809a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 404 len: 111 microversion: 2.1 time: 0.178641 Aug 25 13:33:34.601941 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2684/5309] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:34 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:33:34.617667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1060c54-3f4a-4bc1-a563-161d3ce7ff8d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '.version_select at 0x7f3a290e3790>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:34.668864 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b1060c54-3f4a-4bc1-a563-161d3ce7ff8d tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519696221" status: 202 len: 0 microversion: 2.1 time: 0.058141 Aug 25 13:33:34.671587 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2626/5310] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 13:33:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519696221 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:33:52.512388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:52.514692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:52.551671 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:33:52.558165 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 13:33:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 (ip 10.222.0.70) !!! Aug 25 13:33:52.561466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=5 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:52.565492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:52.569115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:52.577952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:52.580023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:52.581699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:52.584882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:52.588845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:52.684839 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] HTTP exception thrown: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Request method failure captured: Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 HTTP/1.1 Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3gBLi1uKUWANpYqcbcFYPdnBylKytpfnlg8LFzHfrIdDHosTzM7lfi7yOQMgvQDR6XYW6W4VHoZFCVD_nfVljgVdFk2uvXde6V--Hhjljc6Y9BGZ35h830QFG47V_HO55OgAkrcvaVnOtFo958wKZ3iXfbA4p9btTprzLoKxtOrtFA Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_103003f7cdb1448491050c8c627764e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/103003f7cdb1448491050c8c627764e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}] Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c8f37e1d986144ccb4ff3523d6b8c226 Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '4fc60335-156b-4f4a-b26a-9b169d3cf720'} Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:33:52.689785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:52.697728 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:33:52.700156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Returning 404 to user: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:33:52.702157 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-97a65741-6a63-4233-a970-cb593abf132a tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 404 len: 111 microversion: 2.1 time: 0.210397 Aug 25 13:33:52.703980 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2685/5311] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:33:52 2022] DELETE /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:33:52.717882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:52.721863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 4fc60335-156b-4f4a-b26a-9b169d3cf720] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:52.759076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:52.761786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:52.766654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:52.769184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:52.770087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:52.771569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:52.772591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:52.773682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:52.860095 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] HTTP exception thrown: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Request method failure captured: Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 HTTP/1.1 Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3gBLi1uKUWANpYqcbcFYPdnBylKytpfnlg8LFzHfrIdDHosTzM7lfi7yOQMgvQDR6XYW6W4VHoZFCVD_nfVljgVdFk2uvXde6V--Hhjljc6Y9BGZ35h830QFG47V_HO55OgAkrcvaVnOtFo958wKZ3iXfbA4p9btTprzLoKxtOrtFA Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_103003f7cdb1448491050c8c627764e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/103003f7cdb1448491050c8c627764e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}] Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: c8f37e1d986144ccb4ff3523d6b8c226 Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '4fc60335-156b-4f4a-b26a-9b169d3cf720'} Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:33:52.866521 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:33:52.875885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:33:52.875885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:33:52.875885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:33:52.875885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:33:52.875885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:33:52.875885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. Aug 25 13:33:52.875885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:33:52.877380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Returning 404 to user: Instance 4fc60335-156b-4f4a-b26a-9b169d3cf720 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:33:52.886114 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8ab2ac10-e3e0-426d-9fd2-a5bea69c29c7 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720" status: 404 len: 111 microversion: 2.1 time: 0.169229 Aug 25 13:33:52.887797 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2627/5312] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:52 2022] GET /compute/v2.1/servers/4fc60335-156b-4f4a-b26a-9b169d3cf720 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:34:00.607346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:00.609038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:00.625168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:00.626433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:00.627739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:00.629338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:00.630499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:00.631514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:00.675895 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] HTTP exception thrown: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Request method failure captured: Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 HTTP/1.1 Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3gBLi1uKUWANpYqcbcFYPdnBylKytpfnlg8LFzHfrIdDHosTzM7lfi7yOQMgvQDR6XYW6W4VHoZFCVD_nfVljgVdFk2uvXde6V--Hhjljc6Y9BGZ35h830QFG47V_HO55OgAkrcvaVnOtFo958wKZ3iXfbA4p9btTprzLoKxtOrtFA Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_103003f7cdb1448491050c8c627764e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/103003f7cdb1448491050c8c627764e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}] Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c8f37e1d986144ccb4ff3523d6b8c226 Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '2166b072-a2e3-469f-b49a-ac99195a5827'} Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:34:00.679260 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:34:00.687949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:00.699208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Returning 404 to user: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:34:00.699208 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-396cab0d-6b80-4823-a00a-c0d9f1125527 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 404 len: 111 microversion: 2.1 time: 0.102105 Aug 25 13:34:00.701040 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2686/5313] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:34:00 2022] DELETE /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:34:00.709889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:00.711189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] [instance: 2166b072-a2e3-469f-b49a-ac99195a5827] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:00.795401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:00.828304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:00.830621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:00.832371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:00.833617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:00.836766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:00.910453 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] HTTP exception thrown: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Request method failure captured: Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 HTTP/1.1 Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3gBLi1uKUWANpYqcbcFYPdnBylKytpfnlg8LFzHfrIdDHosTzM7lfi7yOQMgvQDR6XYW6W4VHoZFCVD_nfVljgVdFk2uvXde6V--Hhjljc6Y9BGZ35h830QFG47V_HO55OgAkrcvaVnOtFo958wKZ3iXfbA4p9btTprzLoKxtOrtFA Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_103003f7cdb1448491050c8c627764e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/103003f7cdb1448491050c8c627764e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/103003f7cdb1448491050c8c627764e0"}]}] Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 103003f7cdb1448491050c8c627764e0 Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870544469 Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: c8f37e1d986144ccb4ff3523d6b8c226 Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeTestJSON-870544469-project Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '2166b072-a2e3-469f-b49a-ac99195a5827'} Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:00.920485 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:00.938522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:00.938522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:00.938522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:00.938522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:34:00.938522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:34:00.938522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. Aug 25 13:34:00.938522 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:00.938522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] Returning 404 to user: Instance 2166b072-a2e3-469f-b49a-ac99195a5827 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:34:00.938522 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-879a1cad-24eb-437e-bac6-c34e9e5d0009 tempest-AttachVolumeTestJSON-870544469 tempest-AttachVolumeTestJSON-870544469-project] 10.222.0.70 "GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827" status: 404 len: 111 microversion: 2.1 time: 0.226400 Aug 25 13:34:00.938522 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2628/5314] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:00 2022] GET /compute/v2.1/servers/2166b072-a2e3-469f-b49a-ac99195a5827 => generated 111 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:34:21.893731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-60071c89-8c5c-47cc-a688-f0d02bab2a16 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:21.901648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-60071c89-8c5c-47cc-a688-f0d02bab2a16 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:21.915052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:21.916895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:21.919710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60071c89-8c5c-47cc-a688-f0d02bab2a16 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:21.920455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60071c89-8c5c-47cc-a688-f0d02bab2a16 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:21.924157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60071c89-8c5c-47cc-a688-f0d02bab2a16 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:21.926026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60071c89-8c5c-47cc-a688-f0d02bab2a16 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:21.927269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60071c89-8c5c-47cc-a688-f0d02bab2a16 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:21.928237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60071c89-8c5c-47cc-a688-f0d02bab2a16 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:22.016261 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-60071c89-8c5c-47cc-a688-f0d02bab2a16 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.130786 Aug 25 13:34:22.044754 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2687/5315] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Aug 25 13:34:21 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:22.165642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-abcdaa4b-f1d2-4a79-9ce6-b2e06e557652 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:22.167646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-abcdaa4b-f1d2-4a79-9ce6-b2e06e557652 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:22.177983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:22.181758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:22.193479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abcdaa4b-f1d2-4a79-9ce6-b2e06e557652 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:22.194863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abcdaa4b-f1d2-4a79-9ce6-b2e06e557652 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:22.196041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abcdaa4b-f1d2-4a79-9ce6-b2e06e557652 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:22.197684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abcdaa4b-f1d2-4a79-9ce6-b2e06e557652 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:22.199481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abcdaa4b-f1d2-4a79-9ce6-b2e06e557652 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:22.200821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abcdaa4b-f1d2-4a79-9ce6-b2e06e557652 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:22.289396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-abcdaa4b-f1d2-4a79-9ce6-b2e06e557652 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:34:22.613982 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-abcdaa4b-f1d2-4a79-9ce6-b2e06e557652 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "DELETE /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 204 len: 0 microversion: 2.20 time: 0.455958 Aug 25 13:34:22.619756 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2629/5316] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:34:22 2022] DELETE /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:34:22.640385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:22.644664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:22.679184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:22.683104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:22.686373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:22.691815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:22.693224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:22.700309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:24.403104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:24.429066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:24.434220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:24.437655 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-67602a1d-fd6c-4abc-97a3-8197a11922c9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 1.809338 Aug 25 13:34:24.440785 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2688/5317] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:34:22 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:34:25.487957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:25.489402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:25.516387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:25.528023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:25.528911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:25.531015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:25.532280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:25.533441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:28.027587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:28.062186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:28.071460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:28.074487 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-45c875aa-953b-40f3-9548-2796bb882e2e tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1723 microversion: 2.20 time: 2.596457 Aug 25 13:34:28.080541 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2630/5318] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:34:25 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1723 bytes in 2605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:34:28.818768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-fbde6a1b-801f-4c97-be0a-68f3fa1d52a4 req-cc901805-5ae6-4efb-a9f3-331cfb63f811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d84654-c8b1-496b-992d-8d0d80b25316", "name": "network-vif-deleted", "tag": "76dc1323-87f8-4b14-9fdf-6ed8548e9491"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:28.909249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fbde6a1b-801f-4c97-be0a-68f3fa1d52a4 req-cc901805-5ae6-4efb-a9f3-331cfb63f811 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:28.913830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fbde6a1b-801f-4c97-be0a-68f3fa1d52a4 req-cc901805-5ae6-4efb-a9f3-331cfb63f811 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:28.917684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fbde6a1b-801f-4c97-be0a-68f3fa1d52a4 req-cc901805-5ae6-4efb-a9f3-331cfb63f811 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:29.015600 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-fbde6a1b-801f-4c97-be0a-68f3fa1d52a4 req-cc901805-5ae6-4efb-a9f3-331cfb63f811 service nova] Creating event network-vif-deleted:76dc1323-87f8-4b14-9fdf-6ed8548e9491 for instance 32d84654-c8b1-496b-992d-8d0d80b25316 on n-h2-852771-8 Aug 25 13:34:29.048575 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-fbde6a1b-801f-4c97-be0a-68f3fa1d52a4 req-cc901805-5ae6-4efb-a9f3-331cfb63f811 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237941 Aug 25 13:34:29.053052 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2689/5319] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:34:29.137565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:29.143490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:29.170503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:29.175403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:29.176692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:29.180277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:29.181810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:29.185414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:29.363778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:29.367118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:29.371252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:29.375186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lazy-loading 'fault' on Instance uuid 32d84654-c8b1-496b-992d-8d0d80b25316 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:34:29.921909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:29.968022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:29.976439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b008e1fc747f4b928cac286f7c74d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ec962b7eb948ffa6ba84d7571087c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:29.979325 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-537d0e9f-8ed8-4ebb-99d9-3258678a6735 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 200 len: 1372 microversion: 2.20 time: 0.850131 Aug 25 13:34:29.980526 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2631/5320] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:34:29 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 1372 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:34:31.041168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:31.044597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:31.091381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:31.093806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:31.095042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:31.098761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:31.100421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:31.101923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:31.148405 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] HTTP exception thrown: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Request method failure captured: Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 HTTP/1.1 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fV6OqGIovTn6ssVW7eyjeID_7H24QtcYDVhxWGtW-LVK0ojz4OAa3vF6qvzOPN4gt3quTmLBQalSl7DDEdG9Twv_5b_6gKP8gPT2xApkV4rtc4C583wiwdmAXS86Jq5t4N2SyI8Tf9ximYAJ8JEZSHPLiaOqL6_Gq9t2fLV4cA4C0 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_37ec962b7eb948ffa6ba84d7571087c4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}] Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b008e1fc747f4b928cac286f7c74d0cf Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '32d84654-c8b1-496b-992d-8d0d80b25316'} Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:31.152232 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:31.165029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:31.165029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:31.165029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:31.165029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:31.165029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:34:31.165029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:34:31.165029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:31.165029 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:31.171481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Returning 404 to user: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:34:31.171481 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b7839b17-9dba-4f7d-a0b8-80ea1de9a29b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 404 len: 111 microversion: 2.20 time: 0.148688 Aug 25 13:34:31.172818 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2690/5321] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:34:31 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:34:31.203998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bec871b3-32ad-4d0b-920b-49173334587d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '.version_select at 0x7f3a29083d30>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:31.285608 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bec871b3-32ad-4d0b-920b-49173334587d tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848265354" status: 204 len: 0 microversion: 2.20 time: 0.094516 Aug 25 13:34:31.286870 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2632/5322] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Aug 25 13:34:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848265354 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 13:34:39.140582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0691cc53-3160-47d6-89c8-108a65ba7d68 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: .version_select at 0x7f3a29326310>, body: {"keypair": {"name": "tempest-keypair-287365193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/CUSLCOUDeMVRuoSOil+umL3av3VZzsWp5kNx9Sk3uwUo0G1ew4hZ+eQTgq43eNMdftRdHg1wkEVvEKeDHL796H+JHblLilmw2rvFsbh6M6z9ueALGPJUvpkYwqyQqQg=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:39.208924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-0691cc53-3160-47d6-89c8-108a65ba7d68 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:34:39.242031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-0691cc53-3160-47d6-89c8-108a65ba7d68 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for user b7fdce9f6d624473be8244e28eb215e0 and project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:34:39.299872 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0691cc53-3160-47d6-89c8-108a65ba7d68 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:34:40.315851 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [None req-0691cc53-3160-47d6-89c8-108a65ba7d68 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60070. Aug 25 13:34:40.448069 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0691cc53-3160-47d6-89c8-108a65ba7d68 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.594497 Aug 25 13:34:40.450450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2691/5323] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:34:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:34:44.475038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:44.477240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:44.516159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:44.517975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:44.550966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:44.558782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:44.559795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:44.574731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:44.583522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:44.583941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:44.691610 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] HTTP exception thrown: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Request method failure captured: Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 HTTP/1.1 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fV6OqGIovTn6ssVW7eyjeID_7H24QtcYDVhxWGtW-LVK0ojz4OAa3vF6qvzOPN4gt3quTmLBQalSl7DDEdG9Twv_5b_6gKP8gPT2xApkV4rtc4C583wiwdmAXS86Jq5t4N2SyI8Tf9ximYAJ8JEZSHPLiaOqL6_Gq9t2fLV4cA4C0 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_37ec962b7eb948ffa6ba84d7571087c4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}] Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b008e1fc747f4b928cac286f7c74d0cf Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '32d84654-c8b1-496b-992d-8d0d80b25316'} Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:34:44.695345 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Returning 404 to user: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:34:44.703055 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f707920b-b051-4cdd-a95d-f5564d5b0d4f tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "DELETE /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 404 len: 111 microversion: 2.20 time: 0.227317 Aug 25 13:34:44.706277 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2633/5324] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:34:44 2022] DELETE /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:34:44.710128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=16 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:44.726087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:44.727852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: 32d84654-c8b1-496b-992d-8d0d80b25316] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:44.749983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:44.756790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:44.757952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:44.767814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:44.769158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:44.770667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:44.840549 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] HTTP exception thrown: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Request method failure captured: Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 HTTP/1.1 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fV6OqGIovTn6ssVW7eyjeID_7H24QtcYDVhxWGtW-LVK0ojz4OAa3vF6qvzOPN4gt3quTmLBQalSl7DDEdG9Twv_5b_6gKP8gPT2xApkV4rtc4C583wiwdmAXS86Jq5t4N2SyI8Tf9ximYAJ8JEZSHPLiaOqL6_Gq9t2fLV4cA4C0 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_37ec962b7eb948ffa6ba84d7571087c4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}] Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b008e1fc747f4b928cac286f7c74d0cf Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '32d84654-c8b1-496b-992d-8d0d80b25316'} Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:44.844621 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:44.852600 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:44.852600 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:44.852600 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:44.852600 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:44.852600 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:34:44.852600 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:34:44.852600 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. Aug 25 13:34:44.852600 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:44.852600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Returning 404 to user: Instance 32d84654-c8b1-496b-992d-8d0d80b25316 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:34:44.852600 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-837991d3-c7b3-44c2-b0cc-6cac72ba08b9 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316" status: 404 len: 111 microversion: 2.20 time: 0.139338 Aug 25 13:34:44.857765 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2692/5325] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:34:44 2022] GET /compute/v2.1/servers/32d84654-c8b1-496b-992d-8d0d80b25316 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:34:47.548807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1564555329", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "229df64b-66b9-4c71-89d1-8ec5cff9e192"}], "security_groups": [{"name": "tempest-securitygroup--1462183751"}], "key_name": "tempest-keypair-287365193", "user_data": "}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:49.204453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] validate_networks() for [('229df64b-66b9-4c71-89d1-8ec5cff9e192', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:34:52.462422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:34:52.464473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:34:52.465755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:34:52.467812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:34:52.468611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:34:52.500343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:52.501706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:52.502574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:52.504906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:52.505903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:52.506989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:52.550176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:34:52.564705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for user b7fdce9f6d624473be8244e28eb215e0 and project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:34:52.598782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:34:52.604615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:34:52.725683 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2213bf22-9be7-4ea7-92b4-22b882339937 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.185340 Aug 25 13:34:52.738959 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2634/5326] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:34:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 5199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:34:52.751185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52744639-c128-45fe-a063-bd47663ab06d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:52.756634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-52744639-c128-45fe-a063-bd47663ab06d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:52.777742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:52.780636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:52.962270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-52744639-c128-45fe-a063-bd47663ab06d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:52.995920 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-52744639-c128-45fe-a063-bd47663ab06d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1241 microversion: 2.1 time: 0.252717 Aug 25 13:34:52.998093 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2693/5327] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:52 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1241 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:54.042749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d894576f-e350-4729-9b28-0a1bedb19cdf tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:54.049078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d894576f-e350-4729-9b28-0a1bedb19cdf tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:54.309446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d894576f-e350-4729-9b28-0a1bedb19cdf tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:54.322404 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d894576f-e350-4729-9b28-0a1bedb19cdf tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1241 microversion: 2.1 time: 0.293769 Aug 25 13:34:54.322997 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2635/5328] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:54 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1241 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:55.364302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63f3d847-3967-4f4f-8706-64fe870bff0a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:55.368467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-63f3d847-3967-4f4f-8706-64fe870bff0a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:55.385167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:55.409346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f3d847-3967-4f4f-8706-64fe870bff0a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:55.417367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f3d847-3967-4f4f-8706-64fe870bff0a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:55.418529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f3d847-3967-4f4f-8706-64fe870bff0a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:55.419679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f3d847-3967-4f4f-8706-64fe870bff0a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:55.421407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f3d847-3967-4f4f-8706-64fe870bff0a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:55.422559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63f3d847-3967-4f4f-8706-64fe870bff0a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:55.676419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-63f3d847-3967-4f4f-8706-64fe870bff0a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:55.706167 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-63f3d847-3967-4f4f-8706-64fe870bff0a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1293 microversion: 2.1 time: 0.349777 Aug 25 13:34:55.727824 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2694/5329] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:55 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1293 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:56.326435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:56.338175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:56.402175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.403144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.403995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.419017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.420337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.423631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.504908 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] HTTP exception thrown: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Request method failure captured: Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b HTTP/1.1 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3fV6OqGIovTn6ssVW7eyjeID_7H24QtcYDVhxWGtW-LVK0ojz4OAa3vF6qvzOPN4gt3quTmLBQalSl7DDEdG9Twv_5b_6gKP8gPT2xApkV4rtc4C583wiwdmAXS86Jq5t4N2SyI8Tf9ximYAJ8JEZSHPLiaOqL6_Gq9t2fLV4cA4C0 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_37ec962b7eb948ffa6ba84d7571087c4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}] Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b008e1fc747f4b928cac286f7c74d0cf Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'd404ff6f-0fad-4c7f-bf95-5c0fe210039b'} Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:34:56.509885 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:34:56.519745 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:34:56.523940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Returning 404 to user: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:34:56.526770 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-27aa967a-06cc-4022-9ef1-83f91226674b tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 404 len: 111 microversion: 2.20 time: 0.215916 Aug 25 13:34:56.528813 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2636/5330] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Aug 25 13:34:56 2022] DELETE /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:34:56.559125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:56.560371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] [instance: d404ff6f-0fad-4c7f-bf95-5c0fe210039b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:56.616436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.622119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.623330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.624793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.627850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.631206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.698082 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] HTTP exception thrown: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Request method failure captured: Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b HTTP/1.1 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3fV6OqGIovTn6ssVW7eyjeID_7H24QtcYDVhxWGtW-LVK0ojz4OAa3vF6qvzOPN4gt3quTmLBQalSl7DDEdG9Twv_5b_6gKP8gPT2xApkV4rtc4C583wiwdmAXS86Jq5t4N2SyI8Tf9ximYAJ8JEZSHPLiaOqL6_Gq9t2fLV4cA4C0 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_37ec962b7eb948ffa6ba84d7571087c4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/37ec962b7eb948ffa6ba84d7571087c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37ec962b7eb948ffa6ba84d7571087c4"}]}] Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 37ec962b7eb948ffa6ba84d7571087c4 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704731974 Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b008e1fc747f4b928cac286f7c74d0cf Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704731974-project Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'd404ff6f-0fad-4c7f-bf95-5c0fe210039b'} Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:56.709963 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] Returning 404 to user: Instance d404ff6f-0fad-4c7f-bf95-5c0fe210039b could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-747a2312-3022-4139-a824-d394ecf76d00 tempest-AttachVolumeShelveTestJSON-704731974 tempest-AttachVolumeShelveTestJSON-704731974-project] 10.222.0.70 "GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b" status: 404 len: 111 microversion: 2.20 time: 0.178228 Aug 25 13:34:56.720426 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2695/5331] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Aug 25 13:34:56 2022] GET /compute/v2.1/servers/d404ff6f-0fad-4c7f-bf95-5c0fe210039b => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:34:56.761551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7be21e5e-bfda-4256-9b20-2223a3e9059b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:56.763567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7be21e5e-bfda-4256-9b20-2223a3e9059b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:56.801722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be21e5e-bfda-4256-9b20-2223a3e9059b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.806517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be21e5e-bfda-4256-9b20-2223a3e9059b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.809121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be21e5e-bfda-4256-9b20-2223a3e9059b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.812005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be21e5e-bfda-4256-9b20-2223a3e9059b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.815152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be21e5e-bfda-4256-9b20-2223a3e9059b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.822403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7be21e5e-bfda-4256-9b20-2223a3e9059b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:57.040080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7be21e5e-bfda-4256-9b20-2223a3e9059b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:57.082428 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7be21e5e-bfda-4256-9b20-2223a3e9059b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1299 microversion: 2.1 time: 0.333441 Aug 25 13:34:57.084017 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2637/5332] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:56 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1299 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:58.130277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2563d71c-ed0e-4e9b-87ce-146572d43069 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:58.134354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2563d71c-ed0e-4e9b-87ce-146572d43069 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:58.149200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2563d71c-ed0e-4e9b-87ce-146572d43069 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:58.150795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2563d71c-ed0e-4e9b-87ce-146572d43069 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:58.151963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2563d71c-ed0e-4e9b-87ce-146572d43069 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:58.153642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2563d71c-ed0e-4e9b-87ce-146572d43069 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:58.155553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2563d71c-ed0e-4e9b-87ce-146572d43069 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:58.156702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2563d71c-ed0e-4e9b-87ce-146572d43069 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:58.652283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2563d71c-ed0e-4e9b-87ce-146572d43069 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:58.732003 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2563d71c-ed0e-4e9b-87ce-146572d43069 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1299 microversion: 2.1 time: 0.610181 Aug 25 13:34:58.753846 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2696/5333] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:58 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1299 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:59.784977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dca3a722-a23e-4b4c-9dfd-eac9404c875a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:59.792790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dca3a722-a23e-4b4c-9dfd-eac9404c875a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:59.815960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dca3a722-a23e-4b4c-9dfd-eac9404c875a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:59.822802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dca3a722-a23e-4b4c-9dfd-eac9404c875a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:59.824391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dca3a722-a23e-4b4c-9dfd-eac9404c875a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:59.827815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dca3a722-a23e-4b4c-9dfd-eac9404c875a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:59.829048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dca3a722-a23e-4b4c-9dfd-eac9404c875a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:59.830333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dca3a722-a23e-4b4c-9dfd-eac9404c875a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:00.158775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dca3a722-a23e-4b4c-9dfd-eac9404c875a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:00.189922 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dca3a722-a23e-4b4c-9dfd-eac9404c875a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1299 microversion: 2.1 time: 0.415360 Aug 25 13:35:00.202513 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2638/5334] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:59 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1299 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:01.242054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d595cee8-013b-4391-bc5b-9068c10213e6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:01.245385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d595cee8-013b-4391-bc5b-9068c10213e6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:01.266877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d595cee8-013b-4391-bc5b-9068c10213e6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:01.269011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d595cee8-013b-4391-bc5b-9068c10213e6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:01.271151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d595cee8-013b-4391-bc5b-9068c10213e6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:01.273582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d595cee8-013b-4391-bc5b-9068c10213e6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:01.275403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d595cee8-013b-4391-bc5b-9068c10213e6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:01.276741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d595cee8-013b-4391-bc5b-9068c10213e6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:01.921550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d595cee8-013b-4391-bc5b-9068c10213e6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:01.960600 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d595cee8-013b-4391-bc5b-9068c10213e6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1299 microversion: 2.1 time: 0.733693 Aug 25 13:35:01.962170 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2697/5335] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:01 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1299 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:03.004222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bb523cd6-1b22-42df-9920-163dc7bd059e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:03.007317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bb523cd6-1b22-42df-9920-163dc7bd059e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:03.026738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:03.054576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb523cd6-1b22-42df-9920-163dc7bd059e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:03.058254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb523cd6-1b22-42df-9920-163dc7bd059e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:03.059216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb523cd6-1b22-42df-9920-163dc7bd059e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:03.061793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb523cd6-1b22-42df-9920-163dc7bd059e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:03.065091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb523cd6-1b22-42df-9920-163dc7bd059e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:03.065929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb523cd6-1b22-42df-9920-163dc7bd059e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:04.027077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bb523cd6-1b22-42df-9920-163dc7bd059e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:04.062917 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bb523cd6-1b22-42df-9920-163dc7bd059e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1367 microversion: 2.1 time: 1.065083 Aug 25 13:35:04.078803 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2639/5336] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:02 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1367 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:35:05.102514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-595c521e-5626-4673-8bd2-763eab303c86 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:05.103652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-595c521e-5626-4673-8bd2-763eab303c86 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:05.133965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:05.136445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-595c521e-5626-4673-8bd2-763eab303c86 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:05.137695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-595c521e-5626-4673-8bd2-763eab303c86 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:05.139432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-595c521e-5626-4673-8bd2-763eab303c86 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:05.142195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-595c521e-5626-4673-8bd2-763eab303c86 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:05.143369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-595c521e-5626-4673-8bd2-763eab303c86 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:05.144416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-595c521e-5626-4673-8bd2-763eab303c86 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:05.849105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-595c521e-5626-4673-8bd2-763eab303c86 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:05.866794 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-595c521e-5626-4673-8bd2-763eab303c86 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1367 microversion: 2.1 time: 0.773179 Aug 25 13:35:05.868855 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2698/5337] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:05 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1367 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:06.919015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a76e910b-81a6-418d-991d-d9fd7b2bacbd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:06.948875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a76e910b-81a6-418d-991d-d9fd7b2bacbd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:07.001620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:07.016812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a76e910b-81a6-418d-991d-d9fd7b2bacbd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:07.018318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a76e910b-81a6-418d-991d-d9fd7b2bacbd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:07.019847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a76e910b-81a6-418d-991d-d9fd7b2bacbd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:07.023613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a76e910b-81a6-418d-991d-d9fd7b2bacbd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:07.026273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a76e910b-81a6-418d-991d-d9fd7b2bacbd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:07.031049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a76e910b-81a6-418d-991d-d9fd7b2bacbd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:07.687735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8f44b463-a9da-4613-80ff-b43440e63bf0 req-f78c2854-16ad-42a5-9077-8129d1bb3b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7840aa88-f6e2-4295-a852-daa4d572f8b3", "tag": "f8dbc661-202c-42c0-98c7-97614542582b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:07.726784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8f44b463-a9da-4613-80ff-b43440e63bf0 req-f78c2854-16ad-42a5-9077-8129d1bb3b08 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:07.727703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8f44b463-a9da-4613-80ff-b43440e63bf0 req-f78c2854-16ad-42a5-9077-8129d1bb3b08 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:07.730004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8f44b463-a9da-4613-80ff-b43440e63bf0 req-f78c2854-16ad-42a5-9077-8129d1bb3b08 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:07.780070 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8f44b463-a9da-4613-80ff-b43440e63bf0 req-f78c2854-16ad-42a5-9077-8129d1bb3b08 service nova] Creating event network-changed:f8dbc661-202c-42c0-98c7-97614542582b for instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 on n-h1-852771-8 Aug 25 13:35:07.791516 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8f44b463-a9da-4613-80ff-b43440e63bf0 req-f78c2854-16ad-42a5-9077-8129d1bb3b08 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.591470 Aug 25 13:35:07.793942 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2699/5338] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:08.172036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a76e910b-81a6-418d-991d-d9fd7b2bacbd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:08.202876 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a76e910b-81a6-418d-991d-d9fd7b2bacbd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1367 microversion: 2.1 time: 1.296649 Aug 25 13:35:08.217821 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2640/5339] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:06 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1367 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:09.275713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4c0b62c5-100f-4989-992e-05eff85e0f80 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:09.280773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4c0b62c5-100f-4989-992e-05eff85e0f80 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:09.313321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0b62c5-100f-4989-992e-05eff85e0f80 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:09.326681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0b62c5-100f-4989-992e-05eff85e0f80 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:09.327729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0b62c5-100f-4989-992e-05eff85e0f80 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:09.329207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0b62c5-100f-4989-992e-05eff85e0f80 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:09.330242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0b62c5-100f-4989-992e-05eff85e0f80 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:09.331201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0b62c5-100f-4989-992e-05eff85e0f80 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:10.174086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4c0b62c5-100f-4989-992e-05eff85e0f80 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:10.201640 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4c0b62c5-100f-4989-992e-05eff85e0f80 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1367 microversion: 2.1 time: 0.959647 Aug 25 13:35:10.214394 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2700/5340] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:09 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1367 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:11.262082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dc45c84a-10eb-4f11-a39f-535fac334fa9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:11.274257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dc45c84a-10eb-4f11-a39f-535fac334fa9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:11.325225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc45c84a-10eb-4f11-a39f-535fac334fa9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:11.328119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc45c84a-10eb-4f11-a39f-535fac334fa9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:11.332447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc45c84a-10eb-4f11-a39f-535fac334fa9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:11.338104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc45c84a-10eb-4f11-a39f-535fac334fa9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:11.343272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc45c84a-10eb-4f11-a39f-535fac334fa9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:11.349482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc45c84a-10eb-4f11-a39f-535fac334fa9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:11.988729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dc45c84a-10eb-4f11-a39f-535fac334fa9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:12.023144 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dc45c84a-10eb-4f11-a39f-535fac334fa9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1367 microversion: 2.1 time: 0.771774 Aug 25 13:35:12.024622 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2641/5341] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:11 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1367 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:13.073076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9d192cc-105e-4eda-8488-5afacf50c7e7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:13.075367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b9d192cc-105e-4eda-8488-5afacf50c7e7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:13.097753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9d192cc-105e-4eda-8488-5afacf50c7e7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:13.100001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9d192cc-105e-4eda-8488-5afacf50c7e7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:13.101840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9d192cc-105e-4eda-8488-5afacf50c7e7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:13.104734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9d192cc-105e-4eda-8488-5afacf50c7e7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:13.106441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9d192cc-105e-4eda-8488-5afacf50c7e7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:13.108545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9d192cc-105e-4eda-8488-5afacf50c7e7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:13.753434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89553ce5-95c4-4b52-823a-c85397c00d92 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Action: 'create', calling method: .version_select at 0x7f3a2e83fd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-476707628"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:13.791490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b9d192cc-105e-4eda-8488-5afacf50c7e7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:13.810113 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9d192cc-105e-4eda-8488-5afacf50c7e7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1367 microversion: 2.1 time: 0.747150 Aug 25 13:35:13.828304 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2701/5342] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:13 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1367 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:14.854246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce011cc3-262a-4ad2-b2db-bb0757995179 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:14.866359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ce011cc3-262a-4ad2-b2db-bb0757995179 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:14.893474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce011cc3-262a-4ad2-b2db-bb0757995179 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:14.895015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce011cc3-262a-4ad2-b2db-bb0757995179 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:14.898599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce011cc3-262a-4ad2-b2db-bb0757995179 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:14.900543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce011cc3-262a-4ad2-b2db-bb0757995179 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:14.910356 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89553ce5-95c4-4b52-823a-c85397c00d92 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.441377 Aug 25 13:35:14.921428 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2642/5343] 10.222.0.70 () {60 vars in 1155 bytes} [Thu Aug 25 13:35:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1454 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 25 13:35:14.925813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce011cc3-262a-4ad2-b2db-bb0757995179 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:14.939158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1c5d82b4-8f18-42f5-97ab-4cc13e38f90c tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a2a59a8b0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:14.943813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce011cc3-262a-4ad2-b2db-bb0757995179 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:15.149897 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1c5d82b4-8f18-42f5-97ab-4cc13e38f90c tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 200 len: 344 microversion: 2.1 time: 0.218684 Aug 25 13:35:15.151266 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2643/5344] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:14 2022] GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 344 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:35:16.177289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72064665-16dc-4686-8b42-cd983c77629e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a290e3700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:16.316672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ce011cc3-262a-4ad2-b2db-bb0757995179 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:16.369783 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce011cc3-262a-4ad2-b2db-bb0757995179 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1367 microversion: 2.1 time: 1.514906 Aug 25 13:35:16.374330 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2702/5345] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:14 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1367 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:35:16.465718 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72064665-16dc-4686-8b42-cd983c77629e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 200 len: 344 microversion: 2.1 time: 0.298197 Aug 25 13:35:16.470227 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2644/5346] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:16 2022] GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 344 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:35:17.418096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da04ff08-c2bd-4465-bd32-c69a2ef2bbd0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:17.420583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da04ff08-c2bd-4465-bd32-c69a2ef2bbd0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:17.435912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da04ff08-c2bd-4465-bd32-c69a2ef2bbd0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:17.437329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da04ff08-c2bd-4465-bd32-c69a2ef2bbd0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:17.446632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da04ff08-c2bd-4465-bd32-c69a2ef2bbd0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:17.448588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da04ff08-c2bd-4465-bd32-c69a2ef2bbd0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:17.449316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da04ff08-c2bd-4465-bd32-c69a2ef2bbd0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:17.450321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da04ff08-c2bd-4465-bd32-c69a2ef2bbd0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:17.490847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-18159fbe-150e-4293-ad55-c8ebc8eb62c9 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a2905b550>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:17.675421 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-18159fbe-150e-4293-ad55-c8ebc8eb62c9 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 200 len: 345 microversion: 2.1 time: 0.191452 Aug 25 13:35:17.676811 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2645/5347] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:17 2022] GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:35:17.707697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-17a56e93-26f6-45c4-abf8-3dbf64047c85 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Action: 'create', calling method: .version_select at 0x7f3a2905b820>, body: {"snapshot": {"volume_id": "e66c6d6c-d293-4408-a50f-0599831c3286", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1414430813"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:18.219581 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-17a56e93-26f6-45c4-abf8-3dbf64047c85 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.520270 Aug 25 13:35:18.239969 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2646/5348] 10.222.0.70 () {60 vars in 1162 bytes} [Thu Aug 25 13:35:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:35:18.249635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b2d23df-a43b-43c2-8325-098a2fc62825 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a29067700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:18.316600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da04ff08-c2bd-4465-bd32-c69a2ef2bbd0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:18.346905 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da04ff08-c2bd-4465-bd32-c69a2ef2bbd0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1367 microversion: 2.1 time: 0.936688 Aug 25 13:35:18.372012 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2703/5349] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:17 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1367 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:18.402341 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b2d23df-a43b-43c2-8325-098a2fc62825 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 200 len: 287 microversion: 2.1 time: 0.160056 Aug 25 13:35:18.405815 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2647/5350] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:18 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 287 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:18.432563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b4f4ea69-cddc-4472-aee7-14a183621d3f tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a29274e50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:18.545201 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b4f4ea69-cddc-4472-aee7-14a183621d3f tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.128929 Aug 25 13:35:18.548205 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2704/5351] 10.222.0.70 () {58 vars in 1140 bytes} [Thu Aug 25 13:35:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:35:18.605835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4e04b328-0d0f-449d-bfbc-9b3ebe08b0cb tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a29067700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:18.775447 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4e04b328-0d0f-449d-bfbc-9b3ebe08b0cb tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 200 len: 287 microversion: 2.1 time: 0.195123 Aug 25 13:35:18.776587 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2648/5352] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:18 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 287 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:19.397184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-384bdac9-520f-4f6f-adef-64e14bd72b2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:19.401410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-384bdac9-520f-4f6f-adef-64e14bd72b2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:19.416972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-384bdac9-520f-4f6f-adef-64e14bd72b2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:19.418284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-384bdac9-520f-4f6f-adef-64e14bd72b2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:19.420232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-384bdac9-520f-4f6f-adef-64e14bd72b2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:19.421949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-384bdac9-520f-4f6f-adef-64e14bd72b2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:19.423132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-384bdac9-520f-4f6f-adef-64e14bd72b2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:19.424185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-384bdac9-520f-4f6f-adef-64e14bd72b2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:19.798014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-beaf9ea6-14ef-4dec-a810-ae54e3876ade tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a29105940>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:19.929485 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-beaf9ea6-14ef-4dec-a810-ae54e3876ade tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 200 len: 287 microversion: 2.1 time: 0.137250 Aug 25 13:35:19.931695 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2649/5353] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:19 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:19.963833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c81c2c2f-51fd-4ee5-8131-49634daa6f45 req-0dafb9da-888d-4383-b56d-7e9f739a4c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7840aa88-f6e2-4295-a852-daa4d572f8b3", "name": "network-vif-plugged", "status": "completed", "tag": "f8dbc661-202c-42c0-98c7-97614542582b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:20.022385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:20.036800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c81c2c2f-51fd-4ee5-8131-49634daa6f45 req-0dafb9da-888d-4383-b56d-7e9f739a4c72 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:20.045472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c81c2c2f-51fd-4ee5-8131-49634daa6f45 req-0dafb9da-888d-4383-b56d-7e9f739a4c72 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:20.045957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c81c2c2f-51fd-4ee5-8131-49634daa6f45 req-0dafb9da-888d-4383-b56d-7e9f739a4c72 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:20.060293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=37 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:20.099828 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c81c2c2f-51fd-4ee5-8131-49634daa6f45 req-0dafb9da-888d-4383-b56d-7e9f739a4c72 service nova] Creating event network-vif-plugged:f8dbc661-202c-42c0-98c7-97614542582b for instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 on n-h1-852771-8 Aug 25 13:35:20.117671 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c81c2c2f-51fd-4ee5-8131-49634daa6f45 req-0dafb9da-888d-4383-b56d-7e9f739a4c72 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160975 Aug 25 13:35:20.120085 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2650/5354] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:20.183141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-384bdac9-520f-4f6f-adef-64e14bd72b2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:20.202308 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-384bdac9-520f-4f6f-adef-64e14bd72b2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1367 microversion: 2.1 time: 0.811841 Aug 25 13:35:20.203910 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2705/5355] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:19 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1367 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:20.968757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d9509fcc-d9d8-4491-8a95-bc5e59edb45e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a290e3700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:21.083496 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d9509fcc-d9d8-4491-8a95-bc5e59edb45e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 200 len: 287 microversion: 2.1 time: 0.136942 Aug 25 13:35:21.085011 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2651/5356] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:20 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 287 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:21.244247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e5881c2-b8c6-4c7e-9107-4fb81fa41030 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:21.245486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5e5881c2-b8c6-4c7e-9107-4fb81fa41030 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:21.281364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e5881c2-b8c6-4c7e-9107-4fb81fa41030 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:21.285325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e5881c2-b8c6-4c7e-9107-4fb81fa41030 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:21.286821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e5881c2-b8c6-4c7e-9107-4fb81fa41030 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:21.291947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e5881c2-b8c6-4c7e-9107-4fb81fa41030 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:21.295304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e5881c2-b8c6-4c7e-9107-4fb81fa41030 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:21.298327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e5881c2-b8c6-4c7e-9107-4fb81fa41030 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:22.110133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9850fdb4-8a4e-4ea3-a84e-b24500d4476f tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a290488b0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:22.254129 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9850fdb4-8a4e-4ea3-a84e-b24500d4476f tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 200 len: 287 microversion: 2.1 time: 0.153922 Aug 25 13:35:22.255560 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2652/5357] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:22 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:35:22.698653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5e5881c2-b8c6-4c7e-9107-4fb81fa41030 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:22.721048 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5e5881c2-b8c6-4c7e-9107-4fb81fa41030 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1367 microversion: 2.1 time: 1.483299 Aug 25 13:35:22.722170 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2706/5358] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:21 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1367 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:35:23.280823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-49c1c688-6a1d-4b5f-a036-5133744a53b7 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a29048a60>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:23.391450 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-49c1c688-6a1d-4b5f-a036-5133744a53b7 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 200 len: 288 microversion: 2.1 time: 0.121329 Aug 25 13:35:23.392543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2653/5359] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:23 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 288 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:23.415046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-282937f9-27b6-4917-a38d-10d8ce739391 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a294290d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:23.712072 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-282937f9-27b6-4917-a38d-10d8ce739391 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 202 len: 0 microversion: 2.1 time: 0.306458 Aug 25 13:35:23.714019 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2707/5360] 10.222.0.70 () {58 vars in 1254 bytes} [Thu Aug 25 13:35:23 2022] DELETE /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:35:23.730519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-78f32115-44fa-4115-84be-2e0b58a37b57 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a29142a60>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:23.766488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-878976cd-a4bf-4e86-a099-9d9639e49136 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:23.770465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-878976cd-a4bf-4e86-a099-9d9639e49136 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:23.805183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=28 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:23.812152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-878976cd-a4bf-4e86-a099-9d9639e49136 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:23.822128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-878976cd-a4bf-4e86-a099-9d9639e49136 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:23.823654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-878976cd-a4bf-4e86-a099-9d9639e49136 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:23.826451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-878976cd-a4bf-4e86-a099-9d9639e49136 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:23.828118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-878976cd-a4bf-4e86-a099-9d9639e49136 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:23.829346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-878976cd-a4bf-4e86-a099-9d9639e49136 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:23.881816 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-78f32115-44fa-4115-84be-2e0b58a37b57 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 200 len: 287 microversion: 2.1 time: 0.160742 Aug 25 13:35:23.890490 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2654/5361] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:23 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:24.920636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4f2e50bd-ea38-49d5-a905-62a16a78234a tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a2909a700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:24.929308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-878976cd-a4bf-4e86-a099-9d9639e49136 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:24.971824 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-878976cd-a4bf-4e86-a099-9d9639e49136 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1558 microversion: 2.1 time: 1.206849 Aug 25 13:35:24.974054 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2708/5362] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:23 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1558 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:35:25.036653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d21ae1a1-c291-4bb1-b707-a52e48b2abd9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:25.039058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d21ae1a1-c291-4bb1-b707-a52e48b2abd9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:25.071531 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4f2e50bd-ea38-49d5-a905-62a16a78234a tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 200 len: 287 microversion: 2.1 time: 0.171815 Aug 25 13:35:25.076566 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2655/5363] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:24 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 287 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:25.086369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d21ae1a1-c291-4bb1-b707-a52e48b2abd9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:25.087735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d21ae1a1-c291-4bb1-b707-a52e48b2abd9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:25.088811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d21ae1a1-c291-4bb1-b707-a52e48b2abd9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:25.090420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d21ae1a1-c291-4bb1-b707-a52e48b2abd9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:25.092158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d21ae1a1-c291-4bb1-b707-a52e48b2abd9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:25.093220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d21ae1a1-c291-4bb1-b707-a52e48b2abd9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:25.342488 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d21ae1a1-c291-4bb1-b707-a52e48b2abd9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.324298 Aug 25 13:35:25.358153 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2709/5364] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:35:25 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-interface => generated 285 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:26.102149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f242db74-9beb-4791-978c-5dde1502b21e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a2991f940>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:26.268510 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f242db74-9beb-4791-978c-5dde1502b21e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 200 len: 287 microversion: 2.1 time: 0.178860 Aug 25 13:35:26.270385 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2656/5365] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:26 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 287 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:35:27.315831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-16207c2e-4552-4522-aaf8-20b10e090014 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a2933faf0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:27.523715 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-16207c2e-4552-4522-aaf8-20b10e090014 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 200 len: 287 microversion: 2.1 time: 0.238398 Aug 25 13:35:27.526279 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2710/5366] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:27 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 287 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:28.550169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a707aac-949d-479a-85c3-64d893d35b3e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a29337d30>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:28.579423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-4020a99e-f803-4dd2-96fc-edb56c14efae req-b3c7cc89-6b33-4e74-9b21-df5a5e55d2db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7840aa88-f6e2-4295-a852-daa4d572f8b3", "tag": "f8dbc661-202c-42c0-98c7-97614542582b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:28.687787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4020a99e-f803-4dd2-96fc-edb56c14efae req-b3c7cc89-6b33-4e74-9b21-df5a5e55d2db service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:28.688072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4020a99e-f803-4dd2-96fc-edb56c14efae req-b3c7cc89-6b33-4e74-9b21-df5a5e55d2db service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:28.706928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4020a99e-f803-4dd2-96fc-edb56c14efae req-b3c7cc89-6b33-4e74-9b21-df5a5e55d2db service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:28.759440 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-4020a99e-f803-4dd2-96fc-edb56c14efae req-b3c7cc89-6b33-4e74-9b21-df5a5e55d2db service nova] Creating event network-changed:f8dbc661-202c-42c0-98c7-97614542582b for instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 on n-h1-852771-8 Aug 25 13:35:28.775311 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-7a707aac-949d-479a-85c3-64d893d35b3e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] HTTP exception thrown: Snapshot 6f2f02c1-117a-4c7e-badc-8ebfde345034 could not be found. Aug 25 13:35:28.784844 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-4020a99e-f803-4dd2-96fc-edb56c14efae req-b3c7cc89-6b33-4e74-9b21-df5a5e55d2db service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.428962 Aug 25 13:35:28.792495 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2657/5367] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a707aac-949d-479a-85c3-64d893d35b3e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Request method failure captured: Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 HTTP/1.1 Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3qRRK1hOl4G6Lwfi584wIvnthEf2vXfbJbb_H6mCGKEIkZrJUEqdcP_8RmitzEJLRPxBipPj4aABeesTKwjM9ODp_ovXMMz_5zl61kas64vcyARWFgl0_RbTuHlTNtzcUx3JCfZpT2eS26gszyodG74K8x6fflgXmlEw2XcyIm0tJs Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 02d5252c77694efeba1c7c64b2ced810 Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02d5252c77694efeba1c7c64b2ced810"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_02d5252c77694efeba1c7c64b2ced810", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/02d5252c77694efeba1c7c64b2ced810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02d5252c77694efeba1c7c64b2ced810"}]}] Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 02d5252c77694efeba1c7c64b2ced810 Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesSnapshotsTestJSON-1565076753-project Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c87fc8823bcd4b8abbb3c6c73daabe6a Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1565076753-project Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: exception: Snapshot 6f2f02c1-117a-4c7e-badc-8ebfde345034 could not be found. Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '6f2f02c1-117a-4c7e-badc-8ebfde345034'} Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6f2f02c1-117a-4c7e-badc-8ebfde345034 could not be found. (HTTP 404) (Request-ID: req-77b21b5a-787a-4c6d-ba17-8d04e4bcc759) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:35:28.802412 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6f2f02c1-117a-4c7e-badc-8ebfde345034 could not be found. Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6f2f02c1-117a-4c7e-badc-8ebfde345034 could not be found. Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6f2f02c1-117a-4c7e-badc-8ebfde345034 could not be found. Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a707aac-949d-479a-85c3-64d893d35b3e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Returning 404 to user: Snapshot 6f2f02c1-117a-4c7e-badc-8ebfde345034 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:28.812066 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a707aac-949d-479a-85c3-64d893d35b3e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034" status: 404 len: 111 microversion: 2.1 time: 0.267410 Aug 25 13:35:28.821211 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2711/5368] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 13:35:28 2022] GET /compute/v2.1/os-snapshots/6f2f02c1-117a-4c7e-badc-8ebfde345034 => generated 111 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:35:28.828398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-087852f7-2922-489e-80c7-08c2ee0ff2bb tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a290e3700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:29.064689 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-087852f7-2922-489e-80c7-08c2ee0ff2bb tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 202 len: 0 microversion: 2.1 time: 0.248284 Aug 25 13:35:29.072108 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2658/5369] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:35:28 2022] DELETE /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:35:29.082807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fba457ce-71ac-40fa-b246-8557bdbb296b tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a29274b80>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:29.302994 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fba457ce-71ac-40fa-b246-8557bdbb296b tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 200 len: 344 microversion: 2.1 time: 0.227829 Aug 25 13:35:29.304244 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2712/5370] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:29 2022] GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 344 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:30.376872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e8699b88-7b8f-4ac6-877f-b22a3245f940 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a29fd2e50>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:30.512500 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e8699b88-7b8f-4ac6-877f-b22a3245f940 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 200 len: 344 microversion: 2.1 time: 0.190673 Aug 25 13:35:30.525678 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2659/5371] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:30 2022] GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:31.546042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-65fd6fcc-c086-4daa-9154-41d534be3fce tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a292ea1f0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:31.812252 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-65fd6fcc-c086-4daa-9154-41d534be3fce tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 200 len: 344 microversion: 2.1 time: 0.279381 Aug 25 13:35:31.813300 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2713/5372] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:31 2022] GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 344 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:32.844501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a4cf7cff-6202-46ab-86f0-3c83c0c97f03 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a290cb3a0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:33.068976 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a4cf7cff-6202-46ab-86f0-3c83c0c97f03 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 200 len: 344 microversion: 2.1 time: 0.236950 Aug 25 13:35:33.071221 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2660/5373] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:32 2022] GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 344 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:34.107117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-471ae014-7354-40fe-9ee0-c479f476556e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a292c9160>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:34.327461 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-471ae014-7354-40fe-9ee0-c479f476556e tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 200 len: 344 microversion: 2.1 time: 0.230096 Aug 25 13:35:34.329231 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2714/5374] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:34 2022] GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 344 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:35.356801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c9361a2b-44e8-4882-aa3c-d838ebcff45a tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a29067280>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:35.464755 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c9361a2b-44e8-4882-aa3c-d838ebcff45a tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] HTTP exception thrown: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c9361a2b-44e8-4882-aa3c-d838ebcff45a tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Request method failure captured: Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 HTTP/1.1 Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3qRRK1hOl4G6Lwfi584wIvnthEf2vXfbJbb_H6mCGKEIkZrJUEqdcP_8RmitzEJLRPxBipPj4aABeesTKwjM9ODp_ovXMMz_5zl61kas64vcyARWFgl0_RbTuHlTNtzcUx3JCfZpT2eS26gszyodG74K8x6fflgXmlEw2XcyIm0tJs Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 02d5252c77694efeba1c7c64b2ced810 Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02d5252c77694efeba1c7c64b2ced810"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_02d5252c77694efeba1c7c64b2ced810", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/02d5252c77694efeba1c7c64b2ced810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02d5252c77694efeba1c7c64b2ced810"}]}] Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 02d5252c77694efeba1c7c64b2ced810 Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-VolumesSnapshotsTestJSON-1565076753-project Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: c87fc8823bcd4b8abbb3c6c73daabe6a Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1565076753-project Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: exception: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'e66c6d6c-d293-4408-a50f-0599831c3286'} Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. (HTTP 404) (Request-ID: req-a34142f7-ac24-40bb-87a2-dcef81ac5512) Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:35:35.470549 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.478589 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.491165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c9361a2b-44e8-4882-aa3c-d838ebcff45a tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Returning 404 to user: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:35.491165 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c9361a2b-44e8-4882-aa3c-d838ebcff45a tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 404 len: 109 microversion: 2.1 time: 0.138939 Aug 25 13:35:35.507721 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2661/5375] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:35 2022] GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 109 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:35:35.509295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:35.512852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=74 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:35.528644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c995b8f-fc13-46dd-bc71-a9998ac68fe8 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a292910d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:35.677703 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-9c995b8f-fc13-46dd-bc71-a9998ac68fe8 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] HTTP exception thrown: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c995b8f-fc13-46dd-bc71-a9998ac68fe8 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Request method failure captured: Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 HTTP/1.1 Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3qRRK1hOl4G6Lwfi584wIvnthEf2vXfbJbb_H6mCGKEIkZrJUEqdcP_8RmitzEJLRPxBipPj4aABeesTKwjM9ODp_ovXMMz_5zl61kas64vcyARWFgl0_RbTuHlTNtzcUx3JCfZpT2eS26gszyodG74K8x6fflgXmlEw2XcyIm0tJs Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 02d5252c77694efeba1c7c64b2ced810 Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02d5252c77694efeba1c7c64b2ced810"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_02d5252c77694efeba1c7c64b2ced810", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/02d5252c77694efeba1c7c64b2ced810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02d5252c77694efeba1c7c64b2ced810"}]}] Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 02d5252c77694efeba1c7c64b2ced810 Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesSnapshotsTestJSON-1565076753-project Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: c87fc8823bcd4b8abbb3c6c73daabe6a Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1565076753-project Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: method: Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: exception: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'e66c6d6c-d293-4408-a50f-0599831c3286'} Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. (HTTP 404) (Request-ID: req-05d6bbb1-4104-408c-94dd-4e616f11b38a) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:35:35.681668 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c995b8f-fc13-46dd-bc71-a9998ac68fe8 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Returning 404 to user: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c995b8f-fc13-46dd-bc71-a9998ac68fe8 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 404 len: 109 microversion: 2.1 time: 0.179787 Aug 25 13:35:35.697648 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2715/5376] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:35:35 2022] DELETE /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:35:35.717228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3db34c51-79d3-44ed-a32c-62ebdd9d4d86 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Calling method '.version_select at 0x7f3a290489d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:35.824552 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-3db34c51-79d3-44ed-a32c-62ebdd9d4d86 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] HTTP exception thrown: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3db34c51-79d3-44ed-a32c-62ebdd9d4d86 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Request method failure captured: Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 HTTP/1.1 Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3qRRK1hOl4G6Lwfi584wIvnthEf2vXfbJbb_H6mCGKEIkZrJUEqdcP_8RmitzEJLRPxBipPj4aABeesTKwjM9ODp_ovXMMz_5zl61kas64vcyARWFgl0_RbTuHlTNtzcUx3JCfZpT2eS26gszyodG74K8x6fflgXmlEw2XcyIm0tJs Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 02d5252c77694efeba1c7c64b2ced810 Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02d5252c77694efeba1c7c64b2ced810"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_02d5252c77694efeba1c7c64b2ced810", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/02d5252c77694efeba1c7c64b2ced810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02d5252c77694efeba1c7c64b2ced810"}]}] Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 02d5252c77694efeba1c7c64b2ced810 Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1565076753 Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-VolumesSnapshotsTestJSON-1565076753-project Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: c87fc8823bcd4b8abbb3c6c73daabe6a Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1565076753-project Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: exception: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'e66c6d6c-d293-4408-a50f-0599831c3286'} Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. (HTTP 404) (Request-ID: req-7f661933-bbdd-49a7-80a0-2c5f327b70c9) Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:35:35.829573 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. Aug 25 13:35:35.838539 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:35.847050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3db34c51-79d3-44ed-a32c-62ebdd9d4d86 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] Returning 404 to user: Volume e66c6d6c-d293-4408-a50f-0599831c3286 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:35.855800 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3db34c51-79d3-44ed-a32c-62ebdd9d4d86 tempest-VolumesSnapshotsTestJSON-1565076753 tempest-VolumesSnapshotsTestJSON-1565076753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286" status: 404 len: 109 microversion: 2.1 time: 0.149356 Aug 25 13:35:35.858566 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2662/5377] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:35 2022] GET /compute/v2.1/os-volumes/e66c6d6c-d293-4408-a50f-0599831c3286 => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:35:42.741119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70ecb326-a915-4c3c-a017-daafd4b70f24 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Action: 'create', calling method: .version_select at 0x7f3a29295d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1689492779", "metadata": {"Type": "work"}}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:43.798179 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70ecb326-a915-4c3c-a017-daafd4b70f24 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.401051 Aug 25 13:35:43.798179 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2716/5378] 10.222.0.70 () {60 vars in 1156 bytes} [Thu Aug 25 13:35:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1404 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 25 13:35:43.813253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:43.815776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:43.828117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-94c9c27c-fb9f-4edc-afd0-d81b1b65e667 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a29063b80>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:44.078562 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-94c9c27c-fb9f-4edc-afd0-d81b1b65e667 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 200 len: 353 microversion: 2.1 time: 0.269296 Aug 25 13:35:44.079878 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2663/5379] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:43 2022] GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 353 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:45.108324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b3676b90-fbc1-4093-bd13-42f2450dbb9d tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a292a3280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:45.332629 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b3676b90-fbc1-4093-bd13-42f2450dbb9d tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 200 len: 353 microversion: 2.1 time: 0.235957 Aug 25 13:35:45.334869 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2717/5380] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:45 2022] GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 353 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:46.358046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7db7ee48-c027-43fc-9d8a-609ccca0296e tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a29067040>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:46.530158 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7db7ee48-c027-43fc-9d8a-609ccca0296e tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 200 len: 353 microversion: 2.1 time: 0.179457 Aug 25 13:35:46.531203 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2664/5381] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:46 2022] GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:47.592238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3b4c6e5c-4e76-40a2-b477-c62f55a37088 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a292a6700>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:47.760297 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3b4c6e5c-4e76-40a2-b477-c62f55a37088 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 200 len: 354 microversion: 2.1 time: 0.203541 Aug 25 13:35:47.761250 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2718/5382] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:47 2022] GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:47.788901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e147f075-f8a5-4625-ad1e-a3e34212a8c2 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a290531f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:47.953217 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e147f075-f8a5-4625-ad1e-a3e34212a8c2 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 200 len: 354 microversion: 2.1 time: 0.175529 Aug 25 13:35:47.954368 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2665/5383] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:47 2022] GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:35:47.992131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-64762ad9-fcf3-4789-8c54-095f22309a6b tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a293378b0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:48.165666 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-64762ad9-fcf3-4789-8c54-095f22309a6b tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 202 len: 0 microversion: 2.1 time: 0.189003 Aug 25 13:35:48.168061 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2719/5384] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:35:47 2022] DELETE /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:35:48.185406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63a85ae1-886b-4c8c-9084-9533f762c061 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a29105e50>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:48.360677 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-63a85ae1-886b-4c8c-9084-9533f762c061 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 200 len: 353 microversion: 2.1 time: 0.185037 Aug 25 13:35:48.362196 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2666/5385] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:48 2022] GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:49.385112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f46810d8-20fe-4f53-873e-9bbc5d93087b tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a29291ca0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:49.505526 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f46810d8-20fe-4f53-873e-9bbc5d93087b tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 200 len: 353 microversion: 2.1 time: 0.127395 Aug 25 13:35:49.526340 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2720/5386] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:49 2022] GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:50.536102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ace9ec86-4965-49cd-b38a-d6905eda20a1 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a29002700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:50.721184 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ace9ec86-4965-49cd-b38a-d6905eda20a1 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 200 len: 353 microversion: 2.1 time: 0.195311 Aug 25 13:35:50.724160 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2667/5387] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:50 2022] GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:51.750626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-71d030f0-21d2-486d-8161-dacd898ba6da tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a292a6e50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:51.851732 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-71d030f0-21d2-486d-8161-dacd898ba6da tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 200 len: 353 microversion: 2.1 time: 0.112359 Aug 25 13:35:51.852510 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2721/5388] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:51 2022] GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:52.890013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef833ba0-f292-4886-9be0-610c0d607738 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Calling method '.version_select at 0x7f3a29002dc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:52.970316 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-ef833ba0-f292-4886-9be0-610c0d607738 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] HTTP exception thrown: Volume 8da156f1-8fc8-47aa-b8e1-9acba1431a18 could not be found. Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef833ba0-f292-4886-9be0-610c0d607738 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Request method failure captured: Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 HTTP/1.1 Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3qu7YmlUKUl4sjiM_8O3sFyfvaOHft4pwo95NHn0OLpYD53D8tYbha2r_Rt8i-d05TEfbBdUOEqdpJbc5K4lm-jk2-0f6WSi4ijjaUmGR0FCY9LSfJ64tqEVykn5rKPSpOh6_iCKD2Y6v4DPs6VRurJf_mE-lUTrGZrz13M2Sqi690 Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 07b39964674a458a81faba9c5a7ff7f5 Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-VolumesGetTestJSON-1976302200 Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07b39964674a458a81faba9c5a7ff7f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_07b39964674a458a81faba9c5a7ff7f5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/07b39964674a458a81faba9c5a7ff7f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07b39964674a458a81faba9c5a7ff7f5"}]}] Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-VolumesGetTestJSON-1976302200 Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 07b39964674a458a81faba9c5a7ff7f5 Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-VolumesGetTestJSON-1976302200 Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-VolumesGetTestJSON-1976302200-project Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: fbd3dee355a843fcae74ba58a8822e5e Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-VolumesGetTestJSON-1976302200-project Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: method: Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: exception: Volume 8da156f1-8fc8-47aa-b8e1-9acba1431a18 could not be found. Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '8da156f1-8fc8-47aa-b8e1-9acba1431a18'} Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8da156f1-8fc8-47aa-b8e1-9acba1431a18 could not be found. (HTTP 404) (Request-ID: req-bf04d838-8e61-43cc-af44-8383183eb0fa) Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:35:52.975856 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8da156f1-8fc8-47aa-b8e1-9acba1431a18 could not be found. Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8da156f1-8fc8-47aa-b8e1-9acba1431a18 could not be found. Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8da156f1-8fc8-47aa-b8e1-9acba1431a18 could not be found. Aug 25 13:35:52.985672 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:35:52.996021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef833ba0-f292-4886-9be0-610c0d607738 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] Returning 404 to user: Volume 8da156f1-8fc8-47aa-b8e1-9acba1431a18 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:52.996021 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef833ba0-f292-4886-9be0-610c0d607738 tempest-VolumesGetTestJSON-1976302200 tempest-VolumesGetTestJSON-1976302200-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18" status: 404 len: 109 microversion: 2.1 time: 0.119638 Aug 25 13:35:52.996021 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2668/5389] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Aug 25 13:35:52 2022] GET /compute/v2.1/os-volumes/8da156f1-8fc8-47aa-b8e1-9acba1431a18 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:36:29.836458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-388c80f1-7502-4ebb-bd94-92fa219fae7c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:29.848120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-388c80f1-7502-4ebb-bd94-92fa219fae7c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:29.873150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388c80f1-7502-4ebb-bd94-92fa219fae7c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:29.882692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388c80f1-7502-4ebb-bd94-92fa219fae7c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:29.883770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388c80f1-7502-4ebb-bd94-92fa219fae7c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:29.889870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388c80f1-7502-4ebb-bd94-92fa219fae7c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:29.894198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388c80f1-7502-4ebb-bd94-92fa219fae7c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:29.898875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-388c80f1-7502-4ebb-bd94-92fa219fae7c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:30.031866 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-388c80f1-7502-4ebb-bd94-92fa219fae7c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/ips" status: 200 len: 151 microversion: 2.1 time: 0.219971 Aug 25 13:36:30.045590 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2722/5390] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:36:29 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/ips => generated 151 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:35.154577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1c17ebb4-0365-4124-b42a-5c3507cf8dae tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc5b7ca3-80db-460c-89f9-b71777b84e5f"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:36:35.171303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1c17ebb4-0365-4124-b42a-5c3507cf8dae tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:35.206485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c17ebb4-0365-4124-b42a-5c3507cf8dae tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:35.207992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c17ebb4-0365-4124-b42a-5c3507cf8dae tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:35.212155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c17ebb4-0365-4124-b42a-5c3507cf8dae tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:35.215049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c17ebb4-0365-4124-b42a-5c3507cf8dae tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:35.216730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c17ebb4-0365-4124-b42a-5c3507cf8dae tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:35.217675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c17ebb4-0365-4124-b42a-5c3507cf8dae tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:37.823160 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1c17ebb4-0365-4124-b42a-5c3507cf8dae tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.692596 Aug 25 13:36:37.831491 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2669/5391] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:36:35 2022] POST /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 194 bytes in 2703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:37:01.691177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9a035e4-2442-4667-9e3d-87f1c7c43696 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: .version_select at 0x7f3a292a3e50>, body: {"keypair": {"name": "tempest-keypair-1344616092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1tGYzAek+jORQGqJCxP+jl7FdO+OfBy6LDAJ1ojidBf9o7E5owwrzfSWhCgpQWqlRzNva2642pcnOZK1toni+TkP8nD58KYnV1vLh6VHhsudNidOiUbijkbtdAh7S3fw=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:37:01.706511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:01.708423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:01.729734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c9a035e4-2442-4667-9e3d-87f1c7c43696 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:37:01.740217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c9a035e4-2442-4667-9e3d-87f1c7c43696 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for user b7fdce9f6d624473be8244e28eb215e0 and project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:37:01.792526 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9a035e4-2442-4667-9e3d-87f1c7c43696 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108634 Aug 25 13:37:01.796589 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2723/5392] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:37:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:37:06.767305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1593952026", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "229df64b-66b9-4c71-89d1-8ec5cff9e192"}], "security_groups": [{"name": "tempest-securitygroup--1179081742"}], "key_name": "tempest-keypair-1344616092", "user_data": "}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:37:06.837249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:06.839213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:07.160894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] validate_networks() for [('229df64b-66b9-4c71-89d1-8ec5cff9e192', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:37:08.782850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:37:08.783886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:37:08.784662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:37:08.785415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:37:08.786194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:37:08.805114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:08.806523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:08.807608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:08.809196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:08.810159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:08.811043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:08.851288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:37:08.863890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for user b7fdce9f6d624473be8244e28eb215e0 and project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:37:08.892200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:37:08.896668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:37:09.038869 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9f6ed542-0532-4408-90ff-b3e205965a12 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.290953 Aug 25 13:37:09.051543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2670/5393] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:37:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 2306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:37:09.060808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-698ee60f-e913-439a-aed0-cc64352120f1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:09.062110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-698ee60f-e913-439a-aed0-cc64352120f1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:09.750365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-698ee60f-e913-439a-aed0-cc64352120f1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:09.769043 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-698ee60f-e913-439a-aed0-cc64352120f1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1242 microversion: 2.1 time: 0.716366 Aug 25 13:37:09.770190 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2724/5394] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:09 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1242 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:37:10.819712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2db3764c-3628-4622-bea3-2115c0246d6c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:10.824815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2db3764c-3628-4622-bea3-2115c0246d6c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:10.855988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2db3764c-3628-4622-bea3-2115c0246d6c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:10.856916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2db3764c-3628-4622-bea3-2115c0246d6c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:10.857650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2db3764c-3628-4622-bea3-2115c0246d6c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:10.858963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2db3764c-3628-4622-bea3-2115c0246d6c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:10.860625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2db3764c-3628-4622-bea3-2115c0246d6c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:10.862089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2db3764c-3628-4622-bea3-2115c0246d6c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:11.047704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2db3764c-3628-4622-bea3-2115c0246d6c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:11.078148 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2db3764c-3628-4622-bea3-2115c0246d6c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1238 microversion: 2.1 time: 0.266362 Aug 25 13:37:11.079695 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2671/5395] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:10 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1238 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:12.123134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-360391a2-0606-4541-aaec-e0bc810d45e1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:12.124445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-360391a2-0606-4541-aaec-e0bc810d45e1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:12.152255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360391a2-0606-4541-aaec-e0bc810d45e1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:12.156066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360391a2-0606-4541-aaec-e0bc810d45e1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:12.159407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360391a2-0606-4541-aaec-e0bc810d45e1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:12.161438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360391a2-0606-4541-aaec-e0bc810d45e1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:12.162594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360391a2-0606-4541-aaec-e0bc810d45e1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:12.163638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-360391a2-0606-4541-aaec-e0bc810d45e1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:12.331011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-360391a2-0606-4541-aaec-e0bc810d45e1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:12.361044 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-360391a2-0606-4541-aaec-e0bc810d45e1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1300 microversion: 2.1 time: 0.245252 Aug 25 13:37:12.363123 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2725/5396] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:12 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1300 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:13.399578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0d6962e0-a9be-4469-bad8-118b7871fef4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:13.402846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0d6962e0-a9be-4469-bad8-118b7871fef4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:13.424151 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:37:13.424812 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 13:37:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f (ip 10.222.0.70) !!! Aug 25 13:37:13.447902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d6962e0-a9be-4469-bad8-118b7871fef4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:13.451065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d6962e0-a9be-4469-bad8-118b7871fef4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:13.453854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d6962e0-a9be-4469-bad8-118b7871fef4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:13.456298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d6962e0-a9be-4469-bad8-118b7871fef4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:13.457662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d6962e0-a9be-4469-bad8-118b7871fef4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:13.462121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0d6962e0-a9be-4469-bad8-118b7871fef4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:13.791637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0d6962e0-a9be-4469-bad8-118b7871fef4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:13.820195 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0d6962e0-a9be-4469-bad8-118b7871fef4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1300 microversion: 2.1 time: 0.429251 Aug 25 13:37:13.821276 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2672/5397] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:13 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1300 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:37:14.867101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b57d57de-356e-4e69-bce5-4ef543cfb530 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:14.869286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b57d57de-356e-4e69-bce5-4ef543cfb530 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:14.890763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b57d57de-356e-4e69-bce5-4ef543cfb530 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:14.892196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b57d57de-356e-4e69-bce5-4ef543cfb530 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:14.893344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b57d57de-356e-4e69-bce5-4ef543cfb530 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:14.895087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b57d57de-356e-4e69-bce5-4ef543cfb530 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:14.896196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b57d57de-356e-4e69-bce5-4ef543cfb530 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:14.897602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b57d57de-356e-4e69-bce5-4ef543cfb530 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:15.463188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b57d57de-356e-4e69-bce5-4ef543cfb530 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:15.477048 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b57d57de-356e-4e69-bce5-4ef543cfb530 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1368 microversion: 2.1 time: 0.618709 Aug 25 13:37:15.478613 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2726/5398] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:14 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1368 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:16.522658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-981f4655-2c31-4718-b775-fc5045f39400 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:16.525015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-981f4655-2c31-4718-b775-fc5045f39400 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:16.546538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-981f4655-2c31-4718-b775-fc5045f39400 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:16.547752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-981f4655-2c31-4718-b775-fc5045f39400 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:16.550908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-981f4655-2c31-4718-b775-fc5045f39400 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:16.550908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-981f4655-2c31-4718-b775-fc5045f39400 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:16.551389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-981f4655-2c31-4718-b775-fc5045f39400 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:16.551887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-981f4655-2c31-4718-b775-fc5045f39400 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:16.963624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-981f4655-2c31-4718-b775-fc5045f39400 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:16.996111 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-981f4655-2c31-4718-b775-fc5045f39400 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1368 microversion: 2.1 time: 0.477386 Aug 25 13:37:16.997320 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2673/5399] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:16 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1368 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:37:18.053324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2640086-2613-48cd-8933-6d6ac0307730 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:18.053324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b2640086-2613-48cd-8933-6d6ac0307730 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:18.066814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2640086-2613-48cd-8933-6d6ac0307730 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:18.067813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2640086-2613-48cd-8933-6d6ac0307730 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:18.069187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2640086-2613-48cd-8933-6d6ac0307730 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:18.071201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2640086-2613-48cd-8933-6d6ac0307730 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:18.072646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2640086-2613-48cd-8933-6d6ac0307730 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:18.073980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2640086-2613-48cd-8933-6d6ac0307730 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:18.621818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b2640086-2613-48cd-8933-6d6ac0307730 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:18.656662 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2640086-2613-48cd-8933-6d6ac0307730 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1368 microversion: 2.1 time: 0.619715 Aug 25 13:37:18.658724 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2727/5400] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:18 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1368 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:37:18.830360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:18.882921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:18.906777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-55184007-5fa6-448f-a833-e5643b63906d req-a91a54ff-461e-4170-89f5-0989cf42ff06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40057511-8a17-4107-bd91-ec6f0307f92f", "tag": "474d34d3-91e4-4c54-ac58-8fe0568159f2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:37:18.929650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-55184007-5fa6-448f-a833-e5643b63906d req-a91a54ff-461e-4170-89f5-0989cf42ff06 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:18.931016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-55184007-5fa6-448f-a833-e5643b63906d req-a91a54ff-461e-4170-89f5-0989cf42ff06 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:18.932407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-55184007-5fa6-448f-a833-e5643b63906d req-a91a54ff-461e-4170-89f5-0989cf42ff06 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:18.960278 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-55184007-5fa6-448f-a833-e5643b63906d req-a91a54ff-461e-4170-89f5-0989cf42ff06 service nova] Creating event network-changed:474d34d3-91e4-4c54-ac58-8fe0568159f2 for instance 40057511-8a17-4107-bd91-ec6f0307f92f on n-h2-852771-8 Aug 25 13:37:18.971438 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-55184007-5fa6-448f-a833-e5643b63906d req-a91a54ff-461e-4170-89f5-0989cf42ff06 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.323071 Aug 25 13:37:18.973565 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2674/5401] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:37:19.706286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3801844d-96ea-4982-a2fd-531df3805c39 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:19.710107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3801844d-96ea-4982-a2fd-531df3805c39 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:19.739241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3801844d-96ea-4982-a2fd-531df3805c39 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:19.741724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3801844d-96ea-4982-a2fd-531df3805c39 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:19.743794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3801844d-96ea-4982-a2fd-531df3805c39 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:19.747073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3801844d-96ea-4982-a2fd-531df3805c39 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:19.752577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3801844d-96ea-4982-a2fd-531df3805c39 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:19.753916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3801844d-96ea-4982-a2fd-531df3805c39 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:19.763784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:20.232068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3801844d-96ea-4982-a2fd-531df3805c39 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:20.251475 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3801844d-96ea-4982-a2fd-531df3805c39 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1368 microversion: 2.1 time: 0.559943 Aug 25 13:37:20.252823 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2728/5402] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:19 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1368 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:21.301561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bc1d22d8-746f-4b03-8497-84d17b8d52d3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:21.304685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bc1d22d8-746f-4b03-8497-84d17b8d52d3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:21.325403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc1d22d8-746f-4b03-8497-84d17b8d52d3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:21.327710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc1d22d8-746f-4b03-8497-84d17b8d52d3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:21.330332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc1d22d8-746f-4b03-8497-84d17b8d52d3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:21.334089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc1d22d8-746f-4b03-8497-84d17b8d52d3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:21.336058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc1d22d8-746f-4b03-8497-84d17b8d52d3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:21.339781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc1d22d8-746f-4b03-8497-84d17b8d52d3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:22.121173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bc1d22d8-746f-4b03-8497-84d17b8d52d3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:22.179749 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bc1d22d8-746f-4b03-8497-84d17b8d52d3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1368 microversion: 2.1 time: 0.888911 Aug 25 13:37:22.201556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2675/5403] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:21 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1368 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:23.238700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce0215b1-87c0-40af-a122-4f0c798ea6a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:23.243519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ce0215b1-87c0-40af-a122-4f0c798ea6a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:23.259635 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:37:23.260175 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 13:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f (ip 10.222.0.70) !!! Aug 25 13:37:23.308136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0215b1-87c0-40af-a122-4f0c798ea6a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:23.314536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0215b1-87c0-40af-a122-4f0c798ea6a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:23.315723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0215b1-87c0-40af-a122-4f0c798ea6a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:23.317891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0215b1-87c0-40af-a122-4f0c798ea6a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:23.320811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0215b1-87c0-40af-a122-4f0c798ea6a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:23.323743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce0215b1-87c0-40af-a122-4f0c798ea6a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:23.979226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ce0215b1-87c0-40af-a122-4f0c798ea6a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:24.037126 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce0215b1-87c0-40af-a122-4f0c798ea6a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1368 microversion: 2.1 time: 0.801848 Aug 25 13:37:24.054788 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2729/5404] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:23 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1368 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:25.088545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-33d6a39e-e1f4-46d2-a6c8-5c3ab32b71fe tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:25.094189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-33d6a39e-e1f4-46d2-a6c8-5c3ab32b71fe tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:25.131070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d6a39e-e1f4-46d2-a6c8-5c3ab32b71fe tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:25.131983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d6a39e-e1f4-46d2-a6c8-5c3ab32b71fe tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:25.132830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d6a39e-e1f4-46d2-a6c8-5c3ab32b71fe tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:25.134366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d6a39e-e1f4-46d2-a6c8-5c3ab32b71fe tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:25.135124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d6a39e-e1f4-46d2-a6c8-5c3ab32b71fe tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:25.140099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33d6a39e-e1f4-46d2-a6c8-5c3ab32b71fe tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:26.009828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-33d6a39e-e1f4-46d2-a6c8-5c3ab32b71fe tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:26.041070 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-33d6a39e-e1f4-46d2-a6c8-5c3ab32b71fe tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1368 microversion: 2.1 time: 0.964035 Aug 25 13:37:26.044359 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2676/5405] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:25 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1368 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:27.082888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-96454ea8-6eaa-4b38-a838-695a4591fb55 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:27.087722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-96454ea8-6eaa-4b38-a838-695a4591fb55 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:27.130895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96454ea8-6eaa-4b38-a838-695a4591fb55 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:27.132204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96454ea8-6eaa-4b38-a838-695a4591fb55 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:27.133441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96454ea8-6eaa-4b38-a838-695a4591fb55 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:27.135116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96454ea8-6eaa-4b38-a838-695a4591fb55 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:27.136264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96454ea8-6eaa-4b38-a838-695a4591fb55 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:27.137117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96454ea8-6eaa-4b38-a838-695a4591fb55 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:27.188715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-6f8b6d44-2005-4b82-be73-49f18d319441 req-e7311854-c0de-4423-83a8-5def2b7fd9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40057511-8a17-4107-bd91-ec6f0307f92f", "name": "network-vif-plugged", "status": "completed", "tag": "474d34d3-91e4-4c54-ac58-8fe0568159f2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:37:27.230573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6f8b6d44-2005-4b82-be73-49f18d319441 req-e7311854-c0de-4423-83a8-5def2b7fd9e8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:27.238946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6f8b6d44-2005-4b82-be73-49f18d319441 req-e7311854-c0de-4423-83a8-5def2b7fd9e8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:27.239914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6f8b6d44-2005-4b82-be73-49f18d319441 req-e7311854-c0de-4423-83a8-5def2b7fd9e8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:27.296389 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-6f8b6d44-2005-4b82-be73-49f18d319441 req-e7311854-c0de-4423-83a8-5def2b7fd9e8 service nova] Creating event network-vif-plugged:474d34d3-91e4-4c54-ac58-8fe0568159f2 for instance 40057511-8a17-4107-bd91-ec6f0307f92f on n-h2-852771-8 Aug 25 13:37:27.306402 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-6f8b6d44-2005-4b82-be73-49f18d319441 req-e7311854-c0de-4423-83a8-5def2b7fd9e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274217 Aug 25 13:37:27.309367 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2730/5406] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:37:27.945850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-96454ea8-6eaa-4b38-a838-695a4591fb55 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:27.977450 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-96454ea8-6eaa-4b38-a838-695a4591fb55 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1368 microversion: 2.1 time: 0.904301 Aug 25 13:37:27.978577 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2677/5407] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:27 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1368 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:37:29.021385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b797137-13bf-4b7b-ac45-4c42956591c3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:29.038256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b797137-13bf-4b7b-ac45-4c42956591c3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:29.063980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b797137-13bf-4b7b-ac45-4c42956591c3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:29.065371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b797137-13bf-4b7b-ac45-4c42956591c3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:29.066450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b797137-13bf-4b7b-ac45-4c42956591c3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:29.068346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b797137-13bf-4b7b-ac45-4c42956591c3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:29.069831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b797137-13bf-4b7b-ac45-4c42956591c3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:29.071093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b797137-13bf-4b7b-ac45-4c42956591c3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:30.343171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b797137-13bf-4b7b-ac45-4c42956591c3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:30.374275 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b797137-13bf-4b7b-ac45-4c42956591c3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1368 microversion: 2.1 time: 1.363203 Aug 25 13:37:30.376327 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2731/5408] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:29 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1368 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:31.424364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7417f694-13c1-4a36-9a1f-133d43666621 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:31.428029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7417f694-13c1-4a36-9a1f-133d43666621 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:31.447463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7417f694-13c1-4a36-9a1f-133d43666621 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:31.448459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7417f694-13c1-4a36-9a1f-133d43666621 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:31.450006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7417f694-13c1-4a36-9a1f-133d43666621 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:31.451997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7417f694-13c1-4a36-9a1f-133d43666621 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:31.453091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7417f694-13c1-4a36-9a1f-133d43666621 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:31.454272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7417f694-13c1-4a36-9a1f-133d43666621 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:31.759921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7417f694-13c1-4a36-9a1f-133d43666621 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:31.787524 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7417f694-13c1-4a36-9a1f-133d43666621 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1559 microversion: 2.1 time: 0.374143 Aug 25 13:37:31.789408 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2678/5409] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:31 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1559 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:31.838013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fdb2612e-b318-4505-8897-433333570cfc tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:31.841370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fdb2612e-b318-4505-8897-433333570cfc tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:31.847063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:31.860571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fdb2612e-b318-4505-8897-433333570cfc tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:31.861665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fdb2612e-b318-4505-8897-433333570cfc tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:31.861915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fdb2612e-b318-4505-8897-433333570cfc tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:31.863173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fdb2612e-b318-4505-8897-433333570cfc tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:31.872800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fdb2612e-b318-4505-8897-433333570cfc tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:31.874237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fdb2612e-b318-4505-8897-433333570cfc tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:32.317075 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fdb2612e-b318-4505-8897-433333570cfc tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.484048 Aug 25 13:37:32.321580 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2732/5410] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:37:31 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f/os-interface => generated 285 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:37:36.031608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-15253e9f-11d8-4e83-b075-140160b7a51d req-568dee67-a865-4b25-a058-e963efc85edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40057511-8a17-4107-bd91-ec6f0307f92f", "tag": "474d34d3-91e4-4c54-ac58-8fe0568159f2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:37:36.062899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-15253e9f-11d8-4e83-b075-140160b7a51d req-568dee67-a865-4b25-a058-e963efc85edb service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:36.065923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-15253e9f-11d8-4e83-b075-140160b7a51d req-568dee67-a865-4b25-a058-e963efc85edb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:36.066885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-15253e9f-11d8-4e83-b075-140160b7a51d req-568dee67-a865-4b25-a058-e963efc85edb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:36.111902 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-15253e9f-11d8-4e83-b075-140160b7a51d req-568dee67-a865-4b25-a058-e963efc85edb service nova] Creating event network-changed:474d34d3-91e4-4c54-ac58-8fe0568159f2 for instance 40057511-8a17-4107-bd91-ec6f0307f92f on n-h2-852771-8 Aug 25 13:37:36.131313 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-15253e9f-11d8-4e83-b075-140160b7a51d req-568dee67-a865-4b25-a058-e963efc85edb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338776 Aug 25 13:37:36.132521 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2679/5411] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:38:37.754211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=42 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:37.756125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:37.775640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ff0696c-1d8f-441a-ad79-400ee71bd0b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:37.777006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4ff0696c-1d8f-441a-ad79-400ee71bd0b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:37.804221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff0696c-1d8f-441a-ad79-400ee71bd0b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:37.807370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff0696c-1d8f-441a-ad79-400ee71bd0b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:37.823204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff0696c-1d8f-441a-ad79-400ee71bd0b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:37.825076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff0696c-1d8f-441a-ad79-400ee71bd0b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:37.826572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff0696c-1d8f-441a-ad79-400ee71bd0b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:37.827644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff0696c-1d8f-441a-ad79-400ee71bd0b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:37.935525 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ff0696c-1d8f-441a-ad79-400ee71bd0b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f/ips" status: 200 len: 150 microversion: 2.1 time: 0.186977 Aug 25 13:38:37.940648 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2733/5412] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:38:37 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f/ips => generated 150 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:38:37.958768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:37.960062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=48 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:37.989994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc5b7ca3-80db-460c-89f9-b71777b84e5f"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:38:37.996248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:38.014016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:38.015037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:38.015719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:38.017067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:38.018394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:38.019576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:38.263390 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Invalid volume: volume dc5b7ca3-80db-460c-89f9-b71777b84e5f is already attached to instances: 7840aa88-f6e2-4295-a852-daa4d572f8b3 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f/os-volume_attachments HTTP/1.1 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 74 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: {"volumeAttachment": {"volumeId": "dc5b7ca3-80db-460c-89f9-b71777b84e5f"}} Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: exception: Invalid volume: volume dc5b7ca3-80db-460c-89f9-b71777b84e5f is already attached to instances: 7840aa88-f6e2-4295-a852-daa4d572f8b3 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'server_id': '40057511-8a17-4107-bd91-ec6f0307f92f', 'body': {'volumeAttachment': {'volumeId': 'dc5b7ca3-80db-460c-89f9-b71777b84e5f'}}} Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dc5b7ca3-80db-460c-89f9-b71777b84e5f is already attached to instances: 7840aa88-f6e2-4295-a852-daa4d572f8b3 Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:38:38.267213 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dc5b7ca3-80db-460c-89f9-b71777b84e5f is already attached to instances: 7840aa88-f6e2-4295-a852-daa4d572f8b3 Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dc5b7ca3-80db-460c-89f9-b71777b84e5f is already attached to instances: 7840aa88-f6e2-4295-a852-daa4d572f8b3 Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 400 to user: Invalid volume: volume dc5b7ca3-80db-460c-89f9-b71777b84e5f is already attached to instances: 7840aa88-f6e2-4295-a852-daa4d572f8b3 {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b1467c3f-d515-41f9-821e-f2b89cd9cf0e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.315825 Aug 25 13:38:38.278077 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2680/5413] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:38:37 2022] POST /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f/os-volume_attachments => generated 174 bytes in 318 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 13:38:38.293862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d5a02760-3ff5-43c0-9feb-202f7e093f02 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:38.295287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d5a02760-3ff5-43c0-9feb-202f7e093f02 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:38.317757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a02760-3ff5-43c0-9feb-202f7e093f02 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:38.319119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a02760-3ff5-43c0-9feb-202f7e093f02 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:38.320167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a02760-3ff5-43c0-9feb-202f7e093f02 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:38.322636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a02760-3ff5-43c0-9feb-202f7e093f02 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:38.323855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a02760-3ff5-43c0-9feb-202f7e093f02 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:38.324682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a02760-3ff5-43c0-9feb-202f7e093f02 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:38.400845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d5a02760-3ff5-43c0-9feb-202f7e093f02 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:38:38.674092 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d5a02760-3ff5-43c0-9feb-202f7e093f02 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 204 len: 0 microversion: 2.1 time: 0.391187 Aug 25 13:38:38.679790 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2734/5414] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:38:38 2022] DELETE /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:38:38.708025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0eecae08-e1f4-4718-878b-449ca298f951 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:38.710228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0eecae08-e1f4-4718-878b-449ca298f951 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:38.729611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0eecae08-e1f4-4718-878b-449ca298f951 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:38.731009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0eecae08-e1f4-4718-878b-449ca298f951 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:38.732229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0eecae08-e1f4-4718-878b-449ca298f951 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:38.734064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0eecae08-e1f4-4718-878b-449ca298f951 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:38.735028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0eecae08-e1f4-4718-878b-449ca298f951 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:38.744545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0eecae08-e1f4-4718-878b-449ca298f951 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:39.413526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0eecae08-e1f4-4718-878b-449ca298f951 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:39.449075 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0eecae08-e1f4-4718-878b-449ca298f951 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1683 microversion: 2.1 time: 0.760198 Aug 25 13:38:39.461700 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2681/5415] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:38 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1683 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:40.480616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e11102de-1d52-4281-b4e8-c3e06df1b6c8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:40.487321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e11102de-1d52-4281-b4e8-c3e06df1b6c8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:40.520255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11102de-1d52-4281-b4e8-c3e06df1b6c8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:40.521338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11102de-1d52-4281-b4e8-c3e06df1b6c8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:40.522186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11102de-1d52-4281-b4e8-c3e06df1b6c8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:40.523879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11102de-1d52-4281-b4e8-c3e06df1b6c8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:40.554830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11102de-1d52-4281-b4e8-c3e06df1b6c8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:40.555943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e11102de-1d52-4281-b4e8-c3e06df1b6c8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:40.959778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e11102de-1d52-4281-b4e8-c3e06df1b6c8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:40.977142 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e11102de-1d52-4281-b4e8-c3e06df1b6c8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1683 microversion: 2.1 time: 0.504557 Aug 25 13:38:40.978455 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2735/5416] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:40 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1683 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:42.025912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-199ed7cf-43ac-456f-8523-2e080ba0ca53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:42.029262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-199ed7cf-43ac-456f-8523-2e080ba0ca53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:42.110936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-199ed7cf-43ac-456f-8523-2e080ba0ca53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:42.114937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-199ed7cf-43ac-456f-8523-2e080ba0ca53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:42.118143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-199ed7cf-43ac-456f-8523-2e080ba0ca53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:42.122776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-199ed7cf-43ac-456f-8523-2e080ba0ca53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:42.123653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-199ed7cf-43ac-456f-8523-2e080ba0ca53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:42.124482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-199ed7cf-43ac-456f-8523-2e080ba0ca53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:42.813349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-199ed7cf-43ac-456f-8523-2e080ba0ca53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:42.834020 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-199ed7cf-43ac-456f-8523-2e080ba0ca53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1683 microversion: 2.1 time: 0.823469 Aug 25 13:38:42.836222 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2682/5417] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:42 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1683 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:43.912603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-981664a9-ad12-41e3-b9f5-8f813ae53c7e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:43.925456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-981664a9-ad12-41e3-b9f5-8f813ae53c7e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:43.961726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-981664a9-ad12-41e3-b9f5-8f813ae53c7e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:43.963774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-981664a9-ad12-41e3-b9f5-8f813ae53c7e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:43.973246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-981664a9-ad12-41e3-b9f5-8f813ae53c7e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:43.983472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-981664a9-ad12-41e3-b9f5-8f813ae53c7e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:43.995510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-981664a9-ad12-41e3-b9f5-8f813ae53c7e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:43.996767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-981664a9-ad12-41e3-b9f5-8f813ae53c7e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:44.222536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-981664a9-ad12-41e3-b9f5-8f813ae53c7e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:44.256958 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-981664a9-ad12-41e3-b9f5-8f813ae53c7e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1615 microversion: 2.1 time: 0.379068 Aug 25 13:38:44.289666 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2736/5418] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:43 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1615 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:45.308657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02e5f57f-a1e3-4640-b2cd-8fdcbe4e1d18 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:45.316771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-02e5f57f-a1e3-4640-b2cd-8fdcbe4e1d18 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:45.405961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02e5f57f-a1e3-4640-b2cd-8fdcbe4e1d18 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:45.411374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02e5f57f-a1e3-4640-b2cd-8fdcbe4e1d18 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:45.418576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02e5f57f-a1e3-4640-b2cd-8fdcbe4e1d18 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:45.436802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02e5f57f-a1e3-4640-b2cd-8fdcbe4e1d18 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:45.437946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02e5f57f-a1e3-4640-b2cd-8fdcbe4e1d18 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:45.438950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02e5f57f-a1e3-4640-b2cd-8fdcbe4e1d18 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:45.794183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9d95a3bb-049a-4553-b424-093dfad0cdbb req-e1b242cb-5e1a-47b5-9921-e10032a06801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40057511-8a17-4107-bd91-ec6f0307f92f", "name": "network-vif-deleted", "tag": "474d34d3-91e4-4c54-ac58-8fe0568159f2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:38:45.911595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9d95a3bb-049a-4553-b424-093dfad0cdbb req-e1b242cb-5e1a-47b5-9921-e10032a06801 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:45.934030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9d95a3bb-049a-4553-b424-093dfad0cdbb req-e1b242cb-5e1a-47b5-9921-e10032a06801 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:45.935592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9d95a3bb-049a-4553-b424-093dfad0cdbb req-e1b242cb-5e1a-47b5-9921-e10032a06801 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:46.016648 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9d95a3bb-049a-4553-b424-093dfad0cdbb req-e1b242cb-5e1a-47b5-9921-e10032a06801 service nova] Creating event network-vif-deleted:474d34d3-91e4-4c54-ac58-8fe0568159f2 for instance 40057511-8a17-4107-bd91-ec6f0307f92f on n-h2-852771-8 Aug 25 13:38:46.069578 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9d95a3bb-049a-4553-b424-093dfad0cdbb req-e1b242cb-5e1a-47b5-9921-e10032a06801 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.284870 Aug 25 13:38:46.075972 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2737/5419] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:38:46.131784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-02e5f57f-a1e3-4640-b2cd-8fdcbe4e1d18 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:46.192258 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-02e5f57f-a1e3-4640-b2cd-8fdcbe4e1d18 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 200 len: 1615 microversion: 2.1 time: 0.889794 Aug 25 13:38:46.193529 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2683/5420] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:45 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 1615 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:47.242797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:47.249791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:47.281249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:47.282776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:47.287454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:47.290803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:47.292785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:47.294381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:47.339016 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f HTTP/1.1 Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '40057511-8a17-4107-bd91-ec6f0307f92f'} Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:38:47.366572 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:38:47.375715 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:47.375715 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:38:47.375715 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:38:47.375715 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:38:47.375715 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:38:47.375715 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:38:47.375715 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:38:47.379535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:38:47.390612 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-be440a3a-da1d-4f5e-af2b-fc3e073f6321 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 404 len: 111 microversion: 2.1 time: 0.157154 Aug 25 13:38:47.393077 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2738/5421] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:47 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:38:47.406887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-57b94350-747d-4c2d-ae80-421afcae178c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '.version_select at 0x7f3a2e88adc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:47.503496 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-57b94350-747d-4c2d-ae80-421afcae178c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1344616092" status: 202 len: 0 microversion: 2.1 time: 0.104088 Aug 25 13:38:47.505971 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2684/5422] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 13:38:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1344616092 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:38:52.064278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ddd0186f-1408-4f57-bd76-2e1f380083e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:52.070629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ddd0186f-1408-4f57-bd76-2e1f380083e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:52.089275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddd0186f-1408-4f57-bd76-2e1f380083e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:52.090086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddd0186f-1408-4f57-bd76-2e1f380083e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:52.090606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddd0186f-1408-4f57-bd76-2e1f380083e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:52.091759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddd0186f-1408-4f57-bd76-2e1f380083e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:52.092659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddd0186f-1408-4f57-bd76-2e1f380083e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:52.093466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddd0186f-1408-4f57-bd76-2e1f380083e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:52.441262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-ddd0186f-1408-4f57-bd76-2e1f380083e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lazy-loading 'services' on Instance uuid 7840aa88-f6e2-4295-a852-daa4d572f8b3 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:38:52.758014 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ddd0186f-1408-4f57-bd76-2e1f380083e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments/dc5b7ca3-80db-460c-89f9-b71777b84e5f" status: 202 len: 0 microversion: 2.1 time: 0.717162 Aug 25 13:38:52.759743 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2739/5423] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:38:52 2022] DELETE /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments/dc5b7ca3-80db-460c-89f9-b71777b84e5f => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:38:52.776068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-36c97ff0-cdee-4699-9d75-da9e7563519c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:52.787124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-36c97ff0-cdee-4699-9d75-da9e7563519c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:52.810655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c97ff0-cdee-4699-9d75-da9e7563519c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:52.823545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c97ff0-cdee-4699-9d75-da9e7563519c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:52.824899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c97ff0-cdee-4699-9d75-da9e7563519c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:52.826571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c97ff0-cdee-4699-9d75-da9e7563519c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:52.828147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c97ff0-cdee-4699-9d75-da9e7563519c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:52.829672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36c97ff0-cdee-4699-9d75-da9e7563519c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:52.918716 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-36c97ff0-cdee-4699-9d75-da9e7563519c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150505 Aug 25 13:38:52.920195 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2685/5424] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:38:52 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:38:53.946183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3137e8f-db4d-41b7-9193-d91bd91c8f04 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:53.956890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a3137e8f-db4d-41b7-9193-d91bd91c8f04 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:53.976487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3137e8f-db4d-41b7-9193-d91bd91c8f04 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:53.978965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3137e8f-db4d-41b7-9193-d91bd91c8f04 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:53.980333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3137e8f-db4d-41b7-9193-d91bd91c8f04 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:53.985056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3137e8f-db4d-41b7-9193-d91bd91c8f04 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:53.986265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3137e8f-db4d-41b7-9193-d91bd91c8f04 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:53.989146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3137e8f-db4d-41b7-9193-d91bd91c8f04 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:54.065717 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a3137e8f-db4d-41b7-9193-d91bd91c8f04 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131728 Aug 25 13:38:54.068966 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2740/5425] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:38:53 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:38:55.088309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cc79479c-1504-4402-915e-c692c7420926 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:55.094636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cc79479c-1504-4402-915e-c692c7420926 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:55.107075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc79479c-1504-4402-915e-c692c7420926 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:55.108448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc79479c-1504-4402-915e-c692c7420926 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:55.109589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc79479c-1504-4402-915e-c692c7420926 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:55.110874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc79479c-1504-4402-915e-c692c7420926 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:55.111961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc79479c-1504-4402-915e-c692c7420926 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:55.112959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cc79479c-1504-4402-915e-c692c7420926 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:55.175813 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cc79479c-1504-4402-915e-c692c7420926 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095630 Aug 25 13:38:55.177196 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2686/5426] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:38:55 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:38:56.204032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f95474e-c9cc-403a-aa73-60728f3ba20a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:56.209719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7f95474e-c9cc-403a-aa73-60728f3ba20a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:56.225351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f95474e-c9cc-403a-aa73-60728f3ba20a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:56.227023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f95474e-c9cc-403a-aa73-60728f3ba20a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:56.228858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f95474e-c9cc-403a-aa73-60728f3ba20a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:56.230805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f95474e-c9cc-403a-aa73-60728f3ba20a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:56.231962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f95474e-c9cc-403a-aa73-60728f3ba20a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:56.233377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f95474e-c9cc-403a-aa73-60728f3ba20a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:56.359434 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7f95474e-c9cc-403a-aa73-60728f3ba20a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168181 Aug 25 13:38:56.360952 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2741/5427] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:38:56 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:38:57.381763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ae84580c-2db6-4eac-9c7c-2b8a2a55f200 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:57.394315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ae84580c-2db6-4eac-9c7c-2b8a2a55f200 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:57.423071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae84580c-2db6-4eac-9c7c-2b8a2a55f200 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:57.424157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae84580c-2db6-4eac-9c7c-2b8a2a55f200 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:57.425007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae84580c-2db6-4eac-9c7c-2b8a2a55f200 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:57.430117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae84580c-2db6-4eac-9c7c-2b8a2a55f200 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:57.431617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae84580c-2db6-4eac-9c7c-2b8a2a55f200 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:57.432477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ae84580c-2db6-4eac-9c7c-2b8a2a55f200 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:57.563830 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ae84580c-2db6-4eac-9c7c-2b8a2a55f200 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190148 Aug 25 13:38:57.577419 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2687/5428] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:38:57 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:38:58.602792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad8b4f99-22ef-49c9-83d7-5d357575c37c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:58.608278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad8b4f99-22ef-49c9-83d7-5d357575c37c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:58.627670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8b4f99-22ef-49c9-83d7-5d357575c37c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:58.631088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8b4f99-22ef-49c9-83d7-5d357575c37c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:58.632951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8b4f99-22ef-49c9-83d7-5d357575c37c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:58.635652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8b4f99-22ef-49c9-83d7-5d357575c37c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:58.637304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8b4f99-22ef-49c9-83d7-5d357575c37c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:58.638967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad8b4f99-22ef-49c9-83d7-5d357575c37c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:58.747841 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad8b4f99-22ef-49c9-83d7-5d357575c37c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156825 Aug 25 13:38:58.757849 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2742/5429] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:38:58 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:38:59.787257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1e0f863-ff72-47f1-9235-0e1ac9439058 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:59.801658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c1e0f863-ff72-47f1-9235-0e1ac9439058 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:59.834774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e0f863-ff72-47f1-9235-0e1ac9439058 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:59.841249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e0f863-ff72-47f1-9235-0e1ac9439058 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:59.842058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e0f863-ff72-47f1-9235-0e1ac9439058 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:59.843369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e0f863-ff72-47f1-9235-0e1ac9439058 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:59.846306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e0f863-ff72-47f1-9235-0e1ac9439058 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:59.849577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e0f863-ff72-47f1-9235-0e1ac9439058 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:59.966522 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c1e0f863-ff72-47f1-9235-0e1ac9439058 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199451 Aug 25 13:38:59.968531 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2688/5430] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:38:59 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:01.005801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85000f9f-7625-4b8b-acbf-52a1a2963a05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:01.018706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85000f9f-7625-4b8b-acbf-52a1a2963a05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:01.052566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85000f9f-7625-4b8b-acbf-52a1a2963a05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:01.052814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85000f9f-7625-4b8b-acbf-52a1a2963a05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:01.056031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85000f9f-7625-4b8b-acbf-52a1a2963a05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:01.060855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85000f9f-7625-4b8b-acbf-52a1a2963a05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:01.062170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85000f9f-7625-4b8b-acbf-52a1a2963a05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:01.064313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85000f9f-7625-4b8b-acbf-52a1a2963a05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:01.195018 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85000f9f-7625-4b8b-acbf-52a1a2963a05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207575 Aug 25 13:39:01.211096 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2743/5431] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:39:00 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 197 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:02.218731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2a8f8623-f940-4e59-bea5-bf8d29f347dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:02.230532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a8f8623-f940-4e59-bea5-bf8d29f347dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:02.264714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8f8623-f940-4e59-bea5-bf8d29f347dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:02.268367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8f8623-f940-4e59-bea5-bf8d29f347dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:02.269455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8f8623-f940-4e59-bea5-bf8d29f347dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:02.275921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8f8623-f940-4e59-bea5-bf8d29f347dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:02.277894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8f8623-f940-4e59-bea5-bf8d29f347dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:02.283138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a8f8623-f940-4e59-bea5-bf8d29f347dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:02.363390 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2a8f8623-f940-4e59-bea5-bf8d29f347dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153660 Aug 25 13:39:02.365453 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2689/5432] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:39:02 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:03.391405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f838c10-9307-45f2-8c06-fa73fbac3dff tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:03.421735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f838c10-9307-45f2-8c06-fa73fbac3dff tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:03.486987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f838c10-9307-45f2-8c06-fa73fbac3dff tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:03.492398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f838c10-9307-45f2-8c06-fa73fbac3dff tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:03.497169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f838c10-9307-45f2-8c06-fa73fbac3dff tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:03.502092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f838c10-9307-45f2-8c06-fa73fbac3dff tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:03.508168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f838c10-9307-45f2-8c06-fa73fbac3dff tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:03.513351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f838c10-9307-45f2-8c06-fa73fbac3dff tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:03.695361 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f838c10-9307-45f2-8c06-fa73fbac3dff tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.317237 Aug 25 13:39:03.711673 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2744/5433] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:39:03 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 197 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:04.715705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-86de0a39-b99d-46d4-8112-cdb0bdef2b08 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:04.719396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-86de0a39-b99d-46d4-8112-cdb0bdef2b08 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:04.730385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86de0a39-b99d-46d4-8112-cdb0bdef2b08 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:04.731632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86de0a39-b99d-46d4-8112-cdb0bdef2b08 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:04.732657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86de0a39-b99d-46d4-8112-cdb0bdef2b08 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:04.733719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86de0a39-b99d-46d4-8112-cdb0bdef2b08 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:04.734469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86de0a39-b99d-46d4-8112-cdb0bdef2b08 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:04.735358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-86de0a39-b99d-46d4-8112-cdb0bdef2b08 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:04.797124 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-86de0a39-b99d-46d4-8112-cdb0bdef2b08 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088772 Aug 25 13:39:04.799012 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2690/5434] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:39:04 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:39:04.966140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c09adebf-9929-4cec-9f52-aa0123d5cad2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:04.967132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c09adebf-9929-4cec-9f52-aa0123d5cad2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:04.997893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c09adebf-9929-4cec-9f52-aa0123d5cad2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:04.999332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c09adebf-9929-4cec-9f52-aa0123d5cad2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:05.004002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c09adebf-9929-4cec-9f52-aa0123d5cad2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:05.011341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c09adebf-9929-4cec-9f52-aa0123d5cad2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:05.013207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c09adebf-9929-4cec-9f52-aa0123d5cad2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:05.014298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c09adebf-9929-4cec-9f52-aa0123d5cad2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:05.070057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c09adebf-9929-4cec-9f52-aa0123d5cad2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:39:05.303460 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c09adebf-9929-4cec-9f52-aa0123d5cad2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 204 len: 0 microversion: 2.1 time: 0.343433 Aug 25 13:39:05.313728 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2745/5435] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:39:04 2022] DELETE /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:39:05.323077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-88cc6de5-4c59-4f67-a81a-8aeea88510c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:05.324176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-88cc6de5-4c59-4f67-a81a-8aeea88510c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:05.337845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88cc6de5-4c59-4f67-a81a-8aeea88510c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:05.338669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88cc6de5-4c59-4f67-a81a-8aeea88510c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:05.339801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88cc6de5-4c59-4f67-a81a-8aeea88510c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:05.341535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88cc6de5-4c59-4f67-a81a-8aeea88510c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:05.342758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88cc6de5-4c59-4f67-a81a-8aeea88510c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:05.343909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88cc6de5-4c59-4f67-a81a-8aeea88510c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:06.123268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-88cc6de5-4c59-4f67-a81a-8aeea88510c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:06.141834 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-88cc6de5-4c59-4f67-a81a-8aeea88510c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1683 microversion: 2.1 time: 0.826093 Aug 25 13:39:06.146897 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2691/5436] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:05 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1683 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:07.200286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4ccde89-4783-4e0d-9f4f-07134787aa07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:07.201593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e4ccde89-4783-4e0d-9f4f-07134787aa07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:07.232891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4ccde89-4783-4e0d-9f4f-07134787aa07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:07.234070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4ccde89-4783-4e0d-9f4f-07134787aa07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:07.239821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4ccde89-4783-4e0d-9f4f-07134787aa07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:07.242633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4ccde89-4783-4e0d-9f4f-07134787aa07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:07.256830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4ccde89-4783-4e0d-9f4f-07134787aa07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:07.259738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4ccde89-4783-4e0d-9f4f-07134787aa07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:07.907319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e4ccde89-4783-4e0d-9f4f-07134787aa07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:07.911676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:07.941977 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e4ccde89-4783-4e0d-9f4f-07134787aa07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1683 microversion: 2.1 time: 0.763234 Aug 25 13:39:07.950357 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2746/5437] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:07 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1683 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:08.993049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1c45f5b-9c9d-4ab8-953f-4ed48dccafd6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:08.999288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e1c45f5b-9c9d-4ab8-953f-4ed48dccafd6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:09.029892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:09.065802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c45f5b-9c9d-4ab8-953f-4ed48dccafd6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:09.069648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c45f5b-9c9d-4ab8-953f-4ed48dccafd6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:09.075473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c45f5b-9c9d-4ab8-953f-4ed48dccafd6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:09.078767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c45f5b-9c9d-4ab8-953f-4ed48dccafd6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:09.082903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c45f5b-9c9d-4ab8-953f-4ed48dccafd6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:09.085263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c45f5b-9c9d-4ab8-953f-4ed48dccafd6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:09.102218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=67 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:09.976422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e1c45f5b-9c9d-4ab8-953f-4ed48dccafd6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:10.013039 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e1c45f5b-9c9d-4ab8-953f-4ed48dccafd6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1683 microversion: 2.1 time: 1.026265 Aug 25 13:39:10.014297 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2692/5438] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:08 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1683 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:11.059018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8db5e158-ccc2-4de6-9c2b-7d229a603407 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:11.066185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8db5e158-ccc2-4de6-9c2b-7d229a603407 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:11.086412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:11.117501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db5e158-ccc2-4de6-9c2b-7d229a603407 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:11.122257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db5e158-ccc2-4de6-9c2b-7d229a603407 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:11.123726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db5e158-ccc2-4de6-9c2b-7d229a603407 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:11.126818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db5e158-ccc2-4de6-9c2b-7d229a603407 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:11.131374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db5e158-ccc2-4de6-9c2b-7d229a603407 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:11.132175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db5e158-ccc2-4de6-9c2b-7d229a603407 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:11.347947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8db5e158-ccc2-4de6-9c2b-7d229a603407 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:11.365144 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8db5e158-ccc2-4de6-9c2b-7d229a603407 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1615 microversion: 2.1 time: 0.315739 Aug 25 13:39:11.367342 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2747/5439] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:11 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1615 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:12.182869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c531565f-8e46-4d6b-86e6-6e26b827cdfc req-98a62ffe-c690-4eb1-ac1b-22994f1864fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7840aa88-f6e2-4295-a852-daa4d572f8b3", "name": "network-vif-deleted", "tag": "f8dbc661-202c-42c0-98c7-97614542582b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:12.205339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c531565f-8e46-4d6b-86e6-6e26b827cdfc req-98a62ffe-c690-4eb1-ac1b-22994f1864fd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:12.206648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c531565f-8e46-4d6b-86e6-6e26b827cdfc req-98a62ffe-c690-4eb1-ac1b-22994f1864fd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:12.207777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c531565f-8e46-4d6b-86e6-6e26b827cdfc req-98a62ffe-c690-4eb1-ac1b-22994f1864fd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:12.250544 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c531565f-8e46-4d6b-86e6-6e26b827cdfc req-98a62ffe-c690-4eb1-ac1b-22994f1864fd service nova] Creating event network-vif-deleted:f8dbc661-202c-42c0-98c7-97614542582b for instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 on n-h1-852771-8 Aug 25 13:39:12.266039 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c531565f-8e46-4d6b-86e6-6e26b827cdfc req-98a62ffe-c690-4eb1-ac1b-22994f1864fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090141 Aug 25 13:39:12.270792 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2693/5440] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:12.412444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:12.419246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:12.460445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:12.462787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:12.463941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:12.466195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:12.467402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:12.468429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:12.566900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:12.568081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:12.569963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:12.571180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lazy-loading 'fault' on Instance uuid 7840aa88-f6e2-4295-a852-daa4d572f8b3 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:39:12.892275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:12.930332 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-08d23ee3-d903-4af5-a361-60c53feb84b5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 200 len: 1331 microversion: 2.1 time: 0.525898 Aug 25 13:39:12.954506 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2748/5441] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:12 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 1331 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:13.981564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:13.984920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:14.007416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:14.008385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:14.009848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:14.012854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:14.013751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:14.014611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:14.057578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 HTTP/1.1 Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7840aa88-f6e2-4295-a852-daa4d572f8b3'} Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:39:14.061940 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:39:14.079030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:14.079030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:39:14.079030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:39:14.079030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:39:14.079030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:39:14.079030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:39:14.079030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:39:14.079030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:39:14.079030 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-54d52617-23cf-436b-8b8b-6ce45264e46e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 404 len: 111 microversion: 2.1 time: 0.102950 Aug 25 13:39:14.079030 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2694/5442] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:13 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:39:14.085866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc055baf-c9e9-4161-8f0c-6f918f91c29d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '.version_select at 0x7f3a2983e550>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:14.154328 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc055baf-c9e9-4161-8f0c-6f918f91c29d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-287365193" status: 202 len: 0 microversion: 2.1 time: 0.077358 Aug 25 13:39:14.157246 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2749/5443] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 13:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-287365193 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:39:18.191462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b99613e7-8a65-4022-9fb4-9003542daa53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: .version_select at 0x7f3a2e88a8b0>, body: {"keypair": {"name": "tempest-keypair-552560658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3LvrsVmmojpOHZtE6TT0Jj1ibHJ6DQIbm8VIouqi8bMjGJKVyASrCBOIUg5dFUZtWWynkC65Jn6veOfC0vWAo5MUwlA1a7FK2bEW7Q99IrXRTjVuc4Edai9pcc8h17cQ=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:18.261262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-b99613e7-8a65-4022-9fb4-9003542daa53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:39:18.279043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-b99613e7-8a65-4022-9fb4-9003542daa53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for user b7fdce9f6d624473be8244e28eb215e0 and project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:39:18.530499 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b99613e7-8a65-4022-9fb4-9003542daa53 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.358705 Aug 25 13:39:18.538455 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2695/5444] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:39:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:26.777346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2082036236", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "229df64b-66b9-4c71-89d1-8ec5cff9e192"}], "security_groups": [{"name": "tempest-securitygroup--1541361634"}], "key_name": "tempest-keypair-552560658", "user_data": "}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:26.809459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=15 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:26.812395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:27.191848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] validate_networks() for [('229df64b-66b9-4c71-89d1-8ec5cff9e192', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:39:30.395632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:39:30.396773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:39:30.397762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:39:30.398874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:39:30.401769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:39:30.483731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:30.485045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:30.486237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:30.487956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:30.492214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:30.494874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:30.662778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:39:30.699834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for user b7fdce9f6d624473be8244e28eb215e0 and project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:39:30.761235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:39:30.767257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:39:31.008875 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b76a7558-c53e-4b27-83ef-3eb56f08314c tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.242481 Aug 25 13:39:31.010914 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2750/5445] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:39:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 4246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:39:31.025018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=9 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:31.026820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:31.028118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:31.035676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99b59c0f-a326-4e0a-bc63-e21d8f2a09d4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:31.037808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-99b59c0f-a326-4e0a-bc63-e21d8f2a09d4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:31.339409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99b59c0f-a326-4e0a-bc63-e21d8f2a09d4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:31.361315 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-99b59c0f-a326-4e0a-bc63-e21d8f2a09d4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1241 microversion: 2.1 time: 0.339578 Aug 25 13:39:31.366044 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2696/5446] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:31 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1241 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:32.406148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aefc9389-aeb7-4c10-ba14-0ca98cdf41a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:32.408689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-aefc9389-aeb7-4c10-ba14-0ca98cdf41a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:32.425414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aefc9389-aeb7-4c10-ba14-0ca98cdf41a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:32.428478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aefc9389-aeb7-4c10-ba14-0ca98cdf41a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:32.431112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aefc9389-aeb7-4c10-ba14-0ca98cdf41a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:32.432859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aefc9389-aeb7-4c10-ba14-0ca98cdf41a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:32.434515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aefc9389-aeb7-4c10-ba14-0ca98cdf41a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:32.435572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aefc9389-aeb7-4c10-ba14-0ca98cdf41a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:33.073305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-aefc9389-aeb7-4c10-ba14-0ca98cdf41a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:33.114042 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aefc9389-aeb7-4c10-ba14-0ca98cdf41a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1293 microversion: 2.1 time: 0.714567 Aug 25 13:39:33.115993 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2751/5447] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:32 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1293 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:34.158054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-016a556e-3896-4d06-9b0a-09c262d6de0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:34.159036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-016a556e-3896-4d06-9b0a-09c262d6de0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:34.206131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-016a556e-3896-4d06-9b0a-09c262d6de0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:34.207119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-016a556e-3896-4d06-9b0a-09c262d6de0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:34.207965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-016a556e-3896-4d06-9b0a-09c262d6de0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:34.214420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-016a556e-3896-4d06-9b0a-09c262d6de0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:34.215697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-016a556e-3896-4d06-9b0a-09c262d6de0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:34.216839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-016a556e-3896-4d06-9b0a-09c262d6de0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:34.536166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-016a556e-3896-4d06-9b0a-09c262d6de0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:34.599885 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-016a556e-3896-4d06-9b0a-09c262d6de0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1299 microversion: 2.1 time: 0.449172 Aug 25 13:39:34.632605 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2697/5448] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:34 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1299 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:35.658294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-04de1829-e7fd-411c-a7c6-6c3620adf12b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:35.661027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-04de1829-e7fd-411c-a7c6-6c3620adf12b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:35.746137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04de1829-e7fd-411c-a7c6-6c3620adf12b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:35.748308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04de1829-e7fd-411c-a7c6-6c3620adf12b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:35.749650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04de1829-e7fd-411c-a7c6-6c3620adf12b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:35.751289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04de1829-e7fd-411c-a7c6-6c3620adf12b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:35.752495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04de1829-e7fd-411c-a7c6-6c3620adf12b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:35.753581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-04de1829-e7fd-411c-a7c6-6c3620adf12b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:37.745909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-04de1829-e7fd-411c-a7c6-6c3620adf12b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:37.778479 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-04de1829-e7fd-411c-a7c6-6c3620adf12b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1367 microversion: 2.1 time: 2.135741 Aug 25 13:39:37.781912 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2752/5449] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:35 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1367 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:38.833643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa8d04fa-aab0-4898-8cc4-a46e7d470670 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:38.834904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa8d04fa-aab0-4898-8cc4-a46e7d470670 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:38.868481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8d04fa-aab0-4898-8cc4-a46e7d470670 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:38.869350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8d04fa-aab0-4898-8cc4-a46e7d470670 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:38.869852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8d04fa-aab0-4898-8cc4-a46e7d470670 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:38.874343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8d04fa-aab0-4898-8cc4-a46e7d470670 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:38.877922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8d04fa-aab0-4898-8cc4-a46e7d470670 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:38.878913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8d04fa-aab0-4898-8cc4-a46e7d470670 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:38.979328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-7fafaa62-c9f7-4849-95ee-2948c3b93c62 req-4860b980-79bb-4169-824c-c3b13047893c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad98a18-8328-4972-a028-5e75187fb027", "tag": "ef0904db-64f1-49d4-874a-f547eacca178"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:39.037051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7fafaa62-c9f7-4849-95ee-2948c3b93c62 req-4860b980-79bb-4169-824c-c3b13047893c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:39.042972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7fafaa62-c9f7-4849-95ee-2948c3b93c62 req-4860b980-79bb-4169-824c-c3b13047893c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:39.044659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7fafaa62-c9f7-4849-95ee-2948c3b93c62 req-4860b980-79bb-4169-824c-c3b13047893c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:39.078140 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-7fafaa62-c9f7-4849-95ee-2948c3b93c62 req-4860b980-79bb-4169-824c-c3b13047893c service nova] Creating event network-changed:ef0904db-64f1-49d4-874a-f547eacca178 for instance 3ad98a18-8328-4972-a028-5e75187fb027 on n-h2-852771-8 Aug 25 13:39:39.089803 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-7fafaa62-c9f7-4849-95ee-2948c3b93c62 req-4860b980-79bb-4169-824c-c3b13047893c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126754 Aug 25 13:39:39.096112 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2753/5450] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:40.181054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fa8d04fa-aab0-4898-8cc4-a46e7d470670 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:40.217555 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa8d04fa-aab0-4898-8cc4-a46e7d470670 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1367 microversion: 2.1 time: 1.401265 Aug 25 13:39:40.219011 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2698/5451] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:38 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1367 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:41.300049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0ce01844-3927-495d-bdf1-1c71b831e38f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:41.321959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0ce01844-3927-495d-bdf1-1c71b831e38f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:41.338778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:41.340991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:41.346586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ce01844-3927-495d-bdf1-1c71b831e38f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:41.349721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ce01844-3927-495d-bdf1-1c71b831e38f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:41.351200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ce01844-3927-495d-bdf1-1c71b831e38f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:41.353865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ce01844-3927-495d-bdf1-1c71b831e38f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:41.354662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ce01844-3927-495d-bdf1-1c71b831e38f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:41.355331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ce01844-3927-495d-bdf1-1c71b831e38f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:42.183510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ce01844-3927-495d-bdf1-1c71b831e38f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:42.208548 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0ce01844-3927-495d-bdf1-1c71b831e38f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1367 microversion: 2.1 time: 0.931879 Aug 25 13:39:42.209155 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2754/5452] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:41 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1367 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:43.272730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4b086005-a079-4a76-af78-8be169fd28e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:43.276219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4b086005-a079-4a76-af78-8be169fd28e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:43.293970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:43.302398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b086005-a079-4a76-af78-8be169fd28e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:43.310886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b086005-a079-4a76-af78-8be169fd28e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:43.314439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b086005-a079-4a76-af78-8be169fd28e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:43.320419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b086005-a079-4a76-af78-8be169fd28e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:43.323073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b086005-a079-4a76-af78-8be169fd28e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:43.345922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b086005-a079-4a76-af78-8be169fd28e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:44.092093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4b086005-a079-4a76-af78-8be169fd28e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:44.117211 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4b086005-a079-4a76-af78-8be169fd28e9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1367 microversion: 2.1 time: 0.861480 Aug 25 13:39:44.122161 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2699/5453] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:43 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1367 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:45.187319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efe9fb95-bc28-473c-a8a4-a3996c5a3109 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:45.199461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-efe9fb95-bc28-473c-a8a4-a3996c5a3109 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:45.238051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efe9fb95-bc28-473c-a8a4-a3996c5a3109 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:45.238975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efe9fb95-bc28-473c-a8a4-a3996c5a3109 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:45.239663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efe9fb95-bc28-473c-a8a4-a3996c5a3109 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:45.242110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efe9fb95-bc28-473c-a8a4-a3996c5a3109 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:45.244353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efe9fb95-bc28-473c-a8a4-a3996c5a3109 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:45.250136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efe9fb95-bc28-473c-a8a4-a3996c5a3109 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:46.193191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-efe9fb95-bc28-473c-a8a4-a3996c5a3109 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:46.229136 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-efe9fb95-bc28-473c-a8a4-a3996c5a3109 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1367 microversion: 2.1 time: 1.067564 Aug 25 13:39:46.235852 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2755/5454] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:45 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1367 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:47.283713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4b7b3e89-68c2-4ee2-9d91-53365ef66681 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:47.286478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4b7b3e89-68c2-4ee2-9d91-53365ef66681 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:47.334480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b7b3e89-68c2-4ee2-9d91-53365ef66681 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:47.344562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b7b3e89-68c2-4ee2-9d91-53365ef66681 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:47.345990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b7b3e89-68c2-4ee2-9d91-53365ef66681 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:47.348796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b7b3e89-68c2-4ee2-9d91-53365ef66681 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:47.359059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b7b3e89-68c2-4ee2-9d91-53365ef66681 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:47.360038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b7b3e89-68c2-4ee2-9d91-53365ef66681 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:48.615615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4b7b3e89-68c2-4ee2-9d91-53365ef66681 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:48.664090 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4b7b3e89-68c2-4ee2-9d91-53365ef66681 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1367 microversion: 2.1 time: 1.390616 Aug 25 13:39:48.681201 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2700/5455] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:47 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1367 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:49.734219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a4f25355-2d94-4d43-9676-a5ff0ed2b218 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:49.735295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a4f25355-2d94-4d43-9676-a5ff0ed2b218 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:49.766679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4f25355-2d94-4d43-9676-a5ff0ed2b218 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:49.778090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4f25355-2d94-4d43-9676-a5ff0ed2b218 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:49.780294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4f25355-2d94-4d43-9676-a5ff0ed2b218 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:49.782086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4f25355-2d94-4d43-9676-a5ff0ed2b218 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:49.783958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4f25355-2d94-4d43-9676-a5ff0ed2b218 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:49.784936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4f25355-2d94-4d43-9676-a5ff0ed2b218 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:50.496224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a4f25355-2d94-4d43-9676-a5ff0ed2b218 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:50.536202 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a4f25355-2d94-4d43-9676-a5ff0ed2b218 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1367 microversion: 2.1 time: 0.806285 Aug 25 13:39:50.537833 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2756/5456] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:49 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1367 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:51.593545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-73f08774-2ec4-4fb8-a1bb-f3bbd985ddf5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:51.596680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-73f08774-2ec4-4fb8-a1bb-f3bbd985ddf5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:51.624370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73f08774-2ec4-4fb8-a1bb-f3bbd985ddf5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:51.626990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73f08774-2ec4-4fb8-a1bb-f3bbd985ddf5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:51.629488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73f08774-2ec4-4fb8-a1bb-f3bbd985ddf5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:51.631698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73f08774-2ec4-4fb8-a1bb-f3bbd985ddf5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:51.632652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73f08774-2ec4-4fb8-a1bb-f3bbd985ddf5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:51.634066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-73f08774-2ec4-4fb8-a1bb-f3bbd985ddf5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:51.900059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-73f08774-2ec4-4fb8-a1bb-f3bbd985ddf5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:51.923962 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-73f08774-2ec4-4fb8-a1bb-f3bbd985ddf5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1367 microversion: 2.1 time: 0.349850 Aug 25 13:39:51.952490 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2701/5457] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:51 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:52.083638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-24b99693-d8a5-43ff-beef-ca834742c90f req-9fbf2541-a4a6-40f6-a1aa-993f73249363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad98a18-8328-4972-a028-5e75187fb027", "name": "network-vif-plugged", "status": "completed", "tag": "ef0904db-64f1-49d4-874a-f547eacca178"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:52.122489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-24b99693-d8a5-43ff-beef-ca834742c90f req-9fbf2541-a4a6-40f6-a1aa-993f73249363 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:52.123950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-24b99693-d8a5-43ff-beef-ca834742c90f req-9fbf2541-a4a6-40f6-a1aa-993f73249363 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:52.125210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-24b99693-d8a5-43ff-beef-ca834742c90f req-9fbf2541-a4a6-40f6-a1aa-993f73249363 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:52.172939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-24b99693-d8a5-43ff-beef-ca834742c90f req-9fbf2541-a4a6-40f6-a1aa-993f73249363 service nova] Creating event network-vif-plugged:ef0904db-64f1-49d4-874a-f547eacca178 for instance 3ad98a18-8328-4972-a028-5e75187fb027 on n-h2-852771-8 Aug 25 13:39:52.184477 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-24b99693-d8a5-43ff-beef-ca834742c90f req-9fbf2541-a4a6-40f6-a1aa-993f73249363 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121596 Aug 25 13:39:52.186022 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2757/5458] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:52.974675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59c9603d-df80-4a84-907c-17bf80ab0b47 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:52.980136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59c9603d-df80-4a84-907c-17bf80ab0b47 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:53.011057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c9603d-df80-4a84-907c-17bf80ab0b47 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:53.016067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c9603d-df80-4a84-907c-17bf80ab0b47 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:53.017070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c9603d-df80-4a84-907c-17bf80ab0b47 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:53.022891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c9603d-df80-4a84-907c-17bf80ab0b47 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:53.025494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c9603d-df80-4a84-907c-17bf80ab0b47 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:53.029609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59c9603d-df80-4a84-907c-17bf80ab0b47 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:53.666016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-59c9603d-df80-4a84-907c-17bf80ab0b47 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:53.728881 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59c9603d-df80-4a84-907c-17bf80ab0b47 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1367 microversion: 2.1 time: 0.764378 Aug 25 13:39:53.752987 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2702/5459] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:52 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1367 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:54.770996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-59c4faa3-be21-410d-9ae7-906856873d7b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:54.780764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-59c4faa3-be21-410d-9ae7-906856873d7b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:54.824612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c4faa3-be21-410d-9ae7-906856873d7b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:54.825813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c4faa3-be21-410d-9ae7-906856873d7b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:54.828930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c4faa3-be21-410d-9ae7-906856873d7b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:54.831608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c4faa3-be21-410d-9ae7-906856873d7b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:54.838492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c4faa3-be21-410d-9ae7-906856873d7b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:54.842975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c4faa3-be21-410d-9ae7-906856873d7b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:55.586104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-59c4faa3-be21-410d-9ae7-906856873d7b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:55.615000 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-59c4faa3-be21-410d-9ae7-906856873d7b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1558 microversion: 2.1 time: 0.856642 Aug 25 13:39:55.657497 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2758/5460] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:54 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1558 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:55.672637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-34ff984d-0a1d-464b-be47-9393428e75c2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:55.674555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-34ff984d-0a1d-464b-be47-9393428e75c2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:55.697643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34ff984d-0a1d-464b-be47-9393428e75c2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:55.702674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34ff984d-0a1d-464b-be47-9393428e75c2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:55.710524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34ff984d-0a1d-464b-be47-9393428e75c2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:55.714014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34ff984d-0a1d-464b-be47-9393428e75c2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:55.714650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34ff984d-0a1d-464b-be47-9393428e75c2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:55.715428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-34ff984d-0a1d-464b-be47-9393428e75c2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:56.239747 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-34ff984d-0a1d-464b-be47-9393428e75c2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.583908 Aug 25 13:39:56.242876 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2703/5461] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:39:55 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-interface => generated 285 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:59.537550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-fd0e26af-d6b0-4be0-a1fc-b3c67570bc03 req-6ec5844c-7b28-43eb-bb87-5c43a7ece392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad98a18-8328-4972-a028-5e75187fb027", "tag": "ef0904db-64f1-49d4-874a-f547eacca178"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:59.602849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:59.626250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fd0e26af-d6b0-4be0-a1fc-b3c67570bc03 req-6ec5844c-7b28-43eb-bb87-5c43a7ece392 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:59.627684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fd0e26af-d6b0-4be0-a1fc-b3c67570bc03 req-6ec5844c-7b28-43eb-bb87-5c43a7ece392 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:59.628788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fd0e26af-d6b0-4be0-a1fc-b3c67570bc03 req-6ec5844c-7b28-43eb-bb87-5c43a7ece392 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:59.645241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=43 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:59.693879 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-fd0e26af-d6b0-4be0-a1fc-b3c67570bc03 req-6ec5844c-7b28-43eb-bb87-5c43a7ece392 service nova] Creating event network-changed:ef0904db-64f1-49d4-874a-f547eacca178 for instance 3ad98a18-8328-4972-a028-5e75187fb027 on n-h2-852771-8 Aug 25 13:39:59.713188 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-fd0e26af-d6b0-4be0-a1fc-b3c67570bc03 req-6ec5844c-7b28-43eb-bb87-5c43a7ece392 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199746 Aug 25 13:39:59.726107 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2759/5462] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:40:12.111995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=18 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:12.127707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=40 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:12.730552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-983972442", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "783aafb7-fcdd-46e5-80b4-c7cc92042f4d"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:12.848931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] validate_networks() for [('783aafb7-fcdd-46e5-80b4-c7cc92042f4d', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:40:16.335024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:40:16.338198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:40:16.339646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:40:16.340753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:40:16.341850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:40:16.365952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:16.367404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:16.368570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:16.370457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:16.371737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:16.372841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:16.444840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Getting quotas for project 9acde8f8838d4e709fd03a882bb50b74. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:40:16.464915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Getting quotas for user 040c9da07e4840a999bef4336a033752 and project 9acde8f8838d4e709fd03a882bb50b74. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:40:16.505209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:40:16.510883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:40:16.717880 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89740c6d-763a-493d-831e-15f10ace588f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.623345 Aug 25 13:40:16.722314 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2704/5463] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:40:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:40:16.743546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f78ef6e3-91d9-4e97-a7ae-9099912efc03 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:16.745001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f78ef6e3-91d9-4e97-a7ae-9099912efc03 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:16.768930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:17.283854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f78ef6e3-91d9-4e97-a7ae-9099912efc03 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:17.308485 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f78ef6e3-91d9-4e97-a7ae-9099912efc03 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1214 microversion: 2.1 time: 0.574153 Aug 25 13:40:17.312143 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2760/5464] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:16 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1214 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:18.372390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-be55595f-abbe-43a8-b590-7f23eca04ef4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:18.378274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-be55595f-abbe-43a8-b590-7f23eca04ef4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:18.736837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-be55595f-abbe-43a8-b590-7f23eca04ef4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:18.780702 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-be55595f-abbe-43a8-b590-7f23eca04ef4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1214 microversion: 2.1 time: 0.430285 Aug 25 13:40:18.812554 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2705/5465] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:18 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1214 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:19.844963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8880c363-25e6-4a38-85be-22c21aa71ce3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:19.849309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8880c363-25e6-4a38-85be-22c21aa71ce3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:19.876320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8880c363-25e6-4a38-85be-22c21aa71ce3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:19.878215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8880c363-25e6-4a38-85be-22c21aa71ce3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:19.879733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8880c363-25e6-4a38-85be-22c21aa71ce3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:19.881742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8880c363-25e6-4a38-85be-22c21aa71ce3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:19.883598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8880c363-25e6-4a38-85be-22c21aa71ce3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:19.884866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8880c363-25e6-4a38-85be-22c21aa71ce3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:20.244118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8880c363-25e6-4a38-85be-22c21aa71ce3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:20.298154 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8880c363-25e6-4a38-85be-22c21aa71ce3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1266 microversion: 2.1 time: 0.463938 Aug 25 13:40:20.308992 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2761/5466] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:19 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1266 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:21.366008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c96dfb4b-170e-4b35-9230-8d90123213ba tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:21.372978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c96dfb4b-170e-4b35-9230-8d90123213ba tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:21.388354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c96dfb4b-170e-4b35-9230-8d90123213ba tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:21.389304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c96dfb4b-170e-4b35-9230-8d90123213ba tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:21.390507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c96dfb4b-170e-4b35-9230-8d90123213ba tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:21.395472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c96dfb4b-170e-4b35-9230-8d90123213ba tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:21.396456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c96dfb4b-170e-4b35-9230-8d90123213ba tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:21.397296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c96dfb4b-170e-4b35-9230-8d90123213ba tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:21.729872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c96dfb4b-170e-4b35-9230-8d90123213ba tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:21.753728 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c96dfb4b-170e-4b35-9230-8d90123213ba tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1272 microversion: 2.1 time: 0.403296 Aug 25 13:40:21.755727 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2706/5467] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:21 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1272 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:22.799051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8e4767ca-b648-4dbd-b79a-c79c3e59e001 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:22.803190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8e4767ca-b648-4dbd-b79a-c79c3e59e001 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:22.828659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e4767ca-b648-4dbd-b79a-c79c3e59e001 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:22.830709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e4767ca-b648-4dbd-b79a-c79c3e59e001 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:22.831848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e4767ca-b648-4dbd-b79a-c79c3e59e001 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:22.834146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e4767ca-b648-4dbd-b79a-c79c3e59e001 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:22.836822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e4767ca-b648-4dbd-b79a-c79c3e59e001 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:22.838067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e4767ca-b648-4dbd-b79a-c79c3e59e001 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:22.996604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8e4767ca-b648-4dbd-b79a-c79c3e59e001 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:23.018620 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8e4767ca-b648-4dbd-b79a-c79c3e59e001 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1272 microversion: 2.1 time: 0.227551 Aug 25 13:40:23.019998 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2762/5468] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:22 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:24.082727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3dcd1b52-76aa-4533-a083-d67b9e4cc86a tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:24.088263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3dcd1b52-76aa-4533-a083-d67b9e4cc86a tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:24.108197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dcd1b52-76aa-4533-a083-d67b9e4cc86a tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:24.109418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dcd1b52-76aa-4533-a083-d67b9e4cc86a tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:24.111059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dcd1b52-76aa-4533-a083-d67b9e4cc86a tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:24.113692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dcd1b52-76aa-4533-a083-d67b9e4cc86a tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:24.114919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dcd1b52-76aa-4533-a083-d67b9e4cc86a tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:24.116061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3dcd1b52-76aa-4533-a083-d67b9e4cc86a tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:24.676898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3dcd1b52-76aa-4533-a083-d67b9e4cc86a tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:24.700958 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3dcd1b52-76aa-4533-a083-d67b9e4cc86a tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1314 microversion: 2.1 time: 0.627213 Aug 25 13:40:24.718407 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2707/5469] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:24 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:25.748978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8873cea1-3225-494f-9dc7-63f43b06323f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:25.755308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8873cea1-3225-494f-9dc7-63f43b06323f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:25.769687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8873cea1-3225-494f-9dc7-63f43b06323f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:25.771099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8873cea1-3225-494f-9dc7-63f43b06323f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:25.772216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8873cea1-3225-494f-9dc7-63f43b06323f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:25.773838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8873cea1-3225-494f-9dc7-63f43b06323f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:25.775002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8873cea1-3225-494f-9dc7-63f43b06323f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:25.776159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8873cea1-3225-494f-9dc7-63f43b06323f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:26.123318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-10f74500-2655-4dea-9164-82136fe4856e req-251699c5-703b-4147-acfa-b31ca2695189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "054ad142-ad08-4820-b2be-b278916e2662", "tag": "19db6dbf-b41f-4936-a6e4-2c0e96eac874"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:26.166672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-10f74500-2655-4dea-9164-82136fe4856e req-251699c5-703b-4147-acfa-b31ca2695189 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:26.176639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-10f74500-2655-4dea-9164-82136fe4856e req-251699c5-703b-4147-acfa-b31ca2695189 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:26.178104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-10f74500-2655-4dea-9164-82136fe4856e req-251699c5-703b-4147-acfa-b31ca2695189 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:26.230733 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-10f74500-2655-4dea-9164-82136fe4856e req-251699c5-703b-4147-acfa-b31ca2695189 service nova] Creating event network-changed:19db6dbf-b41f-4936-a6e4-2c0e96eac874 for instance 054ad142-ad08-4820-b2be-b278916e2662 on n-h1-852771-8 Aug 25 13:40:26.260210 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-10f74500-2655-4dea-9164-82136fe4856e req-251699c5-703b-4147-acfa-b31ca2695189 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144155 Aug 25 13:40:26.265631 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2708/5470] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:40:26.981466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8873cea1-3225-494f-9dc7-63f43b06323f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:27.003169 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8873cea1-3225-494f-9dc7-63f43b06323f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1314 microversion: 2.1 time: 1.264895 Aug 25 13:40:27.006316 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2763/5471] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:25 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1314 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:28.047358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8546450d-44c5-4c21-a64c-5da7e996ac8d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:28.054950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8546450d-44c5-4c21-a64c-5da7e996ac8d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:28.060704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:28.079662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8546450d-44c5-4c21-a64c-5da7e996ac8d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:28.082021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8546450d-44c5-4c21-a64c-5da7e996ac8d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:28.083723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8546450d-44c5-4c21-a64c-5da7e996ac8d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:28.087816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8546450d-44c5-4c21-a64c-5da7e996ac8d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:28.090226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8546450d-44c5-4c21-a64c-5da7e996ac8d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:28.091423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8546450d-44c5-4c21-a64c-5da7e996ac8d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:28.638272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8546450d-44c5-4c21-a64c-5da7e996ac8d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:28.663826 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8546450d-44c5-4c21-a64c-5da7e996ac8d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1314 microversion: 2.1 time: 0.625002 Aug 25 13:40:28.670762 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2709/5472] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:28 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:29.712957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-59708d96-7f97-4d54-a749-2d7290dbf1af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:29.717537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-59708d96-7f97-4d54-a749-2d7290dbf1af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:29.723842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:29.736696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59708d96-7f97-4d54-a749-2d7290dbf1af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:29.739690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59708d96-7f97-4d54-a749-2d7290dbf1af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:29.772055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59708d96-7f97-4d54-a749-2d7290dbf1af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:29.774910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59708d96-7f97-4d54-a749-2d7290dbf1af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:29.775464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59708d96-7f97-4d54-a749-2d7290dbf1af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:29.776281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59708d96-7f97-4d54-a749-2d7290dbf1af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:30.645386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-59708d96-7f97-4d54-a749-2d7290dbf1af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:30.667318 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-59708d96-7f97-4d54-a749-2d7290dbf1af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1314 microversion: 2.1 time: 0.962338 Aug 25 13:40:30.682389 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2764/5473] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:29 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1314 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:31.716842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8345c168-4071-4b0b-bd4b-3d266d85f10f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:31.718116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8345c168-4071-4b0b-bd4b-3d266d85f10f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:31.737017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:31.747582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8345c168-4071-4b0b-bd4b-3d266d85f10f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:31.748453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8345c168-4071-4b0b-bd4b-3d266d85f10f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:31.749723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8345c168-4071-4b0b-bd4b-3d266d85f10f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:31.755258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8345c168-4071-4b0b-bd4b-3d266d85f10f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:31.759905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8345c168-4071-4b0b-bd4b-3d266d85f10f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:31.762893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8345c168-4071-4b0b-bd4b-3d266d85f10f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:32.918288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8345c168-4071-4b0b-bd4b-3d266d85f10f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:32.943053 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8345c168-4071-4b0b-bd4b-3d266d85f10f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1314 microversion: 2.1 time: 1.240723 Aug 25 13:40:32.944034 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2710/5474] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:31 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:33.988253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a576a09c-8c3e-41fc-8f4b-904e5a06fdd9 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:33.993363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a576a09c-8c3e-41fc-8f4b-904e5a06fdd9 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:34.008280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a576a09c-8c3e-41fc-8f4b-904e5a06fdd9 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:34.009304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a576a09c-8c3e-41fc-8f4b-904e5a06fdd9 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:34.010464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a576a09c-8c3e-41fc-8f4b-904e5a06fdd9 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:34.013887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a576a09c-8c3e-41fc-8f4b-904e5a06fdd9 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:34.014908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a576a09c-8c3e-41fc-8f4b-904e5a06fdd9 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:34.015818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a576a09c-8c3e-41fc-8f4b-904e5a06fdd9 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:34.607794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a576a09c-8c3e-41fc-8f4b-904e5a06fdd9 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:34.624341 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a576a09c-8c3e-41fc-8f4b-904e5a06fdd9 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1314 microversion: 2.1 time: 0.645452 Aug 25 13:40:34.641565 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2765/5475] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:33 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:35.670685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aa1d8aeb-7576-4dc1-a147-a564a412eb69 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:35.671927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aa1d8aeb-7576-4dc1-a147-a564a412eb69 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:35.693159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa1d8aeb-7576-4dc1-a147-a564a412eb69 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:35.694169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa1d8aeb-7576-4dc1-a147-a564a412eb69 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:35.695665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa1d8aeb-7576-4dc1-a147-a564a412eb69 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:35.697670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa1d8aeb-7576-4dc1-a147-a564a412eb69 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:35.699184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa1d8aeb-7576-4dc1-a147-a564a412eb69 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:35.700239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa1d8aeb-7576-4dc1-a147-a564a412eb69 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:36.155228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c98b4822-a0b0-4128-8422-c9233c07a558 req-84acf417-c440-40f3-a52f-3c45c05c48ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "054ad142-ad08-4820-b2be-b278916e2662", "name": "network-vif-plugged", "status": "completed", "tag": "19db6dbf-b41f-4936-a6e4-2c0e96eac874"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:36.206581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c98b4822-a0b0-4128-8422-c9233c07a558 req-84acf417-c440-40f3-a52f-3c45c05c48ab service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:36.207534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c98b4822-a0b0-4128-8422-c9233c07a558 req-84acf417-c440-40f3-a52f-3c45c05c48ab service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:36.212548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c98b4822-a0b0-4128-8422-c9233c07a558 req-84acf417-c440-40f3-a52f-3c45c05c48ab service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:36.236604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aa1d8aeb-7576-4dc1-a147-a564a412eb69 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:36.262201 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c98b4822-a0b0-4128-8422-c9233c07a558 req-84acf417-c440-40f3-a52f-3c45c05c48ab service nova] Creating event network-vif-plugged:19db6dbf-b41f-4936-a6e4-2c0e96eac874 for instance 054ad142-ad08-4820-b2be-b278916e2662 on n-h1-852771-8 Aug 25 13:40:36.274503 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aa1d8aeb-7576-4dc1-a147-a564a412eb69 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1314 microversion: 2.1 time: 0.615761 Aug 25 13:40:36.276671 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2711/5476] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:35 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:36.302548 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c98b4822-a0b0-4128-8422-c9233c07a558 req-84acf417-c440-40f3-a52f-3c45c05c48ab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154987 Aug 25 13:40:36.305839 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2766/5477] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:40:37.321556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-999f9a3c-3556-4c5f-be2f-1e64409d032c tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:37.322910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-999f9a3c-3556-4c5f-be2f-1e64409d032c tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:37.339485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999f9a3c-3556-4c5f-be2f-1e64409d032c tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:37.341197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999f9a3c-3556-4c5f-be2f-1e64409d032c tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:37.342734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999f9a3c-3556-4c5f-be2f-1e64409d032c tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:37.344952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999f9a3c-3556-4c5f-be2f-1e64409d032c tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:37.345868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999f9a3c-3556-4c5f-be2f-1e64409d032c tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:37.347371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999f9a3c-3556-4c5f-be2f-1e64409d032c tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:37.818835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-999f9a3c-3556-4c5f-be2f-1e64409d032c tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:37.838509 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-999f9a3c-3556-4c5f-be2f-1e64409d032c tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1314 microversion: 2.1 time: 0.526833 Aug 25 13:40:37.839927 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2712/5478] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:37 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:38.887404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2de7570b-7ecd-4ae7-abb0-be2e18cef230 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:38.888656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2de7570b-7ecd-4ae7-abb0-be2e18cef230 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:38.920036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2de7570b-7ecd-4ae7-abb0-be2e18cef230 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:38.930863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2de7570b-7ecd-4ae7-abb0-be2e18cef230 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:38.932314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2de7570b-7ecd-4ae7-abb0-be2e18cef230 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:38.934404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2de7570b-7ecd-4ae7-abb0-be2e18cef230 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:38.936034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2de7570b-7ecd-4ae7-abb0-be2e18cef230 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:38.937344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2de7570b-7ecd-4ae7-abb0-be2e18cef230 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:39.894510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2de7570b-7ecd-4ae7-abb0-be2e18cef230 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:39.932222 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2de7570b-7ecd-4ae7-abb0-be2e18cef230 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1500 microversion: 2.1 time: 1.050400 Aug 25 13:40:39.934594 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2767/5479] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:38 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1500 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:39.978317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-afc6e09a-59b7-4b7f-abc7-f1a3fc83eec3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:39.979432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-afc6e09a-59b7-4b7f-abc7-f1a3fc83eec3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:40.007162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc6e09a-59b7-4b7f-abc7-f1a3fc83eec3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:40.008500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc6e09a-59b7-4b7f-abc7-f1a3fc83eec3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:40.009627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc6e09a-59b7-4b7f-abc7-f1a3fc83eec3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:40.011233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc6e09a-59b7-4b7f-abc7-f1a3fc83eec3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:40.012395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc6e09a-59b7-4b7f-abc7-f1a3fc83eec3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:40.013442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc6e09a-59b7-4b7f-abc7-f1a3fc83eec3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:40.567924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-afc6e09a-59b7-4b7f-abc7-f1a3fc83eec3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:40.597731 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-afc6e09a-59b7-4b7f-abc7-f1a3fc83eec3 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1500 microversion: 2.1 time: 0.626822 Aug 25 13:40:40.599319 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2713/5480] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:39 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1500 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:40.649787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3582087-b6ad-40a5-bc8a-dd252014ad0f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:40.651612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c3582087-b6ad-40a5-bc8a-dd252014ad0f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:40.692022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3582087-b6ad-40a5-bc8a-dd252014ad0f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:40.693929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3582087-b6ad-40a5-bc8a-dd252014ad0f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:40.695345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3582087-b6ad-40a5-bc8a-dd252014ad0f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:40.697339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3582087-b6ad-40a5-bc8a-dd252014ad0f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:40.699476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3582087-b6ad-40a5-bc8a-dd252014ad0f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:40.700652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c3582087-b6ad-40a5-bc8a-dd252014ad0f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:40.787735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-c3582087-b6ad-40a5-bc8a-dd252014ad0f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lazy-loading 'flavor' on Instance uuid 054ad142-ad08-4820-b2be-b278916e2662 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:40:41.010559 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3582087-b6ad-40a5-bc8a-dd252014ad0f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "POST /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662/action" status: 202 len: 0 microversion: 2.1 time: 0.373909 Aug 25 13:40:41.016837 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2768/5481] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:40:40 2022] POST /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:40:41.042237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d0b8031a-47f2-434c-81eb-8d3299499c6b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:41.046064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d0b8031a-47f2-434c-81eb-8d3299499c6b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:41.067728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b8031a-47f2-434c-81eb-8d3299499c6b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:41.069294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b8031a-47f2-434c-81eb-8d3299499c6b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:41.070529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b8031a-47f2-434c-81eb-8d3299499c6b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:41.072211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b8031a-47f2-434c-81eb-8d3299499c6b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:41.073092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b8031a-47f2-434c-81eb-8d3299499c6b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:41.073916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d0b8031a-47f2-434c-81eb-8d3299499c6b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:41.598202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d0b8031a-47f2-434c-81eb-8d3299499c6b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:41.612049 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d0b8031a-47f2-434c-81eb-8d3299499c6b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1508 microversion: 2.1 time: 0.583580 Aug 25 13:40:41.634865 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2714/5482] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:41 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1508 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:40:42.659182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-11983c43-0ceb-4ff6-8a69-d619348e8b61 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:42.661724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-11983c43-0ceb-4ff6-8a69-d619348e8b61 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:42.681696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11983c43-0ceb-4ff6-8a69-d619348e8b61 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:42.683184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11983c43-0ceb-4ff6-8a69-d619348e8b61 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:42.684400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11983c43-0ceb-4ff6-8a69-d619348e8b61 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:42.686920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11983c43-0ceb-4ff6-8a69-d619348e8b61 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:42.688355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11983c43-0ceb-4ff6-8a69-d619348e8b61 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:42.691035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11983c43-0ceb-4ff6-8a69-d619348e8b61 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:43.126490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-11983c43-0ceb-4ff6-8a69-d619348e8b61 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:43.147450 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-11983c43-0ceb-4ff6-8a69-d619348e8b61 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1491 microversion: 2.1 time: 0.503098 Aug 25 13:40:43.149717 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2769/5483] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:42 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1491 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:43.197120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb8b627c-693a-436a-8ea6-4edee7183e37 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:43.198214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fb8b627c-693a-436a-8ea6-4edee7183e37 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:43.218523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:43.230174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb8b627c-693a-436a-8ea6-4edee7183e37 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:43.231838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb8b627c-693a-436a-8ea6-4edee7183e37 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:43.233242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb8b627c-693a-436a-8ea6-4edee7183e37 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:43.235182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb8b627c-693a-436a-8ea6-4edee7183e37 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:43.237088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb8b627c-693a-436a-8ea6-4edee7183e37 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:43.238470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb8b627c-693a-436a-8ea6-4edee7183e37 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:43.286946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=53 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:43.456501 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb8b627c-693a-436a-8ea6-4edee7183e37 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "POST /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662/action" status: 202 len: 0 microversion: 2.1 time: 0.268200 Aug 25 13:40:43.465947 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2715/5484] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:40:43 2022] POST /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:40:43.484983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-28115e61-47e1-4882-88ea-54e6d6e2bd62 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:43.487742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-28115e61-47e1-4882-88ea-54e6d6e2bd62 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:43.504801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28115e61-47e1-4882-88ea-54e6d6e2bd62 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:43.508317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28115e61-47e1-4882-88ea-54e6d6e2bd62 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:43.509942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28115e61-47e1-4882-88ea-54e6d6e2bd62 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:43.512170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28115e61-47e1-4882-88ea-54e6d6e2bd62 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:43.514909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28115e61-47e1-4882-88ea-54e6d6e2bd62 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:43.516146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28115e61-47e1-4882-88ea-54e6d6e2bd62 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:43.855111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-28115e61-47e1-4882-88ea-54e6d6e2bd62 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:43.872488 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-28115e61-47e1-4882-88ea-54e6d6e2bd62 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1497 microversion: 2.1 time: 0.397344 Aug 25 13:40:43.873687 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2770/5485] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:43 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1497 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:44.928699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f5aa79a7-7e80-47c8-a0c1-d2a85ef0139b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:44.936583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f5aa79a7-7e80-47c8-a0c1-d2a85ef0139b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:44.969183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5aa79a7-7e80-47c8-a0c1-d2a85ef0139b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:44.972999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5aa79a7-7e80-47c8-a0c1-d2a85ef0139b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:44.974777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5aa79a7-7e80-47c8-a0c1-d2a85ef0139b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:44.980654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5aa79a7-7e80-47c8-a0c1-d2a85ef0139b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:44.982394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5aa79a7-7e80-47c8-a0c1-d2a85ef0139b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:44.983488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f5aa79a7-7e80-47c8-a0c1-d2a85ef0139b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:45.723633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f5aa79a7-7e80-47c8-a0c1-d2a85ef0139b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:45.745431 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f5aa79a7-7e80-47c8-a0c1-d2a85ef0139b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1497 microversion: 2.1 time: 0.837325 Aug 25 13:40:45.748057 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2716/5486] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:44 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1497 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:46.794139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d65f5cf7-a2a8-4b7a-b67a-80538512c64f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:46.796415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d65f5cf7-a2a8-4b7a-b67a-80538512c64f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:46.811266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=26 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:46.828712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d65f5cf7-a2a8-4b7a-b67a-80538512c64f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:46.832465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d65f5cf7-a2a8-4b7a-b67a-80538512c64f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:46.836926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d65f5cf7-a2a8-4b7a-b67a-80538512c64f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:46.838977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d65f5cf7-a2a8-4b7a-b67a-80538512c64f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:46.841683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d65f5cf7-a2a8-4b7a-b67a-80538512c64f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:46.846040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d65f5cf7-a2a8-4b7a-b67a-80538512c64f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:46.969346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:47.397392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d65f5cf7-a2a8-4b7a-b67a-80538512c64f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:47.421736 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d65f5cf7-a2a8-4b7a-b67a-80538512c64f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1500 microversion: 2.1 time: 0.635595 Aug 25 13:40:47.438220 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2771/5487] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:46 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1500 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:47.465356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ed2b578-5ec9-480e-8da3-dfd34beae03b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:47.471622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9ed2b578-5ec9-480e-8da3-dfd34beae03b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:47.495858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ed2b578-5ec9-480e-8da3-dfd34beae03b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:47.499440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ed2b578-5ec9-480e-8da3-dfd34beae03b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:47.502513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ed2b578-5ec9-480e-8da3-dfd34beae03b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:47.505985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ed2b578-5ec9-480e-8da3-dfd34beae03b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:47.514104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ed2b578-5ec9-480e-8da3-dfd34beae03b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:47.514978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ed2b578-5ec9-480e-8da3-dfd34beae03b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:47.595959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-9ed2b578-5ec9-480e-8da3-dfd34beae03b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lazy-loading 'flavor' on Instance uuid 054ad142-ad08-4820-b2be-b278916e2662 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:40:47.802715 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9ed2b578-5ec9-480e-8da3-dfd34beae03b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "POST /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662/action" status: 202 len: 0 microversion: 2.1 time: 0.347092 Aug 25 13:40:47.822963 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2717/5488] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:40:47 2022] POST /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:40:47.824878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a779a659-8329-4f44-b98c-ae5d7dbe9dce tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:47.827836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a779a659-8329-4f44-b98c-ae5d7dbe9dce tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:47.858420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a779a659-8329-4f44-b98c-ae5d7dbe9dce tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:47.859354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a779a659-8329-4f44-b98c-ae5d7dbe9dce tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:47.860253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a779a659-8329-4f44-b98c-ae5d7dbe9dce tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:47.861710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a779a659-8329-4f44-b98c-ae5d7dbe9dce tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:47.863692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a779a659-8329-4f44-b98c-ae5d7dbe9dce tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:47.864544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a779a659-8329-4f44-b98c-ae5d7dbe9dce tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:48.619024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a779a659-8329-4f44-b98c-ae5d7dbe9dce tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:48.639898 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a779a659-8329-4f44-b98c-ae5d7dbe9dce tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1508 microversion: 2.1 time: 0.829776 Aug 25 13:40:48.645311 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2772/5489] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:47 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1508 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:49.698903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2aaeb90a-1bd2-4e34-9098-0e182d15ce8b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:49.701385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2aaeb90a-1bd2-4e34-9098-0e182d15ce8b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:49.716400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aaeb90a-1bd2-4e34-9098-0e182d15ce8b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:49.718087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aaeb90a-1bd2-4e34-9098-0e182d15ce8b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:49.721223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aaeb90a-1bd2-4e34-9098-0e182d15ce8b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:49.723057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aaeb90a-1bd2-4e34-9098-0e182d15ce8b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:49.724304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aaeb90a-1bd2-4e34-9098-0e182d15ce8b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:49.725054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aaeb90a-1bd2-4e34-9098-0e182d15ce8b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:50.362616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2aaeb90a-1bd2-4e34-9098-0e182d15ce8b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:50.379318 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2aaeb90a-1bd2-4e34-9098-0e182d15ce8b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1491 microversion: 2.1 time: 0.690907 Aug 25 13:40:50.380794 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2718/5490] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:49 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1491 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:50.423279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-460da0fb-52e2-4f46-80f4-9ca59ec8748b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:50.425448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-460da0fb-52e2-4f46-80f4-9ca59ec8748b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:50.442451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-460da0fb-52e2-4f46-80f4-9ca59ec8748b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:50.443856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-460da0fb-52e2-4f46-80f4-9ca59ec8748b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:50.445627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-460da0fb-52e2-4f46-80f4-9ca59ec8748b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:50.447353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-460da0fb-52e2-4f46-80f4-9ca59ec8748b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:50.448604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-460da0fb-52e2-4f46-80f4-9ca59ec8748b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:50.449715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-460da0fb-52e2-4f46-80f4-9ca59ec8748b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:50.619803 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-460da0fb-52e2-4f46-80f4-9ca59ec8748b tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "POST /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662/action" status: 202 len: 0 microversion: 2.1 time: 0.204951 Aug 25 13:40:50.626899 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2773/5491] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:40:50 2022] POST /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:40:50.641239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-edbc2821-035e-4874-b21d-aa7cc6f6dd30 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:50.643471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-edbc2821-035e-4874-b21d-aa7cc6f6dd30 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:50.664311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edbc2821-035e-4874-b21d-aa7cc6f6dd30 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:50.666410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edbc2821-035e-4874-b21d-aa7cc6f6dd30 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:50.667887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edbc2821-035e-4874-b21d-aa7cc6f6dd30 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:50.675843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edbc2821-035e-4874-b21d-aa7cc6f6dd30 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:50.686802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edbc2821-035e-4874-b21d-aa7cc6f6dd30 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:50.692035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edbc2821-035e-4874-b21d-aa7cc6f6dd30 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:51.214312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-edbc2821-035e-4874-b21d-aa7cc6f6dd30 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:51.234299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-edbc2821-035e-4874-b21d-aa7cc6f6dd30 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1497 microversion: 2.1 time: 0.603823 Aug 25 13:40:51.248763 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2719/5492] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:50 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1497 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:52.293406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62fc8797-37dc-4efb-8122-bc65b32d39af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:52.296930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-62fc8797-37dc-4efb-8122-bc65b32d39af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:52.313959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62fc8797-37dc-4efb-8122-bc65b32d39af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:52.315541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62fc8797-37dc-4efb-8122-bc65b32d39af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:52.316713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62fc8797-37dc-4efb-8122-bc65b32d39af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:52.318738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62fc8797-37dc-4efb-8122-bc65b32d39af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:52.322399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62fc8797-37dc-4efb-8122-bc65b32d39af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:52.323901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62fc8797-37dc-4efb-8122-bc65b32d39af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:52.797390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62fc8797-37dc-4efb-8122-bc65b32d39af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:52.818193 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-62fc8797-37dc-4efb-8122-bc65b32d39af tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1497 microversion: 2.1 time: 0.536747 Aug 25 13:40:52.819417 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2774/5493] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:52 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1497 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:53.877269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a55ce6c8-992f-4c33-a786-3af9e8087d9d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:53.882564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a55ce6c8-992f-4c33-a786-3af9e8087d9d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:53.903888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a55ce6c8-992f-4c33-a786-3af9e8087d9d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:53.910218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a55ce6c8-992f-4c33-a786-3af9e8087d9d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:53.912403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a55ce6c8-992f-4c33-a786-3af9e8087d9d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:53.935554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a55ce6c8-992f-4c33-a786-3af9e8087d9d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:53.938986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a55ce6c8-992f-4c33-a786-3af9e8087d9d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:53.940651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a55ce6c8-992f-4c33-a786-3af9e8087d9d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:54.335339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a55ce6c8-992f-4c33-a786-3af9e8087d9d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:54.354885 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a55ce6c8-992f-4c33-a786-3af9e8087d9d tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1500 microversion: 2.1 time: 0.499582 Aug 25 13:40:54.355960 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2720/5494] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:53 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1500 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:54.406163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-19d46af9-2e2d-4fd5-a63d-aaae93850d41 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:54.406163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-19d46af9-2e2d-4fd5-a63d-aaae93850d41 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:54.417734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19d46af9-2e2d-4fd5-a63d-aaae93850d41 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:54.418686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19d46af9-2e2d-4fd5-a63d-aaae93850d41 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:54.419797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19d46af9-2e2d-4fd5-a63d-aaae93850d41 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:54.421495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19d46af9-2e2d-4fd5-a63d-aaae93850d41 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:54.422742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19d46af9-2e2d-4fd5-a63d-aaae93850d41 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:54.424031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19d46af9-2e2d-4fd5-a63d-aaae93850d41 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:54.499438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-19d46af9-2e2d-4fd5-a63d-aaae93850d41 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:40:54.721076 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-19d46af9-2e2d-4fd5-a63d-aaae93850d41 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "DELETE /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 204 len: 0 microversion: 2.1 time: 0.327763 Aug 25 13:40:54.723417 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2775/5495] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:40:54 2022] DELETE /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:40:54.740973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0dc34e1d-8424-4ac3-903c-7a987c478f12 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:54.743045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0dc34e1d-8424-4ac3-903c-7a987c478f12 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:54.762201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dc34e1d-8424-4ac3-903c-7a987c478f12 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:54.763335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dc34e1d-8424-4ac3-903c-7a987c478f12 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:54.764365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dc34e1d-8424-4ac3-903c-7a987c478f12 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:54.765975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dc34e1d-8424-4ac3-903c-7a987c478f12 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:54.767046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dc34e1d-8424-4ac3-903c-7a987c478f12 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:54.768050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dc34e1d-8424-4ac3-903c-7a987c478f12 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:55.062128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0dc34e1d-8424-4ac3-903c-7a987c478f12 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:55.079732 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0dc34e1d-8424-4ac3-903c-7a987c478f12 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1506 microversion: 2.1 time: 0.348085 Aug 25 13:40:55.080776 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2721/5496] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:54 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:56.124468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7118ec3d-fa86-4a87-94cb-1ffdf6db368f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:56.126392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7118ec3d-fa86-4a87-94cb-1ffdf6db368f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:56.135914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7118ec3d-fa86-4a87-94cb-1ffdf6db368f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:56.136828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7118ec3d-fa86-4a87-94cb-1ffdf6db368f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:56.137978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7118ec3d-fa86-4a87-94cb-1ffdf6db368f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:56.139321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7118ec3d-fa86-4a87-94cb-1ffdf6db368f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:56.140092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7118ec3d-fa86-4a87-94cb-1ffdf6db368f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:56.140649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7118ec3d-fa86-4a87-94cb-1ffdf6db368f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:56.578734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7118ec3d-fa86-4a87-94cb-1ffdf6db368f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:56.606121 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7118ec3d-fa86-4a87-94cb-1ffdf6db368f tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1506 microversion: 2.1 time: 0.489023 Aug 25 13:40:56.613255 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2776/5497] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:56 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:40:57.658452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e5483a25-822e-4906-9ed9-5a59e4553823 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:57.665048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e5483a25-822e-4906-9ed9-5a59e4553823 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:57.682591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5483a25-822e-4906-9ed9-5a59e4553823 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:57.684130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5483a25-822e-4906-9ed9-5a59e4553823 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:57.685708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5483a25-822e-4906-9ed9-5a59e4553823 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:57.687250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5483a25-822e-4906-9ed9-5a59e4553823 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:57.688214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5483a25-822e-4906-9ed9-5a59e4553823 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:57.689351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5483a25-822e-4906-9ed9-5a59e4553823 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:58.011298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e5483a25-822e-4906-9ed9-5a59e4553823 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c9da07e4840a999bef4336a033752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acde8f8838d4e709fd03a882bb50b74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:58.030472 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e5483a25-822e-4906-9ed9-5a59e4553823 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 200 len: 1506 microversion: 2.1 time: 0.382760 Aug 25 13:40:58.031537 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2722/5498] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:57 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:58.150565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-fb163c1b-7eca-44a8-ae4d-d9f6d16237a8 req-b7da3832-717d-49ef-8adb-540420ccb3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "054ad142-ad08-4820-b2be-b278916e2662", "name": "network-vif-deleted", "tag": "19db6dbf-b41f-4936-a6e4-2c0e96eac874"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:58.183845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fb163c1b-7eca-44a8-ae4d-d9f6d16237a8 req-b7da3832-717d-49ef-8adb-540420ccb3c6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:58.185385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fb163c1b-7eca-44a8-ae4d-d9f6d16237a8 req-b7da3832-717d-49ef-8adb-540420ccb3c6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:58.187176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fb163c1b-7eca-44a8-ae4d-d9f6d16237a8 req-b7da3832-717d-49ef-8adb-540420ccb3c6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:58.220682 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-fb163c1b-7eca-44a8-ae4d-d9f6d16237a8 req-b7da3832-717d-49ef-8adb-540420ccb3c6 service nova] Creating event network-vif-deleted:19db6dbf-b41f-4936-a6e4-2c0e96eac874 for instance 054ad142-ad08-4820-b2be-b278916e2662 on n-h1-852771-8 Aug 25 13:40:58.233286 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-fb163c1b-7eca-44a8-ae4d-d9f6d16237a8 req-b7da3832-717d-49ef-8adb-540420ccb3c6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105134 Aug 25 13:40:58.235242 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2777/5499] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:40:59.080166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:59.081710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] [instance: 054ad142-ad08-4820-b2be-b278916e2662] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:59.098136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:59.098970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:59.100149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:59.104940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:59.106142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:59.107404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:59.141452 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] HTTP exception thrown: Instance 054ad142-ad08-4820-b2be-b278916e2662 could not be found. Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Request method failure captured: Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 HTTP/1.1 Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3u2xpTJfJRn9unjcmeCzgDRsKX7XtCUKFyx1iU_93pm5L7bfCYLcCAAR9reRTvGFYW0uEvjpUx7vh8IT2u1Vjn-ii5FEgRPcvTurtw74jVhxsOxLLjUdpw7760eVHk2L32qj_wSnGZ-TPQaPzXkt8h18sBtWJCnf4qlNxrwjy-BT-M Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 9acde8f8838d4e709fd03a882bb50b74 Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestServerAdvancedOps-1587750518 Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9acde8f8838d4e709fd03a882bb50b74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9acde8f8838d4e709fd03a882bb50b74", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9acde8f8838d4e709fd03a882bb50b74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9acde8f8838d4e709fd03a882bb50b74"}]}] Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestServerAdvancedOps-1587750518 Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 9acde8f8838d4e709fd03a882bb50b74 Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestServerAdvancedOps-1587750518 Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestServerAdvancedOps-1587750518-project Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 040c9da07e4840a999bef4336a033752 Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestServerAdvancedOps-1587750518-project Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 054ad142-ad08-4820-b2be-b278916e2662 could not be found. Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '054ad142-ad08-4820-b2be-b278916e2662'} Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 054ad142-ad08-4820-b2be-b278916e2662 could not be found. Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 054ad142-ad08-4820-b2be-b278916e2662 could not be found. Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:40:59.146478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:40:59.158783 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:40:59.158783 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:40:59.158783 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:40:59.158783 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:40:59.158783 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:40:59.158783 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 054ad142-ad08-4820-b2be-b278916e2662 could not be found. Aug 25 13:40:59.158783 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:40:59.161062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] Returning 404 to user: Instance 054ad142-ad08-4820-b2be-b278916e2662 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:40:59.162637 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3c092b42-fd52-4bf8-8930-cf6ba544bcb4 tempest-TestServerAdvancedOps-1587750518 tempest-TestServerAdvancedOps-1587750518-project] 10.222.0.70 "GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662" status: 404 len: 111 microversion: 2.1 time: 0.100521 Aug 25 13:40:59.167192 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2723/5500] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:59 2022] GET /compute/v2.1/servers/054ad142-ad08-4820-b2be-b278916e2662 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:41:03.008101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d88c47e0-688f-4ccb-87d6-8999fbcf968d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:03.010518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d88c47e0-688f-4ccb-87d6-8999fbcf968d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:03.030897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88c47e0-688f-4ccb-87d6-8999fbcf968d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:03.032963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88c47e0-688f-4ccb-87d6-8999fbcf968d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:03.034424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88c47e0-688f-4ccb-87d6-8999fbcf968d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:03.036956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88c47e0-688f-4ccb-87d6-8999fbcf968d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:03.038633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88c47e0-688f-4ccb-87d6-8999fbcf968d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:03.040123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88c47e0-688f-4ccb-87d6-8999fbcf968d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:03.106482 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d88c47e0-688f-4ccb-87d6-8999fbcf968d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/ips" status: 200 len: 151 microversion: 2.1 time: 0.107491 Aug 25 13:41:03.110825 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2778/5501] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:41:02 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/ips => generated 151 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:07.625889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2150a857-95ae-484b-8e8d-11b1630117d9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef80fb01-27f9-44dc-b487-bd9a0a9df83a"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:07.644804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2150a857-95ae-484b-8e8d-11b1630117d9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:07.669323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2150a857-95ae-484b-8e8d-11b1630117d9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:07.671115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2150a857-95ae-484b-8e8d-11b1630117d9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:07.674818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2150a857-95ae-484b-8e8d-11b1630117d9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:07.676662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2150a857-95ae-484b-8e8d-11b1630117d9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:07.679078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2150a857-95ae-484b-8e8d-11b1630117d9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:07.681232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2150a857-95ae-484b-8e8d-11b1630117d9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:08.575620 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2150a857-95ae-484b-8e8d-11b1630117d9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.971533 Aug 25 13:41:08.578958 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2724/5502] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:41:07 2022] POST /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 194 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:31.149402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef80fb01-27f9-44dc-b487-bd9a0a9df83a"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:31.176392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:31.199075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:31.207100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:31.234543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:31.235522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:31.236346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:31.237764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:31.249676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:31.251431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:31.482613 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Invalid volume: volume ef80fb01-27f9-44dc-b487-bd9a0a9df83a is already attached to instances: 3ad98a18-8328-4972-a028-5e75187fb027 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments HTTP/1.1 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 74 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: {"volumeAttachment": {"volumeId": "ef80fb01-27f9-44dc-b487-bd9a0a9df83a"}} Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid volume: volume ef80fb01-27f9-44dc-b487-bd9a0a9df83a is already attached to instances: 3ad98a18-8328-4972-a028-5e75187fb027 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': '3ad98a18-8328-4972-a028-5e75187fb027', 'body': {'volumeAttachment': {'volumeId': 'ef80fb01-27f9-44dc-b487-bd9a0a9df83a'}}} Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ef80fb01-27f9-44dc-b487-bd9a0a9df83a is already attached to instances: 3ad98a18-8328-4972-a028-5e75187fb027 Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:41:31.486654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ef80fb01-27f9-44dc-b487-bd9a0a9df83a is already attached to instances: 3ad98a18-8328-4972-a028-5e75187fb027 Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ef80fb01-27f9-44dc-b487-bd9a0a9df83a is already attached to instances: 3ad98a18-8328-4972-a028-5e75187fb027 Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 400 to user: Invalid volume: volume ef80fb01-27f9-44dc-b487-bd9a0a9df83a is already attached to instances: 3ad98a18-8328-4972-a028-5e75187fb027 {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42843496-656b-4919-9426-7bcd451c57a5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.363459 Aug 25 13:41:31.504839 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2779/5503] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:41:31 2022] POST /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 174 bytes in 369 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:41:31.797762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7f018b08-c7ec-4ac8-b027-731f8834ccb4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:31.798833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7f018b08-c7ec-4ac8-b027-731f8834ccb4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:31.832651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=19 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:31.841691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:31.871235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f018b08-c7ec-4ac8-b027-731f8834ccb4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:31.871966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f018b08-c7ec-4ac8-b027-731f8834ccb4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:31.872719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f018b08-c7ec-4ac8-b027-731f8834ccb4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:31.874755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f018b08-c7ec-4ac8-b027-731f8834ccb4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:31.878885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f018b08-c7ec-4ac8-b027-731f8834ccb4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:31.884402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7f018b08-c7ec-4ac8-b027-731f8834ccb4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:32.363781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-7f018b08-c7ec-4ac8-b027-731f8834ccb4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lazy-loading 'services' on Instance uuid 3ad98a18-8328-4972-a028-5e75187fb027 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:41:32.870354 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7f018b08-c7ec-4ac8-b027-731f8834ccb4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments/ef80fb01-27f9-44dc-b487-bd9a0a9df83a" status: 202 len: 0 microversion: 2.1 time: 1.076749 Aug 25 13:41:32.882491 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2725/5504] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:41:31 2022] DELETE /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments/ef80fb01-27f9-44dc-b487-bd9a0a9df83a => generated 0 bytes in 1095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:41:32.893167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e8a2d907-4faf-44ee-befd-bb55bc892ae2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:32.909342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e8a2d907-4faf-44ee-befd-bb55bc892ae2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:32.994535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8a2d907-4faf-44ee-befd-bb55bc892ae2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:32.995814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8a2d907-4faf-44ee-befd-bb55bc892ae2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:32.996735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8a2d907-4faf-44ee-befd-bb55bc892ae2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:33.002392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8a2d907-4faf-44ee-befd-bb55bc892ae2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:33.003571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8a2d907-4faf-44ee-befd-bb55bc892ae2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:33.013003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e8a2d907-4faf-44ee-befd-bb55bc892ae2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:33.152662 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e8a2d907-4faf-44ee-befd-bb55bc892ae2 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.260890 Aug 25 13:41:33.154074 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2780/5505] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:32 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:34.200403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27c5c32d-5c27-4045-82b6-8684f8546f0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:34.211552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-27c5c32d-5c27-4045-82b6-8684f8546f0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:34.274372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27c5c32d-5c27-4045-82b6-8684f8546f0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:34.276568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27c5c32d-5c27-4045-82b6-8684f8546f0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:34.277817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27c5c32d-5c27-4045-82b6-8684f8546f0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:34.279554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27c5c32d-5c27-4045-82b6-8684f8546f0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:34.280798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27c5c32d-5c27-4045-82b6-8684f8546f0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:34.281946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27c5c32d-5c27-4045-82b6-8684f8546f0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:34.396924 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-27c5c32d-5c27-4045-82b6-8684f8546f0d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216311 Aug 25 13:41:34.416118 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2726/5506] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:34 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:35.427479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-51342e27-e3fc-488d-a591-2ec4d27ebc9d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:35.432310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-51342e27-e3fc-488d-a591-2ec4d27ebc9d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:35.478414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51342e27-e3fc-488d-a591-2ec4d27ebc9d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:35.479872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51342e27-e3fc-488d-a591-2ec4d27ebc9d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:35.486472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51342e27-e3fc-488d-a591-2ec4d27ebc9d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:35.494897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51342e27-e3fc-488d-a591-2ec4d27ebc9d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:35.496075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51342e27-e3fc-488d-a591-2ec4d27ebc9d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:35.497142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51342e27-e3fc-488d-a591-2ec4d27ebc9d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:35.627679 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-51342e27-e3fc-488d-a591-2ec4d27ebc9d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207654 Aug 25 13:41:35.633610 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2781/5507] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:35 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:36.655602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3bdad910-099c-47af-98de-36529ea20a3f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:36.667012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3bdad910-099c-47af-98de-36529ea20a3f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:36.747970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3bdad910-099c-47af-98de-36529ea20a3f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:36.757618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3bdad910-099c-47af-98de-36529ea20a3f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:36.759113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3bdad910-099c-47af-98de-36529ea20a3f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:36.763405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3bdad910-099c-47af-98de-36529ea20a3f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:36.765300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3bdad910-099c-47af-98de-36529ea20a3f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:36.774115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3bdad910-099c-47af-98de-36529ea20a3f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:36.918201 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3bdad910-099c-47af-98de-36529ea20a3f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.272754 Aug 25 13:41:36.920090 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2727/5508] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:36 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:37.945496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-974faaac-fd05-45a1-8e15-d29fbaea56e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:37.957294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-974faaac-fd05-45a1-8e15-d29fbaea56e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:37.987716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-974faaac-fd05-45a1-8e15-d29fbaea56e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:37.988715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-974faaac-fd05-45a1-8e15-d29fbaea56e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:37.989412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-974faaac-fd05-45a1-8e15-d29fbaea56e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:37.991711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-974faaac-fd05-45a1-8e15-d29fbaea56e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:37.992568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-974faaac-fd05-45a1-8e15-d29fbaea56e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:37.993360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-974faaac-fd05-45a1-8e15-d29fbaea56e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:38.125351 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-974faaac-fd05-45a1-8e15-d29fbaea56e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192997 Aug 25 13:41:38.127548 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2782/5509] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:37 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:39.156697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a98ed2c-5295-4935-98f3-f982c514b6df tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:39.166383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a98ed2c-5295-4935-98f3-f982c514b6df tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:39.207718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a98ed2c-5295-4935-98f3-f982c514b6df tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:39.209213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a98ed2c-5295-4935-98f3-f982c514b6df tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:39.213713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a98ed2c-5295-4935-98f3-f982c514b6df tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:39.216536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a98ed2c-5295-4935-98f3-f982c514b6df tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:39.223817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a98ed2c-5295-4935-98f3-f982c514b6df tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:39.226170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a98ed2c-5295-4935-98f3-f982c514b6df tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:39.412323 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a98ed2c-5295-4935-98f3-f982c514b6df tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.260435 Aug 25 13:41:39.423266 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2728/5510] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:39 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:40.439831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fa00ab96-79b7-4652-a398-cf95440b5559 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:40.466714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fa00ab96-79b7-4652-a398-cf95440b5559 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:40.483460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa00ab96-79b7-4652-a398-cf95440b5559 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:40.484253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa00ab96-79b7-4652-a398-cf95440b5559 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:40.484950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa00ab96-79b7-4652-a398-cf95440b5559 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:40.498880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa00ab96-79b7-4652-a398-cf95440b5559 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:40.499480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa00ab96-79b7-4652-a398-cf95440b5559 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:40.500108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa00ab96-79b7-4652-a398-cf95440b5559 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:40.593763 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fa00ab96-79b7-4652-a398-cf95440b5559 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162177 Aug 25 13:41:40.596608 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2783/5511] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:40 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:41.626169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9b728fd0-3cbc-4af5-ac15-30726b5b594f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:41.638463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9b728fd0-3cbc-4af5-ac15-30726b5b594f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:41.659803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b728fd0-3cbc-4af5-ac15-30726b5b594f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:41.670090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b728fd0-3cbc-4af5-ac15-30726b5b594f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:41.678412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b728fd0-3cbc-4af5-ac15-30726b5b594f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:41.679344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b728fd0-3cbc-4af5-ac15-30726b5b594f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:41.679980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b728fd0-3cbc-4af5-ac15-30726b5b594f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:41.680498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b728fd0-3cbc-4af5-ac15-30726b5b594f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:41.841245 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9b728fd0-3cbc-4af5-ac15-30726b5b594f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231447 Aug 25 13:41:41.845764 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2729/5512] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:41 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:42.865207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93e03f88-123d-4097-aa42-1ade1defdd9a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:42.869429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-93e03f88-123d-4097-aa42-1ade1defdd9a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:42.914211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93e03f88-123d-4097-aa42-1ade1defdd9a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:42.914938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93e03f88-123d-4097-aa42-1ade1defdd9a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:42.915501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93e03f88-123d-4097-aa42-1ade1defdd9a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:42.916275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93e03f88-123d-4097-aa42-1ade1defdd9a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:42.916753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93e03f88-123d-4097-aa42-1ade1defdd9a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:42.917188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93e03f88-123d-4097-aa42-1ade1defdd9a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:43.040341 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-93e03f88-123d-4097-aa42-1ade1defdd9a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182477 Aug 25 13:41:43.057960 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2784/5513] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:42 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:43.566538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8b8cb8b3-ccf2-4c41-9f9a-ca66e4e5ca94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:43.572559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b8cb8b3-ccf2-4c41-9f9a-ca66e4e5ca94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:43.578254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b8cb8b3-ccf2-4c41-9f9a-ca66e4e5ca94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:43.583517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b8cb8b3-ccf2-4c41-9f9a-ca66e4e5ca94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:43.585753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b8cb8b3-ccf2-4c41-9f9a-ca66e4e5ca94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:43.592445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b8cb8b3-ccf2-4c41-9f9a-ca66e4e5ca94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:43.593801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b8cb8b3-ccf2-4c41-9f9a-ca66e4e5ca94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:43.716760 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8b8cb8b3-ccf2-4c41-9f9a-ca66e4e5ca94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.611985 Aug 25 13:41:43.718159 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2730/5514] 10.222.0.70 () {58 vars in 1185 bytes} [Thu Aug 25 13:41:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:44.068140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c0e634f7-2c27-4fc3-9721-5df0c8bd0c21 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:44.073382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c0e634f7-2c27-4fc3-9721-5df0c8bd0c21 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:44.088964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0e634f7-2c27-4fc3-9721-5df0c8bd0c21 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:44.089601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0e634f7-2c27-4fc3-9721-5df0c8bd0c21 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:44.090117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0e634f7-2c27-4fc3-9721-5df0c8bd0c21 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:44.090876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0e634f7-2c27-4fc3-9721-5df0c8bd0c21 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:44.091672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0e634f7-2c27-4fc3-9721-5df0c8bd0c21 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:44.092214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0e634f7-2c27-4fc3-9721-5df0c8bd0c21 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:44.214168 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c0e634f7-2c27-4fc3-9721-5df0c8bd0c21 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162851 Aug 25 13:41:44.215691 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2785/5515] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:44 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:44.220787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-478807498", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "availability_zone": "nova:n-h1-852771-8", "networks": [{"uuid": "1fafb782-b6cb-4364-8622-c36d2909ff6c"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:45.243039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-41bfd336-af11-48f3-9327-4a1451dcce56 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:45.297846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-41bfd336-af11-48f3-9327-4a1451dcce56 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:45.337732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41bfd336-af11-48f3-9327-4a1451dcce56 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:45.339177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41bfd336-af11-48f3-9327-4a1451dcce56 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:45.345762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41bfd336-af11-48f3-9327-4a1451dcce56 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:45.352061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41bfd336-af11-48f3-9327-4a1451dcce56 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:45.353479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41bfd336-af11-48f3-9327-4a1451dcce56 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:45.354648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41bfd336-af11-48f3-9327-4a1451dcce56 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:45.360199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] validate_networks() for [('1fafb782-b6cb-4364-8622-c36d2909ff6c', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:41:45.492127 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-41bfd336-af11-48f3-9327-4a1451dcce56 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.265841 Aug 25 13:41:45.494240 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2786/5516] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:45 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:41:46.566027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1da29f22-19c5-43e3-b02f-b06e82ff92c5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:46.577883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1da29f22-19c5-43e3-b02f-b06e82ff92c5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:46.600952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1da29f22-19c5-43e3-b02f-b06e82ff92c5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:46.601434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1da29f22-19c5-43e3-b02f-b06e82ff92c5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:46.606556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1da29f22-19c5-43e3-b02f-b06e82ff92c5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:46.607826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1da29f22-19c5-43e3-b02f-b06e82ff92c5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:46.608726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1da29f22-19c5-43e3-b02f-b06e82ff92c5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:46.612565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1da29f22-19c5-43e3-b02f-b06e82ff92c5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:46.781006 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1da29f22-19c5-43e3-b02f-b06e82ff92c5 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.253161 Aug 25 13:41:46.800646 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2787/5517] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:46 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:47.042593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:41:47.043343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:41:47.044088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:41:47.045035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:41:47.046288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:41:47.104206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:47.107728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:47.109876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:47.126265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:47.133948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:47.140652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:47.242622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Getting quotas for project 813bd6cce011401696cdd0f722a152e1. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:41:47.279652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Getting quotas for user 94f8524ea47f4d2093d7195774b26487 and project 813bd6cce011401696cdd0f722a152e1. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:41:47.316592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:41:47.323265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:41:47.467760 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d3a4549-c6b2-46df-8675-cf5eb32194de tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.252894 Aug 25 13:41:47.471315 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2731/5518] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:41:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:41:47.489413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-15a8455d-d59c-464e-ae31-43c18786e2c5 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:47.497324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-15a8455d-d59c-464e-ae31-43c18786e2c5 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:47.825243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ebb72b0b-0341-4d25-b1a7-540025a3b603 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:47.829935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ebb72b0b-0341-4d25-b1a7-540025a3b603 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:47.836169 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-15a8455d-d59c-464e-ae31-43c18786e2c5 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1328 microversion: 2.1 time: 0.354214 Aug 25 13:41:47.848371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebb72b0b-0341-4d25-b1a7-540025a3b603 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:47.852104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebb72b0b-0341-4d25-b1a7-540025a3b603 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:47.853115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebb72b0b-0341-4d25-b1a7-540025a3b603 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:47.854662 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2788/5519] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:47 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1328 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:47.855727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebb72b0b-0341-4d25-b1a7-540025a3b603 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:47.856677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebb72b0b-0341-4d25-b1a7-540025a3b603 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:47.857702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebb72b0b-0341-4d25-b1a7-540025a3b603 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:47.954308 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ebb72b0b-0341-4d25-b1a7-540025a3b603 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139076 Aug 25 13:41:47.956208 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2732/5520] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:47 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:48.888243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dcf7cc70-652b-4c51-9d53-ff01f68a52f2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:48.889165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dcf7cc70-652b-4c51-9d53-ff01f68a52f2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:48.977274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0cd79f48-f7ac-4c12-b1a4-5ca9bcbf2804 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:49.011244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0cd79f48-f7ac-4c12-b1a4-5ca9bcbf2804 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:49.033045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd79f48-f7ac-4c12-b1a4-5ca9bcbf2804 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:49.051115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd79f48-f7ac-4c12-b1a4-5ca9bcbf2804 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:49.052625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd79f48-f7ac-4c12-b1a4-5ca9bcbf2804 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:49.054906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd79f48-f7ac-4c12-b1a4-5ca9bcbf2804 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:49.057139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd79f48-f7ac-4c12-b1a4-5ca9bcbf2804 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:49.058949 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dcf7cc70-652b-4c51-9d53-ff01f68a52f2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1328 microversion: 2.1 time: 0.178912 Aug 25 13:41:49.059965 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2789/5521] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:48 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1328 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:49.060177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd79f48-f7ac-4c12-b1a4-5ca9bcbf2804 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:49.246399 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0cd79f48-f7ac-4c12-b1a4-5ca9bcbf2804 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.277399 Aug 25 13:41:49.250399 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2733/5522] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:41:48 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027/os-volume_attachments => generated 25 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:41:49.519342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fedbe792-bdc9-41e2-98a9-db2f062005dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:49.521209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fedbe792-bdc9-41e2-98a9-db2f062005dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:49.534038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fedbe792-bdc9-41e2-98a9-db2f062005dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:49.535385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fedbe792-bdc9-41e2-98a9-db2f062005dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:49.536596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fedbe792-bdc9-41e2-98a9-db2f062005dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:49.538582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fedbe792-bdc9-41e2-98a9-db2f062005dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:49.539902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fedbe792-bdc9-41e2-98a9-db2f062005dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:49.541074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fedbe792-bdc9-41e2-98a9-db2f062005dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:49.612236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fedbe792-bdc9-41e2-98a9-db2f062005dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:41:49.815793 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fedbe792-bdc9-41e2-98a9-db2f062005dd tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 204 len: 0 microversion: 2.1 time: 0.302380 Aug 25 13:41:49.819743 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2790/5523] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:41:49 2022] DELETE /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:41:49.836904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a041d0b-aa1b-4ac2-b7ca-b7a2d6055ba8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:49.839797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a041d0b-aa1b-4ac2-b7ca-b7a2d6055ba8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:49.858495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a041d0b-aa1b-4ac2-b7ca-b7a2d6055ba8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:49.861852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a041d0b-aa1b-4ac2-b7ca-b7a2d6055ba8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:49.862891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a041d0b-aa1b-4ac2-b7ca-b7a2d6055ba8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:49.864600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a041d0b-aa1b-4ac2-b7ca-b7a2d6055ba8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:49.865656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a041d0b-aa1b-4ac2-b7ca-b7a2d6055ba8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:49.866751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a041d0b-aa1b-4ac2-b7ca-b7a2d6055ba8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:50.102908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5a046a20-7157-4616-a82c-bf381753c6e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:50.104485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5a046a20-7157-4616-a82c-bf381753c6e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:50.141872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a046a20-7157-4616-a82c-bf381753c6e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:50.143333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a046a20-7157-4616-a82c-bf381753c6e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:50.144499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a046a20-7157-4616-a82c-bf381753c6e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:50.146295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a046a20-7157-4616-a82c-bf381753c6e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:50.147982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a046a20-7157-4616-a82c-bf381753c6e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:50.148430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5a046a20-7157-4616-a82c-bf381753c6e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:50.154371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5a041d0b-aa1b-4ac2-b7ca-b7a2d6055ba8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:50.176068 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a041d0b-aa1b-4ac2-b7ca-b7a2d6055ba8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1683 microversion: 2.1 time: 0.349546 Aug 25 13:41:50.179270 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2734/5524] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:49 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1683 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:50.296969 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5a046a20-7157-4616-a82c-bf381753c6e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1345 microversion: 2.1 time: 0.202261 Aug 25 13:41:50.299899 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2791/5525] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:50 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1345 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:41:51.222441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-295e2e39-e632-40bc-8e2a-12c2a24b7e05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:51.229676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-295e2e39-e632-40bc-8e2a-12c2a24b7e05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:51.275316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-295e2e39-e632-40bc-8e2a-12c2a24b7e05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:51.284036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-295e2e39-e632-40bc-8e2a-12c2a24b7e05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:51.284843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-295e2e39-e632-40bc-8e2a-12c2a24b7e05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:51.294485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-295e2e39-e632-40bc-8e2a-12c2a24b7e05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:51.295513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-295e2e39-e632-40bc-8e2a-12c2a24b7e05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:51.296338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-295e2e39-e632-40bc-8e2a-12c2a24b7e05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:51.357040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8b7daa2e-b362-451b-ba6e-ddb43b92e53e tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:51.359540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8b7daa2e-b362-451b-ba6e-ddb43b92e53e tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:51.429531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b7daa2e-b362-451b-ba6e-ddb43b92e53e tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:51.430885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b7daa2e-b362-451b-ba6e-ddb43b92e53e tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:51.432193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b7daa2e-b362-451b-ba6e-ddb43b92e53e tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:51.433815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b7daa2e-b362-451b-ba6e-ddb43b92e53e tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:51.434996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b7daa2e-b362-451b-ba6e-ddb43b92e53e tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:51.436355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8b7daa2e-b362-451b-ba6e-ddb43b92e53e tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:51.863905 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8b7daa2e-b362-451b-ba6e-ddb43b92e53e tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1337 microversion: 2.1 time: 0.531347 Aug 25 13:41:51.876994 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2792/5526] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:51 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1337 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:52.147352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-295e2e39-e632-40bc-8e2a-12c2a24b7e05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:52.184822 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-295e2e39-e632-40bc-8e2a-12c2a24b7e05 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1683 microversion: 2.1 time: 0.971737 Aug 25 13:41:52.196264 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2735/5527] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:51 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1683 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:52.901182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22601bad-0e7a-4ef3-be28-1305dc2b0e0f tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:52.903149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-22601bad-0e7a-4ef3-be28-1305dc2b0e0f tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:52.932951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22601bad-0e7a-4ef3-be28-1305dc2b0e0f tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:52.939265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22601bad-0e7a-4ef3-be28-1305dc2b0e0f tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:52.940760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22601bad-0e7a-4ef3-be28-1305dc2b0e0f tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:52.950608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22601bad-0e7a-4ef3-be28-1305dc2b0e0f tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:52.951818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22601bad-0e7a-4ef3-be28-1305dc2b0e0f tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:52.952780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22601bad-0e7a-4ef3-be28-1305dc2b0e0f tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:53.262869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4863ddb7-3ed1-4a13-a0b9-02f2a58d52c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:53.268836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4863ddb7-3ed1-4a13-a0b9-02f2a58d52c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:53.313644 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22601bad-0e7a-4ef3-be28-1305dc2b0e0f tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1421 microversion: 2.1 time: 0.403115 Aug 25 13:41:53.320067 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2793/5528] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:52 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1421 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:53.329821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4863ddb7-3ed1-4a13-a0b9-02f2a58d52c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:53.329821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4863ddb7-3ed1-4a13-a0b9-02f2a58d52c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:53.329821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4863ddb7-3ed1-4a13-a0b9-02f2a58d52c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:53.333189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4863ddb7-3ed1-4a13-a0b9-02f2a58d52c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:53.336991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4863ddb7-3ed1-4a13-a0b9-02f2a58d52c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:53.338560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4863ddb7-3ed1-4a13-a0b9-02f2a58d52c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:53.767904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4863ddb7-3ed1-4a13-a0b9-02f2a58d52c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:53.784718 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4863ddb7-3ed1-4a13-a0b9-02f2a58d52c1 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1683 microversion: 2.1 time: 0.538604 Aug 25 13:41:53.786693 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2736/5529] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:53 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1683 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:41:54.369371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d1adda1-3fe7-462a-a22a-c5d6701639e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:54.370394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5d1adda1-3fe7-462a-a22a-c5d6701639e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:54.407912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d1adda1-3fe7-462a-a22a-c5d6701639e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:54.408941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d1adda1-3fe7-462a-a22a-c5d6701639e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:54.409876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d1adda1-3fe7-462a-a22a-c5d6701639e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:54.411781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d1adda1-3fe7-462a-a22a-c5d6701639e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:54.414400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d1adda1-3fe7-462a-a22a-c5d6701639e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:54.415779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d1adda1-3fe7-462a-a22a-c5d6701639e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:54.692560 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5d1adda1-3fe7-462a-a22a-c5d6701639e0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1421 microversion: 2.1 time: 0.329746 Aug 25 13:41:54.695093 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2794/5530] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:54 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1421 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:41:54.827811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6bd443b0-df1d-4896-ba7e-785a07bd9598 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:54.829347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6bd443b0-df1d-4896-ba7e-785a07bd9598 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:54.848071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd443b0-df1d-4896-ba7e-785a07bd9598 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:54.849442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd443b0-df1d-4896-ba7e-785a07bd9598 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:54.851310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd443b0-df1d-4896-ba7e-785a07bd9598 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:54.853395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd443b0-df1d-4896-ba7e-785a07bd9598 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:54.856150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd443b0-df1d-4896-ba7e-785a07bd9598 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:54.857398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bd443b0-df1d-4896-ba7e-785a07bd9598 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:55.083834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6bd443b0-df1d-4896-ba7e-785a07bd9598 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:55.134184 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6bd443b0-df1d-4896-ba7e-785a07bd9598 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1615 microversion: 2.1 time: 0.305206 Aug 25 13:41:55.142805 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2737/5531] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:54 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1615 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:55.721816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d4ac31c0-441f-402c-9abf-5bdd35e7d0fd tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:55.722452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d4ac31c0-441f-402c-9abf-5bdd35e7d0fd tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:55.741545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4ac31c0-441f-402c-9abf-5bdd35e7d0fd tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:55.743453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4ac31c0-441f-402c-9abf-5bdd35e7d0fd tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:55.744234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4ac31c0-441f-402c-9abf-5bdd35e7d0fd tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:55.745557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4ac31c0-441f-402c-9abf-5bdd35e7d0fd tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:55.746402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4ac31c0-441f-402c-9abf-5bdd35e7d0fd tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:55.747173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4ac31c0-441f-402c-9abf-5bdd35e7d0fd tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:55.791772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8015b3e7-901a-4f73-bf73-a008ee073f34 req-abee31e1-b7fb-40e4-8ce4-9cfe39b928a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad98a18-8328-4972-a028-5e75187fb027", "name": "network-vif-deleted", "tag": "ef0904db-64f1-49d4-874a-f547eacca178"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:55.872224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8015b3e7-901a-4f73-bf73-a008ee073f34 req-abee31e1-b7fb-40e4-8ce4-9cfe39b928a7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:55.873105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8015b3e7-901a-4f73-bf73-a008ee073f34 req-abee31e1-b7fb-40e4-8ce4-9cfe39b928a7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:55.878482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8015b3e7-901a-4f73-bf73-a008ee073f34 req-abee31e1-b7fb-40e4-8ce4-9cfe39b928a7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:55.939397 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8015b3e7-901a-4f73-bf73-a008ee073f34 req-abee31e1-b7fb-40e4-8ce4-9cfe39b928a7 service nova] Creating event network-vif-deleted:ef0904db-64f1-49d4-874a-f547eacca178 for instance 3ad98a18-8328-4972-a028-5e75187fb027 on n-h2-852771-8 Aug 25 13:41:55.968102 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8015b3e7-901a-4f73-bf73-a008ee073f34 req-abee31e1-b7fb-40e4-8ce4-9cfe39b928a7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182992 Aug 25 13:41:55.972138 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2738/5532] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:41:56.190677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:56.192769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:56.234244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:56.237588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:56.239809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:56.245782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:56.247177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:56.249381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:56.313795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:56.341543 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d4ac31c0-441f-402c-9abf-5bdd35e7d0fd tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1463 microversion: 2.1 time: 0.618470 Aug 25 13:41:56.347978 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2795/5533] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:55 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1463 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:56.387565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:56.388654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:56.389427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:56.390474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lazy-loading 'fault' on Instance uuid 3ad98a18-8328-4972-a028-5e75187fb027 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:41:56.605457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:56.631983 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f95847e4-68af-42a0-a6c2-deaf88f8eea7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 200 len: 1331 microversion: 2.1 time: 0.454726 Aug 25 13:41:56.638885 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2739/5534] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:56 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 1331 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:57.409114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eaa5956b-124b-406f-819a-db0e336aa645 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:57.410797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eaa5956b-124b-406f-819a-db0e336aa645 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:57.447626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa5956b-124b-406f-819a-db0e336aa645 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:57.448517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa5956b-124b-406f-819a-db0e336aa645 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:57.449781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa5956b-124b-406f-819a-db0e336aa645 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:57.451484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa5956b-124b-406f-819a-db0e336aa645 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:57.454280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa5956b-124b-406f-819a-db0e336aa645 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:57.455406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eaa5956b-124b-406f-819a-db0e336aa645 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:57.723463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:57.724508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:57.758765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:57.760509 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eaa5956b-124b-406f-819a-db0e336aa645 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1463 microversion: 2.1 time: 0.372069 Aug 25 13:41:57.763718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:57.765321 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2796/5535] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:57 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1463 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:57.768707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:57.770795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:57.772647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:57.774113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:57.775223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:57.776116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:57.820879 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 HTTP/1.1 Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '3ad98a18-8328-4972-a028-5e75187fb027'} Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:41:57.824903 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:41:57.836705 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:41:57.836705 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:41:57.836705 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:41:57.836705 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:41:57.836705 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:41:57.836705 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:41:57.836705 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:41:57.836705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:41:57.836705 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-68a7e297-c741-4df1-a1f3-9a010cfd96ef tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 404 len: 111 microversion: 2.1 time: 0.155621 Aug 25 13:41:57.838185 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2740/5536] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:57 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:41:57.849193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9af0b3bb-78ad-4f45-9c7e-ccd205aed10e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '.version_select at 0x7f3a29258280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:57.861699 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9af0b3bb-78ad-4f45-9c7e-ccd205aed10e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:41:58.012341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-aaa1f4fd-80f3-40ab-9c1b-84d697904d63 req-2ec7c065-06f7-4d31-9321-64539d493f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38a7ff60-4f82-4e35-8199-9dfceb821bb7", "tag": "725959f2-38f2-4adb-962f-08ceaddf6ae2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:58.032667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aaa1f4fd-80f3-40ab-9c1b-84d697904d63 req-2ec7c065-06f7-4d31-9321-64539d493f71 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:58.034212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aaa1f4fd-80f3-40ab-9c1b-84d697904d63 req-2ec7c065-06f7-4d31-9321-64539d493f71 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:58.035276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aaa1f4fd-80f3-40ab-9c1b-84d697904d63 req-2ec7c065-06f7-4d31-9321-64539d493f71 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:58.070928 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-aaa1f4fd-80f3-40ab-9c1b-84d697904d63 req-2ec7c065-06f7-4d31-9321-64539d493f71 service nova] Creating event network-changed:725959f2-38f2-4adb-962f-08ceaddf6ae2 for instance 38a7ff60-4f82-4e35-8199-9dfceb821bb7 on n-h1-852771-8 Aug 25 13:41:58.080705 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-aaa1f4fd-80f3-40ab-9c1b-84d697904d63 req-2ec7c065-06f7-4d31-9321-64539d493f71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078766 Aug 25 13:41:58.082770 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2741/5537] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:41:58.816568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-025ad243-fc8c-4015-a3fb-466479263a25 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:58.818305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-025ad243-fc8c-4015-a3fb-466479263a25 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:58.833879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025ad243-fc8c-4015-a3fb-466479263a25 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:58.835382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025ad243-fc8c-4015-a3fb-466479263a25 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:58.836522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025ad243-fc8c-4015-a3fb-466479263a25 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:58.850521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025ad243-fc8c-4015-a3fb-466479263a25 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:58.854248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025ad243-fc8c-4015-a3fb-466479263a25 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:58.854938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-025ad243-fc8c-4015-a3fb-466479263a25 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:58.871989 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [None req-9af0b3bb-78ad-4f45-9c7e-ccd205aed10e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 36944. Aug 25 13:41:58.923042 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9af0b3bb-78ad-4f45-9c7e-ccd205aed10e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552560658" status: 202 len: 0 microversion: 2.1 time: 1.077579 Aug 25 13:41:58.926496 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2797/5538] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 13:41:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552560658 => generated 0 bytes in 1087 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:41:59.265805 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-025ad243-fc8c-4015-a3fb-466479263a25 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1463 microversion: 2.1 time: 0.462589 Aug 25 13:41:59.266718 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2742/5539] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:58 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1463 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:00.304367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:00.333806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ea1199a-0d20-47c6-a244-5aa3d181678d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:00.338120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ea1199a-0d20-47c6-a244-5aa3d181678d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:00.387936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ea1199a-0d20-47c6-a244-5aa3d181678d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:00.387936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ea1199a-0d20-47c6-a244-5aa3d181678d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:00.391845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ea1199a-0d20-47c6-a244-5aa3d181678d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:00.394618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ea1199a-0d20-47c6-a244-5aa3d181678d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:00.398606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ea1199a-0d20-47c6-a244-5aa3d181678d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:00.399704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ea1199a-0d20-47c6-a244-5aa3d181678d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:00.414897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-763b8411-6d10-4def-8eac-0cea875d5979 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: .version_select at 0x7f3a2a4eb430>, body: {"keypair": {"name": "tempest-keypair-876950097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXfNr29ox43bikB0hEYTySIOohD22ZCT06w0lqJrT4izI04snQ89uTtakEzhA7j/cB6K79VjdA2xmzAsnxHMS6phGWcfUsfiYuQjO5L7m8VQHvDfLdx664Thrub0AFuIw=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:00.449065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-763b8411-6d10-4def-8eac-0cea875d5979 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:42:00.463423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-763b8411-6d10-4def-8eac-0cea875d5979 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for user b7fdce9f6d624473be8244e28eb215e0 and project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:42:00.512285 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-763b8411-6d10-4def-8eac-0cea875d5979 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103931 Aug 25 13:42:00.543267 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2743/5540] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:42:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:42:00.744159 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2ea1199a-0d20-47c6-a244-5aa3d181678d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1463 microversion: 2.1 time: 0.442239 Aug 25 13:42:00.787468 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2798/5541] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:00 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1463 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:01.795362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a29749e4-ece9-4002-b59f-3fbd7349c4cc tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:01.797460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a29749e4-ece9-4002-b59f-3fbd7349c4cc tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:01.814472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a29749e4-ece9-4002-b59f-3fbd7349c4cc tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:01.816056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a29749e4-ece9-4002-b59f-3fbd7349c4cc tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:01.817325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a29749e4-ece9-4002-b59f-3fbd7349c4cc tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:01.823480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a29749e4-ece9-4002-b59f-3fbd7349c4cc tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:01.824884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a29749e4-ece9-4002-b59f-3fbd7349c4cc tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:01.826087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a29749e4-ece9-4002-b59f-3fbd7349c4cc tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:02.279162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:02.314657 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a29749e4-ece9-4002-b59f-3fbd7349c4cc tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1463 microversion: 2.1 time: 0.532568 Aug 25 13:42:02.315486 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2744/5542] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:01 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1463 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:03.357007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bd3480e8-f40d-49c1-a33a-5c9342619394 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:03.360952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bd3480e8-f40d-49c1-a33a-5c9342619394 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:03.367572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:03.386454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd3480e8-f40d-49c1-a33a-5c9342619394 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:03.389034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd3480e8-f40d-49c1-a33a-5c9342619394 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:03.390005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd3480e8-f40d-49c1-a33a-5c9342619394 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:03.393901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd3480e8-f40d-49c1-a33a-5c9342619394 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:03.397867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd3480e8-f40d-49c1-a33a-5c9342619394 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:03.399901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd3480e8-f40d-49c1-a33a-5c9342619394 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:03.701571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1705229936", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "229df64b-66b9-4c71-89d1-8ec5cff9e192"}], "security_groups": [{"name": "tempest-securitygroup--778653319"}], "key_name": "tempest-keypair-876950097", "user_data": "}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:03.721940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:03.860010 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bd3480e8-f40d-49c1-a33a-5c9342619394 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1463 microversion: 2.1 time: 0.512896 Aug 25 13:42:03.867160 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2799/5543] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:03 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1463 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:03.964514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] validate_networks() for [('229df64b-66b9-4c71-89d1-8ec5cff9e192', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:42:04.746230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:42:04.747072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:42:04.747840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:42:04.748179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:42:04.748879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:42:04.770119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:04.771442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:04.772767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:04.774439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:04.775342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:04.776054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:04.808761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:42:04.821239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Getting quotas for user b7fdce9f6d624473be8244e28eb215e0 and project 79c97afb76ae4d0ba3e14f8b23a8d1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:42:04.847736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:42:04.853794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:42:04.891703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1b1f4213-0af6-4d28-80fd-2621762c032b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:04.892588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1b1f4213-0af6-4d28-80fd-2621762c032b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:04.904874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1f4213-0af6-4d28-80fd-2621762c032b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:04.905726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1f4213-0af6-4d28-80fd-2621762c032b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:04.906521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1f4213-0af6-4d28-80fd-2621762c032b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:04.907567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1f4213-0af6-4d28-80fd-2621762c032b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:04.908435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1f4213-0af6-4d28-80fd-2621762c032b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:04.909227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b1f4213-0af6-4d28-80fd-2621762c032b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:04.981222 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa173ce9-5cee-4210-8f74-eff31b0f1e87 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.284543 Aug 25 13:42:04.993609 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2745/5544] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:42:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:42:05.004449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-76303c0b-6914-4bb2-89b7-f048a8230ce7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:05.007579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-76303c0b-6914-4bb2-89b7-f048a8230ce7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:05.124132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-76303c0b-6914-4bb2-89b7-f048a8230ce7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:05.148982 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-76303c0b-6914-4bb2-89b7-f048a8230ce7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1241 microversion: 2.1 time: 0.149420 Aug 25 13:42:05.150153 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2746/5545] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:04 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1241 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:05.236598 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1b1f4213-0af6-4d28-80fd-2621762c032b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1463 microversion: 2.1 time: 0.349299 Aug 25 13:42:05.238337 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2800/5546] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:04 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1463 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:05.917707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-97e06319-9220-448d-a8cc-c9f39ab45f5b req-47bd6be7-858c-4eb9-8e1f-77256572dcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38a7ff60-4f82-4e35-8199-9dfceb821bb7", "name": "network-vif-plugged", "status": "completed", "tag": "725959f2-38f2-4adb-962f-08ceaddf6ae2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:05.954232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-97e06319-9220-448d-a8cc-c9f39ab45f5b req-47bd6be7-858c-4eb9-8e1f-77256572dcf1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:05.955409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-97e06319-9220-448d-a8cc-c9f39ab45f5b req-47bd6be7-858c-4eb9-8e1f-77256572dcf1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:05.956411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-97e06319-9220-448d-a8cc-c9f39ab45f5b req-47bd6be7-858c-4eb9-8e1f-77256572dcf1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:05.978991 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-97e06319-9220-448d-a8cc-c9f39ab45f5b req-47bd6be7-858c-4eb9-8e1f-77256572dcf1 service nova] Creating event network-vif-plugged:725959f2-38f2-4adb-962f-08ceaddf6ae2 for instance 38a7ff60-4f82-4e35-8199-9dfceb821bb7 on n-h1-852771-8 Aug 25 13:42:05.992984 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-97e06319-9220-448d-a8cc-c9f39ab45f5b req-47bd6be7-858c-4eb9-8e1f-77256572dcf1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083700 Aug 25 13:42:06.000305 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2747/5547] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:06.190222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9210180f-a510-48b4-b8de-d4247ca35df6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:06.195046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9210180f-a510-48b4-b8de-d4247ca35df6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:06.222812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9210180f-a510-48b4-b8de-d4247ca35df6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:06.235169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9210180f-a510-48b4-b8de-d4247ca35df6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:06.237254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9210180f-a510-48b4-b8de-d4247ca35df6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:06.238651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9210180f-a510-48b4-b8de-d4247ca35df6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:06.239561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9210180f-a510-48b4-b8de-d4247ca35df6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:06.241382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9210180f-a510-48b4-b8de-d4247ca35df6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:06.277750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-35777165-1b05-43e7-8e82-3b426bc73ef3 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:06.278400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-35777165-1b05-43e7-8e82-3b426bc73ef3 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:06.295168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35777165-1b05-43e7-8e82-3b426bc73ef3 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:06.300207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35777165-1b05-43e7-8e82-3b426bc73ef3 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:06.302167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35777165-1b05-43e7-8e82-3b426bc73ef3 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:06.308143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35777165-1b05-43e7-8e82-3b426bc73ef3 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:06.309355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35777165-1b05-43e7-8e82-3b426bc73ef3 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:06.310359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-35777165-1b05-43e7-8e82-3b426bc73ef3 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:06.482586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9210180f-a510-48b4-b8de-d4247ca35df6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:06.495874 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9210180f-a510-48b4-b8de-d4247ca35df6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1237 microversion: 2.1 time: 0.315037 Aug 25 13:42:06.496885 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2801/5548] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:06 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1237 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:06.616277 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-35777165-1b05-43e7-8e82-3b426bc73ef3 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1463 microversion: 2.1 time: 0.342340 Aug 25 13:42:06.617005 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2748/5549] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:06 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1463 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:07.533042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ede8700e-0de7-402f-a731-81896cdac5ce tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:07.536805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ede8700e-0de7-402f-a731-81896cdac5ce tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:07.555133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ede8700e-0de7-402f-a731-81896cdac5ce tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:07.556552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ede8700e-0de7-402f-a731-81896cdac5ce tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:07.557413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ede8700e-0de7-402f-a731-81896cdac5ce tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:07.558830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ede8700e-0de7-402f-a731-81896cdac5ce tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:07.559673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ede8700e-0de7-402f-a731-81896cdac5ce tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:07.560351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ede8700e-0de7-402f-a731-81896cdac5ce tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:07.658785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dfde1552-3228-4626-881c-a94eab26a3b0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:07.659717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dfde1552-3228-4626-881c-a94eab26a3b0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:07.690976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfde1552-3228-4626-881c-a94eab26a3b0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:07.696246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfde1552-3228-4626-881c-a94eab26a3b0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:07.697852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfde1552-3228-4626-881c-a94eab26a3b0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:07.703105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfde1552-3228-4626-881c-a94eab26a3b0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:07.705534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfde1552-3228-4626-881c-a94eab26a3b0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:07.706930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dfde1552-3228-4626-881c-a94eab26a3b0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:07.892563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ede8700e-0de7-402f-a731-81896cdac5ce tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:07.922950 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ede8700e-0de7-402f-a731-81896cdac5ce tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1299 microversion: 2.1 time: 0.396662 Aug 25 13:42:07.938668 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2802/5550] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:07 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1299 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:08.156118 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dfde1552-3228-4626-881c-a94eab26a3b0 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1463 microversion: 2.1 time: 0.507821 Aug 25 13:42:08.157386 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2749/5551] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:07 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1463 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:08.986228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e5eebe6f-2f26-43cd-a016-c522a59069e3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:08.987329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e5eebe6f-2f26-43cd-a016-c522a59069e3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:09.005466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5eebe6f-2f26-43cd-a016-c522a59069e3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:09.006394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5eebe6f-2f26-43cd-a016-c522a59069e3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:09.007224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5eebe6f-2f26-43cd-a016-c522a59069e3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:09.008787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5eebe6f-2f26-43cd-a016-c522a59069e3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:09.009641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5eebe6f-2f26-43cd-a016-c522a59069e3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:09.010391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5eebe6f-2f26-43cd-a016-c522a59069e3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:09.191835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5488de1-a2d1-474d-be2e-8862ff5a2f94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:09.200067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b5488de1-a2d1-474d-be2e-8862ff5a2f94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:09.229613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5488de1-a2d1-474d-be2e-8862ff5a2f94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:09.231364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5488de1-a2d1-474d-be2e-8862ff5a2f94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:09.233805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5488de1-a2d1-474d-be2e-8862ff5a2f94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:09.240993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5488de1-a2d1-474d-be2e-8862ff5a2f94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:09.242514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5488de1-a2d1-474d-be2e-8862ff5a2f94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:09.243727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5488de1-a2d1-474d-be2e-8862ff5a2f94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:09.533706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e5eebe6f-2f26-43cd-a016-c522a59069e3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:09.571286 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e5eebe6f-2f26-43cd-a016-c522a59069e3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1366 microversion: 2.1 time: 0.591578 Aug 25 13:42:09.573361 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2803/5552] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:08 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1366 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:10.268351 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b5488de1-a2d1-474d-be2e-8862ff5a2f94 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1648 microversion: 2.1 time: 1.085356 Aug 25 13:42:10.272134 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2750/5553] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:09 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1648 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:10.305963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3a004856-f0e5-4eba-82de-634fd28c229a tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:10.307035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3a004856-f0e5-4eba-82de-634fd28c229a tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:10.338614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a004856-f0e5-4eba-82de-634fd28c229a tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:10.340172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a004856-f0e5-4eba-82de-634fd28c229a tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:10.341698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a004856-f0e5-4eba-82de-634fd28c229a tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:10.343619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a004856-f0e5-4eba-82de-634fd28c229a tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:10.347315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a004856-f0e5-4eba-82de-634fd28c229a tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:10.350823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a004856-f0e5-4eba-82de-634fd28c229a tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:10.627050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5536f880-f68d-414f-a171-7cfbff2b5a3e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:10.628284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5536f880-f68d-414f-a171-7cfbff2b5a3e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:10.691827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5536f880-f68d-414f-a171-7cfbff2b5a3e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:10.692696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5536f880-f68d-414f-a171-7cfbff2b5a3e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:10.695963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5536f880-f68d-414f-a171-7cfbff2b5a3e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:10.702890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5536f880-f68d-414f-a171-7cfbff2b5a3e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:10.703635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5536f880-f68d-414f-a171-7cfbff2b5a3e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:10.707469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5536f880-f68d-414f-a171-7cfbff2b5a3e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:11.183062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5536f880-f68d-414f-a171-7cfbff2b5a3e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:11.218408 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5536f880-f68d-414f-a171-7cfbff2b5a3e tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1366 microversion: 2.1 time: 0.606520 Aug 25 13:42:11.219593 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2751/5554] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:10 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:11.250884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-15b1ed58-8984-40b2-b479-248f19315a6a req-e7ad61f1-ac21-46fe-a0ef-9f8d853f5d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3783384-6fff-4126-89ff-bb6c09fca26b", "tag": "cbe27a5c-c800-4e8b-bc99-893d19430281"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:11.294370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-15b1ed58-8984-40b2-b479-248f19315a6a req-e7ad61f1-ac21-46fe-a0ef-9f8d853f5d75 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:11.296442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-15b1ed58-8984-40b2-b479-248f19315a6a req-e7ad61f1-ac21-46fe-a0ef-9f8d853f5d75 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:11.297966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-15b1ed58-8984-40b2-b479-248f19315a6a req-e7ad61f1-ac21-46fe-a0ef-9f8d853f5d75 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:11.323921 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-15b1ed58-8984-40b2-b479-248f19315a6a req-e7ad61f1-ac21-46fe-a0ef-9f8d853f5d75 service nova] Creating event network-changed:cbe27a5c-c800-4e8b-bc99-893d19430281 for instance f3783384-6fff-4126-89ff-bb6c09fca26b on n-h2-852771-8 Aug 25 13:42:11.335070 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-15b1ed58-8984-40b2-b479-248f19315a6a req-e7ad61f1-ac21-46fe-a0ef-9f8d853f5d75 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110312 Aug 25 13:42:11.336665 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2752/5555] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:11.543941 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3a004856-f0e5-4eba-82de-634fd28c229a tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1648 microversion: 2.1 time: 1.244854 Aug 25 13:42:11.547624 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2804/5556] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:10 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1648 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:11.592109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-66e1e6b2-1b86-4c4a-bfc9-d9f3a97bf6a8 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:11.594808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-66e1e6b2-1b86-4c4a-bfc9-d9f3a97bf6a8 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:11.611720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66e1e6b2-1b86-4c4a-bfc9-d9f3a97bf6a8 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:11.613078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66e1e6b2-1b86-4c4a-bfc9-d9f3a97bf6a8 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:11.614112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66e1e6b2-1b86-4c4a-bfc9-d9f3a97bf6a8 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:11.615537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66e1e6b2-1b86-4c4a-bfc9-d9f3a97bf6a8 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:11.616684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66e1e6b2-1b86-4c4a-bfc9-d9f3a97bf6a8 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:11.617722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66e1e6b2-1b86-4c4a-bfc9-d9f3a97bf6a8 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:11.934171 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-66e1e6b2-1b86-4c4a-bfc9-d9f3a97bf6a8 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1648 microversion: 2.1 time: 0.352992 Aug 25 13:42:11.935055 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2753/5557] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:11 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1648 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:12.209860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-502943801", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "availability_zone": "nova:n-h2-852771-8", "networks": [{"uuid": "1fafb782-b6cb-4364-8622-c36d2909ff6c"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:12.272454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c9009fd3-f767-44cd-b60c-a27440f5e847 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:12.273830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c9009fd3-f767-44cd-b60c-a27440f5e847 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:12.291399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9009fd3-f767-44cd-b60c-a27440f5e847 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:12.293034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9009fd3-f767-44cd-b60c-a27440f5e847 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:12.294785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9009fd3-f767-44cd-b60c-a27440f5e847 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:12.297362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9009fd3-f767-44cd-b60c-a27440f5e847 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:12.299218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9009fd3-f767-44cd-b60c-a27440f5e847 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:12.302104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9009fd3-f767-44cd-b60c-a27440f5e847 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:12.329316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] validate_networks() for [('1fafb782-b6cb-4364-8622-c36d2909ff6c', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:42:12.796810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c9009fd3-f767-44cd-b60c-a27440f5e847 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:12.825877 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c9009fd3-f767-44cd-b60c-a27440f5e847 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1366 microversion: 2.1 time: 0.566766 Aug 25 13:42:12.827356 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2754/5558] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:12 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1366 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:13.379593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:42:13.380325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:42:13.381799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:42:13.382522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:42:13.383220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:42:13.399503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:13.400398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:13.400999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:13.402649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:13.403416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:13.404438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:13.437191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Getting quotas for project 813bd6cce011401696cdd0f722a152e1. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:42:13.447291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Getting quotas for user 94f8524ea47f4d2093d7195774b26487 and project 813bd6cce011401696cdd0f722a152e1. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:42:13.472366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:42:13.477215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:42:13.579621 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e33bd33a-3b97-4984-9488-7c407a08d913 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.376771 Aug 25 13:42:13.581203 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2805/5559] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:42:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:42:13.616751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b9d11b6-b427-41ff-a509-62a4cd99d92d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:13.621965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b9d11b6-b427-41ff-a509-62a4cd99d92d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:13.839732 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b9d11b6-b427-41ff-a509-62a4cd99d92d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1328 microversion: 2.1 time: 0.246146 Aug 25 13:42:13.845560 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2755/5560] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:13 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1328 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:13.871311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-37629d69-6641-476e-9bac-feb4ed0aef64 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:13.874235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-37629d69-6641-476e-9bac-feb4ed0aef64 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:13.915765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37629d69-6641-476e-9bac-feb4ed0aef64 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:13.915765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37629d69-6641-476e-9bac-feb4ed0aef64 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:13.921763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37629d69-6641-476e-9bac-feb4ed0aef64 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:13.924942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37629d69-6641-476e-9bac-feb4ed0aef64 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:13.927605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37629d69-6641-476e-9bac-feb4ed0aef64 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:13.928877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37629d69-6641-476e-9bac-feb4ed0aef64 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:14.445546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-37629d69-6641-476e-9bac-feb4ed0aef64 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:14.468051 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-37629d69-6641-476e-9bac-feb4ed0aef64 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1366 microversion: 2.1 time: 0.608153 Aug 25 13:42:14.469650 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2806/5561] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:13 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1366 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:14.886451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-36f402e0-5820-4fe6-8b92-329e0c3ed9d4 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:14.888760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-36f402e0-5820-4fe6-8b92-329e0c3ed9d4 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:14.905369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:14.927631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f402e0-5820-4fe6-8b92-329e0c3ed9d4 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:14.933336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f402e0-5820-4fe6-8b92-329e0c3ed9d4 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:14.934027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f402e0-5820-4fe6-8b92-329e0c3ed9d4 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:14.935361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f402e0-5820-4fe6-8b92-329e0c3ed9d4 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:14.936507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f402e0-5820-4fe6-8b92-329e0c3ed9d4 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:14.940872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f402e0-5820-4fe6-8b92-329e0c3ed9d4 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:15.161499 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-36f402e0-5820-4fe6-8b92-329e0c3ed9d4 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1345 microversion: 2.1 time: 0.282515 Aug 25 13:42:15.172762 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2756/5562] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:14 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1345 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:15.519326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-13753609-b6cb-417f-a34a-8b85d7497adb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:15.535286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-13753609-b6cb-417f-a34a-8b85d7497adb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:15.555127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13753609-b6cb-417f-a34a-8b85d7497adb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:15.555935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13753609-b6cb-417f-a34a-8b85d7497adb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:15.556829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13753609-b6cb-417f-a34a-8b85d7497adb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:15.558256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13753609-b6cb-417f-a34a-8b85d7497adb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:15.559373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13753609-b6cb-417f-a34a-8b85d7497adb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:15.560158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13753609-b6cb-417f-a34a-8b85d7497adb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:16.043688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-13753609-b6cb-417f-a34a-8b85d7497adb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:16.059402 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-13753609-b6cb-417f-a34a-8b85d7497adb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1366 microversion: 2.1 time: 0.547676 Aug 25 13:42:16.079314 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2807/5563] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:15 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1366 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:16.215327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0c4b80e-7d0f-4469-ba27-62c20d12b11d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:16.221062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b0c4b80e-7d0f-4469-ba27-62c20d12b11d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:16.255518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0c4b80e-7d0f-4469-ba27-62c20d12b11d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:16.259964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0c4b80e-7d0f-4469-ba27-62c20d12b11d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:16.261293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0c4b80e-7d0f-4469-ba27-62c20d12b11d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:16.264879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0c4b80e-7d0f-4469-ba27-62c20d12b11d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:16.264879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0c4b80e-7d0f-4469-ba27-62c20d12b11d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:16.265908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0c4b80e-7d0f-4469-ba27-62c20d12b11d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:16.502858 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b0c4b80e-7d0f-4469-ba27-62c20d12b11d tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1433 microversion: 2.1 time: 0.303436 Aug 25 13:42:16.529620 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2757/5564] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:16 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1433 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:17.097400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e6c974a-5e48-430c-b48d-c4f3c31c85f3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:17.099440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6e6c974a-5e48-430c-b48d-c4f3c31c85f3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:17.127774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e6c974a-5e48-430c-b48d-c4f3c31c85f3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:17.137925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e6c974a-5e48-430c-b48d-c4f3c31c85f3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:17.138723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e6c974a-5e48-430c-b48d-c4f3c31c85f3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:17.140084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e6c974a-5e48-430c-b48d-c4f3c31c85f3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:17.140870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e6c974a-5e48-430c-b48d-c4f3c31c85f3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:17.141547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e6c974a-5e48-430c-b48d-c4f3c31c85f3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:17.562424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7119844b-8af2-4345-8e07-ad5b29b291b2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:17.590413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7119844b-8af2-4345-8e07-ad5b29b291b2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:17.623061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6e6c974a-5e48-430c-b48d-c4f3c31c85f3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:17.666871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7119844b-8af2-4345-8e07-ad5b29b291b2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:17.671696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7119844b-8af2-4345-8e07-ad5b29b291b2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:17.672462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7119844b-8af2-4345-8e07-ad5b29b291b2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:17.673559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7119844b-8af2-4345-8e07-ad5b29b291b2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:17.674444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7119844b-8af2-4345-8e07-ad5b29b291b2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:17.675247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7119844b-8af2-4345-8e07-ad5b29b291b2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:17.689922 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e6c974a-5e48-430c-b48d-c4f3c31c85f3 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1366 microversion: 2.1 time: 0.601770 Aug 25 13:42:17.717855 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2808/5565] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:17 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1366 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:18.118711 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7119844b-8af2-4345-8e07-ad5b29b291b2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1463 microversion: 2.1 time: 0.572389 Aug 25 13:42:18.121440 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2758/5566] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:17 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1463 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:18.740378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eff19842-633d-4d13-92b0-3f4cd5bb9f9f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:18.741963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eff19842-633d-4d13-92b0-3f4cd5bb9f9f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:18.769279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eff19842-633d-4d13-92b0-3f4cd5bb9f9f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:18.770112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eff19842-633d-4d13-92b0-3f4cd5bb9f9f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:18.770970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eff19842-633d-4d13-92b0-3f4cd5bb9f9f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:18.772957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eff19842-633d-4d13-92b0-3f4cd5bb9f9f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:18.773982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eff19842-633d-4d13-92b0-3f4cd5bb9f9f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:18.775061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eff19842-633d-4d13-92b0-3f4cd5bb9f9f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:19.310407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eff19842-633d-4d13-92b0-3f4cd5bb9f9f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:19.329570 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eff19842-633d-4d13-92b0-3f4cd5bb9f9f tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1366 microversion: 2.1 time: 0.597996 Aug 25 13:42:19.331485 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2809/5567] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:18 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1366 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:19.352513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1ff37f27-f110-4a08-9c0c-44f76afa40fe tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:19.355044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1ff37f27-f110-4a08-9c0c-44f76afa40fe tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:19.374951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff37f27-f110-4a08-9c0c-44f76afa40fe tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:19.377336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff37f27-f110-4a08-9c0c-44f76afa40fe tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:19.379712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff37f27-f110-4a08-9c0c-44f76afa40fe tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:19.382152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff37f27-f110-4a08-9c0c-44f76afa40fe tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:19.383520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff37f27-f110-4a08-9c0c-44f76afa40fe tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:19.384785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1ff37f27-f110-4a08-9c0c-44f76afa40fe tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:19.765500 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1ff37f27-f110-4a08-9c0c-44f76afa40fe tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1463 microversion: 2.1 time: 0.429159 Aug 25 13:42:19.765500 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2810/5568] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:19 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1463 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:19.780312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-3711737c-e139-4b1f-aa4d-0bec40353c9b req-56feecab-a2a4-43ec-b902-f9e04a8c708b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3783384-6fff-4126-89ff-bb6c09fca26b", "name": "network-vif-plugged", "status": "completed", "tag": "cbe27a5c-c800-4e8b-bc99-893d19430281"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:19.835137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3711737c-e139-4b1f-aa4d-0bec40353c9b req-56feecab-a2a4-43ec-b902-f9e04a8c708b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:19.836324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3711737c-e139-4b1f-aa4d-0bec40353c9b req-56feecab-a2a4-43ec-b902-f9e04a8c708b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:19.838287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3711737c-e139-4b1f-aa4d-0bec40353c9b req-56feecab-a2a4-43ec-b902-f9e04a8c708b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:19.869464 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-3711737c-e139-4b1f-aa4d-0bec40353c9b req-56feecab-a2a4-43ec-b902-f9e04a8c708b service nova] Creating event network-vif-plugged:cbe27a5c-c800-4e8b-bc99-893d19430281 for instance f3783384-6fff-4126-89ff-bb6c09fca26b on n-h2-852771-8 Aug 25 13:42:19.883078 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-3711737c-e139-4b1f-aa4d-0bec40353c9b req-56feecab-a2a4-43ec-b902-f9e04a8c708b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112516 Aug 25 13:42:19.884413 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2811/5569] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:19.941616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c30fba1b-f730-4c2b-bc70-7ba4a666d30e req-a1ca6d58-22ee-4ec9-855d-9617f29ab1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f8e120-0a7a-4969-9d85-9a3378868b79", "tag": "90eaa015-30aa-4e15-a51e-c8c23fe13ec7"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:19.964270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c30fba1b-f730-4c2b-bc70-7ba4a666d30e req-a1ca6d58-22ee-4ec9-855d-9617f29ab1a8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:19.965685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c30fba1b-f730-4c2b-bc70-7ba4a666d30e req-a1ca6d58-22ee-4ec9-855d-9617f29ab1a8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:19.966804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c30fba1b-f730-4c2b-bc70-7ba4a666d30e req-a1ca6d58-22ee-4ec9-855d-9617f29ab1a8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:19.992824 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c30fba1b-f730-4c2b-bc70-7ba4a666d30e req-a1ca6d58-22ee-4ec9-855d-9617f29ab1a8 service nova] Creating event network-changed:90eaa015-30aa-4e15-a51e-c8c23fe13ec7 for instance 16f8e120-0a7a-4969-9d85-9a3378868b79 on n-h2-852771-8 Aug 25 13:42:20.002536 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c30fba1b-f730-4c2b-bc70-7ba4a666d30e req-a1ca6d58-22ee-4ec9-855d-9617f29ab1a8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.898666 Aug 25 13:42:20.004677 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2759/5570] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:20.371973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b8a3263d-cad2-4bff-a0bc-86482dee87f6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:20.373840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b8a3263d-cad2-4bff-a0bc-86482dee87f6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:20.391697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a3263d-cad2-4bff-a0bc-86482dee87f6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:20.393582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a3263d-cad2-4bff-a0bc-86482dee87f6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:20.395243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a3263d-cad2-4bff-a0bc-86482dee87f6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:20.396789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a3263d-cad2-4bff-a0bc-86482dee87f6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:20.397734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a3263d-cad2-4bff-a0bc-86482dee87f6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:20.398868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8a3263d-cad2-4bff-a0bc-86482dee87f6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:20.689219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b8a3263d-cad2-4bff-a0bc-86482dee87f6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:20.715404 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b8a3263d-cad2-4bff-a0bc-86482dee87f6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1366 microversion: 2.1 time: 0.352583 Aug 25 13:42:20.716530 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2812/5571] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:20 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:20.813892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-67d40c56-b1b9-4d7b-be47-84691112aec2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:20.815608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-67d40c56-b1b9-4d7b-be47-84691112aec2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:20.828162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d40c56-b1b9-4d7b-be47-84691112aec2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:20.829309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d40c56-b1b9-4d7b-be47-84691112aec2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:20.830141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d40c56-b1b9-4d7b-be47-84691112aec2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:20.831788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d40c56-b1b9-4d7b-be47-84691112aec2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:20.832421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d40c56-b1b9-4d7b-be47-84691112aec2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:20.833408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-67d40c56-b1b9-4d7b-be47-84691112aec2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:21.135544 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-67d40c56-b1b9-4d7b-be47-84691112aec2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1463 microversion: 2.1 time: 0.331243 Aug 25 13:42:21.150155 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2760/5572] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:20 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1463 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:21.763221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0ab35bc2-dc82-417a-a626-c6441000b316 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:21.764279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0ab35bc2-dc82-417a-a626-c6441000b316 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:21.780081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab35bc2-dc82-417a-a626-c6441000b316 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:21.781324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab35bc2-dc82-417a-a626-c6441000b316 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:21.782261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab35bc2-dc82-417a-a626-c6441000b316 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:21.783919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab35bc2-dc82-417a-a626-c6441000b316 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:21.785359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab35bc2-dc82-417a-a626-c6441000b316 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:21.785711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab35bc2-dc82-417a-a626-c6441000b316 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:22.058920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ab35bc2-dc82-417a-a626-c6441000b316 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:22.073641 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0ab35bc2-dc82-417a-a626-c6441000b316 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1366 microversion: 2.1 time: 0.319333 Aug 25 13:42:22.074654 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2813/5573] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:21 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:22.173545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dbcfc6cb-56e6-4d93-95fc-15db1b4e6f35 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:22.174756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dbcfc6cb-56e6-4d93-95fc-15db1b4e6f35 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:22.187549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbcfc6cb-56e6-4d93-95fc-15db1b4e6f35 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:22.188712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbcfc6cb-56e6-4d93-95fc-15db1b4e6f35 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:22.189494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbcfc6cb-56e6-4d93-95fc-15db1b4e6f35 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:22.191254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbcfc6cb-56e6-4d93-95fc-15db1b4e6f35 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:22.192028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbcfc6cb-56e6-4d93-95fc-15db1b4e6f35 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:22.192970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbcfc6cb-56e6-4d93-95fc-15db1b4e6f35 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:22.488686 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dbcfc6cb-56e6-4d93-95fc-15db1b4e6f35 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1463 microversion: 2.1 time: 0.322171 Aug 25 13:42:22.491285 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2761/5574] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:22 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1463 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:23.114384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e96d1360-e46a-4596-b254-83823803add0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:23.116575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e96d1360-e46a-4596-b254-83823803add0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:23.129485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e96d1360-e46a-4596-b254-83823803add0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:23.130336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e96d1360-e46a-4596-b254-83823803add0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:23.131873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e96d1360-e46a-4596-b254-83823803add0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:23.133214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e96d1360-e46a-4596-b254-83823803add0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:23.134050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e96d1360-e46a-4596-b254-83823803add0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:23.134781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e96d1360-e46a-4596-b254-83823803add0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:23.421734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:23.463962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:23.508337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e96d1360-e46a-4596-b254-83823803add0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:23.526301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:23.532872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8bbdb54e-3b0d-429b-8ed0-b60bfcab2d2b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:23.544769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8bbdb54e-3b0d-429b-8ed0-b60bfcab2d2b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:23.561209 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e96d1360-e46a-4596-b254-83823803add0 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1366 microversion: 2.1 time: 0.453598 Aug 25 13:42:23.565225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bbdb54e-3b0d-429b-8ed0-b60bfcab2d2b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:23.565225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bbdb54e-3b0d-429b-8ed0-b60bfcab2d2b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:23.566129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bbdb54e-3b0d-429b-8ed0-b60bfcab2d2b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:23.570279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bbdb54e-3b0d-429b-8ed0-b60bfcab2d2b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:23.571230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bbdb54e-3b0d-429b-8ed0-b60bfcab2d2b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:23.576419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bbdb54e-3b0d-429b-8ed0-b60bfcab2d2b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:23.586559 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2814/5575] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:23 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1366 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:23.832942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=14 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:23.993332 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8bbdb54e-3b0d-429b-8ed0-b60bfcab2d2b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1463 microversion: 2.1 time: 0.467571 Aug 25 13:42:24.014703 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2762/5576] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:23 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1463 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:24.621034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e13c4ea-954d-48fa-82fc-6a2db1a07c65 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:24.622301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4e13c4ea-954d-48fa-82fc-6a2db1a07c65 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:24.635324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e13c4ea-954d-48fa-82fc-6a2db1a07c65 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:24.636192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e13c4ea-954d-48fa-82fc-6a2db1a07c65 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:24.636908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e13c4ea-954d-48fa-82fc-6a2db1a07c65 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:24.637971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e13c4ea-954d-48fa-82fc-6a2db1a07c65 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:24.638525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e13c4ea-954d-48fa-82fc-6a2db1a07c65 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:24.639030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e13c4ea-954d-48fa-82fc-6a2db1a07c65 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:24.966315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e13c4ea-954d-48fa-82fc-6a2db1a07c65 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:24.985916 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e13c4ea-954d-48fa-82fc-6a2db1a07c65 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1557 microversion: 2.1 time: 0.374592 Aug 25 13:42:24.991210 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2815/5577] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:24 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1557 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:25.024127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-83314096-37c1-47cb-9b02-02be85bbf8c9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:25.024811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-83314096-37c1-47cb-9b02-02be85bbf8c9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:25.054131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83314096-37c1-47cb-9b02-02be85bbf8c9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:25.055370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83314096-37c1-47cb-9b02-02be85bbf8c9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:25.056704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83314096-37c1-47cb-9b02-02be85bbf8c9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:25.058764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83314096-37c1-47cb-9b02-02be85bbf8c9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:25.060156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83314096-37c1-47cb-9b02-02be85bbf8c9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:25.061317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83314096-37c1-47cb-9b02-02be85bbf8c9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:25.079127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2df7fd3-abc6-4280-8d0c-e0d5cd2989a2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:25.080378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b2df7fd3-abc6-4280-8d0c-e0d5cd2989a2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:25.100254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2df7fd3-abc6-4280-8d0c-e0d5cd2989a2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:25.118230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2df7fd3-abc6-4280-8d0c-e0d5cd2989a2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:25.119633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2df7fd3-abc6-4280-8d0c-e0d5cd2989a2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:25.121275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2df7fd3-abc6-4280-8d0c-e0d5cd2989a2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:25.122478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2df7fd3-abc6-4280-8d0c-e0d5cd2989a2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:25.123405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2df7fd3-abc6-4280-8d0c-e0d5cd2989a2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:25.344396 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-83314096-37c1-47cb-9b02-02be85bbf8c9 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.326411 Aug 25 13:42:25.359225 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2763/5578] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 13:42:25 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-interface => generated 285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:25.856180 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2df7fd3-abc6-4280-8d0c-e0d5cd2989a2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1463 microversion: 2.1 time: 0.802131 Aug 25 13:42:25.860043 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2816/5579] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:25 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1463 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:26.906734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-74ac3351-12eb-4d26-a312-abf4007bc877 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:26.914316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-74ac3351-12eb-4d26-a312-abf4007bc877 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:26.938151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74ac3351-12eb-4d26-a312-abf4007bc877 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:26.939067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74ac3351-12eb-4d26-a312-abf4007bc877 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:26.939909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74ac3351-12eb-4d26-a312-abf4007bc877 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:26.941232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74ac3351-12eb-4d26-a312-abf4007bc877 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:26.942151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74ac3351-12eb-4d26-a312-abf4007bc877 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:26.943036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-74ac3351-12eb-4d26-a312-abf4007bc877 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:27.526844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-50ccc624-7472-4585-93b2-d0eecce08b94 req-f11c1481-6086-4aa9-9d22-0b4068be1fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f8e120-0a7a-4969-9d85-9a3378868b79", "name": "network-vif-plugged", "status": "completed", "tag": "90eaa015-30aa-4e15-a51e-c8c23fe13ec7"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:27.549325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-50ccc624-7472-4585-93b2-d0eecce08b94 req-f11c1481-6086-4aa9-9d22-0b4068be1fe4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:27.551093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-50ccc624-7472-4585-93b2-d0eecce08b94 req-f11c1481-6086-4aa9-9d22-0b4068be1fe4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:27.552102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-50ccc624-7472-4585-93b2-d0eecce08b94 req-f11c1481-6086-4aa9-9d22-0b4068be1fe4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:27.584979 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-50ccc624-7472-4585-93b2-d0eecce08b94 req-f11c1481-6086-4aa9-9d22-0b4068be1fe4 service nova] Creating event network-vif-plugged:90eaa015-30aa-4e15-a51e-c8c23fe13ec7 for instance 16f8e120-0a7a-4969-9d85-9a3378868b79 on n-h2-852771-8 Aug 25 13:42:27.596834 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-50ccc624-7472-4585-93b2-d0eecce08b94 req-f11c1481-6086-4aa9-9d22-0b4068be1fe4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.484368 Aug 25 13:42:27.598840 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2817/5580] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:42:27.608979 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-74ac3351-12eb-4d26-a312-abf4007bc877 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1463 microversion: 2.1 time: 0.706277 Aug 25 13:42:27.610416 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2764/5581] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:26 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1463 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:28.021582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2f909a52-6c19-40ae-a003-93db259ea44f req-1ae54bac-8fa5-49c2-928f-7abb2c6af89a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3783384-6fff-4126-89ff-bb6c09fca26b", "tag": "cbe27a5c-c800-4e8b-bc99-893d19430281"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:28.044122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2f909a52-6c19-40ae-a003-93db259ea44f req-1ae54bac-8fa5-49c2-928f-7abb2c6af89a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:28.045288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2f909a52-6c19-40ae-a003-93db259ea44f req-1ae54bac-8fa5-49c2-928f-7abb2c6af89a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:28.046222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2f909a52-6c19-40ae-a003-93db259ea44f req-1ae54bac-8fa5-49c2-928f-7abb2c6af89a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:28.094050 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2f909a52-6c19-40ae-a003-93db259ea44f req-1ae54bac-8fa5-49c2-928f-7abb2c6af89a service nova] Creating event network-changed:cbe27a5c-c800-4e8b-bc99-893d19430281 for instance f3783384-6fff-4126-89ff-bb6c09fca26b on n-h2-852771-8 Aug 25 13:42:28.107878 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2f909a52-6c19-40ae-a003-93db259ea44f req-1ae54bac-8fa5-49c2-928f-7abb2c6af89a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097062 Aug 25 13:42:28.109281 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2818/5582] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:28.652368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ad2dd86f-3be9-410c-9084-63cf9f8eca27 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:28.653611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ad2dd86f-3be9-410c-9084-63cf9f8eca27 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:28.681673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad2dd86f-3be9-410c-9084-63cf9f8eca27 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:28.685863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad2dd86f-3be9-410c-9084-63cf9f8eca27 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:28.687807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad2dd86f-3be9-410c-9084-63cf9f8eca27 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:28.694497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad2dd86f-3be9-410c-9084-63cf9f8eca27 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:28.704621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad2dd86f-3be9-410c-9084-63cf9f8eca27 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:28.704621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad2dd86f-3be9-410c-9084-63cf9f8eca27 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:28.998291 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ad2dd86f-3be9-410c-9084-63cf9f8eca27 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1463 microversion: 2.1 time: 0.353784 Aug 25 13:42:29.019719 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2765/5583] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:28 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1463 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:30.049438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab2563d0-e366-4e71-b19f-18b5eb742c71 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:30.051296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ab2563d0-e366-4e71-b19f-18b5eb742c71 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:30.067620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab2563d0-e366-4e71-b19f-18b5eb742c71 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:30.068573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab2563d0-e366-4e71-b19f-18b5eb742c71 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:30.069408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab2563d0-e366-4e71-b19f-18b5eb742c71 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:30.070964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab2563d0-e366-4e71-b19f-18b5eb742c71 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:30.071855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab2563d0-e366-4e71-b19f-18b5eb742c71 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:30.072675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab2563d0-e366-4e71-b19f-18b5eb742c71 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:30.381890 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ab2563d0-e366-4e71-b19f-18b5eb742c71 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1649 microversion: 2.1 time: 0.346140 Aug 25 13:42:30.383516 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2819/5584] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:30 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1649 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:30.427282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-786e523d-144e-4574-9271-78e2161b01aa tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:30.428497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-786e523d-144e-4574-9271-78e2161b01aa tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:30.459121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-786e523d-144e-4574-9271-78e2161b01aa tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:30.461201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-786e523d-144e-4574-9271-78e2161b01aa tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:30.462959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-786e523d-144e-4574-9271-78e2161b01aa tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:30.465281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-786e523d-144e-4574-9271-78e2161b01aa tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:30.468035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-786e523d-144e-4574-9271-78e2161b01aa tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:30.470456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-786e523d-144e-4574-9271-78e2161b01aa tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:30.518493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:30.767791 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-786e523d-144e-4574-9271-78e2161b01aa tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1649 microversion: 2.1 time: 0.346975 Aug 25 13:42:30.769807 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2766/5585] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:30 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1649 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:30.814607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b0a990d8-17eb-4fbb-b6d1-950cfb7c48bf tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:30.817270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b0a990d8-17eb-4fbb-b6d1-950cfb7c48bf tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:30.831232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0a990d8-17eb-4fbb-b6d1-950cfb7c48bf tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:30.832490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0a990d8-17eb-4fbb-b6d1-950cfb7c48bf tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:30.836776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0a990d8-17eb-4fbb-b6d1-950cfb7c48bf tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:30.838608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0a990d8-17eb-4fbb-b6d1-950cfb7c48bf tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:30.839632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0a990d8-17eb-4fbb-b6d1-950cfb7c48bf tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:30.840511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0a990d8-17eb-4fbb-b6d1-950cfb7c48bf tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:31.290292 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b0a990d8-17eb-4fbb-b6d1-950cfb7c48bf tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1649 microversion: 2.1 time: 0.491753 Aug 25 13:42:31.291369 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2820/5586] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:30 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1649 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:31.341353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-999c57ca-463e-410a-9997-69cc1af2ce17 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:31.342456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-999c57ca-463e-410a-9997-69cc1af2ce17 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:31.353273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999c57ca-463e-410a-9997-69cc1af2ce17 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:31.354033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999c57ca-463e-410a-9997-69cc1af2ce17 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:31.354994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999c57ca-463e-410a-9997-69cc1af2ce17 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:31.356339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999c57ca-463e-410a-9997-69cc1af2ce17 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:31.357078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999c57ca-463e-410a-9997-69cc1af2ce17 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:31.357951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-999c57ca-463e-410a-9997-69cc1af2ce17 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:31.419713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-999c57ca-463e-410a-9997-69cc1af2ce17 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:42:31.645344 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-999c57ca-463e-410a-9997-69cc1af2ce17 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 204 len: 0 microversion: 2.1 time: 0.302283 Aug 25 13:42:31.654793 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2767/5587] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:42:31 2022] DELETE /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:42:31.689417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5de53b56-18b4-4be0-91e7-eb6c98423a47 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:31.689417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5de53b56-18b4-4be0-91e7-eb6c98423a47 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:31.722766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5de53b56-18b4-4be0-91e7-eb6c98423a47 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:31.729067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5de53b56-18b4-4be0-91e7-eb6c98423a47 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:31.730105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5de53b56-18b4-4be0-91e7-eb6c98423a47 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:31.731604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5de53b56-18b4-4be0-91e7-eb6c98423a47 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:31.732764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5de53b56-18b4-4be0-91e7-eb6c98423a47 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:31.734475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5de53b56-18b4-4be0-91e7-eb6c98423a47 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:32.033749 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5de53b56-18b4-4be0-91e7-eb6c98423a47 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1655 microversion: 2.1 time: 0.367425 Aug 25 13:42:32.034863 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2821/5588] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:31 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1655 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:33.080488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-937f9cbd-8fd0-4765-93fc-7b49903fb54b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:33.081795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-937f9cbd-8fd0-4765-93fc-7b49903fb54b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:33.095851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-937f9cbd-8fd0-4765-93fc-7b49903fb54b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:33.096619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-937f9cbd-8fd0-4765-93fc-7b49903fb54b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:33.097292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-937f9cbd-8fd0-4765-93fc-7b49903fb54b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:33.098466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-937f9cbd-8fd0-4765-93fc-7b49903fb54b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:33.100251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-937f9cbd-8fd0-4765-93fc-7b49903fb54b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:33.101566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-937f9cbd-8fd0-4765-93fc-7b49903fb54b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:33.544338 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-937f9cbd-8fd0-4765-93fc-7b49903fb54b tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1655 microversion: 2.1 time: 0.471337 Aug 25 13:42:33.549370 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2768/5589] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:33 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1655 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:34.473785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-430511dd-736b-417c-b4cc-9a39f389c5b8 req-d271a5cb-8481-402c-b651-049a2cc09ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f8e120-0a7a-4969-9d85-9a3378868b79", "name": "network-vif-deleted", "tag": "90eaa015-30aa-4e15-a51e-c8c23fe13ec7"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:34.519351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:34.532960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-430511dd-736b-417c-b4cc-9a39f389c5b8 req-d271a5cb-8481-402c-b651-049a2cc09ff4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:34.548936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-430511dd-736b-417c-b4cc-9a39f389c5b8 req-d271a5cb-8481-402c-b651-049a2cc09ff4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:34.553953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-430511dd-736b-417c-b4cc-9a39f389c5b8 req-d271a5cb-8481-402c-b651-049a2cc09ff4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:34.585039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:34.600999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:34.627242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-430511dd-736b-417c-b4cc-9a39f389c5b8 req-d271a5cb-8481-402c-b651-049a2cc09ff4 service nova] Creating event network-vif-deleted:90eaa015-30aa-4e15-a51e-c8c23fe13ec7 for instance 16f8e120-0a7a-4969-9d85-9a3378868b79 on n-h2-852771-8 Aug 25 13:42:34.656514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:34.666409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:34.672084 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-430511dd-736b-417c-b4cc-9a39f389c5b8 req-d271a5cb-8481-402c-b651-049a2cc09ff4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228967 Aug 25 13:42:34.673342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:34.679944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:34.682556 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2822/5590] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:34.695583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:34.699657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:34.702565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:34.867015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:34.867459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:34.868307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:34.869129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lazy-loading 'fault' on Instance uuid 16f8e120-0a7a-4969-9d85-9a3378868b79 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:42:34.977539 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f164317e-233d-4ad7-8a8f-a5cdb9952041 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 200 len: 1453 microversion: 2.1 time: 0.400755 Aug 25 13:42:34.979388 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2769/5591] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:34 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 1453 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:36.012087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:36.014638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 16f8e120-0a7a-4969-9d85-9a3378868b79] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:36.029792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:36.030837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:36.031797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:36.033296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:36.034333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:36.035274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:36.065279 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] HTTP exception thrown: Instance 16f8e120-0a7a-4969-9d85-9a3378868b79 could not be found. Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Request method failure captured: Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 HTTP/1.1 Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3wW5lKWEoR1omrZDamRt2Bewh0rJ4WIfqqBgPz0xCn6P4FEBr6S1Jz_DIqeNYK16ZOvFDDWzYfr0Be6sOLNRZacjybrwznp0-Te-RAmwNMs6vyx6pgggmfHK1tTTs_p8SpWFlQS07OTdvZZKlOHGSD7l6azx9q-c1q3W66XXUKN9pw Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 813bd6cce011401696cdd0f722a152e1 Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestServerMultinode-595612886 Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/813bd6cce011401696cdd0f722a152e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_813bd6cce011401696cdd0f722a152e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/813bd6cce011401696cdd0f722a152e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/813bd6cce011401696cdd0f722a152e1"}]}] Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestServerMultinode-595612886 Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 813bd6cce011401696cdd0f722a152e1 Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestServerMultinode-595612886 Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestServerMultinode-595612886-project-admin Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 94f8524ea47f4d2093d7195774b26487 Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestServerMultinode-595612886-project-admin Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 16f8e120-0a7a-4969-9d85-9a3378868b79 could not be found. Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '16f8e120-0a7a-4969-9d85-9a3378868b79'} Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f8e120-0a7a-4969-9d85-9a3378868b79 could not be found. Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f8e120-0a7a-4969-9d85-9a3378868b79 could not be found. Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:42:36.069577 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:42:36.082713 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:42:36.082713 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:42:36.082713 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:42:36.082713 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:42:36.082713 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:42:36.082713 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f8e120-0a7a-4969-9d85-9a3378868b79 could not be found. Aug 25 13:42:36.082713 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:42:36.082713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Returning 404 to user: Instance 16f8e120-0a7a-4969-9d85-9a3378868b79 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:42:36.082713 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-78ffe019-3645-4007-a705-27e75b42fc01 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79" status: 404 len: 111 microversion: 2.1 time: 0.071577 Aug 25 13:42:36.082713 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2823/5592] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:36 2022] GET /compute/v2.1/servers/16f8e120-0a7a-4969-9d85-9a3378868b79 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:42:36.097271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-935a5c69-5155-472f-bdba-fe0c57bd7a89 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:36.098883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-935a5c69-5155-472f-bdba-fe0c57bd7a89 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:36.113143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935a5c69-5155-472f-bdba-fe0c57bd7a89 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:36.114266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935a5c69-5155-472f-bdba-fe0c57bd7a89 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:36.115286 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935a5c69-5155-472f-bdba-fe0c57bd7a89 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:36.117016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935a5c69-5155-472f-bdba-fe0c57bd7a89 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:36.118333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935a5c69-5155-472f-bdba-fe0c57bd7a89 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:36.119313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-935a5c69-5155-472f-bdba-fe0c57bd7a89 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:36.175938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-935a5c69-5155-472f-bdba-fe0c57bd7a89 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:42:36.357142 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-935a5c69-5155-472f-bdba-fe0c57bd7a89 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 204 len: 0 microversion: 2.1 time: 0.266864 Aug 25 13:42:36.364311 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2770/5593] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:42:36 2022] DELETE /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:42:36.372361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0d62cce4-68ba-4352-a80c-ecb7c1241ce7 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:36.373451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0d62cce4-68ba-4352-a80c-ecb7c1241ce7 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:36.384107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d62cce4-68ba-4352-a80c-ecb7c1241ce7 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:36.384956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d62cce4-68ba-4352-a80c-ecb7c1241ce7 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:36.386343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d62cce4-68ba-4352-a80c-ecb7c1241ce7 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:36.388403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d62cce4-68ba-4352-a80c-ecb7c1241ce7 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:36.389066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d62cce4-68ba-4352-a80c-ecb7c1241ce7 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:36.389773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d62cce4-68ba-4352-a80c-ecb7c1241ce7 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:36.643057 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0d62cce4-68ba-4352-a80c-ecb7c1241ce7 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1654 microversion: 2.1 time: 0.274904 Aug 25 13:42:36.675445 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2824/5594] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:36 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1654 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:37.688089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-28764848-ab3c-4276-9652-8f0b7600f1c2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:37.689318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-28764848-ab3c-4276-9652-8f0b7600f1c2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:37.714101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28764848-ab3c-4276-9652-8f0b7600f1c2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:37.717143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28764848-ab3c-4276-9652-8f0b7600f1c2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:37.726853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28764848-ab3c-4276-9652-8f0b7600f1c2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:37.728505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28764848-ab3c-4276-9652-8f0b7600f1c2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:37.734710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28764848-ab3c-4276-9652-8f0b7600f1c2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:37.736741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28764848-ab3c-4276-9652-8f0b7600f1c2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:38.111070 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-28764848-ab3c-4276-9652-8f0b7600f1c2 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1654 microversion: 2.1 time: 0.430974 Aug 25 13:42:38.122298 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2771/5595] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:37 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1654 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:39.182027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-21b0d7b7-7d78-43f4-93a9-c2546a6d21bb tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:39.184607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-21b0d7b7-7d78-43f4-93a9-c2546a6d21bb tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:39.198625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21b0d7b7-7d78-43f4-93a9-c2546a6d21bb tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:39.199973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21b0d7b7-7d78-43f4-93a9-c2546a6d21bb tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:39.201193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21b0d7b7-7d78-43f4-93a9-c2546a6d21bb tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:39.203058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21b0d7b7-7d78-43f4-93a9-c2546a6d21bb tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:39.204387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21b0d7b7-7d78-43f4-93a9-c2546a6d21bb tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:39.205585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-21b0d7b7-7d78-43f4-93a9-c2546a6d21bb tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:39.544611 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-21b0d7b7-7d78-43f4-93a9-c2546a6d21bb tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 200 len: 1654 microversion: 2.1 time: 0.379336 Aug 25 13:42:39.546432 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2825/5596] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:39 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 1654 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:39.731585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-561ca566-64bc-40ad-a6d5-d97ddd429a4f req-f160f623-c445-4c91-b457-473792f196a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38a7ff60-4f82-4e35-8199-9dfceb821bb7", "name": "network-vif-deleted", "tag": "725959f2-38f2-4adb-962f-08ceaddf6ae2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:39.752695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-561ca566-64bc-40ad-a6d5-d97ddd429a4f req-f160f623-c445-4c91-b457-473792f196a1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:39.753879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-561ca566-64bc-40ad-a6d5-d97ddd429a4f req-f160f623-c445-4c91-b457-473792f196a1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:39.754822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-561ca566-64bc-40ad-a6d5-d97ddd429a4f req-f160f623-c445-4c91-b457-473792f196a1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:39.781445 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-561ca566-64bc-40ad-a6d5-d97ddd429a4f req-f160f623-c445-4c91-b457-473792f196a1 service nova] Creating event network-vif-deleted:725959f2-38f2-4adb-962f-08ceaddf6ae2 for instance 38a7ff60-4f82-4e35-8199-9dfceb821bb7 on n-h1-852771-8 Aug 25 13:42:39.792578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-561ca566-64bc-40ad-a6d5-d97ddd429a4f req-f160f623-c445-4c91-b457-473792f196a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068730 Aug 25 13:42:39.794413 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2772/5597] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:40.601713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:40.602980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] [instance: 38a7ff60-4f82-4e35-8199-9dfceb821bb7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:40.616718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:40.617801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:40.618688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:40.620142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:40.621168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:40.622913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:40.658382 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] HTTP exception thrown: Instance 38a7ff60-4f82-4e35-8199-9dfceb821bb7 could not be found. Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Request method failure captured: Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 HTTP/1.1 Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3wW5lKWEoR1omrZDamRt2Bewh0rJ4WIfqqBgPz0xCn6P4FEBr6S1Jz_DIqeNYK16ZOvFDDWzYfr0Be6sOLNRZacjybrwznp0-Te-RAmwNMs6vyx6pgggmfHK1tTTs_p8SpWFlQS07OTdvZZKlOHGSD7l6azx9q-c1q3W66XXUKN9pw Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 813bd6cce011401696cdd0f722a152e1 Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestServerMultinode-595612886 Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/813bd6cce011401696cdd0f722a152e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_813bd6cce011401696cdd0f722a152e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/813bd6cce011401696cdd0f722a152e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/813bd6cce011401696cdd0f722a152e1"}]}] Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestServerMultinode-595612886 Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 813bd6cce011401696cdd0f722a152e1 Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestServerMultinode-595612886 Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestServerMultinode-595612886-project-admin Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 94f8524ea47f4d2093d7195774b26487 Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestServerMultinode-595612886-project-admin Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 38a7ff60-4f82-4e35-8199-9dfceb821bb7 could not be found. Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '38a7ff60-4f82-4e35-8199-9dfceb821bb7'} Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38a7ff60-4f82-4e35-8199-9dfceb821bb7 could not be found. Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38a7ff60-4f82-4e35-8199-9dfceb821bb7 could not be found. Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:42:40.663499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:42:40.675015 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:42:40.675015 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:42:40.675015 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:42:40.675015 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:42:40.675015 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:42:40.675015 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38a7ff60-4f82-4e35-8199-9dfceb821bb7 could not be found. Aug 25 13:42:40.675015 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:42:40.675015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] Returning 404 to user: Instance 38a7ff60-4f82-4e35-8199-9dfceb821bb7 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:42:40.680010 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2c4fb391-773a-4d24-a813-61a1d49e3b55 tempest-TestServerMultinode-595612886 tempest-TestServerMultinode-595612886-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7" status: 404 len: 111 microversion: 2.1 time: 0.084412 Aug 25 13:42:40.681081 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2826/5598] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:40 2022] GET /compute/v2.1/servers/38a7ff60-4f82-4e35-8199-9dfceb821bb7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:42:46.680017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a5b0bf70-9277-4fca-9eb7-6f5fe2ed01a2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'create', calling method: .version_select at 0x7f3a29f31e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1522546407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINOGRTkcinBosI/UeudJbh34iQQqypihnUJbUBpk+bP+3j0LBF6oA71Gs+vXJN+nlADoWxYqvvIbEP8yvsVRUyQ8N83j14PXMgS0BTt02fQ1GhgJGwE7p9bm34LWdo3Cw=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:46.714479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a5b0bf70-9277-4fca-9eb7-6f5fe2ed01a2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:42:46.728123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a5b0bf70-9277-4fca-9eb7-6f5fe2ed01a2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for user ecfd27e7237548f485ae9480d489286a and project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:42:46.783063 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a5b0bf70-9277-4fca-9eb7-6f5fe2ed01a2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.549546 Aug 25 13:42:46.784552 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2773/5599] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:42:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:03.398081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-481843540", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a5b7f601-9e66-46ab-84e8-d54bfcd0493e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1522546407", "security_groups": [{"name": "tempest-secgroup-smoke-413638519"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:03.459737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=9 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:03.461973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=52 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:03.959724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] validate_networks() for [('a5b7f601-9e66-46ab-84e8-d54bfcd0493e', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:43:04.818371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:43:04.819486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:43:04.820121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:43:04.820899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:43:04.821748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:43:04.861580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:04.862283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:04.862836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:04.865997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:04.866830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:04.868422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:04.948786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:43:04.965672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for user ecfd27e7237548f485ae9480d489286a and project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:43:05.000316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:43:05.006050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:43:05.154797 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b812061-e6a1-4bce-a70a-761273bca860 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.767669 Aug 25 13:43:05.158323 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2827/5600] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:43:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:43:05.179455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f90d6518-442b-4e13-b60e-c69293bfd183 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:05.180893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f90d6518-442b-4e13-b60e-c69293bfd183 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:05.188358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:05.190369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:05.192370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:05.435527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f90d6518-442b-4e13-b60e-c69293bfd183 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:05.473119 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f90d6518-442b-4e13-b60e-c69293bfd183 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1266 microversion: 2.1 time: 0.300789 Aug 25 13:43:05.475196 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2774/5601] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:05 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:06.512803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-04323fa7-1423-4cac-aced-1aaa9b8cb79b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:06.517291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-04323fa7-1423-4cac-aced-1aaa9b8cb79b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:06.738826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-04323fa7-1423-4cac-aced-1aaa9b8cb79b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:06.769900 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-04323fa7-1423-4cac-aced-1aaa9b8cb79b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1266 microversion: 2.1 time: 0.264500 Aug 25 13:43:06.784943 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2828/5602] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:06 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:07.834508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d637cb40-77d5-490d-a0c9-6dcc36ccce0e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:07.842114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d637cb40-77d5-490d-a0c9-6dcc36ccce0e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:07.879487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d637cb40-77d5-490d-a0c9-6dcc36ccce0e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:07.881448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d637cb40-77d5-490d-a0c9-6dcc36ccce0e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:07.882602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d637cb40-77d5-490d-a0c9-6dcc36ccce0e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:07.884472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d637cb40-77d5-490d-a0c9-6dcc36ccce0e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:07.885816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d637cb40-77d5-490d-a0c9-6dcc36ccce0e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:07.887303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d637cb40-77d5-490d-a0c9-6dcc36ccce0e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:08.181547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d637cb40-77d5-490d-a0c9-6dcc36ccce0e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:08.209176 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d637cb40-77d5-490d-a0c9-6dcc36ccce0e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1326 microversion: 2.1 time: 0.385832 Aug 25 13:43:08.214684 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2775/5603] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:07 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1326 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:09.258970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-495a127f-0678-4612-a533-4d7b68ad7746 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:09.260184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-495a127f-0678-4612-a533-4d7b68ad7746 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:09.291106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-495a127f-0678-4612-a533-4d7b68ad7746 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:09.292554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-495a127f-0678-4612-a533-4d7b68ad7746 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:09.302827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-495a127f-0678-4612-a533-4d7b68ad7746 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:09.304874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-495a127f-0678-4612-a533-4d7b68ad7746 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:09.306391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-495a127f-0678-4612-a533-4d7b68ad7746 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:09.308000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-495a127f-0678-4612-a533-4d7b68ad7746 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:09.521929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-495a127f-0678-4612-a533-4d7b68ad7746 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:09.577527 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-495a127f-0678-4612-a533-4d7b68ad7746 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1324 microversion: 2.1 time: 0.326206 Aug 25 13:43:09.611469 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2829/5604] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:09 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:10.648531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fbc47b45-8897-4072-805b-ef4be1963853 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:10.652614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fbc47b45-8897-4072-805b-ef4be1963853 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:10.690801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbc47b45-8897-4072-805b-ef4be1963853 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:10.691837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbc47b45-8897-4072-805b-ef4be1963853 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:10.694065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbc47b45-8897-4072-805b-ef4be1963853 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:10.701468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbc47b45-8897-4072-805b-ef4be1963853 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:10.703085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbc47b45-8897-4072-805b-ef4be1963853 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:10.704842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbc47b45-8897-4072-805b-ef4be1963853 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:11.546209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fbc47b45-8897-4072-805b-ef4be1963853 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:11.569425 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fbc47b45-8897-4072-805b-ef4be1963853 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1391 microversion: 2.1 time: 0.932821 Aug 25 13:43:11.572105 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2776/5605] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:10 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1391 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:12.614998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d3763121-9b83-4cd7-b326-d8d7bfc6235e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:12.622452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d3763121-9b83-4cd7-b326-d8d7bfc6235e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:12.674953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3763121-9b83-4cd7-b326-d8d7bfc6235e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:12.676402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3763121-9b83-4cd7-b326-d8d7bfc6235e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:12.679552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3763121-9b83-4cd7-b326-d8d7bfc6235e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:12.695748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3763121-9b83-4cd7-b326-d8d7bfc6235e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:12.697297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3763121-9b83-4cd7-b326-d8d7bfc6235e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:12.699401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3763121-9b83-4cd7-b326-d8d7bfc6235e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:13.090005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7cf0491b-2a2c-44c4-aeef-de30c887a067 req-701b1554-57f7-41a9-a699-7f626c3e9ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6658fa88-0502-4a02-8d35-b006b602b116", "tag": "8f59cb30-8327-4cc8-9066-ea4560db24d0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:13.156126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7cf0491b-2a2c-44c4-aeef-de30c887a067 req-701b1554-57f7-41a9-a699-7f626c3e9ab0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:13.158954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7cf0491b-2a2c-44c4-aeef-de30c887a067 req-701b1554-57f7-41a9-a699-7f626c3e9ab0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:13.164630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7cf0491b-2a2c-44c4-aeef-de30c887a067 req-701b1554-57f7-41a9-a699-7f626c3e9ab0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:13.243266 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7cf0491b-2a2c-44c4-aeef-de30c887a067 req-701b1554-57f7-41a9-a699-7f626c3e9ab0 service nova] Creating event network-changed:8f59cb30-8327-4cc8-9066-ea4560db24d0 for instance 6658fa88-0502-4a02-8d35-b006b602b116 on n-h1-852771-8 Aug 25 13:43:13.262876 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7cf0491b-2a2c-44c4-aeef-de30c887a067 req-701b1554-57f7-41a9-a699-7f626c3e9ab0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190645 Aug 25 13:43:13.265674 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2777/5606] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:13.460847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d3763121-9b83-4cd7-b326-d8d7bfc6235e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:13.495419 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d3763121-9b83-4cd7-b326-d8d7bfc6235e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1391 microversion: 2.1 time: 0.891592 Aug 25 13:43:13.496798 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2830/5607] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:12 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1391 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:14.542842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-82e3fbff-b97d-44cb-9453-4d5bbde21c17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:14.550238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-82e3fbff-b97d-44cb-9453-4d5bbde21c17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:14.568304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e3fbff-b97d-44cb-9453-4d5bbde21c17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:14.569685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e3fbff-b97d-44cb-9453-4d5bbde21c17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:14.570871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e3fbff-b97d-44cb-9453-4d5bbde21c17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:14.572345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e3fbff-b97d-44cb-9453-4d5bbde21c17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:14.573300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e3fbff-b97d-44cb-9453-4d5bbde21c17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:14.574195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82e3fbff-b97d-44cb-9453-4d5bbde21c17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:15.311282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-82e3fbff-b97d-44cb-9453-4d5bbde21c17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:15.345534 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-82e3fbff-b97d-44cb-9453-4d5bbde21c17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1391 microversion: 2.1 time: 0.810164 Aug 25 13:43:15.347386 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2778/5608] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:14 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1391 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:43:16.393793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:16.409984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce17582c-ddb1-45ce-8bff-98c64e38f67a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:16.411230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ce17582c-ddb1-45ce-8bff-98c64e38f67a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:16.430559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce17582c-ddb1-45ce-8bff-98c64e38f67a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:16.432818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce17582c-ddb1-45ce-8bff-98c64e38f67a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:16.434097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce17582c-ddb1-45ce-8bff-98c64e38f67a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:16.436308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce17582c-ddb1-45ce-8bff-98c64e38f67a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:16.437818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce17582c-ddb1-45ce-8bff-98c64e38f67a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:16.438872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce17582c-ddb1-45ce-8bff-98c64e38f67a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:16.761202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:16.928587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ce17582c-ddb1-45ce-8bff-98c64e38f67a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:16.951483 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce17582c-ddb1-45ce-8bff-98c64e38f67a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1391 microversion: 2.1 time: 0.566972 Aug 25 13:43:16.952690 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2831/5609] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:16 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1391 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:18.026222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-28bb31dc-d1ed-44b4-8420-ba7a54b6e3bc tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:18.027606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-28bb31dc-d1ed-44b4-8420-ba7a54b6e3bc tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:18.032593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:18.070629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28bb31dc-d1ed-44b4-8420-ba7a54b6e3bc tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:18.074126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28bb31dc-d1ed-44b4-8420-ba7a54b6e3bc tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:18.075103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28bb31dc-d1ed-44b4-8420-ba7a54b6e3bc tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:18.076510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28bb31dc-d1ed-44b4-8420-ba7a54b6e3bc tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:18.077423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28bb31dc-d1ed-44b4-8420-ba7a54b6e3bc tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:18.087490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28bb31dc-d1ed-44b4-8420-ba7a54b6e3bc tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:18.879428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-28bb31dc-d1ed-44b4-8420-ba7a54b6e3bc tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:18.925722 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-28bb31dc-d1ed-44b4-8420-ba7a54b6e3bc tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1391 microversion: 2.1 time: 0.925092 Aug 25 13:43:18.932553 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2779/5610] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:17 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1391 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:20.002359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a6824057-4077-42c6-9f99-86d0ac36672f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:20.004944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a6824057-4077-42c6-9f99-86d0ac36672f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:20.034424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6824057-4077-42c6-9f99-86d0ac36672f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:20.035505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6824057-4077-42c6-9f99-86d0ac36672f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:20.038845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6824057-4077-42c6-9f99-86d0ac36672f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:20.040403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6824057-4077-42c6-9f99-86d0ac36672f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:20.041385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6824057-4077-42c6-9f99-86d0ac36672f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:20.042500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6824057-4077-42c6-9f99-86d0ac36672f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:20.578651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a6824057-4077-42c6-9f99-86d0ac36672f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:20.613535 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a6824057-4077-42c6-9f99-86d0ac36672f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1391 microversion: 2.1 time: 0.640697 Aug 25 13:43:20.615012 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2832/5611] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:19 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1391 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:21.670027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e4131e91-91ca-401b-aeb6-02ef74d7e598 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:21.672937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e4131e91-91ca-401b-aeb6-02ef74d7e598 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:21.696636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4131e91-91ca-401b-aeb6-02ef74d7e598 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:21.700020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4131e91-91ca-401b-aeb6-02ef74d7e598 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:21.701781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4131e91-91ca-401b-aeb6-02ef74d7e598 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:21.703943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4131e91-91ca-401b-aeb6-02ef74d7e598 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:21.705926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4131e91-91ca-401b-aeb6-02ef74d7e598 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:21.707481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4131e91-91ca-401b-aeb6-02ef74d7e598 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:22.331525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e4131e91-91ca-401b-aeb6-02ef74d7e598 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:22.405367 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e4131e91-91ca-401b-aeb6-02ef74d7e598 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1391 microversion: 2.1 time: 0.728945 Aug 25 13:43:22.406725 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2780/5612] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:21 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1391 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:23.302893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f6d3161b-b1fb-4db4-aae6-21ccf968b51e req-94ee056f-2c22-4b30-a0e6-cb6cb9f6b4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6658fa88-0502-4a02-8d35-b006b602b116", "name": "network-vif-plugged", "status": "completed", "tag": "8f59cb30-8327-4cc8-9066-ea4560db24d0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:23.363132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f6d3161b-b1fb-4db4-aae6-21ccf968b51e req-94ee056f-2c22-4b30-a0e6-cb6cb9f6b4cd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:23.364051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f6d3161b-b1fb-4db4-aae6-21ccf968b51e req-94ee056f-2c22-4b30-a0e6-cb6cb9f6b4cd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:23.364879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f6d3161b-b1fb-4db4-aae6-21ccf968b51e req-94ee056f-2c22-4b30-a0e6-cb6cb9f6b4cd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:23.440278 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f6d3161b-b1fb-4db4-aae6-21ccf968b51e req-94ee056f-2c22-4b30-a0e6-cb6cb9f6b4cd service nova] Creating event network-vif-plugged:8f59cb30-8327-4cc8-9066-ea4560db24d0 for instance 6658fa88-0502-4a02-8d35-b006b602b116 on n-h1-852771-8 Aug 25 13:43:23.456464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-be9f1176-93d4-40ee-b507-d5265e571761 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:23.457902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-be9f1176-93d4-40ee-b507-d5265e571761 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:23.468338 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f6d3161b-b1fb-4db4-aae6-21ccf968b51e req-94ee056f-2c22-4b30-a0e6-cb6cb9f6b4cd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166499 Aug 25 13:43:23.470094 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2833/5613] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:23.521463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be9f1176-93d4-40ee-b507-d5265e571761 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:23.522461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be9f1176-93d4-40ee-b507-d5265e571761 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:23.523302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be9f1176-93d4-40ee-b507-d5265e571761 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:23.524746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be9f1176-93d4-40ee-b507-d5265e571761 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:23.533994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be9f1176-93d4-40ee-b507-d5265e571761 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:23.537070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-be9f1176-93d4-40ee-b507-d5265e571761 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:24.130413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-be9f1176-93d4-40ee-b507-d5265e571761 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:24.153898 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-be9f1176-93d4-40ee-b507-d5265e571761 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1391 microversion: 2.1 time: 0.717900 Aug 25 13:43:24.175000 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2781/5614] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:23 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1391 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:25.197197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c87f4d7-1123-42f7-a3ce-a803692780d7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:25.198627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c87f4d7-1123-42f7-a3ce-a803692780d7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:25.247323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c87f4d7-1123-42f7-a3ce-a803692780d7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:25.251975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c87f4d7-1123-42f7-a3ce-a803692780d7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:25.259035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c87f4d7-1123-42f7-a3ce-a803692780d7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:25.259857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c87f4d7-1123-42f7-a3ce-a803692780d7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:25.260352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c87f4d7-1123-42f7-a3ce-a803692780d7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:25.260920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c87f4d7-1123-42f7-a3ce-a803692780d7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:25.780288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0c87f4d7-1123-42f7-a3ce-a803692780d7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:25.818834 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c87f4d7-1123-42f7-a3ce-a803692780d7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1391 microversion: 2.1 time: 0.630168 Aug 25 13:43:25.823346 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2834/5615] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:25 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1391 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:43:26.867269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-024cd734-9486-4c22-bac3-8dff6ee24c21 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:26.871460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-024cd734-9486-4c22-bac3-8dff6ee24c21 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:26.894861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024cd734-9486-4c22-bac3-8dff6ee24c21 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:26.899447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024cd734-9486-4c22-bac3-8dff6ee24c21 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:26.900902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024cd734-9486-4c22-bac3-8dff6ee24c21 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:26.904924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024cd734-9486-4c22-bac3-8dff6ee24c21 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:26.923589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024cd734-9486-4c22-bac3-8dff6ee24c21 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:26.926759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024cd734-9486-4c22-bac3-8dff6ee24c21 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:27.861526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-024cd734-9486-4c22-bac3-8dff6ee24c21 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:27.889943 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-024cd734-9486-4c22-bac3-8dff6ee24c21 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1562 microversion: 2.1 time: 1.033786 Aug 25 13:43:27.893255 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2782/5616] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:26 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1562 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:27.934315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e31e2d4d-56a4-479b-b22f-36624878deb2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:27.936498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e31e2d4d-56a4-479b-b22f-36624878deb2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:27.948102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e31e2d4d-56a4-479b-b22f-36624878deb2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:27.949018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e31e2d4d-56a4-479b-b22f-36624878deb2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:27.949718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e31e2d4d-56a4-479b-b22f-36624878deb2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:27.950770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e31e2d4d-56a4-479b-b22f-36624878deb2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:27.951465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e31e2d4d-56a4-479b-b22f-36624878deb2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:27.955799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e31e2d4d-56a4-479b-b22f-36624878deb2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:28.510162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e31e2d4d-56a4-479b-b22f-36624878deb2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:28.510162 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e31e2d4d-56a4-479b-b22f-36624878deb2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1562 microversion: 2.1 time: 0.578578 Aug 25 13:43:28.510162 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2835/5617] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:27 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1562 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:43:31.785950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bf356eb3-1444-4fc7-a371-5cb1088d5a06 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:31.787610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bf356eb3-1444-4fc7-a371-5cb1088d5a06 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:31.811842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf356eb3-1444-4fc7-a371-5cb1088d5a06 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:31.826666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf356eb3-1444-4fc7-a371-5cb1088d5a06 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:31.827433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf356eb3-1444-4fc7-a371-5cb1088d5a06 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:31.828855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf356eb3-1444-4fc7-a371-5cb1088d5a06 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:31.829789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf356eb3-1444-4fc7-a371-5cb1088d5a06 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:31.830577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bf356eb3-1444-4fc7-a371-5cb1088d5a06 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:31.947296 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bf356eb3-1444-4fc7-a371-5cb1088d5a06 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/ips" status: 200 len: 151 microversion: 2.1 time: 0.168826 Aug 25 13:43:31.960130 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2783/5618] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Aug 25 13:43:31 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/ips => generated 151 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:33.430127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-65613d15-9cdd-463d-a758-caac78e0f900 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:33.431256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-65613d15-9cdd-463d-a758-caac78e0f900 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:33.440050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-484f03da-01bd-401d-b4dd-e6e7fbe6d47a req-dc068fe4-af5c-4ecf-b367-e78ad486c4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6658fa88-0502-4a02-8d35-b006b602b116", "tag": "8f59cb30-8327-4cc8-9066-ea4560db24d0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:33.465125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-484f03da-01bd-401d-b4dd-e6e7fbe6d47a req-dc068fe4-af5c-4ecf-b367-e78ad486c4b7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:33.465960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-484f03da-01bd-401d-b4dd-e6e7fbe6d47a req-dc068fe4-af5c-4ecf-b367-e78ad486c4b7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:33.466938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-484f03da-01bd-401d-b4dd-e6e7fbe6d47a req-dc068fe4-af5c-4ecf-b367-e78ad486c4b7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:33.490271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65613d15-9cdd-463d-a758-caac78e0f900 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:33.491253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65613d15-9cdd-463d-a758-caac78e0f900 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:33.492059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65613d15-9cdd-463d-a758-caac78e0f900 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:33.493464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65613d15-9cdd-463d-a758-caac78e0f900 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:33.494419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65613d15-9cdd-463d-a758-caac78e0f900 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:33.501094 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-484f03da-01bd-401d-b4dd-e6e7fbe6d47a req-dc068fe4-af5c-4ecf-b367-e78ad486c4b7 service nova] Creating event network-changed:8f59cb30-8327-4cc8-9066-ea4560db24d0 for instance 6658fa88-0502-4a02-8d35-b006b602b116 on n-h1-852771-8 Aug 25 13:43:33.502754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65613d15-9cdd-463d-a758-caac78e0f900 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:33.510567 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-484f03da-01bd-401d-b4dd-e6e7fbe6d47a req-dc068fe4-af5c-4ecf-b367-e78ad486c4b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079061 Aug 25 13:43:33.516189 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2784/5619] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:43:33.530816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=41 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:34.101479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-65613d15-9cdd-463d-a758-caac78e0f900 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:34.135512 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-65613d15-9cdd-463d-a758-caac78e0f900 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1562 microversion: 2.1 time: 0.712146 Aug 25 13:43:34.164471 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2836/5620] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:33 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1562 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:43:36.872908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7ccb86ce-42fb-48cc-bfe9-ab969ef21f0b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92706114-c7e0-4943-87e7-b17df366cdba"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:36.876599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7ccb86ce-42fb-48cc-bfe9-ab969ef21f0b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:36.881630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=25 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:36.921456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ccb86ce-42fb-48cc-bfe9-ab969ef21f0b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:36.929354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ccb86ce-42fb-48cc-bfe9-ab969ef21f0b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:36.930861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ccb86ce-42fb-48cc-bfe9-ab969ef21f0b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:36.943503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ccb86ce-42fb-48cc-bfe9-ab969ef21f0b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:36.947169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ccb86ce-42fb-48cc-bfe9-ab969ef21f0b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:36.953790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7ccb86ce-42fb-48cc-bfe9-ab969ef21f0b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:36.986130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=51 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:37.519392 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7ccb86ce-42fb-48cc-bfe9-ab969ef21f0b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "POST /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.650760 Aug 25 13:43:37.523548 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2785/5621] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:43:36 2022] POST /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:55.013152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d76a20b9-f346-4d07-b81f-f5def8c325eb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:55.014970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d76a20b9-f346-4d07-b81f-f5def8c325eb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:55.024311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:55.025791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=5 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:55.027982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76a20b9-f346-4d07-b81f-f5def8c325eb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:55.028880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76a20b9-f346-4d07-b81f-f5def8c325eb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:55.029548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76a20b9-f346-4d07-b81f-f5def8c325eb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:55.030519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76a20b9-f346-4d07-b81f-f5def8c325eb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:55.031164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76a20b9-f346-4d07-b81f-f5def8c325eb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:55.031762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d76a20b9-f346-4d07-b81f-f5def8c325eb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:55.236943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-d76a20b9-f346-4d07-b81f-f5def8c325eb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lazy-loading 'services' on Instance uuid f3783384-6fff-4126-89ff-bb6c09fca26b {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:43:55.374849 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d76a20b9-f346-4d07-b81f-f5def8c325eb tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments/92706114-c7e0-4943-87e7-b17df366cdba" status: 202 len: 0 microversion: 2.1 time: 0.367145 Aug 25 13:43:55.376201 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2837/5622] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:43:55 2022] DELETE /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments/92706114-c7e0-4943-87e7-b17df366cdba => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:43:55.390497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a9b2bfee-57d9-483d-8ae6-fe9a113155e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:55.396536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a9b2bfee-57d9-483d-8ae6-fe9a113155e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:55.403843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:55.405784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:55.427304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9b2bfee-57d9-483d-8ae6-fe9a113155e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:55.432594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9b2bfee-57d9-483d-8ae6-fe9a113155e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:55.434280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9b2bfee-57d9-483d-8ae6-fe9a113155e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:55.435457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9b2bfee-57d9-483d-8ae6-fe9a113155e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:55.436074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9b2bfee-57d9-483d-8ae6-fe9a113155e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:55.436653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9b2bfee-57d9-483d-8ae6-fe9a113155e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:55.484431 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a9b2bfee-57d9-483d-8ae6-fe9a113155e8 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101296 Aug 25 13:43:55.485679 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2786/5623] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:43:55 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:43:56.506789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-598cfc21-1d82-491d-96ff-bc4d339675d6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:56.512884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-598cfc21-1d82-491d-96ff-bc4d339675d6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:56.528494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598cfc21-1d82-491d-96ff-bc4d339675d6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:56.529806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598cfc21-1d82-491d-96ff-bc4d339675d6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:56.530790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598cfc21-1d82-491d-96ff-bc4d339675d6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:56.532164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598cfc21-1d82-491d-96ff-bc4d339675d6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:56.533119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598cfc21-1d82-491d-96ff-bc4d339675d6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:56.534074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-598cfc21-1d82-491d-96ff-bc4d339675d6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:56.584228 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-598cfc21-1d82-491d-96ff-bc4d339675d6 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084468 Aug 25 13:43:56.585097 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2838/5624] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:43:56 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:57.599742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b9a1398-ea85-4afc-9ccf-a4f8c0e4ff8b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:57.602142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b9a1398-ea85-4afc-9ccf-a4f8c0e4ff8b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:57.616335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b9a1398-ea85-4afc-9ccf-a4f8c0e4ff8b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:57.616840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b9a1398-ea85-4afc-9ccf-a4f8c0e4ff8b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:57.617298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b9a1398-ea85-4afc-9ccf-a4f8c0e4ff8b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:57.618024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b9a1398-ea85-4afc-9ccf-a4f8c0e4ff8b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:57.618490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b9a1398-ea85-4afc-9ccf-a4f8c0e4ff8b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:57.618925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b9a1398-ea85-4afc-9ccf-a4f8c0e4ff8b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:57.688711 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b9a1398-ea85-4afc-9ccf-a4f8c0e4ff8b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092775 Aug 25 13:43:57.690588 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2787/5625] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:43:57 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:58.703757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bba134ed-49da-46ec-90dc-ef9d13406e98 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:58.706421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bba134ed-49da-46ec-90dc-ef9d13406e98 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:58.718303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba134ed-49da-46ec-90dc-ef9d13406e98 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:58.718822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba134ed-49da-46ec-90dc-ef9d13406e98 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:58.719312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba134ed-49da-46ec-90dc-ef9d13406e98 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:58.720969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba134ed-49da-46ec-90dc-ef9d13406e98 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:58.720969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba134ed-49da-46ec-90dc-ef9d13406e98 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:58.720969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba134ed-49da-46ec-90dc-ef9d13406e98 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:58.776195 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bba134ed-49da-46ec-90dc-ef9d13406e98 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077267 Aug 25 13:43:58.777097 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2839/5626] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:43:58 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:59.883514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a516e50-2e83-43e2-a44f-6976f0e99fda tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:59.888362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a516e50-2e83-43e2-a44f-6976f0e99fda tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:59.902179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a516e50-2e83-43e2-a44f-6976f0e99fda tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:59.903631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a516e50-2e83-43e2-a44f-6976f0e99fda tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:59.904508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a516e50-2e83-43e2-a44f-6976f0e99fda tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:59.906197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a516e50-2e83-43e2-a44f-6976f0e99fda tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:59.907416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a516e50-2e83-43e2-a44f-6976f0e99fda tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:59.908658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a516e50-2e83-43e2-a44f-6976f0e99fda tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:59.975431 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a516e50-2e83-43e2-a44f-6976f0e99fda tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100259 Aug 25 13:43:59.977420 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2788/5627] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:43:59 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:00.996381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3e93af2b-a42c-4766-87ef-0fa0486544aa tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:01.002547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3e93af2b-a42c-4766-87ef-0fa0486544aa tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:01.018161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e93af2b-a42c-4766-87ef-0fa0486544aa tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:01.019330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e93af2b-a42c-4766-87ef-0fa0486544aa tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:01.020777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e93af2b-a42c-4766-87ef-0fa0486544aa tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:01.022048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e93af2b-a42c-4766-87ef-0fa0486544aa tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:01.022699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e93af2b-a42c-4766-87ef-0fa0486544aa tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:01.023290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3e93af2b-a42c-4766-87ef-0fa0486544aa tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:01.095577 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3e93af2b-a42c-4766-87ef-0fa0486544aa tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105756 Aug 25 13:44:01.105080 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2840/5628] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:44:00 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:01.228572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f9e9e09b-864b-4f26-821a-56d07f3d6f63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:01.234446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f9e9e09b-864b-4f26-821a-56d07f3d6f63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:01.265456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e9e09b-864b-4f26-821a-56d07f3d6f63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:01.268324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e9e09b-864b-4f26-821a-56d07f3d6f63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:01.269310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e9e09b-864b-4f26-821a-56d07f3d6f63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:01.270778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e9e09b-864b-4f26-821a-56d07f3d6f63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:01.271645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e9e09b-864b-4f26-821a-56d07f3d6f63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:01.272753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e9e09b-864b-4f26-821a-56d07f3d6f63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:01.388117 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f9e9e09b-864b-4f26-821a-56d07f3d6f63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116/action" status: 200 len: 24572 microversion: 2.1 time: 0.167724 Aug 25 13:44:01.389432 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2789/5629] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:44:01 2022] POST /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116/action => generated 24572 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:44:02.114337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fd905c8a-1f5c-425e-a129-2ba99c6afd2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:02.117879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fd905c8a-1f5c-425e-a129-2ba99c6afd2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:02.128439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd905c8a-1f5c-425e-a129-2ba99c6afd2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:02.129717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd905c8a-1f5c-425e-a129-2ba99c6afd2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:02.130440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd905c8a-1f5c-425e-a129-2ba99c6afd2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:02.131861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd905c8a-1f5c-425e-a129-2ba99c6afd2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:02.132568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd905c8a-1f5c-425e-a129-2ba99c6afd2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:02.133215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd905c8a-1f5c-425e-a129-2ba99c6afd2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:02.187556 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fd905c8a-1f5c-425e-a129-2ba99c6afd2d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079190 Aug 25 13:44:02.189897 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2841/5630] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:44:02 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:03.204172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-63d4984f-0f0d-43f1-bbde-cfadb633f235 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:03.206925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-63d4984f-0f0d-43f1-bbde-cfadb633f235 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:03.233110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63d4984f-0f0d-43f1-bbde-cfadb633f235 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:03.234051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63d4984f-0f0d-43f1-bbde-cfadb633f235 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:03.235215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63d4984f-0f0d-43f1-bbde-cfadb633f235 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:03.235952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63d4984f-0f0d-43f1-bbde-cfadb633f235 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:03.236521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63d4984f-0f0d-43f1-bbde-cfadb633f235 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:03.237645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-63d4984f-0f0d-43f1-bbde-cfadb633f235 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:03.305417 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-63d4984f-0f0d-43f1-bbde-cfadb633f235 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106272 Aug 25 13:44:03.306573 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2790/5631] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:44:03 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:44:04.329724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75acb62d-54e9-4fcf-a33d-68de461f6b07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:04.334841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-75acb62d-54e9-4fcf-a33d-68de461f6b07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:04.347157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75acb62d-54e9-4fcf-a33d-68de461f6b07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:04.350548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75acb62d-54e9-4fcf-a33d-68de461f6b07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:04.351655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75acb62d-54e9-4fcf-a33d-68de461f6b07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:04.353433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75acb62d-54e9-4fcf-a33d-68de461f6b07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:04.356627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75acb62d-54e9-4fcf-a33d-68de461f6b07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:04.357419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75acb62d-54e9-4fcf-a33d-68de461f6b07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:04.432638 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-75acb62d-54e9-4fcf-a33d-68de461f6b07 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111895 Aug 25 13:44:04.434108 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2842/5632] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 13:44:04 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:44:04.560994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7452c80e-5fea-4ca0-a374-fbdf22ebb4b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:04.562234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7452c80e-5fea-4ca0-a374-fbdf22ebb4b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:04.579618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7452c80e-5fea-4ca0-a374-fbdf22ebb4b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:04.580702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7452c80e-5fea-4ca0-a374-fbdf22ebb4b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:04.581789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7452c80e-5fea-4ca0-a374-fbdf22ebb4b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:04.583535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7452c80e-5fea-4ca0-a374-fbdf22ebb4b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:04.584770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7452c80e-5fea-4ca0-a374-fbdf22ebb4b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:04.585762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7452c80e-5fea-4ca0-a374-fbdf22ebb4b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:04.641336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7452c80e-5fea-4ca0-a374-fbdf22ebb4b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:44:04.805909 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7452c80e-5fea-4ca0-a374-fbdf22ebb4b4 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 204 len: 0 microversion: 2.1 time: 0.248153 Aug 25 13:44:04.810165 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2791/5633] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:44:04 2022] DELETE /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:44:04.823876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7f48191f-509c-4853-b629-427478688458 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:04.825207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7f48191f-509c-4853-b629-427478688458 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:04.838706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f48191f-509c-4853-b629-427478688458 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:04.840290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f48191f-509c-4853-b629-427478688458 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:04.841438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f48191f-509c-4853-b629-427478688458 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:04.842882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f48191f-509c-4853-b629-427478688458 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:04.843740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f48191f-509c-4853-b629-427478688458 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:04.844477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7f48191f-509c-4853-b629-427478688458 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:05.043245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7f48191f-509c-4853-b629-427478688458 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:05.058051 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7f48191f-509c-4853-b629-427478688458 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1682 microversion: 2.1 time: 0.241846 Aug 25 13:44:05.059540 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2843/5634] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:04 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1682 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:06.085482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d619b28b-1cb5-4fa3-8383-29bfa3f4d890 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:06.087291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d619b28b-1cb5-4fa3-8383-29bfa3f4d890 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:06.122670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d619b28b-1cb5-4fa3-8383-29bfa3f4d890 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:06.123895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d619b28b-1cb5-4fa3-8383-29bfa3f4d890 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:06.124960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d619b28b-1cb5-4fa3-8383-29bfa3f4d890 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:06.129750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d619b28b-1cb5-4fa3-8383-29bfa3f4d890 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:06.131490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d619b28b-1cb5-4fa3-8383-29bfa3f4d890 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:06.132820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d619b28b-1cb5-4fa3-8383-29bfa3f4d890 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:06.389906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d619b28b-1cb5-4fa3-8383-29bfa3f4d890 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:06.406628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d619b28b-1cb5-4fa3-8383-29bfa3f4d890 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1682 microversion: 2.1 time: 0.328586 Aug 25 13:44:06.412244 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2792/5635] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:06 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1682 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:07.453216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47ba1543-26f7-4d8f-839e-5796c9af2689 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:07.454636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-47ba1543-26f7-4d8f-839e-5796c9af2689 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:07.466907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ba1543-26f7-4d8f-839e-5796c9af2689 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:07.467448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ba1543-26f7-4d8f-839e-5796c9af2689 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:07.467896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ba1543-26f7-4d8f-839e-5796c9af2689 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:07.468675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ba1543-26f7-4d8f-839e-5796c9af2689 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:07.469445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ba1543-26f7-4d8f-839e-5796c9af2689 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:07.470129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ba1543-26f7-4d8f-839e-5796c9af2689 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:07.686470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-47ba1543-26f7-4d8f-839e-5796c9af2689 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:07.703199 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47ba1543-26f7-4d8f-839e-5796c9af2689 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1615 microversion: 2.1 time: 0.254637 Aug 25 13:44:07.705920 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2844/5636] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:07 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1615 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:08.411583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c08f9c0f-c156-499a-89d2-8ada1f53efda req-17f6c1bf-243a-4d24-80ea-bf62854bd9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3783384-6fff-4126-89ff-bb6c09fca26b", "name": "network-vif-deleted", "tag": "cbe27a5c-c800-4e8b-bc99-893d19430281"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:08.434771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c08f9c0f-c156-499a-89d2-8ada1f53efda req-17f6c1bf-243a-4d24-80ea-bf62854bd9a7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:08.435736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c08f9c0f-c156-499a-89d2-8ada1f53efda req-17f6c1bf-243a-4d24-80ea-bf62854bd9a7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:08.436457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c08f9c0f-c156-499a-89d2-8ada1f53efda req-17f6c1bf-243a-4d24-80ea-bf62854bd9a7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:08.456865 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c08f9c0f-c156-499a-89d2-8ada1f53efda req-17f6c1bf-243a-4d24-80ea-bf62854bd9a7 service nova] Creating event network-vif-deleted:cbe27a5c-c800-4e8b-bc99-893d19430281 for instance f3783384-6fff-4126-89ff-bb6c09fca26b on n-h2-852771-8 Aug 25 13:44:08.463490 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c08f9c0f-c156-499a-89d2-8ada1f53efda req-17f6c1bf-243a-4d24-80ea-bf62854bd9a7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.419170 Aug 25 13:44:08.465343 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2793/5637] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:08.749332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:08.755648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:08.780355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:08.782558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:08.783702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:08.785959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:08.787789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:08.789008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:08.880185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:08.880985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:08.881664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:08.882432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lazy-loading 'fault' on Instance uuid f3783384-6fff-4126-89ff-bb6c09fca26b {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:44:08.999154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fdce9f6d624473be8244e28eb215e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c97afb76ae4d0ba3e14f8b23a8d1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:09.017989 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c507dbd6-87af-4528-a4e2-c9de0a3e6bb7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 200 len: 1331 microversion: 2.1 time: 0.276949 Aug 25 13:44:09.030653 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2845/5638] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:08 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 1331 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:10.069428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:10.071864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:10.086210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:10.087505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:10.088622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:10.090121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:10.091201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:10.092108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:10.120474 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b HTTP/1.1 Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'f3783384-6fff-4126-89ff-bb6c09fca26b'} Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:10.122607 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:10.127729 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:10.127729 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:10.127729 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:10.127729 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:44:10.127729 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:44:10.127729 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:10.127729 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:10.127729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:44:10.129678 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1565fab1-1655-42c3-9b8e-225430eb483b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 404 len: 111 microversion: 2.1 time: 0.068563 Aug 25 13:44:10.130573 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2794/5639] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:10 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:44:10.147992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-46ea33ef-3047-411b-9061-7755f1384521 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '.version_select at 0x7f3a29337b80>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:10.179777 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-46ea33ef-3047-411b-9061-7755f1384521 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876950097" status: 202 len: 0 microversion: 2.1 time: 0.043884 Aug 25 13:44:10.180536 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2846/5640] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Aug 25 13:44:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876950097 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:44:15.741583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:15.743666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:15.756753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:15.758091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:15.761016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:15.762171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:15.762889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:15.764447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:15.805568 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b HTTP/1.1 Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'f3783384-6fff-4126-89ff-bb6c09fca26b'} Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:44:15.817110 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a7a6bc02-117c-46cf-a696-a673a65feb5b tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 404 len: 111 microversion: 2.1 time: 0.083853 Aug 25 13:44:15.834207 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2795/5641] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:44:15 2022] DELETE /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:44:15.839829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:15.839829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: f3783384-6fff-4126-89ff-bb6c09fca26b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:15.852516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:15.854439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:15.855848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:15.857369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:15.858503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:15.860165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:15.903924 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b HTTP/1.1 Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'f3783384-6fff-4126-89ff-bb6c09fca26b'} Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:15.906719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:15.911154 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:15.911154 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:15.911154 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:15.911154 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:44:15.911154 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:44:15.911154 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. Aug 25 13:44:15.911154 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:15.913190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance f3783384-6fff-4126-89ff-bb6c09fca26b could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:44:15.914361 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-efac1e34-0fc2-4748-8bfd-b414407e5e2a tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b" status: 404 len: 111 microversion: 2.1 time: 0.087912 Aug 25 13:44:15.915796 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2847/5642] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:15 2022] GET /compute/v2.1/servers/f3783384-6fff-4126-89ff-bb6c09fca26b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:44:20.583480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:20.593773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:20.606709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:20.608100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:20.609318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:20.618093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:20.619173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:20.619870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:20.647715 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 HTTP/1.1 Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '3ad98a18-8328-4972-a028-5e75187fb027'} Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:44:20.651133 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:44:20.656741 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.660232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:44:20.662623 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6446d1be-4834-4d6a-b1ac-a321e9590e48 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 404 len: 111 microversion: 2.1 time: 0.086955 Aug 25 13:44:20.668442 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2796/5643] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:44:20 2022] DELETE /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:44:20.678671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:20.682956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 3ad98a18-8328-4972-a028-5e75187fb027] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:20.699891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:20.701148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:20.701849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:20.704515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:20.705367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:20.706002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:20.726105 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 HTTP/1.1 Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '3ad98a18-8328-4972-a028-5e75187fb027'} Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:20.728097 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.731473 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.731473 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:20.731473 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:20.731473 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:44:20.731473 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:44:20.731473 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. Aug 25 13:44:20.731473 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.733537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance 3ad98a18-8328-4972-a028-5e75187fb027 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:44:20.734710 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-556e2f34-be07-46e2-99b4-f987a6eed589 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027" status: 404 len: 111 microversion: 2.1 time: 0.064954 Aug 25 13:44:20.735871 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2848/5644] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:20 2022] GET /compute/v2.1/servers/3ad98a18-8328-4972-a028-5e75187fb027 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:44:20.745712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:20.746433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:20.753125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:20.754544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:20.754943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:20.755785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:20.756496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:20.757173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:20.773852 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f HTTP/1.1 Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '40057511-8a17-4107-bd91-ec6f0307f92f'} Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:44:20.775586 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:44:20.779360 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.780929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:44:20.781907 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ebeff36f-850f-4aa9-b342-efd6f56baf60 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 404 len: 111 microversion: 2.1 time: 0.040759 Aug 25 13:44:20.782562 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2797/5645] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:44:20 2022] DELETE /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:44:20.794040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:20.794669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 40057511-8a17-4107-bd91-ec6f0307f92f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:20.802164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:20.802674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:20.803128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:20.803904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:20.804413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:20.804853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:20.822200 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f HTTP/1.1 Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '40057511-8a17-4107-bd91-ec6f0307f92f'} Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:20.824003 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.828294 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:20.828294 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:20.828294 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:20.828294 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:44:20.828294 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:44:20.828294 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. Aug 25 13:44:20.828294 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:20.830591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance 40057511-8a17-4107-bd91-ec6f0307f92f could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:44:20.831584 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1dfdd49d-c1ea-4cf2-8882-885d384d3b8d tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f" status: 404 len: 111 microversion: 2.1 time: 0.044167 Aug 25 13:44:20.833100 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2849/5646] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:20 2022] GET /compute/v2.1/servers/40057511-8a17-4107-bd91-ec6f0307f92f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:44:25.341597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:25.360510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:25.372758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:25.373919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:25.375430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:25.377166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:25.378134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:25.379646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:25.408118 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 HTTP/1.1 Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '7840aa88-f6e2-4295-a852-daa4d572f8b3'} Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:44:25.412261 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19a88a66-5f26-46b1-ac36-0558d3efa296 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 404 len: 111 microversion: 2.1 time: 0.085354 Aug 25 13:44:25.418640 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2798/5647] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:44:25 2022] DELETE /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:44:25.425034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:25.426521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] [instance: 7840aa88-f6e2-4295-a852-daa4d572f8b3] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:25.434924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:25.436713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:25.437323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:25.437928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:25.438990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:25.439542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:25.440047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:25.447703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:25.464797 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] HTTP exception thrown: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Request method failure captured: Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 HTTP/1.1 Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3pu7RCnBmsMvvmzZc42hd36xNg4JPopvPzZf24r9fNK8uRfjvBArhos8JpCqLk-HMMpHlbcjv_800SLGVMOhVhKGYRiDfljzCzs98gKpLGO4-D_MfKt5k5FphLWo4gn9JMdgeTkGNyXEiGnNwNoK21U43wK9lh8yrYvsOmPNSGutRg Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_79c97afb76ae4d0ba3e14f8b23a8d1d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/79c97afb76ae4d0ba3e14f8b23a8d1d9"}]}] Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 79c97afb76ae4d0ba3e14f8b23a8d1d9 Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965396398 Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: b7fdce9f6d624473be8244e28eb215e0 Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-AttachVolumeNegativeTest-1965396398-project Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '7840aa88-f6e2-4295-a852-daa4d572f8b3'} Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:25.467197 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:25.471302 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:25.471302 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:25.471302 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:25.471302 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:44:25.471302 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:44:25.471302 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. Aug 25 13:44:25.471302 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:44:25.472727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] Returning 404 to user: Instance 7840aa88-f6e2-4295-a852-daa4d572f8b3 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:44:25.474557 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ed03c72e-a05d-4296-b2ad-5c4a2fe27ac7 tempest-AttachVolumeNegativeTest-1965396398 tempest-AttachVolumeNegativeTest-1965396398-project] 10.222.0.70 "GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3" status: 404 len: 111 microversion: 2.1 time: 0.053697 Aug 25 13:44:25.475810 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2850/5648] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:25 2022] GET /compute/v2.1/servers/7840aa88-f6e2-4295-a852-daa4d572f8b3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:44:31.835926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e49232d8-20a5-4157-a1d7-c717af25b169 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:31.839748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e49232d8-20a5-4157-a1d7-c717af25b169 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:31.844699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:31.871241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e49232d8-20a5-4157-a1d7-c717af25b169 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:31.871762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e49232d8-20a5-4157-a1d7-c717af25b169 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:31.872205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e49232d8-20a5-4157-a1d7-c717af25b169 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:31.886949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e49232d8-20a5-4157-a1d7-c717af25b169 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:31.887984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e49232d8-20a5-4157-a1d7-c717af25b169 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:31.888610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e49232d8-20a5-4157-a1d7-c717af25b169 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:31.899832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:32.482627 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e49232d8-20a5-4157-a1d7-c717af25b169 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1831 microversion: 2.1 time: 0.655209 Aug 25 13:44:32.483410 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2799/5649] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:31 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1831 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:32.561361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4fae5031-7c5f-4b0c-baa6-7c3e0422ef98 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:32.565217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4fae5031-7c5f-4b0c-baa6-7c3e0422ef98 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:32.574227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fae5031-7c5f-4b0c-baa6-7c3e0422ef98 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:32.574823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fae5031-7c5f-4b0c-baa6-7c3e0422ef98 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:32.575429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fae5031-7c5f-4b0c-baa6-7c3e0422ef98 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:32.576736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fae5031-7c5f-4b0c-baa6-7c3e0422ef98 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:32.577309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fae5031-7c5f-4b0c-baa6-7c3e0422ef98 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:32.577901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fae5031-7c5f-4b0c-baa6-7c3e0422ef98 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:32.817161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4fae5031-7c5f-4b0c-baa6-7c3e0422ef98 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:32.837072 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4fae5031-7c5f-4b0c-baa6-7c3e0422ef98 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1680 microversion: 2.1 time: 0.301979 Aug 25 13:44:32.838552 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2851/5650] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:32 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1680 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:32.985430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ad395b6a-1ea2-4329-9d42-33ea4a7a2a66 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:32.989790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ad395b6a-1ea2-4329-9d42-33ea4a7a2a66 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:32.999764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad395b6a-1ea2-4329-9d42-33ea4a7a2a66 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:33.000550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad395b6a-1ea2-4329-9d42-33ea4a7a2a66 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:33.001167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad395b6a-1ea2-4329-9d42-33ea4a7a2a66 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:33.002250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad395b6a-1ea2-4329-9d42-33ea4a7a2a66 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:33.002945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad395b6a-1ea2-4329-9d42-33ea4a7a2a66 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:33.004651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad395b6a-1ea2-4329-9d42-33ea4a7a2a66 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:33.110813 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ad395b6a-1ea2-4329-9d42-33ea4a7a2a66 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116/action" status: 200 len: 32643 microversion: 2.1 time: 0.130876 Aug 25 13:44:33.122867 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2800/5651] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:44:32 2022] POST /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116/action => generated 32643 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:44:33.291033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:33.292715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:33.306068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:33.307341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:33.308450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:33.310156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:33.311264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:33.312538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:33.546854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9c1ef8118b934efc9090df2b1df8236e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da27602c05a445de810de5a195a51bb6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:33.547491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] flavor_id is None. Assuming migration. {{(pid=129060) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 25 13:44:33.547935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129060) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 13:44:34.155162 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-48e2746c-04c0-4c12-b456-5c8adbdf1976 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116/action" status: 202 len: 0 microversion: 2.1 time: 0.873272 Aug 25 13:44:34.160380 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2852/5652] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:44:33 2022] POST /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116/action => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:44:34.174639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dcf08f1b-fbe5-4d98-a019-b5251f445ff6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:34.176833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dcf08f1b-fbe5-4d98-a019-b5251f445ff6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:34.192264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcf08f1b-fbe5-4d98-a019-b5251f445ff6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:34.193044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcf08f1b-fbe5-4d98-a019-b5251f445ff6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:34.194186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcf08f1b-fbe5-4d98-a019-b5251f445ff6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:34.195766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcf08f1b-fbe5-4d98-a019-b5251f445ff6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:34.196838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcf08f1b-fbe5-4d98-a019-b5251f445ff6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:34.197487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dcf08f1b-fbe5-4d98-a019-b5251f445ff6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:34.533945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dcf08f1b-fbe5-4d98-a019-b5251f445ff6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:34.551862 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dcf08f1b-fbe5-4d98-a019-b5251f445ff6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1689 microversion: 2.1 time: 0.389874 Aug 25 13:44:34.553481 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2801/5653] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:34 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1689 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:35.578708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2d009ea-e020-4d39-b914-befb6bfd768f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:35.580032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b2d009ea-e020-4d39-b914-befb6bfd768f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:35.590212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d009ea-e020-4d39-b914-befb6bfd768f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:35.591084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d009ea-e020-4d39-b914-befb6bfd768f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:35.591830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d009ea-e020-4d39-b914-befb6bfd768f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:35.593041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d009ea-e020-4d39-b914-befb6bfd768f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:35.593901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d009ea-e020-4d39-b914-befb6bfd768f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:35.594507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d009ea-e020-4d39-b914-befb6bfd768f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:35.925871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b2d009ea-e020-4d39-b914-befb6bfd768f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:35.942984 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2d009ea-e020-4d39-b914-befb6bfd768f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1689 microversion: 2.1 time: 0.370111 Aug 25 13:44:35.962313 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2853/5654] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:35 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1689 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:36.979714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ac2cfd28-3a3c-4fc5-bd24-5f003aca9b6e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:36.983074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ac2cfd28-3a3c-4fc5-bd24-5f003aca9b6e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:37.009372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac2cfd28-3a3c-4fc5-bd24-5f003aca9b6e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:37.010996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac2cfd28-3a3c-4fc5-bd24-5f003aca9b6e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:37.012483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac2cfd28-3a3c-4fc5-bd24-5f003aca9b6e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:37.014177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac2cfd28-3a3c-4fc5-bd24-5f003aca9b6e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:37.015436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac2cfd28-3a3c-4fc5-bd24-5f003aca9b6e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:37.016883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac2cfd28-3a3c-4fc5-bd24-5f003aca9b6e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:37.328113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ac2cfd28-3a3c-4fc5-bd24-5f003aca9b6e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:37.366953 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ac2cfd28-3a3c-4fc5-bd24-5f003aca9b6e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1689 microversion: 2.1 time: 0.400033 Aug 25 13:44:37.369866 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2802/5655] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:36 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1689 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:38.407452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c59f9c8-1a27-4b4e-a712-8e0cd68c07f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:38.408593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9c59f9c8-1a27-4b4e-a712-8e0cd68c07f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:38.437648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c59f9c8-1a27-4b4e-a712-8e0cd68c07f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:38.438553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c59f9c8-1a27-4b4e-a712-8e0cd68c07f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:38.439521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c59f9c8-1a27-4b4e-a712-8e0cd68c07f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:38.451306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c59f9c8-1a27-4b4e-a712-8e0cd68c07f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:38.452560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c59f9c8-1a27-4b4e-a712-8e0cd68c07f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:38.453485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c59f9c8-1a27-4b4e-a712-8e0cd68c07f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:38.846481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9c59f9c8-1a27-4b4e-a712-8e0cd68c07f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:38.890695 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c59f9c8-1a27-4b4e-a712-8e0cd68c07f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1689 microversion: 2.1 time: 0.489720 Aug 25 13:44:38.891236 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2854/5656] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:38 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1689 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:39.942442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-83ed712c-5ca7-4bd9-b1df-57bd091d7674 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:39.944535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-83ed712c-5ca7-4bd9-b1df-57bd091d7674 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:39.957877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83ed712c-5ca7-4bd9-b1df-57bd091d7674 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:39.959927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83ed712c-5ca7-4bd9-b1df-57bd091d7674 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:39.961250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83ed712c-5ca7-4bd9-b1df-57bd091d7674 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:39.962881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83ed712c-5ca7-4bd9-b1df-57bd091d7674 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:39.964101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83ed712c-5ca7-4bd9-b1df-57bd091d7674 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:39.965175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-83ed712c-5ca7-4bd9-b1df-57bd091d7674 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:40.235098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-83ed712c-5ca7-4bd9-b1df-57bd091d7674 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:40.263598 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-83ed712c-5ca7-4bd9-b1df-57bd091d7674 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1694 microversion: 2.1 time: 0.329595 Aug 25 13:44:40.268699 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2803/5657] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:39 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1694 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:41.316628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-127ad204-2c51-461b-9136-19601dc2129d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:41.320581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-127ad204-2c51-461b-9136-19601dc2129d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:41.343411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-127ad204-2c51-461b-9136-19601dc2129d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:41.344224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-127ad204-2c51-461b-9136-19601dc2129d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:41.346359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-127ad204-2c51-461b-9136-19601dc2129d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:41.349875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-127ad204-2c51-461b-9136-19601dc2129d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:41.351664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-127ad204-2c51-461b-9136-19601dc2129d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:41.353740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-127ad204-2c51-461b-9136-19601dc2129d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:41.654626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-127ad204-2c51-461b-9136-19601dc2129d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:41.669701 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-127ad204-2c51-461b-9136-19601dc2129d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1694 microversion: 2.1 time: 0.375408 Aug 25 13:44:41.670658 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2855/5658] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:41 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1694 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:42.700896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b465db8-39bc-4bb0-b4c7-ed4af7b4d6e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:42.703223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b465db8-39bc-4bb0-b4c7-ed4af7b4d6e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:42.719694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b465db8-39bc-4bb0-b4c7-ed4af7b4d6e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:42.720940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b465db8-39bc-4bb0-b4c7-ed4af7b4d6e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:42.723050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b465db8-39bc-4bb0-b4c7-ed4af7b4d6e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:42.724798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b465db8-39bc-4bb0-b4c7-ed4af7b4d6e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:42.726180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b465db8-39bc-4bb0-b4c7-ed4af7b4d6e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:42.727348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b465db8-39bc-4bb0-b4c7-ed4af7b4d6e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:42.975638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b465db8-39bc-4bb0-b4c7-ed4af7b4d6e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:42.988352 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b465db8-39bc-4bb0-b4c7-ed4af7b4d6e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1694 microversion: 2.1 time: 0.296592 Aug 25 13:44:43.002876 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2804/5659] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:42 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1694 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:44.027288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c29e3ec7-fe59-4148-b2fb-7e6c3b48a8e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:44.032198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c29e3ec7-fe59-4148-b2fb-7e6c3b48a8e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:44.071628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c29e3ec7-fe59-4148-b2fb-7e6c3b48a8e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:44.072856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c29e3ec7-fe59-4148-b2fb-7e6c3b48a8e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:44.073926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c29e3ec7-fe59-4148-b2fb-7e6c3b48a8e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:44.084291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c29e3ec7-fe59-4148-b2fb-7e6c3b48a8e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:44.085115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c29e3ec7-fe59-4148-b2fb-7e6c3b48a8e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:44.086535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c29e3ec7-fe59-4148-b2fb-7e6c3b48a8e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:44.348941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c29e3ec7-fe59-4148-b2fb-7e6c3b48a8e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:44.363238 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c29e3ec7-fe59-4148-b2fb-7e6c3b48a8e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1694 microversion: 2.1 time: 0.343581 Aug 25 13:44:44.364868 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2856/5660] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:44 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1694 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:45.395892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-23cde8f2-3e2f-4d6f-9f1c-c8f9fdaf6ab9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:45.399030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-23cde8f2-3e2f-4d6f-9f1c-c8f9fdaf6ab9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:45.414410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cde8f2-3e2f-4d6f-9f1c-c8f9fdaf6ab9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:45.416150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cde8f2-3e2f-4d6f-9f1c-c8f9fdaf6ab9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:45.418729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cde8f2-3e2f-4d6f-9f1c-c8f9fdaf6ab9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:45.420146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cde8f2-3e2f-4d6f-9f1c-c8f9fdaf6ab9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:45.421479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cde8f2-3e2f-4d6f-9f1c-c8f9fdaf6ab9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:45.422705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cde8f2-3e2f-4d6f-9f1c-c8f9fdaf6ab9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:45.732969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-23cde8f2-3e2f-4d6f-9f1c-c8f9fdaf6ab9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:45.744163 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-23cde8f2-3e2f-4d6f-9f1c-c8f9fdaf6ab9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1694 microversion: 2.1 time: 0.357647 Aug 25 13:44:45.758025 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2805/5661] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:45 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1694 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:46.782303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bcac1d66-3eab-4ba7-a8e9-958e71e4e65d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:46.784781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bcac1d66-3eab-4ba7-a8e9-958e71e4e65d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:46.799353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcac1d66-3eab-4ba7-a8e9-958e71e4e65d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:46.801137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcac1d66-3eab-4ba7-a8e9-958e71e4e65d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:46.802975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcac1d66-3eab-4ba7-a8e9-958e71e4e65d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:46.804596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcac1d66-3eab-4ba7-a8e9-958e71e4e65d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:46.806157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcac1d66-3eab-4ba7-a8e9-958e71e4e65d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:46.807278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcac1d66-3eab-4ba7-a8e9-958e71e4e65d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:47.130476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bcac1d66-3eab-4ba7-a8e9-958e71e4e65d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:47.154122 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bcac1d66-3eab-4ba7-a8e9-958e71e4e65d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1694 microversion: 2.1 time: 0.389158 Aug 25 13:44:47.155132 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2857/5662] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:46 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1694 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:48.217402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7bc3577a-b322-4f03-8356-d3c49858c11a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:48.226507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7bc3577a-b322-4f03-8356-d3c49858c11a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:48.254544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bc3577a-b322-4f03-8356-d3c49858c11a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:48.255637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bc3577a-b322-4f03-8356-d3c49858c11a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:48.260430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bc3577a-b322-4f03-8356-d3c49858c11a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:48.265263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bc3577a-b322-4f03-8356-d3c49858c11a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:48.266499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bc3577a-b322-4f03-8356-d3c49858c11a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:48.267543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bc3577a-b322-4f03-8356-d3c49858c11a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:48.594706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7bc3577a-b322-4f03-8356-d3c49858c11a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:48.610035 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7bc3577a-b322-4f03-8356-d3c49858c11a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1694 microversion: 2.1 time: 0.427245 Aug 25 13:44:48.611907 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2806/5663] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:48 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1694 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:49.674877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b0f4bee0-391b-4f0d-945e-f5284103f86f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:49.679652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b0f4bee0-391b-4f0d-945e-f5284103f86f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:49.693331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0f4bee0-391b-4f0d-945e-f5284103f86f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:49.695133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0f4bee0-391b-4f0d-945e-f5284103f86f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:49.696297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0f4bee0-391b-4f0d-945e-f5284103f86f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:49.701474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0f4bee0-391b-4f0d-945e-f5284103f86f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:49.704013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0f4bee0-391b-4f0d-945e-f5284103f86f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:49.705815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b0f4bee0-391b-4f0d-945e-f5284103f86f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:50.023075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b0f4bee0-391b-4f0d-945e-f5284103f86f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:50.037766 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b0f4bee0-391b-4f0d-945e-f5284103f86f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1694 microversion: 2.1 time: 0.381564 Aug 25 13:44:50.037961 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2858/5664] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:49 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1694 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:51.080078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-31fcd51e-ca66-4c5c-9558-92ce9762e452 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:51.081079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-31fcd51e-ca66-4c5c-9558-92ce9762e452 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:51.104664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcd51e-ca66-4c5c-9558-92ce9762e452 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:51.107860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcd51e-ca66-4c5c-9558-92ce9762e452 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:51.108627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcd51e-ca66-4c5c-9558-92ce9762e452 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:51.110066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcd51e-ca66-4c5c-9558-92ce9762e452 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:51.110853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcd51e-ca66-4c5c-9558-92ce9762e452 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:51.111809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcd51e-ca66-4c5c-9558-92ce9762e452 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:51.548592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-31fcd51e-ca66-4c5c-9558-92ce9762e452 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:51.574302 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-31fcd51e-ca66-4c5c-9558-92ce9762e452 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1694 microversion: 2.1 time: 0.500229 Aug 25 13:44:51.575908 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2807/5665] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:51 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1694 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:52.621958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52f9399d-aa41-4ace-a18d-bcae7ead8ff4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:52.627206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-52f9399d-aa41-4ace-a18d-bcae7ead8ff4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:52.655848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f9399d-aa41-4ace-a18d-bcae7ead8ff4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:52.657357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f9399d-aa41-4ace-a18d-bcae7ead8ff4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:52.658806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f9399d-aa41-4ace-a18d-bcae7ead8ff4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:52.665317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f9399d-aa41-4ace-a18d-bcae7ead8ff4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:52.668178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f9399d-aa41-4ace-a18d-bcae7ead8ff4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:52.676718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52f9399d-aa41-4ace-a18d-bcae7ead8ff4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:53.106977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a288a2bc-d604-41a8-a689-bca5881ba579 req-56b412ec-88b3-4b71-9b20-683179b926fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6658fa88-0502-4a02-8d35-b006b602b116", "name": "network-vif-unplugged", "status": "completed", "tag": "8f59cb30-8327-4cc8-9066-ea4560db24d0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:53.150496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a288a2bc-d604-41a8-a689-bca5881ba579 req-56b412ec-88b3-4b71-9b20-683179b926fd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:53.155817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a288a2bc-d604-41a8-a689-bca5881ba579 req-56b412ec-88b3-4b71-9b20-683179b926fd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:53.157000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a288a2bc-d604-41a8-a689-bca5881ba579 req-56b412ec-88b3-4b71-9b20-683179b926fd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:53.167538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-52f9399d-aa41-4ace-a18d-bcae7ead8ff4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:53.224588 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-52f9399d-aa41-4ace-a18d-bcae7ead8ff4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1693 microversion: 2.1 time: 0.614385 Aug 25 13:44:53.228803 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2859/5666] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:52 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1693 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:53.266163 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a288a2bc-d604-41a8-a689-bca5881ba579 req-56b412ec-88b3-4b71-9b20-683179b926fd service nova] Creating event network-vif-unplugged:8f59cb30-8327-4cc8-9066-ea4560db24d0 for instance 6658fa88-0502-4a02-8d35-b006b602b116 on n-h2-852771-8 Aug 25 13:44:53.283497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-a288a2bc-d604-41a8-a689-bca5881ba579 req-56b412ec-88b3-4b71-9b20-683179b926fd service nova] Instance 6658fa88-0502-4a02-8d35-b006b602b116 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:44:53.341095 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a288a2bc-d604-41a8-a689-bca5881ba579 req-56b412ec-88b3-4b71-9b20-683179b926fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.238766 Aug 25 13:44:53.344751 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2808/5667] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:44:54.273379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-44a8dcbe-83fe-4a58-9b10-4cdee77cf386 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:54.281997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-44a8dcbe-83fe-4a58-9b10-4cdee77cf386 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:54.324325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44a8dcbe-83fe-4a58-9b10-4cdee77cf386 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:54.325339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44a8dcbe-83fe-4a58-9b10-4cdee77cf386 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:54.330087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44a8dcbe-83fe-4a58-9b10-4cdee77cf386 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:54.344259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44a8dcbe-83fe-4a58-9b10-4cdee77cf386 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:54.354219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44a8dcbe-83fe-4a58-9b10-4cdee77cf386 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:54.355626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44a8dcbe-83fe-4a58-9b10-4cdee77cf386 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:54.930602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-44a8dcbe-83fe-4a58-9b10-4cdee77cf386 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:54.948408 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-44a8dcbe-83fe-4a58-9b10-4cdee77cf386 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1693 microversion: 2.1 time: 0.686704 Aug 25 13:44:54.949312 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2860/5668] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:54 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1693 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:55.413117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-def186e5-e9c9-4587-9c30-338f45f067c0 req-ac1ee4d8-40e7-4e18-92c8-033a763c00c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6658fa88-0502-4a02-8d35-b006b602b116", "tag": "8f59cb30-8327-4cc8-9066-ea4560db24d0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:55.467743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-def186e5-e9c9-4587-9c30-338f45f067c0 req-ac1ee4d8-40e7-4e18-92c8-033a763c00c0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:55.468494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-def186e5-e9c9-4587-9c30-338f45f067c0 req-ac1ee4d8-40e7-4e18-92c8-033a763c00c0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:55.472081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-def186e5-e9c9-4587-9c30-338f45f067c0 req-ac1ee4d8-40e7-4e18-92c8-033a763c00c0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:55.527046 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-def186e5-e9c9-4587-9c30-338f45f067c0 req-ac1ee4d8-40e7-4e18-92c8-033a763c00c0 service nova] Creating event network-changed:8f59cb30-8327-4cc8-9066-ea4560db24d0 for instance 6658fa88-0502-4a02-8d35-b006b602b116 on n-h2-852771-8 Aug 25 13:44:55.555620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-def186e5-e9c9-4587-9c30-338f45f067c0 req-ac1ee4d8-40e7-4e18-92c8-033a763c00c0 service nova] Instance 6658fa88-0502-4a02-8d35-b006b602b116 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:44:55.611559 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-def186e5-e9c9-4587-9c30-338f45f067c0 req-ac1ee4d8-40e7-4e18-92c8-033a763c00c0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219430 Aug 25 13:44:55.613617 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2809/5669] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:55.987534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6ee1d09-f04d-418b-88dc-370e8c779547 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:55.990067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b6ee1d09-f04d-418b-88dc-370e8c779547 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:56.004373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6ee1d09-f04d-418b-88dc-370e8c779547 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:56.006289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6ee1d09-f04d-418b-88dc-370e8c779547 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:56.007353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6ee1d09-f04d-418b-88dc-370e8c779547 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:56.008949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6ee1d09-f04d-418b-88dc-370e8c779547 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:56.010207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6ee1d09-f04d-418b-88dc-370e8c779547 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:56.011143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6ee1d09-f04d-418b-88dc-370e8c779547 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:56.744932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b6ee1d09-f04d-418b-88dc-370e8c779547 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:56.772806 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b6ee1d09-f04d-418b-88dc-370e8c779547 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1693 microversion: 2.1 time: 0.792809 Aug 25 13:44:56.798050 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2861/5670] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:55 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1693 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:57.838524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0e6fb342-0d8c-4714-8424-95a88dbc8a17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:57.839984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0e6fb342-0d8c-4714-8424-95a88dbc8a17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:57.850459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e6fb342-0d8c-4714-8424-95a88dbc8a17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:57.851296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e6fb342-0d8c-4714-8424-95a88dbc8a17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:57.852094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e6fb342-0d8c-4714-8424-95a88dbc8a17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:57.853112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e6fb342-0d8c-4714-8424-95a88dbc8a17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:57.854159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e6fb342-0d8c-4714-8424-95a88dbc8a17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:57.854884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e6fb342-0d8c-4714-8424-95a88dbc8a17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:58.221672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0e6fb342-0d8c-4714-8424-95a88dbc8a17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:58.257344 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0e6fb342-0d8c-4714-8424-95a88dbc8a17 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1691 microversion: 2.1 time: 0.436559 Aug 25 13:44:58.259879 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2810/5671] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:57 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1691 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:59.312813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-abaa8e93-d877-4786-a031-ddd6317d211a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:59.326292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-abaa8e93-d877-4786-a031-ddd6317d211a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:59.347571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abaa8e93-d877-4786-a031-ddd6317d211a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:59.348221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abaa8e93-d877-4786-a031-ddd6317d211a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:59.348690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abaa8e93-d877-4786-a031-ddd6317d211a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:59.349730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abaa8e93-d877-4786-a031-ddd6317d211a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:59.350113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abaa8e93-d877-4786-a031-ddd6317d211a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:59.350678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abaa8e93-d877-4786-a031-ddd6317d211a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:59.854973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-abaa8e93-d877-4786-a031-ddd6317d211a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:59.876681 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-abaa8e93-d877-4786-a031-ddd6317d211a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1691 microversion: 2.1 time: 0.569654 Aug 25 13:44:59.878841 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2862/5672] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:59 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1691 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:00.917899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa9e66ac-67aa-430a-9770-7bd8bd1fb4df tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:00.920213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa9e66ac-67aa-430a-9770-7bd8bd1fb4df tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:00.937150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa9e66ac-67aa-430a-9770-7bd8bd1fb4df tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:00.938503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa9e66ac-67aa-430a-9770-7bd8bd1fb4df tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:00.941667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa9e66ac-67aa-430a-9770-7bd8bd1fb4df tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:00.944826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa9e66ac-67aa-430a-9770-7bd8bd1fb4df tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:00.945866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa9e66ac-67aa-430a-9770-7bd8bd1fb4df tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:00.947390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa9e66ac-67aa-430a-9770-7bd8bd1fb4df tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:01.396639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fa9e66ac-67aa-430a-9770-7bd8bd1fb4df tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:01.433453 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa9e66ac-67aa-430a-9770-7bd8bd1fb4df tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1688 microversion: 2.1 time: 0.525703 Aug 25 13:45:01.436614 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2811/5673] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:00 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1688 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:01.477737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c0205e75-4cc0-4ceb-acb2-7721aee5ccbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:45:01.479047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c0205e75-4cc0-4ceb-acb2-7721aee5ccbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:01.495065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0205e75-4cc0-4ceb-acb2-7721aee5ccbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:01.496049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0205e75-4cc0-4ceb-acb2-7721aee5ccbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:01.497192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0205e75-4cc0-4ceb-acb2-7721aee5ccbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:01.498784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0205e75-4cc0-4ceb-acb2-7721aee5ccbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:01.500168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0205e75-4cc0-4ceb-acb2-7721aee5ccbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:01.501794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0205e75-4cc0-4ceb-acb2-7721aee5ccbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:01.692729 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c0205e75-4cc0-4ceb-acb2-7721aee5ccbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116/action" status: 204 len: 0 microversion: 2.1 time: 0.221937 Aug 25 13:45:01.694741 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2863/5674] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:45:01 2022] POST /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116/action => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:45:01.714837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e199dad-729b-458a-9f26-e1bc56a2407c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:01.715478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e199dad-729b-458a-9f26-e1bc56a2407c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:01.742423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e199dad-729b-458a-9f26-e1bc56a2407c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:01.743292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e199dad-729b-458a-9f26-e1bc56a2407c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:01.743811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e199dad-729b-458a-9f26-e1bc56a2407c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:01.744791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e199dad-729b-458a-9f26-e1bc56a2407c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:01.745351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e199dad-729b-458a-9f26-e1bc56a2407c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:01.745892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e199dad-729b-458a-9f26-e1bc56a2407c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:02.202858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e199dad-729b-458a-9f26-e1bc56a2407c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:02.208772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=76 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:02.228105 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e199dad-729b-458a-9f26-e1bc56a2407c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1688 microversion: 2.1 time: 0.526545 Aug 25 13:45:02.230202 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2812/5675] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:01 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1688 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:03.285044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81985eba-95b0-4e9f-8a71-f671d8fe5809 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:03.288664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-81985eba-95b0-4e9f-8a71-f671d8fe5809 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:03.294788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=30 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:03.308770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81985eba-95b0-4e9f-8a71-f671d8fe5809 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:03.311771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81985eba-95b0-4e9f-8a71-f671d8fe5809 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:03.316275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81985eba-95b0-4e9f-8a71-f671d8fe5809 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:03.322621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81985eba-95b0-4e9f-8a71-f671d8fe5809 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:03.323628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81985eba-95b0-4e9f-8a71-f671d8fe5809 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:03.325432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81985eba-95b0-4e9f-8a71-f671d8fe5809 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:03.417242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:03.788818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81985eba-95b0-4e9f-8a71-f671d8fe5809 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:03.812478 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-81985eba-95b0-4e9f-8a71-f671d8fe5809 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1688 microversion: 2.1 time: 0.543549 Aug 25 13:45:03.828683 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2864/5676] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:03 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1688 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:04.224951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-821ee4e9-f8ca-4243-84e6-2f1b5f354517 req-c47115e9-4e12-4eba-a023-a8436cbacbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6658fa88-0502-4a02-8d35-b006b602b116", "name": "network-vif-plugged", "status": "completed", "tag": "8f59cb30-8327-4cc8-9066-ea4560db24d0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:45:04.255217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=28 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:04.274223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-821ee4e9-f8ca-4243-84e6-2f1b5f354517 req-c47115e9-4e12-4eba-a023-a8436cbacbe3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:04.280515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-821ee4e9-f8ca-4243-84e6-2f1b5f354517 req-c47115e9-4e12-4eba-a023-a8436cbacbe3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:04.283815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-821ee4e9-f8ca-4243-84e6-2f1b5f354517 req-c47115e9-4e12-4eba-a023-a8436cbacbe3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:04.340786 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-821ee4e9-f8ca-4243-84e6-2f1b5f354517 req-c47115e9-4e12-4eba-a023-a8436cbacbe3 service nova] Creating event network-vif-plugged:8f59cb30-8327-4cc8-9066-ea4560db24d0 for instance 6658fa88-0502-4a02-8d35-b006b602b116 on n-h2-852771-8 Aug 25 13:45:04.373929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-821ee4e9-f8ca-4243-84e6-2f1b5f354517 req-c47115e9-4e12-4eba-a023-a8436cbacbe3 service nova] Instance 6658fa88-0502-4a02-8d35-b006b602b116 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:45:04.413493 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-821ee4e9-f8ca-4243-84e6-2f1b5f354517 req-c47115e9-4e12-4eba-a023-a8436cbacbe3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201330 Aug 25 13:45:04.419242 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2813/5677] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:45:04.855621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d2ad2d72-4d53-40ac-8a56-639c59900f34 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:04.856779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d2ad2d72-4d53-40ac-8a56-639c59900f34 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:04.882821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ad2d72-4d53-40ac-8a56-639c59900f34 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:04.903505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ad2d72-4d53-40ac-8a56-639c59900f34 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:04.904496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ad2d72-4d53-40ac-8a56-639c59900f34 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:04.906624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ad2d72-4d53-40ac-8a56-639c59900f34 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:04.910258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ad2d72-4d53-40ac-8a56-639c59900f34 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:04.911009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2ad2d72-4d53-40ac-8a56-639c59900f34 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:05.493243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d2ad2d72-4d53-40ac-8a56-639c59900f34 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:05.544445 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d2ad2d72-4d53-40ac-8a56-639c59900f34 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1688 microversion: 2.1 time: 0.697039 Aug 25 13:45:05.552390 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2865/5678] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:04 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1688 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:06.580506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-09813e93-27f3-49e0-bcdb-c28c7ef38931 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:06.582801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-09813e93-27f3-49e0-bcdb-c28c7ef38931 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:06.604590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09813e93-27f3-49e0-bcdb-c28c7ef38931 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:06.605461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09813e93-27f3-49e0-bcdb-c28c7ef38931 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:06.606207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09813e93-27f3-49e0-bcdb-c28c7ef38931 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:06.607247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09813e93-27f3-49e0-bcdb-c28c7ef38931 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:06.608055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09813e93-27f3-49e0-bcdb-c28c7ef38931 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:06.608727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-09813e93-27f3-49e0-bcdb-c28c7ef38931 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:07.042377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-09813e93-27f3-49e0-bcdb-c28c7ef38931 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:07.080384 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-09813e93-27f3-49e0-bcdb-c28c7ef38931 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1680 microversion: 2.1 time: 0.505665 Aug 25 13:45:07.083146 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2814/5679] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:06 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1680 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:33.484631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-889afb92-fb5d-4d45-acaf-ca806436b92d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:45:33.488549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-889afb92-fb5d-4d45-acaf-ca806436b92d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:33.492364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:33.507623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=11 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:33.520803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889afb92-fb5d-4d45-acaf-ca806436b92d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:33.521761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889afb92-fb5d-4d45-acaf-ca806436b92d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:33.522680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889afb92-fb5d-4d45-acaf-ca806436b92d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:33.523884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889afb92-fb5d-4d45-acaf-ca806436b92d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:33.524773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889afb92-fb5d-4d45-acaf-ca806436b92d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:33.552483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-889afb92-fb5d-4d45-acaf-ca806436b92d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:33.733705 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-889afb92-fb5d-4d45-acaf-ca806436b92d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116/action" status: 200 len: 24577 microversion: 2.1 time: 0.257242 Aug 25 13:45:33.734432 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2866/5680] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:45:33 2022] POST /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116/action => generated 24577 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:45:56.804487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a6938d39-748b-4570-b455-4ca6c5aeb9a0 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:56.807855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a6938d39-748b-4570-b455-4ca6c5aeb9a0 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:56.822104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:56.823580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=11 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:56.830120 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:45:56.830905 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 13:45:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 (ip 10.222.0.70) !!! Aug 25 13:45:56.876344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6938d39-748b-4570-b455-4ca6c5aeb9a0 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:56.878525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6938d39-748b-4570-b455-4ca6c5aeb9a0 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:56.880624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6938d39-748b-4570-b455-4ca6c5aeb9a0 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:56.882890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6938d39-748b-4570-b455-4ca6c5aeb9a0 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:56.884848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6938d39-748b-4570-b455-4ca6c5aeb9a0 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:56.886841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6938d39-748b-4570-b455-4ca6c5aeb9a0 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:57.412589 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a6938d39-748b-4570-b455-4ca6c5aeb9a0 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1831 microversion: 2.1 time: 0.617379 Aug 25 13:45:57.415013 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2815/5681] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:56 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1831 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:59.994816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6211c6c-6f6c-4c00-be1c-fc2f0d86ffc4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:00.006274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d6211c6c-6f6c-4c00-be1c-fc2f0d86ffc4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:00.030274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:00.032099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:00.035837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8b9c4700-f1b7-4ded-93c9-90a249e039af req-558f3615-07a7-4df8-a65f-85348e18b5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6658fa88-0502-4a02-8d35-b006b602b116", "tag": "8f59cb30-8327-4cc8-9066-ea4560db24d0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:00.046664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6211c6c-6f6c-4c00-be1c-fc2f0d86ffc4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:00.048210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6211c6c-6f6c-4c00-be1c-fc2f0d86ffc4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:00.050950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6211c6c-6f6c-4c00-be1c-fc2f0d86ffc4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:00.053009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6211c6c-6f6c-4c00-be1c-fc2f0d86ffc4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:00.054221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6211c6c-6f6c-4c00-be1c-fc2f0d86ffc4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:00.055283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6211c6c-6f6c-4c00-be1c-fc2f0d86ffc4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:00.102532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8b9c4700-f1b7-4ded-93c9-90a249e039af req-558f3615-07a7-4df8-a65f-85348e18b5ff service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:00.103559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8b9c4700-f1b7-4ded-93c9-90a249e039af req-558f3615-07a7-4df8-a65f-85348e18b5ff service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:00.104355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8b9c4700-f1b7-4ded-93c9-90a249e039af req-558f3615-07a7-4df8-a65f-85348e18b5ff service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:00.148641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d6211c6c-6f6c-4c00-be1c-fc2f0d86ffc4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:46:00.170696 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8b9c4700-f1b7-4ded-93c9-90a249e039af req-558f3615-07a7-4df8-a65f-85348e18b5ff service nova] Creating event network-changed:8f59cb30-8327-4cc8-9066-ea4560db24d0 for instance 6658fa88-0502-4a02-8d35-b006b602b116 on n-h2-852771-8 Aug 25 13:46:00.189942 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8b9c4700-f1b7-4ded-93c9-90a249e039af req-558f3615-07a7-4df8-a65f-85348e18b5ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161333 Aug 25 13:46:00.191749 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2816/5682] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:46:00.380278 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d6211c6c-6f6c-4c00-be1c-fc2f0d86ffc4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 204 len: 0 microversion: 2.1 time: 0.394019 Aug 25 13:46:00.385838 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2867/5683] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:45:59 2022] DELETE /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:46:00.401714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f9faabad-bec7-4e46-b74a-382ba63b6d6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:00.404239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f9faabad-bec7-4e46-b74a-382ba63b6d6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:00.418040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9faabad-bec7-4e46-b74a-382ba63b6d6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:00.419469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9faabad-bec7-4e46-b74a-382ba63b6d6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:00.420889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9faabad-bec7-4e46-b74a-382ba63b6d6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:00.422862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9faabad-bec7-4e46-b74a-382ba63b6d6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:00.424657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9faabad-bec7-4e46-b74a-382ba63b6d6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:00.425879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9faabad-bec7-4e46-b74a-382ba63b6d6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:00.877352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f9faabad-bec7-4e46-b74a-382ba63b6d6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:00.899025 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f9faabad-bec7-4e46-b74a-382ba63b6d6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1686 microversion: 2.1 time: 0.505137 Aug 25 13:46:00.931322 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2817/5684] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:00 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1686 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:01.951114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0d58637b-4046-481a-b56a-cf7e234de1e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:01.952375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0d58637b-4046-481a-b56a-cf7e234de1e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:02.008945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d58637b-4046-481a-b56a-cf7e234de1e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:02.022905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d58637b-4046-481a-b56a-cf7e234de1e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:02.024030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d58637b-4046-481a-b56a-cf7e234de1e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:02.029729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d58637b-4046-481a-b56a-cf7e234de1e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:02.038623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d58637b-4046-481a-b56a-cf7e234de1e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:02.039802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0d58637b-4046-481a-b56a-cf7e234de1e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:03.506938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0d58637b-4046-481a-b56a-cf7e234de1e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:03.547614 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0d58637b-4046-481a-b56a-cf7e234de1e6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 200 len: 1686 microversion: 2.1 time: 1.604279 Aug 25 13:46:03.554450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2868/5685] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:01 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 1686 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:03.682360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-23a940e3-0134-425e-83de-dba793285e71 req-a45c8a7c-d91b-441c-bb5b-61564292b406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6658fa88-0502-4a02-8d35-b006b602b116", "name": "network-vif-deleted", "tag": "8f59cb30-8327-4cc8-9066-ea4560db24d0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:03.740450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-23a940e3-0134-425e-83de-dba793285e71 req-a45c8a7c-d91b-441c-bb5b-61564292b406 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:03.747873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-23a940e3-0134-425e-83de-dba793285e71 req-a45c8a7c-d91b-441c-bb5b-61564292b406 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:03.751039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-23a940e3-0134-425e-83de-dba793285e71 req-a45c8a7c-d91b-441c-bb5b-61564292b406 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:03.817422 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-23a940e3-0134-425e-83de-dba793285e71 req-a45c8a7c-d91b-441c-bb5b-61564292b406 service nova] Creating event network-vif-deleted:8f59cb30-8327-4cc8-9066-ea4560db24d0 for instance 6658fa88-0502-4a02-8d35-b006b602b116 on n-h2-852771-8 Aug 25 13:46:03.845474 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-23a940e3-0134-425e-83de-dba793285e71 req-a45c8a7c-d91b-441c-bb5b-61564292b406 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170825 Aug 25 13:46:03.849132 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2818/5686] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:46:04.614808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:04.617227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 6658fa88-0502-4a02-8d35-b006b602b116] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:04.646348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:04.647348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:04.659174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:04.662634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:04.663607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:04.669079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:04.731711 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] HTTP exception thrown: Instance 6658fa88-0502-4a02-8d35-b006b602b116 could not be found. Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Request method failure captured: Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 HTTP/1.1 Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3xUnETqauI1fxE397rReMXDLCicli9Hi5kLufClsv6N95sYOGTClXRLJCM2pDIKRWw-GpkZg3DQxGaWT8EsmuVnSKPWDo4sA2E4cLg9pp_ZjLYOlU7spY_Q87AN4fXVuBQueQfXTy0eO391Jp23FUZkFxq3DruyvbrbheLtC8cWpR4 Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3f2ace59bb66449bb97802fd18379f1a Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f2ace59bb66449bb97802fd18379f1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3f2ace59bb66449bb97802fd18379f1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3f2ace59bb66449bb97802fd18379f1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f2ace59bb66449bb97802fd18379f1a"}]}] Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3f2ace59bb66449bb97802fd18379f1a Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestNetworkAdvancedServerOps-1232753206-project Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: ecfd27e7237548f485ae9480d489286a Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1232753206-project Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 6658fa88-0502-4a02-8d35-b006b602b116 could not be found. Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '6658fa88-0502-4a02-8d35-b006b602b116'} Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6658fa88-0502-4a02-8d35-b006b602b116 could not be found. Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6658fa88-0502-4a02-8d35-b006b602b116 could not be found. Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:46:04.743280 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:46:04.751475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:46:04.751475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:46:04.751475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:46:04.751475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:46:04.751475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:46:04.751475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:46:04.751475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6658fa88-0502-4a02-8d35-b006b602b116 could not be found. Aug 25 13:46:04.751475 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:46:04.751475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Returning 404 to user: Instance 6658fa88-0502-4a02-8d35-b006b602b116 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:46:04.751475 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9fa34fa8-55db-4824-a461-68a61aa19fcf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116" status: 404 len: 111 microversion: 2.1 time: 0.144097 Aug 25 13:46:04.755977 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2869/5687] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:04 2022] GET /compute/v2.1/servers/6658fa88-0502-4a02-8d35-b006b602b116 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:46:15.106787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-634aefe2-9be1-4b4b-ae0f-43a6e0feaeff tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '.version_select at 0x7f3a2e81bb80>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:15.130193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:15.144334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=16 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:15.225773 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-634aefe2-9be1-4b4b-ae0f-43a6e0feaeff tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1522546407" status: 202 len: 0 microversion: 2.1 time: 0.131775 Aug 25 13:46:15.227539 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2819/5688] 10.222.0.70 () {58 vars in 1284 bytes} [Thu Aug 25 13:46:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1522546407 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:46:15.297434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea508479-6a75-4d5e-bb15-51251b396836 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'create', calling method: .version_select at 0x7f3a29ba0790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-283244426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIue6ZiJmoco0cJ80KqpJN8mE3T6AA6UTT27U9TFMk+jrkma9OO9LFVwzmUwHHum5bPbuF7+PU/5cGEQWIBGlIusjf0I9XQldnWj7A2s4tTymh9QIbS1uzR6S/6eMor0QQ=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:15.329887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:15.332891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:15.367809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ea508479-6a75-4d5e-bb15-51251b396836 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:46:15.381578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ea508479-6a75-4d5e-bb15-51251b396836 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for user ecfd27e7237548f485ae9480d489286a and project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:46:15.451754 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ea508479-6a75-4d5e-bb15-51251b396836 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.166482 Aug 25 13:46:15.452937 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2870/5689] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:46:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:46:32.573428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1963790840", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "67f95c1c-5b12-47a7-be77-d7f8f25ed755"}], "key_name": "tempest-TestNetworkAdvancedServerOps-283244426", "security_groups": [{"name": "tempest-secgroup-smoke-1557015454"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:32.638879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:33.007651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] validate_networks() for [('67f95c1c-5b12-47a7-be77-d7f8f25ed755', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:46:34.917116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:46:34.920778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:46:34.922165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:46:34.923248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:46:34.926914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:46:34.950267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:34.951928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:34.953482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:34.956105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:34.958758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:34.960609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:35.043553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:46:35.065304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for user ecfd27e7237548f485ae9480d489286a and project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:46:35.125820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:46:35.130293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:46:35.215002 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [9171309d-4152-41e9-b831-4e2dfe28864b] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:46:36.232793 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [9171309d-4152-41e9-b831-4e2dfe28864b] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 42626. Aug 25 13:46:36.243117 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f88d474a-13ec-4d31-8439-cf0cfd9d7f86 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.686666 Aug 25 13:46:36.262461 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2820/5690] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:46:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 3707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:46:36.273280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a735c6b9-4795-47c3-aed5-3ac44edb9e8a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:36.278582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a735c6b9-4795-47c3-aed5-3ac44edb9e8a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:36.321318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:36.327297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:36.561559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a735c6b9-4795-47c3-aed5-3ac44edb9e8a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:36.612471 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a735c6b9-4795-47c3-aed5-3ac44edb9e8a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1266 microversion: 2.1 time: 0.346870 Aug 25 13:46:36.613540 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2871/5691] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:36 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:37.681162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f4dac904-21fd-4c86-b20b-24e326163666 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:37.683326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f4dac904-21fd-4c86-b20b-24e326163666 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:37.910911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f4dac904-21fd-4c86-b20b-24e326163666 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:37.944559 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f4dac904-21fd-4c86-b20b-24e326163666 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1266 microversion: 2.1 time: 0.300755 Aug 25 13:46:37.977847 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2821/5692] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:37 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:38.995806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6569db0c-b9d7-4bf1-9663-a3828dfbf1b5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:38.999021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6569db0c-b9d7-4bf1-9663-a3828dfbf1b5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:39.057166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6569db0c-b9d7-4bf1-9663-a3828dfbf1b5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:39.062616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6569db0c-b9d7-4bf1-9663-a3828dfbf1b5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:39.063550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6569db0c-b9d7-4bf1-9663-a3828dfbf1b5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:39.066941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6569db0c-b9d7-4bf1-9663-a3828dfbf1b5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:39.069586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6569db0c-b9d7-4bf1-9663-a3828dfbf1b5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:39.073178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6569db0c-b9d7-4bf1-9663-a3828dfbf1b5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:39.366345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6569db0c-b9d7-4bf1-9663-a3828dfbf1b5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:39.402073 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6569db0c-b9d7-4bf1-9663-a3828dfbf1b5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1262 microversion: 2.1 time: 0.416129 Aug 25 13:46:39.407373 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2872/5693] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:38 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1262 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:40.464481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa5e8c6c-b00b-40aa-9b53-1d9db00db669 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:40.467253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa5e8c6c-b00b-40aa-9b53-1d9db00db669 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:40.499484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa5e8c6c-b00b-40aa-9b53-1d9db00db669 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:40.501058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa5e8c6c-b00b-40aa-9b53-1d9db00db669 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:40.503653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa5e8c6c-b00b-40aa-9b53-1d9db00db669 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:40.505244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa5e8c6c-b00b-40aa-9b53-1d9db00db669 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:40.506590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa5e8c6c-b00b-40aa-9b53-1d9db00db669 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:40.507652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa5e8c6c-b00b-40aa-9b53-1d9db00db669 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:40.707525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fa5e8c6c-b00b-40aa-9b53-1d9db00db669 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:40.731259 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa5e8c6c-b00b-40aa-9b53-1d9db00db669 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1324 microversion: 2.1 time: 0.281643 Aug 25 13:46:40.735067 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2822/5694] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:40 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:41.791851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2fe3eb0-7b91-463e-9a0b-dc72e6ead95f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:41.792994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e2fe3eb0-7b91-463e-9a0b-dc72e6ead95f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:41.815036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2fe3eb0-7b91-463e-9a0b-dc72e6ead95f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:41.816600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2fe3eb0-7b91-463e-9a0b-dc72e6ead95f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:41.817733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2fe3eb0-7b91-463e-9a0b-dc72e6ead95f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:41.819658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2fe3eb0-7b91-463e-9a0b-dc72e6ead95f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:41.821694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2fe3eb0-7b91-463e-9a0b-dc72e6ead95f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:41.823117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2fe3eb0-7b91-463e-9a0b-dc72e6ead95f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:41.946864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2fe3eb0-7b91-463e-9a0b-dc72e6ead95f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:41.958918 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e2fe3eb0-7b91-463e-9a0b-dc72e6ead95f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1324 microversion: 2.1 time: 0.193531 Aug 25 13:46:41.959542 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2873/5695] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:41 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1324 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:46:43.069198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-42bb5e5f-ca84-4a07-8055-3494410fb5b0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:43.084536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-42bb5e5f-ca84-4a07-8055-3494410fb5b0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:43.104557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42bb5e5f-ca84-4a07-8055-3494410fb5b0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:43.105934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42bb5e5f-ca84-4a07-8055-3494410fb5b0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:43.106903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42bb5e5f-ca84-4a07-8055-3494410fb5b0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:43.113757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42bb5e5f-ca84-4a07-8055-3494410fb5b0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:43.116195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42bb5e5f-ca84-4a07-8055-3494410fb5b0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:43.117866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42bb5e5f-ca84-4a07-8055-3494410fb5b0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:43.542114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-42bb5e5f-ca84-4a07-8055-3494410fb5b0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:43.553876 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-42bb5e5f-ca84-4a07-8055-3494410fb5b0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1392 microversion: 2.1 time: 0.547082 Aug 25 13:46:43.554989 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2823/5696] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:42 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1392 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:44.332615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f6f37ec1-a667-400b-bca3-76dd7db80cdb req-8420e2c3-355e-4e2f-8307-3e48a8febef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:44.369198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f6f37ec1-a667-400b-bca3-76dd7db80cdb req-8420e2c3-355e-4e2f-8307-3e48a8febef5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:44.372671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f6f37ec1-a667-400b-bca3-76dd7db80cdb req-8420e2c3-355e-4e2f-8307-3e48a8febef5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:44.373317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f6f37ec1-a667-400b-bca3-76dd7db80cdb req-8420e2c3-355e-4e2f-8307-3e48a8febef5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:44.406271 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f6f37ec1-a667-400b-bca3-76dd7db80cdb req-8420e2c3-355e-4e2f-8307-3e48a8febef5 service nova] Creating event network-changed:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h1-852771-8 Aug 25 13:46:44.429472 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f6f37ec1-a667-400b-bca3-76dd7db80cdb req-8420e2c3-355e-4e2f-8307-3e48a8febef5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099647 Aug 25 13:46:44.433652 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2874/5697] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:46:44.594564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6835c27a-1c5f-49d6-909e-f8bacb988237 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:44.597165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6835c27a-1c5f-49d6-909e-f8bacb988237 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:44.617078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6835c27a-1c5f-49d6-909e-f8bacb988237 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:44.618075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6835c27a-1c5f-49d6-909e-f8bacb988237 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:44.618943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6835c27a-1c5f-49d6-909e-f8bacb988237 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:44.620255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6835c27a-1c5f-49d6-909e-f8bacb988237 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:44.625783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6835c27a-1c5f-49d6-909e-f8bacb988237 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:44.627675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6835c27a-1c5f-49d6-909e-f8bacb988237 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:44.984731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:45.582858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6835c27a-1c5f-49d6-909e-f8bacb988237 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:45.601331 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6835c27a-1c5f-49d6-909e-f8bacb988237 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1392 microversion: 2.1 time: 1.011673 Aug 25 13:46:45.605326 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2824/5698] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:44 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1392 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:46.631023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-55209349-ede2-43c7-a43e-fc7e18543894 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:46.631993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-55209349-ede2-43c7-a43e-fc7e18543894 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:46.635620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:46.647118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55209349-ede2-43c7-a43e-fc7e18543894 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:46.647832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55209349-ede2-43c7-a43e-fc7e18543894 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:46.648608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55209349-ede2-43c7-a43e-fc7e18543894 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:46.649719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55209349-ede2-43c7-a43e-fc7e18543894 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:46.650662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55209349-ede2-43c7-a43e-fc7e18543894 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:46.651353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55209349-ede2-43c7-a43e-fc7e18543894 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:46.981698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-55209349-ede2-43c7-a43e-fc7e18543894 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:47.003561 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-55209349-ede2-43c7-a43e-fc7e18543894 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1392 microversion: 2.1 time: 0.378255 Aug 25 13:46:47.005977 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2875/5699] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:46 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1392 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:48.047071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-136c5750-e0f6-4488-9c5f-16686ddc7741 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:48.048298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-136c5750-e0f6-4488-9c5f-16686ddc7741 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:48.053324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:48.078890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-136c5750-e0f6-4488-9c5f-16686ddc7741 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:48.080372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-136c5750-e0f6-4488-9c5f-16686ddc7741 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:48.081214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-136c5750-e0f6-4488-9c5f-16686ddc7741 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:48.082528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-136c5750-e0f6-4488-9c5f-16686ddc7741 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:48.083415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-136c5750-e0f6-4488-9c5f-16686ddc7741 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:48.084239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-136c5750-e0f6-4488-9c5f-16686ddc7741 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:48.688581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-136c5750-e0f6-4488-9c5f-16686ddc7741 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:48.715986 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-136c5750-e0f6-4488-9c5f-16686ddc7741 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1392 microversion: 2.1 time: 0.676420 Aug 25 13:46:48.734388 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2825/5700] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:48 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1392 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:49.769712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-719b511a-69e4-4dd5-8c86-5c761c890e63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:49.769712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-719b511a-69e4-4dd5-8c86-5c761c890e63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:49.806465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-719b511a-69e4-4dd5-8c86-5c761c890e63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:49.807415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-719b511a-69e4-4dd5-8c86-5c761c890e63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:49.815271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-719b511a-69e4-4dd5-8c86-5c761c890e63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:49.823726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-719b511a-69e4-4dd5-8c86-5c761c890e63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:49.824601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-719b511a-69e4-4dd5-8c86-5c761c890e63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:49.825305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-719b511a-69e4-4dd5-8c86-5c761c890e63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:50.310866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-719b511a-69e4-4dd5-8c86-5c761c890e63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:50.322127 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-719b511a-69e4-4dd5-8c86-5c761c890e63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1392 microversion: 2.1 time: 0.567314 Aug 25 13:46:50.323229 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2876/5701] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:49 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1392 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:51.358157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59bbaadd-6943-41de-a375-ab09535f6f1b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:51.371265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59bbaadd-6943-41de-a375-ab09535f6f1b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:51.406595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59bbaadd-6943-41de-a375-ab09535f6f1b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:51.409027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59bbaadd-6943-41de-a375-ab09535f6f1b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:51.414172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59bbaadd-6943-41de-a375-ab09535f6f1b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:51.420426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59bbaadd-6943-41de-a375-ab09535f6f1b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:51.422423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59bbaadd-6943-41de-a375-ab09535f6f1b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:51.424797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59bbaadd-6943-41de-a375-ab09535f6f1b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:51.861944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b984c1bb-5305-4433-b1af-26105e8d0d2a req-6e34bdb2-577b-4ca2-9e89-1c64b89b0eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "name": "network-vif-plugged", "status": "completed", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:51.919124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b984c1bb-5305-4433-b1af-26105e8d0d2a req-6e34bdb2-577b-4ca2-9e89-1c64b89b0eb1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:51.920117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b984c1bb-5305-4433-b1af-26105e8d0d2a req-6e34bdb2-577b-4ca2-9e89-1c64b89b0eb1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:51.921017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b984c1bb-5305-4433-b1af-26105e8d0d2a req-6e34bdb2-577b-4ca2-9e89-1c64b89b0eb1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:52.006454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-59bbaadd-6943-41de-a375-ab09535f6f1b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:52.010401 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b984c1bb-5305-4433-b1af-26105e8d0d2a req-6e34bdb2-577b-4ca2-9e89-1c64b89b0eb1 service nova] Creating event network-vif-plugged:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h1-852771-8 Aug 25 13:46:52.025841 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b984c1bb-5305-4433-b1af-26105e8d0d2a req-6e34bdb2-577b-4ca2-9e89-1c64b89b0eb1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174205 Aug 25 13:46:52.030153 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2877/5702] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:46:52.054379 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59bbaadd-6943-41de-a375-ab09535f6f1b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1392 microversion: 2.1 time: 0.698032 Aug 25 13:46:52.055561 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2826/5703] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:51 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1392 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:53.113621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a2af7ac5-f04d-4d61-b7cf-b7848b48fe5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:53.115191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a2af7ac5-f04d-4d61-b7cf-b7848b48fe5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:53.164628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2af7ac5-f04d-4d61-b7cf-b7848b48fe5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:53.165822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2af7ac5-f04d-4d61-b7cf-b7848b48fe5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:53.166283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2af7ac5-f04d-4d61-b7cf-b7848b48fe5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:53.169215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2af7ac5-f04d-4d61-b7cf-b7848b48fe5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:53.176783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2af7ac5-f04d-4d61-b7cf-b7848b48fe5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:53.187708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2af7ac5-f04d-4d61-b7cf-b7848b48fe5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:53.855462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a2af7ac5-f04d-4d61-b7cf-b7848b48fe5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:53.930027 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a2af7ac5-f04d-4d61-b7cf-b7848b48fe5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1392 microversion: 2.1 time: 0.839704 Aug 25 13:46:53.961548 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2878/5704] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:53 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1392 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:54.987245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-23f43917-bde4-4683-92e1-907689bd6cb1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:54.989971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-23f43917-bde4-4683-92e1-907689bd6cb1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:55.005575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23f43917-bde4-4683-92e1-907689bd6cb1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:55.006456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23f43917-bde4-4683-92e1-907689bd6cb1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:55.007644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23f43917-bde4-4683-92e1-907689bd6cb1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:55.009482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23f43917-bde4-4683-92e1-907689bd6cb1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:55.010702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23f43917-bde4-4683-92e1-907689bd6cb1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:55.011845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23f43917-bde4-4683-92e1-907689bd6cb1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:55.481233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-23f43917-bde4-4683-92e1-907689bd6cb1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:55.510402 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-23f43917-bde4-4683-92e1-907689bd6cb1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1562 microversion: 2.1 time: 0.530971 Aug 25 13:46:55.525540 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2827/5705] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:54 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1562 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:55.552433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-040d220c-3104-466c-b83c-891f702b10b3 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:55.554598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-040d220c-3104-466c-b83c-891f702b10b3 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:55.580672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d220c-3104-466c-b83c-891f702b10b3 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:55.581925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d220c-3104-466c-b83c-891f702b10b3 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:55.583370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d220c-3104-466c-b83c-891f702b10b3 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:55.585426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d220c-3104-466c-b83c-891f702b10b3 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:55.587443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d220c-3104-466c-b83c-891f702b10b3 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:55.593457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-040d220c-3104-466c-b83c-891f702b10b3 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:56.078004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-040d220c-3104-466c-b83c-891f702b10b3 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:56.106827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-040d220c-3104-466c-b83c-891f702b10b3 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1562 microversion: 2.1 time: 0.562366 Aug 25 13:46:56.118723 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2879/5706] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:55 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1562 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:57.633334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c995ae3c-0511-4148-b200-e6e988170885 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Action: 'create', calling method: .version_select at 0x7f3a2e744040>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1033780759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVFzeNEJMYMd9U+UiAGpmay23/EAFz61zs5bnl8qWOoulRk/jJJz1pIuFWQEXtnou9R0PWyrS7lZIhdJR0/0+u6AHg2KoVTGUyK9TXdvERj6NxNUWM9sUogDliGmX/R+g=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:57.681979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c995ae3c-0511-4148-b200-e6e988170885 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Getting quotas for project 8a0a1d9728c24170bb3ec1585599a38c. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:46:57.695663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c995ae3c-0511-4148-b200-e6e988170885 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Getting quotas for user 8e58cdd9006f469c8da1ea1bdeb8c4d9 and project 8a0a1d9728c24170bb3ec1585599a38c. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:46:57.748183 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c995ae3c-0511-4148-b200-e6e988170885 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.124526 Aug 25 13:46:57.749366 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2828/5707] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:46:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:47:00.635355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-001c9f8a-7dcb-479a-99d2-4299e46f9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:00.636273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b8b75d1c-51fe-49a9-ab01-b1a64883c50c req-da1d8e58-898b-4b9a-bef5-3de80f07bcef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:00.640782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-001c9f8a-7dcb-479a-99d2-4299e46f9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:00.654334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-001c9f8a-7dcb-479a-99d2-4299e46f9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:00.655813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-001c9f8a-7dcb-479a-99d2-4299e46f9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:00.662013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-001c9f8a-7dcb-479a-99d2-4299e46f9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:00.663178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-001c9f8a-7dcb-479a-99d2-4299e46f9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:00.664732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-001c9f8a-7dcb-479a-99d2-4299e46f9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:00.668060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-001c9f8a-7dcb-479a-99d2-4299e46f9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:00.709032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b8b75d1c-51fe-49a9-ab01-b1a64883c50c req-da1d8e58-898b-4b9a-bef5-3de80f07bcef service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:00.721149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b8b75d1c-51fe-49a9-ab01-b1a64883c50c req-da1d8e58-898b-4b9a-bef5-3de80f07bcef service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:00.724650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b8b75d1c-51fe-49a9-ab01-b1a64883c50c req-da1d8e58-898b-4b9a-bef5-3de80f07bcef service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:00.818065 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b8b75d1c-51fe-49a9-ab01-b1a64883c50c req-da1d8e58-898b-4b9a-bef5-3de80f07bcef service nova] Creating event network-changed:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h1-852771-8 Aug 25 13:47:00.839685 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b8b75d1c-51fe-49a9-ab01-b1a64883c50c req-da1d8e58-898b-4b9a-bef5-3de80f07bcef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210270 Aug 25 13:47:00.843404 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2829/5708] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:47:01.108122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-001c9f8a-7dcb-479a-99d2-4299e46f9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:01.137228 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-001c9f8a-7dcb-479a-99d2-4299e46f9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1562 microversion: 2.1 time: 0.512053 Aug 25 13:47:01.141648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1051680140", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3ef5416b-5b1c-4023-afa5-6012a39e5b3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1033780759", "security_groups": [{"name": "tempest-secgroup-smoke-2130413553"}], "networks": [{"uuid": "d61716be-7417-4f69-aa67-7f42e9fc0f20"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:01.144785 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2880/5709] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:00 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1562 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:01.742202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] validate_networks() for [('d61716be-7417-4f69-aa67-7f42e9fc0f20', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:47:02.866777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:47:02.867448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:47:02.867963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:47:02.868486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:47:02.869020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:47:02.871911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:02.894405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:02.902515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:02.902515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:02.902515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:02.902515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:02.902515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:02.911053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=41 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:02.938091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Getting quotas for project 8a0a1d9728c24170bb3ec1585599a38c. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:47:02.948810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Getting quotas for user 8e58cdd9006f469c8da1ea1bdeb8c4d9 and project 8a0a1d9728c24170bb3ec1585599a38c. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:47:03.078622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:47:03.083883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ef5416b-5b1c-4023-afa5-6012a39e5b3a',volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:47:03.427531 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe0d88bf-64de-41a8-9342-e32a393dc196 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.304480 Aug 25 13:47:03.429695 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2830/5710] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:47:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 2310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:47:03.450137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-caf015c9-9e82-4053-8243-db498e301687 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:03.451775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-caf015c9-9e82-4053-8243-db498e301687 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:03.605434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-caf015c9-9e82-4053-8243-db498e301687 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:03.621829 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-caf015c9-9e82-4053-8243-db498e301687 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1099 microversion: 2.1 time: 0.184642 Aug 25 13:47:03.645664 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2881/5711] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:03 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1099 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:04.678322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-442fe87e-e10d-4439-8e70-dff1ffbb6376 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:04.679372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-442fe87e-e10d-4439-8e70-dff1ffbb6376 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:04.692818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442fe87e-e10d-4439-8e70-dff1ffbb6376 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:04.693392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442fe87e-e10d-4439-8e70-dff1ffbb6376 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:04.693918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442fe87e-e10d-4439-8e70-dff1ffbb6376 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:04.694991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442fe87e-e10d-4439-8e70-dff1ffbb6376 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:04.695467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442fe87e-e10d-4439-8e70-dff1ffbb6376 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:04.695894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-442fe87e-e10d-4439-8e70-dff1ffbb6376 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:04.800432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-442fe87e-e10d-4439-8e70-dff1ffbb6376 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:04.811639 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-442fe87e-e10d-4439-8e70-dff1ffbb6376 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1197 microversion: 2.1 time: 0.141697 Aug 25 13:47:04.827201 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2831/5712] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:04 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:05.837091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da75bf69-eb3a-412b-ace5-5f737136be3f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:05.838487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da75bf69-eb3a-412b-ace5-5f737136be3f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:05.848007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da75bf69-eb3a-412b-ace5-5f737136be3f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:05.848863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da75bf69-eb3a-412b-ace5-5f737136be3f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:05.849489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da75bf69-eb3a-412b-ace5-5f737136be3f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:05.850559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da75bf69-eb3a-412b-ace5-5f737136be3f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:05.851240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da75bf69-eb3a-412b-ace5-5f737136be3f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:05.851844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da75bf69-eb3a-412b-ace5-5f737136be3f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:06.121207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da75bf69-eb3a-412b-ace5-5f737136be3f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:06.140856 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da75bf69-eb3a-412b-ace5-5f737136be3f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1215 microversion: 2.1 time: 0.308055 Aug 25 13:47:06.142677 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2882/5713] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:05 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:47:07.190312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5681f9f7-dc84-4bfa-b4e4-0d2e90e3f96f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:07.193089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5681f9f7-dc84-4bfa-b4e4-0d2e90e3f96f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:07.222270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5681f9f7-dc84-4bfa-b4e4-0d2e90e3f96f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:07.229266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5681f9f7-dc84-4bfa-b4e4-0d2e90e3f96f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:07.237000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5681f9f7-dc84-4bfa-b4e4-0d2e90e3f96f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:07.239392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5681f9f7-dc84-4bfa-b4e4-0d2e90e3f96f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:07.240721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5681f9f7-dc84-4bfa-b4e4-0d2e90e3f96f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:07.241897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5681f9f7-dc84-4bfa-b4e4-0d2e90e3f96f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:07.668729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5681f9f7-dc84-4bfa-b4e4-0d2e90e3f96f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:07.685146 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5681f9f7-dc84-4bfa-b4e4-0d2e90e3f96f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1283 microversion: 2.1 time: 0.504607 Aug 25 13:47:07.702560 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2832/5714] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:07 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1283 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:08.139651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b3cebbb9-8c67-43dc-a1e6-2e77f2cf7167 req-a7b8d886-b30f-479a-a0b2-a01617beb2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe1cade-295f-4cfd-a894-7073c8089af8", "tag": "ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:08.156519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=29 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:08.167162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b3cebbb9-8c67-43dc-a1e6-2e77f2cf7167 req-a7b8d886-b30f-479a-a0b2-a01617beb2ec service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:08.169424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b3cebbb9-8c67-43dc-a1e6-2e77f2cf7167 req-a7b8d886-b30f-479a-a0b2-a01617beb2ec service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:08.170649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b3cebbb9-8c67-43dc-a1e6-2e77f2cf7167 req-a7b8d886-b30f-479a-a0b2-a01617beb2ec service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:08.191861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=53 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:08.205689 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b3cebbb9-8c67-43dc-a1e6-2e77f2cf7167 req-a7b8d886-b30f-479a-a0b2-a01617beb2ec service nova] Creating event network-changed:ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53 for instance dbe1cade-295f-4cfd-a894-7073c8089af8 on n-h2-852771-8 Aug 25 13:47:08.213620 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b3cebbb9-8c67-43dc-a1e6-2e77f2cf7167 req-a7b8d886-b30f-479a-a0b2-a01617beb2ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081593 Aug 25 13:47:08.214363 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2883/5715] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:47:08.742401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8b2142e8-9154-4bab-924d-29e64c992416 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:08.743681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8b2142e8-9154-4bab-924d-29e64c992416 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:08.768175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b2142e8-9154-4bab-924d-29e64c992416 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:08.773338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b2142e8-9154-4bab-924d-29e64c992416 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:08.774044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b2142e8-9154-4bab-924d-29e64c992416 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:08.774995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b2142e8-9154-4bab-924d-29e64c992416 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:08.776700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b2142e8-9154-4bab-924d-29e64c992416 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:08.777306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8b2142e8-9154-4bab-924d-29e64c992416 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:09.525422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8b2142e8-9154-4bab-924d-29e64c992416 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:09.555267 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8b2142e8-9154-4bab-924d-29e64c992416 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1283 microversion: 2.1 time: 0.833056 Aug 25 13:47:09.563021 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2833/5716] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:08 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1283 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:10.597350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f11d880b-c931-4f96-9b63-4ef81065eaf6 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:10.606721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f11d880b-c931-4f96-9b63-4ef81065eaf6 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:10.647222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f11d880b-c931-4f96-9b63-4ef81065eaf6 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:10.653678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f11d880b-c931-4f96-9b63-4ef81065eaf6 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:10.655135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f11d880b-c931-4f96-9b63-4ef81065eaf6 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:10.665525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f11d880b-c931-4f96-9b63-4ef81065eaf6 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:10.669346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f11d880b-c931-4f96-9b63-4ef81065eaf6 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:10.670169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f11d880b-c931-4f96-9b63-4ef81065eaf6 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:11.339964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f11d880b-c931-4f96-9b63-4ef81065eaf6 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:11.379903 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f11d880b-c931-4f96-9b63-4ef81065eaf6 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1283 microversion: 2.1 time: 0.785560 Aug 25 13:47:11.382032 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2884/5717] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:10 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1283 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:12.430867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b9b4f09-1f52-4512-85aa-1d90a7bec85d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:12.433280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b9b4f09-1f52-4512-85aa-1d90a7bec85d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:12.448933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9b4f09-1f52-4512-85aa-1d90a7bec85d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:12.450534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9b4f09-1f52-4512-85aa-1d90a7bec85d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:12.451786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9b4f09-1f52-4512-85aa-1d90a7bec85d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:12.453456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9b4f09-1f52-4512-85aa-1d90a7bec85d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:12.455437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9b4f09-1f52-4512-85aa-1d90a7bec85d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:12.456818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9b4f09-1f52-4512-85aa-1d90a7bec85d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:12.816774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b9b4f09-1f52-4512-85aa-1d90a7bec85d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:12.834762 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b9b4f09-1f52-4512-85aa-1d90a7bec85d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1283 microversion: 2.1 time: 0.418030 Aug 25 13:47:12.836847 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2834/5718] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:12 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1283 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:13.879647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-00c7d5e9-5f85-4151-82ac-c640783c404c tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:13.880528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-00c7d5e9-5f85-4151-82ac-c640783c404c tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:13.884078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:13.905711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00c7d5e9-5f85-4151-82ac-c640783c404c tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:13.906665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00c7d5e9-5f85-4151-82ac-c640783c404c tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:13.908559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00c7d5e9-5f85-4151-82ac-c640783c404c tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:13.910968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00c7d5e9-5f85-4151-82ac-c640783c404c tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:13.911954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00c7d5e9-5f85-4151-82ac-c640783c404c tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:13.913005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00c7d5e9-5f85-4151-82ac-c640783c404c tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:14.293299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-00c7d5e9-5f85-4151-82ac-c640783c404c tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:14.328628 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-00c7d5e9-5f85-4151-82ac-c640783c404c tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1283 microversion: 2.1 time: 0.455970 Aug 25 13:47:14.330567 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2885/5719] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:13 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1283 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:15.360259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-56c74717-3d00-4749-ab3c-eea8c5524910 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:15.362812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-56c74717-3d00-4749-ab3c-eea8c5524910 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:15.366328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:15.367609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:15.382112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56c74717-3d00-4749-ab3c-eea8c5524910 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:15.383564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56c74717-3d00-4749-ab3c-eea8c5524910 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:15.384476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56c74717-3d00-4749-ab3c-eea8c5524910 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:15.386236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56c74717-3d00-4749-ab3c-eea8c5524910 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:15.387198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56c74717-3d00-4749-ab3c-eea8c5524910 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:15.388471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56c74717-3d00-4749-ab3c-eea8c5524910 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:15.762219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-56c74717-3d00-4749-ab3c-eea8c5524910 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:15.776485 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-56c74717-3d00-4749-ab3c-eea8c5524910 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1271 microversion: 2.1 time: 0.420718 Aug 25 13:47:15.783137 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2835/5720] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:15 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1271 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:16.814430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d5a2f1f2-3afa-4831-a196-a68b4172fcdc tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:16.815995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d5a2f1f2-3afa-4831-a196-a68b4172fcdc tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:16.831808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a2f1f2-3afa-4831-a196-a68b4172fcdc tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:16.832891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a2f1f2-3afa-4831-a196-a68b4172fcdc tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:16.833692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a2f1f2-3afa-4831-a196-a68b4172fcdc tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:16.835142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a2f1f2-3afa-4831-a196-a68b4172fcdc tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:16.835513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a2f1f2-3afa-4831-a196-a68b4172fcdc tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:16.835954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5a2f1f2-3afa-4831-a196-a68b4172fcdc tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:17.144992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d5a2f1f2-3afa-4831-a196-a68b4172fcdc tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:17.160967 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d5a2f1f2-3afa-4831-a196-a68b4172fcdc tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1271 microversion: 2.1 time: 0.351097 Aug 25 13:47:17.162640 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2886/5721] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:16 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1271 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:18.195632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19c9252c-5e44-4701-a896-ae8f72143af4 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:18.196516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-19c9252c-5e44-4701-a896-ae8f72143af4 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:18.209547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19c9252c-5e44-4701-a896-ae8f72143af4 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:18.211658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19c9252c-5e44-4701-a896-ae8f72143af4 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:18.214051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19c9252c-5e44-4701-a896-ae8f72143af4 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:18.215025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19c9252c-5e44-4701-a896-ae8f72143af4 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:18.215581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19c9252c-5e44-4701-a896-ae8f72143af4 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:18.216131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19c9252c-5e44-4701-a896-ae8f72143af4 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:18.415931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-19c9252c-5e44-4701-a896-ae8f72143af4 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:18.430728 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19c9252c-5e44-4701-a896-ae8f72143af4 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1271 microversion: 2.1 time: 0.239316 Aug 25 13:47:18.431952 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2836/5722] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:18 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:19.460038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a2dfae4d-7e2e-43db-868a-21606f1d2064 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:19.461791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a2dfae4d-7e2e-43db-868a-21606f1d2064 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:19.477010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2dfae4d-7e2e-43db-868a-21606f1d2064 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:19.477753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2dfae4d-7e2e-43db-868a-21606f1d2064 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:19.478346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2dfae4d-7e2e-43db-868a-21606f1d2064 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:19.479185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2dfae4d-7e2e-43db-868a-21606f1d2064 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:19.479718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2dfae4d-7e2e-43db-868a-21606f1d2064 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:19.480220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2dfae4d-7e2e-43db-868a-21606f1d2064 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:19.758049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a2dfae4d-7e2e-43db-868a-21606f1d2064 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:19.768600 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a2dfae4d-7e2e-43db-868a-21606f1d2064 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1271 microversion: 2.1 time: 0.315438 Aug 25 13:47:19.771240 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2887/5723] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:19 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1271 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:20.803124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4bf03b92-6068-4c6a-9bb0-c877038ab63f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:20.804605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4bf03b92-6068-4c6a-9bb0-c877038ab63f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:20.834755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bf03b92-6068-4c6a-9bb0-c877038ab63f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:20.835666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bf03b92-6068-4c6a-9bb0-c877038ab63f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:20.836949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bf03b92-6068-4c6a-9bb0-c877038ab63f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:20.844428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bf03b92-6068-4c6a-9bb0-c877038ab63f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:20.845996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bf03b92-6068-4c6a-9bb0-c877038ab63f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:20.846834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bf03b92-6068-4c6a-9bb0-c877038ab63f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:21.073325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4bf03b92-6068-4c6a-9bb0-c877038ab63f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:21.086498 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4bf03b92-6068-4c6a-9bb0-c877038ab63f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1271 microversion: 2.1 time: 0.293037 Aug 25 13:47:21.087423 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2837/5724] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:20 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:22.123819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bd600b5e-524e-4853-ad36-40a0909cd8d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:22.124667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bd600b5e-524e-4853-ad36-40a0909cd8d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:22.134400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd600b5e-524e-4853-ad36-40a0909cd8d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:22.135271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd600b5e-524e-4853-ad36-40a0909cd8d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:22.135858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd600b5e-524e-4853-ad36-40a0909cd8d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:22.137403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd600b5e-524e-4853-ad36-40a0909cd8d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:22.138690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd600b5e-524e-4853-ad36-40a0909cd8d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:22.139397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd600b5e-524e-4853-ad36-40a0909cd8d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:22.364759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bd600b5e-524e-4853-ad36-40a0909cd8d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:22.377436 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bd600b5e-524e-4853-ad36-40a0909cd8d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1271 microversion: 2.1 time: 0.260054 Aug 25 13:47:22.378541 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2888/5725] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:22 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:23.420060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-28225220-2577-496f-a165-0ecc65b380d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:23.421835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-28225220-2577-496f-a165-0ecc65b380d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:23.432173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28225220-2577-496f-a165-0ecc65b380d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:23.433056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28225220-2577-496f-a165-0ecc65b380d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:23.433791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28225220-2577-496f-a165-0ecc65b380d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:23.434774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28225220-2577-496f-a165-0ecc65b380d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:23.435938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28225220-2577-496f-a165-0ecc65b380d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:23.436600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-28225220-2577-496f-a165-0ecc65b380d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:23.692768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-28225220-2577-496f-a165-0ecc65b380d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:23.702707 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-28225220-2577-496f-a165-0ecc65b380d3 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1271 microversion: 2.1 time: 0.288640 Aug 25 13:47:23.703355 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2838/5726] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:23 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:24.728014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b30b11a4-5891-48e6-8a0e-5d6cacea6757 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:24.728854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b30b11a4-5891-48e6-8a0e-5d6cacea6757 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:24.740921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30b11a4-5891-48e6-8a0e-5d6cacea6757 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:24.741996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30b11a4-5891-48e6-8a0e-5d6cacea6757 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:24.743500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30b11a4-5891-48e6-8a0e-5d6cacea6757 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:24.744572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30b11a4-5891-48e6-8a0e-5d6cacea6757 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:24.745250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30b11a4-5891-48e6-8a0e-5d6cacea6757 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:24.745870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b30b11a4-5891-48e6-8a0e-5d6cacea6757 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:25.002268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b30b11a4-5891-48e6-8a0e-5d6cacea6757 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:25.014867 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b30b11a4-5891-48e6-8a0e-5d6cacea6757 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1271 microversion: 2.1 time: 0.292855 Aug 25 13:47:25.029630 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2889/5727] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:24 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:26.039413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ddccfe88-d3b8-41ef-b886-4464a08a5052 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:26.041444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ddccfe88-d3b8-41ef-b886-4464a08a5052 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:26.056806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddccfe88-d3b8-41ef-b886-4464a08a5052 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:26.057474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddccfe88-d3b8-41ef-b886-4464a08a5052 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:26.058068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddccfe88-d3b8-41ef-b886-4464a08a5052 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:26.058924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddccfe88-d3b8-41ef-b886-4464a08a5052 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:26.059512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddccfe88-d3b8-41ef-b886-4464a08a5052 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:26.060060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddccfe88-d3b8-41ef-b886-4464a08a5052 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:26.306280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ddccfe88-d3b8-41ef-b886-4464a08a5052 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:26.324419 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ddccfe88-d3b8-41ef-b886-4464a08a5052 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1271 microversion: 2.1 time: 0.290092 Aug 25 13:47:26.326385 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2839/5728] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:26 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:26.516093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-64223520-248f-4ecd-a00e-dcb73370d4e8 req-1efe0c36-1410-4a8c-9f8e-4c6f02a1d4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe1cade-295f-4cfd-a894-7073c8089af8", "name": "network-vif-plugged", "status": "completed", "tag": "ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:26.534977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-64223520-248f-4ecd-a00e-dcb73370d4e8 req-1efe0c36-1410-4a8c-9f8e-4c6f02a1d4a3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:26.536372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-64223520-248f-4ecd-a00e-dcb73370d4e8 req-1efe0c36-1410-4a8c-9f8e-4c6f02a1d4a3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:26.537466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-64223520-248f-4ecd-a00e-dcb73370d4e8 req-1efe0c36-1410-4a8c-9f8e-4c6f02a1d4a3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:26.559685 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-64223520-248f-4ecd-a00e-dcb73370d4e8 req-1efe0c36-1410-4a8c-9f8e-4c6f02a1d4a3 service nova] Creating event network-vif-plugged:ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53 for instance dbe1cade-295f-4cfd-a894-7073c8089af8 on n-h2-852771-8 Aug 25 13:47:26.570899 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-64223520-248f-4ecd-a00e-dcb73370d4e8 req-1efe0c36-1410-4a8c-9f8e-4c6f02a1d4a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059267 Aug 25 13:47:26.574462 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2890/5729] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:47:27.352988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-840ee128-2324-4e88-9cae-cd71fc727a53 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:27.354229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-840ee128-2324-4e88-9cae-cd71fc727a53 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:27.379205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840ee128-2324-4e88-9cae-cd71fc727a53 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:27.379725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840ee128-2324-4e88-9cae-cd71fc727a53 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:27.380183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840ee128-2324-4e88-9cae-cd71fc727a53 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:27.380939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840ee128-2324-4e88-9cae-cd71fc727a53 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:27.381452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840ee128-2324-4e88-9cae-cd71fc727a53 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:27.382134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840ee128-2324-4e88-9cae-cd71fc727a53 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:27.664177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-840ee128-2324-4e88-9cae-cd71fc727a53 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:27.675778 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-840ee128-2324-4e88-9cae-cd71fc727a53 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1271 microversion: 2.1 time: 0.328073 Aug 25 13:47:27.677349 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2840/5730] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:27 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1271 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:28.706840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c7fa192c-6b4e-40bb-b625-05dd1c807d64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:28.708184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c7fa192c-6b4e-40bb-b625-05dd1c807d64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:28.720782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7fa192c-6b4e-40bb-b625-05dd1c807d64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:28.721921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7fa192c-6b4e-40bb-b625-05dd1c807d64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:28.722520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7fa192c-6b4e-40bb-b625-05dd1c807d64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:28.723890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7fa192c-6b4e-40bb-b625-05dd1c807d64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:28.724741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7fa192c-6b4e-40bb-b625-05dd1c807d64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:28.725561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c7fa192c-6b4e-40bb-b625-05dd1c807d64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:28.973128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c7fa192c-6b4e-40bb-b625-05dd1c807d64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:28.984622 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c7fa192c-6b4e-40bb-b625-05dd1c807d64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1459 microversion: 2.1 time: 0.288090 Aug 25 13:47:28.985831 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2891/5731] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:28 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1459 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:29.010939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cd9859de-1c26-4b1a-87b3-b15f546ae28b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:29.012935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cd9859de-1c26-4b1a-87b3-b15f546ae28b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:29.024564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd9859de-1c26-4b1a-87b3-b15f546ae28b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:29.025041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd9859de-1c26-4b1a-87b3-b15f546ae28b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:29.025558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd9859de-1c26-4b1a-87b3-b15f546ae28b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:29.026542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd9859de-1c26-4b1a-87b3-b15f546ae28b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:29.027007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd9859de-1c26-4b1a-87b3-b15f546ae28b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:29.027675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd9859de-1c26-4b1a-87b3-b15f546ae28b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:29.243611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cd9859de-1c26-4b1a-87b3-b15f546ae28b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:29.259370 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cd9859de-1c26-4b1a-87b3-b15f546ae28b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1459 microversion: 2.1 time: 0.254252 Aug 25 13:47:29.260346 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2841/5732] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:29 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1459 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:31.173187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1945029f-9757-4b3e-ae4b-5084fdc676b8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:31.181093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1945029f-9757-4b3e-ae4b-5084fdc676b8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:31.207160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1945029f-9757-4b3e-ae4b-5084fdc676b8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:31.212753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1945029f-9757-4b3e-ae4b-5084fdc676b8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:31.215585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1945029f-9757-4b3e-ae4b-5084fdc676b8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:31.217859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1945029f-9757-4b3e-ae4b-5084fdc676b8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:31.222307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1945029f-9757-4b3e-ae4b-5084fdc676b8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:31.224030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1945029f-9757-4b3e-ae4b-5084fdc676b8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:31.318995 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1945029f-9757-4b3e-ae4b-5084fdc676b8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4/action" status: 200 len: 24558 microversion: 2.1 time: 0.155360 Aug 25 13:47:31.320119 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2892/5733] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:47:31 2022] POST /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4/action => generated 24558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:47:33.046390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-4fa395e5-387f-4fca-8782-14c4051d1598 req-b0a01c8c-6bad-4a84-acee-11686821d5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe1cade-295f-4cfd-a894-7073c8089af8", "tag": "ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:33.073076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:33.077493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4fa395e5-387f-4fca-8782-14c4051d1598 req-b0a01c8c-6bad-4a84-acee-11686821d5e0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:33.078546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4fa395e5-387f-4fca-8782-14c4051d1598 req-b0a01c8c-6bad-4a84-acee-11686821d5e0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:33.080393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4fa395e5-387f-4fca-8782-14c4051d1598 req-b0a01c8c-6bad-4a84-acee-11686821d5e0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:33.111655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=68 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:33.116907 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-4fa395e5-387f-4fca-8782-14c4051d1598 req-b0a01c8c-6bad-4a84-acee-11686821d5e0 service nova] Creating event network-changed:ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53 for instance dbe1cade-295f-4cfd-a894-7073c8089af8 on n-h2-852771-8 Aug 25 13:47:33.126388 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-4fa395e5-387f-4fca-8782-14c4051d1598 req-b0a01c8c-6bad-4a84-acee-11686821d5e0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.462421 Aug 25 13:47:33.127759 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2842/5734] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:47:35.440878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-283e6708-2f83-48a2-b1f8-fc5b447cdbb8 req-aa8ba154-812c-4ba7-9423-dba097040387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe1cade-295f-4cfd-a894-7073c8089af8", "tag": "ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:35.504923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-283e6708-2f83-48a2-b1f8-fc5b447cdbb8 req-aa8ba154-812c-4ba7-9423-dba097040387 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:35.506239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-283e6708-2f83-48a2-b1f8-fc5b447cdbb8 req-aa8ba154-812c-4ba7-9423-dba097040387 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:35.507605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-283e6708-2f83-48a2-b1f8-fc5b447cdbb8 req-aa8ba154-812c-4ba7-9423-dba097040387 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:35.544746 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-283e6708-2f83-48a2-b1f8-fc5b447cdbb8 req-aa8ba154-812c-4ba7-9423-dba097040387 service nova] Creating event network-changed:ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53 for instance dbe1cade-295f-4cfd-a894-7073c8089af8 on n-h2-852771-8 Aug 25 13:47:35.557353 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-283e6708-2f83-48a2-b1f8-fc5b447cdbb8 req-aa8ba154-812c-4ba7-9423-dba097040387 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124063 Aug 25 13:47:35.560346 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2893/5735] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:47:37.595752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c29c76ed-b7d2-4579-af32-495923dce895 req-f2da7b48-60ec-4549-84ce-3af98d1a1285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe1cade-295f-4cfd-a894-7073c8089af8", "tag": "ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:37.636230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c29c76ed-b7d2-4579-af32-495923dce895 req-f2da7b48-60ec-4549-84ce-3af98d1a1285 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:37.638036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c29c76ed-b7d2-4579-af32-495923dce895 req-f2da7b48-60ec-4549-84ce-3af98d1a1285 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:37.644334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c29c76ed-b7d2-4579-af32-495923dce895 req-f2da7b48-60ec-4549-84ce-3af98d1a1285 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:37.674642 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c29c76ed-b7d2-4579-af32-495923dce895 req-f2da7b48-60ec-4549-84ce-3af98d1a1285 service nova] Creating event network-changed:ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53 for instance dbe1cade-295f-4cfd-a894-7073c8089af8 on n-h2-852771-8 Aug 25 13:47:37.682321 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c29c76ed-b7d2-4579-af32-495923dce895 req-f2da7b48-60ec-4549-84ce-3af98d1a1285 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096638 Aug 25 13:47:37.686583 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2843/5736] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:01.779783 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:48:01.797869 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 13:48:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 (ip 10.222.0.70) !!! Aug 25 13:48:01.800619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=21 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:01.810774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=51 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:02.186096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-40ccb93b-689a-4704-910e-62994c564d90 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:02.187503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-40ccb93b-689a-4704-910e-62994c564d90 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:02.208843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40ccb93b-689a-4704-910e-62994c564d90 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:02.210121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40ccb93b-689a-4704-910e-62994c564d90 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:02.212401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40ccb93b-689a-4704-910e-62994c564d90 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:02.213897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40ccb93b-689a-4704-910e-62994c564d90 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:02.214697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40ccb93b-689a-4704-910e-62994c564d90 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:02.215258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40ccb93b-689a-4704-910e-62994c564d90 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:02.482678 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-40ccb93b-689a-4704-910e-62994c564d90 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1832 microversion: 2.1 time: 0.713244 Aug 25 13:48:02.483816 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2894/5737] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:01 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1832 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:02.529677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:02.531184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:02.786238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0239e367-9fe0-4ecd-8b8f-eac82e048a0b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:02.787767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0239e367-9fe0-4ecd-8b8f-eac82e048a0b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:02.801688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0239e367-9fe0-4ecd-8b8f-eac82e048a0b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:02.803191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0239e367-9fe0-4ecd-8b8f-eac82e048a0b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:02.803923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0239e367-9fe0-4ecd-8b8f-eac82e048a0b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:02.805840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0239e367-9fe0-4ecd-8b8f-eac82e048a0b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:02.806630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0239e367-9fe0-4ecd-8b8f-eac82e048a0b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:02.807954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0239e367-9fe0-4ecd-8b8f-eac82e048a0b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:03.100859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0239e367-9fe0-4ecd-8b8f-eac82e048a0b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:03.122884 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0239e367-9fe0-4ecd-8b8f-eac82e048a0b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1681 microversion: 2.1 time: 0.601864 Aug 25 13:48:03.133775 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2844/5738] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:02 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1681 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:03.349481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7221e87b-350e-45ec-affd-b06c3d4589e2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:03.353821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7221e87b-350e-45ec-affd-b06c3d4589e2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:03.383482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7221e87b-350e-45ec-affd-b06c3d4589e2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:03.385336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7221e87b-350e-45ec-affd-b06c3d4589e2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:03.386783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7221e87b-350e-45ec-affd-b06c3d4589e2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:03.388724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7221e87b-350e-45ec-affd-b06c3d4589e2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:03.394125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7221e87b-350e-45ec-affd-b06c3d4589e2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:03.395612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7221e87b-350e-45ec-affd-b06c3d4589e2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:03.494906 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7221e87b-350e-45ec-affd-b06c3d4589e2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4/action" status: 200 len: 32627 microversion: 2.1 time: 0.166863 Aug 25 13:48:03.497093 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2895/5739] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:48:03 2022] POST /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4/action => generated 32627 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:48:03.738395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:03.739240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:03.749865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:03.751570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:03.752535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:03.755158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:03.756993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:03.758348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:03.825113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9c1ef8118b934efc9090df2b1df8236e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da27602c05a445de810de5a195a51bb6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:03.826545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] flavor_id is None. Assuming migration. {{(pid=129059) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 25 13:48:03.827231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129059) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 13:48:04.453054 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-39872941-1b9c-4191-bf21-c8426ffcb629 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4/action" status: 202 len: 0 microversion: 2.1 time: 0.721018 Aug 25 13:48:04.461791 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2845/5740] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:48:03 2022] POST /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:48:04.471078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bc4f601f-b481-4b97-8a2d-397c1db8c9ea tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:04.473085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bc4f601f-b481-4b97-8a2d-397c1db8c9ea tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:04.508456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4f601f-b481-4b97-8a2d-397c1db8c9ea tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:04.509601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4f601f-b481-4b97-8a2d-397c1db8c9ea tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:04.510590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4f601f-b481-4b97-8a2d-397c1db8c9ea tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:04.512840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4f601f-b481-4b97-8a2d-397c1db8c9ea tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:04.514318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4f601f-b481-4b97-8a2d-397c1db8c9ea tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:04.515264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc4f601f-b481-4b97-8a2d-397c1db8c9ea tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:04.854822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bc4f601f-b481-4b97-8a2d-397c1db8c9ea tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:04.873058 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bc4f601f-b481-4b97-8a2d-397c1db8c9ea tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1690 microversion: 2.1 time: 0.408101 Aug 25 13:48:04.875055 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2896/5741] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:04 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1690 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:05.904066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-37797012-c3db-45d4-a5f5-65de3b12fa6a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:05.904935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-37797012-c3db-45d4-a5f5-65de3b12fa6a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:05.916116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37797012-c3db-45d4-a5f5-65de3b12fa6a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:05.916699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37797012-c3db-45d4-a5f5-65de3b12fa6a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:05.917196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37797012-c3db-45d4-a5f5-65de3b12fa6a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:05.917985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37797012-c3db-45d4-a5f5-65de3b12fa6a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:05.918466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37797012-c3db-45d4-a5f5-65de3b12fa6a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:05.918907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37797012-c3db-45d4-a5f5-65de3b12fa6a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:06.175927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37797012-c3db-45d4-a5f5-65de3b12fa6a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:06.195911 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-37797012-c3db-45d4-a5f5-65de3b12fa6a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1690 microversion: 2.1 time: 0.295053 Aug 25 13:48:06.197164 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2846/5742] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:05 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1690 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:07.228670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fbe7f83a-3c58-4b88-99a0-703e5ddcc2ab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:07.229362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fbe7f83a-3c58-4b88-99a0-703e5ddcc2ab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:07.284246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe7f83a-3c58-4b88-99a0-703e5ddcc2ab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:07.288318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe7f83a-3c58-4b88-99a0-703e5ddcc2ab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:07.289457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe7f83a-3c58-4b88-99a0-703e5ddcc2ab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:07.291031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe7f83a-3c58-4b88-99a0-703e5ddcc2ab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:07.296857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe7f83a-3c58-4b88-99a0-703e5ddcc2ab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:07.298486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbe7f83a-3c58-4b88-99a0-703e5ddcc2ab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:07.845368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fbe7f83a-3c58-4b88-99a0-703e5ddcc2ab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:07.868727 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fbe7f83a-3c58-4b88-99a0-703e5ddcc2ab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1690 microversion: 2.1 time: 0.649240 Aug 25 13:48:07.870027 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2897/5743] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:07 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1690 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:08.901967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d7fb83c4-2e6c-4842-9861-4468ff6068bd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:08.903134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d7fb83c4-2e6c-4842-9861-4468ff6068bd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:08.962172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-56055848-1ef3-451d-8be9-6b3807c637a1 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:08.964021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7fb83c4-2e6c-4842-9861-4468ff6068bd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:08.964547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-56055848-1ef3-451d-8be9-6b3807c637a1 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:08.968337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7fb83c4-2e6c-4842-9861-4468ff6068bd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:08.970723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7fb83c4-2e6c-4842-9861-4468ff6068bd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:08.971714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7fb83c4-2e6c-4842-9861-4468ff6068bd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:08.975322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7fb83c4-2e6c-4842-9861-4468ff6068bd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:08.978390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7fb83c4-2e6c-4842-9861-4468ff6068bd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:08.997441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56055848-1ef3-451d-8be9-6b3807c637a1 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:09.001370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56055848-1ef3-451d-8be9-6b3807c637a1 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:09.004046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56055848-1ef3-451d-8be9-6b3807c637a1 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:09.008831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56055848-1ef3-451d-8be9-6b3807c637a1 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:09.012864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56055848-1ef3-451d-8be9-6b3807c637a1 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:09.016445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56055848-1ef3-451d-8be9-6b3807c637a1 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:09.106631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-56055848-1ef3-451d-8be9-6b3807c637a1 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:48:09.356010 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-56055848-1ef3-451d-8be9-6b3807c637a1 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 204 len: 0 microversion: 2.1 time: 0.405660 Aug 25 13:48:09.357100 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2898/5744] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:48:08 2022] DELETE /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:48:09.381864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-3a3a3d4d-f8ba-4f0c-ac47-61138b2b57a1 req-6267dd70-2c5d-4122-907a-eab8ff38c785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe1cade-295f-4cfd-a894-7073c8089af8", "tag": "ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:09.398650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d7fb83c4-2e6c-4842-9861-4468ff6068bd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:09.420280 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d7fb83c4-2e6c-4842-9861-4468ff6068bd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1695 microversion: 2.1 time: 0.531075 Aug 25 13:48:09.430081 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2847/5745] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:08 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1695 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:09.435679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3a3a3d4d-f8ba-4f0c-ac47-61138b2b57a1 req-6267dd70-2c5d-4122-907a-eab8ff38c785 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:09.439597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3a3a3d4d-f8ba-4f0c-ac47-61138b2b57a1 req-6267dd70-2c5d-4122-907a-eab8ff38c785 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:09.439597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3a3a3d4d-f8ba-4f0c-ac47-61138b2b57a1 req-6267dd70-2c5d-4122-907a-eab8ff38c785 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:09.440027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b9fb1f0f-6fd1-48ba-814e-84244e58fb64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:09.443211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b9fb1f0f-6fd1-48ba-814e-84244e58fb64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:09.457898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb1f0f-6fd1-48ba-814e-84244e58fb64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:09.459053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb1f0f-6fd1-48ba-814e-84244e58fb64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:09.460131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb1f0f-6fd1-48ba-814e-84244e58fb64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:09.461829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb1f0f-6fd1-48ba-814e-84244e58fb64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:09.463000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb1f0f-6fd1-48ba-814e-84244e58fb64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:09.468595 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-3a3a3d4d-f8ba-4f0c-ac47-61138b2b57a1 req-6267dd70-2c5d-4122-907a-eab8ff38c785 service nova] Creating event network-changed:ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53 for instance dbe1cade-295f-4cfd-a894-7073c8089af8 on n-h2-852771-8 Aug 25 13:48:09.470427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9fb1f0f-6fd1-48ba-814e-84244e58fb64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:09.489341 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-3a3a3d4d-f8ba-4f0c-ac47-61138b2b57a1 req-6267dd70-2c5d-4122-907a-eab8ff38c785 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123942 Aug 25 13:48:09.490319 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2899/5746] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:09.737844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b9fb1f0f-6fd1-48ba-814e-84244e58fb64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:09.756540 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b9fb1f0f-6fd1-48ba-814e-84244e58fb64 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1582 microversion: 2.1 time: 0.329906 Aug 25 13:48:09.758275 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2848/5747] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:09 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1582 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:10.464325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6b15d795-95ff-4cd3-af0f-5e572756a563 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:10.477791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6b15d795-95ff-4cd3-af0f-5e572756a563 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:10.506896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b15d795-95ff-4cd3-af0f-5e572756a563 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:10.507791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b15d795-95ff-4cd3-af0f-5e572756a563 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:10.508600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b15d795-95ff-4cd3-af0f-5e572756a563 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:10.512744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b15d795-95ff-4cd3-af0f-5e572756a563 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:10.513804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b15d795-95ff-4cd3-af0f-5e572756a563 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:10.514889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6b15d795-95ff-4cd3-af0f-5e572756a563 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:10.810170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-297daa4c-676f-4313-a780-56d161594ec8 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:10.811545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-297daa4c-676f-4313-a780-56d161594ec8 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:10.822433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-297daa4c-676f-4313-a780-56d161594ec8 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:10.824165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-297daa4c-676f-4313-a780-56d161594ec8 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:10.824847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-297daa4c-676f-4313-a780-56d161594ec8 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:10.825629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-297daa4c-676f-4313-a780-56d161594ec8 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:10.831583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-297daa4c-676f-4313-a780-56d161594ec8 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:10.833064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-297daa4c-676f-4313-a780-56d161594ec8 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:11.532479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6b15d795-95ff-4cd3-af0f-5e572756a563 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:11.548020 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6b15d795-95ff-4cd3-af0f-5e572756a563 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1695 microversion: 2.1 time: 1.093334 Aug 25 13:48:11.549353 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2900/5748] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:10 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1695 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:11.585241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-297daa4c-676f-4313-a780-56d161594ec8 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:11.602593 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-297daa4c-676f-4313-a780-56d161594ec8 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1582 microversion: 2.1 time: 0.816250 Aug 25 13:48:11.604570 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2849/5749] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:10 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1582 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:12.071857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8333315c-4b8b-4f5d-8d7a-a4aeac2fbcca req-ccd9c094-0767-4a46-8993-518c2e155283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe1cade-295f-4cfd-a894-7073c8089af8", "name": "network-vif-deleted", "tag": "ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:12.100468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8333315c-4b8b-4f5d-8d7a-a4aeac2fbcca req-ccd9c094-0767-4a46-8993-518c2e155283 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:12.100958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8333315c-4b8b-4f5d-8d7a-a4aeac2fbcca req-ccd9c094-0767-4a46-8993-518c2e155283 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:12.101780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8333315c-4b8b-4f5d-8d7a-a4aeac2fbcca req-ccd9c094-0767-4a46-8993-518c2e155283 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:12.136053 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8333315c-4b8b-4f5d-8d7a-a4aeac2fbcca req-ccd9c094-0767-4a46-8993-518c2e155283 service nova] Creating event network-vif-deleted:ccf6a3bc-cb2c-4127-98ae-c895ecdb3f53 for instance dbe1cade-295f-4cfd-a894-7073c8089af8 on n-h2-852771-8 Aug 25 13:48:12.154895 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8333315c-4b8b-4f5d-8d7a-a4aeac2fbcca req-ccd9c094-0767-4a46-8993-518c2e155283 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095739 Aug 25 13:48:12.155872 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2901/5750] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 25 13:48:12.590545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9a9cbdc5-5a24-47b2-ae7a-99636e836451 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:12.591495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9a9cbdc5-5a24-47b2-ae7a-99636e836451 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:12.609942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a9cbdc5-5a24-47b2-ae7a-99636e836451 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:12.611560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a9cbdc5-5a24-47b2-ae7a-99636e836451 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:12.612924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a9cbdc5-5a24-47b2-ae7a-99636e836451 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:12.614109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a9cbdc5-5a24-47b2-ae7a-99636e836451 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:12.615034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a9cbdc5-5a24-47b2-ae7a-99636e836451 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:12.615934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9a9cbdc5-5a24-47b2-ae7a-99636e836451 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:12.649151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-37b535d2-75a2-458d-a5b6-6a32171ad47b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:12.655369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-37b535d2-75a2-458d-a5b6-6a32171ad47b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:12.671892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37b535d2-75a2-458d-a5b6-6a32171ad47b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:12.673041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37b535d2-75a2-458d-a5b6-6a32171ad47b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:12.673968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37b535d2-75a2-458d-a5b6-6a32171ad47b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:12.675646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37b535d2-75a2-458d-a5b6-6a32171ad47b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:12.677198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37b535d2-75a2-458d-a5b6-6a32171ad47b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:12.678604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37b535d2-75a2-458d-a5b6-6a32171ad47b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:12.813848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-37b535d2-75a2-458d-a5b6-6a32171ad47b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:12.837644 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-37b535d2-75a2-458d-a5b6-6a32171ad47b tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1397 microversion: 2.1 time: 0.201035 Aug 25 13:48:12.851672 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2902/5751] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:12 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1397 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:12.902967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9a9cbdc5-5a24-47b2-ae7a-99636e836451 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:12.915557 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9a9cbdc5-5a24-47b2-ae7a-99636e836451 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1695 microversion: 2.1 time: 0.329974 Aug 25 13:48:12.916925 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2850/5752] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:12 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1695 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:13.888154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f4e0d77-7305-44c8-a049-3eb1b42fedbd tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:13.890905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f4e0d77-7305-44c8-a049-3eb1b42fedbd tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:13.915781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4e0d77-7305-44c8-a049-3eb1b42fedbd tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:13.923539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4e0d77-7305-44c8-a049-3eb1b42fedbd tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:13.924891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4e0d77-7305-44c8-a049-3eb1b42fedbd tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:13.926233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4e0d77-7305-44c8-a049-3eb1b42fedbd tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:13.927076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4e0d77-7305-44c8-a049-3eb1b42fedbd tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:13.928079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4e0d77-7305-44c8-a049-3eb1b42fedbd tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:13.949792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e7ca5cd0-fbf9-4600-a608-da874a769243 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:13.951249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e7ca5cd0-fbf9-4600-a608-da874a769243 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:13.967025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7ca5cd0-fbf9-4600-a608-da874a769243 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:13.974607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7ca5cd0-fbf9-4600-a608-da874a769243 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:13.975564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7ca5cd0-fbf9-4600-a608-da874a769243 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:13.976779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7ca5cd0-fbf9-4600-a608-da874a769243 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:13.977984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7ca5cd0-fbf9-4600-a608-da874a769243 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:13.978346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7ca5cd0-fbf9-4600-a608-da874a769243 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:14.052717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f4e0d77-7305-44c8-a049-3eb1b42fedbd tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:14.091179 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f4e0d77-7305-44c8-a049-3eb1b42fedbd tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1397 microversion: 2.1 time: 0.204566 Aug 25 13:48:14.129880 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2903/5753] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:13 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:14.255047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e7ca5cd0-fbf9-4600-a608-da874a769243 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:14.272256 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e7ca5cd0-fbf9-4600-a608-da874a769243 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1695 microversion: 2.1 time: 0.328759 Aug 25 13:48:14.298148 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2851/5754] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:13 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1695 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:15.177763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9912186-0c7e-4e6d-af6d-156f484a5876 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:15.180206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b9912186-0c7e-4e6d-af6d-156f484a5876 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:15.195977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9912186-0c7e-4e6d-af6d-156f484a5876 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:15.197365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9912186-0c7e-4e6d-af6d-156f484a5876 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:15.198512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9912186-0c7e-4e6d-af6d-156f484a5876 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:15.200183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9912186-0c7e-4e6d-af6d-156f484a5876 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:15.201259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9912186-0c7e-4e6d-af6d-156f484a5876 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:15.202426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9912186-0c7e-4e6d-af6d-156f484a5876 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:15.318549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dc50639b-dcf6-4356-afea-c3f8c16096cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:15.320315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dc50639b-dcf6-4356-afea-c3f8c16096cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:15.340596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc50639b-dcf6-4356-afea-c3f8c16096cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:15.342033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc50639b-dcf6-4356-afea-c3f8c16096cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:15.343143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc50639b-dcf6-4356-afea-c3f8c16096cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:15.346474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc50639b-dcf6-4356-afea-c3f8c16096cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:15.347763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc50639b-dcf6-4356-afea-c3f8c16096cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:15.348898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc50639b-dcf6-4356-afea-c3f8c16096cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:15.352147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b9912186-0c7e-4e6d-af6d-156f484a5876 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:15.369168 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9912186-0c7e-4e6d-af6d-156f484a5876 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1397 microversion: 2.1 time: 0.198367 Aug 25 13:48:15.370662 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2904/5755] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:15 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1397 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:15.909334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dc50639b-dcf6-4356-afea-c3f8c16096cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:16.008197 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dc50639b-dcf6-4356-afea-c3f8c16096cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1695 microversion: 2.1 time: 0.681396 Aug 25 13:48:16.013452 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2852/5756] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:15 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1695 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:16.443096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-32e6d04f-774a-4d8a-a172-8abbd391e223 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:16.447579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-32e6d04f-774a-4d8a-a172-8abbd391e223 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:16.473292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32e6d04f-774a-4d8a-a172-8abbd391e223 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:16.474226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32e6d04f-774a-4d8a-a172-8abbd391e223 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:16.475439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32e6d04f-774a-4d8a-a172-8abbd391e223 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:16.476873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32e6d04f-774a-4d8a-a172-8abbd391e223 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:16.478149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32e6d04f-774a-4d8a-a172-8abbd391e223 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:16.479100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-32e6d04f-774a-4d8a-a172-8abbd391e223 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:16.616895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-32e6d04f-774a-4d8a-a172-8abbd391e223 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:16.635940 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-32e6d04f-774a-4d8a-a172-8abbd391e223 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1397 microversion: 2.1 time: 0.207342 Aug 25 13:48:16.637109 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2905/5757] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:16 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1397 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:17.079749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f7974a5b-8780-42fd-8324-ae577b7f2b4c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:17.084106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f7974a5b-8780-42fd-8324-ae577b7f2b4c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:17.124826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7974a5b-8780-42fd-8324-ae577b7f2b4c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:17.126497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7974a5b-8780-42fd-8324-ae577b7f2b4c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:17.127726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7974a5b-8780-42fd-8324-ae577b7f2b4c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:17.128162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7974a5b-8780-42fd-8324-ae577b7f2b4c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:17.130663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7974a5b-8780-42fd-8324-ae577b7f2b4c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:17.144041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f7974a5b-8780-42fd-8324-ae577b7f2b4c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:17.614998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f7974a5b-8780-42fd-8324-ae577b7f2b4c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:17.647128 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f7974a5b-8780-42fd-8324-ae577b7f2b4c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1695 microversion: 2.1 time: 0.576603 Aug 25 13:48:17.648678 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2853/5758] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:17 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1695 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:17.699094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fd2f567c-7125-4bad-bf07-1faa6a54cc6f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:17.701566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fd2f567c-7125-4bad-bf07-1faa6a54cc6f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:17.747238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2f567c-7125-4bad-bf07-1faa6a54cc6f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:17.750926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2f567c-7125-4bad-bf07-1faa6a54cc6f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:17.757419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2f567c-7125-4bad-bf07-1faa6a54cc6f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:17.759336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2f567c-7125-4bad-bf07-1faa6a54cc6f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:17.765205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2f567c-7125-4bad-bf07-1faa6a54cc6f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:17.770068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd2f567c-7125-4bad-bf07-1faa6a54cc6f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:18.016217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fd2f567c-7125-4bad-bf07-1faa6a54cc6f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:18.036469 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fd2f567c-7125-4bad-bf07-1faa6a54cc6f tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1397 microversion: 2.1 time: 0.345016 Aug 25 13:48:18.046803 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2906/5759] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:17 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1397 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:18.706249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-407a71e9-011c-4a33-b8c3-164a8ef9332a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:18.707500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-407a71e9-011c-4a33-b8c3-164a8ef9332a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:18.728002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-407a71e9-011c-4a33-b8c3-164a8ef9332a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:18.728823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-407a71e9-011c-4a33-b8c3-164a8ef9332a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:18.729552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-407a71e9-011c-4a33-b8c3-164a8ef9332a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:18.731353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-407a71e9-011c-4a33-b8c3-164a8ef9332a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:18.732308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-407a71e9-011c-4a33-b8c3-164a8ef9332a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:18.733250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-407a71e9-011c-4a33-b8c3-164a8ef9332a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:19.112281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7e077148-244f-4b68-bf15-3d61961fb70d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:19.117446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7e077148-244f-4b68-bf15-3d61961fb70d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:19.134085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e077148-244f-4b68-bf15-3d61961fb70d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:19.135344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e077148-244f-4b68-bf15-3d61961fb70d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:19.136553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e077148-244f-4b68-bf15-3d61961fb70d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:19.138663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e077148-244f-4b68-bf15-3d61961fb70d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:19.139857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e077148-244f-4b68-bf15-3d61961fb70d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:19.141543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e077148-244f-4b68-bf15-3d61961fb70d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:19.254191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-407a71e9-011c-4a33-b8c3-164a8ef9332a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:19.291633 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-407a71e9-011c-4a33-b8c3-164a8ef9332a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1695 microversion: 2.1 time: 0.592905 Aug 25 13:48:19.313627 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2854/5760] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:18 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1695 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:19.335906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7e077148-244f-4b68-bf15-3d61961fb70d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:19.352872 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7e077148-244f-4b68-bf15-3d61961fb70d tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1397 microversion: 2.1 time: 0.253886 Aug 25 13:48:19.357415 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2907/5761] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:19 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1397 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:20.350344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e57d336f-d31f-4551-8176-8d69433e5cec tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:20.352862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e57d336f-d31f-4551-8176-8d69433e5cec tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:20.368435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57d336f-d31f-4551-8176-8d69433e5cec tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:20.369830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57d336f-d31f-4551-8176-8d69433e5cec tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:20.370900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57d336f-d31f-4551-8176-8d69433e5cec tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:20.372995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57d336f-d31f-4551-8176-8d69433e5cec tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:20.374162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57d336f-d31f-4551-8176-8d69433e5cec tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:20.374903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e57d336f-d31f-4551-8176-8d69433e5cec tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:20.399776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:20.401168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:20.422397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:20.424010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:20.425022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:20.426457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:20.426726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:20.427468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:20.512194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:20.513429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:20.514454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:20.515520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lazy-loading 'fault' on Instance uuid dbe1cade-295f-4cfd-a894-7073c8089af8 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:48:20.625679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e58cdd9006f469c8da1ea1bdeb8c4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0a1d9728c24170bb3ec1585599a38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:20.645614 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c007ee0a-4378-4abc-827c-2eee5e2f6fd9 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 200 len: 1402 microversion: 2.1 time: 0.252561 Aug 25 13:48:20.645614 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2908/5762] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:20 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 1402 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:20.780289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e57d336f-d31f-4551-8176-8d69433e5cec tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:20.795320 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e57d336f-d31f-4551-8176-8d69433e5cec tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1695 microversion: 2.1 time: 0.452338 Aug 25 13:48:20.796618 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2855/5763] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:20 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1695 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:21.679762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:21.680913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] [instance: dbe1cade-295f-4cfd-a894-7073c8089af8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:21.704576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:21.713776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:21.714694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:21.718927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:21.722937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:21.724562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] HTTP exception thrown: Instance dbe1cade-295f-4cfd-a894-7073c8089af8 could not be found. Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Request method failure captured: Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 HTTP/1.1 Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3xztvMxqmsmxi7JO_VLbLdwMObRJzldI4_-n4Oi8PDtAatugzgzehqOtJaxCjT0QwOGTshKqu33Ph5h92y7IbMiuuLdfJfGjMp0tOEwvaYFtryrY6RqyOTnJ6BsYDFyYeF_rQW8bFtEN0V8TH6VSqpw6LCmBgrDUDAedBHPib5bPJ8 Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 8a0a1d9728c24170bb3ec1585599a38c Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestVolumeBackupRestore-895252004 Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8a0a1d9728c24170bb3ec1585599a38c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8a0a1d9728c24170bb3ec1585599a38c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8a0a1d9728c24170bb3ec1585599a38c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8a0a1d9728c24170bb3ec1585599a38c"}]}] Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestVolumeBackupRestore-895252004 Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 8a0a1d9728c24170bb3ec1585599a38c Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestVolumeBackupRestore-895252004 Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestVolumeBackupRestore-895252004-project Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 8e58cdd9006f469c8da1ea1bdeb8c4d9 Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestVolumeBackupRestore-895252004-project Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance dbe1cade-295f-4cfd-a894-7073c8089af8 could not be found. Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'dbe1cade-295f-4cfd-a894-7073c8089af8'} Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe1cade-295f-4cfd-a894-7073c8089af8 could not be found. Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:48:21.775997 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe1cade-295f-4cfd-a894-7073c8089af8 could not be found. Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe1cade-295f-4cfd-a894-7073c8089af8 could not be found. Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Returning 404 to user: Instance dbe1cade-295f-4cfd-a894-7073c8089af8 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a3db20e2-a906-4cd8-80b3-8ec3e4a13b17 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8" status: 404 len: 111 microversion: 2.1 time: 0.096059 Aug 25 13:48:21.782614 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2909/5764] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:21 2022] GET /compute/v2.1/servers/dbe1cade-295f-4cfd-a894-7073c8089af8 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:48:21.834931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6446c9fd-8cef-4620-bb5f-1f6381b6106f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:21.835758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6446c9fd-8cef-4620-bb5f-1f6381b6106f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:21.848060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446c9fd-8cef-4620-bb5f-1f6381b6106f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:21.848684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446c9fd-8cef-4620-bb5f-1f6381b6106f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:21.849146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446c9fd-8cef-4620-bb5f-1f6381b6106f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:21.849958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446c9fd-8cef-4620-bb5f-1f6381b6106f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:21.850461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446c9fd-8cef-4620-bb5f-1f6381b6106f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:21.850969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6446c9fd-8cef-4620-bb5f-1f6381b6106f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:22.380349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6446c9fd-8cef-4620-bb5f-1f6381b6106f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:22.408718 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6446c9fd-8cef-4620-bb5f-1f6381b6106f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1694 microversion: 2.1 time: 0.575264 Aug 25 13:48:22.429787 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2856/5765] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:21 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1694 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:22.569910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f2db89a7-0482-4912-a3d6-be4b37ded8ca req-53d2a18f-e393-4b07-abbb-6461eebcd9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "name": "network-vif-unplugged", "status": "completed", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:22.613818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f2db89a7-0482-4912-a3d6-be4b37ded8ca req-53d2a18f-e393-4b07-abbb-6461eebcd9e6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:22.614665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f2db89a7-0482-4912-a3d6-be4b37ded8ca req-53d2a18f-e393-4b07-abbb-6461eebcd9e6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:22.615284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f2db89a7-0482-4912-a3d6-be4b37ded8ca req-53d2a18f-e393-4b07-abbb-6461eebcd9e6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:22.643874 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f2db89a7-0482-4912-a3d6-be4b37ded8ca req-53d2a18f-e393-4b07-abbb-6461eebcd9e6 service nova] Creating event network-vif-unplugged:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h2-852771-8 Aug 25 13:48:22.663873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-f2db89a7-0482-4912-a3d6-be4b37ded8ca req-53d2a18f-e393-4b07-abbb-6461eebcd9e6 service nova] Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:48:22.697828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef05f81a-3b61-4473-901f-cd1d7037dd63 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] Calling method '.version_select at 0x7f3a2a127430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:22.711347 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f2db89a7-0482-4912-a3d6-be4b37ded8ca req-53d2a18f-e393-4b07-abbb-6461eebcd9e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150298 Aug 25 13:48:22.717120 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2910/5766] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:22.745050 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef05f81a-3b61-4473-901f-cd1d7037dd63 tempest-TestVolumeBackupRestore-895252004 tempest-TestVolumeBackupRestore-895252004-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1033780759" status: 202 len: 0 microversion: 2.1 time: 0.055714 Aug 25 13:48:22.749426 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2857/5767] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 13:48:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1033780759 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:48:23.467817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f65554b-9100-4b02-9ae1-c8640a4d4d92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:23.470390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3f65554b-9100-4b02-9ae1-c8640a4d4d92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:23.504624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f65554b-9100-4b02-9ae1-c8640a4d4d92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:23.507116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f65554b-9100-4b02-9ae1-c8640a4d4d92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:23.509347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f65554b-9100-4b02-9ae1-c8640a4d4d92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:23.511159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f65554b-9100-4b02-9ae1-c8640a4d4d92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:23.512327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f65554b-9100-4b02-9ae1-c8640a4d4d92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:23.513222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f65554b-9100-4b02-9ae1-c8640a4d4d92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:23.523027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:24.108974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f65554b-9100-4b02-9ae1-c8640a4d4d92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:24.132384 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f65554b-9100-4b02-9ae1-c8640a4d4d92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1694 microversion: 2.1 time: 0.679002 Aug 25 13:48:24.138360 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2911/5768] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:23 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1694 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:24.755103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-7841c6b2-96b5-4882-88d1-7ae37de4ce1a req-92d9e03a-652d-41d7-8a3b-2a9dbb3f7c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:24.781698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7841c6b2-96b5-4882-88d1-7ae37de4ce1a req-92d9e03a-652d-41d7-8a3b-2a9dbb3f7c05 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:24.783109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7841c6b2-96b5-4882-88d1-7ae37de4ce1a req-92d9e03a-652d-41d7-8a3b-2a9dbb3f7c05 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:24.783446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-7841c6b2-96b5-4882-88d1-7ae37de4ce1a req-92d9e03a-652d-41d7-8a3b-2a9dbb3f7c05 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:24.814937 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-7841c6b2-96b5-4882-88d1-7ae37de4ce1a req-92d9e03a-652d-41d7-8a3b-2a9dbb3f7c05 service nova] Creating event network-changed:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h2-852771-8 Aug 25 13:48:24.830282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-7841c6b2-96b5-4882-88d1-7ae37de4ce1a req-92d9e03a-652d-41d7-8a3b-2a9dbb3f7c05 service nova] Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:48:24.860787 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-7841c6b2-96b5-4882-88d1-7ae37de4ce1a req-92d9e03a-652d-41d7-8a3b-2a9dbb3f7c05 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119944 Aug 25 13:48:24.862200 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2858/5769] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:48:25.191269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-daaa1de1-0c61-4fa6-aba0-57e4c57bc7da tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:25.192285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-daaa1de1-0c61-4fa6-aba0-57e4c57bc7da tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:25.232168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa1de1-0c61-4fa6-aba0-57e4c57bc7da tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:25.242554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa1de1-0c61-4fa6-aba0-57e4c57bc7da tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:25.243405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa1de1-0c61-4fa6-aba0-57e4c57bc7da tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:25.244828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa1de1-0c61-4fa6-aba0-57e4c57bc7da tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:25.245742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa1de1-0c61-4fa6-aba0-57e4c57bc7da tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:25.246447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-daaa1de1-0c61-4fa6-aba0-57e4c57bc7da tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:26.856161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-daaa1de1-0c61-4fa6-aba0-57e4c57bc7da tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:26.936408 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-daaa1de1-0c61-4fa6-aba0-57e4c57bc7da tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1694 microversion: 2.1 time: 1.751948 Aug 25 13:48:26.952428 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2912/5770] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:25 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1694 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:27.991787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b6de43b-aa50-4d38-86d8-80345682e20e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:27.992625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b6de43b-aa50-4d38-86d8-80345682e20e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:28.022477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b6de43b-aa50-4d38-86d8-80345682e20e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:28.023097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b6de43b-aa50-4d38-86d8-80345682e20e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:28.023785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b6de43b-aa50-4d38-86d8-80345682e20e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:28.024854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b6de43b-aa50-4d38-86d8-80345682e20e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:28.025389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b6de43b-aa50-4d38-86d8-80345682e20e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:28.038518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b6de43b-aa50-4d38-86d8-80345682e20e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:28.782557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b6de43b-aa50-4d38-86d8-80345682e20e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:28.809867 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b6de43b-aa50-4d38-86d8-80345682e20e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1692 microversion: 2.1 time: 0.827822 Aug 25 13:48:28.829557 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2859/5771] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:27 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1692 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:29.851635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be1de7ed-e2a1-4d6c-b2d6-527c877f4c08 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:29.852852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be1de7ed-e2a1-4d6c-b2d6-527c877f4c08 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:29.873352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be1de7ed-e2a1-4d6c-b2d6-527c877f4c08 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:29.874196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be1de7ed-e2a1-4d6c-b2d6-527c877f4c08 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:29.877431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be1de7ed-e2a1-4d6c-b2d6-527c877f4c08 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:29.879374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be1de7ed-e2a1-4d6c-b2d6-527c877f4c08 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:29.880068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be1de7ed-e2a1-4d6c-b2d6-527c877f4c08 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:29.880815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be1de7ed-e2a1-4d6c-b2d6-527c877f4c08 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:30.775331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-be1de7ed-e2a1-4d6c-b2d6-527c877f4c08 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:30.796437 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-be1de7ed-e2a1-4d6c-b2d6-527c877f4c08 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1692 microversion: 2.1 time: 0.951027 Aug 25 13:48:30.808490 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2913/5772] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:29 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1692 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:31.835787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c636d8e4-2c66-4d79-a040-d18aab06c830 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:31.839413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c636d8e4-2c66-4d79-a040-d18aab06c830 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:31.860394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c636d8e4-2c66-4d79-a040-d18aab06c830 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:31.861769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c636d8e4-2c66-4d79-a040-d18aab06c830 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:31.863160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c636d8e4-2c66-4d79-a040-d18aab06c830 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:31.864875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c636d8e4-2c66-4d79-a040-d18aab06c830 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:31.866437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c636d8e4-2c66-4d79-a040-d18aab06c830 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:31.881350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c636d8e4-2c66-4d79-a040-d18aab06c830 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:31.896419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:32.234151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c636d8e4-2c66-4d79-a040-d18aab06c830 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:32.246513 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c636d8e4-2c66-4d79-a040-d18aab06c830 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1689 microversion: 2.1 time: 0.421739 Aug 25 13:48:32.248559 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2860/5773] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:31 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1689 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:32.289903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85a933ab-e4e1-4a51-93bd-3433eb1e3768 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:32.291124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85a933ab-e4e1-4a51-93bd-3433eb1e3768 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:32.296399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:32.308789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85a933ab-e4e1-4a51-93bd-3433eb1e3768 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:32.311330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85a933ab-e4e1-4a51-93bd-3433eb1e3768 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:32.312057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85a933ab-e4e1-4a51-93bd-3433eb1e3768 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:32.317040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85a933ab-e4e1-4a51-93bd-3433eb1e3768 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:32.317731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85a933ab-e4e1-4a51-93bd-3433eb1e3768 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:32.318521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85a933ab-e4e1-4a51-93bd-3433eb1e3768 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:32.645177 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85a933ab-e4e1-4a51-93bd-3433eb1e3768 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4/action" status: 202 len: 0 microversion: 2.1 time: 0.359499 Aug 25 13:48:32.647085 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2914/5774] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:48:32 2022] POST /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:48:32.665444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5185c1a6-a937-4507-acce-11faf3545c57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:32.666540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5185c1a6-a937-4507-acce-11faf3545c57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:32.673862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:32.690428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5185c1a6-a937-4507-acce-11faf3545c57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:32.691935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5185c1a6-a937-4507-acce-11faf3545c57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:32.693284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5185c1a6-a937-4507-acce-11faf3545c57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:32.694844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5185c1a6-a937-4507-acce-11faf3545c57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:32.696355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5185c1a6-a937-4507-acce-11faf3545c57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:32.697349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5185c1a6-a937-4507-acce-11faf3545c57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:33.375415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5185c1a6-a937-4507-acce-11faf3545c57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:33.387763 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5185c1a6-a937-4507-acce-11faf3545c57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1688 microversion: 2.1 time: 0.736101 Aug 25 13:48:33.402249 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2861/5775] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:32 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1688 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:33.967256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b66db1fd-b178-491e-b337-fb226f769445 req-4dad7313-2a06-4974-9673-a601d793b482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "name": "network-vif-plugged", "status": "completed", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:33.995902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b66db1fd-b178-491e-b337-fb226f769445 req-4dad7313-2a06-4974-9673-a601d793b482 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:33.997124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b66db1fd-b178-491e-b337-fb226f769445 req-4dad7313-2a06-4974-9673-a601d793b482 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:33.998157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b66db1fd-b178-491e-b337-fb226f769445 req-4dad7313-2a06-4974-9673-a601d793b482 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:34.022793 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b66db1fd-b178-491e-b337-fb226f769445 req-4dad7313-2a06-4974-9673-a601d793b482 service nova] Creating event network-vif-plugged:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h2-852771-8 Aug 25 13:48:34.039980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-b66db1fd-b178-491e-b337-fb226f769445 req-4dad7313-2a06-4974-9673-a601d793b482 service nova] Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:48:34.070640 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b66db1fd-b178-491e-b337-fb226f769445 req-4dad7313-2a06-4974-9673-a601d793b482 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.697979 Aug 25 13:48:34.079731 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2915/5776] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:34.417154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8c546ea9-c55b-418a-ae80-49b4559f456b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:34.418292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8c546ea9-c55b-418a-ae80-49b4559f456b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:34.460117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c546ea9-c55b-418a-ae80-49b4559f456b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:34.460791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c546ea9-c55b-418a-ae80-49b4559f456b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:34.461696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c546ea9-c55b-418a-ae80-49b4559f456b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:34.462802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c546ea9-c55b-418a-ae80-49b4559f456b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:34.463618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c546ea9-c55b-418a-ae80-49b4559f456b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:34.464660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c546ea9-c55b-418a-ae80-49b4559f456b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:34.979784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8c546ea9-c55b-418a-ae80-49b4559f456b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:34.996085 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8c546ea9-c55b-418a-ae80-49b4559f456b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1688 microversion: 2.1 time: 0.583760 Aug 25 13:48:35.034987 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2862/5777] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:34 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1688 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:36.096886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-45ac78f4-b35f-4579-a614-d134a9d3125f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:36.098276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-45ac78f4-b35f-4579-a614-d134a9d3125f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:36.124609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45ac78f4-b35f-4579-a614-d134a9d3125f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:36.125569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45ac78f4-b35f-4579-a614-d134a9d3125f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:36.126395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45ac78f4-b35f-4579-a614-d134a9d3125f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:36.127840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45ac78f4-b35f-4579-a614-d134a9d3125f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:36.128663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45ac78f4-b35f-4579-a614-d134a9d3125f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:36.129458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45ac78f4-b35f-4579-a614-d134a9d3125f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:37.129367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-45ac78f4-b35f-4579-a614-d134a9d3125f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:37.176438 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-45ac78f4-b35f-4579-a614-d134a9d3125f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1688 microversion: 2.1 time: 1.103523 Aug 25 13:48:37.181095 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2916/5778] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:36 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1688 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:38.238670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-435292dc-df9e-4e01-b794-52aaec0965e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:38.246264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-435292dc-df9e-4e01-b794-52aaec0965e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:38.279952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-435292dc-df9e-4e01-b794-52aaec0965e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:38.282203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-435292dc-df9e-4e01-b794-52aaec0965e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:38.287495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-435292dc-df9e-4e01-b794-52aaec0965e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:38.289744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-435292dc-df9e-4e01-b794-52aaec0965e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:38.291166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-435292dc-df9e-4e01-b794-52aaec0965e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:38.292484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-435292dc-df9e-4e01-b794-52aaec0965e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:38.779224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-435292dc-df9e-4e01-b794-52aaec0965e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:38.796169 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-435292dc-df9e-4e01-b794-52aaec0965e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1688 microversion: 2.1 time: 0.590771 Aug 25 13:48:38.799174 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2863/5779] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:38 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1688 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:39.840929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c6898a0-f230-4366-9628-d6252573c329 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:39.842143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c6898a0-f230-4366-9628-d6252573c329 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:39.884546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6898a0-f230-4366-9628-d6252573c329 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:39.892948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6898a0-f230-4366-9628-d6252573c329 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:39.901080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6898a0-f230-4366-9628-d6252573c329 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:39.907157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6898a0-f230-4366-9628-d6252573c329 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:39.908389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6898a0-f230-4366-9628-d6252573c329 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:39.909221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c6898a0-f230-4366-9628-d6252573c329 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:40.201752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f921075e-e5be-457a-8972-a45b0f5842f3 req-1fbf5d0e-f9c8-408f-85c5-af088757a4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "name": "network-vif-unplugged", "status": "completed", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:40.258728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f921075e-e5be-457a-8972-a45b0f5842f3 req-1fbf5d0e-f9c8-408f-85c5-af088757a4de service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:40.259820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f921075e-e5be-457a-8972-a45b0f5842f3 req-1fbf5d0e-f9c8-408f-85c5-af088757a4de service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:40.260650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f921075e-e5be-457a-8972-a45b0f5842f3 req-1fbf5d0e-f9c8-408f-85c5-af088757a4de service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:40.309347 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f921075e-e5be-457a-8972-a45b0f5842f3 req-1fbf5d0e-f9c8-408f-85c5-af088757a4de service nova] Creating event network-vif-unplugged:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h1-852771-8 Aug 25 13:48:40.346634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-f921075e-e5be-457a-8972-a45b0f5842f3 req-1fbf5d0e-f9c8-408f-85c5-af088757a4de service nova] Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:48:40.374646 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f921075e-e5be-457a-8972-a45b0f5842f3 req-1fbf5d0e-f9c8-408f-85c5-af088757a4de service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.183420 Aug 25 13:48:40.379776 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2864/5780] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:48:40.757690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7c6898a0-f230-4366-9628-d6252573c329 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:40.780269 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c6898a0-f230-4366-9628-d6252573c329 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1688 microversion: 2.1 time: 0.946147 Aug 25 13:48:40.791370 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2917/5781] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:39 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1688 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:41.845942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1e462d3-8c16-4308-aa00-96d813902b92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:41.847265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c1e462d3-8c16-4308-aa00-96d813902b92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:41.893699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e462d3-8c16-4308-aa00-96d813902b92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:41.894767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e462d3-8c16-4308-aa00-96d813902b92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:41.897903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e462d3-8c16-4308-aa00-96d813902b92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:41.906832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e462d3-8c16-4308-aa00-96d813902b92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:41.907920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e462d3-8c16-4308-aa00-96d813902b92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:41.910046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e462d3-8c16-4308-aa00-96d813902b92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:42.480247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f0abf31b-98b4-49b5-ac62-cdb3cd0f4750 req-7677bb14-64d0-48a5-849d-95e772bdb702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:42.523436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f0abf31b-98b4-49b5-ac62-cdb3cd0f4750 req-7677bb14-64d0-48a5-849d-95e772bdb702 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:42.523436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f0abf31b-98b4-49b5-ac62-cdb3cd0f4750 req-7677bb14-64d0-48a5-849d-95e772bdb702 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:42.523948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f0abf31b-98b4-49b5-ac62-cdb3cd0f4750 req-7677bb14-64d0-48a5-849d-95e772bdb702 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:42.589743 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f0abf31b-98b4-49b5-ac62-cdb3cd0f4750 req-7677bb14-64d0-48a5-849d-95e772bdb702 service nova] Creating event network-changed:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h1-852771-8 Aug 25 13:48:42.604835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-f0abf31b-98b4-49b5-ac62-cdb3cd0f4750 req-7677bb14-64d0-48a5-849d-95e772bdb702 service nova] Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:48:42.637711 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f0abf31b-98b4-49b5-ac62-cdb3cd0f4750 req-7677bb14-64d0-48a5-849d-95e772bdb702 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166823 Aug 25 13:48:42.643025 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2918/5782] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:42.802773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c1e462d3-8c16-4308-aa00-96d813902b92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:42.824134 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c1e462d3-8c16-4308-aa00-96d813902b92 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1688 microversion: 2.1 time: 0.994486 Aug 25 13:48:42.848332 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2865/5783] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:41 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1688 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:43.870345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c76bc58f-4cd9-41ed-99fd-8c13bcf217f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:43.872315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c76bc58f-4cd9-41ed-99fd-8c13bcf217f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:43.892187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c76bc58f-4cd9-41ed-99fd-8c13bcf217f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:43.893076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c76bc58f-4cd9-41ed-99fd-8c13bcf217f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:43.896389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c76bc58f-4cd9-41ed-99fd-8c13bcf217f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:43.900683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c76bc58f-4cd9-41ed-99fd-8c13bcf217f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:43.904694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c76bc58f-4cd9-41ed-99fd-8c13bcf217f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:43.924503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c76bc58f-4cd9-41ed-99fd-8c13bcf217f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:46.286072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c76bc58f-4cd9-41ed-99fd-8c13bcf217f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:46.319703 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c76bc58f-4cd9-41ed-99fd-8c13bcf217f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1688 microversion: 2.1 time: 2.469696 Aug 25 13:48:46.331218 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2919/5784] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:43 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1688 bytes in 2483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:47.349670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-18d52182-ebc0-4d90-add6-59fbd174ebab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:47.351261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-18d52182-ebc0-4d90-add6-59fbd174ebab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:47.378040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18d52182-ebc0-4d90-add6-59fbd174ebab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:47.378889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18d52182-ebc0-4d90-add6-59fbd174ebab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:47.379587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18d52182-ebc0-4d90-add6-59fbd174ebab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:47.380725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18d52182-ebc0-4d90-add6-59fbd174ebab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:47.381343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18d52182-ebc0-4d90-add6-59fbd174ebab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:47.382010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18d52182-ebc0-4d90-add6-59fbd174ebab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:47.704527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-18d52182-ebc0-4d90-add6-59fbd174ebab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:47.728471 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-18d52182-ebc0-4d90-add6-59fbd174ebab tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1688 microversion: 2.1 time: 0.383170 Aug 25 13:48:47.730838 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2866/5785] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:47 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1688 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:48.323585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-736710399", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:48.446164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] validate_networks() for None {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:48:48.758318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-baba5f96-49ee-4538-95b0-afcaf5982d25 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:48.760751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-baba5f96-49ee-4538-95b0-afcaf5982d25 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:48.774594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baba5f96-49ee-4538-95b0-afcaf5982d25 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:48.776051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baba5f96-49ee-4538-95b0-afcaf5982d25 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:48.777452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baba5f96-49ee-4538-95b0-afcaf5982d25 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:48.779327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baba5f96-49ee-4538-95b0-afcaf5982d25 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:48.780717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baba5f96-49ee-4538-95b0-afcaf5982d25 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:48.782028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-baba5f96-49ee-4538-95b0-afcaf5982d25 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:49.371544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-baba5f96-49ee-4538-95b0-afcaf5982d25 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:49.398711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:48:49.399465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:48:49.400056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:48:49.400817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:48:49.405557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:48:49.416544 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-baba5f96-49ee-4538-95b0-afcaf5982d25 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1681 microversion: 2.1 time: 0.666763 Aug 25 13:48:49.417709 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2867/5786] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:48 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1681 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:49.447611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:49.448228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:49.448786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:49.455325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:49.456046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:49.456797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:49.481223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Getting quotas for project b24e7caa6f5145a9952deef32a6c48ad. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:48:49.489130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Getting quotas for user 3b1054e88dbd439186eccd7e026aa3d2 and project b24e7caa6f5145a9952deef32a6c48ad. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:48:49.506417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:48:49.509145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:48:49.612587 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff99bbe4-b52c-44c9-ad50-38f472c83c95 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.294056 Aug 25 13:48:49.613437 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2920/5787] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:48:49.627379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9a1565ad-e2c9-49ae-8400-64313009b82b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:49.632448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9a1565ad-e2c9-49ae-8400-64313009b82b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:49.800436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9a1565ad-e2c9-49ae-8400-64313009b82b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:49.808975 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9a1565ad-e2c9-49ae-8400-64313009b82b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1213 microversion: 2.1 time: 0.187134 Aug 25 13:48:49.811100 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2868/5788] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:49 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1213 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:50.631212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b698c613-986e-41a5-9f84-885611fd99b1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Action: 'create', calling method: .version_select at 0x7f3a29a1e940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-798124864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqDqYLV2J3xGR8gKlyrhNxNfUI5T2wXUbJd7FIS8yVL/AO513dlwitS6pQVJHVOyift2E+wBkgvD/6karuxLHaNtwndhTIcZcL7SpxwwWZeRzWGhEyf3UFMgKhoPvvhkQ=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:50.683595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b698c613-986e-41a5-9f84-885611fd99b1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:48:50.697485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b698c613-986e-41a5-9f84-885611fd99b1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for user a882ff06dbb14328b6360ce89f4d75e5 and project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:48:50.752472 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b698c613-986e-41a5-9f84-885611fd99b1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.127036 Aug 25 13:48:50.753976 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2921/5789] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:48:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:50.839559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-64079a3b-390b-4bbe-b1a1-51cc00cf3608 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:50.840377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-64079a3b-390b-4bbe-b1a1-51cc00cf3608 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:50.874240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64079a3b-390b-4bbe-b1a1-51cc00cf3608 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:50.877947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64079a3b-390b-4bbe-b1a1-51cc00cf3608 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:50.878533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64079a3b-390b-4bbe-b1a1-51cc00cf3608 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:50.880758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64079a3b-390b-4bbe-b1a1-51cc00cf3608 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:50.881296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64079a3b-390b-4bbe-b1a1-51cc00cf3608 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:50.882029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64079a3b-390b-4bbe-b1a1-51cc00cf3608 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:51.043806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-64079a3b-390b-4bbe-b1a1-51cc00cf3608 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:51.060442 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-64079a3b-390b-4bbe-b1a1-51cc00cf3608 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1209 microversion: 2.1 time: 0.227153 Aug 25 13:48:51.063214 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2869/5790] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:50 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1209 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:52.085942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da43bc93-87d9-4133-a00b-6987c7ed21f0 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:52.086563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da43bc93-87d9-4133-a00b-6987c7ed21f0 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:52.102536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da43bc93-87d9-4133-a00b-6987c7ed21f0 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:52.103288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da43bc93-87d9-4133-a00b-6987c7ed21f0 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:52.103892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da43bc93-87d9-4133-a00b-6987c7ed21f0 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:52.105880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da43bc93-87d9-4133-a00b-6987c7ed21f0 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:52.110719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da43bc93-87d9-4133-a00b-6987c7ed21f0 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:52.111358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da43bc93-87d9-4133-a00b-6987c7ed21f0 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:52.340273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da43bc93-87d9-4133-a00b-6987c7ed21f0 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:52.358241 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da43bc93-87d9-4133-a00b-6987c7ed21f0 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1271 microversion: 2.1 time: 0.276788 Aug 25 13:48:52.360404 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2922/5791] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:52 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:52.396374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-02473682-c241-42e9-a4e9-ea801aa9ee21 req-beb086e6-0803-4827-89ab-fc08a3d59de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "name": "network-vif-plugged", "status": "completed", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:52.458498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-02473682-c241-42e9-a4e9-ea801aa9ee21 req-beb086e6-0803-4827-89ab-fc08a3d59de9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:52.459875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-02473682-c241-42e9-a4e9-ea801aa9ee21 req-beb086e6-0803-4827-89ab-fc08a3d59de9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:52.460887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-02473682-c241-42e9-a4e9-ea801aa9ee21 req-beb086e6-0803-4827-89ab-fc08a3d59de9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:52.518730 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-02473682-c241-42e9-a4e9-ea801aa9ee21 req-beb086e6-0803-4827-89ab-fc08a3d59de9 service nova] Creating event network-vif-plugged:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h1-852771-8 Aug 25 13:48:52.541229 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-02473682-c241-42e9-a4e9-ea801aa9ee21 req-beb086e6-0803-4827-89ab-fc08a3d59de9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154036 Aug 25 13:48:52.543470 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2870/5792] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:53.165020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1511044720", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "631f1c7d-59ed-406b-a2f7-d21f439c79fc"}], "key_name": "tempest-TestNetworkBasicOps-798124864", "security_groups": [{"name": "tempest-secgroup-smoke-145201791"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:53.386177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d20d3e38-654f-481b-862c-eaf7d06e918d tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:53.386895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d20d3e38-654f-481b-862c-eaf7d06e918d tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:53.399398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d3e38-654f-481b-862c-eaf7d06e918d tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:53.400303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d3e38-654f-481b-862c-eaf7d06e918d tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:53.400457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d3e38-654f-481b-862c-eaf7d06e918d tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:53.401218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d3e38-654f-481b-862c-eaf7d06e918d tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:53.401978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d3e38-654f-481b-862c-eaf7d06e918d tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:53.402714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d20d3e38-654f-481b-862c-eaf7d06e918d tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:53.468133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] validate_networks() for [('631f1c7d-59ed-406b-a2f7-d21f439c79fc', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:48:53.549569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d20d3e38-654f-481b-862c-eaf7d06e918d tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:53.559440 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d20d3e38-654f-481b-862c-eaf7d06e918d tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1271 microversion: 2.1 time: 0.177183 Aug 25 13:48:53.573560 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2871/5793] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:53 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:54.586207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-62f9e461-0098-421d-ae89-a28551bc7aa1 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:54.586901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-62f9e461-0098-421d-ae89-a28551bc7aa1 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:54.598346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62f9e461-0098-421d-ae89-a28551bc7aa1 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:54.610790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62f9e461-0098-421d-ae89-a28551bc7aa1 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:54.611614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62f9e461-0098-421d-ae89-a28551bc7aa1 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:54.612974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62f9e461-0098-421d-ae89-a28551bc7aa1 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:54.613870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62f9e461-0098-421d-ae89-a28551bc7aa1 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:54.614655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62f9e461-0098-421d-ae89-a28551bc7aa1 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:54.944293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:48:54.944956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:48:54.945650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:48:54.964826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:48:54.969316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:48:54.996166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:54.997711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:54.998939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:55.001255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:55.002419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:55.003425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:55.021164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:55.057655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:48:55.069068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for user a882ff06dbb14328b6360ce89f4d75e5 and project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:48:55.080561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-62f9e461-0098-421d-ae89-a28551bc7aa1 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:55.102436 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-62f9e461-0098-421d-ae89-a28551bc7aa1 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1313 microversion: 2.1 time: 0.521132 Aug 25 13:48:55.104545 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2872/5794] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:54 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:55.118920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:48:55.123596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:48:55.230254 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-916fa602-bdf0-4786-911e-502ff61bd736 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.070329 Aug 25 13:48:55.232592 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2923/5795] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:48:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 2074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:48:55.257789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4b97f731-edc8-4400-a0aa-ce34a6ae99b4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:55.263640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4b97f731-edc8-4400-a0aa-ce34a6ae99b4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:55.442099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4b97f731-edc8-4400-a0aa-ce34a6ae99b4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:55.458827 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4b97f731-edc8-4400-a0aa-ce34a6ae99b4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1248 microversion: 2.1 time: 0.215453 Aug 25 13:48:55.475599 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2873/5796] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:55 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1248 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:56.143456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb3aff34-cb72-4cb6-a443-e8762fb6cf22 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:56.144721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb3aff34-cb72-4cb6-a443-e8762fb6cf22 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:56.163384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3aff34-cb72-4cb6-a443-e8762fb6cf22 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:56.164264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3aff34-cb72-4cb6-a443-e8762fb6cf22 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:56.165109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3aff34-cb72-4cb6-a443-e8762fb6cf22 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:56.166758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3aff34-cb72-4cb6-a443-e8762fb6cf22 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:56.168446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3aff34-cb72-4cb6-a443-e8762fb6cf22 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:56.169551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb3aff34-cb72-4cb6-a443-e8762fb6cf22 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:56.489708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b49c286-88d6-483b-9599-243f016ea8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:56.490897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b49c286-88d6-483b-9599-243f016ea8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:56.505568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b49c286-88d6-483b-9599-243f016ea8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:56.506930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b49c286-88d6-483b-9599-243f016ea8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:56.507937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b49c286-88d6-483b-9599-243f016ea8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:56.509617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b49c286-88d6-483b-9599-243f016ea8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:56.511273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b49c286-88d6-483b-9599-243f016ea8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:56.512423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b49c286-88d6-483b-9599-243f016ea8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:56.766013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b49c286-88d6-483b-9599-243f016ea8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:56.780850 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b49c286-88d6-483b-9599-243f016ea8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1244 microversion: 2.1 time: 0.299168 Aug 25 13:48:56.791177 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2874/5797] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:56 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1244 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:56.800459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a1fdc1a9-87f7-47c8-bbd9-bbdeb670c2a2 req-f7037de5-ab3c-49c3-b79b-c0afc8b33c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64792e48-f365-4939-b754-3ace50ef700a", "tag": "f5a1d6e4-afb8-41d5-b5e5-017aa542e9bc"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:56.820305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a1fdc1a9-87f7-47c8-bbd9-bbdeb670c2a2 req-f7037de5-ab3c-49c3-b79b-c0afc8b33c22 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:56.821670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a1fdc1a9-87f7-47c8-bbd9-bbdeb670c2a2 req-f7037de5-ab3c-49c3-b79b-c0afc8b33c22 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:56.822570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a1fdc1a9-87f7-47c8-bbd9-bbdeb670c2a2 req-f7037de5-ab3c-49c3-b79b-c0afc8b33c22 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:56.852030 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a1fdc1a9-87f7-47c8-bbd9-bbdeb670c2a2 req-f7037de5-ab3c-49c3-b79b-c0afc8b33c22 service nova] Creating event network-changed:f5a1d6e4-afb8-41d5-b5e5-017aa542e9bc for instance 64792e48-f365-4939-b754-3ace50ef700a on n-h2-852771-8 Aug 25 13:48:56.863769 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a1fdc1a9-87f7-47c8-bbd9-bbdeb670c2a2 req-f7037de5-ab3c-49c3-b79b-c0afc8b33c22 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070531 Aug 25 13:48:56.865673 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2875/5798] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:57.064134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cb3aff34-cb72-4cb6-a443-e8762fb6cf22 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:57.090062 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb3aff34-cb72-4cb6-a443-e8762fb6cf22 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1313 microversion: 2.1 time: 0.956023 Aug 25 13:48:57.091200 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2924/5799] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:56 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1313 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:57.813817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1357548f-30f4-4c31-bd68-021285201df3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:57.815239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1357548f-30f4-4c31-bd68-021285201df3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:57.823486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1357548f-30f4-4c31-bd68-021285201df3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:57.824297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1357548f-30f4-4c31-bd68-021285201df3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:57.824907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1357548f-30f4-4c31-bd68-021285201df3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:57.825857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1357548f-30f4-4c31-bd68-021285201df3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:57.826506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1357548f-30f4-4c31-bd68-021285201df3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:57.826954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1357548f-30f4-4c31-bd68-021285201df3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:57.966716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1357548f-30f4-4c31-bd68-021285201df3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:57.977464 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1357548f-30f4-4c31-bd68-021285201df3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1318 microversion: 2.1 time: 0.171899 Aug 25 13:48:57.990095 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2876/5800] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:57 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:58.134324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c7169ae-b2a2-4c32-91b1-fade25388051 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:58.135528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c7169ae-b2a2-4c32-91b1-fade25388051 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:58.150183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7169ae-b2a2-4c32-91b1-fade25388051 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:58.151156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7169ae-b2a2-4c32-91b1-fade25388051 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:58.152419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7169ae-b2a2-4c32-91b1-fade25388051 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:58.154388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7169ae-b2a2-4c32-91b1-fade25388051 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:58.155255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7169ae-b2a2-4c32-91b1-fade25388051 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:58.159140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7169ae-b2a2-4c32-91b1-fade25388051 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:58.471090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7c7169ae-b2a2-4c32-91b1-fade25388051 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:58.481109 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c7169ae-b2a2-4c32-91b1-fade25388051 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1313 microversion: 2.1 time: 0.357128 Aug 25 13:48:58.483702 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2925/5801] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:58 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:59.008718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e4cdbb3c-335a-4151-9136-a2224bdc732a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:59.010198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e4cdbb3c-335a-4151-9136-a2224bdc732a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:59.019272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4cdbb3c-335a-4151-9136-a2224bdc732a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:59.019949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4cdbb3c-335a-4151-9136-a2224bdc732a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:59.020575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4cdbb3c-335a-4151-9136-a2224bdc732a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:59.021783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4cdbb3c-335a-4151-9136-a2224bdc732a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:59.022426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4cdbb3c-335a-4151-9136-a2224bdc732a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:59.023033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4cdbb3c-335a-4151-9136-a2224bdc732a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:59.341195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e4cdbb3c-335a-4151-9136-a2224bdc732a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:59.360478 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e4cdbb3c-335a-4151-9136-a2224bdc732a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1373 microversion: 2.1 time: 0.356497 Aug 25 13:48:59.363300 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2877/5802] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:59 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1373 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:59.507534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aa22417b-54cd-431d-96fb-847bd2eb858e tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:59.508694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-aa22417b-54cd-431d-96fb-847bd2eb858e tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:59.523196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa22417b-54cd-431d-96fb-847bd2eb858e tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:59.524528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa22417b-54cd-431d-96fb-847bd2eb858e tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:59.525628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa22417b-54cd-431d-96fb-847bd2eb858e tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:59.527283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa22417b-54cd-431d-96fb-847bd2eb858e tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:59.528179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa22417b-54cd-431d-96fb-847bd2eb858e tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:59.528998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-aa22417b-54cd-431d-96fb-847bd2eb858e tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:00.092607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-aa22417b-54cd-431d-96fb-847bd2eb858e tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:00.105851 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aa22417b-54cd-431d-96fb-847bd2eb858e tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1313 microversion: 2.1 time: 0.605273 Aug 25 13:49:00.107443 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2926/5803] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:59 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:00.408638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6c752255-4769-44db-a15f-202a57010eaa tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:00.412105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6c752255-4769-44db-a15f-202a57010eaa tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:00.435681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c752255-4769-44db-a15f-202a57010eaa tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:00.437056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c752255-4769-44db-a15f-202a57010eaa tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:00.438321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c752255-4769-44db-a15f-202a57010eaa tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:00.439788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c752255-4769-44db-a15f-202a57010eaa tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:00.441682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c752255-4769-44db-a15f-202a57010eaa tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:00.442511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c752255-4769-44db-a15f-202a57010eaa tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:01.080369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6c752255-4769-44db-a15f-202a57010eaa tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:01.093043 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6c752255-4769-44db-a15f-202a57010eaa tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1373 microversion: 2.1 time: 0.702762 Aug 25 13:49:01.095424 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2878/5804] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:00 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1373 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:01.136894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-147faba5-35d3-4f82-b255-83c35002e5ce tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:01.138103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-147faba5-35d3-4f82-b255-83c35002e5ce tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:01.172738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-147faba5-35d3-4f82-b255-83c35002e5ce tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:01.175981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-147faba5-35d3-4f82-b255-83c35002e5ce tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:01.177691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-147faba5-35d3-4f82-b255-83c35002e5ce tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:01.180820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-147faba5-35d3-4f82-b255-83c35002e5ce tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:01.183048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-147faba5-35d3-4f82-b255-83c35002e5ce tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:01.184561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-147faba5-35d3-4f82-b255-83c35002e5ce tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:01.445447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-18154200-d537-46d1-a9fc-cc16e62566e1 req-43bbde40-7ece-4ae5-8231-99a6d260bdd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae1ab300-4ab6-498d-b183-61c03e329808", "tag": "b5cac3bc-a2dd-4e04-8b81-5921be3543f9"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:01.473714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-18154200-d537-46d1-a9fc-cc16e62566e1 req-43bbde40-7ece-4ae5-8231-99a6d260bdd3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:01.474539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-18154200-d537-46d1-a9fc-cc16e62566e1 req-43bbde40-7ece-4ae5-8231-99a6d260bdd3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:01.475343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-18154200-d537-46d1-a9fc-cc16e62566e1 req-43bbde40-7ece-4ae5-8231-99a6d260bdd3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:01.524960 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-18154200-d537-46d1-a9fc-cc16e62566e1 req-43bbde40-7ece-4ae5-8231-99a6d260bdd3 service nova] Creating event network-changed:b5cac3bc-a2dd-4e04-8b81-5921be3543f9 for instance ae1ab300-4ab6-498d-b183-61c03e329808 on n-h1-852771-8 Aug 25 13:49:01.538250 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-18154200-d537-46d1-a9fc-cc16e62566e1 req-43bbde40-7ece-4ae5-8231-99a6d260bdd3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100058 Aug 25 13:49:01.539861 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2879/5805] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:01.591093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-147faba5-35d3-4f82-b255-83c35002e5ce tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:01.613940 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-147faba5-35d3-4f82-b255-83c35002e5ce tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1313 microversion: 2.1 time: 0.484312 Aug 25 13:49:01.630321 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2927/5806] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:01 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:02.144113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-52f04b3e-0e3e-4ba5-b7ec-7f5ab0780c11 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:02.145366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-52f04b3e-0e3e-4ba5-b7ec-7f5ab0780c11 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:02.166311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52f04b3e-0e3e-4ba5-b7ec-7f5ab0780c11 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:02.168696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52f04b3e-0e3e-4ba5-b7ec-7f5ab0780c11 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:02.171193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52f04b3e-0e3e-4ba5-b7ec-7f5ab0780c11 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:02.173331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52f04b3e-0e3e-4ba5-b7ec-7f5ab0780c11 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:02.175603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52f04b3e-0e3e-4ba5-b7ec-7f5ab0780c11 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:02.176404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-52f04b3e-0e3e-4ba5-b7ec-7f5ab0780c11 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:02.185418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=93 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:02.391979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-52f04b3e-0e3e-4ba5-b7ec-7f5ab0780c11 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:02.402059 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-52f04b3e-0e3e-4ba5-b7ec-7f5ab0780c11 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1373 microversion: 2.1 time: 0.273585 Aug 25 13:49:02.403928 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2880/5807] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:02 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1373 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:02.652170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0581ae59-8fb3-45b3-8f87-0308f6f78d4c tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:02.652961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0581ae59-8fb3-45b3-8f87-0308f6f78d4c tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:02.657077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=7 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:02.666242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0581ae59-8fb3-45b3-8f87-0308f6f78d4c tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:02.667145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0581ae59-8fb3-45b3-8f87-0308f6f78d4c tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:02.667860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0581ae59-8fb3-45b3-8f87-0308f6f78d4c tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:02.668717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0581ae59-8fb3-45b3-8f87-0308f6f78d4c tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:02.669189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0581ae59-8fb3-45b3-8f87-0308f6f78d4c tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:02.669766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0581ae59-8fb3-45b3-8f87-0308f6f78d4c tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:02.840300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0581ae59-8fb3-45b3-8f87-0308f6f78d4c tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:02.852201 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0581ae59-8fb3-45b3-8f87-0308f6f78d4c tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1313 microversion: 2.1 time: 0.204173 Aug 25 13:49:02.852820 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2928/5808] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:02 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:03.140647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-0024a978-cd3d-47d3-b76f-dd07ace40533 req-6f84c44c-40b2-489d-85df-86906b2e8add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64792e48-f365-4939-b754-3ace50ef700a", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1d6e4-afb8-41d5-b5e5-017aa542e9bc"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:03.152786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=44 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:03.155736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0024a978-cd3d-47d3-b76f-dd07ace40533 req-6f84c44c-40b2-489d-85df-86906b2e8add service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:03.157440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0024a978-cd3d-47d3-b76f-dd07ace40533 req-6f84c44c-40b2-489d-85df-86906b2e8add service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:03.157882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-0024a978-cd3d-47d3-b76f-dd07ace40533 req-6f84c44c-40b2-489d-85df-86906b2e8add service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:03.173133 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-0024a978-cd3d-47d3-b76f-dd07ace40533 req-6f84c44c-40b2-489d-85df-86906b2e8add service nova] Creating event network-vif-plugged:f5a1d6e4-afb8-41d5-b5e5-017aa542e9bc for instance 64792e48-f365-4939-b754-3ace50ef700a on n-h2-852771-8 Aug 25 13:49:03.179252 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-0024a978-cd3d-47d3-b76f-dd07ace40533 req-6f84c44c-40b2-489d-85df-86906b2e8add service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043741 Aug 25 13:49:03.180242 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2881/5809] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:03.427388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-34c1a51b-8bbf-4e70-aec4-890145166879 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:03.428663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-34c1a51b-8bbf-4e70-aec4-890145166879 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:03.445283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34c1a51b-8bbf-4e70-aec4-890145166879 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:03.451483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34c1a51b-8bbf-4e70-aec4-890145166879 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:03.452214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34c1a51b-8bbf-4e70-aec4-890145166879 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:03.453316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34c1a51b-8bbf-4e70-aec4-890145166879 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:03.456820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34c1a51b-8bbf-4e70-aec4-890145166879 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:03.457301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34c1a51b-8bbf-4e70-aec4-890145166879 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:03.716679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-34c1a51b-8bbf-4e70-aec4-890145166879 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:03.743711 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-34c1a51b-8bbf-4e70-aec4-890145166879 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1373 microversion: 2.1 time: 0.320159 Aug 25 13:49:03.747533 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2929/5810] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:03 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1373 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:03.883789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-440fab71-aa7b-46c4-8e9b-6f46204dba30 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:03.886546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-440fab71-aa7b-46c4-8e9b-6f46204dba30 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:03.902897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-440fab71-aa7b-46c4-8e9b-6f46204dba30 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:03.907761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-440fab71-aa7b-46c4-8e9b-6f46204dba30 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:03.910013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-440fab71-aa7b-46c4-8e9b-6f46204dba30 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:03.911959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-440fab71-aa7b-46c4-8e9b-6f46204dba30 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:03.913202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-440fab71-aa7b-46c4-8e9b-6f46204dba30 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:03.915229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-440fab71-aa7b-46c4-8e9b-6f46204dba30 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:04.133316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-440fab71-aa7b-46c4-8e9b-6f46204dba30 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:04.145174 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-440fab71-aa7b-46c4-8e9b-6f46204dba30 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1313 microversion: 2.1 time: 0.274176 Aug 25 13:49:04.161768 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2882/5811] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:03 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:04.772325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a5683fc4-ea68-4544-9c3e-23e2142838b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:04.774984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a5683fc4-ea68-4544-9c3e-23e2142838b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:04.795341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5683fc4-ea68-4544-9c3e-23e2142838b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:04.796174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5683fc4-ea68-4544-9c3e-23e2142838b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:04.797000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5683fc4-ea68-4544-9c3e-23e2142838b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:04.798028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5683fc4-ea68-4544-9c3e-23e2142838b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:04.802748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5683fc4-ea68-4544-9c3e-23e2142838b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:04.803525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a5683fc4-ea68-4544-9c3e-23e2142838b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:05.021769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:05.096620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=16 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:05.139599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a5683fc4-ea68-4544-9c3e-23e2142838b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:05.154907 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a5683fc4-ea68-4544-9c3e-23e2142838b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1373 microversion: 2.1 time: 0.390482 Aug 25 13:49:05.157743 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2930/5812] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:04 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1373 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:05.182310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-296a7b23-5793-4fba-91d6-14dd99837ae3 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:05.184446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-296a7b23-5793-4fba-91d6-14dd99837ae3 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:05.199216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296a7b23-5793-4fba-91d6-14dd99837ae3 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:05.200200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296a7b23-5793-4fba-91d6-14dd99837ae3 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:05.201129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296a7b23-5793-4fba-91d6-14dd99837ae3 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:05.202554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296a7b23-5793-4fba-91d6-14dd99837ae3 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:05.204494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296a7b23-5793-4fba-91d6-14dd99837ae3 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:05.205333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-296a7b23-5793-4fba-91d6-14dd99837ae3 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:05.458330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:05.503450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-296a7b23-5793-4fba-91d6-14dd99837ae3 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:05.516458 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-296a7b23-5793-4fba-91d6-14dd99837ae3 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1463 microversion: 2.1 time: 0.345299 Aug 25 13:49:05.517077 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2883/5813] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:05 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1463 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:05.539964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-34120ad9-bb7b-4ffb-8049-43b1067002d9 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04bf4774-ca67-4751-90ca-0d332f1b3712", "device": "/dev/sdb"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:05.549089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-34120ad9-bb7b-4ffb-8049-43b1067002d9 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:05.569679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34120ad9-bb7b-4ffb-8049-43b1067002d9 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:05.573922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34120ad9-bb7b-4ffb-8049-43b1067002d9 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:05.574609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34120ad9-bb7b-4ffb-8049-43b1067002d9 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:05.575530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34120ad9-bb7b-4ffb-8049-43b1067002d9 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:05.576385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34120ad9-bb7b-4ffb-8049-43b1067002d9 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:05.577663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34120ad9-bb7b-4ffb-8049-43b1067002d9 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:06.163916 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-34120ad9-bb7b-4ffb-8049-43b1067002d9 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "POST /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627896 Aug 25 13:49:06.164911 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2931/5814] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:49:05 2022] POST /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:06.185190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d50a83fa-f79d-4408-9db4-cb6e570de46e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:06.186076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d50a83fa-f79d-4408-9db4-cb6e570de46e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:06.198217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d50a83fa-f79d-4408-9db4-cb6e570de46e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:06.200995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d50a83fa-f79d-4408-9db4-cb6e570de46e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:06.201686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d50a83fa-f79d-4408-9db4-cb6e570de46e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:06.203461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d50a83fa-f79d-4408-9db4-cb6e570de46e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:06.206503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d50a83fa-f79d-4408-9db4-cb6e570de46e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:06.207233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d50a83fa-f79d-4408-9db4-cb6e570de46e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:06.576493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d50a83fa-f79d-4408-9db4-cb6e570de46e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:06.592993 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d50a83fa-f79d-4408-9db4-cb6e570de46e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1373 microversion: 2.1 time: 0.411731 Aug 25 13:49:06.597541 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2884/5815] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:06 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1373 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:07.630941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc4f385d-312c-4683-afb3-fb0c193265ee tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:07.634956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fc4f385d-312c-4683-afb3-fb0c193265ee tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:07.655499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc4f385d-312c-4683-afb3-fb0c193265ee tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:07.656898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc4f385d-312c-4683-afb3-fb0c193265ee tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:07.657618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc4f385d-312c-4683-afb3-fb0c193265ee tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:07.658680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc4f385d-312c-4683-afb3-fb0c193265ee tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:07.659374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc4f385d-312c-4683-afb3-fb0c193265ee tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:07.660063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc4f385d-312c-4683-afb3-fb0c193265ee tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:08.052745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc4f385d-312c-4683-afb3-fb0c193265ee tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:08.069117 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fc4f385d-312c-4683-afb3-fb0c193265ee tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1373 microversion: 2.1 time: 0.449300 Aug 25 13:49:08.070248 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2932/5816] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:07 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1373 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:08.870975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d1f30673-8ca0-4a01-9d62-a31802b17a07 req-9395fd70-4313-4154-bcbe-1768223049f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae1ab300-4ab6-498d-b183-61c03e329808", "name": "network-vif-plugged", "status": "completed", "tag": "b5cac3bc-a2dd-4e04-8b81-5921be3543f9"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:08.897094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d1f30673-8ca0-4a01-9d62-a31802b17a07 req-9395fd70-4313-4154-bcbe-1768223049f7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:08.899819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d1f30673-8ca0-4a01-9d62-a31802b17a07 req-9395fd70-4313-4154-bcbe-1768223049f7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:08.901427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d1f30673-8ca0-4a01-9d62-a31802b17a07 req-9395fd70-4313-4154-bcbe-1768223049f7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:08.927989 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d1f30673-8ca0-4a01-9d62-a31802b17a07 req-9395fd70-4313-4154-bcbe-1768223049f7 service nova] Creating event network-vif-plugged:b5cac3bc-a2dd-4e04-8b81-5921be3543f9 for instance ae1ab300-4ab6-498d-b183-61c03e329808 on n-h1-852771-8 Aug 25 13:49:08.942205 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d1f30673-8ca0-4a01-9d62-a31802b17a07 req-9395fd70-4313-4154-bcbe-1768223049f7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074787 Aug 25 13:49:08.945083 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2885/5817] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:09.100713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f819d0cf-a7ff-4140-a9bb-758bf99b1680 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:09.102171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f819d0cf-a7ff-4140-a9bb-758bf99b1680 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:09.118180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f819d0cf-a7ff-4140-a9bb-758bf99b1680 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:09.118956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f819d0cf-a7ff-4140-a9bb-758bf99b1680 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:09.122660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f819d0cf-a7ff-4140-a9bb-758bf99b1680 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:09.123911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f819d0cf-a7ff-4140-a9bb-758bf99b1680 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:09.131282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f819d0cf-a7ff-4140-a9bb-758bf99b1680 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:09.132251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f819d0cf-a7ff-4140-a9bb-758bf99b1680 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:09.401488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f819d0cf-a7ff-4140-a9bb-758bf99b1680 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:09.416406 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f819d0cf-a7ff-4140-a9bb-758bf99b1680 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1373 microversion: 2.1 time: 0.319827 Aug 25 13:49:09.434466 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2933/5818] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:09 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1373 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:10.460219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fdca283c-b580-4773-8367-7bc0060a696a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:10.478914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fdca283c-b580-4773-8367-7bc0060a696a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:10.519278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdca283c-b580-4773-8367-7bc0060a696a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:10.519278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdca283c-b580-4773-8367-7bc0060a696a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:10.519278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdca283c-b580-4773-8367-7bc0060a696a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:10.519278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdca283c-b580-4773-8367-7bc0060a696a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:10.520027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdca283c-b580-4773-8367-7bc0060a696a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:10.521019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdca283c-b580-4773-8367-7bc0060a696a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:10.888017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fdca283c-b580-4773-8367-7bc0060a696a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:10.917866 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fdca283c-b580-4773-8367-7bc0060a696a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1373 microversion: 2.1 time: 0.456426 Aug 25 13:49:10.918712 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2886/5819] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:10 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1373 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:11.948137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3a93edcd-3f17-4e1f-a7f4-398f5746bab3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:11.950446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3a93edcd-3f17-4e1f-a7f4-398f5746bab3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:11.971678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a93edcd-3f17-4e1f-a7f4-398f5746bab3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:11.974938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a93edcd-3f17-4e1f-a7f4-398f5746bab3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:11.975732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a93edcd-3f17-4e1f-a7f4-398f5746bab3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:11.980706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a93edcd-3f17-4e1f-a7f4-398f5746bab3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:11.981218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a93edcd-3f17-4e1f-a7f4-398f5746bab3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:11.981976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a93edcd-3f17-4e1f-a7f4-398f5746bab3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:12.459894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3a93edcd-3f17-4e1f-a7f4-398f5746bab3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:12.485920 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3a93edcd-3f17-4e1f-a7f4-398f5746bab3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1545 microversion: 2.1 time: 0.542991 Aug 25 13:49:12.487191 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2934/5820] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:11 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1545 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:12.526732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1692a850-08c5-465a-a914-91baaa86b100 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:12.531787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1692a850-08c5-465a-a914-91baaa86b100 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:12.549300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1692a850-08c5-465a-a914-91baaa86b100 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:12.550521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1692a850-08c5-465a-a914-91baaa86b100 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:12.551237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1692a850-08c5-465a-a914-91baaa86b100 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:12.552259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1692a850-08c5-465a-a914-91baaa86b100 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:12.553096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1692a850-08c5-465a-a914-91baaa86b100 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:12.553825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1692a850-08c5-465a-a914-91baaa86b100 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:13.450316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1692a850-08c5-465a-a914-91baaa86b100 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:13.495830 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1692a850-08c5-465a-a914-91baaa86b100 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1545 microversion: 2.1 time: 0.969606 Aug 25 13:49:13.497834 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2887/5821] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:12 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1545 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:18.193259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f650f628-dd75-4f0a-b966-ea1bcde0c0ac req-50f6a669-0af5-4c6c-8f8f-ff73595b70d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae1ab300-4ab6-498d-b183-61c03e329808", "tag": "b5cac3bc-a2dd-4e04-8b81-5921be3543f9"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:18.221227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f650f628-dd75-4f0a-b966-ea1bcde0c0ac req-50f6a669-0af5-4c6c-8f8f-ff73595b70d9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:18.222033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f650f628-dd75-4f0a-b966-ea1bcde0c0ac req-50f6a669-0af5-4c6c-8f8f-ff73595b70d9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:18.223076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f650f628-dd75-4f0a-b966-ea1bcde0c0ac req-50f6a669-0af5-4c6c-8f8f-ff73595b70d9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:18.251871 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f650f628-dd75-4f0a-b966-ea1bcde0c0ac req-50f6a669-0af5-4c6c-8f8f-ff73595b70d9 service nova] Creating event network-changed:b5cac3bc-a2dd-4e04-8b81-5921be3543f9 for instance ae1ab300-4ab6-498d-b183-61c03e329808 on n-h1-852771-8 Aug 25 13:49:18.268340 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f650f628-dd75-4f0a-b966-ea1bcde0c0ac req-50f6a669-0af5-4c6c-8f8f-ff73595b70d9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341135 Aug 25 13:49:18.270582 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2935/5822] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:20.371558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1456747399", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "790985ca-519f-4feb-8dc6-0aef2caf19b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9216295-ead7-4063-84e8-342351244740"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:20.517981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] validate_networks() for [('f9216295-ead7-4063-84e8-342351244740', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:49:21.184387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:49:21.190240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:49:21.190949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:49:21.191683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:49:21.192441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:49:21.205927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:21.206454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:21.206910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:21.207675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:21.208272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:21.208777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:21.242051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:49:21.250671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for user 93fbad0b63d14f3fb12de08d966bffad and project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:49:21.349991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:49:21.353280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='790985ca-519f-4feb-8dc6-0aef2caf19b3',volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:49:21.581635 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eb7ae0c5-d560-4914-869b-3ca82f119d22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.218977 Aug 25 13:49:21.585682 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2888/5823] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:49:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:49:21.607692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bf308ce5-646d-4b63-b1a1-07424d57db23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:21.620228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bf308ce5-646d-4b63-b1a1-07424d57db23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:21.718836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bf308ce5-646d-4b63-b1a1-07424d57db23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:21.755350 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bf308ce5-646d-4b63-b1a1-07424d57db23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1057 microversion: 2.1 time: 0.149175 Aug 25 13:49:21.757664 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2936/5824] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:21 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1057 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:21.908016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fbf39e90-a9e2-41c3-be64-dcb3d55ded0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:21.913657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fbf39e90-a9e2-41c3-be64-dcb3d55ded0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:21.931114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbf39e90-a9e2-41c3-be64-dcb3d55ded0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:21.932325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbf39e90-a9e2-41c3-be64-dcb3d55ded0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:21.933013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbf39e90-a9e2-41c3-be64-dcb3d55ded0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:21.936614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbf39e90-a9e2-41c3-be64-dcb3d55ded0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:21.938062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbf39e90-a9e2-41c3-be64-dcb3d55ded0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:21.939754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fbf39e90-a9e2-41c3-be64-dcb3d55ded0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:22.071231 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fbf39e90-a9e2-41c3-be64-dcb3d55ded0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4/action" status: 200 len: 63190 microversion: 2.1 time: 0.178020 Aug 25 13:49:22.072541 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2889/5825] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:49:21 2022] POST /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4/action => generated 63190 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:49:22.799357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-143a3b32-6143-41f4-b1b5-d350ca23a949 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:22.800565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-143a3b32-6143-41f4-b1b5-d350ca23a949 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:22.816185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143a3b32-6143-41f4-b1b5-d350ca23a949 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:22.817725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143a3b32-6143-41f4-b1b5-d350ca23a949 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:22.818614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143a3b32-6143-41f4-b1b5-d350ca23a949 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:22.820298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143a3b32-6143-41f4-b1b5-d350ca23a949 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:22.821231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143a3b32-6143-41f4-b1b5-d350ca23a949 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:22.822227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-143a3b32-6143-41f4-b1b5-d350ca23a949 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:22.920251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-143a3b32-6143-41f4-b1b5-d350ca23a949 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:22.929963 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-143a3b32-6143-41f4-b1b5-d350ca23a949 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1155 microversion: 2.1 time: 0.136394 Aug 25 13:49:22.930602 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2937/5826] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:22 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1155 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:23.955256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-08e9a209-2c53-4787-9755-c5e649c0a8a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:23.957421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-08e9a209-2c53-4787-9755-c5e649c0a8a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:23.967680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e9a209-2c53-4787-9755-c5e649c0a8a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:23.968530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e9a209-2c53-4787-9755-c5e649c0a8a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:23.969277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e9a209-2c53-4787-9755-c5e649c0a8a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:23.970261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e9a209-2c53-4787-9755-c5e649c0a8a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:23.970985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e9a209-2c53-4787-9755-c5e649c0a8a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:23.971596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08e9a209-2c53-4787-9755-c5e649c0a8a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:24.101067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-08e9a209-2c53-4787-9755-c5e649c0a8a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:24.126794 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-08e9a209-2c53-4787-9755-c5e649c0a8a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1173 microversion: 2.1 time: 0.177228 Aug 25 13:49:24.129362 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2890/5827] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:23 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1173 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:25.165392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dfeafacf-065e-4696-a0c5-eb3f25514d55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:25.168207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dfeafacf-065e-4696-a0c5-eb3f25514d55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:25.206182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfeafacf-065e-4696-a0c5-eb3f25514d55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:25.207057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfeafacf-065e-4696-a0c5-eb3f25514d55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:25.207868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfeafacf-065e-4696-a0c5-eb3f25514d55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:25.209160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfeafacf-065e-4696-a0c5-eb3f25514d55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:25.210136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfeafacf-065e-4696-a0c5-eb3f25514d55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:25.210842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dfeafacf-065e-4696-a0c5-eb3f25514d55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:25.258091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:25.604200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dfeafacf-065e-4696-a0c5-eb3f25514d55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:25.623188 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dfeafacf-065e-4696-a0c5-eb3f25514d55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1215 microversion: 2.1 time: 0.461843 Aug 25 13:49:25.624732 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2938/5828] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:25 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1215 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:26.169885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-33296676-9bd2-482d-b2ba-e08fd7ed8ce9 req-cdf615c3-4cca-44ff-99b5-af3847f83457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e5d9113-800e-4217-978d-196f77c1fac6", "tag": "6e576e9b-b21a-4c21-b610-509dc964e88c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:26.225755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-33296676-9bd2-482d-b2ba-e08fd7ed8ce9 req-cdf615c3-4cca-44ff-99b5-af3847f83457 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:26.227010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-33296676-9bd2-482d-b2ba-e08fd7ed8ce9 req-cdf615c3-4cca-44ff-99b5-af3847f83457 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:26.229373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-33296676-9bd2-482d-b2ba-e08fd7ed8ce9 req-cdf615c3-4cca-44ff-99b5-af3847f83457 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:26.265168 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-33296676-9bd2-482d-b2ba-e08fd7ed8ce9 req-cdf615c3-4cca-44ff-99b5-af3847f83457 service nova] Creating event network-changed:6e576e9b-b21a-4c21-b610-509dc964e88c for instance 4e5d9113-800e-4217-978d-196f77c1fac6 on n-h2-852771-8 Aug 25 13:49:26.300798 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-33296676-9bd2-482d-b2ba-e08fd7ed8ce9 req-cdf615c3-4cca-44ff-99b5-af3847f83457 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144944 Aug 25 13:49:26.302272 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2891/5829] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:26.684509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c2dc46f9-7300-4db7-8722-706bd95163c8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:26.688381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c2dc46f9-7300-4db7-8722-706bd95163c8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:26.710184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2dc46f9-7300-4db7-8722-706bd95163c8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:26.711606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2dc46f9-7300-4db7-8722-706bd95163c8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:26.712645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2dc46f9-7300-4db7-8722-706bd95163c8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:26.716182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2dc46f9-7300-4db7-8722-706bd95163c8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:26.717421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2dc46f9-7300-4db7-8722-706bd95163c8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:26.719878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2dc46f9-7300-4db7-8722-706bd95163c8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:27.095445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c2dc46f9-7300-4db7-8722-706bd95163c8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:27.123909 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c2dc46f9-7300-4db7-8722-706bd95163c8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1215 microversion: 2.1 time: 0.450380 Aug 25 13:49:27.123909 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2939/5830] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:26 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1215 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:28.157012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-069cd00c-83ef-4d74-b7e9-5816ed11bfe6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:28.158814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-069cd00c-83ef-4d74-b7e9-5816ed11bfe6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:28.167846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-069cd00c-83ef-4d74-b7e9-5816ed11bfe6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:28.168708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-069cd00c-83ef-4d74-b7e9-5816ed11bfe6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:28.169497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-069cd00c-83ef-4d74-b7e9-5816ed11bfe6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:28.170726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-069cd00c-83ef-4d74-b7e9-5816ed11bfe6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:28.173112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-069cd00c-83ef-4d74-b7e9-5816ed11bfe6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:28.174133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-069cd00c-83ef-4d74-b7e9-5816ed11bfe6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:28.451462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-069cd00c-83ef-4d74-b7e9-5816ed11bfe6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:28.469704 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-069cd00c-83ef-4d74-b7e9-5816ed11bfe6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1215 microversion: 2.1 time: 0.318083 Aug 25 13:49:28.471484 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2892/5831] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:28 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1215 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:29.497397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b54d7d66-0451-4172-baa3-18b498072b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:29.498829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b54d7d66-0451-4172-baa3-18b498072b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:29.507969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b54d7d66-0451-4172-baa3-18b498072b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:29.508835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b54d7d66-0451-4172-baa3-18b498072b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:29.509562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b54d7d66-0451-4172-baa3-18b498072b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:29.510312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b54d7d66-0451-4172-baa3-18b498072b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:29.511034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b54d7d66-0451-4172-baa3-18b498072b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:29.511673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b54d7d66-0451-4172-baa3-18b498072b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:29.757047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b54d7d66-0451-4172-baa3-18b498072b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:29.776567 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b54d7d66-0451-4172-baa3-18b498072b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1215 microversion: 2.1 time: 0.282769 Aug 25 13:49:29.778207 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2940/5832] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:29 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:30.810091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2bdc9690-fb2c-4bae-ae07-56d62d275264 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:30.811375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2bdc9690-fb2c-4bae-ae07-56d62d275264 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:30.828683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bdc9690-fb2c-4bae-ae07-56d62d275264 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:30.829660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bdc9690-fb2c-4bae-ae07-56d62d275264 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:30.830947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bdc9690-fb2c-4bae-ae07-56d62d275264 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:30.833231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bdc9690-fb2c-4bae-ae07-56d62d275264 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:30.833231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bdc9690-fb2c-4bae-ae07-56d62d275264 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:30.833231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bdc9690-fb2c-4bae-ae07-56d62d275264 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:31.077860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2bdc9690-fb2c-4bae-ae07-56d62d275264 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:31.094092 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2bdc9690-fb2c-4bae-ae07-56d62d275264 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1215 microversion: 2.1 time: 0.288903 Aug 25 13:49:31.109847 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2893/5833] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:30 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:32.129489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-30094694-ac9c-474d-b7ac-ac0903071665 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:32.131744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-30094694-ac9c-474d-b7ac-ac0903071665 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:32.136759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:32.147498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30094694-ac9c-474d-b7ac-ac0903071665 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:32.148897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30094694-ac9c-474d-b7ac-ac0903071665 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:32.150069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30094694-ac9c-474d-b7ac-ac0903071665 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:32.151239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30094694-ac9c-474d-b7ac-ac0903071665 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:32.152283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30094694-ac9c-474d-b7ac-ac0903071665 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:32.152492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30094694-ac9c-474d-b7ac-ac0903071665 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:32.367155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-30094694-ac9c-474d-b7ac-ac0903071665 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:32.380887 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-30094694-ac9c-474d-b7ac-ac0903071665 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.259569 Aug 25 13:49:32.382082 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2941/5834] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:32 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:33.418359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a2d148a-d4a3-4d75-9900-2ae408583b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:33.419121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a2d148a-d4a3-4d75-9900-2ae408583b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:33.422207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:33.422987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:33.424934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:33.432727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2d148a-d4a3-4d75-9900-2ae408583b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:33.433306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2d148a-d4a3-4d75-9900-2ae408583b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:33.433850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2d148a-d4a3-4d75-9900-2ae408583b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:33.434741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2d148a-d4a3-4d75-9900-2ae408583b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:33.435223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2d148a-d4a3-4d75-9900-2ae408583b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:33.435669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2d148a-d4a3-4d75-9900-2ae408583b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:33.440372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=66 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:33.663582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5a2d148a-d4a3-4d75-9900-2ae408583b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:33.673945 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a2d148a-d4a3-4d75-9900-2ae408583b77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.260214 Aug 25 13:49:33.674709 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2894/5835] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:33 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:34.701883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-142fe839-c23e-4749-8585-b40e887cc50b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:34.705416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-142fe839-c23e-4749-8585-b40e887cc50b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:34.712582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=30 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:34.721456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142fe839-c23e-4749-8585-b40e887cc50b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:34.722389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142fe839-c23e-4749-8585-b40e887cc50b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:34.723232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142fe839-c23e-4749-8585-b40e887cc50b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:34.724564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142fe839-c23e-4749-8585-b40e887cc50b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:34.725437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142fe839-c23e-4749-8585-b40e887cc50b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:34.726287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-142fe839-c23e-4749-8585-b40e887cc50b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:34.970123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-142fe839-c23e-4749-8585-b40e887cc50b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:34.985161 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-142fe839-c23e-4749-8585-b40e887cc50b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.291218 Aug 25 13:49:34.985855 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2942/5836] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:34 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:36.009735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-45ded6fd-1802-401d-9efe-cb35d1cdc817 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:36.011581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-45ded6fd-1802-401d-9efe-cb35d1cdc817 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:36.024717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ded6fd-1802-401d-9efe-cb35d1cdc817 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:36.025155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ded6fd-1802-401d-9efe-cb35d1cdc817 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:36.025933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ded6fd-1802-401d-9efe-cb35d1cdc817 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:36.027410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ded6fd-1802-401d-9efe-cb35d1cdc817 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:36.028189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ded6fd-1802-401d-9efe-cb35d1cdc817 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:36.028953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-45ded6fd-1802-401d-9efe-cb35d1cdc817 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:36.229112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-45ded6fd-1802-401d-9efe-cb35d1cdc817 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:36.242676 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-45ded6fd-1802-401d-9efe-cb35d1cdc817 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.238271 Aug 25 13:49:36.243634 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2895/5837] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:36 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:37.265363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fbfd0e97-ac7d-4967-9959-37943d01403a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:37.267027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fbfd0e97-ac7d-4967-9959-37943d01403a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:37.277002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbfd0e97-ac7d-4967-9959-37943d01403a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:37.277720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbfd0e97-ac7d-4967-9959-37943d01403a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:37.278230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbfd0e97-ac7d-4967-9959-37943d01403a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:37.279332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbfd0e97-ac7d-4967-9959-37943d01403a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:37.280772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbfd0e97-ac7d-4967-9959-37943d01403a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:37.282861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbfd0e97-ac7d-4967-9959-37943d01403a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:37.517016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fbfd0e97-ac7d-4967-9959-37943d01403a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:37.533918 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fbfd0e97-ac7d-4967-9959-37943d01403a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.271204 Aug 25 13:49:37.533918 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2943/5838] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:37 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:38.487847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f36efcb4-5ca8-4217-87cb-d17506061bee tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:38.489040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f36efcb4-5ca8-4217-87cb-d17506061bee tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:38.504436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f36efcb4-5ca8-4217-87cb-d17506061bee tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:38.505378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f36efcb4-5ca8-4217-87cb-d17506061bee tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:38.506489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f36efcb4-5ca8-4217-87cb-d17506061bee tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:38.507870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f36efcb4-5ca8-4217-87cb-d17506061bee tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:38.508792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f36efcb4-5ca8-4217-87cb-d17506061bee tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:38.509736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f36efcb4-5ca8-4217-87cb-d17506061bee tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:38.572875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f5f3ca2e-ba99-4b0f-b523-8a1b90c0221f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:38.574121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f5f3ca2e-ba99-4b0f-b523-8a1b90c0221f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:38.588717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5f3ca2e-ba99-4b0f-b523-8a1b90c0221f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:38.589269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5f3ca2e-ba99-4b0f-b523-8a1b90c0221f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:38.590012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5f3ca2e-ba99-4b0f-b523-8a1b90c0221f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:38.590819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5f3ca2e-ba99-4b0f-b523-8a1b90c0221f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:38.591447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5f3ca2e-ba99-4b0f-b523-8a1b90c0221f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:38.592130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f5f3ca2e-ba99-4b0f-b523-8a1b90c0221f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:38.774406 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f36efcb4-5ca8-4217-87cb-d17506061bee tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1832 microversion: 2.1 time: 0.293690 Aug 25 13:49:38.775592 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2896/5839] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:38 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1832 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:38.855487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f5f3ca2e-ba99-4b0f-b523-8a1b90c0221f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:38.865325 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f5f3ca2e-ba99-4b0f-b523-8a1b90c0221f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.309402 Aug 25 13:49:38.866130 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2944/5840] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:38 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:39.889014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f813fc73-dd71-4159-a0b5-132dc9e58981 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:39.890784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f813fc73-dd71-4159-a0b5-132dc9e58981 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:39.912587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f813fc73-dd71-4159-a0b5-132dc9e58981 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:39.913719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f813fc73-dd71-4159-a0b5-132dc9e58981 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:39.915663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f813fc73-dd71-4159-a0b5-132dc9e58981 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:39.918400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f813fc73-dd71-4159-a0b5-132dc9e58981 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:39.919048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f813fc73-dd71-4159-a0b5-132dc9e58981 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:39.920637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f813fc73-dd71-4159-a0b5-132dc9e58981 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:40.182429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f813fc73-dd71-4159-a0b5-132dc9e58981 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:40.190927 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f813fc73-dd71-4159-a0b5-132dc9e58981 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.306550 Aug 25 13:49:40.191540 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2897/5841] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:39 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:40.332646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8fca1b92-38be-488a-9da4-7d1b72c715e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:40.333391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8fca1b92-38be-488a-9da4-7d1b72c715e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:40.335963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ad542189-fc54-4bd3-aa36-ba8dd68f31a8 req-9ae84198-836f-48e6-9479-6a28040e5574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:40.344496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fca1b92-38be-488a-9da4-7d1b72c715e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:40.345243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fca1b92-38be-488a-9da4-7d1b72c715e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:40.345864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fca1b92-38be-488a-9da4-7d1b72c715e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:40.346822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fca1b92-38be-488a-9da4-7d1b72c715e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:40.347582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fca1b92-38be-488a-9da4-7d1b72c715e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:40.348261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fca1b92-38be-488a-9da4-7d1b72c715e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:40.363498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ad542189-fc54-4bd3-aa36-ba8dd68f31a8 req-9ae84198-836f-48e6-9479-6a28040e5574 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:40.364824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ad542189-fc54-4bd3-aa36-ba8dd68f31a8 req-9ae84198-836f-48e6-9479-6a28040e5574 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:40.365916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ad542189-fc54-4bd3-aa36-ba8dd68f31a8 req-9ae84198-836f-48e6-9479-6a28040e5574 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:40.390435 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ad542189-fc54-4bd3-aa36-ba8dd68f31a8 req-9ae84198-836f-48e6-9479-6a28040e5574 service nova] Creating event network-changed:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h1-852771-8 Aug 25 13:49:40.402030 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ad542189-fc54-4bd3-aa36-ba8dd68f31a8 req-9ae84198-836f-48e6-9479-6a28040e5574 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073640 Aug 25 13:49:40.402357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8fca1b92-38be-488a-9da4-7d1b72c715e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:49:40.404132 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2945/5842] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:40.613638 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8fca1b92-38be-488a-9da4-7d1b72c715e4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 204 len: 0 microversion: 2.1 time: 0.285671 Aug 25 13:49:40.614796 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2898/5843] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:49:40 2022] DELETE /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:49:40.629296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cca8cfed-73e4-4026-85d2-81c01b5b5010 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:40.630285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cca8cfed-73e4-4026-85d2-81c01b5b5010 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:40.640750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cca8cfed-73e4-4026-85d2-81c01b5b5010 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:40.641923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cca8cfed-73e4-4026-85d2-81c01b5b5010 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:40.642684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cca8cfed-73e4-4026-85d2-81c01b5b5010 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:40.643631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cca8cfed-73e4-4026-85d2-81c01b5b5010 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:40.644306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cca8cfed-73e4-4026-85d2-81c01b5b5010 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:40.644940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cca8cfed-73e4-4026-85d2-81c01b5b5010 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:40.894359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cca8cfed-73e4-4026-85d2-81c01b5b5010 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:40.910209 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cca8cfed-73e4-4026-85d2-81c01b5b5010 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1687 microversion: 2.1 time: 0.289529 Aug 25 13:49:40.912046 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2946/5844] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:40 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1687 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:41.221793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-acc8aca1-2d5d-4b1d-99d6-e6c20135a222 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:41.224170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-acc8aca1-2d5d-4b1d-99d6-e6c20135a222 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:41.238729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acc8aca1-2d5d-4b1d-99d6-e6c20135a222 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:41.239903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acc8aca1-2d5d-4b1d-99d6-e6c20135a222 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:41.241042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acc8aca1-2d5d-4b1d-99d6-e6c20135a222 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:41.242694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acc8aca1-2d5d-4b1d-99d6-e6c20135a222 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:41.243560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acc8aca1-2d5d-4b1d-99d6-e6c20135a222 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:41.244283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acc8aca1-2d5d-4b1d-99d6-e6c20135a222 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:41.477552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-acc8aca1-2d5d-4b1d-99d6-e6c20135a222 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:41.500125 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-acc8aca1-2d5d-4b1d-99d6-e6c20135a222 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.284837 Aug 25 13:49:41.500789 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2899/5845] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:41 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:41.942935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-708b5e2b-caa2-44ba-80a8-21d194619683 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:41.944529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-708b5e2b-caa2-44ba-80a8-21d194619683 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:41.965748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-708b5e2b-caa2-44ba-80a8-21d194619683 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:41.967427 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-708b5e2b-caa2-44ba-80a8-21d194619683 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:41.974209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-708b5e2b-caa2-44ba-80a8-21d194619683 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:41.975620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-708b5e2b-caa2-44ba-80a8-21d194619683 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:41.976536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-708b5e2b-caa2-44ba-80a8-21d194619683 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:41.977380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-708b5e2b-caa2-44ba-80a8-21d194619683 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:42.203636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-708b5e2b-caa2-44ba-80a8-21d194619683 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:42.212214 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-708b5e2b-caa2-44ba-80a8-21d194619683 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1687 microversion: 2.1 time: 0.280504 Aug 25 13:49:42.212823 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2947/5846] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:41 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1687 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:42.521769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14c038ce-5216-47fd-b461-cd9ed976dbae tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:42.522391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-14c038ce-5216-47fd-b461-cd9ed976dbae tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:42.529712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14c038ce-5216-47fd-b461-cd9ed976dbae tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:42.530895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14c038ce-5216-47fd-b461-cd9ed976dbae tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:42.531591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14c038ce-5216-47fd-b461-cd9ed976dbae tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:42.532608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14c038ce-5216-47fd-b461-cd9ed976dbae tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:42.533075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14c038ce-5216-47fd-b461-cd9ed976dbae tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:42.533552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14c038ce-5216-47fd-b461-cd9ed976dbae tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:42.715077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-14c038ce-5216-47fd-b461-cd9ed976dbae tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:42.724888 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-14c038ce-5216-47fd-b461-cd9ed976dbae tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.207095 Aug 25 13:49:42.725832 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2900/5847] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:42 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:43.060153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-3193835c-f2ea-4631-b07a-f6f35182162f req-322783b1-41b4-4140-847b-b4cb0b2b4653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0380171e-bf5a-4533-866a-b1ab0cdaf3f4", "name": "network-vif-deleted", "tag": "1a722add-4caa-44eb-8011-51764976ac8b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:43.072544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3193835c-f2ea-4631-b07a-f6f35182162f req-322783b1-41b4-4140-847b-b4cb0b2b4653 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:43.073035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3193835c-f2ea-4631-b07a-f6f35182162f req-322783b1-41b4-4140-847b-b4cb0b2b4653 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:43.073472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3193835c-f2ea-4631-b07a-f6f35182162f req-322783b1-41b4-4140-847b-b4cb0b2b4653 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:43.089925 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-3193835c-f2ea-4631-b07a-f6f35182162f req-322783b1-41b4-4140-847b-b4cb0b2b4653 service nova] Creating event network-vif-deleted:1a722add-4caa-44eb-8011-51764976ac8b for instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 on n-h1-852771-8 Aug 25 13:49:43.097870 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-3193835c-f2ea-4631-b07a-f6f35182162f req-322783b1-41b4-4140-847b-b4cb0b2b4653 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048091 Aug 25 13:49:43.101962 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2948/5848] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:43.243064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:43.244456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:43.256666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:43.258229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:43.259360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:43.260909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:43.262137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:43.263198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:43.326297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-e9cd90f7-7501-44a1-9ea4-e13d318b01e3 req-f1ce2969-269b-42e0-a3b2-a1c104f9df97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5d9113-800e-4217-978d-196f77c1fac6", "name": "network-vif-plugged", "status": "completed", "tag": "6e576e9b-b21a-4c21-b610-509dc964e88c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:43.328330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:43.329188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:43.329992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:43.330814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lazy-loading 'fault' on Instance uuid 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:49:43.344645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e9cd90f7-7501-44a1-9ea4-e13d318b01e3 req-f1ce2969-269b-42e0-a3b2-a1c104f9df97 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:43.345127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e9cd90f7-7501-44a1-9ea4-e13d318b01e3 req-f1ce2969-269b-42e0-a3b2-a1c104f9df97 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:43.345800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e9cd90f7-7501-44a1-9ea4-e13d318b01e3 req-f1ce2969-269b-42e0-a3b2-a1c104f9df97 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:43.385812 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-e9cd90f7-7501-44a1-9ea4-e13d318b01e3 req-f1ce2969-269b-42e0-a3b2-a1c104f9df97 service nova] Creating event network-vif-plugged:6e576e9b-b21a-4c21-b610-509dc964e88c for instance 4e5d9113-800e-4217-978d-196f77c1fac6 on n-h2-852771-8 Aug 25 13:49:43.392412 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-e9cd90f7-7501-44a1-9ea4-e13d318b01e3 req-f1ce2969-269b-42e0-a3b2-a1c104f9df97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070741 Aug 25 13:49:43.393442 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2949/5849] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:49:43.405098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:43.417843 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1cff23d9-4a66-4767-a3d0-5a9e940d7fe4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 200 len: 1356 microversion: 2.1 time: 0.186025 Aug 25 13:49:43.431744 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2901/5850] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:43 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 1356 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:43.747336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3dc62500-de01-4a37-9774-2ae79047dc8d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:43.748062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3dc62500-de01-4a37-9774-2ae79047dc8d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:43.755973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dc62500-de01-4a37-9774-2ae79047dc8d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:43.756476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dc62500-de01-4a37-9774-2ae79047dc8d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:43.757203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dc62500-de01-4a37-9774-2ae79047dc8d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:43.758052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dc62500-de01-4a37-9774-2ae79047dc8d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:43.758216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dc62500-de01-4a37-9774-2ae79047dc8d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:43.758838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3dc62500-de01-4a37-9774-2ae79047dc8d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:43.908668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3dc62500-de01-4a37-9774-2ae79047dc8d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:43.917844 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3dc62500-de01-4a37-9774-2ae79047dc8d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.174943 Aug 25 13:49:43.918541 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2950/5851] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:43 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:44.463662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:44.464301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 0380171e-bf5a-4533-866a-b1ab0cdaf3f4] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:44.471600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:44.472106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:44.472572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:44.473576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:44.474038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:44.474504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:44.493529 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] HTTP exception thrown: Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 could not be found. Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Request method failure captured: Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 HTTP/1.1 Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB3xUnETqauI1fxE397rReMXDLCicli9Hi5kLufClsv6N95sYOGTClXRLJCM2pDIKRWw-GpkZg3DQxGaWT8EsmuVnSKPWDo4sA2E4cLg9pp_ZjLYOlU7spY_Q87AN4fXVuBQueQfXTy0eO391Jp23FUZkFxq3DruyvbrbheLtC8cWpR4 Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 3f2ace59bb66449bb97802fd18379f1a Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f2ace59bb66449bb97802fd18379f1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3f2ace59bb66449bb97802fd18379f1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3f2ace59bb66449bb97802fd18379f1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f2ace59bb66449bb97802fd18379f1a"}]}] Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 3f2ace59bb66449bb97802fd18379f1a Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestNetworkAdvancedServerOps-1232753206-project Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: ecfd27e7237548f485ae9480d489286a Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1232753206-project Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 could not be found. Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '0380171e-bf5a-4533-866a-b1ab0cdaf3f4'} Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 could not be found. Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 could not be found. Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:49:44.495258 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 could not be found. Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Returning 404 to user: Instance 0380171e-bf5a-4533-866a-b1ab0cdaf3f4 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a2517ec6-8030-4168-89e4-5bd6c08073d0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4" status: 404 len: 111 microversion: 2.1 time: 0.039154 Aug 25 13:49:44.508537 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2902/5852] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:44 2022] GET /compute/v2.1/servers/0380171e-bf5a-4533-866a-b1ab0cdaf3f4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:49:44.938825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bcd6c9b6-a83c-42ac-b8d7-d3a812f511fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:44.940369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bcd6c9b6-a83c-42ac-b8d7-d3a812f511fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:44.956462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcd6c9b6-a83c-42ac-b8d7-d3a812f511fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:44.957362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcd6c9b6-a83c-42ac-b8d7-d3a812f511fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:44.960144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcd6c9b6-a83c-42ac-b8d7-d3a812f511fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:44.961312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcd6c9b6-a83c-42ac-b8d7-d3a812f511fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:44.962007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcd6c9b6-a83c-42ac-b8d7-d3a812f511fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:44.963991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bcd6c9b6-a83c-42ac-b8d7-d3a812f511fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:45.230003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bcd6c9b6-a83c-42ac-b8d7-d3a812f511fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:45.248289 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bcd6c9b6-a83c-42ac-b8d7-d3a812f511fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1203 microversion: 2.1 time: 0.312932 Aug 25 13:49:45.270393 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2951/5853] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:44 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1203 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:46.284507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d54710b6-d9a4-4364-ba72-335efe2a48d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:46.285469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d54710b6-d9a4-4364-ba72-335efe2a48d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:46.292685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54710b6-d9a4-4364-ba72-335efe2a48d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:46.293387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54710b6-d9a4-4364-ba72-335efe2a48d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:46.294114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54710b6-d9a4-4364-ba72-335efe2a48d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:46.295085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54710b6-d9a4-4364-ba72-335efe2a48d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:46.295540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54710b6-d9a4-4364-ba72-335efe2a48d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:46.297130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d54710b6-d9a4-4364-ba72-335efe2a48d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:46.505600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d54710b6-d9a4-4364-ba72-335efe2a48d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:46.515024 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d54710b6-d9a4-4364-ba72-335efe2a48d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1390 microversion: 2.1 time: 0.235455 Aug 25 13:49:46.516540 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2903/5854] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:46 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1390 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:46.543651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cccf3d63-0c66-468c-9d7a-981b550f2082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:46.543651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cccf3d63-0c66-468c-9d7a-981b550f2082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:46.551250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccf3d63-0c66-468c-9d7a-981b550f2082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:46.551747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccf3d63-0c66-468c-9d7a-981b550f2082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:46.552397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccf3d63-0c66-468c-9d7a-981b550f2082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:46.553119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccf3d63-0c66-468c-9d7a-981b550f2082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:46.553772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccf3d63-0c66-468c-9d7a-981b550f2082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:46.554354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccf3d63-0c66-468c-9d7a-981b550f2082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:46.723297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cccf3d63-0c66-468c-9d7a-981b550f2082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:46.741209 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cccf3d63-0c66-468c-9d7a-981b550f2082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1390 microversion: 2.1 time: 0.201880 Aug 25 13:49:46.745598 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2952/5855] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:46 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1390 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:46.777016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5bce3449-c62e-46bb-8734-a27d719083d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:46.777655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5bce3449-c62e-46bb-8734-a27d719083d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:46.784158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bce3449-c62e-46bb-8734-a27d719083d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:46.784780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bce3449-c62e-46bb-8734-a27d719083d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:46.785219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bce3449-c62e-46bb-8734-a27d719083d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:46.786700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bce3449-c62e-46bb-8734-a27d719083d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:46.787162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bce3449-c62e-46bb-8734-a27d719083d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:46.787594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bce3449-c62e-46bb-8734-a27d719083d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:46.954381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5bce3449-c62e-46bb-8734-a27d719083d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:46.965790 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5bce3449-c62e-46bb-8734-a27d719083d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1390 microversion: 2.1 time: 0.192544 Aug 25 13:49:46.974816 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2904/5856] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:46 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1390 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:46.990236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ced3125d-f8a8-4877-aed3-6580ca8d69e8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:46.990877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ced3125d-f8a8-4877-aed3-6580ca8d69e8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:46.997887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ced3125d-f8a8-4877-aed3-6580ca8d69e8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:46.998504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ced3125d-f8a8-4877-aed3-6580ca8d69e8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:46.999245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ced3125d-f8a8-4877-aed3-6580ca8d69e8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:47.000065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ced3125d-f8a8-4877-aed3-6580ca8d69e8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:47.000861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ced3125d-f8a8-4877-aed3-6580ca8d69e8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:47.001377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ced3125d-f8a8-4877-aed3-6580ca8d69e8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:47.037136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ced3125d-f8a8-4877-aed3-6580ca8d69e8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:49:47.150917 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ced3125d-f8a8-4877-aed3-6580ca8d69e8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 204 len: 0 microversion: 2.1 time: 0.164582 Aug 25 13:49:47.151865 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2953/5857] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:49:46 2022] DELETE /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:49:47.161827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9739a28e-7bc0-48e7-95b9-b56052c49076 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:47.162864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9739a28e-7bc0-48e7-95b9-b56052c49076 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:47.170818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9739a28e-7bc0-48e7-95b9-b56052c49076 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:47.170818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9739a28e-7bc0-48e7-95b9-b56052c49076 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:47.171819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9739a28e-7bc0-48e7-95b9-b56052c49076 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:47.173178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9739a28e-7bc0-48e7-95b9-b56052c49076 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:47.173789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9739a28e-7bc0-48e7-95b9-b56052c49076 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:47.174325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9739a28e-7bc0-48e7-95b9-b56052c49076 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:47.366505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9739a28e-7bc0-48e7-95b9-b56052c49076 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:47.378853 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9739a28e-7bc0-48e7-95b9-b56052c49076 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1396 microversion: 2.1 time: 0.220988 Aug 25 13:49:47.380123 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2905/5858] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:47 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1396 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:48.404552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-449ae8c0-fa41-4282-9e54-28b1de1e272e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:48.406052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-449ae8c0-fa41-4282-9e54-28b1de1e272e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:48.415251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-449ae8c0-fa41-4282-9e54-28b1de1e272e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:48.416043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-449ae8c0-fa41-4282-9e54-28b1de1e272e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:48.417311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-449ae8c0-fa41-4282-9e54-28b1de1e272e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:48.418288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-449ae8c0-fa41-4282-9e54-28b1de1e272e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:48.419030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-449ae8c0-fa41-4282-9e54-28b1de1e272e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:48.419984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-449ae8c0-fa41-4282-9e54-28b1de1e272e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:48.498350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8a54ff67-c4c2-42ed-8d6c-d0a23adc21d2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:48.506952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8a54ff67-c4c2-42ed-8d6c-d0a23adc21d2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:48.524788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a54ff67-c4c2-42ed-8d6c-d0a23adc21d2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:48.527327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a54ff67-c4c2-42ed-8d6c-d0a23adc21d2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:48.527327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a54ff67-c4c2-42ed-8d6c-d0a23adc21d2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:48.527631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a54ff67-c4c2-42ed-8d6c-d0a23adc21d2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:48.527881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a54ff67-c4c2-42ed-8d6c-d0a23adc21d2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:48.528325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a54ff67-c4c2-42ed-8d6c-d0a23adc21d2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:48.620708 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8a54ff67-c4c2-42ed-8d6c-d0a23adc21d2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "POST /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808/action" status: 200 len: 24575 microversion: 2.1 time: 0.126864 Aug 25 13:49:48.621844 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2906/5859] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:49:48 2022] POST /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808/action => generated 24575 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:49:48.692664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-449ae8c0-fa41-4282-9e54-28b1de1e272e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:48.710799 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-449ae8c0-fa41-4282-9e54-28b1de1e272e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1396 microversion: 2.1 time: 0.311593 Aug 25 13:49:48.711434 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2954/5860] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:48 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1396 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:49.751675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-abfd118d-1e69-46fe-a82e-66a91d7fcc5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:49.753887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-abfd118d-1e69-46fe-a82e-66a91d7fcc5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:49.764265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfd118d-1e69-46fe-a82e-66a91d7fcc5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:49.765261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfd118d-1e69-46fe-a82e-66a91d7fcc5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:49.766349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfd118d-1e69-46fe-a82e-66a91d7fcc5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:49.767476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfd118d-1e69-46fe-a82e-66a91d7fcc5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:49.769827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfd118d-1e69-46fe-a82e-66a91d7fcc5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:49.770959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfd118d-1e69-46fe-a82e-66a91d7fcc5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:49.782580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1440e2c0-2910-4622-a2b3-7cf87c5c8aff req-76e4072c-546c-402d-b837-13a1a586edd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5d9113-800e-4217-978d-196f77c1fac6", "name": "network-vif-deleted", "tag": "6e576e9b-b21a-4c21-b610-509dc964e88c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:49.823991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1440e2c0-2910-4622-a2b3-7cf87c5c8aff req-76e4072c-546c-402d-b837-13a1a586edd3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:49.825234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1440e2c0-2910-4622-a2b3-7cf87c5c8aff req-76e4072c-546c-402d-b837-13a1a586edd3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:49.825802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1440e2c0-2910-4622-a2b3-7cf87c5c8aff req-76e4072c-546c-402d-b837-13a1a586edd3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:49.871882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:49.877046 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1440e2c0-2910-4622-a2b3-7cf87c5c8aff req-76e4072c-546c-402d-b837-13a1a586edd3 service nova] Creating event network-vif-deleted:6e576e9b-b21a-4c21-b610-509dc964e88c for instance 4e5d9113-800e-4217-978d-196f77c1fac6 on n-h2-852771-8 Aug 25 13:49:49.888482 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1440e2c0-2910-4622-a2b3-7cf87c5c8aff req-76e4072c-546c-402d-b837-13a1a586edd3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115251 Aug 25 13:49:49.894552 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2955/5861] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:49.957098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5067fd06-b46d-4848-ab15-1905dadeccd0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '.version_select at 0x7f3a2a1b6d30>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:49.984245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-abfd118d-1e69-46fe-a82e-66a91d7fcc5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:50.005917 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5067fd06-b46d-4848-ab15-1905dadeccd0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-283244426" status: 202 len: 0 microversion: 2.1 time: 0.053848 Aug 25 13:49:50.007015 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2956/5862] 10.222.0.70 () {58 vars in 1281 bytes} [Thu Aug 25 13:49:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-283244426 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:49:50.052829 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-abfd118d-1e69-46fe-a82e-66a91d7fcc5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1354 microversion: 2.1 time: 0.298162 Aug 25 13:49:50.053589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c4db808d-6ac0-48d4-9e69-1ca48c18334e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'create', calling method: .version_select at 0x7f3a2a2498b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1411669147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAAxuvRsEWahs/dgYY9V53vZ4TJfP+WZoE6wnFnd0Kn6GDbEw4qCNAjGt4iNtmpyH31ymPvLsNB+Q3lPd2tP6TK88Fa//W0GMbW5pQ+l2Ax/p0jbz0lfXxjqsq+SGt39Q=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:50.070108 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2907/5863] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:49 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1354 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:50.094113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c4db808d-6ac0-48d4-9e69-1ca48c18334e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:49:50.101250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-c4db808d-6ac0-48d4-9e69-1ca48c18334e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for user ecfd27e7237548f485ae9480d489286a and project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:49:50.131113 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c4db808d-6ac0-48d4-9e69-1ca48c18334e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.085194 Aug 25 13:49:50.131942 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2957/5864] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:49:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:49:51.095409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fa8861ab-015f-45f2-980a-1ab92e061fcc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:51.096844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fa8861ab-015f-45f2-980a-1ab92e061fcc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:51.105384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8861ab-015f-45f2-980a-1ab92e061fcc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:51.106294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8861ab-015f-45f2-980a-1ab92e061fcc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:51.107002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8861ab-015f-45f2-980a-1ab92e061fcc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:51.107985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8861ab-015f-45f2-980a-1ab92e061fcc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:51.108758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8861ab-015f-45f2-980a-1ab92e061fcc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:51.109454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fa8861ab-015f-45f2-980a-1ab92e061fcc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:51.239365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fa8861ab-015f-45f2-980a-1ab92e061fcc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:51.252370 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fa8861ab-015f-45f2-980a-1ab92e061fcc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1188 microversion: 2.1 time: 0.160934 Aug 25 13:49:51.253286 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2908/5865] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:51 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1188 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:52.282469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-25f942e1-386e-4c5c-bb14-cddbe0e385dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:52.283374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-25f942e1-386e-4c5c-bb14-cddbe0e385dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:52.294525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25f942e1-386e-4c5c-bb14-cddbe0e385dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:52.298382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25f942e1-386e-4c5c-bb14-cddbe0e385dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:52.299340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25f942e1-386e-4c5c-bb14-cddbe0e385dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:52.300392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25f942e1-386e-4c5c-bb14-cddbe0e385dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:52.301158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25f942e1-386e-4c5c-bb14-cddbe0e385dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:52.301842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25f942e1-386e-4c5c-bb14-cddbe0e385dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:52.752185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-25f942e1-386e-4c5c-bb14-cddbe0e385dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:52.762636 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-25f942e1-386e-4c5c-bb14-cddbe0e385dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1188 microversion: 2.1 time: 0.485886 Aug 25 13:49:52.774183 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2958/5866] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:52 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1188 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:53.792406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89b1012c-7163-4ad3-9a56-820af83174af tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:53.794915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89b1012c-7163-4ad3-9a56-820af83174af tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:53.807361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1012c-7163-4ad3-9a56-820af83174af tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:53.815197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1012c-7163-4ad3-9a56-820af83174af tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:53.816350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1012c-7163-4ad3-9a56-820af83174af tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:53.817894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1012c-7163-4ad3-9a56-820af83174af tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:53.818888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1012c-7163-4ad3-9a56-820af83174af tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:53.819734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89b1012c-7163-4ad3-9a56-820af83174af tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:53.926188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-89b1012c-7163-4ad3-9a56-820af83174af tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:53.929062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:53.942009 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89b1012c-7163-4ad3-9a56-820af83174af tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1188 microversion: 2.1 time: 0.155772 Aug 25 13:49:53.943251 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2909/5867] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:53 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1188 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:54.980707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d039cb7f-77ac-4256-b55d-19cbe4d5a767 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:54.981886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d039cb7f-77ac-4256-b55d-19cbe4d5a767 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:55.007653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d039cb7f-77ac-4256-b55d-19cbe4d5a767 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:55.009600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d039cb7f-77ac-4256-b55d-19cbe4d5a767 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:55.010936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d039cb7f-77ac-4256-b55d-19cbe4d5a767 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:55.015699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d039cb7f-77ac-4256-b55d-19cbe4d5a767 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:55.017032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d039cb7f-77ac-4256-b55d-19cbe4d5a767 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:55.018182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d039cb7f-77ac-4256-b55d-19cbe4d5a767 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:55.292632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d039cb7f-77ac-4256-b55d-19cbe4d5a767 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:55.308390 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d039cb7f-77ac-4256-b55d-19cbe4d5a767 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1188 microversion: 2.1 time: 0.335029 Aug 25 13:49:55.309005 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2959/5868] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:54 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:56.346078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:56.347804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:56.362790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:56.364105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:56.364745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:56.366038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:56.366739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:56.367336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:56.446913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:56.447904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:56.448624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:56.449376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lazy-loading 'fault' on Instance uuid 4e5d9113-800e-4217-978d-196f77c1fac6 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:49:56.549132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:56.567735 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0b903183-a008-4673-aa2b-727577d9ca82 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 200 len: 1193 microversion: 2.1 time: 0.231189 Aug 25 13:49:56.569099 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2910/5869] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:56 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 1193 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:57.602945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:57.604880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4e5d9113-800e-4217-978d-196f77c1fac6] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:57.620357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:57.621117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:57.621797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:57.623226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:57.624268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:57.624887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:57.650797 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 4e5d9113-800e-4217-978d-196f77c1fac6 could not be found. Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 HTTP/1.1 Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 4e5d9113-800e-4217-978d-196f77c1fac6 could not be found. Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '4e5d9113-800e-4217-978d-196f77c1fac6'} Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5d9113-800e-4217-978d-196f77c1fac6 could not be found. Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5d9113-800e-4217-978d-196f77c1fac6 could not be found. Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:49:57.655899 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:49:57.660273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:49:57.660273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:49:57.660273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:49:57.660273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:49:57.660273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:49:57.660273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5d9113-800e-4217-978d-196f77c1fac6 could not be found. Aug 25 13:49:57.660273 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:49:57.662276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 4e5d9113-800e-4217-978d-196f77c1fac6 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:49:57.663441 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-154c558b-d408-4b30-8169-ec7013b78dde tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6" status: 404 len: 111 microversion: 2.1 time: 0.068326 Aug 25 13:49:57.664308 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2960/5870] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:57 2022] GET /compute/v2.1/servers/4e5d9113-800e-4217-978d-196f77c1fac6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:50:01.215690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-295903197", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "f570650d-52e8-4a42-a944-73151eb49a6a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1411669147", "security_groups": [{"name": "tempest-secgroup-smoke-170224686"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:01.541313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] validate_networks() for [('f570650d-52e8-4a42-a944-73151eb49a6a', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:50:02.383051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:50:02.383883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:50:02.384333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:50:02.385656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:50:02.386866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:50:02.439115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:02.440547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:02.441605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:02.450924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:02.459267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:02.460661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:02.488028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:50:02.495924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for user ecfd27e7237548f485ae9480d489286a and project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:50:02.518153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:50:02.521473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:50:02.588214 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f56765f3-8e8f-4a89-9472-b2d1ca8a1b67 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.381723 Aug 25 13:50:02.589597 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2911/5871] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:50:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:50:02.604878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9ceeb994-300c-4544-a811-e77e7b41bb5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:02.611100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9ceeb994-300c-4544-a811-e77e7b41bb5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:02.618355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:02.779024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9ceeb994-300c-4544-a811-e77e7b41bb5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:02.789375 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9ceeb994-300c-4544-a811-e77e7b41bb5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1266 microversion: 2.1 time: 0.189214 Aug 25 13:50:02.790024 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2961/5872] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:02 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:03.841773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ebdcf65f-4c28-4c73-a4ee-cb19c5a6a264 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:03.843619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ebdcf65f-4c28-4c73-a4ee-cb19c5a6a264 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:03.872764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:03.875747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdcf65f-4c28-4c73-a4ee-cb19c5a6a264 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:03.885099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdcf65f-4c28-4c73-a4ee-cb19c5a6a264 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:03.887445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdcf65f-4c28-4c73-a4ee-cb19c5a6a264 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:03.888811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdcf65f-4c28-4c73-a4ee-cb19c5a6a264 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:03.894148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdcf65f-4c28-4c73-a4ee-cb19c5a6a264 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:03.895237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebdcf65f-4c28-4c73-a4ee-cb19c5a6a264 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:04.119936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ebdcf65f-4c28-4c73-a4ee-cb19c5a6a264 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:04.137878 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ebdcf65f-4c28-4c73-a4ee-cb19c5a6a264 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1262 microversion: 2.1 time: 0.329002 Aug 25 13:50:04.143624 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2912/5873] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:03 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1262 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:05.192495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fd713f7f-0b9a-4040-8de1-bbd68cecda6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:05.196442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fd713f7f-0b9a-4040-8de1-bbd68cecda6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:05.209658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:05.251738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd713f7f-0b9a-4040-8de1-bbd68cecda6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:05.252525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd713f7f-0b9a-4040-8de1-bbd68cecda6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:05.253274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd713f7f-0b9a-4040-8de1-bbd68cecda6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:05.254600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd713f7f-0b9a-4040-8de1-bbd68cecda6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:05.255652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd713f7f-0b9a-4040-8de1-bbd68cecda6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:05.256734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd713f7f-0b9a-4040-8de1-bbd68cecda6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:05.408023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fd713f7f-0b9a-4040-8de1-bbd68cecda6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:05.448078 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fd713f7f-0b9a-4040-8de1-bbd68cecda6c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1324 microversion: 2.1 time: 0.261372 Aug 25 13:50:05.449327 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2962/5874] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:05 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:06.505854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dab372d6-6e54-4517-b3e7-5f63b3e9b96f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:06.506530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dab372d6-6e54-4517-b3e7-5f63b3e9b96f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:06.516015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab372d6-6e54-4517-b3e7-5f63b3e9b96f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:06.516523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab372d6-6e54-4517-b3e7-5f63b3e9b96f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:06.516971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab372d6-6e54-4517-b3e7-5f63b3e9b96f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:06.520854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab372d6-6e54-4517-b3e7-5f63b3e9b96f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:06.521337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab372d6-6e54-4517-b3e7-5f63b3e9b96f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:06.521993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dab372d6-6e54-4517-b3e7-5f63b3e9b96f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:06.997270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dab372d6-6e54-4517-b3e7-5f63b3e9b96f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:07.020589 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dab372d6-6e54-4517-b3e7-5f63b3e9b96f tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1391 microversion: 2.1 time: 0.536753 Aug 25 13:50:07.022257 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2913/5875] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:06 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1391 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:07.822383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-574603447", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "38061739-8640-4a7b-91d7-8997bf7bf975", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9216295-ead7-4063-84e8-342351244740"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:07.911374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-43e428e7-e544-494e-9c9f-a300c8e3aecb req-50e4d15d-aa60-4b22-bc42-06bfc7b64759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd83b4d4-e933-41fb-b596-ab891f7420a7", "tag": "7c61df38-9f17-4673-ab66-6bcfa817e247"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:07.950806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] validate_networks() for [('f9216295-ead7-4063-84e8-342351244740', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:50:07.952188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-43e428e7-e544-494e-9c9f-a300c8e3aecb req-50e4d15d-aa60-4b22-bc42-06bfc7b64759 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:07.953886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-43e428e7-e544-494e-9c9f-a300c8e3aecb req-50e4d15d-aa60-4b22-bc42-06bfc7b64759 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:07.957580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-43e428e7-e544-494e-9c9f-a300c8e3aecb req-50e4d15d-aa60-4b22-bc42-06bfc7b64759 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:07.980402 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-43e428e7-e544-494e-9c9f-a300c8e3aecb req-50e4d15d-aa60-4b22-bc42-06bfc7b64759 service nova] Creating event network-changed:7c61df38-9f17-4673-ab66-6bcfa817e247 for instance fd83b4d4-e933-41fb-b596-ab891f7420a7 on n-h2-852771-8 Aug 25 13:50:07.992185 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-43e428e7-e544-494e-9c9f-a300c8e3aecb req-50e4d15d-aa60-4b22-bc42-06bfc7b64759 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089398 Aug 25 13:50:07.993192 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2914/5876] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:08.052875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f71cd3e-e8d9-4219-9801-e1f2dbb29384 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:08.054770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f71cd3e-e8d9-4219-9801-e1f2dbb29384 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:08.063759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f71cd3e-e8d9-4219-9801-e1f2dbb29384 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:08.064435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f71cd3e-e8d9-4219-9801-e1f2dbb29384 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:08.065028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f71cd3e-e8d9-4219-9801-e1f2dbb29384 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:08.066156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f71cd3e-e8d9-4219-9801-e1f2dbb29384 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:08.066848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f71cd3e-e8d9-4219-9801-e1f2dbb29384 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:08.067568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f71cd3e-e8d9-4219-9801-e1f2dbb29384 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:08.460938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f71cd3e-e8d9-4219-9801-e1f2dbb29384 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:08.482675 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f71cd3e-e8d9-4219-9801-e1f2dbb29384 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1391 microversion: 2.1 time: 0.435748 Aug 25 13:50:08.485700 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2915/5877] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:08 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1391 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:09.426370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:50:09.429936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:50:09.431609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:50:09.432786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:50:09.433712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:50:09.451496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:09.456050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:09.456970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:09.458173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:09.458797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:09.459372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:09.486964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:50:09.497216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for user 93fbad0b63d14f3fb12de08d966bffad and project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:50:09.528278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9824c7e4-c761-46ec-bfa0-526c753d9a5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:09.529393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9824c7e4-c761-46ec-bfa0-526c753d9a5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:09.543047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9824c7e4-c761-46ec-bfa0-526c753d9a5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:09.544236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9824c7e4-c761-46ec-bfa0-526c753d9a5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:09.545013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9824c7e4-c761-46ec-bfa0-526c753d9a5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:09.547122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9824c7e4-c761-46ec-bfa0-526c753d9a5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:09.547973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9824c7e4-c761-46ec-bfa0-526c753d9a5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:09.548673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9824c7e4-c761-46ec-bfa0-526c753d9a5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:09.606362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:50:09.609239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38061739-8640-4a7b-91d7-8997bf7bf975',volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:50:09.804375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9824c7e4-c761-46ec-bfa0-526c753d9a5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:09.818888 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9824c7e4-c761-46ec-bfa0-526c753d9a5e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1391 microversion: 2.1 time: 0.300035 Aug 25 13:50:09.820587 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2916/5878] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:09 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1391 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:09.871714 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-762f1175-447e-47b5-ad15-4ce031398d35 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.062674 Aug 25 13:50:09.872688 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2963/5879] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:50:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:50:09.888529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0d5fdb4c-912a-40e4-8a8b-2226914b33ac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:09.890268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0d5fdb4c-912a-40e4-8a8b-2226914b33ac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:09.985175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0d5fdb4c-912a-40e4-8a8b-2226914b33ac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:09.999199 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0d5fdb4c-912a-40e4-8a8b-2226914b33ac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1056 microversion: 2.1 time: 0.116209 Aug 25 13:50:10.018650 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2917/5880] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:09 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1056 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:10.852985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5da57b27-2ff6-48da-b6c1-1fa0a30f2f47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:10.854302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5da57b27-2ff6-48da-b6c1-1fa0a30f2f47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:10.871422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5da57b27-2ff6-48da-b6c1-1fa0a30f2f47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:10.872354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5da57b27-2ff6-48da-b6c1-1fa0a30f2f47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:10.873230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5da57b27-2ff6-48da-b6c1-1fa0a30f2f47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:10.875837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5da57b27-2ff6-48da-b6c1-1fa0a30f2f47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:10.877176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5da57b27-2ff6-48da-b6c1-1fa0a30f2f47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:10.878018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5da57b27-2ff6-48da-b6c1-1fa0a30f2f47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:11.055137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-94179bc7-c0e4-408d-8373-aac687bd5128 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:11.057076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-94179bc7-c0e4-408d-8373-aac687bd5128 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:11.071539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94179bc7-c0e4-408d-8373-aac687bd5128 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:11.072755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94179bc7-c0e4-408d-8373-aac687bd5128 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:11.073854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94179bc7-c0e4-408d-8373-aac687bd5128 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:11.075458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94179bc7-c0e4-408d-8373-aac687bd5128 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:11.076631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94179bc7-c0e4-408d-8373-aac687bd5128 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:11.077819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-94179bc7-c0e4-408d-8373-aac687bd5128 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:11.138754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5da57b27-2ff6-48da-b6c1-1fa0a30f2f47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:11.151974 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5da57b27-2ff6-48da-b6c1-1fa0a30f2f47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1391 microversion: 2.1 time: 0.305170 Aug 25 13:50:11.153018 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2964/5881] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:10 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:11.192636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-94179bc7-c0e4-408d-8373-aac687bd5128 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:11.203703 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-94179bc7-c0e4-408d-8373-aac687bd5128 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1154 microversion: 2.1 time: 0.166602 Aug 25 13:50:11.204864 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2918/5882] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:11 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1154 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:12.204247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dbdc6199-8862-45af-aa02-9ff800aed7db tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:12.206137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dbdc6199-8862-45af-aa02-9ff800aed7db tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:12.223114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbdc6199-8862-45af-aa02-9ff800aed7db tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:12.234625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee9cb21c-b797-4f05-93f7-4e061fbde798 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:12.235976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee9cb21c-b797-4f05-93f7-4e061fbde798 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:12.237753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbdc6199-8862-45af-aa02-9ff800aed7db tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:12.240060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbdc6199-8862-45af-aa02-9ff800aed7db tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:12.245939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbdc6199-8862-45af-aa02-9ff800aed7db tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:12.247125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbdc6199-8862-45af-aa02-9ff800aed7db tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:12.250550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dbdc6199-8862-45af-aa02-9ff800aed7db tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:12.270070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee9cb21c-b797-4f05-93f7-4e061fbde798 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:12.272015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee9cb21c-b797-4f05-93f7-4e061fbde798 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:12.274476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee9cb21c-b797-4f05-93f7-4e061fbde798 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:12.298541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee9cb21c-b797-4f05-93f7-4e061fbde798 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:12.299942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee9cb21c-b797-4f05-93f7-4e061fbde798 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:12.301062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee9cb21c-b797-4f05-93f7-4e061fbde798 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:12.476028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:12.590594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ee9cb21c-b797-4f05-93f7-4e061fbde798 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:12.606761 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee9cb21c-b797-4f05-93f7-4e061fbde798 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1172 microversion: 2.1 time: 0.380063 Aug 25 13:50:12.609087 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2919/5883] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:12 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1172 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:50:12.734291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dbdc6199-8862-45af-aa02-9ff800aed7db tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:12.758468 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dbdc6199-8862-45af-aa02-9ff800aed7db tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1391 microversion: 2.1 time: 0.574239 Aug 25 13:50:12.761452 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2965/5884] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:12 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1391 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:13.663462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-05f0b90f-3728-4979-8c62-42efc6cb014a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:13.664306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-05f0b90f-3728-4979-8c62-42efc6cb014a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:13.674577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05f0b90f-3728-4979-8c62-42efc6cb014a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:13.675469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05f0b90f-3728-4979-8c62-42efc6cb014a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:13.676232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05f0b90f-3728-4979-8c62-42efc6cb014a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:13.677347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05f0b90f-3728-4979-8c62-42efc6cb014a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:13.678541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05f0b90f-3728-4979-8c62-42efc6cb014a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:13.679662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05f0b90f-3728-4979-8c62-42efc6cb014a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:13.796477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c4eff9b5-99b6-40f6-a34d-328531d1364e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:13.797562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c4eff9b5-99b6-40f6-a34d-328531d1364e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:13.817853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4eff9b5-99b6-40f6-a34d-328531d1364e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:13.818709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4eff9b5-99b6-40f6-a34d-328531d1364e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:13.823063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4eff9b5-99b6-40f6-a34d-328531d1364e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:13.824744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4eff9b5-99b6-40f6-a34d-328531d1364e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:13.829851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4eff9b5-99b6-40f6-a34d-328531d1364e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:13.830902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4eff9b5-99b6-40f6-a34d-328531d1364e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:14.532080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c4eff9b5-99b6-40f6-a34d-328531d1364e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:14.554168 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c4eff9b5-99b6-40f6-a34d-328531d1364e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1391 microversion: 2.1 time: 0.763175 Aug 25 13:50:14.565336 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2966/5885] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:13 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1391 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:14.643920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-05f0b90f-3728-4979-8c62-42efc6cb014a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:14.684526 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-05f0b90f-3728-4979-8c62-42efc6cb014a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1214 microversion: 2.1 time: 1.020473 Aug 25 13:50:14.686911 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2920/5886] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:13 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1214 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:14.914345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2a2342e8-f3af-4b36-81c1-1cb017487b61 req-4a71a1e1-2db2-4001-a6cb-e8fbca797480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81af0aa7-20be-4cc0-8b75-0ec57882a00b", "tag": "cf1e89ec-2450-4f20-a59b-10d887a06033"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:14.962128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a2342e8-f3af-4b36-81c1-1cb017487b61 req-4a71a1e1-2db2-4001-a6cb-e8fbca797480 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:14.963586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a2342e8-f3af-4b36-81c1-1cb017487b61 req-4a71a1e1-2db2-4001-a6cb-e8fbca797480 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:14.965280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2a2342e8-f3af-4b36-81c1-1cb017487b61 req-4a71a1e1-2db2-4001-a6cb-e8fbca797480 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:14.999747 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2a2342e8-f3af-4b36-81c1-1cb017487b61 req-4a71a1e1-2db2-4001-a6cb-e8fbca797480 service nova] Creating event network-changed:cf1e89ec-2450-4f20-a59b-10d887a06033 for instance 81af0aa7-20be-4cc0-8b75-0ec57882a00b on n-h1-852771-8 Aug 25 13:50:15.010161 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2a2342e8-f3af-4b36-81c1-1cb017487b61 req-4a71a1e1-2db2-4001-a6cb-e8fbca797480 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102607 Aug 25 13:50:15.012145 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2967/5887] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:15.610034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-56ace8be-5338-4d28-9e1d-3ba418ce4575 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:15.614663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-56ace8be-5338-4d28-9e1d-3ba418ce4575 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:15.641394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56ace8be-5338-4d28-9e1d-3ba418ce4575 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:15.642387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56ace8be-5338-4d28-9e1d-3ba418ce4575 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:15.643248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56ace8be-5338-4d28-9e1d-3ba418ce4575 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:15.655046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56ace8be-5338-4d28-9e1d-3ba418ce4575 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:15.656263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56ace8be-5338-4d28-9e1d-3ba418ce4575 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:15.657231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56ace8be-5338-4d28-9e1d-3ba418ce4575 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:15.718088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-963fad5b-4bf7-446f-ac7c-cb0cd4b72df1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:15.727249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-963fad5b-4bf7-446f-ac7c-cb0cd4b72df1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:15.757842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963fad5b-4bf7-446f-ac7c-cb0cd4b72df1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:15.758877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963fad5b-4bf7-446f-ac7c-cb0cd4b72df1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:15.760094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963fad5b-4bf7-446f-ac7c-cb0cd4b72df1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:15.760547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963fad5b-4bf7-446f-ac7c-cb0cd4b72df1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:15.761846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963fad5b-4bf7-446f-ac7c-cb0cd4b72df1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:15.762086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-963fad5b-4bf7-446f-ac7c-cb0cd4b72df1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:16.314817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-963fad5b-4bf7-446f-ac7c-cb0cd4b72df1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:16.341470 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-963fad5b-4bf7-446f-ac7c-cb0cd4b72df1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1214 microversion: 2.1 time: 0.630404 Aug 25 13:50:16.356465 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2968/5888] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:15 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1214 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:16.363224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-56ace8be-5338-4d28-9e1d-3ba418ce4575 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:16.390718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-857fd237-9b5f-45f9-96ff-e4e42ac39a20 req-8e93404d-7c57-4f49-a98a-373179a5366b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd83b4d4-e933-41fb-b596-ab891f7420a7", "name": "network-vif-plugged", "status": "completed", "tag": "7c61df38-9f17-4673-ab66-6bcfa817e247"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:16.396663 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-56ace8be-5338-4d28-9e1d-3ba418ce4575 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1391 microversion: 2.1 time: 0.794455 Aug 25 13:50:16.399654 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2921/5889] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:15 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1391 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:16.410394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-857fd237-9b5f-45f9-96ff-e4e42ac39a20 req-8e93404d-7c57-4f49-a98a-373179a5366b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:16.410911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-857fd237-9b5f-45f9-96ff-e4e42ac39a20 req-8e93404d-7c57-4f49-a98a-373179a5366b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:16.411448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-857fd237-9b5f-45f9-96ff-e4e42ac39a20 req-8e93404d-7c57-4f49-a98a-373179a5366b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:16.429201 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-857fd237-9b5f-45f9-96ff-e4e42ac39a20 req-8e93404d-7c57-4f49-a98a-373179a5366b service nova] Creating event network-vif-plugged:7c61df38-9f17-4673-ab66-6bcfa817e247 for instance fd83b4d4-e933-41fb-b596-ab891f7420a7 on n-h2-852771-8 Aug 25 13:50:16.438891 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-857fd237-9b5f-45f9-96ff-e4e42ac39a20 req-8e93404d-7c57-4f49-a98a-373179a5366b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078041 Aug 25 13:50:16.441408 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2969/5890] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:17.386578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b50b402f-629b-4b4a-8a60-4e65e4fdea37 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:17.388321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b50b402f-629b-4b4a-8a60-4e65e4fdea37 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:17.397462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50b402f-629b-4b4a-8a60-4e65e4fdea37 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:17.398487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50b402f-629b-4b4a-8a60-4e65e4fdea37 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:17.398965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50b402f-629b-4b4a-8a60-4e65e4fdea37 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:17.399729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50b402f-629b-4b4a-8a60-4e65e4fdea37 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:17.400212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50b402f-629b-4b4a-8a60-4e65e4fdea37 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:17.400655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50b402f-629b-4b4a-8a60-4e65e4fdea37 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:17.432500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a12b79a-bc80-4d22-8b65-5d4f4c58ded1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:17.440229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7a12b79a-bc80-4d22-8b65-5d4f4c58ded1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:17.449475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a12b79a-bc80-4d22-8b65-5d4f4c58ded1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:17.450407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a12b79a-bc80-4d22-8b65-5d4f4c58ded1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:17.451232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a12b79a-bc80-4d22-8b65-5d4f4c58ded1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:17.452331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a12b79a-bc80-4d22-8b65-5d4f4c58ded1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:17.453185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a12b79a-bc80-4d22-8b65-5d4f4c58ded1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:17.453951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a12b79a-bc80-4d22-8b65-5d4f4c58ded1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:17.722774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b50b402f-629b-4b4a-8a60-4e65e4fdea37 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:17.730078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7a12b79a-bc80-4d22-8b65-5d4f4c58ded1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:17.740039 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a12b79a-bc80-4d22-8b65-5d4f4c58ded1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1391 microversion: 2.1 time: 0.314928 Aug 25 13:50:17.741564 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2970/5891] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:17 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1391 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:17.751145 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b50b402f-629b-4b4a-8a60-4e65e4fdea37 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1214 microversion: 2.1 time: 0.369882 Aug 25 13:50:17.762223 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2922/5892] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:17 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1214 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:18.783560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a4424ebc-8eb3-4832-a0a1-d93b161ae14a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:18.784395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a4424ebc-8eb3-4832-a0a1-d93b161ae14a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:18.794261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7dcf792f-6d8f-4ed0-b0e0-b5a47db18d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:18.795834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4424ebc-8eb3-4832-a0a1-d93b161ae14a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:18.796865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4424ebc-8eb3-4832-a0a1-d93b161ae14a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:18.797040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7dcf792f-6d8f-4ed0-b0e0-b5a47db18d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:18.797749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4424ebc-8eb3-4832-a0a1-d93b161ae14a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:18.798876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4424ebc-8eb3-4832-a0a1-d93b161ae14a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:18.799742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4424ebc-8eb3-4832-a0a1-d93b161ae14a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:18.800376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a4424ebc-8eb3-4832-a0a1-d93b161ae14a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:18.807573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dcf792f-6d8f-4ed0-b0e0-b5a47db18d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:18.808777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dcf792f-6d8f-4ed0-b0e0-b5a47db18d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:18.809584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dcf792f-6d8f-4ed0-b0e0-b5a47db18d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:18.812500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dcf792f-6d8f-4ed0-b0e0-b5a47db18d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:18.813456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dcf792f-6d8f-4ed0-b0e0-b5a47db18d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:18.814272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7dcf792f-6d8f-4ed0-b0e0-b5a47db18d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:19.148781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a4424ebc-8eb3-4832-a0a1-d93b161ae14a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:19.174821 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a4424ebc-8eb3-4832-a0a1-d93b161ae14a tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1564 microversion: 2.1 time: 0.398921 Aug 25 13:50:19.181802 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2971/5893] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:18 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1564 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:19.194204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7dcf792f-6d8f-4ed0-b0e0-b5a47db18d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:19.203796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-adf3a990-5006-4678-b632-0a5f40944b38 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:19.204734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-adf3a990-5006-4678-b632-0a5f40944b38 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:19.209841 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7dcf792f-6d8f-4ed0-b0e0-b5a47db18d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1214 microversion: 2.1 time: 0.429227 Aug 25 13:50:19.210449 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2923/5894] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:18 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1214 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:50:19.212834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adf3a990-5006-4678-b632-0a5f40944b38 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:19.213584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adf3a990-5006-4678-b632-0a5f40944b38 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:19.214211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adf3a990-5006-4678-b632-0a5f40944b38 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:19.215110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adf3a990-5006-4678-b632-0a5f40944b38 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:19.215729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adf3a990-5006-4678-b632-0a5f40944b38 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:19.216323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adf3a990-5006-4678-b632-0a5f40944b38 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:19.433013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-adf3a990-5006-4678-b632-0a5f40944b38 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:19.443275 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-adf3a990-5006-4678-b632-0a5f40944b38 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1564 microversion: 2.1 time: 0.243686 Aug 25 13:50:19.455771 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2972/5895] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:19 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1564 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:50:20.244788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dbc2520d-ab24-44c0-a555-9a95a873fbd5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:20.245688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dbc2520d-ab24-44c0-a555-9a95a873fbd5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:20.250648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:20.260312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc2520d-ab24-44c0-a555-9a95a873fbd5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:20.261101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc2520d-ab24-44c0-a555-9a95a873fbd5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:20.262176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc2520d-ab24-44c0-a555-9a95a873fbd5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:20.265018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc2520d-ab24-44c0-a555-9a95a873fbd5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:20.266152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc2520d-ab24-44c0-a555-9a95a873fbd5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:20.266983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc2520d-ab24-44c0-a555-9a95a873fbd5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:20.614797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dbc2520d-ab24-44c0-a555-9a95a873fbd5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:20.625764 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dbc2520d-ab24-44c0-a555-9a95a873fbd5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1214 microversion: 2.1 time: 0.392831 Aug 25 13:50:20.626581 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2924/5896] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:20 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1214 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:21.647251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:21.647251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:21.651955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e63f80cd-1906-4296-874e-e6f557159bf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:21.653546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e63f80cd-1906-4296-874e-e6f557159bf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:21.662730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e63f80cd-1906-4296-874e-e6f557159bf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:21.663601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e63f80cd-1906-4296-874e-e6f557159bf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:21.664688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e63f80cd-1906-4296-874e-e6f557159bf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:21.666010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e63f80cd-1906-4296-874e-e6f557159bf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:21.666819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e63f80cd-1906-4296-874e-e6f557159bf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:21.668063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e63f80cd-1906-4296-874e-e6f557159bf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:21.675074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=70 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:21.964549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e63f80cd-1906-4296-874e-e6f557159bf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:21.978287 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e63f80cd-1906-4296-874e-e6f557159bf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.334606 Aug 25 13:50:21.978908 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2973/5897] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:21 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:22.315979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-3cbf18c9-d0d6-4ccd-a05b-858e2f05bc3c req-65bc5b9c-52fe-4808-ab02-9aed400ca7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd83b4d4-e933-41fb-b596-ab891f7420a7", "tag": "7c61df38-9f17-4673-ab66-6bcfa817e247"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:22.329739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3cbf18c9-d0d6-4ccd-a05b-858e2f05bc3c req-65bc5b9c-52fe-4808-ab02-9aed400ca7e9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:22.330493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3cbf18c9-d0d6-4ccd-a05b-858e2f05bc3c req-65bc5b9c-52fe-4808-ab02-9aed400ca7e9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:22.331144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3cbf18c9-d0d6-4ccd-a05b-858e2f05bc3c req-65bc5b9c-52fe-4808-ab02-9aed400ca7e9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:22.331323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8a22a8d-9c9a-49ed-9627-6d7847149627 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:22.332647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8a22a8d-9c9a-49ed-9627-6d7847149627 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:22.350757 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-3cbf18c9-d0d6-4ccd-a05b-858e2f05bc3c req-65bc5b9c-52fe-4808-ab02-9aed400ca7e9 service nova] Creating event network-changed:7c61df38-9f17-4673-ab66-6bcfa817e247 for instance fd83b4d4-e933-41fb-b596-ab891f7420a7 on n-h2-852771-8 Aug 25 13:50:22.362456 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-3cbf18c9-d0d6-4ccd-a05b-858e2f05bc3c req-65bc5b9c-52fe-4808-ab02-9aed400ca7e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050963 Aug 25 13:50:22.362709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8a22a8d-9c9a-49ed-9627-6d7847149627 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:22.363617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8a22a8d-9c9a-49ed-9627-6d7847149627 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:22.364412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8a22a8d-9c9a-49ed-9627-6d7847149627 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:22.365727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8a22a8d-9c9a-49ed-9627-6d7847149627 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:22.368837 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2974/5898] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:50:22.372824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8a22a8d-9c9a-49ed-9627-6d7847149627 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:22.374247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8a22a8d-9c9a-49ed-9627-6d7847149627 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:22.742240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b8a22a8d-9c9a-49ed-9627-6d7847149627 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:22.758564 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8a22a8d-9c9a-49ed-9627-6d7847149627 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1564 microversion: 2.1 time: 0.455387 Aug 25 13:50:22.763076 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2925/5899] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:22 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1564 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:23.011751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b928771b-f1cb-4f97-a112-52659d16bef1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:23.012521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b928771b-f1cb-4f97-a112-52659d16bef1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:23.026459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b928771b-f1cb-4f97-a112-52659d16bef1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:23.027576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b928771b-f1cb-4f97-a112-52659d16bef1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:23.028332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b928771b-f1cb-4f97-a112-52659d16bef1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:23.029581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b928771b-f1cb-4f97-a112-52659d16bef1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:23.031359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b928771b-f1cb-4f97-a112-52659d16bef1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:23.032532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b928771b-f1cb-4f97-a112-52659d16bef1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:23.462108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b928771b-f1cb-4f97-a112-52659d16bef1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:23.486033 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b928771b-f1cb-4f97-a112-52659d16bef1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.478121 Aug 25 13:50:23.488137 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2975/5900] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:23 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:50:24.331580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d003a63-dc15-4698-8ac3-968b8acc50ad tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Action: 'create', calling method: .version_select at 0x7f3a29f6eaf0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1041290338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7EsYFBUQwKp+lABo/hd0w/ZU0LhWVd247kGgRxtOXYKZZ7HGdVezAJr97spvr6jC73vwTtFdwDQgN9iKKevz0LP42BBG/FT9OMytvJ5T/PMp9+5fxp8ovLMnb2X1sOaw=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:24.362230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-8d003a63-dc15-4698-8ac3-968b8acc50ad tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:50:24.370573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-8d003a63-dc15-4698-8ac3-968b8acc50ad tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for user a882ff06dbb14328b6360ce89f4d75e5 and project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:50:24.415839 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d003a63-dc15-4698-8ac3-968b8acc50ad tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.089121 Aug 25 13:50:24.417264 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2926/5901] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:50:24 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:24.535678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8c21411b-4d5c-40f5-9a67-0c363ab992a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:24.539401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8c21411b-4d5c-40f5-9a67-0c363ab992a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:24.565547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c21411b-4d5c-40f5-9a67-0c363ab992a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:24.566354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c21411b-4d5c-40f5-9a67-0c363ab992a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:24.570413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c21411b-4d5c-40f5-9a67-0c363ab992a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:24.572755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c21411b-4d5c-40f5-9a67-0c363ab992a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:24.574105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c21411b-4d5c-40f5-9a67-0c363ab992a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:24.576001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c21411b-4d5c-40f5-9a67-0c363ab992a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:24.895821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8c21411b-4d5c-40f5-9a67-0c363ab992a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:24.918795 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8c21411b-4d5c-40f5-9a67-0c363ab992a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.405158 Aug 25 13:50:24.922570 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2976/5902] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:24 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:25.946742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d7884f7b-ee0e-4187-8587-2ea62f913aaa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:25.948170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d7884f7b-ee0e-4187-8587-2ea62f913aaa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:25.957768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7884f7b-ee0e-4187-8587-2ea62f913aaa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:25.958544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7884f7b-ee0e-4187-8587-2ea62f913aaa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:25.959214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7884f7b-ee0e-4187-8587-2ea62f913aaa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:25.960821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7884f7b-ee0e-4187-8587-2ea62f913aaa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:25.961536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7884f7b-ee0e-4187-8587-2ea62f913aaa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:25.962243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7884f7b-ee0e-4187-8587-2ea62f913aaa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:26.240857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d7884f7b-ee0e-4187-8587-2ea62f913aaa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:26.252926 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d7884f7b-ee0e-4187-8587-2ea62f913aaa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.312817 Aug 25 13:50:26.261871 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2927/5903] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:25 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:26.483951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-847954841", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "9c881e44-3235-4abb-a6e3-e2ac9343d5f9"}], "key_name": "tempest-TestNetworkBasicOps-1041290338", "security_groups": [{"name": "tempest-secgroup-smoke-455416866"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:26.718590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] validate_networks() for [('9c881e44-3235-4abb-a6e3-e2ac9343d5f9', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:50:27.283941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-08f2b182-ba6e-4a36-b7f8-ab72074a1f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:27.284846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-08f2b182-ba6e-4a36-b7f8-ab72074a1f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:27.309833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f2b182-ba6e-4a36-b7f8-ab72074a1f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:27.309833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f2b182-ba6e-4a36-b7f8-ab72074a1f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:27.310184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f2b182-ba6e-4a36-b7f8-ab72074a1f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:27.311509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f2b182-ba6e-4a36-b7f8-ab72074a1f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:27.312001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f2b182-ba6e-4a36-b7f8-ab72074a1f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:27.312479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-08f2b182-ba6e-4a36-b7f8-ab72074a1f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:27.334669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=92 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:27.628893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-08f2b182-ba6e-4a36-b7f8-ab72074a1f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:27.643243 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-08f2b182-ba6e-4a36-b7f8-ab72074a1f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.369960 Aug 25 13:50:27.644200 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2928/5904] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:27 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:27.834878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:50:27.835345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:50:27.836215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:50:27.836825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:50:27.837295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:50:27.852709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:27.854388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:27.855443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:27.856988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:27.858093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:27.859051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:27.897479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:50:27.909677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for user a882ff06dbb14328b6360ce89f4d75e5 and project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:50:27.932002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:50:27.934425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:50:28.006472 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cbf51c60-875f-4a02-8e9a-edbe8a3e5770 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.526951 Aug 25 13:50:28.008028 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2977/5905] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:50:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:50:28.030466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f60ae358-7279-4fd3-a1dd-2ba2b76f8c2a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:28.032170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f60ae358-7279-4fd3-a1dd-2ba2b76f8c2a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:28.117602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f60ae358-7279-4fd3-a1dd-2ba2b76f8c2a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:28.128304 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f60ae358-7279-4fd3-a1dd-2ba2b76f8c2a tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1248 microversion: 2.1 time: 0.106466 Aug 25 13:50:28.129721 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2929/5906] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:28 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1248 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:28.683201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc2a72e7-5ea9-4faf-9689-d7b77266b523 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:28.684751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc2a72e7-5ea9-4faf-9689-d7b77266b523 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:28.697166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc2a72e7-5ea9-4faf-9689-d7b77266b523 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:28.697706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc2a72e7-5ea9-4faf-9689-d7b77266b523 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:28.698153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc2a72e7-5ea9-4faf-9689-d7b77266b523 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:28.699055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc2a72e7-5ea9-4faf-9689-d7b77266b523 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:28.699518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc2a72e7-5ea9-4faf-9689-d7b77266b523 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:28.699950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc2a72e7-5ea9-4faf-9689-d7b77266b523 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:28.934104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc2a72e7-5ea9-4faf-9689-d7b77266b523 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:28.945761 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc2a72e7-5ea9-4faf-9689-d7b77266b523 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.267852 Aug 25 13:50:28.947161 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2978/5907] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:28 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:29.168908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d7f93102-3490-4c97-b50c-d3839afd1e8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:29.169697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d7f93102-3490-4c97-b50c-d3839afd1e8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:29.181137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7f93102-3490-4c97-b50c-d3839afd1e8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:29.181995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7f93102-3490-4c97-b50c-d3839afd1e8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:29.182800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7f93102-3490-4c97-b50c-d3839afd1e8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:29.183898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7f93102-3490-4c97-b50c-d3839afd1e8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:29.184638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7f93102-3490-4c97-b50c-d3839afd1e8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:29.185455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d7f93102-3490-4c97-b50c-d3839afd1e8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:29.278669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d7f93102-3490-4c97-b50c-d3839afd1e8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:29.292881 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d7f93102-3490-4c97-b50c-d3839afd1e8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1300 microversion: 2.1 time: 0.127533 Aug 25 13:50:29.294014 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2930/5908] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:29 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1300 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:50:29.985742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-33c82dc8-20e8-4057-989a-f435298190d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:29.986371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-33c82dc8-20e8-4057-989a-f435298190d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:29.997101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33c82dc8-20e8-4057-989a-f435298190d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:29.998174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33c82dc8-20e8-4057-989a-f435298190d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:30.013763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33c82dc8-20e8-4057-989a-f435298190d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:30.015577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33c82dc8-20e8-4057-989a-f435298190d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:30.016241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33c82dc8-20e8-4057-989a-f435298190d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:30.016915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33c82dc8-20e8-4057-989a-f435298190d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:30.192031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-33c82dc8-20e8-4057-989a-f435298190d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:30.201979 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-33c82dc8-20e8-4057-989a-f435298190d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.220450 Aug 25 13:50:30.215589 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2979/5909] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:29 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:30.331618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-98dd192c-d3df-45a3-b92f-a4a643f2930e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:30.332259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-98dd192c-d3df-45a3-b92f-a4a643f2930e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:30.340048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98dd192c-d3df-45a3-b92f-a4a643f2930e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:30.340574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98dd192c-d3df-45a3-b92f-a4a643f2930e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:30.341132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98dd192c-d3df-45a3-b92f-a4a643f2930e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:30.342661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98dd192c-d3df-45a3-b92f-a4a643f2930e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:30.343384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98dd192c-d3df-45a3-b92f-a4a643f2930e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:30.344101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98dd192c-d3df-45a3-b92f-a4a643f2930e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:30.430205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-98dd192c-d3df-45a3-b92f-a4a643f2930e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:30.445599 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-98dd192c-d3df-45a3-b92f-a4a643f2930e tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1306 microversion: 2.1 time: 0.118750 Aug 25 13:50:30.446209 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2931/5910] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:30 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1306 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:31.226716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0374e130-2dd9-4e1f-8f6d-aa5edbbc646d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:31.229469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0374e130-2dd9-4e1f-8f6d-aa5edbbc646d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:31.242160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0374e130-2dd9-4e1f-8f6d-aa5edbbc646d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:31.243422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0374e130-2dd9-4e1f-8f6d-aa5edbbc646d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:31.244405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0374e130-2dd9-4e1f-8f6d-aa5edbbc646d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:31.248026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0374e130-2dd9-4e1f-8f6d-aa5edbbc646d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:31.249428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0374e130-2dd9-4e1f-8f6d-aa5edbbc646d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:31.250513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0374e130-2dd9-4e1f-8f6d-aa5edbbc646d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:31.469905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b3d69d45-9927-43e0-bb00-f7b47cb84cd8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:31.470704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b3d69d45-9927-43e0-bb00-f7b47cb84cd8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:31.475926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0374e130-2dd9-4e1f-8f6d-aa5edbbc646d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:31.478113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3d69d45-9927-43e0-bb00-f7b47cb84cd8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:31.478984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3d69d45-9927-43e0-bb00-f7b47cb84cd8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:31.479656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3d69d45-9927-43e0-bb00-f7b47cb84cd8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:31.480582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3d69d45-9927-43e0-bb00-f7b47cb84cd8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:31.481216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3d69d45-9927-43e0-bb00-f7b47cb84cd8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:31.481837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3d69d45-9927-43e0-bb00-f7b47cb84cd8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:31.494907 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0374e130-2dd9-4e1f-8f6d-aa5edbbc646d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.274492 Aug 25 13:50:31.495648 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2980/5911] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:31 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:31.578762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-40b9c960-c567-44cd-81ea-87fd26f23306 req-eb5e614f-b3fc-4f76-ae21-ea99c734eef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "160b1165-7614-49f6-90dc-b439a6f9d7d0", "tag": "b08f165d-0a17-4a1b-987c-c1f918f70fff"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:31.602418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-40b9c960-c567-44cd-81ea-87fd26f23306 req-eb5e614f-b3fc-4f76-ae21-ea99c734eef0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:31.603505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-40b9c960-c567-44cd-81ea-87fd26f23306 req-eb5e614f-b3fc-4f76-ae21-ea99c734eef0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:31.604380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-40b9c960-c567-44cd-81ea-87fd26f23306 req-eb5e614f-b3fc-4f76-ae21-ea99c734eef0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:31.656899 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-40b9c960-c567-44cd-81ea-87fd26f23306 req-eb5e614f-b3fc-4f76-ae21-ea99c734eef0 service nova] Creating event network-changed:b08f165d-0a17-4a1b-987c-c1f918f70fff for instance 160b1165-7614-49f6-90dc-b439a6f9d7d0 on n-h1-852771-8 Aug 25 13:50:31.665434 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-40b9c960-c567-44cd-81ea-87fd26f23306 req-eb5e614f-b3fc-4f76-ae21-ea99c734eef0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092138 Aug 25 13:50:31.667186 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2981/5912] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:31.738211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b3d69d45-9927-43e0-bb00-f7b47cb84cd8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:31.750923 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b3d69d45-9927-43e0-bb00-f7b47cb84cd8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1373 microversion: 2.1 time: 0.285281 Aug 25 13:50:31.751551 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2932/5913] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:31 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1373 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:32.527761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-82cf924c-6d67-4674-9944-87a1ae4099fd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:32.530581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-82cf924c-6d67-4674-9944-87a1ae4099fd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:32.550596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82cf924c-6d67-4674-9944-87a1ae4099fd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:32.551486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82cf924c-6d67-4674-9944-87a1ae4099fd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:32.552245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82cf924c-6d67-4674-9944-87a1ae4099fd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:32.553813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82cf924c-6d67-4674-9944-87a1ae4099fd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:32.554874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82cf924c-6d67-4674-9944-87a1ae4099fd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:32.555909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82cf924c-6d67-4674-9944-87a1ae4099fd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:32.708674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3c5e4e9e-e27f-4651-9156-d4779258df2e req-605a7b9a-f34f-4eba-947f-2c80a7030cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81af0aa7-20be-4cc0-8b75-0ec57882a00b", "name": "network-vif-plugged", "status": "completed", "tag": "cf1e89ec-2450-4f20-a59b-10d887a06033"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:32.734257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3c5e4e9e-e27f-4651-9156-d4779258df2e req-605a7b9a-f34f-4eba-947f-2c80a7030cfc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:32.735471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3c5e4e9e-e27f-4651-9156-d4779258df2e req-605a7b9a-f34f-4eba-947f-2c80a7030cfc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:32.736468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3c5e4e9e-e27f-4651-9156-d4779258df2e req-605a7b9a-f34f-4eba-947f-2c80a7030cfc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:32.759246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-82cf924c-6d67-4674-9944-87a1ae4099fd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:32.760760 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3c5e4e9e-e27f-4651-9156-d4779258df2e req-605a7b9a-f34f-4eba-947f-2c80a7030cfc service nova] Creating event network-vif-plugged:cf1e89ec-2450-4f20-a59b-10d887a06033 for instance 81af0aa7-20be-4cc0-8b75-0ec57882a00b on n-h1-852771-8 Aug 25 13:50:32.769472 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3c5e4e9e-e27f-4651-9156-d4779258df2e req-605a7b9a-f34f-4eba-947f-2c80a7030cfc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072444 Aug 25 13:50:32.770265 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-82cf924c-6d67-4674-9944-87a1ae4099fd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.254761 Aug 25 13:50:32.771374 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2982/5914] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:32 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:32.772504 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2933/5915] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:32.791950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bc45a412-1331-4302-8255-fb120939e042 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:32.793876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bc45a412-1331-4302-8255-fb120939e042 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:32.802308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc45a412-1331-4302-8255-fb120939e042 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:32.803120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc45a412-1331-4302-8255-fb120939e042 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:32.803643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc45a412-1331-4302-8255-fb120939e042 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:32.804484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc45a412-1331-4302-8255-fb120939e042 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:32.805703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc45a412-1331-4302-8255-fb120939e042 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:32.806172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc45a412-1331-4302-8255-fb120939e042 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:32.995112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bc45a412-1331-4302-8255-fb120939e042 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:33.004502 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bc45a412-1331-4302-8255-fb120939e042 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1373 microversion: 2.1 time: 0.217981 Aug 25 13:50:33.005137 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2983/5916] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:32 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1373 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:33.800194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f878545-d0ce-48b1-bc4d-24ebd1a40853 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:33.801006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f878545-d0ce-48b1-bc4d-24ebd1a40853 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:33.807854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f878545-d0ce-48b1-bc4d-24ebd1a40853 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:33.808435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f878545-d0ce-48b1-bc4d-24ebd1a40853 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:33.808954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f878545-d0ce-48b1-bc4d-24ebd1a40853 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:33.809771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f878545-d0ce-48b1-bc4d-24ebd1a40853 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:33.810324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f878545-d0ce-48b1-bc4d-24ebd1a40853 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:33.811481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f878545-d0ce-48b1-bc4d-24ebd1a40853 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:33.960362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f878545-d0ce-48b1-bc4d-24ebd1a40853 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:33.971686 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f878545-d0ce-48b1-bc4d-24ebd1a40853 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.177324 Aug 25 13:50:33.972437 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2934/5917] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:33 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:34.039387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4912265f-3ed8-4f0f-b64c-f3d7a83d64d8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:34.040257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4912265f-3ed8-4f0f-b64c-f3d7a83d64d8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:34.060666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4912265f-3ed8-4f0f-b64c-f3d7a83d64d8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:34.061212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4912265f-3ed8-4f0f-b64c-f3d7a83d64d8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:34.062015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4912265f-3ed8-4f0f-b64c-f3d7a83d64d8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:34.062947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4912265f-3ed8-4f0f-b64c-f3d7a83d64d8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:34.063410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4912265f-3ed8-4f0f-b64c-f3d7a83d64d8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:34.063854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4912265f-3ed8-4f0f-b64c-f3d7a83d64d8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:34.252266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4912265f-3ed8-4f0f-b64c-f3d7a83d64d8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:34.263537 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4912265f-3ed8-4f0f-b64c-f3d7a83d64d8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1373 microversion: 2.1 time: 0.239326 Aug 25 13:50:34.264626 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2984/5918] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:34 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1373 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:34.994521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-92c1925a-b60f-4996-a698-77e0cb0dd24b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:34.995564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-92c1925a-b60f-4996-a698-77e0cb0dd24b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:34.998723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:35.005103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c1925a-b60f-4996-a698-77e0cb0dd24b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:35.005856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c1925a-b60f-4996-a698-77e0cb0dd24b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:35.006305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c1925a-b60f-4996-a698-77e0cb0dd24b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:35.007021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c1925a-b60f-4996-a698-77e0cb0dd24b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:35.009209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c1925a-b60f-4996-a698-77e0cb0dd24b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:35.009996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92c1925a-b60f-4996-a698-77e0cb0dd24b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:35.188573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-92c1925a-b60f-4996-a698-77e0cb0dd24b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:35.198678 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-92c1925a-b60f-4996-a698-77e0cb0dd24b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1202 microversion: 2.1 time: 0.209158 Aug 25 13:50:35.199567 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2935/5919] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:34 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1202 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:35.291767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b199538e-e01a-4db2-82fb-39cbb74bc818 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:35.293328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b199538e-e01a-4db2-82fb-39cbb74bc818 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:35.303947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b199538e-e01a-4db2-82fb-39cbb74bc818 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:35.304922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b199538e-e01a-4db2-82fb-39cbb74bc818 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:35.305913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b199538e-e01a-4db2-82fb-39cbb74bc818 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:35.307518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b199538e-e01a-4db2-82fb-39cbb74bc818 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:35.308556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b199538e-e01a-4db2-82fb-39cbb74bc818 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:35.310324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b199538e-e01a-4db2-82fb-39cbb74bc818 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:35.518192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b199538e-e01a-4db2-82fb-39cbb74bc818 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:35.531766 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b199538e-e01a-4db2-82fb-39cbb74bc818 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1373 microversion: 2.1 time: 0.249048 Aug 25 13:50:35.532529 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2985/5920] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:35 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1373 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:36.224224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-930401da-855b-48f6-900e-87bf1411b174 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:36.224856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-930401da-855b-48f6-900e-87bf1411b174 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:36.233338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930401da-855b-48f6-900e-87bf1411b174 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:36.234444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930401da-855b-48f6-900e-87bf1411b174 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:36.234939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930401da-855b-48f6-900e-87bf1411b174 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:36.235871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930401da-855b-48f6-900e-87bf1411b174 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:36.236518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930401da-855b-48f6-900e-87bf1411b174 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:36.237167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-930401da-855b-48f6-900e-87bf1411b174 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:36.411875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-930401da-855b-48f6-900e-87bf1411b174 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:36.423092 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-930401da-855b-48f6-900e-87bf1411b174 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1389 microversion: 2.1 time: 0.202961 Aug 25 13:50:36.429620 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2936/5921] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:36 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1389 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:36.447006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e016681-5bcf-4157-bd65-6eb82e5d04a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:36.447795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4e016681-5bcf-4157-bd65-6eb82e5d04a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:36.451028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:36.459506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e016681-5bcf-4157-bd65-6eb82e5d04a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:36.459862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e016681-5bcf-4157-bd65-6eb82e5d04a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:36.465849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e016681-5bcf-4157-bd65-6eb82e5d04a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:36.466665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e016681-5bcf-4157-bd65-6eb82e5d04a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:36.468083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e016681-5bcf-4157-bd65-6eb82e5d04a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:36.468929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4e016681-5bcf-4157-bd65-6eb82e5d04a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:36.554367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8074a8b2-56c0-418c-a87f-525ed8fb19e6 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:36.555172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8074a8b2-56c0-418c-a87f-525ed8fb19e6 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:36.563153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8074a8b2-56c0-418c-a87f-525ed8fb19e6 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:36.563688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8074a8b2-56c0-418c-a87f-525ed8fb19e6 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:36.564769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8074a8b2-56c0-418c-a87f-525ed8fb19e6 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:36.565910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8074a8b2-56c0-418c-a87f-525ed8fb19e6 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:36.566542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8074a8b2-56c0-418c-a87f-525ed8fb19e6 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:36.567276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8074a8b2-56c0-418c-a87f-525ed8fb19e6 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:36.801962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e016681-5bcf-4157-bd65-6eb82e5d04a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:36.812994 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e016681-5bcf-4157-bd65-6eb82e5d04a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1389 microversion: 2.1 time: 0.370807 Aug 25 13:50:36.814369 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2986/5922] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:36 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1389 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:36.835527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-338c80fe-bb56-461f-a0e6-60d9ef4745ee tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:36.836174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-338c80fe-bb56-461f-a0e6-60d9ef4745ee tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:36.848528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-338c80fe-bb56-461f-a0e6-60d9ef4745ee tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:36.850277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-338c80fe-bb56-461f-a0e6-60d9ef4745ee tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:36.850940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-338c80fe-bb56-461f-a0e6-60d9ef4745ee tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:36.852258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-338c80fe-bb56-461f-a0e6-60d9ef4745ee tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:36.852957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-338c80fe-bb56-461f-a0e6-60d9ef4745ee tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:36.853635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-338c80fe-bb56-461f-a0e6-60d9ef4745ee tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:36.909086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8074a8b2-56c0-418c-a87f-525ed8fb19e6 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:36.941033 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8074a8b2-56c0-418c-a87f-525ed8fb19e6 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1373 microversion: 2.1 time: 0.391044 Aug 25 13:50:36.955829 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2937/5923] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:36 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1373 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:50:37.065565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-338c80fe-bb56-461f-a0e6-60d9ef4745ee tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:37.075975 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-338c80fe-bb56-461f-a0e6-60d9ef4745ee tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1389 microversion: 2.1 time: 0.244526 Aug 25 13:50:37.077605 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2987/5924] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:36 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1389 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:50:37.098799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d90c27cd-68e2-444c-af8c-d2c9812e8e1c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:37.099469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d90c27cd-68e2-444c-af8c-d2c9812e8e1c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:37.118396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d90c27cd-68e2-444c-af8c-d2c9812e8e1c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:37.118814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d90c27cd-68e2-444c-af8c-d2c9812e8e1c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:37.119269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d90c27cd-68e2-444c-af8c-d2c9812e8e1c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:37.121992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d90c27cd-68e2-444c-af8c-d2c9812e8e1c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:37.122873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d90c27cd-68e2-444c-af8c-d2c9812e8e1c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:37.124913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d90c27cd-68e2-444c-af8c-d2c9812e8e1c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:37.166868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d90c27cd-68e2-444c-af8c-d2c9812e8e1c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:50:37.319001 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d90c27cd-68e2-444c-af8c-d2c9812e8e1c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 204 len: 0 microversion: 2.1 time: 0.223947 Aug 25 13:50:37.321004 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2938/5925] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:50:37 2022] DELETE /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:50:37.332719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-14281218-e6ba-4864-8c18-b1007dcb7f55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:37.333495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-14281218-e6ba-4864-8c18-b1007dcb7f55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:37.341282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14281218-e6ba-4864-8c18-b1007dcb7f55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:37.342563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14281218-e6ba-4864-8c18-b1007dcb7f55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:37.343483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14281218-e6ba-4864-8c18-b1007dcb7f55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:37.344415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14281218-e6ba-4864-8c18-b1007dcb7f55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:37.345203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14281218-e6ba-4864-8c18-b1007dcb7f55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:37.345973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-14281218-e6ba-4864-8c18-b1007dcb7f55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:37.535491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-14281218-e6ba-4864-8c18-b1007dcb7f55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:37.551931 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-14281218-e6ba-4864-8c18-b1007dcb7f55 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1395 microversion: 2.1 time: 0.224663 Aug 25 13:50:37.553045 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2988/5926] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:37 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1395 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:37.966610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-58d968a7-ecf1-4b78-acde-4543e0da7d31 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:37.967566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-58d968a7-ecf1-4b78-acde-4543e0da7d31 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:37.974394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58d968a7-ecf1-4b78-acde-4543e0da7d31 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:37.974898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58d968a7-ecf1-4b78-acde-4543e0da7d31 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:37.975350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58d968a7-ecf1-4b78-acde-4543e0da7d31 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:37.976072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58d968a7-ecf1-4b78-acde-4543e0da7d31 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:37.976553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58d968a7-ecf1-4b78-acde-4543e0da7d31 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:37.976963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58d968a7-ecf1-4b78-acde-4543e0da7d31 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:38.125239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:38.163095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-58d968a7-ecf1-4b78-acde-4543e0da7d31 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:38.175022 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-58d968a7-ecf1-4b78-acde-4543e0da7d31 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1373 microversion: 2.1 time: 0.212439 Aug 25 13:50:38.175792 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2939/5927] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:37 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1373 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:38.470594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e3aa9a78-43cd-4624-b743-abf945fbd181 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:38.471094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e3aa9a78-43cd-4624-b743-abf945fbd181 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:38.473025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:38.473717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:38.481148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3aa9a78-43cd-4624-b743-abf945fbd181 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:38.481669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3aa9a78-43cd-4624-b743-abf945fbd181 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:38.482109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3aa9a78-43cd-4624-b743-abf945fbd181 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:38.483814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3aa9a78-43cd-4624-b743-abf945fbd181 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:38.484623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3aa9a78-43cd-4624-b743-abf945fbd181 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:38.485456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3aa9a78-43cd-4624-b743-abf945fbd181 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:38.582897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77616da1-93d2-462a-ab1f-dd2df13af3dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:38.585176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-77616da1-93d2-462a-ab1f-dd2df13af3dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:38.603103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77616da1-93d2-462a-ab1f-dd2df13af3dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:38.604442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77616da1-93d2-462a-ab1f-dd2df13af3dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:38.606778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77616da1-93d2-462a-ab1f-dd2df13af3dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:38.610016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77616da1-93d2-462a-ab1f-dd2df13af3dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:38.611157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77616da1-93d2-462a-ab1f-dd2df13af3dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:38.612332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77616da1-93d2-462a-ab1f-dd2df13af3dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:38.619673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-e3aa9a78-43cd-4624-b743-abf945fbd181 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lazy-loading 'services' on Instance uuid 64792e48-f365-4939-b754-3ace50ef700a {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:50:38.741415 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e3aa9a78-43cd-4624-b743-abf945fbd181 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a/os-volume_attachments/04bf4774-ca67-4751-90ca-0d332f1b3712" status: 202 len: 0 microversion: 2.1 time: 0.275984 Aug 25 13:50:38.742945 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2989/5928] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:50:38 2022] DELETE /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a/os-volume_attachments/04bf4774-ca67-4751-90ca-0d332f1b3712 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:50:38.751232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-96bd1a6e-fb7b-4f1a-a7e0-f9e0aeb2a26a req-77492c39-bd00-4a1c-a726-0ed863c73a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160b1165-7614-49f6-90dc-b439a6f9d7d0", "name": "network-vif-plugged", "status": "completed", "tag": "b08f165d-0a17-4a1b-987c-c1f918f70fff"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:38.766673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-96bd1a6e-fb7b-4f1a-a7e0-f9e0aeb2a26a req-77492c39-bd00-4a1c-a726-0ed863c73a38 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:38.767885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-96bd1a6e-fb7b-4f1a-a7e0-f9e0aeb2a26a req-77492c39-bd00-4a1c-a726-0ed863c73a38 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:38.768569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-96bd1a6e-fb7b-4f1a-a7e0-f9e0aeb2a26a req-77492c39-bd00-4a1c-a726-0ed863c73a38 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:38.788460 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-96bd1a6e-fb7b-4f1a-a7e0-f9e0aeb2a26a req-77492c39-bd00-4a1c-a726-0ed863c73a38 service nova] Creating event network-vif-plugged:b08f165d-0a17-4a1b-987c-c1f918f70fff for instance 160b1165-7614-49f6-90dc-b439a6f9d7d0 on n-h1-852771-8 Aug 25 13:50:38.798721 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-96bd1a6e-fb7b-4f1a-a7e0-f9e0aeb2a26a req-77492c39-bd00-4a1c-a726-0ed863c73a38 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052658 Aug 25 13:50:38.801141 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2990/5929] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:38.822428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-77616da1-93d2-462a-ab1f-dd2df13af3dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:38.836169 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-77616da1-93d2-462a-ab1f-dd2df13af3dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1395 microversion: 2.1 time: 0.261846 Aug 25 13:50:38.836438 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2940/5930] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:38 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1395 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:50:39.200793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c268e0f8-bf6b-4dbb-b656-9a15797176ef tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:39.202771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c268e0f8-bf6b-4dbb-b656-9a15797176ef tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:39.211015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c268e0f8-bf6b-4dbb-b656-9a15797176ef tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:39.211815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c268e0f8-bf6b-4dbb-b656-9a15797176ef tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:39.212334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c268e0f8-bf6b-4dbb-b656-9a15797176ef tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:39.213163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c268e0f8-bf6b-4dbb-b656-9a15797176ef tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:39.213914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c268e0f8-bf6b-4dbb-b656-9a15797176ef tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:39.214651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c268e0f8-bf6b-4dbb-b656-9a15797176ef tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:39.554081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c268e0f8-bf6b-4dbb-b656-9a15797176ef tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:39.556920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:39.567652 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c268e0f8-bf6b-4dbb-b656-9a15797176ef tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1373 microversion: 2.1 time: 0.371415 Aug 25 13:50:39.568420 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2991/5931] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:39 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1373 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:39.851196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f5e1ebd5-398b-49f9-a456-dee57ebda6ac req-ae44c2df-edd8-4f7f-b081-cc6b67ca798c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81af0aa7-20be-4cc0-8b75-0ec57882a00b", "name": "network-vif-deleted", "tag": "cf1e89ec-2450-4f20-a59b-10d887a06033"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:39.864213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f5e1ebd5-398b-49f9-a456-dee57ebda6ac req-ae44c2df-edd8-4f7f-b081-cc6b67ca798c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:39.865013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f5e1ebd5-398b-49f9-a456-dee57ebda6ac req-ae44c2df-edd8-4f7f-b081-cc6b67ca798c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:39.867618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f5e1ebd5-398b-49f9-a456-dee57ebda6ac req-ae44c2df-edd8-4f7f-b081-cc6b67ca798c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:39.873577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-16c5b349-a4b3-4266-9906-f2658e294e6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:39.874584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-16c5b349-a4b3-4266-9906-f2658e294e6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:39.895647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16c5b349-a4b3-4266-9906-f2658e294e6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:39.896486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16c5b349-a4b3-4266-9906-f2658e294e6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:39.898232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16c5b349-a4b3-4266-9906-f2658e294e6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:39.902667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16c5b349-a4b3-4266-9906-f2658e294e6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:39.903570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16c5b349-a4b3-4266-9906-f2658e294e6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:39.904524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16c5b349-a4b3-4266-9906-f2658e294e6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:39.909438 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f5e1ebd5-398b-49f9-a456-dee57ebda6ac req-ae44c2df-edd8-4f7f-b081-cc6b67ca798c service nova] Creating event network-vif-deleted:cf1e89ec-2450-4f20-a59b-10d887a06033 for instance 81af0aa7-20be-4cc0-8b75-0ec57882a00b on n-h1-852771-8 Aug 25 13:50:39.932442 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f5e1ebd5-398b-49f9-a456-dee57ebda6ac req-ae44c2df-edd8-4f7f-b081-cc6b67ca798c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085657 Aug 25 13:50:39.935393 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2941/5932] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:40.020507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-16c5b349-a4b3-4266-9906-f2658e294e6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:40.034168 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-16c5b349-a4b3-4266-9906-f2658e294e6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1353 microversion: 2.1 time: 0.164726 Aug 25 13:50:40.048571 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2992/5933] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:39 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1353 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:40.603167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e4d6bd02-1f2e-4199-9e3f-3130e0da0d58 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:40.603816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e4d6bd02-1f2e-4199-9e3f-3130e0da0d58 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:40.611922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4d6bd02-1f2e-4199-9e3f-3130e0da0d58 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:40.612617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4d6bd02-1f2e-4199-9e3f-3130e0da0d58 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:40.613070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4d6bd02-1f2e-4199-9e3f-3130e0da0d58 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:40.613816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4d6bd02-1f2e-4199-9e3f-3130e0da0d58 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:40.614277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4d6bd02-1f2e-4199-9e3f-3130e0da0d58 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:40.614738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4d6bd02-1f2e-4199-9e3f-3130e0da0d58 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:40.811949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e4d6bd02-1f2e-4199-9e3f-3130e0da0d58 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:40.821797 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e4d6bd02-1f2e-4199-9e3f-3130e0da0d58 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1546 microversion: 2.1 time: 0.224050 Aug 25 13:50:40.822516 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2942/5934] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:40 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1546 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:40.863413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4f65a48e-0f27-427e-8140-a668abe1439d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:40.864387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4f65a48e-0f27-427e-8140-a668abe1439d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:40.878461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f65a48e-0f27-427e-8140-a668abe1439d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:40.879495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f65a48e-0f27-427e-8140-a668abe1439d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:40.880385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f65a48e-0f27-427e-8140-a668abe1439d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:40.881830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f65a48e-0f27-427e-8140-a668abe1439d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:40.882790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f65a48e-0f27-427e-8140-a668abe1439d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:40.883689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f65a48e-0f27-427e-8140-a668abe1439d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:41.072048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3d106744-6566-45c8-9b97-2a04eacc1e3d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:41.074213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3d106744-6566-45c8-9b97-2a04eacc1e3d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:41.083253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d106744-6566-45c8-9b97-2a04eacc1e3d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:41.083746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d106744-6566-45c8-9b97-2a04eacc1e3d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:41.084380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d106744-6566-45c8-9b97-2a04eacc1e3d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:41.085101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d106744-6566-45c8-9b97-2a04eacc1e3d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:41.085605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d106744-6566-45c8-9b97-2a04eacc1e3d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:41.086031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d106744-6566-45c8-9b97-2a04eacc1e3d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:41.162481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4f65a48e-0f27-427e-8140-a668abe1439d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:41.174739 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4f65a48e-0f27-427e-8140-a668abe1439d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1546 microversion: 2.1 time: 0.319475 Aug 25 13:50:41.176420 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2993/5935] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:40 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1546 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:41.187283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3d106744-6566-45c8-9b97-2a04eacc1e3d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:41.200331 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3d106744-6566-45c8-9b97-2a04eacc1e3d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1187 microversion: 2.1 time: 0.132839 Aug 25 13:50:41.201071 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2943/5936] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:41 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:50:42.228413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df4ad65a-6028-46f8-b5e4-77f34c8aa431 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:42.229175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-df4ad65a-6028-46f8-b5e4-77f34c8aa431 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:42.238957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df4ad65a-6028-46f8-b5e4-77f34c8aa431 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:42.239563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df4ad65a-6028-46f8-b5e4-77f34c8aa431 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:42.240087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df4ad65a-6028-46f8-b5e4-77f34c8aa431 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:42.240929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df4ad65a-6028-46f8-b5e4-77f34c8aa431 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:42.241522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df4ad65a-6028-46f8-b5e4-77f34c8aa431 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:42.242238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df4ad65a-6028-46f8-b5e4-77f34c8aa431 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:42.337837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df4ad65a-6028-46f8-b5e4-77f34c8aa431 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:42.354094 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-df4ad65a-6028-46f8-b5e4-77f34c8aa431 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1187 microversion: 2.1 time: 0.129695 Aug 25 13:50:42.355134 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2994/5937] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:42 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1187 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:43.380410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a1588d03-b981-4420-b799-39068965a427 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:43.381761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a1588d03-b981-4420-b799-39068965a427 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:43.390295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1588d03-b981-4420-b799-39068965a427 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:43.390798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1588d03-b981-4420-b799-39068965a427 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:43.391461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1588d03-b981-4420-b799-39068965a427 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:43.392454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1588d03-b981-4420-b799-39068965a427 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:43.393089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1588d03-b981-4420-b799-39068965a427 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:43.393573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1588d03-b981-4420-b799-39068965a427 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:43.479081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1588d03-b981-4420-b799-39068965a427 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:43.492870 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a1588d03-b981-4420-b799-39068965a427 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1187 microversion: 2.1 time: 0.115573 Aug 25 13:50:43.493529 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2944/5938] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:43 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1187 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:44.519960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7fce5c70-284f-49d0-b26b-24e083253300 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:44.522516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7fce5c70-284f-49d0-b26b-24e083253300 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:44.543342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fce5c70-284f-49d0-b26b-24e083253300 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:44.550222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fce5c70-284f-49d0-b26b-24e083253300 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:44.550925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fce5c70-284f-49d0-b26b-24e083253300 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:44.555321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fce5c70-284f-49d0-b26b-24e083253300 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:44.556093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fce5c70-284f-49d0-b26b-24e083253300 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:44.558698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fce5c70-284f-49d0-b26b-24e083253300 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:44.624104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-acbd7d5b-f4fc-4a2f-9b18-4f488e9fcab7 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:44.625665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-acbd7d5b-f4fc-4a2f-9b18-4f488e9fcab7 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:44.663142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbd7d5b-f4fc-4a2f-9b18-4f488e9fcab7 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:44.664244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbd7d5b-f4fc-4a2f-9b18-4f488e9fcab7 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:44.667405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbd7d5b-f4fc-4a2f-9b18-4f488e9fcab7 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:44.668824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbd7d5b-f4fc-4a2f-9b18-4f488e9fcab7 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:44.669734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbd7d5b-f4fc-4a2f-9b18-4f488e9fcab7 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:44.675412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-acbd7d5b-f4fc-4a2f-9b18-4f488e9fcab7 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:44.741777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:44.777849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7fce5c70-284f-49d0-b26b-24e083253300 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:44.783163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-acbd7d5b-f4fc-4a2f-9b18-4f488e9fcab7 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:50:44.809795 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7fce5c70-284f-49d0-b26b-24e083253300 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1187 microversion: 2.1 time: 0.294474 Aug 25 13:50:44.822133 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2995/5939] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:44 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1187 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:44.940980 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-acbd7d5b-f4fc-4a2f-9b18-4f488e9fcab7 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 204 len: 0 microversion: 2.1 time: 0.320513 Aug 25 13:50:44.946876 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2945/5940] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:50:44 2022] DELETE /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:50:44.957740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-16f35ec0-fb7c-49c2-b217-e679755671f2 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:44.959100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-16f35ec0-fb7c-49c2-b217-e679755671f2 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:44.970581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16f35ec0-fb7c-49c2-b217-e679755671f2 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:44.971793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16f35ec0-fb7c-49c2-b217-e679755671f2 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:44.972757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16f35ec0-fb7c-49c2-b217-e679755671f2 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:44.974237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16f35ec0-fb7c-49c2-b217-e679755671f2 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:44.975254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16f35ec0-fb7c-49c2-b217-e679755671f2 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:44.976201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16f35ec0-fb7c-49c2-b217-e679755671f2 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:45.221750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-16f35ec0-fb7c-49c2-b217-e679755671f2 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:45.233299 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-16f35ec0-fb7c-49c2-b217-e679755671f2 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1469 microversion: 2.1 time: 0.283238 Aug 25 13:50:45.234348 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2996/5941] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:44 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1469 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:45.849833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-241e3ea4-d05c-4294-b7ff-508ec703bd86 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:45.850619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-241e3ea4-d05c-4294-b7ff-508ec703bd86 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:45.858647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-241e3ea4-d05c-4294-b7ff-508ec703bd86 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:45.859135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-241e3ea4-d05c-4294-b7ff-508ec703bd86 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:45.859765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-241e3ea4-d05c-4294-b7ff-508ec703bd86 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:45.860670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-241e3ea4-d05c-4294-b7ff-508ec703bd86 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:45.861301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-241e3ea4-d05c-4294-b7ff-508ec703bd86 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:45.861916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-241e3ea4-d05c-4294-b7ff-508ec703bd86 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:45.935837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-241e3ea4-d05c-4294-b7ff-508ec703bd86 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:45.945686 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-241e3ea4-d05c-4294-b7ff-508ec703bd86 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1187 microversion: 2.1 time: 0.099829 Aug 25 13:50:45.946886 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2946/5942] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:45 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:46.271429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e48d8598-23cc-4319-9d54-1afd48e77f9b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:46.272163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e48d8598-23cc-4319-9d54-1afd48e77f9b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:46.281530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48d8598-23cc-4319-9d54-1afd48e77f9b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:46.282047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48d8598-23cc-4319-9d54-1afd48e77f9b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:46.282492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48d8598-23cc-4319-9d54-1afd48e77f9b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:46.283225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48d8598-23cc-4319-9d54-1afd48e77f9b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:46.283816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48d8598-23cc-4319-9d54-1afd48e77f9b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:46.284248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e48d8598-23cc-4319-9d54-1afd48e77f9b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:46.554254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e48d8598-23cc-4319-9d54-1afd48e77f9b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:46.569655 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e48d8598-23cc-4319-9d54-1afd48e77f9b tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1469 microversion: 2.1 time: 0.302194 Aug 25 13:50:46.570263 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2997/5943] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:46 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:46.969930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9dcc7aee-4ad1-4d02-85c5-73e4a08acf23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:46.971775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9dcc7aee-4ad1-4d02-85c5-73e4a08acf23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:46.981557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dcc7aee-4ad1-4d02-85c5-73e4a08acf23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:46.984593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dcc7aee-4ad1-4d02-85c5-73e4a08acf23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:46.988723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dcc7aee-4ad1-4d02-85c5-73e4a08acf23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:46.988723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dcc7aee-4ad1-4d02-85c5-73e4a08acf23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:46.990298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dcc7aee-4ad1-4d02-85c5-73e4a08acf23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:46.995384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dcc7aee-4ad1-4d02-85c5-73e4a08acf23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:47.138370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9dcc7aee-4ad1-4d02-85c5-73e4a08acf23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:47.148766 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9dcc7aee-4ad1-4d02-85c5-73e4a08acf23 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1187 microversion: 2.1 time: 0.183120 Aug 25 13:50:47.150471 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2947/5944] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:46 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1187 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:50:47.462524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1f16ff7e-09e4-46a3-bde5-5c41e2b1f62e req-e785288e-7b7c-4542-ad67-43395d127812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64792e48-f365-4939-b754-3ace50ef700a", "name": "network-vif-deleted", "tag": "f5a1d6e4-afb8-41d5-b5e5-017aa542e9bc"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:47.475237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1f16ff7e-09e4-46a3-bde5-5c41e2b1f62e req-e785288e-7b7c-4542-ad67-43395d127812 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:47.475833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1f16ff7e-09e4-46a3-bde5-5c41e2b1f62e req-e785288e-7b7c-4542-ad67-43395d127812 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:47.476350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1f16ff7e-09e4-46a3-bde5-5c41e2b1f62e req-e785288e-7b7c-4542-ad67-43395d127812 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:47.490599 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1f16ff7e-09e4-46a3-bde5-5c41e2b1f62e req-e785288e-7b7c-4542-ad67-43395d127812 service nova] Creating event network-vif-deleted:f5a1d6e4-afb8-41d5-b5e5-017aa542e9bc for instance 64792e48-f365-4939-b754-3ace50ef700a on n-h2-852771-8 Aug 25 13:50:47.497207 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1f16ff7e-09e4-46a3-bde5-5c41e2b1f62e req-e785288e-7b7c-4542-ad67-43395d127812 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038257 Aug 25 13:50:47.499551 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2998/5945] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:47.598451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:47.599225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:47.610349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:47.611281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:47.611990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:47.613211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:47.614027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:47.614699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:47.692019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:47.692615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:47.693068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:47.693557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lazy-loading 'fault' on Instance uuid 64792e48-f365-4939-b754-3ace50ef700a {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:50:47.765433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1054e88dbd439186eccd7e026aa3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24e7caa6f5145a9952deef32a6c48ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:47.791488 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c6e29fb0-046c-4e2a-abd9-89a0d2940e09 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 200 len: 1303 microversion: 2.1 time: 0.196668 Aug 25 13:50:47.793792 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2948/5946] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:47 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 1303 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:48.187201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b8fd023d-5fa1-4f04-a655-ba7792e8c936 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:48.193294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b8fd023d-5fa1-4f04-a655-ba7792e8c936 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:48.227790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fd023d-5fa1-4f04-a655-ba7792e8c936 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:48.231180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fd023d-5fa1-4f04-a655-ba7792e8c936 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:48.233133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fd023d-5fa1-4f04-a655-ba7792e8c936 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:48.234785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fd023d-5fa1-4f04-a655-ba7792e8c936 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:48.235953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fd023d-5fa1-4f04-a655-ba7792e8c936 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:48.238114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fd023d-5fa1-4f04-a655-ba7792e8c936 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:48.353770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b8fd023d-5fa1-4f04-a655-ba7792e8c936 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:48.369384 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b8fd023d-5fa1-4f04-a655-ba7792e8c936 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1187 microversion: 2.1 time: 0.190124 Aug 25 13:50:48.371194 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 2999/5947] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:48 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1187 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:48.820298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:48.821622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] [instance: 64792e48-f365-4939-b754-3ace50ef700a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:48.832546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:48.833270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:48.834019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:48.835130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:48.835805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:48.836476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:48.859088 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] HTTP exception thrown: Instance 64792e48-f365-4939-b754-3ace50ef700a could not be found. Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Request method failure captured: Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a HTTP/1.1 Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB327DC74ASqkE4m8jP5E91pobipg_D0u_78OSRTGhRM2l07-JldCv3pLX9_FwHuuUts6AMoPp8KSpCE79aozrLBORQNiTh-05nZbWqLSC23MLSCXV54hLub9cf5dyT_whdIHrvNnx5RNvgxMLovAqHzdLj9feEHbUBocadE6yNmzDGA Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: b24e7caa6f5145a9952deef32a6c48ad Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-VolumesBackupsTest-1688235137 Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b24e7caa6f5145a9952deef32a6c48ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b24e7caa6f5145a9952deef32a6c48ad", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b24e7caa6f5145a9952deef32a6c48ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b24e7caa6f5145a9952deef32a6c48ad"}]}] Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-VolumesBackupsTest-1688235137 Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: b24e7caa6f5145a9952deef32a6c48ad Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-VolumesBackupsTest-1688235137 Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-VolumesBackupsTest-1688235137-project Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3b1054e88dbd439186eccd7e026aa3d2 Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-VolumesBackupsTest-1688235137-project Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 64792e48-f365-4939-b754-3ace50ef700a could not be found. Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '64792e48-f365-4939-b754-3ace50ef700a'} Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64792e48-f365-4939-b754-3ace50ef700a could not be found. Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64792e48-f365-4939-b754-3ace50ef700a could not be found. Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:50:48.860735 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:50:48.870315 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:50:48.870315 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:50:48.870315 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:50:48.870315 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:50:48.870315 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:50:48.870315 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64792e48-f365-4939-b754-3ace50ef700a could not be found. Aug 25 13:50:48.870315 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:50:48.870315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] Returning 404 to user: Instance 64792e48-f365-4939-b754-3ace50ef700a could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:50:48.870315 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-04f3f959-750a-4b8b-8953-5f32b9e87763 tempest-VolumesBackupsTest-1688235137 tempest-VolumesBackupsTest-1688235137-project] 10.222.0.70 "GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a" status: 404 len: 111 microversion: 2.1 time: 0.048539 Aug 25 13:50:48.870315 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2949/5948] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:48 2022] GET /compute/v2.1/servers/64792e48-f365-4939-b754-3ace50ef700a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:50:49.400232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-30cf3c9f-2dde-47bf-afeb-af4c0596dee0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:49.401476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-30cf3c9f-2dde-47bf-afeb-af4c0596dee0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:49.409963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30cf3c9f-2dde-47bf-afeb-af4c0596dee0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:49.410478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30cf3c9f-2dde-47bf-afeb-af4c0596dee0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:49.410884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30cf3c9f-2dde-47bf-afeb-af4c0596dee0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:49.411593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30cf3c9f-2dde-47bf-afeb-af4c0596dee0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:49.412049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30cf3c9f-2dde-47bf-afeb-af4c0596dee0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:49.412515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-30cf3c9f-2dde-47bf-afeb-af4c0596dee0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:49.514287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-30cf3c9f-2dde-47bf-afeb-af4c0596dee0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:49.528959 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-30cf3c9f-2dde-47bf-afeb-af4c0596dee0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 200 len: 1187 microversion: 2.1 time: 0.132851 Aug 25 13:50:49.530903 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3000/5949] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:49 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 1187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:50.554028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:50.555557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 81af0aa7-20be-4cc0-8b75-0ec57882a00b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:50.563568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:50.565193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:50.565665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:50.566386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:50.567004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:50.568262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:50.587610 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 81af0aa7-20be-4cc0-8b75-0ec57882a00b could not be found. Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b HTTP/1.1 Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 81af0aa7-20be-4cc0-8b75-0ec57882a00b could not be found. Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '81af0aa7-20be-4cc0-8b75-0ec57882a00b'} Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81af0aa7-20be-4cc0-8b75-0ec57882a00b could not be found. Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81af0aa7-20be-4cc0-8b75-0ec57882a00b could not be found. Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:50:50.589152 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:50:50.594158 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:50:50.594158 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:50:50.594158 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:50:50.594158 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:50:50.594158 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:50:50.594158 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81af0aa7-20be-4cc0-8b75-0ec57882a00b could not be found. Aug 25 13:50:50.594158 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:50:50.594158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 81af0aa7-20be-4cc0-8b75-0ec57882a00b could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:50:50.594158 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-18c5c415-4ab0-4242-8625-92f535edca03 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b" status: 404 len: 111 microversion: 2.1 time: 0.042844 Aug 25 13:50:50.594158 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2950/5950] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:50 2022] GET /compute/v2.1/servers/81af0aa7-20be-4cc0-8b75-0ec57882a00b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:50:55.407719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c2ccbba2-236f-4e36-8b68-39c0d744a608 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:55.410035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c2ccbba2-236f-4e36-8b68-39c0d744a608 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:55.417245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2ccbba2-236f-4e36-8b68-39c0d744a608 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:55.418082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2ccbba2-236f-4e36-8b68-39c0d744a608 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:55.418536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2ccbba2-236f-4e36-8b68-39c0d744a608 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:55.419276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2ccbba2-236f-4e36-8b68-39c0d744a608 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:55.419774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2ccbba2-236f-4e36-8b68-39c0d744a608 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:55.420795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2ccbba2-236f-4e36-8b68-39c0d744a608 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:55.488798 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c2ccbba2-236f-4e36-8b68-39c0d744a608 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7/action" status: 200 len: 24569 microversion: 2.1 time: 0.084048 Aug 25 13:50:55.492323 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3001/5951] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:50:55 2022] POST /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7/action => generated 24569 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:51:19.097427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cdcc6fbd-9d1a-4490-bd83-45ae7d5e7e5f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:19.102084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cdcc6fbd-9d1a-4490-bd83-45ae7d5e7e5f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:19.109430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:19.111259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:19.113646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cdcc6fbd-9d1a-4490-bd83-45ae7d5e7e5f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:19.114681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cdcc6fbd-9d1a-4490-bd83-45ae7d5e7e5f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:19.115029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cdcc6fbd-9d1a-4490-bd83-45ae7d5e7e5f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:19.115761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cdcc6fbd-9d1a-4490-bd83-45ae7d5e7e5f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:19.116225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cdcc6fbd-9d1a-4490-bd83-45ae7d5e7e5f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:19.116662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cdcc6fbd-9d1a-4490-bd83-45ae7d5e7e5f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:19.156702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cdcc6fbd-9d1a-4490-bd83-45ae7d5e7e5f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:51:19.277856 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cdcc6fbd-9d1a-4490-bd83-45ae7d5e7e5f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "DELETE /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 204 len: 0 microversion: 2.1 time: 0.183377 Aug 25 13:51:19.280194 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2951/5952] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:51:19 2022] DELETE /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:51:19.291517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c659e59f-37ac-4870-97d8-b95ede45e1a7 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:19.292419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c659e59f-37ac-4870-97d8-b95ede45e1a7 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:19.300962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=31 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:19.301718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=55 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:19.304216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c659e59f-37ac-4870-97d8-b95ede45e1a7 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:19.304971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c659e59f-37ac-4870-97d8-b95ede45e1a7 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:19.305619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c659e59f-37ac-4870-97d8-b95ede45e1a7 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:19.306695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c659e59f-37ac-4870-97d8-b95ede45e1a7 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:19.307492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c659e59f-37ac-4870-97d8-b95ede45e1a7 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:19.308091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c659e59f-37ac-4870-97d8-b95ede45e1a7 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:19.505042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c659e59f-37ac-4870-97d8-b95ede45e1a7 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:19.513709 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c659e59f-37ac-4870-97d8-b95ede45e1a7 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1552 microversion: 2.1 time: 0.228403 Aug 25 13:51:19.514501 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3002/5953] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:19 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1552 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:19.634977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1041391335", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e869234c-5b9f-4d8c-9750-dff78c0d291e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f9216295-ead7-4063-84e8-342351244740"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:19.749755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] validate_networks() for [('f9216295-ead7-4063-84e8-342351244740', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:51:20.221727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:51:20.222344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:51:20.222728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:51:20.223146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:51:20.223820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:51:20.234463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:20.234961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:20.235410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:20.236152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:20.236619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:20.237086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:20.256481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:51:20.262505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for user 93fbad0b63d14f3fb12de08d966bffad and project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:51:20.278682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:51:20.281007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e869234c-5b9f-4d8c-9750-dff78c0d291e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:51:20.360523 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df7ba493-e376-47a3-b450-34d1c3f018cd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729622 Aug 25 13:51:20.367626 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2952/5954] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:51:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:51:20.373847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f9f47b12-dcf1-484d-aa6f-19f57f452280 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:20.374525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f9f47b12-dcf1-484d-aa6f-19f57f452280 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:20.451929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f9f47b12-dcf1-484d-aa6f-19f57f452280 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:20.461146 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f9f47b12-dcf1-484d-aa6f-19f57f452280 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1057 microversion: 2.1 time: 0.092052 Aug 25 13:51:20.461819 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3003/5955] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:20 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1057 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:20.541665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f3354a5d-555c-46ec-ab87-2ca86ef6df94 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:20.542931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f3354a5d-555c-46ec-ab87-2ca86ef6df94 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:20.554846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3354a5d-555c-46ec-ab87-2ca86ef6df94 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:20.556309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3354a5d-555c-46ec-ab87-2ca86ef6df94 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:20.557346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3354a5d-555c-46ec-ab87-2ca86ef6df94 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:20.558312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3354a5d-555c-46ec-ab87-2ca86ef6df94 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:20.560052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3354a5d-555c-46ec-ab87-2ca86ef6df94 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:20.560820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3354a5d-555c-46ec-ab87-2ca86ef6df94 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:20.774499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3354a5d-555c-46ec-ab87-2ca86ef6df94 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:20.795907 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f3354a5d-555c-46ec-ab87-2ca86ef6df94 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1552 microversion: 2.1 time: 0.261808 Aug 25 13:51:20.809788 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2953/5956] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:20 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1552 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:21.397275 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8976bd35-871d-4f06-830f-ff01b5f93c9e req-70a6cf6e-5368-4483-8449-8e5aaafa2326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160b1165-7614-49f6-90dc-b439a6f9d7d0", "name": "network-vif-deleted", "tag": "b08f165d-0a17-4a1b-987c-c1f918f70fff"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:21.408582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8976bd35-871d-4f06-830f-ff01b5f93c9e req-70a6cf6e-5368-4483-8449-8e5aaafa2326 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:21.409080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8976bd35-871d-4f06-830f-ff01b5f93c9e req-70a6cf6e-5368-4483-8449-8e5aaafa2326 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:21.409535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8976bd35-871d-4f06-830f-ff01b5f93c9e req-70a6cf6e-5368-4483-8449-8e5aaafa2326 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:21.424425 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8976bd35-871d-4f06-830f-ff01b5f93c9e req-70a6cf6e-5368-4483-8449-8e5aaafa2326 service nova] Creating event network-vif-deleted:b08f165d-0a17-4a1b-987c-c1f918f70fff for instance 160b1165-7614-49f6-90dc-b439a6f9d7d0 on n-h1-852771-8 Aug 25 13:51:21.430072 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8976bd35-871d-4f06-830f-ff01b5f93c9e req-70a6cf6e-5368-4483-8449-8e5aaafa2326 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036454 Aug 25 13:51:21.430745 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3004/5957] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:51:21.485179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-270e68a9-25ea-45bb-acc1-c2129a8c4b7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:21.486944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-270e68a9-25ea-45bb-acc1-c2129a8c4b7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:21.495558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270e68a9-25ea-45bb-acc1-c2129a8c4b7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:21.496609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270e68a9-25ea-45bb-acc1-c2129a8c4b7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:21.497445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270e68a9-25ea-45bb-acc1-c2129a8c4b7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:21.498445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270e68a9-25ea-45bb-acc1-c2129a8c4b7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:21.499114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270e68a9-25ea-45bb-acc1-c2129a8c4b7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:21.499765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-270e68a9-25ea-45bb-acc1-c2129a8c4b7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:21.619062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-270e68a9-25ea-45bb-acc1-c2129a8c4b7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:21.630760 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-270e68a9-25ea-45bb-acc1-c2129a8c4b7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1117 microversion: 2.1 time: 0.150774 Aug 25 13:51:21.642395 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2954/5958] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:21 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1117 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:21.832472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:21.832472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:21.849372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:21.849976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:21.850616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:21.857792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:21.859193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:21.859826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:21.953945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:21.956030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:21.956489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:21.958145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lazy-loading 'fault' on Instance uuid 160b1165-7614-49f6-90dc-b439a6f9d7d0 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:51:22.325832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:22.343515 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d75cd958-e88d-423f-b5cc-807506852f92 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 200 len: 1338 microversion: 2.1 time: 0.525829 Aug 25 13:51:22.345476 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3005/5959] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:21 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 1338 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:22.661855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-85d49311-ebfb-4764-801c-fa9b76c1624e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:22.666826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-85d49311-ebfb-4764-801c-fa9b76c1624e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:22.679613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85d49311-ebfb-4764-801c-fa9b76c1624e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:22.680409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85d49311-ebfb-4764-801c-fa9b76c1624e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:22.681103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85d49311-ebfb-4764-801c-fa9b76c1624e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:22.682132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85d49311-ebfb-4764-801c-fa9b76c1624e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:22.682801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85d49311-ebfb-4764-801c-fa9b76c1624e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:22.683405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-85d49311-ebfb-4764-801c-fa9b76c1624e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:22.807938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-85d49311-ebfb-4764-801c-fa9b76c1624e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:22.836000 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-85d49311-ebfb-4764-801c-fa9b76c1624e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1127 microversion: 2.1 time: 0.179760 Aug 25 13:51:22.842253 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2955/5960] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:22 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1127 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:23.368936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:23.369682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 160b1165-7614-49f6-90dc-b439a6f9d7d0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:23.381340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:23.382150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:23.382793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:23.383518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:23.383971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:23.384585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:23.400159 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] HTTP exception thrown: Instance 160b1165-7614-49f6-90dc-b439a6f9d7d0 could not be found. Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Request method failure captured: Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 HTTP/1.1 Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB32vdaQ_S9icGAjYyPhLFfzCiYxIPTIIkJYOFl9u4OdkP4hfZ-pfsBl6HZG2TelsqdqZL6sfytQqgJTb6O4hD7ntUuSQpwOIs3D_4FB0sR7oU2EiKRMLaksk6bJ3ZHFVz3qRNAMYQk-hBhSL_TZceK0Tk2Z6NDFvRcIJC1gkegfC_1A Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 11aa34f5f9654a08adbb90ebca9c6d4d Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestNetworkBasicOps-921108427 Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/11aa34f5f9654a08adbb90ebca9c6d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_11aa34f5f9654a08adbb90ebca9c6d4d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/11aa34f5f9654a08adbb90ebca9c6d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/11aa34f5f9654a08adbb90ebca9c6d4d"}]}] Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestNetworkBasicOps-921108427 Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 11aa34f5f9654a08adbb90ebca9c6d4d Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestNetworkBasicOps-921108427 Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestNetworkBasicOps-921108427-project Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a882ff06dbb14328b6360ce89f4d75e5 Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestNetworkBasicOps-921108427-project Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 160b1165-7614-49f6-90dc-b439a6f9d7d0 could not be found. Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '160b1165-7614-49f6-90dc-b439a6f9d7d0'} Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 160b1165-7614-49f6-90dc-b439a6f9d7d0 could not be found. Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 160b1165-7614-49f6-90dc-b439a6f9d7d0 could not be found. Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:51:23.401889 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:51:23.406844 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:23.406844 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:51:23.406844 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:51:23.406844 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:51:23.406844 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:51:23.406844 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 160b1165-7614-49f6-90dc-b439a6f9d7d0 could not be found. Aug 25 13:51:23.406844 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:51:23.406844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Returning 404 to user: Instance 160b1165-7614-49f6-90dc-b439a6f9d7d0 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:51:23.406844 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-262a286a-850b-45ff-9016-f05a7a65410f tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0" status: 404 len: 111 microversion: 2.1 time: 0.039661 Aug 25 13:51:23.406844 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3006/5961] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:23 2022] GET /compute/v2.1/servers/160b1165-7614-49f6-90dc-b439a6f9d7d0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:51:23.613313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f0eaa2ac-364e-4589-9dc3-216b38e98f6d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '.version_select at 0x7f3a2a9c3700>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:23.657363 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f0eaa2ac-364e-4589-9dc3-216b38e98f6d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1041290338" status: 202 len: 0 microversion: 2.1 time: 0.048635 Aug 25 13:51:23.660985 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2956/5962] 10.222.0.70 () {58 vars in 1257 bytes} [Thu Aug 25 13:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1041290338 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:51:23.862121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec11d23e-7b77-4704-9ab0-df56dbc9e3e0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:23.862705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec11d23e-7b77-4704-9ab0-df56dbc9e3e0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:23.896403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-47910c27-6d16-43a9-b0e3-99a1b5f593f8 req-e1cdc51c-320a-400a-b927-d21d89e880cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96553438-fc7f-470d-a424-1b7ac2d1ace5", "tag": "b635fd88-a49f-4e2d-baca-2a7fc2dc8f01"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:23.935255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec11d23e-7b77-4704-9ab0-df56dbc9e3e0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:23.935768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec11d23e-7b77-4704-9ab0-df56dbc9e3e0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:23.936217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec11d23e-7b77-4704-9ab0-df56dbc9e3e0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:23.936954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec11d23e-7b77-4704-9ab0-df56dbc9e3e0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:23.937418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec11d23e-7b77-4704-9ab0-df56dbc9e3e0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:23.937888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec11d23e-7b77-4704-9ab0-df56dbc9e3e0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:23.966754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-47910c27-6d16-43a9-b0e3-99a1b5f593f8 req-e1cdc51c-320a-400a-b927-d21d89e880cd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:23.967265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-47910c27-6d16-43a9-b0e3-99a1b5f593f8 req-e1cdc51c-320a-400a-b927-d21d89e880cd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:23.967726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-47910c27-6d16-43a9-b0e3-99a1b5f593f8 req-e1cdc51c-320a-400a-b927-d21d89e880cd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:24.025332 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-47910c27-6d16-43a9-b0e3-99a1b5f593f8 req-e1cdc51c-320a-400a-b927-d21d89e880cd service nova] Creating event network-changed:b635fd88-a49f-4e2d-baca-2a7fc2dc8f01 for instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 on n-h2-852771-8 Aug 25 13:51:24.038530 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-47910c27-6d16-43a9-b0e3-99a1b5f593f8 req-e1cdc51c-320a-400a-b927-d21d89e880cd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168053 Aug 25 13:51:24.045859 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2957/5963] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:51:24.362187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec11d23e-7b77-4704-9ab0-df56dbc9e3e0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:24.390162 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ec11d23e-7b77-4704-9ab0-df56dbc9e3e0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.533155 Aug 25 13:51:24.392739 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3007/5964] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:23 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:25.413220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-888f2397-d07b-4fb1-ad13-506d19a1d198 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:25.413944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-888f2397-d07b-4fb1-ad13-506d19a1d198 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:25.422199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-888f2397-d07b-4fb1-ad13-506d19a1d198 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:25.422694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-888f2397-d07b-4fb1-ad13-506d19a1d198 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:25.424214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-888f2397-d07b-4fb1-ad13-506d19a1d198 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:25.424956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-888f2397-d07b-4fb1-ad13-506d19a1d198 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:25.425406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-888f2397-d07b-4fb1-ad13-506d19a1d198 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:25.425869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-888f2397-d07b-4fb1-ad13-506d19a1d198 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:25.784418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-888f2397-d07b-4fb1-ad13-506d19a1d198 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:25.807752 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-888f2397-d07b-4fb1-ad13-506d19a1d198 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.396603 Aug 25 13:51:25.810430 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2958/5965] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:25 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:25.949482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e526c59-5596-45f7-87fb-f57eb735e8c4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:25.952457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e526c59-5596-45f7-87fb-f57eb735e8c4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:25.968928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e526c59-5596-45f7-87fb-f57eb735e8c4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:25.970516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e526c59-5596-45f7-87fb-f57eb735e8c4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:25.971885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e526c59-5596-45f7-87fb-f57eb735e8c4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:25.974696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e526c59-5596-45f7-87fb-f57eb735e8c4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:25.977199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e526c59-5596-45f7-87fb-f57eb735e8c4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:25.978354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e526c59-5596-45f7-87fb-f57eb735e8c4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:26.296193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e526c59-5596-45f7-87fb-f57eb735e8c4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:26.336391 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e526c59-5596-45f7-87fb-f57eb735e8c4 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1683 microversion: 2.1 time: 0.410222 Aug 25 13:51:26.337599 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3008/5966] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:25 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1683 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:26.485835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d218dc5f-be2b-46d4-8b80-068bbb52e3ca tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:26.489237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d218dc5f-be2b-46d4-8b80-068bbb52e3ca tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:26.498054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d218dc5f-be2b-46d4-8b80-068bbb52e3ca tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:26.498558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d218dc5f-be2b-46d4-8b80-068bbb52e3ca tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:26.499009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d218dc5f-be2b-46d4-8b80-068bbb52e3ca tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:26.499729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d218dc5f-be2b-46d4-8b80-068bbb52e3ca tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:26.500196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d218dc5f-be2b-46d4-8b80-068bbb52e3ca tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:26.500635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d218dc5f-be2b-46d4-8b80-068bbb52e3ca tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:26.583446 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d218dc5f-be2b-46d4-8b80-068bbb52e3ca tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7/action" status: 200 len: 32642 microversion: 2.1 time: 0.103582 Aug 25 13:51:26.591588 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2959/5967] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:51:26 2022] POST /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7/action => generated 32642 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:51:26.797396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d706878-178d-4176-a1f1-580c28e841c3 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:26.797939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4d706878-178d-4176-a1f1-580c28e841c3 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:26.810385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d706878-178d-4176-a1f1-580c28e841c3 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:26.810736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d706878-178d-4176-a1f1-580c28e841c3 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:26.811103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d706878-178d-4176-a1f1-580c28e841c3 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:26.811849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d706878-178d-4176-a1f1-580c28e841c3 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:26.812331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d706878-178d-4176-a1f1-580c28e841c3 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:26.812770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d706878-178d-4176-a1f1-580c28e841c3 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:26.850802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-630c7dba-332a-43f3-a7b1-36327a2f24cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:26.853066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-630c7dba-332a-43f3-a7b1-36327a2f24cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:26.881345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-630c7dba-332a-43f3-a7b1-36327a2f24cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:26.883363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-630c7dba-332a-43f3-a7b1-36327a2f24cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:26.885982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-630c7dba-332a-43f3-a7b1-36327a2f24cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:26.889728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-630c7dba-332a-43f3-a7b1-36327a2f24cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:26.891447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-630c7dba-332a-43f3-a7b1-36327a2f24cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:26.892408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-630c7dba-332a-43f3-a7b1-36327a2f24cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:27.190446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-630c7dba-332a-43f3-a7b1-36327a2f24cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:27.211358 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d706878-178d-4176-a1f1-580c28e841c3 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1834 microversion: 2.1 time: 0.418564 Aug 25 13:51:27.212168 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-630c7dba-332a-43f3-a7b1-36327a2f24cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.381446 Aug 25 13:51:27.212319 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3009/5968] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:26 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1834 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:27.231772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e44f2bec-229e-49ca-9919-fad84004ecaf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:27.231772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e44f2bec-229e-49ca-9919-fad84004ecaf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:27.238082 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2960/5969] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:26 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:27.243777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e44f2bec-229e-49ca-9919-fad84004ecaf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:27.244672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e44f2bec-229e-49ca-9919-fad84004ecaf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:27.248200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e44f2bec-229e-49ca-9919-fad84004ecaf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:27.257996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e44f2bec-229e-49ca-9919-fad84004ecaf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:27.258850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e44f2bec-229e-49ca-9919-fad84004ecaf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:27.259514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e44f2bec-229e-49ca-9919-fad84004ecaf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:27.269961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1ba051c6-cd85-4e6e-b8b0-78c2a5834cc5 req-d285b502-8b37-4fe4-a5e6-05e0f6615ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae1ab300-4ab6-498d-b183-61c03e329808", "tag": "b5cac3bc-a2dd-4e04-8b81-5921be3543f9"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:27.289860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1ba051c6-cd85-4e6e-b8b0-78c2a5834cc5 req-d285b502-8b37-4fe4-a5e6-05e0f6615ea3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:27.291107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1ba051c6-cd85-4e6e-b8b0-78c2a5834cc5 req-d285b502-8b37-4fe4-a5e6-05e0f6615ea3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:27.291952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1ba051c6-cd85-4e6e-b8b0-78c2a5834cc5 req-d285b502-8b37-4fe4-a5e6-05e0f6615ea3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:27.297643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e44f2bec-229e-49ca-9919-fad84004ecaf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:51:27.323735 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1ba051c6-cd85-4e6e-b8b0-78c2a5834cc5 req-d285b502-8b37-4fe4-a5e6-05e0f6615ea3 service nova] Creating event network-changed:b5cac3bc-a2dd-4e04-8b81-5921be3543f9 for instance ae1ab300-4ab6-498d-b183-61c03e329808 on n-h1-852771-8 Aug 25 13:51:27.330200 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1ba051c6-cd85-4e6e-b8b0-78c2a5834cc5 req-d285b502-8b37-4fe4-a5e6-05e0f6615ea3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091685 Aug 25 13:51:27.331000 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2961/5970] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:51:27.338028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:27.342555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:27.352897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:27.354080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:27.358213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:27.359303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:27.360038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:27.360661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:27.408648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lazy-loading 'flavor' on Instance uuid fd83b4d4-e933-41fb-b596-ab891f7420a7 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:51:27.448917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Going to try to live migrate instance to another host {{(pid=129059) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 13:51:27.573445 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e44f2bec-229e-49ca-9919-fad84004ecaf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 204 len: 0 microversion: 2.1 time: 0.360188 Aug 25 13:51:27.574381 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3010/5971] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:51:27 2022] DELETE /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:51:27.592438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5158eea3-74dd-410e-af5e-e8362e5809c1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:27.593144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5158eea3-74dd-410e-af5e-e8362e5809c1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:27.623922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5158eea3-74dd-410e-af5e-e8362e5809c1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:27.625226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5158eea3-74dd-410e-af5e-e8362e5809c1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:27.625693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5158eea3-74dd-410e-af5e-e8362e5809c1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:27.634583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5158eea3-74dd-410e-af5e-e8362e5809c1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:27.647031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5158eea3-74dd-410e-af5e-e8362e5809c1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:27.647498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5158eea3-74dd-410e-af5e-e8362e5809c1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:28.131631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5158eea3-74dd-410e-af5e-e8362e5809c1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:28.145620 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5158eea3-74dd-410e-af5e-e8362e5809c1 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1668 microversion: 2.1 time: 0.561354 Aug 25 13:51:28.147028 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3011/5972] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:27 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1668 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:28.239734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-33d54c82-2258-4bb1-9978-832c80ad17b4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:28.240882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-33d54c82-2258-4bb1-9978-832c80ad17b4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:28.253250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33d54c82-2258-4bb1-9978-832c80ad17b4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:28.253961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33d54c82-2258-4bb1-9978-832c80ad17b4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:28.258301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33d54c82-2258-4bb1-9978-832c80ad17b4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:28.259791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33d54c82-2258-4bb1-9978-832c80ad17b4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:28.260649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33d54c82-2258-4bb1-9978-832c80ad17b4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:28.266229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-33d54c82-2258-4bb1-9978-832c80ad17b4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:28.950889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-33d54c82-2258-4bb1-9978-832c80ad17b4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:28.995991 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-33d54c82-2258-4bb1-9978-832c80ad17b4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.761180 Aug 25 13:51:28.997034 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3012/5973] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:28 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:29.178542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8db93e5b-6147-4fe1-a8b9-74769ba9b573 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:29.179170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8db93e5b-6147-4fe1-a8b9-74769ba9b573 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:29.194749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db93e5b-6147-4fe1-a8b9-74769ba9b573 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:29.195513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db93e5b-6147-4fe1-a8b9-74769ba9b573 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:29.195956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db93e5b-6147-4fe1-a8b9-74769ba9b573 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:29.196675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db93e5b-6147-4fe1-a8b9-74769ba9b573 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:29.197135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db93e5b-6147-4fe1-a8b9-74769ba9b573 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:29.197707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8db93e5b-6147-4fe1-a8b9-74769ba9b573 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:29.665876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8db93e5b-6147-4fe1-a8b9-74769ba9b573 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:29.680447 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8db93e5b-6147-4fe1-a8b9-74769ba9b573 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1668 microversion: 2.1 time: 0.506696 Aug 25 13:51:29.685935 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3013/5974] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:29 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1668 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:30.045990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d907dd9-0aa8-4840-b29c-f8458ad76960 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:30.046995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d907dd9-0aa8-4840-b29c-f8458ad76960 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:30.058730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d907dd9-0aa8-4840-b29c-f8458ad76960 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:30.060107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d907dd9-0aa8-4840-b29c-f8458ad76960 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:30.061303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d907dd9-0aa8-4840-b29c-f8458ad76960 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:30.062509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d907dd9-0aa8-4840-b29c-f8458ad76960 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:30.062509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d907dd9-0aa8-4840-b29c-f8458ad76960 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:30.062509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d907dd9-0aa8-4840-b29c-f8458ad76960 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:30.246040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:30.270566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:30.457068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:30.742549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8d907dd9-0aa8-4840-b29c-f8458ad76960 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:30.759954 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d907dd9-0aa8-4840-b29c-f8458ad76960 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.730988 Aug 25 13:51:30.765196 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3014/5975] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:30 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:30.770654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6f129e24-d238-41f0-bd80-5bbb5e776da0 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:30.771655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6f129e24-d238-41f0-bd80-5bbb5e776da0 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:30.786475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f129e24-d238-41f0-bd80-5bbb5e776da0 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:30.787419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f129e24-d238-41f0-bd80-5bbb5e776da0 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:30.788149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f129e24-d238-41f0-bd80-5bbb5e776da0 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:30.789272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f129e24-d238-41f0-bd80-5bbb5e776da0 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:30.789959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f129e24-d238-41f0-bd80-5bbb5e776da0 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:30.790631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f129e24-d238-41f0-bd80-5bbb5e776da0 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:30.896771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6f129e24-d238-41f0-bd80-5bbb5e776da0 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:30.956979 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6f129e24-d238-41f0-bd80-5bbb5e776da0 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 200 len: 1484 microversion: 2.1 time: 0.190044 Aug 25 13:51:30.970560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3015/5976] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:30 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 1484 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:31.220048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-7c7330d8-aec3-4e4a-9616-dbbdc6837ee5 req-7fa34595-cd99-46ea-bd6e-a3a08be3f891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae1ab300-4ab6-498d-b183-61c03e329808", "name": "network-vif-deleted", "tag": "b5cac3bc-a2dd-4e04-8b81-5921be3543f9"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:31.236556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7c7330d8-aec3-4e4a-9616-dbbdc6837ee5 req-7fa34595-cd99-46ea-bd6e-a3a08be3f891 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:31.237370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7c7330d8-aec3-4e4a-9616-dbbdc6837ee5 req-7fa34595-cd99-46ea-bd6e-a3a08be3f891 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:31.238004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7c7330d8-aec3-4e4a-9616-dbbdc6837ee5 req-7fa34595-cd99-46ea-bd6e-a3a08be3f891 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:31.275278 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-7c7330d8-aec3-4e4a-9616-dbbdc6837ee5 req-7fa34595-cd99-46ea-bd6e-a3a08be3f891 service nova] Creating event network-vif-deleted:b5cac3bc-a2dd-4e04-8b81-5921be3543f9 for instance ae1ab300-4ab6-498d-b183-61c03e329808 on n-h1-852771-8 Aug 25 13:51:31.289864 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-7c7330d8-aec3-4e4a-9616-dbbdc6837ee5 req-7fa34595-cd99-46ea-bd6e-a3a08be3f891 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084284 Aug 25 13:51:31.294592 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3016/5977] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:51:31.722066 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1651f1df-ce50-41b4-9fdc-fd0b131bcc73 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7/action" status: 202 len: 0 microversion: 2.1 time: 4.388822 Aug 25 13:51:31.723878 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2962/5978] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:51:27 2022] POST /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7/action => generated 0 bytes in 4392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:51:31.747029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-51d85c0f-090c-4385-93dd-956d8d74114c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:31.748564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-51d85c0f-090c-4385-93dd-956d8d74114c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:31.785410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51d85c0f-090c-4385-93dd-956d8d74114c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:31.786253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51d85c0f-090c-4385-93dd-956d8d74114c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:31.786878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51d85c0f-090c-4385-93dd-956d8d74114c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:31.793968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d6e79959-2542-41d6-8aef-273bd5a223f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:31.794621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d6e79959-2542-41d6-8aef-273bd5a223f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:31.798696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51d85c0f-090c-4385-93dd-956d8d74114c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:31.801134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51d85c0f-090c-4385-93dd-956d8d74114c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:31.801805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51d85c0f-090c-4385-93dd-956d8d74114c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:31.804169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6e79959-2542-41d6-8aef-273bd5a223f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:31.805106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6e79959-2542-41d6-8aef-273bd5a223f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:31.805851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6e79959-2542-41d6-8aef-273bd5a223f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:31.806714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6e79959-2542-41d6-8aef-273bd5a223f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:31.807349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6e79959-2542-41d6-8aef-273bd5a223f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:31.808503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d6e79959-2542-41d6-8aef-273bd5a223f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:32.222395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-51d85c0f-090c-4385-93dd-956d8d74114c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:32.225925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d6e79959-2542-41d6-8aef-273bd5a223f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:32.238142 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-51d85c0f-090c-4385-93dd-956d8d74114c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1693 microversion: 2.1 time: 0.500652 Aug 25 13:51:32.241056 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d6e79959-2542-41d6-8aef-273bd5a223f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.451373 Aug 25 13:51:32.242330 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2963/5979] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:31 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:32.248696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:32.249628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: ae1ab300-4ab6-498d-b183-61c03e329808] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:32.258125 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3017/5980] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:31 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1693 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:32.273336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:32.274300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:32.275072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:32.275871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:32.276516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:32.276955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:32.300267 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] HTTP exception thrown: Instance ae1ab300-4ab6-498d-b183-61c03e329808 could not be found. Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Request method failure captured: Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 HTTP/1.1 Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB32vdaQ_S9icGAjYyPhLFfzCiYxIPTIIkJYOFl9u4OdkP4hfZ-pfsBl6HZG2TelsqdqZL6sfytQqgJTb6O4hD7ntUuSQpwOIs3D_4FB0sR7oU2EiKRMLaksk6bJ3ZHFVz3qRNAMYQk-hBhSL_TZceK0Tk2Z6NDFvRcIJC1gkegfC_1A Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 11aa34f5f9654a08adbb90ebca9c6d4d Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestNetworkBasicOps-921108427 Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/11aa34f5f9654a08adbb90ebca9c6d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_11aa34f5f9654a08adbb90ebca9c6d4d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/11aa34f5f9654a08adbb90ebca9c6d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/11aa34f5f9654a08adbb90ebca9c6d4d"}]}] Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestNetworkBasicOps-921108427 Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 11aa34f5f9654a08adbb90ebca9c6d4d Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestNetworkBasicOps-921108427 Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestNetworkBasicOps-921108427-project Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a882ff06dbb14328b6360ce89f4d75e5 Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestNetworkBasicOps-921108427-project Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ae1ab300-4ab6-498d-b183-61c03e329808 could not be found. Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ae1ab300-4ab6-498d-b183-61c03e329808'} Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1ab300-4ab6-498d-b183-61c03e329808 could not be found. Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1ab300-4ab6-498d-b183-61c03e329808 could not be found. Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:51:32.302760 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:51:32.315275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:32.315275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:51:32.315275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:51:32.315275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:51:32.315275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:51:32.315275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1ab300-4ab6-498d-b183-61c03e329808 could not be found. Aug 25 13:51:32.315275 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:51:32.315275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Returning 404 to user: Instance ae1ab300-4ab6-498d-b183-61c03e329808 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:51:32.315275 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0e61677-ed7d-4c05-a5ca-1a3deaaad8b9 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808" status: 404 len: 111 microversion: 2.1 time: 0.060858 Aug 25 13:51:32.315275 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2964/5981] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:32 2022] GET /compute/v2.1/servers/ae1ab300-4ab6-498d-b183-61c03e329808 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:51:32.651669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-887f14bf-133f-43f5-ad64-8af849d5809b tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '.version_select at 0x7f3a299e8f70>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:32.713337 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-887f14bf-133f-43f5-ad64-8af849d5809b tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-798124864" status: 202 len: 0 microversion: 2.1 time: 0.076573 Aug 25 13:51:32.717304 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3018/5982] 10.222.0.70 () {58 vars in 1254 bytes} [Thu Aug 25 13:51:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-798124864 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:51:33.275284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-866d7c86-b590-49cd-bc37-79b6a9da3ec3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:33.276748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-866d7c86-b590-49cd-bc37-79b6a9da3ec3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:33.286112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-866d7c86-b590-49cd-bc37-79b6a9da3ec3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:33.286754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-866d7c86-b590-49cd-bc37-79b6a9da3ec3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:33.287625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-866d7c86-b590-49cd-bc37-79b6a9da3ec3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:33.288573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-866d7c86-b590-49cd-bc37-79b6a9da3ec3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:33.289257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-866d7c86-b590-49cd-bc37-79b6a9da3ec3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:33.289950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-866d7c86-b590-49cd-bc37-79b6a9da3ec3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:33.297783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-96d32a90-d65a-43c7-aef2-9b32b3f2d473 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:33.298521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-96d32a90-d65a-43c7-aef2-9b32b3f2d473 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:33.314871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d32a90-d65a-43c7-aef2-9b32b3f2d473 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:33.315668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d32a90-d65a-43c7-aef2-9b32b3f2d473 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:33.316114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d32a90-d65a-43c7-aef2-9b32b3f2d473 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:33.316936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d32a90-d65a-43c7-aef2-9b32b3f2d473 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:33.317375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d32a90-d65a-43c7-aef2-9b32b3f2d473 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:33.317901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-96d32a90-d65a-43c7-aef2-9b32b3f2d473 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:33.670191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-866d7c86-b590-49cd-bc37-79b6a9da3ec3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:33.681334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-866d7c86-b590-49cd-bc37-79b6a9da3ec3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.409966 Aug 25 13:51:33.682105 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2965/5983] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:33 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:33.699977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-96d32a90-d65a-43c7-aef2-9b32b3f2d473 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:33.713919 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-96d32a90-d65a-43c7-aef2-9b32b3f2d473 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1693 microversion: 2.1 time: 0.434347 Aug 25 13:51:33.715727 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3019/5984] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:33 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1693 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:33.982418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-af755a36-db5d-403e-a542-1498bce91346 req-b52cfe74-be9a-4d44-8de0-3df25fd1937a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd83b4d4-e933-41fb-b596-ab891f7420a7", "name": "network-vif-unplugged", "status": "completed", "tag": "7c61df38-9f17-4673-ab66-6bcfa817e247"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:33.993432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-af755a36-db5d-403e-a542-1498bce91346 req-b52cfe74-be9a-4d44-8de0-3df25fd1937a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:33.994294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-af755a36-db5d-403e-a542-1498bce91346 req-b52cfe74-be9a-4d44-8de0-3df25fd1937a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:33.994970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-af755a36-db5d-403e-a542-1498bce91346 req-b52cfe74-be9a-4d44-8de0-3df25fd1937a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:34.008825 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-af755a36-db5d-403e-a542-1498bce91346 req-b52cfe74-be9a-4d44-8de0-3df25fd1937a service nova] Creating event network-vif-unplugged:7c61df38-9f17-4673-ab66-6bcfa817e247 for instance fd83b4d4-e933-41fb-b596-ab891f7420a7 on n-h2-852771-8 Aug 25 13:51:34.022043 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-af755a36-db5d-403e-a542-1498bce91346 req-b52cfe74-be9a-4d44-8de0-3df25fd1937a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043987 Aug 25 13:51:34.026340 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2966/5985] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:51:34.714468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dab2bc92-54d4-4301-8715-c5eec2aec290 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:34.717211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dab2bc92-54d4-4301-8715-c5eec2aec290 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:34.731304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dab2bc92-54d4-4301-8715-c5eec2aec290 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:34.732608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dab2bc92-54d4-4301-8715-c5eec2aec290 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:34.733680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dab2bc92-54d4-4301-8715-c5eec2aec290 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:34.735476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dab2bc92-54d4-4301-8715-c5eec2aec290 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:34.736617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dab2bc92-54d4-4301-8715-c5eec2aec290 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:34.737767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dab2bc92-54d4-4301-8715-c5eec2aec290 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:34.739999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-603efa4d-9e2c-449e-a225-741d0f077a20 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:34.740806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-603efa4d-9e2c-449e-a225-741d0f077a20 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:34.765446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-603efa4d-9e2c-449e-a225-741d0f077a20 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:34.765446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-603efa4d-9e2c-449e-a225-741d0f077a20 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:34.770180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-603efa4d-9e2c-449e-a225-741d0f077a20 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:34.771213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-603efa4d-9e2c-449e-a225-741d0f077a20 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:34.774094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-603efa4d-9e2c-449e-a225-741d0f077a20 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:34.781708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:34.783479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-603efa4d-9e2c-449e-a225-741d0f077a20 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:35.211935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dab2bc92-54d4-4301-8715-c5eec2aec290 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:35.225064 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dab2bc92-54d4-4301-8715-c5eec2aec290 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.519751 Aug 25 13:51:35.226836 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3020/5986] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:34 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:35.285298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-603efa4d-9e2c-449e-a225-741d0f077a20 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:35.295370 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-603efa4d-9e2c-449e-a225-741d0f077a20 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1693 microversion: 2.1 time: 0.561192 Aug 25 13:51:35.295968 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2967/5987] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:34 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1693 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:36.067356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9324c339-d1ef-49ab-83b5-96f6de8755b0 req-871a289f-247d-4d96-9288-435750207b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd83b4d4-e933-41fb-b596-ab891f7420a7", "tag": "7c61df38-9f17-4673-ab66-6bcfa817e247"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:36.089475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9324c339-d1ef-49ab-83b5-96f6de8755b0 req-871a289f-247d-4d96-9288-435750207b2c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:36.090995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9324c339-d1ef-49ab-83b5-96f6de8755b0 req-871a289f-247d-4d96-9288-435750207b2c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:36.091708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9324c339-d1ef-49ab-83b5-96f6de8755b0 req-871a289f-247d-4d96-9288-435750207b2c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:36.109406 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9324c339-d1ef-49ab-83b5-96f6de8755b0 req-871a289f-247d-4d96-9288-435750207b2c service nova] Creating event network-changed:7c61df38-9f17-4673-ab66-6bcfa817e247 for instance fd83b4d4-e933-41fb-b596-ab891f7420a7 on n-h2-852771-8 Aug 25 13:51:36.118637 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9324c339-d1ef-49ab-83b5-96f6de8755b0 req-871a289f-247d-4d96-9288-435750207b2c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059442 Aug 25 13:51:36.119877 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3021/5988] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:51:36.250993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4014974-0ff7-4593-b1e5-b8b7a98bbad8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:36.252374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4014974-0ff7-4593-b1e5-b8b7a98bbad8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:36.264537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4014974-0ff7-4593-b1e5-b8b7a98bbad8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:36.265763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4014974-0ff7-4593-b1e5-b8b7a98bbad8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:36.266606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4014974-0ff7-4593-b1e5-b8b7a98bbad8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:36.279912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4014974-0ff7-4593-b1e5-b8b7a98bbad8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:36.280866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4014974-0ff7-4593-b1e5-b8b7a98bbad8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:36.281499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4014974-0ff7-4593-b1e5-b8b7a98bbad8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:36.323592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7fdf05b3-2046-43e0-bdba-57fcedfde579 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:36.324673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7fdf05b3-2046-43e0-bdba-57fcedfde579 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:36.349817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fdf05b3-2046-43e0-bdba-57fcedfde579 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:36.350586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fdf05b3-2046-43e0-bdba-57fcedfde579 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:36.351519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fdf05b3-2046-43e0-bdba-57fcedfde579 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:36.352679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fdf05b3-2046-43e0-bdba-57fcedfde579 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:36.353588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fdf05b3-2046-43e0-bdba-57fcedfde579 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:36.354212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fdf05b3-2046-43e0-bdba-57fcedfde579 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:37.104033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d4014974-0ff7-4593-b1e5-b8b7a98bbad8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:37.108881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:37.116051 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4014974-0ff7-4593-b1e5-b8b7a98bbad8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.870742 Aug 25 13:51:37.116651 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2968/5989] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:36 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:37.147711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7fdf05b3-2046-43e0-bdba-57fcedfde579 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:37.160696 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7fdf05b3-2046-43e0-bdba-57fcedfde579 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1693 microversion: 2.1 time: 0.845886 Aug 25 13:51:37.189775 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3022/5990] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:36 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1693 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:38.139992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0bdb6f30-f071-4df8-a426-ac3b55d31d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:38.140752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0bdb6f30-f071-4df8-a426-ac3b55d31d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:38.164197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bdb6f30-f071-4df8-a426-ac3b55d31d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:38.164825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bdb6f30-f071-4df8-a426-ac3b55d31d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:38.165412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bdb6f30-f071-4df8-a426-ac3b55d31d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:38.166308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bdb6f30-f071-4df8-a426-ac3b55d31d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:38.166856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bdb6f30-f071-4df8-a426-ac3b55d31d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:38.167375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bdb6f30-f071-4df8-a426-ac3b55d31d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:38.202116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-916989e9-1134-4ea8-984e-5dd74e103760 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:38.203379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-916989e9-1134-4ea8-984e-5dd74e103760 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:38.219798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916989e9-1134-4ea8-984e-5dd74e103760 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:38.220494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916989e9-1134-4ea8-984e-5dd74e103760 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:38.220890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916989e9-1134-4ea8-984e-5dd74e103760 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:38.221444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916989e9-1134-4ea8-984e-5dd74e103760 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:38.231049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916989e9-1134-4ea8-984e-5dd74e103760 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:38.231491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916989e9-1134-4ea8-984e-5dd74e103760 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:38.596277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0bdb6f30-f071-4df8-a426-ac3b55d31d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:38.612338 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0bdb6f30-f071-4df8-a426-ac3b55d31d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.477971 Aug 25 13:51:38.619059 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2969/5991] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:38 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:38.663715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-916989e9-1134-4ea8-984e-5dd74e103760 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:38.674246 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-916989e9-1134-4ea8-984e-5dd74e103760 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1693 microversion: 2.1 time: 0.476000 Aug 25 13:51:38.675132 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3023/5992] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:38 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1693 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:39.645021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dad32d21-9209-4e73-87b7-1c508b4eb0ea tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:39.648405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dad32d21-9209-4e73-87b7-1c508b4eb0ea tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:39.676020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dad32d21-9209-4e73-87b7-1c508b4eb0ea tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:39.677063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dad32d21-9209-4e73-87b7-1c508b4eb0ea tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:39.678040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dad32d21-9209-4e73-87b7-1c508b4eb0ea tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:39.679661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dad32d21-9209-4e73-87b7-1c508b4eb0ea tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:39.680612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dad32d21-9209-4e73-87b7-1c508b4eb0ea tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:39.682571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dad32d21-9209-4e73-87b7-1c508b4eb0ea tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:39.700555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-34718522-4567-4424-820e-ef6513538d63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:39.702927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-34718522-4567-4424-820e-ef6513538d63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:39.714089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34718522-4567-4424-820e-ef6513538d63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:39.714923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34718522-4567-4424-820e-ef6513538d63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:39.715680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34718522-4567-4424-820e-ef6513538d63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:39.716616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34718522-4567-4424-820e-ef6513538d63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:39.717457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34718522-4567-4424-820e-ef6513538d63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:39.725399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34718522-4567-4424-820e-ef6513538d63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:40.210511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-34718522-4567-4424-820e-ef6513538d63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:40.222300 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-34718522-4567-4424-820e-ef6513538d63 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1693 microversion: 2.1 time: 0.528117 Aug 25 13:51:40.239088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dad32d21-9209-4e73-87b7-1c508b4eb0ea tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:40.248089 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3024/5993] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:39 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1693 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:40.252318 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dad32d21-9209-4e73-87b7-1c508b4eb0ea tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.615748 Aug 25 13:51:40.254282 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2970/5994] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:39 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:41.257018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-45845e4e-8b4d-4956-8d6d-ed4250cf2cf1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:41.259493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-45845e4e-8b4d-4956-8d6d-ed4250cf2cf1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:41.269942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45845e4e-8b4d-4956-8d6d-ed4250cf2cf1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:41.270898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45845e4e-8b4d-4956-8d6d-ed4250cf2cf1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:41.271550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45845e4e-8b4d-4956-8d6d-ed4250cf2cf1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:41.272659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45845e4e-8b4d-4956-8d6d-ed4250cf2cf1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:41.273448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45845e4e-8b4d-4956-8d6d-ed4250cf2cf1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:41.274341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45845e4e-8b4d-4956-8d6d-ed4250cf2cf1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:41.282167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8453e734-4f81-4cec-a0a5-c0da96c2e7be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:41.282833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8453e734-4f81-4cec-a0a5-c0da96c2e7be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:41.294779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8453e734-4f81-4cec-a0a5-c0da96c2e7be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:41.295283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8453e734-4f81-4cec-a0a5-c0da96c2e7be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:41.295735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8453e734-4f81-4cec-a0a5-c0da96c2e7be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:41.296459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8453e734-4f81-4cec-a0a5-c0da96c2e7be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:41.296924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8453e734-4f81-4cec-a0a5-c0da96c2e7be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:41.297359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8453e734-4f81-4cec-a0a5-c0da96c2e7be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:41.618672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-45845e4e-8b4d-4956-8d6d-ed4250cf2cf1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:41.630120 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-45845e4e-8b4d-4956-8d6d-ed4250cf2cf1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1693 microversion: 2.1 time: 0.378076 Aug 25 13:51:41.644157 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3025/5995] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:41 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1693 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:41.693358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8453e734-4f81-4cec-a0a5-c0da96c2e7be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:41.709697 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8453e734-4f81-4cec-a0a5-c0da96c2e7be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.431243 Aug 25 13:51:41.727225 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2971/5996] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:41 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:42.672303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9bb3f1df-2f96-414c-b645-cc4f712caed0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:42.673289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9bb3f1df-2f96-414c-b645-cc4f712caed0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:42.680950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bb3f1df-2f96-414c-b645-cc4f712caed0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:42.681771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bb3f1df-2f96-414c-b645-cc4f712caed0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:42.682387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bb3f1df-2f96-414c-b645-cc4f712caed0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:42.683891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bb3f1df-2f96-414c-b645-cc4f712caed0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:42.684544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bb3f1df-2f96-414c-b645-cc4f712caed0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:42.685149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9bb3f1df-2f96-414c-b645-cc4f712caed0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:42.735346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8a68191d-c6c5-41c6-9b6a-96057189e7d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:42.735985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8a68191d-c6c5-41c6-9b6a-96057189e7d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:42.750006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a68191d-c6c5-41c6-9b6a-96057189e7d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:42.750517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a68191d-c6c5-41c6-9b6a-96057189e7d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:42.750971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a68191d-c6c5-41c6-9b6a-96057189e7d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:42.751705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a68191d-c6c5-41c6-9b6a-96057189e7d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:42.752167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a68191d-c6c5-41c6-9b6a-96057189e7d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:42.752600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a68191d-c6c5-41c6-9b6a-96057189e7d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:43.176537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8a68191d-c6c5-41c6-9b6a-96057189e7d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:43.190389 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8a68191d-c6c5-41c6-9b6a-96057189e7d6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.458725 Aug 25 13:51:43.198501 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2972/5997] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:42 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:43.201479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9bb3f1df-2f96-414c-b645-cc4f712caed0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:43.212261 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9bb3f1df-2f96-414c-b645-cc4f712caed0 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1693 microversion: 2.1 time: 0.563780 Aug 25 13:51:43.226723 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3026/5998] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:42 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1693 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:44.215841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-66b3721c-f8c4-4485-8285-33682eec1209 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:44.219664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-66b3721c-f8c4-4485-8285-33682eec1209 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:44.238051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d664b60-c1e2-47c4-b803-48c885c822e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:44.238847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5d664b60-c1e2-47c4-b803-48c885c822e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:44.253279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66b3721c-f8c4-4485-8285-33682eec1209 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:44.253676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d664b60-c1e2-47c4-b803-48c885c822e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:44.254303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d664b60-c1e2-47c4-b803-48c885c822e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:44.258266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66b3721c-f8c4-4485-8285-33682eec1209 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:44.260498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66b3721c-f8c4-4485-8285-33682eec1209 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:44.262548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66b3721c-f8c4-4485-8285-33682eec1209 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:44.266250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d664b60-c1e2-47c4-b803-48c885c822e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:44.267043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66b3721c-f8c4-4485-8285-33682eec1209 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:44.270285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d664b60-c1e2-47c4-b803-48c885c822e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:44.270970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d664b60-c1e2-47c4-b803-48c885c822e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:44.271721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66b3721c-f8c4-4485-8285-33682eec1209 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:44.272357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d664b60-c1e2-47c4-b803-48c885c822e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:44.953205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-66b3721c-f8c4-4485-8285-33682eec1209 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:45.014679 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-66b3721c-f8c4-4485-8285-33682eec1209 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1169 microversion: 2.1 time: 0.806676 Aug 25 13:51:45.023123 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2973/5999] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:44 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1169 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:45.339626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5d664b60-c1e2-47c4-b803-48c885c822e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:45.349891 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5d664b60-c1e2-47c4-b803-48c885c822e9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1693 microversion: 2.1 time: 1.116752 Aug 25 13:51:45.356688 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3027/6000] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:44 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1693 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:46.045168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-62065029-3fc0-496c-a555-83741b218b81 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:46.046586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-62065029-3fc0-496c-a555-83741b218b81 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:46.079687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62065029-3fc0-496c-a555-83741b218b81 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:46.080165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62065029-3fc0-496c-a555-83741b218b81 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:46.080638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62065029-3fc0-496c-a555-83741b218b81 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:46.081653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62065029-3fc0-496c-a555-83741b218b81 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:46.082125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62065029-3fc0-496c-a555-83741b218b81 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:46.082569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62065029-3fc0-496c-a555-83741b218b81 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:46.376022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2478967f-934e-408d-930f-0b944e168ecf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:46.377018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2478967f-934e-408d-930f-0b944e168ecf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:46.386499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2478967f-934e-408d-930f-0b944e168ecf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:46.387565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2478967f-934e-408d-930f-0b944e168ecf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:46.388211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2478967f-934e-408d-930f-0b944e168ecf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:46.389129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2478967f-934e-408d-930f-0b944e168ecf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:46.389789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2478967f-934e-408d-930f-0b944e168ecf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:46.391689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2478967f-934e-408d-930f-0b944e168ecf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:47.116362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-62065029-3fc0-496c-a555-83741b218b81 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:47.130051 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-62065029-3fc0-496c-a555-83741b218b81 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1203 microversion: 2.1 time: 1.089260 Aug 25 13:51:47.131191 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2974/6001] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:46 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1203 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:47.133033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2478967f-934e-408d-930f-0b944e168ecf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:47.150599 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2478967f-934e-408d-930f-0b944e168ecf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1693 microversion: 2.1 time: 0.778425 Aug 25 13:51:47.155037 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3028/6002] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:46 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1693 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:48.158847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b649426-bc5f-415e-bb03-9c75f5c7d4be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:48.159576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b649426-bc5f-415e-bb03-9c75f5c7d4be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:48.167496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b649426-bc5f-415e-bb03-9c75f5c7d4be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:48.168483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b649426-bc5f-415e-bb03-9c75f5c7d4be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:48.169128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b649426-bc5f-415e-bb03-9c75f5c7d4be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:48.170108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b649426-bc5f-415e-bb03-9c75f5c7d4be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:48.170828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b649426-bc5f-415e-bb03-9c75f5c7d4be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:48.171543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b649426-bc5f-415e-bb03-9c75f5c7d4be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:48.199734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2e50aaae-f2e2-4650-b6f7-9fed63727c0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:48.200529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2e50aaae-f2e2-4650-b6f7-9fed63727c0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:48.215067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e50aaae-f2e2-4650-b6f7-9fed63727c0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:48.225407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e50aaae-f2e2-4650-b6f7-9fed63727c0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:48.226154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e50aaae-f2e2-4650-b6f7-9fed63727c0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:48.227088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e50aaae-f2e2-4650-b6f7-9fed63727c0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:48.227765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e50aaae-f2e2-4650-b6f7-9fed63727c0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:48.233988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2e50aaae-f2e2-4650-b6f7-9fed63727c0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:48.672916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b649426-bc5f-415e-bb03-9c75f5c7d4be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:48.683985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2e50aaae-f2e2-4650-b6f7-9fed63727c0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:48.684678 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b649426-bc5f-415e-bb03-9c75f5c7d4be tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1203 microversion: 2.1 time: 0.530953 Aug 25 13:51:48.686517 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2975/6003] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:48 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1203 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:48.697478 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2e50aaae-f2e2-4650-b6f7-9fed63727c0d tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1683 microversion: 2.1 time: 0.502912 Aug 25 13:51:48.713541 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3029/6004] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:48 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1683 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:48.720853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b0cc22f5-c19f-4d1c-ad47-6add69b913d1 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:48.721483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b0cc22f5-c19f-4d1c-ad47-6add69b913d1 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:48.728313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0cc22f5-c19f-4d1c-ad47-6add69b913d1 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:48.728933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0cc22f5-c19f-4d1c-ad47-6add69b913d1 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:48.729278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0cc22f5-c19f-4d1c-ad47-6add69b913d1 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:48.730736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0cc22f5-c19f-4d1c-ad47-6add69b913d1 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:48.731217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0cc22f5-c19f-4d1c-ad47-6add69b913d1 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:48.731746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b0cc22f5-c19f-4d1c-ad47-6add69b913d1 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:49.118876 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b0cc22f5-c19f-4d1c-ad47-6add69b913d1 tempest-TestNetworkAdvancedServerOps-1934855863 tempest-TestNetworkAdvancedServerOps-1934855863-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1834 microversion: 2.1 time: 0.401644 Aug 25 13:51:49.119913 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2976/6005] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:48 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1834 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:49.155323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9e45b54e-8af9-4da3-a592-b795a02d4080 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:49.157059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9e45b54e-8af9-4da3-a592-b795a02d4080 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:49.169449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e45b54e-8af9-4da3-a592-b795a02d4080 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:49.170900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e45b54e-8af9-4da3-a592-b795a02d4080 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:49.172363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e45b54e-8af9-4da3-a592-b795a02d4080 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:49.174151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e45b54e-8af9-4da3-a592-b795a02d4080 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:49.175695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e45b54e-8af9-4da3-a592-b795a02d4080 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:49.177179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e45b54e-8af9-4da3-a592-b795a02d4080 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:49.456054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9e45b54e-8af9-4da3-a592-b795a02d4080 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:49.466584 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9e45b54e-8af9-4da3-a592-b795a02d4080 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1683 microversion: 2.1 time: 0.317458 Aug 25 13:51:49.467820 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3030/6006] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:49 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1683 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:49.702174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87234987-3c8a-4279-9f29-805d783ecd76 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:49.706010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-87234987-3c8a-4279-9f29-805d783ecd76 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:49.721756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6188b65e-6f55-4446-bd68-d51d0e57a517 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:49.723313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6188b65e-6f55-4446-bd68-d51d0e57a517 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:49.735855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:49.743260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:49.744730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87234987-3c8a-4279-9f29-805d783ecd76 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:49.749369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6188b65e-6f55-4446-bd68-d51d0e57a517 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:49.749573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87234987-3c8a-4279-9f29-805d783ecd76 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:49.750353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6188b65e-6f55-4446-bd68-d51d0e57a517 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:49.750821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87234987-3c8a-4279-9f29-805d783ecd76 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:49.751343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6188b65e-6f55-4446-bd68-d51d0e57a517 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:49.752171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87234987-3c8a-4279-9f29-805d783ecd76 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:49.752589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6188b65e-6f55-4446-bd68-d51d0e57a517 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:49.753059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87234987-3c8a-4279-9f29-805d783ecd76 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:49.753674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6188b65e-6f55-4446-bd68-d51d0e57a517 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:49.753870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87234987-3c8a-4279-9f29-805d783ecd76 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:49.754520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6188b65e-6f55-4446-bd68-d51d0e57a517 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:49.898121 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87234987-3c8a-4279-9f29-805d783ecd76 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7/action" status: 200 len: 38674 microversion: 2.1 time: 0.200552 Aug 25 13:51:49.900154 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2977/6007] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:51:49 2022] POST /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7/action => generated 38674 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:51:49.978922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6188b65e-6f55-4446-bd68-d51d0e57a517 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:49.994578 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6188b65e-6f55-4446-bd68-d51d0e57a517 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1203 microversion: 2.1 time: 0.280787 Aug 25 13:51:49.997806 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3031/6008] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:49 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1203 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:50.039656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c8355210-6f9c-4543-bcd1-51cdecf7e640 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Action: 'create', calling method: .version_select at 0x7f3a2994dc10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1720774474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgwaooq2ONYnPP/i/ZSzY56p/60hJ71w09Zi3xqsLDG4QgWcBAOyWumqM22/yl8tqnUSGd2if5aC0E0K+D6z6Q2C8SsNVqhu0dqvKdRmFWG+eVhPl42wfvQ+/VFr+eFjA=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:50.098496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c8355210-6f9c-4543-bcd1-51cdecf7e640 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:51:50.118893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c8355210-6f9c-4543-bcd1-51cdecf7e640 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for user a882ff06dbb14328b6360ce89f4d75e5 and project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:51:50.168456 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c8355210-6f9c-4543-bcd1-51cdecf7e640 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.134419 Aug 25 13:51:50.181883 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2978/6009] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:51:50 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:51:51.027720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c185b867-bfa1-49ea-8ea3-9c0489a7df98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:51.030685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c185b867-bfa1-49ea-8ea3-9c0489a7df98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:51.079322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c185b867-bfa1-49ea-8ea3-9c0489a7df98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:51.080014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c185b867-bfa1-49ea-8ea3-9c0489a7df98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:51.080714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c185b867-bfa1-49ea-8ea3-9c0489a7df98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:51.081678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c185b867-bfa1-49ea-8ea3-9c0489a7df98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:51.082310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c185b867-bfa1-49ea-8ea3-9c0489a7df98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:51.082942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c185b867-bfa1-49ea-8ea3-9c0489a7df98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:51.407505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c185b867-bfa1-49ea-8ea3-9c0489a7df98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:51.424087 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c185b867-bfa1-49ea-8ea3-9c0489a7df98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1203 microversion: 2.1 time: 0.403070 Aug 25 13:51:51.429758 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3032/6010] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:51 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1203 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:51.765049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1476e0de-a762-426c-ad02-9e6803190f58 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:51.766564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1476e0de-a762-426c-ad02-9e6803190f58 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:51.785487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1476e0de-a762-426c-ad02-9e6803190f58 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:51.786400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1476e0de-a762-426c-ad02-9e6803190f58 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:51.786641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-03e3662e-dfe1-40cc-b714-aabc128182d1 req-c1aa05e4-5e35-42b7-a922-cb66b37283ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd83b4d4-e933-41fb-b596-ab891f7420a7", "tag": "7c61df38-9f17-4673-ab66-6bcfa817e247"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:51.787379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1476e0de-a762-426c-ad02-9e6803190f58 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:51.788426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1476e0de-a762-426c-ad02-9e6803190f58 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:51.789176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1476e0de-a762-426c-ad02-9e6803190f58 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:51.789989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1476e0de-a762-426c-ad02-9e6803190f58 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:51.815393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-03e3662e-dfe1-40cc-b714-aabc128182d1 req-c1aa05e4-5e35-42b7-a922-cb66b37283ca service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:51.820425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-03e3662e-dfe1-40cc-b714-aabc128182d1 req-c1aa05e4-5e35-42b7-a922-cb66b37283ca service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:51.821021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-03e3662e-dfe1-40cc-b714-aabc128182d1 req-c1aa05e4-5e35-42b7-a922-cb66b37283ca service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:51.836475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1476e0de-a762-426c-ad02-9e6803190f58 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:51:51.902934 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-03e3662e-dfe1-40cc-b714-aabc128182d1 req-c1aa05e4-5e35-42b7-a922-cb66b37283ca service nova] Creating event network-changed:7c61df38-9f17-4673-ab66-6bcfa817e247 for instance fd83b4d4-e933-41fb-b596-ab891f7420a7 on n-h1-852771-8 Aug 25 13:51:51.912088 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-03e3662e-dfe1-40cc-b714-aabc128182d1 req-c1aa05e4-5e35-42b7-a922-cb66b37283ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143234 Aug 25 13:51:51.913762 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3033/6011] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:51:52.127401 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1476e0de-a762-426c-ad02-9e6803190f58 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 204 len: 0 microversion: 2.1 time: 0.368830 Aug 25 13:51:52.129562 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2979/6012] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:51:51 2022] DELETE /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:51:52.172464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b8fa7252-7a7d-4d54-9575-b9a5c9a73cbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:52.174951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b8fa7252-7a7d-4d54-9575-b9a5c9a73cbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:52.187609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fa7252-7a7d-4d54-9575-b9a5c9a73cbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:52.188680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fa7252-7a7d-4d54-9575-b9a5c9a73cbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:52.189607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fa7252-7a7d-4d54-9575-b9a5c9a73cbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:52.190961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fa7252-7a7d-4d54-9575-b9a5c9a73cbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:52.191886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fa7252-7a7d-4d54-9575-b9a5c9a73cbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:52.192827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b8fa7252-7a7d-4d54-9575-b9a5c9a73cbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:52.450282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-524589b0-cc58-4a71-b797-09ae3cc478ce tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:52.456510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-524589b0-cc58-4a71-b797-09ae3cc478ce tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:52.520184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-524589b0-cc58-4a71-b797-09ae3cc478ce tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:52.522056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-524589b0-cc58-4a71-b797-09ae3cc478ce tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:52.523222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-524589b0-cc58-4a71-b797-09ae3cc478ce tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:52.525268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-524589b0-cc58-4a71-b797-09ae3cc478ce tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:52.527314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-524589b0-cc58-4a71-b797-09ae3cc478ce tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:52.528408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-524589b0-cc58-4a71-b797-09ae3cc478ce tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:53.266611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-524589b0-cc58-4a71-b797-09ae3cc478ce tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:53.304529 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-524589b0-cc58-4a71-b797-09ae3cc478ce tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1203 microversion: 2.1 time: 0.859717 Aug 25 13:51:53.311088 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2980/6013] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:52 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1203 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:53.373768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b8fa7252-7a7d-4d54-9575-b9a5c9a73cbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:53.401551 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b8fa7252-7a7d-4d54-9575-b9a5c9a73cbe tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1689 microversion: 2.1 time: 1.266920 Aug 25 13:51:53.411612 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3034/6014] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:52 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1689 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:53.441704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2086316293", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "38ca71a9-2b2f-4031-bc7b-7cef62edbd45"}], "key_name": "tempest-TestNetworkBasicOps-1720774474", "security_groups": [{"name": "tempest-secgroup-smoke-1005642907"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:53.694334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] validate_networks() for [('38ca71a9-2b2f-4031-bc7b-7cef62edbd45', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:51:54.348589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6d480ae3-1167-419d-923a-93fe751fe905 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:54.349221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6d480ae3-1167-419d-923a-93fe751fe905 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:54.357568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d480ae3-1167-419d-923a-93fe751fe905 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:54.358236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d480ae3-1167-419d-923a-93fe751fe905 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:54.359013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d480ae3-1167-419d-923a-93fe751fe905 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:54.360039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d480ae3-1167-419d-923a-93fe751fe905 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:54.360769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d480ae3-1167-419d-923a-93fe751fe905 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:54.361498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d480ae3-1167-419d-923a-93fe751fe905 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:54.965222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6d480ae3-1167-419d-923a-93fe751fe905 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:54.994138 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6d480ae3-1167-419d-923a-93fe751fe905 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1203 microversion: 2.1 time: 0.638846 Aug 25 13:51:54.994563 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3035/6015] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:54 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1203 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:55.000270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:55.000905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:55.020716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:55.021371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:55.022079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:55.024168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:55.024902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:55.025426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:55.067523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:55.068491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:55.069250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:55.070303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lazy-loading 'fault' on Instance uuid fd83b4d4-e933-41fb-b596-ab891f7420a7 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:51:55.154322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:55.155811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:51:55.156934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:51:55.159691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:51:55.161497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:51:55.162439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:51:55.172234 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d464374b-9623-45aa-99d0-7c3595e9c036 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 200 len: 1356 microversion: 2.1 time: 0.176137 Aug 25 13:51:55.173839 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3036/6016] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:54 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:55.181408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-3602691c-e6ad-4e53-ad28-777de845cad0 req-13990895-c4a0-4fcb-8f97-26d1c1506422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd83b4d4-e933-41fb-b596-ab891f7420a7", "name": "network-vif-deleted", "tag": "7c61df38-9f17-4673-ab66-6bcfa817e247"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:55.192837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:55.193828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3602691c-e6ad-4e53-ad28-777de845cad0 req-13990895-c4a0-4fcb-8f97-26d1c1506422 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:55.194271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:55.194988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3602691c-e6ad-4e53-ad28-777de845cad0 req-13990895-c4a0-4fcb-8f97-26d1c1506422 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:55.195189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:55.195765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-3602691c-e6ad-4e53-ad28-777de845cad0 req-13990895-c4a0-4fcb-8f97-26d1c1506422 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:55.196772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:55.197356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:55.199030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:55.211844 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-3602691c-e6ad-4e53-ad28-777de845cad0 req-13990895-c4a0-4fcb-8f97-26d1c1506422 service nova] Creating event network-vif-deleted:7c61df38-9f17-4673-ab66-6bcfa817e247 for instance fd83b4d4-e933-41fb-b596-ab891f7420a7 on n-h1-852771-8 Aug 25 13:51:55.218902 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-3602691c-e6ad-4e53-ad28-777de845cad0 req-13990895-c4a0-4fcb-8f97-26d1c1506422 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042773 Aug 25 13:51:55.220593 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3037/6017] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:51:55.230980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:51:55.238092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Getting quotas for user a882ff06dbb14328b6360ce89f4d75e5 and project 11aa34f5f9654a08adbb90ebca9c6d4d. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:51:55.258764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:51:55.261999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:51:55.322522 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0bcc9bec-8f9c-41ea-83f5-78b545334b4c tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.884562 Aug 25 13:51:55.324025 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2981/6018] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:51:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:51:55.338466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02923ebe-8de6-4550-b886-46c4e95456d4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:55.340078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02923ebe-8de6-4550-b886-46c4e95456d4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:55.461194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02923ebe-8de6-4550-b886-46c4e95456d4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:55.483725 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02923ebe-8de6-4550-b886-46c4e95456d4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1249 microversion: 2.1 time: 0.148831 Aug 25 13:51:55.485325 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3038/6019] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:55 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1249 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:56.023779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-321fe019-e603-4709-a2b8-b48f1fb2d9d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:56.024835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-321fe019-e603-4709-a2b8-b48f1fb2d9d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:56.051124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-321fe019-e603-4709-a2b8-b48f1fb2d9d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:56.051632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-321fe019-e603-4709-a2b8-b48f1fb2d9d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:56.052401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-321fe019-e603-4709-a2b8-b48f1fb2d9d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:56.054051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-321fe019-e603-4709-a2b8-b48f1fb2d9d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:56.055046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-321fe019-e603-4709-a2b8-b48f1fb2d9d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:56.055842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-321fe019-e603-4709-a2b8-b48f1fb2d9d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:56.225651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:56.226912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: fd83b4d4-e933-41fb-b596-ab891f7420a7] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:56.243282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:56.244440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:56.247375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:56.249169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:56.250226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:56.251183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:56.318755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-321fe019-e603-4709-a2b8-b48f1fb2d9d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:56.327339 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] HTTP exception thrown: Instance fd83b4d4-e933-41fb-b596-ab891f7420a7 could not be found. Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Request method failure captured: Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 HTTP/1.1 Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3xUnETqauI1fxE397rReMXDLCicli9Hi5kLufClsv6N95sYOGTClXRLJCM2pDIKRWw-GpkZg3DQxGaWT8EsmuVnSKPWDo4sA2E4cLg9pp_ZjLYOlU7spY_Q87AN4fXVuBQueQfXTy0eO391Jp23FUZkFxq3DruyvbrbheLtC8cWpR4 Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3f2ace59bb66449bb97802fd18379f1a Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f2ace59bb66449bb97802fd18379f1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3f2ace59bb66449bb97802fd18379f1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3f2ace59bb66449bb97802fd18379f1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f2ace59bb66449bb97802fd18379f1a"}]}] Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3f2ace59bb66449bb97802fd18379f1a Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestNetworkAdvancedServerOps-1232753206-project Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: ecfd27e7237548f485ae9480d489286a Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1232753206-project Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance fd83b4d4-e933-41fb-b596-ab891f7420a7 could not be found. Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'fd83b4d4-e933-41fb-b596-ab891f7420a7'} Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd83b4d4-e933-41fb-b596-ab891f7420a7 could not be found. Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd83b4d4-e933-41fb-b596-ab891f7420a7 could not be found. Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:51:56.331147 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:51:56.338095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:51:56.338095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:56.338095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:51:56.338095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:51:56.338095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:51:56.338095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:51:56.338095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd83b4d4-e933-41fb-b596-ab891f7420a7 could not be found. Aug 25 13:51:56.338095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:51:56.339318 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-321fe019-e603-4709-a2b8-b48f1fb2d9d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1203 microversion: 2.1 time: 0.325537 Aug 25 13:51:56.350076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Returning 404 to user: Instance fd83b4d4-e933-41fb-b596-ab891f7420a7 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:51:56.350076 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7969049f-ec27-49b6-8dbe-6efd6b8cbdb9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7" status: 404 len: 111 microversion: 2.1 time: 0.124739 Aug 25 13:51:56.353593 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3039/6020] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:56 2022] GET /compute/v2.1/servers/fd83b4d4-e933-41fb-b596-ab891f7420a7 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:51:56.355641 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2982/6021] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:56 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1203 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:56.515225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d4af58f-34a2-49b6-8b0d-4ee62e7dce23 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:56.518691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d4af58f-34a2-49b6-8b0d-4ee62e7dce23 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:56.535129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d4af58f-34a2-49b6-8b0d-4ee62e7dce23 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:56.536741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d4af58f-34a2-49b6-8b0d-4ee62e7dce23 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:56.539196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d4af58f-34a2-49b6-8b0d-4ee62e7dce23 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:56.541165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d4af58f-34a2-49b6-8b0d-4ee62e7dce23 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:56.543392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d4af58f-34a2-49b6-8b0d-4ee62e7dce23 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:56.544815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d4af58f-34a2-49b6-8b0d-4ee62e7dce23 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:56.600911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:56.705914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d4af58f-34a2-49b6-8b0d-4ee62e7dce23 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:56.719039 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d4af58f-34a2-49b6-8b0d-4ee62e7dce23 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1301 microversion: 2.1 time: 0.212935 Aug 25 13:51:56.724531 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3040/6022] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:56 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1301 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:57.379601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02dca1a2-9c0b-445e-8a8b-f51510867a6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:57.380986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-02dca1a2-9c0b-445e-8a8b-f51510867a6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:57.391878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02dca1a2-9c0b-445e-8a8b-f51510867a6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:57.393301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02dca1a2-9c0b-445e-8a8b-f51510867a6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:57.394505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02dca1a2-9c0b-445e-8a8b-f51510867a6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:57.395751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02dca1a2-9c0b-445e-8a8b-f51510867a6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:57.396406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02dca1a2-9c0b-445e-8a8b-f51510867a6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:57.397115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02dca1a2-9c0b-445e-8a8b-f51510867a6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:57.746921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-023efe7f-8ba2-4c05-962d-480195e782cf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:57.747809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-023efe7f-8ba2-4c05-962d-480195e782cf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:57.757575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-023efe7f-8ba2-4c05-962d-480195e782cf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:57.758459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-023efe7f-8ba2-4c05-962d-480195e782cf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:57.759084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-023efe7f-8ba2-4c05-962d-480195e782cf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:57.760328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-023efe7f-8ba2-4c05-962d-480195e782cf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:57.761381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-023efe7f-8ba2-4c05-962d-480195e782cf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:57.762546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-023efe7f-8ba2-4c05-962d-480195e782cf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:57.842756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-02dca1a2-9c0b-445e-8a8b-f51510867a6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:57.853569 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-02dca1a2-9c0b-445e-8a8b-f51510867a6e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1203 microversion: 2.1 time: 0.478215 Aug 25 13:51:57.854717 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2983/6023] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:57 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1203 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:57.949840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-023efe7f-8ba2-4c05-962d-480195e782cf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:57.962157 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-023efe7f-8ba2-4c05-962d-480195e782cf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1307 microversion: 2.1 time: 0.224984 Aug 25 13:51:57.963521 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3041/6024] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:57 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1307 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:58.215193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c71393d0-d308-4576-baf0-bfe4f35afd7b req-f865c249-a20b-47f6-960b-1472480d5188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96553438-fc7f-470d-a424-1b7ac2d1ace5", "name": "network-vif-plugged", "status": "completed", "tag": "b635fd88-a49f-4e2d-baca-2a7fc2dc8f01"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:58.232620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c71393d0-d308-4576-baf0-bfe4f35afd7b req-f865c249-a20b-47f6-960b-1472480d5188 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:58.233595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c71393d0-d308-4576-baf0-bfe4f35afd7b req-f865c249-a20b-47f6-960b-1472480d5188 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:58.234609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c71393d0-d308-4576-baf0-bfe4f35afd7b req-f865c249-a20b-47f6-960b-1472480d5188 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:58.255609 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c71393d0-d308-4576-baf0-bfe4f35afd7b req-f865c249-a20b-47f6-960b-1472480d5188 service nova] Creating event network-vif-plugged:b635fd88-a49f-4e2d-baca-2a7fc2dc8f01 for instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 on n-h2-852771-8 Aug 25 13:51:58.265138 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c71393d0-d308-4576-baf0-bfe4f35afd7b req-f865c249-a20b-47f6-960b-1472480d5188 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054401 Aug 25 13:51:58.266605 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2984/6025] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:51:58.887337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c921a551-3eb0-4018-9110-08319aedc4e9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:58.890409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c921a551-3eb0-4018-9110-08319aedc4e9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:58.921449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c921a551-3eb0-4018-9110-08319aedc4e9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:58.922724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c921a551-3eb0-4018-9110-08319aedc4e9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:58.929660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c921a551-3eb0-4018-9110-08319aedc4e9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:58.931325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c921a551-3eb0-4018-9110-08319aedc4e9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:58.936998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c921a551-3eb0-4018-9110-08319aedc4e9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:58.938592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c921a551-3eb0-4018-9110-08319aedc4e9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:59.008922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cb30af06-2744-4500-84fa-27b8d7c46fa2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:59.011620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cb30af06-2744-4500-84fa-27b8d7c46fa2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:59.029716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb30af06-2744-4500-84fa-27b8d7c46fa2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:59.033892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb30af06-2744-4500-84fa-27b8d7c46fa2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:59.037073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb30af06-2744-4500-84fa-27b8d7c46fa2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:59.038714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb30af06-2744-4500-84fa-27b8d7c46fa2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:59.039818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb30af06-2744-4500-84fa-27b8d7c46fa2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:59.043936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cb30af06-2744-4500-84fa-27b8d7c46fa2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:59.402700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c921a551-3eb0-4018-9110-08319aedc4e9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:59.423629 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c921a551-3eb0-4018-9110-08319aedc4e9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1203 microversion: 2.1 time: 0.541342 Aug 25 13:51:59.431118 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3042/6026] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:58 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1203 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:59.601941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cb30af06-2744-4500-84fa-27b8d7c46fa2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:59.612745 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cb30af06-2744-4500-84fa-27b8d7c46fa2 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1375 microversion: 2.1 time: 0.612805 Aug 25 13:51:59.618116 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2985/6027] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:58 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1375 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:00.461167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b932163e-d726-40f5-927f-b68ffe73ace5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:00.462103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b932163e-d726-40f5-927f-b68ffe73ace5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:00.473645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b932163e-d726-40f5-927f-b68ffe73ace5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:00.474660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b932163e-d726-40f5-927f-b68ffe73ace5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:00.475312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b932163e-d726-40f5-927f-b68ffe73ace5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:00.476374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b932163e-d726-40f5-927f-b68ffe73ace5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:00.477009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b932163e-d726-40f5-927f-b68ffe73ace5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:00.478111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b932163e-d726-40f5-927f-b68ffe73ace5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:00.647042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8142006-8ffb-4d1a-8a50-3e9b4b358f28 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:00.667724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8142006-8ffb-4d1a-8a50-3e9b4b358f28 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:00.695893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8142006-8ffb-4d1a-8a50-3e9b4b358f28 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:00.695893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8142006-8ffb-4d1a-8a50-3e9b4b358f28 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:00.695893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8142006-8ffb-4d1a-8a50-3e9b4b358f28 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:00.699897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8142006-8ffb-4d1a-8a50-3e9b4b358f28 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:00.700585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8142006-8ffb-4d1a-8a50-3e9b4b358f28 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:00.701689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8142006-8ffb-4d1a-8a50-3e9b4b358f28 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:00.765578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:01.017765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b932163e-d726-40f5-927f-b68ffe73ace5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:01.049407 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b932163e-d726-40f5-927f-b68ffe73ace5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1391 microversion: 2.1 time: 0.595751 Aug 25 13:52:01.050641 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3043/6028] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:00 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1391 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:01.086486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ff34867-ad72-481f-bd73-b2796b2f85dd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:01.088194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4ff34867-ad72-481f-bd73-b2796b2f85dd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:01.099718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff34867-ad72-481f-bd73-b2796b2f85dd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:01.100972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff34867-ad72-481f-bd73-b2796b2f85dd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:01.101983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff34867-ad72-481f-bd73-b2796b2f85dd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:01.103394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff34867-ad72-481f-bd73-b2796b2f85dd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:01.104514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff34867-ad72-481f-bd73-b2796b2f85dd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:01.105541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ff34867-ad72-481f-bd73-b2796b2f85dd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:01.190802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b8142006-8ffb-4d1a-8a50-3e9b4b358f28 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:01.206319 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8142006-8ffb-4d1a-8a50-3e9b4b358f28 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1375 microversion: 2.1 time: 0.565976 Aug 25 13:52:01.206957 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2986/6029] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:00 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1375 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:01.516477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4ff34867-ad72-481f-bd73-b2796b2f85dd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:01.552505 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ff34867-ad72-481f-bd73-b2796b2f85dd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1391 microversion: 2.1 time: 0.470081 Aug 25 13:52:01.555928 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3044/6030] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:01 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1391 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:01.598550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2eafb501-15ed-4757-b913-0abf6e221b7c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:01.600595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2eafb501-15ed-4757-b913-0abf6e221b7c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:01.642600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2eafb501-15ed-4757-b913-0abf6e221b7c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:01.643103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d3e2b336-954d-4ce9-baf3-72697ac9285f req-1d37f2a1-d6ec-4ca4-be6f-598eedf5e850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5575cf32-02bc-41c8-99fc-694c87554be1", "tag": "ba4c2fa1-5645-4524-9e99-d0b3699e471e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:01.644299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2eafb501-15ed-4757-b913-0abf6e221b7c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:01.645080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2eafb501-15ed-4757-b913-0abf6e221b7c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:01.646095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2eafb501-15ed-4757-b913-0abf6e221b7c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:01.647709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2eafb501-15ed-4757-b913-0abf6e221b7c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:01.653210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2eafb501-15ed-4757-b913-0abf6e221b7c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:01.674446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d3e2b336-954d-4ce9-baf3-72697ac9285f req-1d37f2a1-d6ec-4ca4-be6f-598eedf5e850 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:01.675121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d3e2b336-954d-4ce9-baf3-72697ac9285f req-1d37f2a1-d6ec-4ca4-be6f-598eedf5e850 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:01.679251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d3e2b336-954d-4ce9-baf3-72697ac9285f req-1d37f2a1-d6ec-4ca4-be6f-598eedf5e850 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:01.713906 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d3e2b336-954d-4ce9-baf3-72697ac9285f req-1d37f2a1-d6ec-4ca4-be6f-598eedf5e850 service nova] Creating event network-changed:ba4c2fa1-5645-4524-9e99-d0b3699e471e for instance 5575cf32-02bc-41c8-99fc-694c87554be1 on n-h1-852771-8 Aug 25 13:52:01.729873 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d3e2b336-954d-4ce9-baf3-72697ac9285f req-1d37f2a1-d6ec-4ca4-be6f-598eedf5e850 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086312 Aug 25 13:52:01.731543 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3045/6031] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:52:02.241981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d438fff5-4234-4f44-9914-1dc699cfce8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:02.243396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d438fff5-4234-4f44-9914-1dc699cfce8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:02.261982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d438fff5-4234-4f44-9914-1dc699cfce8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:02.262768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d438fff5-4234-4f44-9914-1dc699cfce8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:02.263386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d438fff5-4234-4f44-9914-1dc699cfce8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:02.270014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d438fff5-4234-4f44-9914-1dc699cfce8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:02.270638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d438fff5-4234-4f44-9914-1dc699cfce8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:02.271036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d438fff5-4234-4f44-9914-1dc699cfce8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:02.272202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2eafb501-15ed-4757-b913-0abf6e221b7c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:02.314873 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2eafb501-15ed-4757-b913-0abf6e221b7c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1391 microversion: 2.1 time: 0.727455 Aug 25 13:52:02.317962 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2987/6032] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:01 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1391 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:02.564452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e62837fe-d998-47e5-86c8-22a58e514f5e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:02.564452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e62837fe-d998-47e5-86c8-22a58e514f5e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:02.581852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62837fe-d998-47e5-86c8-22a58e514f5e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:02.582929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62837fe-d998-47e5-86c8-22a58e514f5e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:02.583632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62837fe-d998-47e5-86c8-22a58e514f5e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:02.601943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62837fe-d998-47e5-86c8-22a58e514f5e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:02.602766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62837fe-d998-47e5-86c8-22a58e514f5e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:02.603582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e62837fe-d998-47e5-86c8-22a58e514f5e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:02.688700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e62837fe-d998-47e5-86c8-22a58e514f5e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:52:02.833645 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e62837fe-d998-47e5-86c8-22a58e514f5e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 204 len: 0 microversion: 2.1 time: 0.276469 Aug 25 13:52:02.836854 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2988/6033] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:52:02 2022] DELETE /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:52:02.853971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-29827a2e-53bd-4884-b886-62d86cb8a13e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:02.856140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-29827a2e-53bd-4884-b886-62d86cb8a13e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:02.875129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29827a2e-53bd-4884-b886-62d86cb8a13e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:02.877902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29827a2e-53bd-4884-b886-62d86cb8a13e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:02.879374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29827a2e-53bd-4884-b886-62d86cb8a13e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:02.882209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29827a2e-53bd-4884-b886-62d86cb8a13e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:02.883987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29827a2e-53bd-4884-b886-62d86cb8a13e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:02.886390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-29827a2e-53bd-4884-b886-62d86cb8a13e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:02.963355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d438fff5-4234-4f44-9914-1dc699cfce8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:02.980223 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d438fff5-4234-4f44-9914-1dc699cfce8d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1375 microversion: 2.1 time: 0.742871 Aug 25 13:52:02.982146 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3046/6034] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:02 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1375 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:03.182573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-29827a2e-53bd-4884-b886-62d86cb8a13e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:03.196879 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-29827a2e-53bd-4884-b886-62d86cb8a13e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1397 microversion: 2.1 time: 0.352839 Aug 25 13:52:03.198508 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2989/6035] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:02 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1397 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:04.020785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43a1df90-93df-4a76-9f3d-528d67ef2845 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:04.029811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43a1df90-93df-4a76-9f3d-528d67ef2845 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:04.040519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a1df90-93df-4a76-9f3d-528d67ef2845 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:04.041013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a1df90-93df-4a76-9f3d-528d67ef2845 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:04.044905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a1df90-93df-4a76-9f3d-528d67ef2845 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:04.044905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a1df90-93df-4a76-9f3d-528d67ef2845 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:04.044905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a1df90-93df-4a76-9f3d-528d67ef2845 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:04.044905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43a1df90-93df-4a76-9f3d-528d67ef2845 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:04.238123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-03d2c6cb-a6ef-4674-b0f6-c48f42aa3116 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:04.239004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-03d2c6cb-a6ef-4674-b0f6-c48f42aa3116 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:04.256398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03d2c6cb-a6ef-4674-b0f6-c48f42aa3116 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:04.257696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03d2c6cb-a6ef-4674-b0f6-c48f42aa3116 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:04.258341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03d2c6cb-a6ef-4674-b0f6-c48f42aa3116 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:04.261091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03d2c6cb-a6ef-4674-b0f6-c48f42aa3116 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:04.262013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03d2c6cb-a6ef-4674-b0f6-c48f42aa3116 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:04.262929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-03d2c6cb-a6ef-4674-b0f6-c48f42aa3116 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:04.404922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43a1df90-93df-4a76-9f3d-528d67ef2845 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:04.426301 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43a1df90-93df-4a76-9f3d-528d67ef2845 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1375 microversion: 2.1 time: 0.411881 Aug 25 13:52:04.428347 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3047/6036] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:04 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1375 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:04.512143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-03d2c6cb-a6ef-4674-b0f6-c48f42aa3116 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:04.531659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f6604bc-46fd-4f9f-9d5d-f1e8f37de421 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '.version_select at 0x7f3a2a507820>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:04.552486 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-03d2c6cb-a6ef-4674-b0f6-c48f42aa3116 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1397 microversion: 2.1 time: 0.324921 Aug 25 13:52:04.553095 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2990/6037] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:04 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1397 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:52:04.596255 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f6604bc-46fd-4f9f-9d5d-f1e8f37de421 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1411669147" status: 202 len: 0 microversion: 2.1 time: 0.093009 Aug 25 13:52:04.597194 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3048/6038] 10.222.0.70 () {58 vars in 1284 bytes} [Thu Aug 25 13:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1411669147 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:52:04.633899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-75f5ca1d-f870-4c35-8735-d5a4985665a8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'create', calling method: .version_select at 0x7f3a2e88a9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-25629083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB1XjseoggKtLLvlF6wV2pDS8XkZ/UL+AffE3xafXzOus3qe8iKvtOAeFoj0befUle1MEeMYpuTVcze1WgqrB8+hWDzajUDYWrnmPIDZUDBwTbubRvoSG6E8z2EVJ/51g=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:04.655597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-75f5ca1d-f870-4c35-8735-d5a4985665a8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:52:04.661852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-75f5ca1d-f870-4c35-8735-d5a4985665a8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for user ecfd27e7237548f485ae9480d489286a and project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:52:04.697178 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-75f5ca1d-f870-4c35-8735-d5a4985665a8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.067040 Aug 25 13:52:04.699736 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2991/6039] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:52:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:52:05.135922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-56e652b3-dd2f-46ce-9b56-d281ab0de13b req-f490425b-82f7-4265-a748-ebda54bf56f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96553438-fc7f-470d-a424-1b7ac2d1ace5", "name": "network-vif-deleted", "tag": "b635fd88-a49f-4e2d-baca-2a7fc2dc8f01"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:05.163141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-56e652b3-dd2f-46ce-9b56-d281ab0de13b req-f490425b-82f7-4265-a748-ebda54bf56f1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:05.163749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-56e652b3-dd2f-46ce-9b56-d281ab0de13b req-f490425b-82f7-4265-a748-ebda54bf56f1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:05.164314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-56e652b3-dd2f-46ce-9b56-d281ab0de13b req-f490425b-82f7-4265-a748-ebda54bf56f1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:05.198306 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-56e652b3-dd2f-46ce-9b56-d281ab0de13b req-f490425b-82f7-4265-a748-ebda54bf56f1 service nova] Creating event network-vif-deleted:b635fd88-a49f-4e2d-baca-2a7fc2dc8f01 for instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 on n-h2-852771-8 Aug 25 13:52:05.205969 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-56e652b3-dd2f-46ce-9b56-d281ab0de13b req-f490425b-82f7-4265-a748-ebda54bf56f1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077191 Aug 25 13:52:05.207201 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3049/6040] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:52:05.455563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b880967-d6be-45b2-b10f-65118b337651 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:05.456146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b880967-d6be-45b2-b10f-65118b337651 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:05.458934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:05.486958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b880967-d6be-45b2-b10f-65118b337651 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:05.492396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b880967-d6be-45b2-b10f-65118b337651 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:05.493294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b880967-d6be-45b2-b10f-65118b337651 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:05.495085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b880967-d6be-45b2-b10f-65118b337651 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:05.498269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b880967-d6be-45b2-b10f-65118b337651 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:05.499130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b880967-d6be-45b2-b10f-65118b337651 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:05.575938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:05.601656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da80a836-3a53-47de-a26d-42294080a0fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:05.608562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da80a836-3a53-47de-a26d-42294080a0fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:05.634585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da80a836-3a53-47de-a26d-42294080a0fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:05.636531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da80a836-3a53-47de-a26d-42294080a0fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:05.640630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da80a836-3a53-47de-a26d-42294080a0fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:05.642191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da80a836-3a53-47de-a26d-42294080a0fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:05.644547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da80a836-3a53-47de-a26d-42294080a0fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:05.645499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da80a836-3a53-47de-a26d-42294080a0fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:06.011866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da80a836-3a53-47de-a26d-42294080a0fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:06.040356 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da80a836-3a53-47de-a26d-42294080a0fb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1188 microversion: 2.1 time: 0.467556 Aug 25 13:52:06.050767 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3050/6041] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:05 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1188 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:06.181014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b880967-d6be-45b2-b10f-65118b337651 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:06.197713 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b880967-d6be-45b2-b10f-65118b337651 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1375 microversion: 2.1 time: 0.748460 Aug 25 13:52:06.200471 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2992/6042] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:05 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1375 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:07.076574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c4dff836-cd7b-4b89-9f05-74bd91f80e90 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:07.077317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c4dff836-cd7b-4b89-9f05-74bd91f80e90 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:07.099504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4dff836-cd7b-4b89-9f05-74bd91f80e90 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:07.100591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4dff836-cd7b-4b89-9f05-74bd91f80e90 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:07.101150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4dff836-cd7b-4b89-9f05-74bd91f80e90 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:07.105958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4dff836-cd7b-4b89-9f05-74bd91f80e90 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:07.106893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4dff836-cd7b-4b89-9f05-74bd91f80e90 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:07.107844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4dff836-cd7b-4b89-9f05-74bd91f80e90 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:07.226305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-998e2250-ce20-44bf-ba20-dbb952fbdcf4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:07.226961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-998e2250-ce20-44bf-ba20-dbb952fbdcf4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:07.246718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-998e2250-ce20-44bf-ba20-dbb952fbdcf4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:07.247539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-998e2250-ce20-44bf-ba20-dbb952fbdcf4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:07.255151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-998e2250-ce20-44bf-ba20-dbb952fbdcf4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:07.256439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-998e2250-ce20-44bf-ba20-dbb952fbdcf4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:07.257102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-998e2250-ce20-44bf-ba20-dbb952fbdcf4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:07.257756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-998e2250-ce20-44bf-ba20-dbb952fbdcf4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:07.292227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c4dff836-cd7b-4b89-9f05-74bd91f80e90 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:07.325369 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c4dff836-cd7b-4b89-9f05-74bd91f80e90 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1188 microversion: 2.1 time: 0.255893 Aug 25 13:52:07.326164 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3051/6043] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:07 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1188 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:07.720707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-998e2250-ce20-44bf-ba20-dbb952fbdcf4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:07.737224 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-998e2250-ce20-44bf-ba20-dbb952fbdcf4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1375 microversion: 2.1 time: 0.516294 Aug 25 13:52:07.738533 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2993/6044] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:07 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1375 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:08.354144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-82a3153f-35e7-4384-b9bb-b7b828eb4330 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:08.356274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-82a3153f-35e7-4384-b9bb-b7b828eb4330 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:08.368890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82a3153f-35e7-4384-b9bb-b7b828eb4330 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:08.370806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82a3153f-35e7-4384-b9bb-b7b828eb4330 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:08.372089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82a3153f-35e7-4384-b9bb-b7b828eb4330 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:08.373901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82a3153f-35e7-4384-b9bb-b7b828eb4330 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:08.375160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82a3153f-35e7-4384-b9bb-b7b828eb4330 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:08.376289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82a3153f-35e7-4384-b9bb-b7b828eb4330 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:08.473621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-82a3153f-35e7-4384-b9bb-b7b828eb4330 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:08.484316 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-82a3153f-35e7-4384-b9bb-b7b828eb4330 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1188 microversion: 2.1 time: 0.137034 Aug 25 13:52:08.485952 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3052/6045] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:08 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1188 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:08.768790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9d07019a-7710-4a61-9872-77187de86e98 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:08.773533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9d07019a-7710-4a61-9872-77187de86e98 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:08.788987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d07019a-7710-4a61-9872-77187de86e98 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:08.790496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d07019a-7710-4a61-9872-77187de86e98 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:08.791772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d07019a-7710-4a61-9872-77187de86e98 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:08.793455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d07019a-7710-4a61-9872-77187de86e98 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:08.794751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d07019a-7710-4a61-9872-77187de86e98 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:08.797280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d07019a-7710-4a61-9872-77187de86e98 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:09.329611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9d07019a-7710-4a61-9872-77187de86e98 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:09.349623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1c9b2201-d8a6-4e5d-bac9-fc9a6c1ab6cc req-cfb4a09a-38d2-4603-9a06-b0016111c4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5575cf32-02bc-41c8-99fc-694c87554be1", "name": "network-vif-plugged", "status": "completed", "tag": "ba4c2fa1-5645-4524-9e99-d0b3699e471e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:09.367817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1c9b2201-d8a6-4e5d-bac9-fc9a6c1ab6cc req-cfb4a09a-38d2-4603-9a06-b0016111c4a3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:09.370069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1c9b2201-d8a6-4e5d-bac9-fc9a6c1ab6cc req-cfb4a09a-38d2-4603-9a06-b0016111c4a3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:09.371801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1c9b2201-d8a6-4e5d-bac9-fc9a6c1ab6cc req-cfb4a09a-38d2-4603-9a06-b0016111c4a3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:09.373676 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9d07019a-7710-4a61-9872-77187de86e98 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1375 microversion: 2.1 time: 0.601392 Aug 25 13:52:09.374763 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2994/6046] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:08 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1375 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:09.413878 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1c9b2201-d8a6-4e5d-bac9-fc9a6c1ab6cc req-cfb4a09a-38d2-4603-9a06-b0016111c4a3 service nova] Creating event network-vif-plugged:ba4c2fa1-5645-4524-9e99-d0b3699e471e for instance 5575cf32-02bc-41c8-99fc-694c87554be1 on n-h1-852771-8 Aug 25 13:52:09.431538 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1c9b2201-d8a6-4e5d-bac9-fc9a6c1ab6cc req-cfb4a09a-38d2-4603-9a06-b0016111c4a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088587 Aug 25 13:52:09.433397 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3053/6047] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:52:09.520235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ba28bd6-d7a8-4a43-81cb-fddd2d24b98b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:09.527714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ba28bd6-d7a8-4a43-81cb-fddd2d24b98b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:09.575451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ba28bd6-d7a8-4a43-81cb-fddd2d24b98b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:09.577541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ba28bd6-d7a8-4a43-81cb-fddd2d24b98b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:09.578378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ba28bd6-d7a8-4a43-81cb-fddd2d24b98b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:09.580258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ba28bd6-d7a8-4a43-81cb-fddd2d24b98b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:09.583324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ba28bd6-d7a8-4a43-81cb-fddd2d24b98b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:09.585618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1ba28bd6-d7a8-4a43-81cb-fddd2d24b98b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:09.837653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1ba28bd6-d7a8-4a43-81cb-fddd2d24b98b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:09.874352 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ba28bd6-d7a8-4a43-81cb-fddd2d24b98b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1188 microversion: 2.1 time: 0.368740 Aug 25 13:52:09.883026 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2995/6048] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:09 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1188 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:10.409543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d2f32f14-94ec-4d95-87a3-01133327e051 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:10.411022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d2f32f14-94ec-4d95-87a3-01133327e051 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:10.422957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2f32f14-94ec-4d95-87a3-01133327e051 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:10.425161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2f32f14-94ec-4d95-87a3-01133327e051 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:10.425919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2f32f14-94ec-4d95-87a3-01133327e051 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:10.427061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2f32f14-94ec-4d95-87a3-01133327e051 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:10.427822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2f32f14-94ec-4d95-87a3-01133327e051 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:10.428472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2f32f14-94ec-4d95-87a3-01133327e051 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:10.832046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d2f32f14-94ec-4d95-87a3-01133327e051 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:10.856582 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d2f32f14-94ec-4d95-87a3-01133327e051 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1375 microversion: 2.1 time: 0.452896 Aug 25 13:52:10.859697 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3054/6049] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:10 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1375 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:10.922740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d5e0d26-1eee-4657-95ce-a78f170c764e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:10.925114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4d5e0d26-1eee-4657-95ce-a78f170c764e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:10.942161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5e0d26-1eee-4657-95ce-a78f170c764e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:10.943564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5e0d26-1eee-4657-95ce-a78f170c764e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:10.944960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5e0d26-1eee-4657-95ce-a78f170c764e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:10.946737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5e0d26-1eee-4657-95ce-a78f170c764e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:10.949182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5e0d26-1eee-4657-95ce-a78f170c764e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:10.951021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d5e0d26-1eee-4657-95ce-a78f170c764e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:11.088777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4d5e0d26-1eee-4657-95ce-a78f170c764e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:11.127872 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4d5e0d26-1eee-4657-95ce-a78f170c764e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1188 microversion: 2.1 time: 0.212927 Aug 25 13:52:11.154566 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2996/6050] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:10 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1188 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:11.889889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-93349333-c663-4c3e-815a-38032340c2fd tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:11.893838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-93349333-c663-4c3e-815a-38032340c2fd tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:11.911264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93349333-c663-4c3e-815a-38032340c2fd tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:11.914168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93349333-c663-4c3e-815a-38032340c2fd tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:11.918390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93349333-c663-4c3e-815a-38032340c2fd tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:11.922878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93349333-c663-4c3e-815a-38032340c2fd tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:11.927549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93349333-c663-4c3e-815a-38032340c2fd tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:11.932844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-93349333-c663-4c3e-815a-38032340c2fd tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:12.175928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-13231e61-faf3-45c5-b830-9fefd5937d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:12.178149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-13231e61-faf3-45c5-b830-9fefd5937d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:12.206632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13231e61-faf3-45c5-b830-9fefd5937d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:12.210220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13231e61-faf3-45c5-b830-9fefd5937d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:12.218469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13231e61-faf3-45c5-b830-9fefd5937d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:12.219997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13231e61-faf3-45c5-b830-9fefd5937d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:12.221028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13231e61-faf3-45c5-b830-9fefd5937d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:12.222000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13231e61-faf3-45c5-b830-9fefd5937d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:12.525052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-13231e61-faf3-45c5-b830-9fefd5937d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:12.542348 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-13231e61-faf3-45c5-b830-9fefd5937d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1188 microversion: 2.1 time: 0.373616 Aug 25 13:52:12.557546 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2997/6051] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:12 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1188 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:12.727997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-93349333-c663-4c3e-815a-38032340c2fd tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:12.747058 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-93349333-c663-4c3e-815a-38032340c2fd tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1546 microversion: 2.1 time: 0.863419 Aug 25 13:52:12.760448 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3055/6052] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:11 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1546 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:12.783573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-de68caec-849b-4244-a450-521eb881e6a8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:12.784395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-de68caec-849b-4244-a450-521eb881e6a8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:12.797435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de68caec-849b-4244-a450-521eb881e6a8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:12.803146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de68caec-849b-4244-a450-521eb881e6a8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:12.803852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de68caec-849b-4244-a450-521eb881e6a8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:12.804781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de68caec-849b-4244-a450-521eb881e6a8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:12.807122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de68caec-849b-4244-a450-521eb881e6a8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:12.809323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-de68caec-849b-4244-a450-521eb881e6a8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:13.574232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:13.575616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:13.592935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:13.596472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:13.598083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:13.600504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:13.601318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:13.602854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:13.686173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:13.686675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:13.693977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:13.695099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lazy-loading 'fault' on Instance uuid 96553438-fc7f-470d-a424-1b7ac2d1ace5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:52:13.974816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-de68caec-849b-4244-a450-521eb881e6a8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:13.982510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:13.990902 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-de68caec-849b-4244-a450-521eb881e6a8 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1546 microversion: 2.1 time: 1.210229 Aug 25 13:52:13.995414 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2998/6053] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:12 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1546 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:14.015173 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b6a21e87-574d-4bad-ba39-1b73185002c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 200 len: 1193 microversion: 2.1 time: 0.445316 Aug 25 13:52:14.030996 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3056/6054] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:13 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 1193 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:15.044765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:15.057748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:15.077842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=14 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:15.092586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:15.094072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:15.095213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:15.100336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:15.101749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:15.106693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:15.148575 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 HTTP/1.1 Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '96553438-fc7f-470d-a424-1b7ac2d1ace5'} Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:52:15.157909 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:52:15.168080 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:52:15.168080 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:52:15.168080 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:52:15.168080 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:52:15.168080 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:52:15.168080 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:15.168080 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:52:15.171556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:52:15.179730 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d5ccd784-2e01-42b0-9d44-1d0e31a4ae00 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 404 len: 111 microversion: 2.1 time: 0.142791 Aug 25 13:52:15.180988 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 2999/6055] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:15 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:52:17.587802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-475090467", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "87a6941d-10cd-4c95-8ef6-1d63afd47c6a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-25629083", "security_groups": [{"name": "tempest-secgroup-smoke-1955729851"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:17.887410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] validate_networks() for [('87a6941d-10cd-4c95-8ef6-1d63afd47c6a', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:52:18.938014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:52:18.939268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:52:18.942730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:52:18.946213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:52:18.948215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:52:18.971313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:18.972253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:18.973019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:18.974330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:18.983205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:18.984619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:19.046939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:52:19.069805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Getting quotas for user ecfd27e7237548f485ae9480d489286a and project 3f2ace59bb66449bb97802fd18379f1a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:52:19.100839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:52:19.110509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:52:19.255402 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-35e3e9d5-f839-4447-91c7-e4d0eacc569c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.674924 Aug 25 13:52:19.264576 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3057/6056] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:52:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:52:19.269263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-29f89625-c92b-4d8d-8c0c-314c46288d5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:19.270834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-29f89625-c92b-4d8d-8c0c-314c46288d5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:19.387580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9a7e6721-f6f6-4a84-bc24-d37591fb8a47 req-f24c6c4b-c33e-4936-ba47-7c64ade1ce5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5575cf32-02bc-41c8-99fc-694c87554be1", "tag": "ba4c2fa1-5645-4524-9e99-d0b3699e471e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:19.413996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9a7e6721-f6f6-4a84-bc24-d37591fb8a47 req-f24c6c4b-c33e-4936-ba47-7c64ade1ce5e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:19.421524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-29f89625-c92b-4d8d-8c0c-314c46288d5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:19.422950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9a7e6721-f6f6-4a84-bc24-d37591fb8a47 req-f24c6c4b-c33e-4936-ba47-7c64ade1ce5e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:19.424929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9a7e6721-f6f6-4a84-bc24-d37591fb8a47 req-f24c6c4b-c33e-4936-ba47-7c64ade1ce5e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:19.452197 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-29f89625-c92b-4d8d-8c0c-314c46288d5b tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1264 microversion: 2.1 time: 0.164986 Aug 25 13:52:19.454927 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3000/6057] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:19 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:19.486236 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9a7e6721-f6f6-4a84-bc24-d37591fb8a47 req-f24c6c4b-c33e-4936-ba47-7c64ade1ce5e service nova] Creating event network-changed:ba4c2fa1-5645-4524-9e99-d0b3699e471e for instance 5575cf32-02bc-41c8-99fc-694c87554be1 on n-h1-852771-8 Aug 25 13:52:19.510662 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9a7e6721-f6f6-4a84-bc24-d37591fb8a47 req-f24c6c4b-c33e-4936-ba47-7c64ade1ce5e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128053 Aug 25 13:52:19.512458 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3058/6058] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:52:20.477193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dca0e045-d77e-40bb-a3a7-28f0a90fc991 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:20.478568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dca0e045-d77e-40bb-a3a7-28f0a90fc991 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:20.512616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:20.714013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dca0e045-d77e-40bb-a3a7-28f0a90fc991 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:20.724532 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dca0e045-d77e-40bb-a3a7-28f0a90fc991 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1264 microversion: 2.1 time: 0.252081 Aug 25 13:52:20.725843 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3001/6059] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:20 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:21.074977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:21.076972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:21.099629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:21.108542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:21.109950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:21.111294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:21.112861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:21.114023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:21.115095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:21.163774 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 HTTP/1.1 Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '96553438-fc7f-470d-a424-1b7ac2d1ace5'} Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:52:21.168300 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:21.180584 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:52:21.192642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:52:21.194773 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-81df3d50-c28d-4b88-a5ea-ae58d86fd9c9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 404 len: 111 microversion: 2.1 time: 0.135080 Aug 25 13:52:21.199850 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3059/6060] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:52:21 2022] DELETE /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:52:21.215913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:21.216683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 96553438-fc7f-470d-a424-1b7ac2d1ace5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:21.233340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:21.233928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:21.234409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:21.235118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:21.235599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:21.236039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:21.270061 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 HTTP/1.1 Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '96553438-fc7f-470d-a424-1b7ac2d1ace5'} Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:52:21.271875 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:52:21.277867 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:52:21.277867 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:52:21.277867 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:52:21.277867 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:52:21.277867 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:52:21.277867 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. Aug 25 13:52:21.277867 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:52:21.277867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 96553438-fc7f-470d-a424-1b7ac2d1ace5 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:52:21.277867 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6b0b83d2-1b0a-4b2b-9942-739f9ca1be2e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5" status: 404 len: 111 microversion: 2.1 time: 0.068758 Aug 25 13:52:21.277867 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3002/6061] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:21 2022] GET /compute/v2.1/servers/96553438-fc7f-470d-a424-1b7ac2d1ace5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:52:21.765031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fcda8871-970b-4a55-bd76-6da5fb8298af tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:21.767659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fcda8871-970b-4a55-bd76-6da5fb8298af tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:21.786923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcda8871-970b-4a55-bd76-6da5fb8298af tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:21.789542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcda8871-970b-4a55-bd76-6da5fb8298af tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:21.791355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcda8871-970b-4a55-bd76-6da5fb8298af tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:21.792289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcda8871-970b-4a55-bd76-6da5fb8298af tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:21.793879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcda8871-970b-4a55-bd76-6da5fb8298af tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:21.795304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fcda8871-970b-4a55-bd76-6da5fb8298af tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:22.152747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fcda8871-970b-4a55-bd76-6da5fb8298af tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:22.165337 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fcda8871-970b-4a55-bd76-6da5fb8298af tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1334 microversion: 2.1 time: 0.409796 Aug 25 13:52:22.178775 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3060/6062] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:21 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1334 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:23.206035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-101c5596-ff79-4b17-a7d5-93525a67e879 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:23.206673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-101c5596-ff79-4b17-a7d5-93525a67e879 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:23.223108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-101c5596-ff79-4b17-a7d5-93525a67e879 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:23.223984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-101c5596-ff79-4b17-a7d5-93525a67e879 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:23.224797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-101c5596-ff79-4b17-a7d5-93525a67e879 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:23.226056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-101c5596-ff79-4b17-a7d5-93525a67e879 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:23.226740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-101c5596-ff79-4b17-a7d5-93525a67e879 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:23.227476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-101c5596-ff79-4b17-a7d5-93525a67e879 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:23.667068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-101c5596-ff79-4b17-a7d5-93525a67e879 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:23.677962 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-101c5596-ff79-4b17-a7d5-93525a67e879 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1390 microversion: 2.1 time: 0.476487 Aug 25 13:52:23.678588 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3003/6063] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:23 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1390 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:24.454582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8d93da68-679b-42c3-ba42-dfb6a1c7435b req-21eed3c6-08b8-4ee1-bef5-ae6f598c8039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa4a96f-0b26-42e7-880d-63af3734aa76", "tag": "1d2dcd29-a6ca-4cba-bfaa-8229d9209c53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:24.471249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8d93da68-679b-42c3-ba42-dfb6a1c7435b req-21eed3c6-08b8-4ee1-bef5-ae6f598c8039 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:24.472086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8d93da68-679b-42c3-ba42-dfb6a1c7435b req-21eed3c6-08b8-4ee1-bef5-ae6f598c8039 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:24.472598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8d93da68-679b-42c3-ba42-dfb6a1c7435b req-21eed3c6-08b8-4ee1-bef5-ae6f598c8039 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:24.506271 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8d93da68-679b-42c3-ba42-dfb6a1c7435b req-21eed3c6-08b8-4ee1-bef5-ae6f598c8039 service nova] Creating event network-changed:1d2dcd29-a6ca-4cba-bfaa-8229d9209c53 for instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 on n-h2-852771-8 Aug 25 13:52:24.515574 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8d93da68-679b-42c3-ba42-dfb6a1c7435b req-21eed3c6-08b8-4ee1-bef5-ae6f598c8039 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066534 Aug 25 13:52:24.516532 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3061/6064] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:52:24.701562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0ab1ab31-8df5-4aba-b8e6-e181dea33213 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:24.702896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ab1ab31-8df5-4aba-b8e6-e181dea33213 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:24.729970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab1ab31-8df5-4aba-b8e6-e181dea33213 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:24.730651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab1ab31-8df5-4aba-b8e6-e181dea33213 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:24.731178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab1ab31-8df5-4aba-b8e6-e181dea33213 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:24.732142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab1ab31-8df5-4aba-b8e6-e181dea33213 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:24.732788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab1ab31-8df5-4aba-b8e6-e181dea33213 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:24.733456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab1ab31-8df5-4aba-b8e6-e181dea33213 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:24.967722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ab1ab31-8df5-4aba-b8e6-e181dea33213 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:24.977340 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0ab1ab31-8df5-4aba-b8e6-e181dea33213 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1390 microversion: 2.1 time: 0.279747 Aug 25 13:52:24.990341 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3004/6065] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:24 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1390 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:26.021354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d34fbe57-20c0-404e-8ad9-c60ed3e193f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:26.022512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d34fbe57-20c0-404e-8ad9-c60ed3e193f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:26.046054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d34fbe57-20c0-404e-8ad9-c60ed3e193f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:26.046565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d34fbe57-20c0-404e-8ad9-c60ed3e193f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:26.047013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d34fbe57-20c0-404e-8ad9-c60ed3e193f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:26.047919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d34fbe57-20c0-404e-8ad9-c60ed3e193f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:26.048636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d34fbe57-20c0-404e-8ad9-c60ed3e193f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:26.049271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d34fbe57-20c0-404e-8ad9-c60ed3e193f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:26.089056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:26.272356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d34fbe57-20c0-404e-8ad9-c60ed3e193f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:26.283421 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d34fbe57-20c0-404e-8ad9-c60ed3e193f9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1390 microversion: 2.1 time: 0.283057 Aug 25 13:52:26.289566 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3062/6066] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:25 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1390 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:27.308408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1083d6c9-fc5c-416d-bac4-5221d7418abb tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:27.309025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1083d6c9-fc5c-416d-bac4-5221d7418abb tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:27.319851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1083d6c9-fc5c-416d-bac4-5221d7418abb tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:27.320347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1083d6c9-fc5c-416d-bac4-5221d7418abb tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:27.320830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1083d6c9-fc5c-416d-bac4-5221d7418abb tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:27.322546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1083d6c9-fc5c-416d-bac4-5221d7418abb tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:27.323225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1083d6c9-fc5c-416d-bac4-5221d7418abb tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:27.323900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1083d6c9-fc5c-416d-bac4-5221d7418abb tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:27.562773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1083d6c9-fc5c-416d-bac4-5221d7418abb tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:27.571180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:27.575928 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1083d6c9-fc5c-416d-bac4-5221d7418abb tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1390 microversion: 2.1 time: 0.271719 Aug 25 13:52:27.586670 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3005/6067] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:27 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1390 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:28.606366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-59c9a084-2a64-40c7-8938-57a282afc3cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:28.608511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-59c9a084-2a64-40c7-8938-57a282afc3cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:28.630506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c9a084-2a64-40c7-8938-57a282afc3cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:28.632577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c9a084-2a64-40c7-8938-57a282afc3cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:28.634913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c9a084-2a64-40c7-8938-57a282afc3cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:28.636815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c9a084-2a64-40c7-8938-57a282afc3cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:28.637448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c9a084-2a64-40c7-8938-57a282afc3cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:28.639447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59c9a084-2a64-40c7-8938-57a282afc3cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:28.952215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-59c9a084-2a64-40c7-8938-57a282afc3cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:28.967016 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-59c9a084-2a64-40c7-8938-57a282afc3cf tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1390 microversion: 2.1 time: 0.368774 Aug 25 13:52:28.968088 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3063/6068] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:28 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1390 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:29.991838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eafdf4c1-6d88-439b-abc5-acb71854ce70 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:29.992243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eafdf4c1-6d88-439b-abc5-acb71854ce70 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:30.005969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eafdf4c1-6d88-439b-abc5-acb71854ce70 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:30.006698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eafdf4c1-6d88-439b-abc5-acb71854ce70 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:30.007877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eafdf4c1-6d88-439b-abc5-acb71854ce70 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:30.009304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eafdf4c1-6d88-439b-abc5-acb71854ce70 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:30.009989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eafdf4c1-6d88-439b-abc5-acb71854ce70 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:30.010606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eafdf4c1-6d88-439b-abc5-acb71854ce70 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:30.199607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eafdf4c1-6d88-439b-abc5-acb71854ce70 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:30.209686 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eafdf4c1-6d88-439b-abc5-acb71854ce70 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1390 microversion: 2.1 time: 0.222076 Aug 25 13:52:30.211027 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3006/6069] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:29 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1390 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:52:30.411163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5f86eb48-712c-40ce-963a-2f85adc0ea5f req-42a48bb5-ad68-469a-b3fd-1a7591ce7200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa4a96f-0b26-42e7-880d-63af3734aa76", "name": "network-vif-plugged", "status": "completed", "tag": "1d2dcd29-a6ca-4cba-bfaa-8229d9209c53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:30.429934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:30.431531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:30.441097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5f86eb48-712c-40ce-963a-2f85adc0ea5f req-42a48bb5-ad68-469a-b3fd-1a7591ce7200 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:30.442064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5f86eb48-712c-40ce-963a-2f85adc0ea5f req-42a48bb5-ad68-469a-b3fd-1a7591ce7200 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:30.442694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5f86eb48-712c-40ce-963a-2f85adc0ea5f req-42a48bb5-ad68-469a-b3fd-1a7591ce7200 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:30.458176 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5f86eb48-712c-40ce-963a-2f85adc0ea5f req-42a48bb5-ad68-469a-b3fd-1a7591ce7200 service nova] Creating event network-vif-plugged:1d2dcd29-a6ca-4cba-bfaa-8229d9209c53 for instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 on n-h2-852771-8 Aug 25 13:52:30.465260 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5f86eb48-712c-40ce-963a-2f85adc0ea5f req-42a48bb5-ad68-469a-b3fd-1a7591ce7200 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057940 Aug 25 13:52:30.466276 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3064/6070] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:52:31.233419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-33c1a67e-9bc4-4c68-a80f-2176fddfa6b9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:31.234116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-33c1a67e-9bc4-4c68-a80f-2176fddfa6b9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:31.236440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:31.244612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33c1a67e-9bc4-4c68-a80f-2176fddfa6b9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:31.245334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33c1a67e-9bc4-4c68-a80f-2176fddfa6b9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:31.246063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33c1a67e-9bc4-4c68-a80f-2176fddfa6b9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:31.246965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33c1a67e-9bc4-4c68-a80f-2176fddfa6b9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:31.247446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33c1a67e-9bc4-4c68-a80f-2176fddfa6b9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:31.247891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-33c1a67e-9bc4-4c68-a80f-2176fddfa6b9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:31.426605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-33c1a67e-9bc4-4c68-a80f-2176fddfa6b9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:31.436099 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-33c1a67e-9bc4-4c68-a80f-2176fddfa6b9 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1390 microversion: 2.1 time: 0.206650 Aug 25 13:52:31.436694 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3007/6071] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:31 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1390 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:32.473569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9d3c6e4-bba6-4a26-a2bf-f7fe5c208171 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:32.474497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c9d3c6e4-bba6-4a26-a2bf-f7fe5c208171 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:32.483459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9d3c6e4-bba6-4a26-a2bf-f7fe5c208171 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:32.484182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9d3c6e4-bba6-4a26-a2bf-f7fe5c208171 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:32.485007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9d3c6e4-bba6-4a26-a2bf-f7fe5c208171 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:32.485865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9d3c6e4-bba6-4a26-a2bf-f7fe5c208171 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:32.486223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9d3c6e4-bba6-4a26-a2bf-f7fe5c208171 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:32.486653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9d3c6e4-bba6-4a26-a2bf-f7fe5c208171 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:32.696849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c9d3c6e4-bba6-4a26-a2bf-f7fe5c208171 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:32.706931 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9d3c6e4-bba6-4a26-a2bf-f7fe5c208171 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1562 microversion: 2.1 time: 0.252472 Aug 25 13:52:32.721535 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3065/6072] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:32 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1562 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:32.729272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f68eee4c-d5de-4dc7-9d67-02c667f8d738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:32.729930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f68eee4c-d5de-4dc7-9d67-02c667f8d738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:32.738513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f68eee4c-d5de-4dc7-9d67-02c667f8d738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:32.739365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f68eee4c-d5de-4dc7-9d67-02c667f8d738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:32.740177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f68eee4c-d5de-4dc7-9d67-02c667f8d738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:32.741381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f68eee4c-d5de-4dc7-9d67-02c667f8d738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:32.741879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f68eee4c-d5de-4dc7-9d67-02c667f8d738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:32.742437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f68eee4c-d5de-4dc7-9d67-02c667f8d738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:32.909621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f68eee4c-d5de-4dc7-9d67-02c667f8d738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:32.919018 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f68eee4c-d5de-4dc7-9d67-02c667f8d738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1562 microversion: 2.1 time: 0.193686 Aug 25 13:52:32.919609 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3008/6073] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:32 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1562 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:35.380775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b281d48e-8693-4112-be5c-634b61369bc6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:35.381853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b281d48e-8693-4112-be5c-634b61369bc6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:35.397143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b281d48e-8693-4112-be5c-634b61369bc6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:35.398667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b281d48e-8693-4112-be5c-634b61369bc6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:35.401852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b281d48e-8693-4112-be5c-634b61369bc6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:35.402879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b281d48e-8693-4112-be5c-634b61369bc6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:35.403516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b281d48e-8693-4112-be5c-634b61369bc6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:35.404264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b281d48e-8693-4112-be5c-634b61369bc6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:35.528795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f4038170-3d91-4b11-9596-6e457677c4e7 req-07113e66-9fd2-4382-963b-1429d58b3019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa4a96f-0b26-42e7-880d-63af3734aa76", "tag": "1d2dcd29-a6ca-4cba-bfaa-8229d9209c53"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:35.544706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f4038170-3d91-4b11-9596-6e457677c4e7 req-07113e66-9fd2-4382-963b-1429d58b3019 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:35.546036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f4038170-3d91-4b11-9596-6e457677c4e7 req-07113e66-9fd2-4382-963b-1429d58b3019 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:35.546036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f4038170-3d91-4b11-9596-6e457677c4e7 req-07113e66-9fd2-4382-963b-1429d58b3019 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:35.584757 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f4038170-3d91-4b11-9596-6e457677c4e7 req-07113e66-9fd2-4382-963b-1429d58b3019 service nova] Creating event network-changed:1d2dcd29-a6ca-4cba-bfaa-8229d9209c53 for instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 on n-h2-852771-8 Aug 25 13:52:35.593881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b281d48e-8693-4112-be5c-634b61369bc6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:35.594085 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f4038170-3d91-4b11-9596-6e457677c4e7 req-07113e66-9fd2-4382-963b-1429d58b3019 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214813 Aug 25 13:52:35.594875 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3009/6074] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:52:35.611262 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b281d48e-8693-4112-be5c-634b61369bc6 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1562 microversion: 2.1 time: 0.234272 Aug 25 13:52:35.620447 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3066/6075] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:35 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:47.627702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=19 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:47.629718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=20 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:47.637051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d3da7a6-a823-4859-96e7-fc57e7e495a3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:47.637051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8d3da7a6-a823-4859-96e7-fc57e7e495a3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:47.653808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3da7a6-a823-4859-96e7-fc57e7e495a3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:47.654632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3da7a6-a823-4859-96e7-fc57e7e495a3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:47.657125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3da7a6-a823-4859-96e7-fc57e7e495a3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:47.658520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3da7a6-a823-4859-96e7-fc57e7e495a3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:47.659565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3da7a6-a823-4859-96e7-fc57e7e495a3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:47.660381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3da7a6-a823-4859-96e7-fc57e7e495a3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:47.749787 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d3da7a6-a823-4859-96e7-fc57e7e495a3 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "POST /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1/action" status: 200 len: 24573 microversion: 2.1 time: 0.123856 Aug 25 13:52:47.750868 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3010/6076] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:52:47 2022] POST /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1/action => generated 24573 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:52:49.440331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-830546911", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "82289a20-96fa-477f-acc3-fc8ac3ca7abf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f9216295-ead7-4063-84e8-342351244740"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:49.453234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=15 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:49.454013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=22 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:49.513053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] validate_networks() for [('f9216295-ead7-4063-84e8-342351244740', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:52:49.965911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:52:49.966647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:52:49.971553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:52:49.972258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:52:49.972689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:52:49.983309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:49.983798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:49.984730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:49.985127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:49.985602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:49.986058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:50.004929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:52:50.012312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for user 93fbad0b63d14f3fb12de08d966bffad and project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:52:50.085494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:52:50.089163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82289a20-96fa-477f-acc3-fc8ac3ca7abf',volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:52:50.239627 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a745112-ec7d-4fa8-8781-f873acf3f38d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804571 Aug 25 13:52:50.240413 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3067/6077] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:52:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:52:50.253259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e030163d-a066-4ad6-bfe6-10f27e248f41 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:50.254185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e030163d-a066-4ad6-bfe6-10f27e248f41 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:50.333836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e030163d-a066-4ad6-bfe6-10f27e248f41 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:50.342274 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e030163d-a066-4ad6-bfe6-10f27e248f41 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1070 microversion: 2.1 time: 0.093863 Aug 25 13:52:50.342864 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3011/6078] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:50 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1070 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:52:51.364614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-869098bb-2fb1-4390-8ab4-e0b51a55c297 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:51.366184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-869098bb-2fb1-4390-8ab4-e0b51a55c297 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:51.379840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869098bb-2fb1-4390-8ab4-e0b51a55c297 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:51.380687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869098bb-2fb1-4390-8ab4-e0b51a55c297 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:51.381386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869098bb-2fb1-4390-8ab4-e0b51a55c297 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:51.383915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869098bb-2fb1-4390-8ab4-e0b51a55c297 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:51.384477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869098bb-2fb1-4390-8ab4-e0b51a55c297 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:51.384912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-869098bb-2fb1-4390-8ab4-e0b51a55c297 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:51.461776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-869098bb-2fb1-4390-8ab4-e0b51a55c297 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:51.471020 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-869098bb-2fb1-4390-8ab4-e0b51a55c297 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1186 microversion: 2.1 time: 0.111244 Aug 25 13:52:51.472385 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3068/6079] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:51 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1186 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:52.495923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-40cdeec4-50c2-48b4-9a8d-e07e443ce501 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:52.496641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-40cdeec4-50c2-48b4-9a8d-e07e443ce501 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:52.505676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cdeec4-50c2-48b4-9a8d-e07e443ce501 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:52.506878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cdeec4-50c2-48b4-9a8d-e07e443ce501 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:52.507600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cdeec4-50c2-48b4-9a8d-e07e443ce501 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:52.508601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cdeec4-50c2-48b4-9a8d-e07e443ce501 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:52.509298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cdeec4-50c2-48b4-9a8d-e07e443ce501 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:52.510019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40cdeec4-50c2-48b4-9a8d-e07e443ce501 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:52.683146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-40cdeec4-50c2-48b4-9a8d-e07e443ce501 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:52.696204 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-40cdeec4-50c2-48b4-9a8d-e07e443ce501 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1228 microversion: 2.1 time: 0.206063 Aug 25 13:52:52.697224 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3012/6080] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:52 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1228 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:53.003938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-59d1ec5b-1ede-47ef-9b20-1d0a172ce5b0 req-2895f53a-0e95-435d-a832-f03e35fa6d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0275ad9f-2318-4002-8576-66cbace22bdb", "tag": "aed9b9c0-f776-4a87-bdea-b3f1bb6327e2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:53.022318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-59d1ec5b-1ede-47ef-9b20-1d0a172ce5b0 req-2895f53a-0e95-435d-a832-f03e35fa6d84 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:53.022966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-59d1ec5b-1ede-47ef-9b20-1d0a172ce5b0 req-2895f53a-0e95-435d-a832-f03e35fa6d84 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:53.023561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-59d1ec5b-1ede-47ef-9b20-1d0a172ce5b0 req-2895f53a-0e95-435d-a832-f03e35fa6d84 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:53.037851 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-59d1ec5b-1ede-47ef-9b20-1d0a172ce5b0 req-2895f53a-0e95-435d-a832-f03e35fa6d84 service nova] Creating event network-changed:aed9b9c0-f776-4a87-bdea-b3f1bb6327e2 for instance 0275ad9f-2318-4002-8576-66cbace22bdb on n-h2-852771-8 Aug 25 13:52:53.053562 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-59d1ec5b-1ede-47ef-9b20-1d0a172ce5b0 req-2895f53a-0e95-435d-a832-f03e35fa6d84 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061070 Aug 25 13:52:53.067096 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3069/6081] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:52:53.718102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-88a3127f-576b-4623-9f23-d4b4535726c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:53.719039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-88a3127f-576b-4623-9f23-d4b4535726c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:53.726818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88a3127f-576b-4623-9f23-d4b4535726c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:53.727410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88a3127f-576b-4623-9f23-d4b4535726c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:53.727872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88a3127f-576b-4623-9f23-d4b4535726c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:53.728986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88a3127f-576b-4623-9f23-d4b4535726c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:53.729881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88a3127f-576b-4623-9f23-d4b4535726c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:53.730321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88a3127f-576b-4623-9f23-d4b4535726c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:53.905794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-88a3127f-576b-4623-9f23-d4b4535726c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:53.919559 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-88a3127f-576b-4623-9f23-d4b4535726c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1228 microversion: 2.1 time: 0.205017 Aug 25 13:52:53.920521 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3013/6082] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:53 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1228 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:54.942756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ab0c433-f38b-4165-a93c-270483b0c082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:54.943728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7ab0c433-f38b-4165-a93c-270483b0c082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:54.952804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab0c433-f38b-4165-a93c-270483b0c082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:54.953292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab0c433-f38b-4165-a93c-270483b0c082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:54.953761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab0c433-f38b-4165-a93c-270483b0c082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:54.954474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab0c433-f38b-4165-a93c-270483b0c082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:54.954927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab0c433-f38b-4165-a93c-270483b0c082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:54.955350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ab0c433-f38b-4165-a93c-270483b0c082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:55.121144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7ab0c433-f38b-4165-a93c-270483b0c082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:55.130242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ab0c433-f38b-4165-a93c-270483b0c082 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1228 microversion: 2.1 time: 0.191731 Aug 25 13:52:55.141875 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3070/6083] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:54 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1228 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:56.160304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-efb15e87-952b-4a2c-bd49-5081fd9efce1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:56.161861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-efb15e87-952b-4a2c-bd49-5081fd9efce1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:56.171131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb15e87-952b-4a2c-bd49-5081fd9efce1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:56.171774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb15e87-952b-4a2c-bd49-5081fd9efce1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:56.172305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb15e87-952b-4a2c-bd49-5081fd9efce1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:56.173101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb15e87-952b-4a2c-bd49-5081fd9efce1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:56.173678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb15e87-952b-4a2c-bd49-5081fd9efce1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:56.174189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-efb15e87-952b-4a2c-bd49-5081fd9efce1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:56.315751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-efb15e87-952b-4a2c-bd49-5081fd9efce1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:56.325971 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-efb15e87-952b-4a2c-bd49-5081fd9efce1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1228 microversion: 2.1 time: 0.173897 Aug 25 13:52:56.326579 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3014/6084] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:56 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1228 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:57.347924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-385701c9-45b6-4eee-a354-5447def85443 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:57.348540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-385701c9-45b6-4eee-a354-5447def85443 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:57.356758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385701c9-45b6-4eee-a354-5447def85443 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:57.357253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385701c9-45b6-4eee-a354-5447def85443 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:57.357733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385701c9-45b6-4eee-a354-5447def85443 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:57.358445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385701c9-45b6-4eee-a354-5447def85443 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:57.358910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385701c9-45b6-4eee-a354-5447def85443 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:57.359338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385701c9-45b6-4eee-a354-5447def85443 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:57.515779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-385701c9-45b6-4eee-a354-5447def85443 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:57.525122 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-385701c9-45b6-4eee-a354-5447def85443 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1228 microversion: 2.1 time: 0.181336 Aug 25 13:52:57.525786 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3071/6085] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:57 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1228 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:58.548678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e5faf5e2-2cb7-4105-95b3-adf133b44212 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:58.549398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e5faf5e2-2cb7-4105-95b3-adf133b44212 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:58.558370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5faf5e2-2cb7-4105-95b3-adf133b44212 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:58.558976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5faf5e2-2cb7-4105-95b3-adf133b44212 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:58.559508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5faf5e2-2cb7-4105-95b3-adf133b44212 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:58.561385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5faf5e2-2cb7-4105-95b3-adf133b44212 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:58.561385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5faf5e2-2cb7-4105-95b3-adf133b44212 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:58.561385 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5faf5e2-2cb7-4105-95b3-adf133b44212 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:58.738881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e5faf5e2-2cb7-4105-95b3-adf133b44212 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:58.751885 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e5faf5e2-2cb7-4105-95b3-adf133b44212 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1228 microversion: 2.1 time: 0.208257 Aug 25 13:52:58.752801 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3015/6086] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:58 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1228 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:59.774732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c65092b2-ed00-427b-982d-a10b5e9f2ee7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:59.775630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c65092b2-ed00-427b-982d-a10b5e9f2ee7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:59.783533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c65092b2-ed00-427b-982d-a10b5e9f2ee7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:59.784152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c65092b2-ed00-427b-982d-a10b5e9f2ee7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:59.784699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c65092b2-ed00-427b-982d-a10b5e9f2ee7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:59.785556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c65092b2-ed00-427b-982d-a10b5e9f2ee7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:59.786098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c65092b2-ed00-427b-982d-a10b5e9f2ee7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:59.786625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c65092b2-ed00-427b-982d-a10b5e9f2ee7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:59.963802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c65092b2-ed00-427b-982d-a10b5e9f2ee7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:59.975158 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c65092b2-ed00-427b-982d-a10b5e9f2ee7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1228 microversion: 2.1 time: 0.204893 Aug 25 13:52:59.976138 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3072/6087] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:59 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1228 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:01.001006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-21ab9c09-7b40-4ee6-a1cc-2621559b9a77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:01.002126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-21ab9c09-7b40-4ee6-a1cc-2621559b9a77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:01.011065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:01.017783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21ab9c09-7b40-4ee6-a1cc-2621559b9a77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:01.018533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21ab9c09-7b40-4ee6-a1cc-2621559b9a77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:01.019069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21ab9c09-7b40-4ee6-a1cc-2621559b9a77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:01.019923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21ab9c09-7b40-4ee6-a1cc-2621559b9a77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:01.020509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21ab9c09-7b40-4ee6-a1cc-2621559b9a77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:01.021063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-21ab9c09-7b40-4ee6-a1cc-2621559b9a77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:01.241970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-21ab9c09-7b40-4ee6-a1cc-2621559b9a77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:01.256513 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-21ab9c09-7b40-4ee6-a1cc-2621559b9a77 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.261920 Aug 25 13:53:01.257797 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3016/6088] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:00 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:02.288761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12a75e00-f99d-4363-9714-501ef4588b98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:02.289990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12a75e00-f99d-4363-9714-501ef4588b98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:02.292726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:02.293901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:02.308179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a75e00-f99d-4363-9714-501ef4588b98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:02.308993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a75e00-f99d-4363-9714-501ef4588b98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:02.309767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a75e00-f99d-4363-9714-501ef4588b98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:02.311140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a75e00-f99d-4363-9714-501ef4588b98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:02.311791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a75e00-f99d-4363-9714-501ef4588b98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:02.312534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12a75e00-f99d-4363-9714-501ef4588b98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:02.511961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12a75e00-f99d-4363-9714-501ef4588b98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:02.521142 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12a75e00-f99d-4363-9714-501ef4588b98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.237367 Aug 25 13:53:02.521742 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3073/6089] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:02 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:03.547414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d79b7e76-9542-4381-aa6a-b76b5d619302 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:03.548558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d79b7e76-9542-4381-aa6a-b76b5d619302 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:03.566106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d79b7e76-9542-4381-aa6a-b76b5d619302 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:03.567080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d79b7e76-9542-4381-aa6a-b76b5d619302 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:03.567908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d79b7e76-9542-4381-aa6a-b76b5d619302 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:03.570253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d79b7e76-9542-4381-aa6a-b76b5d619302 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:03.571175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d79b7e76-9542-4381-aa6a-b76b5d619302 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:03.571984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d79b7e76-9542-4381-aa6a-b76b5d619302 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:03.793195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d79b7e76-9542-4381-aa6a-b76b5d619302 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:03.804625 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d79b7e76-9542-4381-aa6a-b76b5d619302 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.264444 Aug 25 13:53:03.805586 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3017/6090] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:03 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:04.841145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-00d7db1d-6eab-46db-9ac7-76c79ea3951e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:04.841882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-00d7db1d-6eab-46db-9ac7-76c79ea3951e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:04.850128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00d7db1d-6eab-46db-9ac7-76c79ea3951e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:04.851648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00d7db1d-6eab-46db-9ac7-76c79ea3951e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:04.853289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00d7db1d-6eab-46db-9ac7-76c79ea3951e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:04.854074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00d7db1d-6eab-46db-9ac7-76c79ea3951e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:04.854850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00d7db1d-6eab-46db-9ac7-76c79ea3951e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:04.856165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00d7db1d-6eab-46db-9ac7-76c79ea3951e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:05.060873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-00d7db1d-6eab-46db-9ac7-76c79ea3951e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:05.072906 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-00d7db1d-6eab-46db-9ac7-76c79ea3951e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.247748 Aug 25 13:53:05.073571 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3074/6091] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:04 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:06.099335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-047d27d4-9e6a-4300-a164-dd7feff7ebd0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:06.100211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-047d27d4-9e6a-4300-a164-dd7feff7ebd0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:06.107776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-047d27d4-9e6a-4300-a164-dd7feff7ebd0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:06.108289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-047d27d4-9e6a-4300-a164-dd7feff7ebd0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:06.108838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-047d27d4-9e6a-4300-a164-dd7feff7ebd0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:06.109632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-047d27d4-9e6a-4300-a164-dd7feff7ebd0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:06.110169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-047d27d4-9e6a-4300-a164-dd7feff7ebd0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:06.110660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-047d27d4-9e6a-4300-a164-dd7feff7ebd0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:06.321778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-047d27d4-9e6a-4300-a164-dd7feff7ebd0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:06.338374 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-047d27d4-9e6a-4300-a164-dd7feff7ebd0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.245259 Aug 25 13:53:06.339197 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3018/6092] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:06 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:07.378220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-848cc5c6-f41a-48ae-b903-25c044916bdf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:07.379110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-848cc5c6-f41a-48ae-b903-25c044916bdf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:07.390476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848cc5c6-f41a-48ae-b903-25c044916bdf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:07.391355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848cc5c6-f41a-48ae-b903-25c044916bdf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:07.392158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848cc5c6-f41a-48ae-b903-25c044916bdf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:07.393485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848cc5c6-f41a-48ae-b903-25c044916bdf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:07.394664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848cc5c6-f41a-48ae-b903-25c044916bdf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:07.395441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848cc5c6-f41a-48ae-b903-25c044916bdf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:07.630106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-848cc5c6-f41a-48ae-b903-25c044916bdf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:07.640563 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-848cc5c6-f41a-48ae-b903-25c044916bdf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.268682 Aug 25 13:53:07.641179 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3075/6093] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:07 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:08.252972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1bc3804f-336b-4b67-96a0-05e912aa9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:08.256641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1bc3804f-336b-4b67-96a0-05e912aa9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:08.267549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bc3804f-336b-4b67-96a0-05e912aa9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:08.268023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bc3804f-336b-4b67-96a0-05e912aa9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:08.269118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bc3804f-336b-4b67-96a0-05e912aa9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:08.270816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bc3804f-336b-4b67-96a0-05e912aa9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:08.271350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bc3804f-336b-4b67-96a0-05e912aa9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:08.272117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bc3804f-336b-4b67-96a0-05e912aa9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:08.339433 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1bc3804f-336b-4b67-96a0-05e912aa9309 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76/action" status: 200 len: 24569 microversion: 2.1 time: 0.270315 Aug 25 13:53:08.340257 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3019/6094] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:53:08 2022] POST /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76/action => generated 24569 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:53:08.674807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ba3b974f-b92c-400e-9761-3de05f5409d0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:08.675639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ba3b974f-b92c-400e-9761-3de05f5409d0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:08.684270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba3b974f-b92c-400e-9761-3de05f5409d0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:08.684859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba3b974f-b92c-400e-9761-3de05f5409d0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:08.685382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba3b974f-b92c-400e-9761-3de05f5409d0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:08.686267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba3b974f-b92c-400e-9761-3de05f5409d0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:08.686769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba3b974f-b92c-400e-9761-3de05f5409d0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:08.687290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba3b974f-b92c-400e-9761-3de05f5409d0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:08.901618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ba3b974f-b92c-400e-9761-3de05f5409d0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:08.915690 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ba3b974f-b92c-400e-9761-3de05f5409d0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.245377 Aug 25 13:53:08.916471 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3076/6095] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:08 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:09.943705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0dbb493c-89ed-4249-bb89-fb06985f43f4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:09.946469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0dbb493c-89ed-4249-bb89-fb06985f43f4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:09.959856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dbb493c-89ed-4249-bb89-fb06985f43f4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:09.961014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dbb493c-89ed-4249-bb89-fb06985f43f4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:09.962032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dbb493c-89ed-4249-bb89-fb06985f43f4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:09.963419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dbb493c-89ed-4249-bb89-fb06985f43f4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:09.964408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dbb493c-89ed-4249-bb89-fb06985f43f4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:09.965500 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0dbb493c-89ed-4249-bb89-fb06985f43f4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:10.212292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0dbb493c-89ed-4249-bb89-fb06985f43f4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:10.229389 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0dbb493c-89ed-4249-bb89-fb06985f43f4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.293246 Aug 25 13:53:10.230050 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3020/6096] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:09 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:11.266819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-99f92654-078b-4be1-b296-f491781caa18 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:11.267530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-99f92654-078b-4be1-b296-f491781caa18 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:11.278225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99f92654-078b-4be1-b296-f491781caa18 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:11.279434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99f92654-078b-4be1-b296-f491781caa18 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:11.279434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99f92654-078b-4be1-b296-f491781caa18 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:11.280213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99f92654-078b-4be1-b296-f491781caa18 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:11.280678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99f92654-078b-4be1-b296-f491781caa18 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:11.281119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99f92654-078b-4be1-b296-f491781caa18 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:11.457020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-99f92654-078b-4be1-b296-f491781caa18 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:11.471002 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-99f92654-078b-4be1-b296-f491781caa18 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.211544 Aug 25 13:53:11.471583 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3077/6097] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:11 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:12.497420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b4345ba9-b8bf-42c8-ab85-87e0dea0bfd7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:12.503740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b4345ba9-b8bf-42c8-ab85-87e0dea0bfd7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:12.521207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4345ba9-b8bf-42c8-ab85-87e0dea0bfd7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:12.521773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4345ba9-b8bf-42c8-ab85-87e0dea0bfd7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:12.522810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4345ba9-b8bf-42c8-ab85-87e0dea0bfd7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:12.523782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4345ba9-b8bf-42c8-ab85-87e0dea0bfd7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:12.524247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4345ba9-b8bf-42c8-ab85-87e0dea0bfd7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:12.524709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4345ba9-b8bf-42c8-ab85-87e0dea0bfd7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:12.629108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1a0fde01-952a-4885-856f-8506a7c978f5 req-81bd689d-bb0a-4bc3-856c-6be7017ed6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0275ad9f-2318-4002-8576-66cbace22bdb", "name": "network-vif-plugged", "status": "completed", "tag": "aed9b9c0-f776-4a87-bdea-b3f1bb6327e2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:12.646143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a0fde01-952a-4885-856f-8506a7c978f5 req-81bd689d-bb0a-4bc3-856c-6be7017ed6be service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:12.646638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a0fde01-952a-4885-856f-8506a7c978f5 req-81bd689d-bb0a-4bc3-856c-6be7017ed6be service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:12.647106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a0fde01-952a-4885-856f-8506a7c978f5 req-81bd689d-bb0a-4bc3-856c-6be7017ed6be service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:12.668458 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1a0fde01-952a-4885-856f-8506a7c978f5 req-81bd689d-bb0a-4bc3-856c-6be7017ed6be service nova] Creating event network-vif-plugged:aed9b9c0-f776-4a87-bdea-b3f1bb6327e2 for instance 0275ad9f-2318-4002-8576-66cbace22bdb on n-h2-852771-8 Aug 25 13:53:12.676802 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1a0fde01-952a-4885-856f-8506a7c978f5 req-81bd689d-bb0a-4bc3-856c-6be7017ed6be service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063352 Aug 25 13:53:12.677706 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3078/6098] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:53:12.739037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b4345ba9-b8bf-42c8-ab85-87e0dea0bfd7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:12.750128 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b4345ba9-b8bf-42c8-ab85-87e0dea0bfd7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.261166 Aug 25 13:53:12.750912 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3021/6099] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:12 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:13.777123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-256aef0b-79c7-4f6e-99de-ab49b1fbbeb6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:13.778030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-256aef0b-79c7-4f6e-99de-ab49b1fbbeb6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:13.786330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-256aef0b-79c7-4f6e-99de-ab49b1fbbeb6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:13.786938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-256aef0b-79c7-4f6e-99de-ab49b1fbbeb6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:13.787221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-256aef0b-79c7-4f6e-99de-ab49b1fbbeb6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:13.788064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-256aef0b-79c7-4f6e-99de-ab49b1fbbeb6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:13.789922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-256aef0b-79c7-4f6e-99de-ab49b1fbbeb6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:13.790387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-256aef0b-79c7-4f6e-99de-ab49b1fbbeb6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:13.961701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-256aef0b-79c7-4f6e-99de-ab49b1fbbeb6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:13.976003 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-256aef0b-79c7-4f6e-99de-ab49b1fbbeb6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1216 microversion: 2.1 time: 0.202609 Aug 25 13:53:13.980782 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3079/6100] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:13 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:15.000759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b113e0a9-05ab-40e5-bd03-eafdb872a696 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:15.001364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b113e0a9-05ab-40e5-bd03-eafdb872a696 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:15.009458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b113e0a9-05ab-40e5-bd03-eafdb872a696 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:15.009985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b113e0a9-05ab-40e5-bd03-eafdb872a696 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:15.010434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b113e0a9-05ab-40e5-bd03-eafdb872a696 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:15.011148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b113e0a9-05ab-40e5-bd03-eafdb872a696 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:15.011611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b113e0a9-05ab-40e5-bd03-eafdb872a696 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:15.012041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b113e0a9-05ab-40e5-bd03-eafdb872a696 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:15.172034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b113e0a9-05ab-40e5-bd03-eafdb872a696 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:15.186407 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b113e0a9-05ab-40e5-bd03-eafdb872a696 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1403 microversion: 2.1 time: 0.189178 Aug 25 13:53:15.187376 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3022/6101] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:14 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1403 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:15.214062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-34bd3dc1-596b-475f-9487-32a82670d533 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:15.214855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-34bd3dc1-596b-475f-9487-32a82670d533 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:15.222510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34bd3dc1-596b-475f-9487-32a82670d533 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:15.223362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34bd3dc1-596b-475f-9487-32a82670d533 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:15.223784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34bd3dc1-596b-475f-9487-32a82670d533 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:15.224487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34bd3dc1-596b-475f-9487-32a82670d533 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:15.225118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34bd3dc1-596b-475f-9487-32a82670d533 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:15.226089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-34bd3dc1-596b-475f-9487-32a82670d533 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:15.404156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-34bd3dc1-596b-475f-9487-32a82670d533 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:15.418509 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-34bd3dc1-596b-475f-9487-32a82670d533 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1403 microversion: 2.1 time: 0.209364 Aug 25 13:53:15.419677 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3080/6102] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:15 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1403 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:15.446198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1503044442"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:15.450271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:15.461199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:15.461988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:15.462646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:15.463817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:15.464604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:15.469045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:15.592431 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.compute.api [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Attempting to quiesce instance before volume snapshot. Aug 25 13:53:15.656726 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.compute.api [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 25 13:53:15.762513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Creating snapshot from volume 82289a20-96fa-477f-acc3-fc8ac3ca7abf. {{(pid=129059) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 25 13:53:16.818537 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c32e2e32-4094-4ab4-bd14-97bf94fd4b13 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "POST /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb/action" status: 202 len: 0 microversion: 2.1 time: 1.379220 Aug 25 13:53:16.820558 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3023/6103] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:53:15 2022] POST /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb/action => generated 0 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 13:53:18.027899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-577976862", "imageRef": "2ac45695-cbdd-4dd0-8917-0ed1754d19c0", "flavorRef": "452", "networks": [{"uuid": "f9216295-ead7-4063-84e8-342351244740"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:18.097361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] validate_networks() for [('f9216295-ead7-4063-84e8-342351244740', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:53:18.279265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2860877e-81c6-4685-a7be-83f558a7dbd4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:18.284334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2860877e-81c6-4685-a7be-83f558a7dbd4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:18.288354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=31 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:18.299645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2860877e-81c6-4685-a7be-83f558a7dbd4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:18.300169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2860877e-81c6-4685-a7be-83f558a7dbd4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:18.300644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2860877e-81c6-4685-a7be-83f558a7dbd4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:18.301402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2860877e-81c6-4685-a7be-83f558a7dbd4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:18.302058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2860877e-81c6-4685-a7be-83f558a7dbd4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:18.302588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2860877e-81c6-4685-a7be-83f558a7dbd4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:18.306758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:18.385638 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2860877e-81c6-4685-a7be-83f558a7dbd4 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "POST /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1/action" status: 200 len: 32646 microversion: 2.1 time: 0.117202 Aug 25 13:53:18.387563 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3024/6104] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:53:18 2022] POST /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1/action => generated 32646 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:53:19.003368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:53:19.006266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:53:19.008586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:53:19.009592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:53:19.010264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:53:19.033061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:19.034473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:19.035394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:19.036436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:19.037237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:19.038578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:19.077762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:53:19.085196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for user 93fbad0b63d14f3fb12de08d966bffad and project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:53:19.107546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:53:19.110324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2d1e0f42-2645-47a7-ab28-775da8dafcdc',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:53:19.213544 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-072271b4-a9da-4948-9886-78562648f8fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.189832 Aug 25 13:53:19.215038 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3081/6105] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:53:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:53:19.227817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14676f2c-c5c7-420d-9638-0937ca8499d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:19.228980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-14676f2c-c5c7-420d-9638-0937ca8499d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:19.290703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-14676f2c-c5c7-420d-9638-0937ca8499d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:19.302382 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-14676f2c-c5c7-420d-9638-0937ca8499d3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1229 microversion: 2.1 time: 0.079478 Aug 25 13:53:19.303491 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3025/6106] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:19 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1229 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:19.855816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-098dead7-26de-43ed-ad55-536c65e89b16 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:19.861489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6dc46d0d-a71d-4c6b-9b9a-6a072cc6c9e2 req-5730bf7c-c00b-42bc-9213-8c97af0853de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5575cf32-02bc-41c8-99fc-694c87554be1", "tag": "ba4c2fa1-5645-4524-9e99-d0b3699e471e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:19.864725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-098dead7-26de-43ed-ad55-536c65e89b16 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:19.878406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6dc46d0d-a71d-4c6b-9b9a-6a072cc6c9e2 req-5730bf7c-c00b-42bc-9213-8c97af0853de service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:19.878717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:19.879508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6dc46d0d-a71d-4c6b-9b9a-6a072cc6c9e2 req-5730bf7c-c00b-42bc-9213-8c97af0853de service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:19.880280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6dc46d0d-a71d-4c6b-9b9a-6a072cc6c9e2 req-5730bf7c-c00b-42bc-9213-8c97af0853de service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:19.893824 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6dc46d0d-a71d-4c6b-9b9a-6a072cc6c9e2 req-5730bf7c-c00b-42bc-9213-8c97af0853de service nova] Creating event network-changed:ba4c2fa1-5645-4524-9e99-d0b3699e471e for instance 5575cf32-02bc-41c8-99fc-694c87554be1 on n-h1-852771-8 Aug 25 13:53:19.900219 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6dc46d0d-a71d-4c6b-9b9a-6a072cc6c9e2 req-5730bf7c-c00b-42bc-9213-8c97af0853de service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042433 Aug 25 13:53:19.901491 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3026/6107] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:53:19.905993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-098dead7-26de-43ed-ad55-536c65e89b16 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:19.907392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-098dead7-26de-43ed-ad55-536c65e89b16 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:19.908578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-098dead7-26de-43ed-ad55-536c65e89b16 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:19.910390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-098dead7-26de-43ed-ad55-536c65e89b16 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:19.918917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-098dead7-26de-43ed-ad55-536c65e89b16 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:19.920502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-098dead7-26de-43ed-ad55-536c65e89b16 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:19.927066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=75 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:19.973893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-098dead7-26de-43ed-ad55-536c65e89b16 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:53:20.141581 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-098dead7-26de-43ed-ad55-536c65e89b16 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 204 len: 0 microversion: 2.1 time: 0.289401 Aug 25 13:53:20.142934 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3082/6108] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:53:19 2022] DELETE /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:53:20.153540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1c1e10bc-7b57-4445-81af-1e71dc65ba56 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:20.154302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1c1e10bc-7b57-4445-81af-1e71dc65ba56 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:20.167206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c1e10bc-7b57-4445-81af-1e71dc65ba56 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:20.167767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c1e10bc-7b57-4445-81af-1e71dc65ba56 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:20.168235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c1e10bc-7b57-4445-81af-1e71dc65ba56 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:20.169081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c1e10bc-7b57-4445-81af-1e71dc65ba56 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:20.169589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c1e10bc-7b57-4445-81af-1e71dc65ba56 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:20.170061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1c1e10bc-7b57-4445-81af-1e71dc65ba56 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:20.326750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43983cc9-009f-46e7-9aad-01e6643e1b2c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:20.327842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43983cc9-009f-46e7-9aad-01e6643e1b2c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:20.336677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43983cc9-009f-46e7-9aad-01e6643e1b2c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:20.337609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43983cc9-009f-46e7-9aad-01e6643e1b2c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:20.338297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43983cc9-009f-46e7-9aad-01e6643e1b2c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:20.339259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43983cc9-009f-46e7-9aad-01e6643e1b2c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:20.340053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43983cc9-009f-46e7-9aad-01e6643e1b2c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:20.340734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43983cc9-009f-46e7-9aad-01e6643e1b2c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:20.402651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1c1e10bc-7b57-4445-81af-1e71dc65ba56 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:20.416819 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1c1e10bc-7b57-4445-81af-1e71dc65ba56 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1671 microversion: 2.1 time: 0.268293 Aug 25 13:53:20.430899 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3027/6109] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:20 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1671 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:20.438958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43983cc9-009f-46e7-9aad-01e6643e1b2c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:20.450555 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43983cc9-009f-46e7-9aad-01e6643e1b2c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1281 microversion: 2.1 time: 0.127720 Aug 25 13:53:20.452041 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3083/6110] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:20 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1281 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:21.443181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e5bee1dc-ee36-4356-bb4a-67f184dfa21d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:21.444654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e5bee1dc-ee36-4356-bb4a-67f184dfa21d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:21.452986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5bee1dc-ee36-4356-bb4a-67f184dfa21d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.453591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5bee1dc-ee36-4356-bb4a-67f184dfa21d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.454014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5bee1dc-ee36-4356-bb4a-67f184dfa21d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.454775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5bee1dc-ee36-4356-bb4a-67f184dfa21d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.455264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5bee1dc-ee36-4356-bb4a-67f184dfa21d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.455848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5bee1dc-ee36-4356-bb4a-67f184dfa21d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.486274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b4a6c861-7aee-45cb-b51b-452e86eeafaf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:21.487166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b4a6c861-7aee-45cb-b51b-452e86eeafaf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:21.496117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4a6c861-7aee-45cb-b51b-452e86eeafaf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.496614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4a6c861-7aee-45cb-b51b-452e86eeafaf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.497056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4a6c861-7aee-45cb-b51b-452e86eeafaf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.498112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4a6c861-7aee-45cb-b51b-452e86eeafaf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.498577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4a6c861-7aee-45cb-b51b-452e86eeafaf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.499005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4a6c861-7aee-45cb-b51b-452e86eeafaf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.608320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b4a6c861-7aee-45cb-b51b-452e86eeafaf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:21.621991 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b4a6c861-7aee-45cb-b51b-452e86eeafaf tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1281 microversion: 2.1 time: 0.139395 Aug 25 13:53:21.622603 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3084/6111] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:21 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1281 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:21.713132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e5bee1dc-ee36-4356-bb4a-67f184dfa21d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:21.723949 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e5bee1dc-ee36-4356-bb4a-67f184dfa21d tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1671 microversion: 2.1 time: 0.285234 Aug 25 13:53:21.737239 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3028/6112] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:21 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1671 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:22.653847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c713cb7-d637-4406-93ca-42a5361d029c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:22.654476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c713cb7-d637-4406-93ca-42a5361d029c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:22.668018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c713cb7-d637-4406-93ca-42a5361d029c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:22.668521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c713cb7-d637-4406-93ca-42a5361d029c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:22.669036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c713cb7-d637-4406-93ca-42a5361d029c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:22.669763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c713cb7-d637-4406-93ca-42a5361d029c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:22.670235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c713cb7-d637-4406-93ca-42a5361d029c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:22.670669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c713cb7-d637-4406-93ca-42a5361d029c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:22.759045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-51304657-0bdc-4718-a203-376b8a701667 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:22.759727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-51304657-0bdc-4718-a203-376b8a701667 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:22.773982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51304657-0bdc-4718-a203-376b8a701667 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:22.774944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51304657-0bdc-4718-a203-376b8a701667 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:22.775910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51304657-0bdc-4718-a203-376b8a701667 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:22.777216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51304657-0bdc-4718-a203-376b8a701667 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:22.778573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51304657-0bdc-4718-a203-376b8a701667 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:22.779548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-51304657-0bdc-4718-a203-376b8a701667 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:22.810977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7c713cb7-d637-4406-93ca-42a5361d029c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:22.830817 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c713cb7-d637-4406-93ca-42a5361d029c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1299 microversion: 2.1 time: 0.178686 Aug 25 13:53:22.853288 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3085/6113] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:22 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1299 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:23.029976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-51304657-0bdc-4718-a203-376b8a701667 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a882ff06dbb14328b6360ce89f4d75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11aa34f5f9654a08adbb90ebca9c6d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:23.040137 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-51304657-0bdc-4718-a203-376b8a701667 tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 200 len: 1552 microversion: 2.1 time: 0.288281 Aug 25 13:53:23.051991 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3029/6114] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:22 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 1552 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:23.247247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-18fd0bd3-7e30-43f7-9159-30715ee7c9dd req-9680541d-2803-4865-997d-8c24cb01c29f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5575cf32-02bc-41c8-99fc-694c87554be1", "name": "network-vif-deleted", "tag": "ba4c2fa1-5645-4524-9e99-d0b3699e471e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:23.260242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-18fd0bd3-7e30-43f7-9159-30715ee7c9dd req-9680541d-2803-4865-997d-8c24cb01c29f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:23.260865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-18fd0bd3-7e30-43f7-9159-30715ee7c9dd req-9680541d-2803-4865-997d-8c24cb01c29f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:23.261638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-18fd0bd3-7e30-43f7-9159-30715ee7c9dd req-9680541d-2803-4865-997d-8c24cb01c29f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:23.282671 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-18fd0bd3-7e30-43f7-9159-30715ee7c9dd req-9680541d-2803-4865-997d-8c24cb01c29f service nova] Creating event network-vif-deleted:ba4c2fa1-5645-4524-9e99-d0b3699e471e for instance 5575cf32-02bc-41c8-99fc-694c87554be1 on n-h1-852771-8 Aug 25 13:53:23.300086 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-18fd0bd3-7e30-43f7-9159-30715ee7c9dd req-9680541d-2803-4865-997d-8c24cb01c29f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057189 Aug 25 13:53:23.301294 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3086/6115] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:53:23.882476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5574224a-c456-498c-b06a-e4a8c3559635 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:23.890363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5574224a-c456-498c-b06a-e4a8c3559635 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:23.941109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5574224a-c456-498c-b06a-e4a8c3559635 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:23.942380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5574224a-c456-498c-b06a-e4a8c3559635 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:23.945062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5574224a-c456-498c-b06a-e4a8c3559635 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:23.948801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5574224a-c456-498c-b06a-e4a8c3559635 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:23.954802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5574224a-c456-498c-b06a-e4a8c3559635 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:23.956140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5574224a-c456-498c-b06a-e4a8c3559635 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:24.072755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:24.080136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] [instance: 5575cf32-02bc-41c8-99fc-694c87554be1] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:24.109031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:24.112908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:24.113642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:24.114495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:24.119997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:24.122742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:24.198588 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] HTTP exception thrown: Instance 5575cf32-02bc-41c8-99fc-694c87554be1 could not be found. Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Request method failure captured: Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 HTTP/1.1 Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB32vdaQ_S9icGAjYyPhLFfzCiYxIPTIIkJYOFl9u4OdkP4hfZ-pfsBl6HZG2TelsqdqZL6sfytQqgJTb6O4hD7ntUuSQpwOIs3D_4FB0sR7oU2EiKRMLaksk6bJ3ZHFVz3qRNAMYQk-hBhSL_TZceK0Tk2Z6NDFvRcIJC1gkegfC_1A Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 11aa34f5f9654a08adbb90ebca9c6d4d Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestNetworkBasicOps-921108427 Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/11aa34f5f9654a08adbb90ebca9c6d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_11aa34f5f9654a08adbb90ebca9c6d4d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/11aa34f5f9654a08adbb90ebca9c6d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/11aa34f5f9654a08adbb90ebca9c6d4d"}]}] Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestNetworkBasicOps-921108427 Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 11aa34f5f9654a08adbb90ebca9c6d4d Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestNetworkBasicOps-921108427 Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestNetworkBasicOps-921108427-project Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a882ff06dbb14328b6360ce89f4d75e5 Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestNetworkBasicOps-921108427-project Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 5575cf32-02bc-41c8-99fc-694c87554be1 could not be found. Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '5575cf32-02bc-41c8-99fc-694c87554be1'} Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5575cf32-02bc-41c8-99fc-694c87554be1 could not be found. Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5575cf32-02bc-41c8-99fc-694c87554be1 could not be found. Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:53:24.201215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:53:24.205394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:53:24.205394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:53:24.205394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:53:24.205394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:53:24.205394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:53:24.205394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5575cf32-02bc-41c8-99fc-694c87554be1 could not be found. Aug 25 13:53:24.205394 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:53:24.205394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Returning 404 to user: Instance 5575cf32-02bc-41c8-99fc-694c87554be1 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:53:24.205394 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-499c78fa-85f1-4a93-817d-61cec3fc2fbf tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1" status: 404 len: 111 microversion: 2.1 time: 0.139617 Aug 25 13:53:24.205394 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3087/6116] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:24 2022] GET /compute/v2.1/servers/5575cf32-02bc-41c8-99fc-694c87554be1 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:53:24.333699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5574224a-c456-498c-b06a-e4a8c3559635 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:24.364420 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5574224a-c456-498c-b06a-e4a8c3559635 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.507355 Aug 25 13:53:24.366627 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3030/6117] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:23 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:24.846199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-601211a9-f84c-4ac7-bac1-e6b17b78dbac tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] Calling method '.version_select at 0x7f3a2e9409d0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:24.885372 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-601211a9-f84c-4ac7-bac1-e6b17b78dbac tempest-TestNetworkBasicOps-921108427 tempest-TestNetworkBasicOps-921108427-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1720774474" status: 202 len: 0 microversion: 2.1 time: 0.043709 Aug 25 13:53:24.889775 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3088/6118] 10.222.0.70 () {58 vars in 1257 bytes} [Thu Aug 25 13:53:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1720774474 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:53:25.400517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-42088319-d9fe-40a4-8c3d-c0d297d4620a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:25.401974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-42088319-d9fe-40a4-8c3d-c0d297d4620a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:25.413229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b9f8b59a-b89c-4299-af22-6952cfd890c1 req-e257e2c2-92f8-4983-9a9f-1bbd4486865f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02934ab4-1e30-44e6-a774-eb46d981e333", "tag": "a9d2f6e0-4b62-45c5-88ab-7fd319d8f0ac"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:25.419234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42088319-d9fe-40a4-8c3d-c0d297d4620a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:25.420721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42088319-d9fe-40a4-8c3d-c0d297d4620a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:25.421442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42088319-d9fe-40a4-8c3d-c0d297d4620a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:25.422776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42088319-d9fe-40a4-8c3d-c0d297d4620a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:25.423460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42088319-d9fe-40a4-8c3d-c0d297d4620a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:25.424601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42088319-d9fe-40a4-8c3d-c0d297d4620a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:25.454433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b9f8b59a-b89c-4299-af22-6952cfd890c1 req-e257e2c2-92f8-4983-9a9f-1bbd4486865f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:25.462201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b9f8b59a-b89c-4299-af22-6952cfd890c1 req-e257e2c2-92f8-4983-9a9f-1bbd4486865f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:25.463059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b9f8b59a-b89c-4299-af22-6952cfd890c1 req-e257e2c2-92f8-4983-9a9f-1bbd4486865f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:25.479575 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b9f8b59a-b89c-4299-af22-6952cfd890c1 req-e257e2c2-92f8-4983-9a9f-1bbd4486865f service nova] Creating event network-changed:a9d2f6e0-4b62-45c5-88ab-7fd319d8f0ac for instance 02934ab4-1e30-44e6-a774-eb46d981e333 on n-h1-852771-8 Aug 25 13:53:25.496118 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b9f8b59a-b89c-4299-af22-6952cfd890c1 req-e257e2c2-92f8-4983-9a9f-1bbd4486865f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088678 Aug 25 13:53:25.502462 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3089/6119] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:53:26.047463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-42088319-d9fe-40a4-8c3d-c0d297d4620a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:26.062686 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-42088319-d9fe-40a4-8c3d-c0d297d4620a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.667437 Aug 25 13:53:26.077113 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3031/6120] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:25 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:27.097288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ae8c1b5-8b5c-418e-b492-2aa6f0e6164c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:27.098263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ae8c1b5-8b5c-418e-b492-2aa6f0e6164c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:27.167115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ae8c1b5-8b5c-418e-b492-2aa6f0e6164c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:27.167732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ae8c1b5-8b5c-418e-b492-2aa6f0e6164c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:27.168214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ae8c1b5-8b5c-418e-b492-2aa6f0e6164c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:27.168965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ae8c1b5-8b5c-418e-b492-2aa6f0e6164c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:27.169425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ae8c1b5-8b5c-418e-b492-2aa6f0e6164c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:27.169885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ae8c1b5-8b5c-418e-b492-2aa6f0e6164c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:27.965715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2ae8c1b5-8b5c-418e-b492-2aa6f0e6164c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:28.010592 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2ae8c1b5-8b5c-418e-b492-2aa6f0e6164c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.923285 Aug 25 13:53:28.012463 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3090/6121] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:27 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:29.059729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f756239b-5ba5-48fa-a640-1422419d5214 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:29.061263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f756239b-5ba5-48fa-a640-1422419d5214 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:29.079212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f756239b-5ba5-48fa-a640-1422419d5214 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:29.080205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f756239b-5ba5-48fa-a640-1422419d5214 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:29.082627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f756239b-5ba5-48fa-a640-1422419d5214 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:29.085378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f756239b-5ba5-48fa-a640-1422419d5214 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:29.086962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f756239b-5ba5-48fa-a640-1422419d5214 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:29.088212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f756239b-5ba5-48fa-a640-1422419d5214 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:29.310131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:29.461898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f756239b-5ba5-48fa-a640-1422419d5214 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:29.529360 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f756239b-5ba5-48fa-a640-1422419d5214 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.482860 Aug 25 13:53:29.533012 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3032/6122] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:29 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:30.569147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab9b9d00-28d9-4e0b-81cf-b032dbdc9187 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:30.570722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ab9b9d00-28d9-4e0b-81cf-b032dbdc9187 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:30.583098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:30.587299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:30.593351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab9b9d00-28d9-4e0b-81cf-b032dbdc9187 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:30.594249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab9b9d00-28d9-4e0b-81cf-b032dbdc9187 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:30.595523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab9b9d00-28d9-4e0b-81cf-b032dbdc9187 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:30.597727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab9b9d00-28d9-4e0b-81cf-b032dbdc9187 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:30.601546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab9b9d00-28d9-4e0b-81cf-b032dbdc9187 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:30.602105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab9b9d00-28d9-4e0b-81cf-b032dbdc9187 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:31.092813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ab9b9d00-28d9-4e0b-81cf-b032dbdc9187 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:31.120576 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ab9b9d00-28d9-4e0b-81cf-b032dbdc9187 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.555522 Aug 25 13:53:31.121667 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3091/6123] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:30 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:32.149198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c7ce760a-59e8-4b5b-8c75-04466dbb2d3b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:32.155062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c7ce760a-59e8-4b5b-8c75-04466dbb2d3b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:32.178029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ce760a-59e8-4b5b-8c75-04466dbb2d3b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:32.183200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ce760a-59e8-4b5b-8c75-04466dbb2d3b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:32.183200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ce760a-59e8-4b5b-8c75-04466dbb2d3b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:32.183200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ce760a-59e8-4b5b-8c75-04466dbb2d3b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:32.189325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ce760a-59e8-4b5b-8c75-04466dbb2d3b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:32.189325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7ce760a-59e8-4b5b-8c75-04466dbb2d3b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:32.688400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c7ce760a-59e8-4b5b-8c75-04466dbb2d3b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:32.717230 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c7ce760a-59e8-4b5b-8c75-04466dbb2d3b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.572328 Aug 25 13:53:32.718221 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3033/6124] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:32 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:33.756639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-49295d29-0c8f-4b51-917c-cef7b3eb15b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:33.762356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-49295d29-0c8f-4b51-917c-cef7b3eb15b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:33.789308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49295d29-0c8f-4b51-917c-cef7b3eb15b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:33.790413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49295d29-0c8f-4b51-917c-cef7b3eb15b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:33.794076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49295d29-0c8f-4b51-917c-cef7b3eb15b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:33.795685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49295d29-0c8f-4b51-917c-cef7b3eb15b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:33.796178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49295d29-0c8f-4b51-917c-cef7b3eb15b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:33.797107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49295d29-0c8f-4b51-917c-cef7b3eb15b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:34.078691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-49295d29-0c8f-4b51-917c-cef7b3eb15b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:34.102808 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-49295d29-0c8f-4b51-917c-cef7b3eb15b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.352273 Aug 25 13:53:34.103597 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3092/6125] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:33 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:35.140488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-50dd08cf-a831-4bfe-adfd-8a9c7cba97f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:35.141806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-50dd08cf-a831-4bfe-adfd-8a9c7cba97f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:35.149671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50dd08cf-a831-4bfe-adfd-8a9c7cba97f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:35.150617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50dd08cf-a831-4bfe-adfd-8a9c7cba97f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:35.151085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50dd08cf-a831-4bfe-adfd-8a9c7cba97f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:35.151998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50dd08cf-a831-4bfe-adfd-8a9c7cba97f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:35.152665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50dd08cf-a831-4bfe-adfd-8a9c7cba97f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:35.152925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50dd08cf-a831-4bfe-adfd-8a9c7cba97f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:35.375765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-50dd08cf-a831-4bfe-adfd-8a9c7cba97f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:35.390435 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-50dd08cf-a831-4bfe-adfd-8a9c7cba97f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.253722 Aug 25 13:53:35.392430 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3034/6126] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:35 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:36.419601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-820f017a-7ca2-4f8b-9809-1079bc6911ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:36.420715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-820f017a-7ca2-4f8b-9809-1079bc6911ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:36.431502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-820f017a-7ca2-4f8b-9809-1079bc6911ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:36.432632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-820f017a-7ca2-4f8b-9809-1079bc6911ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:36.433210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-820f017a-7ca2-4f8b-9809-1079bc6911ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:36.435811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-820f017a-7ca2-4f8b-9809-1079bc6911ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:36.436426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-820f017a-7ca2-4f8b-9809-1079bc6911ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:36.436995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-820f017a-7ca2-4f8b-9809-1079bc6911ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:36.662303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-820f017a-7ca2-4f8b-9809-1079bc6911ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:36.683927 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-820f017a-7ca2-4f8b-9809-1079bc6911ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.268161 Aug 25 13:53:36.698089 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3093/6127] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:36 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:37.718151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-41f617c5-1536-477f-a2df-ebff73f1dcdd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:37.719122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-41f617c5-1536-477f-a2df-ebff73f1dcdd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:37.729633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41f617c5-1536-477f-a2df-ebff73f1dcdd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:37.731158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41f617c5-1536-477f-a2df-ebff73f1dcdd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:37.731836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41f617c5-1536-477f-a2df-ebff73f1dcdd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:37.732780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41f617c5-1536-477f-a2df-ebff73f1dcdd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:37.733561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41f617c5-1536-477f-a2df-ebff73f1dcdd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:37.734192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41f617c5-1536-477f-a2df-ebff73f1dcdd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:37.982861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-41f617c5-1536-477f-a2df-ebff73f1dcdd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:37.991741 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-41f617c5-1536-477f-a2df-ebff73f1dcdd tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.280731 Aug 25 13:53:37.993751 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3035/6128] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:37 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:39.021892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec4b84de-8e0c-43ec-a099-0006a3e64410 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:39.022778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec4b84de-8e0c-43ec-a099-0006a3e64410 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:39.044899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4b84de-8e0c-43ec-a099-0006a3e64410 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:39.046383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4b84de-8e0c-43ec-a099-0006a3e64410 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:39.047516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4b84de-8e0c-43ec-a099-0006a3e64410 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:39.049707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4b84de-8e0c-43ec-a099-0006a3e64410 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:39.050689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4b84de-8e0c-43ec-a099-0006a3e64410 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:39.053058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4b84de-8e0c-43ec-a099-0006a3e64410 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:39.319930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec4b84de-8e0c-43ec-a099-0006a3e64410 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:39.337941 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ec4b84de-8e0c-43ec-a099-0006a3e64410 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.324203 Aug 25 13:53:39.344611 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3094/6129] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:39 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:40.375938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8bd9081d-a96a-4d36-808c-e4f4e098014c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:40.376710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8bd9081d-a96a-4d36-808c-e4f4e098014c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:40.399153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bd9081d-a96a-4d36-808c-e4f4e098014c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:40.400256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bd9081d-a96a-4d36-808c-e4f4e098014c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:40.403258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bd9081d-a96a-4d36-808c-e4f4e098014c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:40.405142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bd9081d-a96a-4d36-808c-e4f4e098014c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:40.406238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bd9081d-a96a-4d36-808c-e4f4e098014c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:40.410105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8bd9081d-a96a-4d36-808c-e4f4e098014c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:40.757788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8bd9081d-a96a-4d36-808c-e4f4e098014c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:40.775525 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8bd9081d-a96a-4d36-808c-e4f4e098014c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.406951 Aug 25 13:53:40.796130 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3036/6130] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:40 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:41.809959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-db11e30f-de82-4444-b93f-c3220ccd6c0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:41.811589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-db11e30f-de82-4444-b93f-c3220ccd6c0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:41.824351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db11e30f-de82-4444-b93f-c3220ccd6c0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:41.825480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db11e30f-de82-4444-b93f-c3220ccd6c0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:41.826956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db11e30f-de82-4444-b93f-c3220ccd6c0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:41.828470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db11e30f-de82-4444-b93f-c3220ccd6c0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:41.829731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db11e30f-de82-4444-b93f-c3220ccd6c0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:41.831026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-db11e30f-de82-4444-b93f-c3220ccd6c0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:42.240881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-db11e30f-de82-4444-b93f-c3220ccd6c0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:42.286354 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-db11e30f-de82-4444-b93f-c3220ccd6c0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.484603 Aug 25 13:53:42.293072 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3095/6131] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:41 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:43.331978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a2191eb-f54e-4900-8bed-994bbe012323 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:43.340149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a2191eb-f54e-4900-8bed-994bbe012323 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:43.362170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2191eb-f54e-4900-8bed-994bbe012323 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:43.365166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2191eb-f54e-4900-8bed-994bbe012323 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:43.366567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2191eb-f54e-4900-8bed-994bbe012323 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:43.368381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2191eb-f54e-4900-8bed-994bbe012323 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:43.369627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2191eb-f54e-4900-8bed-994bbe012323 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:43.370816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a2191eb-f54e-4900-8bed-994bbe012323 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:43.842842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5a2191eb-f54e-4900-8bed-994bbe012323 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:43.857377 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a2191eb-f54e-4900-8bed-994bbe012323 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.533989 Aug 25 13:53:43.858675 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3037/6132] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:43 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:44.893755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e6715494-62ec-4c0d-8f06-ecba0856a922 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:44.897058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e6715494-62ec-4c0d-8f06-ecba0856a922 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:44.913441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6715494-62ec-4c0d-8f06-ecba0856a922 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:44.914597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6715494-62ec-4c0d-8f06-ecba0856a922 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:44.915744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6715494-62ec-4c0d-8f06-ecba0856a922 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:44.917627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6715494-62ec-4c0d-8f06-ecba0856a922 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:44.919417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6715494-62ec-4c0d-8f06-ecba0856a922 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:44.921060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6715494-62ec-4c0d-8f06-ecba0856a922 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:45.176207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e6715494-62ec-4c0d-8f06-ecba0856a922 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:45.193701 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e6715494-62ec-4c0d-8f06-ecba0856a922 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.309326 Aug 25 13:53:45.194786 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3096/6133] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:44 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:46.228426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f9e18586-2fb5-4edc-b94f-34f05f1cad4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:46.229149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f9e18586-2fb5-4edc-b94f-34f05f1cad4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:46.250542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e18586-2fb5-4edc-b94f-34f05f1cad4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:46.254071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e18586-2fb5-4edc-b94f-34f05f1cad4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:46.261119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e18586-2fb5-4edc-b94f-34f05f1cad4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:46.264376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e18586-2fb5-4edc-b94f-34f05f1cad4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:46.267521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e18586-2fb5-4edc-b94f-34f05f1cad4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:46.268140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f9e18586-2fb5-4edc-b94f-34f05f1cad4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:46.624292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f9e18586-2fb5-4edc-b94f-34f05f1cad4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:46.641062 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f9e18586-2fb5-4edc-b94f-34f05f1cad4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.417355 Aug 25 13:53:46.663955 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3038/6134] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:46 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:47.301190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:47.306839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:47.317253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:47.319073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:47.319830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:47.321351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:47.322352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:47.323114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:47.477559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:53:47.479175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:53:47.480624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:53:47.481811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:53:47.482902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:53:47.663393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:47.677094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:47.678130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:47.679199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:47.680838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:47.682576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:47.684145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:47.697361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3e52e17-09a1-4a19-b0f8-7b6f2c16c64a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:47.702182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c3e52e17-09a1-4a19-b0f8-7b6f2c16c64a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:47.738081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3e52e17-09a1-4a19-b0f8-7b6f2c16c64a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:47.741072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3e52e17-09a1-4a19-b0f8-7b6f2c16c64a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:47.747127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3e52e17-09a1-4a19-b0f8-7b6f2c16c64a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:47.749545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3e52e17-09a1-4a19-b0f8-7b6f2c16c64a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:47.751567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3e52e17-09a1-4a19-b0f8-7b6f2c16c64a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:47.757019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3e52e17-09a1-4a19-b0f8-7b6f2c16c64a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:47.765038 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f8ea7b3a-fc50-4eeb-a4b4-0bc1d776ed47 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76/action" status: 202 len: 1136 microversion: 2.1 time: 0.472409 Aug 25 13:53:47.782533 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3097/6135] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:53:47 2022] POST /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76/action => generated 1136 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 25 13:53:47.805897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4362bf6a-3db1-4216-bc5c-345221e0d165 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:47.807723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4362bf6a-3db1-4216-bc5c-345221e0d165 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:47.819614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4362bf6a-3db1-4216-bc5c-345221e0d165 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:47.820821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4362bf6a-3db1-4216-bc5c-345221e0d165 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:47.821936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4362bf6a-3db1-4216-bc5c-345221e0d165 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:47.823558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4362bf6a-3db1-4216-bc5c-345221e0d165 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:47.825205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4362bf6a-3db1-4216-bc5c-345221e0d165 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:47.826490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4362bf6a-3db1-4216-bc5c-345221e0d165 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:47.836326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:48.478242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4362bf6a-3db1-4216-bc5c-345221e0d165 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:48.508752 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4362bf6a-3db1-4216-bc5c-345221e0d165 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 0.715498 Aug 25 13:53:48.519973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3e52e17-09a1-4a19-b0f8-7b6f2c16c64a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:48.525867 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3098/6136] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:47 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:48.526719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=82 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:48.563098 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3e52e17-09a1-4a19-b0f8-7b6f2c16c64a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.876705 Aug 25 13:53:48.565655 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3039/6137] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:47 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:49.566182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d06bba5-9c3e-4ede-a74b-f45b6a8212a1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:49.568162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d06bba5-9c3e-4ede-a74b-f45b6a8212a1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:49.577038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d06bba5-9c3e-4ede-a74b-f45b6a8212a1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:49.577883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d06bba5-9c3e-4ede-a74b-f45b6a8212a1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:49.578515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d06bba5-9c3e-4ede-a74b-f45b6a8212a1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:49.579410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d06bba5-9c3e-4ede-a74b-f45b6a8212a1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:49.580060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d06bba5-9c3e-4ede-a74b-f45b6a8212a1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:49.580481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d06bba5-9c3e-4ede-a74b-f45b6a8212a1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:49.605379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b857b9e2-c6bd-46e6-a931-508f3ed9a266 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:49.606735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b857b9e2-c6bd-46e6-a931-508f3ed9a266 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:49.622583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=34 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:49.624956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b857b9e2-c6bd-46e6-a931-508f3ed9a266 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:49.631476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b857b9e2-c6bd-46e6-a931-508f3ed9a266 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:49.633634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b857b9e2-c6bd-46e6-a931-508f3ed9a266 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:49.635335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b857b9e2-c6bd-46e6-a931-508f3ed9a266 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:49.636133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b857b9e2-c6bd-46e6-a931-508f3ed9a266 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:49.655686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b857b9e2-c6bd-46e6-a931-508f3ed9a266 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:50.336001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d06bba5-9c3e-4ede-a74b-f45b6a8212a1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:50.370084 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d06bba5-9c3e-4ede-a74b-f45b6a8212a1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 0.808466 Aug 25 13:53:50.370084 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3099/6138] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:49 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:50.406894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b857b9e2-c6bd-46e6-a931-508f3ed9a266 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:50.434877 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b857b9e2-c6bd-46e6-a931-508f3ed9a266 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 0.833459 Aug 25 13:53:50.438683 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3040/6139] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:49 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:51.408584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d3b36763-d007-4692-995c-754fc4f0db57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:51.415612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d3b36763-d007-4692-995c-754fc4f0db57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:51.459068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:51.472356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b36763-d007-4692-995c-754fc4f0db57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:51.482697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b36763-d007-4692-995c-754fc4f0db57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:51.484997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b36763-d007-4692-995c-754fc4f0db57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:51.491261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b36763-d007-4692-995c-754fc4f0db57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:51.492896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b36763-d007-4692-995c-754fc4f0db57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:51.493910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7792e156-8705-4202-8350-e8a44f16c30e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:51.495115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7792e156-8705-4202-8350-e8a44f16c30e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:51.495692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d3b36763-d007-4692-995c-754fc4f0db57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:51.548699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7792e156-8705-4202-8350-e8a44f16c30e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:51.570506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7792e156-8705-4202-8350-e8a44f16c30e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:51.573689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7792e156-8705-4202-8350-e8a44f16c30e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:51.575485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7792e156-8705-4202-8350-e8a44f16c30e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:51.589904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7792e156-8705-4202-8350-e8a44f16c30e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:51.594090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7792e156-8705-4202-8350-e8a44f16c30e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:52.356472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d3b36763-d007-4692-995c-754fc4f0db57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:52.433167 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d3b36763-d007-4692-995c-754fc4f0db57 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 1.034883 Aug 25 13:53:52.438712 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3100/6140] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:51 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:52.501744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7792e156-8705-4202-8350-e8a44f16c30e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:52.592942 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7792e156-8705-4202-8350-e8a44f16c30e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1341 microversion: 2.1 time: 1.100804 Aug 25 13:53:52.595468 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3041/6141] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:51 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1341 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:53.478668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d7d805af-27dd-4e0e-9c28-0eb10907fd85 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:53.479789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d7d805af-27dd-4e0e-9c28-0eb10907fd85 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:53.523105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7d805af-27dd-4e0e-9c28-0eb10907fd85 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:53.523965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7d805af-27dd-4e0e-9c28-0eb10907fd85 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:53.525072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7d805af-27dd-4e0e-9c28-0eb10907fd85 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:53.526957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7d805af-27dd-4e0e-9c28-0eb10907fd85 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:53.546709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7d805af-27dd-4e0e-9c28-0eb10907fd85 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:53.547567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7d805af-27dd-4e0e-9c28-0eb10907fd85 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:53.637880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cac212be-a13b-4bf5-a629-e03dec032b45 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:53.680096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cac212be-a13b-4bf5-a629-e03dec032b45 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:53.709178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac212be-a13b-4bf5-a629-e03dec032b45 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:53.711002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac212be-a13b-4bf5-a629-e03dec032b45 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:53.712700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac212be-a13b-4bf5-a629-e03dec032b45 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:53.715168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac212be-a13b-4bf5-a629-e03dec032b45 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:53.716712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac212be-a13b-4bf5-a629-e03dec032b45 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:53.720624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac212be-a13b-4bf5-a629-e03dec032b45 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:54.228073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d7d805af-27dd-4e0e-9c28-0eb10907fd85 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:54.247586 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d7d805af-27dd-4e0e-9c28-0eb10907fd85 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 0.777101 Aug 25 13:53:54.253397 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3101/6142] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:53 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:54.271392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cac212be-a13b-4bf5-a629-e03dec032b45 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:54.289541 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cac212be-a13b-4bf5-a629-e03dec032b45 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1387 microversion: 2.1 time: 0.660285 Aug 25 13:53:54.297154 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3042/6143] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:53 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1387 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:55.292927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-37649e51-bcb9-42b0-a27b-cbd26a8bb0fd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:55.297998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-37649e51-bcb9-42b0-a27b-cbd26a8bb0fd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:55.300374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37649e51-bcb9-42b0-a27b-cbd26a8bb0fd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:55.300880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37649e51-bcb9-42b0-a27b-cbd26a8bb0fd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:55.302043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37649e51-bcb9-42b0-a27b-cbd26a8bb0fd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:55.303201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37649e51-bcb9-42b0-a27b-cbd26a8bb0fd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:55.303677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37649e51-bcb9-42b0-a27b-cbd26a8bb0fd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:55.304112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-37649e51-bcb9-42b0-a27b-cbd26a8bb0fd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:55.340465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe5eadbf-009b-4baa-9888-3aebf548b301 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:55.347954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe5eadbf-009b-4baa-9888-3aebf548b301 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:55.409777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5eadbf-009b-4baa-9888-3aebf548b301 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:55.411600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5eadbf-009b-4baa-9888-3aebf548b301 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:55.412574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5eadbf-009b-4baa-9888-3aebf548b301 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:55.414016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5eadbf-009b-4baa-9888-3aebf548b301 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:55.415214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5eadbf-009b-4baa-9888-3aebf548b301 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:55.416037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5eadbf-009b-4baa-9888-3aebf548b301 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:55.705991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-37649e51-bcb9-42b0-a27b-cbd26a8bb0fd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:55.740643 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-37649e51-bcb9-42b0-a27b-cbd26a8bb0fd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 0.450307 Aug 25 13:53:55.762831 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3102/6144] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:55 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:55.899949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fe5eadbf-009b-4baa-9888-3aebf548b301 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:55.926960 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe5eadbf-009b-4baa-9888-3aebf548b301 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1375 microversion: 2.1 time: 0.599210 Aug 25 13:53:55.928482 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3043/6145] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:55 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1375 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:56.358769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29e6b580-10c3-4e6b-9f2e-e25ec267f2aa tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Action: 'create', calling method: .version_select at 0x7f3a2a52f160>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1542111758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF9meZk6h9bh8asm9DEJVttpoNpOgOU3mKn6HpzgkFDLUaRiRFp/e3gIgDmnGRwDsJfi26M9jplhuC2hmH0KvZ//O5JTahUtULbVYsmdpH20EuIVT0opvFNl/WYxPHbQw=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:56.394501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-29e6b580-10c3-4e6b-9f2e-e25ec267f2aa tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Getting quotas for project 321d4d99f7404bd08e3ccf6ee6fa1ab4. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:53:56.411337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-29e6b580-10c3-4e6b-9f2e-e25ec267f2aa tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Getting quotas for user 2b5b50a0040948f9b1f7b2d643d26bcb and project 321d4d99f7404bd08e3ccf6ee6fa1ab4. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:53:56.468191 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29e6b580-10c3-4e6b-9f2e-e25ec267f2aa tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.450251 Aug 25 13:53:56.477141 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3103/6146] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:53:56 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:53:56.788807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-60f335d6-9289-4f41-85c1-45ea04e2d0d2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:56.791576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-60f335d6-9289-4f41-85c1-45ea04e2d0d2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:56.804896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60f335d6-9289-4f41-85c1-45ea04e2d0d2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:56.806058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60f335d6-9289-4f41-85c1-45ea04e2d0d2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:56.806772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60f335d6-9289-4f41-85c1-45ea04e2d0d2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:56.808357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60f335d6-9289-4f41-85c1-45ea04e2d0d2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:56.808758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60f335d6-9289-4f41-85c1-45ea04e2d0d2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:56.809374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60f335d6-9289-4f41-85c1-45ea04e2d0d2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:56.975547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-385d777e-e5ca-45a4-b1d0-00f5e57d4e96 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:56.977150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-385d777e-e5ca-45a4-b1d0-00f5e57d4e96 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:57.006113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385d777e-e5ca-45a4-b1d0-00f5e57d4e96 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:57.007259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385d777e-e5ca-45a4-b1d0-00f5e57d4e96 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:57.008267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385d777e-e5ca-45a4-b1d0-00f5e57d4e96 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:57.009808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385d777e-e5ca-45a4-b1d0-00f5e57d4e96 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:57.010793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385d777e-e5ca-45a4-b1d0-00f5e57d4e96 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:57.011822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-385d777e-e5ca-45a4-b1d0-00f5e57d4e96 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:57.138847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60f335d6-9289-4f41-85c1-45ea04e2d0d2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:57.155942 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-60f335d6-9289-4f41-85c1-45ea04e2d0d2 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 0.381889 Aug 25 13:53:57.157809 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3044/6147] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:56 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:57.236240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-385d777e-e5ca-45a4-b1d0-00f5e57d4e96 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:57.246892 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-385d777e-e5ca-45a4-b1d0-00f5e57d4e96 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1375 microversion: 2.1 time: 0.284050 Aug 25 13:53:57.249248 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3104/6148] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:56 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1375 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:58.185291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-db9cc9c2-4e6c-4843-8deb-5c1bee23ef05 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:58.186769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-db9cc9c2-4e6c-4843-8deb-5c1bee23ef05 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:58.196489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db9cc9c2-4e6c-4843-8deb-5c1bee23ef05 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:58.197531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db9cc9c2-4e6c-4843-8deb-5c1bee23ef05 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:58.198247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db9cc9c2-4e6c-4843-8deb-5c1bee23ef05 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:58.199369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db9cc9c2-4e6c-4843-8deb-5c1bee23ef05 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:58.200067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db9cc9c2-4e6c-4843-8deb-5c1bee23ef05 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:58.200722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db9cc9c2-4e6c-4843-8deb-5c1bee23ef05 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:58.274095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7af316e-0317-46a1-b3e4-17d39c6847cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:58.275244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a7af316e-0317-46a1-b3e4-17d39c6847cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:58.327265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7af316e-0317-46a1-b3e4-17d39c6847cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:58.330585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7af316e-0317-46a1-b3e4-17d39c6847cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:58.331618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7af316e-0317-46a1-b3e4-17d39c6847cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:58.333688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7af316e-0317-46a1-b3e4-17d39c6847cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:58.334796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7af316e-0317-46a1-b3e4-17d39c6847cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:58.335651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7af316e-0317-46a1-b3e4-17d39c6847cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:58.618246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-db9cc9c2-4e6c-4843-8deb-5c1bee23ef05 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:58.643662 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-db9cc9c2-4e6c-4843-8deb-5c1bee23ef05 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 0.461696 Aug 25 13:53:58.646255 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3045/6149] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:58 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:58.662804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-848951501", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1542111758", "security_groups": [{"name": "tempest-secgroup-smoke-1108982314"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "a8344a56-ad49-4d71-a84d-a0e31b5d43df"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:58.718556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a7af316e-0317-46a1-b3e4-17d39c6847cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:58.733726 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a7af316e-0317-46a1-b3e4-17d39c6847cc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1375 microversion: 2.1 time: 0.467304 Aug 25 13:53:58.734697 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3105/6150] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:58 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1375 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:58.914302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] validate_networks() for [('a8344a56-ad49-4d71-a84d-a0e31b5d43df', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:53:59.688745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7938dca9-a96c-4f87-b5a3-ab6e7fffc738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:59.690835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7938dca9-a96c-4f87-b5a3-ab6e7fffc738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:59.702402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7938dca9-a96c-4f87-b5a3-ab6e7fffc738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:59.703510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7938dca9-a96c-4f87-b5a3-ab6e7fffc738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:59.704605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7938dca9-a96c-4f87-b5a3-ab6e7fffc738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:59.705750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7938dca9-a96c-4f87-b5a3-ab6e7fffc738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:59.706584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7938dca9-a96c-4f87-b5a3-ab6e7fffc738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:59.707373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7938dca9-a96c-4f87-b5a3-ab6e7fffc738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:59.713735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Getting quotas for project 321d4d99f7404bd08e3ccf6ee6fa1ab4. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:53:59.722057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Getting quotas for user 2b5b50a0040948f9b1f7b2d643d26bcb and project 321d4d99f7404bd08e3ccf6ee6fa1ab4. Resources: dict_keys(['metadata_items']) {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:53:59.739903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:53:59.740632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:53:59.741472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:53:59.742223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:53:59.742654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:53:59.769037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:59.771134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:59.772210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:59.774101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:59.775695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:59.776827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:59.815660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Getting quotas for project 321d4d99f7404bd08e3ccf6ee6fa1ab4. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:53:59.829172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Getting quotas for user 2b5b50a0040948f9b1f7b2d643d26bcb and project 321d4d99f7404bd08e3ccf6ee6fa1ab4. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:53:59.888783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:53:59.892807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:53:59.981003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7938dca9-a96c-4f87-b5a3-ab6e7fffc738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:59.986546 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-89e65978-8e30-4745-b689-6dbfc7767ad1 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.337383 Aug 25 13:53:59.988259 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3046/6151] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:53:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:53:59.997038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ebc45831-c8ff-4846-a3d8-5f9647f12bfc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:59.998131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ebc45831-c8ff-4846-a3d8-5f9647f12bfc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:00.016126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebc45831-c8ff-4846-a3d8-5f9647f12bfc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:00.017018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebc45831-c8ff-4846-a3d8-5f9647f12bfc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:00.017457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebc45831-c8ff-4846-a3d8-5f9647f12bfc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:00.018615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebc45831-c8ff-4846-a3d8-5f9647f12bfc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:00.019519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebc45831-c8ff-4846-a3d8-5f9647f12bfc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:00.020852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebc45831-c8ff-4846-a3d8-5f9647f12bfc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:00.022989 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7938dca9-a96c-4f87-b5a3-ab6e7fffc738 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 0.338484 Aug 25 13:54:00.026192 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3106/6152] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:59 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:54:00.041494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02f1430b-f94e-4153-9be2-a3fd0c6d73f3 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:00.042576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02f1430b-f94e-4153-9be2-a3fd0c6d73f3 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:00.323291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02f1430b-f94e-4153-9be2-a3fd0c6d73f3 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:00.346675 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02f1430b-f94e-4153-9be2-a3fd0c6d73f3 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1302 microversion: 2.1 time: 0.317271 Aug 25 13:54:00.347357 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3107/6153] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:00 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1302 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:00.385595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ebc45831-c8ff-4846-a3d8-5f9647f12bfc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:00.408628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ebc45831-c8ff-4846-a3d8-5f9647f12bfc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1375 microversion: 2.1 time: 0.416778 Aug 25 13:54:00.410030 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3047/6154] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:59 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1375 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:01.064868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1116334f-97c1-48ee-9645-3ecc44944c3e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:01.065925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1116334f-97c1-48ee-9645-3ecc44944c3e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:01.085463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1116334f-97c1-48ee-9645-3ecc44944c3e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:01.087212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1116334f-97c1-48ee-9645-3ecc44944c3e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:01.087674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1116334f-97c1-48ee-9645-3ecc44944c3e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:01.090980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1116334f-97c1-48ee-9645-3ecc44944c3e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:01.091980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1116334f-97c1-48ee-9645-3ecc44944c3e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:01.094350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1116334f-97c1-48ee-9645-3ecc44944c3e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:01.341836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1116334f-97c1-48ee-9645-3ecc44944c3e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:01.352804 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1116334f-97c1-48ee-9645-3ecc44944c3e tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 0.292241 Aug 25 13:54:01.353428 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3108/6155] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:01 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:01.384049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a5261ee2-168c-4ba4-8bf7-cc80cd0f7648 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:01.384947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a5261ee2-168c-4ba4-8bf7-cc80cd0f7648 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:01.394109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5261ee2-168c-4ba4-8bf7-cc80cd0f7648 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:01.394920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5261ee2-168c-4ba4-8bf7-cc80cd0f7648 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:01.395580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5261ee2-168c-4ba4-8bf7-cc80cd0f7648 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:01.396455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5261ee2-168c-4ba4-8bf7-cc80cd0f7648 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:01.397098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5261ee2-168c-4ba4-8bf7-cc80cd0f7648 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:01.397705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a5261ee2-168c-4ba4-8bf7-cc80cd0f7648 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:01.449671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0db9e9eb-799b-40d6-8d68-62d2750ba9a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:01.450690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0db9e9eb-799b-40d6-8d68-62d2750ba9a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:01.459382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0db9e9eb-799b-40d6-8d68-62d2750ba9a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:01.460068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0db9e9eb-799b-40d6-8d68-62d2750ba9a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:01.460829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0db9e9eb-799b-40d6-8d68-62d2750ba9a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:01.461917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0db9e9eb-799b-40d6-8d68-62d2750ba9a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:01.462624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0db9e9eb-799b-40d6-8d68-62d2750ba9a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:01.463372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0db9e9eb-799b-40d6-8d68-62d2750ba9a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:01.501318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a5261ee2-168c-4ba4-8bf7-cc80cd0f7648 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:01.512334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a5261ee2-168c-4ba4-8bf7-cc80cd0f7648 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1354 microversion: 2.1 time: 0.137065 Aug 25 13:54:01.513252 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3048/6156] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:01 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:01.728248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0db9e9eb-799b-40d6-8d68-62d2750ba9a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:01.781368 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0db9e9eb-799b-40d6-8d68-62d2750ba9a5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1375 microversion: 2.1 time: 0.333559 Aug 25 13:54:01.806300 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3109/6157] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:01 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1375 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:02.378552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3a706e42-0317-49f8-8028-1a25f5983cfd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:02.380104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3a706e42-0317-49f8-8028-1a25f5983cfd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:02.394505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a706e42-0317-49f8-8028-1a25f5983cfd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:02.396796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a706e42-0317-49f8-8028-1a25f5983cfd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:02.396796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a706e42-0317-49f8-8028-1a25f5983cfd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:02.397368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a706e42-0317-49f8-8028-1a25f5983cfd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:02.398052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a706e42-0317-49f8-8028-1a25f5983cfd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:02.398918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a706e42-0317-49f8-8028-1a25f5983cfd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:02.548311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-837e2fb8-6212-4434-af0a-f7406baced6f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:02.555976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-837e2fb8-6212-4434-af0a-f7406baced6f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:02.576407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837e2fb8-6212-4434-af0a-f7406baced6f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:02.577225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837e2fb8-6212-4434-af0a-f7406baced6f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:02.577447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837e2fb8-6212-4434-af0a-f7406baced6f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:02.578182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837e2fb8-6212-4434-af0a-f7406baced6f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:02.580447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837e2fb8-6212-4434-af0a-f7406baced6f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:02.581036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-837e2fb8-6212-4434-af0a-f7406baced6f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:02.682967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3a706e42-0317-49f8-8028-1a25f5983cfd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:02.711095 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3a706e42-0317-49f8-8028-1a25f5983cfd tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 0.336045 Aug 25 13:54:02.716644 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3049/6158] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:02 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:02.741754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-837e2fb8-6212-4434-af0a-f7406baced6f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:02.756813 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-837e2fb8-6212-4434-af0a-f7406baced6f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1360 microversion: 2.1 time: 0.224176 Aug 25 13:54:02.758557 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3110/6159] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:02 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:02.822327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0635dc72-f569-465e-8e44-bd8ddb3b15b1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:02.826732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0635dc72-f569-465e-8e44-bd8ddb3b15b1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:02.837445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0635dc72-f569-465e-8e44-bd8ddb3b15b1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:02.838555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0635dc72-f569-465e-8e44-bd8ddb3b15b1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:02.845101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0635dc72-f569-465e-8e44-bd8ddb3b15b1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:02.846578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0635dc72-f569-465e-8e44-bd8ddb3b15b1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:02.847290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0635dc72-f569-465e-8e44-bd8ddb3b15b1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:02.848664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0635dc72-f569-465e-8e44-bd8ddb3b15b1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:03.138620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0635dc72-f569-465e-8e44-bd8ddb3b15b1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:03.169908 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0635dc72-f569-465e-8e44-bd8ddb3b15b1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1375 microversion: 2.1 time: 0.357377 Aug 25 13:54:03.172782 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3050/6160] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:02 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1375 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:03.742265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-41f0f7d5-3112-4229-9513-fc8724132e04 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:03.745452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-41f0f7d5-3112-4229-9513-fc8724132e04 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:03.753580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41f0f7d5-3112-4229-9513-fc8724132e04 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:03.753747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41f0f7d5-3112-4229-9513-fc8724132e04 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:03.755293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41f0f7d5-3112-4229-9513-fc8724132e04 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:03.756643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41f0f7d5-3112-4229-9513-fc8724132e04 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:03.757545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41f0f7d5-3112-4229-9513-fc8724132e04 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:03.758426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41f0f7d5-3112-4229-9513-fc8724132e04 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:03.786742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1613158a-0def-4807-9fcf-c48988ef5058 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:03.787749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1613158a-0def-4807-9fcf-c48988ef5058 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:03.803093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1613158a-0def-4807-9fcf-c48988ef5058 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:03.807861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1613158a-0def-4807-9fcf-c48988ef5058 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:03.813248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1613158a-0def-4807-9fcf-c48988ef5058 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:03.814696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1613158a-0def-4807-9fcf-c48988ef5058 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:03.815494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1613158a-0def-4807-9fcf-c48988ef5058 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:03.816279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1613158a-0def-4807-9fcf-c48988ef5058 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:04.104792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-41f0f7d5-3112-4229-9513-fc8724132e04 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:04.147085 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-41f0f7d5-3112-4229-9513-fc8724132e04 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1689 microversion: 2.1 time: 0.409383 Aug 25 13:54:04.148820 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3111/6161] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:03 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1689 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:04.198461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8299f6ef-5f40-4f26-8cf1-0c11dad4e99a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:04.199566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8299f6ef-5f40-4f26-8cf1-0c11dad4e99a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:04.200231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1613158a-0def-4807-9fcf-c48988ef5058 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:04.210052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8299f6ef-5f40-4f26-8cf1-0c11dad4e99a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:04.211451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8299f6ef-5f40-4f26-8cf1-0c11dad4e99a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:04.212174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8299f6ef-5f40-4f26-8cf1-0c11dad4e99a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:04.213491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8299f6ef-5f40-4f26-8cf1-0c11dad4e99a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:04.214769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8299f6ef-5f40-4f26-8cf1-0c11dad4e99a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:04.215634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8299f6ef-5f40-4f26-8cf1-0c11dad4e99a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:04.219561 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1613158a-0def-4807-9fcf-c48988ef5058 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1428 microversion: 2.1 time: 0.438315 Aug 25 13:54:04.225323 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3051/6162] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:03 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1428 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:04.533002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8299f6ef-5f40-4f26-8cf1-0c11dad4e99a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:04.556963 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8299f6ef-5f40-4f26-8cf1-0c11dad4e99a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1375 microversion: 2.1 time: 0.366629 Aug 25 13:54:04.558628 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3112/6163] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:04 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1375 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:04.958544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-60723cb0-cb53-4350-8dbb-44a50b20a29e req-98f12776-22e8-4d1f-9743-0bb7450e76bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a000574e-1bee-4c31-94d8-8354f189e716", "tag": "e7e5e1aa-3d12-4e36-b83f-342b73aefc9f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:54:04.998390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-60723cb0-cb53-4350-8dbb-44a50b20a29e req-98f12776-22e8-4d1f-9743-0bb7450e76bd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:04.999023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-60723cb0-cb53-4350-8dbb-44a50b20a29e req-98f12776-22e8-4d1f-9743-0bb7450e76bd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:04.999670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-60723cb0-cb53-4350-8dbb-44a50b20a29e req-98f12776-22e8-4d1f-9743-0bb7450e76bd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:05.035087 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-60723cb0-cb53-4350-8dbb-44a50b20a29e req-98f12776-22e8-4d1f-9743-0bb7450e76bd service nova] Creating event network-changed:e7e5e1aa-3d12-4e36-b83f-342b73aefc9f for instance a000574e-1bee-4c31-94d8-8354f189e716 on n-h2-852771-8 Aug 25 13:54:05.045221 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-60723cb0-cb53-4350-8dbb-44a50b20a29e req-98f12776-22e8-4d1f-9743-0bb7450e76bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097041 Aug 25 13:54:05.047388 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3052/6164] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:54:05.179499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9ea8bd1e-c7fa-4024-91dc-e3d4b5029d2c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:05.181351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9ea8bd1e-c7fa-4024-91dc-e3d4b5029d2c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:05.189719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ea8bd1e-c7fa-4024-91dc-e3d4b5029d2c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:05.190450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ea8bd1e-c7fa-4024-91dc-e3d4b5029d2c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:05.191291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ea8bd1e-c7fa-4024-91dc-e3d4b5029d2c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:05.194327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ea8bd1e-c7fa-4024-91dc-e3d4b5029d2c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:05.195221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ea8bd1e-c7fa-4024-91dc-e3d4b5029d2c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:05.196085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ea8bd1e-c7fa-4024-91dc-e3d4b5029d2c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:05.246992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-083b0775-6c6e-4aaf-a00b-6268ef1f9923 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:05.249937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-083b0775-6c6e-4aaf-a00b-6268ef1f9923 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:05.262504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-083b0775-6c6e-4aaf-a00b-6268ef1f9923 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:05.263762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-083b0775-6c6e-4aaf-a00b-6268ef1f9923 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:05.264488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-083b0775-6c6e-4aaf-a00b-6268ef1f9923 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:05.268936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-083b0775-6c6e-4aaf-a00b-6268ef1f9923 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:05.270477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-083b0775-6c6e-4aaf-a00b-6268ef1f9923 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:05.271177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-083b0775-6c6e-4aaf-a00b-6268ef1f9923 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:05.887363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9ea8bd1e-c7fa-4024-91dc-e3d4b5029d2c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:05.906777 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9ea8bd1e-c7fa-4024-91dc-e3d4b5029d2c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1695 microversion: 2.1 time: 0.734092 Aug 25 13:54:05.908465 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3113/6165] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:05 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1695 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:05.915127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9a574133-728f-4e0e-b329-a3336b0682b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:05.915758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9a574133-728f-4e0e-b329-a3336b0682b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:05.923908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a574133-728f-4e0e-b329-a3336b0682b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:05.924744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a574133-728f-4e0e-b329-a3336b0682b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:05.925395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a574133-728f-4e0e-b329-a3336b0682b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:05.926428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a574133-728f-4e0e-b329-a3336b0682b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:05.927289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a574133-728f-4e0e-b329-a3336b0682b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:05.927912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9a574133-728f-4e0e-b329-a3336b0682b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:05.979043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-083b0775-6c6e-4aaf-a00b-6268ef1f9923 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:05.991497 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-083b0775-6c6e-4aaf-a00b-6268ef1f9923 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1428 microversion: 2.1 time: 0.748788 Aug 25 13:54:05.992157 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3053/6166] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:05 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1428 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:06.102538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-78fff5df-299f-47ab-984d-f34242957a4f req-b659e8d6-8d0b-4abd-af4f-67580050f4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02934ab4-1e30-44e6-a774-eb46d981e333", "name": "network-vif-plugged", "status": "completed", "tag": "a9d2f6e0-4b62-45c5-88ab-7fd319d8f0ac"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:54:06.115783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-78fff5df-299f-47ab-984d-f34242957a4f req-b659e8d6-8d0b-4abd-af4f-67580050f4de service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:06.116691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-78fff5df-299f-47ab-984d-f34242957a4f req-b659e8d6-8d0b-4abd-af4f-67580050f4de service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:06.117172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-78fff5df-299f-47ab-984d-f34242957a4f req-b659e8d6-8d0b-4abd-af4f-67580050f4de service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:06.134397 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-78fff5df-299f-47ab-984d-f34242957a4f req-b659e8d6-8d0b-4abd-af4f-67580050f4de service nova] Creating event network-vif-plugged:a9d2f6e0-4b62-45c5-88ab-7fd319d8f0ac for instance 02934ab4-1e30-44e6-a774-eb46d981e333 on n-h1-852771-8 Aug 25 13:54:06.141331 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-78fff5df-299f-47ab-984d-f34242957a4f req-b659e8d6-8d0b-4abd-af4f-67580050f4de service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147092 Aug 25 13:54:06.142117 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3054/6167] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:54:06.150400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9a574133-728f-4e0e-b329-a3336b0682b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:06.162912 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9a574133-728f-4e0e-b329-a3336b0682b2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1375 microversion: 2.1 time: 0.252094 Aug 25 13:54:06.164465 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3114/6168] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:05 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1375 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:06.936792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e6b96cd2-d5c1-4823-a616-7c3d5777c232 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:06.937751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e6b96cd2-d5c1-4823-a616-7c3d5777c232 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:06.946836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b96cd2-d5c1-4823-a616-7c3d5777c232 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:06.947713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b96cd2-d5c1-4823-a616-7c3d5777c232 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:06.948290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b96cd2-d5c1-4823-a616-7c3d5777c232 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:06.949332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b96cd2-d5c1-4823-a616-7c3d5777c232 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:06.950182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b96cd2-d5c1-4823-a616-7c3d5777c232 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:06.950708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6b96cd2-d5c1-4823-a616-7c3d5777c232 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:07.030381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bd0833ad-f10e-4fd9-a76c-9a49796ae9fb tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:07.031769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bd0833ad-f10e-4fd9-a76c-9a49796ae9fb tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:07.045149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd0833ad-f10e-4fd9-a76c-9a49796ae9fb tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:07.045730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd0833ad-f10e-4fd9-a76c-9a49796ae9fb tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:07.046191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd0833ad-f10e-4fd9-a76c-9a49796ae9fb tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:07.046941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd0833ad-f10e-4fd9-a76c-9a49796ae9fb tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:07.047517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd0833ad-f10e-4fd9-a76c-9a49796ae9fb tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:07.047845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bd0833ad-f10e-4fd9-a76c-9a49796ae9fb tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:07.180015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e6b96cd2-d5c1-4823-a616-7c3d5777c232 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:07.197696 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e6b96cd2-d5c1-4823-a616-7c3d5777c232 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1695 microversion: 2.1 time: 0.265813 Aug 25 13:54:07.213364 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3055/6169] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:06 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1695 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:07.229245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1043cb62-0bab-4375-905f-bb5f19521de5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:07.231125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1043cb62-0bab-4375-905f-bb5f19521de5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:07.248437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1043cb62-0bab-4375-905f-bb5f19521de5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:07.250255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1043cb62-0bab-4375-905f-bb5f19521de5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:07.250982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1043cb62-0bab-4375-905f-bb5f19521de5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:07.256798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1043cb62-0bab-4375-905f-bb5f19521de5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:07.257612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1043cb62-0bab-4375-905f-bb5f19521de5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:07.258340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1043cb62-0bab-4375-905f-bb5f19521de5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:07.296408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bd0833ad-f10e-4fd9-a76c-9a49796ae9fb tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:07.313884 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bd0833ad-f10e-4fd9-a76c-9a49796ae9fb tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1428 microversion: 2.1 time: 0.290933 Aug 25 13:54:07.328651 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3115/6170] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:07 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1428 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:07.478519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1043cb62-0bab-4375-905f-bb5f19521de5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:07.490567 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1043cb62-0bab-4375-905f-bb5f19521de5 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1375 microversion: 2.1 time: 0.275011 Aug 25 13:54:07.491440 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3056/6171] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:07 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1375 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:08.233787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6860614d-04dd-4912-bdab-782932018815 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:08.234635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6860614d-04dd-4912-bdab-782932018815 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:08.247894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6860614d-04dd-4912-bdab-782932018815 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:08.248631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6860614d-04dd-4912-bdab-782932018815 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:08.249285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6860614d-04dd-4912-bdab-782932018815 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:08.250662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6860614d-04dd-4912-bdab-782932018815 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:08.251338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6860614d-04dd-4912-bdab-782932018815 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:08.251960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6860614d-04dd-4912-bdab-782932018815 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:08.359106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3a0216d-d66c-47c5-88e0-935150667246 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:08.360274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c3a0216d-d66c-47c5-88e0-935150667246 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:08.372657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3a0216d-d66c-47c5-88e0-935150667246 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:08.373311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3a0216d-d66c-47c5-88e0-935150667246 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:08.373951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3a0216d-d66c-47c5-88e0-935150667246 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:08.375327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3a0216d-d66c-47c5-88e0-935150667246 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:08.376830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3a0216d-d66c-47c5-88e0-935150667246 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:08.378308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3a0216d-d66c-47c5-88e0-935150667246 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:08.481843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6860614d-04dd-4912-bdab-782932018815 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:08.485919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:08.499349 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6860614d-04dd-4912-bdab-782932018815 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1695 microversion: 2.1 time: 0.270224 Aug 25 13:54:08.500653 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3116/6172] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:08 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1695 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:08.523481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85e6674a-141e-4703-b7a3-0d62a9dea061 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:08.524657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85e6674a-141e-4703-b7a3-0d62a9dea061 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:08.536740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e6674a-141e-4703-b7a3-0d62a9dea061 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:08.537663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e6674a-141e-4703-b7a3-0d62a9dea061 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:08.538443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e6674a-141e-4703-b7a3-0d62a9dea061 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:08.539923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e6674a-141e-4703-b7a3-0d62a9dea061 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:08.540778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e6674a-141e-4703-b7a3-0d62a9dea061 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:08.541596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85e6674a-141e-4703-b7a3-0d62a9dea061 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:08.646028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3a0216d-d66c-47c5-88e0-935150667246 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:08.667556 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3a0216d-d66c-47c5-88e0-935150667246 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1428 microversion: 2.1 time: 0.322280 Aug 25 13:54:08.669291 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3057/6173] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:08 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1428 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:08.795373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-85e6674a-141e-4703-b7a3-0d62a9dea061 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:08.812410 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85e6674a-141e-4703-b7a3-0d62a9dea061 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1563 microversion: 2.1 time: 0.296103 Aug 25 13:54:08.813369 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3117/6174] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:08 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1563 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:54:08.848445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4b4ab667-88ab-46af-a649-f130cc984d50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:08.849273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4b4ab667-88ab-46af-a649-f130cc984d50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:08.858109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b4ab667-88ab-46af-a649-f130cc984d50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:08.859030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b4ab667-88ab-46af-a649-f130cc984d50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:08.859858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b4ab667-88ab-46af-a649-f130cc984d50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:08.860632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b4ab667-88ab-46af-a649-f130cc984d50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:08.861183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b4ab667-88ab-46af-a649-f130cc984d50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:08.861922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4b4ab667-88ab-46af-a649-f130cc984d50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:08.882631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:08.983538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1a0f42e6-c709-4695-b811-d8325a4d3b2d req-24d19e50-b819-4182-86cc-592d5db280a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa4a96f-0b26-42e7-880d-63af3734aa76", "name": "network-vif-unplugged", "status": "completed", "tag": "1d2dcd29-a6ca-4cba-bfaa-8229d9209c53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:54:09.007320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a0f42e6-c709-4695-b811-d8325a4d3b2d req-24d19e50-b819-4182-86cc-592d5db280a3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:09.007804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a0f42e6-c709-4695-b811-d8325a4d3b2d req-24d19e50-b819-4182-86cc-592d5db280a3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:09.008433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a0f42e6-c709-4695-b811-d8325a4d3b2d req-24d19e50-b819-4182-86cc-592d5db280a3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:09.027406 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1a0f42e6-c709-4695-b811-d8325a4d3b2d req-24d19e50-b819-4182-86cc-592d5db280a3 service nova] Creating event network-vif-unplugged:1d2dcd29-a6ca-4cba-bfaa-8229d9209c53 for instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 on n-h2-852771-8 Aug 25 13:54:09.036655 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1a0f42e6-c709-4695-b811-d8325a4d3b2d req-24d19e50-b819-4182-86cc-592d5db280a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066700 Aug 25 13:54:09.038468 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3118/6175] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:54:09.092290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4b4ab667-88ab-46af-a649-f130cc984d50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:09.111039 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4b4ab667-88ab-46af-a649-f130cc984d50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1563 microversion: 2.1 time: 0.269149 Aug 25 13:54:09.111664 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3058/6176] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:08 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1563 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:09.242628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f15825c-e8c5-4b22-b62d-48b036dad66c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:09.243766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f15825c-e8c5-4b22-b62d-48b036dad66c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:09.254026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f15825c-e8c5-4b22-b62d-48b036dad66c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:09.255587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f15825c-e8c5-4b22-b62d-48b036dad66c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:09.256915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f15825c-e8c5-4b22-b62d-48b036dad66c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:09.257400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f15825c-e8c5-4b22-b62d-48b036dad66c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:09.258016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f15825c-e8c5-4b22-b62d-48b036dad66c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:09.258803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f15825c-e8c5-4b22-b62d-48b036dad66c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:09.294342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f15825c-e8c5-4b22-b62d-48b036dad66c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:54:09.435619 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f15825c-e8c5-4b22-b62d-48b036dad66c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 204 len: 0 microversion: 2.1 time: 0.200084 Aug 25 13:54:09.436421 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3119/6177] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:54:09 2022] DELETE /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:54:09.454165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b9b5243a-aca7-4931-8da1-21acd3844f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:09.455012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b9b5243a-aca7-4931-8da1-21acd3844f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:09.467926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9b5243a-aca7-4931-8da1-21acd3844f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:09.468861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9b5243a-aca7-4931-8da1-21acd3844f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:09.469740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9b5243a-aca7-4931-8da1-21acd3844f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:09.471075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9b5243a-aca7-4931-8da1-21acd3844f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:09.472002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9b5243a-aca7-4931-8da1-21acd3844f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:09.473444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9b5243a-aca7-4931-8da1-21acd3844f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:09.525475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dda6a438-c910-4cef-be19-2b41dcc7d8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:09.526287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dda6a438-c910-4cef-be19-2b41dcc7d8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:09.535991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dda6a438-c910-4cef-be19-2b41dcc7d8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:09.536800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dda6a438-c910-4cef-be19-2b41dcc7d8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:09.537554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dda6a438-c910-4cef-be19-2b41dcc7d8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:09.538663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dda6a438-c910-4cef-be19-2b41dcc7d8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:09.539391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dda6a438-c910-4cef-be19-2b41dcc7d8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:09.540180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dda6a438-c910-4cef-be19-2b41dcc7d8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:09.760070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b9b5243a-aca7-4931-8da1-21acd3844f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:09.773205 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b9b5243a-aca7-4931-8da1-21acd3844f7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1569 microversion: 2.1 time: 0.331997 Aug 25 13:54:09.775156 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3059/6178] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:09 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1569 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:54:09.783128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-731c568d-d6c4-4e68-82dd-79149c234ae8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:09.785418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-731c568d-d6c4-4e68-82dd-79149c234ae8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:09.801617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dda6a438-c910-4cef-be19-2b41dcc7d8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:09.814731 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dda6a438-c910-4cef-be19-2b41dcc7d8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1695 microversion: 2.1 time: 0.294363 Aug 25 13:54:09.815371 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3120/6179] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:09 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1695 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:54:09.818155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:09.833909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731c568d-d6c4-4e68-82dd-79149c234ae8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:09.834878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731c568d-d6c4-4e68-82dd-79149c234ae8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:09.835831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731c568d-d6c4-4e68-82dd-79149c234ae8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:09.836957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731c568d-d6c4-4e68-82dd-79149c234ae8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:09.838033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731c568d-d6c4-4e68-82dd-79149c234ae8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:09.838733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-731c568d-d6c4-4e68-82dd-79149c234ae8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:09.876810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:10.193534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-731c568d-d6c4-4e68-82dd-79149c234ae8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:10.207952 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-731c568d-d6c4-4e68-82dd-79149c234ae8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1428 microversion: 2.1 time: 0.429783 Aug 25 13:54:10.208979 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3060/6180] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:09 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1428 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:10.824219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-358086b6-5785-4eb4-9314-c69bded7d59d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:10.833794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-358086b6-5785-4eb4-9314-c69bded7d59d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:10.840268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:10.851043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-358086b6-5785-4eb4-9314-c69bded7d59d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:10.852035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-358086b6-5785-4eb4-9314-c69bded7d59d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:10.852698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-358086b6-5785-4eb4-9314-c69bded7d59d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:10.855818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-358086b6-5785-4eb4-9314-c69bded7d59d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:10.855818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-358086b6-5785-4eb4-9314-c69bded7d59d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:10.855818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-358086b6-5785-4eb4-9314-c69bded7d59d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:10.864675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e37c1c0-6dfb-443d-a8c9-46bc505cd8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:10.873579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5e37c1c0-6dfb-443d-a8c9-46bc505cd8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:10.884971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e37c1c0-6dfb-443d-a8c9-46bc505cd8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:10.885763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e37c1c0-6dfb-443d-a8c9-46bc505cd8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:10.886510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e37c1c0-6dfb-443d-a8c9-46bc505cd8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:10.887585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e37c1c0-6dfb-443d-a8c9-46bc505cd8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:10.888298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e37c1c0-6dfb-443d-a8c9-46bc505cd8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:10.888949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e37c1c0-6dfb-443d-a8c9-46bc505cd8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:11.227495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5e37c1c0-6dfb-443d-a8c9-46bc505cd8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:11.248698 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5e37c1c0-6dfb-443d-a8c9-46bc505cd8f1 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1695 microversion: 2.1 time: 0.390776 Aug 25 13:54:11.257342 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3061/6181] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:10 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1695 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:11.283106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59a1bee7-2925-47db-bee2-63ebb6b1a215 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:11.283859 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59a1bee7-2925-47db-bee2-63ebb6b1a215 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:11.302375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a1bee7-2925-47db-bee2-63ebb6b1a215 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:11.303176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a1bee7-2925-47db-bee2-63ebb6b1a215 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:11.303643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a1bee7-2925-47db-bee2-63ebb6b1a215 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:11.305395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a1bee7-2925-47db-bee2-63ebb6b1a215 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:11.306081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a1bee7-2925-47db-bee2-63ebb6b1a215 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:11.306536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a1bee7-2925-47db-bee2-63ebb6b1a215 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:11.351841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-358086b6-5785-4eb4-9314-c69bded7d59d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:11.363516 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-358086b6-5785-4eb4-9314-c69bded7d59d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1569 microversion: 2.1 time: 0.546343 Aug 25 13:54:11.364588 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3121/6182] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:10 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1569 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:11.386240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9f114333-c198-4a23-aafa-2b7b6b2f18a3 req-a8c5bcbd-d916-4fa1-8223-541dbded3fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa4a96f-0b26-42e7-880d-63af3734aa76", "name": "network-vif-plugged", "status": "completed", "tag": "1d2dcd29-a6ca-4cba-bfaa-8229d9209c53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:54:11.417245 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9f114333-c198-4a23-aafa-2b7b6b2f18a3 req-a8c5bcbd-d916-4fa1-8223-541dbded3fb2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:11.418678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9f114333-c198-4a23-aafa-2b7b6b2f18a3 req-a8c5bcbd-d916-4fa1-8223-541dbded3fb2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:11.423764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9f114333-c198-4a23-aafa-2b7b6b2f18a3 req-a8c5bcbd-d916-4fa1-8223-541dbded3fb2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:11.456630 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9f114333-c198-4a23-aafa-2b7b6b2f18a3 req-a8c5bcbd-d916-4fa1-8223-541dbded3fb2 service nova] Creating event network-vif-plugged:1d2dcd29-a6ca-4cba-bfaa-8229d9209c53 for instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 on n-h2-852771-8 Aug 25 13:54:11.467737 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9f114333-c198-4a23-aafa-2b7b6b2f18a3 req-a8c5bcbd-d916-4fa1-8223-541dbded3fb2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091640 Aug 25 13:54:11.469498 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3122/6183] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:54:11.604027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-59a1bee7-2925-47db-bee2-63ebb6b1a215 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:11.630821 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59a1bee7-2925-47db-bee2-63ebb6b1a215 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1428 microversion: 2.1 time: 0.365026 Aug 25 13:54:11.633873 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3062/6184] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:11 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1428 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:12.146202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-6d904f59-dd1f-4303-b819-20a1dad6f44a req-6cc4cf8d-f352-4535-88ec-c6ae5617def1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02934ab4-1e30-44e6-a774-eb46d981e333", "name": "network-vif-deleted", "tag": "a9d2f6e0-4b62-45c5-88ab-7fd319d8f0ac"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:54:12.175569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6d904f59-dd1f-4303-b819-20a1dad6f44a req-6cc4cf8d-f352-4535-88ec-c6ae5617def1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:12.176617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6d904f59-dd1f-4303-b819-20a1dad6f44a req-6cc4cf8d-f352-4535-88ec-c6ae5617def1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:12.178279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6d904f59-dd1f-4303-b819-20a1dad6f44a req-6cc4cf8d-f352-4535-88ec-c6ae5617def1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:12.203789 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-6d904f59-dd1f-4303-b819-20a1dad6f44a req-6cc4cf8d-f352-4535-88ec-c6ae5617def1 service nova] Creating event network-vif-deleted:a9d2f6e0-4b62-45c5-88ab-7fd319d8f0ac for instance 02934ab4-1e30-44e6-a774-eb46d981e333 on n-h1-852771-8 Aug 25 13:54:12.213597 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-6d904f59-dd1f-4303-b819-20a1dad6f44a req-6cc4cf8d-f352-4535-88ec-c6ae5617def1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087306 Aug 25 13:54:12.214930 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3123/6185] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:54:12.297742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-add158bc-04ab-451e-9fd3-a54397d1e4f8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:12.298635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-add158bc-04ab-451e-9fd3-a54397d1e4f8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:12.326835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add158bc-04ab-451e-9fd3-a54397d1e4f8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:12.333009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add158bc-04ab-451e-9fd3-a54397d1e4f8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:12.337317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add158bc-04ab-451e-9fd3-a54397d1e4f8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:12.342617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add158bc-04ab-451e-9fd3-a54397d1e4f8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:12.343477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add158bc-04ab-451e-9fd3-a54397d1e4f8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:12.344762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-add158bc-04ab-451e-9fd3-a54397d1e4f8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:12.402264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e1daf4d9-381b-4b73-9bca-e9997b558916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:12.403636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e1daf4d9-381b-4b73-9bca-e9997b558916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:12.444898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1daf4d9-381b-4b73-9bca-e9997b558916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:12.445783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1daf4d9-381b-4b73-9bca-e9997b558916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:12.446266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1daf4d9-381b-4b73-9bca-e9997b558916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:12.447140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1daf4d9-381b-4b73-9bca-e9997b558916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:12.447569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1daf4d9-381b-4b73-9bca-e9997b558916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:12.447969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1daf4d9-381b-4b73-9bca-e9997b558916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:12.751864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e1daf4d9-381b-4b73-9bca-e9997b558916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:12.773289 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e1daf4d9-381b-4b73-9bca-e9997b558916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1360 microversion: 2.1 time: 0.381620 Aug 25 13:54:12.775992 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3124/6186] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:12 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1360 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:12.786443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b36b726b-cf52-4a17-9f94-c322d7d5f5c8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:12.787978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b36b726b-cf52-4a17-9f94-c322d7d5f5c8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:12.799891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b36b726b-cf52-4a17-9f94-c322d7d5f5c8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:12.801783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b36b726b-cf52-4a17-9f94-c322d7d5f5c8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:12.802869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b36b726b-cf52-4a17-9f94-c322d7d5f5c8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:12.804443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b36b726b-cf52-4a17-9f94-c322d7d5f5c8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:12.805603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b36b726b-cf52-4a17-9f94-c322d7d5f5c8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:12.806630 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b36b726b-cf52-4a17-9f94-c322d7d5f5c8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:12.863538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-add158bc-04ab-451e-9fd3-a54397d1e4f8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:12.882860 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-add158bc-04ab-451e-9fd3-a54397d1e4f8 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1680 microversion: 2.1 time: 0.588635 Aug 25 13:54:12.884789 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3063/6187] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:12 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1680 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:13.093366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b36b726b-cf52-4a17-9f94-c322d7d5f5c8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:13.116623 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b36b726b-cf52-4a17-9f94-c322d7d5f5c8 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1428 microversion: 2.1 time: 0.337723 Aug 25 13:54:13.118388 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3125/6188] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:12 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1428 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:13.803962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a9c3a884-3ced-4eb2-8fdd-35f518cd8915 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:13.805103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a9c3a884-3ced-4eb2-8fdd-35f518cd8915 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:13.814233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9c3a884-3ced-4eb2-8fdd-35f518cd8915 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:13.815134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9c3a884-3ced-4eb2-8fdd-35f518cd8915 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:13.815737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9c3a884-3ced-4eb2-8fdd-35f518cd8915 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:13.817663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9c3a884-3ced-4eb2-8fdd-35f518cd8915 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:13.818180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9c3a884-3ced-4eb2-8fdd-35f518cd8915 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:13.818725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9c3a884-3ced-4eb2-8fdd-35f518cd8915 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:13.949756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9c3a884-3ced-4eb2-8fdd-35f518cd8915 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:13.968572 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a9c3a884-3ced-4eb2-8fdd-35f518cd8915 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1360 microversion: 2.1 time: 0.170430 Aug 25 13:54:13.969963 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3064/6189] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:13 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:14.155030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-16276ddc-22d5-49b0-96e2-3815599bc827 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:14.156006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-16276ddc-22d5-49b0-96e2-3815599bc827 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:14.168672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16276ddc-22d5-49b0-96e2-3815599bc827 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:14.169570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16276ddc-22d5-49b0-96e2-3815599bc827 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:14.170744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16276ddc-22d5-49b0-96e2-3815599bc827 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:14.172034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16276ddc-22d5-49b0-96e2-3815599bc827 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:14.172881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16276ddc-22d5-49b0-96e2-3815599bc827 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:14.173580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-16276ddc-22d5-49b0-96e2-3815599bc827 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:14.467368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-16276ddc-22d5-49b0-96e2-3815599bc827 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:14.493077 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-16276ddc-22d5-49b0-96e2-3815599bc827 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1428 microversion: 2.1 time: 0.344550 Aug 25 13:54:14.494411 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3126/6190] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:14 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1428 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:54:15.009357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eb281b2c-0f0c-4a3b-8a74-3c6fec87a2e2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:15.010643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb281b2c-0f0c-4a3b-8a74-3c6fec87a2e2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:15.028261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0d64d251-8e0f-4e6d-b391-f4d351977680 req-bbec5415-a31a-4925-9d30-b4d4051552e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a000574e-1bee-4c31-94d8-8354f189e716", "name": "network-vif-plugged", "status": "completed", "tag": "e7e5e1aa-3d12-4e36-b83f-342b73aefc9f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:54:15.043125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb281b2c-0f0c-4a3b-8a74-3c6fec87a2e2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:15.044029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb281b2c-0f0c-4a3b-8a74-3c6fec87a2e2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:15.044848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb281b2c-0f0c-4a3b-8a74-3c6fec87a2e2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:15.046525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb281b2c-0f0c-4a3b-8a74-3c6fec87a2e2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:15.047792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb281b2c-0f0c-4a3b-8a74-3c6fec87a2e2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:15.048988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb281b2c-0f0c-4a3b-8a74-3c6fec87a2e2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:15.076559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0d64d251-8e0f-4e6d-b391-f4d351977680 req-bbec5415-a31a-4925-9d30-b4d4051552e0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:15.080261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0d64d251-8e0f-4e6d-b391-f4d351977680 req-bbec5415-a31a-4925-9d30-b4d4051552e0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:15.083186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0d64d251-8e0f-4e6d-b391-f4d351977680 req-bbec5415-a31a-4925-9d30-b4d4051552e0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:15.116794 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0d64d251-8e0f-4e6d-b391-f4d351977680 req-bbec5415-a31a-4925-9d30-b4d4051552e0 service nova] Creating event network-vif-plugged:e7e5e1aa-3d12-4e36-b83f-342b73aefc9f for instance a000574e-1bee-4c31-94d8-8354f189e716 on n-h2-852771-8 Aug 25 13:54:15.128695 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0d64d251-8e0f-4e6d-b391-f4d351977680 req-bbec5415-a31a-4925-9d30-b4d4051552e0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114135 Aug 25 13:54:15.129954 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3127/6191] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:54:15.224981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eb281b2c-0f0c-4a3b-8a74-3c6fec87a2e2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:15.245028 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eb281b2c-0f0c-4a3b-8a74-3c6fec87a2e2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1360 microversion: 2.1 time: 0.254795 Aug 25 13:54:15.245904 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3065/6192] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:14 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1360 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:15.537004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-238a45f4-ad78-4143-87e1-85b04404d21d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:15.540369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-238a45f4-ad78-4143-87e1-85b04404d21d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:15.560618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238a45f4-ad78-4143-87e1-85b04404d21d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:15.562039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238a45f4-ad78-4143-87e1-85b04404d21d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:15.563165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238a45f4-ad78-4143-87e1-85b04404d21d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:15.564812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238a45f4-ad78-4143-87e1-85b04404d21d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:15.565987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238a45f4-ad78-4143-87e1-85b04404d21d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:15.568352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-238a45f4-ad78-4143-87e1-85b04404d21d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:15.895096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-238a45f4-ad78-4143-87e1-85b04404d21d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:15.910423 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-238a45f4-ad78-4143-87e1-85b04404d21d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1428 microversion: 2.1 time: 0.383578 Aug 25 13:54:15.911724 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3128/6193] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:15 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1428 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:16.283315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-108e63ef-3b2a-4c4a-9041-ad7b732d1d65 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:16.284454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-108e63ef-3b2a-4c4a-9041-ad7b732d1d65 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:16.294565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-108e63ef-3b2a-4c4a-9041-ad7b732d1d65 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:16.295078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-108e63ef-3b2a-4c4a-9041-ad7b732d1d65 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:16.295837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-108e63ef-3b2a-4c4a-9041-ad7b732d1d65 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:16.296872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-108e63ef-3b2a-4c4a-9041-ad7b732d1d65 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:16.297355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-108e63ef-3b2a-4c4a-9041-ad7b732d1d65 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:16.298020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-108e63ef-3b2a-4c4a-9041-ad7b732d1d65 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:16.401578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-108e63ef-3b2a-4c4a-9041-ad7b732d1d65 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:16.414392 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-108e63ef-3b2a-4c4a-9041-ad7b732d1d65 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1360 microversion: 2.1 time: 0.138673 Aug 25 13:54:16.415131 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3066/6194] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:16 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1360 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:16.953222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ea7892d-b9b3-4318-9d2d-a2b9bde8bc13 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:16.955302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8ea7892d-b9b3-4318-9d2d-a2b9bde8bc13 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:16.972028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ea7892d-b9b3-4318-9d2d-a2b9bde8bc13 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:16.973400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ea7892d-b9b3-4318-9d2d-a2b9bde8bc13 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:16.974504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ea7892d-b9b3-4318-9d2d-a2b9bde8bc13 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:16.975871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ea7892d-b9b3-4318-9d2d-a2b9bde8bc13 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:16.976736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ea7892d-b9b3-4318-9d2d-a2b9bde8bc13 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:16.977460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ea7892d-b9b3-4318-9d2d-a2b9bde8bc13 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:17.208858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8ea7892d-b9b3-4318-9d2d-a2b9bde8bc13 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:17.221142 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8ea7892d-b9b3-4318-9d2d-a2b9bde8bc13 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1609 microversion: 2.1 time: 0.276369 Aug 25 13:54:17.222864 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3129/6195] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:16 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1609 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:17.260464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9dc21fe4-d8be-409d-9404-dfc88827ae05 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:17.261213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9dc21fe4-d8be-409d-9404-dfc88827ae05 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:17.272435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dc21fe4-d8be-409d-9404-dfc88827ae05 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:17.273107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dc21fe4-d8be-409d-9404-dfc88827ae05 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:17.274002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dc21fe4-d8be-409d-9404-dfc88827ae05 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:17.275535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dc21fe4-d8be-409d-9404-dfc88827ae05 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:17.276327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dc21fe4-d8be-409d-9404-dfc88827ae05 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:17.277302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9dc21fe4-d8be-409d-9404-dfc88827ae05 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:17.525083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9dc21fe4-d8be-409d-9404-dfc88827ae05 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:17.535677 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9dc21fe4-d8be-409d-9404-dfc88827ae05 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1609 microversion: 2.1 time: 0.283363 Aug 25 13:54:17.536431 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3067/6196] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:17 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1609 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:17.564103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d1899b4a-8d93-4160-8805-f2d8bbe36536 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:17.565179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d1899b4a-8d93-4160-8805-f2d8bbe36536 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:17.581754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1899b4a-8d93-4160-8805-f2d8bbe36536 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:17.583396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1899b4a-8d93-4160-8805-f2d8bbe36536 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:17.584598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1899b4a-8d93-4160-8805-f2d8bbe36536 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:17.586316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1899b4a-8d93-4160-8805-f2d8bbe36536 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:17.587696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1899b4a-8d93-4160-8805-f2d8bbe36536 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:17.588922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d1899b4a-8d93-4160-8805-f2d8bbe36536 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:17.700672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-41173314-d6c4-41cf-ad36-7dd74787295a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:17.701314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-41173314-d6c4-41cf-ad36-7dd74787295a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:17.711642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41173314-d6c4-41cf-ad36-7dd74787295a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:17.712150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41173314-d6c4-41cf-ad36-7dd74787295a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:17.712836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41173314-d6c4-41cf-ad36-7dd74787295a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:17.713858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41173314-d6c4-41cf-ad36-7dd74787295a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:17.714410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41173314-d6c4-41cf-ad36-7dd74787295a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:17.714983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41173314-d6c4-41cf-ad36-7dd74787295a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:17.875205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-41173314-d6c4-41cf-ad36-7dd74787295a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:17.897815 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-41173314-d6c4-41cf-ad36-7dd74787295a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1360 microversion: 2.1 time: 0.454045 Aug 25 13:54:17.914941 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3130/6197] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:17 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1360 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:17.940538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d1899b4a-8d93-4160-8805-f2d8bbe36536 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:17.959197 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d1899b4a-8d93-4160-8805-f2d8bbe36536 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1609 microversion: 2.1 time: 0.400045 Aug 25 13:54:17.960435 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3068/6198] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:17 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1609 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:54:18.939264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7ec507fa-5345-4be4-8576-4f6b70d0091f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:18.940704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7ec507fa-5345-4be4-8576-4f6b70d0091f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:18.951341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ec507fa-5345-4be4-8576-4f6b70d0091f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:18.952280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ec507fa-5345-4be4-8576-4f6b70d0091f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:18.952958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ec507fa-5345-4be4-8576-4f6b70d0091f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:18.954035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ec507fa-5345-4be4-8576-4f6b70d0091f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:18.954742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ec507fa-5345-4be4-8576-4f6b70d0091f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:18.955424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7ec507fa-5345-4be4-8576-4f6b70d0091f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:19.110821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7ec507fa-5345-4be4-8576-4f6b70d0091f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:19.122787 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7ec507fa-5345-4be4-8576-4f6b70d0091f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1360 microversion: 2.1 time: 0.187381 Aug 25 13:54:19.123654 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3131/6199] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:18 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1360 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:20.158230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:20.162111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:20.180835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:20.201570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:20.203988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:20.208010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:20.214803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:20.217353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:20.218664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:20.325252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:20.325983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:20.326471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:20.327279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lazy-loading 'fault' on Instance uuid 02934ab4-1e30-44e6-a774-eb46d981e333 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:54:20.420453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:20.448531 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e841f42-e569-4844-8b17-6a595b7e5e4c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 200 len: 1319 microversion: 2.1 time: 0.301491 Aug 25 13:54:20.451873 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3069/6200] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:20 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:21.490288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:21.491589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:21.520320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:21.522177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:21.522980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:21.523990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:21.524986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:21.525991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:21.556807 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 HTTP/1.1 Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '02934ab4-1e30-44e6-a774-eb46d981e333'} Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:21.559290 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:21.563926 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:21.563926 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:21.563926 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:21.563926 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:54:21.563926 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:54:21.563926 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:21.563926 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:21.565984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:54:21.567845 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c876e6a-17ac-4f54-94dd-c5517d6b9ad6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 404 len: 111 microversion: 2.1 time: 0.085139 Aug 25 13:54:21.585467 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3132/6201] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:21 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:54:21.803562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-26af14bd-014c-4b81-9dbc-7e95a26e0655 req-42a2d141-739d-4cf3-9882-0b706a53d0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a000574e-1bee-4c31-94d8-8354f189e716", "tag": "e7e5e1aa-3d12-4e36-b83f-342b73aefc9f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:54:21.821996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-26af14bd-014c-4b81-9dbc-7e95a26e0655 req-42a2d141-739d-4cf3-9882-0b706a53d0fb service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:21.822903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-26af14bd-014c-4b81-9dbc-7e95a26e0655 req-42a2d141-739d-4cf3-9882-0b706a53d0fb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:21.823721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-26af14bd-014c-4b81-9dbc-7e95a26e0655 req-42a2d141-739d-4cf3-9882-0b706a53d0fb service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:21.849415 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-26af14bd-014c-4b81-9dbc-7e95a26e0655 req-42a2d141-739d-4cf3-9882-0b706a53d0fb service nova] Creating event network-changed:e7e5e1aa-3d12-4e36-b83f-342b73aefc9f for instance a000574e-1bee-4c31-94d8-8354f189e716 on n-h2-852771-8 Aug 25 13:54:21.862465 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-26af14bd-014c-4b81-9dbc-7e95a26e0655 req-42a2d141-739d-4cf3-9882-0b706a53d0fb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197950 Aug 25 13:54:21.864616 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3070/6202] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:54:27.200978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a454992-fc82-4337-9765-cc8d0b7621dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:27.201643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a454992-fc82-4337-9765-cc8d0b7621dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:27.204701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:27.212692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a454992-fc82-4337-9765-cc8d0b7621dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:27.213185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a454992-fc82-4337-9765-cc8d0b7621dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:27.213668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a454992-fc82-4337-9765-cc8d0b7621dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:27.214413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a454992-fc82-4337-9765-cc8d0b7621dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:27.215010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a454992-fc82-4337-9765-cc8d0b7621dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:27.215438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a454992-fc82-4337-9765-cc8d0b7621dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:27.255079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a454992-fc82-4337-9765-cc8d0b7621dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:54:27.310417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:27.362739 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a454992-fc82-4337-9765-cc8d0b7621dc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 204 len: 0 microversion: 2.1 time: 0.165290 Aug 25 13:54:27.363353 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3133/6203] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:54:27 2022] DELETE /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:54:27.375853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a4965aa0-a867-4bfa-9f42-a294b8f2c710 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:27.377247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a4965aa0-a867-4bfa-9f42-a294b8f2c710 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:27.387085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4965aa0-a867-4bfa-9f42-a294b8f2c710 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:27.387085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4965aa0-a867-4bfa-9f42-a294b8f2c710 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:27.389539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4965aa0-a867-4bfa-9f42-a294b8f2c710 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:27.389539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4965aa0-a867-4bfa-9f42-a294b8f2c710 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:27.391839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4965aa0-a867-4bfa-9f42-a294b8f2c710 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:27.391839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a4965aa0-a867-4bfa-9f42-a294b8f2c710 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:27.581168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a4965aa0-a867-4bfa-9f42-a294b8f2c710 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:27.592533 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a4965aa0-a867-4bfa-9f42-a294b8f2c710 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1409 microversion: 2.1 time: 0.223876 Aug 25 13:54:27.593134 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3071/6204] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:27 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1409 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:28.616199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6c615a47-593d-45eb-b6cd-ee20592a1b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:28.616942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6c615a47-593d-45eb-b6cd-ee20592a1b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:28.624910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c615a47-593d-45eb-b6cd-ee20592a1b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:28.625563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c615a47-593d-45eb-b6cd-ee20592a1b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:28.625964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c615a47-593d-45eb-b6cd-ee20592a1b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:28.626683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c615a47-593d-45eb-b6cd-ee20592a1b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:28.627237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c615a47-593d-45eb-b6cd-ee20592a1b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:28.627672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c615a47-593d-45eb-b6cd-ee20592a1b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:28.797787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6c615a47-593d-45eb-b6cd-ee20592a1b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:28.806640 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6c615a47-593d-45eb-b6cd-ee20592a1b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1409 microversion: 2.1 time: 0.194764 Aug 25 13:54:28.807239 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3134/6205] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:28 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:29.833114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-79fcf74f-e44d-47f7-8c83-4996db4efde1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:29.833943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-79fcf74f-e44d-47f7-8c83-4996db4efde1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:29.842464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79fcf74f-e44d-47f7-8c83-4996db4efde1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:29.843173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79fcf74f-e44d-47f7-8c83-4996db4efde1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:29.843941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79fcf74f-e44d-47f7-8c83-4996db4efde1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:29.844718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79fcf74f-e44d-47f7-8c83-4996db4efde1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:29.845251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79fcf74f-e44d-47f7-8c83-4996db4efde1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:29.845734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79fcf74f-e44d-47f7-8c83-4996db4efde1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:29.953192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-79fcf74f-e44d-47f7-8c83-4996db4efde1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:29.965597 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-79fcf74f-e44d-47f7-8c83-4996db4efde1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1367 microversion: 2.1 time: 0.139085 Aug 25 13:54:29.966281 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3072/6206] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:29 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1367 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:29.979291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-99fd8c45-146c-483b-849c-7b8bcaa761d6 req-494a1645-ddf4-40f7-9781-fd134b936790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0275ad9f-2318-4002-8576-66cbace22bdb", "name": "network-vif-deleted", "tag": "aed9b9c0-f776-4a87-bdea-b3f1bb6327e2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:54:29.994882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-99fd8c45-146c-483b-849c-7b8bcaa761d6 req-494a1645-ddf4-40f7-9781-fd134b936790 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:29.995523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-99fd8c45-146c-483b-849c-7b8bcaa761d6 req-494a1645-ddf4-40f7-9781-fd134b936790 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:29.995969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-99fd8c45-146c-483b-849c-7b8bcaa761d6 req-494a1645-ddf4-40f7-9781-fd134b936790 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:30.014039 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-99fd8c45-146c-483b-849c-7b8bcaa761d6 req-494a1645-ddf4-40f7-9781-fd134b936790 service nova] Creating event network-vif-deleted:aed9b9c0-f776-4a87-bdea-b3f1bb6327e2 for instance 0275ad9f-2318-4002-8576-66cbace22bdb on n-h2-852771-8 Aug 25 13:54:30.020836 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-99fd8c45-146c-483b-849c-7b8bcaa761d6 req-494a1645-ddf4-40f7-9781-fd134b936790 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047465 Aug 25 13:54:30.022124 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3135/6207] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:54:30.992073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1241c00e-5960-4d8d-b0de-b18c9b7c81db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:30.992925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1241c00e-5960-4d8d-b0de-b18c9b7c81db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:31.005847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1241c00e-5960-4d8d-b0de-b18c9b7c81db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:31.006534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1241c00e-5960-4d8d-b0de-b18c9b7c81db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:31.007182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1241c00e-5960-4d8d-b0de-b18c9b7c81db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:31.008430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1241c00e-5960-4d8d-b0de-b18c9b7c81db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:31.009960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1241c00e-5960-4d8d-b0de-b18c9b7c81db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:31.010472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1241c00e-5960-4d8d-b0de-b18c9b7c81db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:31.106347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1241c00e-5960-4d8d-b0de-b18c9b7c81db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:31.117995 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1241c00e-5960-4d8d-b0de-b18c9b7c81db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1201 microversion: 2.1 time: 0.132199 Aug 25 13:54:31.132928 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3073/6208] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:30 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1201 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:54:32.142122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d9de151-0f21-4407-9ac4-b64fdcfe6676 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:32.142914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9d9de151-0f21-4407-9ac4-b64fdcfe6676 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:32.152727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d9de151-0f21-4407-9ac4-b64fdcfe6676 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:32.154005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d9de151-0f21-4407-9ac4-b64fdcfe6676 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:32.155041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d9de151-0f21-4407-9ac4-b64fdcfe6676 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:32.155950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d9de151-0f21-4407-9ac4-b64fdcfe6676 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:32.156577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d9de151-0f21-4407-9ac4-b64fdcfe6676 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:32.157182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d9de151-0f21-4407-9ac4-b64fdcfe6676 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:32.233563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d9de151-0f21-4407-9ac4-b64fdcfe6676 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:32.254962 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d9de151-0f21-4407-9ac4-b64fdcfe6676 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1201 microversion: 2.1 time: 0.117853 Aug 25 13:54:32.255877 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3136/6209] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:32 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1201 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:54:33.279563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-82791368-0c1e-49ec-b8bd-74b1fe769edb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:33.280208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-82791368-0c1e-49ec-b8bd-74b1fe769edb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:33.288970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82791368-0c1e-49ec-b8bd-74b1fe769edb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:33.292990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82791368-0c1e-49ec-b8bd-74b1fe769edb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:33.293572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82791368-0c1e-49ec-b8bd-74b1fe769edb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:33.301317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82791368-0c1e-49ec-b8bd-74b1fe769edb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:33.302321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82791368-0c1e-49ec-b8bd-74b1fe769edb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:33.303160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-82791368-0c1e-49ec-b8bd-74b1fe769edb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:33.403485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-82791368-0c1e-49ec-b8bd-74b1fe769edb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:33.412445 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-82791368-0c1e-49ec-b8bd-74b1fe769edb tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1201 microversion: 2.1 time: 0.136967 Aug 25 13:54:33.413061 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3074/6210] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:33 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1201 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:54:34.433483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c9529a6-24d5-47fb-ab56-86d9271aded9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:34.434364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5c9529a6-24d5-47fb-ab56-86d9271aded9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:34.442358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c9529a6-24d5-47fb-ab56-86d9271aded9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:34.442848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c9529a6-24d5-47fb-ab56-86d9271aded9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:34.443298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c9529a6-24d5-47fb-ab56-86d9271aded9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:34.444040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c9529a6-24d5-47fb-ab56-86d9271aded9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:34.444509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c9529a6-24d5-47fb-ab56-86d9271aded9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:34.444940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c9529a6-24d5-47fb-ab56-86d9271aded9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:34.520333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5c9529a6-24d5-47fb-ab56-86d9271aded9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:54:34.534750 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c9529a6-24d5-47fb-ab56-86d9271aded9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 200 len: 1201 microversion: 2.1 time: 0.104767 Aug 25 13:54:34.536714 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3137/6211] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:34 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 1201 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:54:35.567658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:35.568542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:35.577037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:35.577590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:35.578444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:35.579633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:35.580143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:35.580758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:35.608014 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb HTTP/1.1 Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '0275ad9f-2318-4002-8576-66cbace22bdb'} Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:35.611580 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:35.617428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:35.617428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:35.617428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:35.617428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:54:35.617428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:54:35.617428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:35.617428 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:35.617428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:54:35.617428 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a79117ef-ceed-476a-83f5-0eed55a00d2b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 404 len: 111 microversion: 2.1 time: 0.056021 Aug 25 13:54:35.617428 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3075/6212] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:35 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:54:39.972220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:39.972784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:39.980404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:39.981068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:39.981597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:39.982295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:39.982755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:39.983195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:40.001860 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 HTTP/1.1 Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '02934ab4-1e30-44e6-a774-eb46d981e333'} Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:54:40.004367 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8492e586-a8b4-45f5-9ce5-c05670fda88b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 404 len: 111 microversion: 2.1 time: 0.037832 Aug 25 13:54:40.008966 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3138/6213] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:54:39 2022] DELETE /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:54:40.015337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:40.015976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 02934ab4-1e30-44e6-a774-eb46d981e333] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:40.023569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:40.024087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:40.024543 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:40.025269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:40.025767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:40.026212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:40.029892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:40.041327 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 HTTP/1.1 Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '02934ab4-1e30-44e6-a774-eb46d981e333'} Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:40.043030 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.047636 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.047636 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:40.047636 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:40.047636 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:54:40.047636 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:54:40.047636 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. Aug 25 13:54:40.047636 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.047636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 02934ab4-1e30-44e6-a774-eb46d981e333 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:54:40.047636 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-69fba930-412c-4eab-9546-120cea31eb1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333" status: 404 len: 111 microversion: 2.1 time: 0.033260 Aug 25 13:54:40.050248 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3076/6214] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:40 2022] GET /compute/v2.1/servers/02934ab4-1e30-44e6-a774-eb46d981e333 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:54:40.646626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:40.647276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:40.656502 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:40.656998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:40.657443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:40.658231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:40.659073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:40.659512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:40.675369 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb HTTP/1.1 Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '0275ad9f-2318-4002-8576-66cbace22bdb'} Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:54:40.676949 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8ee6973b-9881-4057-8544-b03a0363e0ef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 404 len: 111 microversion: 2.1 time: 0.035849 Aug 25 13:54:40.683064 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3139/6215] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:54:40 2022] DELETE /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:54:40.692133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:54:40.693057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 0275ad9f-2318-4002-8576-66cbace22bdb] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:40.701054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:40.702013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:40.702489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:40.703273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:40.703857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:40.704318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:40.732751 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb HTTP/1.1 Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '0275ad9f-2318-4002-8576-66cbace22bdb'} Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:54:40.734420 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.741603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:54:40.741603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:54:40.741603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:54:40.741603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:54:40.741603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:54:40.741603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. Aug 25 13:54:40.741603 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:54:40.741603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 0275ad9f-2318-4002-8576-66cbace22bdb could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:54:40.741603 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-253d4378-9336-4d03-86ea-684db5a10d7e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb" status: 404 len: 111 microversion: 2.1 time: 0.050310 Aug 25 13:54:40.741603 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3077/6216] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:54:40 2022] GET /compute/v2.1/servers/0275ad9f-2318-4002-8576-66cbace22bdb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:54:40.820953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ead97d51-80b1-4a96-9924-ab06441cb6da tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Action: 'create', calling method: .version_select at 0x7f3a292d6ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1200164785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOFcVT3vO9Ynqs8FpPvHiHfuF1PIY/vpbxfVfKJRB9Dzc8d5l5AMTIEdiesne20UzXB56fXMlkgj/nK0irbso+y7x0U4WkxNfNH1ieHcBtEAXea9t3YeJdutenxoqXRmg=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:54:40.839022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ead97d51-80b1-4a96-9924-ab06441cb6da tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:54:40.844897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-ead97d51-80b1-4a96-9924-ab06441cb6da tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for user 93fbad0b63d14f3fb12de08d966bffad and project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:54:40.872312 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ead97d51-80b1-4a96-9924-ab06441cb6da tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.055581 Aug 25 13:54:40.873118 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3140/6217] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:54:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:54:51.299991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-31d9be13-a164-4041-8da7-201b0c0992be tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:54:51.302619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-31d9be13-a164-4041-8da7-201b0c0992be tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:54:51.306168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=19 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:51.307069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:54:51.316142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31d9be13-a164-4041-8da7-201b0c0992be tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:51.316933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31d9be13-a164-4041-8da7-201b0c0992be tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:51.317402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31d9be13-a164-4041-8da7-201b0c0992be tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:51.318206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31d9be13-a164-4041-8da7-201b0c0992be tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:54:51.319013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31d9be13-a164-4041-8da7-201b0c0992be tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:54:51.319262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31d9be13-a164-4041-8da7-201b0c0992be tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:54:51.394093 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-31d9be13-a164-4041-8da7-201b0c0992be tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "POST /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76/action" status: 200 len: 24566 microversion: 2.1 time: 0.097851 Aug 25 13:54:51.395228 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3078/6218] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 13:54:51 2022] POST /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76/action => generated 24566 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:55:01.887944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1691591557", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1200164785", "security_groups": [{"name": "tempest-secgroup-smoke-1252652195"}], "block_device_mapping_v2": [{"uuid": "a6b97cd7-d3bf-43b1-b254-2358ca66df6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9216295-ead7-4063-84e8-342351244740"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:55:01.900017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:01.901092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:01.903044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:02.024679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] validate_networks() for [('f9216295-ead7-4063-84e8-342351244740', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:55:02.457995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:55:02.458430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:55:02.458911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:55:02.459323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:55:02.459739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:55:02.471690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:02.472174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:02.472833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:02.473614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:02.474078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:02.474560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:02.494773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:55:02.500922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for user 93fbad0b63d14f3fb12de08d966bffad and project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:55:02.571003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:55:02.573616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6b97cd7-d3bf-43b1-b254-2358ca66df6a',volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:55:02.723632 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-06d57e73-aae1-4e52-a971-2ce0a9b6038f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.840266 Aug 25 13:55:02.724381 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3141/6219] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:55:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:55:02.737250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-566a3f49-d590-4c2c-ab09-7c9b9c5bdc95 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:02.738000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-566a3f49-d590-4c2c-ab09-7c9b9c5bdc95 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:02.741335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:02.742062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:02.800871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-566a3f49-d590-4c2c-ab09-7c9b9c5bdc95 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:02.808292 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-566a3f49-d590-4c2c-ab09-7c9b9c5bdc95 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1095 microversion: 2.1 time: 0.076315 Aug 25 13:55:02.809519 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3079/6220] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:02 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:03.831072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ec3ee93-528c-43a0-add5-cb50f8bc1efa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:03.831668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8ec3ee93-528c-43a0-add5-cb50f8bc1efa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:03.896562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8ec3ee93-528c-43a0-add5-cb50f8bc1efa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:03.906933 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8ec3ee93-528c-43a0-add5-cb50f8bc1efa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1095 microversion: 2.1 time: 0.081322 Aug 25 13:55:03.907684 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3142/6221] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:03 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:04.935589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c885eda-10c9-41c0-a68b-5010a4df5160 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:04.937007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9c885eda-10c9-41c0-a68b-5010a4df5160 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:04.947924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c885eda-10c9-41c0-a68b-5010a4df5160 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:04.948813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c885eda-10c9-41c0-a68b-5010a4df5160 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:04.949491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c885eda-10c9-41c0-a68b-5010a4df5160 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:04.950674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c885eda-10c9-41c0-a68b-5010a4df5160 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:04.951867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c885eda-10c9-41c0-a68b-5010a4df5160 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:04.952482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c885eda-10c9-41c0-a68b-5010a4df5160 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:05.031986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9c885eda-10c9-41c0-a68b-5010a4df5160 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:05.041113 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c885eda-10c9-41c0-a68b-5010a4df5160 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1211 microversion: 2.1 time: 0.110502 Aug 25 13:55:05.049550 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3080/6222] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:04 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:06.063097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c7daf3e-f6fc-4f95-8a8a-fdf172193c51 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:06.065853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c7daf3e-f6fc-4f95-8a8a-fdf172193c51 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:06.075351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7daf3e-f6fc-4f95-8a8a-fdf172193c51 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:06.076675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7daf3e-f6fc-4f95-8a8a-fdf172193c51 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:06.077648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7daf3e-f6fc-4f95-8a8a-fdf172193c51 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:06.078359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7daf3e-f6fc-4f95-8a8a-fdf172193c51 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:06.078831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7daf3e-f6fc-4f95-8a8a-fdf172193c51 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:06.079460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c7daf3e-f6fc-4f95-8a8a-fdf172193c51 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:06.253700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7c7daf3e-f6fc-4f95-8a8a-fdf172193c51 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:06.263895 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c7daf3e-f6fc-4f95-8a8a-fdf172193c51 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1279 microversion: 2.1 time: 0.204720 Aug 25 13:55:06.278447 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3143/6223] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:06 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:06.496060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8e8cd584-49c8-4d9e-9d4f-5fc523b8eb11 req-60437255-c901-49a8-88c3-671e8665fa30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdc7943-2094-4efe-b733-b69755860c2e", "tag": "2afc0e3e-d5bd-41c3-ad3c-2758dd1463e1"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:55:06.509235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8e8cd584-49c8-4d9e-9d4f-5fc523b8eb11 req-60437255-c901-49a8-88c3-671e8665fa30 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:06.510007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8e8cd584-49c8-4d9e-9d4f-5fc523b8eb11 req-60437255-c901-49a8-88c3-671e8665fa30 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:06.510669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8e8cd584-49c8-4d9e-9d4f-5fc523b8eb11 req-60437255-c901-49a8-88c3-671e8665fa30 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:06.525033 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8e8cd584-49c8-4d9e-9d4f-5fc523b8eb11 req-60437255-c901-49a8-88c3-671e8665fa30 service nova] Creating event network-changed:2afc0e3e-d5bd-41c3-ad3c-2758dd1463e1 for instance 9cdc7943-2094-4efe-b733-b69755860c2e on n-h1-852771-8 Aug 25 13:55:06.542905 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8e8cd584-49c8-4d9e-9d4f-5fc523b8eb11 req-60437255-c901-49a8-88c3-671e8665fa30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051437 Aug 25 13:55:06.544204 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3081/6224] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:55:07.287380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12fa5679-2802-4ca0-8170-91d092fbed5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:07.288891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12fa5679-2802-4ca0-8170-91d092fbed5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:07.297908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fa5679-2802-4ca0-8170-91d092fbed5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:07.298816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fa5679-2802-4ca0-8170-91d092fbed5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:07.299459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fa5679-2802-4ca0-8170-91d092fbed5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:07.300462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fa5679-2802-4ca0-8170-91d092fbed5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:07.301433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fa5679-2802-4ca0-8170-91d092fbed5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:07.302141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fa5679-2802-4ca0-8170-91d092fbed5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:07.482396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12fa5679-2802-4ca0-8170-91d092fbed5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:07.493220 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12fa5679-2802-4ca0-8170-91d092fbed5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1279 microversion: 2.1 time: 0.210142 Aug 25 13:55:07.494847 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3144/6225] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:07 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:55:08.518437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0af7cd56-158e-443f-9180-ade431eb6f0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:08.519153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0af7cd56-158e-443f-9180-ade431eb6f0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:08.527540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0af7cd56-158e-443f-9180-ade431eb6f0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:08.528216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0af7cd56-158e-443f-9180-ade431eb6f0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:08.528836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0af7cd56-158e-443f-9180-ade431eb6f0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:08.529695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0af7cd56-158e-443f-9180-ade431eb6f0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:08.530304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0af7cd56-158e-443f-9180-ade431eb6f0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:08.530826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0af7cd56-158e-443f-9180-ade431eb6f0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:08.696821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0af7cd56-158e-443f-9180-ade431eb6f0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:08.706932 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0af7cd56-158e-443f-9180-ade431eb6f0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1279 microversion: 2.1 time: 0.194080 Aug 25 13:55:08.707595 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3082/6226] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:08 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:09.727178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-68a33114-8927-408d-a240-0331278cbe0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:09.728106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-68a33114-8927-408d-a240-0331278cbe0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:09.738309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a33114-8927-408d-a240-0331278cbe0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:09.738947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a33114-8927-408d-a240-0331278cbe0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:09.739493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a33114-8927-408d-a240-0331278cbe0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:09.740306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a33114-8927-408d-a240-0331278cbe0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:09.740889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a33114-8927-408d-a240-0331278cbe0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:09.741412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-68a33114-8927-408d-a240-0331278cbe0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:09.898304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-68a33114-8927-408d-a240-0331278cbe0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:09.907489 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-68a33114-8927-408d-a240-0331278cbe0b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1279 microversion: 2.1 time: 0.184058 Aug 25 13:55:09.913249 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3145/6227] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:09 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:10.931270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cd02fc74-aea2-4fda-9e0f-c470e773cc0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:10.932765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cd02fc74-aea2-4fda-9e0f-c470e773cc0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:10.941814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd02fc74-aea2-4fda-9e0f-c470e773cc0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:10.942800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd02fc74-aea2-4fda-9e0f-c470e773cc0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:10.943506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd02fc74-aea2-4fda-9e0f-c470e773cc0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:10.944556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd02fc74-aea2-4fda-9e0f-c470e773cc0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:10.946231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd02fc74-aea2-4fda-9e0f-c470e773cc0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:10.946917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cd02fc74-aea2-4fda-9e0f-c470e773cc0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:11.134525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cd02fc74-aea2-4fda-9e0f-c470e773cc0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:11.147840 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cd02fc74-aea2-4fda-9e0f-c470e773cc0f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1279 microversion: 2.1 time: 0.220781 Aug 25 13:55:11.149429 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3083/6228] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:10 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:55:12.170347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97fac89e-74cb-4e4c-bc6c-177a24301fef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:12.171038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-97fac89e-74cb-4e4c-bc6c-177a24301fef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:12.185710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97fac89e-74cb-4e4c-bc6c-177a24301fef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:12.186323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97fac89e-74cb-4e4c-bc6c-177a24301fef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:12.186846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97fac89e-74cb-4e4c-bc6c-177a24301fef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:12.187403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97fac89e-74cb-4e4c-bc6c-177a24301fef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:12.187881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97fac89e-74cb-4e4c-bc6c-177a24301fef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:12.188320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97fac89e-74cb-4e4c-bc6c-177a24301fef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:12.353224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-97fac89e-74cb-4e4c-bc6c-177a24301fef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:12.367561 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-97fac89e-74cb-4e4c-bc6c-177a24301fef tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1267 microversion: 2.1 time: 0.201353 Aug 25 13:55:12.368842 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3146/6229] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:12 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:55:13.392465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-941d7568-9643-4ffe-8213-ce699bbb2d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:13.393244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-941d7568-9643-4ffe-8213-ce699bbb2d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:13.396429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:13.402099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-941d7568-9643-4ffe-8213-ce699bbb2d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:13.402614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-941d7568-9643-4ffe-8213-ce699bbb2d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:13.403078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-941d7568-9643-4ffe-8213-ce699bbb2d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:13.403968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-941d7568-9643-4ffe-8213-ce699bbb2d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:13.404553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-941d7568-9643-4ffe-8213-ce699bbb2d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:13.405872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-941d7568-9643-4ffe-8213-ce699bbb2d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:13.901088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-941d7568-9643-4ffe-8213-ce699bbb2d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:13.915846 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-941d7568-9643-4ffe-8213-ce699bbb2d7f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1267 microversion: 2.1 time: 0.526848 Aug 25 13:55:13.915846 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3084/6230] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:13 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1267 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:14.937908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-574f5b63-c3ff-4db8-b45a-0e3e70f83b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:14.939083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-574f5b63-c3ff-4db8-b45a-0e3e70f83b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:14.941478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:14.943136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=8 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:14.949676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-574f5b63-c3ff-4db8-b45a-0e3e70f83b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:14.950189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-574f5b63-c3ff-4db8-b45a-0e3e70f83b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:14.950652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-574f5b63-c3ff-4db8-b45a-0e3e70f83b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:14.951441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-574f5b63-c3ff-4db8-b45a-0e3e70f83b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:14.951889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-574f5b63-c3ff-4db8-b45a-0e3e70f83b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:14.952331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-574f5b63-c3ff-4db8-b45a-0e3e70f83b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:15.127749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-574f5b63-c3ff-4db8-b45a-0e3e70f83b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:15.136575 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-574f5b63-c3ff-4db8-b45a-0e3e70f83b80 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1267 microversion: 2.1 time: 0.202544 Aug 25 13:55:15.137220 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3147/6231] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:14 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:16.159065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-af898ca3-82a4-4166-9f13-44824a171455 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:16.160100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-af898ca3-82a4-4166-9f13-44824a171455 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:16.172833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af898ca3-82a4-4166-9f13-44824a171455 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:16.173840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af898ca3-82a4-4166-9f13-44824a171455 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:16.174687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af898ca3-82a4-4166-9f13-44824a171455 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:16.176126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af898ca3-82a4-4166-9f13-44824a171455 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:16.177057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af898ca3-82a4-4166-9f13-44824a171455 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:16.178032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af898ca3-82a4-4166-9f13-44824a171455 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:16.400515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-af898ca3-82a4-4166-9f13-44824a171455 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:16.416224 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-af898ca3-82a4-4166-9f13-44824a171455 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1267 microversion: 2.1 time: 0.260807 Aug 25 13:55:16.417337 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3085/6232] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:16 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:17.452958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7d1503ff-acff-4670-a3d6-3e5b163667a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:17.454649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7d1503ff-acff-4670-a3d6-3e5b163667a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:17.466665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d1503ff-acff-4670-a3d6-3e5b163667a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:17.467538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d1503ff-acff-4670-a3d6-3e5b163667a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:17.468307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d1503ff-acff-4670-a3d6-3e5b163667a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:17.470164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d1503ff-acff-4670-a3d6-3e5b163667a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:17.471128 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d1503ff-acff-4670-a3d6-3e5b163667a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:17.471901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d1503ff-acff-4670-a3d6-3e5b163667a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:17.696198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7d1503ff-acff-4670-a3d6-3e5b163667a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:17.708022 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7d1503ff-acff-4670-a3d6-3e5b163667a8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1267 microversion: 2.1 time: 0.262101 Aug 25 13:55:17.708687 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3148/6233] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:17 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:18.737104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7badb185-466a-42d7-961e-668ae5ad193c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:18.738387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7badb185-466a-42d7-961e-668ae5ad193c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:18.751542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7badb185-466a-42d7-961e-668ae5ad193c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:18.752492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7badb185-466a-42d7-961e-668ae5ad193c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:18.753365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7badb185-466a-42d7-961e-668ae5ad193c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:18.754730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7badb185-466a-42d7-961e-668ae5ad193c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:18.755345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7badb185-466a-42d7-961e-668ae5ad193c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:18.755944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7badb185-466a-42d7-961e-668ae5ad193c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:18.929111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7badb185-466a-42d7-961e-668ae5ad193c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:18.939775 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7badb185-466a-42d7-961e-668ae5ad193c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1267 microversion: 2.1 time: 0.210869 Aug 25 13:55:18.940372 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3086/6234] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:18 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:19.963728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-968016c6-8508-4648-91e3-3985ac687023 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:19.964571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-968016c6-8508-4648-91e3-3985ac687023 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:19.974280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968016c6-8508-4648-91e3-3985ac687023 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:19.975177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968016c6-8508-4648-91e3-3985ac687023 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:19.975927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968016c6-8508-4648-91e3-3985ac687023 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:19.977112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968016c6-8508-4648-91e3-3985ac687023 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:19.977960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968016c6-8508-4648-91e3-3985ac687023 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:19.979521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968016c6-8508-4648-91e3-3985ac687023 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:20.150744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-968016c6-8508-4648-91e3-3985ac687023 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:20.162052 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-968016c6-8508-4648-91e3-3985ac687023 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1267 microversion: 2.1 time: 0.203671 Aug 25 13:55:20.163069 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3149/6235] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:19 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:55:21.192555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5bb1f71b-6046-4578-a616-c4b816d8dc98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:21.193248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5bb1f71b-6046-4578-a616-c4b816d8dc98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:21.200557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bb1f71b-6046-4578-a616-c4b816d8dc98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:21.201077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bb1f71b-6046-4578-a616-c4b816d8dc98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:21.201569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bb1f71b-6046-4578-a616-c4b816d8dc98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:21.202326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bb1f71b-6046-4578-a616-c4b816d8dc98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:21.202815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bb1f71b-6046-4578-a616-c4b816d8dc98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:21.203266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5bb1f71b-6046-4578-a616-c4b816d8dc98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:21.414579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5bb1f71b-6046-4578-a616-c4b816d8dc98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:21.423623 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5bb1f71b-6046-4578-a616-c4b816d8dc98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1267 microversion: 2.1 time: 0.235968 Aug 25 13:55:21.424334 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3087/6236] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:21 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:21.850876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0fb93679-14c6-4bbb-befb-17b61501ef0d req-4661c2e9-0f3f-4803-ad5a-0bd3f2bd1237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdc7943-2094-4efe-b733-b69755860c2e", "name": "network-vif-plugged", "status": "completed", "tag": "2afc0e3e-d5bd-41c3-ad3c-2758dd1463e1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:55:21.863229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0fb93679-14c6-4bbb-befb-17b61501ef0d req-4661c2e9-0f3f-4803-ad5a-0bd3f2bd1237 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:21.864149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0fb93679-14c6-4bbb-befb-17b61501ef0d req-4661c2e9-0f3f-4803-ad5a-0bd3f2bd1237 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:21.864864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0fb93679-14c6-4bbb-befb-17b61501ef0d req-4661c2e9-0f3f-4803-ad5a-0bd3f2bd1237 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:21.878593 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0fb93679-14c6-4bbb-befb-17b61501ef0d req-4661c2e9-0f3f-4803-ad5a-0bd3f2bd1237 service nova] Creating event network-vif-plugged:2afc0e3e-d5bd-41c3-ad3c-2758dd1463e1 for instance 9cdc7943-2094-4efe-b733-b69755860c2e on n-h1-852771-8 Aug 25 13:55:21.886268 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0fb93679-14c6-4bbb-befb-17b61501ef0d req-4661c2e9-0f3f-4803-ad5a-0bd3f2bd1237 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041711 Aug 25 13:55:21.887162 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3150/6237] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:55:22.447067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-024c4b22-499a-4ea0-ab07-51de049144ff tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:22.447653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-024c4b22-499a-4ea0-ab07-51de049144ff tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:22.455633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024c4b22-499a-4ea0-ab07-51de049144ff tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:22.455886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024c4b22-499a-4ea0-ab07-51de049144ff tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:22.456431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024c4b22-499a-4ea0-ab07-51de049144ff tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:22.457105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024c4b22-499a-4ea0-ab07-51de049144ff tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:22.457623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024c4b22-499a-4ea0-ab07-51de049144ff tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:22.458057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-024c4b22-499a-4ea0-ab07-51de049144ff tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:22.633429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-024c4b22-499a-4ea0-ab07-51de049144ff tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:22.649591 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-024c4b22-499a-4ea0-ab07-51de049144ff tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1267 microversion: 2.1 time: 0.206623 Aug 25 13:55:22.650507 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3088/6238] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:22 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:23.684639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6f2fa60b-222f-473e-a949-8c357b91eba1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:23.685585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6f2fa60b-222f-473e-a949-8c357b91eba1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:23.696472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60b-222f-473e-a949-8c357b91eba1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:23.697724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60b-222f-473e-a949-8c357b91eba1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:23.698683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60b-222f-473e-a949-8c357b91eba1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:23.699772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60b-222f-473e-a949-8c357b91eba1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:23.700734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60b-222f-473e-a949-8c357b91eba1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:23.701362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60b-222f-473e-a949-8c357b91eba1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:23.899916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6f2fa60b-222f-473e-a949-8c357b91eba1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:23.913190 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6f2fa60b-222f-473e-a949-8c357b91eba1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1454 microversion: 2.1 time: 0.237517 Aug 25 13:55:23.914215 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3151/6239] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:23 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1454 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:55:23.950484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1189710b-5b8f-459f-a88c-44f32851c652 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:23.951563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1189710b-5b8f-459f-a88c-44f32851c652 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:23.963367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1189710b-5b8f-459f-a88c-44f32851c652 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:23.964141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1189710b-5b8f-459f-a88c-44f32851c652 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:23.964933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1189710b-5b8f-459f-a88c-44f32851c652 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:23.966161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1189710b-5b8f-459f-a88c-44f32851c652 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:23.966905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1189710b-5b8f-459f-a88c-44f32851c652 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:23.967903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1189710b-5b8f-459f-a88c-44f32851c652 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:24.158459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1189710b-5b8f-459f-a88c-44f32851c652 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:24.167032 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1189710b-5b8f-459f-a88c-44f32851c652 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1454 microversion: 2.1 time: 0.223080 Aug 25 13:55:24.168170 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3089/6240] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:23 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1454 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:55:26.777026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-478bd753-d260-47ff-a2f5-ba63b302f088 req-f16d1875-0927-4fdc-99af-0a443a02262e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdc7943-2094-4efe-b733-b69755860c2e", "tag": "2afc0e3e-d5bd-41c3-ad3c-2758dd1463e1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:55:26.792154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-478bd753-d260-47ff-a2f5-ba63b302f088 req-f16d1875-0927-4fdc-99af-0a443a02262e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:26.792696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-478bd753-d260-47ff-a2f5-ba63b302f088 req-f16d1875-0927-4fdc-99af-0a443a02262e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:26.793109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-478bd753-d260-47ff-a2f5-ba63b302f088 req-f16d1875-0927-4fdc-99af-0a443a02262e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:26.811559 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-478bd753-d260-47ff-a2f5-ba63b302f088 req-f16d1875-0927-4fdc-99af-0a443a02262e service nova] Creating event network-changed:2afc0e3e-d5bd-41c3-ad3c-2758dd1463e1 for instance 9cdc7943-2094-4efe-b733-b69755860c2e on n-h1-852771-8 Aug 25 13:55:26.819499 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-478bd753-d260-47ff-a2f5-ba63b302f088 req-f16d1875-0927-4fdc-99af-0a443a02262e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046156 Aug 25 13:55:26.820123 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3152/6241] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:55:31.129403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a20eeff9-1351-46a1-9a80-d5bde001b7e5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:31.130592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a20eeff9-1351-46a1-9a80-d5bde001b7e5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:31.146571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a20eeff9-1351-46a1-9a80-d5bde001b7e5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:31.148633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a20eeff9-1351-46a1-9a80-d5bde001b7e5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:31.149661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a20eeff9-1351-46a1-9a80-d5bde001b7e5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:31.151308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a20eeff9-1351-46a1-9a80-d5bde001b7e5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:31.152420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a20eeff9-1351-46a1-9a80-d5bde001b7e5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:31.153873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a20eeff9-1351-46a1-9a80-d5bde001b7e5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:31.158633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-97ef8f4c-a859-419d-a96c-4f4d2d87c994 req-a25d8b47-1c99-4aec-aa89-ecf4c83eb6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa4a96f-0b26-42e7-880d-63af3734aa76", "tag": "1d2dcd29-a6ca-4cba-bfaa-8229d9209c53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:55:31.179594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-97ef8f4c-a859-419d-a96c-4f4d2d87c994 req-a25d8b47-1c99-4aec-aa89-ecf4c83eb6b2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:31.180515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-97ef8f4c-a859-419d-a96c-4f4d2d87c994 req-a25d8b47-1c99-4aec-aa89-ecf4c83eb6b2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:31.180840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-97ef8f4c-a859-419d-a96c-4f4d2d87c994 req-a25d8b47-1c99-4aec-aa89-ecf4c83eb6b2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:31.189834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a20eeff9-1351-46a1-9a80-d5bde001b7e5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:55:31.216042 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-97ef8f4c-a859-419d-a96c-4f4d2d87c994 req-a25d8b47-1c99-4aec-aa89-ecf4c83eb6b2 service nova] Creating event network-changed:1d2dcd29-a6ca-4cba-bfaa-8229d9209c53 for instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 on n-h2-852771-8 Aug 25 13:55:31.222651 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-97ef8f4c-a859-419d-a96c-4f4d2d87c994 req-a25d8b47-1c99-4aec-aa89-ecf4c83eb6b2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071636 Aug 25 13:55:31.224014 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3153/6242] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:55:31.349785 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a20eeff9-1351-46a1-9a80-d5bde001b7e5 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 204 len: 0 microversion: 2.1 time: 0.226394 Aug 25 13:55:31.350893 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3090/6243] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:55:31 2022] DELETE /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:55:31.361355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-911e465c-597b-4c1b-8ac6-8bb2e549b938 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:31.362475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-911e465c-597b-4c1b-8ac6-8bb2e549b938 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:31.375227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-911e465c-597b-4c1b-8ac6-8bb2e549b938 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:31.376512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-911e465c-597b-4c1b-8ac6-8bb2e549b938 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:31.376512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-911e465c-597b-4c1b-8ac6-8bb2e549b938 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:31.376897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-911e465c-597b-4c1b-8ac6-8bb2e549b938 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:31.377357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-911e465c-597b-4c1b-8ac6-8bb2e549b938 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:31.377826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-911e465c-597b-4c1b-8ac6-8bb2e549b938 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:31.703450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-911e465c-597b-4c1b-8ac6-8bb2e549b938 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:31.713596 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-911e465c-597b-4c1b-8ac6-8bb2e549b938 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1686 microversion: 2.1 time: 0.357072 Aug 25 13:55:31.714187 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3154/6244] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:31 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1686 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:55:32.758846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe17ed1f-7ca2-4ea2-a9b8-c2938ae3edb7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:32.759585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe17ed1f-7ca2-4ea2-a9b8-c2938ae3edb7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:32.776748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:32.779595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe17ed1f-7ca2-4ea2-a9b8-c2938ae3edb7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:32.784443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe17ed1f-7ca2-4ea2-a9b8-c2938ae3edb7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:32.784949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe17ed1f-7ca2-4ea2-a9b8-c2938ae3edb7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:32.785821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe17ed1f-7ca2-4ea2-a9b8-c2938ae3edb7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:32.786339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe17ed1f-7ca2-4ea2-a9b8-c2938ae3edb7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:32.786803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe17ed1f-7ca2-4ea2-a9b8-c2938ae3edb7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:32.826310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:33.006599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fe17ed1f-7ca2-4ea2-a9b8-c2938ae3edb7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:33.019135 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe17ed1f-7ca2-4ea2-a9b8-c2938ae3edb7 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1686 microversion: 2.1 time: 0.269619 Aug 25 13:55:33.020380 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3091/6245] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:32 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1686 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:33.834464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-46c7ad37-2436-494e-8861-bc298a3c746d req-948b8079-a158-4dae-b04b-f487308507ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa4a96f-0b26-42e7-880d-63af3734aa76", "name": "network-vif-deleted", "tag": "1d2dcd29-a6ca-4cba-bfaa-8229d9209c53"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:55:33.854281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:33.856864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-46c7ad37-2436-494e-8861-bc298a3c746d req-948b8079-a158-4dae-b04b-f487308507ac service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:33.857546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-46c7ad37-2436-494e-8861-bc298a3c746d req-948b8079-a158-4dae-b04b-f487308507ac service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:33.858315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-46c7ad37-2436-494e-8861-bc298a3c746d req-948b8079-a158-4dae-b04b-f487308507ac service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:33.872090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=63 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:33.875473 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-46c7ad37-2436-494e-8861-bc298a3c746d req-948b8079-a158-4dae-b04b-f487308507ac service nova] Creating event network-vif-deleted:1d2dcd29-a6ca-4cba-bfaa-8229d9209c53 for instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 on n-h2-852771-8 Aug 25 13:55:33.882925 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-46c7ad37-2436-494e-8861-bc298a3c746d req-948b8079-a158-4dae-b04b-f487308507ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057266 Aug 25 13:55:33.883929 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3155/6246] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:55:34.048203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:34.049446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:34.057188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:34.057789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:34.058268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:34.059145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:34.059567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:34.060072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:34.102238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:34.102584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:34.103042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:34.103575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lazy-loading 'fault' on Instance uuid 1aa4a96f-0b26-42e7-880d-63af3734aa76 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:55:34.161310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfd27e7237548f485ae9480d489286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2ace59bb66449bb97802fd18379f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:34.169252 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee7dbb09-5640-4955-8466-20223535c6fa tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 200 len: 1354 microversion: 2.1 time: 0.125552 Aug 25 13:55:34.169889 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3092/6247] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:34 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 1354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:35.194936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:35.195844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] [instance: 1aa4a96f-0b26-42e7-880d-63af3734aa76] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:35.202655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:35.203645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:35.204330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:35.205076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:35.205743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:35.206176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:35.227545 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] HTTP exception thrown: Instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 could not be found. Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Request method failure captured: Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 HTTP/1.1 Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3xUnETqauI1fxE397rReMXDLCicli9Hi5kLufClsv6N95sYOGTClXRLJCM2pDIKRWw-GpkZg3DQxGaWT8EsmuVnSKPWDo4sA2E4cLg9pp_ZjLYOlU7spY_Q87AN4fXVuBQueQfXTy0eO391Jp23FUZkFxq3DruyvbrbheLtC8cWpR4 Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 3f2ace59bb66449bb97802fd18379f1a Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f2ace59bb66449bb97802fd18379f1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3f2ace59bb66449bb97802fd18379f1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3f2ace59bb66449bb97802fd18379f1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3f2ace59bb66449bb97802fd18379f1a"}]}] Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 3f2ace59bb66449bb97802fd18379f1a Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1232753206 Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestNetworkAdvancedServerOps-1232753206-project Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: ecfd27e7237548f485ae9480d489286a Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1232753206-project Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 could not be found. Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '1aa4a96f-0b26-42e7-880d-63af3734aa76'} Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 could not be found. Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 could not be found. Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:55:35.229227 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 could not be found. Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Returning 404 to user: Instance 1aa4a96f-0b26-42e7-880d-63af3734aa76 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-621e8d29-1660-4ec9-83b3-adecf3132a99 tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76" status: 404 len: 111 microversion: 2.1 time: 0.041649 Aug 25 13:55:35.235785 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3156/6248] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:35 2022] GET /compute/v2.1/servers/1aa4a96f-0b26-42e7-880d-63af3734aa76 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:55:39.644889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c8fbc392-fdc4-4b91-b018-fdd188aad63c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] Calling method '.version_select at 0x7f3a2991faf0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:39.691964 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c8fbc392-fdc4-4b91-b018-fdd188aad63c tempest-TestNetworkAdvancedServerOps-1232753206 tempest-TestNetworkAdvancedServerOps-1232753206-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-25629083" status: 202 len: 0 microversion: 2.1 time: 0.052008 Aug 25 13:55:39.693080 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3093/6249] 10.222.0.70 () {58 vars in 1278 bytes} [Thu Aug 25 13:55:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-25629083 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:55:40.025724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-76d9abfa-1473-4168-880d-90b935183cef tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:40.026888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-76d9abfa-1473-4168-880d-90b935183cef tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:40.035016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76d9abfa-1473-4168-880d-90b935183cef tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:40.035442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76d9abfa-1473-4168-880d-90b935183cef tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:40.035887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76d9abfa-1473-4168-880d-90b935183cef tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:40.036611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76d9abfa-1473-4168-880d-90b935183cef tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:40.037077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76d9abfa-1473-4168-880d-90b935183cef tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:40.037528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76d9abfa-1473-4168-880d-90b935183cef tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:40.065772 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-76d9abfa-1473-4168-880d-90b935183cef tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.043754 Aug 25 13:55:40.066835 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3157/6250] 10.222.0.70 () {58 vars in 1293 bytes} [Thu Aug 25 13:55:40 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716/os-server-password => generated 116 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:55:43.554339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a601c433-bd30-49c7-82d1-1fff26694e02 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Action: 'create', calling method: .version_select at 0x7f3a2a06c550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1819276328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVpS7NblTeyU/37OdOWMyvApXSNZVBcQ6JlWHvJroWdjqSRvJIY44KZkWJN7FN+BKxgYSUJdpeXZn4HSKaKYZGtrxgJ+QhZZrFAC1Cg7B+0CYxUFf8O8/VpyIFIrGlZJg=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:55:43.582313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a601c433-bd30-49c7-82d1-1fff26694e02 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Getting quotas for project f0f09652dfdb44bbb0a429873b8c8791. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:55:43.590097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a601c433-bd30-49c7-82d1-1fff26694e02 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Getting quotas for user f135e0af81ad43f3a47d7c6707d0bdcd and project f0f09652dfdb44bbb0a429873b8c8791. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:55:43.625423 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a601c433-bd30-49c7-82d1-1fff26694e02 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.293440 Aug 25 13:55:43.626889 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3094/6251] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 13:55:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:55:51.385732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-838283507-access_point-872325041", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "ce9a2618-6e95-49ed-ab1d-1655cef60773"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1819276328", "security_groups": [{"name": "tempest-secgroup_access--2138817597"}, {"name": "tempest-secgroup_general--1039742255"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:55:51.404104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=5 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:51.405367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=7 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:51.753404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] validate_networks() for [('ce9a2618-6e95-49ed-ab1d-1655cef60773', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:55:52.392534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:55:52.393918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:55:52.394508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:55:52.396061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:55:52.396648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:55:52.423987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:52.424597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:52.425309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:52.426301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:52.426466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:52.427667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:52.456858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Getting quotas for project f0f09652dfdb44bbb0a429873b8c8791. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:55:52.463260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Getting quotas for user f135e0af81ad43f3a47d7c6707d0bdcd and project f0f09652dfdb44bbb0a429873b8c8791. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:55:52.488113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:55:52.490360 n-d-852771-8 devstack@n-api.service[129060]: WARNING nova.utils [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-838283507-access_point-872325041 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-838283507-acc Aug 25 13:55:52.491129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:55:52.570668 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a34ae686-cb03-4513-9cb0-b3aff9f9bad7 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.189237 Aug 25 13:55:52.572010 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3158/6252] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:55:51 2022] POST /compute/v2.1/servers => generated 458 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:55:52.585187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4995bb45-b12e-4d89-ab77-6c3d9d266b58 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:52.587368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4995bb45-b12e-4d89-ab77-6c3d9d266b58 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:52.591762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=13 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:55:52.775150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4995bb45-b12e-4d89-ab77-6c3d9d266b58 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:52.790643 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4995bb45-b12e-4d89-ab77-6c3d9d266b58 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1293 microversion: 2.1 time: 0.209000 Aug 25 13:55:52.792526 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3095/6253] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:52 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1293 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:53.817079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b22ad1e-859a-41c4-8a74-66214bea38b5 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:53.817867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5b22ad1e-859a-41c4-8a74-66214bea38b5 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:53.826046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b22ad1e-859a-41c4-8a74-66214bea38b5 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:53.826538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b22ad1e-859a-41c4-8a74-66214bea38b5 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:53.827177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b22ad1e-859a-41c4-8a74-66214bea38b5 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:53.828058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b22ad1e-859a-41c4-8a74-66214bea38b5 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:53.828595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b22ad1e-859a-41c4-8a74-66214bea38b5 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:53.829025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b22ad1e-859a-41c4-8a74-66214bea38b5 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:53.918142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b22ad1e-859a-41c4-8a74-66214bea38b5 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:53.930479 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b22ad1e-859a-41c4-8a74-66214bea38b5 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1345 microversion: 2.1 time: 0.117144 Aug 25 13:55:53.931078 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3159/6254] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:53 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:54.957032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-253c4610-2945-431d-98ea-9e569987b26c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:54.957032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-253c4610-2945-431d-98ea-9e569987b26c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:54.978045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253c4610-2945-431d-98ea-9e569987b26c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:54.978569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253c4610-2945-431d-98ea-9e569987b26c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:54.979047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253c4610-2945-431d-98ea-9e569987b26c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:54.979793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253c4610-2945-431d-98ea-9e569987b26c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:54.980274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253c4610-2945-431d-98ea-9e569987b26c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:54.980948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-253c4610-2945-431d-98ea-9e569987b26c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:55.241553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-253c4610-2945-431d-98ea-9e569987b26c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:55.250698 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-253c4610-2945-431d-98ea-9e569987b26c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1471 microversion: 2.1 time: 0.299069 Aug 25 13:55:55.251635 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3096/6255] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:54 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1471 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:55.937764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ed835577-0e92-4860-af67-29b5a0d24003 req-6cf2836a-df0c-43e9-b5de-f415a2ad4c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c307a68-8453-48ba-969f-4a825b891d35", "tag": "20be1b6a-013f-4bac-b970-18122d00778e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:55:55.956144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ed835577-0e92-4860-af67-29b5a0d24003 req-6cf2836a-df0c-43e9-b5de-f415a2ad4c10 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:55.956965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ed835577-0e92-4860-af67-29b5a0d24003 req-6cf2836a-df0c-43e9-b5de-f415a2ad4c10 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:55.960354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ed835577-0e92-4860-af67-29b5a0d24003 req-6cf2836a-df0c-43e9-b5de-f415a2ad4c10 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:55.990156 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ed835577-0e92-4860-af67-29b5a0d24003 req-6cf2836a-df0c-43e9-b5de-f415a2ad4c10 service nova] Creating event network-changed:20be1b6a-013f-4bac-b970-18122d00778e for instance 9c307a68-8453-48ba-969f-4a825b891d35 on n-h2-852771-8 Aug 25 13:55:55.996289 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ed835577-0e92-4860-af67-29b5a0d24003 req-6cf2836a-df0c-43e9-b5de-f415a2ad4c10 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065389 Aug 25 13:55:55.997735 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3160/6256] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:55:56.277794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-69daf3cc-c35d-420a-8a59-fca9a9c18cb6 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:56.279068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-69daf3cc-c35d-420a-8a59-fca9a9c18cb6 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:56.293804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69daf3cc-c35d-420a-8a59-fca9a9c18cb6 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:56.294642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69daf3cc-c35d-420a-8a59-fca9a9c18cb6 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:56.295365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69daf3cc-c35d-420a-8a59-fca9a9c18cb6 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:56.297483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69daf3cc-c35d-420a-8a59-fca9a9c18cb6 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:56.298643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69daf3cc-c35d-420a-8a59-fca9a9c18cb6 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:56.299318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69daf3cc-c35d-420a-8a59-fca9a9c18cb6 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:56.544588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-69daf3cc-c35d-420a-8a59-fca9a9c18cb6 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:56.558836 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-69daf3cc-c35d-420a-8a59-fca9a9c18cb6 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1471 microversion: 2.1 time: 0.285417 Aug 25 13:55:56.561179 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3097/6257] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:56 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1471 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:57.596694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f38cfa30-8312-44a4-9a55-82b79025f73b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:57.597324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f38cfa30-8312-44a4-9a55-82b79025f73b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:57.605848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f38cfa30-8312-44a4-9a55-82b79025f73b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:57.606494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f38cfa30-8312-44a4-9a55-82b79025f73b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:57.607123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f38cfa30-8312-44a4-9a55-82b79025f73b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:57.607969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f38cfa30-8312-44a4-9a55-82b79025f73b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:57.610005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f38cfa30-8312-44a4-9a55-82b79025f73b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:57.610699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f38cfa30-8312-44a4-9a55-82b79025f73b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:57.814444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f38cfa30-8312-44a4-9a55-82b79025f73b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:57.831677 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f38cfa30-8312-44a4-9a55-82b79025f73b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1471 microversion: 2.1 time: 0.245322 Aug 25 13:55:57.832797 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3161/6258] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:57 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:55:58.871306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-96323b90-62fb-4ece-b8f1-6b099793608b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:55:58.872392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-96323b90-62fb-4ece-b8f1-6b099793608b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:55:58.880594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96323b90-62fb-4ece-b8f1-6b099793608b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:58.881098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96323b90-62fb-4ece-b8f1-6b099793608b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:58.881577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96323b90-62fb-4ece-b8f1-6b099793608b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:58.882942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96323b90-62fb-4ece-b8f1-6b099793608b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:55:58.882942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96323b90-62fb-4ece-b8f1-6b099793608b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:55:58.883249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96323b90-62fb-4ece-b8f1-6b099793608b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:55:59.067730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-96323b90-62fb-4ece-b8f1-6b099793608b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:55:59.085700 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-96323b90-62fb-4ece-b8f1-6b099793608b tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1471 microversion: 2.1 time: 0.219481 Aug 25 13:55:59.087250 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3098/6259] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:55:58 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:00.116594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c158995-6e1c-40f4-8bb4-7b5c993daf2a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:00.117324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9c158995-6e1c-40f4-8bb4-7b5c993daf2a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:00.126032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c158995-6e1c-40f4-8bb4-7b5c993daf2a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:00.126903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c158995-6e1c-40f4-8bb4-7b5c993daf2a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:00.127666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c158995-6e1c-40f4-8bb4-7b5c993daf2a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:00.128420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c158995-6e1c-40f4-8bb4-7b5c993daf2a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:00.129290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c158995-6e1c-40f4-8bb4-7b5c993daf2a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:00.130115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c158995-6e1c-40f4-8bb4-7b5c993daf2a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:00.373691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9c158995-6e1c-40f4-8bb4-7b5c993daf2a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:00.385413 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c158995-6e1c-40f4-8bb4-7b5c993daf2a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1471 microversion: 2.1 time: 0.273410 Aug 25 13:56:00.386522 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3162/6260] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:00 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:56:01.430522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-70c2164e-93bd-446c-b562-a0c449b51038 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:01.433924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-70c2164e-93bd-446c-b562-a0c449b51038 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:01.451108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-70c2164e-93bd-446c-b562-a0c449b51038 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:01.453593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-70c2164e-93bd-446c-b562-a0c449b51038 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:01.455009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-70c2164e-93bd-446c-b562-a0c449b51038 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:01.456767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-70c2164e-93bd-446c-b562-a0c449b51038 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:01.457933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-70c2164e-93bd-446c-b562-a0c449b51038 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:01.459335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-70c2164e-93bd-446c-b562-a0c449b51038 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:01.762773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-70c2164e-93bd-446c-b562-a0c449b51038 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:01.772560 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-70c2164e-93bd-446c-b562-a0c449b51038 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1471 microversion: 2.1 time: 0.351837 Aug 25 13:56:01.773337 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3099/6261] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:01 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1471 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:02.808385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a952593a-a175-425c-9ffa-0aa65986508d tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:02.809079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a952593a-a175-425c-9ffa-0aa65986508d tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:02.812552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:02.813305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:02.819641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a952593a-a175-425c-9ffa-0aa65986508d tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:02.820132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a952593a-a175-425c-9ffa-0aa65986508d tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:02.820569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a952593a-a175-425c-9ffa-0aa65986508d tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:02.821276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a952593a-a175-425c-9ffa-0aa65986508d tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:02.821761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a952593a-a175-425c-9ffa-0aa65986508d tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:02.822313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a952593a-a175-425c-9ffa-0aa65986508d tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:03.001431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a952593a-a175-425c-9ffa-0aa65986508d tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:03.010593 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a952593a-a175-425c-9ffa-0aa65986508d tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1471 microversion: 2.1 time: 0.206083 Aug 25 13:56:03.011543 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3163/6262] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:02 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:03.382227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6a246cd7-9e77-43e1-aec7-f2f9cd1c4bea req-3867804e-0ad6-4c83-9a4b-7f19e3a77f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c307a68-8453-48ba-969f-4a825b891d35", "name": "network-vif-plugged", "status": "completed", "tag": "20be1b6a-013f-4bac-b970-18122d00778e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:56:03.394262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:03.396323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:03.404339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a246cd7-9e77-43e1-aec7-f2f9cd1c4bea req-3867804e-0ad6-4c83-9a4b-7f19e3a77f0c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:03.406424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a246cd7-9e77-43e1-aec7-f2f9cd1c4bea req-3867804e-0ad6-4c83-9a4b-7f19e3a77f0c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:03.407829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a246cd7-9e77-43e1-aec7-f2f9cd1c4bea req-3867804e-0ad6-4c83-9a4b-7f19e3a77f0c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:03.431252 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6a246cd7-9e77-43e1-aec7-f2f9cd1c4bea req-3867804e-0ad6-4c83-9a4b-7f19e3a77f0c service nova] Creating event network-vif-plugged:20be1b6a-013f-4bac-b970-18122d00778e for instance 9c307a68-8453-48ba-969f-4a825b891d35 on n-h2-852771-8 Aug 25 13:56:03.441646 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6a246cd7-9e77-43e1-aec7-f2f9cd1c4bea req-3867804e-0ad6-4c83-9a4b-7f19e3a77f0c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064886 Aug 25 13:56:03.442723 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3100/6263] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:56:04.038059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-754edb40-12bc-4627-ad01-48f66c6281e1 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:04.039363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-754edb40-12bc-4627-ad01-48f66c6281e1 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:04.054153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-754edb40-12bc-4627-ad01-48f66c6281e1 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:04.055025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-754edb40-12bc-4627-ad01-48f66c6281e1 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:04.055852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-754edb40-12bc-4627-ad01-48f66c6281e1 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:04.057152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-754edb40-12bc-4627-ad01-48f66c6281e1 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:04.058033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-754edb40-12bc-4627-ad01-48f66c6281e1 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:04.058808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-754edb40-12bc-4627-ad01-48f66c6281e1 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:04.300417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-754edb40-12bc-4627-ad01-48f66c6281e1 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:04.317335 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-754edb40-12bc-4627-ad01-48f66c6281e1 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1471 microversion: 2.1 time: 0.286184 Aug 25 13:56:04.322523 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3164/6264] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:04 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:05.363252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-263c672a-7185-4e4e-8c6a-47ed3dd20428 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:05.364569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-263c672a-7185-4e4e-8c6a-47ed3dd20428 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:05.372813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263c672a-7185-4e4e-8c6a-47ed3dd20428 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:05.373369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263c672a-7185-4e4e-8c6a-47ed3dd20428 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:05.373832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263c672a-7185-4e4e-8c6a-47ed3dd20428 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:05.374601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263c672a-7185-4e4e-8c6a-47ed3dd20428 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:05.375049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263c672a-7185-4e4e-8c6a-47ed3dd20428 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:05.375498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263c672a-7185-4e4e-8c6a-47ed3dd20428 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:05.564794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-263c672a-7185-4e4e-8c6a-47ed3dd20428 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:05.581542 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-263c672a-7185-4e4e-8c6a-47ed3dd20428 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1642 microversion: 2.1 time: 0.226086 Aug 25 13:56:05.582523 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3101/6265] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:05 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1642 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:05.609223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e7ba3664-e4de-4978-a669-9c29b2b9d083 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:05.612863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e7ba3664-e4de-4978-a669-9c29b2b9d083 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:05.622652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7ba3664-e4de-4978-a669-9c29b2b9d083 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:05.623293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7ba3664-e4de-4978-a669-9c29b2b9d083 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:05.624464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7ba3664-e4de-4978-a669-9c29b2b9d083 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:05.625416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7ba3664-e4de-4978-a669-9c29b2b9d083 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:05.626039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7ba3664-e4de-4978-a669-9c29b2b9d083 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:05.626580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7ba3664-e4de-4978-a669-9c29b2b9d083 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:05.849965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e7ba3664-e4de-4978-a669-9c29b2b9d083 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:05.859727 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e7ba3664-e4de-4978-a669-9c29b2b9d083 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1642 microversion: 2.1 time: 0.257928 Aug 25 13:56:05.860353 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3165/6266] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:05 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1642 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:05.885901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4614f3f1-63c5-41f5-b9fa-d236c4d537b6 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:05.886447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4614f3f1-63c5-41f5-b9fa-d236c4d537b6 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:05.893791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4614f3f1-63c5-41f5-b9fa-d236c4d537b6 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:05.894319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4614f3f1-63c5-41f5-b9fa-d236c4d537b6 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:05.894799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4614f3f1-63c5-41f5-b9fa-d236c4d537b6 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:05.895560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4614f3f1-63c5-41f5-b9fa-d236c4d537b6 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:05.896049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4614f3f1-63c5-41f5-b9fa-d236c4d537b6 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:05.896509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4614f3f1-63c5-41f5-b9fa-d236c4d537b6 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:06.250688 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4614f3f1-63c5-41f5-b9fa-d236c4d537b6 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1793 microversion: 2.1 time: 0.368597 Aug 25 13:56:06.251367 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3102/6267] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:05 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1793 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:56:08.539738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-90e35124-345f-441f-99fa-e7dc2ad640f0 req-0cbdd4c6-2de7-45bd-be5e-3cd982703cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c307a68-8453-48ba-969f-4a825b891d35", "tag": "20be1b6a-013f-4bac-b970-18122d00778e"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:56:08.553741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-90e35124-345f-441f-99fa-e7dc2ad640f0 req-0cbdd4c6-2de7-45bd-be5e-3cd982703cbe service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:08.555660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-90e35124-345f-441f-99fa-e7dc2ad640f0 req-0cbdd4c6-2de7-45bd-be5e-3cd982703cbe service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:08.556184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-90e35124-345f-441f-99fa-e7dc2ad640f0 req-0cbdd4c6-2de7-45bd-be5e-3cd982703cbe service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:08.580670 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-90e35124-345f-441f-99fa-e7dc2ad640f0 req-0cbdd4c6-2de7-45bd-be5e-3cd982703cbe service nova] Creating event network-changed:20be1b6a-013f-4bac-b970-18122d00778e for instance 9c307a68-8453-48ba-969f-4a825b891d35 on n-h2-852771-8 Aug 25 13:56:08.592451 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-90e35124-345f-441f-99fa-e7dc2ad640f0 req-0cbdd4c6-2de7-45bd-be5e-3cd982703cbe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055848 Aug 25 13:56:08.594653 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3166/6268] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:57:24.403128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=5 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:24.404274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=38 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:24.406848 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:57:24.407042 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 13:57:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e (ip 10.222.0.70) !!! Aug 25 13:57:24.413454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-960656dc-e617-43e3-9437-00bd9422e6fe tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:24.414231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-960656dc-e617-43e3-9437-00bd9422e6fe tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:24.430239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960656dc-e617-43e3-9437-00bd9422e6fe tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:24.430959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960656dc-e617-43e3-9437-00bd9422e6fe tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:24.431607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960656dc-e617-43e3-9437-00bd9422e6fe tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:24.432431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960656dc-e617-43e3-9437-00bd9422e6fe tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:24.432918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960656dc-e617-43e3-9437-00bd9422e6fe tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:24.433374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-960656dc-e617-43e3-9437-00bd9422e6fe tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:24.472248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-960656dc-e617-43e3-9437-00bd9422e6fe tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:57:24.585688 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-960656dc-e617-43e3-9437-00bd9422e6fe tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 204 len: 0 microversion: 2.1 time: 0.184328 Aug 25 13:57:24.586730 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3103/6269] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:57:24 2022] DELETE /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:57:24.601263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:24.603219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=42 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:24.606150 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:57:24.606457 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 13:57:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e (ip 10.222.0.70) !!! Aug 25 13:57:24.614597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6d2b2fb8-0b18-438f-b93a-8ffdc1e9affa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:24.615700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6d2b2fb8-0b18-438f-b93a-8ffdc1e9affa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:24.633866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d2b2fb8-0b18-438f-b93a-8ffdc1e9affa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:24.634284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d2b2fb8-0b18-438f-b93a-8ffdc1e9affa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:24.635015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d2b2fb8-0b18-438f-b93a-8ffdc1e9affa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:24.636264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d2b2fb8-0b18-438f-b93a-8ffdc1e9affa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:24.636923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d2b2fb8-0b18-438f-b93a-8ffdc1e9affa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:24.637552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d2b2fb8-0b18-438f-b93a-8ffdc1e9affa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:25.082930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6d2b2fb8-0b18-438f-b93a-8ffdc1e9affa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:25.091089 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6d2b2fb8-0b18-438f-b93a-8ffdc1e9affa tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1579 microversion: 2.1 time: 0.498384 Aug 25 13:57:25.091694 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3167/6270] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:24 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1579 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:26.114590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2406a4f-d73c-40d3-a90d-be7382b048b3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:26.115656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2406a4f-d73c-40d3-a90d-be7382b048b3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:26.124558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2406a4f-d73c-40d3-a90d-be7382b048b3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:26.126150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2406a4f-d73c-40d3-a90d-be7382b048b3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:26.126727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2406a4f-d73c-40d3-a90d-be7382b048b3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:26.127561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2406a4f-d73c-40d3-a90d-be7382b048b3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:26.128102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2406a4f-d73c-40d3-a90d-be7382b048b3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:26.128728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2406a4f-d73c-40d3-a90d-be7382b048b3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:26.529719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c2406a4f-d73c-40d3-a90d-be7382b048b3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:26.547946 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2406a4f-d73c-40d3-a90d-be7382b048b3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1579 microversion: 2.1 time: 0.437356 Aug 25 13:57:26.550754 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3104/6271] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:26 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1579 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:27.574647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a22cc1b-f000-4a7d-a0f5-e609799bd1d8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:27.576126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7a22cc1b-f000-4a7d-a0f5-e609799bd1d8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:27.584991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a22cc1b-f000-4a7d-a0f5-e609799bd1d8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:27.585535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a22cc1b-f000-4a7d-a0f5-e609799bd1d8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:27.585981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a22cc1b-f000-4a7d-a0f5-e609799bd1d8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:27.586720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a22cc1b-f000-4a7d-a0f5-e609799bd1d8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:27.587199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a22cc1b-f000-4a7d-a0f5-e609799bd1d8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:27.587643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a22cc1b-f000-4a7d-a0f5-e609799bd1d8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:27.911970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7a22cc1b-f000-4a7d-a0f5-e609799bd1d8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:27.930771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1985511924", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "d7bf192b-9718-4f87-a983-3edb62f2d447"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:27.944026 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a22cc1b-f000-4a7d-a0f5-e609799bd1d8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1579 microversion: 2.1 time: 0.373002 Aug 25 13:57:27.945108 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3168/6272] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:27 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1579 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:28.035791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] validate_networks() for [('d7bf192b-9718-4f87-a983-3edb62f2d447', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:57:28.400232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f2acf3e1-b647-406c-9551-9b9791e2d5d9 req-bbd428a4-c6f1-4859-92de-a8fec02d428a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdc7943-2094-4efe-b733-b69755860c2e", "name": "network-vif-deleted", "tag": "2afc0e3e-d5bd-41c3-ad3c-2758dd1463e1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:28.415485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f2acf3e1-b647-406c-9551-9b9791e2d5d9 req-bbd428a4-c6f1-4859-92de-a8fec02d428a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:28.416555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f2acf3e1-b647-406c-9551-9b9791e2d5d9 req-bbd428a4-c6f1-4859-92de-a8fec02d428a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:28.417261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f2acf3e1-b647-406c-9551-9b9791e2d5d9 req-bbd428a4-c6f1-4859-92de-a8fec02d428a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:28.469482 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f2acf3e1-b647-406c-9551-9b9791e2d5d9 req-bbd428a4-c6f1-4859-92de-a8fec02d428a service nova] Creating event network-vif-deleted:2afc0e3e-d5bd-41c3-ad3c-2758dd1463e1 for instance 9cdc7943-2094-4efe-b733-b69755860c2e on n-h1-852771-8 Aug 25 13:57:28.478625 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f2acf3e1-b647-406c-9551-9b9791e2d5d9 req-bbd428a4-c6f1-4859-92de-a8fec02d428a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082715 Aug 25 13:57:28.482507 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3169/6273] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:57:28.969705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6479023c-9f16-41c4-8445-4cdce2f8e369 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:28.971380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6479023c-9f16-41c4-8445-4cdce2f8e369 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:28.987990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6479023c-9f16-41c4-8445-4cdce2f8e369 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:28.993849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6479023c-9f16-41c4-8445-4cdce2f8e369 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:28.994799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6479023c-9f16-41c4-8445-4cdce2f8e369 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:28.996771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6479023c-9f16-41c4-8445-4cdce2f8e369 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:29.001942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6479023c-9f16-41c4-8445-4cdce2f8e369 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:29.002697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6479023c-9f16-41c4-8445-4cdce2f8e369 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:29.128201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:57:29.128941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:57:29.130158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:57:29.131190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:57:29.138623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:57:29.167744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:29.168639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:29.169138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:29.175496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:29.176338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:29.176955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:29.211752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6479023c-9f16-41c4-8445-4cdce2f8e369 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:29.229645 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6479023c-9f16-41c4-8445-4cdce2f8e369 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1226 microversion: 2.1 time: 0.265878 Aug 25 13:57:29.230269 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3170/6274] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:28 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1226 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:29.233846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Getting quotas for project eb5fe49d1ee84611aeb5f91c5994b199. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:57:29.244560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Getting quotas for user 62e98d7da5234aca8aac0f5c54acb614 and project eb5fe49d1ee84611aeb5f91c5994b199. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:57:29.297372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:57:29.302261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:57:29.430865 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4c048ac3-240a-4089-b767-ada256c706e3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509531 Aug 25 13:57:29.437786 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3105/6275] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:57:29.451826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c1e5d0e-095a-4af4-b0c4-a955e3f176da tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:29.455002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c1e5d0e-095a-4af4-b0c4-a955e3f176da tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:29.629358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7c1e5d0e-095a-4af4-b0c4-a955e3f176da tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:29.642773 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c1e5d0e-095a-4af4-b0c4-a955e3f176da tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1219 microversion: 2.1 time: 0.199241 Aug 25 13:57:29.652299 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3171/6276] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:29 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1219 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:30.260663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9adcd3c9-5723-4cf1-80f0-a0c396c40760 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:30.262262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9adcd3c9-5723-4cf1-80f0-a0c396c40760 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:30.282937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9adcd3c9-5723-4cf1-80f0-a0c396c40760 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:30.286491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9adcd3c9-5723-4cf1-80f0-a0c396c40760 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:30.287335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9adcd3c9-5723-4cf1-80f0-a0c396c40760 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:30.288970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9adcd3c9-5723-4cf1-80f0-a0c396c40760 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:30.290022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9adcd3c9-5723-4cf1-80f0-a0c396c40760 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:30.295871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9adcd3c9-5723-4cf1-80f0-a0c396c40760 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:30.472459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9adcd3c9-5723-4cf1-80f0-a0c396c40760 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:30.493280 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9adcd3c9-5723-4cf1-80f0-a0c396c40760 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1226 microversion: 2.1 time: 0.236915 Aug 25 13:57:30.497092 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3106/6277] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:30 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1226 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:30.679522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e37c6fb7-7997-4d48-b016-4320a378dc00 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:30.680164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e37c6fb7-7997-4d48-b016-4320a378dc00 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:30.700410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e37c6fb7-7997-4d48-b016-4320a378dc00 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:30.701002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e37c6fb7-7997-4d48-b016-4320a378dc00 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:30.701394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e37c6fb7-7997-4d48-b016-4320a378dc00 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:30.708189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e37c6fb7-7997-4d48-b016-4320a378dc00 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:30.709542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e37c6fb7-7997-4d48-b016-4320a378dc00 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:30.710913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e37c6fb7-7997-4d48-b016-4320a378dc00 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:30.889122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e37c6fb7-7997-4d48-b016-4320a378dc00 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:30.911576 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e37c6fb7-7997-4d48-b016-4320a378dc00 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1223 microversion: 2.1 time: 0.237785 Aug 25 13:57:30.913811 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3172/6278] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:30 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1223 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:31.518414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1001402-5d39-41a4-bfd1-de19f07577c1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:31.519095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e1001402-5d39-41a4-bfd1-de19f07577c1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:31.534456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1001402-5d39-41a4-bfd1-de19f07577c1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:31.534976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1001402-5d39-41a4-bfd1-de19f07577c1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:31.535441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1001402-5d39-41a4-bfd1-de19f07577c1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:31.536208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1001402-5d39-41a4-bfd1-de19f07577c1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:31.543248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1001402-5d39-41a4-bfd1-de19f07577c1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:31.543921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1001402-5d39-41a4-bfd1-de19f07577c1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:31.683608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e1001402-5d39-41a4-bfd1-de19f07577c1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:31.712591 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e1001402-5d39-41a4-bfd1-de19f07577c1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1226 microversion: 2.1 time: 0.198100 Aug 25 13:57:31.714882 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3107/6279] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:31 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:31.943259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f2dde61-aa05-462b-83ef-0b09542b0835 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:31.944769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f2dde61-aa05-462b-83ef-0b09542b0835 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:31.959211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f2dde61-aa05-462b-83ef-0b09542b0835 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:31.960067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f2dde61-aa05-462b-83ef-0b09542b0835 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:31.960701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f2dde61-aa05-462b-83ef-0b09542b0835 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:31.961623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f2dde61-aa05-462b-83ef-0b09542b0835 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:31.962252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f2dde61-aa05-462b-83ef-0b09542b0835 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:31.962901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f2dde61-aa05-462b-83ef-0b09542b0835 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:32.073363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f2dde61-aa05-462b-83ef-0b09542b0835 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:32.085023 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f2dde61-aa05-462b-83ef-0b09542b0835 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1277 microversion: 2.1 time: 0.149199 Aug 25 13:57:32.086152 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3173/6280] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:31 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:32.742074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f3978ca4-c1a4-4da3-bfdf-fa56786d6583 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:32.742643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f3978ca4-c1a4-4da3-bfdf-fa56786d6583 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:32.768279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3978ca4-c1a4-4da3-bfdf-fa56786d6583 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:32.768811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3978ca4-c1a4-4da3-bfdf-fa56786d6583 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:32.769284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3978ca4-c1a4-4da3-bfdf-fa56786d6583 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:32.770089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3978ca4-c1a4-4da3-bfdf-fa56786d6583 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:32.770701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3978ca4-c1a4-4da3-bfdf-fa56786d6583 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:32.774812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f3978ca4-c1a4-4da3-bfdf-fa56786d6583 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:32.892582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f3978ca4-c1a4-4da3-bfdf-fa56786d6583 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:32.909328 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f3978ca4-c1a4-4da3-bfdf-fa56786d6583 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1226 microversion: 2.1 time: 0.171507 Aug 25 13:57:32.910099 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3108/6281] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:32 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1226 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:33.110435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-60a58f05-4762-49ad-b3f3-a5cd327074cf tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:33.111238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-60a58f05-4762-49ad-b3f3-a5cd327074cf tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:33.127530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60a58f05-4762-49ad-b3f3-a5cd327074cf tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:33.128570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60a58f05-4762-49ad-b3f3-a5cd327074cf tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:33.129409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60a58f05-4762-49ad-b3f3-a5cd327074cf tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:33.131807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60a58f05-4762-49ad-b3f3-a5cd327074cf tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:33.132655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60a58f05-4762-49ad-b3f3-a5cd327074cf tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:33.133310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60a58f05-4762-49ad-b3f3-a5cd327074cf tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:33.369064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-60a58f05-4762-49ad-b3f3-a5cd327074cf tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:33.386359 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-60a58f05-4762-49ad-b3f3-a5cd327074cf tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1319 microversion: 2.1 time: 0.282407 Aug 25 13:57:33.387380 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3174/6282] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:33 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:33.945984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c5612ece-5b5d-49b8-8de5-e07cbdedfa1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:33.946636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c5612ece-5b5d-49b8-8de5-e07cbdedfa1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:33.964030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5612ece-5b5d-49b8-8de5-e07cbdedfa1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:33.964846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5612ece-5b5d-49b8-8de5-e07cbdedfa1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:33.965563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5612ece-5b5d-49b8-8de5-e07cbdedfa1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:33.966653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5612ece-5b5d-49b8-8de5-e07cbdedfa1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:33.967322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5612ece-5b5d-49b8-8de5-e07cbdedfa1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:33.968012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c5612ece-5b5d-49b8-8de5-e07cbdedfa1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:34.069216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c5612ece-5b5d-49b8-8de5-e07cbdedfa1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:34.090180 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c5612ece-5b5d-49b8-8de5-e07cbdedfa1f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1226 microversion: 2.1 time: 0.150043 Aug 25 13:57:34.091145 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3109/6283] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:33 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:34.413497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-23f12c67-d0b3-4088-98e6-fe4e04da815b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:34.419370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-23f12c67-d0b3-4088-98e6-fe4e04da815b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:34.449055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23f12c67-d0b3-4088-98e6-fe4e04da815b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:34.451047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23f12c67-d0b3-4088-98e6-fe4e04da815b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:34.452080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23f12c67-d0b3-4088-98e6-fe4e04da815b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:34.454029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23f12c67-d0b3-4088-98e6-fe4e04da815b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:34.454682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23f12c67-d0b3-4088-98e6-fe4e04da815b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:34.455836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-23f12c67-d0b3-4088-98e6-fe4e04da815b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:34.721024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-23f12c67-d0b3-4088-98e6-fe4e04da815b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:34.735999 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-23f12c67-d0b3-4088-98e6-fe4e04da815b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1319 microversion: 2.1 time: 0.330279 Aug 25 13:57:34.737672 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3175/6284] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:34 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:35.049855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-e3394940-b8b0-414e-bde6-cf64c932735f req-eaf916f7-003a-4b05-b793-d4d3ed8318e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca53cfc1-6d39-422a-97ff-23863446350b", "tag": "356d537b-add8-4e15-bed0-1e67b8f257e6"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:35.114668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e3394940-b8b0-414e-bde6-cf64c932735f req-eaf916f7-003a-4b05-b793-d4d3ed8318e5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:35.115571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e3394940-b8b0-414e-bde6-cf64c932735f req-eaf916f7-003a-4b05-b793-d4d3ed8318e5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:35.119616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e3394940-b8b0-414e-bde6-cf64c932735f req-eaf916f7-003a-4b05-b793-d4d3ed8318e5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:35.123555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a78ea535-8c7a-4f21-823e-2b176c9dd59c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:35.126299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a78ea535-8c7a-4f21-823e-2b176c9dd59c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:35.147391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a78ea535-8c7a-4f21-823e-2b176c9dd59c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:35.148475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a78ea535-8c7a-4f21-823e-2b176c9dd59c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:35.150428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a78ea535-8c7a-4f21-823e-2b176c9dd59c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:35.151525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a78ea535-8c7a-4f21-823e-2b176c9dd59c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:35.161028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a78ea535-8c7a-4f21-823e-2b176c9dd59c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:35.161988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a78ea535-8c7a-4f21-823e-2b176c9dd59c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:35.167943 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-e3394940-b8b0-414e-bde6-cf64c932735f req-eaf916f7-003a-4b05-b793-d4d3ed8318e5 service nova] Creating event network-changed:356d537b-add8-4e15-bed0-1e67b8f257e6 for instance ca53cfc1-6d39-422a-97ff-23863446350b on n-h1-852771-8 Aug 25 13:57:35.179140 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-e3394940-b8b0-414e-bde6-cf64c932735f req-eaf916f7-003a-4b05-b793-d4d3ed8318e5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136993 Aug 25 13:57:35.180601 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3110/6285] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:57:35.314670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a78ea535-8c7a-4f21-823e-2b176c9dd59c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:35.334513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-263463529", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "9f6245fc-5465-4c63-8518-5d1d6ccfd901"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1819276328", "security_groups": []}, "os:scheduler_hints": {"different_host": ["9c307a68-8453-48ba-969f-4a825b891d35"]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:35.354606 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a78ea535-8c7a-4f21-823e-2b176c9dd59c tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 200 len: 1226 microversion: 2.1 time: 0.225482 Aug 25 13:57:35.355935 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3176/6286] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:35 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 1226 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:35.427368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] validate_networks() for [('9f6245fc-5465-4c63-8518-5d1d6ccfd901', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:57:35.769564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-77a75244-0e74-432a-8842-f71aa5918179 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:35.771030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-77a75244-0e74-432a-8842-f71aa5918179 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:35.782373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77a75244-0e74-432a-8842-f71aa5918179 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:35.788056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77a75244-0e74-432a-8842-f71aa5918179 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:35.789312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77a75244-0e74-432a-8842-f71aa5918179 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:35.793411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77a75244-0e74-432a-8842-f71aa5918179 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:35.794119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77a75244-0e74-432a-8842-f71aa5918179 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:35.794710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-77a75244-0e74-432a-8842-f71aa5918179 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:36.275491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:57:36.277477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:57:36.278607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:57:36.279542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:57:36.281245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:57:36.287757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-77a75244-0e74-432a-8842-f71aa5918179 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:36.294679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:36.295283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:36.295794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:36.297457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:36.297997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:36.298467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:36.311967 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-77a75244-0e74-432a-8842-f71aa5918179 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1319 microversion: 2.1 time: 0.546347 Aug 25 13:57:36.314168 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3177/6287] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:35 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1319 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:36.331161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Getting quotas for project f0f09652dfdb44bbb0a429873b8c8791. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:57:36.339111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Getting quotas for user f135e0af81ad43f3a47d7c6707d0bdcd and project f0f09652dfdb44bbb0a429873b8c8791. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:57:36.359271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:57:36.362536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:57:36.384136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:36.385216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:36.393582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:36.394628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:36.395383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:36.396478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:36.397453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:36.398299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:36.423573 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e HTTP/1.1 Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '9cdc7943-2094-4efe-b733-b69755860c2e'} Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:57:36.426805 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:57:36.431682 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:57:36.431682 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:57:36.431682 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:57:36.431682 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:57:36.431682 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:57:36.431682 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 13:57:36.431682 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:57:36.433410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:57:36.434700 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8882172c-e58e-422e-b403-b8ff8cd0f4f7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 404 len: 111 microversion: 2.1 time: 0.054802 Aug 25 13:57:36.438564 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3178/6288] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:36 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:57:36.450599 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b56e0c30-ea3c-487f-a783-703d2776a529 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.120945 Aug 25 13:57:36.460819 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3111/6289] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:57:35 2022] POST /compute/v2.1/servers => generated 361 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:57:36.474900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62c7585a-5c41-4a89-80da-7479e9ef7cbe tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:36.475996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-62c7585a-5c41-4a89-80da-7479e9ef7cbe tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:36.586496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62c7585a-5c41-4a89-80da-7479e9ef7cbe tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:36.604188 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-62c7585a-5c41-4a89-80da-7479e9ef7cbe tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1241 microversion: 2.1 time: 0.137831 Aug 25 13:57:36.606032 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3179/6290] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:36 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:36.669809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-888854230", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1200164785", "security_groups": [{"name": "tempest-secgroup-smoke-1252652195"}], "block_device_mapping_v2": [{"uuid": "a6b97cd7-d3bf-43b1-b254-2358ca66df6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9216295-ead7-4063-84e8-342351244740"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:36.836812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] validate_networks() for [('f9216295-ead7-4063-84e8-342351244740', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:57:37.352993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-75b8c7d8-7385-4897-b1c4-2937f4cc191d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:37.354805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-75b8c7d8-7385-4897-b1c4-2937f4cc191d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:37.376748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75b8c7d8-7385-4897-b1c4-2937f4cc191d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:37.377756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75b8c7d8-7385-4897-b1c4-2937f4cc191d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:37.378887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75b8c7d8-7385-4897-b1c4-2937f4cc191d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:37.380809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75b8c7d8-7385-4897-b1c4-2937f4cc191d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:37.381738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75b8c7d8-7385-4897-b1c4-2937f4cc191d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:37.382552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-75b8c7d8-7385-4897-b1c4-2937f4cc191d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:37.681787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:57:37.682336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:57:37.682710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:57:37.683141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:57:37.683899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:57:37.714557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:37.715333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:37.716331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:37.718751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:37.719715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:37.720621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:37.731401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-75b8c7d8-7385-4897-b1c4-2937f4cc191d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:37.760814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:57:37.767040 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-75b8c7d8-7385-4897-b1c4-2937f4cc191d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1319 microversion: 2.1 time: 0.420584 Aug 25 13:57:37.769150 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3180/6291] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:37 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:37.770683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for user 93fbad0b63d14f3fb12de08d966bffad and project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:57:37.778228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fe33fafd-9624-4cb6-ab2a-1d6af2585c09 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:37.780081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fe33fafd-9624-4cb6-ab2a-1d6af2585c09 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:37.794735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe33fafd-9624-4cb6-ab2a-1d6af2585c09 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:37.796108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe33fafd-9624-4cb6-ab2a-1d6af2585c09 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:37.797238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe33fafd-9624-4cb6-ab2a-1d6af2585c09 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:37.798121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe33fafd-9624-4cb6-ab2a-1d6af2585c09 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:37.798711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe33fafd-9624-4cb6-ab2a-1d6af2585c09 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:37.799289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fe33fafd-9624-4cb6-ab2a-1d6af2585c09 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:37.870551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:57:37.873430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6b97cd7-d3bf-43b1-b254-2358ca66df6a',volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:57:37.924733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fe33fafd-9624-4cb6-ab2a-1d6af2585c09 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:37.940125 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fe33fafd-9624-4cb6-ab2a-1d6af2585c09 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1245 microversion: 2.1 time: 0.169029 Aug 25 13:57:37.941554 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3181/6292] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:37 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1245 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:38.057286 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-00cb3131-7fb5-4a0d-be1b-19acca7c5cf0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.404008 Aug 25 13:57:38.057990 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3112/6293] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:57:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:57:38.070145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8314ef3e-3f05-4d31-a288-b0cb45380578 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:38.070701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8314ef3e-3f05-4d31-a288-b0cb45380578 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:38.167842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8314ef3e-3f05-4d31-a288-b0cb45380578 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:38.178311 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8314ef3e-3f05-4d31-a288-b0cb45380578 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1094 microversion: 2.1 time: 0.112110 Aug 25 13:57:38.179164 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3182/6294] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:38 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1094 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:38.806744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d058263-143e-4421-94d4-079477d64350 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:38.808175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d058263-143e-4421-94d4-079477d64350 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:38.864192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d058263-143e-4421-94d4-079477d64350 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:38.864638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d058263-143e-4421-94d4-079477d64350 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:38.865348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d058263-143e-4421-94d4-079477d64350 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:38.866797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d058263-143e-4421-94d4-079477d64350 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:38.867727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d058263-143e-4421-94d4-079477d64350 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:38.868565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d058263-143e-4421-94d4-079477d64350 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:38.978170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4db4b9f1-edab-4576-966e-c64065616f80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:38.979041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4db4b9f1-edab-4576-966e-c64065616f80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:38.996225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4db4b9f1-edab-4576-966e-c64065616f80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:38.996954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4db4b9f1-edab-4576-966e-c64065616f80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:38.997739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4db4b9f1-edab-4576-966e-c64065616f80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:39.004869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4db4b9f1-edab-4576-966e-c64065616f80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:39.006821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4db4b9f1-edab-4576-966e-c64065616f80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:39.012782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4db4b9f1-edab-4576-966e-c64065616f80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:39.199577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4db4b9f1-edab-4576-966e-c64065616f80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:39.207944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6d058263-143e-4421-94d4-079477d64350 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:39.219925 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d058263-143e-4421-94d4-079477d64350 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1319 microversion: 2.1 time: 0.422800 Aug 25 13:57:39.220931 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3113/6295] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:38 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:39.226667 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4db4b9f1-edab-4576-966e-c64065616f80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1293 microversion: 2.1 time: 0.246784 Aug 25 13:57:39.227888 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3183/6296] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:38 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1293 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:39.243272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-160fe2b6-a647-4875-89e2-a67a4e166001 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:39.244572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-160fe2b6-a647-4875-89e2-a67a4e166001 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:39.257472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-160fe2b6-a647-4875-89e2-a67a4e166001 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:39.258487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-160fe2b6-a647-4875-89e2-a67a4e166001 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:39.259349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-160fe2b6-a647-4875-89e2-a67a4e166001 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:39.260450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-160fe2b6-a647-4875-89e2-a67a4e166001 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:39.262868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-160fe2b6-a647-4875-89e2-a67a4e166001 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:39.267497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-160fe2b6-a647-4875-89e2-a67a4e166001 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:39.418381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-160fe2b6-a647-4875-89e2-a67a4e166001 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:39.434598 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-160fe2b6-a647-4875-89e2-a67a4e166001 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1192 microversion: 2.1 time: 0.211590 Aug 25 13:57:39.439069 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3114/6297] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:39 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1192 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:40.246378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-abe87b37-7545-45fa-b000-79f1138f60a6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:40.258566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-abe87b37-7545-45fa-b000-79f1138f60a6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:40.275011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e2e1a09e-9c04-4254-bf18-4852a6ac162a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:40.277415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e2e1a09e-9c04-4254-bf18-4852a6ac162a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:40.290886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abe87b37-7545-45fa-b000-79f1138f60a6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:40.294237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2e1a09e-9c04-4254-bf18-4852a6ac162a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:40.294759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abe87b37-7545-45fa-b000-79f1138f60a6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:40.295363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abe87b37-7545-45fa-b000-79f1138f60a6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:40.296525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2e1a09e-9c04-4254-bf18-4852a6ac162a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:40.297604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abe87b37-7545-45fa-b000-79f1138f60a6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:40.298168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abe87b37-7545-45fa-b000-79f1138f60a6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:40.298585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2e1a09e-9c04-4254-bf18-4852a6ac162a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:40.300426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2e1a09e-9c04-4254-bf18-4852a6ac162a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:40.301222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abe87b37-7545-45fa-b000-79f1138f60a6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:40.302117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2e1a09e-9c04-4254-bf18-4852a6ac162a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:40.303408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e2e1a09e-9c04-4254-bf18-4852a6ac162a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:40.490656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e2e1a09e-9c04-4254-bf18-4852a6ac162a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:40.509693 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e2e1a09e-9c04-4254-bf18-4852a6ac162a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1299 microversion: 2.1 time: 0.242990 Aug 25 13:57:40.529745 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3115/6298] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:40 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1299 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:40.544405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e65154e1-2ec1-4226-865f-aef29d6fc2c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:40.545153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e65154e1-2ec1-4226-865f-aef29d6fc2c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:40.564342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e65154e1-2ec1-4226-865f-aef29d6fc2c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:40.568967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e65154e1-2ec1-4226-865f-aef29d6fc2c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:40.569763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e65154e1-2ec1-4226-865f-aef29d6fc2c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:40.570655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e65154e1-2ec1-4226-865f-aef29d6fc2c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:40.571217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e65154e1-2ec1-4226-865f-aef29d6fc2c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:40.571850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e65154e1-2ec1-4226-865f-aef29d6fc2c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:40.689473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e65154e1-2ec1-4226-865f-aef29d6fc2c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:40.705978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-abe87b37-7545-45fa-b000-79f1138f60a6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:40.716482 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e65154e1-2ec1-4226-865f-aef29d6fc2c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1210 microversion: 2.1 time: 0.183959 Aug 25 13:57:40.733223 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-abe87b37-7545-45fa-b000-79f1138f60a6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1319 microversion: 2.1 time: 0.493816 Aug 25 13:57:40.734137 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3184/6299] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:40 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:40.748633 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3116/6300] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:40 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1210 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:41.544807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad1b9e90-2700-4eb3-93f0-045cb598b6f4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:41.548366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad1b9e90-2700-4eb3-93f0-045cb598b6f4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:41.566376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad1b9e90-2700-4eb3-93f0-045cb598b6f4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:41.567110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad1b9e90-2700-4eb3-93f0-045cb598b6f4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:41.567711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad1b9e90-2700-4eb3-93f0-045cb598b6f4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:41.568736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad1b9e90-2700-4eb3-93f0-045cb598b6f4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:41.569388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad1b9e90-2700-4eb3-93f0-045cb598b6f4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:41.570185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad1b9e90-2700-4eb3-93f0-045cb598b6f4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:41.743104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44378bc7-4c33-4054-bf80-a4719c59880e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:41.744566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44378bc7-4c33-4054-bf80-a4719c59880e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:41.760747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ad1b9e90-2700-4eb3-93f0-045cb598b6f4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:41.770390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44378bc7-4c33-4054-bf80-a4719c59880e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:41.770986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44378bc7-4c33-4054-bf80-a4719c59880e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:41.771565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44378bc7-4c33-4054-bf80-a4719c59880e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:41.772538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44378bc7-4c33-4054-bf80-a4719c59880e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:41.773223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44378bc7-4c33-4054-bf80-a4719c59880e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:41.776658 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad1b9e90-2700-4eb3-93f0-045cb598b6f4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1299 microversion: 2.1 time: 0.239250 Aug 25 13:57:41.779178 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3185/6301] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:41 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1299 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:41.787065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6592c8c4-5422-4a87-9109-15d17ef546fd tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:41.789841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6592c8c4-5422-4a87-9109-15d17ef546fd tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:41.797383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44378bc7-4c33-4054-bf80-a4719c59880e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:41.807839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6592c8c4-5422-4a87-9109-15d17ef546fd tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:41.812885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6592c8c4-5422-4a87-9109-15d17ef546fd tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:41.818874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6592c8c4-5422-4a87-9109-15d17ef546fd tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:41.820232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6592c8c4-5422-4a87-9109-15d17ef546fd tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:41.821112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6592c8c4-5422-4a87-9109-15d17ef546fd tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:41.821983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6592c8c4-5422-4a87-9109-15d17ef546fd tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:42.256749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6592c8c4-5422-4a87-9109-15d17ef546fd tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:42.291803 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6592c8c4-5422-4a87-9109-15d17ef546fd tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1319 microversion: 2.1 time: 0.503029 Aug 25 13:57:42.293275 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3186/6302] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:41 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:42.343996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44378bc7-4c33-4054-bf80-a4719c59880e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:42.375072 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44378bc7-4c33-4054-bf80-a4719c59880e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1278 microversion: 2.1 time: 0.637804 Aug 25 13:57:42.376529 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3117/6303] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:41 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1278 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:42.567607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-12124c27-ebd6-48e0-9485-240f6c6e2b1b req-f4f4675d-c73c-42ca-a0b4-b832a4599eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca53cfc1-6d39-422a-97ff-23863446350b", "name": "network-vif-plugged", "status": "completed", "tag": "356d537b-add8-4e15-bed0-1e67b8f257e6"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:42.588822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-12124c27-ebd6-48e0-9485-240f6c6e2b1b req-f4f4675d-c73c-42ca-a0b4-b832a4599eb9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:42.592521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-12124c27-ebd6-48e0-9485-240f6c6e2b1b req-f4f4675d-c73c-42ca-a0b4-b832a4599eb9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:42.594961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-12124c27-ebd6-48e0-9485-240f6c6e2b1b req-f4f4675d-c73c-42ca-a0b4-b832a4599eb9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:42.615651 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-12124c27-ebd6-48e0-9485-240f6c6e2b1b req-f4f4675d-c73c-42ca-a0b4-b832a4599eb9 service nova] Creating event network-vif-plugged:356d537b-add8-4e15-bed0-1e67b8f257e6 for instance ca53cfc1-6d39-422a-97ff-23863446350b on n-h1-852771-8 Aug 25 13:57:42.622884 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-12124c27-ebd6-48e0-9485-240f6c6e2b1b req-f4f4675d-c73c-42ca-a0b4-b832a4599eb9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061066 Aug 25 13:57:42.625612 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3187/6304] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:57:42.817997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4c064c1f-75e6-4d94-b268-f59f11e749da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:42.819514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4c064c1f-75e6-4d94-b268-f59f11e749da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:42.828048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c064c1f-75e6-4d94-b268-f59f11e749da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:42.829265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c064c1f-75e6-4d94-b268-f59f11e749da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:42.829765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c064c1f-75e6-4d94-b268-f59f11e749da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:42.830728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c064c1f-75e6-4d94-b268-f59f11e749da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:42.831217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c064c1f-75e6-4d94-b268-f59f11e749da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:42.831863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c064c1f-75e6-4d94-b268-f59f11e749da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:42.935443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4c064c1f-75e6-4d94-b268-f59f11e749da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:42.944564 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4c064c1f-75e6-4d94-b268-f59f11e749da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1299 microversion: 2.1 time: 0.131370 Aug 25 13:57:42.945898 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3118/6305] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:42 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:43.322808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-37bbe402-bbe0-42c9-8cb2-0aedacbed02d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:43.324206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-37bbe402-bbe0-42c9-8cb2-0aedacbed02d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:43.339366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37bbe402-bbe0-42c9-8cb2-0aedacbed02d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:43.340354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37bbe402-bbe0-42c9-8cb2-0aedacbed02d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:43.341178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37bbe402-bbe0-42c9-8cb2-0aedacbed02d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:43.342306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37bbe402-bbe0-42c9-8cb2-0aedacbed02d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:43.343340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37bbe402-bbe0-42c9-8cb2-0aedacbed02d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:43.344659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37bbe402-bbe0-42c9-8cb2-0aedacbed02d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:43.460956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-499e7a50-ada4-4026-950d-a398074b6018 req-c9374048-379b-481f-a6cd-1631fa2a2de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf267d9-94b2-4a2c-ac0e-7253d2751762", "tag": "4d424370-53c7-471e-9db8-136e74393dd2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:43.493175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-499e7a50-ada4-4026-950d-a398074b6018 req-c9374048-379b-481f-a6cd-1631fa2a2de5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:43.493999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-499e7a50-ada4-4026-950d-a398074b6018 req-c9374048-379b-481f-a6cd-1631fa2a2de5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:43.494707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-499e7a50-ada4-4026-950d-a398074b6018 req-c9374048-379b-481f-a6cd-1631fa2a2de5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:43.529417 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-499e7a50-ada4-4026-950d-a398074b6018 req-c9374048-379b-481f-a6cd-1631fa2a2de5 service nova] Creating event network-changed:4d424370-53c7-471e-9db8-136e74393dd2 for instance ebf267d9-94b2-4a2c-ac0e-7253d2751762 on n-h1-852771-8 Aug 25 13:57:43.552455 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-499e7a50-ada4-4026-950d-a398074b6018 req-c9374048-379b-481f-a6cd-1631fa2a2de5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249959 Aug 25 13:57:43.554558 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3188/6306] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:57:43.571044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d0a20198-b741-43be-9367-666c35f59a4f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:43.572555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d0a20198-b741-43be-9367-666c35f59a4f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:43.590058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0a20198-b741-43be-9367-666c35f59a4f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:43.591042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0a20198-b741-43be-9367-666c35f59a4f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:43.591891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0a20198-b741-43be-9367-666c35f59a4f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:43.595041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0a20198-b741-43be-9367-666c35f59a4f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:43.600512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0a20198-b741-43be-9367-666c35f59a4f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:43.602398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0a20198-b741-43be-9367-666c35f59a4f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:43.615285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=100 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:43.637297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37bbe402-bbe0-42c9-8cb2-0aedacbed02d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:43.650238 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-37bbe402-bbe0-42c9-8cb2-0aedacbed02d tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1319 microversion: 2.1 time: 0.331628 Aug 25 13:57:43.665547 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3119/6307] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:43 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:43.846893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d0a20198-b741-43be-9367-666c35f59a4f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:43.864743 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d0a20198-b741-43be-9367-666c35f59a4f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1278 microversion: 2.1 time: 0.307448 Aug 25 13:57:43.867325 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3189/6308] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:43 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1278 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:43.969487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44b71340-ccba-430f-921a-4a2ca8a9d96a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:43.970258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44b71340-ccba-430f-921a-4a2ca8a9d96a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:43.977836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b71340-ccba-430f-921a-4a2ca8a9d96a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:43.978348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b71340-ccba-430f-921a-4a2ca8a9d96a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:43.978808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b71340-ccba-430f-921a-4a2ca8a9d96a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:43.979657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b71340-ccba-430f-921a-4a2ca8a9d96a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:43.980159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b71340-ccba-430f-921a-4a2ca8a9d96a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:43.980613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b71340-ccba-430f-921a-4a2ca8a9d96a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:44.003967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:44.111255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44b71340-ccba-430f-921a-4a2ca8a9d96a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:44.120269 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44b71340-ccba-430f-921a-4a2ca8a9d96a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1299 microversion: 2.1 time: 0.156251 Aug 25 13:57:44.121609 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3120/6309] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:43 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:44.691044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-705739ba-ebc8-48cc-b3b9-791a1ef265df tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:44.692161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-705739ba-ebc8-48cc-b3b9-791a1ef265df tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:44.699856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-705739ba-ebc8-48cc-b3b9-791a1ef265df tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:44.700546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-705739ba-ebc8-48cc-b3b9-791a1ef265df tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:44.701111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-705739ba-ebc8-48cc-b3b9-791a1ef265df tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:44.702203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-705739ba-ebc8-48cc-b3b9-791a1ef265df tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:44.702984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-705739ba-ebc8-48cc-b3b9-791a1ef265df tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:44.703671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-705739ba-ebc8-48cc-b3b9-791a1ef265df tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:44.874829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-705739ba-ebc8-48cc-b3b9-791a1ef265df tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:44.886153 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-705739ba-ebc8-48cc-b3b9-791a1ef265df tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1509 microversion: 2.1 time: 0.200234 Aug 25 13:57:44.887643 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3190/6310] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:44 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:44.892721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a616209-1924-4b35-be19-a1044011ca22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:44.893921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a616209-1924-4b35-be19-a1044011ca22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:44.908891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a616209-1924-4b35-be19-a1044011ca22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:44.910676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a616209-1924-4b35-be19-a1044011ca22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:44.911843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a616209-1924-4b35-be19-a1044011ca22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:44.914613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a616209-1924-4b35-be19-a1044011ca22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:44.915506 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a616209-1924-4b35-be19-a1044011ca22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:44.916315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a616209-1924-4b35-be19-a1044011ca22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:45.156698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5a616209-1924-4b35-be19-a1044011ca22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:45.163058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9735ade4-ca8e-4d93-b2fc-bf97602e60fb tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:45.164110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9735ade4-ca8e-4d93-b2fc-bf97602e60fb tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:45.177740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9735ade4-ca8e-4d93-b2fc-bf97602e60fb tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:45.178191 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a616209-1924-4b35-be19-a1044011ca22 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1278 microversion: 2.1 time: 0.293482 Aug 25 13:57:45.179687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9735ade4-ca8e-4d93-b2fc-bf97602e60fb tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:45.180482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9735ade4-ca8e-4d93-b2fc-bf97602e60fb tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:45.181035 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3121/6311] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:44 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:45.181888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9735ade4-ca8e-4d93-b2fc-bf97602e60fb tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:45.183053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9735ade4-ca8e-4d93-b2fc-bf97602e60fb tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:45.183729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9735ade4-ca8e-4d93-b2fc-bf97602e60fb tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:45.283985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9735ade4-ca8e-4d93-b2fc-bf97602e60fb tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:45.294840 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9735ade4-ca8e-4d93-b2fc-bf97602e60fb tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1299 microversion: 2.1 time: 0.144231 Aug 25 13:57:45.297938 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3191/6312] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:45 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:45.605666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-aa74dbf6-cbaf-49d3-a0b8-5586e3a158c6 req-a8ecae1c-93a2-4af4-8bc3-608cd674bd55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d01aa0-56df-43fa-b485-d2cdf4afcb4a", "tag": "295c3d0a-e49a-46a7-867f-62da6bef901c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:45.641109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aa74dbf6-cbaf-49d3-a0b8-5586e3a158c6 req-a8ecae1c-93a2-4af4-8bc3-608cd674bd55 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:45.641661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aa74dbf6-cbaf-49d3-a0b8-5586e3a158c6 req-a8ecae1c-93a2-4af4-8bc3-608cd674bd55 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:45.642237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-aa74dbf6-cbaf-49d3-a0b8-5586e3a158c6 req-a8ecae1c-93a2-4af4-8bc3-608cd674bd55 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:45.681006 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-aa74dbf6-cbaf-49d3-a0b8-5586e3a158c6 req-a8ecae1c-93a2-4af4-8bc3-608cd674bd55 service nova] Creating event network-changed:295c3d0a-e49a-46a7-867f-62da6bef901c for instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a on n-h2-852771-8 Aug 25 13:57:45.689459 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-aa74dbf6-cbaf-49d3-a0b8-5586e3a158c6 req-a8ecae1c-93a2-4af4-8bc3-608cd674bd55 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088805 Aug 25 13:57:45.690127 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3122/6313] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:57:46.214700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ceebec3-df9f-47d5-8635-72151ec83e27 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:46.215367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ceebec3-df9f-47d5-8635-72151ec83e27 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:46.231082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ceebec3-df9f-47d5-8635-72151ec83e27 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:46.233847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ceebec3-df9f-47d5-8635-72151ec83e27 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:46.238499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ceebec3-df9f-47d5-8635-72151ec83e27 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:46.241537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ceebec3-df9f-47d5-8635-72151ec83e27 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:46.243953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ceebec3-df9f-47d5-8635-72151ec83e27 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:46.246461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ceebec3-df9f-47d5-8635-72151ec83e27 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:46.329864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27425136-0e8c-480d-8546-72dd7de1a7a0 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:46.331398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-27425136-0e8c-480d-8546-72dd7de1a7a0 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:46.344935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27425136-0e8c-480d-8546-72dd7de1a7a0 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:46.346040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27425136-0e8c-480d-8546-72dd7de1a7a0 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:46.346960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27425136-0e8c-480d-8546-72dd7de1a7a0 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:46.348179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27425136-0e8c-480d-8546-72dd7de1a7a0 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:46.351362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27425136-0e8c-480d-8546-72dd7de1a7a0 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:46.352634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27425136-0e8c-480d-8546-72dd7de1a7a0 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:46.564085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2ceebec3-df9f-47d5-8635-72151ec83e27 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:46.577949 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2ceebec3-df9f-47d5-8635-72151ec83e27 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1278 microversion: 2.1 time: 0.377899 Aug 25 13:57:46.579428 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3192/6314] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:46 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1278 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:46.678907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-27425136-0e8c-480d-8546-72dd7de1a7a0 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:46.699184 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-27425136-0e8c-480d-8546-72dd7de1a7a0 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1299 microversion: 2.1 time: 0.377815 Aug 25 13:57:46.701769 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3123/6315] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:46 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1299 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:47.616749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a40916de-1da3-4549-aab6-552bceb54004 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:47.617380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a40916de-1da3-4549-aab6-552bceb54004 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:47.626491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a40916de-1da3-4549-aab6-552bceb54004 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:47.626990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a40916de-1da3-4549-aab6-552bceb54004 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:47.628039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a40916de-1da3-4549-aab6-552bceb54004 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:47.629220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a40916de-1da3-4549-aab6-552bceb54004 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:47.629748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a40916de-1da3-4549-aab6-552bceb54004 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:47.630175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a40916de-1da3-4549-aab6-552bceb54004 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:47.731569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bd4bc5f8-58cb-4d81-9190-085aa125d0da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:47.732873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bd4bc5f8-58cb-4d81-9190-085aa125d0da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:47.736484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:47.742325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd4bc5f8-58cb-4d81-9190-085aa125d0da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:47.743131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd4bc5f8-58cb-4d81-9190-085aa125d0da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:47.743784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd4bc5f8-58cb-4d81-9190-085aa125d0da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:47.744725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd4bc5f8-58cb-4d81-9190-085aa125d0da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:47.745692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd4bc5f8-58cb-4d81-9190-085aa125d0da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:47.746327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bd4bc5f8-58cb-4d81-9190-085aa125d0da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:47.784818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=18 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:47.804560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a40916de-1da3-4549-aab6-552bceb54004 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:47.814421 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a40916de-1da3-4549-aab6-552bceb54004 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1266 microversion: 2.1 time: 0.202030 Aug 25 13:57:47.815032 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3193/6316] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:47 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:47.867749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bd4bc5f8-58cb-4d81-9190-085aa125d0da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:47.877285 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bd4bc5f8-58cb-4d81-9190-085aa125d0da tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1299 microversion: 2.1 time: 0.151866 Aug 25 13:57:47.878089 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3124/6317] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:47 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1299 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:48.836942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a0c51303-8946-4ac7-999b-d0631e9efa06 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:48.837880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a0c51303-8946-4ac7-999b-d0631e9efa06 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:48.839651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:48.850417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0c51303-8946-4ac7-999b-d0631e9efa06 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:48.851200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0c51303-8946-4ac7-999b-d0631e9efa06 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:48.851896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0c51303-8946-4ac7-999b-d0631e9efa06 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:48.852966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0c51303-8946-4ac7-999b-d0631e9efa06 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:48.853559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0c51303-8946-4ac7-999b-d0631e9efa06 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:48.854368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a0c51303-8946-4ac7-999b-d0631e9efa06 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:48.902990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-50736723-eec0-4c40-ae8c-246088a72135 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:48.906258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-50736723-eec0-4c40-ae8c-246088a72135 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:48.930024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50736723-eec0-4c40-ae8c-246088a72135 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:48.933197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50736723-eec0-4c40-ae8c-246088a72135 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:48.934021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50736723-eec0-4c40-ae8c-246088a72135 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:48.935980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50736723-eec0-4c40-ae8c-246088a72135 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:48.937799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50736723-eec0-4c40-ae8c-246088a72135 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:48.938905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50736723-eec0-4c40-ae8c-246088a72135 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:49.113169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-50736723-eec0-4c40-ae8c-246088a72135 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:49.117746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a0c51303-8946-4ac7-999b-d0631e9efa06 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:49.125626 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-50736723-eec0-4c40-ae8c-246088a72135 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1299 microversion: 2.1 time: 0.228822 Aug 25 13:57:49.126541 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3125/6318] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:48 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:49.131339 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a0c51303-8946-4ac7-999b-d0631e9efa06 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1266 microversion: 2.1 time: 0.297803 Aug 25 13:57:49.131832 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3194/6319] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:48 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:50.148558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec7cef4f-781a-4309-84c2-e30a2242dcf4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:50.151776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ec7cef4f-781a-4309-84c2-e30a2242dcf4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:50.154121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:50.157911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5331005f-8eb3-40f6-a41a-9189268ccecc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:50.158757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec7cef4f-781a-4309-84c2-e30a2242dcf4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:50.159167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec7cef4f-781a-4309-84c2-e30a2242dcf4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:50.159636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec7cef4f-781a-4309-84c2-e30a2242dcf4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:50.160462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec7cef4f-781a-4309-84c2-e30a2242dcf4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:50.160588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5331005f-8eb3-40f6-a41a-9189268ccecc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:50.160846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec7cef4f-781a-4309-84c2-e30a2242dcf4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:50.161291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec7cef4f-781a-4309-84c2-e30a2242dcf4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:50.172239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5331005f-8eb3-40f6-a41a-9189268ccecc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:50.172994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5331005f-8eb3-40f6-a41a-9189268ccecc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:50.173723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5331005f-8eb3-40f6-a41a-9189268ccecc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:50.175152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5331005f-8eb3-40f6-a41a-9189268ccecc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:50.175930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5331005f-8eb3-40f6-a41a-9189268ccecc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:50.176644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5331005f-8eb3-40f6-a41a-9189268ccecc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:50.312570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ec7cef4f-781a-4309-84c2-e30a2242dcf4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:50.322179 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ec7cef4f-781a-4309-84c2-e30a2242dcf4 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1299 microversion: 2.1 time: 0.177417 Aug 25 13:57:50.323132 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3126/6320] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:50 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1299 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:50.396702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5331005f-8eb3-40f6-a41a-9189268ccecc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:50.407109 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5331005f-8eb3-40f6-a41a-9189268ccecc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1266 microversion: 2.1 time: 0.254663 Aug 25 13:57:50.407711 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3195/6321] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:50 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:50.634829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d0db3371-0334-476d-b394-450a3e9e2b21 req-0bdb2012-02eb-41c7-8a27-8dfaea4250c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf267d9-94b2-4a2c-ac0e-7253d2751762", "name": "network-vif-plugged", "status": "completed", "tag": "4d424370-53c7-471e-9db8-136e74393dd2"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:50.649081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d0db3371-0334-476d-b394-450a3e9e2b21 req-0bdb2012-02eb-41c7-8a27-8dfaea4250c9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:50.650042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d0db3371-0334-476d-b394-450a3e9e2b21 req-0bdb2012-02eb-41c7-8a27-8dfaea4250c9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:50.650811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d0db3371-0334-476d-b394-450a3e9e2b21 req-0bdb2012-02eb-41c7-8a27-8dfaea4250c9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:50.675071 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d0db3371-0334-476d-b394-450a3e9e2b21 req-0bdb2012-02eb-41c7-8a27-8dfaea4250c9 service nova] Creating event network-vif-plugged:4d424370-53c7-471e-9db8-136e74393dd2 for instance ebf267d9-94b2-4a2c-ac0e-7253d2751762 on n-h1-852771-8 Aug 25 13:57:50.680454 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d0db3371-0334-476d-b394-450a3e9e2b21 req-0bdb2012-02eb-41c7-8a27-8dfaea4250c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050807 Aug 25 13:57:50.681158 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3127/6322] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:57:51.345286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d7325b39-8886-4aad-9e0f-5d4a100fc97a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:51.346255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d7325b39-8886-4aad-9e0f-5d4a100fc97a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:51.355280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7325b39-8886-4aad-9e0f-5d4a100fc97a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:51.355678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7325b39-8886-4aad-9e0f-5d4a100fc97a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:51.356120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7325b39-8886-4aad-9e0f-5d4a100fc97a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:51.356862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7325b39-8886-4aad-9e0f-5d4a100fc97a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:51.357459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7325b39-8886-4aad-9e0f-5d4a100fc97a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:51.357798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7325b39-8886-4aad-9e0f-5d4a100fc97a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:51.431533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b45a6e82-f746-4261-a585-d45c743730c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:51.432433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b45a6e82-f746-4261-a585-d45c743730c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:51.441554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b45a6e82-f746-4261-a585-d45c743730c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:51.442515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b45a6e82-f746-4261-a585-d45c743730c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:51.443422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b45a6e82-f746-4261-a585-d45c743730c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:51.444661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b45a6e82-f746-4261-a585-d45c743730c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:51.445164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b45a6e82-f746-4261-a585-d45c743730c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:51.445780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b45a6e82-f746-4261-a585-d45c743730c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:51.475016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d7325b39-8886-4aad-9e0f-5d4a100fc97a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:51.485540 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d7325b39-8886-4aad-9e0f-5d4a100fc97a tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1299 microversion: 2.1 time: 0.144380 Aug 25 13:57:51.486750 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3196/6323] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:51 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:52.086467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b45a6e82-f746-4261-a585-d45c743730c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:52.101140 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b45a6e82-f746-4261-a585-d45c743730c3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1266 microversion: 2.1 time: 0.675723 Aug 25 13:57:52.101796 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3128/6324] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:51 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1266 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:52.508046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-27849e2e-d4f7-48ac-85ff-0b85c605b884 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:52.509010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-27849e2e-d4f7-48ac-85ff-0b85c605b884 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:52.519885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27849e2e-d4f7-48ac-85ff-0b85c605b884 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:52.520773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27849e2e-d4f7-48ac-85ff-0b85c605b884 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:52.521391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27849e2e-d4f7-48ac-85ff-0b85c605b884 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:52.522496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27849e2e-d4f7-48ac-85ff-0b85c605b884 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:52.523071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27849e2e-d4f7-48ac-85ff-0b85c605b884 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:52.523605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-27849e2e-d4f7-48ac-85ff-0b85c605b884 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:52.625207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-27849e2e-d4f7-48ac-85ff-0b85c605b884 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:52.634063 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-27849e2e-d4f7-48ac-85ff-0b85c605b884 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1472 microversion: 2.1 time: 0.130080 Aug 25 13:57:52.639436 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3197/6325] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:52 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1472 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:52.670456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e20423d-f57f-4196-a8e2-d436f0b0087c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:52.672915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e20423d-f57f-4196-a8e2-d436f0b0087c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:52.681484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e20423d-f57f-4196-a8e2-d436f0b0087c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:52.682039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e20423d-f57f-4196-a8e2-d436f0b0087c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:52.682511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e20423d-f57f-4196-a8e2-d436f0b0087c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:52.683282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e20423d-f57f-4196-a8e2-d436f0b0087c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:52.683772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e20423d-f57f-4196-a8e2-d436f0b0087c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:52.684213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e20423d-f57f-4196-a8e2-d436f0b0087c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:52.718614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0d13449f-a969-474a-a7ab-8a8fee33f52a req-a7e048e5-bead-445f-9a8a-5cb44899838c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d01aa0-56df-43fa-b485-d2cdf4afcb4a", "name": "network-vif-plugged", "status": "completed", "tag": "295c3d0a-e49a-46a7-867f-62da6bef901c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:52.735696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0d13449f-a969-474a-a7ab-8a8fee33f52a req-a7e048e5-bead-445f-9a8a-5cb44899838c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:52.736183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0d13449f-a969-474a-a7ab-8a8fee33f52a req-a7e048e5-bead-445f-9a8a-5cb44899838c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:52.736619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0d13449f-a969-474a-a7ab-8a8fee33f52a req-a7e048e5-bead-445f-9a8a-5cb44899838c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:52.772899 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0d13449f-a969-474a-a7ab-8a8fee33f52a req-a7e048e5-bead-445f-9a8a-5cb44899838c service nova] Creating event network-vif-plugged:295c3d0a-e49a-46a7-867f-62da6bef901c for instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a on n-h2-852771-8 Aug 25 13:57:52.782638 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0d13449f-a969-474a-a7ab-8a8fee33f52a req-a7e048e5-bead-445f-9a8a-5cb44899838c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070338 Aug 25 13:57:52.784025 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3198/6326] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:57:52.812659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e20423d-f57f-4196-a8e2-d436f0b0087c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:52.829489 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e20423d-f57f-4196-a8e2-d436f0b0087c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1472 microversion: 2.1 time: 0.164354 Aug 25 13:57:52.830203 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3129/6327] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:52 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:52.851144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f951ce71-b0e2-4fe1-b722-76d51cc8ad16 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:52.852151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f951ce71-b0e2-4fe1-b722-76d51cc8ad16 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:52.860979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f951ce71-b0e2-4fe1-b722-76d51cc8ad16 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:52.861695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f951ce71-b0e2-4fe1-b722-76d51cc8ad16 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:52.862538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f951ce71-b0e2-4fe1-b722-76d51cc8ad16 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:52.863870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f951ce71-b0e2-4fe1-b722-76d51cc8ad16 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:52.864519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f951ce71-b0e2-4fe1-b722-76d51cc8ad16 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:52.865752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f951ce71-b0e2-4fe1-b722-76d51cc8ad16 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:53.018891 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f951ce71-b0e2-4fe1-b722-76d51cc8ad16 tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1623 microversion: 2.1 time: 0.171936 Aug 25 13:57:53.019711 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3199/6328] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:52 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1623 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:53.042784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a91f12b5-2802-4c5c-ba1d-16bae86af64c tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:53.043329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a91f12b5-2802-4c5c-ba1d-16bae86af64c tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:53.051131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91f12b5-2802-4c5c-ba1d-16bae86af64c tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:53.052007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91f12b5-2802-4c5c-ba1d-16bae86af64c tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:53.052473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91f12b5-2802-4c5c-ba1d-16bae86af64c tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:53.053423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91f12b5-2802-4c5c-ba1d-16bae86af64c tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:53.053934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91f12b5-2802-4c5c-ba1d-16bae86af64c tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:53.054410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a91f12b5-2802-4c5c-ba1d-16bae86af64c tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:53.129304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b4c306e9-eae8-4a23-9046-cdfb87d2bea8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:53.130288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b4c306e9-eae8-4a23-9046-cdfb87d2bea8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:53.138961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4c306e9-eae8-4a23-9046-cdfb87d2bea8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:53.138961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4c306e9-eae8-4a23-9046-cdfb87d2bea8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:53.138961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4c306e9-eae8-4a23-9046-cdfb87d2bea8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:53.140830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4c306e9-eae8-4a23-9046-cdfb87d2bea8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:53.141326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4c306e9-eae8-4a23-9046-cdfb87d2bea8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:53.141801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4c306e9-eae8-4a23-9046-cdfb87d2bea8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:53.331387 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a91f12b5-2802-4c5c-ba1d-16bae86af64c tempest-TestSecurityGroupsBasicOps-527545943 tempest-TestSecurityGroupsBasicOps-527545943-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1912 microversion: 2.1 time: 0.292850 Aug 25 13:57:53.332523 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3130/6329] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:53 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1912 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:53.370255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b4c306e9-eae8-4a23-9046-cdfb87d2bea8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:53.382517 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b4c306e9-eae8-4a23-9046-cdfb87d2bea8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1266 microversion: 2.1 time: 0.257277 Aug 25 13:57:53.383798 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3200/6330] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:53 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:53.422706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a3ba3762-2ad5-461f-b60b-14bab5653b9c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:53.423237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a3ba3762-2ad5-461f-b60b-14bab5653b9c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:53.429893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3ba3762-2ad5-461f-b60b-14bab5653b9c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:53.430405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3ba3762-2ad5-461f-b60b-14bab5653b9c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:53.430864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3ba3762-2ad5-461f-b60b-14bab5653b9c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:53.431981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3ba3762-2ad5-461f-b60b-14bab5653b9c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:53.432151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3ba3762-2ad5-461f-b60b-14bab5653b9c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:53.432504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3ba3762-2ad5-461f-b60b-14bab5653b9c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:53.466497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a3ba3762-2ad5-461f-b60b-14bab5653b9c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:57:53.579423 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a3ba3762-2ad5-461f-b60b-14bab5653b9c tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 204 len: 0 microversion: 2.1 time: 0.164207 Aug 25 13:57:53.580215 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3131/6331] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:57:53 2022] DELETE /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:57:53.591601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3721acae-43d0-4e2e-816a-96a4d6894fd2 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:53.593645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3721acae-43d0-4e2e-816a-96a4d6894fd2 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:53.603399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3721acae-43d0-4e2e-816a-96a4d6894fd2 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:53.604202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3721acae-43d0-4e2e-816a-96a4d6894fd2 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:53.604758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3721acae-43d0-4e2e-816a-96a4d6894fd2 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:53.605990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3721acae-43d0-4e2e-816a-96a4d6894fd2 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:53.606515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3721acae-43d0-4e2e-816a-96a4d6894fd2 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:53.607147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3721acae-43d0-4e2e-816a-96a4d6894fd2 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:53.719272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3721acae-43d0-4e2e-816a-96a4d6894fd2 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:53.729482 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3721acae-43d0-4e2e-816a-96a4d6894fd2 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1478 microversion: 2.1 time: 0.142762 Aug 25 13:57:53.730543 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3201/6332] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:53 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1478 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:54.416831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b293e2b-8d68-43e3-b0eb-4229797fda98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:54.417792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b293e2b-8d68-43e3-b0eb-4229797fda98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:54.442001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b293e2b-8d68-43e3-b0eb-4229797fda98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:54.442519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b293e2b-8d68-43e3-b0eb-4229797fda98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:54.443323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b293e2b-8d68-43e3-b0eb-4229797fda98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:54.443734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b293e2b-8d68-43e3-b0eb-4229797fda98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:54.444210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b293e2b-8d68-43e3-b0eb-4229797fda98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:54.444662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b293e2b-8d68-43e3-b0eb-4229797fda98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:54.633918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b293e2b-8d68-43e3-b0eb-4229797fda98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:54.647215 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b293e2b-8d68-43e3-b0eb-4229797fda98 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1453 microversion: 2.1 time: 0.236733 Aug 25 13:57:54.660099 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3132/6333] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:54 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1453 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:54.678956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-879a360e-bec8-4d8d-b57c-41c03eec16a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:54.679813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-879a360e-bec8-4d8d-b57c-41c03eec16a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:54.688744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879a360e-bec8-4d8d-b57c-41c03eec16a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:54.689248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879a360e-bec8-4d8d-b57c-41c03eec16a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:54.689735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879a360e-bec8-4d8d-b57c-41c03eec16a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:54.690925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879a360e-bec8-4d8d-b57c-41c03eec16a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:54.691433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879a360e-bec8-4d8d-b57c-41c03eec16a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:54.692113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879a360e-bec8-4d8d-b57c-41c03eec16a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:54.757597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-66811b85-4117-45b8-8747-b369aaaee5d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:54.758629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-66811b85-4117-45b8-8747-b369aaaee5d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:54.766966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66811b85-4117-45b8-8747-b369aaaee5d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:54.767479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66811b85-4117-45b8-8747-b369aaaee5d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:54.767943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66811b85-4117-45b8-8747-b369aaaee5d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:54.768881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66811b85-4117-45b8-8747-b369aaaee5d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:54.769364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66811b85-4117-45b8-8747-b369aaaee5d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:54.772310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-66811b85-4117-45b8-8747-b369aaaee5d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:54.938153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-66811b85-4117-45b8-8747-b369aaaee5d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:54.949230 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-66811b85-4117-45b8-8747-b369aaaee5d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1478 microversion: 2.1 time: 0.195377 Aug 25 13:57:54.951205 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3133/6334] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:54 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1478 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:54.971852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-879a360e-bec8-4d8d-b57c-41c03eec16a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:54.981411 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-879a360e-bec8-4d8d-b57c-41c03eec16a9 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1453 microversion: 2.1 time: 0.309046 Aug 25 13:57:54.982073 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3202/6335] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:54 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1453 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:55.983347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0a295a11-fd12-4420-8eac-57a6ba283ede tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:55.984624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0a295a11-fd12-4420-8eac-57a6ba283ede tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:56.007607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a295a11-fd12-4420-8eac-57a6ba283ede tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:56.009021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a295a11-fd12-4420-8eac-57a6ba283ede tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:56.010696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a295a11-fd12-4420-8eac-57a6ba283ede tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:56.012919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a295a11-fd12-4420-8eac-57a6ba283ede tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:56.015964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a295a11-fd12-4420-8eac-57a6ba283ede tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:56.016884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a295a11-fd12-4420-8eac-57a6ba283ede tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:56.047968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-20ad1cdb-ad22-469a-bcca-561fa4a880e9 req-76b8717c-15ef-4e81-9493-311b1fbe1c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf267d9-94b2-4a2c-ac0e-7253d2751762", "name": "network-vif-deleted", "tag": "4d424370-53c7-471e-9db8-136e74393dd2"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:56.061126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=79 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:56.073577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-20ad1cdb-ad22-469a-bcca-561fa4a880e9 req-76b8717c-15ef-4e81-9493-311b1fbe1c9b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:56.075733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-20ad1cdb-ad22-469a-bcca-561fa4a880e9 req-76b8717c-15ef-4e81-9493-311b1fbe1c9b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:56.078381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-20ad1cdb-ad22-469a-bcca-561fa4a880e9 req-76b8717c-15ef-4e81-9493-311b1fbe1c9b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:56.107303 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-20ad1cdb-ad22-469a-bcca-561fa4a880e9 req-76b8717c-15ef-4e81-9493-311b1fbe1c9b service nova] Creating event network-vif-deleted:4d424370-53c7-471e-9db8-136e74393dd2 for instance ebf267d9-94b2-4a2c-ac0e-7253d2751762 on n-h1-852771-8 Aug 25 13:57:56.118423 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-20ad1cdb-ad22-469a-bcca-561fa4a880e9 req-76b8717c-15ef-4e81-9493-311b1fbe1c9b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075983 Aug 25 13:57:56.120159 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3203/6336] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:57:56.255826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0a295a11-fd12-4420-8eac-57a6ba283ede tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:56.272781 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0a295a11-fd12-4420-8eac-57a6ba283ede tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 200 len: 1478 microversion: 2.1 time: 0.293872 Aug 25 13:57:56.274081 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3134/6337] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:55 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 1478 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:57.318068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:57.319404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: ebf267d9-94b2-4a2c-ac0e-7253d2751762] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:57.327899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:57.328705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:57.328900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:57.329974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:57.330536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:57.331051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:57.349827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] HTTP exception thrown: Instance ebf267d9-94b2-4a2c-ac0e-7253d2751762 could not be found. Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Request method failure captured: Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 HTTP/1.1 Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB39dao40z27Yf7xI7WyQDkFv9hL-OZE3o2KHzraYq_st6_1nK46fPndFjBZwEq8jZFovEjFrkyAvGNNQbZjzmC1xWwp7iz2ho25nawouLdtFdn2kmNXhMB2a_qNjcqx_7RRNX8ZyYipf9NkKXLe2zZKBGffboQb4GhPIlWTLrRVkGvU Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f0f09652dfdb44bbb0a429873b8c8791 Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-838283507 Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f0f09652dfdb44bbb0a429873b8c8791"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f0f09652dfdb44bbb0a429873b8c8791", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f0f09652dfdb44bbb0a429873b8c8791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f0f09652dfdb44bbb0a429873b8c8791"}]}] Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestSecurityGroupsBasicOps-838283507 Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f0f09652dfdb44bbb0a429873b8c8791 Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-838283507 Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestSecurityGroupsBasicOps-838283507-project Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: f135e0af81ad43f3a47d7c6707d0bdcd Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestSecurityGroupsBasicOps-838283507-project Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance ebf267d9-94b2-4a2c-ac0e-7253d2751762 could not be found. Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'ebf267d9-94b2-4a2c-ac0e-7253d2751762'} Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf267d9-94b2-4a2c-ac0e-7253d2751762 could not be found. Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf267d9-94b2-4a2c-ac0e-7253d2751762 could not be found. Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:57:57.352404 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:57:57.360554 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:57:57.360554 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:57:57.360554 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:57:57.360554 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:57:57.360554 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:57:57.360554 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf267d9-94b2-4a2c-ac0e-7253d2751762 could not be found. Aug 25 13:57:57.360554 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:57:57.360554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Returning 404 to user: Instance ebf267d9-94b2-4a2c-ac0e-7253d2751762 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:57:57.360554 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-63919550-bc4b-4a6c-9bd9-5eb0170c48cd tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762" status: 404 len: 111 microversion: 2.1 time: 0.049462 Aug 25 13:57:57.360554 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3204/6338] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:57 2022] GET /compute/v2.1/servers/ebf267d9-94b2-4a2c-ac0e-7253d2751762 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:57:58.028199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-20dd9b43-fa5e-4512-ba77-73e4718de6df req-6a2dca1e-5d05-4488-abe6-5524a910435b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d01aa0-56df-43fa-b485-d2cdf4afcb4a", "tag": "295c3d0a-e49a-46a7-867f-62da6bef901c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:58.052827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-20dd9b43-fa5e-4512-ba77-73e4718de6df req-6a2dca1e-5d05-4488-abe6-5524a910435b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:58.054070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-20dd9b43-fa5e-4512-ba77-73e4718de6df req-6a2dca1e-5d05-4488-abe6-5524a910435b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:58.054800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-20dd9b43-fa5e-4512-ba77-73e4718de6df req-6a2dca1e-5d05-4488-abe6-5524a910435b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:58.074308 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-20dd9b43-fa5e-4512-ba77-73e4718de6df req-6a2dca1e-5d05-4488-abe6-5524a910435b service nova] Creating event network-changed:295c3d0a-e49a-46a7-867f-62da6bef901c for instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a on n-h2-852771-8 Aug 25 13:57:58.085692 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-20dd9b43-fa5e-4512-ba77-73e4718de6df req-6a2dca1e-5d05-4488-abe6-5524a910435b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069117 Aug 25 13:57:58.087123 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3135/6339] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:05.433660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b92f743e-1bab-49f8-8612-cb41e6da8d43 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:05.435177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b92f743e-1bab-49f8-8612-cb41e6da8d43 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:05.445006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3a524d41-9868-4ef7-8ffa-a54fe712b0d5 req-831a29dd-f146-4472-aa80-3a1712b90106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c307a68-8453-48ba-969f-4a825b891d35", "tag": "20be1b6a-013f-4bac-b970-18122d00778e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:05.453126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92f743e-1bab-49f8-8612-cb41e6da8d43 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:05.453730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92f743e-1bab-49f8-8612-cb41e6da8d43 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:05.455223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92f743e-1bab-49f8-8612-cb41e6da8d43 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:05.457053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92f743e-1bab-49f8-8612-cb41e6da8d43 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:05.457968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92f743e-1bab-49f8-8612-cb41e6da8d43 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:05.459596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3a524d41-9868-4ef7-8ffa-a54fe712b0d5 req-831a29dd-f146-4472-aa80-3a1712b90106 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:05.459917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b92f743e-1bab-49f8-8612-cb41e6da8d43 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:05.460361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3a524d41-9868-4ef7-8ffa-a54fe712b0d5 req-831a29dd-f146-4472-aa80-3a1712b90106 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:05.461145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3a524d41-9868-4ef7-8ffa-a54fe712b0d5 req-831a29dd-f146-4472-aa80-3a1712b90106 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:05.478413 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3a524d41-9868-4ef7-8ffa-a54fe712b0d5 req-831a29dd-f146-4472-aa80-3a1712b90106 service nova] Creating event network-changed:20be1b6a-013f-4bac-b970-18122d00778e for instance 9c307a68-8453-48ba-969f-4a825b891d35 on n-h2-852771-8 Aug 25 13:58:05.486516 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3a524d41-9868-4ef7-8ffa-a54fe712b0d5 req-831a29dd-f146-4472-aa80-3a1712b90106 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053750 Aug 25 13:58:05.487577 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3136/6340] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:05.510992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b92f743e-1bab-49f8-8612-cb41e6da8d43 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:58:05.695890 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b92f743e-1bab-49f8-8612-cb41e6da8d43 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 204 len: 0 microversion: 2.1 time: 0.268023 Aug 25 13:58:05.699290 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3205/6341] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:58:05 2022] DELETE /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:58:05.710315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7fe99392-8795-463d-8ab3-70f346cfe165 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:05.712046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7fe99392-8795-463d-8ab3-70f346cfe165 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:05.720046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe99392-8795-463d-8ab3-70f346cfe165 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:05.720767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe99392-8795-463d-8ab3-70f346cfe165 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:05.721346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe99392-8795-463d-8ab3-70f346cfe165 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:05.722311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe99392-8795-463d-8ab3-70f346cfe165 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:05.722941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe99392-8795-463d-8ab3-70f346cfe165 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:05.723567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fe99392-8795-463d-8ab3-70f346cfe165 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:06.047559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7fe99392-8795-463d-8ab3-70f346cfe165 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:06.058067 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7fe99392-8795-463d-8ab3-70f346cfe165 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1767 microversion: 2.1 time: 0.352597 Aug 25 13:58:06.058821 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3137/6342] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:05 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1767 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:07.094856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c52d3643-6248-4fca-987b-4370a6994cd8 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:07.096543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c52d3643-6248-4fca-987b-4370a6994cd8 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:07.113273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c52d3643-6248-4fca-987b-4370a6994cd8 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:07.113887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c52d3643-6248-4fca-987b-4370a6994cd8 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:07.114983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c52d3643-6248-4fca-987b-4370a6994cd8 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:07.115776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c52d3643-6248-4fca-987b-4370a6994cd8 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:07.116374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c52d3643-6248-4fca-987b-4370a6994cd8 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:07.116916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c52d3643-6248-4fca-987b-4370a6994cd8 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:07.124495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:07.380687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c52d3643-6248-4fca-987b-4370a6994cd8 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:07.390073 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c52d3643-6248-4fca-987b-4370a6994cd8 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1767 microversion: 2.1 time: 0.308753 Aug 25 13:58:07.405090 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3206/6343] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:07 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1767 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:07.946963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2eb1fdf0-d448-437c-b0b1-ab709d92be61 req-8f65ae8f-9bc4-457d-b485-11c7c219f187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c307a68-8453-48ba-969f-4a825b891d35", "name": "network-vif-deleted", "tag": "20be1b6a-013f-4bac-b970-18122d00778e"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:07.962144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2eb1fdf0-d448-437c-b0b1-ab709d92be61 req-8f65ae8f-9bc4-457d-b485-11c7c219f187 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:07.962988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2eb1fdf0-d448-437c-b0b1-ab709d92be61 req-8f65ae8f-9bc4-457d-b485-11c7c219f187 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:07.963476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2eb1fdf0-d448-437c-b0b1-ab709d92be61 req-8f65ae8f-9bc4-457d-b485-11c7c219f187 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:07.969348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:07.980306 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2eb1fdf0-d448-437c-b0b1-ab709d92be61 req-8f65ae8f-9bc4-457d-b485-11c7c219f187 service nova] Creating event network-vif-deleted:20be1b6a-013f-4bac-b970-18122d00778e for instance 9c307a68-8453-48ba-969f-4a825b891d35 on n-h2-852771-8 Aug 25 13:58:07.988056 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2eb1fdf0-d448-437c-b0b1-ab709d92be61 req-8f65ae8f-9bc4-457d-b485-11c7c219f187 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046419 Aug 25 13:58:07.991958 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3138/6344] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:08.412216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:08.412843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:08.424598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:08.425202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:08.425786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:08.427183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:08.427908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:08.428743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:08.481035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:08.481904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:08.483498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:08.484320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lazy-loading 'fault' on Instance uuid 9c307a68-8453-48ba-969f-4a825b891d35 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:58:08.542225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f135e0af81ad43f3a47d7c6707d0bdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f09652dfdb44bbb0a429873b8c8791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:08.553775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fabb2f79-2398-4871-8e14-28a5ff5d408f tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 200 len: 1383 microversion: 2.1 time: 0.145337 Aug 25 13:58:08.554855 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3207/6345] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:08 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 1383 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:08.640945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c7c53c61-4750-4701-a69b-68f058157c17 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5938886d-7591-4068-9fc1-06cec03cb34e", "device": "/dev/sdb"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:08.643388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c7c53c61-4750-4701-a69b-68f058157c17 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:08.650935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7c53c61-4750-4701-a69b-68f058157c17 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:08.651447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7c53c61-4750-4701-a69b-68f058157c17 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:08.651907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7c53c61-4750-4701-a69b-68f058157c17 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:08.652644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7c53c61-4750-4701-a69b-68f058157c17 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:08.653112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7c53c61-4750-4701-a69b-68f058157c17 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:08.653671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7c53c61-4750-4701-a69b-68f058157c17 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:08.948215 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c7c53c61-4750-4701-a69b-68f058157c17 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "POST /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312371 Aug 25 13:58:08.949080 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3139/6346] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:58:08 2022] POST /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:09.580226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:09.581441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [instance: 9c307a68-8453-48ba-969f-4a825b891d35] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:09.589666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:09.590345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:09.591193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:09.593051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:09.594187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:09.595000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:09.613265 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] HTTP exception thrown: Instance 9c307a68-8453-48ba-969f-4a825b891d35 could not be found. Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Request method failure captured: Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 HTTP/1.1 Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB39dao40z27Yf7xI7WyQDkFv9hL-OZE3o2KHzraYq_st6_1nK46fPndFjBZwEq8jZFovEjFrkyAvGNNQbZjzmC1xWwp7iz2ho25nawouLdtFdn2kmNXhMB2a_qNjcqx_7RRNX8ZyYipf9NkKXLe2zZKBGffboQb4GhPIlWTLrRVkGvU Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f0f09652dfdb44bbb0a429873b8c8791 Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-838283507 Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f0f09652dfdb44bbb0a429873b8c8791"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f0f09652dfdb44bbb0a429873b8c8791", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f0f09652dfdb44bbb0a429873b8c8791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f0f09652dfdb44bbb0a429873b8c8791"}]}] Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestSecurityGroupsBasicOps-838283507 Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f0f09652dfdb44bbb0a429873b8c8791 Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-838283507 Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestSecurityGroupsBasicOps-838283507-project Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: f135e0af81ad43f3a47d7c6707d0bdcd Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestSecurityGroupsBasicOps-838283507-project Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 9c307a68-8453-48ba-969f-4a825b891d35 could not be found. Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '9c307a68-8453-48ba-969f-4a825b891d35'} Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c307a68-8453-48ba-969f-4a825b891d35 could not be found. Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c307a68-8453-48ba-969f-4a825b891d35 could not be found. Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:09.615031 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:58:09.624499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:09.624499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:58:09.624499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:58:09.624499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:58:09.624499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:58:09.624499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c307a68-8453-48ba-969f-4a825b891d35 could not be found. Aug 25 13:58:09.624499 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:58:09.624499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Returning 404 to user: Instance 9c307a68-8453-48ba-969f-4a825b891d35 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:58:09.624499 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5e2ab83b-a8b9-4b3c-91cb-7d645f1313d9 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35" status: 404 len: 111 microversion: 2.1 time: 0.043097 Aug 25 13:58:09.624499 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3208/6347] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:09 2022] GET /compute/v2.1/servers/9c307a68-8453-48ba-969f-4a825b891d35 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:58:14.273929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff4faea7-bc95-437a-8302-33f6b7cbbc80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] Calling method '.version_select at 0x7f3a2919fc10>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:14.279016 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ff4faea7-bc95-437a-8302-33f6b7cbbc80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:58:15.288222 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [None req-ff4faea7-bc95-437a-8302-33f6b7cbbc80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 53208. Aug 25 13:58:15.309070 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff4faea7-bc95-437a-8302-33f6b7cbbc80 tempest-TestSecurityGroupsBasicOps-838283507 tempest-TestSecurityGroupsBasicOps-838283507-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1819276328" status: 202 len: 0 microversion: 2.1 time: 1.039640 Aug 25 13:58:15.309640 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3140/6348] 10.222.0.70 () {58 vars in 1278 bytes} [Thu Aug 25 13:58:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1819276328 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:58:34.399086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ef48f3fe-86bc-45f8-93e7-ceef96ff3d9e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:34.400035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ef48f3fe-86bc-45f8-93e7-ceef96ff3d9e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:34.404159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:34.405284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=14 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:34.417413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef48f3fe-86bc-45f8-93e7-ceef96ff3d9e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:34.418394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef48f3fe-86bc-45f8-93e7-ceef96ff3d9e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:34.419252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef48f3fe-86bc-45f8-93e7-ceef96ff3d9e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:34.420587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef48f3fe-86bc-45f8-93e7-ceef96ff3d9e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:34.421456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef48f3fe-86bc-45f8-93e7-ceef96ff3d9e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:34.422327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ef48f3fe-86bc-45f8-93e7-ceef96ff3d9e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:34.548108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-ef48f3fe-86bc-45f8-93e7-ceef96ff3d9e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lazy-loading 'services' on Instance uuid ca53cfc1-6d39-422a-97ff-23863446350b {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:58:34.638657 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ef48f3fe-86bc-45f8-93e7-ceef96ff3d9e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b/os-volume_attachments/5938886d-7591-4068-9fc1-06cec03cb34e" status: 202 len: 0 microversion: 2.1 time: 0.248052 Aug 25 13:58:34.639385 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3209/6349] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:58:34 2022] DELETE /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b/os-volume_attachments/5938886d-7591-4068-9fc1-06cec03cb34e => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:58:40.079975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:40.081060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:40.085248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3aa021fb-1100-433e-a900-2773bef43c6b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:40.085907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3aa021fb-1100-433e-a900-2773bef43c6b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:40.093812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa021fb-1100-433e-a900-2773bef43c6b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:40.094389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa021fb-1100-433e-a900-2773bef43c6b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:40.094804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa021fb-1100-433e-a900-2773bef43c6b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:40.095525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa021fb-1100-433e-a900-2773bef43c6b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:40.096032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa021fb-1100-433e-a900-2773bef43c6b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:40.096495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3aa021fb-1100-433e-a900-2773bef43c6b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:40.131187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3aa021fb-1100-433e-a900-2773bef43c6b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:58:40.212805 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3aa021fb-1100-433e-a900-2773bef43c6b tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 204 len: 0 microversion: 2.1 time: 0.135823 Aug 25 13:58:40.213733 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3141/6350] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:58:40 2022] DELETE /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:58:40.225248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-55645e17-b4e7-4d87-b5f1-961c404e28d1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:40.225969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-55645e17-b4e7-4d87-b5f1-961c404e28d1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:40.232286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55645e17-b4e7-4d87-b5f1-961c404e28d1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:40.232768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55645e17-b4e7-4d87-b5f1-961c404e28d1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:40.233583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55645e17-b4e7-4d87-b5f1-961c404e28d1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:40.233926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55645e17-b4e7-4d87-b5f1-961c404e28d1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:40.234376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55645e17-b4e7-4d87-b5f1-961c404e28d1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:40.234798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-55645e17-b4e7-4d87-b5f1-961c404e28d1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:40.372681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-55645e17-b4e7-4d87-b5f1-961c404e28d1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:40.381660 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-55645e17-b4e7-4d87-b5f1-961c404e28d1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1515 microversion: 2.1 time: 0.162270 Aug 25 13:58:40.382241 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3210/6351] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:40 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:41.403982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4702d47-e4c5-4f47-a9c0-28139dec6542 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:41.404690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4702d47-e4c5-4f47-a9c0-28139dec6542 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:41.411909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4702d47-e4c5-4f47-a9c0-28139dec6542 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:41.412420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4702d47-e4c5-4f47-a9c0-28139dec6542 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:41.412881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4702d47-e4c5-4f47-a9c0-28139dec6542 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:41.413665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4702d47-e4c5-4f47-a9c0-28139dec6542 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:41.414279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4702d47-e4c5-4f47-a9c0-28139dec6542 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:41.414612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4702d47-e4c5-4f47-a9c0-28139dec6542 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:41.565832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d4702d47-e4c5-4f47-a9c0-28139dec6542 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:41.573897 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4702d47-e4c5-4f47-a9c0-28139dec6542 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1515 microversion: 2.1 time: 0.174223 Aug 25 13:58:41.574513 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3142/6352] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:41 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:42.599177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-968adb58-c024-422c-8635-c39ce717dff1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:42.600216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-968adb58-c024-422c-8635-c39ce717dff1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:42.610584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968adb58-c024-422c-8635-c39ce717dff1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:42.611662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968adb58-c024-422c-8635-c39ce717dff1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:42.612051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968adb58-c024-422c-8635-c39ce717dff1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:42.613206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968adb58-c024-422c-8635-c39ce717dff1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:42.613847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968adb58-c024-422c-8635-c39ce717dff1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:42.614336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-968adb58-c024-422c-8635-c39ce717dff1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:42.690366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-968adb58-c024-422c-8635-c39ce717dff1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:42.705951 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-968adb58-c024-422c-8635-c39ce717dff1 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 200 len: 1473 microversion: 2.1 time: 0.112504 Aug 25 13:58:42.717545 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3211/6353] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:42 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 1473 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:42.770245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-65e42ccd-05fd-4744-b6d1-e1e6cba01a71 req-ec6d35ef-ca6b-43de-b245-256623639ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca53cfc1-6d39-422a-97ff-23863446350b", "name": "network-vif-deleted", "tag": "356d537b-add8-4e15-bed0-1e67b8f257e6"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:42.781061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-65e42ccd-05fd-4744-b6d1-e1e6cba01a71 req-ec6d35ef-ca6b-43de-b245-256623639ef5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:42.781571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-65e42ccd-05fd-4744-b6d1-e1e6cba01a71 req-ec6d35ef-ca6b-43de-b245-256623639ef5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:42.782023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-65e42ccd-05fd-4744-b6d1-e1e6cba01a71 req-ec6d35ef-ca6b-43de-b245-256623639ef5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:42.794537 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-65e42ccd-05fd-4744-b6d1-e1e6cba01a71 req-ec6d35ef-ca6b-43de-b245-256623639ef5 service nova] Creating event network-vif-deleted:356d537b-add8-4e15-bed0-1e67b8f257e6 for instance ca53cfc1-6d39-422a-97ff-23863446350b on n-h1-852771-8 Aug 25 13:58:42.800691 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-65e42ccd-05fd-4744-b6d1-e1e6cba01a71 req-ec6d35ef-ca6b-43de-b245-256623639ef5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035101 Aug 25 13:58:42.801569 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3143/6354] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:43.728497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:43.729130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: ca53cfc1-6d39-422a-97ff-23863446350b] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:43.736703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:43.737454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:43.737934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:43.738666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:43.739129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:43.739569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:43.754978 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] HTTP exception thrown: Instance ca53cfc1-6d39-422a-97ff-23863446350b could not be found. Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Request method failure captured: Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b HTTP/1.1 Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3-PdGpdXRcQzdeB1gguxzexdi5wQgLr1WXpGO-eYpNU45T5do8f23RMHFpIMB-9zlxabbZHzQtjfJ8D3NoSahjZC_3FJJ3x6DqYhu8gHJD-xvZqFI-apINL3t98iyGJkFPRkYSNbQ-_8XLdFCHznOH-lTdC53o0glcSlM5VjK9CBDg Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: eb5fe49d1ee84611aeb5f91c5994b199 Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1103284307 Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eb5fe49d1ee84611aeb5f91c5994b199"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eb5fe49d1ee84611aeb5f91c5994b199", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eb5fe49d1ee84611aeb5f91c5994b199"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eb5fe49d1ee84611aeb5f91c5994b199"}]}] Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesSnapshotTestJSON-1103284307 Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: eb5fe49d1ee84611aeb5f91c5994b199 Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1103284307 Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesSnapshotTestJSON-1103284307-project Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 62e98d7da5234aca8aac0f5c54acb614 Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesSnapshotTestJSON-1103284307-project Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance ca53cfc1-6d39-422a-97ff-23863446350b could not be found. Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'ca53cfc1-6d39-422a-97ff-23863446350b'} Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca53cfc1-6d39-422a-97ff-23863446350b could not be found. Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca53cfc1-6d39-422a-97ff-23863446350b could not be found. Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:43.756671 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:58:43.761042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:43.761042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:58:43.761042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:58:43.761042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:58:43.761042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:58:43.761042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca53cfc1-6d39-422a-97ff-23863446350b could not be found. Aug 25 13:58:43.761042 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:58:43.761042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Returning 404 to user: Instance ca53cfc1-6d39-422a-97ff-23863446350b could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:58:43.761042 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ca47c150-bb6e-475c-96d3-4e2f137140ba tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b" status: 404 len: 111 microversion: 2.1 time: 0.033660 Aug 25 13:58:43.761042 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3212/6355] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:43 2022] GET /compute/v2.1/servers/ca53cfc1-6d39-422a-97ff-23863446350b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:58:50.666505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-799907989", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "d7bf192b-9718-4f87-a983-3edb62f2d447"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:50.722218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] validate_networks() for [('d7bf192b-9718-4f87-a983-3edb62f2d447', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:58:51.099008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:58:51.099448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:58:51.099946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:58:51.100372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:58:51.100803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:58:51.110759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:51.111954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:51.112756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:51.114114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:51.116300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:51.116300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:51.137750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Getting quotas for project eb5fe49d1ee84611aeb5f91c5994b199. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:58:51.145265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Getting quotas for user 62e98d7da5234aca8aac0f5c54acb614 and project eb5fe49d1ee84611aeb5f91c5994b199. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:58:51.160387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:58:51.162903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:58:51.215500 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9895f5eb-eb1d-4813-ae53-3dd9f9bc2572 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554284 Aug 25 13:58:51.216177 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3144/6356] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:58:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:58:51.228981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7872af7a-dd82-4e45-97fd-06487d338cbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:51.229635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7872af7a-dd82-4e45-97fd-06487d338cbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:51.289010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7872af7a-dd82-4e45-97fd-06487d338cbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:51.296595 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7872af7a-dd82-4e45-97fd-06487d338cbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1218 microversion: 2.1 time: 0.071408 Aug 25 13:58:51.297206 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3213/6357] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:51 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:52.320314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a319d3a2-2e83-4399-89f5-6daf512a87ee tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:52.321001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a319d3a2-2e83-4399-89f5-6daf512a87ee tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:52.328677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a319d3a2-2e83-4399-89f5-6daf512a87ee tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:52.329225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a319d3a2-2e83-4399-89f5-6daf512a87ee tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:52.330320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a319d3a2-2e83-4399-89f5-6daf512a87ee tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:52.331083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a319d3a2-2e83-4399-89f5-6daf512a87ee tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:52.331737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a319d3a2-2e83-4399-89f5-6daf512a87ee tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:52.332190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a319d3a2-2e83-4399-89f5-6daf512a87ee tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:52.404823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a319d3a2-2e83-4399-89f5-6daf512a87ee tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:52.413729 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a319d3a2-2e83-4399-89f5-6daf512a87ee tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1278 microversion: 2.1 time: 0.099406 Aug 25 13:58:52.414390 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3145/6358] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:52 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1278 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:53.436806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f0226a72-50ba-4eba-acc9-ff9b68d436b6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:53.437795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f0226a72-50ba-4eba-acc9-ff9b68d436b6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:53.447645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0226a72-50ba-4eba-acc9-ff9b68d436b6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:53.448458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0226a72-50ba-4eba-acc9-ff9b68d436b6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:53.448607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0226a72-50ba-4eba-acc9-ff9b68d436b6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:53.449330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0226a72-50ba-4eba-acc9-ff9b68d436b6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:53.449824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0226a72-50ba-4eba-acc9-ff9b68d436b6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:53.450260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0226a72-50ba-4eba-acc9-ff9b68d436b6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:53.613290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f0226a72-50ba-4eba-acc9-ff9b68d436b6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:53.622133 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f0226a72-50ba-4eba-acc9-ff9b68d436b6 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1318 microversion: 2.1 time: 0.189730 Aug 25 13:58:53.622647 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3214/6359] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:53 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:58:54.223572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-91909e47-f72d-4fef-ae32-cd98d3bf6ac1 req-8377339e-1aa0-4575-a62c-8ae4c52483c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb1060ea-5616-4287-8b49-ff36fa85a1b2", "tag": "3b228304-36c1-495f-b6a0-625485e7abd0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:54.236813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-91909e47-f72d-4fef-ae32-cd98d3bf6ac1 req-8377339e-1aa0-4575-a62c-8ae4c52483c9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:54.237678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-91909e47-f72d-4fef-ae32-cd98d3bf6ac1 req-8377339e-1aa0-4575-a62c-8ae4c52483c9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:54.238581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-91909e47-f72d-4fef-ae32-cd98d3bf6ac1 req-8377339e-1aa0-4575-a62c-8ae4c52483c9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:54.252730 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-91909e47-f72d-4fef-ae32-cd98d3bf6ac1 req-8377339e-1aa0-4575-a62c-8ae4c52483c9 service nova] Creating event network-changed:3b228304-36c1-495f-b6a0-625485e7abd0 for instance bb1060ea-5616-4287-8b49-ff36fa85a1b2 on n-h1-852771-8 Aug 25 13:58:54.260570 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-91909e47-f72d-4fef-ae32-cd98d3bf6ac1 req-8377339e-1aa0-4575-a62c-8ae4c52483c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041273 Aug 25 13:58:54.262037 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3146/6360] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:54.662151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d644e3f1-51aa-48ef-9f18-86f5c8d8f0ed tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:54.664486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d644e3f1-51aa-48ef-9f18-86f5c8d8f0ed tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:54.678977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d644e3f1-51aa-48ef-9f18-86f5c8d8f0ed tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:54.679867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d644e3f1-51aa-48ef-9f18-86f5c8d8f0ed tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:54.680693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d644e3f1-51aa-48ef-9f18-86f5c8d8f0ed tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:54.682090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d644e3f1-51aa-48ef-9f18-86f5c8d8f0ed tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:54.682941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d644e3f1-51aa-48ef-9f18-86f5c8d8f0ed tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:54.683746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d644e3f1-51aa-48ef-9f18-86f5c8d8f0ed tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:54.886179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d644e3f1-51aa-48ef-9f18-86f5c8d8f0ed tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:54.902075 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d644e3f1-51aa-48ef-9f18-86f5c8d8f0ed tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1318 microversion: 2.1 time: 0.247853 Aug 25 13:58:54.903022 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3215/6361] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:54 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:55.926305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-913dcd70-1766-41aa-afa9-97039595d787 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:55.926924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-913dcd70-1766-41aa-afa9-97039595d787 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:55.933965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-913dcd70-1766-41aa-afa9-97039595d787 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:55.934466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-913dcd70-1766-41aa-afa9-97039595d787 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:55.934917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-913dcd70-1766-41aa-afa9-97039595d787 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:55.935646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-913dcd70-1766-41aa-afa9-97039595d787 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:55.936108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-913dcd70-1766-41aa-afa9-97039595d787 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:55.936614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-913dcd70-1766-41aa-afa9-97039595d787 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:56.105495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-913dcd70-1766-41aa-afa9-97039595d787 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:56.113671 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-913dcd70-1766-41aa-afa9-97039595d787 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1318 microversion: 2.1 time: 0.192838 Aug 25 13:58:56.114263 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3147/6362] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:55 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:58:57.137901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4e12b49-d6cf-4fcd-8ec4-3847fa22abbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:57.138527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e4e12b49-d6cf-4fcd-8ec4-3847fa22abbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:57.147822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4e12b49-d6cf-4fcd-8ec4-3847fa22abbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:57.148339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4e12b49-d6cf-4fcd-8ec4-3847fa22abbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:57.148788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4e12b49-d6cf-4fcd-8ec4-3847fa22abbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:57.149563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4e12b49-d6cf-4fcd-8ec4-3847fa22abbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:57.150035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4e12b49-d6cf-4fcd-8ec4-3847fa22abbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:57.150472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4e12b49-d6cf-4fcd-8ec4-3847fa22abbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:57.374254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e4e12b49-d6cf-4fcd-8ec4-3847fa22abbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:57.386107 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e4e12b49-d6cf-4fcd-8ec4-3847fa22abbc tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1318 microversion: 2.1 time: 0.252334 Aug 25 13:58:57.386624 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3216/6363] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:57 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:58.408198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b979d33e-da68-48a7-ab94-85befc19bcf3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:58.408949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b979d33e-da68-48a7-ab94-85befc19bcf3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:58.418000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b979d33e-da68-48a7-ab94-85befc19bcf3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:58.418481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b979d33e-da68-48a7-ab94-85befc19bcf3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:58.418951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b979d33e-da68-48a7-ab94-85befc19bcf3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:58.419717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b979d33e-da68-48a7-ab94-85befc19bcf3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:58.420889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b979d33e-da68-48a7-ab94-85befc19bcf3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:58.420889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b979d33e-da68-48a7-ab94-85befc19bcf3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:58.582454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b979d33e-da68-48a7-ab94-85befc19bcf3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:58.592303 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b979d33e-da68-48a7-ab94-85befc19bcf3 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1318 microversion: 2.1 time: 0.188031 Aug 25 13:58:58.593134 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3148/6364] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:58 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:58:58.744293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f0b6e6b5-b1ec-4a09-bee8-68234ba0fe8f req-5a04198a-6975-464c-acc0-2f011888ab0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1060ea-5616-4287-8b49-ff36fa85a1b2", "name": "network-vif-plugged", "status": "completed", "tag": "3b228304-36c1-495f-b6a0-625485e7abd0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:58.760710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f0b6e6b5-b1ec-4a09-bee8-68234ba0fe8f req-5a04198a-6975-464c-acc0-2f011888ab0b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:58.762106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f0b6e6b5-b1ec-4a09-bee8-68234ba0fe8f req-5a04198a-6975-464c-acc0-2f011888ab0b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:58.762915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f0b6e6b5-b1ec-4a09-bee8-68234ba0fe8f req-5a04198a-6975-464c-acc0-2f011888ab0b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:58.787659 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f0b6e6b5-b1ec-4a09-bee8-68234ba0fe8f req-5a04198a-6975-464c-acc0-2f011888ab0b service nova] Creating event network-vif-plugged:3b228304-36c1-495f-b6a0-625485e7abd0 for instance bb1060ea-5616-4287-8b49-ff36fa85a1b2 on n-h1-852771-8 Aug 25 13:58:58.796892 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f0b6e6b5-b1ec-4a09-bee8-68234ba0fe8f req-5a04198a-6975-464c-acc0-2f011888ab0b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057543 Aug 25 13:58:58.798025 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3217/6365] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:59.630969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-17fe948d-ec03-4686-8bc9-15a1d5842f71 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:59.631821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-17fe948d-ec03-4686-8bc9-15a1d5842f71 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:59.639147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17fe948d-ec03-4686-8bc9-15a1d5842f71 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:59.639714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17fe948d-ec03-4686-8bc9-15a1d5842f71 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:59.640214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17fe948d-ec03-4686-8bc9-15a1d5842f71 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:59.641066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17fe948d-ec03-4686-8bc9-15a1d5842f71 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:59.641680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17fe948d-ec03-4686-8bc9-15a1d5842f71 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:59.642277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-17fe948d-ec03-4686-8bc9-15a1d5842f71 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:59.804880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-17fe948d-ec03-4686-8bc9-15a1d5842f71 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:59.816173 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-17fe948d-ec03-4686-8bc9-15a1d5842f71 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1318 microversion: 2.1 time: 0.190386 Aug 25 13:58:59.816173 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3149/6366] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:59 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:00.841320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8682711e-7749-4288-949c-a919d9364460 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:00.842078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8682711e-7749-4288-949c-a919d9364460 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:00.850476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8682711e-7749-4288-949c-a919d9364460 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:00.850945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8682711e-7749-4288-949c-a919d9364460 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:00.851382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8682711e-7749-4288-949c-a919d9364460 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:00.852098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8682711e-7749-4288-949c-a919d9364460 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:00.852549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8682711e-7749-4288-949c-a919d9364460 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:00.852970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8682711e-7749-4288-949c-a919d9364460 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:01.018138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8682711e-7749-4288-949c-a919d9364460 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:01.026750 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8682711e-7749-4288-949c-a919d9364460 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1508 microversion: 2.1 time: 0.190747 Aug 25 13:59:01.027361 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3218/6367] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:00 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:01.049530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-24cfa1c0-c762-4317-843e-32efae05a51e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eed5a24c-c5f9-4db1-a755-fe20c646657a", "device": "/dev/sdb"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:01.052104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-24cfa1c0-c762-4317-843e-32efae05a51e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:01.059787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24cfa1c0-c762-4317-843e-32efae05a51e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:01.060219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24cfa1c0-c762-4317-843e-32efae05a51e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:01.060685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24cfa1c0-c762-4317-843e-32efae05a51e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:01.061432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24cfa1c0-c762-4317-843e-32efae05a51e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:01.061950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24cfa1c0-c762-4317-843e-32efae05a51e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:01.062397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-24cfa1c0-c762-4317-843e-32efae05a51e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:01.125284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:01.157289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:01.369978 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-24cfa1c0-c762-4317-843e-32efae05a51e tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "POST /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324733 Aug 25 13:59:01.370812 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3150/6368] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 13:59:01 2022] POST /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:59:24.213766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f8dc129-723c-4eb0-aed6-c6560b6beb99 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:24.214648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3f8dc129-723c-4eb0-aed6-c6560b6beb99 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:24.218773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:24.220380 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:59:24.220573 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 13:59:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2/os-volume_attachments/eed5a24c-c5f9-4db1-a755-fe20c646657a (ip 10.222.0.70) !!! Aug 25 13:59:24.223549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=22 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:24.224764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:24.239299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f8dc129-723c-4eb0-aed6-c6560b6beb99 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:24.240185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f8dc129-723c-4eb0-aed6-c6560b6beb99 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:24.240712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f8dc129-723c-4eb0-aed6-c6560b6beb99 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:24.241631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f8dc129-723c-4eb0-aed6-c6560b6beb99 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:24.241992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f8dc129-723c-4eb0-aed6-c6560b6beb99 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:24.242419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f8dc129-723c-4eb0-aed6-c6560b6beb99 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:24.346991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-3f8dc129-723c-4eb0-aed6-c6560b6beb99 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lazy-loading 'services' on Instance uuid bb1060ea-5616-4287-8b49-ff36fa85a1b2 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:59:24.428579 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f8dc129-723c-4eb0-aed6-c6560b6beb99 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2/os-volume_attachments/eed5a24c-c5f9-4db1-a755-fe20c646657a" status: 202 len: 0 microversion: 2.1 time: 0.223142 Aug 25 13:59:24.429201 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3219/6369] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 13:59:24 2022] DELETE /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2/os-volume_attachments/eed5a24c-c5f9-4db1-a755-fe20c646657a => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:59:29.977040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9b6f242c-6722-42b5-a9e1-7880192e79ac tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:29.977877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9b6f242c-6722-42b5-a9e1-7880192e79ac tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:29.981597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:29.982577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:29.990348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6f242c-6722-42b5-a9e1-7880192e79ac tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:29.991000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6f242c-6722-42b5-a9e1-7880192e79ac tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:29.991541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6f242c-6722-42b5-a9e1-7880192e79ac tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:29.992309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6f242c-6722-42b5-a9e1-7880192e79ac tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:29.992793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6f242c-6722-42b5-a9e1-7880192e79ac tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:29.993250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6f242c-6722-42b5-a9e1-7880192e79ac tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:30.025277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9b6f242c-6722-42b5-a9e1-7880192e79ac tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:59:30.141832 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9b6f242c-6722-42b5-a9e1-7880192e79ac tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 204 len: 0 microversion: 2.1 time: 0.170131 Aug 25 13:59:30.142905 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3151/6370] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:59:29 2022] DELETE /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:59:30.160240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62d6804e-1f56-4850-82d3-1d8230071e11 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:30.161518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-62d6804e-1f56-4850-82d3-1d8230071e11 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:30.174396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62d6804e-1f56-4850-82d3-1d8230071e11 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:30.175086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62d6804e-1f56-4850-82d3-1d8230071e11 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:30.175617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62d6804e-1f56-4850-82d3-1d8230071e11 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:30.177259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62d6804e-1f56-4850-82d3-1d8230071e11 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:30.178058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62d6804e-1f56-4850-82d3-1d8230071e11 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:30.178819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62d6804e-1f56-4850-82d3-1d8230071e11 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:30.400597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62d6804e-1f56-4850-82d3-1d8230071e11 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:30.414107 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-62d6804e-1f56-4850-82d3-1d8230071e11 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1514 microversion: 2.1 time: 0.261411 Aug 25 13:59:30.416083 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3220/6371] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:30 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:31.443952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-414569f4-8061-4a13-96f0-6b1874c31d37 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:31.445443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-414569f4-8061-4a13-96f0-6b1874c31d37 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:31.459430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-414569f4-8061-4a13-96f0-6b1874c31d37 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:31.460317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-414569f4-8061-4a13-96f0-6b1874c31d37 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:31.461163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-414569f4-8061-4a13-96f0-6b1874c31d37 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:31.462524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-414569f4-8061-4a13-96f0-6b1874c31d37 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:31.463387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-414569f4-8061-4a13-96f0-6b1874c31d37 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:31.464232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-414569f4-8061-4a13-96f0-6b1874c31d37 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:31.763041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-414569f4-8061-4a13-96f0-6b1874c31d37 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:31.772162 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-414569f4-8061-4a13-96f0-6b1874c31d37 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1514 microversion: 2.1 time: 0.337048 Aug 25 13:59:31.772880 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3152/6372] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:31 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:32.532546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d9eca9ad-0f1c-4a1a-965a-3397f9a81dd4 req-d5a3a099-9be6-4934-982f-57220564124a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1060ea-5616-4287-8b49-ff36fa85a1b2", "name": "network-vif-deleted", "tag": "3b228304-36c1-495f-b6a0-625485e7abd0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:32.546280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d9eca9ad-0f1c-4a1a-965a-3397f9a81dd4 req-d5a3a099-9be6-4934-982f-57220564124a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:32.546790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d9eca9ad-0f1c-4a1a-965a-3397f9a81dd4 req-d5a3a099-9be6-4934-982f-57220564124a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:32.547340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d9eca9ad-0f1c-4a1a-965a-3397f9a81dd4 req-d5a3a099-9be6-4934-982f-57220564124a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:32.584446 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d9eca9ad-0f1c-4a1a-965a-3397f9a81dd4 req-d5a3a099-9be6-4934-982f-57220564124a service nova] Creating event network-vif-deleted:3b228304-36c1-495f-b6a0-625485e7abd0 for instance bb1060ea-5616-4287-8b49-ff36fa85a1b2 on n-h1-852771-8 Aug 25 13:59:32.593651 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d9eca9ad-0f1c-4a1a-965a-3397f9a81dd4 req-d5a3a099-9be6-4934-982f-57220564124a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065555 Aug 25 13:59:32.594633 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3221/6373] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:59:32.806196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:32.806879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:32.814235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:32.815583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:32.816136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:32.817281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:32.818490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:32.818695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:32.856224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:32.856635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:32.857096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:32.857603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lazy-loading 'fault' on Instance uuid bb1060ea-5616-4287-8b49-ff36fa85a1b2 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:59:32.903693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e98d7da5234aca8aac0f5c54acb614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5fe49d1ee84611aeb5f91c5994b199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:32.913819 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c6b4f53b-ae88-4b2a-b903-09b1ffd4f89f tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 200 len: 1308 microversion: 2.1 time: 0.111732 Aug 25 13:59:32.914606 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3153/6374] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:32 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:33.943524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:33.944248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] [instance: bb1060ea-5616-4287-8b49-ff36fa85a1b2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:33.953480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:33.954637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:33.955055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:33.956914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:33.957731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:33.958468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:33.980369 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] HTTP exception thrown: Instance bb1060ea-5616-4287-8b49-ff36fa85a1b2 could not be found. Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Request method failure captured: Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 HTTP/1.1 Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB3-PdGpdXRcQzdeB1gguxzexdi5wQgLr1WXpGO-eYpNU45T5do8f23RMHFpIMB-9zlxabbZHzQtjfJ8D3NoSahjZC_3FJJ3x6DqYhu8gHJD-xvZqFI-apINL3t98iyGJkFPRkYSNbQ-_8XLdFCHznOH-lTdC53o0glcSlM5VjK9CBDg Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: eb5fe49d1ee84611aeb5f91c5994b199 Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1103284307 Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eb5fe49d1ee84611aeb5f91c5994b199"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eb5fe49d1ee84611aeb5f91c5994b199", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eb5fe49d1ee84611aeb5f91c5994b199"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eb5fe49d1ee84611aeb5f91c5994b199"}]}] Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-VolumesSnapshotTestJSON-1103284307 Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: eb5fe49d1ee84611aeb5f91c5994b199 Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1103284307 Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-VolumesSnapshotTestJSON-1103284307-project Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 62e98d7da5234aca8aac0f5c54acb614 Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-VolumesSnapshotTestJSON-1103284307-project Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance bb1060ea-5616-4287-8b49-ff36fa85a1b2 could not be found. Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'bb1060ea-5616-4287-8b49-ff36fa85a1b2'} Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1060ea-5616-4287-8b49-ff36fa85a1b2 could not be found. Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1060ea-5616-4287-8b49-ff36fa85a1b2 could not be found. Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:33.982339 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:59:33.986084 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:33.986084 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:33.986084 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:33.986084 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:59:33.986084 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:59:33.986084 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1060ea-5616-4287-8b49-ff36fa85a1b2 could not be found. Aug 25 13:59:33.986084 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:59:33.986084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] Returning 404 to user: Instance bb1060ea-5616-4287-8b49-ff36fa85a1b2 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:59:33.986084 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-174c658d-817e-416e-a843-6076564723e2 tempest-VolumesSnapshotTestJSON-1103284307 tempest-VolumesSnapshotTestJSON-1103284307-project] 10.222.0.70 "GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2" status: 404 len: 111 microversion: 2.1 time: 0.048883 Aug 25 13:59:33.986084 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3222/6375] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:33 2022] GET /compute/v2.1/servers/bb1060ea-5616-4287-8b49-ff36fa85a1b2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:59:40.432256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-227382402", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1200164785", "security_groups": [{"name": "tempest-secgroup-smoke-1252652195"}], "block_device_mapping_v2": [{"uuid": "22fefcbd-89e2-45e5-9cd7-f61820e907ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9216295-ead7-4063-84e8-342351244740"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:40.575987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] validate_networks() for [('f9216295-ead7-4063-84e8-342351244740', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:59:41.045350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:59:41.045875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:59:41.046374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:59:41.047025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:59:41.047497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:59:41.057570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:41.058072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:41.058525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:41.059272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:41.059766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:41.060365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:41.079921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:59:41.087042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Getting quotas for user 93fbad0b63d14f3fb12de08d966bffad and project 0815a3fec62b4d2d9d5a07275770603a. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:59:41.150249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:59:41.152355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22fefcbd-89e2-45e5-9cd7-f61820e907ab',volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:59:41.308163 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-56f7e9f8-905e-41ba-b4c9-3e9401403579 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.883012 Aug 25 13:59:41.314644 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3154/6376] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 13:59:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:59:41.320826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7cd99792-bdc6-41a2-820b-ff066135daa2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:41.321628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7cd99792-bdc6-41a2-820b-ff066135daa2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:41.386951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7cd99792-bdc6-41a2-820b-ff066135daa2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:41.396400 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7cd99792-bdc6-41a2-820b-ff066135daa2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1094 microversion: 2.1 time: 0.079861 Aug 25 13:59:41.397993 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3223/6377] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:41 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:42.426061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8c32b2ce-6b08-4190-b93e-8b3504003cac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:42.427668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8c32b2ce-6b08-4190-b93e-8b3504003cac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:42.436270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c32b2ce-6b08-4190-b93e-8b3504003cac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:42.437259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c32b2ce-6b08-4190-b93e-8b3504003cac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:42.438576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c32b2ce-6b08-4190-b93e-8b3504003cac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:42.439582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c32b2ce-6b08-4190-b93e-8b3504003cac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:42.440528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c32b2ce-6b08-4190-b93e-8b3504003cac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:42.441192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8c32b2ce-6b08-4190-b93e-8b3504003cac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:42.528781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8c32b2ce-6b08-4190-b93e-8b3504003cac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:42.542688 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8c32b2ce-6b08-4190-b93e-8b3504003cac tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1200 microversion: 2.1 time: 0.122575 Aug 25 13:59:42.553631 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3155/6378] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:42 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1200 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:43.567312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d15ce26d-2d61-41c4-96c2-d82eb7d3c94e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:43.569193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d15ce26d-2d61-41c4-96c2-d82eb7d3c94e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:43.582731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d15ce26d-2d61-41c4-96c2-d82eb7d3c94e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:43.583532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d15ce26d-2d61-41c4-96c2-d82eb7d3c94e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:43.584268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d15ce26d-2d61-41c4-96c2-d82eb7d3c94e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:43.585381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d15ce26d-2d61-41c4-96c2-d82eb7d3c94e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:43.586098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d15ce26d-2d61-41c4-96c2-d82eb7d3c94e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:43.586696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d15ce26d-2d61-41c4-96c2-d82eb7d3c94e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:43.783836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a785f7df-179c-4908-8085-fcf3d8dff69e tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:43.785022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a785f7df-179c-4908-8085-fcf3d8dff69e tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:43.793791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a785f7df-179c-4908-8085-fcf3d8dff69e tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:43.794574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a785f7df-179c-4908-8085-fcf3d8dff69e tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:43.795236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a785f7df-179c-4908-8085-fcf3d8dff69e tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:43.796180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a785f7df-179c-4908-8085-fcf3d8dff69e tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:43.796876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a785f7df-179c-4908-8085-fcf3d8dff69e tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:43.797875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a785f7df-179c-4908-8085-fcf3d8dff69e tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:43.831202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a785f7df-179c-4908-8085-fcf3d8dff69e tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:59:43.987592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d15ce26d-2d61-41c4-96c2-d82eb7d3c94e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:44.000459 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d15ce26d-2d61-41c4-96c2-d82eb7d3c94e tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1278 microversion: 2.1 time: 0.439294 Aug 25 13:59:44.001630 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3156/6379] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:43 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1278 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:44.004004 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a785f7df-179c-4908-8085-fcf3d8dff69e tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 204 len: 0 microversion: 2.1 time: 0.490944 Aug 25 13:59:44.006079 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3224/6380] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:59:43 2022] DELETE /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:59:44.019929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d2a5274f-490a-444c-8dae-434ef9a5d573 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:44.020817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d2a5274f-490a-444c-8dae-434ef9a5d573 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:44.029296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2a5274f-490a-444c-8dae-434ef9a5d573 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:44.029862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2a5274f-490a-444c-8dae-434ef9a5d573 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:44.030316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2a5274f-490a-444c-8dae-434ef9a5d573 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:44.031038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2a5274f-490a-444c-8dae-434ef9a5d573 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:44.031668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2a5274f-490a-444c-8dae-434ef9a5d573 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:44.032326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d2a5274f-490a-444c-8dae-434ef9a5d573 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:44.302403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d2a5274f-490a-444c-8dae-434ef9a5d573 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:44.312716 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d2a5274f-490a-444c-8dae-434ef9a5d573 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1733 microversion: 2.1 time: 0.298047 Aug 25 13:59:44.313690 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3157/6381] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:44 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1733 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:44.648491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-fc0a32ad-5b9d-4c0b-aa41-4d35507de65e req-7b8ae167-0b4b-4c97-b446-dda3e8393d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b19c97f-419e-4a55-bc66-fb2b8acaec41", "tag": "8fcfe320-ddb8-4231-92f3-6738c9c43625"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:44.679748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fc0a32ad-5b9d-4c0b-aa41-4d35507de65e req-7b8ae167-0b4b-4c97-b446-dda3e8393d14 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:44.681084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fc0a32ad-5b9d-4c0b-aa41-4d35507de65e req-7b8ae167-0b4b-4c97-b446-dda3e8393d14 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:44.681904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fc0a32ad-5b9d-4c0b-aa41-4d35507de65e req-7b8ae167-0b4b-4c97-b446-dda3e8393d14 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:44.708179 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-fc0a32ad-5b9d-4c0b-aa41-4d35507de65e req-7b8ae167-0b4b-4c97-b446-dda3e8393d14 service nova] Creating event network-changed:8fcfe320-ddb8-4231-92f3-6738c9c43625 for instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 on n-h1-852771-8 Aug 25 13:59:44.714973 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-fc0a32ad-5b9d-4c0b-aa41-4d35507de65e req-7b8ae167-0b4b-4c97-b446-dda3e8393d14 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071760 Aug 25 13:59:44.715810 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3225/6382] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:59:45.025612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f4cf9719-f888-46e0-bd5b-e6da93bb8d5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:45.027013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f4cf9719-f888-46e0-bd5b-e6da93bb8d5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:45.053679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4cf9719-f888-46e0-bd5b-e6da93bb8d5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:45.056200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4cf9719-f888-46e0-bd5b-e6da93bb8d5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:45.058055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4cf9719-f888-46e0-bd5b-e6da93bb8d5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:45.068784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4cf9719-f888-46e0-bd5b-e6da93bb8d5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:45.070174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4cf9719-f888-46e0-bd5b-e6da93bb8d5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:45.071229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4cf9719-f888-46e0-bd5b-e6da93bb8d5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:45.364802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fba861fb-7637-427e-954e-9579a98a1abf tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:45.382336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fba861fb-7637-427e-954e-9579a98a1abf tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:45.389999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fba861fb-7637-427e-954e-9579a98a1abf tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:45.390495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fba861fb-7637-427e-954e-9579a98a1abf tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:45.391263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fba861fb-7637-427e-954e-9579a98a1abf tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:45.392000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fba861fb-7637-427e-954e-9579a98a1abf tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:45.392867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fba861fb-7637-427e-954e-9579a98a1abf tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:45.393485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fba861fb-7637-427e-954e-9579a98a1abf tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:45.608981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f4cf9719-f888-46e0-bd5b-e6da93bb8d5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:45.621776 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f4cf9719-f888-46e0-bd5b-e6da93bb8d5a tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1278 microversion: 2.1 time: 0.601050 Aug 25 13:59:45.630948 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3158/6383] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:45 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1278 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:45.782077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fba861fb-7637-427e-954e-9579a98a1abf tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:45.820416 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fba861fb-7637-427e-954e-9579a98a1abf tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1733 microversion: 2.1 time: 0.488484 Aug 25 13:59:45.821057 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3226/6384] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:45 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1733 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:46.653722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9b6df668-6a85-4670-b0fe-ebe5449da75f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:46.655462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9b6df668-6a85-4670-b0fe-ebe5449da75f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:46.667838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6df668-6a85-4670-b0fe-ebe5449da75f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:46.677047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6df668-6a85-4670-b0fe-ebe5449da75f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:46.678678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6df668-6a85-4670-b0fe-ebe5449da75f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:46.680041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6df668-6a85-4670-b0fe-ebe5449da75f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:46.683143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6df668-6a85-4670-b0fe-ebe5449da75f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:46.686340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b6df668-6a85-4670-b0fe-ebe5449da75f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:46.848350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc7fb591-09b8-4e7a-b3e5-3ed79b715bd2 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:46.849152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc7fb591-09b8-4e7a-b3e5-3ed79b715bd2 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:46.866232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc7fb591-09b8-4e7a-b3e5-3ed79b715bd2 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:46.867391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc7fb591-09b8-4e7a-b3e5-3ed79b715bd2 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:46.868051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc7fb591-09b8-4e7a-b3e5-3ed79b715bd2 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:46.869351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc7fb591-09b8-4e7a-b3e5-3ed79b715bd2 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:46.870059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc7fb591-09b8-4e7a-b3e5-3ed79b715bd2 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:46.870729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc7fb591-09b8-4e7a-b3e5-3ed79b715bd2 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:46.977182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc7fb591-09b8-4e7a-b3e5-3ed79b715bd2 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:46.990699 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc7fb591-09b8-4e7a-b3e5-3ed79b715bd2 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1665 microversion: 2.1 time: 0.147189 Aug 25 13:59:46.992268 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3227/6385] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:46 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:47.096874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9b6df668-6a85-4670-b0fe-ebe5449da75f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:47.129240 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9b6df668-6a85-4670-b0fe-ebe5449da75f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1278 microversion: 2.1 time: 0.479422 Aug 25 13:59:47.130275 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3159/6386] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:46 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1278 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:47.912155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-88f20b81-3797-4c81-a486-b8d4ff1a6bec req-07466de2-f247-4b5b-87bd-6a2db4cb7bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a000574e-1bee-4c31-94d8-8354f189e716", "name": "network-vif-deleted", "tag": "e7e5e1aa-3d12-4e36-b83f-342b73aefc9f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:47.933397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-88f20b81-3797-4c81-a486-b8d4ff1a6bec req-07466de2-f247-4b5b-87bd-6a2db4cb7bc7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.934452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-88f20b81-3797-4c81-a486-b8d4ff1a6bec req-07466de2-f247-4b5b-87bd-6a2db4cb7bc7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.935049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-88f20b81-3797-4c81-a486-b8d4ff1a6bec req-07466de2-f247-4b5b-87bd-6a2db4cb7bc7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:47.958984 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-88f20b81-3797-4c81-a486-b8d4ff1a6bec req-07466de2-f247-4b5b-87bd-6a2db4cb7bc7 service nova] Creating event network-vif-deleted:e7e5e1aa-3d12-4e36-b83f-342b73aefc9f for instance a000574e-1bee-4c31-94d8-8354f189e716 on n-h2-852771-8 Aug 25 13:59:47.967057 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-88f20b81-3797-4c81-a486-b8d4ff1a6bec req-07466de2-f247-4b5b-87bd-6a2db4cb7bc7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059430 Aug 25 13:59:47.967740 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3228/6387] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 13:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:59:48.020612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-69f10754-9c6b-40b3-ad80-17fc99769115 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:48.021395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-69f10754-9c6b-40b3-ad80-17fc99769115 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:48.039643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69f10754-9c6b-40b3-ad80-17fc99769115 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:48.043050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69f10754-9c6b-40b3-ad80-17fc99769115 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:48.044664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69f10754-9c6b-40b3-ad80-17fc99769115 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:48.049231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69f10754-9c6b-40b3-ad80-17fc99769115 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:48.053628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69f10754-9c6b-40b3-ad80-17fc99769115 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:48.054414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-69f10754-9c6b-40b3-ad80-17fc99769115 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:48.158582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-72b51533-3593-4f14-a0d9-4d509d431403 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:48.159548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-72b51533-3593-4f14-a0d9-4d509d431403 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:48.175988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72b51533-3593-4f14-a0d9-4d509d431403 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:48.176495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72b51533-3593-4f14-a0d9-4d509d431403 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:48.176942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72b51533-3593-4f14-a0d9-4d509d431403 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:48.178048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72b51533-3593-4f14-a0d9-4d509d431403 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:48.178534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72b51533-3593-4f14-a0d9-4d509d431403 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:48.179084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72b51533-3593-4f14-a0d9-4d509d431403 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:48.254893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-69f10754-9c6b-40b3-ad80-17fc99769115 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b50a0040948f9b1f7b2d643d26bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321d4d99f7404bd08e3ccf6ee6fa1ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:48.265750 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-69f10754-9c6b-40b3-ad80-17fc99769115 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 200 len: 1383 microversion: 2.1 time: 0.252269 Aug 25 13:59:48.274356 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3160/6388] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:48 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 1383 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:48.490556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-72b51533-3593-4f14-a0d9-4d509d431403 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:48.524802 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-72b51533-3593-4f14-a0d9-4d509d431403 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1278 microversion: 2.1 time: 0.371199 Aug 25 13:59:48.541546 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3229/6389] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:48 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1278 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:49.290947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:49.292497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:49.302087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:49.302087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:49.302646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:49.305055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:49.305892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:49.306616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:49.335930 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] HTTP exception thrown: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Request method failure captured: Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 HTTP/1.1 Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB37oT68uf0GBWp0nvCEmzVToEgvVPbLuKSFkMfThGG2dVc1HrmrKOuuD7ul-aiHK3RIO4an2WXU_bXBg7wCGpxSs6xOm8gf8Pbvo0Itf81lYLb0oC1ufJvHRP5EC2haSU9rG_X-T4Z-sKkI0m-E5k21mCuutnEv42IVQ98oLqI2FDmQ Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 321d4d99f7404bd08e3ccf6ee6fa1ab4 Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestServerBasicOps-1522890468 Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/321d4d99f7404bd08e3ccf6ee6fa1ab4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_321d4d99f7404bd08e3ccf6ee6fa1ab4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/321d4d99f7404bd08e3ccf6ee6fa1ab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/321d4d99f7404bd08e3ccf6ee6fa1ab4"}]}] Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestServerBasicOps-1522890468 Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 321d4d99f7404bd08e3ccf6ee6fa1ab4 Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestServerBasicOps-1522890468 Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestServerBasicOps-1522890468-project Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b5b50a0040948f9b1f7b2d643d26bcb Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestServerBasicOps-1522890468-project Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'a000574e-1bee-4c31-94d8-8354f189e716'} Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:49.338364 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:59:49.342638 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:49.342638 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:49.342638 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:49.342638 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:59:49.342638 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:59:49.342638 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:49.342638 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:59:49.344195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Returning 404 to user: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:59:49.346677 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b50ee0f5-b17b-4a25-8832-19a9377f508f tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 404 len: 111 microversion: 2.1 time: 0.059279 Aug 25 13:59:49.347919 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3161/6390] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:49 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:59:49.558405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dd9b80da-7866-4b57-b89e-f058d93b1a05 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:49.559101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dd9b80da-7866-4b57-b89e-f058d93b1a05 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:49.574432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9b80da-7866-4b57-b89e-f058d93b1a05 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:49.580320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9b80da-7866-4b57-b89e-f058d93b1a05 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:49.581064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9b80da-7866-4b57-b89e-f058d93b1a05 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:49.581998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9b80da-7866-4b57-b89e-f058d93b1a05 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:49.582573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9b80da-7866-4b57-b89e-f058d93b1a05 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:49.583170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9b80da-7866-4b57-b89e-f058d93b1a05 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:49.944872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dd9b80da-7866-4b57-b89e-f058d93b1a05 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:49.954079 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dd9b80da-7866-4b57-b89e-f058d93b1a05 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1278 microversion: 2.1 time: 0.399784 Aug 25 13:59:49.968658 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3230/6391] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:49 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1278 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:50.175655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:50.176626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:50.188805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:50.188805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:50.190601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:50.192223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:50.193318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:50.193796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:50.219093 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] HTTP exception thrown: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Request method failure captured: Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 HTTP/1.1 Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB37oT68uf0GBWp0nvCEmzVToEgvVPbLuKSFkMfThGG2dVc1HrmrKOuuD7ul-aiHK3RIO4an2WXU_bXBg7wCGpxSs6xOm8gf8Pbvo0Itf81lYLb0oC1ufJvHRP5EC2haSU9rG_X-T4Z-sKkI0m-E5k21mCuutnEv42IVQ98oLqI2FDmQ Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 321d4d99f7404bd08e3ccf6ee6fa1ab4 Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestServerBasicOps-1522890468 Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/321d4d99f7404bd08e3ccf6ee6fa1ab4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_321d4d99f7404bd08e3ccf6ee6fa1ab4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/321d4d99f7404bd08e3ccf6ee6fa1ab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/321d4d99f7404bd08e3ccf6ee6fa1ab4"}]}] Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestServerBasicOps-1522890468 Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 321d4d99f7404bd08e3ccf6ee6fa1ab4 Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestServerBasicOps-1522890468 Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestServerBasicOps-1522890468-project Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 2b5b50a0040948f9b1f7b2d643d26bcb Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestServerBasicOps-1522890468-project Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'a000574e-1bee-4c31-94d8-8354f189e716'} Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:59:50.221310 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Returning 404 to user: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-edc63250-4160-4b77-a07e-eeefc62a3585 tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 404 len: 111 microversion: 2.1 time: 0.054484 Aug 25 13:59:50.228265 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3162/6392] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 13:59:50 2022] DELETE /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:59:50.239070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:50.239916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] [instance: a000574e-1bee-4c31-94d8-8354f189e716] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:50.249238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:50.250215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:50.250838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:50.253655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:50.254307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:50.255324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:50.276143 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] HTTP exception thrown: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Request method failure captured: Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 HTTP/1.1 Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB37oT68uf0GBWp0nvCEmzVToEgvVPbLuKSFkMfThGG2dVc1HrmrKOuuD7ul-aiHK3RIO4an2WXU_bXBg7wCGpxSs6xOm8gf8Pbvo0Itf81lYLb0oC1ufJvHRP5EC2haSU9rG_X-T4Z-sKkI0m-E5k21mCuutnEv42IVQ98oLqI2FDmQ Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 321d4d99f7404bd08e3ccf6ee6fa1ab4 Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestServerBasicOps-1522890468 Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/321d4d99f7404bd08e3ccf6ee6fa1ab4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_321d4d99f7404bd08e3ccf6ee6fa1ab4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/321d4d99f7404bd08e3ccf6ee6fa1ab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/321d4d99f7404bd08e3ccf6ee6fa1ab4"}]}] Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestServerBasicOps-1522890468 Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 321d4d99f7404bd08e3ccf6ee6fa1ab4 Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestServerBasicOps-1522890468 Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestServerBasicOps-1522890468-project Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 2b5b50a0040948f9b1f7b2d643d26bcb Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestServerBasicOps-1522890468-project Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'a000574e-1bee-4c31-94d8-8354f189e716'} Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:50.278840 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:59:50.285906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:50.285906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:50.285906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:50.285906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:59:50.285906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:59:50.285906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. Aug 25 13:59:50.285906 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 13:59:50.285906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Returning 404 to user: Instance a000574e-1bee-4c31-94d8-8354f189e716 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:59:50.285906 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bac13e7a-ea4c-4b95-8db7-5efea5a186cc tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716" status: 404 len: 111 microversion: 2.1 time: 0.051098 Aug 25 13:59:50.285906 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3231/6393] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:50 2022] GET /compute/v2.1/servers/a000574e-1bee-4c31-94d8-8354f189e716 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:59:50.580097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f1fad1e3-7d87-49ee-af43-20b1a6e2024d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] Calling method '.version_select at 0x7f3a2919f0d0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:50.627571 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f1fad1e3-7d87-49ee-af43-20b1a6e2024d tempest-TestServerBasicOps-1522890468 tempest-TestServerBasicOps-1522890468-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1542111758" status: 202 len: 0 microversion: 2.1 time: 0.053514 Aug 25 13:59:50.628485 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3163/6394] 10.222.0.70 () {58 vars in 1254 bytes} [Thu Aug 25 13:59:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1542111758 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:59:50.982164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-49b52430-25db-4fd0-a226-3aff0f4af181 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:50.984431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-49b52430-25db-4fd0-a226-3aff0f4af181 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:50.997918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49b52430-25db-4fd0-a226-3aff0f4af181 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:50.998916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49b52430-25db-4fd0-a226-3aff0f4af181 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:50.999792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49b52430-25db-4fd0-a226-3aff0f4af181 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:51.001111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49b52430-25db-4fd0-a226-3aff0f4af181 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:51.002931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49b52430-25db-4fd0-a226-3aff0f4af181 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:51.003961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49b52430-25db-4fd0-a226-3aff0f4af181 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:51.175062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-49b52430-25db-4fd0-a226-3aff0f4af181 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:51.184864 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-49b52430-25db-4fd0-a226-3aff0f4af181 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1266 microversion: 2.1 time: 0.210810 Aug 25 13:59:51.185450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3232/6395] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:50 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:52.209919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-604d63e9-a421-45eb-8fb3-fbe460380b8f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:52.211327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-604d63e9-a421-45eb-8fb3-fbe460380b8f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:52.213433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:52.214315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:52.224056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-604d63e9-a421-45eb-8fb3-fbe460380b8f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:52.225160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-604d63e9-a421-45eb-8fb3-fbe460380b8f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:52.225821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-604d63e9-a421-45eb-8fb3-fbe460380b8f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:52.226735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-604d63e9-a421-45eb-8fb3-fbe460380b8f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:52.227537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-604d63e9-a421-45eb-8fb3-fbe460380b8f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:52.228200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-604d63e9-a421-45eb-8fb3-fbe460380b8f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:52.419924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-604d63e9-a421-45eb-8fb3-fbe460380b8f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:52.430578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-604d63e9-a421-45eb-8fb3-fbe460380b8f tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1266 microversion: 2.1 time: 0.225850 Aug 25 13:59:52.431167 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3164/6396] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:52 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:53.452514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7a66e9c7-52ba-4084-ba7d-fb02d5ff4916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:53.453830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7a66e9c7-52ba-4084-ba7d-fb02d5ff4916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:53.457078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:53.463961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a66e9c7-52ba-4084-ba7d-fb02d5ff4916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:53.464462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a66e9c7-52ba-4084-ba7d-fb02d5ff4916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:53.465617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a66e9c7-52ba-4084-ba7d-fb02d5ff4916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:53.466555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a66e9c7-52ba-4084-ba7d-fb02d5ff4916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:53.467027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a66e9c7-52ba-4084-ba7d-fb02d5ff4916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:53.467591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7a66e9c7-52ba-4084-ba7d-fb02d5ff4916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:53.739819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7a66e9c7-52ba-4084-ba7d-fb02d5ff4916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:53.750562 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7a66e9c7-52ba-4084-ba7d-fb02d5ff4916 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1266 microversion: 2.1 time: 0.302011 Aug 25 13:59:53.752168 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3233/6397] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:53 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:54.780811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-56025859-adb5-4915-a4b2-99bb41dc71b7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:54.782080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-56025859-adb5-4915-a4b2-99bb41dc71b7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:54.795076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56025859-adb5-4915-a4b2-99bb41dc71b7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:54.796550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56025859-adb5-4915-a4b2-99bb41dc71b7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:54.797688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56025859-adb5-4915-a4b2-99bb41dc71b7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:54.799981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56025859-adb5-4915-a4b2-99bb41dc71b7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:54.800887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56025859-adb5-4915-a4b2-99bb41dc71b7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:54.802082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56025859-adb5-4915-a4b2-99bb41dc71b7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:55.096995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-56025859-adb5-4915-a4b2-99bb41dc71b7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:55.105624 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-56025859-adb5-4915-a4b2-99bb41dc71b7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1266 microversion: 2.1 time: 0.333570 Aug 25 13:59:55.106542 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3165/6398] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:54 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:56.141589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8569da46-db54-44d1-b6a2-f40e8a9e45c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:56.142423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8569da46-db54-44d1-b6a2-f40e8a9e45c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:56.145368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:56.152363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8569da46-db54-44d1-b6a2-f40e8a9e45c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:56.152783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8569da46-db54-44d1-b6a2-f40e8a9e45c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:56.153486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8569da46-db54-44d1-b6a2-f40e8a9e45c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:56.154278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8569da46-db54-44d1-b6a2-f40e8a9e45c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:56.154763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8569da46-db54-44d1-b6a2-f40e8a9e45c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:56.155189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8569da46-db54-44d1-b6a2-f40e8a9e45c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:56.159164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:56.748138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8569da46-db54-44d1-b6a2-f40e8a9e45c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:56.760721 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8569da46-db54-44d1-b6a2-f40e8a9e45c0 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1266 microversion: 2.1 time: 0.622633 Aug 25 13:59:56.761541 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3234/6399] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:56 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1266 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:57.792534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-415368fa-cfb4-4de4-a2c1-b890b8068394 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:57.793728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-415368fa-cfb4-4de4-a2c1-b890b8068394 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:57.808320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-415368fa-cfb4-4de4-a2c1-b890b8068394 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:57.809395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-415368fa-cfb4-4de4-a2c1-b890b8068394 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:57.810255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-415368fa-cfb4-4de4-a2c1-b890b8068394 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:57.811661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-415368fa-cfb4-4de4-a2c1-b890b8068394 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:57.812410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-415368fa-cfb4-4de4-a2c1-b890b8068394 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:57.823697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-415368fa-cfb4-4de4-a2c1-b890b8068394 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:58.114714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-415368fa-cfb4-4de4-a2c1-b890b8068394 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:58.128242 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-415368fa-cfb4-4de4-a2c1-b890b8068394 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1266 microversion: 2.1 time: 0.347824 Aug 25 13:59:58.130086 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3166/6400] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:57 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:59.163217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4c19b1a5-b382-4b66-b58f-43f6f02fd837 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:59.163982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4c19b1a5-b382-4b66-b58f-43f6f02fd837 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:59.183415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c19b1a5-b382-4b66-b58f-43f6f02fd837 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:59.183924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c19b1a5-b382-4b66-b58f-43f6f02fd837 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:59.184372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c19b1a5-b382-4b66-b58f-43f6f02fd837 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:59.185130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c19b1a5-b382-4b66-b58f-43f6f02fd837 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:59.185623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c19b1a5-b382-4b66-b58f-43f6f02fd837 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:59.186062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c19b1a5-b382-4b66-b58f-43f6f02fd837 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:59.497111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4c19b1a5-b382-4b66-b58f-43f6f02fd837 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:59.508388 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4c19b1a5-b382-4b66-b58f-43f6f02fd837 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1266 microversion: 2.1 time: 0.348954 Aug 25 13:59:59.509258 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3235/6401] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:59 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:00:00.535911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-81b306a9-4bf2-495f-86b6-fed430943f50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:00.537192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-81b306a9-4bf2-495f-86b6-fed430943f50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:00.543817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:00.559477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b306a9-4bf2-495f-86b6-fed430943f50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:00.560021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b306a9-4bf2-495f-86b6-fed430943f50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:00.560591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b306a9-4bf2-495f-86b6-fed430943f50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:00.561325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b306a9-4bf2-495f-86b6-fed430943f50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:00.561804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b306a9-4bf2-495f-86b6-fed430943f50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:00.562348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b306a9-4bf2-495f-86b6-fed430943f50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:00.568928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:00.789007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81b306a9-4bf2-495f-86b6-fed430943f50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:00.806379 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-81b306a9-4bf2-495f-86b6-fed430943f50 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1266 microversion: 2.1 time: 0.277253 Aug 25 14:00:00.808361 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3167/6402] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:00 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:01.422769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-71415d4f-0a4b-4174-90b4-ccdca97f2e4b req-12726ebd-7968-4fc1-a5fa-2cccbeda4fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b19c97f-419e-4a55-bc66-fb2b8acaec41", "name": "network-vif-plugged", "status": "completed", "tag": "8fcfe320-ddb8-4231-92f3-6738c9c43625"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:01.434262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-71415d4f-0a4b-4174-90b4-ccdca97f2e4b req-12726ebd-7968-4fc1-a5fa-2cccbeda4fd0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:01.434755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-71415d4f-0a4b-4174-90b4-ccdca97f2e4b req-12726ebd-7968-4fc1-a5fa-2cccbeda4fd0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:01.435228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-71415d4f-0a4b-4174-90b4-ccdca97f2e4b req-12726ebd-7968-4fc1-a5fa-2cccbeda4fd0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:01.458420 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-71415d4f-0a4b-4174-90b4-ccdca97f2e4b req-12726ebd-7968-4fc1-a5fa-2cccbeda4fd0 service nova] Creating event network-vif-plugged:8fcfe320-ddb8-4231-92f3-6738c9c43625 for instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 on n-h1-852771-8 Aug 25 14:00:01.464371 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-71415d4f-0a4b-4174-90b4-ccdca97f2e4b req-12726ebd-7968-4fc1-a5fa-2cccbeda4fd0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.404050 Aug 25 14:00:01.465555 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3236/6403] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:00:01.835825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7233016c-e471-46c6-ab45-43dbc64e32db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:01.836901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7233016c-e471-46c6-ab45-43dbc64e32db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:01.844837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7233016c-e471-46c6-ab45-43dbc64e32db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:01.846666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7233016c-e471-46c6-ab45-43dbc64e32db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:01.847131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7233016c-e471-46c6-ab45-43dbc64e32db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:01.847944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7233016c-e471-46c6-ab45-43dbc64e32db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:01.848420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7233016c-e471-46c6-ab45-43dbc64e32db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:01.848862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7233016c-e471-46c6-ab45-43dbc64e32db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:02.007866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7233016c-e471-46c6-ab45-43dbc64e32db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:02.016226 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7233016c-e471-46c6-ab45-43dbc64e32db tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1266 microversion: 2.1 time: 0.189037 Aug 25 14:00:02.017538 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3168/6404] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:01 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:03.040444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-093ae716-b8d0-4851-9e0f-8591025ea3d1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:03.041159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-093ae716-b8d0-4851-9e0f-8591025ea3d1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:03.049608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-093ae716-b8d0-4851-9e0f-8591025ea3d1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:03.050426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-093ae716-b8d0-4851-9e0f-8591025ea3d1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:03.051190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-093ae716-b8d0-4851-9e0f-8591025ea3d1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:03.051987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-093ae716-b8d0-4851-9e0f-8591025ea3d1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:03.052893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-093ae716-b8d0-4851-9e0f-8591025ea3d1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:03.053574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-093ae716-b8d0-4851-9e0f-8591025ea3d1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:03.216246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-093ae716-b8d0-4851-9e0f-8591025ea3d1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:03.225359 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-093ae716-b8d0-4851-9e0f-8591025ea3d1 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1266 microversion: 2.1 time: 0.190266 Aug 25 14:00:03.225976 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3237/6405] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:03 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:04.247641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cee4937f-8d02-4d67-82be-c2074b2577fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:04.249009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cee4937f-8d02-4d67-82be-c2074b2577fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:04.257390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cee4937f-8d02-4d67-82be-c2074b2577fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:04.258090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cee4937f-8d02-4d67-82be-c2074b2577fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:04.258755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cee4937f-8d02-4d67-82be-c2074b2577fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:04.259569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cee4937f-8d02-4d67-82be-c2074b2577fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:04.260100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cee4937f-8d02-4d67-82be-c2074b2577fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:04.260497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cee4937f-8d02-4d67-82be-c2074b2577fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:04.405336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cee4937f-8d02-4d67-82be-c2074b2577fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:04.413956 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cee4937f-8d02-4d67-82be-c2074b2577fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1454 microversion: 2.1 time: 0.170626 Aug 25 14:00:04.429333 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3169/6406] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:04 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:04.435894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cabe3029-5f35-4115-8932-7d03f7d00067 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:04.437117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cabe3029-5f35-4115-8932-7d03f7d00067 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:04.445835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cabe3029-5f35-4115-8932-7d03f7d00067 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:04.446574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cabe3029-5f35-4115-8932-7d03f7d00067 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:04.447017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cabe3029-5f35-4115-8932-7d03f7d00067 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:04.447723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cabe3029-5f35-4115-8932-7d03f7d00067 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:04.448182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cabe3029-5f35-4115-8932-7d03f7d00067 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:04.448611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cabe3029-5f35-4115-8932-7d03f7d00067 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:04.598780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cabe3029-5f35-4115-8932-7d03f7d00067 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:04.606979 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cabe3029-5f35-4115-8932-7d03f7d00067 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1454 microversion: 2.1 time: 0.174926 Aug 25 14:00:04.607560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3238/6407] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:04 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:06.765328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-112278a4-978e-460b-939d-7c61e630f327 req-f41b3618-6abe-472a-a9d6-1027d8e11261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b19c97f-419e-4a55-bc66-fb2b8acaec41", "tag": "8fcfe320-ddb8-4231-92f3-6738c9c43625"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:06.777566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-112278a4-978e-460b-939d-7c61e630f327 req-f41b3618-6abe-472a-a9d6-1027d8e11261 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:06.778051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-112278a4-978e-460b-939d-7c61e630f327 req-f41b3618-6abe-472a-a9d6-1027d8e11261 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:06.778826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-112278a4-978e-460b-939d-7c61e630f327 req-f41b3618-6abe-472a-a9d6-1027d8e11261 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:06.803164 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-112278a4-978e-460b-939d-7c61e630f327 req-f41b3618-6abe-472a-a9d6-1027d8e11261 service nova] Creating event network-changed:8fcfe320-ddb8-4231-92f3-6738c9c43625 for instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 on n-h1-852771-8 Aug 25 14:00:06.816675 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-112278a4-978e-460b-939d-7c61e630f327 req-f41b3618-6abe-472a-a9d6-1027d8e11261 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185208 Aug 25 14:00:06.817972 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3170/6408] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:01:35.354995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=9 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:35.356652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=25 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:35.357781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=7 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:35.358286 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:01:35.358286 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:01:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 (ip 10.222.0.70) !!! Aug 25 14:01:35.358738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=19 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:35.365359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-85bf5cf5-f60d-4895-81e8-af88c4171e31 req-43d82027-cf5f-4dee-8420-301b6d14f4fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b19c97f-419e-4a55-bc66-fb2b8acaec41", "tag": "8fcfe320-ddb8-4231-92f3-6738c9c43625"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:35.367663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ee92785e-45b2-48c7-a2f5-cede38dd9662 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:35.368469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ee92785e-45b2-48c7-a2f5-cede38dd9662 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:35.377142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-85bf5cf5-f60d-4895-81e8-af88c4171e31 req-43d82027-cf5f-4dee-8420-301b6d14f4fc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:35.378135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-85bf5cf5-f60d-4895-81e8-af88c4171e31 req-43d82027-cf5f-4dee-8420-301b6d14f4fc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:35.378748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-85bf5cf5-f60d-4895-81e8-af88c4171e31 req-43d82027-cf5f-4dee-8420-301b6d14f4fc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:35.382964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee92785e-45b2-48c7-a2f5-cede38dd9662 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:35.383462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee92785e-45b2-48c7-a2f5-cede38dd9662 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:35.384478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee92785e-45b2-48c7-a2f5-cede38dd9662 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:35.384798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee92785e-45b2-48c7-a2f5-cede38dd9662 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:35.385271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee92785e-45b2-48c7-a2f5-cede38dd9662 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:35.385740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee92785e-45b2-48c7-a2f5-cede38dd9662 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:35.393578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-85bf5cf5-f60d-4895-81e8-af88c4171e31 req-43d82027-cf5f-4dee-8420-301b6d14f4fc service nova] Creating event network-changed:8fcfe320-ddb8-4231-92f3-6738c9c43625 for instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 on n-h1-852771-8 Aug 25 14:01:35.398940 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-85bf5cf5-f60d-4895-81e8-af88c4171e31 req-43d82027-cf5f-4dee-8420-301b6d14f4fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043980 Aug 25 14:01:35.399584 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3171/6409] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:01:35.415555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ee92785e-45b2-48c7-a2f5-cede38dd9662 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:01:35.523609 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ee92785e-45b2-48c7-a2f5-cede38dd9662 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 204 len: 0 microversion: 2.1 time: 0.169803 Aug 25 14:01:35.525328 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3239/6410] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:01:35 2022] DELETE /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:01:35.541923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c31d0fd-e5cb-43f8-9823-fd97fe05af6d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:35.542820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3c31d0fd-e5cb-43f8-9823-fd97fe05af6d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:35.551308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c31d0fd-e5cb-43f8-9823-fd97fe05af6d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:35.551829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c31d0fd-e5cb-43f8-9823-fd97fe05af6d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:35.552295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c31d0fd-e5cb-43f8-9823-fd97fe05af6d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:35.553035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c31d0fd-e5cb-43f8-9823-fd97fe05af6d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:35.553562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c31d0fd-e5cb-43f8-9823-fd97fe05af6d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:35.553992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c31d0fd-e5cb-43f8-9823-fd97fe05af6d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:35.729153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3c31d0fd-e5cb-43f8-9823-fd97fe05af6d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:35.742799 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3c31d0fd-e5cb-43f8-9823-fd97fe05af6d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1579 microversion: 2.1 time: 0.211623 Aug 25 14:01:35.743664 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3172/6411] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:35 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1579 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:01:36.765176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-939a7846-8907-423d-b733-238bc8097bd2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:36.766037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-939a7846-8907-423d-b733-238bc8097bd2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:36.774155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939a7846-8907-423d-b733-238bc8097bd2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:36.774649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939a7846-8907-423d-b733-238bc8097bd2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:36.775090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939a7846-8907-423d-b733-238bc8097bd2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:36.775883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939a7846-8907-423d-b733-238bc8097bd2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:36.776263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939a7846-8907-423d-b733-238bc8097bd2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:36.776693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-939a7846-8907-423d-b733-238bc8097bd2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:36.939403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-939a7846-8907-423d-b733-238bc8097bd2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:36.948496 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-939a7846-8907-423d-b733-238bc8097bd2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1579 microversion: 2.1 time: 0.187784 Aug 25 14:01:36.949099 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3240/6412] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:36 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1579 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:37.978666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1a7998b4-5d1a-4270-adfb-d8b93f36c287 req-551a39d1-f90a-4c8d-9be2-c84ad4abf3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b19c97f-419e-4a55-bc66-fb2b8acaec41", "name": "network-vif-deleted", "tag": "8fcfe320-ddb8-4231-92f3-6738c9c43625"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:37.980883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-14a904df-ef38-47d6-8ff4-eb425db64ef6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:37.981556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-14a904df-ef38-47d6-8ff4-eb425db64ef6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:37.990517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a7998b4-5d1a-4270-adfb-d8b93f36c287 req-551a39d1-f90a-4c8d-9be2-c84ad4abf3aa service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:37.991036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a7998b4-5d1a-4270-adfb-d8b93f36c287 req-551a39d1-f90a-4c8d-9be2-c84ad4abf3aa service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:37.991430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1a7998b4-5d1a-4270-adfb-d8b93f36c287 req-551a39d1-f90a-4c8d-9be2-c84ad4abf3aa service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:37.991928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a904df-ef38-47d6-8ff4-eb425db64ef6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:37.992412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a904df-ef38-47d6-8ff4-eb425db64ef6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:37.993050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a904df-ef38-47d6-8ff4-eb425db64ef6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:37.993881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a904df-ef38-47d6-8ff4-eb425db64ef6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:37.994523 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a904df-ef38-47d6-8ff4-eb425db64ef6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:37.995109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-14a904df-ef38-47d6-8ff4-eb425db64ef6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:38.006908 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1a7998b4-5d1a-4270-adfb-d8b93f36c287 req-551a39d1-f90a-4c8d-9be2-c84ad4abf3aa service nova] Creating event network-vif-deleted:8fcfe320-ddb8-4231-92f3-6738c9c43625 for instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 on n-h1-852771-8 Aug 25 14:01:38.013045 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1a7998b4-5d1a-4270-adfb-d8b93f36c287 req-551a39d1-f90a-4c8d-9be2-c84ad4abf3aa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038110 Aug 25 14:01:38.014044 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3241/6413] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:01:38.068638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-14a904df-ef38-47d6-8ff4-eb425db64ef6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:38.076832 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-14a904df-ef38-47d6-8ff4-eb425db64ef6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1392 microversion: 2.1 time: 0.108069 Aug 25 14:01:38.078041 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3173/6414] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:37 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1392 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:39.102143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-81a54cbd-ce7c-4cc9-b3d3-97d0f81eb5e6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:39.103027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-81a54cbd-ce7c-4cc9-b3d3-97d0f81eb5e6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:39.113177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81a54cbd-ce7c-4cc9-b3d3-97d0f81eb5e6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:39.114054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81a54cbd-ce7c-4cc9-b3d3-97d0f81eb5e6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:39.114825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81a54cbd-ce7c-4cc9-b3d3-97d0f81eb5e6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:39.116115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81a54cbd-ce7c-4cc9-b3d3-97d0f81eb5e6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:39.116990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81a54cbd-ce7c-4cc9-b3d3-97d0f81eb5e6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:39.117804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-81a54cbd-ce7c-4cc9-b3d3-97d0f81eb5e6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:39.224703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-81a54cbd-ce7c-4cc9-b3d3-97d0f81eb5e6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:39.233417 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-81a54cbd-ce7c-4cc9-b3d3-97d0f81eb5e6 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1225 microversion: 2.1 time: 0.136912 Aug 25 14:01:39.234061 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3242/6415] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:39 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:40.259438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-84ec4195-3f4d-4c76-b07f-0345edba9d52 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:40.260073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-84ec4195-3f4d-4c76-b07f-0345edba9d52 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:40.268372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84ec4195-3f4d-4c76-b07f-0345edba9d52 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:40.268931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84ec4195-3f4d-4c76-b07f-0345edba9d52 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:40.269568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84ec4195-3f4d-4c76-b07f-0345edba9d52 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:40.270361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84ec4195-3f4d-4c76-b07f-0345edba9d52 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:40.270958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84ec4195-3f4d-4c76-b07f-0345edba9d52 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:40.271412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84ec4195-3f4d-4c76-b07f-0345edba9d52 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:40.342491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-84ec4195-3f4d-4c76-b07f-0345edba9d52 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:40.352576 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-84ec4195-3f4d-4c76-b07f-0345edba9d52 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1225 microversion: 2.1 time: 0.097022 Aug 25 14:01:40.353180 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3174/6416] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:40 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:41.374817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2aade097-738e-4126-b3f9-c6a6357148fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:41.375374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2aade097-738e-4126-b3f9-c6a6357148fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:41.382881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2aade097-738e-4126-b3f9-c6a6357148fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:41.383358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2aade097-738e-4126-b3f9-c6a6357148fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:41.383799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2aade097-738e-4126-b3f9-c6a6357148fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:41.384504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2aade097-738e-4126-b3f9-c6a6357148fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:41.384975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2aade097-738e-4126-b3f9-c6a6357148fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:41.385399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2aade097-738e-4126-b3f9-c6a6357148fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:41.458991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2aade097-738e-4126-b3f9-c6a6357148fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:41.467160 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2aade097-738e-4126-b3f9-c6a6357148fc tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1225 microversion: 2.1 time: 0.097055 Aug 25 14:01:41.467761 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3243/6417] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:41 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:42.488920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:42.489583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:42.496658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:42.497171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:42.497664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:42.498431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:42.498903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:42.499348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:42.539329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:42.539695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:42.540158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:42.540632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lazy-loading 'fault' on Instance uuid 4b19c97f-419e-4a55-bc66-fb2b8acaec41 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:01:42.586583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:42.597386 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c3b0b00c-c958-43f5-9fd2-d8e30c3aae15 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 200 len: 1230 microversion: 2.1 time: 0.112577 Aug 25 14:01:42.598034 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3175/6418] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:42 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:43.620508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:43.621055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 4b19c97f-419e-4a55-bc66-fb2b8acaec41] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:43.628643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:43.629129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:43.629589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:43.630297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:43.630747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:43.631167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:43.646540 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 could not be found. Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 HTTP/1.1 Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 could not be found. Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '4b19c97f-419e-4a55-bc66-fb2b8acaec41'} Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 could not be found. Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 could not be found. Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:43.648337 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:01:43.652510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:43.652510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:43.652510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:43.652510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:01:43.652510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:01:43.652510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 could not be found. Aug 25 14:01:43.652510 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:01:43.652510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 4b19c97f-419e-4a55-bc66-fb2b8acaec41 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:01:43.652510 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-709e5522-0d98-4bb3-92c0-05d9979fa780 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41" status: 404 len: 111 microversion: 2.1 time: 0.033430 Aug 25 14:01:43.652510 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3244/6419] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:43 2022] GET /compute/v2.1/servers/4b19c97f-419e-4a55-bc66-fb2b8acaec41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:01:50.121110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2b02a8e-3f00-4ca9-a346-ad7ff6d51af3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:50.121751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4f66f822-11ef-4129-9373-6c24d7d5dbc7 req-7ffa8ad3-3b05-4f51-b371-e83aed3e47f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d01aa0-56df-43fa-b485-d2cdf4afcb4a", "tag": "295c3d0a-e49a-46a7-867f-62da6bef901c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:50.123064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2b02a8e-3f00-4ca9-a346-ad7ff6d51af3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:50.139151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b02a8e-3f00-4ca9-a346-ad7ff6d51af3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:50.140676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b02a8e-3f00-4ca9-a346-ad7ff6d51af3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:50.141457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b02a8e-3f00-4ca9-a346-ad7ff6d51af3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:50.143041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b02a8e-3f00-4ca9-a346-ad7ff6d51af3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:50.143228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4f66f822-11ef-4129-9373-6c24d7d5dbc7 req-7ffa8ad3-3b05-4f51-b371-e83aed3e47f8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:50.143677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4f66f822-11ef-4129-9373-6c24d7d5dbc7 req-7ffa8ad3-3b05-4f51-b371-e83aed3e47f8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:50.143990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b02a8e-3f00-4ca9-a346-ad7ff6d51af3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:50.144127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4f66f822-11ef-4129-9373-6c24d7d5dbc7 req-7ffa8ad3-3b05-4f51-b371-e83aed3e47f8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:50.145034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c2b02a8e-3f00-4ca9-a346-ad7ff6d51af3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:50.166673 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4f66f822-11ef-4129-9373-6c24d7d5dbc7 req-7ffa8ad3-3b05-4f51-b371-e83aed3e47f8 service nova] Creating event network-changed:295c3d0a-e49a-46a7-867f-62da6bef901c for instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a on n-h2-852771-8 Aug 25 14:01:50.172168 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4f66f822-11ef-4129-9373-6c24d7d5dbc7 req-7ffa8ad3-3b05-4f51-b371-e83aed3e47f8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054321 Aug 25 14:01:50.173740 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3245/6420] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:01:50.182940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c2b02a8e-3f00-4ca9-a346-ad7ff6d51af3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:01:50.281644 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2b02a8e-3f00-4ca9-a346-ad7ff6d51af3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 204 len: 0 microversion: 2.1 time: 0.165590 Aug 25 14:01:50.283581 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3176/6421] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:01:50 2022] DELETE /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:01:50.295130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-683340fe-55ce-4a32-92e4-0123bd0824c4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:50.296815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-683340fe-55ce-4a32-92e4-0123bd0824c4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:50.307961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-683340fe-55ce-4a32-92e4-0123bd0824c4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:50.308691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-683340fe-55ce-4a32-92e4-0123bd0824c4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:50.309463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-683340fe-55ce-4a32-92e4-0123bd0824c4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:50.310503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-683340fe-55ce-4a32-92e4-0123bd0824c4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:50.311047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-683340fe-55ce-4a32-92e4-0123bd0824c4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:50.311561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-683340fe-55ce-4a32-92e4-0123bd0824c4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:50.464873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-683340fe-55ce-4a32-92e4-0123bd0824c4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:50.473811 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-683340fe-55ce-4a32-92e4-0123bd0824c4 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1578 microversion: 2.1 time: 0.185229 Aug 25 14:01:50.475233 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3246/6422] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:50 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:51.497147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4c363bb-0d6b-4c7f-aaf3-de1f410ef3f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:51.498039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4c363bb-0d6b-4c7f-aaf3-de1f410ef3f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:51.506480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c363bb-0d6b-4c7f-aaf3-de1f410ef3f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:51.507001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c363bb-0d6b-4c7f-aaf3-de1f410ef3f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:51.507858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c363bb-0d6b-4c7f-aaf3-de1f410ef3f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:51.508739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c363bb-0d6b-4c7f-aaf3-de1f410ef3f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:51.510183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c363bb-0d6b-4c7f-aaf3-de1f410ef3f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:51.510882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c363bb-0d6b-4c7f-aaf3-de1f410ef3f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:51.658765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d4c363bb-0d6b-4c7f-aaf3-de1f410ef3f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:51.667544 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4c363bb-0d6b-4c7f-aaf3-de1f410ef3f2 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1578 microversion: 2.1 time: 0.174758 Aug 25 14:01:51.668420 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3177/6423] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:51 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:52.689825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1294a730-a319-44af-9741-c89fe474f720 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:52.690781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1294a730-a319-44af-9741-c89fe474f720 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:52.698355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1294a730-a319-44af-9741-c89fe474f720 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:52.698847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1294a730-a319-44af-9741-c89fe474f720 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:52.699456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1294a730-a319-44af-9741-c89fe474f720 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:52.700340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1294a730-a319-44af-9741-c89fe474f720 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:52.700798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1294a730-a319-44af-9741-c89fe474f720 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:52.701405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1294a730-a319-44af-9741-c89fe474f720 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:52.734882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-af75faec-e254-4adc-89f9-9669c293ce8b req-314d6653-e84d-46d3-8c5d-988d4b8d5727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d01aa0-56df-43fa-b485-d2cdf4afcb4a", "name": "network-vif-deleted", "tag": "295c3d0a-e49a-46a7-867f-62da6bef901c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:52.749935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-af75faec-e254-4adc-89f9-9669c293ce8b req-314d6653-e84d-46d3-8c5d-988d4b8d5727 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:52.750663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-af75faec-e254-4adc-89f9-9669c293ce8b req-314d6653-e84d-46d3-8c5d-988d4b8d5727 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:52.751490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-af75faec-e254-4adc-89f9-9669c293ce8b req-314d6653-e84d-46d3-8c5d-988d4b8d5727 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:52.764084 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-af75faec-e254-4adc-89f9-9669c293ce8b req-314d6653-e84d-46d3-8c5d-988d4b8d5727 service nova] Creating event network-vif-deleted:295c3d0a-e49a-46a7-867f-62da6bef901c for instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a on n-h2-852771-8 Aug 25 14:01:52.769296 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-af75faec-e254-4adc-89f9-9669c293ce8b req-314d6653-e84d-46d3-8c5d-988d4b8d5727 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038477 Aug 25 14:01:52.769895 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3178/6424] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:01:52.780217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1294a730-a319-44af-9741-c89fe474f720 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:52.796835 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1294a730-a319-44af-9741-c89fe474f720 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1391 microversion: 2.1 time: 0.111297 Aug 25 14:01:52.797431 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3247/6425] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:52 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1391 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:53.820910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7aefe56e-2308-4fce-95db-54105c48b18b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:53.821681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7aefe56e-2308-4fce-95db-54105c48b18b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:53.828158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aefe56e-2308-4fce-95db-54105c48b18b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:53.828667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aefe56e-2308-4fce-95db-54105c48b18b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:53.829130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aefe56e-2308-4fce-95db-54105c48b18b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:53.829892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aefe56e-2308-4fce-95db-54105c48b18b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:53.830364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aefe56e-2308-4fce-95db-54105c48b18b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:53.830810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7aefe56e-2308-4fce-95db-54105c48b18b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:53.897596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7aefe56e-2308-4fce-95db-54105c48b18b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:53.905530 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7aefe56e-2308-4fce-95db-54105c48b18b tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1391 microversion: 2.1 time: 0.089960 Aug 25 14:01:53.906117 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3179/6426] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:53 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1391 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:54.930229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cce09a20-21c1-43ec-8f89-80696dfefdf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:54.930782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cce09a20-21c1-43ec-8f89-80696dfefdf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:54.938716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce09a20-21c1-43ec-8f89-80696dfefdf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:54.939264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce09a20-21c1-43ec-8f89-80696dfefdf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:54.939714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce09a20-21c1-43ec-8f89-80696dfefdf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:54.940698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce09a20-21c1-43ec-8f89-80696dfefdf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:54.941158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce09a20-21c1-43ec-8f89-80696dfefdf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:54.941605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cce09a20-21c1-43ec-8f89-80696dfefdf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:55.017903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cce09a20-21c1-43ec-8f89-80696dfefdf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:55.026548 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cce09a20-21c1-43ec-8f89-80696dfefdf7 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1391 microversion: 2.1 time: 0.100314 Aug 25 14:01:55.027228 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3248/6427] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:54 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1391 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:56.049224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df12d285-487f-4205-b02f-c029aa8288b8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:56.049928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df12d285-487f-4205-b02f-c029aa8288b8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:56.057746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df12d285-487f-4205-b02f-c029aa8288b8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:56.058296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df12d285-487f-4205-b02f-c029aa8288b8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:56.058760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df12d285-487f-4205-b02f-c029aa8288b8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:56.059501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df12d285-487f-4205-b02f-c029aa8288b8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:56.059980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df12d285-487f-4205-b02f-c029aa8288b8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:56.060449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df12d285-487f-4205-b02f-c029aa8288b8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:56.134977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df12d285-487f-4205-b02f-c029aa8288b8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:56.145123 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df12d285-487f-4205-b02f-c029aa8288b8 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1391 microversion: 2.1 time: 0.100515 Aug 25 14:01:56.146119 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3180/6428] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:56 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1391 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:57.175135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:57.175135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:57.180785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:57.181277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:57.181761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:57.182469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:57.182927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:57.183356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:57.232712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:57.233210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:57.233683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:57.234142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lazy-loading 'fault' on Instance uuid 71d01aa0-56df-43fa-b485-d2cdf4afcb4a {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:01:57.294919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fbad0b63d14f3fb12de08d966bffad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0815a3fec62b4d2d9d5a07275770603a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:57.304815 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b43f0277-09b6-4f20-a589-1e44be2039a3 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 200 len: 1396 microversion: 2.1 time: 0.136223 Aug 25 14:01:57.305784 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3249/6429] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:57 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 1396 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:58.332605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:58.333278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 71d01aa0-56df-43fa-b485-d2cdf4afcb4a] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:58.340352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:58.340862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:58.341327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:58.342100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:58.342577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:58.343029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:58.358944 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a could not be found. Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a HTTP/1.1 Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a could not be found. Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '71d01aa0-56df-43fa-b485-d2cdf4afcb4a'} Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a could not be found. Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a could not be found. Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:58.360801 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.368259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:58.368259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:58.368259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:58.368259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:01:58.368259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:01:58.368259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a could not be found. Aug 25 14:01:58.368259 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.368259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 71d01aa0-56df-43fa-b485-d2cdf4afcb4a could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:01:58.368259 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5d14afe6-d54b-42e2-8db0-4251221e99ed tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a" status: 404 len: 111 microversion: 2.1 time: 0.034521 Aug 25 14:01:58.368259 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3181/6430] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:58 2022] GET /compute/v2.1/servers/71d01aa0-56df-43fa-b485-d2cdf4afcb4a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:01:58.864198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:58.864730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:58.871832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:58.872314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:58.872753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:58.873450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:58.873941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:58.874367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:58.888308 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e HTTP/1.1 Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '9cdc7943-2094-4efe-b733-b69755860c2e'} Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:01:58.890099 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d8ef8f94-43ae-4276-abc0-255cec645d02 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 404 len: 111 microversion: 2.1 time: 0.031798 Aug 25 14:01:58.895230 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3250/6431] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:01:58 2022] DELETE /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:01:58.900281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:58.900913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] [instance: 9cdc7943-2094-4efe-b733-b69755860c2e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:58.907594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:58.908237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:58.908942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:58.909454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:58.909948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:58.910389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:58.924858 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] HTTP exception thrown: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Request method failure captured: Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e HTTP/1.1 Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB33SJ4f7bS2uZe80jTOrvcKEdru7MSQ502zqRuq3B6ufx8lX6BWdUXzuH9WPD_RlZEZUsZ3KlMBvYpxIg3lEc7gknSvxd5GAFx0EaKs9oWRFW9zm0fsQQO9RulFMYEPTEGjTxZb6BXSd-VeAjXZrs6tVQ-Ps5pIFNCBnTk9L0EARyFw Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0815a3fec62b4d2d9d5a07275770603a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0815a3fec62b4d2d9d5a07275770603a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0815a3fec62b4d2d9d5a07275770603a"}]}] Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 0815a3fec62b4d2d9d5a07275770603a Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126491324 Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestVolumeBootPattern-1126491324-project Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 93fbad0b63d14f3fb12de08d966bffad Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestVolumeBootPattern-1126491324-project Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '9cdc7943-2094-4efe-b733-b69755860c2e'} Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:58.926478 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.930781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:58.930781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:58.930781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:58.930781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:01:58.930781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:01:58.930781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. Aug 25 14:01:58.930781 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:01:58.930781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Returning 404 to user: Instance 9cdc7943-2094-4efe-b733-b69755860c2e could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:01:58.930781 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0339dce1-5896-4846-b47b-a8c815b78204 tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e" status: 404 len: 111 microversion: 2.1 time: 0.031484 Aug 25 14:01:58.930781 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3182/6432] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:58 2022] GET /compute/v2.1/servers/9cdc7943-2094-4efe-b733-b69755860c2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:02:02.428305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b01da142-73ca-4410-949c-e1cf4793919d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] Calling method '.version_select at 0x7f3a29b623a0>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:02.464292 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b01da142-73ca-4410-949c-e1cf4793919d tempest-TestVolumeBootPattern-1126491324 tempest-TestVolumeBootPattern-1126491324-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1200164785" status: 202 len: 0 microversion: 2.1 time: 0.040153 Aug 25 14:02:02.465392 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3251/6433] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Aug 25 14:02:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1200164785 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:02:22.717412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:22.718182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:22.855971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-449188105", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:22.924963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] validate_networks() for None {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:02:23.135401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:02:23.135844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:02:23.136337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:02:23.136766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:02:23.137205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:02:23.146935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:23.147435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:23.147900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:23.148643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:23.149120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:23.149591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:23.167491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Getting quotas for project f8c7ffaf9b174023a8f0ce644738db2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:02:23.174037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Getting quotas for user 98577e6c2fdb4cc1915e380eb68bc058 and project f8c7ffaf9b174023a8f0ce644738db2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:02:23.187216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:02:23.190794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:02:23.241992 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cba49eeb-d4eb-4d7c-a748-aba7a419abec tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529791 Aug 25 14:02:23.242670 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3183/6434] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:02:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:02:23.257022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a6dcc2f-3fe3-4b92-9015-d19747868b40 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:23.257682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a6dcc2f-3fe3-4b92-9015-d19747868b40 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:23.261016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:23.262045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:23.326641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a6dcc2f-3fe3-4b92-9015-d19747868b40 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:23.334863 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a6dcc2f-3fe3-4b92-9015-d19747868b40 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1221 microversion: 2.1 time: 0.082626 Aug 25 14:02:23.335450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3252/6435] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:23 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:24.357972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6c36c0b3-1dc5-4013-934c-86e1fdb6599b tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:24.358757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6c36c0b3-1dc5-4013-934c-86e1fdb6599b tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:24.365149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c36c0b3-1dc5-4013-934c-86e1fdb6599b tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:24.365811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c36c0b3-1dc5-4013-934c-86e1fdb6599b tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:24.366266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c36c0b3-1dc5-4013-934c-86e1fdb6599b tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:24.366993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c36c0b3-1dc5-4013-934c-86e1fdb6599b tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:24.367467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c36c0b3-1dc5-4013-934c-86e1fdb6599b tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:24.367911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c36c0b3-1dc5-4013-934c-86e1fdb6599b tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:24.436584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6c36c0b3-1dc5-4013-934c-86e1fdb6599b tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:24.446745 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6c36c0b3-1dc5-4013-934c-86e1fdb6599b tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1273 microversion: 2.1 time: 0.094098 Aug 25 14:02:24.447378 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3184/6436] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:24 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:25.476888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-65ba74b9-c49a-48e0-8ca7-d99b473ab50e tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:25.477621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-65ba74b9-c49a-48e0-8ca7-d99b473ab50e tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:25.484460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65ba74b9-c49a-48e0-8ca7-d99b473ab50e tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:25.484958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65ba74b9-c49a-48e0-8ca7-d99b473ab50e tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:25.485465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65ba74b9-c49a-48e0-8ca7-d99b473ab50e tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:25.486885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65ba74b9-c49a-48e0-8ca7-d99b473ab50e tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:25.487357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65ba74b9-c49a-48e0-8ca7-d99b473ab50e tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:25.487782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-65ba74b9-c49a-48e0-8ca7-d99b473ab50e tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:25.816740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-65ba74b9-c49a-48e0-8ca7-d99b473ab50e tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:25.826569 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-65ba74b9-c49a-48e0-8ca7-d99b473ab50e tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1321 microversion: 2.1 time: 0.360011 Aug 25 14:02:25.827693 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3253/6437] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:25 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:26.215598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a6debb08-9774-45dc-b455-b0402761d7b6 req-dabb8643-9ee7-4f38-97cd-eeaa07138425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81be128-c95d-4b01-bea1-71efaccb534c", "tag": "ae9eda85-f643-412f-be0c-a07c374133c0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:26.228776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a6debb08-9774-45dc-b455-b0402761d7b6 req-dabb8643-9ee7-4f38-97cd-eeaa07138425 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:26.229274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a6debb08-9774-45dc-b455-b0402761d7b6 req-dabb8643-9ee7-4f38-97cd-eeaa07138425 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:26.229772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a6debb08-9774-45dc-b455-b0402761d7b6 req-dabb8643-9ee7-4f38-97cd-eeaa07138425 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:26.244452 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a6debb08-9774-45dc-b455-b0402761d7b6 req-dabb8643-9ee7-4f38-97cd-eeaa07138425 service nova] Creating event network-changed:ae9eda85-f643-412f-be0c-a07c374133c0 for instance a81be128-c95d-4b01-bea1-71efaccb534c on n-h1-852771-8 Aug 25 14:02:26.249715 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a6debb08-9774-45dc-b455-b0402761d7b6 req-dabb8643-9ee7-4f38-97cd-eeaa07138425 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038146 Aug 25 14:02:26.250752 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3185/6438] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:26.849304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f524555-f17e-4d57-8104-b252576ceb4c tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:26.850266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f524555-f17e-4d57-8104-b252576ceb4c tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:26.857341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f524555-f17e-4d57-8104-b252576ceb4c tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:26.857759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f524555-f17e-4d57-8104-b252576ceb4c tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:26.858201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f524555-f17e-4d57-8104-b252576ceb4c tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:26.858914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f524555-f17e-4d57-8104-b252576ceb4c tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:26.860338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f524555-f17e-4d57-8104-b252576ceb4c tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:26.860338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f524555-f17e-4d57-8104-b252576ceb4c tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:27.002286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f524555-f17e-4d57-8104-b252576ceb4c tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:27.010391 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f524555-f17e-4d57-8104-b252576ceb4c tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1321 microversion: 2.1 time: 0.165099 Aug 25 14:02:27.011301 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3254/6439] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:26 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:28.033752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-370145ea-dbc2-4ee6-bb04-ede8c7854cfb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:28.034728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-370145ea-dbc2-4ee6-bb04-ede8c7854cfb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:28.040693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370145ea-dbc2-4ee6-bb04-ede8c7854cfb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:28.041201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370145ea-dbc2-4ee6-bb04-ede8c7854cfb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:28.041690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370145ea-dbc2-4ee6-bb04-ede8c7854cfb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:28.042430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370145ea-dbc2-4ee6-bb04-ede8c7854cfb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:28.042881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370145ea-dbc2-4ee6-bb04-ede8c7854cfb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:28.043326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-370145ea-dbc2-4ee6-bb04-ede8c7854cfb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:28.241580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-370145ea-dbc2-4ee6-bb04-ede8c7854cfb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:28.249432 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-370145ea-dbc2-4ee6-bb04-ede8c7854cfb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1321 microversion: 2.1 time: 0.221719 Aug 25 14:02:28.250561 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3186/6440] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:28 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:29.271500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9cbedecc-2353-490c-8d80-ba2d12565726 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:29.272029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9cbedecc-2353-490c-8d80-ba2d12565726 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:29.279420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbedecc-2353-490c-8d80-ba2d12565726 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:29.279913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbedecc-2353-490c-8d80-ba2d12565726 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:29.280358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbedecc-2353-490c-8d80-ba2d12565726 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:29.281065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbedecc-2353-490c-8d80-ba2d12565726 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:29.281563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbedecc-2353-490c-8d80-ba2d12565726 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:29.282056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9cbedecc-2353-490c-8d80-ba2d12565726 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:29.421562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9cbedecc-2353-490c-8d80-ba2d12565726 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:29.429246 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9cbedecc-2353-490c-8d80-ba2d12565726 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1321 microversion: 2.1 time: 0.162083 Aug 25 14:02:29.429854 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3255/6441] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:29 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:30.450771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eb0774ce-9d85-4d33-8660-93e947be4e75 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:30.451402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb0774ce-9d85-4d33-8660-93e947be4e75 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:30.459388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb0774ce-9d85-4d33-8660-93e947be4e75 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:30.459894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb0774ce-9d85-4d33-8660-93e947be4e75 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:30.460365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb0774ce-9d85-4d33-8660-93e947be4e75 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:30.461096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb0774ce-9d85-4d33-8660-93e947be4e75 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:30.461604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb0774ce-9d85-4d33-8660-93e947be4e75 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:30.462060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb0774ce-9d85-4d33-8660-93e947be4e75 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:30.597366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eb0774ce-9d85-4d33-8660-93e947be4e75 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:30.605403 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eb0774ce-9d85-4d33-8660-93e947be4e75 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1321 microversion: 2.1 time: 0.158537 Aug 25 14:02:30.606022 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3187/6442] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:30 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:31.626821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-69ae331c-2686-40b5-b79f-98bbc87b8dd2 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:31.627490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-69ae331c-2686-40b5-b79f-98bbc87b8dd2 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:31.634532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69ae331c-2686-40b5-b79f-98bbc87b8dd2 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:31.635032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69ae331c-2686-40b5-b79f-98bbc87b8dd2 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:31.635479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69ae331c-2686-40b5-b79f-98bbc87b8dd2 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:31.636194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69ae331c-2686-40b5-b79f-98bbc87b8dd2 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:31.636693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69ae331c-2686-40b5-b79f-98bbc87b8dd2 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:31.637122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-69ae331c-2686-40b5-b79f-98bbc87b8dd2 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:31.778935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-69ae331c-2686-40b5-b79f-98bbc87b8dd2 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:31.787229 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-69ae331c-2686-40b5-b79f-98bbc87b8dd2 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1321 microversion: 2.1 time: 0.164624 Aug 25 14:02:31.787829 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3256/6443] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:31 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:32.808758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-64d1b8ec-f470-4a0d-8143-4250b9860971 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:32.809391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-64d1b8ec-f470-4a0d-8143-4250b9860971 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:32.817465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64d1b8ec-f470-4a0d-8143-4250b9860971 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:32.818006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64d1b8ec-f470-4a0d-8143-4250b9860971 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:32.818470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64d1b8ec-f470-4a0d-8143-4250b9860971 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:32.819198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64d1b8ec-f470-4a0d-8143-4250b9860971 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:32.819670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64d1b8ec-f470-4a0d-8143-4250b9860971 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:32.820121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-64d1b8ec-f470-4a0d-8143-4250b9860971 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:32.968370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-64d1b8ec-f470-4a0d-8143-4250b9860971 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:32.977800 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-64d1b8ec-f470-4a0d-8143-4250b9860971 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1321 microversion: 2.1 time: 0.172953 Aug 25 14:02:32.978396 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3188/6444] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:32 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:33.802108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d099d9b9-63dc-4ee5-b036-426fe2e473bc req-d908a6d8-a7c2-4ecb-a761-e16884056d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81be128-c95d-4b01-bea1-71efaccb534c", "name": "network-vif-plugged", "status": "completed", "tag": "ae9eda85-f643-412f-be0c-a07c374133c0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:33.808036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:33.814546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d099d9b9-63dc-4ee5-b036-426fe2e473bc req-d908a6d8-a7c2-4ecb-a761-e16884056d7b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:33.815813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d099d9b9-63dc-4ee5-b036-426fe2e473bc req-d908a6d8-a7c2-4ecb-a761-e16884056d7b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:33.816295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d099d9b9-63dc-4ee5-b036-426fe2e473bc req-d908a6d8-a7c2-4ecb-a761-e16884056d7b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:33.828898 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d099d9b9-63dc-4ee5-b036-426fe2e473bc req-d908a6d8-a7c2-4ecb-a761-e16884056d7b service nova] Creating event network-vif-plugged:ae9eda85-f643-412f-be0c-a07c374133c0 for instance a81be128-c95d-4b01-bea1-71efaccb534c on n-h1-852771-8 Aug 25 14:02:33.834522 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d099d9b9-63dc-4ee5-b036-426fe2e473bc req-d908a6d8-a7c2-4ecb-a761-e16884056d7b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037135 Aug 25 14:02:33.835129 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3257/6445] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:34.004455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-42649314-b0c0-4aa2-9725-d885c1158c69 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:34.005577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-42649314-b0c0-4aa2-9725-d885c1158c69 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:34.008953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:34.010231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:34.023354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42649314-b0c0-4aa2-9725-d885c1158c69 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:34.024215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42649314-b0c0-4aa2-9725-d885c1158c69 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:34.024962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42649314-b0c0-4aa2-9725-d885c1158c69 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:34.026217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42649314-b0c0-4aa2-9725-d885c1158c69 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:34.027005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42649314-b0c0-4aa2-9725-d885c1158c69 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:34.027749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42649314-b0c0-4aa2-9725-d885c1158c69 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:34.173074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-42649314-b0c0-4aa2-9725-d885c1158c69 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:34.181287 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-42649314-b0c0-4aa2-9725-d885c1158c69 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1321 microversion: 2.1 time: 0.184650 Aug 25 14:02:34.181936 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3189/6446] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:33 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:35.204657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-418e522f-dc26-4ade-b157-3e3db8e63f35 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:35.205383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-418e522f-dc26-4ade-b157-3e3db8e63f35 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:35.211667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-418e522f-dc26-4ade-b157-3e3db8e63f35 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:35.212152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-418e522f-dc26-4ade-b157-3e3db8e63f35 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:35.212591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-418e522f-dc26-4ade-b157-3e3db8e63f35 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:35.213289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-418e522f-dc26-4ade-b157-3e3db8e63f35 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:35.213766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-418e522f-dc26-4ade-b157-3e3db8e63f35 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:35.214193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-418e522f-dc26-4ade-b157-3e3db8e63f35 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:35.359561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-418e522f-dc26-4ade-b157-3e3db8e63f35 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:35.368074 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-418e522f-dc26-4ade-b157-3e3db8e63f35 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1321 microversion: 2.1 time: 0.169057 Aug 25 14:02:35.368662 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3258/6447] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:35 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:36.390470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-01e47255-b1df-4e29-86ba-5a3d207e56ca tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:36.391756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-01e47255-b1df-4e29-86ba-5a3d207e56ca tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:36.399502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01e47255-b1df-4e29-86ba-5a3d207e56ca tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:36.400018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01e47255-b1df-4e29-86ba-5a3d207e56ca tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:36.400482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01e47255-b1df-4e29-86ba-5a3d207e56ca tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:36.401211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01e47255-b1df-4e29-86ba-5a3d207e56ca tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:36.401732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01e47255-b1df-4e29-86ba-5a3d207e56ca tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:36.402177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01e47255-b1df-4e29-86ba-5a3d207e56ca tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:36.539118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-01e47255-b1df-4e29-86ba-5a3d207e56ca tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:36.548005 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-01e47255-b1df-4e29-86ba-5a3d207e56ca tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1471 microversion: 2.1 time: 0.160871 Aug 25 14:02:36.548900 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3190/6448] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:36 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:36.645397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6ffb60d-ea9a-40ab-96ac-aa2d6a9f9d40 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Calling method '.version_select at 0x7f3a293bcc10>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:36.713383 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b6ffb60d-ea9a-40ab-96ac-aa2d6a9f9d40 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/9c0f200ccc324f17afd18858419fdc0f" status: 200 len: 371 microversion: 2.1 time: 0.142666 Aug 25 14:02:36.714007 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3259/6449] 10.222.0.70 () {58 vars in 1242 bytes} [Thu Aug 25 14:02:36 2022] GET /compute/v2.1/os-quota-sets/9c0f200ccc324f17afd18858419fdc0f => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:36.725798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c2dfb700-618f-4d45-917b-463631aba466 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1268072467", "id": 710982817, "os-flavor-access:is_public": "True"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:36.746434 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c2dfb700-618f-4d45-917b-463631aba466 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.024563 Aug 25 14:02:36.747046 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3191/6450] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:02:36 2022] POST /compute/v2.1/flavors => generated 435 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:36.759986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "710982817"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:36.762247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:36.768517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:36.768966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:36.769404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:36.770131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:36.770582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:36.771011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:36.911138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '10e044936caf420fae22c240d7dd0ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0f200ccc324f17afd18858419fdc0f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:36.918039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1268072467 {{(pid=129060) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:02:36.925723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:36.926202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:36.926638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:36.927361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:36.927815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:36.928241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:36.949952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Getting quotas for project f8c7ffaf9b174023a8f0ce644738db2d. Resources: {'cores', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:02:36.955995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Getting quotas for user 98577e6c2fdb4cc1915e380eb68bc058 and project f8c7ffaf9b174023a8f0ce644738db2d. Resources: {'cores', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:02:36.971983 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.compute.api [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] ram quota exceeded for 9c0f200ccc324f17afd18858419fdc0f, tried to resize instance. Aug 25 14:02:36.972523 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Request method failure captured: Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c/action HTTP/1.1 Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 38 Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4DuGHozAg4wHIoaX8gmVwecUeKBcEySv0qfQxSalE4lovfbq1D0Ul6crzRpWpW1R0PfyPa0z5BSQldBBppg1k-T2bmu30IfnVECmIQurvBifaWL8aULgcLSrajqi6lqOX0vvqICZ4xvS9h1E8q4ELpuyy8p7cUIXvsGEeF1DmXG9NQ Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 9c0f200ccc324f17afd18858419fdc0f Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1031081436 Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,admin,reader Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,admin,reader Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9c0f200ccc324f17afd18858419fdc0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9c0f200ccc324f17afd18858419fdc0f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9c0f200ccc324f17afd18858419fdc0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9c0f200ccc324f17afd18858419fdc0f"}]}] Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1031081436 Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 9c0f200ccc324f17afd18858419fdc0f Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1031081436 Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersAdminNegativeTestJSON-1031081436-project-admin Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 10e044936caf420fae22c240d7dd0ac8 Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1031081436-project-admin Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: {"resize": {"flavorRef": "710982817"}} Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'a81be128-c95d-4b01-bea1-71efaccb534c', 'body': {'resize': {'flavorRef': '710982817'}}} Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:02:36.975933 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-433f1e9d-268d-4c79-a997-4c8a55c939d1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c/action" status: 403 len: 118 microversion: 2.1 time: 0.221381 Aug 25 14:02:36.983654 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3260/6451] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:02:36 2022] POST /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c/action => generated 118 bytes in 223 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:02:36.987380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e8e3aaf6-cbdc-48cb-bee7-906331c37a4d tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:37.006939 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e8e3aaf6-cbdc-48cb-bee7-906331c37a4d tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/710982817" status: 202 len: 0 microversion: 2.1 time: 0.023898 Aug 25 14:02:37.007553 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3192/6452] 10.222.0.70 () {58 vars in 1158 bytes} [Thu Aug 25 14:02:36 2022] DELETE /compute/v2.1/flavors/710982817 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:02:37.016632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fe86931d-df95-42aa-9878-1207334c9cd1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:37.037973 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fe86931d-df95-42aa-9878-1207334c9cd1 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025826 Aug 25 14:02:37.038571 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3261/6453] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 14:02:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:37.058044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00e2f9ae-f665-4209-854a-01e53adb6c5b tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Calling method '.version_select at 0x7f3a291b4e50>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:37.131384 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-00e2f9ae-f665-4209-854a-01e53adb6c5b tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/9c0f200ccc324f17afd18858419fdc0f" status: 200 len: 371 microversion: 2.1 time: 0.076960 Aug 25 14:02:37.131981 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3193/6454] 10.222.0.70 () {58 vars in 1242 bytes} [Thu Aug 25 14:02:37 2022] GET /compute/v2.1/os-quota-sets/9c0f200ccc324f17afd18858419fdc0f => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:37.144997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-933faf46-85c0-43bf-87f4-375883b5672b tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-164818663", "id": 1667887052, "os-flavor-access:is_public": "True"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:37.164173 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-933faf46-85c0-43bf-87f4-375883b5672b tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.024099 Aug 25 14:02:37.164687 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3262/6455] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:02:37 2022] POST /compute/v2.1/flavors => generated 436 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:02:37.177932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1667887052"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:37.180400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:37.186845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:37.187350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:37.187862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:37.188757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:37.189237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:37.189709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:37.330953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '10e044936caf420fae22c240d7dd0ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0f200ccc324f17afd18858419fdc0f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:37.337834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-164818663 {{(pid=129059) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:02:37.345115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:37.345647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:37.346105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:37.346857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:37.347324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:37.347772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:37.374408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Getting quotas for project f8c7ffaf9b174023a8f0ce644738db2d. Resources: {'cores', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:02:37.380167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Getting quotas for user 98577e6c2fdb4cc1915e380eb68bc058 and project f8c7ffaf9b174023a8f0ce644738db2d. Resources: {'cores', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:02:37.397320 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.compute.api [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] cores quota exceeded for 9c0f200ccc324f17afd18858419fdc0f, tried to resize instance. Aug 25 14:02:37.398186 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Request method failure captured: Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c/action HTTP/1.1 Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 39 Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4DuGHozAg4wHIoaX8gmVwecUeKBcEySv0qfQxSalE4lovfbq1D0Ul6crzRpWpW1R0PfyPa0z5BSQldBBppg1k-T2bmu30IfnVECmIQurvBifaWL8aULgcLSrajqi6lqOX0vvqICZ4xvS9h1E8q4ELpuyy8p7cUIXvsGEeF1DmXG9NQ Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 9c0f200ccc324f17afd18858419fdc0f Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1031081436 Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,admin,reader Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,admin,reader Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9c0f200ccc324f17afd18858419fdc0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9c0f200ccc324f17afd18858419fdc0f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9c0f200ccc324f17afd18858419fdc0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9c0f200ccc324f17afd18858419fdc0f"}]}] Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1031081436 Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 9c0f200ccc324f17afd18858419fdc0f Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1031081436 Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersAdminNegativeTestJSON-1031081436-project-admin Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 10e044936caf420fae22c240d7dd0ac8 Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1031081436-project-admin Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: {"resize": {"flavorRef": "1667887052"}} Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'a81be128-c95d-4b01-bea1-71efaccb534c', 'body': {'resize': {'flavorRef': '1667887052'}}} Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:02:37.401148 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cf4b0e1e-0fcc-4b49-8f41-e5c5e272fc04 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c/action" status: 403 len: 113 microversion: 2.1 time: 0.229349 Aug 25 14:02:37.405919 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3194/6456] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:02:37 2022] POST /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c/action => generated 113 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:02:37.414431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a66c5f26-0686-4a02-ba24-e0701f3e1327 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:37.433012 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a66c5f26-0686-4a02-ba24-e0701f3e1327 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1667887052" status: 202 len: 0 microversion: 2.1 time: 0.022339 Aug 25 14:02:37.433677 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3263/6457] 10.222.0.70 () {58 vars in 1161 bytes} [Thu Aug 25 14:02:37 2022] DELETE /compute/v2.1/flavors/1667887052 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:02:37.443786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-53fecd8b-f612-4176-bd6c-b977c6f04489 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:37.465628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-53fecd8b-f612-4176-bd6c-b977c6f04489 tempest-ServersAdminNegativeTestJSON-1031081436 tempest-ServersAdminNegativeTestJSON-1031081436-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027238 Aug 25 14:02:37.466221 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3195/6458] 10.222.0.70 () {58 vars in 1146 bytes} [Thu Aug 25 14:02:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:37.487020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9a341b4-86b4-437a-9f09-57c8dabba4b8 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:37.487522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c9a341b4-86b4-437a-9f09-57c8dabba4b8 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:37.493886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9a341b4-86b4-437a-9f09-57c8dabba4b8 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:37.494375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9a341b4-86b4-437a-9f09-57c8dabba4b8 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:37.494815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9a341b4-86b4-437a-9f09-57c8dabba4b8 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:37.495514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9a341b4-86b4-437a-9f09-57c8dabba4b8 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:37.495976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9a341b4-86b4-437a-9f09-57c8dabba4b8 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:37.496406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9a341b4-86b4-437a-9f09-57c8dabba4b8 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:37.525424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c9a341b4-86b4-437a-9f09-57c8dabba4b8 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:02:37.614728 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9a341b4-86b4-437a-9f09-57c8dabba4b8 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 204 len: 0 microversion: 2.1 time: 0.131769 Aug 25 14:02:37.616051 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3264/6459] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:02:37 2022] DELETE /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:02:37.624194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-47605ab5-897a-447d-a843-5e8348e6d970 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:37.624829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-47605ab5-897a-447d-a843-5e8348e6d970 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:37.632111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47605ab5-897a-447d-a843-5e8348e6d970 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:37.632625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47605ab5-897a-447d-a843-5e8348e6d970 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:37.633088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47605ab5-897a-447d-a843-5e8348e6d970 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:37.633840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47605ab5-897a-447d-a843-5e8348e6d970 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:37.634324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47605ab5-897a-447d-a843-5e8348e6d970 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:37.634773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-47605ab5-897a-447d-a843-5e8348e6d970 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:37.777852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-47605ab5-897a-447d-a843-5e8348e6d970 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:37.787095 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-47605ab5-897a-447d-a843-5e8348e6d970 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1477 microversion: 2.1 time: 0.166798 Aug 25 14:02:37.787721 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3196/6460] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:37 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:38.809284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22e2e1a1-e207-4cc7-abab-e93d270491e4 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:38.810034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-22e2e1a1-e207-4cc7-abab-e93d270491e4 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:38.819505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e2e1a1-e207-4cc7-abab-e93d270491e4 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:38.819996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e2e1a1-e207-4cc7-abab-e93d270491e4 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:38.820492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e2e1a1-e207-4cc7-abab-e93d270491e4 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:38.821163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e2e1a1-e207-4cc7-abab-e93d270491e4 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:38.821655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e2e1a1-e207-4cc7-abab-e93d270491e4 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:38.822093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e2e1a1-e207-4cc7-abab-e93d270491e4 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:38.974149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-22e2e1a1-e207-4cc7-abab-e93d270491e4 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:38.982538 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22e2e1a1-e207-4cc7-abab-e93d270491e4 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1477 microversion: 2.1 time: 0.177542 Aug 25 14:02:38.983361 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3265/6461] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:38 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1477 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:39.854532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ad9bbf47-0ff7-4b67-9e27-99dab337a275 req-c3e04fd5-7410-4bea-9f5c-8d2f75ccd9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81be128-c95d-4b01-bea1-71efaccb534c", "name": "network-vif-deleted", "tag": "ae9eda85-f643-412f-be0c-a07c374133c0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:39.868037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ad9bbf47-0ff7-4b67-9e27-99dab337a275 req-c3e04fd5-7410-4bea-9f5c-8d2f75ccd9f0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:39.868604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ad9bbf47-0ff7-4b67-9e27-99dab337a275 req-c3e04fd5-7410-4bea-9f5c-8d2f75ccd9f0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:39.869764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ad9bbf47-0ff7-4b67-9e27-99dab337a275 req-c3e04fd5-7410-4bea-9f5c-8d2f75ccd9f0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:39.884721 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ad9bbf47-0ff7-4b67-9e27-99dab337a275 req-c3e04fd5-7410-4bea-9f5c-8d2f75ccd9f0 service nova] Creating event network-vif-deleted:ae9eda85-f643-412f-be0c-a07c374133c0 for instance a81be128-c95d-4b01-bea1-71efaccb534c on n-h1-852771-8 Aug 25 14:02:39.894072 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ad9bbf47-0ff7-4b67-9e27-99dab337a275 req-c3e04fd5-7410-4bea-9f5c-8d2f75ccd9f0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044713 Aug 25 14:02:39.898591 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3197/6462] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:02:40.007199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:40.007717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:40.016633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:40.017133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:40.017667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.018417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:40.018880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:40.019312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.336184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:40.336674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:40.337108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.337590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lazy-loading 'fault' on Instance uuid a81be128-c95d-4b01-bea1-71efaccb534c {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:02:40.386029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98577e6c2fdb4cc1915e380eb68bc058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c7ffaf9b174023a8f0ce644738db2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:40.395664 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-12fb7d28-d4e3-43bb-8e00-a5e971b29b42 tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 200 len: 1311 microversion: 2.1 time: 0.394290 Aug 25 14:02:40.396330 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3266/6463] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:39 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 1311 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:41.419183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:41.419816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] [instance: a81be128-c95d-4b01-bea1-71efaccb534c] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:41.427231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:41.427734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:41.428194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:41.428920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:41.429394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:41.429879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:41.446844 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] HTTP exception thrown: Instance a81be128-c95d-4b01-bea1-71efaccb534c could not be found. Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Request method failure captured: Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c HTTP/1.1 Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4DtnWaioWay1EA8odqoc6qFaXf1kWha1rCRfw_-yGQy38WEjxbKT8LnxDztwhZBBs-1PVLDB9rgU7Su61Wr4A_l2Bz5SREDrV2S5Vuon89-c2pr5pYvPaTY7TeG6cm-cC9n1tdaYZwkqN4Z256al7cZ1dcdXrYkElht2VSLOTC8cA8 Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f8c7ffaf9b174023a8f0ce644738db2d Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2105706098 Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f8c7ffaf9b174023a8f0ce644738db2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f8c7ffaf9b174023a8f0ce644738db2d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f8c7ffaf9b174023a8f0ce644738db2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f8c7ffaf9b174023a8f0ce644738db2d"}]}] Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2105706098 Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f8c7ffaf9b174023a8f0ce644738db2d Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2105706098 Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersAdminNegativeTestJSON-2105706098-project Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 98577e6c2fdb4cc1915e380eb68bc058 Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2105706098-project Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance a81be128-c95d-4b01-bea1-71efaccb534c could not be found. Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'a81be128-c95d-4b01-bea1-71efaccb534c'} Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81be128-c95d-4b01-bea1-71efaccb534c could not be found. Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81be128-c95d-4b01-bea1-71efaccb534c could not be found. Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:41.448488 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81be128-c95d-4b01-bea1-71efaccb534c could not be found. Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] Returning 404 to user: Instance a81be128-c95d-4b01-bea1-71efaccb534c could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2bc23ef0-e939-47bc-9ac3-c8a5cc62c9cb tempest-ServersAdminNegativeTestJSON-2105706098 tempest-ServersAdminNegativeTestJSON-2105706098-project] 10.222.0.70 "GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c" status: 404 len: 111 microversion: 2.1 time: 0.035217 Aug 25 14:02:41.452623 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3198/6464] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:41 2022] GET /compute/v2.1/servers/a81be128-c95d-4b01-bea1-71efaccb534c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:02:48.368808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:48.370096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:48.510109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1635304945", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "10eb496e-6a6c-41bb-af78-bf07ea28045b"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:48.599583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] validate_networks() for [('10eb496e-6a6c-41bb-af78-bf07ea28045b', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:02:49.053381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:02:49.053849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:02:49.054336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:02:49.054750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:02:49.055168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:02:49.076086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:49.076642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:49.077370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:49.078722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:49.079196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:49.079979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:49.101046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Getting quotas for project 5d94f1d324d04752a98254bb49449170. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:02:49.107305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Getting quotas for user 3f0ed9017ec248f79881d5ff4bc00677 and project 5d94f1d324d04752a98254bb49449170. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:02:49.124357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:02:49.127543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:02:49.176717 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [ee94f617-a4a9-4739-8b59-e118b70cd9fd] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:02:50.184313 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [ee94f617-a4a9-4739-8b59-e118b70cd9fd] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 54412. Aug 25 14:02:50.191307 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-756592a2-d943-4f91-8d50-cdeaf25c8cb3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.828849 Aug 25 14:02:50.192418 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3267/6465] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:02:50.203822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72760fa6-a167-4e7c-b0bb-2511d16a4867 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:50.204460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-72760fa6-a167-4e7c-b0bb-2511d16a4867 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:50.207977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:50.209069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:50.276555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-72760fa6-a167-4e7c-b0bb-2511d16a4867 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:50.285398 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72760fa6-a167-4e7c-b0bb-2511d16a4867 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1215 microversion: 2.1 time: 0.085811 Aug 25 14:02:50.286028 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3199/6466] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:50 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:51.309238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f9586504-6c71-44d0-9632-1a5ad6271088 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:51.309985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f9586504-6c71-44d0-9632-1a5ad6271088 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:51.317280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9586504-6c71-44d0-9632-1a5ad6271088 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:51.317801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9586504-6c71-44d0-9632-1a5ad6271088 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:51.318236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9586504-6c71-44d0-9632-1a5ad6271088 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:51.318935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9586504-6c71-44d0-9632-1a5ad6271088 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:51.319457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9586504-6c71-44d0-9632-1a5ad6271088 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:51.319886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9586504-6c71-44d0-9632-1a5ad6271088 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:51.389878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f9586504-6c71-44d0-9632-1a5ad6271088 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:51.400450 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f9586504-6c71-44d0-9632-1a5ad6271088 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1267 microversion: 2.1 time: 0.095909 Aug 25 14:02:51.401200 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3268/6467] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:51 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:52.423222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c18b61fc-6c57-4443-8a35-aacf4e7ff31c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:52.424880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c18b61fc-6c57-4443-8a35-aacf4e7ff31c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:52.427947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=63 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:52.780289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c18b61fc-6c57-4443-8a35-aacf4e7ff31c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:52.780819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c18b61fc-6c57-4443-8a35-aacf4e7ff31c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:52.781632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c18b61fc-6c57-4443-8a35-aacf4e7ff31c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:52.782063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c18b61fc-6c57-4443-8a35-aacf4e7ff31c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:52.782548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c18b61fc-6c57-4443-8a35-aacf4e7ff31c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:52.783711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c18b61fc-6c57-4443-8a35-aacf4e7ff31c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:52.935354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c18b61fc-6c57-4443-8a35-aacf4e7ff31c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:52.944799 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c18b61fc-6c57-4443-8a35-aacf4e7ff31c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1315 microversion: 2.1 time: 0.526872 Aug 25 14:02:52.945387 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3200/6468] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:52 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:53.429364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-27f04fb9-db2e-4fcf-bf97-87761ebd802c req-f70fb0ac-54ce-4e5d-90f4-78af0b8fb5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3adbc1-b21f-41d3-a509-b786aa5c70ee", "tag": "7279da3e-459c-450b-97cb-c6b0d7df6899"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:53.434580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:53.443931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-27f04fb9-db2e-4fcf-bf97-87761ebd802c req-f70fb0ac-54ce-4e5d-90f4-78af0b8fb5b3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:53.444415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-27f04fb9-db2e-4fcf-bf97-87761ebd802c req-f70fb0ac-54ce-4e5d-90f4-78af0b8fb5b3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:53.444847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-27f04fb9-db2e-4fcf-bf97-87761ebd802c req-f70fb0ac-54ce-4e5d-90f4-78af0b8fb5b3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:53.448346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:53.459898 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-27f04fb9-db2e-4fcf-bf97-87761ebd802c req-f70fb0ac-54ce-4e5d-90f4-78af0b8fb5b3 service nova] Creating event network-changed:7279da3e-459c-450b-97cb-c6b0d7df6899 for instance af3adbc1-b21f-41d3-a509-b786aa5c70ee on n-h1-852771-8 Aug 25 14:02:53.465560 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-27f04fb9-db2e-4fcf-bf97-87761ebd802c req-f70fb0ac-54ce-4e5d-90f4-78af0b8fb5b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144836 Aug 25 14:02:53.466194 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3269/6469] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:53.966329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f98a8084-08ce-4241-9c60-8185bde1b44d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:53.967025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f98a8084-08ce-4241-9c60-8185bde1b44d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:53.969658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:53.976380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f98a8084-08ce-4241-9c60-8185bde1b44d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:53.976894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f98a8084-08ce-4241-9c60-8185bde1b44d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:53.977355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f98a8084-08ce-4241-9c60-8185bde1b44d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:53.978130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f98a8084-08ce-4241-9c60-8185bde1b44d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:53.978608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f98a8084-08ce-4241-9c60-8185bde1b44d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:53.979060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f98a8084-08ce-4241-9c60-8185bde1b44d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:54.118842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f98a8084-08ce-4241-9c60-8185bde1b44d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:54.127101 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f98a8084-08ce-4241-9c60-8185bde1b44d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1315 microversion: 2.1 time: 0.164165 Aug 25 14:02:54.127982 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3201/6470] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:53 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:55.152091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-74288c60-cbb6-4465-b2a3-43a1b05bc184 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:55.152823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-74288c60-cbb6-4465-b2a3-43a1b05bc184 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:55.163584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74288c60-cbb6-4465-b2a3-43a1b05bc184 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:55.164195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74288c60-cbb6-4465-b2a3-43a1b05bc184 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:55.164851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74288c60-cbb6-4465-b2a3-43a1b05bc184 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:55.165906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74288c60-cbb6-4465-b2a3-43a1b05bc184 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:55.166402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74288c60-cbb6-4465-b2a3-43a1b05bc184 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:55.166886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-74288c60-cbb6-4465-b2a3-43a1b05bc184 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:55.314022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-74288c60-cbb6-4465-b2a3-43a1b05bc184 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:55.322635 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-74288c60-cbb6-4465-b2a3-43a1b05bc184 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1315 microversion: 2.1 time: 0.177432 Aug 25 14:02:55.323207 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3270/6471] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:55 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:56.343821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-258b4b02-fa12-497b-a460-da1c86db5c47 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:56.344456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-258b4b02-fa12-497b-a460-da1c86db5c47 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:56.351769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-258b4b02-fa12-497b-a460-da1c86db5c47 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:56.352287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-258b4b02-fa12-497b-a460-da1c86db5c47 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:56.352751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-258b4b02-fa12-497b-a460-da1c86db5c47 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:56.353482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-258b4b02-fa12-497b-a460-da1c86db5c47 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:56.353999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-258b4b02-fa12-497b-a460-da1c86db5c47 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:56.354448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-258b4b02-fa12-497b-a460-da1c86db5c47 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:56.494787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-258b4b02-fa12-497b-a460-da1c86db5c47 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:56.502635 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-258b4b02-fa12-497b-a460-da1c86db5c47 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1315 microversion: 2.1 time: 0.162790 Aug 25 14:02:56.503213 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3202/6472] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:56 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:57.523922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2488ea08-e6cb-4600-b17c-e472f5ffd915 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:57.524517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2488ea08-e6cb-4600-b17c-e472f5ffd915 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:57.531455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2488ea08-e6cb-4600-b17c-e472f5ffd915 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:57.531933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2488ea08-e6cb-4600-b17c-e472f5ffd915 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:57.532368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2488ea08-e6cb-4600-b17c-e472f5ffd915 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:57.533913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2488ea08-e6cb-4600-b17c-e472f5ffd915 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:57.534671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2488ea08-e6cb-4600-b17c-e472f5ffd915 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:57.535258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2488ea08-e6cb-4600-b17c-e472f5ffd915 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:57.676860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2488ea08-e6cb-4600-b17c-e472f5ffd915 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:57.684698 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2488ea08-e6cb-4600-b17c-e472f5ffd915 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1315 microversion: 2.1 time: 0.164674 Aug 25 14:02:57.685288 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3271/6473] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:57 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:58.707607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2183d874-1a0e-4285-97d5-c164e1fde6b4 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:58.708250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2183d874-1a0e-4285-97d5-c164e1fde6b4 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:58.715262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2183d874-1a0e-4285-97d5-c164e1fde6b4 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:58.715777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2183d874-1a0e-4285-97d5-c164e1fde6b4 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:58.716237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2183d874-1a0e-4285-97d5-c164e1fde6b4 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:58.716982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2183d874-1a0e-4285-97d5-c164e1fde6b4 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:58.717455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2183d874-1a0e-4285-97d5-c164e1fde6b4 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:58.717928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2183d874-1a0e-4285-97d5-c164e1fde6b4 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:58.866479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2183d874-1a0e-4285-97d5-c164e1fde6b4 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:58.874551 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2183d874-1a0e-4285-97d5-c164e1fde6b4 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1315 microversion: 2.1 time: 0.171423 Aug 25 14:02:58.875176 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3203/6474] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:58 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:59.897223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-191c53bf-8939-4ad5-80b3-01340f990fa3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:59.898379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-191c53bf-8939-4ad5-80b3-01340f990fa3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:59.900891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:59.901499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:59.908313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-191c53bf-8939-4ad5-80b3-01340f990fa3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:59.909013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-191c53bf-8939-4ad5-80b3-01340f990fa3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:59.909487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-191c53bf-8939-4ad5-80b3-01340f990fa3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:59.910231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-191c53bf-8939-4ad5-80b3-01340f990fa3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:59.910690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-191c53bf-8939-4ad5-80b3-01340f990fa3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:59.911122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-191c53bf-8939-4ad5-80b3-01340f990fa3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:59.933864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d0546945-15ca-4f57-887f-e36dd03c020e req-5ef6a549-47b9-4b00-ab0a-c2d83ba3ce1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3adbc1-b21f-41d3-a509-b786aa5c70ee", "name": "network-vif-plugged", "status": "completed", "tag": "7279da3e-459c-450b-97cb-c6b0d7df6899"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:59.949048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d0546945-15ca-4f57-887f-e36dd03c020e req-5ef6a549-47b9-4b00-ab0a-c2d83ba3ce1f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:59.949598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d0546945-15ca-4f57-887f-e36dd03c020e req-5ef6a549-47b9-4b00-ab0a-c2d83ba3ce1f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:59.950064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d0546945-15ca-4f57-887f-e36dd03c020e req-5ef6a549-47b9-4b00-ab0a-c2d83ba3ce1f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:59.964473 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d0546945-15ca-4f57-887f-e36dd03c020e req-5ef6a549-47b9-4b00-ab0a-c2d83ba3ce1f service nova] Creating event network-vif-plugged:7279da3e-459c-450b-97cb-c6b0d7df6899 for instance af3adbc1-b21f-41d3-a509-b786aa5c70ee on n-h1-852771-8 Aug 25 14:02:59.973176 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d0546945-15ca-4f57-887f-e36dd03c020e req-5ef6a549-47b9-4b00-ab0a-c2d83ba3ce1f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043159 Aug 25 14:02:59.974083 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3204/6475] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:03:00.074131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-191c53bf-8939-4ad5-80b3-01340f990fa3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:00.082571 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-191c53bf-8939-4ad5-80b3-01340f990fa3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1315 microversion: 2.1 time: 0.189290 Aug 25 14:03:00.083180 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3272/6476] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:59 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:01.104718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9528f3c1-d804-4410-ab5c-6464a37250ed tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:01.105442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9528f3c1-d804-4410-ab5c-6464a37250ed tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:01.107666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:03:01.114735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9528f3c1-d804-4410-ab5c-6464a37250ed tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:01.115244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9528f3c1-d804-4410-ab5c-6464a37250ed tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:01.115710 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9528f3c1-d804-4410-ab5c-6464a37250ed tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:01.116461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9528f3c1-d804-4410-ab5c-6464a37250ed tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:01.116939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9528f3c1-d804-4410-ab5c-6464a37250ed tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:01.117397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9528f3c1-d804-4410-ab5c-6464a37250ed tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:01.259106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9528f3c1-d804-4410-ab5c-6464a37250ed tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:01.267694 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9528f3c1-d804-4410-ab5c-6464a37250ed tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1315 microversion: 2.1 time: 0.166634 Aug 25 14:03:01.268339 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3205/6477] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:01 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:02.288739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-59dbee07-305e-474b-9f23-3bcbe4207503 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:02.289428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-59dbee07-305e-474b-9f23-3bcbe4207503 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:02.297137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59dbee07-305e-474b-9f23-3bcbe4207503 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:02.297669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59dbee07-305e-474b-9f23-3bcbe4207503 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:02.298129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59dbee07-305e-474b-9f23-3bcbe4207503 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:02.299087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59dbee07-305e-474b-9f23-3bcbe4207503 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:02.299556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59dbee07-305e-474b-9f23-3bcbe4207503 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:02.300017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-59dbee07-305e-474b-9f23-3bcbe4207503 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:02.436297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-59dbee07-305e-474b-9f23-3bcbe4207503 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:02.446048 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-59dbee07-305e-474b-9f23-3bcbe4207503 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1503 microversion: 2.1 time: 0.161417 Aug 25 14:03:02.446630 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3273/6478] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:02 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:02.467012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:03:02.469345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:02.477101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:02.477652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:02.478125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:02.478854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:02.479337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:02.479789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:02.568649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:02.575225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Old instance type m1.heat2, new instance type m1.heat {{(pid=129059) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:03:02.582937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:03:02.583386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:03:02.583923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:03:02.584355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:03:02.584793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:03:02.698011 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7723632e-9fee-4af7-95b6-56a7bacc9a5b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "POST /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee/action" status: 202 len: 0 microversion: 2.1 time: 0.234788 Aug 25 14:03:02.699204 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3206/6479] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:03:02 2022] POST /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:03:02.708346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1daccae4-8535-4e42-81d6-b818023cbf7d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:02.709092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1daccae4-8535-4e42-81d6-b818023cbf7d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:02.714991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1daccae4-8535-4e42-81d6-b818023cbf7d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:02.715481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1daccae4-8535-4e42-81d6-b818023cbf7d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:02.715923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1daccae4-8535-4e42-81d6-b818023cbf7d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:02.716625 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1daccae4-8535-4e42-81d6-b818023cbf7d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:02.717083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1daccae4-8535-4e42-81d6-b818023cbf7d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:02.717549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1daccae4-8535-4e42-81d6-b818023cbf7d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:02.862009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1daccae4-8535-4e42-81d6-b818023cbf7d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:02.871284 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1daccae4-8535-4e42-81d6-b818023cbf7d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1512 microversion: 2.1 time: 0.167331 Aug 25 14:03:02.871891 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3274/6480] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:02 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:03.895242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d184c91d-63b1-4c88-a822-0fae3f4c04f2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:03.895784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d184c91d-63b1-4c88-a822-0fae3f4c04f2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:03.902812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d184c91d-63b1-4c88-a822-0fae3f4c04f2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:03.903321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d184c91d-63b1-4c88-a822-0fae3f4c04f2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:03.903781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d184c91d-63b1-4c88-a822-0fae3f4c04f2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:03.904499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d184c91d-63b1-4c88-a822-0fae3f4c04f2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:03.905015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d184c91d-63b1-4c88-a822-0fae3f4c04f2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:03.905441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d184c91d-63b1-4c88-a822-0fae3f4c04f2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:04.046918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d184c91d-63b1-4c88-a822-0fae3f4c04f2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:04.055181 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d184c91d-63b1-4c88-a822-0fae3f4c04f2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1512 microversion: 2.1 time: 0.164878 Aug 25 14:03:04.055782 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3207/6481] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:03 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:05.076499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f174f4c-f47a-4804-a1af-8979eb6ddcd2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:05.077106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f174f4c-f47a-4804-a1af-8979eb6ddcd2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:05.084780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f174f4c-f47a-4804-a1af-8979eb6ddcd2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:05.085286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f174f4c-f47a-4804-a1af-8979eb6ddcd2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:05.085746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f174f4c-f47a-4804-a1af-8979eb6ddcd2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:05.086438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f174f4c-f47a-4804-a1af-8979eb6ddcd2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:05.086888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f174f4c-f47a-4804-a1af-8979eb6ddcd2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:05.087310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f174f4c-f47a-4804-a1af-8979eb6ddcd2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:05.233033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f174f4c-f47a-4804-a1af-8979eb6ddcd2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:05.241136 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f174f4c-f47a-4804-a1af-8979eb6ddcd2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.168586 Aug 25 14:03:05.241754 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3275/6482] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:05 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:06.263668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f2d7c2c3-648f-4224-a5a0-288acf20211b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:06.264314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f2d7c2c3-648f-4224-a5a0-288acf20211b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:06.271656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2d7c2c3-648f-4224-a5a0-288acf20211b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:06.272189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2d7c2c3-648f-4224-a5a0-288acf20211b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:06.272640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2d7c2c3-648f-4224-a5a0-288acf20211b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:06.273375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2d7c2c3-648f-4224-a5a0-288acf20211b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:06.273884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2d7c2c3-648f-4224-a5a0-288acf20211b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:06.274348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f2d7c2c3-648f-4224-a5a0-288acf20211b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:06.418083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f2d7c2c3-648f-4224-a5a0-288acf20211b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:06.427319 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f2d7c2c3-648f-4224-a5a0-288acf20211b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.167686 Aug 25 14:03:06.427998 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3208/6483] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:06 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:07.449887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eb13a89d-5164-417f-8823-083c03235076 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:07.450495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eb13a89d-5164-417f-8823-083c03235076 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:07.457731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb13a89d-5164-417f-8823-083c03235076 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:07.458229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb13a89d-5164-417f-8823-083c03235076 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:07.458674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb13a89d-5164-417f-8823-083c03235076 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:07.459395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb13a89d-5164-417f-8823-083c03235076 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:07.459860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb13a89d-5164-417f-8823-083c03235076 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:07.460285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb13a89d-5164-417f-8823-083c03235076 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:07.601267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eb13a89d-5164-417f-8823-083c03235076 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:07.609240 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eb13a89d-5164-417f-8823-083c03235076 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.163317 Aug 25 14:03:07.609841 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3276/6484] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:07 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:08.632017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dc5ada84-3252-4aaa-b185-65326b33e1ab tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:08.632659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dc5ada84-3252-4aaa-b185-65326b33e1ab tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:08.639847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc5ada84-3252-4aaa-b185-65326b33e1ab tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:08.640392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc5ada84-3252-4aaa-b185-65326b33e1ab tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:08.640874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc5ada84-3252-4aaa-b185-65326b33e1ab tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:08.641643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc5ada84-3252-4aaa-b185-65326b33e1ab tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:08.642134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc5ada84-3252-4aaa-b185-65326b33e1ab tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:08.642597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc5ada84-3252-4aaa-b185-65326b33e1ab tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:08.778325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dc5ada84-3252-4aaa-b185-65326b33e1ab tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:08.786882 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dc5ada84-3252-4aaa-b185-65326b33e1ab tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.159068 Aug 25 14:03:08.787463 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3209/6485] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:08 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:09.808954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec0cd081-b74f-407d-8609-c3658811f1e5 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:09.809485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec0cd081-b74f-407d-8609-c3658811f1e5 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:09.817207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec0cd081-b74f-407d-8609-c3658811f1e5 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:09.817719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec0cd081-b74f-407d-8609-c3658811f1e5 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:09.818157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec0cd081-b74f-407d-8609-c3658811f1e5 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:09.818853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec0cd081-b74f-407d-8609-c3658811f1e5 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:09.819307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec0cd081-b74f-407d-8609-c3658811f1e5 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:09.819747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec0cd081-b74f-407d-8609-c3658811f1e5 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:09.958273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec0cd081-b74f-407d-8609-c3658811f1e5 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:09.966076 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ec0cd081-b74f-407d-8609-c3658811f1e5 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.161138 Aug 25 14:03:09.966652 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3277/6486] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:09 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:10.988518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b51df71-6bf4-42ce-aadc-d411f1f2dd1d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:10.989310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b51df71-6bf4-42ce-aadc-d411f1f2dd1d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:10.996887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b51df71-6bf4-42ce-aadc-d411f1f2dd1d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:10.997438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b51df71-6bf4-42ce-aadc-d411f1f2dd1d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:10.997932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b51df71-6bf4-42ce-aadc-d411f1f2dd1d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:10.998734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b51df71-6bf4-42ce-aadc-d411f1f2dd1d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:10.999210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b51df71-6bf4-42ce-aadc-d411f1f2dd1d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:10.999662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b51df71-6bf4-42ce-aadc-d411f1f2dd1d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:11.138280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b51df71-6bf4-42ce-aadc-d411f1f2dd1d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:11.146972 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b51df71-6bf4-42ce-aadc-d411f1f2dd1d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.163275 Aug 25 14:03:11.147569 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3210/6487] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:10 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:12.168228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc3a2c9d-b933-4b79-b283-b2f9bbe049a1 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:12.169017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fc3a2c9d-b933-4b79-b283-b2f9bbe049a1 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:12.177032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc3a2c9d-b933-4b79-b283-b2f9bbe049a1 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:12.177547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc3a2c9d-b933-4b79-b283-b2f9bbe049a1 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:12.178000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc3a2c9d-b933-4b79-b283-b2f9bbe049a1 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:12.178704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc3a2c9d-b933-4b79-b283-b2f9bbe049a1 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:12.179162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc3a2c9d-b933-4b79-b283-b2f9bbe049a1 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:12.179593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc3a2c9d-b933-4b79-b283-b2f9bbe049a1 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:12.319270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc3a2c9d-b933-4b79-b283-b2f9bbe049a1 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:12.327174 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fc3a2c9d-b933-4b79-b283-b2f9bbe049a1 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.162867 Aug 25 14:03:12.327755 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3278/6488] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:12 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:13.348998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-23884a71-cc0f-4a9c-9813-01a7a92a953c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:13.349674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-23884a71-cc0f-4a9c-9813-01a7a92a953c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:13.356671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23884a71-cc0f-4a9c-9813-01a7a92a953c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:13.357170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23884a71-cc0f-4a9c-9813-01a7a92a953c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:13.357652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23884a71-cc0f-4a9c-9813-01a7a92a953c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:13.358371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23884a71-cc0f-4a9c-9813-01a7a92a953c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:13.358844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23884a71-cc0f-4a9c-9813-01a7a92a953c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:13.359291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23884a71-cc0f-4a9c-9813-01a7a92a953c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:13.498862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-23884a71-cc0f-4a9c-9813-01a7a92a953c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:13.507556 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-23884a71-cc0f-4a9c-9813-01a7a92a953c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.163057 Aug 25 14:03:13.508155 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3211/6489] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:13 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:14.529904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f9b65ca-2463-4408-980b-a8399b2bdfc3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:14.530544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f9b65ca-2463-4408-980b-a8399b2bdfc3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:14.537828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9b65ca-2463-4408-980b-a8399b2bdfc3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:14.538320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9b65ca-2463-4408-980b-a8399b2bdfc3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:14.538766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9b65ca-2463-4408-980b-a8399b2bdfc3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:14.539478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9b65ca-2463-4408-980b-a8399b2bdfc3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:14.539937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9b65ca-2463-4408-980b-a8399b2bdfc3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:14.540369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f9b65ca-2463-4408-980b-a8399b2bdfc3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:14.680939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f9b65ca-2463-4408-980b-a8399b2bdfc3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:14.689423 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f9b65ca-2463-4408-980b-a8399b2bdfc3 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.163620 Aug 25 14:03:14.690053 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3279/6490] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:14 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:15.711410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-80f80b40-bf85-4388-86aa-f14408557f48 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:15.712203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-80f80b40-bf85-4388-86aa-f14408557f48 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:15.715412 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:03:15.715564 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:03:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee (ip 10.222.0.70) !!! Aug 25 14:03:15.724436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80f80b40-bf85-4388-86aa-f14408557f48 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:15.724950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80f80b40-bf85-4388-86aa-f14408557f48 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:15.725414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80f80b40-bf85-4388-86aa-f14408557f48 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:15.726181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80f80b40-bf85-4388-86aa-f14408557f48 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:15.726655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80f80b40-bf85-4388-86aa-f14408557f48 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:15.727135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-80f80b40-bf85-4388-86aa-f14408557f48 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:15.870638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-80f80b40-bf85-4388-86aa-f14408557f48 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:15.879276 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-80f80b40-bf85-4388-86aa-f14408557f48 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.171795 Aug 25 14:03:15.880084 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3212/6491] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:15 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:16.901082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70032599-d0ed-41e9-80ee-ac0d048a81d2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:16.901722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70032599-d0ed-41e9-80ee-ac0d048a81d2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:16.909519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70032599-d0ed-41e9-80ee-ac0d048a81d2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:16.910026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70032599-d0ed-41e9-80ee-ac0d048a81d2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:16.910520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70032599-d0ed-41e9-80ee-ac0d048a81d2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:16.911354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70032599-d0ed-41e9-80ee-ac0d048a81d2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:16.911812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70032599-d0ed-41e9-80ee-ac0d048a81d2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:16.912237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70032599-d0ed-41e9-80ee-ac0d048a81d2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:17.062117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70032599-d0ed-41e9-80ee-ac0d048a81d2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:17.070611 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70032599-d0ed-41e9-80ee-ac0d048a81d2 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.173347 Aug 25 14:03:17.071105 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3280/6492] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:16 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:03:18.090807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00aea94c-6d41-40aa-a6f7-f5b4f31e6a7f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:18.091434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-00aea94c-6d41-40aa-a6f7-f5b4f31e6a7f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:18.099354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00aea94c-6d41-40aa-a6f7-f5b4f31e6a7f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:18.100135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00aea94c-6d41-40aa-a6f7-f5b4f31e6a7f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:18.100600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00aea94c-6d41-40aa-a6f7-f5b4f31e6a7f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:18.101415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00aea94c-6d41-40aa-a6f7-f5b4f31e6a7f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:18.101825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00aea94c-6d41-40aa-a6f7-f5b4f31e6a7f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:18.102276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00aea94c-6d41-40aa-a6f7-f5b4f31e6a7f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:18.238224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-00aea94c-6d41-40aa-a6f7-f5b4f31e6a7f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:18.247170 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-00aea94c-6d41-40aa-a6f7-f5b4f31e6a7f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.160231 Aug 25 14:03:18.247756 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3213/6493] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:18 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:19.269198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b89ed34a-0253-4367-bd5b-1e4890fc1963 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:19.270587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b89ed34a-0253-4367-bd5b-1e4890fc1963 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:19.277962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b89ed34a-0253-4367-bd5b-1e4890fc1963 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:19.278453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b89ed34a-0253-4367-bd5b-1e4890fc1963 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:19.278893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b89ed34a-0253-4367-bd5b-1e4890fc1963 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:19.279593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b89ed34a-0253-4367-bd5b-1e4890fc1963 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:19.280048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b89ed34a-0253-4367-bd5b-1e4890fc1963 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:19.280476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b89ed34a-0253-4367-bd5b-1e4890fc1963 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:19.424211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b89ed34a-0253-4367-bd5b-1e4890fc1963 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:19.432624 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b89ed34a-0253-4367-bd5b-1e4890fc1963 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.167388 Aug 25 14:03:19.433226 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3281/6494] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:19 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:20.455210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8a1c72bd-a3a0-4735-a453-5c4200bdde53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:20.455764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8a1c72bd-a3a0-4735-a453-5c4200bdde53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:20.463401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a1c72bd-a3a0-4735-a453-5c4200bdde53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:20.463909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a1c72bd-a3a0-4735-a453-5c4200bdde53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:20.464398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a1c72bd-a3a0-4735-a453-5c4200bdde53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:20.465088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a1c72bd-a3a0-4735-a453-5c4200bdde53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:20.465586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a1c72bd-a3a0-4735-a453-5c4200bdde53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:20.466122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8a1c72bd-a3a0-4735-a453-5c4200bdde53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:20.604615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8a1c72bd-a3a0-4735-a453-5c4200bdde53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:20.612631 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8a1c72bd-a3a0-4735-a453-5c4200bdde53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.161584 Aug 25 14:03:20.613223 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3214/6495] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:20 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:21.635229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1bad2bd0-465d-4a42-a5a7-6f4d869bc2fd tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:21.635849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1bad2bd0-465d-4a42-a5a7-6f4d869bc2fd tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:21.643359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bad2bd0-465d-4a42-a5a7-6f4d869bc2fd tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:21.643851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bad2bd0-465d-4a42-a5a7-6f4d869bc2fd tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:21.644289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bad2bd0-465d-4a42-a5a7-6f4d869bc2fd tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:21.645731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bad2bd0-465d-4a42-a5a7-6f4d869bc2fd tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:21.646564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bad2bd0-465d-4a42-a5a7-6f4d869bc2fd tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:21.647157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1bad2bd0-465d-4a42-a5a7-6f4d869bc2fd tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:21.797463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1bad2bd0-465d-4a42-a5a7-6f4d869bc2fd tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:21.806733 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1bad2bd0-465d-4a42-a5a7-6f4d869bc2fd tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.175293 Aug 25 14:03:21.807331 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3282/6496] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:21 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:22.828410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0e09cda8-7017-4ce6-ad55-c633a93fbb53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:22.829061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0e09cda8-7017-4ce6-ad55-c633a93fbb53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:22.837111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e09cda8-7017-4ce6-ad55-c633a93fbb53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:22.837731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e09cda8-7017-4ce6-ad55-c633a93fbb53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:22.838215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e09cda8-7017-4ce6-ad55-c633a93fbb53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:22.838939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e09cda8-7017-4ce6-ad55-c633a93fbb53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:22.839419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e09cda8-7017-4ce6-ad55-c633a93fbb53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:22.839874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0e09cda8-7017-4ce6-ad55-c633a93fbb53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:22.842895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:03:22.984998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0e09cda8-7017-4ce6-ad55-c633a93fbb53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:22.994075 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0e09cda8-7017-4ce6-ad55-c633a93fbb53 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.169571 Aug 25 14:03:22.994677 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3215/6497] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:22 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:03:24.015522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c70bb5d3-4828-4aea-8a76-5fa89b8d771c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:24.016432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c70bb5d3-4828-4aea-8a76-5fa89b8d771c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:24.024415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c70bb5d3-4828-4aea-8a76-5fa89b8d771c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:24.025001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c70bb5d3-4828-4aea-8a76-5fa89b8d771c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:24.025564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c70bb5d3-4828-4aea-8a76-5fa89b8d771c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:24.026246 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c70bb5d3-4828-4aea-8a76-5fa89b8d771c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:24.026724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c70bb5d3-4828-4aea-8a76-5fa89b8d771c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:24.027213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c70bb5d3-4828-4aea-8a76-5fa89b8d771c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:24.169046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c70bb5d3-4828-4aea-8a76-5fa89b8d771c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:24.177827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c70bb5d3-4828-4aea-8a76-5fa89b8d771c tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.166127 Aug 25 14:03:24.178426 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3283/6498] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:24 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:25.199658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-181c1ba7-e57e-47a2-a357-b5b401734d23 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:25.200294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-181c1ba7-e57e-47a2-a357-b5b401734d23 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:25.203075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=34 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:03:25.208528 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-181c1ba7-e57e-47a2-a357-b5b401734d23 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:25.209061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-181c1ba7-e57e-47a2-a357-b5b401734d23 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:25.209551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-181c1ba7-e57e-47a2-a357-b5b401734d23 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:25.210287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-181c1ba7-e57e-47a2-a357-b5b401734d23 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:25.210764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-181c1ba7-e57e-47a2-a357-b5b401734d23 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:25.211323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-181c1ba7-e57e-47a2-a357-b5b401734d23 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:25.347575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-181c1ba7-e57e-47a2-a357-b5b401734d23 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:25.357525 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-181c1ba7-e57e-47a2-a357-b5b401734d23 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.161764 Aug 25 14:03:25.358146 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3216/6499] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:25 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:03:26.378888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2ef9c53-1a71-4c78-9273-e32cdec3106a tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:26.379768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e2ef9c53-1a71-4c78-9273-e32cdec3106a tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:26.384515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=30 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:03:26.390722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ef9c53-1a71-4c78-9273-e32cdec3106a tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:26.391206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ef9c53-1a71-4c78-9273-e32cdec3106a tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:26.391641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ef9c53-1a71-4c78-9273-e32cdec3106a tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:26.392336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ef9c53-1a71-4c78-9273-e32cdec3106a tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:26.392789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ef9c53-1a71-4c78-9273-e32cdec3106a tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:26.393211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ef9c53-1a71-4c78-9273-e32cdec3106a tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:26.395942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=86 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:03:26.539330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2ef9c53-1a71-4c78-9273-e32cdec3106a tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:26.547746 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e2ef9c53-1a71-4c78-9273-e32cdec3106a tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.172754 Aug 25 14:03:26.548619 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3284/6500] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:26 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:27.572412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b98e1f8-2b6b-449e-92cf-ed88cadbb980 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:27.573115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b98e1f8-2b6b-449e-92cf-ed88cadbb980 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:27.580118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b98e1f8-2b6b-449e-92cf-ed88cadbb980 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:27.580627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b98e1f8-2b6b-449e-92cf-ed88cadbb980 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:27.581120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b98e1f8-2b6b-449e-92cf-ed88cadbb980 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:27.581891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b98e1f8-2b6b-449e-92cf-ed88cadbb980 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:27.582399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b98e1f8-2b6b-449e-92cf-ed88cadbb980 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:27.582845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b98e1f8-2b6b-449e-92cf-ed88cadbb980 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:27.726376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b98e1f8-2b6b-449e-92cf-ed88cadbb980 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:27.735191 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b98e1f8-2b6b-449e-92cf-ed88cadbb980 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.167175 Aug 25 14:03:27.735782 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3217/6501] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:27 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:28.756679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cae7d70d-6cee-486c-89f2-35cd419bc212 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:28.757316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cae7d70d-6cee-486c-89f2-35cd419bc212 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:28.764659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae7d70d-6cee-486c-89f2-35cd419bc212 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:28.765137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae7d70d-6cee-486c-89f2-35cd419bc212 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:28.765589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae7d70d-6cee-486c-89f2-35cd419bc212 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:28.766354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae7d70d-6cee-486c-89f2-35cd419bc212 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:28.766735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae7d70d-6cee-486c-89f2-35cd419bc212 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:28.767156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cae7d70d-6cee-486c-89f2-35cd419bc212 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:28.908579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cae7d70d-6cee-486c-89f2-35cd419bc212 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:28.917954 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cae7d70d-6cee-486c-89f2-35cd419bc212 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.165295 Aug 25 14:03:28.918547 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3285/6502] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:28 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:29.940256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7a31fb82-10b9-4897-86db-da333fd0565b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:29.941159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7a31fb82-10b9-4897-86db-da333fd0565b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:29.948273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a31fb82-10b9-4897-86db-da333fd0565b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:29.948784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a31fb82-10b9-4897-86db-da333fd0565b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:29.949243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a31fb82-10b9-4897-86db-da333fd0565b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:29.950015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a31fb82-10b9-4897-86db-da333fd0565b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:29.950494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a31fb82-10b9-4897-86db-da333fd0565b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:29.950945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7a31fb82-10b9-4897-86db-da333fd0565b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:30.094274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7a31fb82-10b9-4897-86db-da333fd0565b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:30.104649 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7a31fb82-10b9-4897-86db-da333fd0565b tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.168283 Aug 25 14:03:30.105589 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3218/6503] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:29 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:31.127030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0ed07c6f-dfcf-4c99-9289-ba54c8ca43ca tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:31.127751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0ed07c6f-dfcf-4c99-9289-ba54c8ca43ca tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:31.135816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ed07c6f-dfcf-4c99-9289-ba54c8ca43ca tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:31.136314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ed07c6f-dfcf-4c99-9289-ba54c8ca43ca tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:31.136760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ed07c6f-dfcf-4c99-9289-ba54c8ca43ca tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:31.137486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ed07c6f-dfcf-4c99-9289-ba54c8ca43ca tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:31.137979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ed07c6f-dfcf-4c99-9289-ba54c8ca43ca tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:31.138406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ed07c6f-dfcf-4c99-9289-ba54c8ca43ca tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:31.286775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ed07c6f-dfcf-4c99-9289-ba54c8ca43ca tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:31.296485 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0ed07c6f-dfcf-4c99-9289-ba54c8ca43ca tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1517 microversion: 2.1 time: 0.173766 Aug 25 14:03:31.297083 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3286/6504] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:31 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:32.318763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-475ee612-044d-42e8-b103-d7331941dd72 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:32.320104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-475ee612-044d-42e8-b103-d7331941dd72 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:32.327242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475ee612-044d-42e8-b103-d7331941dd72 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:32.327876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475ee612-044d-42e8-b103-d7331941dd72 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:32.328387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475ee612-044d-42e8-b103-d7331941dd72 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:32.329350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475ee612-044d-42e8-b103-d7331941dd72 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:32.330036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475ee612-044d-42e8-b103-d7331941dd72 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:32.330524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-475ee612-044d-42e8-b103-d7331941dd72 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:32.355691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c5e5912d-653d-4895-b4e6-888214b310c8 req-42ec88cf-d2ae-4b75-a7cc-0456eb27210b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3adbc1-b21f-41d3-a509-b786aa5c70ee", "name": "network-vif-unplugged", "status": "completed", "tag": "7279da3e-459c-450b-97cb-c6b0d7df6899"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:03:32.368210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c5e5912d-653d-4895-b4e6-888214b310c8 req-42ec88cf-d2ae-4b75-a7cc-0456eb27210b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:32.368828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c5e5912d-653d-4895-b4e6-888214b310c8 req-42ec88cf-d2ae-4b75-a7cc-0456eb27210b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:32.369349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c5e5912d-653d-4895-b4e6-888214b310c8 req-42ec88cf-d2ae-4b75-a7cc-0456eb27210b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:32.385393 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c5e5912d-653d-4895-b4e6-888214b310c8 req-42ec88cf-d2ae-4b75-a7cc-0456eb27210b service nova] Creating event network-vif-unplugged:7279da3e-459c-450b-97cb-c6b0d7df6899 for instance af3adbc1-b21f-41d3-a509-b786aa5c70ee on n-h2-852771-8 Aug 25 14:03:32.392501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-c5e5912d-653d-4895-b4e6-888214b310c8 req-42ec88cf-d2ae-4b75-a7cc-0456eb27210b service nova] Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:03:32.407143 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c5e5912d-653d-4895-b4e6-888214b310c8 req-42ec88cf-d2ae-4b75-a7cc-0456eb27210b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055092 Aug 25 14:03:32.408070 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3287/6505] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:03:32.542105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-475ee612-044d-42e8-b103-d7331941dd72 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:32.554480 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-475ee612-044d-42e8-b103-d7331941dd72 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1516 microversion: 2.1 time: 0.240495 Aug 25 14:03:32.567809 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3219/6506] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:32 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1516 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:33.578850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c763fb1-8a69-4937-bc24-4527df448cc8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:33.579615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1c763fb1-8a69-4937-bc24-4527df448cc8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:33.586967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c763fb1-8a69-4937-bc24-4527df448cc8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:33.587310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c763fb1-8a69-4937-bc24-4527df448cc8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:33.587758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c763fb1-8a69-4937-bc24-4527df448cc8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:33.588473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c763fb1-8a69-4937-bc24-4527df448cc8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:33.588937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c763fb1-8a69-4937-bc24-4527df448cc8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:33.589373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c763fb1-8a69-4937-bc24-4527df448cc8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:33.736537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1c763fb1-8a69-4937-bc24-4527df448cc8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:33.745338 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1c763fb1-8a69-4937-bc24-4527df448cc8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1514 microversion: 2.1 time: 0.171557 Aug 25 14:03:33.745945 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3288/6507] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:33 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:34.452872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-befcadfc-dd98-42eb-9615-71aecd64e633 req-094e2550-c057-4558-bb7b-36b5e7410a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3adbc1-b21f-41d3-a509-b786aa5c70ee", "tag": "7279da3e-459c-450b-97cb-c6b0d7df6899"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:03:34.463907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-befcadfc-dd98-42eb-9615-71aecd64e633 req-094e2550-c057-4558-bb7b-36b5e7410a37 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:34.464518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-befcadfc-dd98-42eb-9615-71aecd64e633 req-094e2550-c057-4558-bb7b-36b5e7410a37 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:34.464971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-befcadfc-dd98-42eb-9615-71aecd64e633 req-094e2550-c057-4558-bb7b-36b5e7410a37 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:34.477246 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-befcadfc-dd98-42eb-9615-71aecd64e633 req-094e2550-c057-4558-bb7b-36b5e7410a37 service nova] Creating event network-changed:7279da3e-459c-450b-97cb-c6b0d7df6899 for instance af3adbc1-b21f-41d3-a509-b786aa5c70ee on n-h2-852771-8 Aug 25 14:03:34.482839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-befcadfc-dd98-42eb-9615-71aecd64e633 req-094e2550-c057-4558-bb7b-36b5e7410a37 service nova] Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:03:34.493957 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-befcadfc-dd98-42eb-9615-71aecd64e633 req-094e2550-c057-4558-bb7b-36b5e7410a37 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044842 Aug 25 14:03:34.494572 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3220/6508] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:03:34.766750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d25cf953-0699-4c3b-88a6-9112097b2dbf tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:34.768224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d25cf953-0699-4c3b-88a6-9112097b2dbf tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:34.776489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d25cf953-0699-4c3b-88a6-9112097b2dbf tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:34.776991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d25cf953-0699-4c3b-88a6-9112097b2dbf tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:34.777434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d25cf953-0699-4c3b-88a6-9112097b2dbf tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:34.778214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d25cf953-0699-4c3b-88a6-9112097b2dbf tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:34.778680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d25cf953-0699-4c3b-88a6-9112097b2dbf tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:34.779111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d25cf953-0699-4c3b-88a6-9112097b2dbf tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:34.965565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d25cf953-0699-4c3b-88a6-9112097b2dbf tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:34.973466 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d25cf953-0699-4c3b-88a6-9112097b2dbf tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1514 microversion: 2.1 time: 0.210648 Aug 25 14:03:34.974070 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3289/6509] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:34 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:35.996175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-522b6500-fbd7-4bad-b427-34d022d1c0c8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:35.996897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-522b6500-fbd7-4bad-b427-34d022d1c0c8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:36.004644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522b6500-fbd7-4bad-b427-34d022d1c0c8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:36.005188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522b6500-fbd7-4bad-b427-34d022d1c0c8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:36.005677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522b6500-fbd7-4bad-b427-34d022d1c0c8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:36.006413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522b6500-fbd7-4bad-b427-34d022d1c0c8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:36.006900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522b6500-fbd7-4bad-b427-34d022d1c0c8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:36.007406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522b6500-fbd7-4bad-b427-34d022d1c0c8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:36.167035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-522b6500-fbd7-4bad-b427-34d022d1c0c8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:36.176310 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-522b6500-fbd7-4bad-b427-34d022d1c0c8 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1514 microversion: 2.1 time: 0.185198 Aug 25 14:03:36.176919 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3221/6510] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:35 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:37.199405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2902bfd5-f7e6-4b0e-bc55-9244a9dec729 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:37.200018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2902bfd5-f7e6-4b0e-bc55-9244a9dec729 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:37.207164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2902bfd5-f7e6-4b0e-bc55-9244a9dec729 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:37.207659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2902bfd5-f7e6-4b0e-bc55-9244a9dec729 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:37.208098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2902bfd5-f7e6-4b0e-bc55-9244a9dec729 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:37.208807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2902bfd5-f7e6-4b0e-bc55-9244a9dec729 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:37.209264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2902bfd5-f7e6-4b0e-bc55-9244a9dec729 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:37.209727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2902bfd5-f7e6-4b0e-bc55-9244a9dec729 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:37.379875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2902bfd5-f7e6-4b0e-bc55-9244a9dec729 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:37.389218 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2902bfd5-f7e6-4b0e-bc55-9244a9dec729 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1511 microversion: 2.1 time: 0.194479 Aug 25 14:03:37.390174 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3290/6511] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:37 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:37.412443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:37.413604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:37.420750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:37.421270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:37.421842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:37.422610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:37.423098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:37.423547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:37.455804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:03:37.519336 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.compute.api [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Found an unconfirmed migration during delete, id: 16, status: finished Aug 25 14:03:39.015350 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-149d6475-a78a-4c35-ba5b-0edf11d393d6 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 204 len: 0 microversion: 2.1 time: 1.607489 Aug 25 14:03:39.016168 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3222/6512] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:03:37 2022] DELETE /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 0 bytes in 1609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:03:39.026218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dd9e45f9-bc9e-48e0-a340-fed4a1db6139 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:39.026879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dd9e45f9-bc9e-48e0-a340-fed4a1db6139 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:39.034335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9e45f9-bc9e-48e0-a340-fed4a1db6139 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:39.034824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9e45f9-bc9e-48e0-a340-fed4a1db6139 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:39.035266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9e45f9-bc9e-48e0-a340-fed4a1db6139 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:39.035973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9e45f9-bc9e-48e0-a340-fed4a1db6139 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:39.036439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9e45f9-bc9e-48e0-a340-fed4a1db6139 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:39.036859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dd9e45f9-bc9e-48e0-a340-fed4a1db6139 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:39.177279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dd9e45f9-bc9e-48e0-a340-fed4a1db6139 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:39.186159 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dd9e45f9-bc9e-48e0-a340-fed4a1db6139 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1503 microversion: 2.1 time: 0.165024 Aug 25 14:03:39.186772 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3291/6513] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:39 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:03:39.400883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-35de33aa-072f-477e-aa04-37602f7a52d9 req-8ad0ec31-fc62-4616-a83c-91537d8a3835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3adbc1-b21f-41d3-a509-b786aa5c70ee", "name": "network-vif-plugged", "status": "completed", "tag": "7279da3e-459c-450b-97cb-c6b0d7df6899"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:03:39.411571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-35de33aa-072f-477e-aa04-37602f7a52d9 req-8ad0ec31-fc62-4616-a83c-91537d8a3835 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:39.412107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-35de33aa-072f-477e-aa04-37602f7a52d9 req-8ad0ec31-fc62-4616-a83c-91537d8a3835 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:39.412567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-35de33aa-072f-477e-aa04-37602f7a52d9 req-8ad0ec31-fc62-4616-a83c-91537d8a3835 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:39.425219 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-35de33aa-072f-477e-aa04-37602f7a52d9 req-8ad0ec31-fc62-4616-a83c-91537d8a3835 service nova] Creating event network-vif-plugged:7279da3e-459c-450b-97cb-c6b0d7df6899 for instance af3adbc1-b21f-41d3-a509-b786aa5c70ee on n-h2-852771-8 Aug 25 14:03:39.430953 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-35de33aa-072f-477e-aa04-37602f7a52d9 req-8ad0ec31-fc62-4616-a83c-91537d8a3835 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034488 Aug 25 14:03:39.431582 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3223/6514] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:03:40.208338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d88a6fd8-e206-411f-8925-92b946bbbb4f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:40.208994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d88a6fd8-e206-411f-8925-92b946bbbb4f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:40.216670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88a6fd8-e206-411f-8925-92b946bbbb4f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:40.217152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88a6fd8-e206-411f-8925-92b946bbbb4f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:40.218511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88a6fd8-e206-411f-8925-92b946bbbb4f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:40.218511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88a6fd8-e206-411f-8925-92b946bbbb4f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:40.218972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88a6fd8-e206-411f-8925-92b946bbbb4f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:40.219164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d88a6fd8-e206-411f-8925-92b946bbbb4f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:40.370531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d88a6fd8-e206-411f-8925-92b946bbbb4f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:40.379594 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d88a6fd8-e206-411f-8925-92b946bbbb4f tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1503 microversion: 2.1 time: 0.175086 Aug 25 14:03:40.380183 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3292/6515] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:40 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:41.354540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-8e6738f6-fd40-473c-9012-46a75c0ea4cd req-490cb33e-6179-477d-84c7-41000e234790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3adbc1-b21f-41d3-a509-b786aa5c70ee", "name": "network-vif-deleted", "tag": "7279da3e-459c-450b-97cb-c6b0d7df6899"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:03:41.365000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8e6738f6-fd40-473c-9012-46a75c0ea4cd req-490cb33e-6179-477d-84c7-41000e234790 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:41.365524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8e6738f6-fd40-473c-9012-46a75c0ea4cd req-490cb33e-6179-477d-84c7-41000e234790 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:41.365979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-8e6738f6-fd40-473c-9012-46a75c0ea4cd req-490cb33e-6179-477d-84c7-41000e234790 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:41.378807 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-8e6738f6-fd40-473c-9012-46a75c0ea4cd req-490cb33e-6179-477d-84c7-41000e234790 service nova] Creating event network-vif-deleted:7279da3e-459c-450b-97cb-c6b0d7df6899 for instance af3adbc1-b21f-41d3-a509-b786aa5c70ee on n-h2-852771-8 Aug 25 14:03:41.384860 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-8e6738f6-fd40-473c-9012-46a75c0ea4cd req-490cb33e-6179-477d-84c7-41000e234790 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035523 Aug 25 14:03:41.385860 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3224/6516] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:03:41.403846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c79d79d-acd8-4eac-97d9-47e299300906 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:41.404545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9c79d79d-acd8-4eac-97d9-47e299300906 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:41.411986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c79d79d-acd8-4eac-97d9-47e299300906 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:41.412476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c79d79d-acd8-4eac-97d9-47e299300906 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:41.412933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c79d79d-acd8-4eac-97d9-47e299300906 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:41.413776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c79d79d-acd8-4eac-97d9-47e299300906 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:41.414155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c79d79d-acd8-4eac-97d9-47e299300906 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:41.414678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c79d79d-acd8-4eac-97d9-47e299300906 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:41.513945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9c79d79d-acd8-4eac-97d9-47e299300906 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ed9017ec248f79881d5ff4bc00677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d94f1d324d04752a98254bb49449170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:41.527394 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c79d79d-acd8-4eac-97d9-47e299300906 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 200 len: 1294 microversion: 2.1 time: 0.128289 Aug 25 14:03:41.528035 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3293/6517] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:41 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 1294 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:03:42.551469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:42.552195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:42.559000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:42.559521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:42.559980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:42.560703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:42.561192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:42.561674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:42.576368 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] HTTP exception thrown: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Request method failure captured: Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee HTTP/1.1 Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4EIQ61Q253_Ro7s64JmNv88uemvuMHxMAY45679UuFTP_RJ6COh_KFXlqwBDibcfa6gnq4x68VyY7_ZEBZrRyKAfm4U1lWcbazC7dLa4C5_B7fiIR_vMrtPI8fFYDjojdVhKtfk4m_uFBGO0ab4DvZtfBLDZu8-6I4uIFTo02C8xaM Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5d94f1d324d04752a98254bb49449170 Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1450167055 Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d94f1d324d04752a98254bb49449170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d94f1d324d04752a98254bb49449170", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d94f1d324d04752a98254bb49449170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d94f1d324d04752a98254bb49449170"}]}] Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1450167055 Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5d94f1d324d04752a98254bb49449170 Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1450167055 Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1450167055-project Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3f0ed9017ec248f79881d5ff4bc00677 Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1450167055-project Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'af3adbc1-b21f-41d3-a509-b786aa5c70ee'} Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:03:42.578118 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.583491 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:03:42.583491 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:03:42.583491 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:03:42.583491 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:03:42.583491 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:03:42.583491 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.583491 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.583491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Returning 404 to user: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:03:42.583491 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cba27954-f70b-4864-9da9-ef3f82b1217d tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 404 len: 111 microversion: 2.1 time: 0.033540 Aug 25 14:03:42.583491 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3225/6518] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:42 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:03:42.594610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:42.595153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:42.602876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:42.603365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:42.603805 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:42.604540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:42.605004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:42.605432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:42.619471 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] HTTP exception thrown: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Request method failure captured: Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee HTTP/1.1 Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4EIQ61Q253_Ro7s64JmNv88uemvuMHxMAY45679UuFTP_RJ6COh_KFXlqwBDibcfa6gnq4x68VyY7_ZEBZrRyKAfm4U1lWcbazC7dLa4C5_B7fiIR_vMrtPI8fFYDjojdVhKtfk4m_uFBGO0ab4DvZtfBLDZu8-6I4uIFTo02C8xaM Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 5d94f1d324d04752a98254bb49449170 Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-DeleteServersTestJSON-1450167055 Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d94f1d324d04752a98254bb49449170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d94f1d324d04752a98254bb49449170", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d94f1d324d04752a98254bb49449170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d94f1d324d04752a98254bb49449170"}]}] Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-DeleteServersTestJSON-1450167055 Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 5d94f1d324d04752a98254bb49449170 Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-DeleteServersTestJSON-1450167055 Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-DeleteServersTestJSON-1450167055-project Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 3f0ed9017ec248f79881d5ff4bc00677 Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-DeleteServersTestJSON-1450167055-project Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'af3adbc1-b21f-41d3-a509-b786aa5c70ee'} Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:03:42.621179 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Returning 404 to user: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-97ad3093-e6ba-48c7-8386-7cac124c4439 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 404 len: 111 microversion: 2.1 time: 0.032037 Aug 25 14:03:42.625594 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3294/6519] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:03:42 2022] DELETE /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:03:42.631431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:42.632590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] [instance: af3adbc1-b21f-41d3-a509-b786aa5c70ee] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:42.638699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:42.639216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:42.639681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:42.640405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:42.640886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:42.641342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] HTTP exception thrown: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Request method failure captured: Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee HTTP/1.1 Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4EIQ61Q253_Ro7s64JmNv88uemvuMHxMAY45679UuFTP_RJ6COh_KFXlqwBDibcfa6gnq4x68VyY7_ZEBZrRyKAfm4U1lWcbazC7dLa4C5_B7fiIR_vMrtPI8fFYDjojdVhKtfk4m_uFBGO0ab4DvZtfBLDZu8-6I4uIFTo02C8xaM Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 5d94f1d324d04752a98254bb49449170 Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-DeleteServersTestJSON-1450167055 Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d94f1d324d04752a98254bb49449170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d94f1d324d04752a98254bb49449170", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d94f1d324d04752a98254bb49449170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d94f1d324d04752a98254bb49449170"}]}] Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-DeleteServersTestJSON-1450167055 Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 5d94f1d324d04752a98254bb49449170 Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1450167055 Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-DeleteServersTestJSON-1450167055-project Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 3f0ed9017ec248f79881d5ff4bc00677 Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-DeleteServersTestJSON-1450167055-project Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'af3adbc1-b21f-41d3-a509-b786aa5c70ee'} Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:03:42.658019 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] Returning 404 to user: Instance af3adbc1-b21f-41d3-a509-b786aa5c70ee could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b0106e0-468a-4273-af9b-d198bf506f66 tempest-DeleteServersTestJSON-1450167055 tempest-DeleteServersTestJSON-1450167055-project] 10.222.0.70 "GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee" status: 404 len: 111 microversion: 2.1 time: 0.031757 Aug 25 14:03:42.661951 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3226/6520] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:42 2022] GET /compute/v2.1/servers/af3adbc1-b21f-41d3-a509-b786aa5c70ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:03:51.743808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1048015186", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "989377d9-878d-42a5-94c1-a1ddad733706"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:03:51.806968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] validate_networks() for [('989377d9-878d-42a5-94c1-a1ddad733706', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:03:52.200611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:03:52.201064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:03:52.201599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:03:52.201977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:03:52.202393 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:03:52.213237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:52.213748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:52.214181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:52.214901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:52.215348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:52.215768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:52.232419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Getting quotas for project c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:03:52.237911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Getting quotas for user 47eba27ab0d54b92b9e8002cb57972e0 and project c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:03:52.250561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:03:52.252898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:03:52.301131 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66d63ceb-c2b7-4ca8-941e-83b6ecea49f3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696390 Aug 25 14:03:52.302406 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3295/6521] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:03:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:03:52.313144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d32a2d3b-cf09-4e44-8028-10cb636ce215 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:52.313809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d32a2d3b-cf09-4e44-8028-10cb636ce215 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:52.378159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d32a2d3b-cf09-4e44-8028-10cb636ce215 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:52.393696 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d32a2d3b-cf09-4e44-8028-10cb636ce215 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1218 microversion: 2.1 time: 0.083804 Aug 25 14:03:52.394948 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3227/6522] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:52 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:53.426881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70df8a06-a478-4484-b45e-1e891f9cd7b3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:53.428448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70df8a06-a478-4484-b45e-1e891f9cd7b3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:53.436133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70df8a06-a478-4484-b45e-1e891f9cd7b3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:53.436666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70df8a06-a478-4484-b45e-1e891f9cd7b3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:53.437107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70df8a06-a478-4484-b45e-1e891f9cd7b3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:53.437968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70df8a06-a478-4484-b45e-1e891f9cd7b3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:53.438550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70df8a06-a478-4484-b45e-1e891f9cd7b3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:53.439008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70df8a06-a478-4484-b45e-1e891f9cd7b3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:53.516991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70df8a06-a478-4484-b45e-1e891f9cd7b3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:53.526587 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70df8a06-a478-4484-b45e-1e891f9cd7b3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1270 microversion: 2.1 time: 0.104947 Aug 25 14:03:53.527158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3296/6523] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:53 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:54.550132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b6a19920-7e36-4e39-bb8a-53bfe55501a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:54.551483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b6a19920-7e36-4e39-bb8a-53bfe55501a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:54.554908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:03:54.567472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6a19920-7e36-4e39-bb8a-53bfe55501a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:54.567990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6a19920-7e36-4e39-bb8a-53bfe55501a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:54.568483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6a19920-7e36-4e39-bb8a-53bfe55501a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:54.569758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6a19920-7e36-4e39-bb8a-53bfe55501a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:54.570613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6a19920-7e36-4e39-bb8a-53bfe55501a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:54.571273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6a19920-7e36-4e39-bb8a-53bfe55501a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:54.757014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b6a19920-7e36-4e39-bb8a-53bfe55501a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:54.765760 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b6a19920-7e36-4e39-bb8a-53bfe55501a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1318 microversion: 2.1 time: 0.220234 Aug 25 14:03:54.766961 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3228/6524] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:54 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:55.412004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a577b87c-12e0-4e19-915e-4dfc21c594c8 req-99b68a7a-e1a1-4615-a06a-0e7064fb1969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71aec441-13c5-4765-b07c-ed181e5c9219", "tag": "e16e9763-dda5-40f6-8851-41b16f515988"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:03:55.435094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a577b87c-12e0-4e19-915e-4dfc21c594c8 req-99b68a7a-e1a1-4615-a06a-0e7064fb1969 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:55.435604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a577b87c-12e0-4e19-915e-4dfc21c594c8 req-99b68a7a-e1a1-4615-a06a-0e7064fb1969 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:55.436046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a577b87c-12e0-4e19-915e-4dfc21c594c8 req-99b68a7a-e1a1-4615-a06a-0e7064fb1969 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:55.450630 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a577b87c-12e0-4e19-915e-4dfc21c594c8 req-99b68a7a-e1a1-4615-a06a-0e7064fb1969 service nova] Creating event network-changed:e16e9763-dda5-40f6-8851-41b16f515988 for instance 71aec441-13c5-4765-b07c-ed181e5c9219 on n-h2-852771-8 Aug 25 14:03:55.458391 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a577b87c-12e0-4e19-915e-4dfc21c594c8 req-99b68a7a-e1a1-4615-a06a-0e7064fb1969 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053332 Aug 25 14:03:55.460253 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3297/6525] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:03:55.788476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b1e65992-1fa1-4faf-b23e-d2321f0b790b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:55.789138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b1e65992-1fa1-4faf-b23e-d2321f0b790b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:55.791995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:03:55.797748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1e65992-1fa1-4faf-b23e-d2321f0b790b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:55.798208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1e65992-1fa1-4faf-b23e-d2321f0b790b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:55.798680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1e65992-1fa1-4faf-b23e-d2321f0b790b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:55.799414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1e65992-1fa1-4faf-b23e-d2321f0b790b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:55.799893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1e65992-1fa1-4faf-b23e-d2321f0b790b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:55.800352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b1e65992-1fa1-4faf-b23e-d2321f0b790b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:55.948627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b1e65992-1fa1-4faf-b23e-d2321f0b790b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:55.956555 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b1e65992-1fa1-4faf-b23e-d2321f0b790b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1318 microversion: 2.1 time: 0.172220 Aug 25 14:03:55.957140 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3229/6526] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:55 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:56.978595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e9fcd5cb-c2cd-48d2-abec-bb11bb29bc0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:56.979306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e9fcd5cb-c2cd-48d2-abec-bb11bb29bc0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:56.982122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:03:56.988462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9fcd5cb-c2cd-48d2-abec-bb11bb29bc0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:56.989032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9fcd5cb-c2cd-48d2-abec-bb11bb29bc0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:56.989437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9fcd5cb-c2cd-48d2-abec-bb11bb29bc0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:56.990152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9fcd5cb-c2cd-48d2-abec-bb11bb29bc0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:56.990606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9fcd5cb-c2cd-48d2-abec-bb11bb29bc0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:56.991107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e9fcd5cb-c2cd-48d2-abec-bb11bb29bc0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:56.994482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=70 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:03:57.137471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e9fcd5cb-c2cd-48d2-abec-bb11bb29bc0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:57.145338 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e9fcd5cb-c2cd-48d2-abec-bb11bb29bc0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1318 microversion: 2.1 time: 0.170992 Aug 25 14:03:57.145962 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3298/6527] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:56 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:58.166497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02a3a14a-e2dd-40be-a300-07a85e110912 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:58.167037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-02a3a14a-e2dd-40be-a300-07a85e110912 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:58.174524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02a3a14a-e2dd-40be-a300-07a85e110912 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:58.175037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02a3a14a-e2dd-40be-a300-07a85e110912 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:58.175501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02a3a14a-e2dd-40be-a300-07a85e110912 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:58.176230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02a3a14a-e2dd-40be-a300-07a85e110912 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:58.176713 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02a3a14a-e2dd-40be-a300-07a85e110912 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:58.177167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02a3a14a-e2dd-40be-a300-07a85e110912 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:58.318425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-02a3a14a-e2dd-40be-a300-07a85e110912 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:58.327585 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-02a3a14a-e2dd-40be-a300-07a85e110912 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1318 microversion: 2.1 time: 0.165671 Aug 25 14:03:58.328187 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3230/6528] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:58 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:03:59.348715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-45430b40-0024-420a-a123-f35cb6a53eaf tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:03:59.349405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-45430b40-0024-420a-a123-f35cb6a53eaf tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:03:59.356858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45430b40-0024-420a-a123-f35cb6a53eaf tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:59.357345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45430b40-0024-420a-a123-f35cb6a53eaf tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:59.357808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45430b40-0024-420a-a123-f35cb6a53eaf tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:59.358513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45430b40-0024-420a-a123-f35cb6a53eaf tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:03:59.358994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45430b40-0024-420a-a123-f35cb6a53eaf tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:03:59.359420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-45430b40-0024-420a-a123-f35cb6a53eaf tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:03:59.506130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-45430b40-0024-420a-a123-f35cb6a53eaf tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:03:59.514500 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-45430b40-0024-420a-a123-f35cb6a53eaf tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1318 microversion: 2.1 time: 0.169728 Aug 25 14:03:59.515212 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3299/6529] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:03:59 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:00.536234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0cd042e0-f3d9-4424-b82f-6dc08a2003e9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:00.536894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0cd042e0-f3d9-4424-b82f-6dc08a2003e9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:00.544334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd042e0-f3d9-4424-b82f-6dc08a2003e9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:00.544858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd042e0-f3d9-4424-b82f-6dc08a2003e9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:00.545324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd042e0-f3d9-4424-b82f-6dc08a2003e9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:00.546116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd042e0-f3d9-4424-b82f-6dc08a2003e9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:00.546608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd042e0-f3d9-4424-b82f-6dc08a2003e9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:00.547182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0cd042e0-f3d9-4424-b82f-6dc08a2003e9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:00.693540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0cd042e0-f3d9-4424-b82f-6dc08a2003e9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:00.703397 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0cd042e0-f3d9-4424-b82f-6dc08a2003e9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1318 microversion: 2.1 time: 0.171090 Aug 25 14:04:00.703884 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3231/6530] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:00 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:01.470667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-52037969-264e-4978-b59e-6e26ecdd5f61 req-7c850403-a47d-4214-8340-ed8d04e9ec5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71aec441-13c5-4765-b07c-ed181e5c9219", "name": "network-vif-plugged", "status": "completed", "tag": "e16e9763-dda5-40f6-8851-41b16f515988"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:01.482783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-52037969-264e-4978-b59e-6e26ecdd5f61 req-7c850403-a47d-4214-8340-ed8d04e9ec5c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:01.483857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-52037969-264e-4978-b59e-6e26ecdd5f61 req-7c850403-a47d-4214-8340-ed8d04e9ec5c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:01.484296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-52037969-264e-4978-b59e-6e26ecdd5f61 req-7c850403-a47d-4214-8340-ed8d04e9ec5c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:01.497229 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-52037969-264e-4978-b59e-6e26ecdd5f61 req-7c850403-a47d-4214-8340-ed8d04e9ec5c service nova] Creating event network-vif-plugged:e16e9763-dda5-40f6-8851-41b16f515988 for instance 71aec441-13c5-4765-b07c-ed181e5c9219 on n-h2-852771-8 Aug 25 14:04:01.502360 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-52037969-264e-4978-b59e-6e26ecdd5f61 req-7c850403-a47d-4214-8340-ed8d04e9ec5c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035890 Aug 25 14:04:01.503288 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3300/6531] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:01.725352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e6ac9823-fb37-4c28-a1e4-038d2cd19d2f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:01.726957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e6ac9823-fb37-4c28-a1e4-038d2cd19d2f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:01.734399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6ac9823-fb37-4c28-a1e4-038d2cd19d2f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:01.734952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6ac9823-fb37-4c28-a1e4-038d2cd19d2f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:01.735484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6ac9823-fb37-4c28-a1e4-038d2cd19d2f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:01.736335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6ac9823-fb37-4c28-a1e4-038d2cd19d2f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:01.736786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6ac9823-fb37-4c28-a1e4-038d2cd19d2f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:01.737342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6ac9823-fb37-4c28-a1e4-038d2cd19d2f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:01.871786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e6ac9823-fb37-4c28-a1e4-038d2cd19d2f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:01.879756 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e6ac9823-fb37-4c28-a1e4-038d2cd19d2f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1318 microversion: 2.1 time: 0.158465 Aug 25 14:04:01.880336 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3232/6532] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:01 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:02.903089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c0b94b89-c711-403c-9e76-7a48c1289549 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:02.903791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c0b94b89-c711-403c-9e76-7a48c1289549 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:02.905880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:02.906584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:02.914579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0b94b89-c711-403c-9e76-7a48c1289549 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:02.915162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0b94b89-c711-403c-9e76-7a48c1289549 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:02.915531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0b94b89-c711-403c-9e76-7a48c1289549 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:02.916255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0b94b89-c711-403c-9e76-7a48c1289549 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:02.916713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0b94b89-c711-403c-9e76-7a48c1289549 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:02.917137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c0b94b89-c711-403c-9e76-7a48c1289549 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:03.068753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c0b94b89-c711-403c-9e76-7a48c1289549 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:03.077094 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c0b94b89-c711-403c-9e76-7a48c1289549 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1318 microversion: 2.1 time: 0.178415 Aug 25 14:04:03.077793 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3301/6533] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:02 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:04.098657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-56aee491-c0ba-4dd5-80db-e2c0b2dd8367 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:04.099290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-56aee491-c0ba-4dd5-80db-e2c0b2dd8367 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:04.102158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:04.108736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56aee491-c0ba-4dd5-80db-e2c0b2dd8367 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.109245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56aee491-c0ba-4dd5-80db-e2c0b2dd8367 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.109752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56aee491-c0ba-4dd5-80db-e2c0b2dd8367 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.110485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56aee491-c0ba-4dd5-80db-e2c0b2dd8367 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.110953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56aee491-c0ba-4dd5-80db-e2c0b2dd8367 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.111399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-56aee491-c0ba-4dd5-80db-e2c0b2dd8367 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.252241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-56aee491-c0ba-4dd5-80db-e2c0b2dd8367 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:04.261046 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-56aee491-c0ba-4dd5-80db-e2c0b2dd8367 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1507 microversion: 2.1 time: 0.166477 Aug 25 14:04:04.261672 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3233/6534] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:04 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:04.289452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6cf71999-9df2-485b-903e-712643b963b2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:04.290100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6cf71999-9df2-485b-903e-712643b963b2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:04.297329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cf71999-9df2-485b-903e-712643b963b2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.297857 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cf71999-9df2-485b-903e-712643b963b2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.298300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cf71999-9df2-485b-903e-712643b963b2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.299006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cf71999-9df2-485b-903e-712643b963b2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.299465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cf71999-9df2-485b-903e-712643b963b2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.299926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cf71999-9df2-485b-903e-712643b963b2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.441839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6cf71999-9df2-485b-903e-712643b963b2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:04.457603 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6cf71999-9df2-485b-903e-712643b963b2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1507 microversion: 2.1 time: 0.171721 Aug 25 14:04:04.458683 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3302/6535] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:04 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:04.479430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe5ef33f-d803-4346-a695-4bcf9103d507 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:04.482030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe5ef33f-d803-4346-a695-4bcf9103d507 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:04.488320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5ef33f-d803-4346-a695-4bcf9103d507 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.488834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5ef33f-d803-4346-a695-4bcf9103d507 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.489311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5ef33f-d803-4346-a695-4bcf9103d507 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.490077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5ef33f-d803-4346-a695-4bcf9103d507 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.490555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5ef33f-d803-4346-a695-4bcf9103d507 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.491011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe5ef33f-d803-4346-a695-4bcf9103d507 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.562330 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe5ef33f-d803-4346-a695-4bcf9103d507 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "PUT /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1079 microversion: 2.1 time: 0.087539 Aug 25 14:04:04.562985 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3234/6536] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Aug 25 14:04:04 2022] PUT /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1079 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:04.580061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2defac25-eb8b-4c9c-82a8-6ceacdf00b2e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:04.580556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2defac25-eb8b-4c9c-82a8-6ceacdf00b2e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:04.587262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2defac25-eb8b-4c9c-82a8-6ceacdf00b2e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.587747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2defac25-eb8b-4c9c-82a8-6ceacdf00b2e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.588184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2defac25-eb8b-4c9c-82a8-6ceacdf00b2e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.588890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2defac25-eb8b-4c9c-82a8-6ceacdf00b2e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.589343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2defac25-eb8b-4c9c-82a8-6ceacdf00b2e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.589795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2defac25-eb8b-4c9c-82a8-6ceacdf00b2e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.723040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2defac25-eb8b-4c9c-82a8-6ceacdf00b2e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:04.731729 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2defac25-eb8b-4c9c-82a8-6ceacdf00b2e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1505 microversion: 2.1 time: 0.155613 Aug 25 14:04:04.732314 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3303/6537] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:04 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:04.752196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99489cc0-0682-4c7e-a65b-60ce581a65ee tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:04.752817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-99489cc0-0682-4c7e-a65b-60ce581a65ee tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:04.759764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99489cc0-0682-4c7e-a65b-60ce581a65ee tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.760266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99489cc0-0682-4c7e-a65b-60ce581a65ee tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.760723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99489cc0-0682-4c7e-a65b-60ce581a65ee tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.761440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99489cc0-0682-4c7e-a65b-60ce581a65ee tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.761936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99489cc0-0682-4c7e-a65b-60ce581a65ee tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.762394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99489cc0-0682-4c7e-a65b-60ce581a65ee tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.906605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99489cc0-0682-4c7e-a65b-60ce581a65ee tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:04.914644 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-99489cc0-0682-4c7e-a65b-60ce581a65ee tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1505 microversion: 2.1 time: 0.166887 Aug 25 14:04:04.915236 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3235/6538] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:04 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:04.934402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:04.936672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:04.942987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.943473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.943915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.944616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:04.945606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:04.946228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:04.975435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:04.981661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Old instance type m1.heat2, new instance type m1.heat {{(pid=129060) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:04:04.988327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:04:04.988749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:04:04.989229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:04:04.989670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:04:04.990087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:04:05.054035 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-35328e0b-ff20-45de-a92f-63685415c6e4 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "POST /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219/action" status: 202 len: 0 microversion: 2.1 time: 0.123503 Aug 25 14:04:05.054929 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3304/6539] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:04:04 2022] POST /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:04:05.063152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9137c7ac-e5d8-48b1-9954-07e9bebbc7be tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:05.063788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9137c7ac-e5d8-48b1-9954-07e9bebbc7be tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:05.072280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9137c7ac-e5d8-48b1-9954-07e9bebbc7be tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:05.072450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9137c7ac-e5d8-48b1-9954-07e9bebbc7be tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:05.072925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9137c7ac-e5d8-48b1-9954-07e9bebbc7be tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:05.073707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9137c7ac-e5d8-48b1-9954-07e9bebbc7be tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:05.074194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9137c7ac-e5d8-48b1-9954-07e9bebbc7be tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:05.075038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9137c7ac-e5d8-48b1-9954-07e9bebbc7be tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:05.228343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9137c7ac-e5d8-48b1-9954-07e9bebbc7be tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:05.236453 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9137c7ac-e5d8-48b1-9954-07e9bebbc7be tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1516 microversion: 2.1 time: 0.177140 Aug 25 14:04:05.237045 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3236/6540] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:05 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:06.259455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0bc4c8fb-71ac-4fa1-b65e-992da6fa28cc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:06.261050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0bc4c8fb-71ac-4fa1-b65e-992da6fa28cc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:06.279451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bc4c8fb-71ac-4fa1-b65e-992da6fa28cc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:06.280146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bc4c8fb-71ac-4fa1-b65e-992da6fa28cc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:06.280593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bc4c8fb-71ac-4fa1-b65e-992da6fa28cc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:06.281319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bc4c8fb-71ac-4fa1-b65e-992da6fa28cc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:06.281801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bc4c8fb-71ac-4fa1-b65e-992da6fa28cc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:06.282236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bc4c8fb-71ac-4fa1-b65e-992da6fa28cc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:06.419208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0bc4c8fb-71ac-4fa1-b65e-992da6fa28cc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:06.427185 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0bc4c8fb-71ac-4fa1-b65e-992da6fa28cc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1516 microversion: 2.1 time: 0.173542 Aug 25 14:04:06.427770 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3305/6541] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:06 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:07.449074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d42014a0-0d6d-44d2-aaab-9f3a0fb047da tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:07.449747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d42014a0-0d6d-44d2-aaab-9f3a0fb047da tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:07.456641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d42014a0-0d6d-44d2-aaab-9f3a0fb047da tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:07.457149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d42014a0-0d6d-44d2-aaab-9f3a0fb047da tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:07.457631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d42014a0-0d6d-44d2-aaab-9f3a0fb047da tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:07.458349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d42014a0-0d6d-44d2-aaab-9f3a0fb047da tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:07.458819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d42014a0-0d6d-44d2-aaab-9f3a0fb047da tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:07.459260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d42014a0-0d6d-44d2-aaab-9f3a0fb047da tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:07.597347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d42014a0-0d6d-44d2-aaab-9f3a0fb047da tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:07.605619 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d42014a0-0d6d-44d2-aaab-9f3a0fb047da tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.161176 Aug 25 14:04:07.606206 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3237/6542] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:07 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:08.628208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d5738f3b-bb17-424d-ae3d-89da71403c1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:08.628904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d5738f3b-bb17-424d-ae3d-89da71403c1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:08.636577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5738f3b-bb17-424d-ae3d-89da71403c1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:08.637082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5738f3b-bb17-424d-ae3d-89da71403c1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:08.637526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5738f3b-bb17-424d-ae3d-89da71403c1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:08.638239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5738f3b-bb17-424d-ae3d-89da71403c1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:08.638695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5738f3b-bb17-424d-ae3d-89da71403c1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:08.639122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d5738f3b-bb17-424d-ae3d-89da71403c1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:08.782769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d5738f3b-bb17-424d-ae3d-89da71403c1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:08.790977 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d5738f3b-bb17-424d-ae3d-89da71403c1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.166707 Aug 25 14:04:08.791564 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3306/6543] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:08 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:09.811919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-695483e8-9d4b-48d9-a480-fb4cd32368ec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:09.812560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-695483e8-9d4b-48d9-a480-fb4cd32368ec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:09.819839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-695483e8-9d4b-48d9-a480-fb4cd32368ec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:09.820354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-695483e8-9d4b-48d9-a480-fb4cd32368ec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:09.820812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-695483e8-9d4b-48d9-a480-fb4cd32368ec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:09.821553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-695483e8-9d4b-48d9-a480-fb4cd32368ec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:09.822040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-695483e8-9d4b-48d9-a480-fb4cd32368ec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:09.822483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-695483e8-9d4b-48d9-a480-fb4cd32368ec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:09.961952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-695483e8-9d4b-48d9-a480-fb4cd32368ec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:09.969900 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-695483e8-9d4b-48d9-a480-fb4cd32368ec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.162029 Aug 25 14:04:09.970486 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3238/6544] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:09 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:10.991949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1d6567f6-ec9b-4683-8449-cd45875f6990 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:10.992596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1d6567f6-ec9b-4683-8449-cd45875f6990 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:10.999697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d6567f6-ec9b-4683-8449-cd45875f6990 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:11.000179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d6567f6-ec9b-4683-8449-cd45875f6990 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:11.000615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d6567f6-ec9b-4683-8449-cd45875f6990 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:11.001316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d6567f6-ec9b-4683-8449-cd45875f6990 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:11.001803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d6567f6-ec9b-4683-8449-cd45875f6990 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:11.002233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d6567f6-ec9b-4683-8449-cd45875f6990 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:11.456131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d6567f6-ec9b-4683-8449-cd45875f6990 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:11.465234 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1d6567f6-ec9b-4683-8449-cd45875f6990 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.477153 Aug 25 14:04:11.465866 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3307/6545] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:10 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:12.487489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7918e1a5-eedd-43a5-9e4d-f7343c3dfedc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:12.488129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7918e1a5-eedd-43a5-9e4d-f7343c3dfedc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:12.495351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7918e1a5-eedd-43a5-9e4d-f7343c3dfedc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:12.495861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7918e1a5-eedd-43a5-9e4d-f7343c3dfedc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:12.496337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7918e1a5-eedd-43a5-9e4d-f7343c3dfedc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:12.497159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7918e1a5-eedd-43a5-9e4d-f7343c3dfedc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:12.497664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7918e1a5-eedd-43a5-9e4d-f7343c3dfedc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:12.498034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7918e1a5-eedd-43a5-9e4d-f7343c3dfedc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:12.631918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7918e1a5-eedd-43a5-9e4d-f7343c3dfedc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:12.640377 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7918e1a5-eedd-43a5-9e4d-f7343c3dfedc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.156927 Aug 25 14:04:12.640954 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3239/6546] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:12 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:04:13.662390 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9b335f23-7c72-496e-8e68-9255b8e5bcf1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:13.663010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9b335f23-7c72-496e-8e68-9255b8e5bcf1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:13.670876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b335f23-7c72-496e-8e68-9255b8e5bcf1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:13.671372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b335f23-7c72-496e-8e68-9255b8e5bcf1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:13.671845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b335f23-7c72-496e-8e68-9255b8e5bcf1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:13.672565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b335f23-7c72-496e-8e68-9255b8e5bcf1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:13.673030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b335f23-7c72-496e-8e68-9255b8e5bcf1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:13.673462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b335f23-7c72-496e-8e68-9255b8e5bcf1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:13.809977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9b335f23-7c72-496e-8e68-9255b8e5bcf1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:13.818049 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9b335f23-7c72-496e-8e68-9255b8e5bcf1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.159632 Aug 25 14:04:13.818630 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3308/6547] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:13 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:04:14.840429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c60e5e1d-6137-43dc-a303-fdfad195fa4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:14.841057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c60e5e1d-6137-43dc-a303-fdfad195fa4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:14.848273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60e5e1d-6137-43dc-a303-fdfad195fa4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:14.848805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60e5e1d-6137-43dc-a303-fdfad195fa4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:14.849264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60e5e1d-6137-43dc-a303-fdfad195fa4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:14.850027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60e5e1d-6137-43dc-a303-fdfad195fa4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:14.850502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60e5e1d-6137-43dc-a303-fdfad195fa4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:14.850950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60e5e1d-6137-43dc-a303-fdfad195fa4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:14.986138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c60e5e1d-6137-43dc-a303-fdfad195fa4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:14.994740 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c60e5e1d-6137-43dc-a303-fdfad195fa4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.158933 Aug 25 14:04:14.995330 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3240/6548] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:14 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:16.018894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc8306a2-5f27-4b40-a306-231bfc2fbe15 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:16.020041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fc8306a2-5f27-4b40-a306-231bfc2fbe15 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:16.030832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc8306a2-5f27-4b40-a306-231bfc2fbe15 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:16.031844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc8306a2-5f27-4b40-a306-231bfc2fbe15 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:16.031844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc8306a2-5f27-4b40-a306-231bfc2fbe15 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:16.032818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc8306a2-5f27-4b40-a306-231bfc2fbe15 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:16.033184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc8306a2-5f27-4b40-a306-231bfc2fbe15 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:16.033649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc8306a2-5f27-4b40-a306-231bfc2fbe15 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:16.178129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc8306a2-5f27-4b40-a306-231bfc2fbe15 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:16.187887 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fc8306a2-5f27-4b40-a306-231bfc2fbe15 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.175395 Aug 25 14:04:16.188710 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3309/6549] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:16 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:17.211127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3109043c-1d91-4fd6-a61f-c003fc5f166c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:17.211752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3109043c-1d91-4fd6-a61f-c003fc5f166c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:17.219285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3109043c-1d91-4fd6-a61f-c003fc5f166c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:17.219944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3109043c-1d91-4fd6-a61f-c003fc5f166c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:17.220492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3109043c-1d91-4fd6-a61f-c003fc5f166c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:17.221320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3109043c-1d91-4fd6-a61f-c003fc5f166c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:17.221917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3109043c-1d91-4fd6-a61f-c003fc5f166c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:17.222458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3109043c-1d91-4fd6-a61f-c003fc5f166c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:17.365888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3109043c-1d91-4fd6-a61f-c003fc5f166c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:17.374844 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3109043c-1d91-4fd6-a61f-c003fc5f166c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.168197 Aug 25 14:04:17.375449 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3241/6550] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:17 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:18.397314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-065f76db-88e9-4a2a-b719-c03bb8f0b934 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:18.397980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-065f76db-88e9-4a2a-b719-c03bb8f0b934 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:18.406015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-065f76db-88e9-4a2a-b719-c03bb8f0b934 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:18.407089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-065f76db-88e9-4a2a-b719-c03bb8f0b934 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:18.407539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-065f76db-88e9-4a2a-b719-c03bb8f0b934 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:18.408264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-065f76db-88e9-4a2a-b719-c03bb8f0b934 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:18.408725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-065f76db-88e9-4a2a-b719-c03bb8f0b934 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:18.409203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-065f76db-88e9-4a2a-b719-c03bb8f0b934 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:18.544600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-065f76db-88e9-4a2a-b719-c03bb8f0b934 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:18.553555 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-065f76db-88e9-4a2a-b719-c03bb8f0b934 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.160172 Aug 25 14:04:18.554144 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3310/6551] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:18 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:19.575326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-afefb442-a72b-443f-88a8-09ac1f935c5a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:19.575968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-afefb442-a72b-443f-88a8-09ac1f935c5a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:19.583044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afefb442-a72b-443f-88a8-09ac1f935c5a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:19.583554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afefb442-a72b-443f-88a8-09ac1f935c5a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:19.584017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afefb442-a72b-443f-88a8-09ac1f935c5a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:19.584813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afefb442-a72b-443f-88a8-09ac1f935c5a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:19.585295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afefb442-a72b-443f-88a8-09ac1f935c5a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:19.585776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afefb442-a72b-443f-88a8-09ac1f935c5a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:19.732292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-afefb442-a72b-443f-88a8-09ac1f935c5a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:19.740265 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-afefb442-a72b-443f-88a8-09ac1f935c5a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.169138 Aug 25 14:04:19.740843 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3242/6552] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:19 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:04:20.761766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5d42e27a-2785-4b12-a61e-5f8a461b83ba tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:20.762703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5d42e27a-2785-4b12-a61e-5f8a461b83ba tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:20.771716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d42e27a-2785-4b12-a61e-5f8a461b83ba tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:20.772206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d42e27a-2785-4b12-a61e-5f8a461b83ba tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:20.772647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d42e27a-2785-4b12-a61e-5f8a461b83ba tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:20.773355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d42e27a-2785-4b12-a61e-5f8a461b83ba tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:20.773835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d42e27a-2785-4b12-a61e-5f8a461b83ba tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:20.774263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5d42e27a-2785-4b12-a61e-5f8a461b83ba tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:20.926946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5d42e27a-2785-4b12-a61e-5f8a461b83ba tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:20.935894 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5d42e27a-2785-4b12-a61e-5f8a461b83ba tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.178608 Aug 25 14:04:20.936586 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3311/6553] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:20 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:21.959205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b53ff70-6604-4645-97c7-127143a713c8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:21.959991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b53ff70-6604-4645-97c7-127143a713c8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:21.968252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b53ff70-6604-4645-97c7-127143a713c8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:21.968772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b53ff70-6604-4645-97c7-127143a713c8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:21.969350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b53ff70-6604-4645-97c7-127143a713c8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:21.970243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b53ff70-6604-4645-97c7-127143a713c8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:21.970735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b53ff70-6604-4645-97c7-127143a713c8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:21.971284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b53ff70-6604-4645-97c7-127143a713c8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:22.122342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b53ff70-6604-4645-97c7-127143a713c8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:22.125956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:22.131765 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b53ff70-6604-4645-97c7-127143a713c8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.177677 Aug 25 14:04:22.132369 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3243/6554] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:21 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:23.153864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2418383f-4a32-45e4-af27-410242b739c5 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:23.154490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2418383f-4a32-45e4-af27-410242b739c5 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:23.161738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2418383f-4a32-45e4-af27-410242b739c5 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:23.162234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2418383f-4a32-45e4-af27-410242b739c5 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:23.162675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2418383f-4a32-45e4-af27-410242b739c5 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:23.163470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2418383f-4a32-45e4-af27-410242b739c5 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:23.163934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2418383f-4a32-45e4-af27-410242b739c5 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:23.164361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2418383f-4a32-45e4-af27-410242b739c5 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:23.317269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2418383f-4a32-45e4-af27-410242b739c5 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:23.325897 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2418383f-4a32-45e4-af27-410242b739c5 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.176611 Aug 25 14:04:23.326479 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3312/6555] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:23 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:24.347499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c7357972-c4fa-4d99-bc36-e9db513c4462 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:24.348059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c7357972-c4fa-4d99-bc36-e9db513c4462 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:24.355880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7357972-c4fa-4d99-bc36-e9db513c4462 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:24.356391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7357972-c4fa-4d99-bc36-e9db513c4462 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:24.356855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7357972-c4fa-4d99-bc36-e9db513c4462 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:24.357629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7357972-c4fa-4d99-bc36-e9db513c4462 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:24.358276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7357972-c4fa-4d99-bc36-e9db513c4462 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:24.358565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c7357972-c4fa-4d99-bc36-e9db513c4462 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:24.509474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c7357972-c4fa-4d99-bc36-e9db513c4462 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:24.519272 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c7357972-c4fa-4d99-bc36-e9db513c4462 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.176319 Aug 25 14:04:24.519869 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3244/6556] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:24 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:25.541005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e4c148d-a49b-4007-b455-007533bdca5c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:25.541638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e4c148d-a49b-4007-b455-007533bdca5c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:25.548984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e4c148d-a49b-4007-b455-007533bdca5c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:25.549754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e4c148d-a49b-4007-b455-007533bdca5c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:25.550487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e4c148d-a49b-4007-b455-007533bdca5c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:25.551335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e4c148d-a49b-4007-b455-007533bdca5c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:25.552040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e4c148d-a49b-4007-b455-007533bdca5c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:25.552681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e4c148d-a49b-4007-b455-007533bdca5c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:25.691779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e4c148d-a49b-4007-b455-007533bdca5c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:25.700565 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e4c148d-a49b-4007-b455-007533bdca5c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.163410 Aug 25 14:04:25.701161 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3313/6557] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:25 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:26.723304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef274b70-ca22-44e4-a811-3c97556f3152 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:26.724166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ef274b70-ca22-44e4-a811-3c97556f3152 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:26.726926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=32 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:26.733133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef274b70-ca22-44e4-a811-3c97556f3152 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:26.733682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef274b70-ca22-44e4-a811-3c97556f3152 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:26.734143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef274b70-ca22-44e4-a811-3c97556f3152 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:26.734883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef274b70-ca22-44e4-a811-3c97556f3152 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:26.735356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef274b70-ca22-44e4-a811-3c97556f3152 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:26.735809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef274b70-ca22-44e4-a811-3c97556f3152 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:26.874363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ef274b70-ca22-44e4-a811-3c97556f3152 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:26.882440 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef274b70-ca22-44e4-a811-3c97556f3152 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.163270 Aug 25 14:04:26.883034 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3245/6558] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:26 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:27.904475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3c2db6d8-c651-4ade-b46d-f5f3291a7e1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:27.905038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3c2db6d8-c651-4ade-b46d-f5f3291a7e1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:27.907815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=36 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:27.913302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c2db6d8-c651-4ade-b46d-f5f3291a7e1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:27.913850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c2db6d8-c651-4ade-b46d-f5f3291a7e1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:27.914294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c2db6d8-c651-4ade-b46d-f5f3291a7e1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:27.915005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c2db6d8-c651-4ade-b46d-f5f3291a7e1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:27.915471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c2db6d8-c651-4ade-b46d-f5f3291a7e1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:27.915903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c2db6d8-c651-4ade-b46d-f5f3291a7e1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:27.919612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:28.062240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3c2db6d8-c651-4ade-b46d-f5f3291a7e1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:28.070391 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3c2db6d8-c651-4ade-b46d-f5f3291a7e1c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.170054 Aug 25 14:04:28.070967 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3314/6559] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:27 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:29.094721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ec394864-c232-4ca4-b2ac-349cabbe14a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:29.095802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ec394864-c232-4ca4-b2ac-349cabbe14a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:29.103819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec394864-c232-4ca4-b2ac-349cabbe14a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:29.104981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec394864-c232-4ca4-b2ac-349cabbe14a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:29.105603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec394864-c232-4ca4-b2ac-349cabbe14a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:29.106300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec394864-c232-4ca4-b2ac-349cabbe14a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:29.106786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec394864-c232-4ca4-b2ac-349cabbe14a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:29.107240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ec394864-c232-4ca4-b2ac-349cabbe14a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:29.259849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ec394864-c232-4ca4-b2ac-349cabbe14a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:29.270057 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ec394864-c232-4ca4-b2ac-349cabbe14a2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.180564 Aug 25 14:04:29.270057 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3246/6560] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:29 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:30.294064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-606cd688-4efa-4c2b-bda7-8394be090000 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:30.294840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-606cd688-4efa-4c2b-bda7-8394be090000 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:30.302137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-606cd688-4efa-4c2b-bda7-8394be090000 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:30.302627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-606cd688-4efa-4c2b-bda7-8394be090000 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:30.303065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-606cd688-4efa-4c2b-bda7-8394be090000 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:30.303789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-606cd688-4efa-4c2b-bda7-8394be090000 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:30.304243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-606cd688-4efa-4c2b-bda7-8394be090000 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:30.304674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-606cd688-4efa-4c2b-bda7-8394be090000 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:30.456566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-606cd688-4efa-4c2b-bda7-8394be090000 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:30.466953 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-606cd688-4efa-4c2b-bda7-8394be090000 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.178007 Aug 25 14:04:30.467560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3315/6561] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:30 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:04:31.489009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7fdefcaa-418e-4e64-afc3-951d01572771 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:31.490128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7fdefcaa-418e-4e64-afc3-951d01572771 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:31.498684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fdefcaa-418e-4e64-afc3-951d01572771 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:31.499206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fdefcaa-418e-4e64-afc3-951d01572771 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:31.499679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fdefcaa-418e-4e64-afc3-951d01572771 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:31.500441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fdefcaa-418e-4e64-afc3-951d01572771 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:31.500927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fdefcaa-418e-4e64-afc3-951d01572771 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:31.501386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7fdefcaa-418e-4e64-afc3-951d01572771 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:31.662504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7fdefcaa-418e-4e64-afc3-951d01572771 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:31.671650 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7fdefcaa-418e-4e64-afc3-951d01572771 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.186711 Aug 25 14:04:31.672283 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3247/6562] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:31 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:32.695825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-94c99afb-5363-4ae9-80bb-3a764ed833ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:32.696471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-94c99afb-5363-4ae9-80bb-3a764ed833ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:32.704195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94c99afb-5363-4ae9-80bb-3a764ed833ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:32.704681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94c99afb-5363-4ae9-80bb-3a764ed833ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:32.705122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94c99afb-5363-4ae9-80bb-3a764ed833ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:32.705871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94c99afb-5363-4ae9-80bb-3a764ed833ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:32.706335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94c99afb-5363-4ae9-80bb-3a764ed833ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:32.706762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94c99afb-5363-4ae9-80bb-3a764ed833ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:32.850653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-94c99afb-5363-4ae9-80bb-3a764ed833ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:32.859939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-94c99afb-5363-4ae9-80bb-3a764ed833ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.168361 Aug 25 14:04:32.860542 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3316/6563] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:32 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:33.885003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6bcae8e6-48c2-4b52-85a4-0625ca7c266a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:33.886039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6bcae8e6-48c2-4b52-85a4-0625ca7c266a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:33.895046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bcae8e6-48c2-4b52-85a4-0625ca7c266a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:33.895869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bcae8e6-48c2-4b52-85a4-0625ca7c266a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:33.896269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bcae8e6-48c2-4b52-85a4-0625ca7c266a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:33.897409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bcae8e6-48c2-4b52-85a4-0625ca7c266a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:33.898241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bcae8e6-48c2-4b52-85a4-0625ca7c266a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:33.898735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6bcae8e6-48c2-4b52-85a4-0625ca7c266a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:34.049923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6bcae8e6-48c2-4b52-85a4-0625ca7c266a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:34.058162 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6bcae8e6-48c2-4b52-85a4-0625ca7c266a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1521 microversion: 2.1 time: 0.177956 Aug 25 14:04:34.059681 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3248/6564] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:33 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:34.489358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1d64ef25-9513-42af-843f-3b0261906fa6 req-3b30792e-c60e-4b5d-b7d3-f8d1c604bc55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71aec441-13c5-4765-b07c-ed181e5c9219", "name": "network-vif-unplugged", "status": "completed", "tag": "e16e9763-dda5-40f6-8851-41b16f515988"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:34.502793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1d64ef25-9513-42af-843f-3b0261906fa6 req-3b30792e-c60e-4b5d-b7d3-f8d1c604bc55 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:34.503303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1d64ef25-9513-42af-843f-3b0261906fa6 req-3b30792e-c60e-4b5d-b7d3-f8d1c604bc55 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:34.503883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1d64ef25-9513-42af-843f-3b0261906fa6 req-3b30792e-c60e-4b5d-b7d3-f8d1c604bc55 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:34.519423 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1d64ef25-9513-42af-843f-3b0261906fa6 req-3b30792e-c60e-4b5d-b7d3-f8d1c604bc55 service nova] Creating event network-vif-unplugged:e16e9763-dda5-40f6-8851-41b16f515988 for instance 71aec441-13c5-4765-b07c-ed181e5c9219 on n-h1-852771-8 Aug 25 14:04:34.526750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-1d64ef25-9513-42af-843f-3b0261906fa6 req-3b30792e-c60e-4b5d-b7d3-f8d1c604bc55 service nova] Instance 71aec441-13c5-4765-b07c-ed181e5c9219 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:04:34.539431 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1d64ef25-9513-42af-843f-3b0261906fa6 req-3b30792e-c60e-4b5d-b7d3-f8d1c604bc55 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054151 Aug 25 14:04:34.540065 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3317/6565] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:35.081650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cbefdb15-5863-4a02-bbe9-e56feb36691f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:35.082321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cbefdb15-5863-4a02-bbe9-e56feb36691f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:35.090551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbefdb15-5863-4a02-bbe9-e56feb36691f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:35.091123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbefdb15-5863-4a02-bbe9-e56feb36691f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:35.091652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbefdb15-5863-4a02-bbe9-e56feb36691f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:35.092575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbefdb15-5863-4a02-bbe9-e56feb36691f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:35.093064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbefdb15-5863-4a02-bbe9-e56feb36691f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:35.093603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cbefdb15-5863-4a02-bbe9-e56feb36691f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:35.242503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cbefdb15-5863-4a02-bbe9-e56feb36691f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:35.251716 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cbefdb15-5863-4a02-bbe9-e56feb36691f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1520 microversion: 2.1 time: 0.174730 Aug 25 14:04:35.252327 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3249/6566] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:35 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:36.276899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-79d06fce-05f1-490c-9a21-901466a7fe7c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:36.277647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-79d06fce-05f1-490c-9a21-901466a7fe7c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:36.284215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79d06fce-05f1-490c-9a21-901466a7fe7c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:36.284713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79d06fce-05f1-490c-9a21-901466a7fe7c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:36.285164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79d06fce-05f1-490c-9a21-901466a7fe7c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:36.286109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79d06fce-05f1-490c-9a21-901466a7fe7c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:36.286376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79d06fce-05f1-490c-9a21-901466a7fe7c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:36.286811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79d06fce-05f1-490c-9a21-901466a7fe7c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:36.437860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-79d06fce-05f1-490c-9a21-901466a7fe7c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:36.446241 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-79d06fce-05f1-490c-9a21-901466a7fe7c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1518 microversion: 2.1 time: 0.174586 Aug 25 14:04:36.446854 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3318/6567] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:36 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:36.903935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-564b3c10-1915-47ce-a2a8-13e6be76ded5 req-a3ed4b99-529a-4478-b23e-93c48dbc5c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71aec441-13c5-4765-b07c-ed181e5c9219", "tag": "e16e9763-dda5-40f6-8851-41b16f515988"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:36.914971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-564b3c10-1915-47ce-a2a8-13e6be76ded5 req-a3ed4b99-529a-4478-b23e-93c48dbc5c2d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:36.915469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-564b3c10-1915-47ce-a2a8-13e6be76ded5 req-a3ed4b99-529a-4478-b23e-93c48dbc5c2d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:36.915924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-564b3c10-1915-47ce-a2a8-13e6be76ded5 req-a3ed4b99-529a-4478-b23e-93c48dbc5c2d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:36.930970 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-564b3c10-1915-47ce-a2a8-13e6be76ded5 req-a3ed4b99-529a-4478-b23e-93c48dbc5c2d service nova] Creating event network-changed:e16e9763-dda5-40f6-8851-41b16f515988 for instance 71aec441-13c5-4765-b07c-ed181e5c9219 on n-h1-852771-8 Aug 25 14:04:36.939365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-564b3c10-1915-47ce-a2a8-13e6be76ded5 req-a3ed4b99-529a-4478-b23e-93c48dbc5c2d service nova] Instance 71aec441-13c5-4765-b07c-ed181e5c9219 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:04:36.952592 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-564b3c10-1915-47ce-a2a8-13e6be76ded5 req-a3ed4b99-529a-4478-b23e-93c48dbc5c2d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053332 Aug 25 14:04:36.953229 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3250/6568] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:04:37.472619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7675dd24-c83e-433c-b905-b8de4007fde8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:37.473802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7675dd24-c83e-433c-b905-b8de4007fde8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:37.482921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7675dd24-c83e-433c-b905-b8de4007fde8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:37.483500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7675dd24-c83e-433c-b905-b8de4007fde8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:37.484057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7675dd24-c83e-433c-b905-b8de4007fde8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:37.484820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7675dd24-c83e-433c-b905-b8de4007fde8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:37.485361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7675dd24-c83e-433c-b905-b8de4007fde8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:37.485848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7675dd24-c83e-433c-b905-b8de4007fde8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:37.642388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7675dd24-c83e-433c-b905-b8de4007fde8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:37.654690 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7675dd24-c83e-433c-b905-b8de4007fde8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1518 microversion: 2.1 time: 0.188185 Aug 25 14:04:37.655727 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3319/6569] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:37 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:38.681996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-58c8ddec-255c-4486-852c-0296f7a45d87 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:38.682734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-58c8ddec-255c-4486-852c-0296f7a45d87 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:38.690878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58c8ddec-255c-4486-852c-0296f7a45d87 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:38.691778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58c8ddec-255c-4486-852c-0296f7a45d87 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:38.692334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58c8ddec-255c-4486-852c-0296f7a45d87 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:38.693170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58c8ddec-255c-4486-852c-0296f7a45d87 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:38.693694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58c8ddec-255c-4486-852c-0296f7a45d87 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:38.694150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-58c8ddec-255c-4486-852c-0296f7a45d87 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:38.867809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-58c8ddec-255c-4486-852c-0296f7a45d87 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:38.877772 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-58c8ddec-255c-4486-852c-0296f7a45d87 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1518 microversion: 2.1 time: 0.200935 Aug 25 14:04:38.878573 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3251/6570] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:38 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:39.903050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9b96e4a2-2365-42b5-a6cb-81fe9fbbaa66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:39.904150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9b96e4a2-2365-42b5-a6cb-81fe9fbbaa66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:39.915788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b96e4a2-2365-42b5-a6cb-81fe9fbbaa66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:39.916268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b96e4a2-2365-42b5-a6cb-81fe9fbbaa66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:39.916800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b96e4a2-2365-42b5-a6cb-81fe9fbbaa66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:39.917408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b96e4a2-2365-42b5-a6cb-81fe9fbbaa66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:39.917890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b96e4a2-2365-42b5-a6cb-81fe9fbbaa66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:39.918329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b96e4a2-2365-42b5-a6cb-81fe9fbbaa66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:40.060760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9b96e4a2-2365-42b5-a6cb-81fe9fbbaa66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:40.069891 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9b96e4a2-2365-42b5-a6cb-81fe9fbbaa66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1515 microversion: 2.1 time: 0.171276 Aug 25 14:04:40.070396 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3320/6571] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:39 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:40.092513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27d9bca3-dbd3-408d-992d-4a3d0ea45bc8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:40.093359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-27d9bca3-dbd3-408d-992d-4a3d0ea45bc8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:40.101141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27d9bca3-dbd3-408d-992d-4a3d0ea45bc8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:40.101692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27d9bca3-dbd3-408d-992d-4a3d0ea45bc8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:40.102153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27d9bca3-dbd3-408d-992d-4a3d0ea45bc8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:40.103048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27d9bca3-dbd3-408d-992d-4a3d0ea45bc8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:40.104704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27d9bca3-dbd3-408d-992d-4a3d0ea45bc8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:40.105968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27d9bca3-dbd3-408d-992d-4a3d0ea45bc8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:40.200636 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-27d9bca3-dbd3-408d-992d-4a3d0ea45bc8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "POST /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219/action" status: 204 len: 0 microversion: 2.1 time: 0.111658 Aug 25 14:04:40.201558 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3252/6572] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:04:40 2022] POST /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219/action => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:04:40.212087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6d8f8497-d1ce-4f39-87ff-0c1bcde8636a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:40.212780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6d8f8497-d1ce-4f39-87ff-0c1bcde8636a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:40.221536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d8f8497-d1ce-4f39-87ff-0c1bcde8636a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:40.222084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d8f8497-d1ce-4f39-87ff-0c1bcde8636a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:40.222526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d8f8497-d1ce-4f39-87ff-0c1bcde8636a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:40.223271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d8f8497-d1ce-4f39-87ff-0c1bcde8636a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:40.223733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d8f8497-d1ce-4f39-87ff-0c1bcde8636a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:40.224389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d8f8497-d1ce-4f39-87ff-0c1bcde8636a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:40.435148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6d8f8497-d1ce-4f39-87ff-0c1bcde8636a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:40.448224 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6d8f8497-d1ce-4f39-87ff-0c1bcde8636a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1515 microversion: 2.1 time: 0.240475 Aug 25 14:04:40.448869 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3321/6573] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:40 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:04:41.476659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d540d5e6-ab84-469e-901c-60c9e3047cec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:41.478018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d540d5e6-ab84-469e-901c-60c9e3047cec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:41.486817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d540d5e6-ab84-469e-901c-60c9e3047cec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:41.487333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d540d5e6-ab84-469e-901c-60c9e3047cec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:41.487791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d540d5e6-ab84-469e-901c-60c9e3047cec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:41.488521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d540d5e6-ab84-469e-901c-60c9e3047cec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:41.488998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d540d5e6-ab84-469e-901c-60c9e3047cec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:41.489450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d540d5e6-ab84-469e-901c-60c9e3047cec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:41.666701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d540d5e6-ab84-469e-901c-60c9e3047cec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:41.676326 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d540d5e6-ab84-469e-901c-60c9e3047cec tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1507 microversion: 2.1 time: 0.208037 Aug 25 14:04:41.676950 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3253/6574] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:41 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:41.698310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2a631dd-61b9-4b01-b799-f8a902759d0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:41.699080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b2a631dd-61b9-4b01-b799-f8a902759d0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:41.706637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a631dd-61b9-4b01-b799-f8a902759d0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:41.707047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a631dd-61b9-4b01-b799-f8a902759d0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:41.707481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a631dd-61b9-4b01-b799-f8a902759d0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:41.708373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a631dd-61b9-4b01-b799-f8a902759d0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:41.708830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a631dd-61b9-4b01-b799-f8a902759d0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:41.709257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a631dd-61b9-4b01-b799-f8a902759d0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:41.885186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b2a631dd-61b9-4b01-b799-f8a902759d0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:41.894380 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2a631dd-61b9-4b01-b799-f8a902759d0d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1507 microversion: 2.1 time: 0.200028 Aug 25 14:04:41.894999 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3322/6575] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:41 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:41.923942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87b65048-2342-47dd-878f-c13a54a6cca9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Action: 'create', calling method: .version_select at 0x7f3a2a0b74c0>, body: {"keypair": {"name": "tempest-keypair-1852129966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfpKZmHav5fzZPATHmDO59vtf9UgvGr2qpvOG94m6RVWARVVhToQGVxHxmg62V2K5/+fVE5tarcRHYf/FI7+9suVmt2zbMYgGD48gWJwWWqoXpjv1DX3Ey1+nVUKNS16A=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:41.953072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-87b65048-2342-47dd-878f-c13a54a6cca9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Getting quotas for project c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:04:41.964024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-87b65048-2342-47dd-878f-c13a54a6cca9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Getting quotas for user 47eba27ab0d54b92b9e8002cb57972e0 and project c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:04:42.015371 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87b65048-2342-47dd-878f-c13a54a6cca9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099845 Aug 25 14:04:42.016301 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3254/6576] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:04:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:04:42.392837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8976a309-3961-42fd-b13a-5d710c2b9e54 req-50189037-7345-4f40-8dc4-5159053f1a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71aec441-13c5-4765-b07c-ed181e5c9219", "name": "network-vif-plugged", "status": "completed", "tag": "e16e9763-dda5-40f6-8851-41b16f515988"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:42.403692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8976a309-3961-42fd-b13a-5d710c2b9e54 req-50189037-7345-4f40-8dc4-5159053f1a6a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:42.404184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8976a309-3961-42fd-b13a-5d710c2b9e54 req-50189037-7345-4f40-8dc4-5159053f1a6a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:42.404913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8976a309-3961-42fd-b13a-5d710c2b9e54 req-50189037-7345-4f40-8dc4-5159053f1a6a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:42.421731 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8976a309-3961-42fd-b13a-5d710c2b9e54 req-50189037-7345-4f40-8dc4-5159053f1a6a service nova] Creating event network-vif-plugged:e16e9763-dda5-40f6-8851-41b16f515988 for instance 71aec441-13c5-4765-b07c-ed181e5c9219 on n-h1-852771-8 Aug 25 14:04:42.427909 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8976a309-3961-42fd-b13a-5d710c2b9e54 req-50189037-7345-4f40-8dc4-5159053f1a6a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038758 Aug 25 14:04:42.428823 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3323/6577] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:04:43.454287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d343f743-c653-47ce-92e0-d0f2efdaa4bc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:43.454914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d343f743-c653-47ce-92e0-d0f2efdaa4bc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:43.463052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d343f743-c653-47ce-92e0-d0f2efdaa4bc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:43.463572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d343f743-c653-47ce-92e0-d0f2efdaa4bc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:43.464035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d343f743-c653-47ce-92e0-d0f2efdaa4bc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:43.464847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d343f743-c653-47ce-92e0-d0f2efdaa4bc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:43.465293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d343f743-c653-47ce-92e0-d0f2efdaa4bc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:43.465775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d343f743-c653-47ce-92e0-d0f2efdaa4bc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:43.612168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d343f743-c653-47ce-92e0-d0f2efdaa4bc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:43.621122 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d343f743-c653-47ce-92e0-d0f2efdaa4bc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 200 len: 1507 microversion: 2.1 time: 0.172247 Aug 25 14:04:43.621774 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3255/6578] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:43 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:43.650469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fd911163-cf47-468a-855d-651bca580434 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:43.651066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fd911163-cf47-468a-855d-651bca580434 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:43.660485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd911163-cf47-468a-855d-651bca580434 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:43.660981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd911163-cf47-468a-855d-651bca580434 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:43.661426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd911163-cf47-468a-855d-651bca580434 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:43.662196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd911163-cf47-468a-855d-651bca580434 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:43.662662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd911163-cf47-468a-855d-651bca580434 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:43.663096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd911163-cf47-468a-855d-651bca580434 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:43.695629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fd911163-cf47-468a-855d-651bca580434 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:04:43.789023 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fd911163-cf47-468a-855d-651bca580434 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "DELETE /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 204 len: 0 microversion: 2.1 time: 0.143491 Aug 25 14:04:43.789814 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3324/6579] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:04:43 2022] DELETE /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:04:43.849906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1288933834", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "989377d9-878d-42a5-94c1-a1ddad733706"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:43.907704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] validate_networks() for [('989377d9-878d-42a5-94c1-a1ddad733706', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:04:44.291227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:04:44.291665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:04:44.292786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:04:44.292786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:04:44.293118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:04:44.302955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:44.303631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:44.304042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:44.304791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:44.305259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:44.305732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:44.324845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Getting quotas for project c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:04:44.330612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Getting quotas for user 47eba27ab0d54b92b9e8002cb57972e0 and project c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:04:44.344126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:04:44.346479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:04:44.396728 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e94f6f47-db16-49d7-b436-bc8ff6c2e108 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550293 Aug 25 14:04:44.397453 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3256/6580] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:04:44.412015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-67d8eb82-ab20-41fb-b4eb-f3950457bf81 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:44.412877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-67d8eb82-ab20-41fb-b4eb-f3950457bf81 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:44.481822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-67d8eb82-ab20-41fb-b4eb-f3950457bf81 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:44.488839 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-67d8eb82-ab20-41fb-b4eb-f3950457bf81 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1218 microversion: 2.1 time: 0.082662 Aug 25 14:04:44.489420 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3325/6581] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:44 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:45.513932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8318c74a-df0e-49a1-a0ef-1c57053c14ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:45.514785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8318c74a-df0e-49a1-a0ef-1c57053c14ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:45.524606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8318c74a-df0e-49a1-a0ef-1c57053c14ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:45.525209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8318c74a-df0e-49a1-a0ef-1c57053c14ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:45.525760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8318c74a-df0e-49a1-a0ef-1c57053c14ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:45.526651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8318c74a-df0e-49a1-a0ef-1c57053c14ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:45.527911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8318c74a-df0e-49a1-a0ef-1c57053c14ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:45.528271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8318c74a-df0e-49a1-a0ef-1c57053c14ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:45.633884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8318c74a-df0e-49a1-a0ef-1c57053c14ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:45.655985 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8318c74a-df0e-49a1-a0ef-1c57053c14ac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1270 microversion: 2.1 time: 0.147949 Aug 25 14:04:45.657693 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3257/6582] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:45 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:46.693757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6dc8448-4e9d-43d3-9e8a-5eccdfd17ef7 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:46.694572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c6dc8448-4e9d-43d3-9e8a-5eccdfd17ef7 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:46.703991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6dc8448-4e9d-43d3-9e8a-5eccdfd17ef7 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:46.704482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6dc8448-4e9d-43d3-9e8a-5eccdfd17ef7 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:46.704945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6dc8448-4e9d-43d3-9e8a-5eccdfd17ef7 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:46.705955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6dc8448-4e9d-43d3-9e8a-5eccdfd17ef7 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:46.706577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6dc8448-4e9d-43d3-9e8a-5eccdfd17ef7 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:46.707176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6dc8448-4e9d-43d3-9e8a-5eccdfd17ef7 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:46.744937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-83cfb7d9-fb34-4fea-ae1d-2852d749160c req-be933fc2-3b7b-4a80-a149-88607ccaaf89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71aec441-13c5-4765-b07c-ed181e5c9219", "name": "network-vif-deleted", "tag": "e16e9763-dda5-40f6-8851-41b16f515988"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:46.757045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-83cfb7d9-fb34-4fea-ae1d-2852d749160c req-be933fc2-3b7b-4a80-a149-88607ccaaf89 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:46.757947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-83cfb7d9-fb34-4fea-ae1d-2852d749160c req-be933fc2-3b7b-4a80-a149-88607ccaaf89 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:46.758519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-83cfb7d9-fb34-4fea-ae1d-2852d749160c req-be933fc2-3b7b-4a80-a149-88607ccaaf89 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:46.778559 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-83cfb7d9-fb34-4fea-ae1d-2852d749160c req-be933fc2-3b7b-4a80-a149-88607ccaaf89 service nova] Creating event network-vif-deleted:e16e9763-dda5-40f6-8851-41b16f515988 for instance 71aec441-13c5-4765-b07c-ed181e5c9219 on n-h1-852771-8 Aug 25 14:04:46.787552 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-83cfb7d9-fb34-4fea-ae1d-2852d749160c req-be933fc2-3b7b-4a80-a149-88607ccaaf89 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048100 Aug 25 14:04:46.788545 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3258/6583] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:04:46.805105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c6dc8448-4e9d-43d3-9e8a-5eccdfd17ef7 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:46.818325 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6dc8448-4e9d-43d3-9e8a-5eccdfd17ef7 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1276 microversion: 2.1 time: 0.129734 Aug 25 14:04:46.819583 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3326/6584] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:46 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:04:47.842959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df9a2752-d038-4f17-a008-764213952f91 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:47.843733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df9a2752-d038-4f17-a008-764213952f91 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:47.851374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df9a2752-d038-4f17-a008-764213952f91 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:47.851887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df9a2752-d038-4f17-a008-764213952f91 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:47.852450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df9a2752-d038-4f17-a008-764213952f91 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:47.853118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df9a2752-d038-4f17-a008-764213952f91 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:47.853649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df9a2752-d038-4f17-a008-764213952f91 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:47.854147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df9a2752-d038-4f17-a008-764213952f91 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:48.026025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df9a2752-d038-4f17-a008-764213952f91 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:48.034611 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df9a2752-d038-4f17-a008-764213952f91 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1318 microversion: 2.1 time: 0.197547 Aug 25 14:04:48.035222 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3259/6585] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:47 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:48.810100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-62857ea8-0c82-42df-95db-3821e638424c req-344b1c1b-05b6-4eab-9d4e-b217a4ca2af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f", "tag": "250a7323-9984-4d67-9908-222fd6cd921b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:48.821887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-62857ea8-0c82-42df-95db-3821e638424c req-344b1c1b-05b6-4eab-9d4e-b217a4ca2af6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:48.822365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-62857ea8-0c82-42df-95db-3821e638424c req-344b1c1b-05b6-4eab-9d4e-b217a4ca2af6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:48.822790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-62857ea8-0c82-42df-95db-3821e638424c req-344b1c1b-05b6-4eab-9d4e-b217a4ca2af6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:48.836531 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-62857ea8-0c82-42df-95db-3821e638424c req-344b1c1b-05b6-4eab-9d4e-b217a4ca2af6 service nova] Creating event network-changed:250a7323-9984-4d67-9908-222fd6cd921b for instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f on n-h1-852771-8 Aug 25 14:04:48.844128 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-62857ea8-0c82-42df-95db-3821e638424c req-344b1c1b-05b6-4eab-9d4e-b217a4ca2af6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039891 Aug 25 14:04:48.844860 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3327/6586] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:49.057340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d316a86e-22c3-4065-aff8-82728b5d190d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:49.057944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d316a86e-22c3-4065-aff8-82728b5d190d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:49.065593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d316a86e-22c3-4065-aff8-82728b5d190d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:49.065982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d316a86e-22c3-4065-aff8-82728b5d190d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:49.066722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d316a86e-22c3-4065-aff8-82728b5d190d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:49.067482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d316a86e-22c3-4065-aff8-82728b5d190d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:49.067965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d316a86e-22c3-4065-aff8-82728b5d190d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:49.068425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d316a86e-22c3-4065-aff8-82728b5d190d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:49.224153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d316a86e-22c3-4065-aff8-82728b5d190d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:49.232793 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d316a86e-22c3-4065-aff8-82728b5d190d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1318 microversion: 2.1 time: 0.180176 Aug 25 14:04:49.233394 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3260/6587] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:49 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:50.256264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7722b97f-731a-43a4-8c13-0a2087a3bacc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:50.256931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7722b97f-731a-43a4-8c13-0a2087a3bacc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:50.264629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7722b97f-731a-43a4-8c13-0a2087a3bacc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:50.265209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7722b97f-731a-43a4-8c13-0a2087a3bacc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:50.265684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7722b97f-731a-43a4-8c13-0a2087a3bacc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:50.266405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7722b97f-731a-43a4-8c13-0a2087a3bacc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:50.266872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7722b97f-731a-43a4-8c13-0a2087a3bacc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:50.267304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7722b97f-731a-43a4-8c13-0a2087a3bacc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:50.418321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7722b97f-731a-43a4-8c13-0a2087a3bacc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:50.426669 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7722b97f-731a-43a4-8c13-0a2087a3bacc tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1318 microversion: 2.1 time: 0.175728 Aug 25 14:04:50.427253 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3328/6588] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:50 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:51.447703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7bcfd24b-a9cb-4c49-a980-31c25407eb16 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:51.452244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7bcfd24b-a9cb-4c49-a980-31c25407eb16 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:51.458352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bcfd24b-a9cb-4c49-a980-31c25407eb16 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:51.458933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bcfd24b-a9cb-4c49-a980-31c25407eb16 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:51.459448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bcfd24b-a9cb-4c49-a980-31c25407eb16 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:51.460370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bcfd24b-a9cb-4c49-a980-31c25407eb16 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:51.460802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bcfd24b-a9cb-4c49-a980-31c25407eb16 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:51.461319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7bcfd24b-a9cb-4c49-a980-31c25407eb16 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:51.638249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7bcfd24b-a9cb-4c49-a980-31c25407eb16 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:51.651340 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7bcfd24b-a9cb-4c49-a980-31c25407eb16 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1318 microversion: 2.1 time: 0.207408 Aug 25 14:04:51.654154 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3261/6589] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:51 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:52.674616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9b377dba-85d9-4c7a-899a-0ef20b38c3c3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:52.675481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9b377dba-85d9-4c7a-899a-0ef20b38c3c3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:52.682646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b377dba-85d9-4c7a-899a-0ef20b38c3c3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:52.683882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b377dba-85d9-4c7a-899a-0ef20b38c3c3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:52.684440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b377dba-85d9-4c7a-899a-0ef20b38c3c3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:52.685346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b377dba-85d9-4c7a-899a-0ef20b38c3c3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:52.685835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b377dba-85d9-4c7a-899a-0ef20b38c3c3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:52.686271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9b377dba-85d9-4c7a-899a-0ef20b38c3c3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:52.828112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9b377dba-85d9-4c7a-899a-0ef20b38c3c3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:52.836424 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9b377dba-85d9-4c7a-899a-0ef20b38c3c3 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1318 microversion: 2.1 time: 0.165683 Aug 25 14:04:52.837029 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3329/6590] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:52 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:53.860170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-077042f1-69a2-46df-b92f-130aed8e8bb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:53.860993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-077042f1-69a2-46df-b92f-130aed8e8bb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:53.868145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-077042f1-69a2-46df-b92f-130aed8e8bb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:53.868660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-077042f1-69a2-46df-b92f-130aed8e8bb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:53.869126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-077042f1-69a2-46df-b92f-130aed8e8bb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:53.869890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-077042f1-69a2-46df-b92f-130aed8e8bb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:53.870431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-077042f1-69a2-46df-b92f-130aed8e8bb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:53.871043 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-077042f1-69a2-46df-b92f-130aed8e8bb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:53.874210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:54.026270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-077042f1-69a2-46df-b92f-130aed8e8bb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:54.035117 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-077042f1-69a2-46df-b92f-130aed8e8bb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1318 microversion: 2.1 time: 0.178967 Aug 25 14:04:54.035709 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3262/6591] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:53 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:54.417071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-00944cd9-ec40-42db-bbe5-7fa83c4e91e7 req-c784fd47-5981-46e8-bdbf-ace952b5a594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f", "name": "network-vif-plugged", "status": "completed", "tag": "250a7323-9984-4d67-9908-222fd6cd921b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:54.430066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-00944cd9-ec40-42db-bbe5-7fa83c4e91e7 req-c784fd47-5981-46e8-bdbf-ace952b5a594 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:54.430440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-00944cd9-ec40-42db-bbe5-7fa83c4e91e7 req-c784fd47-5981-46e8-bdbf-ace952b5a594 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:54.430841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-00944cd9-ec40-42db-bbe5-7fa83c4e91e7 req-c784fd47-5981-46e8-bdbf-ace952b5a594 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:54.443261 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-00944cd9-ec40-42db-bbe5-7fa83c4e91e7 req-c784fd47-5981-46e8-bdbf-ace952b5a594 service nova] Creating event network-vif-plugged:250a7323-9984-4d67-9908-222fd6cd921b for instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f on n-h1-852771-8 Aug 25 14:04:54.448274 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-00944cd9-ec40-42db-bbe5-7fa83c4e91e7 req-c784fd47-5981-46e8-bdbf-ace952b5a594 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034879 Aug 25 14:04:54.448932 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3330/6592] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:55.056451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b359f465-1cf2-4a9a-8708-020da3837b92 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:55.056995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b359f465-1cf2-4a9a-8708-020da3837b92 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:55.059732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:55.060427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=10 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:55.067750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b359f465-1cf2-4a9a-8708-020da3837b92 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:55.067947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b359f465-1cf2-4a9a-8708-020da3837b92 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:55.068405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b359f465-1cf2-4a9a-8708-020da3837b92 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:55.069141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b359f465-1cf2-4a9a-8708-020da3837b92 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:55.069643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b359f465-1cf2-4a9a-8708-020da3837b92 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:55.070095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b359f465-1cf2-4a9a-8708-020da3837b92 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:55.213827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b359f465-1cf2-4a9a-8708-020da3837b92 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:55.223882 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b359f465-1cf2-4a9a-8708-020da3837b92 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1318 microversion: 2.1 time: 0.171367 Aug 25 14:04:55.224479 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3263/6593] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:55 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:56.247982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:56.253138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4df76c1-06b7-400f-955f-01782c424c0f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:56.253892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e4df76c1-06b7-400f-955f-01782c424c0f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:56.260708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4df76c1-06b7-400f-955f-01782c424c0f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:56.261819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4df76c1-06b7-400f-955f-01782c424c0f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:56.262263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4df76c1-06b7-400f-955f-01782c424c0f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:56.263036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4df76c1-06b7-400f-955f-01782c424c0f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:56.263542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4df76c1-06b7-400f-955f-01782c424c0f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:56.263973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e4df76c1-06b7-400f-955f-01782c424c0f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:56.400295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e4df76c1-06b7-400f-955f-01782c424c0f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:56.408658 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e4df76c1-06b7-400f-955f-01782c424c0f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1507 microversion: 2.1 time: 0.161562 Aug 25 14:04:56.409282 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3331/6594] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:56 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:56.428726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fd04cb58-b2be-4079-9eab-65444007cc2d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:56.429364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fd04cb58-b2be-4079-9eab-65444007cc2d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:56.437417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd04cb58-b2be-4079-9eab-65444007cc2d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:56.437993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd04cb58-b2be-4079-9eab-65444007cc2d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:56.438717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd04cb58-b2be-4079-9eab-65444007cc2d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:56.439445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd04cb58-b2be-4079-9eab-65444007cc2d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:56.439954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd04cb58-b2be-4079-9eab-65444007cc2d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:56.440411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fd04cb58-b2be-4079-9eab-65444007cc2d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:56.582285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fd04cb58-b2be-4079-9eab-65444007cc2d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:56.592387 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fd04cb58-b2be-4079-9eab-65444007cc2d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1507 microversion: 2.1 time: 0.167524 Aug 25 14:04:56.592984 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3264/6595] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:56 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:56.612999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:56.615291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:56.621445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:56.621964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:56.622404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:56.623104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:56.623558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:56.623981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:56.643831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:56.658357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:56.665926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Old instance type m1.heat2, new instance type m1.heat {{(pid=129060) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:04:56.676757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:04:56.677188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:04:56.677690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:04:56.678102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:04:56.678507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:04:56.744848 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2ab92e7a-5430-4a03-ba23-ebdfbfb9db65 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "POST /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f/action" status: 202 len: 0 microversion: 2.1 time: 0.135730 Aug 25 14:04:56.745752 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3332/6596] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:04:56 2022] POST /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:04:56.753862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0563956-914a-48e0-9574-4e3f58b723a9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:56.754364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e0563956-914a-48e0-9574-4e3f58b723a9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:56.756240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:56.763585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0563956-914a-48e0-9574-4e3f58b723a9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:56.764104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0563956-914a-48e0-9574-4e3f58b723a9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:56.764592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0563956-914a-48e0-9574-4e3f58b723a9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:56.765327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0563956-914a-48e0-9574-4e3f58b723a9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:56.765826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0563956-914a-48e0-9574-4e3f58b723a9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:56.766276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0563956-914a-48e0-9574-4e3f58b723a9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:56.911522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e0563956-914a-48e0-9574-4e3f58b723a9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:56.920265 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0563956-914a-48e0-9574-4e3f58b723a9 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1514 microversion: 2.1 time: 0.170423 Aug 25 14:04:56.921137 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3265/6597] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:56 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:57.938962 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:04:57.938962 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:04:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f (ip 10.222.0.70) !!! Aug 25 14:04:57.945079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b3715568-0967-4a48-8a8a-08bd3f5053f8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:57.945818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b3715568-0967-4a48-8a8a-08bd3f5053f8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:57.948036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:57.955249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3715568-0967-4a48-8a8a-08bd3f5053f8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:57.955736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3715568-0967-4a48-8a8a-08bd3f5053f8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:57.956191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3715568-0967-4a48-8a8a-08bd3f5053f8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:57.956913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3715568-0967-4a48-8a8a-08bd3f5053f8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:57.957375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3715568-0967-4a48-8a8a-08bd3f5053f8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:57.957854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3715568-0967-4a48-8a8a-08bd3f5053f8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:58.119222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b3715568-0967-4a48-8a8a-08bd3f5053f8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:58.128454 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b3715568-0967-4a48-8a8a-08bd3f5053f8 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1514 microversion: 2.1 time: 0.190757 Aug 25 14:04:58.129075 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3333/6598] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:57 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:59.155625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a9f0f4cf-f484-474d-b13f-849683af4fac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:59.156791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a9f0f4cf-f484-474d-b13f-849683af4fac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:59.166005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f0f4cf-f484-474d-b13f-849683af4fac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:59.166524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f0f4cf-f484-474d-b13f-849683af4fac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:59.167023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f0f4cf-f484-474d-b13f-849683af4fac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:59.168492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f0f4cf-f484-474d-b13f-849683af4fac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:59.168979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f0f4cf-f484-474d-b13f-849683af4fac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:59.169432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9f0f4cf-f484-474d-b13f-849683af4fac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:59.313139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9f0f4cf-f484-474d-b13f-849683af4fac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:59.321841 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a9f0f4cf-f484-474d-b13f-849683af4fac tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.174545 Aug 25 14:04:59.322436 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3266/6599] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:59 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:00.345779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3414183c-02e5-47fc-8691-36e62c851d66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:00.346331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3414183c-02e5-47fc-8691-36e62c851d66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:00.354072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3414183c-02e5-47fc-8691-36e62c851d66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:00.354561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3414183c-02e5-47fc-8691-36e62c851d66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:00.355240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3414183c-02e5-47fc-8691-36e62c851d66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:00.356206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3414183c-02e5-47fc-8691-36e62c851d66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:00.356664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3414183c-02e5-47fc-8691-36e62c851d66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:00.357086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3414183c-02e5-47fc-8691-36e62c851d66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:00.498728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3414183c-02e5-47fc-8691-36e62c851d66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:00.506908 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3414183c-02e5-47fc-8691-36e62c851d66 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.166314 Aug 25 14:05:00.507497 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3334/6600] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:00 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:05:01.528628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-707368d6-be9e-4ed8-bc0b-4f177533fa30 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:01.529363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-707368d6-be9e-4ed8-bc0b-4f177533fa30 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:01.536674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-707368d6-be9e-4ed8-bc0b-4f177533fa30 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:01.537190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-707368d6-be9e-4ed8-bc0b-4f177533fa30 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:01.537692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-707368d6-be9e-4ed8-bc0b-4f177533fa30 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:01.538891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-707368d6-be9e-4ed8-bc0b-4f177533fa30 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:01.538891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-707368d6-be9e-4ed8-bc0b-4f177533fa30 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:01.539354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-707368d6-be9e-4ed8-bc0b-4f177533fa30 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:01.691804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-707368d6-be9e-4ed8-bc0b-4f177533fa30 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:01.700103 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-707368d6-be9e-4ed8-bc0b-4f177533fa30 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.175398 Aug 25 14:05:01.700702 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3267/6601] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:01 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:02.721470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ba32655d-bef3-4ae6-99cb-44f74f1f7896 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:02.722099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ba32655d-bef3-4ae6-99cb-44f74f1f7896 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:02.728945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba32655d-bef3-4ae6-99cb-44f74f1f7896 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:02.729426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba32655d-bef3-4ae6-99cb-44f74f1f7896 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:02.730660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba32655d-bef3-4ae6-99cb-44f74f1f7896 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:02.731359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba32655d-bef3-4ae6-99cb-44f74f1f7896 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:02.731813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba32655d-bef3-4ae6-99cb-44f74f1f7896 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:02.732242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba32655d-bef3-4ae6-99cb-44f74f1f7896 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:02.866467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ba32655d-bef3-4ae6-99cb-44f74f1f7896 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:02.875909 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ba32655d-bef3-4ae6-99cb-44f74f1f7896 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.158371 Aug 25 14:05:02.876493 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3335/6602] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:02 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:03.898171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-01375c37-e914-49cd-8e70-34a834726d43 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:03.898847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-01375c37-e914-49cd-8e70-34a834726d43 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:03.906995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01375c37-e914-49cd-8e70-34a834726d43 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:03.907621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01375c37-e914-49cd-8e70-34a834726d43 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:03.908095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01375c37-e914-49cd-8e70-34a834726d43 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:03.908962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01375c37-e914-49cd-8e70-34a834726d43 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:03.909306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01375c37-e914-49cd-8e70-34a834726d43 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:03.909785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01375c37-e914-49cd-8e70-34a834726d43 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:04.049987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-01375c37-e914-49cd-8e70-34a834726d43 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:04.058725 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-01375c37-e914-49cd-8e70-34a834726d43 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.163919 Aug 25 14:05:04.059412 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3268/6603] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:03 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:05.080217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c67b5ea-49a7-4fd7-816d-3c91f4fbe84d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:05.080833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c67b5ea-49a7-4fd7-816d-3c91f4fbe84d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:05.087838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c67b5ea-49a7-4fd7-816d-3c91f4fbe84d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:05.088347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c67b5ea-49a7-4fd7-816d-3c91f4fbe84d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:05.088768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c67b5ea-49a7-4fd7-816d-3c91f4fbe84d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:05.090027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c67b5ea-49a7-4fd7-816d-3c91f4fbe84d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:05.090486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c67b5ea-49a7-4fd7-816d-3c91f4fbe84d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:05.090922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c67b5ea-49a7-4fd7-816d-3c91f4fbe84d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:05.224365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7c67b5ea-49a7-4fd7-816d-3c91f4fbe84d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:05.232337 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c67b5ea-49a7-4fd7-816d-3c91f4fbe84d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.156129 Aug 25 14:05:05.232933 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3336/6604] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:05 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:06.255477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-36a75531-b698-42a6-a88b-3aab29dd914c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:06.256114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-36a75531-b698-42a6-a88b-3aab29dd914c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:06.263661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36a75531-b698-42a6-a88b-3aab29dd914c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:06.264180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36a75531-b698-42a6-a88b-3aab29dd914c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:06.264643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36a75531-b698-42a6-a88b-3aab29dd914c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:06.265381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36a75531-b698-42a6-a88b-3aab29dd914c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:06.265892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36a75531-b698-42a6-a88b-3aab29dd914c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:06.266372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36a75531-b698-42a6-a88b-3aab29dd914c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:06.407343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-36a75531-b698-42a6-a88b-3aab29dd914c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:06.415944 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-36a75531-b698-42a6-a88b-3aab29dd914c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.164469 Aug 25 14:05:06.416525 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3269/6605] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:06 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:07.447138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1d30d215-2f83-48f0-a139-d100e64a7a40 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:07.447748 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1d30d215-2f83-48f0-a139-d100e64a7a40 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:07.455591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d30d215-2f83-48f0-a139-d100e64a7a40 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:07.456070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d30d215-2f83-48f0-a139-d100e64a7a40 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:07.456504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d30d215-2f83-48f0-a139-d100e64a7a40 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:07.457399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d30d215-2f83-48f0-a139-d100e64a7a40 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:07.457924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d30d215-2f83-48f0-a139-d100e64a7a40 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:07.458347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d30d215-2f83-48f0-a139-d100e64a7a40 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:07.597839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d30d215-2f83-48f0-a139-d100e64a7a40 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:07.606540 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1d30d215-2f83-48f0-a139-d100e64a7a40 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.163076 Aug 25 14:05:07.607160 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3337/6606] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:07 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:08.628509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-60508193-d430-40ce-a81d-7ad6ab602606 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:08.629314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-60508193-d430-40ce-a81d-7ad6ab602606 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:08.636734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60508193-d430-40ce-a81d-7ad6ab602606 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:08.637341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60508193-d430-40ce-a81d-7ad6ab602606 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:08.637912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60508193-d430-40ce-a81d-7ad6ab602606 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:08.638720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60508193-d430-40ce-a81d-7ad6ab602606 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:08.639189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60508193-d430-40ce-a81d-7ad6ab602606 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:08.639635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-60508193-d430-40ce-a81d-7ad6ab602606 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:08.777185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-60508193-d430-40ce-a81d-7ad6ab602606 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:08.785592 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-60508193-d430-40ce-a81d-7ad6ab602606 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.161385 Aug 25 14:05:08.786177 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3270/6607] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:08 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:09.807793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-916a5796-2d53-4409-a98f-835881d82b0b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:09.809212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-916a5796-2d53-4409-a98f-835881d82b0b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:09.816248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916a5796-2d53-4409-a98f-835881d82b0b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:09.816990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916a5796-2d53-4409-a98f-835881d82b0b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:09.817433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916a5796-2d53-4409-a98f-835881d82b0b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:09.818162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916a5796-2d53-4409-a98f-835881d82b0b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:09.818624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916a5796-2d53-4409-a98f-835881d82b0b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:09.819057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-916a5796-2d53-4409-a98f-835881d82b0b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:09.977357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-916a5796-2d53-4409-a98f-835881d82b0b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:09.985916 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-916a5796-2d53-4409-a98f-835881d82b0b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.182377 Aug 25 14:05:09.986500 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3338/6608] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:09 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:11.008663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cac4b5b4-b929-4d83-9403-7386ddfb1fb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:11.009338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cac4b5b4-b929-4d83-9403-7386ddfb1fb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:11.017412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac4b5b4-b929-4d83-9403-7386ddfb1fb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:11.017951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac4b5b4-b929-4d83-9403-7386ddfb1fb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:11.018416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac4b5b4-b929-4d83-9403-7386ddfb1fb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:11.019143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac4b5b4-b929-4d83-9403-7386ddfb1fb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:11.019621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac4b5b4-b929-4d83-9403-7386ddfb1fb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:11.020076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cac4b5b4-b929-4d83-9403-7386ddfb1fb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:11.158057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cac4b5b4-b929-4d83-9403-7386ddfb1fb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:11.165812 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cac4b5b4-b929-4d83-9403-7386ddfb1fb0 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.161217 Aug 25 14:05:11.166453 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3271/6609] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:11 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:12.188357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-29d35727-caf0-4432-b28b-1fa1b3f02444 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:12.189006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-29d35727-caf0-4432-b28b-1fa1b3f02444 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:12.196269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d35727-caf0-4432-b28b-1fa1b3f02444 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:12.196752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d35727-caf0-4432-b28b-1fa1b3f02444 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:12.197187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d35727-caf0-4432-b28b-1fa1b3f02444 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:12.197917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d35727-caf0-4432-b28b-1fa1b3f02444 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:12.198374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d35727-caf0-4432-b28b-1fa1b3f02444 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:12.198796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-29d35727-caf0-4432-b28b-1fa1b3f02444 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:12.337259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-29d35727-caf0-4432-b28b-1fa1b3f02444 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:12.345983 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-29d35727-caf0-4432-b28b-1fa1b3f02444 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.162321 Aug 25 14:05:12.346561 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3339/6610] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:12 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:05:13.368274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e1c04a6c-de42-4297-9a15-4575a5978f1a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:13.368854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e1c04a6c-de42-4297-9a15-4575a5978f1a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:13.377295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c04a6c-de42-4297-9a15-4575a5978f1a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:13.377831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c04a6c-de42-4297-9a15-4575a5978f1a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:13.378300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c04a6c-de42-4297-9a15-4575a5978f1a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:13.379010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c04a6c-de42-4297-9a15-4575a5978f1a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:13.379490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c04a6c-de42-4297-9a15-4575a5978f1a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:13.379938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e1c04a6c-de42-4297-9a15-4575a5978f1a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:13.518219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e1c04a6c-de42-4297-9a15-4575a5978f1a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:13.526060 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e1c04a6c-de42-4297-9a15-4575a5978f1a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.161973 Aug 25 14:05:13.526705 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3272/6611] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:13 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:14.547928 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f649ad5-829d-40f2-a592-f99f4a355e4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:14.548592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f649ad5-829d-40f2-a592-f99f4a355e4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:14.556028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f649ad5-829d-40f2-a592-f99f4a355e4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:14.556512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f649ad5-829d-40f2-a592-f99f4a355e4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:14.556942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f649ad5-829d-40f2-a592-f99f4a355e4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:14.557670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f649ad5-829d-40f2-a592-f99f4a355e4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:14.558736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f649ad5-829d-40f2-a592-f99f4a355e4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:14.559167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f649ad5-829d-40f2-a592-f99f4a355e4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:14.696599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2f649ad5-829d-40f2-a592-f99f4a355e4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:14.705013 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f649ad5-829d-40f2-a592-f99f4a355e4d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.161006 Aug 25 14:05:14.705694 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3340/6612] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:14 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:15.726508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a36b0dbf-fffe-4937-9804-9a0c6243f76c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:15.727178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a36b0dbf-fffe-4937-9804-9a0c6243f76c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:15.735118 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a36b0dbf-fffe-4937-9804-9a0c6243f76c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:15.735630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a36b0dbf-fffe-4937-9804-9a0c6243f76c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:15.736100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a36b0dbf-fffe-4937-9804-9a0c6243f76c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:15.736830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a36b0dbf-fffe-4937-9804-9a0c6243f76c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:15.737312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a36b0dbf-fffe-4937-9804-9a0c6243f76c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:15.737797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a36b0dbf-fffe-4937-9804-9a0c6243f76c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:15.877677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a36b0dbf-fffe-4937-9804-9a0c6243f76c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:15.886041 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a36b0dbf-fffe-4937-9804-9a0c6243f76c tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.163428 Aug 25 14:05:15.886823 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3273/6613] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:15 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:16.907691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9eec118-3c11-4c38-bedf-7a608a54af34 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:16.908239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c9eec118-3c11-4c38-bedf-7a608a54af34 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:16.915317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9eec118-3c11-4c38-bedf-7a608a54af34 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:16.915813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9eec118-3c11-4c38-bedf-7a608a54af34 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:16.916376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9eec118-3c11-4c38-bedf-7a608a54af34 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:16.917023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9eec118-3c11-4c38-bedf-7a608a54af34 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:16.917487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9eec118-3c11-4c38-bedf-7a608a54af34 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:16.918023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9eec118-3c11-4c38-bedf-7a608a54af34 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:17.052287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c9eec118-3c11-4c38-bedf-7a608a54af34 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:17.060892 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9eec118-3c11-4c38-bedf-7a608a54af34 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.157248 Aug 25 14:05:17.061487 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3341/6614] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:16 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:18.083150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59fc5a63-9f43-45bf-bcdd-2d3c7023d68a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:18.083824 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59fc5a63-9f43-45bf-bcdd-2d3c7023d68a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:18.091114 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fc5a63-9f43-45bf-bcdd-2d3c7023d68a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:18.091625 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fc5a63-9f43-45bf-bcdd-2d3c7023d68a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:18.092092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fc5a63-9f43-45bf-bcdd-2d3c7023d68a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:18.092822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fc5a63-9f43-45bf-bcdd-2d3c7023d68a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:18.093304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fc5a63-9f43-45bf-bcdd-2d3c7023d68a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:18.093779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fc5a63-9f43-45bf-bcdd-2d3c7023d68a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:18.239281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-59fc5a63-9f43-45bf-bcdd-2d3c7023d68a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:18.248746 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59fc5a63-9f43-45bf-bcdd-2d3c7023d68a tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.169420 Aug 25 14:05:18.249363 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3274/6615] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:18 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:19.271070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c4db8e2-0041-406a-8f7d-461e5c6d0bb2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:19.271879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5c4db8e2-0041-406a-8f7d-461e5c6d0bb2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:19.279286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4db8e2-0041-406a-8f7d-461e5c6d0bb2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:19.279777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4db8e2-0041-406a-8f7d-461e5c6d0bb2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:19.280219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4db8e2-0041-406a-8f7d-461e5c6d0bb2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:19.280974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4db8e2-0041-406a-8f7d-461e5c6d0bb2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:19.281437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4db8e2-0041-406a-8f7d-461e5c6d0bb2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:19.281983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c4db8e2-0041-406a-8f7d-461e5c6d0bb2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:19.414590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5c4db8e2-0041-406a-8f7d-461e5c6d0bb2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:19.422782 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c4db8e2-0041-406a-8f7d-461e5c6d0bb2 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.155632 Aug 25 14:05:19.423211 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3342/6616] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:19 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:20.444407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2d754d6-492f-474d-88cd-ddf2e513efd1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:20.445038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a2d754d6-492f-474d-88cd-ddf2e513efd1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:20.452524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2d754d6-492f-474d-88cd-ddf2e513efd1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:20.453034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2d754d6-492f-474d-88cd-ddf2e513efd1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:20.453495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2d754d6-492f-474d-88cd-ddf2e513efd1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:20.454259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2d754d6-492f-474d-88cd-ddf2e513efd1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:20.454735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2d754d6-492f-474d-88cd-ddf2e513efd1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:20.455181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2d754d6-492f-474d-88cd-ddf2e513efd1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:20.591868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a2d754d6-492f-474d-88cd-ddf2e513efd1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:20.601340 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a2d754d6-492f-474d-88cd-ddf2e513efd1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.161164 Aug 25 14:05:20.601961 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3275/6617] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:20 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:21.623384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4332e985-dcaa-4344-8b13-ecd17b848bcd tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:21.624014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4332e985-dcaa-4344-8b13-ecd17b848bcd tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:21.630896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4332e985-dcaa-4344-8b13-ecd17b848bcd tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:21.631394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4332e985-dcaa-4344-8b13-ecd17b848bcd tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:21.631837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4332e985-dcaa-4344-8b13-ecd17b848bcd tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:21.632548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4332e985-dcaa-4344-8b13-ecd17b848bcd tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:21.633004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4332e985-dcaa-4344-8b13-ecd17b848bcd tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:21.633442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4332e985-dcaa-4344-8b13-ecd17b848bcd tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:21.772910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4332e985-dcaa-4344-8b13-ecd17b848bcd tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:21.781170 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4332e985-dcaa-4344-8b13-ecd17b848bcd tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.162498 Aug 25 14:05:21.782472 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3343/6618] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:21 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:22.803211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b2d62106-efc1-4d2e-857d-f40c6bc90329 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:22.803863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b2d62106-efc1-4d2e-857d-f40c6bc90329 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:22.811632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2d62106-efc1-4d2e-857d-f40c6bc90329 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:22.812172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2d62106-efc1-4d2e-857d-f40c6bc90329 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:22.812630 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2d62106-efc1-4d2e-857d-f40c6bc90329 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:22.813353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2d62106-efc1-4d2e-857d-f40c6bc90329 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:22.813848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2d62106-efc1-4d2e-857d-f40c6bc90329 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:22.814311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2d62106-efc1-4d2e-857d-f40c6bc90329 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:22.946855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b2d62106-efc1-4d2e-857d-f40c6bc90329 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:22.954815 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b2d62106-efc1-4d2e-857d-f40c6bc90329 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.155535 Aug 25 14:05:22.955399 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3276/6619] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:22 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:05:23.976189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-35edc094-4138-4aa9-8b53-91d89de09bef tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:23.976798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-35edc094-4138-4aa9-8b53-91d89de09bef tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:23.984645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35edc094-4138-4aa9-8b53-91d89de09bef tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:23.985092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35edc094-4138-4aa9-8b53-91d89de09bef tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:23.985550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35edc094-4138-4aa9-8b53-91d89de09bef tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:23.986250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35edc094-4138-4aa9-8b53-91d89de09bef tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:23.986716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35edc094-4138-4aa9-8b53-91d89de09bef tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:23.987122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35edc094-4138-4aa9-8b53-91d89de09bef tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:24.123738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-35edc094-4138-4aa9-8b53-91d89de09bef tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:24.131630 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-35edc094-4138-4aa9-8b53-91d89de09bef tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.159347 Aug 25 14:05:24.132205 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3344/6620] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:23 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:25.152844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-263dbff8-ccb8-48f1-87a2-d46ffcb54e19 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:25.154176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-263dbff8-ccb8-48f1-87a2-d46ffcb54e19 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:25.160967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263dbff8-ccb8-48f1-87a2-d46ffcb54e19 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:25.161469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263dbff8-ccb8-48f1-87a2-d46ffcb54e19 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:25.161951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263dbff8-ccb8-48f1-87a2-d46ffcb54e19 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:25.162680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263dbff8-ccb8-48f1-87a2-d46ffcb54e19 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:25.163147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263dbff8-ccb8-48f1-87a2-d46ffcb54e19 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:25.163591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-263dbff8-ccb8-48f1-87a2-d46ffcb54e19 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:25.166354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=90 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:25.298449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-263dbff8-ccb8-48f1-87a2-d46ffcb54e19 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:25.306297 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-263dbff8-ccb8-48f1-87a2-d46ffcb54e19 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1519 microversion: 2.1 time: 0.157954 Aug 25 14:05:25.306883 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3277/6621] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:25 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:26.327754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70ab08e6-2438-4db0-96a6-22ca0c382a74 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:26.328397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70ab08e6-2438-4db0-96a6-22ca0c382a74 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:26.335518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ab08e6-2438-4db0-96a6-22ca0c382a74 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:26.336022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ab08e6-2438-4db0-96a6-22ca0c382a74 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:26.336462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ab08e6-2438-4db0-96a6-22ca0c382a74 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:26.337214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ab08e6-2438-4db0-96a6-22ca0c382a74 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:26.337658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ab08e6-2438-4db0-96a6-22ca0c382a74 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:26.338097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ab08e6-2438-4db0-96a6-22ca0c382a74 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:26.405115 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d456d0c5-9dda-47ec-acf9-cd9eb128fd36 req-ac88bf69-66aa-45a8-aaa2-f0b2833afa08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f", "name": "network-vif-unplugged", "status": "completed", "tag": "250a7323-9984-4d67-9908-222fd6cd921b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:26.416695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d456d0c5-9dda-47ec-acf9-cd9eb128fd36 req-ac88bf69-66aa-45a8-aaa2-f0b2833afa08 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:26.417879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d456d0c5-9dda-47ec-acf9-cd9eb128fd36 req-ac88bf69-66aa-45a8-aaa2-f0b2833afa08 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:26.418396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d456d0c5-9dda-47ec-acf9-cd9eb128fd36 req-ac88bf69-66aa-45a8-aaa2-f0b2833afa08 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:26.437801 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d456d0c5-9dda-47ec-acf9-cd9eb128fd36 req-ac88bf69-66aa-45a8-aaa2-f0b2833afa08 service nova] Creating event network-vif-unplugged:250a7323-9984-4d67-9908-222fd6cd921b for instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f on n-h2-852771-8 Aug 25 14:05:26.445360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-d456d0c5-9dda-47ec-acf9-cd9eb128fd36 req-ac88bf69-66aa-45a8-aaa2-f0b2833afa08 service nova] Instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:05:26.458398 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d456d0c5-9dda-47ec-acf9-cd9eb128fd36 req-ac88bf69-66aa-45a8-aaa2-f0b2833afa08 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058544 Aug 25 14:05:26.459297 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3278/6622] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:05:26.488300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70ab08e6-2438-4db0-96a6-22ca0c382a74 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:26.497739 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70ab08e6-2438-4db0-96a6-22ca0c382a74 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1518 microversion: 2.1 time: 0.173948 Aug 25 14:05:26.498363 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3345/6623] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:26 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:27.519796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25d34070-0851-41d1-bccd-c471f8d66d4b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:27.520579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-25d34070-0851-41d1-bccd-c471f8d66d4b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:27.523216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=28 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:27.529781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25d34070-0851-41d1-bccd-c471f8d66d4b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:27.530251 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25d34070-0851-41d1-bccd-c471f8d66d4b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:27.530708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25d34070-0851-41d1-bccd-c471f8d66d4b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:27.531426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25d34070-0851-41d1-bccd-c471f8d66d4b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:27.531892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25d34070-0851-41d1-bccd-c471f8d66d4b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:27.532333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25d34070-0851-41d1-bccd-c471f8d66d4b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:27.675626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-25d34070-0851-41d1-bccd-c471f8d66d4b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:27.684830 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-25d34070-0851-41d1-bccd-c471f8d66d4b tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1516 microversion: 2.1 time: 0.169028 Aug 25 14:05:27.685686 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3279/6624] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:27 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:28.489451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8efa95c4-961f-4408-a366-6dd855263902 req-151b0274-9709-4022-9cca-a219eef34682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f", "tag": "250a7323-9984-4d67-9908-222fd6cd921b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:28.495872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=26 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:28.502438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8efa95c4-961f-4408-a366-6dd855263902 req-151b0274-9709-4022-9cca-a219eef34682 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:28.502930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8efa95c4-961f-4408-a366-6dd855263902 req-151b0274-9709-4022-9cca-a219eef34682 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:28.503371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8efa95c4-961f-4408-a366-6dd855263902 req-151b0274-9709-4022-9cca-a219eef34682 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:28.506227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:28.519549 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8efa95c4-961f-4408-a366-6dd855263902 req-151b0274-9709-4022-9cca-a219eef34682 service nova] Creating event network-changed:250a7323-9984-4d67-9908-222fd6cd921b for instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f on n-h2-852771-8 Aug 25 14:05:28.525787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-8efa95c4-961f-4408-a366-6dd855263902 req-151b0274-9709-4022-9cca-a219eef34682 service nova] Instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:05:28.538080 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8efa95c4-961f-4408-a366-6dd855263902 req-151b0274-9709-4022-9cca-a219eef34682 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052374 Aug 25 14:05:28.538759 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3346/6625] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:05:28.707657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-614177cf-d367-41c2-a595-fa97d8fce37e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:28.708422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-614177cf-d367-41c2-a595-fa97d8fce37e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:28.716481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-614177cf-d367-41c2-a595-fa97d8fce37e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:28.716762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-614177cf-d367-41c2-a595-fa97d8fce37e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:28.717205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-614177cf-d367-41c2-a595-fa97d8fce37e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:28.718001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-614177cf-d367-41c2-a595-fa97d8fce37e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:28.718474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-614177cf-d367-41c2-a595-fa97d8fce37e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:28.718921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-614177cf-d367-41c2-a595-fa97d8fce37e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:28.873370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-614177cf-d367-41c2-a595-fa97d8fce37e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:28.882160 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-614177cf-d367-41c2-a595-fa97d8fce37e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1516 microversion: 2.1 time: 0.178339 Aug 25 14:05:28.882969 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3280/6626] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:28 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:29.907488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7574f9d6-a511-4004-99e6-a4fb345361b1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:29.908214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7574f9d6-a511-4004-99e6-a4fb345361b1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:29.914937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7574f9d6-a511-4004-99e6-a4fb345361b1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:29.915366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7574f9d6-a511-4004-99e6-a4fb345361b1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:29.915825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7574f9d6-a511-4004-99e6-a4fb345361b1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:29.916681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7574f9d6-a511-4004-99e6-a4fb345361b1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:29.917811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7574f9d6-a511-4004-99e6-a4fb345361b1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:29.918266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7574f9d6-a511-4004-99e6-a4fb345361b1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:30.104650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7574f9d6-a511-4004-99e6-a4fb345361b1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:30.122829 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7574f9d6-a511-4004-99e6-a4fb345361b1 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1516 microversion: 2.1 time: 0.221078 Aug 25 14:05:30.123846 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3347/6627] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:29 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:31.148951 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe4a00e4-1779-4257-8ef4-87dfd259691e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:31.149745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe4a00e4-1779-4257-8ef4-87dfd259691e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:31.156781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe4a00e4-1779-4257-8ef4-87dfd259691e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:31.157288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe4a00e4-1779-4257-8ef4-87dfd259691e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:31.157910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe4a00e4-1779-4257-8ef4-87dfd259691e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:31.158641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe4a00e4-1779-4257-8ef4-87dfd259691e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:31.159125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe4a00e4-1779-4257-8ef4-87dfd259691e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:31.159576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe4a00e4-1779-4257-8ef4-87dfd259691e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:31.293202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fe4a00e4-1779-4257-8ef4-87dfd259691e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:31.301306 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe4a00e4-1779-4257-8ef4-87dfd259691e tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1513 microversion: 2.1 time: 0.156306 Aug 25 14:05:31.301933 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3281/6628] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:31 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:31.322525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-24d9b495-1533-45ba-b8b4-d902eba21779 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:31.323763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-24d9b495-1533-45ba-b8b4-d902eba21779 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:31.330922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24d9b495-1533-45ba-b8b4-d902eba21779 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:31.331409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24d9b495-1533-45ba-b8b4-d902eba21779 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:31.331852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24d9b495-1533-45ba-b8b4-d902eba21779 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:31.332561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24d9b495-1533-45ba-b8b4-d902eba21779 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:31.333020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24d9b495-1533-45ba-b8b4-d902eba21779 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:31.333451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-24d9b495-1533-45ba-b8b4-d902eba21779 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:31.394589 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-24d9b495-1533-45ba-b8b4-d902eba21779 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "POST /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f/action" status: 204 len: 0 microversion: 2.1 time: 0.075571 Aug 25 14:05:31.395459 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3348/6629] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:05:31 2022] POST /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:05:31.404282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b4a01a73-c39e-4ae3-8979-d07fd0f3d36f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:31.405156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b4a01a73-c39e-4ae3-8979-d07fd0f3d36f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:31.411393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a01a73-c39e-4ae3-8979-d07fd0f3d36f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:31.411914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a01a73-c39e-4ae3-8979-d07fd0f3d36f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:31.412384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a01a73-c39e-4ae3-8979-d07fd0f3d36f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:31.413184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a01a73-c39e-4ae3-8979-d07fd0f3d36f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:31.413716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a01a73-c39e-4ae3-8979-d07fd0f3d36f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:31.414200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b4a01a73-c39e-4ae3-8979-d07fd0f3d36f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:31.575260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b4a01a73-c39e-4ae3-8979-d07fd0f3d36f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:31.583790 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b4a01a73-c39e-4ae3-8979-d07fd0f3d36f tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1513 microversion: 2.1 time: 0.184087 Aug 25 14:05:31.584420 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3282/6630] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:31 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:32.608307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-535321e7-942f-42f5-b6ca-60872de49751 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:32.609045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-535321e7-942f-42f5-b6ca-60872de49751 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:32.616576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-535321e7-942f-42f5-b6ca-60872de49751 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:32.617070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-535321e7-942f-42f5-b6ca-60872de49751 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:32.617531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-535321e7-942f-42f5-b6ca-60872de49751 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:32.618867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-535321e7-942f-42f5-b6ca-60872de49751 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:32.618867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-535321e7-942f-42f5-b6ca-60872de49751 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:32.619220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-535321e7-942f-42f5-b6ca-60872de49751 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:32.762787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-535321e7-942f-42f5-b6ca-60872de49751 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:32.771538 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-535321e7-942f-42f5-b6ca-60872de49751 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1513 microversion: 2.1 time: 0.168228 Aug 25 14:05:32.772356 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3349/6631] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:32 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:33.794963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25c2164d-929a-4a20-86ae-14531e30b47d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:33.795752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-25c2164d-929a-4a20-86ae-14531e30b47d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:33.802693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c2164d-929a-4a20-86ae-14531e30b47d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:33.803258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c2164d-929a-4a20-86ae-14531e30b47d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:33.803726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c2164d-929a-4a20-86ae-14531e30b47d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:33.804475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c2164d-929a-4a20-86ae-14531e30b47d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:33.804958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c2164d-929a-4a20-86ae-14531e30b47d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:33.805410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25c2164d-929a-4a20-86ae-14531e30b47d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:33.975956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-25c2164d-929a-4a20-86ae-14531e30b47d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:33.992754 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-25c2164d-929a-4a20-86ae-14531e30b47d tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1505 microversion: 2.1 time: 0.201813 Aug 25 14:05:34.009920 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3283/6632] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:33 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:34.022363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ddcda572-866d-4b0d-a31c-be6cc8c04976 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:34.022634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ddcda572-866d-4b0d-a31c-be6cc8c04976 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:34.029423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddcda572-866d-4b0d-a31c-be6cc8c04976 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.029982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddcda572-866d-4b0d-a31c-be6cc8c04976 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.030647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddcda572-866d-4b0d-a31c-be6cc8c04976 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.030780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-0631fccb-bc7b-4231-8967-aa5bbbc41a03 req-475f89c5-857d-4f1f-8f15-d78ca9f6af03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f", "name": "network-vif-plugged", "status": "completed", "tag": "250a7323-9984-4d67-9908-222fd6cd921b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:34.032079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddcda572-866d-4b0d-a31c-be6cc8c04976 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.032757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddcda572-866d-4b0d-a31c-be6cc8c04976 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.033395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ddcda572-866d-4b0d-a31c-be6cc8c04976 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.041100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0631fccb-bc7b-4231-8967-aa5bbbc41a03 req-475f89c5-857d-4f1f-8f15-d78ca9f6af03 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.042308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0631fccb-bc7b-4231-8967-aa5bbbc41a03 req-475f89c5-857d-4f1f-8f15-d78ca9f6af03 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.042749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-0631fccb-bc7b-4231-8967-aa5bbbc41a03 req-475f89c5-857d-4f1f-8f15-d78ca9f6af03 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.059755 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-0631fccb-bc7b-4231-8967-aa5bbbc41a03 req-475f89c5-857d-4f1f-8f15-d78ca9f6af03 service nova] Creating event network-vif-plugged:250a7323-9984-4d67-9908-222fd6cd921b for instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f on n-h2-852771-8 Aug 25 14:05:34.065390 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-0631fccb-bc7b-4231-8967-aa5bbbc41a03 req-475f89c5-857d-4f1f-8f15-d78ca9f6af03 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126340 Aug 25 14:05:34.066083 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3350/6633] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:05:34.188797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ddcda572-866d-4b0d-a31c-be6cc8c04976 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:34.199530 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ddcda572-866d-4b0d-a31c-be6cc8c04976 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1505 microversion: 2.1 time: 0.181773 Aug 25 14:05:34.200131 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3284/6634] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:34 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:34.221535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-426c4574-e68b-4724-ae2e-17ff6cdfc740 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:34.222131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-426c4574-e68b-4724-ae2e-17ff6cdfc740 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:34.228621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-426c4574-e68b-4724-ae2e-17ff6cdfc740 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.229103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-426c4574-e68b-4724-ae2e-17ff6cdfc740 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.229759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-426c4574-e68b-4724-ae2e-17ff6cdfc740 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.230699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-426c4574-e68b-4724-ae2e-17ff6cdfc740 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.231150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-426c4574-e68b-4724-ae2e-17ff6cdfc740 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.232145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-426c4574-e68b-4724-ae2e-17ff6cdfc740 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.376005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-426c4574-e68b-4724-ae2e-17ff6cdfc740 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:34.384165 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-426c4574-e68b-4724-ae2e-17ff6cdfc740 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1505 microversion: 2.1 time: 0.166979 Aug 25 14:05:34.384753 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3351/6635] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:34 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:34.405119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6e530d94-a986-4704-839d-aec2cd894347 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:34.405673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6e530d94-a986-4704-839d-aec2cd894347 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:34.412276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e530d94-a986-4704-839d-aec2cd894347 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.412773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e530d94-a986-4704-839d-aec2cd894347 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.413236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e530d94-a986-4704-839d-aec2cd894347 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.413999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e530d94-a986-4704-839d-aec2cd894347 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.414478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e530d94-a986-4704-839d-aec2cd894347 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.414928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6e530d94-a986-4704-839d-aec2cd894347 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.442920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6e530d94-a986-4704-839d-aec2cd894347 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:05:34.526843 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6e530d94-a986-4704-839d-aec2cd894347 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 204 len: 0 microversion: 2.1 time: 0.125545 Aug 25 14:05:34.527673 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3285/6636] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:05:34 2022] DELETE /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:05:34.547769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:34.548267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:34.554850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.555447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.555984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.556812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.558013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.558811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.586564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:05:34.641481 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.compute.api [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Instance is already in deleting state, ignoring this request Aug 25 14:05:34.642369 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cfb5f5cc-6153-46b7-8041-2b88982c5718 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 204 len: 0 microversion: 2.1 time: 0.098686 Aug 25 14:05:34.643507 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3352/6637] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:05:34 2022] DELETE /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:05:34.652332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-970a118d-4c80-4a6d-b048-4ce44426df14 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:34.653071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-970a118d-4c80-4a6d-b048-4ce44426df14 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:34.659614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970a118d-4c80-4a6d-b048-4ce44426df14 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.660133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970a118d-4c80-4a6d-b048-4ce44426df14 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.660604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970a118d-4c80-4a6d-b048-4ce44426df14 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.661348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970a118d-4c80-4a6d-b048-4ce44426df14 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:34.661861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970a118d-4c80-4a6d-b048-4ce44426df14 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:34.662320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-970a118d-4c80-4a6d-b048-4ce44426df14 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:34.802170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-970a118d-4c80-4a6d-b048-4ce44426df14 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:34.812631 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-970a118d-4c80-4a6d-b048-4ce44426df14 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1511 microversion: 2.1 time: 0.164678 Aug 25 14:05:34.813262 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3286/6638] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:34 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:05:35.835078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-efa08b5f-26b0-446f-8ecc-fdd495bdc188 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:35.835648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-efa08b5f-26b0-446f-8ecc-fdd495bdc188 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:35.843469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efa08b5f-26b0-446f-8ecc-fdd495bdc188 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:35.843964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efa08b5f-26b0-446f-8ecc-fdd495bdc188 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:35.844437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efa08b5f-26b0-446f-8ecc-fdd495bdc188 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:35.845160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efa08b5f-26b0-446f-8ecc-fdd495bdc188 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:35.845656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efa08b5f-26b0-446f-8ecc-fdd495bdc188 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:35.846093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-efa08b5f-26b0-446f-8ecc-fdd495bdc188 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:36.003595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-efa08b5f-26b0-446f-8ecc-fdd495bdc188 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47eba27ab0d54b92b9e8002cb57972e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:36.012391 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-efa08b5f-26b0-446f-8ecc-fdd495bdc188 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 200 len: 1511 microversion: 2.1 time: 0.181325 Aug 25 14:05:36.012998 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3353/6639] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:35 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:05:36.524571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a43f781e-76e7-4ed1-8a4d-62288723ca91 req-d4675772-6e24-434a-ac5e-bce0e71c12f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f", "name": "network-vif-deleted", "tag": "250a7323-9984-4d67-9908-222fd6cd921b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:36.537180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a43f781e-76e7-4ed1-8a4d-62288723ca91 req-d4675772-6e24-434a-ac5e-bce0e71c12f8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:36.537880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a43f781e-76e7-4ed1-8a4d-62288723ca91 req-d4675772-6e24-434a-ac5e-bce0e71c12f8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:36.538448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a43f781e-76e7-4ed1-8a4d-62288723ca91 req-d4675772-6e24-434a-ac5e-bce0e71c12f8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:36.558713 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a43f781e-76e7-4ed1-8a4d-62288723ca91 req-d4675772-6e24-434a-ac5e-bce0e71c12f8 service nova] Creating event network-vif-deleted:250a7323-9984-4d67-9908-222fd6cd921b for instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f on n-h2-852771-8 Aug 25 14:05:36.564208 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a43f781e-76e7-4ed1-8a4d-62288723ca91 req-d4675772-6e24-434a-ac5e-bce0e71c12f8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043555 Aug 25 14:05:36.564908 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3287/6640] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:05:37.035963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:37.036789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:37.046519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:37.047140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:37.047647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:37.048506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:37.049015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:37.049647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:37.065994 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] HTTP exception thrown: Instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f could not be found. Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Request method failure captured: Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f HTTP/1.1 Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4FH-QARFmEWe-450tOqqR7crDu-BYu7ol-gtS2Aj1IFUANB_LgLwTrgIQBgo2q0i_VT3wnlJqq4JxmUMb45747uKjN87pIa_5fhd9aJ9qOn-_Isr4B91c5aTSs4pEcPYT6enoKjawlB94xAu2BjGVy9kV0CF6KapsnOf6r-iRNk4Ls Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerDiskConfigTestJSON-897785338 Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d"}]}] Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerDiskConfigTestJSON-897785338 Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-897785338 Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerDiskConfigTestJSON-897785338-project Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 47eba27ab0d54b92b9e8002cb57972e0 Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerDiskConfigTestJSON-897785338-project Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f could not be found. Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f'} Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f could not be found. Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f could not be found. Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:05:37.067989 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.073341 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:37.073341 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:05:37.073341 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:05:37.073341 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:05:37.073341 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:05:37.073341 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f could not be found. Aug 25 14:05:37.073341 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.073341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Returning 404 to user: Instance 0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:05:37.073341 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-567faa75-b6ef-442d-b851-0c07c714ff69 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f" status: 404 len: 111 microversion: 2.1 time: 0.037821 Aug 25 14:05:37.073341 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3354/6641] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:37 2022] GET /compute/v2.1/servers/0fa3fd02-df2e-4071-b0b0-6fbfc7f9ac7f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:05:37.079821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9d64d89c-e9a2-4385-b774-2b6f3d16c563 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '.version_select at 0x7f3a2a41e1f0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:37.101385 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9d64d89c-e9a2-4385-b774-2b6f3d16c563 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852129966" status: 202 len: 0 microversion: 2.1 time: 0.025869 Aug 25 14:05:37.101999 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3288/6642] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 14:05:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852129966 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:05:37.798702 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:37.799267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:37.805905 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:37.806530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:37.806967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:37.808807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:37.809273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:37.809757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:37.824639 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] HTTP exception thrown: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Request method failure captured: Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 HTTP/1.1 Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4FH-QARFmEWe-450tOqqR7crDu-BYu7ol-gtS2Aj1IFUANB_LgLwTrgIQBgo2q0i_VT3wnlJqq4JxmUMb45747uKjN87pIa_5fhd9aJ9qOn-_Isr4B91c5aTSs4pEcPYT6enoKjawlB94xAu2BjGVy9kV0CF6KapsnOf6r-iRNk4Ls Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerDiskConfigTestJSON-897785338 Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d"}]}] Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerDiskConfigTestJSON-897785338 Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-897785338 Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerDiskConfigTestJSON-897785338-project Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 47eba27ab0d54b92b9e8002cb57972e0 Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerDiskConfigTestJSON-897785338-project Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '71aec441-13c5-4765-b07c-ed181e5c9219'} Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:05:37.826235 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Returning 404 to user: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ebbcdf7-4d22-43ed-80db-cfe355599738 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "DELETE /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 404 len: 111 microversion: 2.1 time: 0.033359 Aug 25 14:05:37.830026 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3355/6643] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:05:37 2022] DELETE /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:05:37.839741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:37.840526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] [instance: 71aec441-13c5-4765-b07c-ed181e5c9219] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:37.849919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:37.850515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:37.850970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:37.851698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:37.852164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:37.852606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:37.867881 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] HTTP exception thrown: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Request method failure captured: Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 HTTP/1.1 Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4FH-QARFmEWe-450tOqqR7crDu-BYu7ol-gtS2Aj1IFUANB_LgLwTrgIQBgo2q0i_VT3wnlJqq4JxmUMb45747uKjN87pIa_5fhd9aJ9qOn-_Isr4B91c5aTSs4pEcPYT6enoKjawlB94xAu2BjGVy9kV0CF6KapsnOf6r-iRNk4Ls Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerDiskConfigTestJSON-897785338 Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d"}]}] Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerDiskConfigTestJSON-897785338 Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: c9edb4f7ef5c4ab6b1a7fb1eec9e3c6d Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-897785338 Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerDiskConfigTestJSON-897785338-project Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 47eba27ab0d54b92b9e8002cb57972e0 Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerDiskConfigTestJSON-897785338-project Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '71aec441-13c5-4765-b07c-ed181e5c9219'} Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:05:37.869598 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.874881 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:37.874881 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:05:37.874881 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:05:37.874881 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:05:37.874881 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:05:37.874881 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. Aug 25 14:05:37.874881 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:05:37.874881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] Returning 404 to user: Instance 71aec441-13c5-4765-b07c-ed181e5c9219 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:05:37.874881 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ed6e744e-b7c7-49a9-9ae0-0ff409ad7578 tempest-ServerDiskConfigTestJSON-897785338 tempest-ServerDiskConfigTestJSON-897785338-project] 10.222.0.70 "GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219" status: 404 len: 111 microversion: 2.1 time: 0.037675 Aug 25 14:05:37.874881 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3289/6644] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:37 2022] GET /compute/v2.1/servers/71aec441-13c5-4765-b07c-ed181e5c9219 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:05:47.890878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=19 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:47.892296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:48.095457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e6b0d342-3be9-43a9-8fbc-4296881fe5cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'create', calling method: .version_select at 0x7f3a2e7db790>, body: {"keypair": {"name": "tempest-keypair-2050390348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCr+kTu/7NmC9Tl8WeZFffOJRkfockBjaz3s/iMXQyg2ffv7bjMrxmhF/5CsUh+8WOMzIY83Qe1Bq0HoesfW5Y6bB9xz4M4Ns3yOg4ZLvFVJ6jZaSk2wDIO+XSaV1/cXbw=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:48.125279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e6b0d342-3be9-43a9-8fbc-4296881fe5cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:05:48.132099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-e6b0d342-3be9-43a9-8fbc-4296881fe5cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for user dccab2ef88f44ffc84b30c57c7a86194 and project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:05:48.180832 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e6b0d342-3be9-43a9-8fbc-4296881fe5cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.299033 Aug 25 14:05:48.184307 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3356/6645] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:05:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:05:49.892093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1292264472", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee9ab0d6-db08-459b-b844-2b0d86452b77"}], "security_groups": [{"name": "tempest-securitygroup--480932018"}], "key_name": "tempest-keypair-2050390348", "user_data": "}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:49.910263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:49.911404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:50.035444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] validate_networks() for [('ee9ab0d6-db08-459b-b844-2b0d86452b77', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:05:50.532844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:05:50.533294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:05:50.533830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:05:50.534261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:05:50.534692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:05:50.546387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:50.546628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:50.547063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:50.547865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:50.548913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:50.548913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:50.572149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:05:50.579924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for user dccab2ef88f44ffc84b30c57c7a86194 and project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:05:50.597248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:05:50.599673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:05:50.652132 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a3e8f990-40b9-494a-b6c3-9193c87778e6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.767564 Aug 25 14:05:50.659494 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3290/6646] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:05:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:05:50.671218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8575e184-ff4b-4d71-92d2-d56f198e5797 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:50.672099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8575e184-ff4b-4d71-92d2-d56f198e5797 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:50.774528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8575e184-ff4b-4d71-92d2-d56f198e5797 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:50.793658 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8575e184-ff4b-4d71-92d2-d56f198e5797 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1239 microversion: 2.1 time: 0.130058 Aug 25 14:05:50.800719 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3357/6647] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:50 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1239 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:51.821391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e659ba18-3820-4a84-97ee-21fb36da4c2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:51.823093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e659ba18-3820-4a84-97ee-21fb36da4c2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:51.830272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e659ba18-3820-4a84-97ee-21fb36da4c2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:51.831290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e659ba18-3820-4a84-97ee-21fb36da4c2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:51.831919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e659ba18-3820-4a84-97ee-21fb36da4c2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:51.832696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e659ba18-3820-4a84-97ee-21fb36da4c2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:51.833341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e659ba18-3820-4a84-97ee-21fb36da4c2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:51.833812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e659ba18-3820-4a84-97ee-21fb36da4c2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:51.937239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e659ba18-3820-4a84-97ee-21fb36da4c2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:51.948170 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e659ba18-3820-4a84-97ee-21fb36da4c2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1299 microversion: 2.1 time: 0.131187 Aug 25 14:05:51.949936 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3291/6648] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:51 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:05:52.972350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7e727530-9e77-4a53-86b3-4eba5c7448d0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:52.973087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7e727530-9e77-4a53-86b3-4eba5c7448d0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:52.981299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e727530-9e77-4a53-86b3-4eba5c7448d0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:52.981826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e727530-9e77-4a53-86b3-4eba5c7448d0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:52.982273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e727530-9e77-4a53-86b3-4eba5c7448d0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:52.983007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e727530-9e77-4a53-86b3-4eba5c7448d0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:52.983472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e727530-9e77-4a53-86b3-4eba5c7448d0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:52.983904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7e727530-9e77-4a53-86b3-4eba5c7448d0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:53.135015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7e727530-9e77-4a53-86b3-4eba5c7448d0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:53.147534 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7e727530-9e77-4a53-86b3-4eba5c7448d0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1364 microversion: 2.1 time: 0.179008 Aug 25 14:05:53.171240 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3358/6649] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:52 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:53.832019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a1f932ff-9544-4af5-8230-830e9d270c2c req-7b73daec-eb50-4b1b-a9f3-6eadbcc48547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1da74f-859e-47e8-b84b-bec7c6bed8c2", "tag": "ec591155-4392-4386-90bb-50f7cb32c039"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:53.843909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a1f932ff-9544-4af5-8230-830e9d270c2c req-7b73daec-eb50-4b1b-a9f3-6eadbcc48547 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:53.844340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a1f932ff-9544-4af5-8230-830e9d270c2c req-7b73daec-eb50-4b1b-a9f3-6eadbcc48547 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:53.845698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a1f932ff-9544-4af5-8230-830e9d270c2c req-7b73daec-eb50-4b1b-a9f3-6eadbcc48547 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:53.857328 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a1f932ff-9544-4af5-8230-830e9d270c2c req-7b73daec-eb50-4b1b-a9f3-6eadbcc48547 service nova] Creating event network-changed:ec591155-4392-4386-90bb-50f7cb32c039 for instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 on n-h2-852771-8 Aug 25 14:05:53.862845 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a1f932ff-9544-4af5-8230-830e9d270c2c req-7b73daec-eb50-4b1b-a9f3-6eadbcc48547 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035119 Aug 25 14:05:53.863478 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3292/6650] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:05:54.174252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-56b6ccd2-2f67-4c63-a801-814ea7684ed1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:54.174982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-56b6ccd2-2f67-4c63-a801-814ea7684ed1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:54.183528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56b6ccd2-2f67-4c63-a801-814ea7684ed1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:54.184364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56b6ccd2-2f67-4c63-a801-814ea7684ed1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:54.184843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56b6ccd2-2f67-4c63-a801-814ea7684ed1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:54.185644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56b6ccd2-2f67-4c63-a801-814ea7684ed1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:54.186154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56b6ccd2-2f67-4c63-a801-814ea7684ed1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:54.186595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-56b6ccd2-2f67-4c63-a801-814ea7684ed1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:54.342270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-56b6ccd2-2f67-4c63-a801-814ea7684ed1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:54.350592 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-56b6ccd2-2f67-4c63-a801-814ea7684ed1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1364 microversion: 2.1 time: 0.180889 Aug 25 14:05:54.351406 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3359/6651] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:54 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:55.374176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9b29bda0-5a4d-4e47-b07c-79b727c6d115 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:55.374887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9b29bda0-5a4d-4e47-b07c-79b727c6d115 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:55.381633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b29bda0-5a4d-4e47-b07c-79b727c6d115 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.382143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b29bda0-5a4d-4e47-b07c-79b727c6d115 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.382605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b29bda0-5a4d-4e47-b07c-79b727c6d115 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.383390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b29bda0-5a4d-4e47-b07c-79b727c6d115 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.383811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b29bda0-5a4d-4e47-b07c-79b727c6d115 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.384249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9b29bda0-5a4d-4e47-b07c-79b727c6d115 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.538143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9b29bda0-5a4d-4e47-b07c-79b727c6d115 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:55.553020 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9b29bda0-5a4d-4e47-b07c-79b727c6d115 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1364 microversion: 2.1 time: 0.184181 Aug 25 14:05:55.554176 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3293/6652] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:55 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:56.578383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e5d9f021-7f16-4fed-9455-398e2d070b01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:56.579001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e5d9f021-7f16-4fed-9455-398e2d070b01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:56.586658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d9f021-7f16-4fed-9455-398e2d070b01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:56.587192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d9f021-7f16-4fed-9455-398e2d070b01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:56.587634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d9f021-7f16-4fed-9455-398e2d070b01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:56.589364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d9f021-7f16-4fed-9455-398e2d070b01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:56.589974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d9f021-7f16-4fed-9455-398e2d070b01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:56.590382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e5d9f021-7f16-4fed-9455-398e2d070b01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:56.736184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e5d9f021-7f16-4fed-9455-398e2d070b01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:56.745478 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e5d9f021-7f16-4fed-9455-398e2d070b01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1364 microversion: 2.1 time: 0.172038 Aug 25 14:05:56.746213 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3360/6653] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:56 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:57.767504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-41d92c80-75c2-4a44-8310-5ba6302911dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:57.768142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-41d92c80-75c2-4a44-8310-5ba6302911dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:57.775551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41d92c80-75c2-4a44-8310-5ba6302911dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:57.776063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41d92c80-75c2-4a44-8310-5ba6302911dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:57.776518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41d92c80-75c2-4a44-8310-5ba6302911dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:57.777262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41d92c80-75c2-4a44-8310-5ba6302911dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:57.777767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41d92c80-75c2-4a44-8310-5ba6302911dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:57.778215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-41d92c80-75c2-4a44-8310-5ba6302911dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:57.955663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-41d92c80-75c2-4a44-8310-5ba6302911dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:57.967730 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-41d92c80-75c2-4a44-8310-5ba6302911dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1364 microversion: 2.1 time: 0.204111 Aug 25 14:05:57.968331 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3294/6654] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:57 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:58.998238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d0d6f6f7-1ce0-4315-a0b1-807c9ca024cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:58.999009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d0d6f6f7-1ce0-4315-a0b1-807c9ca024cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:59.006343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0d6f6f7-1ce0-4315-a0b1-807c9ca024cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:59.006842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0d6f6f7-1ce0-4315-a0b1-807c9ca024cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:59.007293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0d6f6f7-1ce0-4315-a0b1-807c9ca024cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:59.008004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0d6f6f7-1ce0-4315-a0b1-807c9ca024cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:59.008465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0d6f6f7-1ce0-4315-a0b1-807c9ca024cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:59.008899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d0d6f6f7-1ce0-4315-a0b1-807c9ca024cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:59.160817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d0d6f6f7-1ce0-4315-a0b1-807c9ca024cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:59.169750 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d0d6f6f7-1ce0-4315-a0b1-807c9ca024cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1364 microversion: 2.1 time: 0.178287 Aug 25 14:05:59.170339 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3361/6655] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:58 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:00.066075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-119c6170-4cc5-4fb7-bdde-f68035aee961 req-e6601805-8555-4c5f-91e9-50e848c4e75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1da74f-859e-47e8-b84b-bec7c6bed8c2", "name": "network-vif-plugged", "status": "completed", "tag": "ec591155-4392-4386-90bb-50f7cb32c039"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:06:00.081752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-119c6170-4cc5-4fb7-bdde-f68035aee961 req-e6601805-8555-4c5f-91e9-50e848c4e75c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:00.082252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-119c6170-4cc5-4fb7-bdde-f68035aee961 req-e6601805-8555-4c5f-91e9-50e848c4e75c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:00.082877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-119c6170-4cc5-4fb7-bdde-f68035aee961 req-e6601805-8555-4c5f-91e9-50e848c4e75c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:00.098107 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-119c6170-4cc5-4fb7-bdde-f68035aee961 req-e6601805-8555-4c5f-91e9-50e848c4e75c service nova] Creating event network-vif-plugged:ec591155-4392-4386-90bb-50f7cb32c039 for instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 on n-h2-852771-8 Aug 25 14:06:00.105944 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-119c6170-4cc5-4fb7-bdde-f68035aee961 req-e6601805-8555-4c5f-91e9-50e848c4e75c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045459 Aug 25 14:06:00.106813 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3295/6656] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:06:00.194339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f6a05af7-36da-46bb-a5f4-b29a8ad6952d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:00.195206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f6a05af7-36da-46bb-a5f4-b29a8ad6952d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:00.203014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6a05af7-36da-46bb-a5f4-b29a8ad6952d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:00.203518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6a05af7-36da-46bb-a5f4-b29a8ad6952d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:00.204048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6a05af7-36da-46bb-a5f4-b29a8ad6952d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:00.204782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6a05af7-36da-46bb-a5f4-b29a8ad6952d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:00.205243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6a05af7-36da-46bb-a5f4-b29a8ad6952d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:00.205889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f6a05af7-36da-46bb-a5f4-b29a8ad6952d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:00.383599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f6a05af7-36da-46bb-a5f4-b29a8ad6952d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:00.392456 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f6a05af7-36da-46bb-a5f4-b29a8ad6952d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1364 microversion: 2.1 time: 0.203932 Aug 25 14:06:00.393047 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3362/6657] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:00 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:06:01.421363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-293f670c-f75f-4b38-b75d-7c8729862328 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:01.422054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-293f670c-f75f-4b38-b75d-7c8729862328 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:01.424384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:01.425093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:01.433991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-293f670c-f75f-4b38-b75d-7c8729862328 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:01.434507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-293f670c-f75f-4b38-b75d-7c8729862328 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:01.434984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-293f670c-f75f-4b38-b75d-7c8729862328 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:01.435720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-293f670c-f75f-4b38-b75d-7c8729862328 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:01.436198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-293f670c-f75f-4b38-b75d-7c8729862328 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:01.436652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-293f670c-f75f-4b38-b75d-7c8729862328 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:01.588967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-293f670c-f75f-4b38-b75d-7c8729862328 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:01.598030 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-293f670c-f75f-4b38-b75d-7c8729862328 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1364 microversion: 2.1 time: 0.182195 Aug 25 14:06:01.598654 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3296/6658] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:01 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:02.620940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-249d0c5f-e530-4341-adf1-2c358250f31a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:02.621613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-249d0c5f-e530-4341-adf1-2c358250f31a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:02.623550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:02.629929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-249d0c5f-e530-4341-adf1-2c358250f31a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:02.630355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-249d0c5f-e530-4341-adf1-2c358250f31a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:02.630795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-249d0c5f-e530-4341-adf1-2c358250f31a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:02.631500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-249d0c5f-e530-4341-adf1-2c358250f31a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:02.631956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-249d0c5f-e530-4341-adf1-2c358250f31a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:02.632386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-249d0c5f-e530-4341-adf1-2c358250f31a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:02.779718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-249d0c5f-e530-4341-adf1-2c358250f31a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:02.788001 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-249d0c5f-e530-4341-adf1-2c358250f31a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1551 microversion: 2.1 time: 0.171436 Aug 25 14:06:02.788769 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3363/6659] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:02 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1551 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:02.811966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4bde0aa3-fa0f-4860-a35b-11c9d8fd7041 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:02.812538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4bde0aa3-fa0f-4860-a35b-11c9d8fd7041 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:02.819221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bde0aa3-fa0f-4860-a35b-11c9d8fd7041 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:02.819842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bde0aa3-fa0f-4860-a35b-11c9d8fd7041 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:02.820189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bde0aa3-fa0f-4860-a35b-11c9d8fd7041 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:02.821579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bde0aa3-fa0f-4860-a35b-11c9d8fd7041 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:02.821579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bde0aa3-fa0f-4860-a35b-11c9d8fd7041 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:02.821863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4bde0aa3-fa0f-4860-a35b-11c9d8fd7041 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:02.932366 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4bde0aa3-fa0f-4860-a35b-11c9d8fd7041 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125542 Aug 25 14:06:02.933453 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3297/6660] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 14:06:02 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:06:04.020778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-7cefe8ba-b371-4914-a8e3-cf34265f8ca8 req-3930839d-5113-4ffa-801a-b41f255fcbbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1da74f-859e-47e8-b84b-bec7c6bed8c2", "tag": "ec591155-4392-4386-90bb-50f7cb32c039"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:06:04.036931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7cefe8ba-b371-4914-a8e3-cf34265f8ca8 req-3930839d-5113-4ffa-801a-b41f255fcbbf service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:04.037348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7cefe8ba-b371-4914-a8e3-cf34265f8ca8 req-3930839d-5113-4ffa-801a-b41f255fcbbf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:04.037822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7cefe8ba-b371-4914-a8e3-cf34265f8ca8 req-3930839d-5113-4ffa-801a-b41f255fcbbf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:04.058883 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-7cefe8ba-b371-4914-a8e3-cf34265f8ca8 req-3930839d-5113-4ffa-801a-b41f255fcbbf service nova] Creating event network-changed:ec591155-4392-4386-90bb-50f7cb32c039 for instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 on n-h2-852771-8 Aug 25 14:06:04.065299 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-7cefe8ba-b371-4914-a8e3-cf34265f8ca8 req-3930839d-5113-4ffa-801a-b41f255fcbbf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048247 Aug 25 14:06:04.066146 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3364/6661] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:08.818435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:08.819269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=34 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:08.824336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bb416e9f-d2e7-41b9-9a92-9ce441927082 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:08.824966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bb416e9f-d2e7-41b9-9a92-9ce441927082 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:08.833261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb416e9f-d2e7-41b9-9a92-9ce441927082 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:08.833796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb416e9f-d2e7-41b9-9a92-9ce441927082 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:08.834261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb416e9f-d2e7-41b9-9a92-9ce441927082 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:08.834996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb416e9f-d2e7-41b9-9a92-9ce441927082 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:08.835466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb416e9f-d2e7-41b9-9a92-9ce441927082 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:08.835913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bb416e9f-d2e7-41b9-9a92-9ce441927082 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:08.984388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bb416e9f-d2e7-41b9-9a92-9ce441927082 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:08.992485 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bb416e9f-d2e7-41b9-9a92-9ce441927082 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1670 microversion: 2.1 time: 0.176974 Aug 25 14:07:08.993078 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3298/6662] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:08 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:09.012456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:09.013199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=38 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:09.015003 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 25 14:07:09.020823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d1522ea-e75c-4234-bfa5-bc03de8b07fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:09.021569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d1522ea-e75c-4234-bfa5-bc03de8b07fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:09.033711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1522ea-e75c-4234-bfa5-bc03de8b07fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:09.034206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1522ea-e75c-4234-bfa5-bc03de8b07fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:09.034644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1522ea-e75c-4234-bfa5-bc03de8b07fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:09.035343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1522ea-e75c-4234-bfa5-bc03de8b07fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:09.035796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1522ea-e75c-4234-bfa5-bc03de8b07fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:09.036220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1522ea-e75c-4234-bfa5-bc03de8b07fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:09.174827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8d1522ea-e75c-4234-bfa5-bc03de8b07fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:09.183067 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d1522ea-e75c-4234-bfa5-bc03de8b07fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1670 microversion: 2.1 time: 0.173280 Aug 25 14:07:09.183676 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3365/6663] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:09 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:09.207140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b536e08-d0ae-472c-a16e-7605fbb06698 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:09.207948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b536e08-d0ae-472c-a16e-7605fbb06698 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:09.214061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b536e08-d0ae-472c-a16e-7605fbb06698 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:09.214565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b536e08-d0ae-472c-a16e-7605fbb06698 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:09.215022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b536e08-d0ae-472c-a16e-7605fbb06698 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:09.215741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b536e08-d0ae-472c-a16e-7605fbb06698 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:09.216219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b536e08-d0ae-472c-a16e-7605fbb06698 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:09.216957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b536e08-d0ae-472c-a16e-7605fbb06698 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:09.351982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b536e08-d0ae-472c-a16e-7605fbb06698 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:09.360603 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b536e08-d0ae-472c-a16e-7605fbb06698 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1670 microversion: 2.1 time: 0.157508 Aug 25 14:07:09.361242 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3299/6664] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:09 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:09.381170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:09.383512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:09.389549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:09.390021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:09.390540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:09.391164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:09.391664 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:09.392090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:09.422363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:09.428644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Old instance type m1.heat2, new instance type m1.heat {{(pid=129060) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:07:09.435107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:07:09.435531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:07:09.436009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:07:09.436418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:07:09.437383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:07:09.511296 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d60fab1a-26ee-4b44-bfc5-02463b54917f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2/action" status: 202 len: 0 microversion: 2.1 time: 0.133855 Aug 25 14:07:09.511925 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3366/6665] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:07:09 2022] POST /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:07:09.520898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-91332aae-4aa3-4ea8-8ee1-9587d18ce451 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:09.521616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-91332aae-4aa3-4ea8-8ee1-9587d18ce451 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:09.528316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91332aae-4aa3-4ea8-8ee1-9587d18ce451 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:09.528936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91332aae-4aa3-4ea8-8ee1-9587d18ce451 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:09.529435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91332aae-4aa3-4ea8-8ee1-9587d18ce451 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:09.530214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91332aae-4aa3-4ea8-8ee1-9587d18ce451 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:09.530960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91332aae-4aa3-4ea8-8ee1-9587d18ce451 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:09.531623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91332aae-4aa3-4ea8-8ee1-9587d18ce451 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:09.683316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-91332aae-4aa3-4ea8-8ee1-9587d18ce451 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:09.692779 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-91332aae-4aa3-4ea8-8ee1-9587d18ce451 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1679 microversion: 2.1 time: 0.175471 Aug 25 14:07:09.693525 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3300/6666] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:09 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:10.714639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e18b088e-2b4c-4b83-9103-67ac38f2f4c7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:10.715289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e18b088e-2b4c-4b83-9103-67ac38f2f4c7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:10.723070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e18b088e-2b4c-4b83-9103-67ac38f2f4c7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:10.723565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e18b088e-2b4c-4b83-9103-67ac38f2f4c7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:10.724069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e18b088e-2b4c-4b83-9103-67ac38f2f4c7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:10.724719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e18b088e-2b4c-4b83-9103-67ac38f2f4c7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:10.725187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e18b088e-2b4c-4b83-9103-67ac38f2f4c7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:10.725654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e18b088e-2b4c-4b83-9103-67ac38f2f4c7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:10.887815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e18b088e-2b4c-4b83-9103-67ac38f2f4c7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:10.897868 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e18b088e-2b4c-4b83-9103-67ac38f2f4c7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1679 microversion: 2.1 time: 0.187172 Aug 25 14:07:10.898584 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3367/6667] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:10 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:11.923156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b6ee39cd-b260-4501-a2eb-fb8f2e3d24fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:11.923704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b6ee39cd-b260-4501-a2eb-fb8f2e3d24fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:11.930723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6ee39cd-b260-4501-a2eb-fb8f2e3d24fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:11.931234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6ee39cd-b260-4501-a2eb-fb8f2e3d24fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:11.931697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6ee39cd-b260-4501-a2eb-fb8f2e3d24fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:11.932420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6ee39cd-b260-4501-a2eb-fb8f2e3d24fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:11.932908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6ee39cd-b260-4501-a2eb-fb8f2e3d24fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:11.933359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6ee39cd-b260-4501-a2eb-fb8f2e3d24fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:12.068352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b6ee39cd-b260-4501-a2eb-fb8f2e3d24fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:12.076385 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b6ee39cd-b260-4501-a2eb-fb8f2e3d24fa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1684 microversion: 2.1 time: 0.158035 Aug 25 14:07:12.076971 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3301/6668] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:11 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:13.099035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1b92832f-8a50-4f09-a357-7d844fa94999 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:13.099647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1b92832f-8a50-4f09-a357-7d844fa94999 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:13.107079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b92832f-8a50-4f09-a357-7d844fa94999 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:13.107558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b92832f-8a50-4f09-a357-7d844fa94999 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:13.107992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b92832f-8a50-4f09-a357-7d844fa94999 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:13.108847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b92832f-8a50-4f09-a357-7d844fa94999 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:13.109493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b92832f-8a50-4f09-a357-7d844fa94999 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:13.109949 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1b92832f-8a50-4f09-a357-7d844fa94999 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:13.251276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1b92832f-8a50-4f09-a357-7d844fa94999 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:13.259406 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1b92832f-8a50-4f09-a357-7d844fa94999 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1684 microversion: 2.1 time: 0.164358 Aug 25 14:07:13.259981 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3368/6669] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:13 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:14.282852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b2e67854-bc18-40a2-93ba-6c4d534f31a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:14.283480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b2e67854-bc18-40a2-93ba-6c4d534f31a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:14.290919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2e67854-bc18-40a2-93ba-6c4d534f31a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:14.291452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2e67854-bc18-40a2-93ba-6c4d534f31a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:14.291905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2e67854-bc18-40a2-93ba-6c4d534f31a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:14.292635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2e67854-bc18-40a2-93ba-6c4d534f31a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:14.293104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2e67854-bc18-40a2-93ba-6c4d534f31a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:14.293570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b2e67854-bc18-40a2-93ba-6c4d534f31a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:14.455644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b2e67854-bc18-40a2-93ba-6c4d534f31a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:14.464698 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b2e67854-bc18-40a2-93ba-6c4d534f31a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1684 microversion: 2.1 time: 0.186932 Aug 25 14:07:14.465320 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3302/6670] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:14 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:15.493454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ffb7c66e-5ce5-4a70-8586-9098371ce3cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:15.494653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ffb7c66e-5ce5-4a70-8586-9098371ce3cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:15.507791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb7c66e-5ce5-4a70-8586-9098371ce3cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:15.508672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb7c66e-5ce5-4a70-8586-9098371ce3cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:15.509540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb7c66e-5ce5-4a70-8586-9098371ce3cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:15.510806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb7c66e-5ce5-4a70-8586-9098371ce3cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:15.511635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb7c66e-5ce5-4a70-8586-9098371ce3cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:15.512398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffb7c66e-5ce5-4a70-8586-9098371ce3cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:15.677379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ffb7c66e-5ce5-4a70-8586-9098371ce3cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:15.688014 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ffb7c66e-5ce5-4a70-8586-9098371ce3cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1684 microversion: 2.1 time: 0.202138 Aug 25 14:07:15.688631 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3369/6671] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:15 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1684 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:16.710721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b982f1a-d2c2-4762-8077-6b2a2d3c285c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:16.711628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6b982f1a-d2c2-4762-8077-6b2a2d3c285c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:16.719661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b982f1a-d2c2-4762-8077-6b2a2d3c285c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:16.720184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b982f1a-d2c2-4762-8077-6b2a2d3c285c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:16.720655 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b982f1a-d2c2-4762-8077-6b2a2d3c285c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:16.721416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b982f1a-d2c2-4762-8077-6b2a2d3c285c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:16.721925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b982f1a-d2c2-4762-8077-6b2a2d3c285c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:16.722390 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b982f1a-d2c2-4762-8077-6b2a2d3c285c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:16.899891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6b982f1a-d2c2-4762-8077-6b2a2d3c285c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:16.909040 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6b982f1a-d2c2-4762-8077-6b2a2d3c285c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1684 microversion: 2.1 time: 0.202378 Aug 25 14:07:16.909705 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3303/6672] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:16 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1684 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:17.931273 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fbd9c003-7749-4541-97b0-cd150624a0c9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:17.931817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fbd9c003-7749-4541-97b0-cd150624a0c9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:17.939549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbd9c003-7749-4541-97b0-cd150624a0c9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:17.940033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbd9c003-7749-4541-97b0-cd150624a0c9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:17.940468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbd9c003-7749-4541-97b0-cd150624a0c9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:17.945551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbd9c003-7749-4541-97b0-cd150624a0c9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:17.945551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbd9c003-7749-4541-97b0-cd150624a0c9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:17.945551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fbd9c003-7749-4541-97b0-cd150624a0c9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:18.090701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fbd9c003-7749-4541-97b0-cd150624a0c9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:18.099305 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fbd9c003-7749-4541-97b0-cd150624a0c9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1684 microversion: 2.1 time: 0.171966 Aug 25 14:07:18.099912 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3370/6673] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:17 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:19.121854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-987fe871-03bb-413b-8358-fd72da9e15da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:19.122502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-987fe871-03bb-413b-8358-fd72da9e15da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:19.130623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-987fe871-03bb-413b-8358-fd72da9e15da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:19.131145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-987fe871-03bb-413b-8358-fd72da9e15da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:19.131616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-987fe871-03bb-413b-8358-fd72da9e15da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:19.132378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-987fe871-03bb-413b-8358-fd72da9e15da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:19.132891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-987fe871-03bb-413b-8358-fd72da9e15da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:19.133354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-987fe871-03bb-413b-8358-fd72da9e15da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:19.302917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-987fe871-03bb-413b-8358-fd72da9e15da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:19.312534 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-987fe871-03bb-413b-8358-fd72da9e15da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1684 microversion: 2.1 time: 0.194176 Aug 25 14:07:19.313177 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3304/6674] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:19 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1684 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:20.333789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c8753900-a51d-44e8-a673-af0cb89849dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:20.334400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c8753900-a51d-44e8-a673-af0cb89849dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:20.341588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8753900-a51d-44e8-a673-af0cb89849dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:20.342157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8753900-a51d-44e8-a673-af0cb89849dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:20.342653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8753900-a51d-44e8-a673-af0cb89849dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:20.343464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8753900-a51d-44e8-a673-af0cb89849dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:20.343938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8753900-a51d-44e8-a673-af0cb89849dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:20.344372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8753900-a51d-44e8-a673-af0cb89849dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:20.492950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c8753900-a51d-44e8-a673-af0cb89849dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:20.502577 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c8753900-a51d-44e8-a673-af0cb89849dd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1684 microversion: 2.1 time: 0.172603 Aug 25 14:07:20.502917 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3371/6675] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:20 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:21.525706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff5ecb9d-0840-40b5-ae75-58d0078e871d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:21.526334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ff5ecb9d-0840-40b5-ae75-58d0078e871d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:21.533701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff5ecb9d-0840-40b5-ae75-58d0078e871d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:21.534221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff5ecb9d-0840-40b5-ae75-58d0078e871d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:21.534677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff5ecb9d-0840-40b5-ae75-58d0078e871d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:21.535409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff5ecb9d-0840-40b5-ae75-58d0078e871d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:21.535881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff5ecb9d-0840-40b5-ae75-58d0078e871d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:21.536323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff5ecb9d-0840-40b5-ae75-58d0078e871d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:21.691652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ff5ecb9d-0840-40b5-ae75-58d0078e871d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:21.699915 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff5ecb9d-0840-40b5-ae75-58d0078e871d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1684 microversion: 2.1 time: 0.178336 Aug 25 14:07:21.700510 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3305/6676] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:21 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:22.722538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ac0e83f5-deb4-456a-8c6c-69c129161874 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:22.723167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ac0e83f5-deb4-456a-8c6c-69c129161874 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:22.730010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0e83f5-deb4-456a-8c6c-69c129161874 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:22.730493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0e83f5-deb4-456a-8c6c-69c129161874 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:22.730935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0e83f5-deb4-456a-8c6c-69c129161874 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:22.731638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0e83f5-deb4-456a-8c6c-69c129161874 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:22.732092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0e83f5-deb4-456a-8c6c-69c129161874 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:22.732517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ac0e83f5-deb4-456a-8c6c-69c129161874 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:22.868720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ac0e83f5-deb4-456a-8c6c-69c129161874 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:22.878018 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ac0e83f5-deb4-456a-8c6c-69c129161874 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1684 microversion: 2.1 time: 0.159935 Aug 25 14:07:22.878606 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3372/6677] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:22 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:23.883748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a00f245b-a7b2-4a44-ba68-5f88d32a5a68 req-5aefc481-cfd9-4812-a89a-cb2fc77148b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1da74f-859e-47e8-b84b-bec7c6bed8c2", "name": "network-vif-unplugged", "status": "completed", "tag": "ec591155-4392-4386-90bb-50f7cb32c039"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:23.896279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a00f245b-a7b2-4a44-ba68-5f88d32a5a68 req-5aefc481-cfd9-4812-a89a-cb2fc77148b7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:23.896279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a00f245b-a7b2-4a44-ba68-5f88d32a5a68 req-5aefc481-cfd9-4812-a89a-cb2fc77148b7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:23.896279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a00f245b-a7b2-4a44-ba68-5f88d32a5a68 req-5aefc481-cfd9-4812-a89a-cb2fc77148b7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:23.901373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2429e367-db88-4707-839e-c01ad54150cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:23.902754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2429e367-db88-4707-839e-c01ad54150cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:23.909837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2429e367-db88-4707-839e-c01ad54150cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:23.910079 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a00f245b-a7b2-4a44-ba68-5f88d32a5a68 req-5aefc481-cfd9-4812-a89a-cb2fc77148b7 service nova] Creating event network-vif-unplugged:ec591155-4392-4386-90bb-50f7cb32c039 for instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 on n-h1-852771-8 Aug 25 14:07:23.910279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2429e367-db88-4707-839e-c01ad54150cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:23.910707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2429e367-db88-4707-839e-c01ad54150cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:23.911418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2429e367-db88-4707-839e-c01ad54150cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:23.911884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2429e367-db88-4707-839e-c01ad54150cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:23.912318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2429e367-db88-4707-839e-c01ad54150cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:23.916518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-a00f245b-a7b2-4a44-ba68-5f88d32a5a68 req-5aefc481-cfd9-4812-a89a-cb2fc77148b7 service nova] Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:07:23.929773 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a00f245b-a7b2-4a44-ba68-5f88d32a5a68 req-5aefc481-cfd9-4812-a89a-cb2fc77148b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049771 Aug 25 14:07:23.930902 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3306/6678] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:24.063864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2429e367-db88-4707-839e-c01ad54150cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:24.072660 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2429e367-db88-4707-839e-c01ad54150cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1683 microversion: 2.1 time: 0.175531 Aug 25 14:07:24.073368 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3373/6679] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:23 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:25.099329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-522efd44-7bf5-42af-803b-20b64162f930 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:25.100049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-522efd44-7bf5-42af-803b-20b64162f930 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:25.106677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522efd44-7bf5-42af-803b-20b64162f930 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:25.107185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522efd44-7bf5-42af-803b-20b64162f930 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:25.107650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522efd44-7bf5-42af-803b-20b64162f930 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:25.108386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522efd44-7bf5-42af-803b-20b64162f930 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:25.108867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522efd44-7bf5-42af-803b-20b64162f930 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:25.109351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522efd44-7bf5-42af-803b-20b64162f930 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:25.263813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-522efd44-7bf5-42af-803b-20b64162f930 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:25.274045 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-522efd44-7bf5-42af-803b-20b64162f930 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1681 microversion: 2.1 time: 0.180343 Aug 25 14:07:25.274652 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3307/6680] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:25 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:25.962306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d3d35854-b70e-40a0-ac89-56021abb5e1e req-9fbb9127-26dd-4a0b-b772-15f2ced7d06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1da74f-859e-47e8-b84b-bec7c6bed8c2", "tag": "ec591155-4392-4386-90bb-50f7cb32c039"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:25.973141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d3d35854-b70e-40a0-ac89-56021abb5e1e req-9fbb9127-26dd-4a0b-b772-15f2ced7d06d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:25.973634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d3d35854-b70e-40a0-ac89-56021abb5e1e req-9fbb9127-26dd-4a0b-b772-15f2ced7d06d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:25.974071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d3d35854-b70e-40a0-ac89-56021abb5e1e req-9fbb9127-26dd-4a0b-b772-15f2ced7d06d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:25.986633 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d3d35854-b70e-40a0-ac89-56021abb5e1e req-9fbb9127-26dd-4a0b-b772-15f2ced7d06d service nova] Creating event network-changed:ec591155-4392-4386-90bb-50f7cb32c039 for instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 on n-h1-852771-8 Aug 25 14:07:25.992081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-d3d35854-b70e-40a0-ac89-56021abb5e1e req-9fbb9127-26dd-4a0b-b772-15f2ced7d06d service nova] Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:07:26.004242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d3d35854-b70e-40a0-ac89-56021abb5e1e req-9fbb9127-26dd-4a0b-b772-15f2ced7d06d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045642 Aug 25 14:07:26.004862 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3374/6681] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:26.295323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e86a51a5-5453-4570-84a1-bffc1b768880 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:26.296107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e86a51a5-5453-4570-84a1-bffc1b768880 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:26.304343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86a51a5-5453-4570-84a1-bffc1b768880 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:26.304855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86a51a5-5453-4570-84a1-bffc1b768880 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:26.305324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86a51a5-5453-4570-84a1-bffc1b768880 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:26.306101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86a51a5-5453-4570-84a1-bffc1b768880 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:26.306581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86a51a5-5453-4570-84a1-bffc1b768880 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:26.307034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86a51a5-5453-4570-84a1-bffc1b768880 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:26.456436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e86a51a5-5453-4570-84a1-bffc1b768880 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:26.470830 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e86a51a5-5453-4570-84a1-bffc1b768880 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1681 microversion: 2.1 time: 0.178908 Aug 25 14:07:26.471956 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3308/6682] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:26 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:27.507380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9ff00edc-6fa6-4fcb-a6ff-bb5a37986516 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:27.508085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9ff00edc-6fa6-4fcb-a6ff-bb5a37986516 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:27.516182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ff00edc-6fa6-4fcb-a6ff-bb5a37986516 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:27.517381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ff00edc-6fa6-4fcb-a6ff-bb5a37986516 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:27.517867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ff00edc-6fa6-4fcb-a6ff-bb5a37986516 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:27.518582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ff00edc-6fa6-4fcb-a6ff-bb5a37986516 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:27.519045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ff00edc-6fa6-4fcb-a6ff-bb5a37986516 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:27.519478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9ff00edc-6fa6-4fcb-a6ff-bb5a37986516 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:27.753399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9ff00edc-6fa6-4fcb-a6ff-bb5a37986516 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:27.761584 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9ff00edc-6fa6-4fcb-a6ff-bb5a37986516 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1681 microversion: 2.1 time: 0.258457 Aug 25 14:07:27.762124 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3375/6683] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:27 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:28.783198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7504e5dd-b3ea-499e-93b9-a4c90833fa82 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:28.783979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7504e5dd-b3ea-499e-93b9-a4c90833fa82 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:28.790681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7504e5dd-b3ea-499e-93b9-a4c90833fa82 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:28.791191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7504e5dd-b3ea-499e-93b9-a4c90833fa82 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:28.791659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7504e5dd-b3ea-499e-93b9-a4c90833fa82 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:28.792388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7504e5dd-b3ea-499e-93b9-a4c90833fa82 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:28.792868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7504e5dd-b3ea-499e-93b9-a4c90833fa82 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:28.793315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7504e5dd-b3ea-499e-93b9-a4c90833fa82 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:29.001711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7504e5dd-b3ea-499e-93b9-a4c90833fa82 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:29.010316 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7504e5dd-b3ea-499e-93b9-a4c90833fa82 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1678 microversion: 2.1 time: 0.231268 Aug 25 14:07:29.010913 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3309/6684] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:28 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:29.031522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4608b280-f3d6-4d2e-b62c-1ccb2cf4a18c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:29.032388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4608b280-f3d6-4d2e-b62c-1ccb2cf4a18c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:29.039609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4608b280-f3d6-4d2e-b62c-1ccb2cf4a18c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:29.040359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4608b280-f3d6-4d2e-b62c-1ccb2cf4a18c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:29.040661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4608b280-f3d6-4d2e-b62c-1ccb2cf4a18c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:29.041251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4608b280-f3d6-4d2e-b62c-1ccb2cf4a18c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:29.041745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4608b280-f3d6-4d2e-b62c-1ccb2cf4a18c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:29.042214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4608b280-f3d6-4d2e-b62c-1ccb2cf4a18c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:29.106402 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4608b280-f3d6-4d2e-b62c-1ccb2cf4a18c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2/action" status: 204 len: 0 microversion: 2.1 time: 0.078677 Aug 25 14:07:29.107266 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3376/6685] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:07:29 2022] POST /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:07:29.117567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a426ce9d-adf6-4de4-b477-c81f53e4c40d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:29.118370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a426ce9d-adf6-4de4-b477-c81f53e4c40d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:29.125004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a426ce9d-adf6-4de4-b477-c81f53e4c40d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:29.126651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a426ce9d-adf6-4de4-b477-c81f53e4c40d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:29.127358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a426ce9d-adf6-4de4-b477-c81f53e4c40d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:29.128153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a426ce9d-adf6-4de4-b477-c81f53e4c40d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:29.128816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a426ce9d-adf6-4de4-b477-c81f53e4c40d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:29.129276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a426ce9d-adf6-4de4-b477-c81f53e4c40d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:29.320256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a426ce9d-adf6-4de4-b477-c81f53e4c40d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:29.333539 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a426ce9d-adf6-4de4-b477-c81f53e4c40d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1678 microversion: 2.1 time: 0.219987 Aug 25 14:07:29.346637 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3310/6686] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:29 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:30.360161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c67963ee-a960-44d9-a153-2bbe536e5fd2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:30.360812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c67963ee-a960-44d9-a153-2bbe536e5fd2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:30.368251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67963ee-a960-44d9-a153-2bbe536e5fd2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:30.368750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67963ee-a960-44d9-a153-2bbe536e5fd2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:30.369200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67963ee-a960-44d9-a153-2bbe536e5fd2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:30.369956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67963ee-a960-44d9-a153-2bbe536e5fd2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:30.370422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67963ee-a960-44d9-a153-2bbe536e5fd2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:30.370854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c67963ee-a960-44d9-a153-2bbe536e5fd2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:30.532842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c67963ee-a960-44d9-a153-2bbe536e5fd2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:30.542937 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c67963ee-a960-44d9-a153-2bbe536e5fd2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1670 microversion: 2.1 time: 0.189290 Aug 25 14:07:30.545542 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3377/6687] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:30 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1670 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:30.568297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-31fcbbc3-d790-4d5b-9e86-8e5b146257fb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:30.569077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-31fcbbc3-d790-4d5b-9e86-8e5b146257fb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:30.576178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcbbc3-d790-4d5b-9e86-8e5b146257fb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:30.576670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcbbc3-d790-4d5b-9e86-8e5b146257fb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:30.577126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcbbc3-d790-4d5b-9e86-8e5b146257fb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:30.577884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcbbc3-d790-4d5b-9e86-8e5b146257fb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:30.578359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcbbc3-d790-4d5b-9e86-8e5b146257fb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:30.578801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-31fcbbc3-d790-4d5b-9e86-8e5b146257fb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:30.719301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-31fcbbc3-d790-4d5b-9e86-8e5b146257fb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:30.727229 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-31fcbbc3-d790-4d5b-9e86-8e5b146257fb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1670 microversion: 2.1 time: 0.164034 Aug 25 14:07:30.727821 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3311/6688] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:30 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:30.747782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1054c7d4-7c1a-4d36-9f87-12123957dd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:30.748392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1054c7d4-7c1a-4d36-9f87-12123957dd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:30.755176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1054c7d4-7c1a-4d36-9f87-12123957dd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:30.755657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1054c7d4-7c1a-4d36-9f87-12123957dd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:30.756135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1054c7d4-7c1a-4d36-9f87-12123957dd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:30.756791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1054c7d4-7c1a-4d36-9f87-12123957dd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:30.757241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1054c7d4-7c1a-4d36-9f87-12123957dd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:30.757691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1054c7d4-7c1a-4d36-9f87-12123957dd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:30.899424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1054c7d4-7c1a-4d36-9f87-12123957dd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:30.907324 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1054c7d4-7c1a-4d36-9f87-12123957dd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1670 microversion: 2.1 time: 0.163468 Aug 25 14:07:30.907818 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3378/6689] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:30 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:30.928732 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b6c36f50-0a58-4909-8913-02c9b14fac3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:30.929269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b6c36f50-0a58-4909-8913-02c9b14fac3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:30.935343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c36f50-0a58-4909-8913-02c9b14fac3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:30.935846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c36f50-0a58-4909-8913-02c9b14fac3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:30.936289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c36f50-0a58-4909-8913-02c9b14fac3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:30.937000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c36f50-0a58-4909-8913-02c9b14fac3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:30.937468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c36f50-0a58-4909-8913-02c9b14fac3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:30.937933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b6c36f50-0a58-4909-8913-02c9b14fac3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:30.964819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b6c36f50-0a58-4909-8913-02c9b14fac3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:07:31.045143 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b6c36f50-0a58-4909-8913-02c9b14fac3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 204 len: 0 microversion: 2.1 time: 0.120446 Aug 25 14:07:31.046126 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3312/6690] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:07:30 2022] DELETE /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:07:31.054465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a636748-912e-489f-995d-f7cdc2c32c3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:31.055092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a636748-912e-489f-995d-f7cdc2c32c3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:31.061057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a636748-912e-489f-995d-f7cdc2c32c3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:31.061592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a636748-912e-489f-995d-f7cdc2c32c3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:31.062040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a636748-912e-489f-995d-f7cdc2c32c3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:31.062732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a636748-912e-489f-995d-f7cdc2c32c3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:31.063183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a636748-912e-489f-995d-f7cdc2c32c3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:31.063610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a636748-912e-489f-995d-f7cdc2c32c3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:31.079860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:31.207885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a636748-912e-489f-995d-f7cdc2c32c3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:31.216588 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a636748-912e-489f-995d-f7cdc2c32c3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1676 microversion: 2.1 time: 0.165957 Aug 25 14:07:31.217180 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3379/6691] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:31 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:31.426313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2e04a9c0-b9e3-4b0c-9399-7198e1eb8608 req-cfbbbd26-b020-44d4-941f-67a47ebc8d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1da74f-859e-47e8-b84b-bec7c6bed8c2", "name": "network-vif-plugged", "status": "completed", "tag": "ec591155-4392-4386-90bb-50f7cb32c039"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:31.436552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2e04a9c0-b9e3-4b0c-9399-7198e1eb8608 req-cfbbbd26-b020-44d4-941f-67a47ebc8d9d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:31.437065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2e04a9c0-b9e3-4b0c-9399-7198e1eb8608 req-cfbbbd26-b020-44d4-941f-67a47ebc8d9d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:31.437558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2e04a9c0-b9e3-4b0c-9399-7198e1eb8608 req-cfbbbd26-b020-44d4-941f-67a47ebc8d9d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:31.442090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:31.451417 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2e04a9c0-b9e3-4b0c-9399-7198e1eb8608 req-cfbbbd26-b020-44d4-941f-67a47ebc8d9d service nova] Creating event network-vif-plugged:ec591155-4392-4386-90bb-50f7cb32c039 for instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 on n-h1-852771-8 Aug 25 14:07:31.457483 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2e04a9c0-b9e3-4b0c-9399-7198e1eb8608 req-cfbbbd26-b020-44d4-941f-67a47ebc8d9d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035829 Aug 25 14:07:31.458142 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3313/6692] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:32.240580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-61fa0b70-f60c-41b2-bb0a-8d7e7914e34c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:32.241453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-61fa0b70-f60c-41b2-bb0a-8d7e7914e34c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:32.248958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61fa0b70-f60c-41b2-bb0a-8d7e7914e34c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:32.249451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61fa0b70-f60c-41b2-bb0a-8d7e7914e34c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:32.249921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61fa0b70-f60c-41b2-bb0a-8d7e7914e34c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:32.250635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61fa0b70-f60c-41b2-bb0a-8d7e7914e34c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:32.251099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61fa0b70-f60c-41b2-bb0a-8d7e7914e34c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:32.251529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-61fa0b70-f60c-41b2-bb0a-8d7e7914e34c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:32.416900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-61fa0b70-f60c-41b2-bb0a-8d7e7914e34c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:32.428024 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-61fa0b70-f60c-41b2-bb0a-8d7e7914e34c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1676 microversion: 2.1 time: 0.193104 Aug 25 14:07:32.428626 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3380/6693] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:32 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:33.450864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fc64dec2-cccb-4a23-b378-e623eaeea5f9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:33.451829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fc64dec2-cccb-4a23-b378-e623eaeea5f9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:33.463587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc64dec2-cccb-4a23-b378-e623eaeea5f9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:33.464198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc64dec2-cccb-4a23-b378-e623eaeea5f9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:33.464669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc64dec2-cccb-4a23-b378-e623eaeea5f9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:33.465604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc64dec2-cccb-4a23-b378-e623eaeea5f9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:33.466106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc64dec2-cccb-4a23-b378-e623eaeea5f9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:33.466707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fc64dec2-cccb-4a23-b378-e623eaeea5f9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:33.560708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fc64dec2-cccb-4a23-b378-e623eaeea5f9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:33.576730 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fc64dec2-cccb-4a23-b378-e623eaeea5f9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 200 len: 1609 microversion: 2.1 time: 0.130054 Aug 25 14:07:33.577996 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3314/6694] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:33 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 1609 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:33.891252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-78d6b7bb-d1d2-4bab-be0a-19300cad65d8 req-16a13245-6cb2-4861-9c9d-d79f0765b25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1da74f-859e-47e8-b84b-bec7c6bed8c2", "name": "network-vif-deleted", "tag": "ec591155-4392-4386-90bb-50f7cb32c039"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:33.918146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-78d6b7bb-d1d2-4bab-be0a-19300cad65d8 req-16a13245-6cb2-4861-9c9d-d79f0765b25e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:33.919267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-78d6b7bb-d1d2-4bab-be0a-19300cad65d8 req-16a13245-6cb2-4861-9c9d-d79f0765b25e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:33.919810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-78d6b7bb-d1d2-4bab-be0a-19300cad65d8 req-16a13245-6cb2-4861-9c9d-d79f0765b25e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:33.936224 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-78d6b7bb-d1d2-4bab-be0a-19300cad65d8 req-16a13245-6cb2-4861-9c9d-d79f0765b25e service nova] Creating event network-vif-deleted:ec591155-4392-4386-90bb-50f7cb32c039 for instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 on n-h1-852771-8 Aug 25 14:07:33.944292 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-78d6b7bb-d1d2-4bab-be0a-19300cad65d8 req-16a13245-6cb2-4861-9c9d-d79f0765b25e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061989 Aug 25 14:07:33.945592 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3381/6695] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:34.600940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:34.601592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:34.609148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:34.609665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:34.610371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:34.611213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:34.611670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:34.612126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:34.627807 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 HTTP/1.1 Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ab1da74f-859e-47e8-b84b-bec7c6bed8c2'} Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:07:34.629536 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:07:34.634159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:07:34.634159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:07:34.634159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:07:34.634159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:07:34.634159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:07:34.634159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:07:34.634159 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:07:34.634159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:07:34.634159 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72cda7be-29e3-4cfa-8a3f-2fda6e37d868 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 404 len: 111 microversion: 2.1 time: 0.035056 Aug 25 14:07:34.635421 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3315/6696] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:34 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:07:34.647494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:34.648201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:34.655763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:34.656052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:34.656522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:34.657359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:34.657867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:34.658157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:34.682701 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 HTTP/1.1 Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'ab1da74f-859e-47e8-b84b-bec7c6bed8c2'} Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:07:34.686193 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:07:34.692108 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:07:34.692108 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:07:34.692108 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:07:34.692108 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:07:34.692108 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:07:34.692108 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:07:34.692108 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:07:34.692108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:07:34.692108 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9c9f709-6891-450a-a347-74d90c5ef44b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 404 len: 111 microversion: 2.1 time: 0.046770 Aug 25 14:07:34.692108 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3382/6697] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:34 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:07:34.759232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1296692684", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "ee9ab0d6-db08-459b-b844-2b0d86452b77"}], "security_groups": [{"name": "tempest-securitygroup--480932018"}], "key_name": "tempest-keypair-2050390348", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:34.923578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] validate_networks() for [('ee9ab0d6-db08-459b-b844-2b0d86452b77', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:07:35.448312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:07:35.448752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:07:35.449245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:07:35.449714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:07:35.450142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:07:35.460119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:35.460623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:35.461081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:35.461868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:35.462332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:35.462772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:35.480178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:07:35.486343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for user dccab2ef88f44ffc84b30c57c7a86194 and project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:07:35.501796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:07:35.505048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:07:35.559601 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-40d7a2fc-4bbf-44c2-8e97-e0f90e5df5cf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.808865 Aug 25 14:07:35.560263 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3316/6698] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:07:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:07:35.574040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a07f895-0c75-4682-9eb0-f0687f9eb09b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:35.574673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a07f895-0c75-4682-9eb0-f0687f9eb09b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:35.652414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a07f895-0c75-4682-9eb0-f0687f9eb09b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:35.663137 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a07f895-0c75-4682-9eb0-f0687f9eb09b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1239 microversion: 2.1 time: 0.093725 Aug 25 14:07:35.664007 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3383/6699] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:35 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:36.688349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5502752-901d-4c33-b30d-75fdb87de7ae tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:36.689218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b5502752-901d-4c33-b30d-75fdb87de7ae tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:36.697370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5502752-901d-4c33-b30d-75fdb87de7ae tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:36.697911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5502752-901d-4c33-b30d-75fdb87de7ae tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:36.698369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5502752-901d-4c33-b30d-75fdb87de7ae tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:36.699104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5502752-901d-4c33-b30d-75fdb87de7ae tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:36.699587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5502752-901d-4c33-b30d-75fdb87de7ae tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:36.700028 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5502752-901d-4c33-b30d-75fdb87de7ae tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:36.781204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b5502752-901d-4c33-b30d-75fdb87de7ae tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:36.792557 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b5502752-901d-4c33-b30d-75fdb87de7ae tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1291 microversion: 2.1 time: 0.108982 Aug 25 14:07:36.793619 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3317/6700] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:36 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1291 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:37.815208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-be761d0b-9d41-41dc-a541-277b178b122c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:37.816281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-be761d0b-9d41-41dc-a541-277b178b122c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:37.824521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be761d0b-9d41-41dc-a541-277b178b122c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:37.825065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be761d0b-9d41-41dc-a541-277b178b122c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:37.825460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be761d0b-9d41-41dc-a541-277b178b122c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:37.826207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be761d0b-9d41-41dc-a541-277b178b122c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:37.826665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be761d0b-9d41-41dc-a541-277b178b122c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:37.827104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-be761d0b-9d41-41dc-a541-277b178b122c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:38.008282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-be761d0b-9d41-41dc-a541-277b178b122c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:38.017423 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-be761d0b-9d41-41dc-a541-277b178b122c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1364 microversion: 2.1 time: 0.206265 Aug 25 14:07:38.024097 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3384/6701] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:37 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:38.416326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a69931ea-10b8-4677-ac28-f6ea47ff6a3f req-33660997-5fe9-448b-8bd0-5a4d34aa461d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c861e0-bbb8-4f59-b7b0-92b1f1428a6f", "tag": "bc5b5e2a-32f0-4d4e-878c-b35c29965f72"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:38.439678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a69931ea-10b8-4677-ac28-f6ea47ff6a3f req-33660997-5fe9-448b-8bd0-5a4d34aa461d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:38.440676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a69931ea-10b8-4677-ac28-f6ea47ff6a3f req-33660997-5fe9-448b-8bd0-5a4d34aa461d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:38.441168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a69931ea-10b8-4677-ac28-f6ea47ff6a3f req-33660997-5fe9-448b-8bd0-5a4d34aa461d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:38.454577 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a69931ea-10b8-4677-ac28-f6ea47ff6a3f req-33660997-5fe9-448b-8bd0-5a4d34aa461d service nova] Creating event network-changed:bc5b5e2a-32f0-4d4e-878c-b35c29965f72 for instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f on n-h2-852771-8 Aug 25 14:07:38.460487 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a69931ea-10b8-4677-ac28-f6ea47ff6a3f req-33660997-5fe9-448b-8bd0-5a4d34aa461d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051514 Aug 25 14:07:38.461642 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3318/6702] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:39.041743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66029863-3a7c-4238-8e45-6a199447f758 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:39.042417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66029863-3a7c-4238-8e45-6a199447f758 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:39.045640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=47 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:39.051832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66029863-3a7c-4238-8e45-6a199447f758 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:39.052328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66029863-3a7c-4238-8e45-6a199447f758 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:39.052769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66029863-3a7c-4238-8e45-6a199447f758 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:39.053617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66029863-3a7c-4238-8e45-6a199447f758 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:39.054084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66029863-3a7c-4238-8e45-6a199447f758 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:39.054570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66029863-3a7c-4238-8e45-6a199447f758 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:39.237597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-66029863-3a7c-4238-8e45-6a199447f758 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:39.245885 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66029863-3a7c-4238-8e45-6a199447f758 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1364 microversion: 2.1 time: 0.209271 Aug 25 14:07:39.246477 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3385/6703] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:39 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:40.270270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-154c2e55-4d4a-4e9c-a4e3-28c27ff64f9b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:40.271001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-154c2e55-4d4a-4e9c-a4e3-28c27ff64f9b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:40.273131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:40.280670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-154c2e55-4d4a-4e9c-a4e3-28c27ff64f9b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:40.281248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-154c2e55-4d4a-4e9c-a4e3-28c27ff64f9b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:40.281786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-154c2e55-4d4a-4e9c-a4e3-28c27ff64f9b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:40.282672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-154c2e55-4d4a-4e9c-a4e3-28c27ff64f9b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:40.283224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-154c2e55-4d4a-4e9c-a4e3-28c27ff64f9b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:40.283691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-154c2e55-4d4a-4e9c-a4e3-28c27ff64f9b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:40.452520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-154c2e55-4d4a-4e9c-a4e3-28c27ff64f9b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:40.462139 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-154c2e55-4d4a-4e9c-a4e3-28c27ff64f9b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1364 microversion: 2.1 time: 0.197655 Aug 25 14:07:40.462736 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3319/6704] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:40 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:41.486008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-618b9aa5-966d-4deb-a7d5-3f73c4facbc9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:41.487378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-618b9aa5-966d-4deb-a7d5-3f73c4facbc9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:41.495536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-618b9aa5-966d-4deb-a7d5-3f73c4facbc9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:41.496015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-618b9aa5-966d-4deb-a7d5-3f73c4facbc9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:41.496453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-618b9aa5-966d-4deb-a7d5-3f73c4facbc9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:41.497281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-618b9aa5-966d-4deb-a7d5-3f73c4facbc9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:41.497815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-618b9aa5-966d-4deb-a7d5-3f73c4facbc9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:41.498113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-618b9aa5-966d-4deb-a7d5-3f73c4facbc9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:41.644777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-618b9aa5-966d-4deb-a7d5-3f73c4facbc9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:41.653927 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-618b9aa5-966d-4deb-a7d5-3f73c4facbc9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1364 microversion: 2.1 time: 0.172103 Aug 25 14:07:41.654523 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3386/6705] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:41 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:42.683611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0a3d03df-32b3-413d-b6fb-861d6da5a74a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:42.684702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0a3d03df-32b3-413d-b6fb-861d6da5a74a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:42.694446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a3d03df-32b3-413d-b6fb-861d6da5a74a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:42.694988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a3d03df-32b3-413d-b6fb-861d6da5a74a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:42.695448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a3d03df-32b3-413d-b6fb-861d6da5a74a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:42.696181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a3d03df-32b3-413d-b6fb-861d6da5a74a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:42.696659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a3d03df-32b3-413d-b6fb-861d6da5a74a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:42.697142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a3d03df-32b3-413d-b6fb-861d6da5a74a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:42.863010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0a3d03df-32b3-413d-b6fb-861d6da5a74a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:42.873127 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0a3d03df-32b3-413d-b6fb-861d6da5a74a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1364 microversion: 2.1 time: 0.201556 Aug 25 14:07:42.873808 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3320/6706] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:42 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:43.902570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b677ffb4-b093-410b-ac5e-abb4201735a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:43.903492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b677ffb4-b093-410b-ac5e-abb4201735a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:43.912156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b677ffb4-b093-410b-ac5e-abb4201735a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:43.912637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b677ffb4-b093-410b-ac5e-abb4201735a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:43.913088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b677ffb4-b093-410b-ac5e-abb4201735a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:43.913851 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b677ffb4-b093-410b-ac5e-abb4201735a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:43.914329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b677ffb4-b093-410b-ac5e-abb4201735a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:43.914756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b677ffb4-b093-410b-ac5e-abb4201735a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:44.135165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b677ffb4-b093-410b-ac5e-abb4201735a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:44.146098 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b677ffb4-b093-410b-ac5e-abb4201735a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1364 microversion: 2.1 time: 0.247846 Aug 25 14:07:44.146756 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3387/6707] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:43 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:44.513706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b84f24f5-e78d-48a8-acf8-bffd08286a2c req-619b6400-3765-429a-a68f-840edcdf844c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c861e0-bbb8-4f59-b7b0-92b1f1428a6f", "name": "network-vif-plugged", "status": "completed", "tag": "bc5b5e2a-32f0-4d4e-878c-b35c29965f72"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:44.526436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b84f24f5-e78d-48a8-acf8-bffd08286a2c req-619b6400-3765-429a-a68f-840edcdf844c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:44.526950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b84f24f5-e78d-48a8-acf8-bffd08286a2c req-619b6400-3765-429a-a68f-840edcdf844c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:44.527435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b84f24f5-e78d-48a8-acf8-bffd08286a2c req-619b6400-3765-429a-a68f-840edcdf844c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:44.543644 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b84f24f5-e78d-48a8-acf8-bffd08286a2c req-619b6400-3765-429a-a68f-840edcdf844c service nova] Creating event network-vif-plugged:bc5b5e2a-32f0-4d4e-878c-b35c29965f72 for instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f on n-h2-852771-8 Aug 25 14:07:44.555610 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b84f24f5-e78d-48a8-acf8-bffd08286a2c req-619b6400-3765-429a-a68f-840edcdf844c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041382 Aug 25 14:07:44.555610 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3321/6708] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:45.169626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-189f373e-f39b-40bc-94ad-ae8c7986f76f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:45.170611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-189f373e-f39b-40bc-94ad-ae8c7986f76f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:45.182244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-189f373e-f39b-40bc-94ad-ae8c7986f76f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:45.183063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-189f373e-f39b-40bc-94ad-ae8c7986f76f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:45.183518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-189f373e-f39b-40bc-94ad-ae8c7986f76f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:45.184397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-189f373e-f39b-40bc-94ad-ae8c7986f76f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:45.185097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-189f373e-f39b-40bc-94ad-ae8c7986f76f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:45.185839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-189f373e-f39b-40bc-94ad-ae8c7986f76f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:45.361979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-189f373e-f39b-40bc-94ad-ae8c7986f76f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:45.370795 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-189f373e-f39b-40bc-94ad-ae8c7986f76f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1364 microversion: 2.1 time: 0.205848 Aug 25 14:07:45.371391 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3388/6709] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:45 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:46.392270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:46.393027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:46.399005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-457c8e2f-01c9-499a-87b6-fde0ee2ef749 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:46.399748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-457c8e2f-01c9-499a-87b6-fde0ee2ef749 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:46.407928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-457c8e2f-01c9-499a-87b6-fde0ee2ef749 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:46.408542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-457c8e2f-01c9-499a-87b6-fde0ee2ef749 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:46.409035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-457c8e2f-01c9-499a-87b6-fde0ee2ef749 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:46.409881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-457c8e2f-01c9-499a-87b6-fde0ee2ef749 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:46.410368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-457c8e2f-01c9-499a-87b6-fde0ee2ef749 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:46.410829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-457c8e2f-01c9-499a-87b6-fde0ee2ef749 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:46.568157 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-457c8e2f-01c9-499a-87b6-fde0ee2ef749 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:46.576402 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-457c8e2f-01c9-499a-87b6-fde0ee2ef749 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1551 microversion: 2.1 time: 0.185148 Aug 25 14:07:46.577001 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3322/6710] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:46 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1551 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:46.611966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-922e471d-32a4-40ae-bb75-785577192b70 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:46.612903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-922e471d-32a4-40ae-bb75-785577192b70 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:46.615385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:46.623241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922e471d-32a4-40ae-bb75-785577192b70 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:46.623749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922e471d-32a4-40ae-bb75-785577192b70 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:46.624197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922e471d-32a4-40ae-bb75-785577192b70 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:46.625038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922e471d-32a4-40ae-bb75-785577192b70 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:46.625432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922e471d-32a4-40ae-bb75-785577192b70 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:46.625908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-922e471d-32a4-40ae-bb75-785577192b70 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:46.723164 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-922e471d-32a4-40ae-bb75-785577192b70 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115446 Aug 25 14:07:46.723824 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3389/6711] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 14:07:46 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:48.143903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2eec56df-3bc0-43c4-9676-2610104561da req-99a87c6b-b794-4500-8324-085fd12e358d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c861e0-bbb8-4f59-b7b0-92b1f1428a6f", "tag": "bc5b5e2a-32f0-4d4e-878c-b35c29965f72"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:48.160835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2eec56df-3bc0-43c4-9676-2610104561da req-99a87c6b-b794-4500-8324-085fd12e358d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:48.161447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2eec56df-3bc0-43c4-9676-2610104561da req-99a87c6b-b794-4500-8324-085fd12e358d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:48.162017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2eec56df-3bc0-43c4-9676-2610104561da req-99a87c6b-b794-4500-8324-085fd12e358d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:48.174873 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2eec56df-3bc0-43c4-9676-2610104561da req-99a87c6b-b794-4500-8324-085fd12e358d service nova] Creating event network-changed:bc5b5e2a-32f0-4d4e-878c-b35c29965f72 for instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f on n-h2-852771-8 Aug 25 14:07:48.180449 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2eec56df-3bc0-43c4-9676-2610104561da req-99a87c6b-b794-4500-8324-085fd12e358d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041380 Aug 25 14:07:48.181352 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3323/6712] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:01.040826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=9 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:01.042164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=47 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:01.043915 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:09:01.044142 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:09:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/action (ip 10.222.0.70) !!! Aug 25 14:09:01.055853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-805dd013-7fb8-4e6b-9e9d-f1e329227ffa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:01.070900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-805dd013-7fb8-4e6b-9e9d-f1e329227ffa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:01.071780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-805dd013-7fb8-4e6b-9e9d-f1e329227ffa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:01.073437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-805dd013-7fb8-4e6b-9e9d-f1e329227ffa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:01.102938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-805dd013-7fb8-4e6b-9e9d-f1e329227ffa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Going to try to stop instance {{(pid=129060) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 14:09:01.158887 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-805dd013-7fb8-4e6b-9e9d-f1e329227ffa tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/action" status: 202 len: 0 microversion: 2.1 time: 0.122197 Aug 25 14:09:01.159532 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3390/6713] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:09:01 2022] POST /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:09:01.171871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=9 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:01.173109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=40 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:01.176596 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:09:01.176800 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:09:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f (ip 10.222.0.70) !!! Aug 25 14:09:01.193122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e21ff8d7-0f1e-4a40-b0ea-730256d58de5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:01.194774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e21ff8d7-0f1e-4a40-b0ea-730256d58de5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:01.205008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e21ff8d7-0f1e-4a40-b0ea-730256d58de5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:01.205612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e21ff8d7-0f1e-4a40-b0ea-730256d58de5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:01.206163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e21ff8d7-0f1e-4a40-b0ea-730256d58de5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:01.207062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e21ff8d7-0f1e-4a40-b0ea-730256d58de5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:01.207643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e21ff8d7-0f1e-4a40-b0ea-730256d58de5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:01.208185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e21ff8d7-0f1e-4a40-b0ea-730256d58de5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:01.380605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e21ff8d7-0f1e-4a40-b0ea-730256d58de5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:01.389423 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e21ff8d7-0f1e-4a40-b0ea-730256d58de5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.222611 Aug 25 14:09:01.390393 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3324/6714] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:01 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:02.414229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3caf8b7e-595e-46f2-be3e-c9d067bd8d12 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:02.414933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3caf8b7e-595e-46f2-be3e-c9d067bd8d12 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:02.422138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3caf8b7e-595e-46f2-be3e-c9d067bd8d12 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:02.422629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3caf8b7e-595e-46f2-be3e-c9d067bd8d12 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:02.423072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3caf8b7e-595e-46f2-be3e-c9d067bd8d12 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:02.423878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3caf8b7e-595e-46f2-be3e-c9d067bd8d12 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:02.424564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3caf8b7e-595e-46f2-be3e-c9d067bd8d12 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:02.425126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3caf8b7e-595e-46f2-be3e-c9d067bd8d12 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:02.604869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3caf8b7e-595e-46f2-be3e-c9d067bd8d12 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:02.615464 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3caf8b7e-595e-46f2-be3e-c9d067bd8d12 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.207146 Aug 25 14:09:02.616103 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3391/6715] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:02 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:09:03.651522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-48389bea-323a-4c47-aa89-d38319c55a32 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:03.652035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-48389bea-323a-4c47-aa89-d38319c55a32 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:03.659957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48389bea-323a-4c47-aa89-d38319c55a32 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:03.660643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48389bea-323a-4c47-aa89-d38319c55a32 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:03.661180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48389bea-323a-4c47-aa89-d38319c55a32 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:03.661889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48389bea-323a-4c47-aa89-d38319c55a32 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:03.662371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48389bea-323a-4c47-aa89-d38319c55a32 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:03.662819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48389bea-323a-4c47-aa89-d38319c55a32 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:03.834106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-48389bea-323a-4c47-aa89-d38319c55a32 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:03.842920 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-48389bea-323a-4c47-aa89-d38319c55a32 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.195466 Aug 25 14:09:03.843533 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3325/6716] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:03 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:04.867364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-98f16648-6a11-416b-a601-aaba3713dcf7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:04.868019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-98f16648-6a11-416b-a601-aaba3713dcf7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:04.875484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-98f16648-6a11-416b-a601-aaba3713dcf7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:04.875988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-98f16648-6a11-416b-a601-aaba3713dcf7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:04.876639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-98f16648-6a11-416b-a601-aaba3713dcf7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:04.877867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-98f16648-6a11-416b-a601-aaba3713dcf7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:04.878368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-98f16648-6a11-416b-a601-aaba3713dcf7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:04.878784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-98f16648-6a11-416b-a601-aaba3713dcf7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:05.038198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-98f16648-6a11-416b-a601-aaba3713dcf7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:05.053107 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-98f16648-6a11-416b-a601-aaba3713dcf7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.189531 Aug 25 14:09:05.054023 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3392/6717] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:04 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:06.075667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-48541204-183b-47f2-962e-ab67e638f403 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:06.076343 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-48541204-183b-47f2-962e-ab67e638f403 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:06.084192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48541204-183b-47f2-962e-ab67e638f403 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:06.084694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48541204-183b-47f2-962e-ab67e638f403 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:06.085153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48541204-183b-47f2-962e-ab67e638f403 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:06.085915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48541204-183b-47f2-962e-ab67e638f403 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:06.086396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48541204-183b-47f2-962e-ab67e638f403 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:06.086838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-48541204-183b-47f2-962e-ab67e638f403 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:06.232049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-48541204-183b-47f2-962e-ab67e638f403 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:06.242348 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-48541204-183b-47f2-962e-ab67e638f403 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.170605 Aug 25 14:09:06.243147 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3326/6718] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:06 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:07.279077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-659d6535-1e7c-4187-acb7-3db5f8ab657b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:07.279718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-659d6535-1e7c-4187-acb7-3db5f8ab657b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:07.288006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-659d6535-1e7c-4187-acb7-3db5f8ab657b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:07.288499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-659d6535-1e7c-4187-acb7-3db5f8ab657b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:07.288941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-659d6535-1e7c-4187-acb7-3db5f8ab657b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:07.289699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-659d6535-1e7c-4187-acb7-3db5f8ab657b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:07.290166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-659d6535-1e7c-4187-acb7-3db5f8ab657b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:07.290598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-659d6535-1e7c-4187-acb7-3db5f8ab657b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:07.446135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-659d6535-1e7c-4187-acb7-3db5f8ab657b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:07.457639 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-659d6535-1e7c-4187-acb7-3db5f8ab657b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.182039 Aug 25 14:09:07.458730 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3393/6719] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:07 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:08.483591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-11ec9e68-8d23-4fb0-b984-5bd6d80b8356 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:08.484765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-11ec9e68-8d23-4fb0-b984-5bd6d80b8356 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:08.496497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11ec9e68-8d23-4fb0-b984-5bd6d80b8356 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:08.497040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11ec9e68-8d23-4fb0-b984-5bd6d80b8356 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:08.497484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11ec9e68-8d23-4fb0-b984-5bd6d80b8356 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:08.498264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11ec9e68-8d23-4fb0-b984-5bd6d80b8356 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:08.498755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11ec9e68-8d23-4fb0-b984-5bd6d80b8356 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:08.500637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11ec9e68-8d23-4fb0-b984-5bd6d80b8356 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:08.681266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-11ec9e68-8d23-4fb0-b984-5bd6d80b8356 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:08.690498 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-11ec9e68-8d23-4fb0-b984-5bd6d80b8356 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.214416 Aug 25 14:09:08.691106 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3327/6720] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:08 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:09.720056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1cafa407-8b8a-4b09-ad30-8ff77c6e0eee tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:09.720921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1cafa407-8b8a-4b09-ad30-8ff77c6e0eee tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:09.728295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1cafa407-8b8a-4b09-ad30-8ff77c6e0eee tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:09.728781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1cafa407-8b8a-4b09-ad30-8ff77c6e0eee tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:09.729218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1cafa407-8b8a-4b09-ad30-8ff77c6e0eee tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:09.729943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1cafa407-8b8a-4b09-ad30-8ff77c6e0eee tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:09.730403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1cafa407-8b8a-4b09-ad30-8ff77c6e0eee tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:09.730822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1cafa407-8b8a-4b09-ad30-8ff77c6e0eee tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:09.928235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1cafa407-8b8a-4b09-ad30-8ff77c6e0eee tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:09.936749 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1cafa407-8b8a-4b09-ad30-8ff77c6e0eee tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.221381 Aug 25 14:09:09.937359 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3394/6721] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:09 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:10.960354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8ed7e4fc-019a-4518-8ebe-ac9bce6f2d27 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:10.961032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8ed7e4fc-019a-4518-8ebe-ac9bce6f2d27 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:10.968566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ed7e4fc-019a-4518-8ebe-ac9bce6f2d27 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:10.969094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ed7e4fc-019a-4518-8ebe-ac9bce6f2d27 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:10.969683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ed7e4fc-019a-4518-8ebe-ac9bce6f2d27 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:10.971058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ed7e4fc-019a-4518-8ebe-ac9bce6f2d27 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:10.971558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ed7e4fc-019a-4518-8ebe-ac9bce6f2d27 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:10.972101 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8ed7e4fc-019a-4518-8ebe-ac9bce6f2d27 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:11.112678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8ed7e4fc-019a-4518-8ebe-ac9bce6f2d27 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:11.120878 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8ed7e4fc-019a-4518-8ebe-ac9bce6f2d27 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.164592 Aug 25 14:09:11.121472 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3328/6722] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:10 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:12.143543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f369d63c-a455-49af-a581-50851cfb4d13 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:12.144180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f369d63c-a455-49af-a581-50851cfb4d13 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:12.151320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f369d63c-a455-49af-a581-50851cfb4d13 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:12.151801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f369d63c-a455-49af-a581-50851cfb4d13 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:12.152235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f369d63c-a455-49af-a581-50851cfb4d13 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:12.152933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f369d63c-a455-49af-a581-50851cfb4d13 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:12.153382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f369d63c-a455-49af-a581-50851cfb4d13 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:12.153831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f369d63c-a455-49af-a581-50851cfb4d13 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:12.301071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f369d63c-a455-49af-a581-50851cfb4d13 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:12.310233 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f369d63c-a455-49af-a581-50851cfb4d13 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1657 microversion: 2.1 time: 0.170991 Aug 25 14:09:12.310735 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3395/6723] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:12 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1657 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:12.332454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:12.334836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:12.342382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:12.342953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:12.343563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:12.344143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:12.344594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:12.345048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:12.377199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:12.384480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Old instance type m1.heat2, new instance type m1.heat {{(pid=129059) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:09:12.391695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:09:12.392664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:09:12.393169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:09:12.393724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:09:12.394089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:09:12.472309 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d816c8ad-4f6e-4ac6-a883-634dab470209 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/action" status: 202 len: 0 microversion: 2.1 time: 0.143779 Aug 25 14:09:12.473029 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3329/6724] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:09:12 2022] POST /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:09:12.482130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f2761607-7dda-4368-b9cf-2c0ee9dfdf52 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:12.483120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f2761607-7dda-4368-b9cf-2c0ee9dfdf52 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:12.493071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2761607-7dda-4368-b9cf-2c0ee9dfdf52 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:12.493973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2761607-7dda-4368-b9cf-2c0ee9dfdf52 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:12.494561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2761607-7dda-4368-b9cf-2c0ee9dfdf52 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:12.495361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2761607-7dda-4368-b9cf-2c0ee9dfdf52 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:12.495885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2761607-7dda-4368-b9cf-2c0ee9dfdf52 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:12.496411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f2761607-7dda-4368-b9cf-2c0ee9dfdf52 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:12.683383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f2761607-7dda-4368-b9cf-2c0ee9dfdf52 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:12.698443 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f2761607-7dda-4368-b9cf-2c0ee9dfdf52 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.220762 Aug 25 14:09:12.699484 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3396/6725] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:12 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:13.729132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-18473b4e-f05f-4baf-ab78-b4da5ac3ef9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:13.731375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-18473b4e-f05f-4baf-ab78-b4da5ac3ef9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:13.743675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18473b4e-f05f-4baf-ab78-b4da5ac3ef9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:13.744619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18473b4e-f05f-4baf-ab78-b4da5ac3ef9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:13.745433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18473b4e-f05f-4baf-ab78-b4da5ac3ef9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:13.746777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18473b4e-f05f-4baf-ab78-b4da5ac3ef9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:13.747814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18473b4e-f05f-4baf-ab78-b4da5ac3ef9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:13.748636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-18473b4e-f05f-4baf-ab78-b4da5ac3ef9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:13.915498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-18473b4e-f05f-4baf-ab78-b4da5ac3ef9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:13.924831 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-18473b4e-f05f-4baf-ab78-b4da5ac3ef9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.205669 Aug 25 14:09:13.925431 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3330/6726] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:13 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:14.948298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cee7dcb4-cf7f-4695-b611-3b8c51ea7850 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:14.949160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cee7dcb4-cf7f-4695-b611-3b8c51ea7850 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:14.959975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cee7dcb4-cf7f-4695-b611-3b8c51ea7850 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:14.960906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cee7dcb4-cf7f-4695-b611-3b8c51ea7850 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:14.961728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cee7dcb4-cf7f-4695-b611-3b8c51ea7850 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:14.962596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cee7dcb4-cf7f-4695-b611-3b8c51ea7850 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:14.963364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cee7dcb4-cf7f-4695-b611-3b8c51ea7850 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:14.964111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cee7dcb4-cf7f-4695-b611-3b8c51ea7850 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:15.154210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cee7dcb4-cf7f-4695-b611-3b8c51ea7850 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:15.163504 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cee7dcb4-cf7f-4695-b611-3b8c51ea7850 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1680 microversion: 2.1 time: 0.220151 Aug 25 14:09:15.164224 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3397/6727] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:14 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:16.186341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-597d91fe-4d88-438c-960c-924263da08de tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:16.187076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-597d91fe-4d88-438c-960c-924263da08de tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:16.195706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597d91fe-4d88-438c-960c-924263da08de tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:16.196229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597d91fe-4d88-438c-960c-924263da08de tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:16.196704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597d91fe-4d88-438c-960c-924263da08de tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:16.197472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597d91fe-4d88-438c-960c-924263da08de tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:16.198004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597d91fe-4d88-438c-960c-924263da08de tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:16.198463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-597d91fe-4d88-438c-960c-924263da08de tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:16.380225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-597d91fe-4d88-438c-960c-924263da08de tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:16.391849 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-597d91fe-4d88-438c-960c-924263da08de tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1685 microversion: 2.1 time: 0.209219 Aug 25 14:09:16.392761 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3331/6728] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:16 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1685 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:17.422247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ece55d6c-65e1-429e-9329-9a1532c1a5d6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:17.423547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ece55d6c-65e1-429e-9329-9a1532c1a5d6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:17.437697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ece55d6c-65e1-429e-9329-9a1532c1a5d6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:17.438674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ece55d6c-65e1-429e-9329-9a1532c1a5d6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:17.439561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ece55d6c-65e1-429e-9329-9a1532c1a5d6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:17.441027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ece55d6c-65e1-429e-9329-9a1532c1a5d6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:17.442089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ece55d6c-65e1-429e-9329-9a1532c1a5d6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:17.442957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ece55d6c-65e1-429e-9329-9a1532c1a5d6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:17.682945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ece55d6c-65e1-429e-9329-9a1532c1a5d6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:17.698005 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ece55d6c-65e1-429e-9329-9a1532c1a5d6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1684 microversion: 2.1 time: 0.283370 Aug 25 14:09:17.698972 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3398/6729] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:17 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1684 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:17.871345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-cfa03955-f7c6-4da6-9f16-873be1151777 req-0b5e7a29-1893-4693-9f9f-8f2606f47834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c861e0-bbb8-4f59-b7b0-92b1f1428a6f", "name": "network-vif-unplugged", "status": "completed", "tag": "bc5b5e2a-32f0-4d4e-878c-b35c29965f72"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:17.883202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cfa03955-f7c6-4da6-9f16-873be1151777 req-0b5e7a29-1893-4693-9f9f-8f2606f47834 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:17.884017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cfa03955-f7c6-4da6-9f16-873be1151777 req-0b5e7a29-1893-4693-9f9f-8f2606f47834 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:17.884787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cfa03955-f7c6-4da6-9f16-873be1151777 req-0b5e7a29-1893-4693-9f9f-8f2606f47834 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:17.906035 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-cfa03955-f7c6-4da6-9f16-873be1151777 req-0b5e7a29-1893-4693-9f9f-8f2606f47834 service nova] Creating event network-vif-unplugged:bc5b5e2a-32f0-4d4e-878c-b35c29965f72 for instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f on n-h1-852771-8 Aug 25 14:09:17.912551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-cfa03955-f7c6-4da6-9f16-873be1151777 req-0b5e7a29-1893-4693-9f9f-8f2606f47834 service nova] Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:09:17.926992 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-cfa03955-f7c6-4da6-9f16-873be1151777 req-0b5e7a29-1893-4693-9f9f-8f2606f47834 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137675 Aug 25 14:09:17.927626 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3332/6730] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:09:18.729703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7184833c-c1d7-4dd2-b1d6-854bb27529cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:18.730739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7184833c-c1d7-4dd2-b1d6-854bb27529cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:18.744280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7184833c-c1d7-4dd2-b1d6-854bb27529cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:18.745161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7184833c-c1d7-4dd2-b1d6-854bb27529cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:18.745942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7184833c-c1d7-4dd2-b1d6-854bb27529cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:18.746841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7184833c-c1d7-4dd2-b1d6-854bb27529cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:18.747492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7184833c-c1d7-4dd2-b1d6-854bb27529cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:18.748406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7184833c-c1d7-4dd2-b1d6-854bb27529cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:19.328515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7184833c-c1d7-4dd2-b1d6-854bb27529cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:19.338794 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7184833c-c1d7-4dd2-b1d6-854bb27529cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1684 microversion: 2.1 time: 0.614619 Aug 25 14:09:19.339399 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3399/6731] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:18 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1684 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:19.946425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-148a8319-f308-4728-bc0d-8fbe4c30a88c req-e60b990a-9924-4105-8237-045ecd201cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c861e0-bbb8-4f59-b7b0-92b1f1428a6f", "tag": "bc5b5e2a-32f0-4d4e-878c-b35c29965f72"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:19.958308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-148a8319-f308-4728-bc0d-8fbe4c30a88c req-e60b990a-9924-4105-8237-045ecd201cdd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:19.958851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-148a8319-f308-4728-bc0d-8fbe4c30a88c req-e60b990a-9924-4105-8237-045ecd201cdd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:19.959324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-148a8319-f308-4728-bc0d-8fbe4c30a88c req-e60b990a-9924-4105-8237-045ecd201cdd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:19.974134 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-148a8319-f308-4728-bc0d-8fbe4c30a88c req-e60b990a-9924-4105-8237-045ecd201cdd service nova] Creating event network-changed:bc5b5e2a-32f0-4d4e-878c-b35c29965f72 for instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f on n-h1-852771-8 Aug 25 14:09:19.981126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-148a8319-f308-4728-bc0d-8fbe4c30a88c req-e60b990a-9924-4105-8237-045ecd201cdd service nova] Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:09:19.995884 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-148a8319-f308-4728-bc0d-8fbe4c30a88c req-e60b990a-9924-4105-8237-045ecd201cdd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055695 Aug 25 14:09:19.999543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3333/6732] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:09:20.363957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d4b2c7e5-031d-425d-abbb-4deee0ac4042 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:20.364525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d4b2c7e5-031d-425d-abbb-4deee0ac4042 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:20.372363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4b2c7e5-031d-425d-abbb-4deee0ac4042 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:20.372865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4b2c7e5-031d-425d-abbb-4deee0ac4042 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:20.373311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4b2c7e5-031d-425d-abbb-4deee0ac4042 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:20.374083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4b2c7e5-031d-425d-abbb-4deee0ac4042 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:20.374545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4b2c7e5-031d-425d-abbb-4deee0ac4042 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:20.374983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d4b2c7e5-031d-425d-abbb-4deee0ac4042 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:20.604182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d4b2c7e5-031d-425d-abbb-4deee0ac4042 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:20.621021 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d4b2c7e5-031d-425d-abbb-4deee0ac4042 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1682 microversion: 2.1 time: 0.261201 Aug 25 14:09:20.622272 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3400/6733] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:20 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1682 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:21.653242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-da44117d-9a2c-41db-8cc5-30eb627a84cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:21.654023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-da44117d-9a2c-41db-8cc5-30eb627a84cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:21.662771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da44117d-9a2c-41db-8cc5-30eb627a84cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:21.663515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da44117d-9a2c-41db-8cc5-30eb627a84cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:21.664098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da44117d-9a2c-41db-8cc5-30eb627a84cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:21.664992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da44117d-9a2c-41db-8cc5-30eb627a84cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:21.665694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da44117d-9a2c-41db-8cc5-30eb627a84cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:21.666310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-da44117d-9a2c-41db-8cc5-30eb627a84cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:21.889987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-da44117d-9a2c-41db-8cc5-30eb627a84cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:21.904923 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-da44117d-9a2c-41db-8cc5-30eb627a84cb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1682 microversion: 2.1 time: 0.261638 Aug 25 14:09:21.905425 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3334/6734] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:21 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1682 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:22.936226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f633be40-8b14-4c76-abd3-47409c55dd0c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:22.937311 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f633be40-8b14-4c76-abd3-47409c55dd0c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:22.951451 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f633be40-8b14-4c76-abd3-47409c55dd0c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:22.952379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f633be40-8b14-4c76-abd3-47409c55dd0c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:22.953220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f633be40-8b14-4c76-abd3-47409c55dd0c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:22.954947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f633be40-8b14-4c76-abd3-47409c55dd0c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:22.955763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f633be40-8b14-4c76-abd3-47409c55dd0c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:22.955763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f633be40-8b14-4c76-abd3-47409c55dd0c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:23.156859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f633be40-8b14-4c76-abd3-47409c55dd0c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:23.166445 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f633be40-8b14-4c76-abd3-47409c55dd0c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1678 microversion: 2.1 time: 0.237936 Aug 25 14:09:23.167003 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3401/6735] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:22 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:23.189406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e79cf609-c391-40ca-b288-f7be995c4099 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:23.190071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e79cf609-c391-40ca-b288-f7be995c4099 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:23.203549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e79cf609-c391-40ca-b288-f7be995c4099 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:23.204081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e79cf609-c391-40ca-b288-f7be995c4099 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:23.205331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e79cf609-c391-40ca-b288-f7be995c4099 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:23.206130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e79cf609-c391-40ca-b288-f7be995c4099 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:23.206620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e79cf609-c391-40ca-b288-f7be995c4099 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:23.207079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e79cf609-c391-40ca-b288-f7be995c4099 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:23.287353 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e79cf609-c391-40ca-b288-f7be995c4099 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/action" status: 204 len: 0 microversion: 2.1 time: 0.102299 Aug 25 14:09:23.288323 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3335/6736] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:09:23 2022] POST /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/action => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:09:23.299373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eee19ce7-fe02-4877-a9a6-48e748ff8354 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:23.300323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eee19ce7-fe02-4877-a9a6-48e748ff8354 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:23.307551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee19ce7-fe02-4877-a9a6-48e748ff8354 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:23.309054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee19ce7-fe02-4877-a9a6-48e748ff8354 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:23.309423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee19ce7-fe02-4877-a9a6-48e748ff8354 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:23.310312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee19ce7-fe02-4877-a9a6-48e748ff8354 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:23.310873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee19ce7-fe02-4877-a9a6-48e748ff8354 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:23.311354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eee19ce7-fe02-4877-a9a6-48e748ff8354 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:23.512856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eee19ce7-fe02-4877-a9a6-48e748ff8354 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:23.529009 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eee19ce7-fe02-4877-a9a6-48e748ff8354 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1678 microversion: 2.1 time: 0.234215 Aug 25 14:09:23.541824 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3402/6737] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:23 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:24.559615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e4855800-2ebe-4cf9-856e-fd112698cfa6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:24.560297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e4855800-2ebe-4cf9-856e-fd112698cfa6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:24.572222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4855800-2ebe-4cf9-856e-fd112698cfa6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:24.573125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4855800-2ebe-4cf9-856e-fd112698cfa6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:24.574051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4855800-2ebe-4cf9-856e-fd112698cfa6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:24.575364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4855800-2ebe-4cf9-856e-fd112698cfa6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:24.576602 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4855800-2ebe-4cf9-856e-fd112698cfa6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:24.577275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e4855800-2ebe-4cf9-856e-fd112698cfa6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:24.786332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e4855800-2ebe-4cf9-856e-fd112698cfa6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:24.797454 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e4855800-2ebe-4cf9-856e-fd112698cfa6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1678 microversion: 2.1 time: 0.242997 Aug 25 14:09:24.798702 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3336/6738] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:24 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:09:25.758101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-fca76fd2-4993-4267-88ae-ca30e438b516 req-c021dc01-40bf-47ee-b2bc-3f977aee40ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c861e0-bbb8-4f59-b7b0-92b1f1428a6f", "name": "network-vif-plugged", "status": "completed", "tag": "bc5b5e2a-32f0-4d4e-878c-b35c29965f72"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:25.775988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fca76fd2-4993-4267-88ae-ca30e438b516 req-c021dc01-40bf-47ee-b2bc-3f977aee40ab service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:25.776476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fca76fd2-4993-4267-88ae-ca30e438b516 req-c021dc01-40bf-47ee-b2bc-3f977aee40ab service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:25.776907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-fca76fd2-4993-4267-88ae-ca30e438b516 req-c021dc01-40bf-47ee-b2bc-3f977aee40ab service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:25.790740 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-fca76fd2-4993-4267-88ae-ca30e438b516 req-c021dc01-40bf-47ee-b2bc-3f977aee40ab service nova] Creating event network-vif-plugged:bc5b5e2a-32f0-4d4e-878c-b35c29965f72 for instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f on n-h1-852771-8 Aug 25 14:09:25.796894 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-fca76fd2-4993-4267-88ae-ca30e438b516 req-c021dc01-40bf-47ee-b2bc-3f977aee40ab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047013 Aug 25 14:09:25.798265 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3403/6739] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:25.836483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-91988a44-ed37-4bab-b756-e3a021ce52da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:25.837126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-91988a44-ed37-4bab-b756-e3a021ce52da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:25.844801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91988a44-ed37-4bab-b756-e3a021ce52da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:25.846253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91988a44-ed37-4bab-b756-e3a021ce52da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:25.846838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91988a44-ed37-4bab-b756-e3a021ce52da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:25.847615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91988a44-ed37-4bab-b756-e3a021ce52da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:25.848095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91988a44-ed37-4bab-b756-e3a021ce52da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:25.848541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-91988a44-ed37-4bab-b756-e3a021ce52da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:26.005100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-91988a44-ed37-4bab-b756-e3a021ce52da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:26.015034 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-91988a44-ed37-4bab-b756-e3a021ce52da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1657 microversion: 2.1 time: 0.186730 Aug 25 14:09:26.015706 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3337/6740] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:25 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1657 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:26.040129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7368471-8a86-4c6a-912c-d167d8751125 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:26.040853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a7368471-8a86-4c6a-912c-d167d8751125 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:26.049477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7368471-8a86-4c6a-912c-d167d8751125 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:26.051726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7368471-8a86-4c6a-912c-d167d8751125 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:26.052871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7368471-8a86-4c6a-912c-d167d8751125 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:26.055325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7368471-8a86-4c6a-912c-d167d8751125 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:26.056638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7368471-8a86-4c6a-912c-d167d8751125 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:26.058014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7368471-8a86-4c6a-912c-d167d8751125 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:26.243839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a7368471-8a86-4c6a-912c-d167d8751125 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:26.255938 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a7368471-8a86-4c6a-912c-d167d8751125 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1657 microversion: 2.1 time: 0.219794 Aug 25 14:09:26.256960 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3404/6741] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:26 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1657 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:09:26.284830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f6223c5-87c6-423b-82e6-525957488ca5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:26.291504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f6223c5-87c6-423b-82e6-525957488ca5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:26.292024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f6223c5-87c6-423b-82e6-525957488ca5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:26.292487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f6223c5-87c6-423b-82e6-525957488ca5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:26.320659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f6223c5-87c6-423b-82e6-525957488ca5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Going to try to start instance {{(pid=129059) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 14:09:26.324456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:26.379078 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f6223c5-87c6-423b-82e6-525957488ca5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/action" status: 202 len: 0 microversion: 2.1 time: 0.098465 Aug 25 14:09:26.379768 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3338/6742] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:09:26 2022] POST /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:09:26.390250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8fe8dec9-1c18-4df5-820c-6f3199df89b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:26.390886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8fe8dec9-1c18-4df5-820c-6f3199df89b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:26.397460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fe8dec9-1c18-4df5-820c-6f3199df89b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:26.398357 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fe8dec9-1c18-4df5-820c-6f3199df89b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:26.398787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fe8dec9-1c18-4df5-820c-6f3199df89b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:26.399736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fe8dec9-1c18-4df5-820c-6f3199df89b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:26.400315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fe8dec9-1c18-4df5-820c-6f3199df89b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:26.400782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fe8dec9-1c18-4df5-820c-6f3199df89b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:26.575342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8fe8dec9-1c18-4df5-820c-6f3199df89b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:26.591036 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8fe8dec9-1c18-4df5-820c-6f3199df89b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1666 microversion: 2.1 time: 0.204386 Aug 25 14:09:26.598508 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3405/6743] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:26 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1666 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:09:27.625326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f41d9c11-47ef-4dcd-a4bf-6a7896ba617f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:27.627956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f41d9c11-47ef-4dcd-a4bf-6a7896ba617f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:27.635094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41d9c11-47ef-4dcd-a4bf-6a7896ba617f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:27.635969 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41d9c11-47ef-4dcd-a4bf-6a7896ba617f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:27.636487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41d9c11-47ef-4dcd-a4bf-6a7896ba617f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:27.637378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41d9c11-47ef-4dcd-a4bf-6a7896ba617f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:27.638041 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41d9c11-47ef-4dcd-a4bf-6a7896ba617f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:27.638586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f41d9c11-47ef-4dcd-a4bf-6a7896ba617f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:27.807793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f41d9c11-47ef-4dcd-a4bf-6a7896ba617f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:27.816771 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f41d9c11-47ef-4dcd-a4bf-6a7896ba617f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1666 microversion: 2.1 time: 0.199481 Aug 25 14:09:27.817443 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3339/6744] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:27 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1666 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:28.838828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7fe5b769-fb95-42c5-9718-fada326e8297 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:28.839434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7fe5b769-fb95-42c5-9718-fada326e8297 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:28.847910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fe5b769-fb95-42c5-9718-fada326e8297 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:28.848404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fe5b769-fb95-42c5-9718-fada326e8297 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:28.848848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fe5b769-fb95-42c5-9718-fada326e8297 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:28.849649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fe5b769-fb95-42c5-9718-fada326e8297 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:28.850189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fe5b769-fb95-42c5-9718-fada326e8297 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:28.850479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7fe5b769-fb95-42c5-9718-fada326e8297 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:28.855603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:29.050299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7fe5b769-fb95-42c5-9718-fada326e8297 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:29.066980 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7fe5b769-fb95-42c5-9718-fada326e8297 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1670 microversion: 2.1 time: 0.231612 Aug 25 14:09:29.068149 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3406/6745] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:28 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1670 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:29.112590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe2bca4c-0627-4383-8305-aaccb182a404 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:29.113624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe2bca4c-0627-4383-8305-aaccb182a404 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:29.128083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe2bca4c-0627-4383-8305-aaccb182a404 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:29.129021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe2bca4c-0627-4383-8305-aaccb182a404 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:29.129940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe2bca4c-0627-4383-8305-aaccb182a404 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:29.131336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe2bca4c-0627-4383-8305-aaccb182a404 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:29.132214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe2bca4c-0627-4383-8305-aaccb182a404 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:29.133026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe2bca4c-0627-4383-8305-aaccb182a404 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:29.168680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe2bca4c-0627-4383-8305-aaccb182a404 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:09:29.303180 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe2bca4c-0627-4383-8305-aaccb182a404 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 204 len: 0 microversion: 2.1 time: 0.198796 Aug 25 14:09:29.304295 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3340/6746] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:09:29 2022] DELETE /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:09:29.315913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4fcfe83c-e76f-4c52-a1a6-2c05078bf82b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:29.316541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4fcfe83c-e76f-4c52-a1a6-2c05078bf82b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:29.323904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfe83c-e76f-4c52-a1a6-2c05078bf82b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:29.324399 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfe83c-e76f-4c52-a1a6-2c05078bf82b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:29.324842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfe83c-e76f-4c52-a1a6-2c05078bf82b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:29.325610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfe83c-e76f-4c52-a1a6-2c05078bf82b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:29.326080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfe83c-e76f-4c52-a1a6-2c05078bf82b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:29.326515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4fcfe83c-e76f-4c52-a1a6-2c05078bf82b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:29.518522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4fcfe83c-e76f-4c52-a1a6-2c05078bf82b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:29.528091 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4fcfe83c-e76f-4c52-a1a6-2c05078bf82b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1676 microversion: 2.1 time: 0.216861 Aug 25 14:09:29.528826 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3407/6747] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:29 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:30.551306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-171ed001-0794-440d-aea4-ea380aeee580 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:30.552190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-171ed001-0794-440d-aea4-ea380aeee580 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:30.559488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-171ed001-0794-440d-aea4-ea380aeee580 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:30.559997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-171ed001-0794-440d-aea4-ea380aeee580 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:30.560457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-171ed001-0794-440d-aea4-ea380aeee580 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:30.561189 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-171ed001-0794-440d-aea4-ea380aeee580 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:30.561692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-171ed001-0794-440d-aea4-ea380aeee580 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:30.562138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-171ed001-0794-440d-aea4-ea380aeee580 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:30.762306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-171ed001-0794-440d-aea4-ea380aeee580 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:30.771809 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-171ed001-0794-440d-aea4-ea380aeee580 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1676 microversion: 2.1 time: 0.224601 Aug 25 14:09:30.772611 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3341/6748] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:30 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:09:31.796040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06ab38e0-f019-419a-98ea-7e7281c5360b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:31.796675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-06ab38e0-f019-419a-98ea-7e7281c5360b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:31.801027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=37 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:31.807388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06ab38e0-f019-419a-98ea-7e7281c5360b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:31.807888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06ab38e0-f019-419a-98ea-7e7281c5360b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:31.808338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06ab38e0-f019-419a-98ea-7e7281c5360b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:31.809305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06ab38e0-f019-419a-98ea-7e7281c5360b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:31.809638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06ab38e0-f019-419a-98ea-7e7281c5360b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:31.810091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06ab38e0-f019-419a-98ea-7e7281c5360b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:31.852047 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-05a4463e-fd2a-4aea-b0d6-7a6e12b3f915 req-ddc98271-d9a2-407a-b6ce-5f6da537edf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c861e0-bbb8-4f59-b7b0-92b1f1428a6f", "name": "network-vif-deleted", "tag": "bc5b5e2a-32f0-4d4e-878c-b35c29965f72"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:31.858255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:31.864961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-05a4463e-fd2a-4aea-b0d6-7a6e12b3f915 req-ddc98271-d9a2-407a-b6ce-5f6da537edf9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:31.865474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-05a4463e-fd2a-4aea-b0d6-7a6e12b3f915 req-ddc98271-d9a2-407a-b6ce-5f6da537edf9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:31.865997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-05a4463e-fd2a-4aea-b0d6-7a6e12b3f915 req-ddc98271-d9a2-407a-b6ce-5f6da537edf9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:31.887902 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-05a4463e-fd2a-4aea-b0d6-7a6e12b3f915 req-ddc98271-d9a2-407a-b6ce-5f6da537edf9 service nova] Creating event network-vif-deleted:bc5b5e2a-32f0-4d4e-878c-b35c29965f72 for instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f on n-h1-852771-8 Aug 25 14:09:31.893748 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-05a4463e-fd2a-4aea-b0d6-7a6e12b3f915 req-ddc98271-d9a2-407a-b6ce-5f6da537edf9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045271 Aug 25 14:09:31.894455 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3342/6749] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:09:31.922605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-06ab38e0-f019-419a-98ea-7e7281c5360b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:31.933144 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-06ab38e0-f019-419a-98ea-7e7281c5360b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 200 len: 1609 microversion: 2.1 time: 0.140976 Aug 25 14:09:31.934450 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3408/6750] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:31 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 1609 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:32.961659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:32.962377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:32.969153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:32.969741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:32.970214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:32.970939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:32.971414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:32.971860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:32.986519 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f HTTP/1.1 Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '37c861e0-bbb8-4f59-b7b0-92b1f1428a6f'} Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:09:32.988244 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:09:32.995225 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:09:32.995225 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:09:32.995225 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:09:32.995225 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:09:32.995225 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:09:32.995225 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:09:32.995225 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:09:32.995225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:09:32.995225 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-23e225fc-16fc-4389-9644-ec4113450715 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 404 len: 111 microversion: 2.1 time: 0.033487 Aug 25 14:09:32.995225 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3343/6751] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:32 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:09:33.011931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:33.013089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:33.026795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:33.027598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:33.028491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:33.029836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:33.030685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:33.031475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:33.058729 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f HTTP/1.1 Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '37c861e0-bbb8-4f59-b7b0-92b1f1428a6f'} Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:09:33.062215 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:09:33.067005 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:09:33.067005 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:09:33.067005 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:09:33.067005 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:09:33.067005 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:09:33.067005 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:09:33.067005 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:09:33.067005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:09:33.067005 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c89c609b-67a8-402d-9888-eed98896d1d2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 404 len: 111 microversion: 2.1 time: 0.061676 Aug 25 14:09:33.067005 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3409/6752] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:33 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:09:33.143261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-762001292", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "ee9ab0d6-db08-459b-b844-2b0d86452b77"}], "security_groups": [{"name": "tempest-securitygroup--480932018"}], "key_name": "tempest-keypair-2050390348", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:33.296598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] validate_networks() for [('ee9ab0d6-db08-459b-b844-2b0d86452b77', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:09:33.777574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:09:33.778030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:09:33.778532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:09:33.778970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:09:33.779406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:09:33.789350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:33.789893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:33.790355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:33.791111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:33.791589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:33.792042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:33.810674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:09:33.816498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for user dccab2ef88f44ffc84b30c57c7a86194 and project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:09:33.829592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:09:33.831948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:09:33.884831 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cebb90fa-ff27-48ca-9f93-2f5c16a0a338 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746522 Aug 25 14:09:33.885496 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3344/6753] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:09:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:09:33.900379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-86287de5-a086-43bc-aff4-c11657f02ed9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:33.901016 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-86287de5-a086-43bc-aff4-c11657f02ed9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:33.956529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-86287de5-a086-43bc-aff4-c11657f02ed9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:33.963519 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-86287de5-a086-43bc-aff4-c11657f02ed9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1238 microversion: 2.1 time: 0.067171 Aug 25 14:09:33.964101 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3410/6754] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:33 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:34.987380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cab304d4-777f-4d97-8124-9131c927f603 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:34.988067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cab304d4-777f-4d97-8124-9131c927f603 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:34.995877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab304d4-777f-4d97-8124-9131c927f603 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:34.996320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab304d4-777f-4d97-8124-9131c927f603 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:34.996775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab304d4-777f-4d97-8124-9131c927f603 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:34.997632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab304d4-777f-4d97-8124-9131c927f603 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:34.998066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab304d4-777f-4d97-8124-9131c927f603 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:34.998511 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cab304d4-777f-4d97-8124-9131c927f603 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:35.084706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cab304d4-777f-4d97-8124-9131c927f603 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:35.100270 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cab304d4-777f-4d97-8124-9131c927f603 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1298 microversion: 2.1 time: 0.117579 Aug 25 14:09:35.102115 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3345/6755] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:34 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:36.135374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-660b311c-7754-4534-9245-70729dedd9d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:36.135969 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-660b311c-7754-4534-9245-70729dedd9d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:36.144034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-660b311c-7754-4534-9245-70729dedd9d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:36.144533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-660b311c-7754-4534-9245-70729dedd9d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:36.144984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-660b311c-7754-4534-9245-70729dedd9d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:36.145731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-660b311c-7754-4534-9245-70729dedd9d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:36.146197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-660b311c-7754-4534-9245-70729dedd9d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:36.146638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-660b311c-7754-4534-9245-70729dedd9d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:36.296122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-660b311c-7754-4534-9245-70729dedd9d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:36.305879 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-660b311c-7754-4534-9245-70729dedd9d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1363 microversion: 2.1 time: 0.174274 Aug 25 14:09:36.306487 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3411/6756] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:36 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:36.697173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-361fdea8-7a11-4b70-8e5d-8eee95420ed2 req-af9513d2-d533-47d4-9332-288bdc57fe2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc06b7f-fa8f-4f5e-b713-018203883b75", "tag": "2b783813-e3cc-44f8-8491-ea359c859f2f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:36.710862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-361fdea8-7a11-4b70-8e5d-8eee95420ed2 req-af9513d2-d533-47d4-9332-288bdc57fe2c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:36.711393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-361fdea8-7a11-4b70-8e5d-8eee95420ed2 req-af9513d2-d533-47d4-9332-288bdc57fe2c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:36.711935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-361fdea8-7a11-4b70-8e5d-8eee95420ed2 req-af9513d2-d533-47d4-9332-288bdc57fe2c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:36.726861 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-361fdea8-7a11-4b70-8e5d-8eee95420ed2 req-af9513d2-d533-47d4-9332-288bdc57fe2c service nova] Creating event network-changed:2b783813-e3cc-44f8-8491-ea359c859f2f for instance ecc06b7f-fa8f-4f5e-b713-018203883b75 on n-h1-852771-8 Aug 25 14:09:36.732336 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-361fdea8-7a11-4b70-8e5d-8eee95420ed2 req-af9513d2-d533-47d4-9332-288bdc57fe2c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039472 Aug 25 14:09:36.733418 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3346/6757] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:37.339504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d26a94cb-f7a4-46e7-bd62-22d2d281ff0b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:37.340261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d26a94cb-f7a4-46e7-bd62-22d2d281ff0b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:37.347663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d26a94cb-f7a4-46e7-bd62-22d2d281ff0b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:37.348171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d26a94cb-f7a4-46e7-bd62-22d2d281ff0b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:37.348713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d26a94cb-f7a4-46e7-bd62-22d2d281ff0b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:37.349954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d26a94cb-f7a4-46e7-bd62-22d2d281ff0b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:37.350510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d26a94cb-f7a4-46e7-bd62-22d2d281ff0b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:37.351033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d26a94cb-f7a4-46e7-bd62-22d2d281ff0b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:37.513554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d26a94cb-f7a4-46e7-bd62-22d2d281ff0b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:37.522939 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d26a94cb-f7a4-46e7-bd62-22d2d281ff0b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1363 microversion: 2.1 time: 0.188817 Aug 25 14:09:37.523605 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3412/6758] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:37 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:38.554606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-479d6fb1-52e8-4fcc-b8f9-2b1670d2bb51 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:38.555402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-479d6fb1-52e8-4fcc-b8f9-2b1670d2bb51 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:38.564722 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-479d6fb1-52e8-4fcc-b8f9-2b1670d2bb51 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:38.565246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-479d6fb1-52e8-4fcc-b8f9-2b1670d2bb51 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:38.565800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-479d6fb1-52e8-4fcc-b8f9-2b1670d2bb51 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:38.566558 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-479d6fb1-52e8-4fcc-b8f9-2b1670d2bb51 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:38.567046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-479d6fb1-52e8-4fcc-b8f9-2b1670d2bb51 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:38.567505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-479d6fb1-52e8-4fcc-b8f9-2b1670d2bb51 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:38.728816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-479d6fb1-52e8-4fcc-b8f9-2b1670d2bb51 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:38.741250 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-479d6fb1-52e8-4fcc-b8f9-2b1670d2bb51 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1363 microversion: 2.1 time: 0.191688 Aug 25 14:09:38.742159 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3347/6759] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:38 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:39.764560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a463f682-1b66-47cf-aeed-474b620f6ddf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:39.765120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a463f682-1b66-47cf-aeed-474b620f6ddf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:39.773199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a463f682-1b66-47cf-aeed-474b620f6ddf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:39.773948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a463f682-1b66-47cf-aeed-474b620f6ddf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:39.774482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a463f682-1b66-47cf-aeed-474b620f6ddf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:39.775285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a463f682-1b66-47cf-aeed-474b620f6ddf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:39.775837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a463f682-1b66-47cf-aeed-474b620f6ddf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:39.776367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a463f682-1b66-47cf-aeed-474b620f6ddf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:39.937639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a463f682-1b66-47cf-aeed-474b620f6ddf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:39.947245 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a463f682-1b66-47cf-aeed-474b620f6ddf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1363 microversion: 2.1 time: 0.186636 Aug 25 14:09:39.947936 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3413/6760] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:39 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:40.970496 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c4b02c0-a3c7-41ff-856b-6ee49c50cbdb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:40.971125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0c4b02c0-a3c7-41ff-856b-6ee49c50cbdb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:40.978381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4b02c0-a3c7-41ff-856b-6ee49c50cbdb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:40.978893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4b02c0-a3c7-41ff-856b-6ee49c50cbdb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:40.979370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4b02c0-a3c7-41ff-856b-6ee49c50cbdb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:40.980167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4b02c0-a3c7-41ff-856b-6ee49c50cbdb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:40.980649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4b02c0-a3c7-41ff-856b-6ee49c50cbdb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:40.981093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c4b02c0-a3c7-41ff-856b-6ee49c50cbdb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:41.132717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0c4b02c0-a3c7-41ff-856b-6ee49c50cbdb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:41.142032 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0c4b02c0-a3c7-41ff-856b-6ee49c50cbdb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1363 microversion: 2.1 time: 0.175450 Aug 25 14:09:41.142726 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3348/6761] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:40 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:09:42.165424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8facb7d8-d474-4580-9dac-21ee95d3eb01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:42.165985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8facb7d8-d474-4580-9dac-21ee95d3eb01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:42.174522 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8facb7d8-d474-4580-9dac-21ee95d3eb01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:42.175243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8facb7d8-d474-4580-9dac-21ee95d3eb01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:42.175802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8facb7d8-d474-4580-9dac-21ee95d3eb01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:42.176618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8facb7d8-d474-4580-9dac-21ee95d3eb01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:42.177258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8facb7d8-d474-4580-9dac-21ee95d3eb01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:42.177815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8facb7d8-d474-4580-9dac-21ee95d3eb01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:42.332439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8facb7d8-d474-4580-9dac-21ee95d3eb01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:42.341117 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8facb7d8-d474-4580-9dac-21ee95d3eb01 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1363 microversion: 2.1 time: 0.180364 Aug 25 14:09:42.341746 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3414/6762] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:42 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:43.363850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-631319e4-9266-4754-afbb-159653be96f8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:43.364517 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-631319e4-9266-4754-afbb-159653be96f8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:43.376892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-631319e4-9266-4754-afbb-159653be96f8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:43.377443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-631319e4-9266-4754-afbb-159653be96f8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:43.378205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-631319e4-9266-4754-afbb-159653be96f8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:43.378970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-631319e4-9266-4754-afbb-159653be96f8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:43.379489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-631319e4-9266-4754-afbb-159653be96f8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:43.379963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-631319e4-9266-4754-afbb-159653be96f8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:43.539673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-631319e4-9266-4754-afbb-159653be96f8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:43.548672 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-631319e4-9266-4754-afbb-159653be96f8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1363 microversion: 2.1 time: 0.188560 Aug 25 14:09:43.549343 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3349/6763] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:43 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:43.811285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a9f94bde-9d18-40da-a40f-f63dc40bd66c req-8e0802b4-1eb3-495d-97d3-b7427fc379ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc06b7f-fa8f-4f5e-b713-018203883b75", "name": "network-vif-plugged", "status": "completed", "tag": "2b783813-e3cc-44f8-8491-ea359c859f2f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:43.830873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a9f94bde-9d18-40da-a40f-f63dc40bd66c req-8e0802b4-1eb3-495d-97d3-b7427fc379ee service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:43.831768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a9f94bde-9d18-40da-a40f-f63dc40bd66c req-8e0802b4-1eb3-495d-97d3-b7427fc379ee service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:43.832545 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a9f94bde-9d18-40da-a40f-f63dc40bd66c req-8e0802b4-1eb3-495d-97d3-b7427fc379ee service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:43.851234 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a9f94bde-9d18-40da-a40f-f63dc40bd66c req-8e0802b4-1eb3-495d-97d3-b7427fc379ee service nova] Creating event network-vif-plugged:2b783813-e3cc-44f8-8491-ea359c859f2f for instance ecc06b7f-fa8f-4f5e-b713-018203883b75 on n-h1-852771-8 Aug 25 14:09:43.856597 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a9f94bde-9d18-40da-a40f-f63dc40bd66c req-8e0802b4-1eb3-495d-97d3-b7427fc379ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049406 Aug 25 14:09:43.857650 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3415/6764] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:44.573488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d242b7c8-7a61-47d0-8684-6d661a65ab6e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:44.574147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d242b7c8-7a61-47d0-8684-6d661a65ab6e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:44.576168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:44.576857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:44.585060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d242b7c8-7a61-47d0-8684-6d661a65ab6e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:44.585603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d242b7c8-7a61-47d0-8684-6d661a65ab6e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:44.586071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d242b7c8-7a61-47d0-8684-6d661a65ab6e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:44.586807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d242b7c8-7a61-47d0-8684-6d661a65ab6e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:44.587284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d242b7c8-7a61-47d0-8684-6d661a65ab6e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:44.587731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d242b7c8-7a61-47d0-8684-6d661a65ab6e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:44.727788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d242b7c8-7a61-47d0-8684-6d661a65ab6e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:44.736525 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d242b7c8-7a61-47d0-8684-6d661a65ab6e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1363 microversion: 2.1 time: 0.167304 Aug 25 14:09:44.737197 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3350/6765] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:44 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:45.755346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:45.760891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-51cf126c-c886-4293-ba8f-f2a9bb63d652 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:45.761636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-51cf126c-c886-4293-ba8f-f2a9bb63d652 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:45.769228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51cf126c-c886-4293-ba8f-f2a9bb63d652 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:45.769756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51cf126c-c886-4293-ba8f-f2a9bb63d652 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:45.770201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51cf126c-c886-4293-ba8f-f2a9bb63d652 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:45.770906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51cf126c-c886-4293-ba8f-f2a9bb63d652 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:45.771397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51cf126c-c886-4293-ba8f-f2a9bb63d652 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:45.771829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-51cf126c-c886-4293-ba8f-f2a9bb63d652 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:45.918814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-51cf126c-c886-4293-ba8f-f2a9bb63d652 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:45.927408 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-51cf126c-c886-4293-ba8f-f2a9bb63d652 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1550 microversion: 2.1 time: 0.172979 Aug 25 14:09:45.927996 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3416/6766] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:45 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:09:45.950991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-13d13a3c-e9c5-4bf8-b2e2-fc9cc2503891 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:45.951938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-13d13a3c-e9c5-4bf8-b2e2-fc9cc2503891 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:45.961249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d13a3c-e9c5-4bf8-b2e2-fc9cc2503891 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:45.961771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d13a3c-e9c5-4bf8-b2e2-fc9cc2503891 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:45.962240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d13a3c-e9c5-4bf8-b2e2-fc9cc2503891 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:45.962970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d13a3c-e9c5-4bf8-b2e2-fc9cc2503891 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:45.963448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d13a3c-e9c5-4bf8-b2e2-fc9cc2503891 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:45.963897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d13a3c-e9c5-4bf8-b2e2-fc9cc2503891 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:46.057332 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-13d13a3c-e9c5-4bf8-b2e2-fc9cc2503891 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111273 Aug 25 14:09:46.057972 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3351/6767] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 14:09:45 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:47.105404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-09db24e8-5f75-44b3-95ca-904455fd0d00 req-2efd2d29-f124-4043-9977-6a283c3198a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc06b7f-fa8f-4f5e-b713-018203883b75", "tag": "2b783813-e3cc-44f8-8491-ea359c859f2f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:47.114997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-09db24e8-5f75-44b3-95ca-904455fd0d00 req-2efd2d29-f124-4043-9977-6a283c3198a4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:47.115475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-09db24e8-5f75-44b3-95ca-904455fd0d00 req-2efd2d29-f124-4043-9977-6a283c3198a4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:47.115913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-09db24e8-5f75-44b3-95ca-904455fd0d00 req-2efd2d29-f124-4043-9977-6a283c3198a4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:47.128645 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-09db24e8-5f75-44b3-95ca-904455fd0d00 req-2efd2d29-f124-4043-9977-6a283c3198a4 service nova] Creating event network-changed:2b783813-e3cc-44f8-8491-ea359c859f2f for instance ecc06b7f-fa8f-4f5e-b713-018203883b75 on n-h1-852771-8 Aug 25 14:09:47.134595 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-09db24e8-5f75-44b3-95ca-904455fd0d00 req-2efd2d29-f124-4043-9977-6a283c3198a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091389 Aug 25 14:09:47.135210 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3417/6768] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:59.101936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:59.102705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:59.156892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:59.159561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:59.169408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:59.169947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:59.170409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:59.171142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:59.171614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:59.172089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:59.202213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:59.208430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Old instance type m1.heat2, new instance type m1.heat {{(pid=129059) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:10:59.215023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:10:59.215465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:10:59.215960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:10:59.216386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:10:59.216817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:10:59.282281 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff2a19f4-e8f0-4c2b-aa01-cd6665c6745f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75/action" status: 202 len: 0 microversion: 2.1 time: 0.182901 Aug 25 14:10:59.283233 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3352/6769] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:10:59 2022] POST /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:10:59.295654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb66221c-c806-45dd-bdcc-3f1af325f00b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:59.296341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb66221c-c806-45dd-bdcc-3f1af325f00b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:59.299288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=21 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:59.300024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=52 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:59.301102 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:10:59.301261 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:10:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 (ip 10.222.0.70) !!! Aug 25 14:10:59.310243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb66221c-c806-45dd-bdcc-3f1af325f00b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:59.310772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb66221c-c806-45dd-bdcc-3f1af325f00b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:59.311314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb66221c-c806-45dd-bdcc-3f1af325f00b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:59.312145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb66221c-c806-45dd-bdcc-3f1af325f00b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:59.312623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb66221c-c806-45dd-bdcc-3f1af325f00b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:59.313079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb66221c-c806-45dd-bdcc-3f1af325f00b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:59.462934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cb66221c-c806-45dd-bdcc-3f1af325f00b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:59.473683 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb66221c-c806-45dd-bdcc-3f1af325f00b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1678 microversion: 2.1 time: 0.184176 Aug 25 14:10:59.474276 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3418/6770] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:59 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:00.496177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-168a18c9-c610-43ad-8ac7-d9a97d4c900b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:00.497077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-168a18c9-c610-43ad-8ac7-d9a97d4c900b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:00.503288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-168a18c9-c610-43ad-8ac7-d9a97d4c900b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:00.503794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-168a18c9-c610-43ad-8ac7-d9a97d4c900b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:00.504256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-168a18c9-c610-43ad-8ac7-d9a97d4c900b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:00.505017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-168a18c9-c610-43ad-8ac7-d9a97d4c900b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:00.505490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-168a18c9-c610-43ad-8ac7-d9a97d4c900b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:00.505959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-168a18c9-c610-43ad-8ac7-d9a97d4c900b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:00.665769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-168a18c9-c610-43ad-8ac7-d9a97d4c900b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:00.679750 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-168a18c9-c610-43ad-8ac7-d9a97d4c900b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1678 microversion: 2.1 time: 0.188325 Aug 25 14:11:00.680533 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3353/6771] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:00 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:01.707025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2cda83ba-d28a-4948-9281-afb54b12aa45 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:01.707866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2cda83ba-d28a-4948-9281-afb54b12aa45 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:01.715826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cda83ba-d28a-4948-9281-afb54b12aa45 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:01.716323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cda83ba-d28a-4948-9281-afb54b12aa45 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:01.716774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cda83ba-d28a-4948-9281-afb54b12aa45 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:01.717496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cda83ba-d28a-4948-9281-afb54b12aa45 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:01.717995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cda83ba-d28a-4948-9281-afb54b12aa45 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:01.718426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2cda83ba-d28a-4948-9281-afb54b12aa45 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:01.870422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2cda83ba-d28a-4948-9281-afb54b12aa45 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:01.879687 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2cda83ba-d28a-4948-9281-afb54b12aa45 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1683 microversion: 2.1 time: 0.177454 Aug 25 14:11:01.880288 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3419/6772] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:01 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:02.902675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c46a7ce6-b61a-47e3-bbc7-ea3f1579832d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:02.903212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c46a7ce6-b61a-47e3-bbc7-ea3f1579832d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:02.911328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c46a7ce6-b61a-47e3-bbc7-ea3f1579832d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:02.911877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c46a7ce6-b61a-47e3-bbc7-ea3f1579832d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:02.912408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c46a7ce6-b61a-47e3-bbc7-ea3f1579832d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:02.913142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c46a7ce6-b61a-47e3-bbc7-ea3f1579832d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:02.913683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c46a7ce6-b61a-47e3-bbc7-ea3f1579832d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:02.914138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c46a7ce6-b61a-47e3-bbc7-ea3f1579832d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:03.056412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c46a7ce6-b61a-47e3-bbc7-ea3f1579832d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:03.064809 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c46a7ce6-b61a-47e3-bbc7-ea3f1579832d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1683 microversion: 2.1 time: 0.165622 Aug 25 14:11:03.065492 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3354/6773] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:02 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:04.085875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-af840f4c-8b1b-4929-ab6e-93fd671be708 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:04.086521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-af840f4c-8b1b-4929-ab6e-93fd671be708 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:04.094975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af840f4c-8b1b-4929-ab6e-93fd671be708 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:04.096008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af840f4c-8b1b-4929-ab6e-93fd671be708 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:04.096458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af840f4c-8b1b-4929-ab6e-93fd671be708 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:04.097182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af840f4c-8b1b-4929-ab6e-93fd671be708 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:04.097691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af840f4c-8b1b-4929-ab6e-93fd671be708 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:04.098132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-af840f4c-8b1b-4929-ab6e-93fd671be708 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:04.257650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-af840f4c-8b1b-4929-ab6e-93fd671be708 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:04.266049 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-af840f4c-8b1b-4929-ab6e-93fd671be708 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1683 microversion: 2.1 time: 0.184217 Aug 25 14:11:04.266652 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3420/6774] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:04 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:05.288738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16921c5c-4ead-4445-ae13-e0fb9f86c97e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:05.289782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-16921c5c-4ead-4445-ae13-e0fb9f86c97e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:05.297346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16921c5c-4ead-4445-ae13-e0fb9f86c97e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:05.297882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16921c5c-4ead-4445-ae13-e0fb9f86c97e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:05.298867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16921c5c-4ead-4445-ae13-e0fb9f86c97e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:05.299705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16921c5c-4ead-4445-ae13-e0fb9f86c97e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:05.300260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16921c5c-4ead-4445-ae13-e0fb9f86c97e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:05.300709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16921c5c-4ead-4445-ae13-e0fb9f86c97e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:05.473753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16921c5c-4ead-4445-ae13-e0fb9f86c97e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:05.482094 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-16921c5c-4ead-4445-ae13-e0fb9f86c97e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1683 microversion: 2.1 time: 0.197832 Aug 25 14:11:05.482700 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3355/6775] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:05 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:06.505048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-19bdff29-f7f1-47f0-8b03-edb57c532834 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:06.505715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-19bdff29-f7f1-47f0-8b03-edb57c532834 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:06.513367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19bdff29-f7f1-47f0-8b03-edb57c532834 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:06.513964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19bdff29-f7f1-47f0-8b03-edb57c532834 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:06.514417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19bdff29-f7f1-47f0-8b03-edb57c532834 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:06.515154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19bdff29-f7f1-47f0-8b03-edb57c532834 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:06.515627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19bdff29-f7f1-47f0-8b03-edb57c532834 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:06.516060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-19bdff29-f7f1-47f0-8b03-edb57c532834 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:06.716004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-19bdff29-f7f1-47f0-8b03-edb57c532834 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:06.725852 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-19bdff29-f7f1-47f0-8b03-edb57c532834 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1683 microversion: 2.1 time: 0.225207 Aug 25 14:11:06.726455 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3421/6776] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:06 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:07.749281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5675f807-527c-41bb-b54e-3f7928ccf83c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:07.749985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5675f807-527c-41bb-b54e-3f7928ccf83c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:07.758478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5675f807-527c-41bb-b54e-3f7928ccf83c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:07.758993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5675f807-527c-41bb-b54e-3f7928ccf83c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:07.759456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5675f807-527c-41bb-b54e-3f7928ccf83c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:07.760232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5675f807-527c-41bb-b54e-3f7928ccf83c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:07.760751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5675f807-527c-41bb-b54e-3f7928ccf83c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:07.761202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5675f807-527c-41bb-b54e-3f7928ccf83c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:07.953723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5675f807-527c-41bb-b54e-3f7928ccf83c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:07.963619 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5675f807-527c-41bb-b54e-3f7928ccf83c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1683 microversion: 2.1 time: 0.219617 Aug 25 14:11:07.964217 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3356/6777] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:07 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1683 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:11:08.985801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ed1b0c12-ae2e-489f-ab76-6b3c5bd3bb2b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:08.986637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ed1b0c12-ae2e-489f-ab76-6b3c5bd3bb2b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:08.993710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed1b0c12-ae2e-489f-ab76-6b3c5bd3bb2b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:08.994203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed1b0c12-ae2e-489f-ab76-6b3c5bd3bb2b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:08.994647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed1b0c12-ae2e-489f-ab76-6b3c5bd3bb2b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:08.995359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed1b0c12-ae2e-489f-ab76-6b3c5bd3bb2b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:08.995823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed1b0c12-ae2e-489f-ab76-6b3c5bd3bb2b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:08.996255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ed1b0c12-ae2e-489f-ab76-6b3c5bd3bb2b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:09.144862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ed1b0c12-ae2e-489f-ab76-6b3c5bd3bb2b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:09.153242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ed1b0c12-ae2e-489f-ab76-6b3c5bd3bb2b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1683 microversion: 2.1 time: 0.171506 Aug 25 14:11:09.153881 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3422/6778] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:08 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:10.175567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f6bd6015-7abc-42bb-8459-6e2fb3f00bb7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:10.176120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f6bd6015-7abc-42bb-8459-6e2fb3f00bb7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:10.183521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6bd6015-7abc-42bb-8459-6e2fb3f00bb7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:10.184024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6bd6015-7abc-42bb-8459-6e2fb3f00bb7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:10.184572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6bd6015-7abc-42bb-8459-6e2fb3f00bb7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:10.185308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6bd6015-7abc-42bb-8459-6e2fb3f00bb7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:10.185847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6bd6015-7abc-42bb-8459-6e2fb3f00bb7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:10.186369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f6bd6015-7abc-42bb-8459-6e2fb3f00bb7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:10.333724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f6bd6015-7abc-42bb-8459-6e2fb3f00bb7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:10.341751 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f6bd6015-7abc-42bb-8459-6e2fb3f00bb7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1683 microversion: 2.1 time: 0.171024 Aug 25 14:11:10.342338 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3357/6779] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:10 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:11.364795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e960551e-0b0d-419e-8417-87ad7704c34f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:11.365445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e960551e-0b0d-419e-8417-87ad7704c34f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:11.372666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e960551e-0b0d-419e-8417-87ad7704c34f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:11.373159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e960551e-0b0d-419e-8417-87ad7704c34f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:11.373637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e960551e-0b0d-419e-8417-87ad7704c34f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:11.374351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e960551e-0b0d-419e-8417-87ad7704c34f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:11.374809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e960551e-0b0d-419e-8417-87ad7704c34f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:11.375271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e960551e-0b0d-419e-8417-87ad7704c34f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:11.532203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e960551e-0b0d-419e-8417-87ad7704c34f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:11.540705 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e960551e-0b0d-419e-8417-87ad7704c34f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1683 microversion: 2.1 time: 0.180172 Aug 25 14:11:11.541303 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3423/6780] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:11 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:12.562495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4c198874-4de9-4d27-af59-eeb9bcca9bd9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:12.563131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4c198874-4de9-4d27-af59-eeb9bcca9bd9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:12.570556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c198874-4de9-4d27-af59-eeb9bcca9bd9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:12.571066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c198874-4de9-4d27-af59-eeb9bcca9bd9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:12.571529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c198874-4de9-4d27-af59-eeb9bcca9bd9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:12.572262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c198874-4de9-4d27-af59-eeb9bcca9bd9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:12.572745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c198874-4de9-4d27-af59-eeb9bcca9bd9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:12.573194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c198874-4de9-4d27-af59-eeb9bcca9bd9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:12.734743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4c198874-4de9-4d27-af59-eeb9bcca9bd9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:12.744777 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4c198874-4de9-4d27-af59-eeb9bcca9bd9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1683 microversion: 2.1 time: 0.185832 Aug 25 14:11:12.745407 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3358/6781] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:12 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:13.768151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f0dfaddb-d51f-4fac-9803-1e7ae22d622d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:13.768950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f0dfaddb-d51f-4fac-9803-1e7ae22d622d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:13.776871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0dfaddb-d51f-4fac-9803-1e7ae22d622d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:13.777461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0dfaddb-d51f-4fac-9803-1e7ae22d622d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:13.778017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0dfaddb-d51f-4fac-9803-1e7ae22d622d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:13.778840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0dfaddb-d51f-4fac-9803-1e7ae22d622d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:13.779374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0dfaddb-d51f-4fac-9803-1e7ae22d622d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:13.779869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f0dfaddb-d51f-4fac-9803-1e7ae22d622d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:13.923850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f0dfaddb-d51f-4fac-9803-1e7ae22d622d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:13.932684 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f0dfaddb-d51f-4fac-9803-1e7ae22d622d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1682 microversion: 2.1 time: 0.169089 Aug 25 14:11:13.933285 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3424/6782] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:13 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:14.193204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a395b85d-2320-4713-a985-4473c7591e9e req-e4b56cc9-5650-4a7b-ab8e-a50427cda5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc06b7f-fa8f-4f5e-b713-018203883b75", "name": "network-vif-unplugged", "status": "completed", "tag": "2b783813-e3cc-44f8-8491-ea359c859f2f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:14.204134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a395b85d-2320-4713-a985-4473c7591e9e req-e4b56cc9-5650-4a7b-ab8e-a50427cda5b1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:14.204731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a395b85d-2320-4713-a985-4473c7591e9e req-e4b56cc9-5650-4a7b-ab8e-a50427cda5b1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:14.205233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a395b85d-2320-4713-a985-4473c7591e9e req-e4b56cc9-5650-4a7b-ab8e-a50427cda5b1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:14.219680 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a395b85d-2320-4713-a985-4473c7591e9e req-e4b56cc9-5650-4a7b-ab8e-a50427cda5b1 service nova] Creating event network-vif-unplugged:2b783813-e3cc-44f8-8491-ea359c859f2f for instance ecc06b7f-fa8f-4f5e-b713-018203883b75 on n-h2-852771-8 Aug 25 14:11:14.225421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-a395b85d-2320-4713-a985-4473c7591e9e req-e4b56cc9-5650-4a7b-ab8e-a50427cda5b1 service nova] Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:11:14.237754 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a395b85d-2320-4713-a985-4473c7591e9e req-e4b56cc9-5650-4a7b-ab8e-a50427cda5b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048889 Aug 25 14:11:14.238389 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3359/6783] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:14.955948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1fbc0fb0-b4cc-47ec-a528-5389b38562a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:14.956554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1fbc0fb0-b4cc-47ec-a528-5389b38562a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:14.964300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fbc0fb0-b4cc-47ec-a528-5389b38562a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:14.964821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fbc0fb0-b4cc-47ec-a528-5389b38562a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:14.965266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fbc0fb0-b4cc-47ec-a528-5389b38562a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:14.966009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fbc0fb0-b4cc-47ec-a528-5389b38562a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:14.966459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fbc0fb0-b4cc-47ec-a528-5389b38562a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:14.966906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1fbc0fb0-b4cc-47ec-a528-5389b38562a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:15.121030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1fbc0fb0-b4cc-47ec-a528-5389b38562a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:15.132613 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1fbc0fb0-b4cc-47ec-a528-5389b38562a6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1682 microversion: 2.1 time: 0.180824 Aug 25 14:11:15.133213 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3425/6784] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:14 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:16.155401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-06f74e9a-21dd-43eb-a7d7-59fcc8e95500 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:16.156244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-06f74e9a-21dd-43eb-a7d7-59fcc8e95500 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:16.164438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06f74e9a-21dd-43eb-a7d7-59fcc8e95500 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:16.164964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06f74e9a-21dd-43eb-a7d7-59fcc8e95500 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:16.165433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06f74e9a-21dd-43eb-a7d7-59fcc8e95500 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:16.166245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06f74e9a-21dd-43eb-a7d7-59fcc8e95500 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:16.166731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06f74e9a-21dd-43eb-a7d7-59fcc8e95500 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:16.167213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06f74e9a-21dd-43eb-a7d7-59fcc8e95500 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:16.273860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-08726aba-25a2-4dfb-b668-975119ba430e req-1de4ec91-3410-483a-98ee-b3064b604e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc06b7f-fa8f-4f5e-b713-018203883b75", "tag": "2b783813-e3cc-44f8-8491-ea359c859f2f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:16.285821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-08726aba-25a2-4dfb-b668-975119ba430e req-1de4ec91-3410-483a-98ee-b3064b604e53 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:16.286430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-08726aba-25a2-4dfb-b668-975119ba430e req-1de4ec91-3410-483a-98ee-b3064b604e53 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:16.286937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-08726aba-25a2-4dfb-b668-975119ba430e req-1de4ec91-3410-483a-98ee-b3064b604e53 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:16.304287 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-08726aba-25a2-4dfb-b668-975119ba430e req-1de4ec91-3410-483a-98ee-b3064b604e53 service nova] Creating event network-changed:2b783813-e3cc-44f8-8491-ea359c859f2f for instance ecc06b7f-fa8f-4f5e-b713-018203883b75 on n-h2-852771-8 Aug 25 14:11:16.310720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-08726aba-25a2-4dfb-b668-975119ba430e req-1de4ec91-3410-483a-98ee-b3064b604e53 service nova] Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:11:16.317651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-06f74e9a-21dd-43eb-a7d7-59fcc8e95500 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:16.324666 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-08726aba-25a2-4dfb-b668-975119ba430e req-1de4ec91-3410-483a-98ee-b3064b604e53 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054673 Aug 25 14:11:16.325654 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3426/6785] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:11:16.326979 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-06f74e9a-21dd-43eb-a7d7-59fcc8e95500 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1680 microversion: 2.1 time: 0.175945 Aug 25 14:11:16.327573 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3360/6786] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:16 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:17.351418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a14d896b-1c87-4b7e-9c9c-be5011c2a97f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:17.352136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a14d896b-1c87-4b7e-9c9c-be5011c2a97f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:17.359879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a14d896b-1c87-4b7e-9c9c-be5011c2a97f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:17.360370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a14d896b-1c87-4b7e-9c9c-be5011c2a97f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:17.360975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a14d896b-1c87-4b7e-9c9c-be5011c2a97f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:17.361809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a14d896b-1c87-4b7e-9c9c-be5011c2a97f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:17.362276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a14d896b-1c87-4b7e-9c9c-be5011c2a97f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:17.362707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a14d896b-1c87-4b7e-9c9c-be5011c2a97f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:17.513638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a14d896b-1c87-4b7e-9c9c-be5011c2a97f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:17.524490 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a14d896b-1c87-4b7e-9c9c-be5011c2a97f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1680 microversion: 2.1 time: 0.176018 Aug 25 14:11:17.525097 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3427/6787] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:17 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:18.548613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df0d63ed-0266-4c76-87e0-c2cf6e2c9fb3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:18.549999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df0d63ed-0266-4c76-87e0-c2cf6e2c9fb3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:18.560489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df0d63ed-0266-4c76-87e0-c2cf6e2c9fb3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:18.561008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df0d63ed-0266-4c76-87e0-c2cf6e2c9fb3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:18.561475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df0d63ed-0266-4c76-87e0-c2cf6e2c9fb3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:18.562242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df0d63ed-0266-4c76-87e0-c2cf6e2c9fb3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:18.562736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df0d63ed-0266-4c76-87e0-c2cf6e2c9fb3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:18.563177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df0d63ed-0266-4c76-87e0-c2cf6e2c9fb3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:18.761821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df0d63ed-0266-4c76-87e0-c2cf6e2c9fb3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:18.771688 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df0d63ed-0266-4c76-87e0-c2cf6e2c9fb3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1677 microversion: 2.1 time: 0.228553 Aug 25 14:11:18.782108 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3361/6788] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:18 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:18.795979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:18.796747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:18.807077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:18.807767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:18.808403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:18.809421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:18.810424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:18.810764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:18.862915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:18.863319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:18.863761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:18.864499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:18.864960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:18.865391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:18.889631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:11:18.895800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for user dccab2ef88f44ffc84b30c57c7a86194 and project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:11:19.004308 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d00776e4-8e80-4121-a53c-59367891f56c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75/action" status: 202 len: 0 microversion: 2.1 time: 0.214321 Aug 25 14:11:19.004941 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3428/6789] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:11:18 2022] POST /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:11:19.014956 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-53119a9d-b8e1-4b4d-8bcc-1f11c62eac9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:19.015594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-53119a9d-b8e1-4b4d-8bcc-1f11c62eac9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:19.022961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53119a9d-b8e1-4b4d-8bcc-1f11c62eac9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:19.023471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53119a9d-b8e1-4b4d-8bcc-1f11c62eac9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:19.023941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53119a9d-b8e1-4b4d-8bcc-1f11c62eac9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:19.024681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53119a9d-b8e1-4b4d-8bcc-1f11c62eac9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:19.025158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53119a9d-b8e1-4b4d-8bcc-1f11c62eac9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:19.025794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53119a9d-b8e1-4b4d-8bcc-1f11c62eac9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:19.186272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-53119a9d-b8e1-4b4d-8bcc-1f11c62eac9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:19.198213 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-53119a9d-b8e1-4b4d-8bcc-1f11c62eac9a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1676 microversion: 2.1 time: 0.188186 Aug 25 14:11:19.199073 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3362/6790] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:19 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:11:20.229400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b205de18-35c0-4479-a7ee-164f733c1b8d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:20.230062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b205de18-35c0-4479-a7ee-164f733c1b8d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:20.238635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b205de18-35c0-4479-a7ee-164f733c1b8d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:20.239140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b205de18-35c0-4479-a7ee-164f733c1b8d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:20.239605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b205de18-35c0-4479-a7ee-164f733c1b8d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:20.240331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b205de18-35c0-4479-a7ee-164f733c1b8d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:20.241237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b205de18-35c0-4479-a7ee-164f733c1b8d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:20.241237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b205de18-35c0-4479-a7ee-164f733c1b8d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:20.411295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b205de18-35c0-4479-a7ee-164f733c1b8d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:20.421141 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b205de18-35c0-4479-a7ee-164f733c1b8d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1676 microversion: 2.1 time: 0.197270 Aug 25 14:11:20.421826 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3429/6791] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:20 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:11:21.449087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ea635b2-16c3-4191-9039-f569e0f5f8dc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:21.449997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9ea635b2-16c3-4191-9039-f569e0f5f8dc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:21.458259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea635b2-16c3-4191-9039-f569e0f5f8dc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:21.458780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea635b2-16c3-4191-9039-f569e0f5f8dc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:21.459267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea635b2-16c3-4191-9039-f569e0f5f8dc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:21.460002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea635b2-16c3-4191-9039-f569e0f5f8dc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:21.460470 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea635b2-16c3-4191-9039-f569e0f5f8dc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:21.460920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea635b2-16c3-4191-9039-f569e0f5f8dc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:21.646391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9ea635b2-16c3-4191-9039-f569e0f5f8dc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:21.660575 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9ea635b2-16c3-4191-9039-f569e0f5f8dc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1676 microversion: 2.1 time: 0.213951 Aug 25 14:11:21.660575 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3363/6792] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:21 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:21.664527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-62a1e3f3-044b-47f5-93f2-fa461a4dbc5c req-e85f1e8c-f42b-4168-8ca0-704ceeeed650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc06b7f-fa8f-4f5e-b713-018203883b75", "name": "network-vif-plugged", "status": "completed", "tag": "2b783813-e3cc-44f8-8491-ea359c859f2f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:21.677150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-62a1e3f3-044b-47f5-93f2-fa461a4dbc5c req-e85f1e8c-f42b-4168-8ca0-704ceeeed650 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:21.678914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-62a1e3f3-044b-47f5-93f2-fa461a4dbc5c req-e85f1e8c-f42b-4168-8ca0-704ceeeed650 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:21.678914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-62a1e3f3-044b-47f5-93f2-fa461a4dbc5c req-e85f1e8c-f42b-4168-8ca0-704ceeeed650 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:21.691678 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-62a1e3f3-044b-47f5-93f2-fa461a4dbc5c req-e85f1e8c-f42b-4168-8ca0-704ceeeed650 service nova] Creating event network-vif-plugged:2b783813-e3cc-44f8-8491-ea359c859f2f for instance ecc06b7f-fa8f-4f5e-b713-018203883b75 on n-h2-852771-8 Aug 25 14:11:21.697954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-62a1e3f3-044b-47f5-93f2-fa461a4dbc5c req-e85f1e8c-f42b-4168-8ca0-704ceeeed650 service nova] Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:11:21.709236 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-62a1e3f3-044b-47f5-93f2-fa461a4dbc5c req-e85f1e8c-f42b-4168-8ca0-704ceeeed650 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161777 Aug 25 14:11:21.709910 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3430/6793] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:22.679790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d65c2a8f-e21e-4d94-bc56-35dba57d53b1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:22.680433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d65c2a8f-e21e-4d94-bc56-35dba57d53b1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:22.689178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d65c2a8f-e21e-4d94-bc56-35dba57d53b1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:22.690097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d65c2a8f-e21e-4d94-bc56-35dba57d53b1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:22.690699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d65c2a8f-e21e-4d94-bc56-35dba57d53b1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:22.691465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d65c2a8f-e21e-4d94-bc56-35dba57d53b1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:22.692083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d65c2a8f-e21e-4d94-bc56-35dba57d53b1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:22.692529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d65c2a8f-e21e-4d94-bc56-35dba57d53b1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:22.740568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1600ed7e-bb93-41bb-ab48-da575ddcb648 req-6b0dd6dd-474a-4d6f-acf8-7299d739ce93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc06b7f-fa8f-4f5e-b713-018203883b75", "name": "network-vif-unplugged", "status": "completed", "tag": "2b783813-e3cc-44f8-8491-ea359c859f2f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:22.754107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1600ed7e-bb93-41bb-ab48-da575ddcb648 req-6b0dd6dd-474a-4d6f-acf8-7299d739ce93 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:22.755634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1600ed7e-bb93-41bb-ab48-da575ddcb648 req-6b0dd6dd-474a-4d6f-acf8-7299d739ce93 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:22.755781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1600ed7e-bb93-41bb-ab48-da575ddcb648 req-6b0dd6dd-474a-4d6f-acf8-7299d739ce93 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:22.775639 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1600ed7e-bb93-41bb-ab48-da575ddcb648 req-6b0dd6dd-474a-4d6f-acf8-7299d739ce93 service nova] Creating event network-vif-unplugged:2b783813-e3cc-44f8-8491-ea359c859f2f for instance ecc06b7f-fa8f-4f5e-b713-018203883b75 on n-h1-852771-8 Aug 25 14:11:22.785844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-1600ed7e-bb93-41bb-ab48-da575ddcb648 req-6b0dd6dd-474a-4d6f-acf8-7299d739ce93 service nova] Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:11:22.803583 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1600ed7e-bb93-41bb-ab48-da575ddcb648 req-6b0dd6dd-474a-4d6f-acf8-7299d739ce93 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068506 Aug 25 14:11:22.804700 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3431/6794] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:22.894061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d65c2a8f-e21e-4d94-bc56-35dba57d53b1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:22.905031 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d65c2a8f-e21e-4d94-bc56-35dba57d53b1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1676 microversion: 2.1 time: 0.229121 Aug 25 14:11:22.905890 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3364/6795] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:22 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:11:23.930866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-01358fad-b64a-4ec7-b63e-196d0bd017b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:23.931931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-01358fad-b64a-4ec7-b63e-196d0bd017b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:23.942646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01358fad-b64a-4ec7-b63e-196d0bd017b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:23.943371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01358fad-b64a-4ec7-b63e-196d0bd017b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:23.944027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01358fad-b64a-4ec7-b63e-196d0bd017b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:23.945347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01358fad-b64a-4ec7-b63e-196d0bd017b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:23.946061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01358fad-b64a-4ec7-b63e-196d0bd017b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:23.946708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-01358fad-b64a-4ec7-b63e-196d0bd017b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:23.970362 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:24.116740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-01358fad-b64a-4ec7-b63e-196d0bd017b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:24.125607 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-01358fad-b64a-4ec7-b63e-196d0bd017b6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1676 microversion: 2.1 time: 0.201756 Aug 25 14:11:24.126940 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3432/6796] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:23 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:11:24.826127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c8b4e20d-a0ed-40e7-a30d-3945b10246ca req-2d8f0b5c-d809-4702-b9a5-dda0653a0588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc06b7f-fa8f-4f5e-b713-018203883b75", "tag": "2b783813-e3cc-44f8-8491-ea359c859f2f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:24.837659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c8b4e20d-a0ed-40e7-a30d-3945b10246ca req-2d8f0b5c-d809-4702-b9a5-dda0653a0588 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:24.838166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c8b4e20d-a0ed-40e7-a30d-3945b10246ca req-2d8f0b5c-d809-4702-b9a5-dda0653a0588 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:24.838633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c8b4e20d-a0ed-40e7-a30d-3945b10246ca req-2d8f0b5c-d809-4702-b9a5-dda0653a0588 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:24.853214 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c8b4e20d-a0ed-40e7-a30d-3945b10246ca req-2d8f0b5c-d809-4702-b9a5-dda0653a0588 service nova] Creating event network-changed:2b783813-e3cc-44f8-8491-ea359c859f2f for instance ecc06b7f-fa8f-4f5e-b713-018203883b75 on n-h1-852771-8 Aug 25 14:11:24.861289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-c8b4e20d-a0ed-40e7-a30d-3945b10246ca req-2d8f0b5c-d809-4702-b9a5-dda0653a0588 service nova] Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:11:24.874067 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c8b4e20d-a0ed-40e7-a30d-3945b10246ca req-2d8f0b5c-d809-4702-b9a5-dda0653a0588 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051693 Aug 25 14:11:24.874702 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3365/6797] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:11:25.149234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c8724027-94e8-46e3-833b-8c8f88247c18 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:25.149943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c8724027-94e8-46e3-833b-8c8f88247c18 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:25.157641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8724027-94e8-46e3-833b-8c8f88247c18 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:25.158211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8724027-94e8-46e3-833b-8c8f88247c18 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:25.158738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8724027-94e8-46e3-833b-8c8f88247c18 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:25.159473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8724027-94e8-46e3-833b-8c8f88247c18 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:25.159933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8724027-94e8-46e3-833b-8c8f88247c18 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:25.160373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8724027-94e8-46e3-833b-8c8f88247c18 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:25.318937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c8724027-94e8-46e3-833b-8c8f88247c18 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:25.329664 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c8724027-94e8-46e3-833b-8c8f88247c18 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1676 microversion: 2.1 time: 0.184644 Aug 25 14:11:25.330415 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3433/6798] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:25 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:26.354867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e3cd997-4602-4ff4-9794-bf978763cd16 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:26.355596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e3cd997-4602-4ff4-9794-bf978763cd16 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:26.364182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e3cd997-4602-4ff4-9794-bf978763cd16 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:26.364694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e3cd997-4602-4ff4-9794-bf978763cd16 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:26.365160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e3cd997-4602-4ff4-9794-bf978763cd16 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:26.365928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e3cd997-4602-4ff4-9794-bf978763cd16 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:26.366404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e3cd997-4602-4ff4-9794-bf978763cd16 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:26.366847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e3cd997-4602-4ff4-9794-bf978763cd16 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:26.521640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8e3cd997-4602-4ff4-9794-bf978763cd16 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:26.530704 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e3cd997-4602-4ff4-9794-bf978763cd16 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1676 microversion: 2.1 time: 0.180259 Aug 25 14:11:26.531473 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3366/6799] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:26 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:27.553326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-02a0968f-7aed-46de-bf8b-b63cb37ce3f0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:27.553954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-02a0968f-7aed-46de-bf8b-b63cb37ce3f0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:27.561082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a0968f-7aed-46de-bf8b-b63cb37ce3f0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:27.561601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a0968f-7aed-46de-bf8b-b63cb37ce3f0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:27.562041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a0968f-7aed-46de-bf8b-b63cb37ce3f0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:27.562757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a0968f-7aed-46de-bf8b-b63cb37ce3f0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:27.563209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a0968f-7aed-46de-bf8b-b63cb37ce3f0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:27.564404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-02a0968f-7aed-46de-bf8b-b63cb37ce3f0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:27.713708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-02a0968f-7aed-46de-bf8b-b63cb37ce3f0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:27.722823 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-02a0968f-7aed-46de-bf8b-b63cb37ce3f0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1669 microversion: 2.1 time: 0.173433 Aug 25 14:11:27.723456 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3434/6800] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:27 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:27.749791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a8b6d43-0235-4aa9-a214-19ba57a30bea tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:27.750472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a8b6d43-0235-4aa9-a214-19ba57a30bea tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:27.758247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a8b6d43-0235-4aa9-a214-19ba57a30bea tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:27.758764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a8b6d43-0235-4aa9-a214-19ba57a30bea tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:27.759226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a8b6d43-0235-4aa9-a214-19ba57a30bea tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:27.759959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a8b6d43-0235-4aa9-a214-19ba57a30bea tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:27.760435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a8b6d43-0235-4aa9-a214-19ba57a30bea tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:27.760920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a8b6d43-0235-4aa9-a214-19ba57a30bea tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:27.925566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6a8b6d43-0235-4aa9-a214-19ba57a30bea tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:27.931617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:27.942856 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a8b6d43-0235-4aa9-a214-19ba57a30bea tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1669 microversion: 2.1 time: 0.197149 Aug 25 14:11:27.943941 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3367/6801] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:27 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1669 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:27.980622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d6dc16f-6ecc-49f8-94c8-447f0f3d4d3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:27.981249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d6dc16f-6ecc-49f8-94c8-447f0f3d4d3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:27.988283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d6dc16f-6ecc-49f8-94c8-447f0f3d4d3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:27.988795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d6dc16f-6ecc-49f8-94c8-447f0f3d4d3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:27.989242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d6dc16f-6ecc-49f8-94c8-447f0f3d4d3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:27.990179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d6dc16f-6ecc-49f8-94c8-447f0f3d4d3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:27.990509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d6dc16f-6ecc-49f8-94c8-447f0f3d4d3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:27.990955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d6dc16f-6ecc-49f8-94c8-447f0f3d4d3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:28.178195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d6dc16f-6ecc-49f8-94c8-447f0f3d4d3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:28.187373 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d6dc16f-6ecc-49f8-94c8-447f0f3d4d3e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1669 microversion: 2.1 time: 0.210682 Aug 25 14:11:28.187981 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3435/6802] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:27 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1669 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:28.209180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5310982e-8f55-4f2d-adfa-48e2db6ffbe3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:28.210079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5310982e-8f55-4f2d-adfa-48e2db6ffbe3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:28.217909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5310982e-8f55-4f2d-adfa-48e2db6ffbe3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:28.218418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5310982e-8f55-4f2d-adfa-48e2db6ffbe3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:28.218872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5310982e-8f55-4f2d-adfa-48e2db6ffbe3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:28.219607 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5310982e-8f55-4f2d-adfa-48e2db6ffbe3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:28.220861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5310982e-8f55-4f2d-adfa-48e2db6ffbe3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:28.221475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5310982e-8f55-4f2d-adfa-48e2db6ffbe3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:28.248536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5310982e-8f55-4f2d-adfa-48e2db6ffbe3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:11:28.352638 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5310982e-8f55-4f2d-adfa-48e2db6ffbe3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 204 len: 0 microversion: 2.1 time: 0.148309 Aug 25 14:11:28.353190 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3368/6803] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:11:28 2022] DELETE /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:11:28.363038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b4d76f08-aa1a-4b26-8beb-a23d09594c48 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:28.363654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b4d76f08-aa1a-4b26-8beb-a23d09594c48 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:28.370475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4d76f08-aa1a-4b26-8beb-a23d09594c48 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:28.371508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4d76f08-aa1a-4b26-8beb-a23d09594c48 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:28.371656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4d76f08-aa1a-4b26-8beb-a23d09594c48 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:28.372469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4d76f08-aa1a-4b26-8beb-a23d09594c48 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:28.372961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4d76f08-aa1a-4b26-8beb-a23d09594c48 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:28.373469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b4d76f08-aa1a-4b26-8beb-a23d09594c48 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:28.524908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b4d76f08-aa1a-4b26-8beb-a23d09594c48 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:28.534188 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b4d76f08-aa1a-4b26-8beb-a23d09594c48 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1675 microversion: 2.1 time: 0.176039 Aug 25 14:11:28.534798 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3436/6804] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:28 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:29.557638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c78b21d0-1cdc-4979-8d79-403b08cf41b0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:29.558414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c78b21d0-1cdc-4979-8d79-403b08cf41b0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:29.561548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:29.568073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c78b21d0-1cdc-4979-8d79-403b08cf41b0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:29.568491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c78b21d0-1cdc-4979-8d79-403b08cf41b0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:29.568967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c78b21d0-1cdc-4979-8d79-403b08cf41b0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:29.569762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c78b21d0-1cdc-4979-8d79-403b08cf41b0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:29.570512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c78b21d0-1cdc-4979-8d79-403b08cf41b0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:29.570962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c78b21d0-1cdc-4979-8d79-403b08cf41b0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:29.733998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c78b21d0-1cdc-4979-8d79-403b08cf41b0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:29.744227 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c78b21d0-1cdc-4979-8d79-403b08cf41b0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1675 microversion: 2.1 time: 0.190919 Aug 25 14:11:29.744794 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3369/6805] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:29 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:30.496197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8d96817c-e0cf-4c8e-9981-0218f8cdf1cb req-1983822e-69b1-4905-ac6d-7a959b83d8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc06b7f-fa8f-4f5e-b713-018203883b75", "name": "network-vif-plugged", "status": "completed", "tag": "2b783813-e3cc-44f8-8491-ea359c859f2f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:30.505860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:30.506726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:30.513885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8d96817c-e0cf-4c8e-9981-0218f8cdf1cb req-1983822e-69b1-4905-ac6d-7a959b83d8a4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:30.514671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8d96817c-e0cf-4c8e-9981-0218f8cdf1cb req-1983822e-69b1-4905-ac6d-7a959b83d8a4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:30.515332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8d96817c-e0cf-4c8e-9981-0218f8cdf1cb req-1983822e-69b1-4905-ac6d-7a959b83d8a4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:30.531531 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8d96817c-e0cf-4c8e-9981-0218f8cdf1cb req-1983822e-69b1-4905-ac6d-7a959b83d8a4 service nova] Creating event network-vif-plugged:2b783813-e3cc-44f8-8491-ea359c859f2f for instance ecc06b7f-fa8f-4f5e-b713-018203883b75 on n-h1-852771-8 Aug 25 14:11:30.538611 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8d96817c-e0cf-4c8e-9981-0218f8cdf1cb req-1983822e-69b1-4905-ac6d-7a959b83d8a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046768 Aug 25 14:11:30.539603 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3437/6806] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:11:30.775317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d53f046f-16b6-4ece-9236-3ac345bb12a8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:30.776188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d53f046f-16b6-4ece-9236-3ac345bb12a8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:30.784656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d53f046f-16b6-4ece-9236-3ac345bb12a8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:30.785274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d53f046f-16b6-4ece-9236-3ac345bb12a8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:30.785866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d53f046f-16b6-4ece-9236-3ac345bb12a8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:30.786692 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d53f046f-16b6-4ece-9236-3ac345bb12a8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:30.787245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d53f046f-16b6-4ece-9236-3ac345bb12a8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:30.787775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d53f046f-16b6-4ece-9236-3ac345bb12a8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:30.893203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d53f046f-16b6-4ece-9236-3ac345bb12a8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:30.909399 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d53f046f-16b6-4ece-9236-3ac345bb12a8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 200 len: 1608 microversion: 2.1 time: 0.143464 Aug 25 14:11:30.910991 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3370/6807] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:30 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 1608 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:31.154752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-ca5584f7-6d3a-4445-8998-2614a82e7228 req-434fd337-6d51-41cc-8113-e71af181cef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc06b7f-fa8f-4f5e-b713-018203883b75", "name": "network-vif-deleted", "tag": "2b783813-e3cc-44f8-8491-ea359c859f2f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:31.167365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ca5584f7-6d3a-4445-8998-2614a82e7228 req-434fd337-6d51-41cc-8113-e71af181cef5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:31.167885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ca5584f7-6d3a-4445-8998-2614a82e7228 req-434fd337-6d51-41cc-8113-e71af181cef5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:31.168586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-ca5584f7-6d3a-4445-8998-2614a82e7228 req-434fd337-6d51-41cc-8113-e71af181cef5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:31.182121 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-ca5584f7-6d3a-4445-8998-2614a82e7228 req-434fd337-6d51-41cc-8113-e71af181cef5 service nova] Creating event network-vif-deleted:2b783813-e3cc-44f8-8491-ea359c859f2f for instance ecc06b7f-fa8f-4f5e-b713-018203883b75 on n-h1-852771-8 Aug 25 14:11:31.188172 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-ca5584f7-6d3a-4445-8998-2614a82e7228 req-434fd337-6d51-41cc-8113-e71af181cef5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037990 Aug 25 14:11:31.189292 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3438/6808] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:31.942424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:31.943084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:31.951604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:31.952119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:31.952586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:31.953606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:31.954911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:31.955260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:31.980747 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 HTTP/1.1 Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ecc06b7f-fa8f-4f5e-b713-018203883b75'} Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:11:31.983695 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:11:31.988469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:31.988469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:11:31.988469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:11:31.988469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:11:31.988469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:11:31.988469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:11:31.988469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:11:31.988469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:11:31.988469 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-859e8ccd-f036-41f0-8c32-8210f9c3e961 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 404 len: 111 microversion: 2.1 time: 0.049443 Aug 25 14:11:31.988469 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3371/6809] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:31 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:11:32.007092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:32.008300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:32.019831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:32.020449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:32.020763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:32.021492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:32.022064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:32.022700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:32.041384 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 HTTP/1.1 Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'ecc06b7f-fa8f-4f5e-b713-018203883b75'} Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:11:32.043535 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:11:32.049095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:32.049095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:11:32.049095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:11:32.049095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:11:32.049095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:11:32.049095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:11:32.049095 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:11:32.049095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:11:32.049095 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad5d481b-0eb6-4714-b635-5b5061050656 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 404 len: 111 microversion: 2.1 time: 0.044335 Aug 25 14:11:32.049095 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3439/6810] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:31 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:11:32.101903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1644208303", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "ee9ab0d6-db08-459b-b844-2b0d86452b77"}], "security_groups": [{"name": "tempest-securitygroup--480932018"}], "key_name": "tempest-keypair-2050390348", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:32.239346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] validate_networks() for [('ee9ab0d6-db08-459b-b844-2b0d86452b77', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:11:32.725269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:11:32.725764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:11:32.726269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:11:32.726840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:11:32.727288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:11:32.738076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:32.738588 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:32.739057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:32.739811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:32.740370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:32.740830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:32.760145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:11:32.766513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for user dccab2ef88f44ffc84b30c57c7a86194 and project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:11:32.781757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:11:32.784482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:11:32.853856 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb7fbbd5-87ba-4607-a0d1-d4583a53a067 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.755495 Aug 25 14:11:32.854547 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3372/6811] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:11:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:11:32.866191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d71f4cc3-2814-4c1e-a0d3-3bc3c470162d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:32.866826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d71f4cc3-2814-4c1e-a0d3-3bc3c470162d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:32.933633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d71f4cc3-2814-4c1e-a0d3-3bc3c470162d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:32.945869 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d71f4cc3-2814-4c1e-a0d3-3bc3c470162d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1239 microversion: 2.1 time: 0.082995 Aug 25 14:11:32.946760 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3440/6812] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:32 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:33.968902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-639226c4-8e3f-48dc-b853-628eeadb9ee5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:33.970168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-639226c4-8e3f-48dc-b853-628eeadb9ee5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:33.978649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-639226c4-8e3f-48dc-b853-628eeadb9ee5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:33.979258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-639226c4-8e3f-48dc-b853-628eeadb9ee5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:33.979798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-639226c4-8e3f-48dc-b853-628eeadb9ee5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:33.980579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-639226c4-8e3f-48dc-b853-628eeadb9ee5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:33.981067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-639226c4-8e3f-48dc-b853-628eeadb9ee5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:33.981547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-639226c4-8e3f-48dc-b853-628eeadb9ee5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:34.075150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-639226c4-8e3f-48dc-b853-628eeadb9ee5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:34.091673 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-639226c4-8e3f-48dc-b853-628eeadb9ee5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1291 microversion: 2.1 time: 0.126519 Aug 25 14:11:34.101620 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3373/6813] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:33 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1291 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:35.128416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-386777a5-a593-4b11-9387-f78fe9f3772c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:35.129254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-386777a5-a593-4b11-9387-f78fe9f3772c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:35.139588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386777a5-a593-4b11-9387-f78fe9f3772c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:35.140367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386777a5-a593-4b11-9387-f78fe9f3772c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:35.141010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386777a5-a593-4b11-9387-f78fe9f3772c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:35.142036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386777a5-a593-4b11-9387-f78fe9f3772c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:35.142607 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386777a5-a593-4b11-9387-f78fe9f3772c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:35.143043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-386777a5-a593-4b11-9387-f78fe9f3772c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:35.228915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-386777a5-a593-4b11-9387-f78fe9f3772c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:35.239547 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-386777a5-a593-4b11-9387-f78fe9f3772c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1297 microversion: 2.1 time: 0.117134 Aug 25 14:11:35.240307 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3441/6814] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:35 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:36.147965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ec8ecbe9-e8ba-4f51-8d81-89627b5b6f12 req-4c741c5c-092d-4c16-8103-83d1f8db7a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400724ae-c722-47a9-a294-a63c18156ce0", "tag": "eaa95e48-1291-42a1-af8d-c3b02c4d263b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:36.164604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec8ecbe9-e8ba-4f51-8d81-89627b5b6f12 req-4c741c5c-092d-4c16-8103-83d1f8db7a3c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:36.165538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec8ecbe9-e8ba-4f51-8d81-89627b5b6f12 req-4c741c5c-092d-4c16-8103-83d1f8db7a3c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:36.166245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ec8ecbe9-e8ba-4f51-8d81-89627b5b6f12 req-4c741c5c-092d-4c16-8103-83d1f8db7a3c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:36.188098 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ec8ecbe9-e8ba-4f51-8d81-89627b5b6f12 req-4c741c5c-092d-4c16-8103-83d1f8db7a3c service nova] Creating event network-changed:eaa95e48-1291-42a1-af8d-c3b02c4d263b for instance 400724ae-c722-47a9-a294-a63c18156ce0 on n-h2-852771-8 Aug 25 14:11:36.195515 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ec8ecbe9-e8ba-4f51-8d81-89627b5b6f12 req-4c741c5c-092d-4c16-8103-83d1f8db7a3c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051280 Aug 25 14:11:36.196562 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3374/6815] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:36.268102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-121da73e-94ff-4965-a93a-84dcb31b6d10 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:36.268977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-121da73e-94ff-4965-a93a-84dcb31b6d10 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:36.280195 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121da73e-94ff-4965-a93a-84dcb31b6d10 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:36.281005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121da73e-94ff-4965-a93a-84dcb31b6d10 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:36.281841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121da73e-94ff-4965-a93a-84dcb31b6d10 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:36.283858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121da73e-94ff-4965-a93a-84dcb31b6d10 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:36.284716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121da73e-94ff-4965-a93a-84dcb31b6d10 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:36.285927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-121da73e-94ff-4965-a93a-84dcb31b6d10 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:36.443389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-121da73e-94ff-4965-a93a-84dcb31b6d10 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:36.461314 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-121da73e-94ff-4965-a93a-84dcb31b6d10 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1364 microversion: 2.1 time: 0.198947 Aug 25 14:11:36.462458 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3442/6816] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:36 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:11:37.486669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c89b022c-3cec-464c-a524-10bbcb81d028 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:37.487412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c89b022c-3cec-464c-a524-10bbcb81d028 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:37.494110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c89b022c-3cec-464c-a524-10bbcb81d028 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:37.494617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c89b022c-3cec-464c-a524-10bbcb81d028 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:37.495094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c89b022c-3cec-464c-a524-10bbcb81d028 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:37.495816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c89b022c-3cec-464c-a524-10bbcb81d028 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:37.496289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c89b022c-3cec-464c-a524-10bbcb81d028 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:37.496734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c89b022c-3cec-464c-a524-10bbcb81d028 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:37.647654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c89b022c-3cec-464c-a524-10bbcb81d028 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:37.656444 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c89b022c-3cec-464c-a524-10bbcb81d028 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1364 microversion: 2.1 time: 0.175771 Aug 25 14:11:37.657160 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3375/6817] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:37 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:38.678063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-31dbde8d-480c-4267-a432-2f47043a697a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:38.678677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-31dbde8d-480c-4267-a432-2f47043a697a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:38.686488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31dbde8d-480c-4267-a432-2f47043a697a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:38.686991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31dbde8d-480c-4267-a432-2f47043a697a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:38.687436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31dbde8d-480c-4267-a432-2f47043a697a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:38.688185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31dbde8d-480c-4267-a432-2f47043a697a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:38.689424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31dbde8d-480c-4267-a432-2f47043a697a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:38.690172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-31dbde8d-480c-4267-a432-2f47043a697a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:38.856566 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-31dbde8d-480c-4267-a432-2f47043a697a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:38.865877 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-31dbde8d-480c-4267-a432-2f47043a697a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1364 microversion: 2.1 time: 0.191622 Aug 25 14:11:38.866533 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3443/6818] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:38 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:39.896453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e3b498d2-e5b9-46e5-86fe-9f37ce17bf21 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:39.897300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e3b498d2-e5b9-46e5-86fe-9f37ce17bf21 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:39.905702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b498d2-e5b9-46e5-86fe-9f37ce17bf21 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:39.906225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b498d2-e5b9-46e5-86fe-9f37ce17bf21 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:39.906698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b498d2-e5b9-46e5-86fe-9f37ce17bf21 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:39.908002 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b498d2-e5b9-46e5-86fe-9f37ce17bf21 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:39.908685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b498d2-e5b9-46e5-86fe-9f37ce17bf21 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:39.909225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e3b498d2-e5b9-46e5-86fe-9f37ce17bf21 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:40.442702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e3b498d2-e5b9-46e5-86fe-9f37ce17bf21 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:40.453434 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e3b498d2-e5b9-46e5-86fe-9f37ce17bf21 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1364 microversion: 2.1 time: 0.564769 Aug 25 14:11:40.454796 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3376/6819] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:39 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1364 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:41.476965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4a4d62ca-2153-450a-bdd4-e7feee72f5bc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:41.477788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4a4d62ca-2153-450a-bdd4-e7feee72f5bc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:41.486033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a4d62ca-2153-450a-bdd4-e7feee72f5bc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:41.486577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a4d62ca-2153-450a-bdd4-e7feee72f5bc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:41.487033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a4d62ca-2153-450a-bdd4-e7feee72f5bc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:41.487774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a4d62ca-2153-450a-bdd4-e7feee72f5bc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:41.488242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a4d62ca-2153-450a-bdd4-e7feee72f5bc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:41.488677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4a4d62ca-2153-450a-bdd4-e7feee72f5bc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:41.606995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6b4445d0-3a76-4286-ab1e-37418a54e174 req-117645e2-2c59-4be5-a927-ec9bb100cd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400724ae-c722-47a9-a294-a63c18156ce0", "name": "network-vif-plugged", "status": "completed", "tag": "eaa95e48-1291-42a1-af8d-c3b02c4d263b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:41.627582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6b4445d0-3a76-4286-ab1e-37418a54e174 req-117645e2-2c59-4be5-a927-ec9bb100cd5d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:41.628534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6b4445d0-3a76-4286-ab1e-37418a54e174 req-117645e2-2c59-4be5-a927-ec9bb100cd5d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:41.629923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6b4445d0-3a76-4286-ab1e-37418a54e174 req-117645e2-2c59-4be5-a927-ec9bb100cd5d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:41.644333 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6b4445d0-3a76-4286-ab1e-37418a54e174 req-117645e2-2c59-4be5-a927-ec9bb100cd5d service nova] Creating event network-vif-plugged:eaa95e48-1291-42a1-af8d-c3b02c4d263b for instance 400724ae-c722-47a9-a294-a63c18156ce0 on n-h2-852771-8 Aug 25 14:11:41.650754 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6b4445d0-3a76-4286-ab1e-37418a54e174 req-117645e2-2c59-4be5-a927-ec9bb100cd5d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050286 Aug 25 14:11:41.652098 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3377/6820] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:11:41.700888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4a4d62ca-2153-450a-bdd4-e7feee72f5bc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:41.716878 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4a4d62ca-2153-450a-bdd4-e7feee72f5bc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1364 microversion: 2.1 time: 0.243944 Aug 25 14:11:41.718061 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3444/6821] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:41 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:42.742136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0778a90e-ca34-45a3-afb2-1a96a0bb9649 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:42.742915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0778a90e-ca34-45a3-afb2-1a96a0bb9649 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:42.748076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:42.750219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0778a90e-ca34-45a3-afb2-1a96a0bb9649 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:42.751434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0778a90e-ca34-45a3-afb2-1a96a0bb9649 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:42.752062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0778a90e-ca34-45a3-afb2-1a96a0bb9649 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:42.752923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0778a90e-ca34-45a3-afb2-1a96a0bb9649 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:42.753416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0778a90e-ca34-45a3-afb2-1a96a0bb9649 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:42.753958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0778a90e-ca34-45a3-afb2-1a96a0bb9649 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:42.775436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:42.905029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0778a90e-ca34-45a3-afb2-1a96a0bb9649 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:42.914833 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0778a90e-ca34-45a3-afb2-1a96a0bb9649 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1364 microversion: 2.1 time: 0.178437 Aug 25 14:11:42.915518 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3378/6822] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:42 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:43.941727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5833a1b-84f4-4ab3-b605-34a0ab757c79 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:43.942926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5833a1b-84f4-4ab3-b605-34a0ab757c79 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:43.948048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:43.956843 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5833a1b-84f4-4ab3-b605-34a0ab757c79 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:43.957345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5833a1b-84f4-4ab3-b605-34a0ab757c79 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:43.957824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5833a1b-84f4-4ab3-b605-34a0ab757c79 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:43.958548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5833a1b-84f4-4ab3-b605-34a0ab757c79 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:43.959010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5833a1b-84f4-4ab3-b605-34a0ab757c79 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:43.959442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5833a1b-84f4-4ab3-b605-34a0ab757c79 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:44.105952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c5833a1b-84f4-4ab3-b605-34a0ab757c79 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:44.115258 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5833a1b-84f4-4ab3-b605-34a0ab757c79 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1550 microversion: 2.1 time: 0.181009 Aug 25 14:11:44.115950 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3445/6823] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:43 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:44.137743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f948504d-ca19-4e3d-a896-ef4f46b7eb46 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:44.138494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f948504d-ca19-4e3d-a896-ef4f46b7eb46 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:44.146224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f948504d-ca19-4e3d-a896-ef4f46b7eb46 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:44.146770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f948504d-ca19-4e3d-a896-ef4f46b7eb46 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:44.147271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f948504d-ca19-4e3d-a896-ef4f46b7eb46 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:44.148010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f948504d-ca19-4e3d-a896-ef4f46b7eb46 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:44.148479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f948504d-ca19-4e3d-a896-ef4f46b7eb46 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:44.148918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f948504d-ca19-4e3d-a896-ef4f46b7eb46 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:44.241817 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f948504d-ca19-4e3d-a896-ef4f46b7eb46 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107626 Aug 25 14:11:44.242904 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3379/6824] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 14:11:44 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:11:45.435175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-97d74367-7c76-4532-a814-99716c31d78d req-747e1eb3-b35a-4883-961c-adaa6f5b99bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400724ae-c722-47a9-a294-a63c18156ce0", "tag": "eaa95e48-1291-42a1-af8d-c3b02c4d263b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:45.455484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-97d74367-7c76-4532-a814-99716c31d78d req-747e1eb3-b35a-4883-961c-adaa6f5b99bf service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:45.456636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-97d74367-7c76-4532-a814-99716c31d78d req-747e1eb3-b35a-4883-961c-adaa6f5b99bf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:45.457536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-97d74367-7c76-4532-a814-99716c31d78d req-747e1eb3-b35a-4883-961c-adaa6f5b99bf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:45.476535 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-97d74367-7c76-4532-a814-99716c31d78d req-747e1eb3-b35a-4883-961c-adaa6f5b99bf service nova] Creating event network-changed:eaa95e48-1291-42a1-af8d-c3b02c4d263b for instance 400724ae-c722-47a9-a294-a63c18156ce0 on n-h2-852771-8 Aug 25 14:11:45.482802 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-97d74367-7c76-4532-a814-99716c31d78d req-747e1eb3-b35a-4883-961c-adaa6f5b99bf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054650 Aug 25 14:11:45.483825 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3446/6825] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:13:01.117476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:01.118300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:01.119634 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:13:01.119799 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:13:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 (ip 10.222.0.70) !!! Aug 25 14:13:01.126210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bc386c2c-6952-479c-9d2e-d3ef8d7330a2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:01.126845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bc386c2c-6952-479c-9d2e-d3ef8d7330a2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:01.137344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc386c2c-6952-479c-9d2e-d3ef8d7330a2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:01.137888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc386c2c-6952-479c-9d2e-d3ef8d7330a2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:01.138342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc386c2c-6952-479c-9d2e-d3ef8d7330a2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:01.139074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc386c2c-6952-479c-9d2e-d3ef8d7330a2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:01.139544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc386c2c-6952-479c-9d2e-d3ef8d7330a2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:01.139992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc386c2c-6952-479c-9d2e-d3ef8d7330a2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:01.347210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bc386c2c-6952-479c-9d2e-d3ef8d7330a2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:01.355155 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bc386c2c-6952-479c-9d2e-d3ef8d7330a2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1669 microversion: 2.1 time: 0.240777 Aug 25 14:13:01.355752 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3380/6826] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:01 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1669 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:01.374761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=21 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:01.375503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=64 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:01.376626 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:13:01.376777 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:13:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/os-volume_attachments (ip 10.222.0.70) !!! Aug 25 14:13:01.383217 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-226aedee-82db-45e3-b373-4095ccbe4a5f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b6822ae-17da-4de3-be20-af37d3c0376a"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:13:01.386325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-226aedee-82db-45e3-b373-4095ccbe4a5f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:01.394936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-226aedee-82db-45e3-b373-4095ccbe4a5f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:01.395424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-226aedee-82db-45e3-b373-4095ccbe4a5f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:01.395865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-226aedee-82db-45e3-b373-4095ccbe4a5f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:01.396563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-226aedee-82db-45e3-b373-4095ccbe4a5f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:01.397019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-226aedee-82db-45e3-b373-4095ccbe4a5f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:01.397447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-226aedee-82db-45e3-b373-4095ccbe4a5f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:01.791593 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-226aedee-82db-45e3-b373-4095ccbe4a5f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418494 Aug 25 14:13:01.792239 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3447/6827] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 14:13:01 2022] POST /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:13:13.584973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:13:13.587420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:13.590448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:13.591393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:13.597040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:13.597613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:13.598082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:13.598818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:13.599294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:13.599745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:13.646940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:13.653954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Old instance type m1.heat2, new instance type m1.heat {{(pid=129059) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:13:13.661631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:13:13.662077 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:13:13.662584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:13:13.663018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:13:13.663454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:13:13.742742 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4c074e03-9fb4-4330-9dc4-f981ed16abbf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/action" status: 202 len: 0 microversion: 2.1 time: 0.161558 Aug 25 14:13:13.743423 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3381/6828] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:13:13 2022] POST /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:13:13.752279 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4f07d6fd-a3f0-4dc5-988a-6fe60ef23c83 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:13.752985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4f07d6fd-a3f0-4dc5-988a-6fe60ef23c83 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:13.757062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:13.757925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:13.763002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f07d6fd-a3f0-4dc5-988a-6fe60ef23c83 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:13.763645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f07d6fd-a3f0-4dc5-988a-6fe60ef23c83 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:13.763950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f07d6fd-a3f0-4dc5-988a-6fe60ef23c83 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:13.764687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f07d6fd-a3f0-4dc5-988a-6fe60ef23c83 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:13.765234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f07d6fd-a3f0-4dc5-988a-6fe60ef23c83 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:13.765775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4f07d6fd-a3f0-4dc5-988a-6fe60ef23c83 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:13.920690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4f07d6fd-a3f0-4dc5-988a-6fe60ef23c83 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:13.929660 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4f07d6fd-a3f0-4dc5-988a-6fe60ef23c83 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1724 microversion: 2.1 time: 0.181620 Aug 25 14:13:13.930259 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3448/6829] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:13 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:13:14.953040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f233518e-9b25-4f37-8207-1cd2407d62d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:14.953724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f233518e-9b25-4f37-8207-1cd2407d62d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:14.962235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f233518e-9b25-4f37-8207-1cd2407d62d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:14.962826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f233518e-9b25-4f37-8207-1cd2407d62d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:14.963151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f233518e-9b25-4f37-8207-1cd2407d62d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:14.963881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f233518e-9b25-4f37-8207-1cd2407d62d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:14.964357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f233518e-9b25-4f37-8207-1cd2407d62d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:14.964806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f233518e-9b25-4f37-8207-1cd2407d62d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:15.112185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f233518e-9b25-4f37-8207-1cd2407d62d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:15.121686 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f233518e-9b25-4f37-8207-1cd2407d62d5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1724 microversion: 2.1 time: 0.172672 Aug 25 14:13:15.122302 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3382/6830] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:14 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:16.143845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eab3aa0c-8d40-4ead-a7d6-010a539abcd6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:16.144496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eab3aa0c-8d40-4ead-a7d6-010a539abcd6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:16.151680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eab3aa0c-8d40-4ead-a7d6-010a539abcd6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:16.152162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eab3aa0c-8d40-4ead-a7d6-010a539abcd6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:16.152599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eab3aa0c-8d40-4ead-a7d6-010a539abcd6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:16.153305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eab3aa0c-8d40-4ead-a7d6-010a539abcd6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:16.153790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eab3aa0c-8d40-4ead-a7d6-010a539abcd6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:16.154214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eab3aa0c-8d40-4ead-a7d6-010a539abcd6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:16.287352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eab3aa0c-8d40-4ead-a7d6-010a539abcd6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:16.296332 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eab3aa0c-8d40-4ead-a7d6-010a539abcd6 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.156384 Aug 25 14:13:16.296915 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3449/6831] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:16 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:17.318872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-803704aa-ed5e-4ae7-ae8f-a53800a7abd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:17.319501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-803704aa-ed5e-4ae7-ae8f-a53800a7abd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:17.327442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-803704aa-ed5e-4ae7-ae8f-a53800a7abd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:17.327950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-803704aa-ed5e-4ae7-ae8f-a53800a7abd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:17.328407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-803704aa-ed5e-4ae7-ae8f-a53800a7abd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:17.329119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-803704aa-ed5e-4ae7-ae8f-a53800a7abd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:17.329620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-803704aa-ed5e-4ae7-ae8f-a53800a7abd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:17.330065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-803704aa-ed5e-4ae7-ae8f-a53800a7abd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:17.465978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-803704aa-ed5e-4ae7-ae8f-a53800a7abd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:17.474416 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-803704aa-ed5e-4ae7-ae8f-a53800a7abd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.159460 Aug 25 14:13:17.474993 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3383/6832] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:17 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:18.496317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5278fcd9-9fe7-4e92-9b7b-2de2f07b7532 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:18.496961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5278fcd9-9fe7-4e92-9b7b-2de2f07b7532 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:18.503824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5278fcd9-9fe7-4e92-9b7b-2de2f07b7532 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:18.504297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5278fcd9-9fe7-4e92-9b7b-2de2f07b7532 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:18.504743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5278fcd9-9fe7-4e92-9b7b-2de2f07b7532 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:18.505470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5278fcd9-9fe7-4e92-9b7b-2de2f07b7532 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:18.505940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5278fcd9-9fe7-4e92-9b7b-2de2f07b7532 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:18.506361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5278fcd9-9fe7-4e92-9b7b-2de2f07b7532 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:18.644767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5278fcd9-9fe7-4e92-9b7b-2de2f07b7532 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:18.653615 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5278fcd9-9fe7-4e92-9b7b-2de2f07b7532 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.162042 Aug 25 14:13:18.654214 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3450/6833] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:18 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:19.675151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d69ca97f-03f0-41d4-9fdf-960e22eda936 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:19.675777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d69ca97f-03f0-41d4-9fdf-960e22eda936 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:19.683032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d69ca97f-03f0-41d4-9fdf-960e22eda936 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:19.683510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d69ca97f-03f0-41d4-9fdf-960e22eda936 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:19.684072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d69ca97f-03f0-41d4-9fdf-960e22eda936 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:19.684695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d69ca97f-03f0-41d4-9fdf-960e22eda936 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:19.685161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d69ca97f-03f0-41d4-9fdf-960e22eda936 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:19.685755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d69ca97f-03f0-41d4-9fdf-960e22eda936 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:19.818642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d69ca97f-03f0-41d4-9fdf-960e22eda936 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:19.827569 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d69ca97f-03f0-41d4-9fdf-960e22eda936 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.156543 Aug 25 14:13:19.828184 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3384/6834] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:19 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:20.850299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-44c18bc6-6615-414f-a62a-52b16cc268e8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:20.850919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-44c18bc6-6615-414f-a62a-52b16cc268e8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:20.858968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44c18bc6-6615-414f-a62a-52b16cc268e8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:20.859496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44c18bc6-6615-414f-a62a-52b16cc268e8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:20.859886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44c18bc6-6615-414f-a62a-52b16cc268e8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:20.860616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44c18bc6-6615-414f-a62a-52b16cc268e8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:20.861039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44c18bc6-6615-414f-a62a-52b16cc268e8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:20.861464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44c18bc6-6615-414f-a62a-52b16cc268e8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:20.999389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-44c18bc6-6615-414f-a62a-52b16cc268e8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:21.007857 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-44c18bc6-6615-414f-a62a-52b16cc268e8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.161527 Aug 25 14:13:21.008445 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3451/6835] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:20 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:22.029334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e5e81921-3d51-4bbe-9ee0-a936dd71ae1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:22.030519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e5e81921-3d51-4bbe-9ee0-a936dd71ae1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:22.036932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5e81921-3d51-4bbe-9ee0-a936dd71ae1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:22.037438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5e81921-3d51-4bbe-9ee0-a936dd71ae1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:22.037938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5e81921-3d51-4bbe-9ee0-a936dd71ae1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:22.038660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5e81921-3d51-4bbe-9ee0-a936dd71ae1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:22.039139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5e81921-3d51-4bbe-9ee0-a936dd71ae1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:22.039589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e5e81921-3d51-4bbe-9ee0-a936dd71ae1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:22.176078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e5e81921-3d51-4bbe-9ee0-a936dd71ae1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:22.185754 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e5e81921-3d51-4bbe-9ee0-a936dd71ae1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.160338 Aug 25 14:13:22.186361 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3385/6836] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:22 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:23.207394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-baab2600-8e10-4803-9499-224afe32592f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:23.208091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-baab2600-8e10-4803-9499-224afe32592f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:23.215861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baab2600-8e10-4803-9499-224afe32592f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:23.216343 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baab2600-8e10-4803-9499-224afe32592f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:23.216782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baab2600-8e10-4803-9499-224afe32592f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:23.217485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baab2600-8e10-4803-9499-224afe32592f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:23.217968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baab2600-8e10-4803-9499-224afe32592f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:23.218394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-baab2600-8e10-4803-9499-224afe32592f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:23.355416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-baab2600-8e10-4803-9499-224afe32592f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:23.363822 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-baab2600-8e10-4803-9499-224afe32592f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.160464 Aug 25 14:13:23.364409 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3452/6837] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:23 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:24.385854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a6805583-9b13-433d-8035-86e7f2066be8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:24.386530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a6805583-9b13-433d-8035-86e7f2066be8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:24.393788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6805583-9b13-433d-8035-86e7f2066be8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:24.394187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6805583-9b13-433d-8035-86e7f2066be8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:24.394649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6805583-9b13-433d-8035-86e7f2066be8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:24.395375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6805583-9b13-433d-8035-86e7f2066be8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:24.395846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6805583-9b13-433d-8035-86e7f2066be8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:24.396284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6805583-9b13-433d-8035-86e7f2066be8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:24.534693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a6805583-9b13-433d-8035-86e7f2066be8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:24.543097 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a6805583-9b13-433d-8035-86e7f2066be8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.161299 Aug 25 14:13:24.543683 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3386/6838] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:24 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:25.564334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6daca60c-5a19-4ddb-bb90-7cec9967b8a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:25.565047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6daca60c-5a19-4ddb-bb90-7cec9967b8a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:25.573129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6daca60c-5a19-4ddb-bb90-7cec9967b8a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:25.573649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6daca60c-5a19-4ddb-bb90-7cec9967b8a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:25.574092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6daca60c-5a19-4ddb-bb90-7cec9967b8a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:25.574795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6daca60c-5a19-4ddb-bb90-7cec9967b8a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:25.575248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6daca60c-5a19-4ddb-bb90-7cec9967b8a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:25.575675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6daca60c-5a19-4ddb-bb90-7cec9967b8a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:25.718198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6daca60c-5a19-4ddb-bb90-7cec9967b8a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:25.726777 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6daca60c-5a19-4ddb-bb90-7cec9967b8a3 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.166348 Aug 25 14:13:25.727928 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3453/6839] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:25 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:26.749349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-19613af6-121a-436b-8024-b11d0f646843 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:26.750004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-19613af6-121a-436b-8024-b11d0f646843 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:26.756961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19613af6-121a-436b-8024-b11d0f646843 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:26.757464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19613af6-121a-436b-8024-b11d0f646843 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:26.757948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19613af6-121a-436b-8024-b11d0f646843 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:26.758796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19613af6-121a-436b-8024-b11d0f646843 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:26.759293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19613af6-121a-436b-8024-b11d0f646843 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:26.759743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-19613af6-121a-436b-8024-b11d0f646843 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:26.894576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-19613af6-121a-436b-8024-b11d0f646843 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:26.903453 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-19613af6-121a-436b-8024-b11d0f646843 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.158005 Aug 25 14:13:26.903979 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3387/6840] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:26 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:27.924322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9e97704d-28f2-48b3-8555-a2558beaf0e0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:27.924863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9e97704d-28f2-48b3-8555-a2558beaf0e0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:27.932130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e97704d-28f2-48b3-8555-a2558beaf0e0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:27.932605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e97704d-28f2-48b3-8555-a2558beaf0e0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:27.933073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e97704d-28f2-48b3-8555-a2558beaf0e0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:27.933844 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e97704d-28f2-48b3-8555-a2558beaf0e0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:27.934309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e97704d-28f2-48b3-8555-a2558beaf0e0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:27.934769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9e97704d-28f2-48b3-8555-a2558beaf0e0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:28.075543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9e97704d-28f2-48b3-8555-a2558beaf0e0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:28.084005 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9e97704d-28f2-48b3-8555-a2558beaf0e0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.163774 Aug 25 14:13:28.084580 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3454/6841] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:27 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:29.105124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eac5a99d-1730-4915-bd9a-d39acfb5101b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:29.105820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eac5a99d-1730-4915-bd9a-d39acfb5101b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:29.112522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eac5a99d-1730-4915-bd9a-d39acfb5101b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:29.113030 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eac5a99d-1730-4915-bd9a-d39acfb5101b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:29.113492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eac5a99d-1730-4915-bd9a-d39acfb5101b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:29.114250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eac5a99d-1730-4915-bd9a-d39acfb5101b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:29.114727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eac5a99d-1730-4915-bd9a-d39acfb5101b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:29.115177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eac5a99d-1730-4915-bd9a-d39acfb5101b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:29.268373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eac5a99d-1730-4915-bd9a-d39acfb5101b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:29.278019 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eac5a99d-1730-4915-bd9a-d39acfb5101b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.177464 Aug 25 14:13:29.278617 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3388/6842] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:29 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:30.300818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0704df72-b26c-455c-8f58-12e65d2bef2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:30.301430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0704df72-b26c-455c-8f58-12e65d2bef2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:30.309267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0704df72-b26c-455c-8f58-12e65d2bef2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:30.309789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0704df72-b26c-455c-8f58-12e65d2bef2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:30.310234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0704df72-b26c-455c-8f58-12e65d2bef2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:30.310942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0704df72-b26c-455c-8f58-12e65d2bef2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:30.311400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0704df72-b26c-455c-8f58-12e65d2bef2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:30.311832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0704df72-b26c-455c-8f58-12e65d2bef2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:30.445457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0704df72-b26c-455c-8f58-12e65d2bef2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:30.454242 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0704df72-b26c-455c-8f58-12e65d2bef2a tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.157376 Aug 25 14:13:30.454848 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3455/6843] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:30 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:13:31.476512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b9745343-560d-4abd-b078-b01633f62f67 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:31.477176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b9745343-560d-4abd-b078-b01633f62f67 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:31.484760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9745343-560d-4abd-b078-b01633f62f67 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:31.485270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9745343-560d-4abd-b078-b01633f62f67 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:31.485771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9745343-560d-4abd-b078-b01633f62f67 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:31.486499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9745343-560d-4abd-b078-b01633f62f67 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:31.486976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9745343-560d-4abd-b078-b01633f62f67 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:31.487427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b9745343-560d-4abd-b078-b01633f62f67 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:31.629066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b9745343-560d-4abd-b078-b01633f62f67 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:31.639089 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b9745343-560d-4abd-b078-b01633f62f67 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.166340 Aug 25 14:13:31.639993 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3389/6844] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:31 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:32.660302 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-abf1d8d1-5144-4736-ac3c-45787539cc0d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:32.660925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-abf1d8d1-5144-4736-ac3c-45787539cc0d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:32.668251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abf1d8d1-5144-4736-ac3c-45787539cc0d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:32.668734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abf1d8d1-5144-4736-ac3c-45787539cc0d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:32.669180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abf1d8d1-5144-4736-ac3c-45787539cc0d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:32.669937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abf1d8d1-5144-4736-ac3c-45787539cc0d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:32.670400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abf1d8d1-5144-4736-ac3c-45787539cc0d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:32.670831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-abf1d8d1-5144-4736-ac3c-45787539cc0d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:32.804834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-abf1d8d1-5144-4736-ac3c-45787539cc0d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:32.814367 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-abf1d8d1-5144-4736-ac3c-45787539cc0d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.157843 Aug 25 14:13:32.814942 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3456/6845] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:32 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:33.836676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-95eb9a01-8d74-4cdc-8603-c775a821ab4d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:33.837388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-95eb9a01-8d74-4cdc-8603-c775a821ab4d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:33.844329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95eb9a01-8d74-4cdc-8603-c775a821ab4d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:33.844837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95eb9a01-8d74-4cdc-8603-c775a821ab4d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:33.845306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95eb9a01-8d74-4cdc-8603-c775a821ab4d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:33.846057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95eb9a01-8d74-4cdc-8603-c775a821ab4d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:33.846538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95eb9a01-8d74-4cdc-8603-c775a821ab4d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:33.846996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-95eb9a01-8d74-4cdc-8603-c775a821ab4d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:33.985909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-95eb9a01-8d74-4cdc-8603-c775a821ab4d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:33.994808 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-95eb9a01-8d74-4cdc-8603-c775a821ab4d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.162207 Aug 25 14:13:33.995396 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3390/6846] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:33 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:13:35.016025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-599c6e61-e2a2-4f55-90b0-4e63b3152b89 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:35.016646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-599c6e61-e2a2-4f55-90b0-4e63b3152b89 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:35.023701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-599c6e61-e2a2-4f55-90b0-4e63b3152b89 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:35.024272 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-599c6e61-e2a2-4f55-90b0-4e63b3152b89 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:35.024730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-599c6e61-e2a2-4f55-90b0-4e63b3152b89 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:35.025444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-599c6e61-e2a2-4f55-90b0-4e63b3152b89 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:35.025933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-599c6e61-e2a2-4f55-90b0-4e63b3152b89 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:35.026374 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-599c6e61-e2a2-4f55-90b0-4e63b3152b89 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:35.165368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-599c6e61-e2a2-4f55-90b0-4e63b3152b89 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:35.173833 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-599c6e61-e2a2-4f55-90b0-4e63b3152b89 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.161679 Aug 25 14:13:35.174422 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3457/6847] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:35 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:36.198931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-81f3805d-1d92-4360-a2f0-2b1f881e0ad4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:36.199624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-81f3805d-1d92-4360-a2f0-2b1f881e0ad4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:36.206563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f3805d-1d92-4360-a2f0-2b1f881e0ad4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:36.207132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f3805d-1d92-4360-a2f0-2b1f881e0ad4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:36.207587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f3805d-1d92-4360-a2f0-2b1f881e0ad4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:36.208309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f3805d-1d92-4360-a2f0-2b1f881e0ad4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:36.208855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f3805d-1d92-4360-a2f0-2b1f881e0ad4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:36.209224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81f3805d-1d92-4360-a2f0-2b1f881e0ad4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:36.344577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81f3805d-1d92-4360-a2f0-2b1f881e0ad4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:36.353756 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-81f3805d-1d92-4360-a2f0-2b1f881e0ad4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.160227 Aug 25 14:13:36.354474 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3391/6848] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:36 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:37.376370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d12837a-4dd9-4757-a66e-37e11fdb4016 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:37.376989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d12837a-4dd9-4757-a66e-37e11fdb4016 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:37.385121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d12837a-4dd9-4757-a66e-37e11fdb4016 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:37.385670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d12837a-4dd9-4757-a66e-37e11fdb4016 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:37.386116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d12837a-4dd9-4757-a66e-37e11fdb4016 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:37.386841 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d12837a-4dd9-4757-a66e-37e11fdb4016 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:37.387303 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d12837a-4dd9-4757-a66e-37e11fdb4016 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:37.387740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d12837a-4dd9-4757-a66e-37e11fdb4016 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:37.524227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d12837a-4dd9-4757-a66e-37e11fdb4016 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:37.532827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d12837a-4dd9-4757-a66e-37e11fdb4016 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.160950 Aug 25 14:13:37.533422 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3458/6849] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:37 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:38.553678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b19670b8-08ca-4280-8afd-c7bc339721b9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:38.554387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b19670b8-08ca-4280-8afd-c7bc339721b9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:38.561971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b19670b8-08ca-4280-8afd-c7bc339721b9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:38.562822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b19670b8-08ca-4280-8afd-c7bc339721b9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:38.562945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b19670b8-08ca-4280-8afd-c7bc339721b9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:38.563690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b19670b8-08ca-4280-8afd-c7bc339721b9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:38.564170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b19670b8-08ca-4280-8afd-c7bc339721b9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:38.564622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b19670b8-08ca-4280-8afd-c7bc339721b9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:38.707524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b19670b8-08ca-4280-8afd-c7bc339721b9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:38.716037 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b19670b8-08ca-4280-8afd-c7bc339721b9 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1729 microversion: 2.1 time: 0.166536 Aug 25 14:13:38.716639 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3392/6850] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:38 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:39.738435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e12ca2c4-f67d-41f2-b41d-79f5ad28be6b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:39.739144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e12ca2c4-f67d-41f2-b41d-79f5ad28be6b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:39.747288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12ca2c4-f67d-41f2-b41d-79f5ad28be6b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:39.747954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12ca2c4-f67d-41f2-b41d-79f5ad28be6b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:39.748387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12ca2c4-f67d-41f2-b41d-79f5ad28be6b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:39.749101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12ca2c4-f67d-41f2-b41d-79f5ad28be6b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:39.749590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12ca2c4-f67d-41f2-b41d-79f5ad28be6b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:39.750090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e12ca2c4-f67d-41f2-b41d-79f5ad28be6b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:39.898201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e12ca2c4-f67d-41f2-b41d-79f5ad28be6b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:39.907818 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e12ca2c4-f67d-41f2-b41d-79f5ad28be6b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1728 microversion: 2.1 time: 0.173427 Aug 25 14:13:39.908332 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3459/6851] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:39 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:40.180836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-5d1a5881-5f16-42fa-b3c0-5c892983df00 req-b2aa2999-0e3c-4c2e-a78f-e00b114eab39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400724ae-c722-47a9-a294-a63c18156ce0", "name": "network-vif-unplugged", "status": "completed", "tag": "eaa95e48-1291-42a1-af8d-c3b02c4d263b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:13:40.193093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5d1a5881-5f16-42fa-b3c0-5c892983df00 req-b2aa2999-0e3c-4c2e-a78f-e00b114eab39 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:40.193794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5d1a5881-5f16-42fa-b3c0-5c892983df00 req-b2aa2999-0e3c-4c2e-a78f-e00b114eab39 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:40.194296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5d1a5881-5f16-42fa-b3c0-5c892983df00 req-b2aa2999-0e3c-4c2e-a78f-e00b114eab39 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:40.208254 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5d1a5881-5f16-42fa-b3c0-5c892983df00 req-b2aa2999-0e3c-4c2e-a78f-e00b114eab39 service nova] Creating event network-vif-unplugged:eaa95e48-1291-42a1-af8d-c3b02c4d263b for instance 400724ae-c722-47a9-a294-a63c18156ce0 on n-h1-852771-8 Aug 25 14:13:40.214413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-5d1a5881-5f16-42fa-b3c0-5c892983df00 req-b2aa2999-0e3c-4c2e-a78f-e00b114eab39 service nova] Instance 400724ae-c722-47a9-a294-a63c18156ce0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:13:40.226880 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-5d1a5881-5f16-42fa-b3c0-5c892983df00 req-b2aa2999-0e3c-4c2e-a78f-e00b114eab39 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050249 Aug 25 14:13:40.228337 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3393/6852] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:13:40.931369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-03f96a7f-66ad-4e43-9074-34dbfeffc030 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:40.932091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-03f96a7f-66ad-4e43-9074-34dbfeffc030 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:40.939213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03f96a7f-66ad-4e43-9074-34dbfeffc030 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:40.939712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03f96a7f-66ad-4e43-9074-34dbfeffc030 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:40.940157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03f96a7f-66ad-4e43-9074-34dbfeffc030 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:40.940877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03f96a7f-66ad-4e43-9074-34dbfeffc030 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:40.941337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03f96a7f-66ad-4e43-9074-34dbfeffc030 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:40.941795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03f96a7f-66ad-4e43-9074-34dbfeffc030 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:41.093918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-03f96a7f-66ad-4e43-9074-34dbfeffc030 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:41.102693 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-03f96a7f-66ad-4e43-9074-34dbfeffc030 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1728 microversion: 2.1 time: 0.175899 Aug 25 14:13:41.103296 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3460/6853] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:40 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:42.124770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f4989e9d-ca42-45db-b965-3850b4d21e60 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:42.125632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f4989e9d-ca42-45db-b965-3850b4d21e60 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:42.133851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4989e9d-ca42-45db-b965-3850b4d21e60 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:42.134892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4989e9d-ca42-45db-b965-3850b4d21e60 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:42.135358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4989e9d-ca42-45db-b965-3850b4d21e60 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:42.136097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4989e9d-ca42-45db-b965-3850b4d21e60 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:42.136571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4989e9d-ca42-45db-b965-3850b4d21e60 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:42.137020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4989e9d-ca42-45db-b965-3850b4d21e60 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:42.260668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5c2dffee-8e20-4f46-abdf-b3fd6ce90c70 req-e89d8436-4df8-480d-bbc9-63278a9828d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400724ae-c722-47a9-a294-a63c18156ce0", "tag": "eaa95e48-1291-42a1-af8d-c3b02c4d263b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:13:42.272774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5c2dffee-8e20-4f46-abdf-b3fd6ce90c70 req-e89d8436-4df8-480d-bbc9-63278a9828d4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:42.273364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5c2dffee-8e20-4f46-abdf-b3fd6ce90c70 req-e89d8436-4df8-480d-bbc9-63278a9828d4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:42.273896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5c2dffee-8e20-4f46-abdf-b3fd6ce90c70 req-e89d8436-4df8-480d-bbc9-63278a9828d4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:42.281171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f4989e9d-ca42-45db-b965-3850b4d21e60 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:42.287142 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5c2dffee-8e20-4f46-abdf-b3fd6ce90c70 req-e89d8436-4df8-480d-bbc9-63278a9828d4 service nova] Creating event network-changed:eaa95e48-1291-42a1-af8d-c3b02c4d263b for instance 400724ae-c722-47a9-a294-a63c18156ce0 on n-h1-852771-8 Aug 25 14:13:42.292324 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f4989e9d-ca42-45db-b965-3850b4d21e60 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.170847 Aug 25 14:13:42.305789 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3394/6854] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:42 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:42.306023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-5c2dffee-8e20-4f46-abdf-b3fd6ce90c70 req-e89d8436-4df8-480d-bbc9-63278a9828d4 service nova] Instance 400724ae-c722-47a9-a294-a63c18156ce0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:13:42.307014 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5c2dffee-8e20-4f46-abdf-b3fd6ce90c70 req-e89d8436-4df8-480d-bbc9-63278a9828d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050030 Aug 25 14:13:42.307831 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3461/6855] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:13:43.315877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e6a458ff-6825-4b14-afad-38a42e4a9887 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:43.316563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e6a458ff-6825-4b14-afad-38a42e4a9887 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:43.333912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6a458ff-6825-4b14-afad-38a42e4a9887 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:43.334839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6a458ff-6825-4b14-afad-38a42e4a9887 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:43.335300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6a458ff-6825-4b14-afad-38a42e4a9887 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:43.336839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6a458ff-6825-4b14-afad-38a42e4a9887 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:43.338345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6a458ff-6825-4b14-afad-38a42e4a9887 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:43.338498 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e6a458ff-6825-4b14-afad-38a42e4a9887 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:43.498617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e6a458ff-6825-4b14-afad-38a42e4a9887 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:43.507985 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e6a458ff-6825-4b14-afad-38a42e4a9887 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.196036 Aug 25 14:13:43.509437 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3395/6856] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:43 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:44.531144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9196da3-53c4-45a5-8e9f-8a3601c1c2e1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:44.531980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c9196da3-53c4-45a5-8e9f-8a3601c1c2e1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:44.535000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=29 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:44.541202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9196da3-53c4-45a5-8e9f-8a3601c1c2e1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:44.541725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9196da3-53c4-45a5-8e9f-8a3601c1c2e1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:44.542268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9196da3-53c4-45a5-8e9f-8a3601c1c2e1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:44.542883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9196da3-53c4-45a5-8e9f-8a3601c1c2e1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:44.543347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9196da3-53c4-45a5-8e9f-8a3601c1c2e1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:44.543778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9196da3-53c4-45a5-8e9f-8a3601c1c2e1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:44.546779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=83 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:44.700432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c9196da3-53c4-45a5-8e9f-8a3601c1c2e1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:44.709437 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9196da3-53c4-45a5-8e9f-8a3601c1c2e1 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.182550 Aug 25 14:13:44.710062 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3462/6857] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:44 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:45.731208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9fec61f1-01d4-4f28-be1c-e269973b4111 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:45.731963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9fec61f1-01d4-4f28-be1c-e269973b4111 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:45.734926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=35 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:45.740566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fec61f1-01d4-4f28-be1c-e269973b4111 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:45.741181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fec61f1-01d4-4f28-be1c-e269973b4111 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:45.741747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fec61f1-01d4-4f28-be1c-e269973b4111 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:45.743178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fec61f1-01d4-4f28-be1c-e269973b4111 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:45.743772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fec61f1-01d4-4f28-be1c-e269973b4111 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:45.744357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9fec61f1-01d4-4f28-be1c-e269973b4111 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:45.747333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:13:45.900864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9fec61f1-01d4-4f28-be1c-e269973b4111 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:45.909482 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9fec61f1-01d4-4f28-be1c-e269973b4111 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.182157 Aug 25 14:13:45.910101 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3396/6858] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:45 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:46.934238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-879f9d15-3db4-4ff7-9308-d2f5cefc73f7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:46.934846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-879f9d15-3db4-4ff7-9308-d2f5cefc73f7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:46.941859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879f9d15-3db4-4ff7-9308-d2f5cefc73f7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:46.942349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879f9d15-3db4-4ff7-9308-d2f5cefc73f7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:46.942788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879f9d15-3db4-4ff7-9308-d2f5cefc73f7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:46.943493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879f9d15-3db4-4ff7-9308-d2f5cefc73f7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:46.943951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879f9d15-3db4-4ff7-9308-d2f5cefc73f7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:46.944376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-879f9d15-3db4-4ff7-9308-d2f5cefc73f7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:47.080458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-879f9d15-3db4-4ff7-9308-d2f5cefc73f7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:47.089913 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-879f9d15-3db4-4ff7-9308-d2f5cefc73f7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.161514 Aug 25 14:13:47.090509 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3463/6859] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:46 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:13:48.111225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d8b9f513-711d-44e2-a7a1-1f452c2c8f7b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:48.111862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d8b9f513-711d-44e2-a7a1-1f452c2c8f7b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:48.119573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8b9f513-711d-44e2-a7a1-1f452c2c8f7b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:48.120074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8b9f513-711d-44e2-a7a1-1f452c2c8f7b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:48.120532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8b9f513-711d-44e2-a7a1-1f452c2c8f7b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:48.121249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8b9f513-711d-44e2-a7a1-1f452c2c8f7b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:48.121754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8b9f513-711d-44e2-a7a1-1f452c2c8f7b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:48.122204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d8b9f513-711d-44e2-a7a1-1f452c2c8f7b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:48.259820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d8b9f513-711d-44e2-a7a1-1f452c2c8f7b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:48.269968 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d8b9f513-711d-44e2-a7a1-1f452c2c8f7b tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.161642 Aug 25 14:13:48.271365 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3397/6860] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:48 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:49.293741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a689c723-5426-4ab2-b834-fb402f1a76d7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:49.294338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a689c723-5426-4ab2-b834-fb402f1a76d7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:49.301548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a689c723-5426-4ab2-b834-fb402f1a76d7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:49.302036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a689c723-5426-4ab2-b834-fb402f1a76d7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:49.302468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a689c723-5426-4ab2-b834-fb402f1a76d7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:49.303162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a689c723-5426-4ab2-b834-fb402f1a76d7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:49.303613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a689c723-5426-4ab2-b834-fb402f1a76d7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:49.304032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a689c723-5426-4ab2-b834-fb402f1a76d7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:49.445416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a689c723-5426-4ab2-b834-fb402f1a76d7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:49.454859 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a689c723-5426-4ab2-b834-fb402f1a76d7 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.165540 Aug 25 14:13:49.455446 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3464/6861] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:49 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:50.476757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d82aa08b-21f8-4986-8ade-83506c8130bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:50.478320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d82aa08b-21f8-4986-8ade-83506c8130bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:50.485080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d82aa08b-21f8-4986-8ade-83506c8130bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:50.485608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d82aa08b-21f8-4986-8ade-83506c8130bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:50.486086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d82aa08b-21f8-4986-8ade-83506c8130bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:50.486806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d82aa08b-21f8-4986-8ade-83506c8130bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:50.487296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d82aa08b-21f8-4986-8ade-83506c8130bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:50.487735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d82aa08b-21f8-4986-8ade-83506c8130bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:50.622814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d82aa08b-21f8-4986-8ade-83506c8130bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:50.631342 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d82aa08b-21f8-4986-8ade-83506c8130bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.158957 Aug 25 14:13:50.631931 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3398/6862] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:50 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:51.653954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a2ac90e9-9ed9-43e5-b301-3119833617f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:51.654583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a2ac90e9-9ed9-43e5-b301-3119833617f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:51.661405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e9-9ed9-43e5-b301-3119833617f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:51.661930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e9-9ed9-43e5-b301-3119833617f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:51.662378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e9-9ed9-43e5-b301-3119833617f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:51.663142 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e9-9ed9-43e5-b301-3119833617f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:51.663556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e9-9ed9-43e5-b301-3119833617f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:51.663989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e9-9ed9-43e5-b301-3119833617f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:51.802352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a2ac90e9-9ed9-43e5-b301-3119833617f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:51.811322 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a2ac90e9-9ed9-43e5-b301-3119833617f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.161413 Aug 25 14:13:51.811901 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3465/6863] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:51 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:52.833784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ad6da131-eea5-4259-a7a4-0eb5d2038325 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:52.834629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ad6da131-eea5-4259-a7a4-0eb5d2038325 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:52.842654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad6da131-eea5-4259-a7a4-0eb5d2038325 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:52.843243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad6da131-eea5-4259-a7a4-0eb5d2038325 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:52.843658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad6da131-eea5-4259-a7a4-0eb5d2038325 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:52.844845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad6da131-eea5-4259-a7a4-0eb5d2038325 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:52.844845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad6da131-eea5-4259-a7a4-0eb5d2038325 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:52.845239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ad6da131-eea5-4259-a7a4-0eb5d2038325 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:52.983169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ad6da131-eea5-4259-a7a4-0eb5d2038325 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:52.991653 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ad6da131-eea5-4259-a7a4-0eb5d2038325 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.161988 Aug 25 14:13:52.992233 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3399/6864] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:52 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:54.013376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cfd287cd-92c6-4199-b2cf-e1b0396e9c84 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:54.013963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cfd287cd-92c6-4199-b2cf-e1b0396e9c84 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:54.020515 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfd287cd-92c6-4199-b2cf-e1b0396e9c84 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:54.021036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfd287cd-92c6-4199-b2cf-e1b0396e9c84 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:54.021477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfd287cd-92c6-4199-b2cf-e1b0396e9c84 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:54.022213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfd287cd-92c6-4199-b2cf-e1b0396e9c84 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:54.022672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfd287cd-92c6-4199-b2cf-e1b0396e9c84 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:54.023107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cfd287cd-92c6-4199-b2cf-e1b0396e9c84 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:54.167720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cfd287cd-92c6-4199-b2cf-e1b0396e9c84 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:54.176377 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cfd287cd-92c6-4199-b2cf-e1b0396e9c84 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1726 microversion: 2.1 time: 0.167306 Aug 25 14:13:54.176981 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3466/6865] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:54 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:55.200884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2a5781da-a727-40ee-bcc6-5d5825e4d7cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:55.202100 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2a5781da-a727-40ee-bcc6-5d5825e4d7cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:55.208831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a5781da-a727-40ee-bcc6-5d5825e4d7cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:55.209336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a5781da-a727-40ee-bcc6-5d5825e4d7cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:55.209934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a5781da-a727-40ee-bcc6-5d5825e4d7cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:55.210659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a5781da-a727-40ee-bcc6-5d5825e4d7cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:55.211815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a5781da-a727-40ee-bcc6-5d5825e4d7cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:55.212274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2a5781da-a727-40ee-bcc6-5d5825e4d7cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:55.364096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2a5781da-a727-40ee-bcc6-5d5825e4d7cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:55.373323 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2a5781da-a727-40ee-bcc6-5d5825e4d7cd tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1723 microversion: 2.1 time: 0.178022 Aug 25 14:13:55.373987 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3400/6866] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:55 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:55.396534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:13:55.397335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:55.405038 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:55.405850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:55.406294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:55.407028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:55.407482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:55.407912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:55.449442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:55.450090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:55.450533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:55.451269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:55.451728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:55.452154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:55.474277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:13:55.480534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Getting quotas for user dccab2ef88f44ffc84b30c57c7a86194 and project f5e6d0770e8e4c89beba9e72a8ca0ac3. Resources: {'cores', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:13:55.594292 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fd217308-a4e1-43e3-a827-7f5cb669da94 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "POST /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/action" status: 202 len: 0 microversion: 2.1 time: 0.202020 Aug 25 14:13:55.598427 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3467/6867] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:13:55 2022] POST /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:13:55.603940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3d66cde0-84f3-40c5-9860-80c5674ab027 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:55.604760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3d66cde0-84f3-40c5-9860-80c5674ab027 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:55.612550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d66cde0-84f3-40c5-9860-80c5674ab027 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:55.613080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d66cde0-84f3-40c5-9860-80c5674ab027 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:55.613967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d66cde0-84f3-40c5-9860-80c5674ab027 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:55.615184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d66cde0-84f3-40c5-9860-80c5674ab027 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:55.616007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d66cde0-84f3-40c5-9860-80c5674ab027 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:55.616573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d66cde0-84f3-40c5-9860-80c5674ab027 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:55.777031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3d66cde0-84f3-40c5-9860-80c5674ab027 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:55.785828 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3d66cde0-84f3-40c5-9860-80c5674ab027 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.185941 Aug 25 14:13:55.786423 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3401/6868] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:55 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:56.810318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-417dfdd6-3655-4c49-988e-d276459b532e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:56.811223 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-417dfdd6-3655-4c49-988e-d276459b532e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:56.820193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417dfdd6-3655-4c49-988e-d276459b532e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:56.821382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417dfdd6-3655-4c49-988e-d276459b532e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:56.822118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417dfdd6-3655-4c49-988e-d276459b532e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:56.822846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417dfdd6-3655-4c49-988e-d276459b532e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:56.823299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417dfdd6-3655-4c49-988e-d276459b532e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:56.823726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-417dfdd6-3655-4c49-988e-d276459b532e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:56.971895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-417dfdd6-3655-4c49-988e-d276459b532e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:56.980760 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-417dfdd6-3655-4c49-988e-d276459b532e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.176837 Aug 25 14:13:56.981619 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3468/6869] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:56 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:13:57.077946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a3fae91f-2eba-415e-b52a-8a0a73948083 req-7b569155-7cd6-41f3-bfb3-76fb0bb554fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400724ae-c722-47a9-a294-a63c18156ce0", "name": "network-vif-plugged", "status": "completed", "tag": "eaa95e48-1291-42a1-af8d-c3b02c4d263b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:13:57.089239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a3fae91f-2eba-415e-b52a-8a0a73948083 req-7b569155-7cd6-41f3-bfb3-76fb0bb554fe service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:57.089741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a3fae91f-2eba-415e-b52a-8a0a73948083 req-7b569155-7cd6-41f3-bfb3-76fb0bb554fe service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:57.090348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a3fae91f-2eba-415e-b52a-8a0a73948083 req-7b569155-7cd6-41f3-bfb3-76fb0bb554fe service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:57.103190 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a3fae91f-2eba-415e-b52a-8a0a73948083 req-7b569155-7cd6-41f3-bfb3-76fb0bb554fe service nova] Creating event network-vif-plugged:eaa95e48-1291-42a1-af8d-c3b02c4d263b for instance 400724ae-c722-47a9-a294-a63c18156ce0 on n-h1-852771-8 Aug 25 14:13:57.109141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-a3fae91f-2eba-415e-b52a-8a0a73948083 req-7b569155-7cd6-41f3-bfb3-76fb0bb554fe service nova] Instance 400724ae-c722-47a9-a294-a63c18156ce0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:13:57.120907 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a3fae91f-2eba-415e-b52a-8a0a73948083 req-7b569155-7cd6-41f3-bfb3-76fb0bb554fe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046816 Aug 25 14:13:57.121628 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3402/6870] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:13:58.003114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-555a6e76-8ec9-4f8c-9c0d-f80fc13d7d3d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:58.003750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-555a6e76-8ec9-4f8c-9c0d-f80fc13d7d3d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:58.011403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-555a6e76-8ec9-4f8c-9c0d-f80fc13d7d3d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:58.011896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-555a6e76-8ec9-4f8c-9c0d-f80fc13d7d3d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:58.012340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-555a6e76-8ec9-4f8c-9c0d-f80fc13d7d3d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:58.013048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-555a6e76-8ec9-4f8c-9c0d-f80fc13d7d3d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:58.013582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-555a6e76-8ec9-4f8c-9c0d-f80fc13d7d3d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:58.013985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-555a6e76-8ec9-4f8c-9c0d-f80fc13d7d3d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:58.149747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-555a6e76-8ec9-4f8c-9c0d-f80fc13d7d3d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:58.158679 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-555a6e76-8ec9-4f8c-9c0d-f80fc13d7d3d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.159494 Aug 25 14:13:58.159261 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3469/6871] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:57 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:13:59.183563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a68ef90f-e6cf-4ff5-a583-e9ead31227c0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:13:59.184298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a68ef90f-e6cf-4ff5-a583-e9ead31227c0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:13:59.191456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a68ef90f-e6cf-4ff5-a583-e9ead31227c0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:59.191932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a68ef90f-e6cf-4ff5-a583-e9ead31227c0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:59.192355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a68ef90f-e6cf-4ff5-a583-e9ead31227c0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:59.193231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a68ef90f-e6cf-4ff5-a583-e9ead31227c0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:13:59.193746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a68ef90f-e6cf-4ff5-a583-e9ead31227c0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:13:59.194201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a68ef90f-e6cf-4ff5-a583-e9ead31227c0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:13:59.352963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a68ef90f-e6cf-4ff5-a583-e9ead31227c0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:13:59.363394 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a68ef90f-e6cf-4ff5-a583-e9ead31227c0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.186080 Aug 25 14:13:59.364011 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3403/6872] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:13:59 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:00.386836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e7b58a2b-1323-4ea3-9327-17be638ffb04 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:00.387438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e7b58a2b-1323-4ea3-9327-17be638ffb04 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:00.394334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b58a2b-1323-4ea3-9327-17be638ffb04 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:00.394812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b58a2b-1323-4ea3-9327-17be638ffb04 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:00.395247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b58a2b-1323-4ea3-9327-17be638ffb04 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:00.395946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b58a2b-1323-4ea3-9327-17be638ffb04 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:00.396406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b58a2b-1323-4ea3-9327-17be638ffb04 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:00.397387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7b58a2b-1323-4ea3-9327-17be638ffb04 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:00.547983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e7b58a2b-1323-4ea3-9327-17be638ffb04 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:00.560211 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e7b58a2b-1323-4ea3-9327-17be638ffb04 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.177462 Aug 25 14:14:00.560840 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3470/6873] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:00 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:01.373677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f11faf2f-5677-4e5a-85a2-77613a89d304 req-7c791198-db75-42ca-b0ec-767ab2213a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400724ae-c722-47a9-a294-a63c18156ce0", "name": "network-vif-unplugged", "status": "completed", "tag": "eaa95e48-1291-42a1-af8d-c3b02c4d263b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:14:01.386192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f11faf2f-5677-4e5a-85a2-77613a89d304 req-7c791198-db75-42ca-b0ec-767ab2213a12 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:01.386696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f11faf2f-5677-4e5a-85a2-77613a89d304 req-7c791198-db75-42ca-b0ec-767ab2213a12 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:01.387154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f11faf2f-5677-4e5a-85a2-77613a89d304 req-7c791198-db75-42ca-b0ec-767ab2213a12 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:01.401726 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f11faf2f-5677-4e5a-85a2-77613a89d304 req-7c791198-db75-42ca-b0ec-767ab2213a12 service nova] Creating event network-vif-unplugged:eaa95e48-1291-42a1-af8d-c3b02c4d263b for instance 400724ae-c722-47a9-a294-a63c18156ce0 on n-h2-852771-8 Aug 25 14:14:01.408613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-f11faf2f-5677-4e5a-85a2-77613a89d304 req-7c791198-db75-42ca-b0ec-767ab2213a12 service nova] Instance 400724ae-c722-47a9-a294-a63c18156ce0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:14:01.420998 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f11faf2f-5677-4e5a-85a2-77613a89d304 req-7c791198-db75-42ca-b0ec-767ab2213a12 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051037 Aug 25 14:14:01.421800 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3404/6874] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:14:01.583262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6c6cc394-90d1-4eb8-ab9c-aa84790d4348 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:01.583942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6c6cc394-90d1-4eb8-ab9c-aa84790d4348 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:01.591899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c6cc394-90d1-4eb8-ab9c-aa84790d4348 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:01.592521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c6cc394-90d1-4eb8-ab9c-aa84790d4348 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:01.593169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c6cc394-90d1-4eb8-ab9c-aa84790d4348 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:01.593925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c6cc394-90d1-4eb8-ab9c-aa84790d4348 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:01.594376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c6cc394-90d1-4eb8-ab9c-aa84790d4348 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:01.594994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c6cc394-90d1-4eb8-ab9c-aa84790d4348 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:01.740436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6c6cc394-90d1-4eb8-ab9c-aa84790d4348 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:01.750819 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6c6cc394-90d1-4eb8-ab9c-aa84790d4348 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.171663 Aug 25 14:14:01.751553 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3471/6875] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:01 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:02.775237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d2f754c-8467-4cc2-8f30-cbca1698ebc8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:02.775968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d2f754c-8467-4cc2-8f30-cbca1698ebc8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:02.782707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2f754c-8467-4cc2-8f30-cbca1698ebc8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:02.783220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2f754c-8467-4cc2-8f30-cbca1698ebc8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:02.783693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2f754c-8467-4cc2-8f30-cbca1698ebc8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:02.784430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2f754c-8467-4cc2-8f30-cbca1698ebc8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:02.784912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2f754c-8467-4cc2-8f30-cbca1698ebc8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:02.785366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2f754c-8467-4cc2-8f30-cbca1698ebc8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:02.946666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6d2f754c-8467-4cc2-8f30-cbca1698ebc8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:02.957768 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d2f754c-8467-4cc2-8f30-cbca1698ebc8 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.187944 Aug 25 14:14:02.958384 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3405/6876] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:02 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:03.438724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-c1d9ff9d-340e-4e8c-86ab-1e3e37bc9756 req-67d23cd5-e244-4e4c-8f9a-52fdcadf6165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400724ae-c722-47a9-a294-a63c18156ce0", "tag": "eaa95e48-1291-42a1-af8d-c3b02c4d263b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:14:03.451526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c1d9ff9d-340e-4e8c-86ab-1e3e37bc9756 req-67d23cd5-e244-4e4c-8f9a-52fdcadf6165 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:03.452548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c1d9ff9d-340e-4e8c-86ab-1e3e37bc9756 req-67d23cd5-e244-4e4c-8f9a-52fdcadf6165 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:03.452548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-c1d9ff9d-340e-4e8c-86ab-1e3e37bc9756 req-67d23cd5-e244-4e4c-8f9a-52fdcadf6165 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:03.473973 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-c1d9ff9d-340e-4e8c-86ab-1e3e37bc9756 req-67d23cd5-e244-4e4c-8f9a-52fdcadf6165 service nova] Creating event network-changed:eaa95e48-1291-42a1-af8d-c3b02c4d263b for instance 400724ae-c722-47a9-a294-a63c18156ce0 on n-h2-852771-8 Aug 25 14:14:03.482627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-c1d9ff9d-340e-4e8c-86ab-1e3e37bc9756 req-67d23cd5-e244-4e4c-8f9a-52fdcadf6165 service nova] Instance 400724ae-c722-47a9-a294-a63c18156ce0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:14:03.496152 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-c1d9ff9d-340e-4e8c-86ab-1e3e37bc9756 req-67d23cd5-e244-4e4c-8f9a-52fdcadf6165 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061159 Aug 25 14:14:03.497293 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3472/6877] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:14:03.985704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5f004436-5a5b-4446-a324-91a65d538820 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:03.987057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5f004436-5a5b-4446-a324-91a65d538820 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:04.002126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f004436-5a5b-4446-a324-91a65d538820 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:04.003147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f004436-5a5b-4446-a324-91a65d538820 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:04.004335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f004436-5a5b-4446-a324-91a65d538820 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:04.005849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f004436-5a5b-4446-a324-91a65d538820 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:04.006826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f004436-5a5b-4446-a324-91a65d538820 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:04.008567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5f004436-5a5b-4446-a324-91a65d538820 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:04.176230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5f004436-5a5b-4446-a324-91a65d538820 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:04.187742 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5f004436-5a5b-4446-a324-91a65d538820 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.210977 Aug 25 14:14:04.201619 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3406/6878] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:03 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:05.214743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2086462-ba26-4b4a-862d-7f47a16dbb1e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:05.215499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b2086462-ba26-4b4a-862d-7f47a16dbb1e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:05.222243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2086462-ba26-4b4a-862d-7f47a16dbb1e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:05.222744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2086462-ba26-4b4a-862d-7f47a16dbb1e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:05.223191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2086462-ba26-4b4a-862d-7f47a16dbb1e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:05.223908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2086462-ba26-4b4a-862d-7f47a16dbb1e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:05.224376 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2086462-ba26-4b4a-862d-7f47a16dbb1e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:05.224813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2086462-ba26-4b4a-862d-7f47a16dbb1e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:05.390226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b2086462-ba26-4b4a-862d-7f47a16dbb1e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:05.408082 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2086462-ba26-4b4a-862d-7f47a16dbb1e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.198884 Aug 25 14:14:05.409162 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3473/6879] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:05 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:06.433933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-05ea5d1c-a167-469a-afd1-c869949afedf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:06.434699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-05ea5d1c-a167-469a-afd1-c869949afedf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:06.442603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ea5d1c-a167-469a-afd1-c869949afedf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:06.443159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ea5d1c-a167-469a-afd1-c869949afedf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:06.443572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ea5d1c-a167-469a-afd1-c869949afedf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:06.444350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ea5d1c-a167-469a-afd1-c869949afedf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:06.444787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ea5d1c-a167-469a-afd1-c869949afedf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:06.445881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05ea5d1c-a167-469a-afd1-c869949afedf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:06.592291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-05ea5d1c-a167-469a-afd1-c869949afedf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:06.601440 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-05ea5d1c-a167-469a-afd1-c869949afedf tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.172563 Aug 25 14:14:06.602131 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3407/6880] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:06 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:07.623526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-28fc975a-6954-4cd9-8681-8819c17650bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:07.624083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-28fc975a-6954-4cd9-8681-8819c17650bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:07.626078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:07.632511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fc975a-6954-4cd9-8681-8819c17650bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:07.633911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fc975a-6954-4cd9-8681-8819c17650bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:07.634595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fc975a-6954-4cd9-8681-8819c17650bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:07.635316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fc975a-6954-4cd9-8681-8819c17650bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:07.635792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fc975a-6954-4cd9-8681-8819c17650bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:07.636218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-28fc975a-6954-4cd9-8681-8819c17650bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:07.776442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-28fc975a-6954-4cd9-8681-8819c17650bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:07.784983 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-28fc975a-6954-4cd9-8681-8819c17650bb tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.165413 Aug 25 14:14:07.785489 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3474/6881] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:07 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:08.808132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-23cd6a10-0675-4c4d-a093-ff3ada572847 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:08.808778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-23cd6a10-0675-4c4d-a093-ff3ada572847 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:08.816154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cd6a10-0675-4c4d-a093-ff3ada572847 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:08.816767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cd6a10-0675-4c4d-a093-ff3ada572847 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:08.817132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cd6a10-0675-4c4d-a093-ff3ada572847 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:08.817896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cd6a10-0675-4c4d-a093-ff3ada572847 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:08.818375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cd6a10-0675-4c4d-a093-ff3ada572847 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:08.818825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-23cd6a10-0675-4c4d-a093-ff3ada572847 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:08.968889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-23cd6a10-0675-4c4d-a093-ff3ada572847 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:08.978538 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-23cd6a10-0675-4c4d-a093-ff3ada572847 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.174998 Aug 25 14:14:08.979137 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3408/6882] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:08 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:10.000511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66645b98-bfba-40eb-a68f-b15ac9e1c96e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:10.001130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66645b98-bfba-40eb-a68f-b15ac9e1c96e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:10.008842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66645b98-bfba-40eb-a68f-b15ac9e1c96e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:10.009529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66645b98-bfba-40eb-a68f-b15ac9e1c96e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:10.009985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66645b98-bfba-40eb-a68f-b15ac9e1c96e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:10.010697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66645b98-bfba-40eb-a68f-b15ac9e1c96e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:10.011164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66645b98-bfba-40eb-a68f-b15ac9e1c96e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:10.011598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66645b98-bfba-40eb-a68f-b15ac9e1c96e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:10.150309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-66645b98-bfba-40eb-a68f-b15ac9e1c96e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:10.158984 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66645b98-bfba-40eb-a68f-b15ac9e1c96e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.162374 Aug 25 14:14:10.159587 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3475/6883] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:09 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:11.181377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-282c7585-c96f-43d1-9784-111b60ca9fc4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:11.182092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-282c7585-c96f-43d1-9784-111b60ca9fc4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:11.189221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-282c7585-c96f-43d1-9784-111b60ca9fc4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:11.189770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-282c7585-c96f-43d1-9784-111b60ca9fc4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:11.190239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-282c7585-c96f-43d1-9784-111b60ca9fc4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:11.190974 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-282c7585-c96f-43d1-9784-111b60ca9fc4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:11.191453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-282c7585-c96f-43d1-9784-111b60ca9fc4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:11.191905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-282c7585-c96f-43d1-9784-111b60ca9fc4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:11.345430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-282c7585-c96f-43d1-9784-111b60ca9fc4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:11.354406 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-282c7585-c96f-43d1-9784-111b60ca9fc4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.177119 Aug 25 14:14:11.355004 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3409/6884] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:11 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:12.376325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fb245da0-1cf4-44af-bced-63a1e88e1052 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:12.376940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fb245da0-1cf4-44af-bced-63a1e88e1052 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:12.384612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb245da0-1cf4-44af-bced-63a1e88e1052 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:12.384806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb245da0-1cf4-44af-bced-63a1e88e1052 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:12.385181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb245da0-1cf4-44af-bced-63a1e88e1052 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:12.385923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb245da0-1cf4-44af-bced-63a1e88e1052 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:12.386371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb245da0-1cf4-44af-bced-63a1e88e1052 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:12.386796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb245da0-1cf4-44af-bced-63a1e88e1052 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:12.392001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:12.535671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fb245da0-1cf4-44af-bced-63a1e88e1052 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:12.544404 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fb245da0-1cf4-44af-bced-63a1e88e1052 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.171875 Aug 25 14:14:12.545009 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3476/6885] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:12 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:13.566295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59fa8e80-ea40-4117-95f7-d96d2323c699 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:13.566958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59fa8e80-ea40-4117-95f7-d96d2323c699 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:13.575185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fa8e80-ea40-4117-95f7-d96d2323c699 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:13.575709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fa8e80-ea40-4117-95f7-d96d2323c699 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:13.576175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fa8e80-ea40-4117-95f7-d96d2323c699 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:13.576915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fa8e80-ea40-4117-95f7-d96d2323c699 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:13.577394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fa8e80-ea40-4117-95f7-d96d2323c699 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:13.577878 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59fa8e80-ea40-4117-95f7-d96d2323c699 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:13.724556 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-59fa8e80-ea40-4117-95f7-d96d2323c699 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:13.734084 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59fa8e80-ea40-4117-95f7-d96d2323c699 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.171798 Aug 25 14:14:13.734685 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3410/6886] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:13 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:14.756214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-354d762e-8c53-4725-badc-e933d9054a19 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:14.756927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-354d762e-8c53-4725-badc-e933d9054a19 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:14.760222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:14.766506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-354d762e-8c53-4725-badc-e933d9054a19 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:14.767035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-354d762e-8c53-4725-badc-e933d9054a19 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:14.767475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-354d762e-8c53-4725-badc-e933d9054a19 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:14.768184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-354d762e-8c53-4725-badc-e933d9054a19 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:14.768639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-354d762e-8c53-4725-badc-e933d9054a19 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:14.769180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-354d762e-8c53-4725-badc-e933d9054a19 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:14.926982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-354d762e-8c53-4725-badc-e933d9054a19 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:14.938258 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-354d762e-8c53-4725-badc-e933d9054a19 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.186110 Aug 25 14:14:14.938874 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3477/6887] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:14 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:15.960408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4c5d493-4dd6-4651-a0b5-b9cb8fb9d77e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:15.961051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4c5d493-4dd6-4651-a0b5-b9cb8fb9d77e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:15.964366 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=30 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:15.969923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c5d493-4dd6-4651-a0b5-b9cb8fb9d77e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:15.970437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c5d493-4dd6-4651-a0b5-b9cb8fb9d77e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:15.970900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c5d493-4dd6-4651-a0b5-b9cb8fb9d77e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:15.971632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c5d493-4dd6-4651-a0b5-b9cb8fb9d77e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:15.972109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c5d493-4dd6-4651-a0b5-b9cb8fb9d77e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:15.972563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4c5d493-4dd6-4651-a0b5-b9cb8fb9d77e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:15.975924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=86 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:16.143324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d4c5d493-4dd6-4651-a0b5-b9cb8fb9d77e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:16.155185 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4c5d493-4dd6-4651-a0b5-b9cb8fb9d77e tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1722 microversion: 2.1 time: 0.198266 Aug 25 14:14:16.155912 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3411/6888] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:15 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:17.178106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3afdfd83-ff62-4413-b1bd-930436b3f0cc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:17.178718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3afdfd83-ff62-4413-b1bd-930436b3f0cc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:17.186639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afdfd83-ff62-4413-b1bd-930436b3f0cc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:17.187126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afdfd83-ff62-4413-b1bd-930436b3f0cc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:17.187563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afdfd83-ff62-4413-b1bd-930436b3f0cc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:17.188283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afdfd83-ff62-4413-b1bd-930436b3f0cc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:17.188740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afdfd83-ff62-4413-b1bd-930436b3f0cc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:17.189170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3afdfd83-ff62-4413-b1bd-930436b3f0cc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:17.352909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3afdfd83-ff62-4413-b1bd-930436b3f0cc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:17.361845 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3afdfd83-ff62-4413-b1bd-930436b3f0cc tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1715 microversion: 2.1 time: 0.187527 Aug 25 14:14:17.362446 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3478/6889] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:17 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1715 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:17.382869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d517a4cd-6cdd-464a-bf64-bd839280f7f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:17.383512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d517a4cd-6cdd-464a-bf64-bd839280f7f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:17.391134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d517a4cd-6cdd-464a-bf64-bd839280f7f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:17.391642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d517a4cd-6cdd-464a-bf64-bd839280f7f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:17.392099 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d517a4cd-6cdd-464a-bf64-bd839280f7f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:17.392823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d517a4cd-6cdd-464a-bf64-bd839280f7f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:17.393296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d517a4cd-6cdd-464a-bf64-bd839280f7f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:17.393935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d517a4cd-6cdd-464a-bf64-bd839280f7f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:17.533446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d517a4cd-6cdd-464a-bf64-bd839280f7f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:17.542685 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d517a4cd-6cdd-464a-bf64-bd839280f7f5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1715 microversion: 2.1 time: 0.163609 Aug 25 14:14:17.543290 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3412/6890] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:17 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:17.565289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ba05ddc3-24d8-4d99-92de-aa5782a5cd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:17.565938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ba05ddc3-24d8-4d99-92de-aa5782a5cd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:17.574001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba05ddc3-24d8-4d99-92de-aa5782a5cd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:17.574581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba05ddc3-24d8-4d99-92de-aa5782a5cd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:17.574831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba05ddc3-24d8-4d99-92de-aa5782a5cd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:17.575553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba05ddc3-24d8-4d99-92de-aa5782a5cd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:17.576010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba05ddc3-24d8-4d99-92de-aa5782a5cd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:17.576436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba05ddc3-24d8-4d99-92de-aa5782a5cd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:17.744869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ba05ddc3-24d8-4d99-92de-aa5782a5cd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:17.753475 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ba05ddc3-24d8-4d99-92de-aa5782a5cd3c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1715 microversion: 2.1 time: 0.192322 Aug 25 14:14:17.754100 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3479/6891] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:17 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1715 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:17.774480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-744f5dc5-f28a-45f5-9456-a6dabd129bd4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:17.774994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-744f5dc5-f28a-45f5-9456-a6dabd129bd4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:17.781113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-744f5dc5-f28a-45f5-9456-a6dabd129bd4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:17.781669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-744f5dc5-f28a-45f5-9456-a6dabd129bd4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:17.782126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-744f5dc5-f28a-45f5-9456-a6dabd129bd4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:17.782839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-744f5dc5-f28a-45f5-9456-a6dabd129bd4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:17.783309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-744f5dc5-f28a-45f5-9456-a6dabd129bd4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:17.783751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-744f5dc5-f28a-45f5-9456-a6dabd129bd4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:17.810875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-744f5dc5-f28a-45f5-9456-a6dabd129bd4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:14:17.893887 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-744f5dc5-f28a-45f5-9456-a6dabd129bd4 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 204 len: 0 microversion: 2.1 time: 0.122842 Aug 25 14:14:17.894681 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3413/6892] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:14:17 2022] DELETE /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:14:17.904698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a016b93-c89b-4c9e-85d4-abc04a74972f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:17.905490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a016b93-c89b-4c9e-85d4-abc04a74972f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:17.911861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a016b93-c89b-4c9e-85d4-abc04a74972f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:17.912351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a016b93-c89b-4c9e-85d4-abc04a74972f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:17.912790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a016b93-c89b-4c9e-85d4-abc04a74972f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:17.913495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a016b93-c89b-4c9e-85d4-abc04a74972f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:17.913985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a016b93-c89b-4c9e-85d4-abc04a74972f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:17.914421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a016b93-c89b-4c9e-85d4-abc04a74972f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:18.049239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a016b93-c89b-4c9e-85d4-abc04a74972f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:18.058758 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a016b93-c89b-4c9e-85d4-abc04a74972f tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1721 microversion: 2.1 time: 0.159107 Aug 25 14:14:18.059371 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3480/6893] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:17 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:18.367526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-d02e31a8-a8c1-4048-8d82-ea57fc84c6dd req-626b8c79-7adb-46bd-9dd0-31c235a2edfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400724ae-c722-47a9-a294-a63c18156ce0", "name": "network-vif-plugged", "status": "completed", "tag": "eaa95e48-1291-42a1-af8d-c3b02c4d263b"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:14:18.378913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d02e31a8-a8c1-4048-8d82-ea57fc84c6dd req-626b8c79-7adb-46bd-9dd0-31c235a2edfc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:18.379838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d02e31a8-a8c1-4048-8d82-ea57fc84c6dd req-626b8c79-7adb-46bd-9dd0-31c235a2edfc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:18.380360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-d02e31a8-a8c1-4048-8d82-ea57fc84c6dd req-626b8c79-7adb-46bd-9dd0-31c235a2edfc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:18.395351 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-d02e31a8-a8c1-4048-8d82-ea57fc84c6dd req-626b8c79-7adb-46bd-9dd0-31c235a2edfc service nova] Creating event network-vif-plugged:eaa95e48-1291-42a1-af8d-c3b02c4d263b for instance 400724ae-c722-47a9-a294-a63c18156ce0 on n-h2-852771-8 Aug 25 14:14:18.401029 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-d02e31a8-a8c1-4048-8d82-ea57fc84c6dd req-626b8c79-7adb-46bd-9dd0-31c235a2edfc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037665 Aug 25 14:14:18.401692 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3414/6894] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:14:19.082084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8fb620ef-1319-4740-ba04-0aa69ac70c1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:19.082710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8fb620ef-1319-4740-ba04-0aa69ac70c1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:19.090001 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fb620ef-1319-4740-ba04-0aa69ac70c1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:19.090523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fb620ef-1319-4740-ba04-0aa69ac70c1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:19.090934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fb620ef-1319-4740-ba04-0aa69ac70c1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:19.091672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fb620ef-1319-4740-ba04-0aa69ac70c1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:19.092131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fb620ef-1319-4740-ba04-0aa69ac70c1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:19.092559 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8fb620ef-1319-4740-ba04-0aa69ac70c1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:19.274894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8fb620ef-1319-4740-ba04-0aa69ac70c1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:19.285420 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8fb620ef-1319-4740-ba04-0aa69ac70c1c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1721 microversion: 2.1 time: 0.207221 Aug 25 14:14:19.286237 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3481/6895] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:19 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:20.309014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf07af0b-c3ca-4020-949d-4bbe4619f638 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:20.310492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cf07af0b-c3ca-4020-949d-4bbe4619f638 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:20.321773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf07af0b-c3ca-4020-949d-4bbe4619f638 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:20.322867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf07af0b-c3ca-4020-949d-4bbe4619f638 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:20.323560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf07af0b-c3ca-4020-949d-4bbe4619f638 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:20.325645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf07af0b-c3ca-4020-949d-4bbe4619f638 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:20.326412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf07af0b-c3ca-4020-949d-4bbe4619f638 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:20.327104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf07af0b-c3ca-4020-949d-4bbe4619f638 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:20.514464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cf07af0b-c3ca-4020-949d-4bbe4619f638 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:20.523736 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cf07af0b-c3ca-4020-949d-4bbe4619f638 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1721 microversion: 2.1 time: 0.220044 Aug 25 14:14:20.524357 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3415/6896] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:20 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:21.046045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-cdcc7bca-357b-44bc-ae8b-7ec1e735982b req-10b4eae8-43cf-4dd9-922e-951e2af09d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400724ae-c722-47a9-a294-a63c18156ce0", "name": "network-vif-deleted", "tag": "eaa95e48-1291-42a1-af8d-c3b02c4d263b"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:14:21.060922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cdcc7bca-357b-44bc-ae8b-7ec1e735982b req-10b4eae8-43cf-4dd9-922e-951e2af09d9c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:21.061563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cdcc7bca-357b-44bc-ae8b-7ec1e735982b req-10b4eae8-43cf-4dd9-922e-951e2af09d9c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:21.062125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-cdcc7bca-357b-44bc-ae8b-7ec1e735982b req-10b4eae8-43cf-4dd9-922e-951e2af09d9c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:21.083623 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-cdcc7bca-357b-44bc-ae8b-7ec1e735982b req-10b4eae8-43cf-4dd9-922e-951e2af09d9c service nova] Creating event network-vif-deleted:eaa95e48-1291-42a1-af8d-c3b02c4d263b for instance 400724ae-c722-47a9-a294-a63c18156ce0 on n-h2-852771-8 Aug 25 14:14:21.090580 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-cdcc7bca-357b-44bc-ae8b-7ec1e735982b req-10b4eae8-43cf-4dd9-922e-951e2af09d9c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175284 Aug 25 14:14:21.091665 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3482/6897] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:14:21.547486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-00945657-6faa-4a5a-91f5-ca83bfd320a5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:21.548333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-00945657-6faa-4a5a-91f5-ca83bfd320a5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:21.556349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00945657-6faa-4a5a-91f5-ca83bfd320a5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:21.557106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00945657-6faa-4a5a-91f5-ca83bfd320a5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:21.557598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00945657-6faa-4a5a-91f5-ca83bfd320a5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:21.558637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00945657-6faa-4a5a-91f5-ca83bfd320a5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:21.559168 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00945657-6faa-4a5a-91f5-ca83bfd320a5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:21.559624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-00945657-6faa-4a5a-91f5-ca83bfd320a5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:21.643033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-00945657-6faa-4a5a-91f5-ca83bfd320a5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:21.664670 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-00945657-6faa-4a5a-91f5-ca83bfd320a5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1370 microversion: 2.1 time: 0.122066 Aug 25 14:14:21.673328 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3416/6898] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:21 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1370 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:22.688587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8a421c7a-77e3-4321-9eaa-50f917cd8e65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:22.689454 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8a421c7a-77e3-4321-9eaa-50f917cd8e65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:22.696693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a421c7a-77e3-4321-9eaa-50f917cd8e65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:22.697476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a421c7a-77e3-4321-9eaa-50f917cd8e65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:22.697959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a421c7a-77e3-4321-9eaa-50f917cd8e65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:22.698696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a421c7a-77e3-4321-9eaa-50f917cd8e65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:22.699379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a421c7a-77e3-4321-9eaa-50f917cd8e65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:22.699819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8a421c7a-77e3-4321-9eaa-50f917cd8e65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:22.787105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8a421c7a-77e3-4321-9eaa-50f917cd8e65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:22.802609 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8a421c7a-77e3-4321-9eaa-50f917cd8e65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1370 microversion: 2.1 time: 0.118462 Aug 25 14:14:22.803891 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3483/6899] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:22 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1370 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:23.900674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-528f3b32-c700-49ed-a10b-52bc8456469d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:23.901309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-528f3b32-c700-49ed-a10b-52bc8456469d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:23.910426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-528f3b32-c700-49ed-a10b-52bc8456469d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:23.911012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-528f3b32-c700-49ed-a10b-52bc8456469d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:23.911531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-528f3b32-c700-49ed-a10b-52bc8456469d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:23.912272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-528f3b32-c700-49ed-a10b-52bc8456469d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:23.912806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-528f3b32-c700-49ed-a10b-52bc8456469d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:23.913447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-528f3b32-c700-49ed-a10b-52bc8456469d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:23.993711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-528f3b32-c700-49ed-a10b-52bc8456469d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:24.004032 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-528f3b32-c700-49ed-a10b-52bc8456469d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1370 microversion: 2.1 time: 0.107368 Aug 25 14:14:24.004637 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3417/6900] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:23 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1370 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:14:25.025860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e6c6bd2a-71b3-4f78-a1bc-be98ca605de2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:25.026719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e6c6bd2a-71b3-4f78-a1bc-be98ca605de2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:25.035069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6c6bd2a-71b3-4f78-a1bc-be98ca605de2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:25.035562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6c6bd2a-71b3-4f78-a1bc-be98ca605de2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:25.036007 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6c6bd2a-71b3-4f78-a1bc-be98ca605de2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:25.036725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6c6bd2a-71b3-4f78-a1bc-be98ca605de2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:25.037186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6c6bd2a-71b3-4f78-a1bc-be98ca605de2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:25.037644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e6c6bd2a-71b3-4f78-a1bc-be98ca605de2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:25.111728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e6c6bd2a-71b3-4f78-a1bc-be98ca605de2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccab2ef88f44ffc84b30c57c7a86194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6d0770e8e4c89beba9e72a8ca0ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:25.122174 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e6c6bd2a-71b3-4f78-a1bc-be98ca605de2 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 200 len: 1370 microversion: 2.1 time: 0.100292 Aug 25 14:14:25.122787 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3484/6901] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:25 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:14:26.151537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:26.152327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:26.159551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:26.160053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:26.160508 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:26.161227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:26.161729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:26.162171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:26.179498 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 HTTP/1.1 Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '400724ae-c722-47a9-a294-a63c18156ce0'} Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:26.181214 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:26.188289 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:26.188289 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:26.188289 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:26.188289 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:14:26.188289 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:14:26.188289 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:26.188289 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:26.188289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:14:26.188289 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fe8fd7b9-9447-4af3-9be8-7713c98edbad tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 404 len: 111 microversion: 2.1 time: 0.035222 Aug 25 14:14:26.188289 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3418/6902] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:26 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:14:26.248441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:26.250907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:26.258697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:26.259657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:26.259657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:26.260334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:26.260798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:26.262276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:26.276745 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/os-volume_attachments HTTP/1.1 Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': '400724ae-c722-47a9-a294-a63c18156ce0'} Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:14:26.278561 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0fff606d-11a1-4248-b3ef-c70f8a54cf65 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036765 Aug 25 14:14:26.284288 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3485/6903] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:14:26 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:14:29.647600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:29.648622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:29.669444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.670007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.670478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.671236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.671718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.672172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.689189 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 HTTP/1.1 Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '400724ae-c722-47a9-a294-a63c18156ce0'} Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:14:29.690833 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:14:29.695117 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0be30c12-16d7-4774-99d1-e15195605bb0 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 404 len: 111 microversion: 2.1 time: 0.053866 Aug 25 14:14:29.696251 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3419/6904] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:14:29 2022] DELETE /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:14:29.706216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:29.707433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 400724ae-c722-47a9-a294-a63c18156ce0] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:29.720337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.721221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.722147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.723418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.724257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.725019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.744630 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 HTTP/1.1 Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '400724ae-c722-47a9-a294-a63c18156ce0'} Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.746998 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.751352 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.751352 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.751352 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.751352 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:14:29.751352 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:14:29.751352 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. Aug 25 14:14:29.751352 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.751352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance 400724ae-c722-47a9-a294-a63c18156ce0 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:14:29.751352 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f9780f44-b83d-472c-86c8-6f0783d21eab tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0" status: 404 len: 111 microversion: 2.1 time: 0.050400 Aug 25 14:14:29.751352 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3486/6905] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:29 2022] GET /compute/v2.1/servers/400724ae-c722-47a9-a294-a63c18156ce0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:14:29.758703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:29.759379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:29.769403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.769962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.770421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.771154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.771805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.772156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.787989 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 HTTP/1.1 Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ecc06b7f-fa8f-4f5e-b713-018203883b75'} Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:14:29.789631 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5e2af3f6-0183-4ae3-8e32-ff4c09b51380 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 404 len: 111 microversion: 2.1 time: 0.036410 Aug 25 14:14:29.797982 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3420/6906] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:14:29 2022] DELETE /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:14:29.802979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:29.803937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ecc06b7f-fa8f-4f5e-b713-018203883b75] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:29.810966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.811571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.812093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.812892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.813466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.814002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.833950 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 HTTP/1.1 Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'ecc06b7f-fa8f-4f5e-b713-018203883b75'} Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.835556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.841136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.841136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.841136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.841136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:14:29.841136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:14:29.841136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. Aug 25 14:14:29.841136 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.841136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance ecc06b7f-fa8f-4f5e-b713-018203883b75 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:14:29.841136 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-99c621ba-f45e-4ae9-aee3-f066f4330331 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75" status: 404 len: 111 microversion: 2.1 time: 0.038958 Aug 25 14:14:29.841136 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3487/6907] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:29 2022] GET /compute/v2.1/servers/ecc06b7f-fa8f-4f5e-b713-018203883b75 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:14:29.852133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:29.852991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:29.864367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.865095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.865906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.867134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.867915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.868673 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.895299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f HTTP/1.1 Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '37c861e0-bbb8-4f59-b7b0-92b1f1428a6f'} Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:14:29.898484 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a2a1b92c-e92d-43d4-9d80-7a40899f45da tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 404 len: 111 microversion: 2.1 time: 0.055895 Aug 25 14:14:29.903618 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3421/6908] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:14:29 2022] DELETE /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:14:29.915599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:29.916669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:29.928444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.929291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.930108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.931383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.932191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.933331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.959850 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f HTTP/1.1 Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '37c861e0-bbb8-4f59-b7b0-92b1f1428a6f'} Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:29.962836 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.972759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:29.972759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:29.972759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:29.972759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:14:29.972759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:14:29.972759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. Aug 25 14:14:29.972759 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:29.972759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance 37c861e0-bbb8-4f59-b7b0-92b1f1428a6f could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:14:29.972759 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-64eac773-3c51-4cdf-adcc-be6b46420cd5 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f" status: 404 len: 111 microversion: 2.1 time: 0.057449 Aug 25 14:14:29.972759 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3488/6909] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:29 2022] GET /compute/v2.1/servers/37c861e0-bbb8-4f59-b7b0-92b1f1428a6f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:14:29.979401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:29.980746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:29.989583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.990242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.990804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:29.991650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:29.992230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:29.992764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:30.010463 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 HTTP/1.1 Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': 'ab1da74f-859e-47e8-b84b-bec7c6bed8c2'} Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:14:30.013049 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dc100e0f-7cce-4d51-8eef-28c5f03e889c tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 404 len: 111 microversion: 2.1 time: 0.040071 Aug 25 14:14:30.020802 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3422/6910] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:14:29 2022] DELETE /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:14:30.027253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:30.028335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] [instance: ab1da74f-859e-47e8-b84b-bec7c6bed8c2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:30.035593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:30.036164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:30.036874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:30.037791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:30.038287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:30.038749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:30.056172 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] HTTP exception thrown: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Request method failure captured: Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 HTTP/1.1 Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4G79IOnPwGzD_bpdHTVAY9LCnOHvolSMPiuwXflcOuQN2FvypEAKtJy3ECmAMrcs2kizjae8MrJbqLmAln28b5fxPBTz7Y0VP98UATJNzy3f1ykhbVhsFdWfM0qlbktZMCVg3HiqQnp3_4OFKywH2HMGHpbJIMQrQw-PTW2Jn_-88E Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5e6d0770e8e4c89beba9e72a8ca0ac3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5e6d0770e8e4c89beba9e72a8ca0ac3"}]}] Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f5e6d0770e8e4c89beba9e72a8ca0ac3 Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServerActionsTestJSON-1319896587 Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: dccab2ef88f44ffc84b30c57c7a86194 Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServerActionsTestJSON-1319896587-project Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'ab1da74f-859e-47e8-b84b-bec7c6bed8c2'} Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:14:30.057921 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:30.065278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:14:30.065278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:14:30.065278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:14:30.065278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:14:30.065278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:14:30.065278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. Aug 25 14:14:30.065278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:14:30.065278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Returning 404 to user: Instance ab1da74f-859e-47e8-b84b-bec7c6bed8c2 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:14:30.065278 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-18cd186c-2083-44c5-ba94-bb5e3116aa6d tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2" status: 404 len: 111 microversion: 2.1 time: 0.038639 Aug 25 14:14:30.065278 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3489/6911] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:30 2022] GET /compute/v2.1/servers/ab1da74f-859e-47e8-b84b-bec7c6bed8c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:14:30.070626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04d5d63b-0025-4ed5-bf4b-56ade271c150 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] Calling method '.version_select at 0x7f3a2e774040>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:30.105976 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-04d5d63b-0025-4ed5-bf4b-56ade271c150 tempest-ServerActionsTestJSON-1319896587 tempest-ServerActionsTestJSON-1319896587-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050390348" status: 202 len: 0 microversion: 2.1 time: 0.038610 Aug 25 14:14:30.109767 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3423/6912] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Aug 25 14:14:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050390348 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:14:41.195295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=25 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:41.196196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=59 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:41.324596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-198548145", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "dbf9e92f-ab50-4bd0-8c27-2ff479deeecd"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:14:41.383576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] validate_networks() for [('dbf9e92f-ab50-4bd0-8c27-2ff479deeecd', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:14:41.388855 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:14:41.388988 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:14:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.70) !!! Aug 25 14:14:41.879974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:14:41.880441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:14:41.880923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:14:41.881339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:14:41.881783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:14:41.892076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:41.892562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:41.893000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:41.893779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:41.894242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:41.894678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:41.919861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Getting quotas for project 81354401bd9f4c768349d52223752dea. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:14:41.926266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Getting quotas for user f55284c2d2374bc99a2c35170dfc2e1a and project 81354401bd9f4c768349d52223752dea. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:14:41.940476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:14:41.942876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:14:42.000531 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5e4c3e16-ab18-40eb-b25d-c36d54c53c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810812 Aug 25 14:14:42.001611 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3490/6913] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:14:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:14:42.013141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2ce632f9-78ec-4905-bb5d-da5b5640eb2b tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:42.013983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2ce632f9-78ec-4905-bb5d-da5b5640eb2b tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:42.020964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:42.021599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:42.088391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2ce632f9-78ec-4905-bb5d-da5b5640eb2b tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:42.098118 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2ce632f9-78ec-4905-bb5d-da5b5640eb2b tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1216 microversion: 2.1 time: 0.089342 Aug 25 14:14:42.109673 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3424/6914] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:42 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:43.123341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b566b6f0-34e1-4d3a-8538-f615001af6b9 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:43.124063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b566b6f0-34e1-4d3a-8538-f615001af6b9 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:43.132358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b566b6f0-34e1-4d3a-8538-f615001af6b9 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:43.132870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b566b6f0-34e1-4d3a-8538-f615001af6b9 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:43.133316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b566b6f0-34e1-4d3a-8538-f615001af6b9 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:43.134068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b566b6f0-34e1-4d3a-8538-f615001af6b9 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:43.134530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b566b6f0-34e1-4d3a-8538-f615001af6b9 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:43.134998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b566b6f0-34e1-4d3a-8538-f615001af6b9 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:43.221079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b566b6f0-34e1-4d3a-8538-f615001af6b9 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:43.235333 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b566b6f0-34e1-4d3a-8538-f615001af6b9 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1268 microversion: 2.1 time: 0.117885 Aug 25 14:14:43.236286 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3491/6915] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:43 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1268 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:44.260025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e86c7fa4-cebe-4b06-a036-45b54b076c26 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:44.260025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e86c7fa4-cebe-4b06-a036-45b54b076c26 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:44.268891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86c7fa4-cebe-4b06-a036-45b54b076c26 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:44.269410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86c7fa4-cebe-4b06-a036-45b54b076c26 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:44.269901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86c7fa4-cebe-4b06-a036-45b54b076c26 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:44.270646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86c7fa4-cebe-4b06-a036-45b54b076c26 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:44.271130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86c7fa4-cebe-4b06-a036-45b54b076c26 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:44.271582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e86c7fa4-cebe-4b06-a036-45b54b076c26 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:44.494368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e86c7fa4-cebe-4b06-a036-45b54b076c26 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:44.506628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e86c7fa4-cebe-4b06-a036-45b54b076c26 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1316 microversion: 2.1 time: 0.251745 Aug 25 14:14:44.507241 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3425/6916] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:44 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:44.991226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-7e5b3ca8-192b-4346-8558-4d7518120d5b req-e2998e92-6190-455d-8eda-640043665232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f076c7b-a3be-4cd6-a6d8-bc39835aefce", "tag": "e749681b-777b-4df2-bf91-b1783ef61324"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:14:45.005308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7e5b3ca8-192b-4346-8558-4d7518120d5b req-e2998e92-6190-455d-8eda-640043665232 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:45.006135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7e5b3ca8-192b-4346-8558-4d7518120d5b req-e2998e92-6190-455d-8eda-640043665232 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:45.006542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-7e5b3ca8-192b-4346-8558-4d7518120d5b req-e2998e92-6190-455d-8eda-640043665232 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:45.020591 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-7e5b3ca8-192b-4346-8558-4d7518120d5b req-e2998e92-6190-455d-8eda-640043665232 service nova] Creating event network-changed:e749681b-777b-4df2-bf91-b1783ef61324 for instance 6f076c7b-a3be-4cd6-a6d8-bc39835aefce on n-h1-852771-8 Aug 25 14:14:45.027149 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-7e5b3ca8-192b-4346-8558-4d7518120d5b req-e2998e92-6190-455d-8eda-640043665232 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038603 Aug 25 14:14:45.027974 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3492/6917] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:14:45.535224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-056099c8-9aa5-4285-b20e-ac74b6a5fcad tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:45.536082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-056099c8-9aa5-4285-b20e-ac74b6a5fcad tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:45.544921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-056099c8-9aa5-4285-b20e-ac74b6a5fcad tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:45.545121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-056099c8-9aa5-4285-b20e-ac74b6a5fcad tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:45.546479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-056099c8-9aa5-4285-b20e-ac74b6a5fcad tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:45.546479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-056099c8-9aa5-4285-b20e-ac74b6a5fcad tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:45.547032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-056099c8-9aa5-4285-b20e-ac74b6a5fcad tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:45.547679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-056099c8-9aa5-4285-b20e-ac74b6a5fcad tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:45.731899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-056099c8-9aa5-4285-b20e-ac74b6a5fcad tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:45.746850 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-056099c8-9aa5-4285-b20e-ac74b6a5fcad tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1316 microversion: 2.1 time: 0.215701 Aug 25 14:14:45.749916 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3426/6918] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:45 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:46.772944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6f26d72-59b6-4ac1-a543-58697fed79f6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:46.773835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d6f26d72-59b6-4ac1-a543-58697fed79f6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:46.780894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f26d72-59b6-4ac1-a543-58697fed79f6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:46.781422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f26d72-59b6-4ac1-a543-58697fed79f6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:46.781920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f26d72-59b6-4ac1-a543-58697fed79f6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:46.782635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f26d72-59b6-4ac1-a543-58697fed79f6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:46.783148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f26d72-59b6-4ac1-a543-58697fed79f6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:46.783579 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6f26d72-59b6-4ac1-a543-58697fed79f6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:46.936000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d6f26d72-59b6-4ac1-a543-58697fed79f6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:46.944436 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d6f26d72-59b6-4ac1-a543-58697fed79f6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1316 microversion: 2.1 time: 0.180083 Aug 25 14:14:46.945035 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3493/6919] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:46 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:14:47.966357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-02b5480d-1f14-4e6c-bd7b-a220c194c873 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:47.967112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-02b5480d-1f14-4e6c-bd7b-a220c194c873 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:47.974055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02b5480d-1f14-4e6c-bd7b-a220c194c873 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:47.974562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02b5480d-1f14-4e6c-bd7b-a220c194c873 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:47.975019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02b5480d-1f14-4e6c-bd7b-a220c194c873 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:47.975745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02b5480d-1f14-4e6c-bd7b-a220c194c873 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:47.976220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02b5480d-1f14-4e6c-bd7b-a220c194c873 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:47.976668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-02b5480d-1f14-4e6c-bd7b-a220c194c873 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:48.122604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-02b5480d-1f14-4e6c-bd7b-a220c194c873 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:48.130504 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-02b5480d-1f14-4e6c-bd7b-a220c194c873 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1316 microversion: 2.1 time: 0.168823 Aug 25 14:14:48.131102 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3427/6920] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:47 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:49.153324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d78f737-2e87-4651-8d9f-727931822271 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:49.153996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d78f737-2e87-4651-8d9f-727931822271 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:49.161285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d78f737-2e87-4651-8d9f-727931822271 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:49.161824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d78f737-2e87-4651-8d9f-727931822271 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:49.162299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d78f737-2e87-4651-8d9f-727931822271 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:49.163023 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d78f737-2e87-4651-8d9f-727931822271 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:49.163488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d78f737-2e87-4651-8d9f-727931822271 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:49.163923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d78f737-2e87-4651-8d9f-727931822271 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:49.316580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8d78f737-2e87-4651-8d9f-727931822271 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:49.325662 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d78f737-2e87-4651-8d9f-727931822271 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1316 microversion: 2.1 time: 0.176904 Aug 25 14:14:49.326253 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3494/6921] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:49 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:50.346889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-81b798d9-76f7-47a2-a7b2-6616b7dc649f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:50.347526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-81b798d9-76f7-47a2-a7b2-6616b7dc649f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:50.355474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b798d9-76f7-47a2-a7b2-6616b7dc649f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:50.356216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b798d9-76f7-47a2-a7b2-6616b7dc649f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:50.356680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b798d9-76f7-47a2-a7b2-6616b7dc649f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:50.357394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b798d9-76f7-47a2-a7b2-6616b7dc649f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:50.358000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b798d9-76f7-47a2-a7b2-6616b7dc649f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:50.358445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-81b798d9-76f7-47a2-a7b2-6616b7dc649f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:50.499919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-81b798d9-76f7-47a2-a7b2-6616b7dc649f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:50.508126 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-81b798d9-76f7-47a2-a7b2-6616b7dc649f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1316 microversion: 2.1 time: 0.165358 Aug 25 14:14:50.508734 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3428/6922] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:50 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:51.366330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b942e7a5-bc6f-49a2-864e-5ce4e1a8a77e req-885cc88a-2edd-47a3-a6c0-cabcc35e5bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f076c7b-a3be-4cd6-a6d8-bc39835aefce", "name": "network-vif-plugged", "status": "completed", "tag": "e749681b-777b-4df2-bf91-b1783ef61324"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:14:51.379330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b942e7a5-bc6f-49a2-864e-5ce4e1a8a77e req-885cc88a-2edd-47a3-a6c0-cabcc35e5bf2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:51.380123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b942e7a5-bc6f-49a2-864e-5ce4e1a8a77e req-885cc88a-2edd-47a3-a6c0-cabcc35e5bf2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:51.380561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b942e7a5-bc6f-49a2-864e-5ce4e1a8a77e req-885cc88a-2edd-47a3-a6c0-cabcc35e5bf2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:51.392783 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b942e7a5-bc6f-49a2-864e-5ce4e1a8a77e req-885cc88a-2edd-47a3-a6c0-cabcc35e5bf2 service nova] Creating event network-vif-plugged:e749681b-777b-4df2-bf91-b1783ef61324 for instance 6f076c7b-a3be-4cd6-a6d8-bc39835aefce on n-h1-852771-8 Aug 25 14:14:51.398063 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b942e7a5-bc6f-49a2-864e-5ce4e1a8a77e req-885cc88a-2edd-47a3-a6c0-cabcc35e5bf2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035746 Aug 25 14:14:51.398689 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3495/6923] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:14:51.530668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a82fa142-6f7e-4686-937f-5a07f358974e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:51.531310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a82fa142-6f7e-4686-937f-5a07f358974e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:51.543268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a82fa142-6f7e-4686-937f-5a07f358974e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:51.543935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a82fa142-6f7e-4686-937f-5a07f358974e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:51.544403 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a82fa142-6f7e-4686-937f-5a07f358974e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:51.545135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a82fa142-6f7e-4686-937f-5a07f358974e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:51.545632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a82fa142-6f7e-4686-937f-5a07f358974e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:51.546106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a82fa142-6f7e-4686-937f-5a07f358974e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:51.694312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a82fa142-6f7e-4686-937f-5a07f358974e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:51.703289 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a82fa142-6f7e-4686-937f-5a07f358974e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1316 microversion: 2.1 time: 0.177294 Aug 25 14:14:51.703889 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3429/6924] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:51 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:52.722429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:52.723131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:52.728224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce02b5a7-b980-49c4-b0a9-6281a187afe7 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:52.728987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ce02b5a7-b980-49c4-b0a9-6281a187afe7 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:52.736746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce02b5a7-b980-49c4-b0a9-6281a187afe7 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:52.737230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce02b5a7-b980-49c4-b0a9-6281a187afe7 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:52.737697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce02b5a7-b980-49c4-b0a9-6281a187afe7 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:52.738395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce02b5a7-b980-49c4-b0a9-6281a187afe7 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:52.738849 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce02b5a7-b980-49c4-b0a9-6281a187afe7 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:52.739270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce02b5a7-b980-49c4-b0a9-6281a187afe7 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:52.883963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ce02b5a7-b980-49c4-b0a9-6281a187afe7 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:52.894784 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce02b5a7-b980-49c4-b0a9-6281a187afe7 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1316 microversion: 2.1 time: 0.173297 Aug 25 14:14:52.895402 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3496/6925] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:52 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:53.918533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-055450be-a104-445c-8d99-0d149abe390a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:53.919365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-055450be-a104-445c-8d99-0d149abe390a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:53.921908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:53.928089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-055450be-a104-445c-8d99-0d149abe390a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:53.928605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-055450be-a104-445c-8d99-0d149abe390a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:53.929092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-055450be-a104-445c-8d99-0d149abe390a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:53.929869 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-055450be-a104-445c-8d99-0d149abe390a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:53.930345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-055450be-a104-445c-8d99-0d149abe390a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:53.930792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-055450be-a104-445c-8d99-0d149abe390a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:54.078590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-055450be-a104-445c-8d99-0d149abe390a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:54.086559 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-055450be-a104-445c-8d99-0d149abe390a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1506 microversion: 2.1 time: 0.173902 Aug 25 14:14:54.087137 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3430/6926] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:53 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:54.147854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-651061185", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "dbf9e92f-ab50-4bd0-8c27-2ff479deeecd"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:14:54.207278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] validate_networks() for [('dbf9e92f-ab50-4bd0-8c27-2ff479deeecd', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:14:54.600934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:14:54.601359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:14:54.601872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:14:54.602289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:14:54.602736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:14:54.612752 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:54.613163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:54.613657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:54.614402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:54.614863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:54.615295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:54.632616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Getting quotas for project 81354401bd9f4c768349d52223752dea. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:14:54.638076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Getting quotas for user f55284c2d2374bc99a2c35170dfc2e1a and project 81354401bd9f4c768349d52223752dea. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:14:54.651052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:14:54.654230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:14:54.700831 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-64228fe3-52c6-48bb-af96-9b50d697c5a5 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556793 Aug 25 14:14:54.701493 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3497/6927] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:14:54.712355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-277112bf-3672-40cf-81f4-ec06a35028a0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:54.712996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-277112bf-3672-40cf-81f4-ec06a35028a0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:54.769484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-277112bf-3672-40cf-81f4-ec06a35028a0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:54.777552 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-277112bf-3672-40cf-81f4-ec06a35028a0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1216 microversion: 2.1 time: 0.068110 Aug 25 14:14:54.778158 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3431/6928] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:54 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:55.799294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bdd4c1b6-348e-4aae-b356-2e49c48b1236 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:55.799927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bdd4c1b6-348e-4aae-b356-2e49c48b1236 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:55.807551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bdd4c1b6-348e-4aae-b356-2e49c48b1236 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:55.808255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bdd4c1b6-348e-4aae-b356-2e49c48b1236 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:55.808861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bdd4c1b6-348e-4aae-b356-2e49c48b1236 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:55.809823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bdd4c1b6-348e-4aae-b356-2e49c48b1236 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:55.810452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bdd4c1b6-348e-4aae-b356-2e49c48b1236 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:55.810879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bdd4c1b6-348e-4aae-b356-2e49c48b1236 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:55.880228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bdd4c1b6-348e-4aae-b356-2e49c48b1236 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:55.892091 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bdd4c1b6-348e-4aae-b356-2e49c48b1236 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1286 microversion: 2.1 time: 0.097711 Aug 25 14:14:55.892697 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3498/6929] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:55 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:56.917964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99e7f7b0-2733-454c-8759-817a994a45ff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:56.918978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-99e7f7b0-2733-454c-8759-817a994a45ff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:56.928460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99e7f7b0-2733-454c-8759-817a994a45ff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:56.929080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99e7f7b0-2733-454c-8759-817a994a45ff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:56.929940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99e7f7b0-2733-454c-8759-817a994a45ff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:56.930965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99e7f7b0-2733-454c-8759-817a994a45ff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:56.931459 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99e7f7b0-2733-454c-8759-817a994a45ff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:56.931909 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99e7f7b0-2733-454c-8759-817a994a45ff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:57.090594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99e7f7b0-2733-454c-8759-817a994a45ff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:57.098758 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-99e7f7b0-2733-454c-8759-817a994a45ff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1316 microversion: 2.1 time: 0.187197 Aug 25 14:14:57.110132 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3432/6930] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:56 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:14:57.186774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-217db31c-d1e2-45dc-a5dd-9339f07d13c1 req-88311509-9f2c-499a-8042-000953d20ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f82b94a-efbb-4f8f-a897-88d119b9278e", "tag": "c8aa4a22-d856-4e4a-aaca-a89df3a3aac0"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:14:57.206354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-217db31c-d1e2-45dc-a5dd-9339f07d13c1 req-88311509-9f2c-499a-8042-000953d20ba1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:57.206916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-217db31c-d1e2-45dc-a5dd-9339f07d13c1 req-88311509-9f2c-499a-8042-000953d20ba1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:57.208014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-217db31c-d1e2-45dc-a5dd-9339f07d13c1 req-88311509-9f2c-499a-8042-000953d20ba1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:57.222642 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-217db31c-d1e2-45dc-a5dd-9339f07d13c1 req-88311509-9f2c-499a-8042-000953d20ba1 service nova] Creating event network-changed:c8aa4a22-d856-4e4a-aaca-a89df3a3aac0 for instance 6f82b94a-efbb-4f8f-a897-88d119b9278e on n-h2-852771-8 Aug 25 14:14:57.230096 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-217db31c-d1e2-45dc-a5dd-9339f07d13c1 req-88311509-9f2c-499a-8042-000953d20ba1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049838 Aug 25 14:14:57.230798 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3499/6931] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:14:58.121315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6c35f9f2-35d1-4409-9a6f-19fee0e44cf6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:58.121982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6c35f9f2-35d1-4409-9a6f-19fee0e44cf6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:58.128775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c35f9f2-35d1-4409-9a6f-19fee0e44cf6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:58.129281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c35f9f2-35d1-4409-9a6f-19fee0e44cf6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:58.129777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c35f9f2-35d1-4409-9a6f-19fee0e44cf6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:58.130497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c35f9f2-35d1-4409-9a6f-19fee0e44cf6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:58.130972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c35f9f2-35d1-4409-9a6f-19fee0e44cf6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:58.131433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6c35f9f2-35d1-4409-9a6f-19fee0e44cf6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:58.271900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6c35f9f2-35d1-4409-9a6f-19fee0e44cf6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:58.280641 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6c35f9f2-35d1-4409-9a6f-19fee0e44cf6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1316 microversion: 2.1 time: 0.163269 Aug 25 14:14:58.281235 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3433/6932] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:58 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:14:59.303628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3ea262d5-13ed-4c9e-a658-325b3b71d764 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:59.304416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3ea262d5-13ed-4c9e-a658-325b3b71d764 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:59.311726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ea262d5-13ed-4c9e-a658-325b3b71d764 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:59.312215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ea262d5-13ed-4c9e-a658-325b3b71d764 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:59.312658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ea262d5-13ed-4c9e-a658-325b3b71d764 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:59.313364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ea262d5-13ed-4c9e-a658-325b3b71d764 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:59.313855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ea262d5-13ed-4c9e-a658-325b3b71d764 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:59.314308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3ea262d5-13ed-4c9e-a658-325b3b71d764 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:59.455907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3ea262d5-13ed-4c9e-a658-325b3b71d764 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:59.464599 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3ea262d5-13ed-4c9e-a658-325b3b71d764 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1316 microversion: 2.1 time: 0.165367 Aug 25 14:14:59.465332 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3500/6933] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:59 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:00.492997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cddb8e0c-2297-4360-b703-8b09bc6a96ed tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:00.493610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cddb8e0c-2297-4360-b703-8b09bc6a96ed tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:00.502119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cddb8e0c-2297-4360-b703-8b09bc6a96ed tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:00.502634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cddb8e0c-2297-4360-b703-8b09bc6a96ed tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:00.503097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cddb8e0c-2297-4360-b703-8b09bc6a96ed tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:00.503834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cddb8e0c-2297-4360-b703-8b09bc6a96ed tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:00.504371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cddb8e0c-2297-4360-b703-8b09bc6a96ed tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:00.504717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cddb8e0c-2297-4360-b703-8b09bc6a96ed tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:00.675206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cddb8e0c-2297-4360-b703-8b09bc6a96ed tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:00.684549 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cddb8e0c-2297-4360-b703-8b09bc6a96ed tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1316 microversion: 2.1 time: 0.195616 Aug 25 14:15:00.685148 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3434/6934] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:00 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:01.708446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4168b075-5b4f-406d-b8e9-5668fb455e49 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:01.709054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4168b075-5b4f-406d-b8e9-5668fb455e49 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:01.717258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4168b075-5b4f-406d-b8e9-5668fb455e49 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:01.717590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4168b075-5b4f-406d-b8e9-5668fb455e49 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:01.718230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4168b075-5b4f-406d-b8e9-5668fb455e49 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:01.718861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4168b075-5b4f-406d-b8e9-5668fb455e49 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:01.719108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4168b075-5b4f-406d-b8e9-5668fb455e49 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:01.719527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4168b075-5b4f-406d-b8e9-5668fb455e49 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:01.863215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4168b075-5b4f-406d-b8e9-5668fb455e49 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:01.872542 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4168b075-5b4f-406d-b8e9-5668fb455e49 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1316 microversion: 2.1 time: 0.168088 Aug 25 14:15:01.873150 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3501/6935] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:01 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:02.531349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-4a4b5fd7-b670-443c-aa9a-dd109f4843be req-a8f0ff86-ab9c-4890-b8d7-7969ba3a0584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f82b94a-efbb-4f8f-a897-88d119b9278e", "name": "network-vif-plugged", "status": "completed", "tag": "c8aa4a22-d856-4e4a-aaca-a89df3a3aac0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:02.543406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4a4b5fd7-b670-443c-aa9a-dd109f4843be req-a8f0ff86-ab9c-4890-b8d7-7969ba3a0584 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:02.543925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4a4b5fd7-b670-443c-aa9a-dd109f4843be req-a8f0ff86-ab9c-4890-b8d7-7969ba3a0584 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:02.544398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-4a4b5fd7-b670-443c-aa9a-dd109f4843be req-a8f0ff86-ab9c-4890-b8d7-7969ba3a0584 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:02.565035 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-4a4b5fd7-b670-443c-aa9a-dd109f4843be req-a8f0ff86-ab9c-4890-b8d7-7969ba3a0584 service nova] Creating event network-vif-plugged:c8aa4a22-d856-4e4a-aaca-a89df3a3aac0 for instance 6f82b94a-efbb-4f8f-a897-88d119b9278e on n-h2-852771-8 Aug 25 14:15:02.570762 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-4a4b5fd7-b670-443c-aa9a-dd109f4843be req-a8f0ff86-ab9c-4890-b8d7-7969ba3a0584 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044007 Aug 25 14:15:02.571409 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3435/6936] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:02.895683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0335703a-01ae-4ae4-be95-d17d63fa4eff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:02.896679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0335703a-01ae-4ae4-be95-d17d63fa4eff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:02.905268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0335703a-01ae-4ae4-be95-d17d63fa4eff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:02.905789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0335703a-01ae-4ae4-be95-d17d63fa4eff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:02.906235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0335703a-01ae-4ae4-be95-d17d63fa4eff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:02.906958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0335703a-01ae-4ae4-be95-d17d63fa4eff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:02.907414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0335703a-01ae-4ae4-be95-d17d63fa4eff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:02.907880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0335703a-01ae-4ae4-be95-d17d63fa4eff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:03.086228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0335703a-01ae-4ae4-be95-d17d63fa4eff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:03.096306 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0335703a-01ae-4ae4-be95-d17d63fa4eff tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1316 microversion: 2.1 time: 0.205461 Aug 25 14:15:03.096914 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3502/6937] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:02 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:15:04.120491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e38f023e-5bbf-4173-b280-4d95a9a3a61a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:04.121130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e38f023e-5bbf-4173-b280-4d95a9a3a61a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:04.128414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e38f023e-5bbf-4173-b280-4d95a9a3a61a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:04.128935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e38f023e-5bbf-4173-b280-4d95a9a3a61a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:04.129396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e38f023e-5bbf-4173-b280-4d95a9a3a61a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:04.130155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e38f023e-5bbf-4173-b280-4d95a9a3a61a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:04.130636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e38f023e-5bbf-4173-b280-4d95a9a3a61a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:04.131081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e38f023e-5bbf-4173-b280-4d95a9a3a61a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:04.290477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e38f023e-5bbf-4173-b280-4d95a9a3a61a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:04.299562 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e38f023e-5bbf-4173-b280-4d95a9a3a61a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1506 microversion: 2.1 time: 0.184497 Aug 25 14:15:04.300181 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3436/6938] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:04 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:04.322230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-09d33112-ce23-4a6e-b0ae-104cf4f94df2 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:04.323711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-09d33112-ce23-4a6e-b0ae-104cf4f94df2 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:04.331383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d33112-ce23-4a6e-b0ae-104cf4f94df2 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:04.331790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d33112-ce23-4a6e-b0ae-104cf4f94df2 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:04.332242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d33112-ce23-4a6e-b0ae-104cf4f94df2 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:04.332968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d33112-ce23-4a6e-b0ae-104cf4f94df2 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:04.333432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d33112-ce23-4a6e-b0ae-104cf4f94df2 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:04.333911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09d33112-ce23-4a6e-b0ae-104cf4f94df2 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:04.365476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-09d33112-ce23-4a6e-b0ae-104cf4f94df2 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:15:04.449980 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-09d33112-ce23-4a6e-b0ae-104cf4f94df2 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 204 len: 0 microversion: 2.1 time: 0.131179 Aug 25 14:15:04.451196 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3503/6939] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:15:04 2022] DELETE /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:15:04.459181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-faab2dd8-9260-450b-9823-e7899830341f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:04.459813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-faab2dd8-9260-450b-9823-e7899830341f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:04.466725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faab2dd8-9260-450b-9823-e7899830341f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:04.467294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faab2dd8-9260-450b-9823-e7899830341f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:04.467773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faab2dd8-9260-450b-9823-e7899830341f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:04.468545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faab2dd8-9260-450b-9823-e7899830341f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:04.469019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faab2dd8-9260-450b-9823-e7899830341f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:04.469746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-faab2dd8-9260-450b-9823-e7899830341f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:04.602182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-faab2dd8-9260-450b-9823-e7899830341f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:04.610192 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-faab2dd8-9260-450b-9823-e7899830341f tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1512 microversion: 2.1 time: 0.154915 Aug 25 14:15:04.610773 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3437/6940] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:04 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:05.632084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-49955460-1d29-4eba-a356-eb1d749b6539 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:05.632798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-49955460-1d29-4eba-a356-eb1d749b6539 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:05.634817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:05.636186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:05.643192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49955460-1d29-4eba-a356-eb1d749b6539 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:05.643680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49955460-1d29-4eba-a356-eb1d749b6539 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:05.644122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49955460-1d29-4eba-a356-eb1d749b6539 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:05.644835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49955460-1d29-4eba-a356-eb1d749b6539 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:05.645287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49955460-1d29-4eba-a356-eb1d749b6539 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:05.645742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-49955460-1d29-4eba-a356-eb1d749b6539 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:05.794740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-49955460-1d29-4eba-a356-eb1d749b6539 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:05.802706 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-49955460-1d29-4eba-a356-eb1d749b6539 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 200 len: 1512 microversion: 2.1 time: 0.174959 Aug 25 14:15:05.803291 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3504/6941] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:05 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:06.281442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1e08cebd-0fad-43aa-a93d-21803a005575 req-10e6bc52-05f0-421c-9f8e-fefa56f6c56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f82b94a-efbb-4f8f-a897-88d119b9278e", "name": "network-vif-deleted", "tag": "c8aa4a22-d856-4e4a-aaca-a89df3a3aac0"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:06.288598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:06.302436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1e08cebd-0fad-43aa-a93d-21803a005575 req-10e6bc52-05f0-421c-9f8e-fefa56f6c56b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:06.302907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1e08cebd-0fad-43aa-a93d-21803a005575 req-10e6bc52-05f0-421c-9f8e-fefa56f6c56b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:06.303441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1e08cebd-0fad-43aa-a93d-21803a005575 req-10e6bc52-05f0-421c-9f8e-fefa56f6c56b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:06.317829 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1e08cebd-0fad-43aa-a93d-21803a005575 req-10e6bc52-05f0-421c-9f8e-fefa56f6c56b service nova] Creating event network-vif-deleted:c8aa4a22-d856-4e4a-aaca-a89df3a3aac0 for instance 6f82b94a-efbb-4f8f-a897-88d119b9278e on n-h2-852771-8 Aug 25 14:15:06.324747 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1e08cebd-0fad-43aa-a93d-21803a005575 req-10e6bc52-05f0-421c-9f8e-fefa56f6c56b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049173 Aug 25 14:15:06.326200 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3438/6942] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:06.823688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:06.824336 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:06.831765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:06.832259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:06.832698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:06.833405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:06.833884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:06.834318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:06.849481 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] HTTP exception thrown: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Request method failure captured: Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e HTTP/1.1 Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4PRro3vXp7VhN6UL4tN8h51xq2kv0uk_ogMfFZdUKH1LyAMki_9M_5VWCOPTULZMnNWL-ImbXotDdzdht_7GpcJVBlzqXpEEGudyjDKqCdOcYiJ9kmlhiVTOX_0fzJOB_137zQPtPdC56Ado8o__VuzZy4Y9n6Jq7aAJ6UCTj8yQV0 Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81354401bd9f4c768349d52223752dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81354401bd9f4c768349d52223752dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}] Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: f55284c2d2374bc99a2c35170dfc2e1a Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '6f82b94a-efbb-4f8f-a897-88d119b9278e'} Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:06.851187 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:06.857106 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:06.857106 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:06.857106 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:06.857106 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:15:06.857106 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:15:06.857106 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:06.857106 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:06.857106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Returning 404 to user: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:15:06.857106 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d68186b9-10f5-4c96-882c-3aed4f8a0ad0 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 404 len: 111 microversion: 2.1 time: 0.033378 Aug 25 14:15:06.857106 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3505/6943] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:06 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:15:06.863883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d95c2be2-ec9a-43d2-8b60-58558ed72096 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:06.864592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d95c2be2-ec9a-43d2-8b60-58558ed72096 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:06.871784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d95c2be2-ec9a-43d2-8b60-58558ed72096 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:06.872283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d95c2be2-ec9a-43d2-8b60-58558ed72096 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:06.872737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d95c2be2-ec9a-43d2-8b60-58558ed72096 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:06.873482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d95c2be2-ec9a-43d2-8b60-58558ed72096 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:06.873944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d95c2be2-ec9a-43d2-8b60-58558ed72096 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:06.874383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d95c2be2-ec9a-43d2-8b60-58558ed72096 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.016537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d95c2be2-ec9a-43d2-8b60-58558ed72096 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:07.024168 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d95c2be2-ec9a-43d2-8b60-58558ed72096 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1506 microversion: 2.1 time: 0.164635 Aug 25 14:15:07.024756 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3439/6944] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:06 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:07.045892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e1ad1857-946c-4445-bf72-56e806dd8540 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:07.048329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e1ad1857-946c-4445-bf72-56e806dd8540 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: d855a2d6-8a9b-410d-9845-1d1ad92b7c7d] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:07.054267 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-e1ad1857-946c-4445-bf72-56e806dd8540 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] HTTP exception thrown: Instance d855a2d6-8a9b-410d-9845-1d1ad92b7c7d could not be found. Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e1ad1857-946c-4445-bf72-56e806dd8540 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Request method failure captured: Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/d855a2d6-8a9b-410d-9845-1d1ad92b7c7d/action HTTP/1.1 Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 32 Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4PRro3vXp7VhN6UL4tN8h51xq2kv0uk_ogMfFZdUKH1LyAMki_9M_5VWCOPTULZMnNWL-ImbXotDdzdht_7GpcJVBlzqXpEEGudyjDKqCdOcYiJ9kmlhiVTOX_0fzJOB_137zQPtPdC56Ado8o__VuzZy4Y9n6Jq7aAJ6UCTj8yQV0 Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81354401bd9f4c768349d52223752dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81354401bd9f4c768349d52223752dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}] Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: f55284c2d2374bc99a2c35170dfc2e1a Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: {"resize": {"flavorRef": "452"}} Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance d855a2d6-8a9b-410d-9845-1d1ad92b7c7d could not be found. Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'd855a2d6-8a9b-410d-9845-1d1ad92b7c7d', 'body': {'resize': {'flavorRef': '452'}}} Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d855a2d6-8a9b-410d-9845-1d1ad92b7c7d could not be found. Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:15:07.055801 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d855a2d6-8a9b-410d-9845-1d1ad92b7c7d could not be found. Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d855a2d6-8a9b-410d-9845-1d1ad92b7c7d could not be found. Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e1ad1857-946c-4445-bf72-56e806dd8540 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Returning 404 to user: Instance d855a2d6-8a9b-410d-9845-1d1ad92b7c7d could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e1ad1857-946c-4445-bf72-56e806dd8540 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "POST /compute/v2.1/servers/d855a2d6-8a9b-410d-9845-1d1ad92b7c7d/action" status: 404 len: 111 microversion: 2.1 time: 0.016470 Aug 25 14:15:07.061085 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3506/6945] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:15:07 2022] POST /compute/v2.1/servers/d855a2d6-8a9b-410d-9845-1d1ad92b7c7d/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:15:07.067289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-12562674-42a1-486a-bd8e-e88d67325c17 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:07.067828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-12562674-42a1-486a-bd8e-e88d67325c17 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:07.074635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12562674-42a1-486a-bd8e-e88d67325c17 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.075222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12562674-42a1-486a-bd8e-e88d67325c17 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.075681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12562674-42a1-486a-bd8e-e88d67325c17 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.076427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12562674-42a1-486a-bd8e-e88d67325c17 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.076894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12562674-42a1-486a-bd8e-e88d67325c17 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.077365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-12562674-42a1-486a-bd8e-e88d67325c17 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.217746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-12562674-42a1-486a-bd8e-e88d67325c17 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:07.225626 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-12562674-42a1-486a-bd8e-e88d67325c17 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1506 microversion: 2.1 time: 0.162258 Aug 25 14:15:07.226211 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3440/6946] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:07 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:07.247345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-99d20722-c567-4dde-bafd-db661dc6b972 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:07.247970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-99d20722-c567-4dde-bafd-db661dc6b972 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:07.255231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d20722-c567-4dde-bafd-db661dc6b972 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.255715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d20722-c567-4dde-bafd-db661dc6b972 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.256155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d20722-c567-4dde-bafd-db661dc6b972 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.256853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d20722-c567-4dde-bafd-db661dc6b972 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.257319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d20722-c567-4dde-bafd-db661dc6b972 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.257780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-99d20722-c567-4dde-bafd-db661dc6b972 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.391670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-99d20722-c567-4dde-bafd-db661dc6b972 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:07.399763 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-99d20722-c567-4dde-bafd-db661dc6b972 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1506 microversion: 2.1 time: 0.156892 Aug 25 14:15:07.400486 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3507/6947] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:07 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:07.420252 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "b38a0e70-b0e5-4600-a937-22e4bbffcf0e"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:07.422520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:07.429377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.429921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.430380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.431095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.431569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.432015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.462712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:07.468584 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] HTTP exception thrown: Flavor b38a0e70-b0e5-4600-a937-22e4bbffcf0e could not be found. Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Request method failure captured: Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: request: POST /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce/action HTTP/1.1 Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 65 Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4PRro3vXp7VhN6UL4tN8h51xq2kv0uk_ogMfFZdUKH1LyAMki_9M_5VWCOPTULZMnNWL-ImbXotDdzdht_7GpcJVBlzqXpEEGudyjDKqCdOcYiJ9kmlhiVTOX_0fzJOB_137zQPtPdC56Ado8o__VuzZy4Y9n6Jq7aAJ6UCTj8yQV0 Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81354401bd9f4c768349d52223752dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81354401bd9f4c768349d52223752dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}] Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: f55284c2d2374bc99a2c35170dfc2e1a Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: {"resize": {"flavorRef": "b38a0e70-b0e5-4600-a937-22e4bbffcf0e"}} Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: exception: Flavor b38a0e70-b0e5-4600-a937-22e4bbffcf0e could not be found. Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '6f076c7b-a3be-4cd6-a6d8-bc39835aefce', 'body': {'resize': {'flavorRef': 'b38a0e70-b0e5-4600-a937-22e4bbffcf0e'}}} Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:15:07.470554 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b38a0e70-b0e5-4600-a937-22e4bbffcf0e could not be found. Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor b38a0e70-b0e5-4600-a937-22e4bbffcf0e could not be found. Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b38a0e70-b0e5-4600-a937-22e4bbffcf0e could not be found. Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Returning 400 to user: Flavor b38a0e70-b0e5-4600-a937-22e4bbffcf0e could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-049a2a3e-7764-4c9a-9f1f-9e8b673a452e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "POST /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce/action" status: 400 len: 107 microversion: 2.1 time: 0.055861 Aug 25 14:15:07.475693 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3441/6948] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:15:07 2022] POST /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce/action => generated 107 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 14:15:07.483074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ee660ed4-27ba-4b4e-8bf0-d7f208a002c4 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:07.483694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ee660ed4-27ba-4b4e-8bf0-d7f208a002c4 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:07.489863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee660ed4-27ba-4b4e-8bf0-d7f208a002c4 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.490339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee660ed4-27ba-4b4e-8bf0-d7f208a002c4 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.490773 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee660ed4-27ba-4b4e-8bf0-d7f208a002c4 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.491459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee660ed4-27ba-4b4e-8bf0-d7f208a002c4 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.491908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee660ed4-27ba-4b4e-8bf0-d7f208a002c4 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.492331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ee660ed4-27ba-4b4e-8bf0-d7f208a002c4 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.626721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ee660ed4-27ba-4b4e-8bf0-d7f208a002c4 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:07.634584 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ee660ed4-27ba-4b4e-8bf0-d7f208a002c4 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1506 microversion: 2.1 time: 0.155348 Aug 25 14:15:07.635164 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3508/6949] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:07 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:07.656923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-743e82da-c85d-4e19-8948-255f59ee67d6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:07.657586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-743e82da-c85d-4e19-8948-255f59ee67d6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:07.663663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743e82da-c85d-4e19-8948-255f59ee67d6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.664165 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743e82da-c85d-4e19-8948-255f59ee67d6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.664621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743e82da-c85d-4e19-8948-255f59ee67d6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.665341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743e82da-c85d-4e19-8948-255f59ee67d6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.665864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743e82da-c85d-4e19-8948-255f59ee67d6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.666364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-743e82da-c85d-4e19-8948-255f59ee67d6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.809852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-743e82da-c85d-4e19-8948-255f59ee67d6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:07.817855 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-743e82da-c85d-4e19-8948-255f59ee67d6 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1506 microversion: 2.1 time: 0.164846 Aug 25 14:15:07.818445 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3442/6950] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:07 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:07.840033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea004bf8-3743-4344-88f5-0d27c21edf4e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea004bf8-3743-4344-88f5-0d27c21edf4e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Request method failure captured: Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: request: POST /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce/action HTTP/1.1 Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 29 Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4PRro3vXp7VhN6UL4tN8h51xq2kv0uk_ogMfFZdUKH1LyAMki_9M_5VWCOPTULZMnNWL-ImbXotDdzdht_7GpcJVBlzqXpEEGudyjDKqCdOcYiJ9kmlhiVTOX_0fzJOB_137zQPtPdC56Ado8o__VuzZy4Y9n6Jq7aAJ6UCTj8yQV0 Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81354401bd9f4c768349d52223752dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81354401bd9f4c768349d52223752dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}] Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: f55284c2d2374bc99a2c35170dfc2e1a Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: {"resize": {"flavorRef": ""}} Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '6f076c7b-a3be-4cd6-a6d8-bc39835aefce', 'body': {'resize': {'flavorRef': ''}}} Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise error Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi '' Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.843648 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ea004bf8-3743-4344-88f5-0d27c21edf4e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ea004bf8-3743-4344-88f5-0d27c21edf4e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "POST /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce/action" status: 400 len: 113 microversion: 2.1 time: 0.009727 Aug 25 14:15:07.848024 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3509/6951] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:15:07 2022] POST /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 14:15:07.853819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7e4de5cc-a0b6-41fb-9ff7-2a8d9e9852a1 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:07.855194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7e4de5cc-a0b6-41fb-9ff7-2a8d9e9852a1 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:07.861819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e4de5cc-a0b6-41fb-9ff7-2a8d9e9852a1 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.862339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e4de5cc-a0b6-41fb-9ff7-2a8d9e9852a1 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.862805 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e4de5cc-a0b6-41fb-9ff7-2a8d9e9852a1 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:07.863530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e4de5cc-a0b6-41fb-9ff7-2a8d9e9852a1 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:07.864009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e4de5cc-a0b6-41fb-9ff7-2a8d9e9852a1 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:07.864458 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7e4de5cc-a0b6-41fb-9ff7-2a8d9e9852a1 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:08.005645 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7e4de5cc-a0b6-41fb-9ff7-2a8d9e9852a1 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:08.013658 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7e4de5cc-a0b6-41fb-9ff7-2a8d9e9852a1 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1506 microversion: 2.1 time: 0.163657 Aug 25 14:15:08.014250 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3443/6952] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:07 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:08.039679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:08.040178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:08.048395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:08.048878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:08.049315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:08.050091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:08.050544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:08.050972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:08.065809 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] HTTP exception thrown: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Request method failure captured: Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e HTTP/1.1 Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4PRro3vXp7VhN6UL4tN8h51xq2kv0uk_ogMfFZdUKH1LyAMki_9M_5VWCOPTULZMnNWL-ImbXotDdzdht_7GpcJVBlzqXpEEGudyjDKqCdOcYiJ9kmlhiVTOX_0fzJOB_137zQPtPdC56Ado8o__VuzZy4Y9n6Jq7aAJ6UCTj8yQV0 Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81354401bd9f4c768349d52223752dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81354401bd9f4c768349d52223752dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}] Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: f55284c2d2374bc99a2c35170dfc2e1a Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '6f82b94a-efbb-4f8f-a897-88d119b9278e'} Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:15:08.067408 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Returning 404 to user: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0f68b080-45ac-4c7b-91f2-af4caf0f9089 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 404 len: 111 microversion: 2.1 time: 0.033930 Aug 25 14:15:08.071327 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3510/6953] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:15:08 2022] DELETE /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:15:08.078381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:08.079025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f82b94a-efbb-4f8f-a897-88d119b9278e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:08.085474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:08.086025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:08.086488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:08.087212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:08.087688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:08.088130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:08.093659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=100 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:08.106830 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] HTTP exception thrown: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Request method failure captured: Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e HTTP/1.1 Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4PRro3vXp7VhN6UL4tN8h51xq2kv0uk_ogMfFZdUKH1LyAMki_9M_5VWCOPTULZMnNWL-ImbXotDdzdht_7GpcJVBlzqXpEEGudyjDKqCdOcYiJ9kmlhiVTOX_0fzJOB_137zQPtPdC56Ado8o__VuzZy4Y9n6Jq7aAJ6UCTj8yQV0 Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81354401bd9f4c768349d52223752dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81354401bd9f4c768349d52223752dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}] Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: f55284c2d2374bc99a2c35170dfc2e1a Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '6f82b94a-efbb-4f8f-a897-88d119b9278e'} Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:08.108399 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:08.113629 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:08.113629 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:08.113629 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:08.113629 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:15:08.113629 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:15:08.113629 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. Aug 25 14:15:08.113629 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:08.113629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Returning 404 to user: Instance 6f82b94a-efbb-4f8f-a897-88d119b9278e could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:15:08.113629 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-10f858a9-fb44-4c2b-9e86-c220b298180a tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e" status: 404 len: 111 microversion: 2.1 time: 0.035484 Aug 25 14:15:08.113629 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3444/6954] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:08 2022] GET /compute/v2.1/servers/6f82b94a-efbb-4f8f-a897-88d119b9278e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:15:08.118611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-25635a9c-e295-4a1e-a0ff-2cfce4c37e2e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:08.119148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-25635a9c-e295-4a1e-a0ff-2cfce4c37e2e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:08.126022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25635a9c-e295-4a1e-a0ff-2cfce4c37e2e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:08.126503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25635a9c-e295-4a1e-a0ff-2cfce4c37e2e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:08.126940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25635a9c-e295-4a1e-a0ff-2cfce4c37e2e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:08.127634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25635a9c-e295-4a1e-a0ff-2cfce4c37e2e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:08.128084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25635a9c-e295-4a1e-a0ff-2cfce4c37e2e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:08.128514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-25635a9c-e295-4a1e-a0ff-2cfce4c37e2e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:08.149589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:08.161268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-25635a9c-e295-4a1e-a0ff-2cfce4c37e2e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:15:08.256586 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-25635a9c-e295-4a1e-a0ff-2cfce4c37e2e tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 204 len: 0 microversion: 2.1 time: 0.141419 Aug 25 14:15:08.257099 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3511/6955] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:15:08 2022] DELETE /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:15:08.266828 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c819ed8b-9e07-401c-a49a-c35588f1ac52 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:08.267456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c819ed8b-9e07-401c-a49a-c35588f1ac52 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:08.273676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c819ed8b-9e07-401c-a49a-c35588f1ac52 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:08.274185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c819ed8b-9e07-401c-a49a-c35588f1ac52 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:08.274647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c819ed8b-9e07-401c-a49a-c35588f1ac52 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:08.275382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c819ed8b-9e07-401c-a49a-c35588f1ac52 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:08.276493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c819ed8b-9e07-401c-a49a-c35588f1ac52 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:08.277151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c819ed8b-9e07-401c-a49a-c35588f1ac52 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:08.417835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c819ed8b-9e07-401c-a49a-c35588f1ac52 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:08.426357 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c819ed8b-9e07-401c-a49a-c35588f1ac52 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1512 microversion: 2.1 time: 0.164106 Aug 25 14:15:08.426986 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3445/6956] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:08 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:09.449256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e0a92f14-e507-4ea6-8d4c-5aad67350d72 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:09.449999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e0a92f14-e507-4ea6-8d4c-5aad67350d72 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:09.456974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0a92f14-e507-4ea6-8d4c-5aad67350d72 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:09.457456 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0a92f14-e507-4ea6-8d4c-5aad67350d72 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:09.457990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0a92f14-e507-4ea6-8d4c-5aad67350d72 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:09.458639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0a92f14-e507-4ea6-8d4c-5aad67350d72 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:09.459093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0a92f14-e507-4ea6-8d4c-5aad67350d72 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:09.459521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0a92f14-e507-4ea6-8d4c-5aad67350d72 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:09.598879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e0a92f14-e507-4ea6-8d4c-5aad67350d72 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:09.608095 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e0a92f14-e507-4ea6-8d4c-5aad67350d72 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1512 microversion: 2.1 time: 0.163906 Aug 25 14:15:09.608758 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3512/6957] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:09 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:10.632554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-658b08bc-a425-47d4-a7ad-193972ebdb86 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:10.633182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-658b08bc-a425-47d4-a7ad-193972ebdb86 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:10.641275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-658b08bc-a425-47d4-a7ad-193972ebdb86 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:10.641818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-658b08bc-a425-47d4-a7ad-193972ebdb86 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:10.642279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-658b08bc-a425-47d4-a7ad-193972ebdb86 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:10.643202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-658b08bc-a425-47d4-a7ad-193972ebdb86 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:10.643685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-658b08bc-a425-47d4-a7ad-193972ebdb86 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:10.644316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-658b08bc-a425-47d4-a7ad-193972ebdb86 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:10.787950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-658b08bc-a425-47d4-a7ad-193972ebdb86 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55284c2d2374bc99a2c35170dfc2e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81354401bd9f4c768349d52223752dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:10.796832 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-658b08bc-a425-47d4-a7ad-193972ebdb86 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 200 len: 1512 microversion: 2.1 time: 0.168274 Aug 25 14:15:10.797646 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3446/6958] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:10 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:10.848547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4620fed4-09b1-4ada-9267-39c6be9b96ed req-eb155462-677f-4b28-97c5-814fdd30d0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f076c7b-a3be-4cd6-a6d8-bc39835aefce", "name": "network-vif-deleted", "tag": "e749681b-777b-4df2-bf91-b1783ef61324"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:10.859708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4620fed4-09b1-4ada-9267-39c6be9b96ed req-eb155462-677f-4b28-97c5-814fdd30d0a1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:10.860197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4620fed4-09b1-4ada-9267-39c6be9b96ed req-eb155462-677f-4b28-97c5-814fdd30d0a1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:10.860645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4620fed4-09b1-4ada-9267-39c6be9b96ed req-eb155462-677f-4b28-97c5-814fdd30d0a1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:10.874437 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4620fed4-09b1-4ada-9267-39c6be9b96ed req-eb155462-677f-4b28-97c5-814fdd30d0a1 service nova] Creating event network-vif-deleted:e749681b-777b-4df2-bf91-b1783ef61324 for instance 6f076c7b-a3be-4cd6-a6d8-bc39835aefce on n-h1-852771-8 Aug 25 14:15:10.880016 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4620fed4-09b1-4ada-9267-39c6be9b96ed req-eb155462-677f-4b28-97c5-814fdd30d0a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035332 Aug 25 14:15:10.881089 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3513/6959] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:11.819331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:11.819985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] [instance: 6f076c7b-a3be-4cd6-a6d8-bc39835aefce] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:11.828316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:11.828819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:11.829274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:11.830029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:11.830522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:11.830962 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:11.845876 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] HTTP exception thrown: Instance 6f076c7b-a3be-4cd6-a6d8-bc39835aefce could not be found. Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Request method failure captured: Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce HTTP/1.1 Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4PRro3vXp7VhN6UL4tN8h51xq2kv0uk_ogMfFZdUKH1LyAMki_9M_5VWCOPTULZMnNWL-ImbXotDdzdht_7GpcJVBlzqXpEEGudyjDKqCdOcYiJ9kmlhiVTOX_0fzJOB_137zQPtPdC56Ado8o__VuzZy4Y9n6Jq7aAJ6UCTj8yQV0 Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81354401bd9f4c768349d52223752dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81354401bd9f4c768349d52223752dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81354401bd9f4c768349d52223752dea"}]}] Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 81354401bd9f4c768349d52223752dea Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1121714514 Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: f55284c2d2374bc99a2c35170dfc2e1a Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-ServersNegativeTestJSON-1121714514-project Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 6f076c7b-a3be-4cd6-a6d8-bc39835aefce could not be found. Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '6f076c7b-a3be-4cd6-a6d8-bc39835aefce'} Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f076c7b-a3be-4cd6-a6d8-bc39835aefce could not be found. Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f076c7b-a3be-4cd6-a6d8-bc39835aefce could not be found. Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:11.847469 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:11.853434 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:11.853434 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:11.853434 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:11.853434 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:15:11.853434 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:15:11.853434 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f076c7b-a3be-4cd6-a6d8-bc39835aefce could not be found. Aug 25 14:15:11.853434 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:15:11.853434 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] Returning 404 to user: Instance 6f076c7b-a3be-4cd6-a6d8-bc39835aefce could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:15:11.853434 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b615859-166f-4cf9-b35e-8e0db62e3c66 tempest-ServersNegativeTestJSON-1121714514 tempest-ServersNegativeTestJSON-1121714514-project] 10.222.0.70 "GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce" status: 404 len: 111 microversion: 2.1 time: 0.033672 Aug 25 14:15:11.853434 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3447/6960] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:11 2022] GET /compute/v2.1/servers/6f076c7b-a3be-4cd6-a6d8-bc39835aefce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:15:49.321351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:49.330140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:49.601386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-133bfd36-c71c-4925-9f4f-e9fb2a44ff6f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Action: 'create', calling method: .version_select at 0x7f3a298958b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1591669624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXpbUEjNVAw6M9PJ6cZn8+afk1x7UyKuyjpCozFtYuDIuQeJ4hvMTJ3FwcWvdjgIZf7mAvVEYmeoOD23FzDsFHU/PCQe33oLpPYl9XPq3vrT5QM3cILr1rGEcAR5ai9uA=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:49.622377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-133bfd36-c71c-4925-9f4f-e9fb2a44ff6f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:15:49.629322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-133bfd36-c71c-4925-9f4f-e9fb2a44ff6f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for user 1b9dc7cff6f743f29b557567ad883ccc and project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:15:49.700769 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-133bfd36-c71c-4925-9f4f-e9fb2a44ff6f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.381822 Aug 25 14:15:49.703025 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3514/6961] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:15:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:49.791922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-781071429", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1591669624", "networks": [{"uuid": "9e98ca1d-4d75-4b18-8e53-a96fa083759c"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:49.808094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=54 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:49.809026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=14 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:49.868448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] validate_networks() for [('9e98ca1d-4d75-4b18-8e53-a96fa083759c', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:15:50.534565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:15:50.535005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:15:50.535497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:15:50.535926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:15:50.536353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:15:50.546711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:50.547397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:50.547864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:50.549591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:50.549591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:50.550057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:50.571199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:15:50.578278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for user 1b9dc7cff6f743f29b557567ad883ccc and project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:15:50.593684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:15:50.596124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:15:50.652861 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [9171309d-4152-41e9-b831-4e2dfe28864b] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:15:51.664188 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [9171309d-4152-41e9-b831-4e2dfe28864b] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 56430. Aug 25 14:15:51.683093 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-db227ace-bfe3-47ff-b1a9-1b770113881e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.899938 Aug 25 14:15:51.686933 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3448/6962] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:15:51.704957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-96e4b590-815f-44f5-85b2-1112646eb0b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:51.706510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-96e4b590-815f-44f5-85b2-1112646eb0b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:51.777631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-96e4b590-815f-44f5-85b2-1112646eb0b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:51.787019 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-96e4b590-815f-44f5-85b2-1112646eb0b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1262 microversion: 2.1 time: 0.091415 Aug 25 14:15:51.802490 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3515/6963] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:51 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1262 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:52.817972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0eb8ed0-b0d5-4157-b56b-63793954feaf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:52.818905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c0eb8ed0-b0d5-4157-b56b-63793954feaf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:52.827598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ed0-b0d5-4157-b56b-63793954feaf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:52.828245 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ed0-b0d5-4157-b56b-63793954feaf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:52.828812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ed0-b0d5-4157-b56b-63793954feaf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:52.829665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ed0-b0d5-4157-b56b-63793954feaf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:52.830177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ed0-b0d5-4157-b56b-63793954feaf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:52.830632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0eb8ed0-b0d5-4157-b56b-63793954feaf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:52.910796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c0eb8ed0-b0d5-4157-b56b-63793954feaf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:52.926860 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0eb8ed0-b0d5-4157-b56b-63793954feaf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.120409 Aug 25 14:15:52.927932 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3449/6964] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:52 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1314 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:53.954120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4ad7a592-f7f8-4fdc-a123-3b0444875611 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:53.955375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4ad7a592-f7f8-4fdc-a123-3b0444875611 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:53.970314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ad7a592-f7f8-4fdc-a123-3b0444875611 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:53.970825 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ad7a592-f7f8-4fdc-a123-3b0444875611 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:53.971277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ad7a592-f7f8-4fdc-a123-3b0444875611 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:53.972014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ad7a592-f7f8-4fdc-a123-3b0444875611 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:53.972477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ad7a592-f7f8-4fdc-a123-3b0444875611 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:53.977486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4ad7a592-f7f8-4fdc-a123-3b0444875611 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:54.182182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4ad7a592-f7f8-4fdc-a123-3b0444875611 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:54.195370 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4ad7a592-f7f8-4fdc-a123-3b0444875611 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1362 microversion: 2.1 time: 0.245148 Aug 25 14:15:54.196558 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3516/6965] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:53 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:54.644663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-00369eb2-9f59-4148-bbd3-15734edc37a6 req-660ac1c4-51d9-446a-948d-84d21db0cfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa5dcce-b89a-48a1-a0cc-95102856c5a5", "tag": "b763fcd8-f24b-4300-b8a0-1089c92347e3"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:54.661820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-00369eb2-9f59-4148-bbd3-15734edc37a6 req-660ac1c4-51d9-446a-948d-84d21db0cfe6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:54.662591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-00369eb2-9f59-4148-bbd3-15734edc37a6 req-660ac1c4-51d9-446a-948d-84d21db0cfe6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:54.663048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-00369eb2-9f59-4148-bbd3-15734edc37a6 req-660ac1c4-51d9-446a-948d-84d21db0cfe6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:54.679375 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-00369eb2-9f59-4148-bbd3-15734edc37a6 req-660ac1c4-51d9-446a-948d-84d21db0cfe6 service nova] Creating event network-changed:b763fcd8-f24b-4300-b8a0-1089c92347e3 for instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 on n-h1-852771-8 Aug 25 14:15:54.687176 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-00369eb2-9f59-4148-bbd3-15734edc37a6 req-660ac1c4-51d9-446a-948d-84d21db0cfe6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052463 Aug 25 14:15:54.688118 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3450/6966] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:55.217379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3c680e66-08a2-4abb-8d6d-414575e14dad tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:55.218047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3c680e66-08a2-4abb-8d6d-414575e14dad tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:55.225032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c680e66-08a2-4abb-8d6d-414575e14dad tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:55.225543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c680e66-08a2-4abb-8d6d-414575e14dad tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:55.226150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c680e66-08a2-4abb-8d6d-414575e14dad tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:55.226727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c680e66-08a2-4abb-8d6d-414575e14dad tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:55.227183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c680e66-08a2-4abb-8d6d-414575e14dad tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:55.227610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3c680e66-08a2-4abb-8d6d-414575e14dad tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:55.370288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3c680e66-08a2-4abb-8d6d-414575e14dad tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:55.378350 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3c680e66-08a2-4abb-8d6d-414575e14dad tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1362 microversion: 2.1 time: 0.164903 Aug 25 14:15:55.378922 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3517/6967] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:55 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:56.401555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-65a5ea9d-6d02-40a2-b4e0-9d2501badbff tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:56.402322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-65a5ea9d-6d02-40a2-b4e0-9d2501badbff tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:56.410194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65a5ea9d-6d02-40a2-b4e0-9d2501badbff tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:56.410931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65a5ea9d-6d02-40a2-b4e0-9d2501badbff tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:56.411319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65a5ea9d-6d02-40a2-b4e0-9d2501badbff tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:56.412242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65a5ea9d-6d02-40a2-b4e0-9d2501badbff tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:56.412242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65a5ea9d-6d02-40a2-b4e0-9d2501badbff tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:56.413153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-65a5ea9d-6d02-40a2-b4e0-9d2501badbff tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:56.557771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-65a5ea9d-6d02-40a2-b4e0-9d2501badbff tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:56.567085 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-65a5ea9d-6d02-40a2-b4e0-9d2501badbff tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1362 microversion: 2.1 time: 0.170762 Aug 25 14:15:56.567725 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3451/6968] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:56 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:15:57.591742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d63eb291-60ba-48c8-adf3-db20f3118b7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:57.592368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d63eb291-60ba-48c8-adf3-db20f3118b7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:57.599762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d63eb291-60ba-48c8-adf3-db20f3118b7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:57.600877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d63eb291-60ba-48c8-adf3-db20f3118b7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:57.601323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d63eb291-60ba-48c8-adf3-db20f3118b7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:57.602523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d63eb291-60ba-48c8-adf3-db20f3118b7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:57.603123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d63eb291-60ba-48c8-adf3-db20f3118b7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:57.604073 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d63eb291-60ba-48c8-adf3-db20f3118b7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:57.761689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d63eb291-60ba-48c8-adf3-db20f3118b7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:57.770783 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d63eb291-60ba-48c8-adf3-db20f3118b7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1362 microversion: 2.1 time: 0.184187 Aug 25 14:15:57.771416 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3518/6969] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:57 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:58.792762 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-96945770-f72e-4426-ba24-82ad8decd07c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:58.793563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-96945770-f72e-4426-ba24-82ad8decd07c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:58.800515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96945770-f72e-4426-ba24-82ad8decd07c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:58.801022 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96945770-f72e-4426-ba24-82ad8decd07c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:58.801483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96945770-f72e-4426-ba24-82ad8decd07c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:58.802231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96945770-f72e-4426-ba24-82ad8decd07c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:58.802707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96945770-f72e-4426-ba24-82ad8decd07c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:58.803158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-96945770-f72e-4426-ba24-82ad8decd07c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:58.945215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-96945770-f72e-4426-ba24-82ad8decd07c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:58.954558 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-96945770-f72e-4426-ba24-82ad8decd07c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1362 microversion: 2.1 time: 0.166162 Aug 25 14:15:58.955155 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3452/6970] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:58 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:59.638028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-8faf8958-a271-427b-b137-19ab43909ec3 req-42fc1faf-3a71-4c72-b22d-83405817ac72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa5dcce-b89a-48a1-a0cc-95102856c5a5", "name": "network-vif-plugged", "status": "completed", "tag": "b763fcd8-f24b-4300-b8a0-1089c92347e3"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:59.649103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8faf8958-a271-427b-b137-19ab43909ec3 req-42fc1faf-3a71-4c72-b22d-83405817ac72 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:59.650865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8faf8958-a271-427b-b137-19ab43909ec3 req-42fc1faf-3a71-4c72-b22d-83405817ac72 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:59.651631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-8faf8958-a271-427b-b137-19ab43909ec3 req-42fc1faf-3a71-4c72-b22d-83405817ac72 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:59.667760 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-8faf8958-a271-427b-b137-19ab43909ec3 req-42fc1faf-3a71-4c72-b22d-83405817ac72 service nova] Creating event network-vif-plugged:b763fcd8-f24b-4300-b8a0-1089c92347e3 for instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 on n-h1-852771-8 Aug 25 14:15:59.673869 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-8faf8958-a271-427b-b137-19ab43909ec3 req-42fc1faf-3a71-4c72-b22d-83405817ac72 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040659 Aug 25 14:15:59.674496 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3519/6971] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:59.976040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4701a838-eb46-411e-a8ae-94697bccaadd tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:59.976668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4701a838-eb46-411e-a8ae-94697bccaadd tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:59.984570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4701a838-eb46-411e-a8ae-94697bccaadd tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:59.985080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4701a838-eb46-411e-a8ae-94697bccaadd tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:59.985562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4701a838-eb46-411e-a8ae-94697bccaadd tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:59.986398 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4701a838-eb46-411e-a8ae-94697bccaadd tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:59.986882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4701a838-eb46-411e-a8ae-94697bccaadd tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:59.987365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4701a838-eb46-411e-a8ae-94697bccaadd tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:00.127567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4701a838-eb46-411e-a8ae-94697bccaadd tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:00.137279 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4701a838-eb46-411e-a8ae-94697bccaadd tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1362 microversion: 2.1 time: 0.165019 Aug 25 14:16:00.137919 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3453/6972] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:59 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:01.159461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6e99cb7e-78dd-42ad-b75d-f4d40bedd467 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:01.160253 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6e99cb7e-78dd-42ad-b75d-f4d40bedd467 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:01.167787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e99cb7e-78dd-42ad-b75d-f4d40bedd467 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:01.168391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e99cb7e-78dd-42ad-b75d-f4d40bedd467 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:01.168743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e99cb7e-78dd-42ad-b75d-f4d40bedd467 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:01.169484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e99cb7e-78dd-42ad-b75d-f4d40bedd467 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:01.169978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e99cb7e-78dd-42ad-b75d-f4d40bedd467 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:01.170411 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6e99cb7e-78dd-42ad-b75d-f4d40bedd467 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:01.326188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6e99cb7e-78dd-42ad-b75d-f4d40bedd467 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:01.334353 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6e99cb7e-78dd-42ad-b75d-f4d40bedd467 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1362 microversion: 2.1 time: 0.180198 Aug 25 14:16:01.334942 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3520/6973] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:01 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:02.356614 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f4469208-b2d6-4678-9ad8-5f2c59097633 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:02.357207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f4469208-b2d6-4678-9ad8-5f2c59097633 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:02.359201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:02.359932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:02.367301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4469208-b2d6-4678-9ad8-5f2c59097633 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:02.367809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4469208-b2d6-4678-9ad8-5f2c59097633 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:02.368271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4469208-b2d6-4678-9ad8-5f2c59097633 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:02.369532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4469208-b2d6-4678-9ad8-5f2c59097633 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:02.370020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4469208-b2d6-4678-9ad8-5f2c59097633 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:02.370466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4469208-b2d6-4678-9ad8-5f2c59097633 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:02.518744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f4469208-b2d6-4678-9ad8-5f2c59097633 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:02.527719 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f4469208-b2d6-4678-9ad8-5f2c59097633 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1553 microversion: 2.1 time: 0.175104 Aug 25 14:16:02.528319 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3454/6974] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:02 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:02.548404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-282f476b-927c-4d90-af18-57c533b3b052 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:02.549017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-282f476b-927c-4d90-af18-57c533b3b052 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:02.551150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:02.559270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282f476b-927c-4d90-af18-57c533b3b052 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:02.559826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282f476b-927c-4d90-af18-57c533b3b052 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:02.560222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282f476b-927c-4d90-af18-57c533b3b052 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:02.561070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282f476b-927c-4d90-af18-57c533b3b052 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:02.561406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282f476b-927c-4d90-af18-57c533b3b052 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:02.561868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-282f476b-927c-4d90-af18-57c533b3b052 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:02.706401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-282f476b-927c-4d90-af18-57c533b3b052 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:02.715343 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-282f476b-927c-4d90-af18-57c533b3b052 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1553 microversion: 2.1 time: 0.170879 Aug 25 14:16:02.715928 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3521/6975] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:02 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:04.372975 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16ef1490-9c60-4e91-82b3-10260086a7ef tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c5d1b31-43ec-4fef-aac5-2c70090add87"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:04.375565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-16ef1490-9c60-4e91-82b3-10260086a7ef tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:04.382822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16ef1490-9c60-4e91-82b3-10260086a7ef tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:04.383326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16ef1490-9c60-4e91-82b3-10260086a7ef tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:04.383789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16ef1490-9c60-4e91-82b3-10260086a7ef tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:04.384518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16ef1490-9c60-4e91-82b3-10260086a7ef tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:04.384988 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16ef1490-9c60-4e91-82b3-10260086a7ef tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:04.385440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16ef1490-9c60-4e91-82b3-10260086a7ef tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:04.775578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-16ef1490-9c60-4e91-82b3-10260086a7ef tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "POST /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399956 Aug 25 14:16:04.777706 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3455/6976] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 14:16:04 2022] POST /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:16.669944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-622687cf-cafa-4d0f-ae7c-96301f9d7e68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:16.670530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-622687cf-cafa-4d0f-ae7c-96301f9d7e68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:16.673369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:16.674143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=32 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:16.680325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-622687cf-cafa-4d0f-ae7c-96301f9d7e68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:16.680815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-622687cf-cafa-4d0f-ae7c-96301f9d7e68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:16.681251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-622687cf-cafa-4d0f-ae7c-96301f9d7e68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:16.681982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-622687cf-cafa-4d0f-ae7c-96301f9d7e68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:16.682511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-622687cf-cafa-4d0f-ae7c-96301f9d7e68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:16.682988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-622687cf-cafa-4d0f-ae7c-96301f9d7e68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:16.770958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-622687cf-cafa-4d0f-ae7c-96301f9d7e68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lazy-loading 'services' on Instance uuid 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:16:16.847257 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-622687cf-cafa-4d0f-ae7c-96301f9d7e68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments/0c5d1b31-43ec-4fef-aac5-2c70090add87" status: 202 len: 0 microversion: 2.1 time: 0.181979 Aug 25 14:16:16.848880 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3522/6977] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 14:16:16 2022] DELETE /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments/0c5d1b31-43ec-4fef-aac5-2c70090add87 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:16:16.856225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:16.857188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:16.861836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-04f7223c-db18-44f3-81b8-af73ec682183 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:16.864322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-04f7223c-db18-44f3-81b8-af73ec682183 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:16.873819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f7223c-db18-44f3-81b8-af73ec682183 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:16.874326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f7223c-db18-44f3-81b8-af73ec682183 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:16.874776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f7223c-db18-44f3-81b8-af73ec682183 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:16.875501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f7223c-db18-44f3-81b8-af73ec682183 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:16.875971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f7223c-db18-44f3-81b8-af73ec682183 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:16.876413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-04f7223c-db18-44f3-81b8-af73ec682183 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:16.910640 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-04f7223c-db18-44f3-81b8-af73ec682183 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057059 Aug 25 14:16:16.911233 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3456/6978] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:16 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:17.926283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9f85b79-c345-458b-a0d9-dfd564951384 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:17.928597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c9f85b79-c345-458b-a0d9-dfd564951384 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:17.936335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f85b79-c345-458b-a0d9-dfd564951384 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:17.936834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f85b79-c345-458b-a0d9-dfd564951384 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:17.937284 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f85b79-c345-458b-a0d9-dfd564951384 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:17.938074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f85b79-c345-458b-a0d9-dfd564951384 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:17.938505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f85b79-c345-458b-a0d9-dfd564951384 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:17.938940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f85b79-c345-458b-a0d9-dfd564951384 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:17.974318 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9f85b79-c345-458b-a0d9-dfd564951384 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053646 Aug 25 14:16:17.974945 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3523/6979] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:17 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:18.987455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-246805e2-81ee-4679-8c88-9f906026e8b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:18.990147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-246805e2-81ee-4679-8c88-9f906026e8b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:18.998040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246805e2-81ee-4679-8c88-9f906026e8b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:18.998581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246805e2-81ee-4679-8c88-9f906026e8b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:18.999035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246805e2-81ee-4679-8c88-9f906026e8b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:18.999768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246805e2-81ee-4679-8c88-9f906026e8b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:19.000241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246805e2-81ee-4679-8c88-9f906026e8b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:19.000686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-246805e2-81ee-4679-8c88-9f906026e8b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:19.036988 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-246805e2-81ee-4679-8c88-9f906026e8b0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053632 Aug 25 14:16:19.037607 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3457/6980] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:18 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:20.050798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d4f4b8c-056c-4341-b771-0cd6db4e980b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:20.053183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9d4f4b8c-056c-4341-b771-0cd6db4e980b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:20.060344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d4f4b8c-056c-4341-b771-0cd6db4e980b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:20.060873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d4f4b8c-056c-4341-b771-0cd6db4e980b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:20.061277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d4f4b8c-056c-4341-b771-0cd6db4e980b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:20.062034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d4f4b8c-056c-4341-b771-0cd6db4e980b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:20.062499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d4f4b8c-056c-4341-b771-0cd6db4e980b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:20.062930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d4f4b8c-056c-4341-b771-0cd6db4e980b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:20.098501 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d4f4b8c-056c-4341-b771-0cd6db4e980b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052775 Aug 25 14:16:20.099112 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3524/6981] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:20 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:21.118860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0beceff-a952-4a6e-b2f6-c9ec02cf9268 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:21.122932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e0beceff-a952-4a6e-b2f6-c9ec02cf9268 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:21.130936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0beceff-a952-4a6e-b2f6-c9ec02cf9268 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:21.131775 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0beceff-a952-4a6e-b2f6-c9ec02cf9268 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:21.132479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0beceff-a952-4a6e-b2f6-c9ec02cf9268 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:21.133450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0beceff-a952-4a6e-b2f6-c9ec02cf9268 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:21.134474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0beceff-a952-4a6e-b2f6-c9ec02cf9268 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:21.134474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0beceff-a952-4a6e-b2f6-c9ec02cf9268 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:21.169575 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0beceff-a952-4a6e-b2f6-c9ec02cf9268 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061545 Aug 25 14:16:21.170358 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3458/6982] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:21 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:22.183567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08b42d91-48f7-4c9c-b3ef-5fe60d005ec9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:22.187464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-08b42d91-48f7-4c9c-b3ef-5fe60d005ec9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:22.201130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08b42d91-48f7-4c9c-b3ef-5fe60d005ec9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:22.202151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08b42d91-48f7-4c9c-b3ef-5fe60d005ec9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:22.202959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08b42d91-48f7-4c9c-b3ef-5fe60d005ec9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:22.204002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08b42d91-48f7-4c9c-b3ef-5fe60d005ec9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:22.204826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08b42d91-48f7-4c9c-b3ef-5fe60d005ec9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:22.205388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08b42d91-48f7-4c9c-b3ef-5fe60d005ec9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:22.249985 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-08b42d91-48f7-4c9c-b3ef-5fe60d005ec9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071355 Aug 25 14:16:22.250615 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3525/6983] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:22 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 14:16:22.262456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:22.263265 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:22.271391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:22.271914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:22.272412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:22.273172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:22.273706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:22.274166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:22.366319 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] HTTP exception thrown: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 is not attached to volume 0c5d1b31-43ec-4fef-aac5-2c70090add87 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Request method failure captured: Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments/0c5d1b31-43ec-4fef-aac5-2c70090add87 HTTP/1.1 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4QOWws1eZ5Exd_oNamwoPBCbXiUDRLl6rkE4dD7szEIvW-JeO3iFaI-OhmTESqctQOjWadX6rJt0jEkItlsHuHOjZHt-37KG02CaSWB-mkglMOfEwyiJHlqJMrDQxmbVi6Gafayv4ZmYTXOVtN5cYmrJktH0EoprnEvVn21ZMDTBkk Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f73a294f4a574dc2bcb6030cbccbc703", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}] Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1b9dc7cff6f743f29b557567ad883ccc Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 is not attached to volume 0c5d1b31-43ec-4fef-aac5-2c70090add87 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'server_id': '3fa5dcce-b89a-48a1-a0cc-95102856c5a5', 'id': '0c5d1b31-43ec-4fef-aac5-2c70090add87'} Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0c5d1b31-43ec-4fef-aac5-2c70090add87. Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 is not attached to volume 0c5d1b31-43ec-4fef-aac5-2c70090add87 Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:16:22.380376 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:16:22.385953 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:16:22.385953 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:16:22.385953 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 is not attached to volume 0c5d1b31-43ec-4fef-aac5-2c70090add87 Aug 25 14:16:22.385953 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:16:22.385953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Returning 404 to user: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 is not attached to volume 0c5d1b31-43ec-4fef-aac5-2c70090add87 {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:16:22.385953 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3c7844d0-e0b0-457e-a60c-e5d2b7abf1c4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments/0c5d1b31-43ec-4fef-aac5-2c70090add87" status: 404 len: 154 microversion: 2.1 time: 0.124571 Aug 25 14:16:22.385953 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3459/6984] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 14:16:22 2022] DELETE /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5/os-volume_attachments/0c5d1b31-43ec-4fef-aac5-2c70090add87 => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:16:25.879649 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5962cc2e-8dfb-45a4-978f-f1419e9f0e45 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:25.880543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5962cc2e-8dfb-45a4-978f-f1419e9f0e45 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:25.890856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5962cc2e-8dfb-45a4-978f-f1419e9f0e45 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:25.892795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5962cc2e-8dfb-45a4-978f-f1419e9f0e45 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:25.893886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5962cc2e-8dfb-45a4-978f-f1419e9f0e45 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:25.895222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5962cc2e-8dfb-45a4-978f-f1419e9f0e45 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:25.896398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5962cc2e-8dfb-45a4-978f-f1419e9f0e45 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:25.897568 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5962cc2e-8dfb-45a4-978f-f1419e9f0e45 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:25.946995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5962cc2e-8dfb-45a4-978f-f1419e9f0e45 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:16:26.106234 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5962cc2e-8dfb-45a4-978f-f1419e9f0e45 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 204 len: 0 microversion: 2.1 time: 0.228369 Aug 25 14:16:26.108519 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3526/6985] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:16:25 2022] DELETE /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:16:26.122870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d3c2a3a-c3a0-4f49-b7b6-843f2d252b92 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:26.124145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8d3c2a3a-c3a0-4f49-b7b6-843f2d252b92 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:26.138357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3c2a3a-c3a0-4f49-b7b6-843f2d252b92 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:26.139295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3c2a3a-c3a0-4f49-b7b6-843f2d252b92 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:26.140155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3c2a3a-c3a0-4f49-b7b6-843f2d252b92 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:26.141564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3c2a3a-c3a0-4f49-b7b6-843f2d252b92 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:26.142467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3c2a3a-c3a0-4f49-b7b6-843f2d252b92 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:26.143305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d3c2a3a-c3a0-4f49-b7b6-843f2d252b92 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:26.380897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d3c2a3a-c3a0-4f49-b7b6-843f2d252b92 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:26.396578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d3c2a3a-c3a0-4f49-b7b6-843f2d252b92 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1559 microversion: 2.1 time: 0.281201 Aug 25 14:16:26.397550 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3460/6986] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:26 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1559 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:27.437077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bba346b3-349f-49ad-9860-cb56b7f49ad4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:27.437734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bba346b3-349f-49ad-9860-cb56b7f49ad4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:27.445256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba346b3-349f-49ad-9860-cb56b7f49ad4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:27.445811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba346b3-349f-49ad-9860-cb56b7f49ad4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:27.446344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba346b3-349f-49ad-9860-cb56b7f49ad4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:27.447087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba346b3-349f-49ad-9860-cb56b7f49ad4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:27.447596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba346b3-349f-49ad-9860-cb56b7f49ad4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:27.448106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bba346b3-349f-49ad-9860-cb56b7f49ad4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:27.601408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bba346b3-349f-49ad-9860-cb56b7f49ad4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:27.610857 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bba346b3-349f-49ad-9860-cb56b7f49ad4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1559 microversion: 2.1 time: 0.178854 Aug 25 14:16:27.615120 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3527/6987] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:27 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:16:28.634535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0c6b6722-973a-4dcc-b75e-9a2264ee5c4b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:28.635330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0c6b6722-973a-4dcc-b75e-9a2264ee5c4b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:28.643957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c6b6722-973a-4dcc-b75e-9a2264ee5c4b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:28.644469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c6b6722-973a-4dcc-b75e-9a2264ee5c4b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:28.644931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c6b6722-973a-4dcc-b75e-9a2264ee5c4b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:28.645706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c6b6722-973a-4dcc-b75e-9a2264ee5c4b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:28.646439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c6b6722-973a-4dcc-b75e-9a2264ee5c4b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:28.647109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0c6b6722-973a-4dcc-b75e-9a2264ee5c4b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:28.676149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a8fb8283-32a6-4d0c-8097-b7f07f78490c req-815a9249-cf94-4112-b167-1bea0d84cf1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa5dcce-b89a-48a1-a0cc-95102856c5a5", "name": "network-vif-deleted", "tag": "b763fcd8-f24b-4300-b8a0-1089c92347e3"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:28.689593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a8fb8283-32a6-4d0c-8097-b7f07f78490c req-815a9249-cf94-4112-b167-1bea0d84cf1c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:28.691384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a8fb8283-32a6-4d0c-8097-b7f07f78490c req-815a9249-cf94-4112-b167-1bea0d84cf1c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:28.691861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a8fb8283-32a6-4d0c-8097-b7f07f78490c req-815a9249-cf94-4112-b167-1bea0d84cf1c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:28.717853 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a8fb8283-32a6-4d0c-8097-b7f07f78490c req-815a9249-cf94-4112-b167-1bea0d84cf1c service nova] Creating event network-vif-deleted:b763fcd8-f24b-4300-b8a0-1089c92347e3 for instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 on n-h1-852771-8 Aug 25 14:16:28.726401 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a8fb8283-32a6-4d0c-8097-b7f07f78490c req-815a9249-cf94-4112-b167-1bea0d84cf1c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054492 Aug 25 14:16:28.727857 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3528/6988] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:28.755093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0c6b6722-973a-4dcc-b75e-9a2264ee5c4b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:28.765000 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0c6b6722-973a-4dcc-b75e-9a2264ee5c4b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 200 len: 1517 microversion: 2.1 time: 0.135029 Aug 25 14:16:28.767233 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3461/6989] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:28 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 1517 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:29.789358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:29.790004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 3fa5dcce-b89a-48a1-a0cc-95102856c5a5] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:29.796902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:29.797383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:29.797850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:29.798557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:29.799006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:29.799433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:29.815046 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] HTTP exception thrown: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 could not be found. Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Request method failure captured: Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 HTTP/1.1 Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4QOWws1eZ5Exd_oNamwoPBCbXiUDRLl6rkE4dD7szEIvW-JeO3iFaI-OhmTESqctQOjWadX6rJt0jEkItlsHuHOjZHt-37KG02CaSWB-mkglMOfEwyiJHlqJMrDQxmbVi6Gafayv4ZmYTXOVtN5cYmrJktH0EoprnEvVn21ZMDTBkk Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f73a294f4a574dc2bcb6030cbccbc703", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}] Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1b9dc7cff6f743f29b557567ad883ccc Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 could not be found. Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '3fa5dcce-b89a-48a1-a0cc-95102856c5a5'} Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 could not be found. Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 could not be found. Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:16:29.816719 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:16:29.821178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:16:29.821178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:16:29.821178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:16:29.821178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:16:29.821178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:16:29.821178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 could not be found. Aug 25 14:16:29.821178 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:16:29.821178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Returning 404 to user: Instance 3fa5dcce-b89a-48a1-a0cc-95102856c5a5 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:16:29.821178 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bb5089a3-783a-4b15-bdb0-a1089fc2f306 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5" status: 404 len: 111 microversion: 2.1 time: 0.034141 Aug 25 14:16:29.821178 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3529/6990] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:29 2022] GET /compute/v2.1/servers/3fa5dcce-b89a-48a1-a0cc-95102856c5a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:16:29.831856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff80a0c6-8979-4a29-a3cd-e3907ee49057 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '.version_select at 0x7f3a2a59db80>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:29.870914 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff80a0c6-8979-4a29-a3cd-e3907ee49057 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1591669624" status: 202 len: 0 microversion: 2.1 time: 0.045901 Aug 25 14:16:29.871856 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3462/6991] 10.222.0.70 () {58 vars in 1278 bytes} [Thu Aug 25 14:16:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1591669624 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:16:29.896115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9bb98657-3339-403f-8b83-f3331615b65e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Action: 'create', calling method: .version_select at 0x7f3a29ba14c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1638500253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxvq0KulwM595jAIuMAJQw1YNli4deeYjJ2b9cpIUkk+Uv/tntIpyIGWMrFpE/wA/rupy/YU3IoybotqaJm9oHUTacRQfF2WEEobyWlWVhP6FU/98356YaqegRwYq2oyQ=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:29.914131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-9bb98657-3339-403f-8b83-f3331615b65e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:16:29.921030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-9bb98657-3339-403f-8b83-f3331615b65e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for user 1b9dc7cff6f743f29b557567ad883ccc and project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:16:29.948913 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9bb98657-3339-403f-8b83-f3331615b65e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.056044 Aug 25 14:16:29.949739 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3530/6992] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:16:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:30.004606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-99588398", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1638500253", "networks": [{"uuid": "9e98ca1d-4d75-4b18-8e53-a96fa083759c"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:30.065057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] validate_networks() for [('9e98ca1d-4d75-4b18-8e53-a96fa083759c', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:16:30.493443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:16:30.493944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:16:30.494442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:16:30.495490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:16:30.495928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:16:30.505677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:30.506184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:30.506642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:30.507389 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:30.507860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:30.508781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:30.530915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:16:30.536883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for user 1b9dc7cff6f743f29b557567ad883ccc and project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:16:30.550593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:16:30.552893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:16:30.604727 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0b5bb45d-e451-431b-93ea-52aae31a8a56 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605916 Aug 25 14:16:30.605712 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3463/6993] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:16:30.617235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c3efb23b-be3f-43d5-a236-150b4c3025fb tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:30.617923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c3efb23b-be3f-43d5-a236-150b4c3025fb tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:30.677070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c3efb23b-be3f-43d5-a236-150b4c3025fb tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:30.695130 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c3efb23b-be3f-43d5-a236-150b4c3025fb tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1261 microversion: 2.1 time: 0.081995 Aug 25 14:16:30.695737 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3531/6994] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:30 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:16:31.718405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-478a844b-2598-4382-81f2-4426bbb98c53 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:31.719940 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-478a844b-2598-4382-81f2-4426bbb98c53 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:31.727269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-478a844b-2598-4382-81f2-4426bbb98c53 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:31.727885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-478a844b-2598-4382-81f2-4426bbb98c53 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:31.728437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-478a844b-2598-4382-81f2-4426bbb98c53 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:31.729288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-478a844b-2598-4382-81f2-4426bbb98c53 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:31.730417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-478a844b-2598-4382-81f2-4426bbb98c53 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:31.730851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-478a844b-2598-4382-81f2-4426bbb98c53 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:31.802809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-478a844b-2598-4382-81f2-4426bbb98c53 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:31.812052 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-478a844b-2598-4382-81f2-4426bbb98c53 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1331 microversion: 2.1 time: 0.099307 Aug 25 14:16:31.812762 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3464/6995] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:31 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:32.834751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f8dfe29d-f958-4108-9a3b-8f4e28ea90af tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:32.835413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f8dfe29d-f958-4108-9a3b-8f4e28ea90af tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:32.843584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8dfe29d-f958-4108-9a3b-8f4e28ea90af tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:32.844087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8dfe29d-f958-4108-9a3b-8f4e28ea90af tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:32.844534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8dfe29d-f958-4108-9a3b-8f4e28ea90af tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:32.845497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8dfe29d-f958-4108-9a3b-8f4e28ea90af tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:32.845762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8dfe29d-f958-4108-9a3b-8f4e28ea90af tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:32.846196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f8dfe29d-f958-4108-9a3b-8f4e28ea90af tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:33.008665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f8dfe29d-f958-4108-9a3b-8f4e28ea90af tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:33.017807 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f8dfe29d-f958-4108-9a3b-8f4e28ea90af tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1361 microversion: 2.1 time: 0.187003 Aug 25 14:16:33.018411 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3532/6996] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:32 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:33.074748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2489e87d-f01e-46f8-93b8-db268baadd94 req-fbf5885a-5e5f-4551-80be-6627089a9cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38bfa9f9-0739-41cc-b185-e1029531c778", "tag": "798cba9a-1d1f-4934-9413-6cc5b5041230"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:33.087148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2489e87d-f01e-46f8-93b8-db268baadd94 req-fbf5885a-5e5f-4551-80be-6627089a9cb3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:33.087651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2489e87d-f01e-46f8-93b8-db268baadd94 req-fbf5885a-5e5f-4551-80be-6627089a9cb3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:33.088141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2489e87d-f01e-46f8-93b8-db268baadd94 req-fbf5885a-5e5f-4551-80be-6627089a9cb3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:33.101535 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2489e87d-f01e-46f8-93b8-db268baadd94 req-fbf5885a-5e5f-4551-80be-6627089a9cb3 service nova] Creating event network-changed:798cba9a-1d1f-4934-9413-6cc5b5041230 for instance 38bfa9f9-0739-41cc-b185-e1029531c778 on n-h2-852771-8 Aug 25 14:16:33.108476 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2489e87d-f01e-46f8-93b8-db268baadd94 req-fbf5885a-5e5f-4551-80be-6627089a9cb3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037803 Aug 25 14:16:33.109411 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3465/6997] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:16:34.040985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e0336432-a39c-4494-a081-8a88d1d1d7ac tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:34.042676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e0336432-a39c-4494-a081-8a88d1d1d7ac tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:34.049529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0336432-a39c-4494-a081-8a88d1d1d7ac tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:34.050044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0336432-a39c-4494-a081-8a88d1d1d7ac tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:34.050576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0336432-a39c-4494-a081-8a88d1d1d7ac tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:34.051196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0336432-a39c-4494-a081-8a88d1d1d7ac tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:34.051811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0336432-a39c-4494-a081-8a88d1d1d7ac tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:34.052118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0336432-a39c-4494-a081-8a88d1d1d7ac tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:34.214226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e0336432-a39c-4494-a081-8a88d1d1d7ac tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:34.223907 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e0336432-a39c-4494-a081-8a88d1d1d7ac tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1361 microversion: 2.1 time: 0.186841 Aug 25 14:16:34.224523 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3533/6998] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:34 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:35.248314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d103eadd-d667-4c5e-927a-92f76475a40d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:35.249319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d103eadd-d667-4c5e-927a-92f76475a40d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:35.256747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d103eadd-d667-4c5e-927a-92f76475a40d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:35.257851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d103eadd-d667-4c5e-927a-92f76475a40d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:35.257851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d103eadd-d667-4c5e-927a-92f76475a40d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:35.258537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d103eadd-d667-4c5e-927a-92f76475a40d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:35.259017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d103eadd-d667-4c5e-927a-92f76475a40d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:35.259466 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d103eadd-d667-4c5e-927a-92f76475a40d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:35.419324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d103eadd-d667-4c5e-927a-92f76475a40d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:35.428128 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d103eadd-d667-4c5e-927a-92f76475a40d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1361 microversion: 2.1 time: 0.185935 Aug 25 14:16:35.429224 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3466/6999] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:35 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:16:36.451122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ca16dd7b-542f-4986-bc91-0f4d1a10deea tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:36.451932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ca16dd7b-542f-4986-bc91-0f4d1a10deea tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:36.459797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca16dd7b-542f-4986-bc91-0f4d1a10deea tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:36.460403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca16dd7b-542f-4986-bc91-0f4d1a10deea tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:36.460856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca16dd7b-542f-4986-bc91-0f4d1a10deea tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:36.461638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca16dd7b-542f-4986-bc91-0f4d1a10deea tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:36.462101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca16dd7b-542f-4986-bc91-0f4d1a10deea tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:36.462561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca16dd7b-542f-4986-bc91-0f4d1a10deea tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:36.625733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ca16dd7b-542f-4986-bc91-0f4d1a10deea tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:36.635283 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ca16dd7b-542f-4986-bc91-0f4d1a10deea tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1361 microversion: 2.1 time: 0.189376 Aug 25 14:16:36.636598 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3534/7000] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:36 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:16:37.661263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-43cb320b-b2c5-4619-b142-6e246fe2c151 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:37.662267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-43cb320b-b2c5-4619-b142-6e246fe2c151 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:37.672026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cb320b-b2c5-4619-b142-6e246fe2c151 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:37.672589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cb320b-b2c5-4619-b142-6e246fe2c151 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:37.673185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cb320b-b2c5-4619-b142-6e246fe2c151 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:37.674333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cb320b-b2c5-4619-b142-6e246fe2c151 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:37.675135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cb320b-b2c5-4619-b142-6e246fe2c151 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:37.675702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cb320b-b2c5-4619-b142-6e246fe2c151 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:37.835674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-43cb320b-b2c5-4619-b142-6e246fe2c151 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:37.845099 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-43cb320b-b2c5-4619-b142-6e246fe2c151 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1361 microversion: 2.1 time: 0.189983 Aug 25 14:16:37.845873 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3467/7001] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:37 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:38.868165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6d028ce9-a928-4c93-8c10-f0184a707ed7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:38.869117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6d028ce9-a928-4c93-8c10-f0184a707ed7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:38.876542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d028ce9-a928-4c93-8c10-f0184a707ed7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:38.877160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d028ce9-a928-4c93-8c10-f0184a707ed7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:38.877709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d028ce9-a928-4c93-8c10-f0184a707ed7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:38.878496 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d028ce9-a928-4c93-8c10-f0184a707ed7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:38.879021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d028ce9-a928-4c93-8c10-f0184a707ed7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:38.879543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6d028ce9-a928-4c93-8c10-f0184a707ed7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:38.994479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-076fbdad-8f6c-400b-a156-9944a004beba req-731416ef-7374-4960-995e-8c77fe3955d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bfa9f9-0739-41cc-b185-e1029531c778", "name": "network-vif-plugged", "status": "completed", "tag": "798cba9a-1d1f-4934-9413-6cc5b5041230"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:39.006638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-076fbdad-8f6c-400b-a156-9944a004beba req-731416ef-7374-4960-995e-8c77fe3955d8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:39.007147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-076fbdad-8f6c-400b-a156-9944a004beba req-731416ef-7374-4960-995e-8c77fe3955d8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:39.008606 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-076fbdad-8f6c-400b-a156-9944a004beba req-731416ef-7374-4960-995e-8c77fe3955d8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:39.022151 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-076fbdad-8f6c-400b-a156-9944a004beba req-731416ef-7374-4960-995e-8c77fe3955d8 service nova] Creating event network-vif-plugged:798cba9a-1d1f-4934-9413-6cc5b5041230 for instance 38bfa9f9-0739-41cc-b185-e1029531c778 on n-h2-852771-8 Aug 25 14:16:39.028624 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-076fbdad-8f6c-400b-a156-9944a004beba req-731416ef-7374-4960-995e-8c77fe3955d8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111849 Aug 25 14:16:39.029253 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3468/7002] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:16:39.083894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6d028ce9-a928-4c93-8c10-f0184a707ed7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:39.097765 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6d028ce9-a928-4c93-8c10-f0184a707ed7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1361 microversion: 2.1 time: 0.234070 Aug 25 14:16:39.098917 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3535/7003] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:38 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:16:40.122023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1ba2324-c697-406e-a86b-ce994d546e10 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:40.122803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c1ba2324-c697-406e-a86b-ce994d546e10 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:40.129337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1ba2324-c697-406e-a86b-ce994d546e10 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:40.129886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1ba2324-c697-406e-a86b-ce994d546e10 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:40.130346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1ba2324-c697-406e-a86b-ce994d546e10 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:40.131075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1ba2324-c697-406e-a86b-ce994d546e10 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:40.131539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1ba2324-c697-406e-a86b-ce994d546e10 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:40.131981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1ba2324-c697-406e-a86b-ce994d546e10 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:40.286735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c1ba2324-c697-406e-a86b-ce994d546e10 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:40.296114 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c1ba2324-c697-406e-a86b-ce994d546e10 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1361 microversion: 2.1 time: 0.179221 Aug 25 14:16:40.297169 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3469/7004] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:40 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:41.319365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-631bdb59-ddc9-4495-9c8d-c05e6721439c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:41.319913 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-631bdb59-ddc9-4495-9c8d-c05e6721439c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:41.322893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:41.328915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-631bdb59-ddc9-4495-9c8d-c05e6721439c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:41.329406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-631bdb59-ddc9-4495-9c8d-c05e6721439c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:41.329863 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-631bdb59-ddc9-4495-9c8d-c05e6721439c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:41.330562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-631bdb59-ddc9-4495-9c8d-c05e6721439c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:41.331018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-631bdb59-ddc9-4495-9c8d-c05e6721439c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:41.331446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-631bdb59-ddc9-4495-9c8d-c05e6721439c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:41.471991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-631bdb59-ddc9-4495-9c8d-c05e6721439c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:41.480463 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-631bdb59-ddc9-4495-9c8d-c05e6721439c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1551 microversion: 2.1 time: 0.164969 Aug 25 14:16:41.481091 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3536/7005] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:41 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:41.501228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a10d864a-1227-4c83-bf0e-04ce5b81530d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:41.501906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a10d864a-1227-4c83-bf0e-04ce5b81530d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:41.503918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:41.504620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:41.512907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a10d864a-1227-4c83-bf0e-04ce5b81530d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:41.513424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a10d864a-1227-4c83-bf0e-04ce5b81530d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:41.513918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a10d864a-1227-4c83-bf0e-04ce5b81530d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:41.514652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a10d864a-1227-4c83-bf0e-04ce5b81530d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:41.515131 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a10d864a-1227-4c83-bf0e-04ce5b81530d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:41.515580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a10d864a-1227-4c83-bf0e-04ce5b81530d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:41.661116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a10d864a-1227-4c83-bf0e-04ce5b81530d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:41.670276 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a10d864a-1227-4c83-bf0e-04ce5b81530d tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1551 microversion: 2.1 time: 0.172988 Aug 25 14:16:41.670887 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3470/7006] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:41 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1551 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:43.212831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c925c186-878a-4fe1-8a46-5634f17e9995 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "789df5d5-77cb-476f-904f-58dc431633f4"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:43.215921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c925c186-878a-4fe1-8a46-5634f17e9995 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:43.223022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c925c186-878a-4fe1-8a46-5634f17e9995 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:43.223523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c925c186-878a-4fe1-8a46-5634f17e9995 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:43.223970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c925c186-878a-4fe1-8a46-5634f17e9995 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:43.224689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c925c186-878a-4fe1-8a46-5634f17e9995 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:43.225153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c925c186-878a-4fe1-8a46-5634f17e9995 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:43.225622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c925c186-878a-4fe1-8a46-5634f17e9995 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:43.511812 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c925c186-878a-4fe1-8a46-5634f17e9995 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "POST /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302857 Aug 25 14:16:43.512441 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3537/7007] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 14:16:43 2022] POST /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:16:55.327170 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6281c368-a082-4f78-9657-d8c03d16ae9b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:55.327843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6281c368-a082-4f78-9657-d8c03d16ae9b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:55.330143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:55.330927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=72 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:55.336811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6281c368-a082-4f78-9657-d8c03d16ae9b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:55.337331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6281c368-a082-4f78-9657-d8c03d16ae9b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:55.337826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6281c368-a082-4f78-9657-d8c03d16ae9b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:55.339090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6281c368-a082-4f78-9657-d8c03d16ae9b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:55.339571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6281c368-a082-4f78-9657-d8c03d16ae9b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:55.340024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6281c368-a082-4f78-9657-d8c03d16ae9b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:55.427864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-6281c368-a082-4f78-9657-d8c03d16ae9b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lazy-loading 'services' on Instance uuid 38bfa9f9-0739-41cc-b185-e1029531c778 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:16:55.506428 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6281c368-a082-4f78-9657-d8c03d16ae9b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments/789df5d5-77cb-476f-904f-58dc431633f4" status: 202 len: 0 microversion: 2.1 time: 0.183768 Aug 25 14:16:55.508542 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3471/7008] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 14:16:55 2022] DELETE /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments/789df5d5-77cb-476f-904f-58dc431633f4 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:16:55.521497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0c8cdc30-ab68-47ae-adc2-9e7f8a29eeec tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:55.524236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0c8cdc30-ab68-47ae-adc2-9e7f8a29eeec tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:55.529013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:55.529767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:55.542341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c8cdc30-ab68-47ae-adc2-9e7f8a29eeec tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:55.542967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c8cdc30-ab68-47ae-adc2-9e7f8a29eeec tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:55.543429 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c8cdc30-ab68-47ae-adc2-9e7f8a29eeec tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:55.544161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c8cdc30-ab68-47ae-adc2-9e7f8a29eeec tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:55.544624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c8cdc30-ab68-47ae-adc2-9e7f8a29eeec tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:55.545131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0c8cdc30-ab68-47ae-adc2-9e7f8a29eeec tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:55.586373 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0c8cdc30-ab68-47ae-adc2-9e7f8a29eeec tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070724 Aug 25 14:16:55.587241 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3538/7009] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:55 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:56.601848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9e49524e-4c59-4761-a4b3-f046f4631142 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:56.604159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9e49524e-4c59-4761-a4b3-f046f4631142 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:56.610879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e49524e-4c59-4761-a4b3-f046f4631142 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:56.611386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e49524e-4c59-4761-a4b3-f046f4631142 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:56.611848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e49524e-4c59-4761-a4b3-f046f4631142 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:56.612585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e49524e-4c59-4761-a4b3-f046f4631142 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:56.613058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e49524e-4c59-4761-a4b3-f046f4631142 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:56.613530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e49524e-4c59-4761-a4b3-f046f4631142 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:56.646385 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9e49524e-4c59-4761-a4b3-f046f4631142 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049973 Aug 25 14:16:56.647184 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3472/7010] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:56 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:57.659563 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b3550d2b-3069-4e1a-9708-ace15d1c784e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:57.662149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b3550d2b-3069-4e1a-9708-ace15d1c784e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:57.669982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3550d2b-3069-4e1a-9708-ace15d1c784e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:57.670463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3550d2b-3069-4e1a-9708-ace15d1c784e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:57.671021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3550d2b-3069-4e1a-9708-ace15d1c784e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:57.671696 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3550d2b-3069-4e1a-9708-ace15d1c784e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:57.672155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3550d2b-3069-4e1a-9708-ace15d1c784e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:57.672586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b3550d2b-3069-4e1a-9708-ace15d1c784e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:57.715102 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b3550d2b-3069-4e1a-9708-ace15d1c784e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059592 Aug 25 14:16:57.715718 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3539/7011] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:57 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:58.728439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d5a849da-8e4a-45bc-b0e6-5ae519716a7a tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:58.731336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d5a849da-8e4a-45bc-b0e6-5ae519716a7a tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:58.738067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5a849da-8e4a-45bc-b0e6-5ae519716a7a tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:58.738576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5a849da-8e4a-45bc-b0e6-5ae519716a7a tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:58.739037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5a849da-8e4a-45bc-b0e6-5ae519716a7a tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:58.739781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5a849da-8e4a-45bc-b0e6-5ae519716a7a tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:58.740243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5a849da-8e4a-45bc-b0e6-5ae519716a7a tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:58.740691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d5a849da-8e4a-45bc-b0e6-5ae519716a7a tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:58.773847 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d5a849da-8e4a-45bc-b0e6-5ae519716a7a tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049559 Aug 25 14:16:58.774447 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3473/7012] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:58 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:59.786926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-48f7a9fe-6b1c-4457-9f16-9816e6085f68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:59.789034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-48f7a9fe-6b1c-4457-9f16-9816e6085f68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:59.796098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48f7a9fe-6b1c-4457-9f16-9816e6085f68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:59.796591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48f7a9fe-6b1c-4457-9f16-9816e6085f68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:59.797032 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48f7a9fe-6b1c-4457-9f16-9816e6085f68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:59.797768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48f7a9fe-6b1c-4457-9f16-9816e6085f68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:59.798225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48f7a9fe-6b1c-4457-9f16-9816e6085f68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:59.798653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-48f7a9fe-6b1c-4457-9f16-9816e6085f68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:59.831422 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-48f7a9fe-6b1c-4457-9f16-9816e6085f68 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Aug 25 14:16:59.832216 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3540/7013] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:16:59 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:00.843916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ff97b912-d224-4ae2-9e9a-c0a19d94dff0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:00.846144 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ff97b912-d224-4ae2-9e9a-c0a19d94dff0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:00.853155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff97b912-d224-4ae2-9e9a-c0a19d94dff0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:00.854360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff97b912-d224-4ae2-9e9a-c0a19d94dff0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:00.854892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff97b912-d224-4ae2-9e9a-c0a19d94dff0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:00.855624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff97b912-d224-4ae2-9e9a-c0a19d94dff0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:00.856104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff97b912-d224-4ae2-9e9a-c0a19d94dff0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:00.856550 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ff97b912-d224-4ae2-9e9a-c0a19d94dff0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:00.894253 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ff97b912-d224-4ae2-9e9a-c0a19d94dff0 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054229 Aug 25 14:17:00.894872 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3474/7014] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:17:00 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 14:17:00.908978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:00.909639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:00.917022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:00.917537 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:00.917971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:00.918673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:00.919127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:00.919561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:01.002115 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] HTTP exception thrown: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 is not attached to volume 789df5d5-77cb-476f-904f-58dc431633f4 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Request method failure captured: Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments/789df5d5-77cb-476f-904f-58dc431633f4 HTTP/1.1 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4QOWws1eZ5Exd_oNamwoPBCbXiUDRLl6rkE4dD7szEIvW-JeO3iFaI-OhmTESqctQOjWadX6rJt0jEkItlsHuHOjZHt-37KG02CaSWB-mkglMOfEwyiJHlqJMrDQxmbVi6Gafayv4ZmYTXOVtN5cYmrJktH0EoprnEvVn21ZMDTBkk Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f73a294f4a574dc2bcb6030cbccbc703", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}] Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1b9dc7cff6f743f29b557567ad883ccc Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 is not attached to volume 789df5d5-77cb-476f-904f-58dc431633f4 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': '38bfa9f9-0739-41cc-b185-e1029531c778', 'id': '789df5d5-77cb-476f-904f-58dc431633f4'} Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 789df5d5-77cb-476f-904f-58dc431633f4. Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 is not attached to volume 789df5d5-77cb-476f-904f-58dc431633f4 Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:17:01.004096 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:17:01.008534 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:17:01.008534 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:17:01.008534 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 is not attached to volume 789df5d5-77cb-476f-904f-58dc431633f4 Aug 25 14:17:01.008534 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:17:01.008534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Returning 404 to user: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 is not attached to volume 789df5d5-77cb-476f-904f-58dc431633f4 {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:17:01.008534 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c5b198cc-b155-4260-ae34-fa7f13602517 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments/789df5d5-77cb-476f-904f-58dc431633f4" status: 404 len: 154 microversion: 2.1 time: 0.101194 Aug 25 14:17:01.008534 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3541/7015] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 14:17:00 2022] DELETE /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778/os-volume_attachments/789df5d5-77cb-476f-904f-58dc431633f4 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:17:04.361153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99fe3ef8-92e7-45a4-bc1d-bd5a9de6749f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:04.361729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-99fe3ef8-92e7-45a4-bc1d-bd5a9de6749f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:04.368777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99fe3ef8-92e7-45a4-bc1d-bd5a9de6749f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:04.369324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99fe3ef8-92e7-45a4-bc1d-bd5a9de6749f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:04.369809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99fe3ef8-92e7-45a4-bc1d-bd5a9de6749f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:04.370534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99fe3ef8-92e7-45a4-bc1d-bd5a9de6749f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:04.371001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99fe3ef8-92e7-45a4-bc1d-bd5a9de6749f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:04.371443 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99fe3ef8-92e7-45a4-bc1d-bd5a9de6749f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:04.400852 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-99fe3ef8-92e7-45a4-bc1d-bd5a9de6749f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:17:04.485765 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-99fe3ef8-92e7-45a4-bc1d-bd5a9de6749f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 204 len: 0 microversion: 2.1 time: 0.128194 Aug 25 14:17:04.486482 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3475/7016] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:17:04 2022] DELETE /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:17:04.495977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-eb6b5b6b-93a5-438c-a60c-12abd630adb1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:04.496731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-eb6b5b6b-93a5-438c-a60c-12abd630adb1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:04.503770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb6b5b6b-93a5-438c-a60c-12abd630adb1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:04.504264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb6b5b6b-93a5-438c-a60c-12abd630adb1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:04.504711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb6b5b6b-93a5-438c-a60c-12abd630adb1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:04.505647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb6b5b6b-93a5-438c-a60c-12abd630adb1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:04.506117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb6b5b6b-93a5-438c-a60c-12abd630adb1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:04.506548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-eb6b5b6b-93a5-438c-a60c-12abd630adb1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:04.646668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-eb6b5b6b-93a5-438c-a60c-12abd630adb1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:04.655504 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-eb6b5b6b-93a5-438c-a60c-12abd630adb1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1557 microversion: 2.1 time: 0.164069 Aug 25 14:17:04.656097 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3542/7017] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:04 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:05.677155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f8e7bcc-c22f-4f06-aa12-5892bdd10840 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:05.677920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f8e7bcc-c22f-4f06-aa12-5892bdd10840 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:05.685849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f8e7bcc-c22f-4f06-aa12-5892bdd10840 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:05.686359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f8e7bcc-c22f-4f06-aa12-5892bdd10840 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:05.686822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f8e7bcc-c22f-4f06-aa12-5892bdd10840 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:05.687562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f8e7bcc-c22f-4f06-aa12-5892bdd10840 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:05.688044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f8e7bcc-c22f-4f06-aa12-5892bdd10840 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:05.688494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f8e7bcc-c22f-4f06-aa12-5892bdd10840 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:05.835182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f8e7bcc-c22f-4f06-aa12-5892bdd10840 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:05.844105 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f8e7bcc-c22f-4f06-aa12-5892bdd10840 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1557 microversion: 2.1 time: 0.171175 Aug 25 14:17:05.844702 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3476/7018] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:05 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:06.865722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1046c50b-7188-4483-a0f3-e24247324503 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:06.867147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1046c50b-7188-4483-a0f3-e24247324503 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:06.874867 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1046c50b-7188-4483-a0f3-e24247324503 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:06.875693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1046c50b-7188-4483-a0f3-e24247324503 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:06.876353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1046c50b-7188-4483-a0f3-e24247324503 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:06.877155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1046c50b-7188-4483-a0f3-e24247324503 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:06.877845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1046c50b-7188-4483-a0f3-e24247324503 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:06.878241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1046c50b-7188-4483-a0f3-e24247324503 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:06.959984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-cf59da55-8532-4851-a3e3-b94e2ee5d3ae req-fb29a636-3409-4be6-9b3a-4793b63a667e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bfa9f9-0739-41cc-b185-e1029531c778", "name": "network-vif-deleted", "tag": "798cba9a-1d1f-4934-9413-6cc5b5041230"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:17:06.970944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1046c50b-7188-4483-a0f3-e24247324503 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:06.983087 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1046c50b-7188-4483-a0f3-e24247324503 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 200 len: 1515 microversion: 2.1 time: 0.121388 Aug 25 14:17:06.984075 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3543/7019] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:06 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 1515 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:06.997031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cf59da55-8532-4851-a3e3-b94e2ee5d3ae req-fb29a636-3409-4be6-9b3a-4793b63a667e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:06.998048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cf59da55-8532-4851-a3e3-b94e2ee5d3ae req-fb29a636-3409-4be6-9b3a-4793b63a667e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:06.999052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cf59da55-8532-4851-a3e3-b94e2ee5d3ae req-fb29a636-3409-4be6-9b3a-4793b63a667e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:07.015578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-cf59da55-8532-4851-a3e3-b94e2ee5d3ae req-fb29a636-3409-4be6-9b3a-4793b63a667e service nova] Creating event network-vif-deleted:798cba9a-1d1f-4934-9413-6cc5b5041230 for instance 38bfa9f9-0739-41cc-b185-e1029531c778 on n-h2-852771-8 Aug 25 14:17:07.020759 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-cf59da55-8532-4851-a3e3-b94e2ee5d3ae req-fb29a636-3409-4be6-9b3a-4793b63a667e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064800 Aug 25 14:17:07.021373 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3477/7020] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:08.004858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:08.005462 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 38bfa9f9-0739-41cc-b185-e1029531c778] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:08.013266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:08.013797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:08.014256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:08.014960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:08.015420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:08.015852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:08.029988 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] HTTP exception thrown: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 could not be found. Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Request method failure captured: Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 HTTP/1.1 Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4QOWws1eZ5Exd_oNamwoPBCbXiUDRLl6rkE4dD7szEIvW-JeO3iFaI-OhmTESqctQOjWadX6rJt0jEkItlsHuHOjZHt-37KG02CaSWB-mkglMOfEwyiJHlqJMrDQxmbVi6Gafayv4ZmYTXOVtN5cYmrJktH0EoprnEvVn21ZMDTBkk Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f73a294f4a574dc2bcb6030cbccbc703", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}] Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 1b9dc7cff6f743f29b557567ad883ccc Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 could not be found. Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '38bfa9f9-0739-41cc-b185-e1029531c778'} Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 could not be found. Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 could not be found. Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:17:08.031549 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:17:08.037301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:08.037301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:17:08.037301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:17:08.037301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:17:08.037301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:17:08.037301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 could not be found. Aug 25 14:17:08.037301 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:17:08.037301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Returning 404 to user: Instance 38bfa9f9-0739-41cc-b185-e1029531c778 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:17:08.037301 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-380ca532-1848-4d67-b04d-823a56a27aa6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778" status: 404 len: 111 microversion: 2.1 time: 0.032055 Aug 25 14:17:08.037301 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3544/7021] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:07 2022] GET /compute/v2.1/servers/38bfa9f9-0739-41cc-b185-e1029531c778 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:17:08.044515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-067c287f-74fd-46dd-88d3-ad487d3c3a19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '.version_select at 0x7f3a2e79db80>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:08.065359 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-067c287f-74fd-46dd-88d3-ad487d3c3a19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1638500253" status: 202 len: 0 microversion: 2.1 time: 0.025797 Aug 25 14:17:08.065994 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3478/7022] 10.222.0.70 () {58 vars in 1278 bytes} [Thu Aug 25 14:17:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1638500253 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:17:08.087951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-aeae4ec7-2f64-446e-8d15-f7c88592e381 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Action: 'create', calling method: .version_select at 0x7f3a2e9478b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-188897742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4SGHHtGdr/QWYvhm/TIXfbXu5Wcb6UeN6PkUUcBYhSaucsupJ1+UZqy2F9mSU9hXScTf9lDQMpQB2WXhOWOYOD34NJpqBMb0+vC5aNtFhXG5ibe+wPa4F6RJoF9PYz2A=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:17:08.104183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-aeae4ec7-2f64-446e-8d15-f7c88592e381 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:17:08.110641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-aeae4ec7-2f64-446e-8d15-f7c88592e381 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for user 1b9dc7cff6f743f29b557567ad883ccc and project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:17:08.135189 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-aeae4ec7-2f64-446e-8d15-f7c88592e381 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051409 Aug 25 14:17:08.135832 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3545/7023] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:17:08 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:08.186399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1213485019", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-188897742", "networks": [{"uuid": "9e98ca1d-4d75-4b18-8e53-a96fa083759c"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:17:08.240915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] validate_networks() for [('9e98ca1d-4d75-4b18-8e53-a96fa083759c', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:17:08.633313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:17:08.633784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:17:08.634284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:17:08.634719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:17:08.635156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:17:08.645386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:08.645924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:08.646391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:08.647143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:08.647617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:08.648067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:08.666919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:17:08.672454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Getting quotas for user 1b9dc7cff6f743f29b557567ad883ccc and project f73a294f4a574dc2bcb6030cbccbc703. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:17:08.685640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:17:08.688089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:17:08.735754 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5fdd44aa-9eeb-4f31-813c-8abde367c239 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553362 Aug 25 14:17:08.736427 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3479/7024] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:17:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:17:08.748008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e35ef667-8630-4cec-a58d-3db782a72ce7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:08.748740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e35ef667-8630-4cec-a58d-3db782a72ce7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:08.806551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e35ef667-8630-4cec-a58d-3db782a72ce7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:08.815205 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e35ef667-8630-4cec-a58d-3db782a72ce7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1262 microversion: 2.1 time: 0.071910 Aug 25 14:17:08.815817 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3546/7025] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:08 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:17:09.837683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c595c8a3-2d3f-4933-bf8c-df1c81856f8c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:09.838928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c595c8a3-2d3f-4933-bf8c-df1c81856f8c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:09.847653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c595c8a3-2d3f-4933-bf8c-df1c81856f8c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:09.848137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c595c8a3-2d3f-4933-bf8c-df1c81856f8c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:09.848601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c595c8a3-2d3f-4933-bf8c-df1c81856f8c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:09.849321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c595c8a3-2d3f-4933-bf8c-df1c81856f8c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:09.849818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c595c8a3-2d3f-4933-bf8c-df1c81856f8c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:09.850258 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c595c8a3-2d3f-4933-bf8c-df1c81856f8c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:09.923374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c595c8a3-2d3f-4933-bf8c-df1c81856f8c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:09.931628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c595c8a3-2d3f-4933-bf8c-df1c81856f8c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1332 microversion: 2.1 time: 0.098862 Aug 25 14:17:09.932218 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3480/7026] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:09 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:10.953620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06e8ac1c-60f7-4267-9fb8-e2defb2ea2f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:10.954241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-06e8ac1c-60f7-4267-9fb8-e2defb2ea2f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:10.961717 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e8ac1c-60f7-4267-9fb8-e2defb2ea2f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:10.962221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e8ac1c-60f7-4267-9fb8-e2defb2ea2f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:10.962683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e8ac1c-60f7-4267-9fb8-e2defb2ea2f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:10.963404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e8ac1c-60f7-4267-9fb8-e2defb2ea2f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:10.963865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e8ac1c-60f7-4267-9fb8-e2defb2ea2f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:10.964300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e8ac1c-60f7-4267-9fb8-e2defb2ea2f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:11.101435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-06e8ac1c-60f7-4267-9fb8-e2defb2ea2f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:11.110823 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-06e8ac1c-60f7-4267-9fb8-e2defb2ea2f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1362 microversion: 2.1 time: 0.162170 Aug 25 14:17:11.111353 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3547/7027] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:10 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:11.171009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1132f433-5ba5-4af6-8205-0a9ac8e9a815 req-1058300c-643c-4a9d-bfec-abcc67bf21b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b08f57-ce2e-49f9-ae7a-c4d381966c50", "tag": "eafa528f-9143-43ab-a687-2597432a87d4"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:17:11.186177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1132f433-5ba5-4af6-8205-0a9ac8e9a815 req-1058300c-643c-4a9d-bfec-abcc67bf21b0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:11.186950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1132f433-5ba5-4af6-8205-0a9ac8e9a815 req-1058300c-643c-4a9d-bfec-abcc67bf21b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:11.187410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1132f433-5ba5-4af6-8205-0a9ac8e9a815 req-1058300c-643c-4a9d-bfec-abcc67bf21b0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:11.200414 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1132f433-5ba5-4af6-8205-0a9ac8e9a815 req-1058300c-643c-4a9d-bfec-abcc67bf21b0 service nova] Creating event network-changed:eafa528f-9143-43ab-a687-2597432a87d4 for instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 on n-h2-852771-8 Aug 25 14:17:11.206161 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1132f433-5ba5-4af6-8205-0a9ac8e9a815 req-1058300c-643c-4a9d-bfec-abcc67bf21b0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040598 Aug 25 14:17:11.206782 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3481/7028] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:12.132360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-afeeef13-8b93-41e7-a912-f9d1e83a26f4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:12.132993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-afeeef13-8b93-41e7-a912-f9d1e83a26f4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:12.140377 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afeeef13-8b93-41e7-a912-f9d1e83a26f4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:12.140856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afeeef13-8b93-41e7-a912-f9d1e83a26f4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:12.141289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afeeef13-8b93-41e7-a912-f9d1e83a26f4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:12.142081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afeeef13-8b93-41e7-a912-f9d1e83a26f4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:12.142466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afeeef13-8b93-41e7-a912-f9d1e83a26f4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:12.142890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afeeef13-8b93-41e7-a912-f9d1e83a26f4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:12.280230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-afeeef13-8b93-41e7-a912-f9d1e83a26f4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:12.288048 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-afeeef13-8b93-41e7-a912-f9d1e83a26f4 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1362 microversion: 2.1 time: 0.159589 Aug 25 14:17:12.288633 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3548/7029] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:12 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:13.311468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bc793d51-3669-4ea1-8f2b-5efd3fc2ddf8 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:13.312192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bc793d51-3669-4ea1-8f2b-5efd3fc2ddf8 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:13.319272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc793d51-3669-4ea1-8f2b-5efd3fc2ddf8 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:13.319776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc793d51-3669-4ea1-8f2b-5efd3fc2ddf8 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:13.320237 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc793d51-3669-4ea1-8f2b-5efd3fc2ddf8 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:13.320955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc793d51-3669-4ea1-8f2b-5efd3fc2ddf8 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:13.321430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc793d51-3669-4ea1-8f2b-5efd3fc2ddf8 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:13.321905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bc793d51-3669-4ea1-8f2b-5efd3fc2ddf8 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:13.465738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bc793d51-3669-4ea1-8f2b-5efd3fc2ddf8 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:13.473862 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bc793d51-3669-4ea1-8f2b-5efd3fc2ddf8 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1362 microversion: 2.1 time: 0.168122 Aug 25 14:17:13.474450 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3482/7030] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:13 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:14.495653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52ce86c6-4bee-4272-8c6a-040a5327e712 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:14.496968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-52ce86c6-4bee-4272-8c6a-040a5327e712 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:14.504124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52ce86c6-4bee-4272-8c6a-040a5327e712 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:14.504611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52ce86c6-4bee-4272-8c6a-040a5327e712 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:14.505056 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52ce86c6-4bee-4272-8c6a-040a5327e712 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:14.505790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52ce86c6-4bee-4272-8c6a-040a5327e712 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:14.506252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52ce86c6-4bee-4272-8c6a-040a5327e712 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:14.506684 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52ce86c6-4bee-4272-8c6a-040a5327e712 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:14.641768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-52ce86c6-4bee-4272-8c6a-040a5327e712 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:14.650071 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-52ce86c6-4bee-4272-8c6a-040a5327e712 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1362 microversion: 2.1 time: 0.158365 Aug 25 14:17:14.650822 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3549/7031] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:14 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:15.672833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3cbaba31-2403-4885-8b56-d8333f1b3915 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:15.673660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3cbaba31-2403-4885-8b56-d8333f1b3915 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:15.680707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cbaba31-2403-4885-8b56-d8333f1b3915 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:15.681261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cbaba31-2403-4885-8b56-d8333f1b3915 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:15.681702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cbaba31-2403-4885-8b56-d8333f1b3915 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:15.682429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cbaba31-2403-4885-8b56-d8333f1b3915 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:15.682900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cbaba31-2403-4885-8b56-d8333f1b3915 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:15.683346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cbaba31-2403-4885-8b56-d8333f1b3915 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:15.832596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3cbaba31-2403-4885-8b56-d8333f1b3915 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:15.842186 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3cbaba31-2403-4885-8b56-d8333f1b3915 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1362 microversion: 2.1 time: 0.173910 Aug 25 14:17:15.842807 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3483/7032] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:15 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:16.863996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c8042c92-966d-42f3-846e-6fab6924300c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:16.864661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c8042c92-966d-42f3-846e-6fab6924300c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:16.871588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8042c92-966d-42f3-846e-6fab6924300c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:16.872072 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8042c92-966d-42f3-846e-6fab6924300c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:16.872506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8042c92-966d-42f3-846e-6fab6924300c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:16.873201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8042c92-966d-42f3-846e-6fab6924300c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:16.873680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8042c92-966d-42f3-846e-6fab6924300c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:16.874104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8042c92-966d-42f3-846e-6fab6924300c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:17.016823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c8042c92-966d-42f3-846e-6fab6924300c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:17.025114 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c8042c92-966d-42f3-846e-6fab6924300c tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1362 microversion: 2.1 time: 0.164970 Aug 25 14:17:17.025743 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3550/7033] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:16 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:18.048088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-13ce0eb2-115e-4647-b8f6-c026f74b9e17 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:18.048731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-13ce0eb2-115e-4647-b8f6-c026f74b9e17 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:18.055780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13ce0eb2-115e-4647-b8f6-c026f74b9e17 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:18.056278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13ce0eb2-115e-4647-b8f6-c026f74b9e17 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:18.056733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13ce0eb2-115e-4647-b8f6-c026f74b9e17 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:18.057448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13ce0eb2-115e-4647-b8f6-c026f74b9e17 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:18.057942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13ce0eb2-115e-4647-b8f6-c026f74b9e17 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:18.058412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13ce0eb2-115e-4647-b8f6-c026f74b9e17 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:18.198679 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-13ce0eb2-115e-4647-b8f6-c026f74b9e17 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:18.206993 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-13ce0eb2-115e-4647-b8f6-c026f74b9e17 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1362 microversion: 2.1 time: 0.163748 Aug 25 14:17:18.207517 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3484/7034] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:18 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:19.061150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-80e856d9-72a0-459f-8023-2055fdff357a req-239901c2-23ab-46a1-bfad-6a1ef8fe9397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b08f57-ce2e-49f9-ae7a-c4d381966c50", "name": "network-vif-plugged", "status": "completed", "tag": "eafa528f-9143-43ab-a687-2597432a87d4"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:17:19.067079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:19.073154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-80e856d9-72a0-459f-8023-2055fdff357a req-239901c2-23ab-46a1-bfad-6a1ef8fe9397 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:19.073669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-80e856d9-72a0-459f-8023-2055fdff357a req-239901c2-23ab-46a1-bfad-6a1ef8fe9397 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:19.074111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-80e856d9-72a0-459f-8023-2055fdff357a req-239901c2-23ab-46a1-bfad-6a1ef8fe9397 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:19.087293 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-80e856d9-72a0-459f-8023-2055fdff357a req-239901c2-23ab-46a1-bfad-6a1ef8fe9397 service nova] Creating event network-vif-plugged:eafa528f-9143-43ab-a687-2597432a87d4 for instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 on n-h2-852771-8 Aug 25 14:17:19.092876 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-80e856d9-72a0-459f-8023-2055fdff357a req-239901c2-23ab-46a1-bfad-6a1ef8fe9397 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036656 Aug 25 14:17:19.093497 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3551/7035] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:19.233757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1792a65b-19bd-4ef9-83d9-d6430a8eb373 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:19.234413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1792a65b-19bd-4ef9-83d9-d6430a8eb373 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:19.236444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:19.237207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:19.244338 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1792a65b-19bd-4ef9-83d9-d6430a8eb373 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:19.244856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1792a65b-19bd-4ef9-83d9-d6430a8eb373 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:19.245309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1792a65b-19bd-4ef9-83d9-d6430a8eb373 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:19.246088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1792a65b-19bd-4ef9-83d9-d6430a8eb373 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:19.246561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1792a65b-19bd-4ef9-83d9-d6430a8eb373 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:19.247853 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1792a65b-19bd-4ef9-83d9-d6430a8eb373 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:19.398360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1792a65b-19bd-4ef9-83d9-d6430a8eb373 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:19.407357 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1792a65b-19bd-4ef9-83d9-d6430a8eb373 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1362 microversion: 2.1 time: 0.181061 Aug 25 14:17:19.408328 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3485/7036] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:19 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:20.436505 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce28d1ee-467d-4e38-a8a0-93a8c7692928 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:20.437840 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ce28d1ee-467d-4e38-a8a0-93a8c7692928 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:20.446596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce28d1ee-467d-4e38-a8a0-93a8c7692928 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:20.447094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce28d1ee-467d-4e38-a8a0-93a8c7692928 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:20.447541 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce28d1ee-467d-4e38-a8a0-93a8c7692928 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:20.448264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce28d1ee-467d-4e38-a8a0-93a8c7692928 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:20.448924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce28d1ee-467d-4e38-a8a0-93a8c7692928 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:20.450030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce28d1ee-467d-4e38-a8a0-93a8c7692928 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:20.610449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ce28d1ee-467d-4e38-a8a0-93a8c7692928 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:20.625005 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce28d1ee-467d-4e38-a8a0-93a8c7692928 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1362 microversion: 2.1 time: 0.189618 Aug 25 14:17:20.625005 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3552/7037] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:20 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:21.641448 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-72a2ec19-b10f-4385-aa7e-5b10a9c1fc7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:21.642298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-72a2ec19-b10f-4385-aa7e-5b10a9c1fc7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:21.649249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72a2ec19-b10f-4385-aa7e-5b10a9c1fc7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:21.649790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72a2ec19-b10f-4385-aa7e-5b10a9c1fc7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:21.650489 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72a2ec19-b10f-4385-aa7e-5b10a9c1fc7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:21.650997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72a2ec19-b10f-4385-aa7e-5b10a9c1fc7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:21.651618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72a2ec19-b10f-4385-aa7e-5b10a9c1fc7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:21.652080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-72a2ec19-b10f-4385-aa7e-5b10a9c1fc7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:21.792901 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-72a2ec19-b10f-4385-aa7e-5b10a9c1fc7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:21.805433 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-72a2ec19-b10f-4385-aa7e-5b10a9c1fc7e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1552 microversion: 2.1 time: 0.168775 Aug 25 14:17:21.806063 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3486/7038] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:21 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:21.828328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d59cd7a6-fd0a-492e-b72b-1d647cc8c9e1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:21.828979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d59cd7a6-fd0a-492e-b72b-1d647cc8c9e1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:21.836192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d59cd7a6-fd0a-492e-b72b-1d647cc8c9e1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:21.836680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d59cd7a6-fd0a-492e-b72b-1d647cc8c9e1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:21.837130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d59cd7a6-fd0a-492e-b72b-1d647cc8c9e1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:21.837886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d59cd7a6-fd0a-492e-b72b-1d647cc8c9e1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:21.838347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d59cd7a6-fd0a-492e-b72b-1d647cc8c9e1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:21.838780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d59cd7a6-fd0a-492e-b72b-1d647cc8c9e1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:21.985485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d59cd7a6-fd0a-492e-b72b-1d647cc8c9e1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:21.997784 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d59cd7a6-fd0a-492e-b72b-1d647cc8c9e1 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1552 microversion: 2.1 time: 0.174252 Aug 25 14:17:21.998385 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3553/7039] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:21 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:23.514882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f8c05b6-d40f-43cf-8e94-f85086365f26 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b38b771-9be8-4727-ba5c-2bd9a37a1084"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:17:23.517894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f8c05b6-d40f-43cf-8e94-f85086365f26 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:23.524379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f8c05b6-d40f-43cf-8e94-f85086365f26 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:23.524832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f8c05b6-d40f-43cf-8e94-f85086365f26 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:23.525292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f8c05b6-d40f-43cf-8e94-f85086365f26 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:23.526049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f8c05b6-d40f-43cf-8e94-f85086365f26 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:23.526527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f8c05b6-d40f-43cf-8e94-f85086365f26 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:23.527161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f8c05b6-d40f-43cf-8e94-f85086365f26 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:23.656918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:23.788748 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f8c05b6-d40f-43cf-8e94-f85086365f26 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "POST /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278208 Aug 25 14:17:23.789277 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3487/7040] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 14:17:23 2022] POST /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:34.578305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3acb1a67-9c45-4a9c-ac31-a8ebdcb1d682 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:34.578872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3acb1a67-9c45-4a9c-ac31-a8ebdcb1d682 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:34.582025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:34.582706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=76 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:34.589754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3acb1a67-9c45-4a9c-ac31-a8ebdcb1d682 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:34.590248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3acb1a67-9c45-4a9c-ac31-a8ebdcb1d682 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:34.590749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3acb1a67-9c45-4a9c-ac31-a8ebdcb1d682 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:34.591626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3acb1a67-9c45-4a9c-ac31-a8ebdcb1d682 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:34.592083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3acb1a67-9c45-4a9c-ac31-a8ebdcb1d682 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:34.592510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3acb1a67-9c45-4a9c-ac31-a8ebdcb1d682 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:34.687635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-3acb1a67-9c45-4a9c-ac31-a8ebdcb1d682 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lazy-loading 'services' on Instance uuid 04b08f57-ce2e-49f9-ae7a-c4d381966c50 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:17:34.765837 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3acb1a67-9c45-4a9c-ac31-a8ebdcb1d682 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments/3b38b771-9be8-4727-ba5c-2bd9a37a1084" status: 202 len: 0 microversion: 2.1 time: 0.191884 Aug 25 14:17:34.766575 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3554/7041] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 14:17:34 2022] DELETE /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments/3b38b771-9be8-4727-ba5c-2bd9a37a1084 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:17:34.773297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:34.774175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:34.779628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f576b34f-4448-4079-8843-9888af12b79e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:34.782123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f576b34f-4448-4079-8843-9888af12b79e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:34.790220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f576b34f-4448-4079-8843-9888af12b79e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:34.791058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f576b34f-4448-4079-8843-9888af12b79e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:34.791553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f576b34f-4448-4079-8843-9888af12b79e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:34.792314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f576b34f-4448-4079-8843-9888af12b79e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:34.792842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f576b34f-4448-4079-8843-9888af12b79e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:34.793354 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f576b34f-4448-4079-8843-9888af12b79e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:34.834679 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f576b34f-4448-4079-8843-9888af12b79e tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063319 Aug 25 14:17:34.835275 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3488/7042] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:17:34 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:35.850375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bc0701ec-46e1-4f66-b274-ae769f7e1f30 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:35.852900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bc0701ec-46e1-4f66-b274-ae769f7e1f30 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:35.862834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0701ec-46e1-4f66-b274-ae769f7e1f30 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:35.863332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0701ec-46e1-4f66-b274-ae769f7e1f30 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:35.863772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0701ec-46e1-4f66-b274-ae769f7e1f30 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:35.864498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0701ec-46e1-4f66-b274-ae769f7e1f30 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:35.864958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0701ec-46e1-4f66-b274-ae769f7e1f30 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:35.865639 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc0701ec-46e1-4f66-b274-ae769f7e1f30 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:35.906776 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bc0701ec-46e1-4f66-b274-ae769f7e1f30 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061406 Aug 25 14:17:35.907826 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3555/7043] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:17:35 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:36.923539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-42882c23-cb43-4218-b51a-16b136d81fcc tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:36.927268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-42882c23-cb43-4218-b51a-16b136d81fcc tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:36.940009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42882c23-cb43-4218-b51a-16b136d81fcc tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:36.940887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42882c23-cb43-4218-b51a-16b136d81fcc tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:36.941699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42882c23-cb43-4218-b51a-16b136d81fcc tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:36.942980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42882c23-cb43-4218-b51a-16b136d81fcc tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:36.943765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42882c23-cb43-4218-b51a-16b136d81fcc tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:36.944547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42882c23-cb43-4218-b51a-16b136d81fcc tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:36.989454 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-42882c23-cb43-4218-b51a-16b136d81fcc tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069997 Aug 25 14:17:36.996111 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3489/7044] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:17:36 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:38.005677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-372df115-df79-4f2c-a090-79fb9742e783 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:38.008884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-372df115-df79-4f2c-a090-79fb9742e783 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:38.018590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-372df115-df79-4f2c-a090-79fb9742e783 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:38.019310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-372df115-df79-4f2c-a090-79fb9742e783 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:38.019782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-372df115-df79-4f2c-a090-79fb9742e783 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:38.020513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-372df115-df79-4f2c-a090-79fb9742e783 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:38.020978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-372df115-df79-4f2c-a090-79fb9742e783 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:38.021412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-372df115-df79-4f2c-a090-79fb9742e783 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:38.057892 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-372df115-df79-4f2c-a090-79fb9742e783 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057392 Aug 25 14:17:38.058583 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3556/7045] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:17:37 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:39.071135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d075765b-fbe2-402b-8902-7881e6baefc7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:39.073415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d075765b-fbe2-402b-8902-7881e6baefc7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:39.081802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d075765b-fbe2-402b-8902-7881e6baefc7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:39.082305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d075765b-fbe2-402b-8902-7881e6baefc7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:39.082758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d075765b-fbe2-402b-8902-7881e6baefc7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:39.083481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d075765b-fbe2-402b-8902-7881e6baefc7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:39.083947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d075765b-fbe2-402b-8902-7881e6baefc7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:39.084387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d075765b-fbe2-402b-8902-7881e6baefc7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:39.119043 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d075765b-fbe2-402b-8902-7881e6baefc7 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052286 Aug 25 14:17:39.119622 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3490/7046] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:17:39 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:40.133064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ca227627-4833-4fb1-a64a-f3f2097a9be9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:40.135305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ca227627-4833-4fb1-a64a-f3f2097a9be9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:40.143011 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca227627-4833-4fb1-a64a-f3f2097a9be9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:40.143501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca227627-4833-4fb1-a64a-f3f2097a9be9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:40.143938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca227627-4833-4fb1-a64a-f3f2097a9be9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:40.144640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca227627-4833-4fb1-a64a-f3f2097a9be9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:40.145098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca227627-4833-4fb1-a64a-f3f2097a9be9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:40.145543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca227627-4833-4fb1-a64a-f3f2097a9be9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:40.180627 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ca227627-4833-4fb1-a64a-f3f2097a9be9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051606 Aug 25 14:17:40.181213 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3557/7047] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:17:40 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 14:17:40.193396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:40.194225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:40.202429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:40.202937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:40.203450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:40.204154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:40.204621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:40.205070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:40.294586 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] HTTP exception thrown: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 is not attached to volume 3b38b771-9be8-4727-ba5c-2bd9a37a1084 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Request method failure captured: Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments/3b38b771-9be8-4727-ba5c-2bd9a37a1084 HTTP/1.1 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4QOWws1eZ5Exd_oNamwoPBCbXiUDRLl6rkE4dD7szEIvW-JeO3iFaI-OhmTESqctQOjWadX6rJt0jEkItlsHuHOjZHt-37KG02CaSWB-mkglMOfEwyiJHlqJMrDQxmbVi6Gafayv4ZmYTXOVtN5cYmrJktH0EoprnEvVn21ZMDTBkk Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f73a294f4a574dc2bcb6030cbccbc703", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}] Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1b9dc7cff6f743f29b557567ad883ccc Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 is not attached to volume 3b38b771-9be8-4727-ba5c-2bd9a37a1084 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'server_id': '04b08f57-ce2e-49f9-ae7a-c4d381966c50', 'id': '3b38b771-9be8-4727-ba5c-2bd9a37a1084'} Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3b38b771-9be8-4727-ba5c-2bd9a37a1084. Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 is not attached to volume 3b38b771-9be8-4727-ba5c-2bd9a37a1084 Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:17:40.296279 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:17:40.302334 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:17:40.302334 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:17:40.302334 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 is not attached to volume 3b38b771-9be8-4727-ba5c-2bd9a37a1084 Aug 25 14:17:40.302334 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:17:40.302334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Returning 404 to user: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 is not attached to volume 3b38b771-9be8-4727-ba5c-2bd9a37a1084 {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:17:40.302334 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1bd4bc75-91bf-4500-97a1-834648288fa5 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments/3b38b771-9be8-4727-ba5c-2bd9a37a1084" status: 404 len: 154 microversion: 2.1 time: 0.108669 Aug 25 14:17:40.302334 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3491/7048] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 14:17:40 2022] DELETE /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50/os-volume_attachments/3b38b771-9be8-4727-ba5c-2bd9a37a1084 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:17:43.786164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-67afa38b-bf42-45dd-9c5e-ec22cde9195b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:43.786720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-67afa38b-bf42-45dd-9c5e-ec22cde9195b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:43.795000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67afa38b-bf42-45dd-9c5e-ec22cde9195b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:43.795812 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67afa38b-bf42-45dd-9c5e-ec22cde9195b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:43.796262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67afa38b-bf42-45dd-9c5e-ec22cde9195b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:43.797005 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67afa38b-bf42-45dd-9c5e-ec22cde9195b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:43.797471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67afa38b-bf42-45dd-9c5e-ec22cde9195b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:43.797934 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-67afa38b-bf42-45dd-9c5e-ec22cde9195b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:43.828648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-67afa38b-bf42-45dd-9c5e-ec22cde9195b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:17:43.920858 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-67afa38b-bf42-45dd-9c5e-ec22cde9195b tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 204 len: 0 microversion: 2.1 time: 0.138188 Aug 25 14:17:43.928094 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3558/7049] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:17:43 2022] DELETE /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:17:43.934032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2c669277-f35c-4f74-b5c3-9342536085f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:43.935377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2c669277-f35c-4f74-b5c3-9342536085f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:43.943935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c669277-f35c-4f74-b5c3-9342536085f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:43.944432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c669277-f35c-4f74-b5c3-9342536085f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:43.944896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c669277-f35c-4f74-b5c3-9342536085f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:43.945687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c669277-f35c-4f74-b5c3-9342536085f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:43.946174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c669277-f35c-4f74-b5c3-9342536085f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:43.946626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c669277-f35c-4f74-b5c3-9342536085f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:44.117488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2c669277-f35c-4f74-b5c3-9342536085f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:44.134115 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2c669277-f35c-4f74-b5c3-9342536085f6 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1558 microversion: 2.1 time: 0.203786 Aug 25 14:17:44.135259 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3492/7050] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:43 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:45.157323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-347c6e02-cb33-48b4-90a6-50384daf1cf9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:45.157960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-347c6e02-cb33-48b4-90a6-50384daf1cf9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:45.165660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-347c6e02-cb33-48b4-90a6-50384daf1cf9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:45.166149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-347c6e02-cb33-48b4-90a6-50384daf1cf9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:45.166617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-347c6e02-cb33-48b4-90a6-50384daf1cf9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:45.167323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-347c6e02-cb33-48b4-90a6-50384daf1cf9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:45.167779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-347c6e02-cb33-48b4-90a6-50384daf1cf9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:45.168198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-347c6e02-cb33-48b4-90a6-50384daf1cf9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:45.360550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-347c6e02-cb33-48b4-90a6-50384daf1cf9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:45.372393 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-347c6e02-cb33-48b4-90a6-50384daf1cf9 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1558 microversion: 2.1 time: 0.219577 Aug 25 14:17:45.373141 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3559/7051] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:45 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:46.218697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-86b0f4d1-c565-4392-ae52-b1633eed98ec req-dbe9f3d7-83c1-42af-9bdd-bc47ed9def91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b08f57-ce2e-49f9-ae7a-c4d381966c50", "name": "network-vif-deleted", "tag": "eafa528f-9143-43ab-a687-2597432a87d4"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:17:46.232256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-86b0f4d1-c565-4392-ae52-b1633eed98ec req-dbe9f3d7-83c1-42af-9bdd-bc47ed9def91 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:46.232880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-86b0f4d1-c565-4392-ae52-b1633eed98ec req-dbe9f3d7-83c1-42af-9bdd-bc47ed9def91 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:46.233441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-86b0f4d1-c565-4392-ae52-b1633eed98ec req-dbe9f3d7-83c1-42af-9bdd-bc47ed9def91 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:46.251462 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-86b0f4d1-c565-4392-ae52-b1633eed98ec req-dbe9f3d7-83c1-42af-9bdd-bc47ed9def91 service nova] Creating event network-vif-deleted:eafa528f-9143-43ab-a687-2597432a87d4 for instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 on n-h2-852771-8 Aug 25 14:17:46.257747 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-86b0f4d1-c565-4392-ae52-b1633eed98ec req-dbe9f3d7-83c1-42af-9bdd-bc47ed9def91 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044881 Aug 25 14:17:46.259365 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3493/7052] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:17:46.398977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:46.399722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:46.407523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:46.408018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:46.408493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:46.409216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:46.409775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:46.410208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:46.453497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:46.454030 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:46.454476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:46.454948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lazy-loading 'fault' on Instance uuid 04b08f57-ce2e-49f9-ae7a-c4d381966c50 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:17:46.502008 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9dc7cff6f743f29b557567ad883ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a294f4a574dc2bcb6030cbccbc703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:46.510975 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e7fcd32a-9987-4892-856b-5b5e8377870f tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 200 len: 1352 microversion: 2.1 time: 0.115890 Aug 25 14:17:46.511599 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3560/7053] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:46 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 1352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:47.534535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:47.535302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] [instance: 04b08f57-ce2e-49f9-ae7a-c4d381966c50] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:47.542849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:47.543359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:47.543825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:47.544560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:47.545034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:47.545478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:47.560326 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] HTTP exception thrown: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 could not be found. Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Request method failure captured: Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 HTTP/1.1 Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4QOWws1eZ5Exd_oNamwoPBCbXiUDRLl6rkE4dD7szEIvW-JeO3iFaI-OhmTESqctQOjWadX6rJt0jEkItlsHuHOjZHt-37KG02CaSWB-mkglMOfEwyiJHlqJMrDQxmbVi6Gafayv4ZmYTXOVtN5cYmrJktH0EoprnEvVn21ZMDTBkk Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f73a294f4a574dc2bcb6030cbccbc703", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f73a294f4a574dc2bcb6030cbccbc703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f73a294f4a574dc2bcb6030cbccbc703"}]}] Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f73a294f4a574dc2bcb6030cbccbc703 Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-493645668 Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 1b9dc7cff6f743f29b557567ad883ccc Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestEncryptedCinderVolumes-493645668-project Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 could not be found. Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '04b08f57-ce2e-49f9-ae7a-c4d381966c50'} Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 could not be found. Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 could not be found. Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:17:47.562058 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:17:47.566628 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:17:47.566628 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:17:47.566628 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:17:47.566628 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:17:47.566628 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:17:47.566628 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 could not be found. Aug 25 14:17:47.566628 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:17:47.566628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Returning 404 to user: Instance 04b08f57-ce2e-49f9-ae7a-c4d381966c50 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:17:47.566628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8e1528f9-a257-4caf-a010-f7256927de19 tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50" status: 404 len: 111 microversion: 2.1 time: 0.033391 Aug 25 14:17:47.566628 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3494/7054] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:47 2022] GET /compute/v2.1/servers/04b08f57-ce2e-49f9-ae7a-c4d381966c50 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:17:47.572508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-54aed16e-69f0-4c6d-89eb-c373ba4ee8cf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] Calling method '.version_select at 0x7f3a2aa30790>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:47.595084 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-54aed16e-69f0-4c6d-89eb-c373ba4ee8cf tempest-TestEncryptedCinderVolumes-493645668 tempest-TestEncryptedCinderVolumes-493645668-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-188897742" status: 202 len: 0 microversion: 2.1 time: 0.026398 Aug 25 14:17:47.596166 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3561/7055] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Aug 25 14:17:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-188897742 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:18:16.365306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5ea1ac4e-e383-4352-965f-8215a5ce3336 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'create', calling method: .version_select at 0x7f3a2e95cb80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-414828589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkLfgFYGUvv7PmrQGz8ryvPihG58+JgUV+OVW8vc+KM5//qTXKPO7i03YjFagOIRRxX+L68FndYvCLRR0/P02uoqmlEwSHAJFNzEszFvynLDwe5Fb+PeGeTkBj1bPQCFg=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:16.372241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=14 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:16.372922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=34 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:16.390084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-5ea1ac4e-e383-4352-965f-8215a5ce3336 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Getting quotas for project f74481623248490cb178e0676c5d11c5. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:18:16.396324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-5ea1ac4e-e383-4352-965f-8215a5ce3336 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Getting quotas for user a9f57144188c49abb04282c2ca4bf680 and project f74481623248490cb178e0676c5d11c5. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:18:16.422275 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5ea1ac4e-e383-4352-965f-8215a5ce3336 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060825 Aug 25 14:18:16.422911 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3495/7056] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:18:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:16.477192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:16.477998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:16.478924 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:18:16.479059 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:18:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.70) !!! Aug 25 14:18:16.485103 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1664365445", "imageRef": "69dbfd30-2b47-4e1f-8cf5-5c048a2f9c64", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-414828589", "networks": [{"uuid": "067631d0-84ea-4ea4-995e-7b46206bb283"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:16.686096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] validate_networks() for [('067631d0-84ea-4ea4-995e-7b46206bb283', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:18:17.078237 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:18:17.078833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:18:17.079342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:18:17.079753 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:18:17.080167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:18:17.089408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:17.091991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:17.092465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:17.093228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:17.093721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:17.094160 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:17.113026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Getting quotas for project f74481623248490cb178e0676c5d11c5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:18:17.120143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Getting quotas for user a9f57144188c49abb04282c2ca4bf680 and project f74481623248490cb178e0676c5d11c5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:18:17.134758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:18:17.137448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69dbfd30-2b47-4e1f-8cf5-5c048a2f9c64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:18:17.185073 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cd0c0e10-1c82-4cec-9b49-fd7b7a11e12d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709953 Aug 25 14:18:17.185781 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3562/7057] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:18:17.196771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b50fabcd-d758-4acb-9786-3e1b1fb5e971 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:17.197411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b50fabcd-d758-4acb-9786-3e1b1fb5e971 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:17.366834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b50fabcd-d758-4acb-9786-3e1b1fb5e971 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:17.375796 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b50fabcd-d758-4acb-9786-3e1b1fb5e971 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1258 microversion: 2.1 time: 0.183115 Aug 25 14:18:17.376398 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3496/7058] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:17 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:18:18.397439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c4369a76-1aa2-4551-b29a-340528af3ec4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:18.398137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c4369a76-1aa2-4551-b29a-340528af3ec4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:18.405401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4369a76-1aa2-4551-b29a-340528af3ec4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:18.405921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4369a76-1aa2-4551-b29a-340528af3ec4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:18.406368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4369a76-1aa2-4551-b29a-340528af3ec4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:18.407087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4369a76-1aa2-4551-b29a-340528af3ec4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:18.407549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4369a76-1aa2-4551-b29a-340528af3ec4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:18.407981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4369a76-1aa2-4551-b29a-340528af3ec4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:18.479782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c4369a76-1aa2-4551-b29a-340528af3ec4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:18.490423 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c4369a76-1aa2-4551-b29a-340528af3ec4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1316 microversion: 2.1 time: 0.097739 Aug 25 14:18:18.491025 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3563/7059] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:18 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1316 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:18:19.512406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-841f6f59-1cd3-40ce-bdd1-ec36dfc97f09 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:19.513036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-841f6f59-1cd3-40ce-bdd1-ec36dfc97f09 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:19.521644 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-841f6f59-1cd3-40ce-bdd1-ec36dfc97f09 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:19.522437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-841f6f59-1cd3-40ce-bdd1-ec36dfc97f09 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:19.523068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-841f6f59-1cd3-40ce-bdd1-ec36dfc97f09 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:19.523965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-841f6f59-1cd3-40ce-bdd1-ec36dfc97f09 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:19.524600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-841f6f59-1cd3-40ce-bdd1-ec36dfc97f09 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:19.525211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-841f6f59-1cd3-40ce-bdd1-ec36dfc97f09 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:19.684887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-841f6f59-1cd3-40ce-bdd1-ec36dfc97f09 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:19.696985 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-841f6f59-1cd3-40ce-bdd1-ec36dfc97f09 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.188384 Aug 25 14:18:19.699925 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3497/7060] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:19 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:20.724621 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-72e73e44-7391-46f9-98c1-862abbe16211 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:20.725746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-72e73e44-7391-46f9-98c1-862abbe16211 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:20.738185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72e73e44-7391-46f9-98c1-862abbe16211 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:20.738882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72e73e44-7391-46f9-98c1-862abbe16211 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:20.739672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72e73e44-7391-46f9-98c1-862abbe16211 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:20.740860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72e73e44-7391-46f9-98c1-862abbe16211 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:20.741677 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72e73e44-7391-46f9-98c1-862abbe16211 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:20.743318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72e73e44-7391-46f9-98c1-862abbe16211 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:20.995613 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-72e73e44-7391-46f9-98c1-862abbe16211 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:21.011998 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-72e73e44-7391-46f9-98c1-862abbe16211 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.295759 Aug 25 14:18:21.012888 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3564/7061] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:20 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:22.035062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-549ef9c5-a43a-4b41-93f4-3fd90ae924d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:22.035837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-549ef9c5-a43a-4b41-93f4-3fd90ae924d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:22.042141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-549ef9c5-a43a-4b41-93f4-3fd90ae924d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:22.042654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-549ef9c5-a43a-4b41-93f4-3fd90ae924d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:22.043111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-549ef9c5-a43a-4b41-93f4-3fd90ae924d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:22.043836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-549ef9c5-a43a-4b41-93f4-3fd90ae924d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:22.044314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-549ef9c5-a43a-4b41-93f4-3fd90ae924d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:22.045660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-549ef9c5-a43a-4b41-93f4-3fd90ae924d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:22.211773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-549ef9c5-a43a-4b41-93f4-3fd90ae924d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:22.220851 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-549ef9c5-a43a-4b41-93f4-3fd90ae924d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.190663 Aug 25 14:18:22.221449 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3498/7062] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:22 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:23.245062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c4d539de-29c2-4431-8bcc-c38f8ba8bce4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:23.246622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c4d539de-29c2-4431-8bcc-c38f8ba8bce4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:23.255121 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4d539de-29c2-4431-8bcc-c38f8ba8bce4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:23.255601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4d539de-29c2-4431-8bcc-c38f8ba8bce4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:23.256033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4d539de-29c2-4431-8bcc-c38f8ba8bce4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:23.256736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4d539de-29c2-4431-8bcc-c38f8ba8bce4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:23.257187 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4d539de-29c2-4431-8bcc-c38f8ba8bce4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:23.257653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4d539de-29c2-4431-8bcc-c38f8ba8bce4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:23.410421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c4d539de-29c2-4431-8bcc-c38f8ba8bce4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:23.418938 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c4d539de-29c2-4431-8bcc-c38f8ba8bce4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.179774 Aug 25 14:18:23.420159 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3565/7063] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:23 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:24.441610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-042b44cb-1784-4108-9e1c-79444c4dcd0b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:24.442287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-042b44cb-1784-4108-9e1c-79444c4dcd0b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:24.449661 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042b44cb-1784-4108-9e1c-79444c4dcd0b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:24.450465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042b44cb-1784-4108-9e1c-79444c4dcd0b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:24.451795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042b44cb-1784-4108-9e1c-79444c4dcd0b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:24.452584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042b44cb-1784-4108-9e1c-79444c4dcd0b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:24.453069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042b44cb-1784-4108-9e1c-79444c4dcd0b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:24.453633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-042b44cb-1784-4108-9e1c-79444c4dcd0b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:24.631471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-042b44cb-1784-4108-9e1c-79444c4dcd0b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:24.640824 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-042b44cb-1784-4108-9e1c-79444c4dcd0b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.203470 Aug 25 14:18:24.641425 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3499/7064] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:24 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:25.663727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c814ca2-2164-42ab-b8f6-98bef5216490 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:25.664375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c814ca2-2164-42ab-b8f6-98bef5216490 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:25.674356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c814ca2-2164-42ab-b8f6-98bef5216490 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:25.674937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c814ca2-2164-42ab-b8f6-98bef5216490 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:25.675386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c814ca2-2164-42ab-b8f6-98bef5216490 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:25.676110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c814ca2-2164-42ab-b8f6-98bef5216490 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:25.676565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c814ca2-2164-42ab-b8f6-98bef5216490 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:25.676992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c814ca2-2164-42ab-b8f6-98bef5216490 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:25.846676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7c814ca2-2164-42ab-b8f6-98bef5216490 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:25.854924 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c814ca2-2164-42ab-b8f6-98bef5216490 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.195046 Aug 25 14:18:25.855638 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3566/7065] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:25 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:26.876635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aa238c74-2dc9-4443-ae65-0fbe31bb175f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:26.877273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aa238c74-2dc9-4443-ae65-0fbe31bb175f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:26.884377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa238c74-2dc9-4443-ae65-0fbe31bb175f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:26.884889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa238c74-2dc9-4443-ae65-0fbe31bb175f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:26.885361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa238c74-2dc9-4443-ae65-0fbe31bb175f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:26.886126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa238c74-2dc9-4443-ae65-0fbe31bb175f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:26.886611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa238c74-2dc9-4443-ae65-0fbe31bb175f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:26.887058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa238c74-2dc9-4443-ae65-0fbe31bb175f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:27.023806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aa238c74-2dc9-4443-ae65-0fbe31bb175f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:27.032004 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aa238c74-2dc9-4443-ae65-0fbe31bb175f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.159971 Aug 25 14:18:27.032731 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3500/7066] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:26 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:28.054185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-11a3f31f-50f7-433b-976b-9930d6ed5d6d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:28.054816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-11a3f31f-50f7-433b-976b-9930d6ed5d6d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:28.057581 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:28.058280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:28.064252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11a3f31f-50f7-433b-976b-9930d6ed5d6d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:28.064749 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11a3f31f-50f7-433b-976b-9930d6ed5d6d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:28.065186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11a3f31f-50f7-433b-976b-9930d6ed5d6d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:28.065948 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11a3f31f-50f7-433b-976b-9930d6ed5d6d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:28.066409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11a3f31f-50f7-433b-976b-9930d6ed5d6d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:28.066836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-11a3f31f-50f7-433b-976b-9930d6ed5d6d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:28.207198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-11a3f31f-50f7-433b-976b-9930d6ed5d6d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:28.215270 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-11a3f31f-50f7-433b-976b-9930d6ed5d6d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.164947 Aug 25 14:18:28.215897 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3567/7067] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:28 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:29.237386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3206744a-d459-4f69-a249-ed69b999a120 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:29.238036 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3206744a-d459-4f69-a249-ed69b999a120 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:29.240106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:29.246332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3206744a-d459-4f69-a249-ed69b999a120 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:29.246836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3206744a-d459-4f69-a249-ed69b999a120 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:29.247409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3206744a-d459-4f69-a249-ed69b999a120 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:29.248937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3206744a-d459-4f69-a249-ed69b999a120 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:29.249617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3206744a-d459-4f69-a249-ed69b999a120 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:29.250072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3206744a-d459-4f69-a249-ed69b999a120 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:29.414829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3206744a-d459-4f69-a249-ed69b999a120 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:29.426304 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3206744a-d459-4f69-a249-ed69b999a120 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.193769 Aug 25 14:18:29.427255 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3501/7068] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:29 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:30.066436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4b276559-5a86-4fc5-8295-05cca0d9fba6 req-806727b4-0c9d-4209-abb5-53989958935f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f8ac5d-fa95-4536-b033-0fd79a1325ac", "tag": "c900320c-b3c2-4446-b374-3032d6de302f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:30.077640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4b276559-5a86-4fc5-8295-05cca0d9fba6 req-806727b4-0c9d-4209-abb5-53989958935f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:30.078146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4b276559-5a86-4fc5-8295-05cca0d9fba6 req-806727b4-0c9d-4209-abb5-53989958935f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:30.078578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4b276559-5a86-4fc5-8295-05cca0d9fba6 req-806727b4-0c9d-4209-abb5-53989958935f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:30.090743 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4b276559-5a86-4fc5-8295-05cca0d9fba6 req-806727b4-0c9d-4209-abb5-53989958935f service nova] Creating event network-changed:c900320c-b3c2-4446-b374-3032d6de302f for instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac on n-h1-852771-8 Aug 25 14:18:30.096518 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4b276559-5a86-4fc5-8295-05cca0d9fba6 req-806727b4-0c9d-4209-abb5-53989958935f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035912 Aug 25 14:18:30.097134 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3568/7069] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:18:30.448386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dd8913fa-815b-48b9-9781-c1bf11625bf8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:30.449032 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dd8913fa-815b-48b9-9781-c1bf11625bf8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:30.457490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd8913fa-815b-48b9-9781-c1bf11625bf8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:30.458166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd8913fa-815b-48b9-9781-c1bf11625bf8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:30.458857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd8913fa-815b-48b9-9781-c1bf11625bf8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:30.459601 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd8913fa-815b-48b9-9781-c1bf11625bf8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:30.460080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd8913fa-815b-48b9-9781-c1bf11625bf8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:30.460536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd8913fa-815b-48b9-9781-c1bf11625bf8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:30.612628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dd8913fa-815b-48b9-9781-c1bf11625bf8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:30.621007 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dd8913fa-815b-48b9-9781-c1bf11625bf8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.176506 Aug 25 14:18:30.621630 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3502/7070] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:30 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:31.643475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f1d1574-2fd5-410f-b35b-92bbee3d4dfa tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:31.644186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9f1d1574-2fd5-410f-b35b-92bbee3d4dfa tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:31.651319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1d1574-2fd5-410f-b35b-92bbee3d4dfa tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:31.651813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1d1574-2fd5-410f-b35b-92bbee3d4dfa tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:31.652257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1d1574-2fd5-410f-b35b-92bbee3d4dfa tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:31.652970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1d1574-2fd5-410f-b35b-92bbee3d4dfa tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:31.653428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1d1574-2fd5-410f-b35b-92bbee3d4dfa tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:31.654558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9f1d1574-2fd5-410f-b35b-92bbee3d4dfa tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:31.791698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9f1d1574-2fd5-410f-b35b-92bbee3d4dfa tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:31.800578 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f1d1574-2fd5-410f-b35b-92bbee3d4dfa tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.162286 Aug 25 14:18:31.801091 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3569/7071] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:31 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:32.821254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0caf272f-6b22-4f11-aac4-2a6286659a54 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:32.821918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0caf272f-6b22-4f11-aac4-2a6286659a54 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:32.829829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0caf272f-6b22-4f11-aac4-2a6286659a54 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:32.830341 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0caf272f-6b22-4f11-aac4-2a6286659a54 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:32.830798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0caf272f-6b22-4f11-aac4-2a6286659a54 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:32.831524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0caf272f-6b22-4f11-aac4-2a6286659a54 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:32.832000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0caf272f-6b22-4f11-aac4-2a6286659a54 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:32.832492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0caf272f-6b22-4f11-aac4-2a6286659a54 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:32.974905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0caf272f-6b22-4f11-aac4-2a6286659a54 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:32.984297 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0caf272f-6b22-4f11-aac4-2a6286659a54 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.166769 Aug 25 14:18:32.987166 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3503/7072] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:32 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:34.005225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad09cffb-5a6c-4f69-94f5-cf189cf12b31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:34.005885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad09cffb-5a6c-4f69-94f5-cf189cf12b31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:34.012739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad09cffb-5a6c-4f69-94f5-cf189cf12b31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:34.013259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad09cffb-5a6c-4f69-94f5-cf189cf12b31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:34.013724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad09cffb-5a6c-4f69-94f5-cf189cf12b31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:34.014461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad09cffb-5a6c-4f69-94f5-cf189cf12b31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:34.014912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad09cffb-5a6c-4f69-94f5-cf189cf12b31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:34.015335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad09cffb-5a6c-4f69-94f5-cf189cf12b31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:34.150457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ad09cffb-5a6c-4f69-94f5-cf189cf12b31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:34.160018 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad09cffb-5a6c-4f69-94f5-cf189cf12b31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.158677 Aug 25 14:18:34.160625 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3570/7073] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:34 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:35.182657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6f813bc5-5e61-4cdf-a0e4-05cc7980c183 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:35.183282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6f813bc5-5e61-4cdf-a0e4-05cc7980c183 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:35.190386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f813bc5-5e61-4cdf-a0e4-05cc7980c183 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:35.191223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f813bc5-5e61-4cdf-a0e4-05cc7980c183 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:35.192075 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f813bc5-5e61-4cdf-a0e4-05cc7980c183 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:35.192799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f813bc5-5e61-4cdf-a0e4-05cc7980c183 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:35.193368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f813bc5-5e61-4cdf-a0e4-05cc7980c183 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:35.193900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6f813bc5-5e61-4cdf-a0e4-05cc7980c183 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:35.333153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6f813bc5-5e61-4cdf-a0e4-05cc7980c183 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:35.341181 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6f813bc5-5e61-4cdf-a0e4-05cc7980c183 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.162546 Aug 25 14:18:35.341783 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3504/7074] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:35 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:36.307004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-83dd6044-b677-407d-86f4-1fe04f7851f5 req-be329f70-77c4-41f1-afec-11a1bafe5df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f8ac5d-fa95-4536-b033-0fd79a1325ac", "name": "network-vif-plugged", "status": "completed", "tag": "c900320c-b3c2-4446-b374-3032d6de302f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:36.318049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-83dd6044-b677-407d-86f4-1fe04f7851f5 req-be329f70-77c4-41f1-afec-11a1bafe5df5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:36.318543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-83dd6044-b677-407d-86f4-1fe04f7851f5 req-be329f70-77c4-41f1-afec-11a1bafe5df5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:36.319029 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-83dd6044-b677-407d-86f4-1fe04f7851f5 req-be329f70-77c4-41f1-afec-11a1bafe5df5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:36.331952 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-83dd6044-b677-407d-86f4-1fe04f7851f5 req-be329f70-77c4-41f1-afec-11a1bafe5df5 service nova] Creating event network-vif-plugged:c900320c-b3c2-4446-b374-3032d6de302f for instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac on n-h1-852771-8 Aug 25 14:18:36.337560 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-83dd6044-b677-407d-86f4-1fe04f7851f5 req-be329f70-77c4-41f1-afec-11a1bafe5df5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034431 Aug 25 14:18:36.338182 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3571/7075] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:18:36.362592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-37fbba24-603a-4cfe-98d4-0fe8c8d16982 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:36.363231 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-37fbba24-603a-4cfe-98d4-0fe8c8d16982 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:36.370359 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37fbba24-603a-4cfe-98d4-0fe8c8d16982 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:36.370865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37fbba24-603a-4cfe-98d4-0fe8c8d16982 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:36.371329 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37fbba24-603a-4cfe-98d4-0fe8c8d16982 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:36.372056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37fbba24-603a-4cfe-98d4-0fe8c8d16982 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:36.373044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37fbba24-603a-4cfe-98d4-0fe8c8d16982 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:36.373494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37fbba24-603a-4cfe-98d4-0fe8c8d16982 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:36.515468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37fbba24-603a-4cfe-98d4-0fe8c8d16982 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:36.523831 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-37fbba24-603a-4cfe-98d4-0fe8c8d16982 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.165204 Aug 25 14:18:36.524768 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3505/7076] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:36 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:18:37.546315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-72f5c75e-e82d-454e-9843-f98ccb5ec6cf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:37.547020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-72f5c75e-e82d-454e-9843-f98ccb5ec6cf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:37.553351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72f5c75e-e82d-454e-9843-f98ccb5ec6cf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:37.554251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72f5c75e-e82d-454e-9843-f98ccb5ec6cf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:37.554375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72f5c75e-e82d-454e-9843-f98ccb5ec6cf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:37.554997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72f5c75e-e82d-454e-9843-f98ccb5ec6cf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:37.555453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72f5c75e-e82d-454e-9843-f98ccb5ec6cf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:37.555891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72f5c75e-e82d-454e-9843-f98ccb5ec6cf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:37.694342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-72f5c75e-e82d-454e-9843-f98ccb5ec6cf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:37.702909 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-72f5c75e-e82d-454e-9843-f98ccb5ec6cf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1358 microversion: 2.1 time: 0.162127 Aug 25 14:18:37.703508 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3572/7077] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:37 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:38.723768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-353f5f3c-07f8-4fc8-a55c-d9f2b3891f12 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:38.724430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-353f5f3c-07f8-4fc8-a55c-d9f2b3891f12 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:38.731474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-353f5f3c-07f8-4fc8-a55c-d9f2b3891f12 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:38.732635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-353f5f3c-07f8-4fc8-a55c-d9f2b3891f12 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:38.733097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-353f5f3c-07f8-4fc8-a55c-d9f2b3891f12 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:38.733850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-353f5f3c-07f8-4fc8-a55c-d9f2b3891f12 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:38.734323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-353f5f3c-07f8-4fc8-a55c-d9f2b3891f12 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:38.734768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-353f5f3c-07f8-4fc8-a55c-d9f2b3891f12 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:38.873190 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-353f5f3c-07f8-4fc8-a55c-d9f2b3891f12 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:38.881241 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-353f5f3c-07f8-4fc8-a55c-d9f2b3891f12 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1548 microversion: 2.1 time: 0.161393 Aug 25 14:18:38.881867 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3506/7078] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:38 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:38.907316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-52b76ec1-0606-45b8-9d80-bfe137b11328 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:38.907925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-52b76ec1-0606-45b8-9d80-bfe137b11328 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:38.915216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52b76ec1-0606-45b8-9d80-bfe137b11328 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:38.915786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52b76ec1-0606-45b8-9d80-bfe137b11328 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:38.916139 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52b76ec1-0606-45b8-9d80-bfe137b11328 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:38.916845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52b76ec1-0606-45b8-9d80-bfe137b11328 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:38.917296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52b76ec1-0606-45b8-9d80-bfe137b11328 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:38.917759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-52b76ec1-0606-45b8-9d80-bfe137b11328 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:39.055722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-52b76ec1-0606-45b8-9d80-bfe137b11328 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:39.064742 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-52b76ec1-0606-45b8-9d80-bfe137b11328 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1548 microversion: 2.1 time: 0.162304 Aug 25 14:18:39.065340 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3573/7079] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:38 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:39.084902 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:39.089849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:39.090629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Searching by: {'deleted': False, 'project_id': 'f74481623248490cb178e0676c5d11c5'} {{(pid=129059) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 14:18:39.096339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:39.096839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:39.097295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:39.098084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:39.098552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:39.099091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:39.124700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.multi_cell_list [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129059) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 14:18:39.152004 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef6c22ef-faca-4f3d-9b9f-da2a54a4c052 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070873 Aug 25 14:18:39.152596 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3507/7080] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 14:18:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:39.164882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6cae99d5-316f-4912-9548-6cfae1b1ff31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:39.165437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6cae99d5-316f-4912-9548-6cfae1b1ff31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:39.172446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cae99d5-316f-4912-9548-6cfae1b1ff31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:39.172845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cae99d5-316f-4912-9548-6cfae1b1ff31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:39.173288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cae99d5-316f-4912-9548-6cfae1b1ff31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:39.174041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cae99d5-316f-4912-9548-6cfae1b1ff31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:39.174497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cae99d5-316f-4912-9548-6cfae1b1ff31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:39.174915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6cae99d5-316f-4912-9548-6cfae1b1ff31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:39.328476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6cae99d5-316f-4912-9548-6cfae1b1ff31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:39.336360 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6cae99d5-316f-4912-9548-6cfae1b1ff31 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1548 microversion: 2.1 time: 0.175387 Aug 25 14:18:39.336953 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3574/7081] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:39 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:40.896971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fdc4a6d3-298c-4d9a-a3c1-e63cbd5ef2a3 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e5d1505-614e-4771-9c3c-abfc0a3d85ba"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:40.899412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fdc4a6d3-298c-4d9a-a3c1-e63cbd5ef2a3 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:40.906595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdc4a6d3-298c-4d9a-a3c1-e63cbd5ef2a3 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:40.907106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdc4a6d3-298c-4d9a-a3c1-e63cbd5ef2a3 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:40.907569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdc4a6d3-298c-4d9a-a3c1-e63cbd5ef2a3 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:40.908292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdc4a6d3-298c-4d9a-a3c1-e63cbd5ef2a3 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:40.908765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdc4a6d3-298c-4d9a-a3c1-e63cbd5ef2a3 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:40.909224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fdc4a6d3-298c-4d9a-a3c1-e63cbd5ef2a3 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:41.182867 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fdc4a6d3-298c-4d9a-a3c1-e63cbd5ef2a3 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289563 Aug 25 14:18:41.183502 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3508/7082] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 14:18:40 2022] POST /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:54.347750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-decc1aab-dae6-4c3d-a82e-05d5cb6a09c8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:54.348363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-decc1aab-dae6-4c3d-a82e-05d5cb6a09c8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:54.351240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:54.351923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=66 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:54.358988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-decc1aab-dae6-4c3d-a82e-05d5cb6a09c8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:54.359478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-decc1aab-dae6-4c3d-a82e-05d5cb6a09c8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:54.359917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-decc1aab-dae6-4c3d-a82e-05d5cb6a09c8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:54.360646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-decc1aab-dae6-4c3d-a82e-05d5cb6a09c8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:54.361081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-decc1aab-dae6-4c3d-a82e-05d5cb6a09c8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:54.361498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-decc1aab-dae6-4c3d-a82e-05d5cb6a09c8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:54.515455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-decc1aab-dae6-4c3d-a82e-05d5cb6a09c8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:54.523983 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-decc1aab-dae6-4c3d-a82e-05d5cb6a09c8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1594 microversion: 2.1 time: 0.180226 Aug 25 14:18:54.524577 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3575/7083] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:54 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1594 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:56.486244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:56.488862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:56.490052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:56.495784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-e3c2d3c2-a576-4bcf-885a-781594d30e65 req-bea86d33-b71c-4e9b-a16d-0f54b2a60498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f8ac5d-fa95-4536-b033-0fd79a1325ac", "tag": "c900320c-b3c2-4446-b374-3032d6de302f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:56.506702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e3c2d3c2-a576-4bcf-885a-781594d30e65 req-bea86d33-b71c-4e9b-a16d-0f54b2a60498 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:56.507164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e3c2d3c2-a576-4bcf-885a-781594d30e65 req-bea86d33-b71c-4e9b-a16d-0f54b2a60498 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:56.507642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e3c2d3c2-a576-4bcf-885a-781594d30e65 req-bea86d33-b71c-4e9b-a16d-0f54b2a60498 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:56.521897 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-e3c2d3c2-a576-4bcf-885a-781594d30e65 req-bea86d33-b71c-4e9b-a16d-0f54b2a60498 service nova] Creating event network-changed:c900320c-b3c2-4446-b374-3032d6de302f for instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac on n-h1-852771-8 Aug 25 14:18:56.527510 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-e3c2d3c2-a576-4bcf-885a-781594d30e65 req-bea86d33-b71c-4e9b-a16d-0f54b2a60498 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042870 Aug 25 14:18:56.528844 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3509/7084] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:57.589185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f4c77814-b206-404c-892e-03074644861e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2006577182"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:57.589833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f4c77814-b206-404c-892e-03074644861e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:57.597127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4c77814-b206-404c-892e-03074644861e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:57.597671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4c77814-b206-404c-892e-03074644861e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:57.598113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4c77814-b206-404c-892e-03074644861e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:57.598811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4c77814-b206-404c-892e-03074644861e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:57.599264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4c77814-b206-404c-892e-03074644861e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:57.599695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f4c77814-b206-404c-892e-03074644861e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:57.740672 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.network.security_group_api [None req-f4c77814-b206-404c-892e-03074644861e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Adding security group e0360df6-667c-42d3-9277-4a02cc837ec0 to port c900320c-b3c2-4446-b374-3032d6de302f Aug 25 14:18:58.087501 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f4c77814-b206-404c-892e-03074644861e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/action" status: 202 len: 0 microversion: 2.1 time: 0.502000 Aug 25 14:18:58.088476 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3576/7085] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:18:57 2022] POST /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:18:58.100441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb4a0ed1-3fdb-459c-b16b-50adad387ab4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:58.102070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fb4a0ed1-3fdb-459c-b16b-50adad387ab4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:58.110730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb4a0ed1-3fdb-459c-b16b-50adad387ab4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:58.111127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb4a0ed1-3fdb-459c-b16b-50adad387ab4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:58.112197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb4a0ed1-3fdb-459c-b16b-50adad387ab4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:58.114868 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb4a0ed1-3fdb-459c-b16b-50adad387ab4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:58.115641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb4a0ed1-3fdb-459c-b16b-50adad387ab4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:58.116285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb4a0ed1-3fdb-459c-b16b-50adad387ab4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:58.192710 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-953214c8-922e-44d3-b88e-98cc668ebc54 req-41c95e25-aa92-456d-b6c9-bd1613575552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f8ac5d-fa95-4536-b033-0fd79a1325ac", "tag": "c900320c-b3c2-4446-b374-3032d6de302f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:58.205145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-953214c8-922e-44d3-b88e-98cc668ebc54 req-41c95e25-aa92-456d-b6c9-bd1613575552 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:58.206047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-953214c8-922e-44d3-b88e-98cc668ebc54 req-41c95e25-aa92-456d-b6c9-bd1613575552 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:58.206734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-953214c8-922e-44d3-b88e-98cc668ebc54 req-41c95e25-aa92-456d-b6c9-bd1613575552 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:58.221315 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-953214c8-922e-44d3-b88e-98cc668ebc54 req-41c95e25-aa92-456d-b6c9-bd1613575552 service nova] Creating event network-changed:c900320c-b3c2-4446-b374-3032d6de302f for instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac on n-h1-852771-8 Aug 25 14:18:58.227533 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-953214c8-922e-44d3-b88e-98cc668ebc54 req-41c95e25-aa92-456d-b6c9-bd1613575552 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131531 Aug 25 14:18:58.228687 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3577/7086] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:58.331056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fb4a0ed1-3fdb-459c-b16b-50adad387ab4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:58.347075 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb4a0ed1-3fdb-459c-b16b-50adad387ab4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1760 microversion: 2.1 time: 0.251476 Aug 25 14:18:58.347958 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3510/7087] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:58 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1760 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:10.320248 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88c62c8a-2359-4afe-9127-87fbb298a4bd] AMQP server on 10.222.0.70:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 25 14:21:10.321102 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f63c0a0b-f433-4f36-b733-64add1270791] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:21:10.321759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:10.322510 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=12 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:10.323759 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:21:10.323900 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:21:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/action (ip 10.222.0.70) !!! Aug 25 14:21:10.325029 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:21:10.325267 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:21:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/action (ip 10.222.0.70) !!! Aug 25 14:21:10.333034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a71b8206-7be3-4fed-8455-fc1fc6f5d822 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:21:10.336052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a71b8206-7be3-4fed-8455-fc1fc6f5d822 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:10.345165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a71b8206-7be3-4fed-8455-fc1fc6f5d822 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:10.345165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a71b8206-7be3-4fed-8455-fc1fc6f5d822 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:10.345872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a71b8206-7be3-4fed-8455-fc1fc6f5d822 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:10.346211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a71b8206-7be3-4fed-8455-fc1fc6f5d822 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:10.346564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a71b8206-7be3-4fed-8455-fc1fc6f5d822 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:10.346995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a71b8206-7be3-4fed-8455-fc1fc6f5d822 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:10.433637 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a71b8206-7be3-4fed-8455-fc1fc6f5d822 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/action" status: 202 len: 0 microversion: 2.1 time: 0.115082 Aug 25 14:21:10.437833 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3578/7088] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:21:10 2022] POST /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:21:10.442649 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ca47b9fd-db5f-4659-9198-232383143200] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:21:10.443636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:10.444665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:10.446084 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:21:10.446084 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:21:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac (ip 10.222.0.70) !!! Aug 25 14:21:10.447802 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:21:10.447942 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:21:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac (ip 10.222.0.70) !!! Aug 25 14:21:10.454042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a1de9b2b-d9f4-464c-b94d-b937551b84dc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:10.454685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a1de9b2b-d9f4-464c-b94d-b937551b84dc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:10.466407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1de9b2b-d9f4-464c-b94d-b937551b84dc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:10.467332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1de9b2b-d9f4-464c-b94d-b937551b84dc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:10.468162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1de9b2b-d9f4-464c-b94d-b937551b84dc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:10.469420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1de9b2b-d9f4-464c-b94d-b937551b84dc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:10.470235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1de9b2b-d9f4-464c-b94d-b937551b84dc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:10.470855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a1de9b2b-d9f4-464c-b94d-b937551b84dc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:10.656594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a1de9b2b-d9f4-464c-b94d-b937551b84dc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:10.666970 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a1de9b2b-d9f4-464c-b94d-b937551b84dc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1762 microversion: 2.1 time: 0.227405 Aug 25 14:21:10.667724 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3511/7089] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:10 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1762 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:11.694347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e800b6b6-bb08-4274-af43-d052e063522b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:11.695111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e800b6b6-bb08-4274-af43-d052e063522b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:11.711379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e800b6b6-bb08-4274-af43-d052e063522b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:11.712250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e800b6b6-bb08-4274-af43-d052e063522b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:11.713033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e800b6b6-bb08-4274-af43-d052e063522b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:11.714308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e800b6b6-bb08-4274-af43-d052e063522b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:11.715102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e800b6b6-bb08-4274-af43-d052e063522b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:11.715868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e800b6b6-bb08-4274-af43-d052e063522b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:11.739712 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] [88c62c8a-2359-4afe-9127-87fbb298a4bd] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57280. Aug 25 14:21:11.740425 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] [f63c0a0b-f433-4f36-b733-64add1270791] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57282. Aug 25 14:21:11.886437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e800b6b6-bb08-4274-af43-d052e063522b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:11.896114 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e800b6b6-bb08-4274-af43-d052e063522b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1760 microversion: 2.1 time: 0.209494 Aug 25 14:21:11.896579 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3579/7090] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:11 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1760 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:52.015502 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [-] [745e3532-2cb0-4f99-b902-ef5e74eccfa3] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:22:52.017872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:52.018641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:52.019550 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:22:52.019720 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/action (ip 10.222.0.70) !!! Aug 25 14:22:52.025491 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-593c2842-41ef-456d-8392-f90514369457 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2006577182"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:52.026085 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-593c2842-41ef-456d-8392-f90514369457 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:52.037271 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593c2842-41ef-456d-8392-f90514369457 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:52.037809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593c2842-41ef-456d-8392-f90514369457 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:52.038275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593c2842-41ef-456d-8392-f90514369457 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:52.039001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593c2842-41ef-456d-8392-f90514369457 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:52.039476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593c2842-41ef-456d-8392-f90514369457 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:52.039934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593c2842-41ef-456d-8392-f90514369457 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:52.045308 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] [ca47b9fd-db5f-4659-9198-232383143200] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57318. Aug 25 14:22:52.175977 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.network.security_group_api [None req-593c2842-41ef-456d-8392-f90514369457 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Removing security group e0360df6-667c-42d3-9277-4a02cc837ec0 from port c900320c-b3c2-4446-b374-3032d6de302f Aug 25 14:22:52.494167 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-593c2842-41ef-456d-8392-f90514369457 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/action" status: 202 len: 0 microversion: 2.1 time: 0.480092 Aug 25 14:22:52.498287 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3512/7091] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:22:52 2022] POST /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:22:52.502034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:52.502797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:52.503633 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:22:52.503820 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Aug 25 14:22:52.509938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-11a750d6-1c31-4074-b7cb-3bfebd47a34e req-865bcb18-7fe2-4f2d-9e78-9d54b643ee06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f8ac5d-fa95-4536-b033-0fd79a1325ac", "tag": "c900320c-b3c2-4446-b374-3032d6de302f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:52.523637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-11a750d6-1c31-4074-b7cb-3bfebd47a34e req-865bcb18-7fe2-4f2d-9e78-9d54b643ee06 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:52.524133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-11a750d6-1c31-4074-b7cb-3bfebd47a34e req-865bcb18-7fe2-4f2d-9e78-9d54b643ee06 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:52.525455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-11a750d6-1c31-4074-b7cb-3bfebd47a34e req-865bcb18-7fe2-4f2d-9e78-9d54b643ee06 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:52.541152 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-11a750d6-1c31-4074-b7cb-3bfebd47a34e req-865bcb18-7fe2-4f2d-9e78-9d54b643ee06 service nova] Creating event network-changed:c900320c-b3c2-4446-b374-3032d6de302f for instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac on n-h1-852771-8 Aug 25 14:22:52.546700 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-11a750d6-1c31-4074-b7cb-3bfebd47a34e req-865bcb18-7fe2-4f2d-9e78-9d54b643ee06 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046514 Aug 25 14:22:52.547495 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3580/7092] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:22:53.733054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2ef5b048-f8e7-442a-b771-fbd2d4d08b2f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:53.733605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2ef5b048-f8e7-442a-b771-fbd2d4d08b2f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:53.741000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef5b048-f8e7-442a-b771-fbd2d4d08b2f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:53.741536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef5b048-f8e7-442a-b771-fbd2d4d08b2f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:53.742013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef5b048-f8e7-442a-b771-fbd2d4d08b2f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:53.742890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef5b048-f8e7-442a-b771-fbd2d4d08b2f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:53.743421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef5b048-f8e7-442a-b771-fbd2d4d08b2f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:53.743718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2ef5b048-f8e7-442a-b771-fbd2d4d08b2f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:53.750026 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] [745e3532-2cb0-4f99-b902-ef5e74eccfa3] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57344. Aug 25 14:22:53.835239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-2ef5b048-f8e7-442a-b771-fbd2d4d08b2f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lazy-loading 'services' on Instance uuid 24f8ac5d-fa95-4536-b033-0fd79a1325ac {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:22:53.921158 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2ef5b048-f8e7-442a-b771-fbd2d4d08b2f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments/6e5d1505-614e-4771-9c3c-abfc0a3d85ba" status: 202 len: 0 microversion: 2.1 time: 0.193636 Aug 25 14:22:53.922002 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3513/7093] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 14:22:53 2022] DELETE /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments/6e5d1505-614e-4771-9c3c-abfc0a3d85ba => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:22:53.933395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c49aedee-b3e9-4f1c-bf08-005a5eef2e73 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:53.935714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c49aedee-b3e9-4f1c-bf08-005a5eef2e73 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:53.944033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c49aedee-b3e9-4f1c-bf08-005a5eef2e73 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:53.944574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c49aedee-b3e9-4f1c-bf08-005a5eef2e73 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:53.945229 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c49aedee-b3e9-4f1c-bf08-005a5eef2e73 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:53.947203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c49aedee-b3e9-4f1c-bf08-005a5eef2e73 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:53.947532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c49aedee-b3e9-4f1c-bf08-005a5eef2e73 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:53.948108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c49aedee-b3e9-4f1c-bf08-005a5eef2e73 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:53.984246 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c49aedee-b3e9-4f1c-bf08-005a5eef2e73 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056970 Aug 25 14:22:53.984838 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3581/7094] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:22:53 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:22:54.564405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ecfba86d-d993-4866-97e1-2e5ef8656a45 req-14402305-72f3-4a1a-bb5d-09fe4868dd42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f8ac5d-fa95-4536-b033-0fd79a1325ac", "tag": "c900320c-b3c2-4446-b374-3032d6de302f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:54.580905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ecfba86d-d993-4866-97e1-2e5ef8656a45 req-14402305-72f3-4a1a-bb5d-09fe4868dd42 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:54.580905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ecfba86d-d993-4866-97e1-2e5ef8656a45 req-14402305-72f3-4a1a-bb5d-09fe4868dd42 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:54.580905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ecfba86d-d993-4866-97e1-2e5ef8656a45 req-14402305-72f3-4a1a-bb5d-09fe4868dd42 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:54.593557 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ecfba86d-d993-4866-97e1-2e5ef8656a45 req-14402305-72f3-4a1a-bb5d-09fe4868dd42 service nova] Creating event network-changed:c900320c-b3c2-4446-b374-3032d6de302f for instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac on n-h1-852771-8 Aug 25 14:22:54.599210 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ecfba86d-d993-4866-97e1-2e5ef8656a45 req-14402305-72f3-4a1a-bb5d-09fe4868dd42 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039504 Aug 25 14:22:54.600761 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3514/7095] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:22:54.997452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-489c4e6b-9b94-408b-ace0-9f30cc1cd106 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:55.000527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-489c4e6b-9b94-408b-ace0-9f30cc1cd106 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:55.008251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-489c4e6b-9b94-408b-ace0-9f30cc1cd106 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:55.009574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-489c4e6b-9b94-408b-ace0-9f30cc1cd106 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:55.010210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-489c4e6b-9b94-408b-ace0-9f30cc1cd106 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:55.011191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-489c4e6b-9b94-408b-ace0-9f30cc1cd106 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:55.011657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-489c4e6b-9b94-408b-ace0-9f30cc1cd106 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:55.012089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-489c4e6b-9b94-408b-ace0-9f30cc1cd106 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:55.051912 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-489c4e6b-9b94-408b-ace0-9f30cc1cd106 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059033 Aug 25 14:22:55.052742 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3582/7096] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:22:54 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:22:56.066681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-62b9cc7f-aa5d-4893-8d64-f14cf6907fb2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:56.069073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-62b9cc7f-aa5d-4893-8d64-f14cf6907fb2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:56.076468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62b9cc7f-aa5d-4893-8d64-f14cf6907fb2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:56.076982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62b9cc7f-aa5d-4893-8d64-f14cf6907fb2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:56.077445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62b9cc7f-aa5d-4893-8d64-f14cf6907fb2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:56.078211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62b9cc7f-aa5d-4893-8d64-f14cf6907fb2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:56.078693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62b9cc7f-aa5d-4893-8d64-f14cf6907fb2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:56.079409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-62b9cc7f-aa5d-4893-8d64-f14cf6907fb2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:56.115109 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-62b9cc7f-aa5d-4893-8d64-f14cf6907fb2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053583 Aug 25 14:22:56.115891 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3515/7097] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:22:56 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:22:57.128745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-448821dd-21f4-4d0b-b0f5-45b2dd5405e2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:57.131241 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-448821dd-21f4-4d0b-b0f5-45b2dd5405e2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:57.139441 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-448821dd-21f4-4d0b-b0f5-45b2dd5405e2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:57.139938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-448821dd-21f4-4d0b-b0f5-45b2dd5405e2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:57.140483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-448821dd-21f4-4d0b-b0f5-45b2dd5405e2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:57.141219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-448821dd-21f4-4d0b-b0f5-45b2dd5405e2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:57.141747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-448821dd-21f4-4d0b-b0f5-45b2dd5405e2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:57.142185 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-448821dd-21f4-4d0b-b0f5-45b2dd5405e2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:57.178094 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-448821dd-21f4-4d0b-b0f5-45b2dd5405e2 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053347 Aug 25 14:22:57.178720 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3583/7098] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:22:57 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:22:58.191915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5a40944f-160f-419b-afb2-72de048f0101 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:58.194400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5a40944f-160f-419b-afb2-72de048f0101 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:58.202705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a40944f-160f-419b-afb2-72de048f0101 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:58.203194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a40944f-160f-419b-afb2-72de048f0101 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:58.203654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a40944f-160f-419b-afb2-72de048f0101 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:58.204665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a40944f-160f-419b-afb2-72de048f0101 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:58.205138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a40944f-160f-419b-afb2-72de048f0101 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:58.205626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5a40944f-160f-419b-afb2-72de048f0101 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:58.238646 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5a40944f-160f-419b-afb2-72de048f0101 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051022 Aug 25 14:22:58.239255 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3516/7099] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:22:58 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:22:59.256628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8e45f040-4929-497e-8673-22ad7c462576 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:59.260475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8e45f040-4929-497e-8673-22ad7c462576 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:59.270212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e45f040-4929-497e-8673-22ad7c462576 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:59.270716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e45f040-4929-497e-8673-22ad7c462576 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:59.271163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e45f040-4929-497e-8673-22ad7c462576 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:59.271884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e45f040-4929-497e-8673-22ad7c462576 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:59.272352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e45f040-4929-497e-8673-22ad7c462576 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:59.272788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8e45f040-4929-497e-8673-22ad7c462576 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:59.309207 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8e45f040-4929-497e-8673-22ad7c462576 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060561 Aug 25 14:22:59.309851 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3584/7100] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:22:59 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 14:22:59.320934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:59.321567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:59.338739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:59.339268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:59.340318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:59.340502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:59.340983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:59.341435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:59.434159 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] HTTP exception thrown: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac is not attached to volume 6e5d1505-614e-4771-9c3c-abfc0a3d85ba Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Request method failure captured: Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: request: DELETE /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments/6e5d1505-614e-4771-9c3c-abfc0a3d85ba HTTP/1.1 Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4SZtrKkVoIG6mv9Yk0l1UlOrrRlQcSV7d_7CzXk1M_KKqFewVgdDQlpcrGW2BwuMXyPou3gkW5KZIm27WLIcef0KUK5gPbKns3LN0wBMQFotGK_0lnhnOeL19WQyMfLsKT99IYkZd2SGBC6I5pWf0t4qpoKid7n6yWkh_sBlI5GqLc Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f74481623248490cb178e0676c5d11c5 Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f74481623248490cb178e0676c5d11c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f74481623248490cb178e0676c5d11c5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f74481623248490cb178e0676c5d11c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f74481623248490cb178e0676c5d11c5"}]}] Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f74481623248490cb178e0676c5d11c5 Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestMinimumBasicScenario-1146926442-project Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a9f57144188c49abb04282c2ca4bf680 Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestMinimumBasicScenario-1146926442-project Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac is not attached to volume 6e5d1505-614e-4771-9c3c-abfc0a3d85ba Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'server_id': '24f8ac5d-fa95-4536-b033-0fd79a1325ac', 'id': '6e5d1505-614e-4771-9c3c-abfc0a3d85ba'} Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6e5d1505-614e-4771-9c3c-abfc0a3d85ba. Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac is not attached to volume 6e5d1505-614e-4771-9c3c-abfc0a3d85ba Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:22:59.435812 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:22:59.440634 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:22:59.440634 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:22:59.440634 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac is not attached to volume 6e5d1505-614e-4771-9c3c-abfc0a3d85ba Aug 25 14:22:59.440634 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:22:59.440634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Returning 404 to user: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac is not attached to volume 6e5d1505-614e-4771-9c3c-abfc0a3d85ba {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:22:59.440634 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4112c627-8730-418a-b7d3-87843166eabc tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments/6e5d1505-614e-4771-9c3c-abfc0a3d85ba" status: 404 len: 154 microversion: 2.1 time: 0.120668 Aug 25 14:22:59.440634 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3517/7101] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 14:22:59 2022] DELETE /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac/os-volume_attachments/6e5d1505-614e-4771-9c3c-abfc0a3d85ba => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:23:02.749192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9557a7ae-baad-43db-bf9d-b43ca4f721b9 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:02.749875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9557a7ae-baad-43db-bf9d-b43ca4f721b9 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:02.757286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9557a7ae-baad-43db-bf9d-b43ca4f721b9 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:02.757814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9557a7ae-baad-43db-bf9d-b43ca4f721b9 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:02.758258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9557a7ae-baad-43db-bf9d-b43ca4f721b9 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:02.760872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9557a7ae-baad-43db-bf9d-b43ca4f721b9 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:02.760872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9557a7ae-baad-43db-bf9d-b43ca4f721b9 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:02.760872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9557a7ae-baad-43db-bf9d-b43ca4f721b9 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:02.793202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9557a7ae-baad-43db-bf9d-b43ca4f721b9 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:23:02.898863 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9557a7ae-baad-43db-bf9d-b43ca4f721b9 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 204 len: 0 microversion: 2.1 time: 0.152853 Aug 25 14:23:02.900171 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3585/7102] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:23:02 2022] DELETE /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:23:02.914413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-218d753f-dfc6-4329-b26f-048af2c06f42 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:02.915709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-218d753f-dfc6-4329-b26f-048af2c06f42 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:02.922847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-218d753f-dfc6-4329-b26f-048af2c06f42 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:02.923512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-218d753f-dfc6-4329-b26f-048af2c06f42 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:02.923885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-218d753f-dfc6-4329-b26f-048af2c06f42 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:02.924704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-218d753f-dfc6-4329-b26f-048af2c06f42 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:02.925076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-218d753f-dfc6-4329-b26f-048af2c06f42 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:02.925531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-218d753f-dfc6-4329-b26f-048af2c06f42 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:03.089938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-218d753f-dfc6-4329-b26f-048af2c06f42 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:03.099527 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-218d753f-dfc6-4329-b26f-048af2c06f42 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1554 microversion: 2.1 time: 0.192536 Aug 25 14:23:03.100228 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3518/7103] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:02 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:04.121498 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8ce04b44-fd27-4e55-ad90-cb937b214c56 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:04.122242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8ce04b44-fd27-4e55-ad90-cb937b214c56 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:04.130523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ce04b44-fd27-4e55-ad90-cb937b214c56 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:04.131010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ce04b44-fd27-4e55-ad90-cb937b214c56 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:04.131444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ce04b44-fd27-4e55-ad90-cb937b214c56 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:04.132154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ce04b44-fd27-4e55-ad90-cb937b214c56 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:04.132609 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ce04b44-fd27-4e55-ad90-cb937b214c56 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:04.133031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8ce04b44-fd27-4e55-ad90-cb937b214c56 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:04.644321 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8ce04b44-fd27-4e55-ad90-cb937b214c56 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:04.656558 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8ce04b44-fd27-4e55-ad90-cb937b214c56 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1554 microversion: 2.1 time: 0.539736 Aug 25 14:23:04.657174 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3586/7104] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:04 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1554 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:05.431903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-1fe283c4-bc1c-47bd-ad68-6d9c2e5e6ac1 req-991756d0-8a68-4df6-a217-d204e9cfdcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f8ac5d-fa95-4536-b033-0fd79a1325ac", "name": "network-vif-deleted", "tag": "c900320c-b3c2-4446-b374-3032d6de302f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:05.442851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1fe283c4-bc1c-47bd-ad68-6d9c2e5e6ac1 req-991756d0-8a68-4df6-a217-d204e9cfdcd0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:05.443342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1fe283c4-bc1c-47bd-ad68-6d9c2e5e6ac1 req-991756d0-8a68-4df6-a217-d204e9cfdcd0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:05.443806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-1fe283c4-bc1c-47bd-ad68-6d9c2e5e6ac1 req-991756d0-8a68-4df6-a217-d204e9cfdcd0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:05.458229 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-1fe283c4-bc1c-47bd-ad68-6d9c2e5e6ac1 req-991756d0-8a68-4df6-a217-d204e9cfdcd0 service nova] Creating event network-vif-deleted:c900320c-b3c2-4446-b374-3032d6de302f for instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac on n-h1-852771-8 Aug 25 14:23:05.464450 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-1fe283c4-bc1c-47bd-ad68-6d9c2e5e6ac1 req-991756d0-8a68-4df6-a217-d204e9cfdcd0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141596 Aug 25 14:23:05.465099 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3519/7105] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:23:05.681054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:05.681730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:05.689331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:05.689866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:05.690314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:05.691043 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:05.691508 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:05.691960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:05.732975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:05.733481 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:05.734003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:05.734519 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lazy-loading 'fault' on Instance uuid 24f8ac5d-fa95-4536-b033-0fd79a1325ac {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:23:05.783431 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:05.792756 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-396b87fc-370c-4ccb-bfee-507bc92889bb tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 200 len: 1348 microversion: 2.1 time: 0.116100 Aug 25 14:23:05.793340 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3587/7106] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:05 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 1348 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:06.878116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:06.878972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: 24f8ac5d-fa95-4536-b033-0fd79a1325ac] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:06.887106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:06.887733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:06.888213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:06.888993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:06.889484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:06.889977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:06.906012 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] HTTP exception thrown: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac could not be found. Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Request method failure captured: Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac HTTP/1.1 Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4SZtrKkVoIG6mv9Yk0l1UlOrrRlQcSV7d_7CzXk1M_KKqFewVgdDQlpcrGW2BwuMXyPou3gkW5KZIm27WLIcef0KUK5gPbKns3LN0wBMQFotGK_0lnhnOeL19WQyMfLsKT99IYkZd2SGBC6I5pWf0t4qpoKid7n6yWkh_sBlI5GqLc Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: f74481623248490cb178e0676c5d11c5 Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f74481623248490cb178e0676c5d11c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f74481623248490cb178e0676c5d11c5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f74481623248490cb178e0676c5d11c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f74481623248490cb178e0676c5d11c5"}]}] Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: f74481623248490cb178e0676c5d11c5 Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestMinimumBasicScenario-1146926442-project Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: a9f57144188c49abb04282c2ca4bf680 Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestMinimumBasicScenario-1146926442-project Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac could not be found. Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '24f8ac5d-fa95-4536-b033-0fd79a1325ac'} Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac could not be found. Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac could not be found. Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:23:06.907642 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:23:06.912597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:23:06.912597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:23:06.912597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:23:06.912597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:23:06.912597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:23:06.912597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac could not be found. Aug 25 14:23:06.912597 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:23:06.912597 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Returning 404 to user: Instance 24f8ac5d-fa95-4536-b033-0fd79a1325ac could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:23:06.912597 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6baf9ae3-824f-4e92-a399-d3bdf8f99a89 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac" status: 404 len: 111 microversion: 2.1 time: 0.097152 Aug 25 14:23:06.912597 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3520/7107] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:06 2022] GET /compute/v2.1/servers/24f8ac5d-fa95-4536-b033-0fd79a1325ac => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:23:06.920091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9f935536-a5c6-4cb3-9a15-6006ae2f5e70 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '.version_select at 0x7f3a2e812940>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:06.950196 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9f935536-a5c6-4cb3-9a15-6006ae2f5e70 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-414828589" status: 202 len: 0 microversion: 2.1 time: 0.035146 Aug 25 14:23:06.950799 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3588/7108] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 14:23:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-414828589 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:23:16.791145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8431f9e6-b8cf-4fb5-8d5b-33ff19c27c60 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'create', calling method: .version_select at 0x7f3a2a55b790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-104063895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFrIcgchaYdhTUhpHcKUOoNpN5WtkFgtrN9kQ0L0caJNx47H5P1uCX+5dkxWi3qd//hmT7x8u99ITAyFzreb6IBUgwsnq4PtBxgglRnoK7M1IMF1yR1XT5KfGgiqstEZQ=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:16.809262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-8431f9e6-b8cf-4fb5-8d5b-33ff19c27c60 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Getting quotas for project f74481623248490cb178e0676c5d11c5. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:23:16.815051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-8431f9e6-b8cf-4fb5-8d5b-33ff19c27c60 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Getting quotas for user a9f57144188c49abb04282c2ca4bf680 and project f74481623248490cb178e0676c5d11c5. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:23:16.843739 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8431f9e6-b8cf-4fb5-8d5b-33ff19c27c60 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056985 Aug 25 14:23:16.844360 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3521/7109] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:23:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:23:16.895197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:16.899790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1183482944", "imageRef": "646d3008-74c4-4ba5-b5d0-4176bdc54ba0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-104063895", "networks": [{"uuid": "067631d0-84ea-4ea4-995e-7b46206bb283"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:17.005910 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] validate_networks() for [('067631d0-84ea-4ea4-995e-7b46206bb283', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:23:17.524933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:23:17.525369 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:23:17.525889 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:23:17.526319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:23:17.526740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:23:17.536642 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:17.537133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:17.537612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:17.538485 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:17.538961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:17.539397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:17.559528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Getting quotas for project f74481623248490cb178e0676c5d11c5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:23:17.565455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Getting quotas for user a9f57144188c49abb04282c2ca4bf680 and project f74481623248490cb178e0676c5d11c5. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:23:17.580585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:23:17.582826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='646d3008-74c4-4ba5-b5d0-4176bdc54ba0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:23:17.632220 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3778831a-8daf-413c-ab75-7f45c253149d tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738923 Aug 25 14:23:17.632886 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3589/7110] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:23:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:23:17.641547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:17.646055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77409b9b-8c99-478f-85cf-b25cd6000fde tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:17.646700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-77409b9b-8c99-478f-85cf-b25cd6000fde tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:17.763315 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-77409b9b-8c99-478f-85cf-b25cd6000fde tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:17.776144 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-77409b9b-8c99-478f-85cf-b25cd6000fde tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1258 microversion: 2.1 time: 0.134952 Aug 25 14:23:17.777143 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3522/7111] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:17 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1258 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:23:18.797341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e4992281-3c9f-43b8-9c08-d53aad1c9301 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:18.798304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e4992281-3c9f-43b8-9c08-d53aad1c9301 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:18.859644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e4992281-3c9f-43b8-9c08-d53aad1c9301 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:18.866916 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e4992281-3c9f-43b8-9c08-d53aad1c9301 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1258 microversion: 2.1 time: 0.074355 Aug 25 14:23:18.867524 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3590/7112] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:18 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:19.894150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eab90f1c-a389-440a-9a1b-51e1b83b5499 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:19.895155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eab90f1c-a389-440a-9a1b-51e1b83b5499 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:19.966069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eab90f1c-a389-440a-9a1b-51e1b83b5499 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:19.975246 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eab90f1c-a389-440a-9a1b-51e1b83b5499 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1258 microversion: 2.1 time: 0.088372 Aug 25 14:23:19.975853 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3523/7113] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:19 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1258 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:23:21.004768 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-28fccf18-063e-46d7-a51b-eecd0a40fe17 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:21.005416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-28fccf18-063e-46d7-a51b-eecd0a40fe17 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:21.083809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-28fccf18-063e-46d7-a51b-eecd0a40fe17 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:21.094485 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-28fccf18-063e-46d7-a51b-eecd0a40fe17 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1258 microversion: 2.1 time: 0.093813 Aug 25 14:23:21.095091 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3591/7114] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:20 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:22.116544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-704a9c26-3b11-40dd-afd2-968d442170a0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:22.117174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-704a9c26-3b11-40dd-afd2-968d442170a0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:22.119932 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:22.125312 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-704a9c26-3b11-40dd-afd2-968d442170a0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:22.125862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-704a9c26-3b11-40dd-afd2-968d442170a0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:22.126325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-704a9c26-3b11-40dd-afd2-968d442170a0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:22.127063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-704a9c26-3b11-40dd-afd2-968d442170a0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:22.127541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-704a9c26-3b11-40dd-afd2-968d442170a0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:22.127993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-704a9c26-3b11-40dd-afd2-968d442170a0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:22.195572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-704a9c26-3b11-40dd-afd2-968d442170a0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:22.203470 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-704a9c26-3b11-40dd-afd2-968d442170a0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1262 microversion: 2.1 time: 0.090916 Aug 25 14:23:22.204063 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3524/7115] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:22 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:23.225224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-059b8c8c-683d-40c5-8566-778d0b24096a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:23.226186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-059b8c8c-683d-40c5-8566-778d0b24096a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:23.245002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:23.247763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-059b8c8c-683d-40c5-8566-778d0b24096a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:23.248564 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-059b8c8c-683d-40c5-8566-778d0b24096a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:23.249198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-059b8c8c-683d-40c5-8566-778d0b24096a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:23.262650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-059b8c8c-683d-40c5-8566-778d0b24096a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:23.263418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-059b8c8c-683d-40c5-8566-778d0b24096a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:23.264039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-059b8c8c-683d-40c5-8566-778d0b24096a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:23.374760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-059b8c8c-683d-40c5-8566-778d0b24096a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:23.384550 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-059b8c8c-683d-40c5-8566-778d0b24096a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1316 microversion: 2.1 time: 0.163551 Aug 25 14:23:23.401350 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3592/7116] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:23 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:24.408676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-450ba74f-b191-4c8f-8926-21f768ac6e43 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:24.409406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-450ba74f-b191-4c8f-8926-21f768ac6e43 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:24.418291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-450ba74f-b191-4c8f-8926-21f768ac6e43 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:24.419270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-450ba74f-b191-4c8f-8926-21f768ac6e43 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:24.419894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-450ba74f-b191-4c8f-8926-21f768ac6e43 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:24.420821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-450ba74f-b191-4c8f-8926-21f768ac6e43 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:24.421958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-450ba74f-b191-4c8f-8926-21f768ac6e43 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:24.422586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-450ba74f-b191-4c8f-8926-21f768ac6e43 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:24.630229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-450ba74f-b191-4c8f-8926-21f768ac6e43 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:24.646479 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-450ba74f-b191-4c8f-8926-21f768ac6e43 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.241420 Aug 25 14:23:24.648061 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3525/7117] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:24 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:23:25.672500 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff986a0c-21d9-4756-bd89-0f9343c46342 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:25.673904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff986a0c-21d9-4756-bd89-0f9343c46342 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:25.683580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff986a0c-21d9-4756-bd89-0f9343c46342 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:25.684243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff986a0c-21d9-4756-bd89-0f9343c46342 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:25.685200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff986a0c-21d9-4756-bd89-0f9343c46342 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:25.686334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff986a0c-21d9-4756-bd89-0f9343c46342 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:25.687086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff986a0c-21d9-4756-bd89-0f9343c46342 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:25.687594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff986a0c-21d9-4756-bd89-0f9343c46342 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:25.877817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff986a0c-21d9-4756-bd89-0f9343c46342 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:25.889666 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff986a0c-21d9-4756-bd89-0f9343c46342 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.222449 Aug 25 14:23:25.890289 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3593/7118] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:25 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:26.916946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-bba5cbf7-9680-4f65-9f56-5b172fc6197f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:26.917977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-bba5cbf7-9680-4f65-9f56-5b172fc6197f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:26.926576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bba5cbf7-9680-4f65-9f56-5b172fc6197f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:26.927904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bba5cbf7-9680-4f65-9f56-5b172fc6197f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:26.927904 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bba5cbf7-9680-4f65-9f56-5b172fc6197f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:26.929105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bba5cbf7-9680-4f65-9f56-5b172fc6197f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:26.929105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bba5cbf7-9680-4f65-9f56-5b172fc6197f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:26.929793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-bba5cbf7-9680-4f65-9f56-5b172fc6197f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:27.138767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-bba5cbf7-9680-4f65-9f56-5b172fc6197f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:27.153854 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-bba5cbf7-9680-4f65-9f56-5b172fc6197f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.241611 Aug 25 14:23:27.154800 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3526/7119] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:26 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:28.182388 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e0b7916d-d0e1-460b-9b8a-b1f1e57f03bf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:28.183947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e0b7916d-d0e1-460b-9b8a-b1f1e57f03bf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:28.187188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:28.194615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0b7916d-d0e1-460b-9b8a-b1f1e57f03bf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:28.195180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0b7916d-d0e1-460b-9b8a-b1f1e57f03bf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:28.196317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0b7916d-d0e1-460b-9b8a-b1f1e57f03bf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:28.197252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0b7916d-d0e1-460b-9b8a-b1f1e57f03bf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:28.197761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0b7916d-d0e1-460b-9b8a-b1f1e57f03bf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:28.198196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e0b7916d-d0e1-460b-9b8a-b1f1e57f03bf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:28.343198 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e0b7916d-d0e1-460b-9b8a-b1f1e57f03bf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:28.351818 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e0b7916d-d0e1-460b-9b8a-b1f1e57f03bf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.175268 Aug 25 14:23:28.353227 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3594/7120] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:28 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:29.374084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-299bbca4-e351-4526-8138-d2168d5a857f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:29.374781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-299bbca4-e351-4526-8138-d2168d5a857f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:29.381891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-299bbca4-e351-4526-8138-d2168d5a857f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:29.382404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-299bbca4-e351-4526-8138-d2168d5a857f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:29.382861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-299bbca4-e351-4526-8138-d2168d5a857f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:29.383847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-299bbca4-e351-4526-8138-d2168d5a857f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:29.384461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-299bbca4-e351-4526-8138-d2168d5a857f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:29.384913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-299bbca4-e351-4526-8138-d2168d5a857f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:29.587793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-299bbca4-e351-4526-8138-d2168d5a857f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:29.596668 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-299bbca4-e351-4526-8138-d2168d5a857f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.226236 Aug 25 14:23:29.597500 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3527/7121] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:29 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:30.621036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9101bc93-d25f-4a83-8184-bb7631d72685 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:30.621720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9101bc93-d25f-4a83-8184-bb7631d72685 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:30.628590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9101bc93-d25f-4a83-8184-bb7631d72685 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:30.629069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9101bc93-d25f-4a83-8184-bb7631d72685 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:30.629521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9101bc93-d25f-4a83-8184-bb7631d72685 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:30.630236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9101bc93-d25f-4a83-8184-bb7631d72685 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:30.630704 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9101bc93-d25f-4a83-8184-bb7631d72685 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:30.631138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9101bc93-d25f-4a83-8184-bb7631d72685 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:30.764470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9101bc93-d25f-4a83-8184-bb7631d72685 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:30.772230 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9101bc93-d25f-4a83-8184-bb7631d72685 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.155884 Aug 25 14:23:30.772816 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3595/7122] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:30 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:31.791561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:31.796770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1e9097c0-71e0-47ed-98f2-147d4c1b313a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:31.797401 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1e9097c0-71e0-47ed-98f2-147d4c1b313a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:31.803943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9097c0-71e0-47ed-98f2-147d4c1b313a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:31.804440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9097c0-71e0-47ed-98f2-147d4c1b313a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:31.804985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9097c0-71e0-47ed-98f2-147d4c1b313a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:31.805907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9097c0-71e0-47ed-98f2-147d4c1b313a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:31.806382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9097c0-71e0-47ed-98f2-147d4c1b313a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:31.806820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1e9097c0-71e0-47ed-98f2-147d4c1b313a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:31.944778 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1e9097c0-71e0-47ed-98f2-147d4c1b313a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:31.955392 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1e9097c0-71e0-47ed-98f2-147d4c1b313a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.164553 Aug 25 14:23:31.956024 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3528/7123] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:31 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:32.978180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2f2a0ad7-f85e-4111-82cc-ec7fc0c868fd tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:32.978901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2f2a0ad7-f85e-4111-82cc-ec7fc0c868fd tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:32.980689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:32.986958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f2a0ad7-f85e-4111-82cc-ec7fc0c868fd tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:32.987447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f2a0ad7-f85e-4111-82cc-ec7fc0c868fd tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:32.987886 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f2a0ad7-f85e-4111-82cc-ec7fc0c868fd tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:32.988588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f2a0ad7-f85e-4111-82cc-ec7fc0c868fd tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:32.989047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f2a0ad7-f85e-4111-82cc-ec7fc0c868fd tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:32.989476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2f2a0ad7-f85e-4111-82cc-ec7fc0c868fd tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:33.124777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2f2a0ad7-f85e-4111-82cc-ec7fc0c868fd tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:33.132679 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2f2a0ad7-f85e-4111-82cc-ec7fc0c868fd tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.158598 Aug 25 14:23:33.133316 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3596/7124] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:32 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:33.990174 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-5c125ee7-c5b7-498b-993c-cf2d246fcfd9 req-fb987adc-1949-449c-9efc-53cff2284c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a281bd22-83c4-4ed2-a523-c70d3a5dac6f", "tag": "d236389f-1a7c-4f15-9b61-74c730051590"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:34.002914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5c125ee7-c5b7-498b-993c-cf2d246fcfd9 req-fb987adc-1949-449c-9efc-53cff2284c60 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:34.003718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5c125ee7-c5b7-498b-993c-cf2d246fcfd9 req-fb987adc-1949-449c-9efc-53cff2284c60 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:34.004172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5c125ee7-c5b7-498b-993c-cf2d246fcfd9 req-fb987adc-1949-449c-9efc-53cff2284c60 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:34.016214 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5c125ee7-c5b7-498b-993c-cf2d246fcfd9 req-fb987adc-1949-449c-9efc-53cff2284c60 service nova] Creating event network-changed:d236389f-1a7c-4f15-9b61-74c730051590 for instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f on n-h2-852771-8 Aug 25 14:23:34.021581 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-5c125ee7-c5b7-498b-993c-cf2d246fcfd9 req-fb987adc-1949-449c-9efc-53cff2284c60 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035627 Aug 25 14:23:34.022223 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3529/7125] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:23:34.154244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1e714d3e-439d-4cab-8600-3925c330202e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:34.154848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1e714d3e-439d-4cab-8600-3925c330202e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:34.161793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e714d3e-439d-4cab-8600-3925c330202e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:34.162277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e714d3e-439d-4cab-8600-3925c330202e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:34.162713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e714d3e-439d-4cab-8600-3925c330202e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:34.163404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e714d3e-439d-4cab-8600-3925c330202e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:34.163860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e714d3e-439d-4cab-8600-3925c330202e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:34.165003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1e714d3e-439d-4cab-8600-3925c330202e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:34.312996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1e714d3e-439d-4cab-8600-3925c330202e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:34.330746 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1e714d3e-439d-4cab-8600-3925c330202e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.180350 Aug 25 14:23:34.331365 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3597/7126] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:34 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:35.353870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-949eae5d-f0ba-409b-80d4-196fd199b6ec tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:35.354495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-949eae5d-f0ba-409b-80d4-196fd199b6ec tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:35.360725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-949eae5d-f0ba-409b-80d4-196fd199b6ec tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:35.361226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-949eae5d-f0ba-409b-80d4-196fd199b6ec tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:35.361707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-949eae5d-f0ba-409b-80d4-196fd199b6ec tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:35.362421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-949eae5d-f0ba-409b-80d4-196fd199b6ec tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:35.362888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-949eae5d-f0ba-409b-80d4-196fd199b6ec tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:35.363330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-949eae5d-f0ba-409b-80d4-196fd199b6ec tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:35.496516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-949eae5d-f0ba-409b-80d4-196fd199b6ec tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:35.504410 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-949eae5d-f0ba-409b-80d4-196fd199b6ec tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.156377 Aug 25 14:23:35.504986 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3530/7127] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:35 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:36.530818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5b2f02ba-f9a1-4ad7-9189-cea8e319df4c tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:36.531604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5b2f02ba-f9a1-4ad7-9189-cea8e319df4c tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:36.540776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b2f02ba-f9a1-4ad7-9189-cea8e319df4c tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:36.541400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b2f02ba-f9a1-4ad7-9189-cea8e319df4c tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:36.541786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b2f02ba-f9a1-4ad7-9189-cea8e319df4c tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:36.543415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b2f02ba-f9a1-4ad7-9189-cea8e319df4c tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:36.543415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b2f02ba-f9a1-4ad7-9189-cea8e319df4c tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:36.544064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5b2f02ba-f9a1-4ad7-9189-cea8e319df4c tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:36.696439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5b2f02ba-f9a1-4ad7-9189-cea8e319df4c tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:36.704919 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5b2f02ba-f9a1-4ad7-9189-cea8e319df4c tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.179327 Aug 25 14:23:36.705759 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3598/7128] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:36 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:23:37.727730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-11a1012f-1332-480e-9a23-0ab0cbbf9ecf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:37.728365 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-11a1012f-1332-480e-9a23-0ab0cbbf9ecf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:37.735260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11a1012f-1332-480e-9a23-0ab0cbbf9ecf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:37.735757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11a1012f-1332-480e-9a23-0ab0cbbf9ecf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:37.736206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11a1012f-1332-480e-9a23-0ab0cbbf9ecf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:37.736910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11a1012f-1332-480e-9a23-0ab0cbbf9ecf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:37.737375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11a1012f-1332-480e-9a23-0ab0cbbf9ecf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:37.737837 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-11a1012f-1332-480e-9a23-0ab0cbbf9ecf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:37.873915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-11a1012f-1332-480e-9a23-0ab0cbbf9ecf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:37.882155 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-11a1012f-1332-480e-9a23-0ab0cbbf9ecf tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.158725 Aug 25 14:23:37.882477 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3531/7129] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:37 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:38.904348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-06e684a6-38b9-47ed-b401-8fe69bd95143 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:38.905137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-06e684a6-38b9-47ed-b401-8fe69bd95143 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:38.912792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e684a6-38b9-47ed-b401-8fe69bd95143 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:38.913278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e684a6-38b9-47ed-b401-8fe69bd95143 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:38.913746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e684a6-38b9-47ed-b401-8fe69bd95143 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:38.914659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e684a6-38b9-47ed-b401-8fe69bd95143 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:38.915117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e684a6-38b9-47ed-b401-8fe69bd95143 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:38.915551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-06e684a6-38b9-47ed-b401-8fe69bd95143 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:39.048882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-06e684a6-38b9-47ed-b401-8fe69bd95143 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:39.057285 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-06e684a6-38b9-47ed-b401-8fe69bd95143 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.157138 Aug 25 14:23:39.057906 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3599/7130] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:38 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:40.081137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-663abca8-b44a-4224-9ce2-b040b57e4b04 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:40.082395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-663abca8-b44a-4224-9ce2-b040b57e4b04 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:40.092206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-663abca8-b44a-4224-9ce2-b040b57e4b04 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:40.092736 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-663abca8-b44a-4224-9ce2-b040b57e4b04 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:40.093240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-663abca8-b44a-4224-9ce2-b040b57e4b04 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:40.093966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-663abca8-b44a-4224-9ce2-b040b57e4b04 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:40.094444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-663abca8-b44a-4224-9ce2-b040b57e4b04 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:40.094920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-663abca8-b44a-4224-9ce2-b040b57e4b04 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:40.234844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-663abca8-b44a-4224-9ce2-b040b57e4b04 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:40.243118 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-663abca8-b44a-4224-9ce2-b040b57e4b04 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.166636 Aug 25 14:23:40.243700 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3532/7131] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:40 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:40.852418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-132776fc-b512-4b98-a7be-7c9953c78c9e req-d1962ceb-81c4-49f3-82b8-ac8221978510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a281bd22-83c4-4ed2-a523-c70d3a5dac6f", "name": "network-vif-plugged", "status": "completed", "tag": "d236389f-1a7c-4f15-9b61-74c730051590"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:40.862617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-132776fc-b512-4b98-a7be-7c9953c78c9e req-d1962ceb-81c4-49f3-82b8-ac8221978510 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:40.863102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-132776fc-b512-4b98-a7be-7c9953c78c9e req-d1962ceb-81c4-49f3-82b8-ac8221978510 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:40.863539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-132776fc-b512-4b98-a7be-7c9953c78c9e req-d1962ceb-81c4-49f3-82b8-ac8221978510 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:40.875033 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-132776fc-b512-4b98-a7be-7c9953c78c9e req-d1962ceb-81c4-49f3-82b8-ac8221978510 service nova] Creating event network-vif-plugged:d236389f-1a7c-4f15-9b61-74c730051590 for instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f on n-h2-852771-8 Aug 25 14:23:40.879978 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-132776fc-b512-4b98-a7be-7c9953c78c9e req-d1962ceb-81c4-49f3-82b8-ac8221978510 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096068 Aug 25 14:23:40.880579 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3600/7132] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:23:41.263931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-88755a12-1169-4134-8514-ba4d916d8382 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:41.264561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-88755a12-1169-4134-8514-ba4d916d8382 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:41.271583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88755a12-1169-4134-8514-ba4d916d8382 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:41.272086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88755a12-1169-4134-8514-ba4d916d8382 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:41.272544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88755a12-1169-4134-8514-ba4d916d8382 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:41.273266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88755a12-1169-4134-8514-ba4d916d8382 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:41.274288 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88755a12-1169-4134-8514-ba4d916d8382 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:41.274744 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-88755a12-1169-4134-8514-ba4d916d8382 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:41.416492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-88755a12-1169-4134-8514-ba4d916d8382 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:41.424598 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-88755a12-1169-4134-8514-ba4d916d8382 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1358 microversion: 2.1 time: 0.164624 Aug 25 14:23:41.425348 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3533/7133] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:41 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:42.449124 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2a86349-8bad-4954-a520-acbc916918c4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:42.449925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b2a86349-8bad-4954-a520-acbc916918c4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:42.456549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a86349-8bad-4954-a520-acbc916918c4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:42.457037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a86349-8bad-4954-a520-acbc916918c4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:42.457480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a86349-8bad-4954-a520-acbc916918c4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:42.458206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a86349-8bad-4954-a520-acbc916918c4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:42.458668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a86349-8bad-4954-a520-acbc916918c4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:42.459095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2a86349-8bad-4954-a520-acbc916918c4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:42.601544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b2a86349-8bad-4954-a520-acbc916918c4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:42.609463 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2a86349-8bad-4954-a520-acbc916918c4 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1549 microversion: 2.1 time: 0.166981 Aug 25 14:23:42.610087 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3601/7134] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:42 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:42.629933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87b8d19b-3f33-4b6d-9a80-23f78a5451d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:42.630562 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-87b8d19b-3f33-4b6d-9a80-23f78a5451d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:42.638332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b8d19b-3f33-4b6d-9a80-23f78a5451d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:42.638831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b8d19b-3f33-4b6d-9a80-23f78a5451d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:42.639294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b8d19b-3f33-4b6d-9a80-23f78a5451d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:42.640006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b8d19b-3f33-4b6d-9a80-23f78a5451d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:42.640473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b8d19b-3f33-4b6d-9a80-23f78a5451d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:42.640915 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87b8d19b-3f33-4b6d-9a80-23f78a5451d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:42.777426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-87b8d19b-3f33-4b6d-9a80-23f78a5451d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:42.785458 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87b8d19b-3f33-4b6d-9a80-23f78a5451d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1549 microversion: 2.1 time: 0.159346 Aug 25 14:23:42.786109 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3534/7135] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:42 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:42.808862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:42.813596 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:42.814372 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Searching by: {'deleted': False, 'project_id': 'f74481623248490cb178e0676c5d11c5'} {{(pid=129060) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 14:23:42.819862 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:42.820342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:42.820781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:42.821571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:42.822247 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:42.822662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:42.847571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.multi_cell_list [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 14:23:42.878098 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-85b4699c-fde9-4c3b-866e-be7a79cda0ae tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073005 Aug 25 14:23:42.878693 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3602/7136] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Aug 25 14:23:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:23:42.890712 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5777e482-2205-49c2-81c0-a9bb26400d99 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:42.891353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5777e482-2205-49c2-81c0-a9bb26400d99 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:42.897808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5777e482-2205-49c2-81c0-a9bb26400d99 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:42.898317 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5777e482-2205-49c2-81c0-a9bb26400d99 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:42.898770 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5777e482-2205-49c2-81c0-a9bb26400d99 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:42.899596 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5777e482-2205-49c2-81c0-a9bb26400d99 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:42.900633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5777e482-2205-49c2-81c0-a9bb26400d99 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:42.901153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5777e482-2205-49c2-81c0-a9bb26400d99 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:43.034023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5777e482-2205-49c2-81c0-a9bb26400d99 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:43.042039 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5777e482-2205-49c2-81c0-a9bb26400d99 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1549 microversion: 2.1 time: 0.155385 Aug 25 14:23:43.042624 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3535/7137] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:42 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:44.560403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-279343fc-63c0-476a-8cb5-fc40bc395880 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccbe042c-89aa-4734-a1e2-8cc25a1b4950"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:44.562821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-279343fc-63c0-476a-8cb5-fc40bc395880 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:44.569808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-279343fc-63c0-476a-8cb5-fc40bc395880 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:44.570299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-279343fc-63c0-476a-8cb5-fc40bc395880 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:44.570746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-279343fc-63c0-476a-8cb5-fc40bc395880 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:44.572106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-279343fc-63c0-476a-8cb5-fc40bc395880 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:44.572681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-279343fc-63c0-476a-8cb5-fc40bc395880 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:44.573108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-279343fc-63c0-476a-8cb5-fc40bc395880 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:44.828726 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-279343fc-63c0-476a-8cb5-fc40bc395880 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272282 Aug 25 14:23:44.830017 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3603/7138] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Aug 25 14:23:44 2022] POST /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:23:55.639897 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-42c2b506-7815-4513-b7ed-1e2f16c7b23a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:55.640619 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-42c2b506-7815-4513-b7ed-1e2f16c7b23a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:55.643037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=23 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:55.643948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=68 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:55.651535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42c2b506-7815-4513-b7ed-1e2f16c7b23a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:55.652595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42c2b506-7815-4513-b7ed-1e2f16c7b23a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:55.653058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42c2b506-7815-4513-b7ed-1e2f16c7b23a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:55.653856 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42c2b506-7815-4513-b7ed-1e2f16c7b23a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:55.654332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42c2b506-7815-4513-b7ed-1e2f16c7b23a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:55.654786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-42c2b506-7815-4513-b7ed-1e2f16c7b23a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:55.797416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-42c2b506-7815-4513-b7ed-1e2f16c7b23a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:55.806819 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-42c2b506-7815-4513-b7ed-1e2f16c7b23a tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1595 microversion: 2.1 time: 0.170903 Aug 25 14:23:55.807440 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3536/7139] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:55 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1595 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:57.934127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-76f29999-8fa9-45f4-94ef-4a54d05773f9 req-6e4708ab-1f2e-4800-92c4-6607f8da6a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a281bd22-83c4-4ed2-a523-c70d3a5dac6f", "tag": "d236389f-1a7c-4f15-9b61-74c730051590"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:57.939759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:57.941034 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=23 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:57.941873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:57.950521 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-76f29999-8fa9-45f4-94ef-4a54d05773f9 req-6e4708ab-1f2e-4800-92c4-6607f8da6a9e service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:57.950992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-76f29999-8fa9-45f4-94ef-4a54d05773f9 req-6e4708ab-1f2e-4800-92c4-6607f8da6a9e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:57.951576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-76f29999-8fa9-45f4-94ef-4a54d05773f9 req-6e4708ab-1f2e-4800-92c4-6607f8da6a9e service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:57.966312 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-76f29999-8fa9-45f4-94ef-4a54d05773f9 req-6e4708ab-1f2e-4800-92c4-6607f8da6a9e service nova] Creating event network-changed:d236389f-1a7c-4f15-9b61-74c730051590 for instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f on n-h2-852771-8 Aug 25 14:23:57.972099 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-76f29999-8fa9-45f4-94ef-4a54d05773f9 req-6e4708ab-1f2e-4800-92c4-6607f8da6a9e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043454 Aug 25 14:23:57.973009 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3604/7140] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:23:59.066994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0a9589d5-e1b2-4c6d-b5ba-60ab34714bac tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-440257208"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:59.067582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0a9589d5-e1b2-4c6d-b5ba-60ab34714bac tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:59.075666 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a9589d5-e1b2-4c6d-b5ba-60ab34714bac tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:59.076181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a9589d5-e1b2-4c6d-b5ba-60ab34714bac tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:59.076636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a9589d5-e1b2-4c6d-b5ba-60ab34714bac tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:59.077364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a9589d5-e1b2-4c6d-b5ba-60ab34714bac tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:59.077872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a9589d5-e1b2-4c6d-b5ba-60ab34714bac tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:59.078313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0a9589d5-e1b2-4c6d-b5ba-60ab34714bac tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:59.218884 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.network.security_group_api [None req-0a9589d5-e1b2-4c6d-b5ba-60ab34714bac tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Adding security group d5074084-bfae-4d81-a5bd-4276de6ba807 to port d236389f-1a7c-4f15-9b61-74c730051590 Aug 25 14:23:59.560052 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0a9589d5-e1b2-4c6d-b5ba-60ab34714bac tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/action" status: 202 len: 0 microversion: 2.1 time: 0.497656 Aug 25 14:23:59.564831 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3537/7141] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:23:59 2022] POST /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:23:59.576771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c0dace26-16f5-4c22-a94b-3642ea49c998 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:59.577418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c0dace26-16f5-4c22-a94b-3642ea49c998 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:59.584583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0dace26-16f5-4c22-a94b-3642ea49c998 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:59.585096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0dace26-16f5-4c22-a94b-3642ea49c998 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:59.585586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0dace26-16f5-4c22-a94b-3642ea49c998 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:59.586319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0dace26-16f5-4c22-a94b-3642ea49c998 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:59.587585 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0dace26-16f5-4c22-a94b-3642ea49c998 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:59.588239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c0dace26-16f5-4c22-a94b-3642ea49c998 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:59.668482 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d5bd3f1b-2487-4b8c-a586-d15047ad37f6 req-f8a8f907-2a8a-486d-95c7-a7a085f2f388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a281bd22-83c4-4ed2-a523-c70d3a5dac6f", "tag": "d236389f-1a7c-4f15-9b61-74c730051590"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:59.682329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d5bd3f1b-2487-4b8c-a586-d15047ad37f6 req-f8a8f907-2a8a-486d-95c7-a7a085f2f388 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:59.683203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d5bd3f1b-2487-4b8c-a586-d15047ad37f6 req-f8a8f907-2a8a-486d-95c7-a7a085f2f388 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:59.684003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d5bd3f1b-2487-4b8c-a586-d15047ad37f6 req-f8a8f907-2a8a-486d-95c7-a7a085f2f388 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:59.698413 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d5bd3f1b-2487-4b8c-a586-d15047ad37f6 req-f8a8f907-2a8a-486d-95c7-a7a085f2f388 service nova] Creating event network-changed:d236389f-1a7c-4f15-9b61-74c730051590 for instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f on n-h2-852771-8 Aug 25 14:23:59.704044 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d5bd3f1b-2487-4b8c-a586-d15047ad37f6 req-f8a8f907-2a8a-486d-95c7-a7a085f2f388 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137169 Aug 25 14:23:59.705558 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3605/7142] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:23:59.763698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c0dace26-16f5-4c22-a94b-3642ea49c998 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:59.773385 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c0dace26-16f5-4c22-a94b-3642ea49c998 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1758 microversion: 2.1 time: 0.202579 Aug 25 14:23:59.775047 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3538/7143] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:59 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:57.382175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:57.382915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:57.388987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d58df21a-4590-4183-b74b-d6b1d0f42d86 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:24:57.391345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d58df21a-4590-4183-b74b-d6b1d0f42d86 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:57.400078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d58df21a-4590-4183-b74b-d6b1d0f42d86 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:57.400577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d58df21a-4590-4183-b74b-d6b1d0f42d86 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:57.401018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d58df21a-4590-4183-b74b-d6b1d0f42d86 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:57.402410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d58df21a-4590-4183-b74b-d6b1d0f42d86 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:57.402873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d58df21a-4590-4183-b74b-d6b1d0f42d86 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:57.403308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d58df21a-4590-4183-b74b-d6b1d0f42d86 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:57.479254 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d58df21a-4590-4183-b74b-d6b1d0f42d86 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/action" status: 202 len: 0 microversion: 2.1 time: 0.098993 Aug 25 14:24:57.480933 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3606/7144] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:24:57 2022] POST /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:24:57.489438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3737c903-6b9d-4b88-9c24-b5a7fe3710b6 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:57.489880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3737c903-6b9d-4b88-9c24-b5a7fe3710b6 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:57.492250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:57.492931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=16 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:57.493796 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:24:57.493932 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:24:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f (ip 10.222.0.70) !!! Aug 25 14:24:57.503014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3737c903-6b9d-4b88-9c24-b5a7fe3710b6 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:57.503527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3737c903-6b9d-4b88-9c24-b5a7fe3710b6 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:57.503999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3737c903-6b9d-4b88-9c24-b5a7fe3710b6 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:57.504742 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3737c903-6b9d-4b88-9c24-b5a7fe3710b6 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:57.505351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3737c903-6b9d-4b88-9c24-b5a7fe3710b6 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:57.505784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3737c903-6b9d-4b88-9c24-b5a7fe3710b6 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:57.663860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3737c903-6b9d-4b88-9c24-b5a7fe3710b6 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:57.673206 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3737c903-6b9d-4b88-9c24-b5a7fe3710b6 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1750 microversion: 2.1 time: 0.188138 Aug 25 14:24:57.674084 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3539/7145] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:57 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1750 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:58.697736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5f9fc39d-b635-4b63-963a-290689bcf4e0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:58.698797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5f9fc39d-b635-4b63-963a-290689bcf4e0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:58.705173 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9fc39d-b635-4b63-963a-290689bcf4e0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:58.705945 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9fc39d-b635-4b63-963a-290689bcf4e0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:58.706379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9fc39d-b635-4b63-963a-290689bcf4e0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:58.707075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9fc39d-b635-4b63-963a-290689bcf4e0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:58.707532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9fc39d-b635-4b63-963a-290689bcf4e0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:58.707950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5f9fc39d-b635-4b63-963a-290689bcf4e0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:58.857981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-5f9fc39d-b635-4b63-963a-290689bcf4e0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:58.867975 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5f9fc39d-b635-4b63-963a-290689bcf4e0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1755 microversion: 2.1 time: 0.175273 Aug 25 14:24:58.868566 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3607/7146] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:58 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:59.891380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2aea1c4c-d7fb-4c7d-9501-73b0a0ab4740 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:59.892011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2aea1c4c-d7fb-4c7d-9501-73b0a0ab4740 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:59.899281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aea1c4c-d7fb-4c7d-9501-73b0a0ab4740 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:59.899686 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aea1c4c-d7fb-4c7d-9501-73b0a0ab4740 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:59.900141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aea1c4c-d7fb-4c7d-9501-73b0a0ab4740 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:59.900866 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aea1c4c-d7fb-4c7d-9501-73b0a0ab4740 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:59.901334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aea1c4c-d7fb-4c7d-9501-73b0a0ab4740 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:59.902440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2aea1c4c-d7fb-4c7d-9501-73b0a0ab4740 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:00.051565 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2aea1c4c-d7fb-4c7d-9501-73b0a0ab4740 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:00.060319 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2aea1c4c-d7fb-4c7d-9501-73b0a0ab4740 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1755 microversion: 2.1 time: 0.173170 Aug 25 14:25:00.060908 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3540/7147] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:59 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:25:01.082884 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a2e30867-a662-453e-9932-8bdc3f3b791e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:01.083548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a2e30867-a662-453e-9932-8bdc3f3b791e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:01.091024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2e30867-a662-453e-9932-8bdc3f3b791e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:01.091526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2e30867-a662-453e-9932-8bdc3f3b791e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:01.092140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2e30867-a662-453e-9932-8bdc3f3b791e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:01.093022 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2e30867-a662-453e-9932-8bdc3f3b791e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:01.093586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2e30867-a662-453e-9932-8bdc3f3b791e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:01.094087 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2e30867-a662-453e-9932-8bdc3f3b791e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:01.250931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a2e30867-a662-453e-9932-8bdc3f3b791e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:01.259887 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a2e30867-a662-453e-9932-8bdc3f3b791e tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1755 microversion: 2.1 time: 0.181087 Aug 25 14:25:01.260500 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3608/7148] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:01 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:02.282064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4f40ac6c-8dc2-4178-aa7d-bde6867e42d5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:02.282747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4f40ac6c-8dc2-4178-aa7d-bde6867e42d5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:02.290141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f40ac6c-8dc2-4178-aa7d-bde6867e42d5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:02.290647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f40ac6c-8dc2-4178-aa7d-bde6867e42d5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:02.291108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f40ac6c-8dc2-4178-aa7d-bde6867e42d5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:02.291840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f40ac6c-8dc2-4178-aa7d-bde6867e42d5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:02.292811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f40ac6c-8dc2-4178-aa7d-bde6867e42d5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:02.293266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4f40ac6c-8dc2-4178-aa7d-bde6867e42d5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:02.441266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4f40ac6c-8dc2-4178-aa7d-bde6867e42d5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:02.450005 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4f40ac6c-8dc2-4178-aa7d-bde6867e42d5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1755 microversion: 2.1 time: 0.171813 Aug 25 14:25:02.450601 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3541/7149] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:02 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:03.472304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b6f347fd-28b8-42c9-899f-f04ca20e1b9b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:03.472991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b6f347fd-28b8-42c9-899f-f04ca20e1b9b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:03.480591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f347fd-28b8-42c9-899f-f04ca20e1b9b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:03.480916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f347fd-28b8-42c9-899f-f04ca20e1b9b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:03.481375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f347fd-28b8-42c9-899f-f04ca20e1b9b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:03.482094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f347fd-28b8-42c9-899f-f04ca20e1b9b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:03.482550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f347fd-28b8-42c9-899f-f04ca20e1b9b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:03.482977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b6f347fd-28b8-42c9-899f-f04ca20e1b9b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:03.661081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b6f347fd-28b8-42c9-899f-f04ca20e1b9b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:03.673210 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b6f347fd-28b8-42c9-899f-f04ca20e1b9b tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1755 microversion: 2.1 time: 0.204438 Aug 25 14:25:03.673879 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3609/7150] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:03 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:25:04.696711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-251a0d0a-1e9d-444e-bdff-91b53a742e08 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:04.697347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-251a0d0a-1e9d-444e-bdff-91b53a742e08 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:04.705264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-251a0d0a-1e9d-444e-bdff-91b53a742e08 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:04.706090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-251a0d0a-1e9d-444e-bdff-91b53a742e08 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:04.706697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-251a0d0a-1e9d-444e-bdff-91b53a742e08 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:04.707283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-251a0d0a-1e9d-444e-bdff-91b53a742e08 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:04.707756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-251a0d0a-1e9d-444e-bdff-91b53a742e08 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:04.708204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-251a0d0a-1e9d-444e-bdff-91b53a742e08 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:04.859591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-251a0d0a-1e9d-444e-bdff-91b53a742e08 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:04.867971 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-251a0d0a-1e9d-444e-bdff-91b53a742e08 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1755 microversion: 2.1 time: 0.175228 Aug 25 14:25:04.868546 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3542/7151] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:04 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:05.889424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3d61c77e-c9f1-46c2-bf50-c65a6dbaa1fe tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:05.890046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3d61c77e-c9f1-46c2-bf50-c65a6dbaa1fe tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:05.897868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d61c77e-c9f1-46c2-bf50-c65a6dbaa1fe tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:05.900025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d61c77e-c9f1-46c2-bf50-c65a6dbaa1fe tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:05.900025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d61c77e-c9f1-46c2-bf50-c65a6dbaa1fe tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:05.900025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d61c77e-c9f1-46c2-bf50-c65a6dbaa1fe tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:05.900025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d61c77e-c9f1-46c2-bf50-c65a6dbaa1fe tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:05.900424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3d61c77e-c9f1-46c2-bf50-c65a6dbaa1fe tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:06.065659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3d61c77e-c9f1-46c2-bf50-c65a6dbaa1fe tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:06.074482 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3d61c77e-c9f1-46c2-bf50-c65a6dbaa1fe tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1755 microversion: 2.1 time: 0.189181 Aug 25 14:25:06.075076 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3610/7152] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:05 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:07.097119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ebe5378b-f471-48bf-947b-b391992ee3ad tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:07.097784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ebe5378b-f471-48bf-947b-b391992ee3ad tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:07.104818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebe5378b-f471-48bf-947b-b391992ee3ad tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:07.105526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebe5378b-f471-48bf-947b-b391992ee3ad tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:07.105999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebe5378b-f471-48bf-947b-b391992ee3ad tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:07.106737 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebe5378b-f471-48bf-947b-b391992ee3ad tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:07.107212 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebe5378b-f471-48bf-947b-b391992ee3ad tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:07.107663 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ebe5378b-f471-48bf-947b-b391992ee3ad tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:07.257916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ebe5378b-f471-48bf-947b-b391992ee3ad tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:07.266884 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ebe5378b-f471-48bf-947b-b391992ee3ad tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1755 microversion: 2.1 time: 0.174030 Aug 25 14:25:07.267472 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3543/7153] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:07 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:08.288789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a7132bc6-3aa5-44f1-9116-84013de34220 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:08.289386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a7132bc6-3aa5-44f1-9116-84013de34220 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:08.296845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7132bc6-3aa5-44f1-9116-84013de34220 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:08.297330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7132bc6-3aa5-44f1-9116-84013de34220 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:08.297791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7132bc6-3aa5-44f1-9116-84013de34220 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:08.298489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7132bc6-3aa5-44f1-9116-84013de34220 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:08.298937 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7132bc6-3aa5-44f1-9116-84013de34220 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:08.299361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a7132bc6-3aa5-44f1-9116-84013de34220 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:08.453943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a7132bc6-3aa5-44f1-9116-84013de34220 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:08.462643 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a7132bc6-3aa5-44f1-9116-84013de34220 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1755 microversion: 2.1 time: 0.177781 Aug 25 14:25:08.463221 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3611/7154] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:08 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:09.487171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-49918036-c50f-4de4-adaa-f3f59ba18ae0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:09.488204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-49918036-c50f-4de4-adaa-f3f59ba18ae0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:09.497072 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49918036-c50f-4de4-adaa-f3f59ba18ae0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:09.497624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49918036-c50f-4de4-adaa-f3f59ba18ae0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:09.498228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49918036-c50f-4de4-adaa-f3f59ba18ae0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:09.498867 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49918036-c50f-4de4-adaa-f3f59ba18ae0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:09.499350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49918036-c50f-4de4-adaa-f3f59ba18ae0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:09.499801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-49918036-c50f-4de4-adaa-f3f59ba18ae0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:09.665788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-49918036-c50f-4de4-adaa-f3f59ba18ae0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:09.675800 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-49918036-c50f-4de4-adaa-f3f59ba18ae0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1758 microversion: 2.1 time: 0.194008 Aug 25 14:25:09.676540 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3544/7155] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:09 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:12.911301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=12 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:12.912004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:12.917230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c98bc2cd-4665-420e-beff-d5a7cdb75602 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-440257208"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:12.918050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c98bc2cd-4665-420e-beff-d5a7cdb75602 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:12.926489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c98bc2cd-4665-420e-beff-d5a7cdb75602 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:12.926955 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c98bc2cd-4665-420e-beff-d5a7cdb75602 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:12.927442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c98bc2cd-4665-420e-beff-d5a7cdb75602 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:12.928159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c98bc2cd-4665-420e-beff-d5a7cdb75602 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:12.928645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c98bc2cd-4665-420e-beff-d5a7cdb75602 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:12.929077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c98bc2cd-4665-420e-beff-d5a7cdb75602 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:13.084815 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.network.security_group_api [None req-c98bc2cd-4665-420e-beff-d5a7cdb75602 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Removing security group d5074084-bfae-4d81-a5bd-4276de6ba807 from port d236389f-1a7c-4f15-9b61-74c730051590 Aug 25 14:26:13.448189 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c98bc2cd-4665-420e-beff-d5a7cdb75602 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "POST /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/action" status: 202 len: 0 microversion: 2.1 time: 0.538706 Aug 25 14:26:13.452616 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3612/7156] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:26:12 2022] POST /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:26:13.456471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=12 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:13.457905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=36 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:13.462741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3ed504f8-993a-41a5-bb61-366695c4c869 req-e960d95f-e67e-4a90-a003-0729db58107c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a281bd22-83c4-4ed2-a523-c70d3a5dac6f", "tag": "d236389f-1a7c-4f15-9b61-74c730051590"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:13.476255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3ed504f8-993a-41a5-bb61-366695c4c869 req-e960d95f-e67e-4a90-a003-0729db58107c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:13.476833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3ed504f8-993a-41a5-bb61-366695c4c869 req-e960d95f-e67e-4a90-a003-0729db58107c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:13.477218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3ed504f8-993a-41a5-bb61-366695c4c869 req-e960d95f-e67e-4a90-a003-0729db58107c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:13.491853 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3ed504f8-993a-41a5-bb61-366695c4c869 req-e960d95f-e67e-4a90-a003-0729db58107c service nova] Creating event network-changed:d236389f-1a7c-4f15-9b61-74c730051590 for instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f on n-h2-852771-8 Aug 25 14:26:13.497896 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [req-3ed504f8-993a-41a5-bb61-366695c4c869 req-e960d95f-e67e-4a90-a003-0729db58107c service nova] [705e9c9a-a717-40ab-832d-6cacc641c220] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:26:14.506923 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [req-3ed504f8-993a-41a5-bb61-366695c4c869 req-e960d95f-e67e-4a90-a003-0729db58107c service nova] [705e9c9a-a717-40ab-832d-6cacc641c220] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57764. Aug 25 14:26:14.512708 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3ed504f8-993a-41a5-bb61-366695c4c869 req-e960d95f-e67e-4a90-a003-0729db58107c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.057966 Aug 25 14:26:14.514108 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3545/7157] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:14.799158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c93fca93-891a-4996-86ba-97a537189815 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:14.799754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c93fca93-891a-4996-86ba-97a537189815 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:14.806457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c93fca93-891a-4996-86ba-97a537189815 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:14.807081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c93fca93-891a-4996-86ba-97a537189815 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:14.807405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c93fca93-891a-4996-86ba-97a537189815 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:14.808309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c93fca93-891a-4996-86ba-97a537189815 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:14.808931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c93fca93-891a-4996-86ba-97a537189815 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:14.810068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c93fca93-891a-4996-86ba-97a537189815 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:14.928680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-c93fca93-891a-4996-86ba-97a537189815 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lazy-loading 'services' on Instance uuid a281bd22-83c4-4ed2-a523-c70d3a5dac6f {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:26:15.032063 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c93fca93-891a-4996-86ba-97a537189815 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments/ccbe042c-89aa-4734-a1e2-8cc25a1b4950" status: 202 len: 0 microversion: 2.1 time: 0.237998 Aug 25 14:26:15.036584 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3613/7158] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 14:26:14 2022] DELETE /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments/ccbe042c-89aa-4734-a1e2-8cc25a1b4950 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:26:15.044877 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-942dc5eb-b96a-4ab2-a2d2-d6769905cb4f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:15.048749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-942dc5eb-b96a-4ab2-a2d2-d6769905cb4f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:15.058627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-942dc5eb-b96a-4ab2-a2d2-d6769905cb4f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:15.059700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-942dc5eb-b96a-4ab2-a2d2-d6769905cb4f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:15.060794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-942dc5eb-b96a-4ab2-a2d2-d6769905cb4f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:15.061990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-942dc5eb-b96a-4ab2-a2d2-d6769905cb4f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:15.062905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-942dc5eb-b96a-4ab2-a2d2-d6769905cb4f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:15.063981 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-942dc5eb-b96a-4ab2-a2d2-d6769905cb4f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:15.116611 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-942dc5eb-b96a-4ab2-a2d2-d6769905cb4f tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077434 Aug 25 14:26:15.117793 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3546/7159] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:26:15 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:16.130419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dc4fa6ec-9999-418a-b0aa-aa72990e73d1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:16.132770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dc4fa6ec-9999-418a-b0aa-aa72990e73d1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:16.140533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc4fa6ec-9999-418a-b0aa-aa72990e73d1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:16.141149 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc4fa6ec-9999-418a-b0aa-aa72990e73d1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:16.141721 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc4fa6ec-9999-418a-b0aa-aa72990e73d1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:16.142524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc4fa6ec-9999-418a-b0aa-aa72990e73d1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:16.143097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc4fa6ec-9999-418a-b0aa-aa72990e73d1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:16.143620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc4fa6ec-9999-418a-b0aa-aa72990e73d1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:16.190626 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dc4fa6ec-9999-418a-b0aa-aa72990e73d1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064657 Aug 25 14:26:16.191612 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3614/7160] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:26:16 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:16.533300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-b3aced5d-e394-460d-9e71-40eb862ba924 req-675f3bf9-5850-4647-b52d-a0069a3766f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a281bd22-83c4-4ed2-a523-c70d3a5dac6f", "tag": "d236389f-1a7c-4f15-9b61-74c730051590"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:16.544235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b3aced5d-e394-460d-9e71-40eb862ba924 req-675f3bf9-5850-4647-b52d-a0069a3766f0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:16.544757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b3aced5d-e394-460d-9e71-40eb862ba924 req-675f3bf9-5850-4647-b52d-a0069a3766f0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:16.545205 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-b3aced5d-e394-460d-9e71-40eb862ba924 req-675f3bf9-5850-4647-b52d-a0069a3766f0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:16.558417 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-b3aced5d-e394-460d-9e71-40eb862ba924 req-675f3bf9-5850-4647-b52d-a0069a3766f0 service nova] Creating event network-changed:d236389f-1a7c-4f15-9b61-74c730051590 for instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f on n-h2-852771-8 Aug 25 14:26:16.564292 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-b3aced5d-e394-460d-9e71-40eb862ba924 req-675f3bf9-5850-4647-b52d-a0069a3766f0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036355 Aug 25 14:26:16.565038 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3547/7161] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:17.204820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6fb76307-354e-41e9-ae08-bd04f20582de tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:17.208114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6fb76307-354e-41e9-ae08-bd04f20582de tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:17.221057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fb76307-354e-41e9-ae08-bd04f20582de tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:17.221871 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fb76307-354e-41e9-ae08-bd04f20582de tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:17.222327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fb76307-354e-41e9-ae08-bd04f20582de tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:17.223396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fb76307-354e-41e9-ae08-bd04f20582de tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:17.224364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fb76307-354e-41e9-ae08-bd04f20582de tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:17.225031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6fb76307-354e-41e9-ae08-bd04f20582de tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:17.270121 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6fb76307-354e-41e9-ae08-bd04f20582de tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070344 Aug 25 14:26:17.270739 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3615/7162] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:26:17 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:26:18.286332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5fb7e569-cbcf-4c2c-a5d2-fe8330e5d550 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:18.288640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5fb7e569-cbcf-4c2c-a5d2-fe8330e5d550 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:18.301795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb7e569-cbcf-4c2c-a5d2-fe8330e5d550 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:18.302316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb7e569-cbcf-4c2c-a5d2-fe8330e5d550 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:18.302793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb7e569-cbcf-4c2c-a5d2-fe8330e5d550 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:18.303533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb7e569-cbcf-4c2c-a5d2-fe8330e5d550 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:18.304016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb7e569-cbcf-4c2c-a5d2-fe8330e5d550 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:18.304480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fb7e569-cbcf-4c2c-a5d2-fe8330e5d550 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:18.337306 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5fb7e569-cbcf-4c2c-a5d2-fe8330e5d550 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056235 Aug 25 14:26:18.338196 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3548/7163] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:26:18 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:19.350567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fb793e77-c7bf-4fc8-b70b-a783109ddac1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:19.352836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fb793e77-c7bf-4fc8-b70b-a783109ddac1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:19.362161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb793e77-c7bf-4fc8-b70b-a783109ddac1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:19.362655 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb793e77-c7bf-4fc8-b70b-a783109ddac1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:19.363098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb793e77-c7bf-4fc8-b70b-a783109ddac1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:19.363820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb793e77-c7bf-4fc8-b70b-a783109ddac1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:19.364277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb793e77-c7bf-4fc8-b70b-a783109ddac1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:19.364712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fb793e77-c7bf-4fc8-b70b-a783109ddac1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:19.399185 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fb793e77-c7bf-4fc8-b70b-a783109ddac1 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052603 Aug 25 14:26:19.399762 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3616/7164] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:26:19 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:20.412070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1213de7-faf5-4d69-922f-9384b6076c69 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:20.414360 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c1213de7-faf5-4d69-922f-9384b6076c69 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:20.422196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1213de7-faf5-4d69-922f-9384b6076c69 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:20.422704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1213de7-faf5-4d69-922f-9384b6076c69 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:20.423162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1213de7-faf5-4d69-922f-9384b6076c69 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:20.423900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1213de7-faf5-4d69-922f-9384b6076c69 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:20.424369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1213de7-faf5-4d69-922f-9384b6076c69 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:20.424812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1213de7-faf5-4d69-922f-9384b6076c69 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:20.460637 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c1213de7-faf5-4d69-922f-9384b6076c69 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052566 Aug 25 14:26:20.461236 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3549/7165] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Aug 25 14:26:20 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 14:26:20.472872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:20.473785 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:20.481978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:20.482729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:20.483180 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:20.483903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:20.484363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:20.484778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:20.572486 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] HTTP exception thrown: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f is not attached to volume ccbe042c-89aa-4734-a1e2-8cc25a1b4950 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Request method failure captured: Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: request: DELETE /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments/ccbe042c-89aa-4734-a1e2-8cc25a1b4950 HTTP/1.1 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4SZtrKkVoIG6mv9Yk0l1UlOrrRlQcSV7d_7CzXk1M_KKqFewVgdDQlpcrGW2BwuMXyPou3gkW5KZIm27WLIcef0KUK5gPbKns3LN0wBMQFotGK_0lnhnOeL19WQyMfLsKT99IYkZd2SGBC6I5pWf0t4qpoKid7n6yWkh_sBlI5GqLc Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f74481623248490cb178e0676c5d11c5 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f74481623248490cb178e0676c5d11c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f74481623248490cb178e0676c5d11c5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f74481623248490cb178e0676c5d11c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f74481623248490cb178e0676c5d11c5"}]}] Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f74481623248490cb178e0676c5d11c5 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestMinimumBasicScenario-1146926442-project Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a9f57144188c49abb04282c2ca4bf680 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestMinimumBasicScenario-1146926442-project Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f is not attached to volume ccbe042c-89aa-4734-a1e2-8cc25a1b4950 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'server_id': 'a281bd22-83c4-4ed2-a523-c70d3a5dac6f', 'id': 'ccbe042c-89aa-4734-a1e2-8cc25a1b4950'} Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ccbe042c-89aa-4734-a1e2-8cc25a1b4950. Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f is not attached to volume ccbe042c-89aa-4734-a1e2-8cc25a1b4950 Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:26:20.574191 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:26:20.579786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:26:20.579786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:26:20.579786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f is not attached to volume ccbe042c-89aa-4734-a1e2-8cc25a1b4950 Aug 25 14:26:20.579786 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:26:20.579786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Returning 404 to user: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f is not attached to volume ccbe042c-89aa-4734-a1e2-8cc25a1b4950 {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:26:20.579786 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d6d3a17a-e251-412b-b6f2-d9cc4f3f17ed tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments/ccbe042c-89aa-4734-a1e2-8cc25a1b4950" status: 404 len: 154 microversion: 2.1 time: 0.107807 Aug 25 14:26:20.579786 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3617/7166] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Aug 25 14:26:20 2022] DELETE /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f/os-volume_attachments/ccbe042c-89aa-4734-a1e2-8cc25a1b4950 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:26:23.867911 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ac23600c-2920-4a2b-887e-30f9e95dca95 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:23.868512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ac23600c-2920-4a2b-887e-30f9e95dca95 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:23.874943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac23600c-2920-4a2b-887e-30f9e95dca95 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:23.875463 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac23600c-2920-4a2b-887e-30f9e95dca95 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:23.875927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac23600c-2920-4a2b-887e-30f9e95dca95 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:23.876662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac23600c-2920-4a2b-887e-30f9e95dca95 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:23.877140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac23600c-2920-4a2b-887e-30f9e95dca95 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:23.877613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ac23600c-2920-4a2b-887e-30f9e95dca95 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:23.907578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ac23600c-2920-4a2b-887e-30f9e95dca95 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:26:23.993952 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ac23600c-2920-4a2b-887e-30f9e95dca95 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 204 len: 0 microversion: 2.1 time: 0.129832 Aug 25 14:26:23.994554 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3550/7167] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:26:23 2022] DELETE /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:26:24.004577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ddfec4ac-9077-43b6-8292-1fcd7adef395 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:24.005270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ddfec4ac-9077-43b6-8292-1fcd7adef395 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:24.013811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfec4ac-9077-43b6-8292-1fcd7adef395 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:24.014306 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfec4ac-9077-43b6-8292-1fcd7adef395 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:24.014796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfec4ac-9077-43b6-8292-1fcd7adef395 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:24.015474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfec4ac-9077-43b6-8292-1fcd7adef395 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:24.015931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfec4ac-9077-43b6-8292-1fcd7adef395 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:24.016359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ddfec4ac-9077-43b6-8292-1fcd7adef395 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:24.170048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ddfec4ac-9077-43b6-8292-1fcd7adef395 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:24.178617 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ddfec4ac-9077-43b6-8292-1fcd7adef395 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1555 microversion: 2.1 time: 0.178981 Aug 25 14:26:24.179223 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3618/7168] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:23 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:25.201409 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-13d632ab-9f3b-4d1c-a580-3a8942fa98d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:25.202156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-13d632ab-9f3b-4d1c-a580-3a8942fa98d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:25.209633 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d632ab-9f3b-4d1c-a580-3a8942fa98d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:25.210143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d632ab-9f3b-4d1c-a580-3a8942fa98d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:25.210595 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d632ab-9f3b-4d1c-a580-3a8942fa98d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:25.211328 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d632ab-9f3b-4d1c-a580-3a8942fa98d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:25.211793 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d632ab-9f3b-4d1c-a580-3a8942fa98d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:25.212235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-13d632ab-9f3b-4d1c-a580-3a8942fa98d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:25.358377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-13d632ab-9f3b-4d1c-a580-3a8942fa98d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:25.366590 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-13d632ab-9f3b-4d1c-a580-3a8942fa98d0 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1555 microversion: 2.1 time: 0.170131 Aug 25 14:26:25.367188 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3551/7169] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:25 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:26.281459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-655405db-68df-4e32-9d4e-f4112cf111ac req-3dd56f1e-a297-442e-9080-60ac3c0af381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a281bd22-83c4-4ed2-a523-c70d3a5dac6f", "name": "network-vif-deleted", "tag": "d236389f-1a7c-4f15-9b61-74c730051590"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:26.294530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-655405db-68df-4e32-9d4e-f4112cf111ac req-3dd56f1e-a297-442e-9080-60ac3c0af381 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:26.295178 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-655405db-68df-4e32-9d4e-f4112cf111ac req-3dd56f1e-a297-442e-9080-60ac3c0af381 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:26.295714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-655405db-68df-4e32-9d4e-f4112cf111ac req-3dd56f1e-a297-442e-9080-60ac3c0af381 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:26.308599 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-655405db-68df-4e32-9d4e-f4112cf111ac req-3dd56f1e-a297-442e-9080-60ac3c0af381 service nova] Creating event network-vif-deleted:d236389f-1a7c-4f15-9b61-74c730051590 for instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f on n-h2-852771-8 Aug 25 14:26:26.315616 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-655405db-68df-4e32-9d4e-f4112cf111ac req-3dd56f1e-a297-442e-9080-60ac3c0af381 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038087 Aug 25 14:26:26.316413 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3619/7170] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:26:26.389248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:26.390594 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:26.397689 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:26.398069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:26.398609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:26.399295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:26.399745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:26.400196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:26.433127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:26.433539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:26.434638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:26.435224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lazy-loading 'fault' on Instance uuid a281bd22-83c4-4ed2-a523-c70d3a5dac6f {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:26:26.478801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f57144188c49abb04282c2ca4bf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74481623248490cb178e0676c5d11c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:26.487631 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dd7ab3c4-be49-4e6a-aa74-831408b285e8 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 200 len: 1348 microversion: 2.1 time: 0.103084 Aug 25 14:26:26.488146 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3552/7171] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:26 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:27.511242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:27.512435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [instance: a281bd22-83c4-4ed2-a523-c70d3a5dac6f] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:27.518880 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:27.519386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:27.519826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:27.520524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:27.520978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:27.521408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:27.537497 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] HTTP exception thrown: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f could not be found. Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Request method failure captured: Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f HTTP/1.1 Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4SZtrKkVoIG6mv9Yk0l1UlOrrRlQcSV7d_7CzXk1M_KKqFewVgdDQlpcrGW2BwuMXyPou3gkW5KZIm27WLIcef0KUK5gPbKns3LN0wBMQFotGK_0lnhnOeL19WQyMfLsKT99IYkZd2SGBC6I5pWf0t4qpoKid7n6yWkh_sBlI5GqLc Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: f74481623248490cb178e0676c5d11c5 Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f74481623248490cb178e0676c5d11c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f74481623248490cb178e0676c5d11c5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f74481623248490cb178e0676c5d11c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f74481623248490cb178e0676c5d11c5"}]}] Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: f74481623248490cb178e0676c5d11c5 Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1146926442 Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestMinimumBasicScenario-1146926442-project Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: a9f57144188c49abb04282c2ca4bf680 Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestMinimumBasicScenario-1146926442-project Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f could not be found. Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'a281bd22-83c4-4ed2-a523-c70d3a5dac6f'} Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f could not be found. Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f could not be found. Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:26:27.539257 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:26:27.544243 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:26:27.544243 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:26:27.544243 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:26:27.544243 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:26:27.544243 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:26:27.544243 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f could not be found. Aug 25 14:26:27.544243 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:26:27.544243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Returning 404 to user: Instance a281bd22-83c4-4ed2-a523-c70d3a5dac6f could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:26:27.544243 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-72622915-89db-4bd2-8d65-b15fecf43694 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f" status: 404 len: 111 microversion: 2.1 time: 0.034674 Aug 25 14:26:27.544243 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3620/7172] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:27 2022] GET /compute/v2.1/servers/a281bd22-83c4-4ed2-a523-c70d3a5dac6f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:26:27.549576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-32df7941-6df6-4e3a-b40f-9fc2aaa9b6b5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] Calling method '.version_select at 0x7f3a2a55bee0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:27.554512 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-32df7941-6df6-4e3a-b40f-9fc2aaa9b6b5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:26:28.564418 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [None req-32df7941-6df6-4e3a-b40f-9fc2aaa9b6b5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57818. Aug 25 14:26:28.590951 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-32df7941-6df6-4e3a-b40f-9fc2aaa9b6b5 tempest-TestMinimumBasicScenario-1146926442 tempest-TestMinimumBasicScenario-1146926442-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-104063895" status: 202 len: 0 microversion: 2.1 time: 1.044559 Aug 25 14:26:28.591556 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3553/7173] 10.222.0.70 () {58 vars in 1269 bytes} [Thu Aug 25 14:26:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-104063895 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:26:38.405157 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:26:38.405840 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:26:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.70) !!! Aug 25 14:26:38.407375 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:26:38.407494 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:26:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.70) !!! Aug 25 14:26:38.409066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=18 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:38.409835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:38.594271 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-18a9f51b-dd12-4c59-b4f0-7f4aeaed97f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'create', calling method: .version_select at 0x7f3a293aa670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1745395819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBemCXzgSkCaUigAFiTu2UZGE6va4a0rUmGPROXlokYftRSzXUnjd3WOLJ4wxdX3lxcDAv/6KRlZ4+ImAUPDf00EXAP7KQ4fFlYLbMS/PFHt6Zn5HHllhcIxURqaf7Wg7g=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:38.611116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-18a9f51b-dd12-4c59-b4f0-7f4aeaed97f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for project 275f24feb3574af5b9b8a60107ccf118. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:26:38.616117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-18a9f51b-dd12-4c59-b4f0-7f4aeaed97f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for user 03e4ee8ca9ab458ab9fe9657e08aec5a and project 275f24feb3574af5b9b8a60107ccf118. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:26:38.646007 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-18a9f51b-dd12-4c59-b4f0-7f4aeaed97f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.246444 Aug 25 14:26:38.646817 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3621/7174] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:26:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:45.416345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:45.432352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:45.443301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1893736744", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a5c8624a-00dd-492a-94aa-071664d772a7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1745395819", "security_groups": [{"name": "tempest-secgroup-smoke-110508356"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:45.657797 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] validate_networks() for [('a5c8624a-00dd-492a-94aa-071664d772a7', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:26:46.570620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:26:46.572001 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:26:46.572912 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:26:46.573708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:26:46.574568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:26:46.586885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:46.588654 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:46.590023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:46.591201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:46.593966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:46.594844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:46.641618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for project 275f24feb3574af5b9b8a60107ccf118. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:26:46.662719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for user 03e4ee8ca9ab458ab9fe9657e08aec5a and project 275f24feb3574af5b9b8a60107ccf118. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:26:46.680234 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:26:46.684816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:26:46.785312 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c60c1fe8-d2c2-49a3-9ac9-6acb2b6948f9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.369919 Aug 25 14:26:46.787884 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3554/7175] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:26:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 14:26:46.801965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-92462781-0eac-4e2d-b5bf-7ef7425ca9e0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:46.802698 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-92462781-0eac-4e2d-b5bf-7ef7425ca9e0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:46.908051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-92462781-0eac-4e2d-b5bf-7ef7425ca9e0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:46.915458 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-92462781-0eac-4e2d-b5bf-7ef7425ca9e0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1267 microversion: 2.1 time: 0.118529 Aug 25 14:26:46.922105 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3622/7176] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:46 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:26:47.942892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f1841392-c33d-49c4-891b-03a1d3d9bebb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:47.943532 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f1841392-c33d-49c4-891b-03a1d3d9bebb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:47.953183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1841392-c33d-49c4-891b-03a1d3d9bebb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:47.954084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1841392-c33d-49c4-891b-03a1d3d9bebb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:47.954864 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1841392-c33d-49c4-891b-03a1d3d9bebb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:47.956388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1841392-c33d-49c4-891b-03a1d3d9bebb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:47.957057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1841392-c33d-49c4-891b-03a1d3d9bebb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:47.957545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f1841392-c33d-49c4-891b-03a1d3d9bebb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:48.049847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f1841392-c33d-49c4-891b-03a1d3d9bebb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:48.059757 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f1841392-c33d-49c4-891b-03a1d3d9bebb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1319 microversion: 2.1 time: 0.121955 Aug 25 14:26:48.060472 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3555/7177] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:47 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1319 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:49.094036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-427e6fc7-4f56-4787-88f4-951113fbdcdf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:49.095193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-427e6fc7-4f56-4787-88f4-951113fbdcdf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:49.110685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427e6fc7-4f56-4787-88f4-951113fbdcdf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:49.111725 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427e6fc7-4f56-4787-88f4-951113fbdcdf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:49.112433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427e6fc7-4f56-4787-88f4-951113fbdcdf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:49.113640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427e6fc7-4f56-4787-88f4-951113fbdcdf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:49.114340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427e6fc7-4f56-4787-88f4-951113fbdcdf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:49.114997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427e6fc7-4f56-4787-88f4-951113fbdcdf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:49.227567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-427e6fc7-4f56-4787-88f4-951113fbdcdf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:49.247618 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-427e6fc7-4f56-4787-88f4-951113fbdcdf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1325 microversion: 2.1 time: 0.161788 Aug 25 14:26:49.248645 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3623/7178] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:49 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:50.273729 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-97b759be-91fc-45d3-a1e4-e2116b566cca tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:50.275008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-97b759be-91fc-45d3-a1e4-e2116b566cca tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:50.285058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b759be-91fc-45d3-a1e4-e2116b566cca tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:50.285959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b759be-91fc-45d3-a1e4-e2116b566cca tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:50.286604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b759be-91fc-45d3-a1e4-e2116b566cca tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:50.287294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b759be-91fc-45d3-a1e4-e2116b566cca tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:50.287847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b759be-91fc-45d3-a1e4-e2116b566cca tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:50.288419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-97b759be-91fc-45d3-a1e4-e2116b566cca tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:50.394495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-92479237-b72d-4d4a-8ee8-31767cd560f2 req-1ebcb3e9-48d7-4a93-ac63-f77ba4c2d6ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fdf461-d07c-47d7-8067-1877daae33da", "tag": "903ba1eb-02ce-434f-90d9-2501103fbbe4"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:50.410052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-92479237-b72d-4d4a-8ee8-31767cd560f2 req-1ebcb3e9-48d7-4a93-ac63-f77ba4c2d6ce service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:50.411291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-92479237-b72d-4d4a-8ee8-31767cd560f2 req-1ebcb3e9-48d7-4a93-ac63-f77ba4c2d6ce service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:50.411947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-92479237-b72d-4d4a-8ee8-31767cd560f2 req-1ebcb3e9-48d7-4a93-ac63-f77ba4c2d6ce service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:50.427607 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-92479237-b72d-4d4a-8ee8-31767cd560f2 req-1ebcb3e9-48d7-4a93-ac63-f77ba4c2d6ce service nova] Creating event network-changed:903ba1eb-02ce-434f-90d9-2501103fbbe4 for instance 49fdf461-d07c-47d7-8067-1877daae33da on n-h1-852771-8 Aug 25 14:26:50.434685 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-92479237-b72d-4d4a-8ee8-31767cd560f2 req-1ebcb3e9-48d7-4a93-ac63-f77ba4c2d6ce service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044132 Aug 25 14:26:50.435984 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3624/7179] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:50.499322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-97b759be-91fc-45d3-a1e4-e2116b566cca tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:50.507596 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-97b759be-91fc-45d3-a1e4-e2116b566cca tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1392 microversion: 2.1 time: 0.240920 Aug 25 14:26:50.508783 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3556/7180] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:50 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1392 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:51.534325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-214ac338-cdf9-4629-8b58-e06230932c6c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:51.535109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-214ac338-cdf9-4629-8b58-e06230932c6c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:51.542993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-214ac338-cdf9-4629-8b58-e06230932c6c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:51.543574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-214ac338-cdf9-4629-8b58-e06230932c6c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:51.544033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-214ac338-cdf9-4629-8b58-e06230932c6c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:51.544756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-214ac338-cdf9-4629-8b58-e06230932c6c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:51.545227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-214ac338-cdf9-4629-8b58-e06230932c6c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:51.545697 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-214ac338-cdf9-4629-8b58-e06230932c6c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:51.701165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-214ac338-cdf9-4629-8b58-e06230932c6c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:51.710274 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-214ac338-cdf9-4629-8b58-e06230932c6c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1392 microversion: 2.1 time: 0.181381 Aug 25 14:26:51.710884 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3625/7181] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:51 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:52.738990 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4611bf7-8af6-4cf6-997b-87fba69092db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:52.740184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4611bf7-8af6-4cf6-997b-87fba69092db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:52.749945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4611bf7-8af6-4cf6-997b-87fba69092db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:52.750460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4611bf7-8af6-4cf6-997b-87fba69092db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:52.750922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4611bf7-8af6-4cf6-997b-87fba69092db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:52.751658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4611bf7-8af6-4cf6-997b-87fba69092db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:52.752135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4611bf7-8af6-4cf6-997b-87fba69092db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:52.752586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4611bf7-8af6-4cf6-997b-87fba69092db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:52.927042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d4611bf7-8af6-4cf6-997b-87fba69092db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:52.935844 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4611bf7-8af6-4cf6-997b-87fba69092db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1392 microversion: 2.1 time: 0.203173 Aug 25 14:26:52.936451 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3557/7182] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:52 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1392 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:53.956643 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a6a11be4-9961-4b31-9f3f-5482ee8a98da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:53.957260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a6a11be4-9961-4b31-9f3f-5482ee8a98da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:53.964693 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6a11be4-9961-4b31-9f3f-5482ee8a98da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:53.965179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6a11be4-9961-4b31-9f3f-5482ee8a98da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:53.965647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6a11be4-9961-4b31-9f3f-5482ee8a98da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:53.966352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6a11be4-9961-4b31-9f3f-5482ee8a98da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:53.966807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6a11be4-9961-4b31-9f3f-5482ee8a98da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:53.967238 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6a11be4-9961-4b31-9f3f-5482ee8a98da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:54.118494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a6a11be4-9961-4b31-9f3f-5482ee8a98da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:54.127589 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a6a11be4-9961-4b31-9f3f-5482ee8a98da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1392 microversion: 2.1 time: 0.175012 Aug 25 14:26:54.128381 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3626/7183] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:53 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:55.149980 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c632087d-7260-4b2d-ab6c-65181fba652e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:55.150608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c632087d-7260-4b2d-ab6c-65181fba652e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:55.158453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c632087d-7260-4b2d-ab6c-65181fba652e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:55.158966 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c632087d-7260-4b2d-ab6c-65181fba652e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:55.159464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c632087d-7260-4b2d-ab6c-65181fba652e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:55.160160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c632087d-7260-4b2d-ab6c-65181fba652e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:55.160636 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c632087d-7260-4b2d-ab6c-65181fba652e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:55.161079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c632087d-7260-4b2d-ab6c-65181fba652e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:55.309319 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c632087d-7260-4b2d-ab6c-65181fba652e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:55.319905 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c632087d-7260-4b2d-ab6c-65181fba652e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1392 microversion: 2.1 time: 0.173869 Aug 25 14:26:55.320503 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3558/7184] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:55 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:56.342224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-133d95de-25f3-4afb-a188-61d96ce27031 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:56.342846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-133d95de-25f3-4afb-a188-61d96ce27031 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:56.349846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-133d95de-25f3-4afb-a188-61d96ce27031 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:56.350332 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-133d95de-25f3-4afb-a188-61d96ce27031 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:56.350777 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-133d95de-25f3-4afb-a188-61d96ce27031 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:56.351476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-133d95de-25f3-4afb-a188-61d96ce27031 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:56.351932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-133d95de-25f3-4afb-a188-61d96ce27031 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:56.352360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-133d95de-25f3-4afb-a188-61d96ce27031 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:56.492980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-133d95de-25f3-4afb-a188-61d96ce27031 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:56.502016 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-133d95de-25f3-4afb-a188-61d96ce27031 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1392 microversion: 2.1 time: 0.164579 Aug 25 14:26:56.502612 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3627/7185] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:56 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:56.631685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-3b4cf464-5399-4d49-9524-3d873925b40a req-0eb71a74-f151-4a84-9051-3edae2579485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fdf461-d07c-47d7-8067-1877daae33da", "name": "network-vif-plugged", "status": "completed", "tag": "903ba1eb-02ce-434f-90d9-2501103fbbe4"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:56.637923 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:56.647110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3b4cf464-5399-4d49-9524-3d873925b40a req-0eb71a74-f151-4a84-9051-3edae2579485 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:56.647110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3b4cf464-5399-4d49-9524-3d873925b40a req-0eb71a74-f151-4a84-9051-3edae2579485 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:56.647110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-3b4cf464-5399-4d49-9524-3d873925b40a req-0eb71a74-f151-4a84-9051-3edae2579485 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:56.659280 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-3b4cf464-5399-4d49-9524-3d873925b40a req-0eb71a74-f151-4a84-9051-3edae2579485 service nova] Creating event network-vif-plugged:903ba1eb-02ce-434f-90d9-2501103fbbe4 for instance 49fdf461-d07c-47d7-8067-1877daae33da on n-h1-852771-8 Aug 25 14:26:56.665033 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-3b4cf464-5399-4d49-9524-3d873925b40a req-0eb71a74-f151-4a84-9051-3edae2579485 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037154 Aug 25 14:26:56.665885 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3559/7186] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:57.521300 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:57.527200 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-03b7d25c-d609-4acc-a158-66acd6f2ec88 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:57.527921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-03b7d25c-d609-4acc-a158-66acd6f2ec88 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:57.534894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03b7d25c-d609-4acc-a158-66acd6f2ec88 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:57.535501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03b7d25c-d609-4acc-a158-66acd6f2ec88 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:57.535943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03b7d25c-d609-4acc-a158-66acd6f2ec88 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:57.536730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03b7d25c-d609-4acc-a158-66acd6f2ec88 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:57.537257 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03b7d25c-d609-4acc-a158-66acd6f2ec88 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:57.537763 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-03b7d25c-d609-4acc-a158-66acd6f2ec88 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:57.698327 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-03b7d25c-d609-4acc-a158-66acd6f2ec88 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:57.712071 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-03b7d25c-d609-4acc-a158-66acd6f2ec88 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1392 microversion: 2.1 time: 0.191558 Aug 25 14:26:57.712672 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3628/7187] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:57 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:58.733088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:58.738483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a2012698-6bf3-4652-b4f5-13fbd003254a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:58.739211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a2012698-6bf3-4652-b4f5-13fbd003254a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:58.746847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2012698-6bf3-4652-b4f5-13fbd003254a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:58.747339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2012698-6bf3-4652-b4f5-13fbd003254a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:58.747795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2012698-6bf3-4652-b4f5-13fbd003254a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:58.748520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2012698-6bf3-4652-b4f5-13fbd003254a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:58.748989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2012698-6bf3-4652-b4f5-13fbd003254a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:58.749430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a2012698-6bf3-4652-b4f5-13fbd003254a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:58.918939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a2012698-6bf3-4652-b4f5-13fbd003254a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:58.926918 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a2012698-6bf3-4652-b4f5-13fbd003254a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1563 microversion: 2.1 time: 0.194737 Aug 25 14:26:58.927506 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3560/7188] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:58 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1563 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:58.948083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1d8ac2a3-31c3-434e-93cd-f0055b7cc485 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:58.949396 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1d8ac2a3-31c3-434e-93cd-f0055b7cc485 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:58.957100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ac2a3-31c3-434e-93cd-f0055b7cc485 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:58.957615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ac2a3-31c3-434e-93cd-f0055b7cc485 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:58.958059 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ac2a3-31c3-434e-93cd-f0055b7cc485 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:58.958762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ac2a3-31c3-434e-93cd-f0055b7cc485 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:58.959218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ac2a3-31c3-434e-93cd-f0055b7cc485 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:58.959641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d8ac2a3-31c3-434e-93cd-f0055b7cc485 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:59.108156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d8ac2a3-31c3-434e-93cd-f0055b7cc485 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:59.116426 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1d8ac2a3-31c3-434e-93cd-f0055b7cc485 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1563 microversion: 2.1 time: 0.172195 Aug 25 14:26:59.117020 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3629/7189] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:58 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:27:01.644471 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-37b0a912-4329-4aa7-9838-13c428bd4083 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:01.645246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-37b0a912-4329-4aa7-9838-13c428bd4083 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:01.646547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5bea10d5-68c1-49c4-8977-617fc226898a req-2a3844dc-7056-4578-acb6-82e2c2e518a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fdf461-d07c-47d7-8067-1877daae33da", "tag": "903ba1eb-02ce-434f-90d9-2501103fbbe4"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:27:01.657832 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37b0a912-4329-4aa7-9838-13c428bd4083 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:01.658431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37b0a912-4329-4aa7-9838-13c428bd4083 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:01.658957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37b0a912-4329-4aa7-9838-13c428bd4083 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:01.660241 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37b0a912-4329-4aa7-9838-13c428bd4083 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:01.660400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37b0a912-4329-4aa7-9838-13c428bd4083 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:01.660886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-37b0a912-4329-4aa7-9838-13c428bd4083 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:01.662242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5bea10d5-68c1-49c4-8977-617fc226898a req-2a3844dc-7056-4578-acb6-82e2c2e518a6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:01.663015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5bea10d5-68c1-49c4-8977-617fc226898a req-2a3844dc-7056-4578-acb6-82e2c2e518a6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:01.664465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5bea10d5-68c1-49c4-8977-617fc226898a req-2a3844dc-7056-4578-acb6-82e2c2e518a6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:01.678422 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5bea10d5-68c1-49c4-8977-617fc226898a req-2a3844dc-7056-4578-acb6-82e2c2e518a6 service nova] Creating event network-changed:903ba1eb-02ce-434f-90d9-2501103fbbe4 for instance 49fdf461-d07c-47d7-8067-1877daae33da on n-h1-852771-8 Aug 25 14:27:01.684813 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5bea10d5-68c1-49c4-8977-617fc226898a req-2a3844dc-7056-4578-acb6-82e2c2e518a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042499 Aug 25 14:27:01.685881 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3630/7190] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:27:01.846942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-37b0a912-4329-4aa7-9838-13c428bd4083 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:01.864426 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-37b0a912-4329-4aa7-9838-13c428bd4083 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1563 microversion: 2.1 time: 0.225447 Aug 25 14:27:01.870795 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3561/7191] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:01 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1563 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:34.322404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:27:34.324264 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=40 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:27:34.328597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-13808fb9-9285-47f7-b015-a7007ec796bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:27:34.331183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-13808fb9-9285-47f7-b015-a7007ec796bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:34.338795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13808fb9-9285-47f7-b015-a7007ec796bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:34.339378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13808fb9-9285-47f7-b015-a7007ec796bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:34.339824 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13808fb9-9285-47f7-b015-a7007ec796bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:34.340527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13808fb9-9285-47f7-b015-a7007ec796bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:34.340981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13808fb9-9285-47f7-b015-a7007ec796bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:34.341405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-13808fb9-9285-47f7-b015-a7007ec796bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:34.411606 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-13808fb9-9285-47f7-b015-a7007ec796bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da/action" status: 200 len: 24570 microversion: 2.1 time: 0.091335 Aug 25 14:27:34.412538 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3631/7192] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:27:34 2022] POST /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da/action => generated 24570 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 14:28:04.861875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:04.862651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=40 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:04.866733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5aa33918-7ccc-4303-ad4b-f4bf30aea466 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:04.867279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5aa33918-7ccc-4303-ad4b-f4bf30aea466 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:04.875008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa33918-7ccc-4303-ad4b-f4bf30aea466 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:04.875548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa33918-7ccc-4303-ad4b-f4bf30aea466 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:04.876013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa33918-7ccc-4303-ad4b-f4bf30aea466 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:04.877005 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa33918-7ccc-4303-ad4b-f4bf30aea466 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:04.877272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa33918-7ccc-4303-ad4b-f4bf30aea466 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:04.877725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5aa33918-7ccc-4303-ad4b-f4bf30aea466 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:04.951363 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5aa33918-7ccc-4303-ad4b-f4bf30aea466 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da/action" status: 202 len: 0 microversion: 2.1 time: 0.090963 Aug 25 14:28:04.952025 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3562/7193] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:28:04 2022] POST /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:28:04.961846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d9a7e1d-0b6c-4fd3-8c68-508c68960847 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:04.962576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d9a7e1d-0b6c-4fd3-8c68-508c68960847 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:04.966334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:04.967495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:04.972208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d9a7e1d-0b6c-4fd3-8c68-508c68960847 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:04.972666 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d9a7e1d-0b6c-4fd3-8c68-508c68960847 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:04.973110 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d9a7e1d-0b6c-4fd3-8c68-508c68960847 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:04.973848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d9a7e1d-0b6c-4fd3-8c68-508c68960847 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:04.974320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d9a7e1d-0b6c-4fd3-8c68-508c68960847 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:04.974740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d9a7e1d-0b6c-4fd3-8c68-508c68960847 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:05.120513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8d9a7e1d-0b6c-4fd3-8c68-508c68960847 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:05.129426 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d9a7e1d-0b6c-4fd3-8c68-508c68960847 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1687 microversion: 2.1 time: 0.172132 Aug 25 14:28:05.130041 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3632/7194] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:04 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:28:06.153580 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87d9cc5e-79f0-4cc0-b2b1-18e543219679 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:06.154326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-87d9cc5e-79f0-4cc0-b2b1-18e543219679 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:06.161796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d9cc5e-79f0-4cc0-b2b1-18e543219679 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:06.162235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d9cc5e-79f0-4cc0-b2b1-18e543219679 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:06.162700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d9cc5e-79f0-4cc0-b2b1-18e543219679 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:06.163424 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d9cc5e-79f0-4cc0-b2b1-18e543219679 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:06.163906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d9cc5e-79f0-4cc0-b2b1-18e543219679 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:06.164352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87d9cc5e-79f0-4cc0-b2b1-18e543219679 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:06.307250 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-87d9cc5e-79f0-4cc0-b2b1-18e543219679 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:06.315401 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87d9cc5e-79f0-4cc0-b2b1-18e543219679 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1667 microversion: 2.1 time: 0.167740 Aug 25 14:28:06.315973 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3563/7195] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:06 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1667 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:07.413645 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70d6d9ff-3e04-428f-971c-368e8e740299 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:07.415870 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70d6d9ff-3e04-428f-971c-368e8e740299 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:07.422814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70d6d9ff-3e04-428f-971c-368e8e740299 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:07.423299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70d6d9ff-3e04-428f-971c-368e8e740299 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:07.423745 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70d6d9ff-3e04-428f-971c-368e8e740299 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:07.424442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70d6d9ff-3e04-428f-971c-368e8e740299 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:07.424897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70d6d9ff-3e04-428f-971c-368e8e740299 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:07.425358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70d6d9ff-3e04-428f-971c-368e8e740299 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:07.495338 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70d6d9ff-3e04-428f-971c-368e8e740299 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da/action" status: 200 len: 32649 microversion: 2.1 time: 0.085479 Aug 25 14:28:07.496110 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3633/7196] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:28:07 2022] POST /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da/action => generated 32649 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:28:07.509935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c1e31fab-728b-453a-a35e-9bb4ffa958aa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:07.510669 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c1e31fab-728b-453a-a35e-9bb4ffa958aa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:07.518113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e31fab-728b-453a-a35e-9bb4ffa958aa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:07.518623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e31fab-728b-453a-a35e-9bb4ffa958aa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:07.519092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e31fab-728b-453a-a35e-9bb4ffa958aa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:07.519826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e31fab-728b-453a-a35e-9bb4ffa958aa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:07.520332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e31fab-728b-453a-a35e-9bb4ffa958aa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:07.520785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c1e31fab-728b-453a-a35e-9bb4ffa958aa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:07.590696 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c1e31fab-728b-453a-a35e-9bb4ffa958aa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da/action" status: 202 len: 0 microversion: 2.1 time: 0.084557 Aug 25 14:28:07.591361 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3564/7197] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:28:07 2022] POST /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:28:07.601444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-87192de6-d0c9-4e9c-8a48-fa5f2b034aff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:07.602171 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-87192de6-d0c9-4e9c-8a48-fa5f2b034aff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:07.610480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87192de6-d0c9-4e9c-8a48-fa5f2b034aff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:07.610970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87192de6-d0c9-4e9c-8a48-fa5f2b034aff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:07.611409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87192de6-d0c9-4e9c-8a48-fa5f2b034aff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:07.612723 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87192de6-d0c9-4e9c-8a48-fa5f2b034aff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:07.613194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87192de6-d0c9-4e9c-8a48-fa5f2b034aff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:07.613660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-87192de6-d0c9-4e9c-8a48-fa5f2b034aff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:07.753720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-87192de6-d0c9-4e9c-8a48-fa5f2b034aff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:07.761564 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-87192de6-d0c9-4e9c-8a48-fa5f2b034aff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1674 microversion: 2.1 time: 0.164263 Aug 25 14:28:07.762141 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3634/7198] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:07 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:28:08.786714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ef616443-95eb-41ee-bc27-2b478ac5fece tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:08.788084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ef616443-95eb-41ee-bc27-2b478ac5fece tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:08.796862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef616443-95eb-41ee-bc27-2b478ac5fece tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:08.797464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef616443-95eb-41ee-bc27-2b478ac5fece tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:08.797963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef616443-95eb-41ee-bc27-2b478ac5fece tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:08.798773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef616443-95eb-41ee-bc27-2b478ac5fece tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:08.799244 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef616443-95eb-41ee-bc27-2b478ac5fece tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:08.799759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ef616443-95eb-41ee-bc27-2b478ac5fece tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:08.956640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ef616443-95eb-41ee-bc27-2b478ac5fece tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:08.965152 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ef616443-95eb-41ee-bc27-2b478ac5fece tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1674 microversion: 2.1 time: 0.183509 Aug 25 14:28:08.965879 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3565/7199] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:08 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:28:09.987315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bfe54dc4-3646-45af-8eab-7c728074ecae tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:09.987935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bfe54dc4-3646-45af-8eab-7c728074ecae tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:09.994892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfe54dc4-3646-45af-8eab-7c728074ecae tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:09.995381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfe54dc4-3646-45af-8eab-7c728074ecae tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:09.995830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfe54dc4-3646-45af-8eab-7c728074ecae tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:09.996539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfe54dc4-3646-45af-8eab-7c728074ecae tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:09.997000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfe54dc4-3646-45af-8eab-7c728074ecae tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:09.997434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bfe54dc4-3646-45af-8eab-7c728074ecae tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:10.151864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bfe54dc4-3646-45af-8eab-7c728074ecae tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:10.160755 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bfe54dc4-3646-45af-8eab-7c728074ecae tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1674 microversion: 2.1 time: 0.177988 Aug 25 14:28:10.161269 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3635/7200] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:09 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:11.182693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-452b4b7c-2e0b-4fbd-9658-ccd5c67ff498 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:11.183370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-452b4b7c-2e0b-4fbd-9658-ccd5c67ff498 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:11.190827 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-452b4b7c-2e0b-4fbd-9658-ccd5c67ff498 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:11.191348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-452b4b7c-2e0b-4fbd-9658-ccd5c67ff498 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:11.191806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-452b4b7c-2e0b-4fbd-9658-ccd5c67ff498 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:11.192524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-452b4b7c-2e0b-4fbd-9658-ccd5c67ff498 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:11.192998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-452b4b7c-2e0b-4fbd-9658-ccd5c67ff498 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:11.193442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-452b4b7c-2e0b-4fbd-9658-ccd5c67ff498 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:11.333516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-452b4b7c-2e0b-4fbd-9658-ccd5c67ff498 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:11.341433 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-452b4b7c-2e0b-4fbd-9658-ccd5c67ff498 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1674 microversion: 2.1 time: 0.162721 Aug 25 14:28:11.342056 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3566/7201] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:11 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:12.364258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-dc31b177-e8e9-4215-802a-4d9ff910f8c0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:12.364909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-dc31b177-e8e9-4215-802a-4d9ff910f8c0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:12.371518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc31b177-e8e9-4215-802a-4d9ff910f8c0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:12.372006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc31b177-e8e9-4215-802a-4d9ff910f8c0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:12.372450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc31b177-e8e9-4215-802a-4d9ff910f8c0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:12.373153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc31b177-e8e9-4215-802a-4d9ff910f8c0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:12.373816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc31b177-e8e9-4215-802a-4d9ff910f8c0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:12.374255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-dc31b177-e8e9-4215-802a-4d9ff910f8c0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:12.512509 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-dc31b177-e8e9-4215-802a-4d9ff910f8c0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:12.520559 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-dc31b177-e8e9-4215-802a-4d9ff910f8c0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1674 microversion: 2.1 time: 0.160366 Aug 25 14:28:12.521136 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3636/7202] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:12 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:13.543129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-10cf8305-77dd-45ca-b97a-7b50a21d093e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:13.543752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-10cf8305-77dd-45ca-b97a-7b50a21d093e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:13.550810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10cf8305-77dd-45ca-b97a-7b50a21d093e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:13.551322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10cf8305-77dd-45ca-b97a-7b50a21d093e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:13.551789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10cf8305-77dd-45ca-b97a-7b50a21d093e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:13.552514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10cf8305-77dd-45ca-b97a-7b50a21d093e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:13.552995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10cf8305-77dd-45ca-b97a-7b50a21d093e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:13.553447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-10cf8305-77dd-45ca-b97a-7b50a21d093e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:13.692992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-10cf8305-77dd-45ca-b97a-7b50a21d093e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:13.701017 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-10cf8305-77dd-45ca-b97a-7b50a21d093e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1682 microversion: 2.1 time: 0.162196 Aug 25 14:28:13.702307 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3567/7203] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:13 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:13.799304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ba7ee581-2571-4db0-9dde-466a120030f5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:13.801424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ba7ee581-2571-4db0-9dde-466a120030f5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:13.808337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba7ee581-2571-4db0-9dde-466a120030f5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:13.808829 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba7ee581-2571-4db0-9dde-466a120030f5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:13.809265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba7ee581-2571-4db0-9dde-466a120030f5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:13.810067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba7ee581-2571-4db0-9dde-466a120030f5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:13.810529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba7ee581-2571-4db0-9dde-466a120030f5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:13.811526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ba7ee581-2571-4db0-9dde-466a120030f5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:13.875257 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ba7ee581-2571-4db0-9dde-466a120030f5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da/action" status: 200 len: 38583 microversion: 2.1 time: 0.079486 Aug 25 14:28:13.875978 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3637/7204] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:28:13 2022] POST /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da/action => generated 38583 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:28:14.905138 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-77db9ad1-6fdf-4316-b732-794dc36c21fa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:14.905886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-77db9ad1-6fdf-4316-b732-794dc36c21fa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:14.913446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77db9ad1-6fdf-4316-b732-794dc36c21fa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:14.913987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77db9ad1-6fdf-4316-b732-794dc36c21fa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:14.914449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77db9ad1-6fdf-4316-b732-794dc36c21fa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:14.915185 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77db9ad1-6fdf-4316-b732-794dc36c21fa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:14.915699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77db9ad1-6fdf-4316-b732-794dc36c21fa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:14.916140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-77db9ad1-6fdf-4316-b732-794dc36c21fa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:14.955246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-77db9ad1-6fdf-4316-b732-794dc36c21fa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:28:14.971067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-51833994-7197-4683-b3c8-5ef9aae046c9 req-87cae37b-e994-49fe-bde9-e1e256e49bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fdf461-d07c-47d7-8067-1877daae33da", "tag": "903ba1eb-02ce-434f-90d9-2501103fbbe4"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:14.986146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-51833994-7197-4683-b3c8-5ef9aae046c9 req-87cae37b-e994-49fe-bde9-e1e256e49bbd service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:14.986631 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-51833994-7197-4683-b3c8-5ef9aae046c9 req-87cae37b-e994-49fe-bde9-e1e256e49bbd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:14.987067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-51833994-7197-4683-b3c8-5ef9aae046c9 req-87cae37b-e994-49fe-bde9-e1e256e49bbd service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:15.000414 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-51833994-7197-4683-b3c8-5ef9aae046c9 req-87cae37b-e994-49fe-bde9-e1e256e49bbd service nova] Creating event network-changed:903ba1eb-02ce-434f-90d9-2501103fbbe4 for instance 49fdf461-d07c-47d7-8067-1877daae33da on n-h1-852771-8 Aug 25 14:28:15.006392 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-51833994-7197-4683-b3c8-5ef9aae046c9 req-87cae37b-e994-49fe-bde9-e1e256e49bbd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102711 Aug 25 14:28:15.007596 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3638/7205] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:28:15.047557 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-77db9ad1-6fdf-4316-b732-794dc36c21fa tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "DELETE /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 204 len: 0 microversion: 2.1 time: 0.146524 Aug 25 14:28:15.048859 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3568/7206] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:28:14 2022] DELETE /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:28:15.061415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc65cf1c-31b1-4906-90c2-3c9f2168c406 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:15.062667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc65cf1c-31b1-4906-90c2-3c9f2168c406 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:15.070051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc65cf1c-31b1-4906-90c2-3c9f2168c406 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:15.070894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc65cf1c-31b1-4906-90c2-3c9f2168c406 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:15.071439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc65cf1c-31b1-4906-90c2-3c9f2168c406 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:15.072398 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc65cf1c-31b1-4906-90c2-3c9f2168c406 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:15.073117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc65cf1c-31b1-4906-90c2-3c9f2168c406 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:15.073673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc65cf1c-31b1-4906-90c2-3c9f2168c406 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:15.225835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc65cf1c-31b1-4906-90c2-3c9f2168c406 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:15.234638 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc65cf1c-31b1-4906-90c2-3c9f2168c406 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1688 microversion: 2.1 time: 0.180743 Aug 25 14:28:15.235234 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3639/7207] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:15 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:28:16.258110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9e3edc99-e149-47cf-bc9f-add87ce929a3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:16.258794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9e3edc99-e149-47cf-bc9f-add87ce929a3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:16.266430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e3edc99-e149-47cf-bc9f-add87ce929a3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:16.266929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e3edc99-e149-47cf-bc9f-add87ce929a3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:16.267386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e3edc99-e149-47cf-bc9f-add87ce929a3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:16.268103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e3edc99-e149-47cf-bc9f-add87ce929a3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:16.268566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e3edc99-e149-47cf-bc9f-add87ce929a3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:16.269003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e3edc99-e149-47cf-bc9f-add87ce929a3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:16.406650 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9e3edc99-e149-47cf-bc9f-add87ce929a3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:16.414755 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9e3edc99-e149-47cf-bc9f-add87ce929a3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1688 microversion: 2.1 time: 0.160863 Aug 25 14:28:16.415352 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3569/7208] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:16 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:17.437735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e7a35fc2-0365-442c-945e-ac90ddc7425c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:17.438361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e7a35fc2-0365-442c-945e-ac90ddc7425c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:17.445466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7a35fc2-0365-442c-945e-ac90ddc7425c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:17.446006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7a35fc2-0365-442c-945e-ac90ddc7425c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:17.446657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7a35fc2-0365-442c-945e-ac90ddc7425c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:17.447373 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7a35fc2-0365-442c-945e-ac90ddc7425c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:17.447836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7a35fc2-0365-442c-945e-ac90ddc7425c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:17.448267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e7a35fc2-0365-442c-945e-ac90ddc7425c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:17.472213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-670573c8-a9c0-4e4d-adfe-e0304aeaec39 req-6cf3d2ca-49d4-49f3-aec7-a6deec7abd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fdf461-d07c-47d7-8067-1877daae33da", "name": "network-vif-deleted", "tag": "903ba1eb-02ce-434f-90d9-2501103fbbe4"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:17.484896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-670573c8-a9c0-4e4d-adfe-e0304aeaec39 req-6cf3d2ca-49d4-49f3-aec7-a6deec7abd35 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:17.485283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-670573c8-a9c0-4e4d-adfe-e0304aeaec39 req-6cf3d2ca-49d4-49f3-aec7-a6deec7abd35 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:17.485758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-670573c8-a9c0-4e4d-adfe-e0304aeaec39 req-6cf3d2ca-49d4-49f3-aec7-a6deec7abd35 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:17.499689 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-670573c8-a9c0-4e4d-adfe-e0304aeaec39 req-6cf3d2ca-49d4-49f3-aec7-a6deec7abd35 service nova] Creating event network-vif-deleted:903ba1eb-02ce-434f-90d9-2501103fbbe4 for instance 49fdf461-d07c-47d7-8067-1877daae33da on n-h1-852771-8 Aug 25 14:28:17.505186 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-670573c8-a9c0-4e4d-adfe-e0304aeaec39 req-6cf3d2ca-49d4-49f3-aec7-a6deec7abd35 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036555 Aug 25 14:28:17.505883 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3570/7209] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:28:17.594994 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e7a35fc2-0365-442c-945e-ac90ddc7425c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:17.603399 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e7a35fc2-0365-442c-945e-ac90ddc7425c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 200 len: 1502 microversion: 2.1 time: 0.169731 Aug 25 14:28:17.603980 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3640/7210] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:17 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:18.628331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:18.628968 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 49fdf461-d07c-47d7-8067-1877daae33da] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:18.635314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:18.635820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:18.636298 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:18.636992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:18.637487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:18.637954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:18.652714 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] HTTP exception thrown: Instance 49fdf461-d07c-47d7-8067-1877daae33da could not be found. Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Request method failure captured: Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da HTTP/1.1 Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4ads787rgq8t_jXmCTThfVv_kx769QvsW0MZ5tgMODzur0SDWAIYOH4pIE-_yPODKVbrbR0vLAnucf1TpxwL9SGUUa4KpluqsaQKeUsjztYGimEh53QDn1xz-52racGejJeUo3vbBLFEjoLVxrRFo6BBPPQiwzlOMWsONyqJ9sbwfQ Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 275f24feb3574af5b9b8a60107ccf118 Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/275f24feb3574af5b9b8a60107ccf118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_275f24feb3574af5b9b8a60107ccf118", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/275f24feb3574af5b9b8a60107ccf118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/275f24feb3574af5b9b8a60107ccf118"}]}] Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 275f24feb3574af5b9b8a60107ccf118 Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestNetworkAdvancedServerOps-1026450561-project Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 03e4ee8ca9ab458ab9fe9657e08aec5a Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1026450561-project Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 49fdf461-d07c-47d7-8067-1877daae33da could not be found. Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '49fdf461-d07c-47d7-8067-1877daae33da'} Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49fdf461-d07c-47d7-8067-1877daae33da could not be found. Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49fdf461-d07c-47d7-8067-1877daae33da could not be found. Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:28:18.654541 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49fdf461-d07c-47d7-8067-1877daae33da could not be found. Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Returning 404 to user: Instance 49fdf461-d07c-47d7-8067-1877daae33da could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3699de41-176b-4566-877c-e1836a8aff0b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da" status: 404 len: 111 microversion: 2.1 time: 0.033882 Aug 25 14:28:18.659637 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3571/7211] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:18 2022] GET /compute/v2.1/servers/49fdf461-d07c-47d7-8067-1877daae33da => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:28:22.174916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f3c0bddd-011d-493e-a0b0-9adb755b0339 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '.version_select at 0x7f3a2e7ee280>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:22.199881 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f3c0bddd-011d-493e-a0b0-9adb755b0339 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1745395819" status: 202 len: 0 microversion: 2.1 time: 0.028721 Aug 25 14:28:22.200696 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3641/7212] 10.222.0.70 () {58 vars in 1284 bytes} [Thu Aug 25 14:28:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1745395819 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:28:22.231529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-667f9c79-acb0-4f6d-a1c5-ac68bb1649a0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'create', calling method: .version_select at 0x7f3a29812820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-138611309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4uNMn/sIEuQW4Kcd90qUpIzCHR9E1rAgZNhuEcwKCCUrTlGQzDTQD119sTz2pQprbCGkca1+WRIVg/kOrfO9J09CN2HRq7054SMOADlVRtJmRgloe0MM1MR6cwPP+08g=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:22.249465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-667f9c79-acb0-4f6d-a1c5-ac68bb1649a0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for project 275f24feb3574af5b9b8a60107ccf118. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:28:22.255430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-667f9c79-acb0-4f6d-a1c5-ac68bb1649a0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for user 03e4ee8ca9ab458ab9fe9657e08aec5a and project 275f24feb3574af5b9b8a60107ccf118. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:28:22.282259 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-667f9c79-acb0-4f6d-a1c5-ac68bb1649a0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054388 Aug 25 14:28:22.283307 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3572/7213] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:28:22 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:28:28.749960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=46 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:28.763203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-226047212", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "7fd8a432-4d37-481f-a7d4-eb0a73cca923"}], "key_name": "tempest-TestNetworkAdvancedServerOps-138611309", "security_groups": [{"name": "tempest-secgroup-smoke-1092850829"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:28.938656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] validate_networks() for [('7fd8a432-4d37-481f-a7d4-eb0a73cca923', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:28:29.490640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:28:29.491174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:28:29.491806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:28:29.492225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:28:29.492682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:28:29.506082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:29.506678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:29.507129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:29.507900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:29.508364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:29.508798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:29.529589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for project 275f24feb3574af5b9b8a60107ccf118. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:28:29.536101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for user 03e4ee8ca9ab458ab9fe9657e08aec5a and project 275f24feb3574af5b9b8a60107ccf118. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:28:29.552020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:28:29.554538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:28:29.611491 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-faf3d7e1-f4fa-4897-b8ee-b1ca57a6bb75 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.866245 Aug 25 14:28:29.612260 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3642/7214] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:28:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:28:29.624186 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1ff1d3d3-aeaf-4136-959a-f5e221fc9793 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:29.625542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1ff1d3d3-aeaf-4136-959a-f5e221fc9793 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:29.628997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:29.757842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1ff1d3d3-aeaf-4136-959a-f5e221fc9793 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:29.766538 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1ff1d3d3-aeaf-4136-959a-f5e221fc9793 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1265 microversion: 2.1 time: 0.146793 Aug 25 14:28:29.767144 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3573/7215] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:29 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:30.800938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c45e136c-44bb-448c-843c-53724c062cdd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:30.803086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c45e136c-44bb-448c-843c-53724c062cdd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:30.879555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c45e136c-44bb-448c-843c-53724c062cdd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:30.890732 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c45e136c-44bb-448c-843c-53724c062cdd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1265 microversion: 2.1 time: 0.106233 Aug 25 14:28:30.891342 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3643/7216] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:30 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:31.926149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4a240a2d-3042-4c98-a715-1aba1b5e4eab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:31.926796 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4a240a2d-3042-4c98-a715-1aba1b5e4eab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:31.994020 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4a240a2d-3042-4c98-a715-1aba1b5e4eab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:32.007459 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4a240a2d-3042-4c98-a715-1aba1b5e4eab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1265 microversion: 2.1 time: 0.085803 Aug 25 14:28:32.008402 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3574/7217] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:31 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:33.032242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-720e3bc3-dafe-4a3e-a252-aa828e2d5b0f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:33.032912 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-720e3bc3-dafe-4a3e-a252-aa828e2d5b0f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:33.087750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-720e3bc3-dafe-4a3e-a252-aa828e2d5b0f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:33.096117 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-720e3bc3-dafe-4a3e-a252-aa828e2d5b0f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1265 microversion: 2.1 time: 0.068420 Aug 25 14:28:33.096710 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3644/7218] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:33 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1265 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:34.117622 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-aa5063d3-9111-4a6d-b008-4b322f76cbf0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:34.118284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-aa5063d3-9111-4a6d-b008-4b322f76cbf0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:34.125705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa5063d3-9111-4a6d-b008-4b322f76cbf0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:34.126316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa5063d3-9111-4a6d-b008-4b322f76cbf0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:34.126929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa5063d3-9111-4a6d-b008-4b322f76cbf0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:34.127519 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa5063d3-9111-4a6d-b008-4b322f76cbf0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:34.127997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa5063d3-9111-4a6d-b008-4b322f76cbf0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:34.128449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-aa5063d3-9111-4a6d-b008-4b322f76cbf0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:34.198393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-aa5063d3-9111-4a6d-b008-4b322f76cbf0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:34.207605 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-aa5063d3-9111-4a6d-b008-4b322f76cbf0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1269 microversion: 2.1 time: 0.094106 Aug 25 14:28:34.208236 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3575/7219] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:34 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:35.228403 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f793972c-6790-4e5a-bee1-72473d39d4fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:35.229014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f793972c-6790-4e5a-bee1-72473d39d4fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:35.233312 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:35.239197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f793972c-6790-4e5a-bee1-72473d39d4fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:35.239690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f793972c-6790-4e5a-bee1-72473d39d4fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:35.240129 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f793972c-6790-4e5a-bee1-72473d39d4fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:35.240837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f793972c-6790-4e5a-bee1-72473d39d4fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:35.241281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f793972c-6790-4e5a-bee1-72473d39d4fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:35.241766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f793972c-6790-4e5a-bee1-72473d39d4fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:35.328153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f793972c-6790-4e5a-bee1-72473d39d4fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:35.336702 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f793972c-6790-4e5a-bee1-72473d39d4fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1323 microversion: 2.1 time: 0.112046 Aug 25 14:28:35.337306 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3645/7220] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:35 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1323 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:36.360266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a21a1bbd-6562-42a8-9495-1c5e5dab1efc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:36.361125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a21a1bbd-6562-42a8-9495-1c5e5dab1efc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:36.364228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:36.369964 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a21a1bbd-6562-42a8-9495-1c5e5dab1efc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:36.370476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a21a1bbd-6562-42a8-9495-1c5e5dab1efc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:36.371242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a21a1bbd-6562-42a8-9495-1c5e5dab1efc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:36.372181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a21a1bbd-6562-42a8-9495-1c5e5dab1efc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:36.372900 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a21a1bbd-6562-42a8-9495-1c5e5dab1efc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:36.373421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a21a1bbd-6562-42a8-9495-1c5e5dab1efc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:36.529084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a21a1bbd-6562-42a8-9495-1c5e5dab1efc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:36.540263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-b8666f05-60e3-465c-8d06-d1effcddcb11 req-d5fa8042-39f9-42fe-addb-d7c184a0055d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03372971-65eb-4034-8f80-ddd3d45d672e", "tag": "f0f42f76-1baf-44c7-9514-14f306cf12bd"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:36.541473 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a21a1bbd-6562-42a8-9495-1c5e5dab1efc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1391 microversion: 2.1 time: 0.185218 Aug 25 14:28:36.542832 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3576/7221] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:36 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1391 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:36.561212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b8666f05-60e3-465c-8d06-d1effcddcb11 req-d5fa8042-39f9-42fe-addb-d7c184a0055d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:36.562013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b8666f05-60e3-465c-8d06-d1effcddcb11 req-d5fa8042-39f9-42fe-addb-d7c184a0055d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:36.569831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-b8666f05-60e3-465c-8d06-d1effcddcb11 req-d5fa8042-39f9-42fe-addb-d7c184a0055d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:36.584480 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-b8666f05-60e3-465c-8d06-d1effcddcb11 req-d5fa8042-39f9-42fe-addb-d7c184a0055d service nova] Creating event network-changed:f0f42f76-1baf-44c7-9514-14f306cf12bd for instance 03372971-65eb-4034-8f80-ddd3d45d672e on n-h2-852771-8 Aug 25 14:28:36.589860 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-b8666f05-60e3-465c-8d06-d1effcddcb11 req-d5fa8042-39f9-42fe-addb-d7c184a0055d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058563 Aug 25 14:28:36.590482 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3646/7222] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:28:37.564575 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b3e145be-63e5-429b-b9fe-2555cc29bd0d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:37.565270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b3e145be-63e5-429b-b9fe-2555cc29bd0d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:37.572503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e145be-63e5-429b-b9fe-2555cc29bd0d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:37.573000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e145be-63e5-429b-b9fe-2555cc29bd0d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:37.573462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e145be-63e5-429b-b9fe-2555cc29bd0d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:37.574207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e145be-63e5-429b-b9fe-2555cc29bd0d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:37.574676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e145be-63e5-429b-b9fe-2555cc29bd0d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:37.575112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b3e145be-63e5-429b-b9fe-2555cc29bd0d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:37.754835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b3e145be-63e5-429b-b9fe-2555cc29bd0d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:37.763756 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b3e145be-63e5-429b-b9fe-2555cc29bd0d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1391 microversion: 2.1 time: 0.203596 Aug 25 14:28:37.764582 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3577/7223] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:37 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:38.786728 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9c9e8d11-8492-4b8a-be33-9630d7080869 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:38.787435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9c9e8d11-8492-4b8a-be33-9630d7080869 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:38.793879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c9e8d11-8492-4b8a-be33-9630d7080869 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:38.795426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c9e8d11-8492-4b8a-be33-9630d7080869 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:38.795575 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c9e8d11-8492-4b8a-be33-9630d7080869 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:38.796288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c9e8d11-8492-4b8a-be33-9630d7080869 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:38.796747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c9e8d11-8492-4b8a-be33-9630d7080869 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:38.797177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9c9e8d11-8492-4b8a-be33-9630d7080869 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:38.956747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9c9e8d11-8492-4b8a-be33-9630d7080869 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:38.965232 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9c9e8d11-8492-4b8a-be33-9630d7080869 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1391 microversion: 2.1 time: 0.183661 Aug 25 14:28:38.966030 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3647/7224] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:38 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:39.991067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7da7cc48-6edd-4028-91e5-43d8bced6f2c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:39.992259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7da7cc48-6edd-4028-91e5-43d8bced6f2c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:40.005352 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da7cc48-6edd-4028-91e5-43d8bced6f2c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:40.006324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da7cc48-6edd-4028-91e5-43d8bced6f2c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:40.007156 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da7cc48-6edd-4028-91e5-43d8bced6f2c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:40.008507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da7cc48-6edd-4028-91e5-43d8bced6f2c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:40.009402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da7cc48-6edd-4028-91e5-43d8bced6f2c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:40.010242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da7cc48-6edd-4028-91e5-43d8bced6f2c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:40.188766 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7da7cc48-6edd-4028-91e5-43d8bced6f2c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:40.197213 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7da7cc48-6edd-4028-91e5-43d8bced6f2c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1391 microversion: 2.1 time: 0.213249 Aug 25 14:28:40.197852 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3578/7225] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:39 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1391 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:41.222234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-57a31d7d-fca7-42f1-bfe9-d03fffc0e5a2 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:41.229979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-57a31d7d-fca7-42f1-bfe9-d03fffc0e5a2 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:41.229979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:41.233523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a31d7d-fca7-42f1-bfe9-d03fffc0e5a2 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:41.234134 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a31d7d-fca7-42f1-bfe9-d03fffc0e5a2 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:41.234776 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a31d7d-fca7-42f1-bfe9-d03fffc0e5a2 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:41.235652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a31d7d-fca7-42f1-bfe9-d03fffc0e5a2 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:41.236114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a31d7d-fca7-42f1-bfe9-d03fffc0e5a2 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:41.236548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-57a31d7d-fca7-42f1-bfe9-d03fffc0e5a2 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:41.380268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-57a31d7d-fca7-42f1-bfe9-d03fffc0e5a2 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:41.388660 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-57a31d7d-fca7-42f1-bfe9-d03fffc0e5a2 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1391 microversion: 2.1 time: 0.172459 Aug 25 14:28:41.389443 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3648/7226] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:41 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:42.026272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=8 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:42.103166 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-471f175d-b591-4a1c-8f81-4ae05cffc4ac req-47ee3a6e-78ad-4e3d-81e7-da020136351b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03372971-65eb-4034-8f80-ddd3d45d672e", "name": "network-vif-plugged", "status": "completed", "tag": "f0f42f76-1baf-44c7-9514-14f306cf12bd"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:42.116145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-471f175d-b591-4a1c-8f81-4ae05cffc4ac req-47ee3a6e-78ad-4e3d-81e7-da020136351b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:42.116731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-471f175d-b591-4a1c-8f81-4ae05cffc4ac req-47ee3a6e-78ad-4e3d-81e7-da020136351b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:42.117211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-471f175d-b591-4a1c-8f81-4ae05cffc4ac req-47ee3a6e-78ad-4e3d-81e7-da020136351b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:42.130709 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-471f175d-b591-4a1c-8f81-4ae05cffc4ac req-47ee3a6e-78ad-4e3d-81e7-da020136351b service nova] Creating event network-vif-plugged:f0f42f76-1baf-44c7-9514-14f306cf12bd for instance 03372971-65eb-4034-8f80-ddd3d45d672e on n-h2-852771-8 Aug 25 14:28:42.135770 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-471f175d-b591-4a1c-8f81-4ae05cffc4ac req-47ee3a6e-78ad-4e3d-81e7-da020136351b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115340 Aug 25 14:28:42.136380 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3579/7227] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:28:42.411027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fc682d59-1c0d-47d0-a960-6ae7057d415f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:42.411576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fc682d59-1c0d-47d0-a960-6ae7057d415f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:42.418277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc682d59-1c0d-47d0-a960-6ae7057d415f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:42.418764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc682d59-1c0d-47d0-a960-6ae7057d415f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:42.419325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc682d59-1c0d-47d0-a960-6ae7057d415f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:42.420553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc682d59-1c0d-47d0-a960-6ae7057d415f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:42.421018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc682d59-1c0d-47d0-a960-6ae7057d415f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:42.421446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fc682d59-1c0d-47d0-a960-6ae7057d415f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:42.559548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fc682d59-1c0d-47d0-a960-6ae7057d415f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:42.568876 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fc682d59-1c0d-47d0-a960-6ae7057d415f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1391 microversion: 2.1 time: 0.161973 Aug 25 14:28:42.569477 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3649/7228] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:42 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:43.593410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-635fe14a-dcab-4b06-8e3e-672fd1e3ff6f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:43.594084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-635fe14a-dcab-4b06-8e3e-672fd1e3ff6f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:43.600688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-635fe14a-dcab-4b06-8e3e-672fd1e3ff6f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:43.601097 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-635fe14a-dcab-4b06-8e3e-672fd1e3ff6f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:43.601800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-635fe14a-dcab-4b06-8e3e-672fd1e3ff6f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:43.602561 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-635fe14a-dcab-4b06-8e3e-672fd1e3ff6f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:43.603060 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-635fe14a-dcab-4b06-8e3e-672fd1e3ff6f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:43.603542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-635fe14a-dcab-4b06-8e3e-672fd1e3ff6f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:43.754015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-635fe14a-dcab-4b06-8e3e-672fd1e3ff6f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:43.761961 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-635fe14a-dcab-4b06-8e3e-672fd1e3ff6f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1564 microversion: 2.1 time: 0.174037 Aug 25 14:28:43.762543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3580/7229] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:43 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:43.783231 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a710971a-d8c1-4b6d-ac11-a3d0b7e68e57 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:43.783850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a710971a-d8c1-4b6d-ac11-a3d0b7e68e57 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:43.785815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=10 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:28:43.792274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a710971a-d8c1-4b6d-ac11-a3d0b7e68e57 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:43.792762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a710971a-d8c1-4b6d-ac11-a3d0b7e68e57 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:43.793213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a710971a-d8c1-4b6d-ac11-a3d0b7e68e57 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:43.794024 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a710971a-d8c1-4b6d-ac11-a3d0b7e68e57 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:43.794605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a710971a-d8c1-4b6d-ac11-a3d0b7e68e57 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:43.795049 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a710971a-d8c1-4b6d-ac11-a3d0b7e68e57 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:43.935917 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a710971a-d8c1-4b6d-ac11-a3d0b7e68e57 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:43.944430 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a710971a-d8c1-4b6d-ac11-a3d0b7e68e57 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1564 microversion: 2.1 time: 0.165203 Aug 25 14:28:43.945034 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3650/7230] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:43 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:28:45.720464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1b811e95-ffb5-4453-af14-b1dbc1ffb31c req-223ef947-c63f-4227-867a-0100f2adc839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03372971-65eb-4034-8f80-ddd3d45d672e", "tag": "f0f42f76-1baf-44c7-9514-14f306cf12bd"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:28:45.728014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e8b5500c-a845-41f6-a825-b25f2382aae0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:28:45.728665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e8b5500c-a845-41f6-a825-b25f2382aae0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:28:45.740777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8b5500c-a845-41f6-a825-b25f2382aae0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:45.741297 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8b5500c-a845-41f6-a825-b25f2382aae0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:45.741818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8b5500c-a845-41f6-a825-b25f2382aae0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:45.742557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8b5500c-a845-41f6-a825-b25f2382aae0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:45.745809 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1b811e95-ffb5-4453-af14-b1dbc1ffb31c req-223ef947-c63f-4227-867a-0100f2adc839 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:28:45.746314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1b811e95-ffb5-4453-af14-b1dbc1ffb31c req-223ef947-c63f-4227-867a-0100f2adc839 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:45.746743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1b811e95-ffb5-4453-af14-b1dbc1ffb31c req-223ef947-c63f-4227-867a-0100f2adc839 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:45.752382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8b5500c-a845-41f6-a825-b25f2382aae0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:28:45.752854 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e8b5500c-a845-41f6-a825-b25f2382aae0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:28:45.776920 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1b811e95-ffb5-4453-af14-b1dbc1ffb31c req-223ef947-c63f-4227-867a-0100f2adc839 service nova] Creating event network-changed:f0f42f76-1baf-44c7-9514-14f306cf12bd for instance 03372971-65eb-4034-8f80-ddd3d45d672e on n-h2-852771-8 Aug 25 14:28:45.784138 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1b811e95-ffb5-4453-af14-b1dbc1ffb31c req-223ef947-c63f-4227-867a-0100f2adc839 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067573 Aug 25 14:28:45.790321 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3651/7231] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:28:45.923730 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e8b5500c-a845-41f6-a825-b25f2382aae0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:28:45.935702 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e8b5500c-a845-41f6-a825-b25f2382aae0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1564 microversion: 2.1 time: 0.222041 Aug 25 14:28:45.945800 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3581/7232] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:28:45 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1564 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:19.262671 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=13 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:29:19.263410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=36 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:29:19.267860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-42e67029-f711-4ff0-994e-ee673ffb699c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:29:19.270226 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-42e67029-f711-4ff0-994e-ee673ffb699c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:19.277375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42e67029-f711-4ff0-994e-ee673ffb699c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:19.277929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42e67029-f711-4ff0-994e-ee673ffb699c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:19.278333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42e67029-f711-4ff0-994e-ee673ffb699c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:19.279048 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42e67029-f711-4ff0-994e-ee673ffb699c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:19.279504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42e67029-f711-4ff0-994e-ee673ffb699c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:19.279930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-42e67029-f711-4ff0-994e-ee673ffb699c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:19.342839 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-42e67029-f711-4ff0-994e-ee673ffb699c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e/action" status: 200 len: 24560 microversion: 2.1 time: 0.082121 Aug 25 14:29:19.343513 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3652/7233] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:29:19 2022] POST /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e/action => generated 24560 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:29:58.420604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=11 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:29:58.421653 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=38 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:29:58.425972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c71abb33-cee1-45f8-9d9e-37e5c2a7d012 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:29:58.428259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c71abb33-cee1-45f8-9d9e-37e5c2a7d012 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:58.435784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71abb33-cee1-45f8-9d9e-37e5c2a7d012 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:58.436292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71abb33-cee1-45f8-9d9e-37e5c2a7d012 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:58.436753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71abb33-cee1-45f8-9d9e-37e5c2a7d012 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:58.437477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71abb33-cee1-45f8-9d9e-37e5c2a7d012 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:58.437978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71abb33-cee1-45f8-9d9e-37e5c2a7d012 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:58.438420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c71abb33-cee1-45f8-9d9e-37e5c2a7d012 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:58.513745 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c71abb33-cee1-45f8-9d9e-37e5c2a7d012 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e/action" status: 202 len: 0 microversion: 2.1 time: 0.094874 Aug 25 14:29:58.514549 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3582/7234] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:29:58 2022] POST /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:29:58.523612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-44ef6819-8a0c-4bab-b60e-976e4744c07a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:58.524345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-44ef6819-8a0c-4bab-b60e-976e4744c07a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:58.527244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:29:58.527906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:29:58.534015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ef6819-8a0c-4bab-b60e-976e4744c07a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:58.534832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ef6819-8a0c-4bab-b60e-976e4744c07a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:58.535004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ef6819-8a0c-4bab-b60e-976e4744c07a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:58.535654 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ef6819-8a0c-4bab-b60e-976e4744c07a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:58.536125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ef6819-8a0c-4bab-b60e-976e4744c07a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:58.536542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-44ef6819-8a0c-4bab-b60e-976e4744c07a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:58.690308 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-44ef6819-8a0c-4bab-b60e-976e4744c07a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:58.699344 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-44ef6819-8a0c-4bab-b60e-976e4744c07a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1675 microversion: 2.1 time: 0.180080 Aug 25 14:29:58.700438 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3653/7235] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:58 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:59.723782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-cf4b34a8-b3fb-4129-b7c9-0f794a93f24f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:59.724510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-cf4b34a8-b3fb-4129-b7c9-0f794a93f24f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:59.731700 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b34a8-b3fb-4129-b7c9-0f794a93f24f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:59.732330 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b34a8-b3fb-4129-b7c9-0f794a93f24f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:59.732799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b34a8-b3fb-4129-b7c9-0f794a93f24f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:59.733542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b34a8-b3fb-4129-b7c9-0f794a93f24f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:59.734029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b34a8-b3fb-4129-b7c9-0f794a93f24f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:59.734474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-cf4b34a8-b3fb-4129-b7c9-0f794a93f24f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:59.883813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-cf4b34a8-b3fb-4129-b7c9-0f794a93f24f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:59.892021 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-cf4b34a8-b3fb-4129-b7c9-0f794a93f24f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1680 microversion: 2.1 time: 0.173771 Aug 25 14:29:59.892622 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3583/7236] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:59 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:00.913974 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62c2b60c-f0a8-4328-acc4-42d4bb00eedd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:00.914678 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-62c2b60c-f0a8-4328-acc4-42d4bb00eedd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:00.922504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2b60c-f0a8-4328-acc4-42d4bb00eedd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:00.922997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2b60c-f0a8-4328-acc4-42d4bb00eedd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:00.923439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2b60c-f0a8-4328-acc4-42d4bb00eedd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:00.924161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2b60c-f0a8-4328-acc4-42d4bb00eedd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:00.924616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2b60c-f0a8-4328-acc4-42d4bb00eedd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:00.925045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-62c2b60c-f0a8-4328-acc4-42d4bb00eedd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:01.081132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62c2b60c-f0a8-4328-acc4-42d4bb00eedd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:01.092734 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-62c2b60c-f0a8-4328-acc4-42d4bb00eedd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1680 microversion: 2.1 time: 0.182743 Aug 25 14:30:01.093355 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3654/7237] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:00 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:02.115175 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59ebea2d-9fb1-4a8a-ad4a-4710e3b6fc4c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:02.116007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59ebea2d-9fb1-4a8a-ad4a-4710e3b6fc4c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:02.123151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59ebea2d-9fb1-4a8a-ad4a-4710e3b6fc4c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:02.123664 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59ebea2d-9fb1-4a8a-ad4a-4710e3b6fc4c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:02.124124 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59ebea2d-9fb1-4a8a-ad4a-4710e3b6fc4c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:02.124925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59ebea2d-9fb1-4a8a-ad4a-4710e3b6fc4c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:02.125404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59ebea2d-9fb1-4a8a-ad4a-4710e3b6fc4c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:02.125945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59ebea2d-9fb1-4a8a-ad4a-4710e3b6fc4c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:02.275847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-59ebea2d-9fb1-4a8a-ad4a-4710e3b6fc4c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:02.283844 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59ebea2d-9fb1-4a8a-ad4a-4710e3b6fc4c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1680 microversion: 2.1 time: 0.172628 Aug 25 14:30:02.284432 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3584/7238] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:02 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:03.306255 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-bc730954-0c3b-4576-b9ff-e8dd4eea180f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:03.307019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-bc730954-0c3b-4576-b9ff-e8dd4eea180f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:03.316562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc730954-0c3b-4576-b9ff-e8dd4eea180f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:03.317136 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc730954-0c3b-4576-b9ff-e8dd4eea180f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:03.317801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc730954-0c3b-4576-b9ff-e8dd4eea180f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:03.318634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc730954-0c3b-4576-b9ff-e8dd4eea180f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:03.319194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc730954-0c3b-4576-b9ff-e8dd4eea180f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:03.319687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-bc730954-0c3b-4576-b9ff-e8dd4eea180f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:03.500382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-bc730954-0c3b-4576-b9ff-e8dd4eea180f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:03.515121 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-bc730954-0c3b-4576-b9ff-e8dd4eea180f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1680 microversion: 2.1 time: 0.212529 Aug 25 14:30:03.516101 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3655/7239] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:03 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1680 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:04.538406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-98bdd42f-1fe4-40f8-af23-9b6ff38f2529 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:04.539050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-98bdd42f-1fe4-40f8-af23-9b6ff38f2529 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:04.547982 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98bdd42f-1fe4-40f8-af23-9b6ff38f2529 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:04.548557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98bdd42f-1fe4-40f8-af23-9b6ff38f2529 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:04.549088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98bdd42f-1fe4-40f8-af23-9b6ff38f2529 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:04.549863 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98bdd42f-1fe4-40f8-af23-9b6ff38f2529 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:04.550414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98bdd42f-1fe4-40f8-af23-9b6ff38f2529 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:04.550922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-98bdd42f-1fe4-40f8-af23-9b6ff38f2529 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:04.718691 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-98bdd42f-1fe4-40f8-af23-9b6ff38f2529 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:04.727974 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-98bdd42f-1fe4-40f8-af23-9b6ff38f2529 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1680 microversion: 2.1 time: 0.193516 Aug 25 14:30:04.728867 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3585/7240] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:04 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:05.754959 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3746bcef-e563-47dd-894d-7cfae1feddcd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:05.755580 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3746bcef-e563-47dd-894d-7cfae1feddcd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:05.763618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3746bcef-e563-47dd-894d-7cfae1feddcd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:05.764122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3746bcef-e563-47dd-894d-7cfae1feddcd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:05.764562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3746bcef-e563-47dd-894d-7cfae1feddcd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:05.765287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3746bcef-e563-47dd-894d-7cfae1feddcd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:05.765789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3746bcef-e563-47dd-894d-7cfae1feddcd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:05.766248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3746bcef-e563-47dd-894d-7cfae1feddcd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:05.919952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3746bcef-e563-47dd-894d-7cfae1feddcd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:05.933986 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3746bcef-e563-47dd-894d-7cfae1feddcd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1680 microversion: 2.1 time: 0.182602 Aug 25 14:30:05.934986 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3656/7241] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:05 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:06.957840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-039ce880-c8d0-4b18-9be2-05e63d451e3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:06.958628 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-039ce880-c8d0-4b18-9be2-05e63d451e3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:06.968593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-039ce880-c8d0-4b18-9be2-05e63d451e3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:06.969116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-039ce880-c8d0-4b18-9be2-05e63d451e3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:06.969620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-039ce880-c8d0-4b18-9be2-05e63d451e3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:06.970404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-039ce880-c8d0-4b18-9be2-05e63d451e3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:06.970986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-039ce880-c8d0-4b18-9be2-05e63d451e3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:06.971442 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-039ce880-c8d0-4b18-9be2-05e63d451e3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:07.143416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-039ce880-c8d0-4b18-9be2-05e63d451e3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:07.152066 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-039ce880-c8d0-4b18-9be2-05e63d451e3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1680 microversion: 2.1 time: 0.198916 Aug 25 14:30:07.152656 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3586/7242] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:06 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:08.174027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-168c13d7-7954-43a7-b832-9be9a62af0cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:08.174628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-168c13d7-7954-43a7-b832-9be9a62af0cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:08.182530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168c13d7-7954-43a7-b832-9be9a62af0cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:08.183018 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168c13d7-7954-43a7-b832-9be9a62af0cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:08.183459 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168c13d7-7954-43a7-b832-9be9a62af0cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:08.184175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168c13d7-7954-43a7-b832-9be9a62af0cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:08.184626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168c13d7-7954-43a7-b832-9be9a62af0cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:08.185052 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-168c13d7-7954-43a7-b832-9be9a62af0cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:08.334434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-168c13d7-7954-43a7-b832-9be9a62af0cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:08.342882 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-168c13d7-7954-43a7-b832-9be9a62af0cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1680 microversion: 2.1 time: 0.172741 Aug 25 14:30:08.343457 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3657/7243] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:08 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:09.368961 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-533b1f06-38fa-46c5-a175-ebe2f60b3ca8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:09.369801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-533b1f06-38fa-46c5-a175-ebe2f60b3ca8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:09.377815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-533b1f06-38fa-46c5-a175-ebe2f60b3ca8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:09.378340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-533b1f06-38fa-46c5-a175-ebe2f60b3ca8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:09.379952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-533b1f06-38fa-46c5-a175-ebe2f60b3ca8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:09.379952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-533b1f06-38fa-46c5-a175-ebe2f60b3ca8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:09.380253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-533b1f06-38fa-46c5-a175-ebe2f60b3ca8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:09.380525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-533b1f06-38fa-46c5-a175-ebe2f60b3ca8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:09.587581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-533b1f06-38fa-46c5-a175-ebe2f60b3ca8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:09.596024 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-533b1f06-38fa-46c5-a175-ebe2f60b3ca8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1680 microversion: 2.1 time: 0.235591 Aug 25 14:30:09.596637 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3587/7244] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:09 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:10.618122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d3a94d0-5a2c-492f-8207-59f413ca0dfb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:10.618898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d3a94d0-5a2c-492f-8207-59f413ca0dfb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:10.626816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d3a94d0-5a2c-492f-8207-59f413ca0dfb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:10.627314 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d3a94d0-5a2c-492f-8207-59f413ca0dfb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:10.627755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d3a94d0-5a2c-492f-8207-59f413ca0dfb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:10.628473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d3a94d0-5a2c-492f-8207-59f413ca0dfb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:10.628930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d3a94d0-5a2c-492f-8207-59f413ca0dfb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:10.629363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d3a94d0-5a2c-492f-8207-59f413ca0dfb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:10.803386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8d3a94d0-5a2c-492f-8207-59f413ca0dfb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:10.820157 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d3a94d0-5a2c-492f-8207-59f413ca0dfb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1683 microversion: 2.1 time: 0.206163 Aug 25 14:30:10.820767 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3658/7245] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:10 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1683 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:43.057539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5d51b611-6fd8-40fc-9198-5c9d40ea10be tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:30:43.060450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5d51b611-6fd8-40fc-9198-5c9d40ea10be tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:43.062971 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:30:43.063128 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e/action (ip 10.222.0.70) !!! Aug 25 14:30:43.064386 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:30:43.064530 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e/action (ip 10.222.0.70) !!! Aug 25 14:30:43.065587 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=12 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:30:43.066287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:30:43.076847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d51b611-6fd8-40fc-9198-5c9d40ea10be tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:43.077287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d51b611-6fd8-40fc-9198-5c9d40ea10be tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:43.077774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d51b611-6fd8-40fc-9198-5c9d40ea10be tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:43.078531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d51b611-6fd8-40fc-9198-5c9d40ea10be tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:43.079008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d51b611-6fd8-40fc-9198-5c9d40ea10be tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:43.079719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5d51b611-6fd8-40fc-9198-5c9d40ea10be tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:43.142896 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5d51b611-6fd8-40fc-9198-5c9d40ea10be tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e/action" status: 200 len: 69077 microversion: 2.1 time: 0.089092 Aug 25 14:30:43.143941 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3588/7246] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:30:43 2022] POST /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e/action => generated 69077 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:31:07.103558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fa8540e3-2ba0-4724-b588-ab4787f9c55a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:07.104159 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fa8540e3-2ba0-4724-b588-ab4787f9c55a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:07.106214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=12 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:07.106894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=36 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:07.107564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c4cdbac3-5a05-44d1-98f1-c4bd0a784034 req-2b31e4d3-1588-4a8e-bb7b-2de5fd59fbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03372971-65eb-4034-8f80-ddd3d45d672e", "tag": "f0f42f76-1baf-44c7-9514-14f306cf12bd"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:07.113736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa8540e3-2ba0-4724-b588-ab4787f9c55a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:07.114754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa8540e3-2ba0-4724-b588-ab4787f9c55a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:07.115432 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa8540e3-2ba0-4724-b588-ab4787f9c55a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:07.116447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa8540e3-2ba0-4724-b588-ab4787f9c55a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:07.117699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa8540e3-2ba0-4724-b588-ab4787f9c55a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:07.117699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fa8540e3-2ba0-4724-b588-ab4787f9c55a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:07.118665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:07.119611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:07.122815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c4cdbac3-5a05-44d1-98f1-c4bd0a784034 req-2b31e4d3-1588-4a8e-bb7b-2de5fd59fbf3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:07.122815 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c4cdbac3-5a05-44d1-98f1-c4bd0a784034 req-2b31e4d3-1588-4a8e-bb7b-2de5fd59fbf3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:07.123629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c4cdbac3-5a05-44d1-98f1-c4bd0a784034 req-2b31e4d3-1588-4a8e-bb7b-2de5fd59fbf3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:07.147366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fa8540e3-2ba0-4724-b588-ab4787f9c55a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:31:07.149428 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c4cdbac3-5a05-44d1-98f1-c4bd0a784034 req-2b31e4d3-1588-4a8e-bb7b-2de5fd59fbf3 service nova] Creating event network-changed:f0f42f76-1baf-44c7-9514-14f306cf12bd for instance 03372971-65eb-4034-8f80-ddd3d45d672e on n-h2-852771-8 Aug 25 14:31:07.159037 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c4cdbac3-5a05-44d1-98f1-c4bd0a784034 req-2b31e4d3-1588-4a8e-bb7b-2de5fd59fbf3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056595 Aug 25 14:31:07.161230 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3589/7247] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:31:07.252206 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fa8540e3-2ba0-4724-b588-ab4787f9c55a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "DELETE /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 204 len: 0 microversion: 2.1 time: 0.152614 Aug 25 14:31:07.253112 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3659/7248] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:31:07 2022] DELETE /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:31:07.263287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f88356da-f91d-47a2-9109-062d56afb2fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:07.264056 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f88356da-f91d-47a2-9109-062d56afb2fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:07.270933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88356da-f91d-47a2-9109-062d56afb2fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:07.271533 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88356da-f91d-47a2-9109-062d56afb2fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:07.272210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88356da-f91d-47a2-9109-062d56afb2fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:07.272950 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88356da-f91d-47a2-9109-062d56afb2fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:07.273639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88356da-f91d-47a2-9109-062d56afb2fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:07.274128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88356da-f91d-47a2-9109-062d56afb2fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:07.423061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f88356da-f91d-47a2-9109-062d56afb2fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:07.432421 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f88356da-f91d-47a2-9109-062d56afb2fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1689 microversion: 2.1 time: 0.174113 Aug 25 14:31:07.433081 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3590/7249] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:07 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:08.456353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a2194373-9768-4306-a9c7-30c1ea9d4ee8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:08.458184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a2194373-9768-4306-a9c7-30c1ea9d4ee8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:08.464375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2194373-9768-4306-a9c7-30c1ea9d4ee8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:08.464865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2194373-9768-4306-a9c7-30c1ea9d4ee8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:08.465317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2194373-9768-4306-a9c7-30c1ea9d4ee8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:08.466050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2194373-9768-4306-a9c7-30c1ea9d4ee8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:08.466512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2194373-9768-4306-a9c7-30c1ea9d4ee8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:08.466944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2194373-9768-4306-a9c7-30c1ea9d4ee8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:08.609560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a2194373-9768-4306-a9c7-30c1ea9d4ee8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:08.618440 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a2194373-9768-4306-a9c7-30c1ea9d4ee8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1689 microversion: 2.1 time: 0.167692 Aug 25 14:31:08.619130 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3660/7250] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:08 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:09.338008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-e05373ad-e656-421c-85c3-11fab897f7f7 req-64609444-8766-4d5e-86b6-8ba9b536189c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03372971-65eb-4034-8f80-ddd3d45d672e", "name": "network-vif-deleted", "tag": "f0f42f76-1baf-44c7-9514-14f306cf12bd"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:09.352941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e05373ad-e656-421c-85c3-11fab897f7f7 req-64609444-8766-4d5e-86b6-8ba9b536189c service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:09.353573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e05373ad-e656-421c-85c3-11fab897f7f7 req-64609444-8766-4d5e-86b6-8ba9b536189c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:09.354037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e05373ad-e656-421c-85c3-11fab897f7f7 req-64609444-8766-4d5e-86b6-8ba9b536189c service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:09.367223 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-e05373ad-e656-421c-85c3-11fab897f7f7 req-64609444-8766-4d5e-86b6-8ba9b536189c service nova] Creating event network-vif-deleted:f0f42f76-1baf-44c7-9514-14f306cf12bd for instance 03372971-65eb-4034-8f80-ddd3d45d672e on n-h2-852771-8 Aug 25 14:31:09.373134 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-e05373ad-e656-421c-85c3-11fab897f7f7 req-64609444-8766-4d5e-86b6-8ba9b536189c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043734 Aug 25 14:31:09.373795 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3591/7251] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:31:09.641207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:09.641898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:09.651597 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:09.652143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:09.652593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:09.653354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:09.654266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:09.654891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:09.694342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:09.694856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:09.695296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:09.695762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lazy-loading 'fault' on Instance uuid 03372971-65eb-4034-8f80-ddd3d45d672e {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:31:09.750838 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:09.760653 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e3860bb5-14af-4d93-a6ff-8825b6b47d12 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 200 len: 1355 microversion: 2.1 time: 0.122986 Aug 25 14:31:09.761592 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3661/7252] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:09 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 1355 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:31:10.786108 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:10.788520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 03372971-65eb-4034-8f80-ddd3d45d672e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:10.796760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:10.797281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:10.797798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:10.798547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:10.803682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:10.804318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:10.823616 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] HTTP exception thrown: Instance 03372971-65eb-4034-8f80-ddd3d45d672e could not be found. Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Request method failure captured: Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e HTTP/1.1 Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4ads787rgq8t_jXmCTThfVv_kx769QvsW0MZ5tgMODzur0SDWAIYOH4pIE-_yPODKVbrbR0vLAnucf1TpxwL9SGUUa4KpluqsaQKeUsjztYGimEh53QDn1xz-52racGejJeUo3vbBLFEjoLVxrRFo6BBPPQiwzlOMWsONyqJ9sbwfQ Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 275f24feb3574af5b9b8a60107ccf118 Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/275f24feb3574af5b9b8a60107ccf118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_275f24feb3574af5b9b8a60107ccf118", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/275f24feb3574af5b9b8a60107ccf118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/275f24feb3574af5b9b8a60107ccf118"}]}] Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 275f24feb3574af5b9b8a60107ccf118 Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestNetworkAdvancedServerOps-1026450561-project Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 03e4ee8ca9ab458ab9fe9657e08aec5a Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1026450561-project Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 03372971-65eb-4034-8f80-ddd3d45d672e could not be found. Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '03372971-65eb-4034-8f80-ddd3d45d672e'} Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03372971-65eb-4034-8f80-ddd3d45d672e could not be found. Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03372971-65eb-4034-8f80-ddd3d45d672e could not be found. Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:31:10.825311 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03372971-65eb-4034-8f80-ddd3d45d672e could not be found. Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Returning 404 to user: Instance 03372971-65eb-4034-8f80-ddd3d45d672e could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-769532ca-170f-4ff7-934b-85c507d59dad tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e" status: 404 len: 111 microversion: 2.1 time: 0.047138 Aug 25 14:31:10.830445 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3592/7253] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:10 2022] GET /compute/v2.1/servers/03372971-65eb-4034-8f80-ddd3d45d672e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:31:14.605985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-746c2e74-16db-4231-a6e5-16d4f0525a4a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '.version_select at 0x7f3a2941fe50>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:14.617750 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [None req-746c2e74-16db-4231-a6e5-16d4f0525a4a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:31:15.625732 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [None req-746c2e74-16db-4231-a6e5-16d4f0525a4a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 58412. Aug 25 14:31:15.650433 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-746c2e74-16db-4231-a6e5-16d4f0525a4a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-138611309" status: 202 len: 0 microversion: 2.1 time: 1.048219 Aug 25 14:31:15.650560 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3662/7254] 10.222.0.70 () {58 vars in 1281 bytes} [Thu Aug 25 14:31:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-138611309 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:31:15.679184 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2fecc1f5-9920-4126-a223-f6eec3d2550c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'create', calling method: .version_select at 0x7f3a287c8310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1363965675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNOEeTkALvYyIOvGWB27X/OK82uFudQIx2x3CbsMB0/fLMpH0zgydxRGU5ScwT8GpJtqaV6GAXo1Eou76qqrFX5llFcusbU6EwVUtHFyY0nBv/lE6JXC9a776Fxz6tkow=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:15.696751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2fecc1f5-9920-4126-a223-f6eec3d2550c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for project 275f24feb3574af5b9b8a60107ccf118. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:31:15.703327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2fecc1f5-9920-4126-a223-f6eec3d2550c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for user 03e4ee8ca9ab458ab9fe9657e08aec5a and project 275f24feb3574af5b9b8a60107ccf118. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:31:15.740994 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2fecc1f5-9920-4126-a223-f6eec3d2550c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.066618 Aug 25 14:31:15.742328 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3593/7255] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:31:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:31:22.036931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:22.041640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1346059023", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "a5e99b85-8276-41bc-ada4-599cd5addba6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1363965675", "security_groups": [{"name": "tempest-secgroup-smoke-723859535"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:22.196050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] validate_networks() for [('a5e99b85-8276-41bc-ada4-599cd5addba6', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:31:22.816976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:31:22.817414 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:31:22.817932 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:31:22.818353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:31:22.818769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:31:22.834894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:22.836221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:22.836997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:22.838120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:22.839202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:22.839890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:22.882150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for project 275f24feb3574af5b9b8a60107ccf118. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:31:22.889215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for user 03e4ee8ca9ab458ab9fe9657e08aec5a and project 275f24feb3574af5b9b8a60107ccf118. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:31:22.906208 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:31:22.908628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:31:22.970622 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [ee94f617-a4a9-4739-8b59-e118b70cd9fd] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:31:23.982473 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [ee94f617-a4a9-4739-8b59-e118b70cd9fd] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 58462. Aug 25 14:31:23.988284 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7c5b1c84-4b96-4b25-bb29-9e6abf3c6ffe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.953616 Aug 25 14:31:23.989637 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3663/7256] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:31:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:31:23.999127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=12 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:24.007051 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-af0eb68d-d699-4be9-98bf-c14018fdbfb5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:24.008402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-af0eb68d-d699-4be9-98bf-c14018fdbfb5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:24.145088 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-af0eb68d-d699-4be9-98bf-c14018fdbfb5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:24.153233 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-af0eb68d-d699-4be9-98bf-c14018fdbfb5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1267 microversion: 2.1 time: 0.156592 Aug 25 14:31:24.154726 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3594/7257] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:23 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:25.176216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a8b8ee1f-83bd-4eec-8061-70b1fc38d717 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:25.176957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a8b8ee1f-83bd-4eec-8061-70b1fc38d717 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:25.190337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b8ee1f-83bd-4eec-8061-70b1fc38d717 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:25.191444 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b8ee1f-83bd-4eec-8061-70b1fc38d717 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:25.191898 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b8ee1f-83bd-4eec-8061-70b1fc38d717 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:25.192687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b8ee1f-83bd-4eec-8061-70b1fc38d717 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:25.193402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b8ee1f-83bd-4eec-8061-70b1fc38d717 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:25.193881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a8b8ee1f-83bd-4eec-8061-70b1fc38d717 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:25.288589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a8b8ee1f-83bd-4eec-8061-70b1fc38d717 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:25.298376 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a8b8ee1f-83bd-4eec-8061-70b1fc38d717 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1327 microversion: 2.1 time: 0.126946 Aug 25 14:31:25.299478 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3664/7258] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:25 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1327 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:26.321820 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d4cfedd1-1679-4447-9858-ab31cc9ae0f8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:26.322465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d4cfedd1-1679-4447-9858-ab31cc9ae0f8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:26.332109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4cfedd1-1679-4447-9858-ab31cc9ae0f8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:26.333171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4cfedd1-1679-4447-9858-ab31cc9ae0f8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:26.333792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4cfedd1-1679-4447-9858-ab31cc9ae0f8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:26.334734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4cfedd1-1679-4447-9858-ab31cc9ae0f8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:26.335460 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4cfedd1-1679-4447-9858-ab31cc9ae0f8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:26.336239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d4cfedd1-1679-4447-9858-ab31cc9ae0f8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:26.543169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d4cfedd1-1679-4447-9858-ab31cc9ae0f8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:26.551691 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d4cfedd1-1679-4447-9858-ab31cc9ae0f8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1392 microversion: 2.1 time: 0.234599 Aug 25 14:31:26.552547 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3595/7259] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:26 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:26.908206 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-41d9a30d-2940-4035-8e77-c35fe0f4c89e req-b37142c1-f9e5-4ceb-bc00-83bcf8054958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e62a3a59-ac53-4a53-993a-973259c75e3e", "tag": "aee05cea-8c3d-4783-bfc8-711464383a72"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:26.919914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-41d9a30d-2940-4035-8e77-c35fe0f4c89e req-b37142c1-f9e5-4ceb-bc00-83bcf8054958 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:26.920774 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-41d9a30d-2940-4035-8e77-c35fe0f4c89e req-b37142c1-f9e5-4ceb-bc00-83bcf8054958 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:26.921286 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-41d9a30d-2940-4035-8e77-c35fe0f4c89e req-b37142c1-f9e5-4ceb-bc00-83bcf8054958 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:26.939034 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-41d9a30d-2940-4035-8e77-c35fe0f4c89e req-b37142c1-f9e5-4ceb-bc00-83bcf8054958 service nova] Creating event network-changed:aee05cea-8c3d-4783-bfc8-711464383a72 for instance e62a3a59-ac53-4a53-993a-973259c75e3e on n-h1-852771-8 Aug 25 14:31:26.945170 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-41d9a30d-2940-4035-8e77-c35fe0f4c89e req-b37142c1-f9e5-4ceb-bc00-83bcf8054958 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121382 Aug 25 14:31:26.945833 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3665/7260] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:31:27.575278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-257b8734-77b5-4326-932e-f1b83e1e2813 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:27.575857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-257b8734-77b5-4326-932e-f1b83e1e2813 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:27.584059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-257b8734-77b5-4326-932e-f1b83e1e2813 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:27.584570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-257b8734-77b5-4326-932e-f1b83e1e2813 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:27.585102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-257b8734-77b5-4326-932e-f1b83e1e2813 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:27.585792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-257b8734-77b5-4326-932e-f1b83e1e2813 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:27.586267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-257b8734-77b5-4326-932e-f1b83e1e2813 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:27.587112 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-257b8734-77b5-4326-932e-f1b83e1e2813 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:27.734637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-257b8734-77b5-4326-932e-f1b83e1e2813 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:27.744708 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-257b8734-77b5-4326-932e-f1b83e1e2813 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1392 microversion: 2.1 time: 0.173615 Aug 25 14:31:27.745321 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3596/7261] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:27 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:28.767239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f3fa6d7b-dadf-4c09-9422-f4ddcd5b29f7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:28.767960 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f3fa6d7b-dadf-4c09-9422-f4ddcd5b29f7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:28.775140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3fa6d7b-dadf-4c09-9422-f4ddcd5b29f7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:28.775633 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3fa6d7b-dadf-4c09-9422-f4ddcd5b29f7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:28.776078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3fa6d7b-dadf-4c09-9422-f4ddcd5b29f7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:28.776797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3fa6d7b-dadf-4c09-9422-f4ddcd5b29f7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:28.777261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3fa6d7b-dadf-4c09-9422-f4ddcd5b29f7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:28.777738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f3fa6d7b-dadf-4c09-9422-f4ddcd5b29f7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:28.917458 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f3fa6d7b-dadf-4c09-9422-f4ddcd5b29f7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:28.926161 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f3fa6d7b-dadf-4c09-9422-f4ddcd5b29f7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1392 microversion: 2.1 time: 0.164045 Aug 25 14:31:28.926751 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3666/7262] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:28 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:29.948450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a6f822cf-9edf-4482-8902-81882ffc41d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:29.949093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a6f822cf-9edf-4482-8902-81882ffc41d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:29.957811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6f822cf-9edf-4482-8902-81882ffc41d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:29.958233 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6f822cf-9edf-4482-8902-81882ffc41d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:29.958695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6f822cf-9edf-4482-8902-81882ffc41d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:29.959433 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6f822cf-9edf-4482-8902-81882ffc41d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:29.959910 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6f822cf-9edf-4482-8902-81882ffc41d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:29.960414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6f822cf-9edf-4482-8902-81882ffc41d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:30.136978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a6f822cf-9edf-4482-8902-81882ffc41d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:30.146065 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a6f822cf-9edf-4482-8902-81882ffc41d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1392 microversion: 2.1 time: 0.201626 Aug 25 14:31:30.146668 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3597/7263] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:29 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:31.166699 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-6c34bf77-c5bc-4475-863c-1bf86299d9c7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:31.167233 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-6c34bf77-c5bc-4475-863c-1bf86299d9c7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:31.174148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c34bf77-c5bc-4475-863c-1bf86299d9c7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:31.174637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c34bf77-c5bc-4475-863c-1bf86299d9c7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:31.175700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c34bf77-c5bc-4475-863c-1bf86299d9c7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:31.176467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c34bf77-c5bc-4475-863c-1bf86299d9c7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:31.176939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c34bf77-c5bc-4475-863c-1bf86299d9c7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:31.177381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-6c34bf77-c5bc-4475-863c-1bf86299d9c7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:31.320567 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-6c34bf77-c5bc-4475-863c-1bf86299d9c7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:31.328442 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-6c34bf77-c5bc-4475-863c-1bf86299d9c7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1392 microversion: 2.1 time: 0.165812 Aug 25 14:31:31.329021 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3667/7264] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:31 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:32.350159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0ed21e5-366a-4217-8305-edec2becfc80 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:32.350772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e0ed21e5-366a-4217-8305-edec2becfc80 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:32.358092 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0ed21e5-366a-4217-8305-edec2becfc80 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:32.358592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0ed21e5-366a-4217-8305-edec2becfc80 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:32.359054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0ed21e5-366a-4217-8305-edec2becfc80 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:32.359790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0ed21e5-366a-4217-8305-edec2becfc80 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:32.360260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0ed21e5-366a-4217-8305-edec2becfc80 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:32.360704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0ed21e5-366a-4217-8305-edec2becfc80 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:32.537102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e0ed21e5-366a-4217-8305-edec2becfc80 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:32.552746 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0ed21e5-366a-4217-8305-edec2becfc80 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1392 microversion: 2.1 time: 0.205930 Aug 25 14:31:32.553729 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3598/7265] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:32 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1392 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:33.575835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0ab6152b-5ad3-4576-93ba-23adedff5dd1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:33.576452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0ab6152b-5ad3-4576-93ba-23adedff5dd1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:33.579287 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:33.580423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:33.586782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab6152b-5ad3-4576-93ba-23adedff5dd1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:33.587268 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab6152b-5ad3-4576-93ba-23adedff5dd1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:33.587714 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab6152b-5ad3-4576-93ba-23adedff5dd1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:33.588422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab6152b-5ad3-4576-93ba-23adedff5dd1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:33.588885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab6152b-5ad3-4576-93ba-23adedff5dd1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:33.589319 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0ab6152b-5ad3-4576-93ba-23adedff5dd1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:33.728866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0ab6152b-5ad3-4576-93ba-23adedff5dd1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:33.739198 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0ab6152b-5ad3-4576-93ba-23adedff5dd1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1392 microversion: 2.1 time: 0.167161 Aug 25 14:31:33.740340 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3668/7266] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:33 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:33.996407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-e9ccd864-29cb-4ec4-8f25-a3a8522e8d21 req-03c99497-3341-4ed2-bc1a-79942f5e29f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62a3a59-ac53-4a53-993a-973259c75e3e", "name": "network-vif-plugged", "status": "completed", "tag": "aee05cea-8c3d-4783-bfc8-711464383a72"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:34.009801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e9ccd864-29cb-4ec4-8f25-a3a8522e8d21 req-03c99497-3341-4ed2-bc1a-79942f5e29f4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:34.010272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e9ccd864-29cb-4ec4-8f25-a3a8522e8d21 req-03c99497-3341-4ed2-bc1a-79942f5e29f4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:34.010780 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e9ccd864-29cb-4ec4-8f25-a3a8522e8d21 req-03c99497-3341-4ed2-bc1a-79942f5e29f4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:34.024656 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-e9ccd864-29cb-4ec4-8f25-a3a8522e8d21 req-03c99497-3341-4ed2-bc1a-79942f5e29f4 service nova] Creating event network-vif-plugged:aee05cea-8c3d-4783-bfc8-711464383a72 for instance e62a3a59-ac53-4a53-993a-973259c75e3e on n-h1-852771-8 Aug 25 14:31:34.030346 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-e9ccd864-29cb-4ec4-8f25-a3a8522e8d21 req-03c99497-3341-4ed2-bc1a-79942f5e29f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037815 Aug 25 14:31:34.030997 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3599/7267] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:31:34.763251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ff7790db-7e58-4641-a597-39018c3b83de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:34.763973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ff7790db-7e58-4641-a597-39018c3b83de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:34.771901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff7790db-7e58-4641-a597-39018c3b83de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:34.772401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff7790db-7e58-4641-a597-39018c3b83de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:34.772878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff7790db-7e58-4641-a597-39018c3b83de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:34.773764 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff7790db-7e58-4641-a597-39018c3b83de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:34.774460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff7790db-7e58-4641-a597-39018c3b83de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:34.774914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ff7790db-7e58-4641-a597-39018c3b83de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:34.937855 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ff7790db-7e58-4641-a597-39018c3b83de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:34.947411 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ff7790db-7e58-4641-a597-39018c3b83de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1392 microversion: 2.1 time: 0.188946 Aug 25 14:31:34.951381 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3669/7268] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:34 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:35.970426 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4d11f691-cdfd-46de-b424-e46c0279379e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:35.971137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4d11f691-cdfd-46de-b424-e46c0279379e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:35.973705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:35.980019 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d11f691-cdfd-46de-b424-e46c0279379e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:35.980540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d11f691-cdfd-46de-b424-e46c0279379e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:35.980995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d11f691-cdfd-46de-b424-e46c0279379e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:35.981760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d11f691-cdfd-46de-b424-e46c0279379e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:35.982232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d11f691-cdfd-46de-b424-e46c0279379e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:35.982671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4d11f691-cdfd-46de-b424-e46c0279379e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:36.129417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4d11f691-cdfd-46de-b424-e46c0279379e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:36.137845 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4d11f691-cdfd-46de-b424-e46c0279379e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1563 microversion: 2.1 time: 0.171514 Aug 25 14:31:36.138423 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3600/7269] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:35 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:36.161611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9d6b8104-d321-405d-bb1a-401b3563d8a9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:36.162416 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9d6b8104-d321-405d-bb1a-401b3563d8a9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:36.174762 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d6b8104-d321-405d-bb1a-401b3563d8a9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:36.175605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d6b8104-d321-405d-bb1a-401b3563d8a9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:36.176061 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d6b8104-d321-405d-bb1a-401b3563d8a9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:36.176791 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d6b8104-d321-405d-bb1a-401b3563d8a9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:36.177353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d6b8104-d321-405d-bb1a-401b3563d8a9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:36.177730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9d6b8104-d321-405d-bb1a-401b3563d8a9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:36.352428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9d6b8104-d321-405d-bb1a-401b3563d8a9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:36.361049 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9d6b8104-d321-405d-bb1a-401b3563d8a9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1563 microversion: 2.1 time: 0.204805 Aug 25 14:31:36.361690 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3670/7270] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:36 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1563 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:31:38.522506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-6b0fc9b6-dab5-4aad-8b75-dd2a042f8ba6 req-255d3f3c-c61f-48da-9e71-764fc1397a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e62a3a59-ac53-4a53-993a-973259c75e3e", "tag": "aee05cea-8c3d-4783-bfc8-711464383a72"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:38.528423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:38.536074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6b0fc9b6-dab5-4aad-8b75-dd2a042f8ba6 req-255d3f3c-c61f-48da-9e71-764fc1397a2f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:38.536550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6b0fc9b6-dab5-4aad-8b75-dd2a042f8ba6 req-255d3f3c-c61f-48da-9e71-764fc1397a2f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:38.536985 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6b0fc9b6-dab5-4aad-8b75-dd2a042f8ba6 req-255d3f3c-c61f-48da-9e71-764fc1397a2f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:38.554180 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-6b0fc9b6-dab5-4aad-8b75-dd2a042f8ba6 req-255d3f3c-c61f-48da-9e71-764fc1397a2f service nova] Creating event network-changed:aee05cea-8c3d-4783-bfc8-711464383a72 for instance e62a3a59-ac53-4a53-993a-973259c75e3e on n-h1-852771-8 Aug 25 14:31:38.560429 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-6b0fc9b6-dab5-4aad-8b75-dd2a042f8ba6 req-255d3f3c-c61f-48da-9e71-764fc1397a2f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046733 Aug 25 14:31:38.561680 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3671/7271] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:31:38.571662 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b65304cc-39cd-4f2c-979e-ebf683ec5d4f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:38.572307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b65304cc-39cd-4f2c-979e-ebf683ec5d4f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:38.574303 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:38.580219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b65304cc-39cd-4f2c-979e-ebf683ec5d4f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:38.580635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b65304cc-39cd-4f2c-979e-ebf683ec5d4f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:38.581659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b65304cc-39cd-4f2c-979e-ebf683ec5d4f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:38.582402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b65304cc-39cd-4f2c-979e-ebf683ec5d4f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:38.582875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b65304cc-39cd-4f2c-979e-ebf683ec5d4f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:38.583322 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b65304cc-39cd-4f2c-979e-ebf683ec5d4f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:38.837325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b65304cc-39cd-4f2c-979e-ebf683ec5d4f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:38.849247 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b65304cc-39cd-4f2c-979e-ebf683ec5d4f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1563 microversion: 2.1 time: 0.338437 Aug 25 14:31:38.849919 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3601/7272] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:38 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1563 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:12.167827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=42 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:32:12.172347 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-5c686ecf-70fa-4e54-9d1b-efdd351d985d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:32:12.174703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-5c686ecf-70fa-4e54-9d1b-efdd351d985d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:12.183852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c686ecf-70fa-4e54-9d1b-efdd351d985d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:12.184348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c686ecf-70fa-4e54-9d1b-efdd351d985d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:12.184797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c686ecf-70fa-4e54-9d1b-efdd351d985d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:12.185538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c686ecf-70fa-4e54-9d1b-efdd351d985d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:12.186003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c686ecf-70fa-4e54-9d1b-efdd351d985d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:12.186457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-5c686ecf-70fa-4e54-9d1b-efdd351d985d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:12.263055 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-5c686ecf-70fa-4e54-9d1b-efdd351d985d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e/action" status: 200 len: 24569 microversion: 2.1 time: 0.097881 Aug 25 14:32:12.263779 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3672/7273] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:32:12 2022] POST /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e/action => generated 24569 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 14:32:42.692557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:32:42.693429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=38 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:32:42.698159 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:32:42.700522 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:42.707927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:42.708428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:42.708906 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:42.709626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:42.710102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:42.710537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:42.795933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:42.802490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Old instance type m1.heat2, new instance type m1.heat {{(pid=129059) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:32:42.809971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:32:42.810410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:32:42.810928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:32:42.811358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:32:42.811838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:32:42.879525 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-df8aafc1-25d5-49f8-a20a-27c7867f4e26 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e/action" status: 202 len: 0 microversion: 2.1 time: 0.188713 Aug 25 14:32:42.880153 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3602/7274] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:32:42 2022] POST /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:32:42.889734 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2a0aa796-d2cc-42b5-8eb6-cc9a90974cbd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:42.890446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2a0aa796-d2cc-42b5-8eb6-cc9a90974cbd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:42.894352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:32:42.895190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:32:42.901013 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a0aa796-d2cc-42b5-8eb6-cc9a90974cbd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:42.901493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a0aa796-d2cc-42b5-8eb6-cc9a90974cbd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:42.902044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a0aa796-d2cc-42b5-8eb6-cc9a90974cbd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:42.903446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a0aa796-d2cc-42b5-8eb6-cc9a90974cbd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:42.903907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a0aa796-d2cc-42b5-8eb6-cc9a90974cbd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:42.904499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2a0aa796-d2cc-42b5-8eb6-cc9a90974cbd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:43.056455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2a0aa796-d2cc-42b5-8eb6-cc9a90974cbd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:43.064569 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2a0aa796-d2cc-42b5-8eb6-cc9a90974cbd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1691 microversion: 2.1 time: 0.179444 Aug 25 14:32:43.065158 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3673/7275] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:42 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:44.088818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9db53269-da84-4735-b32d-d68f8ee1ed82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:44.089449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9db53269-da84-4735-b32d-d68f8ee1ed82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:44.097358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9db53269-da84-4735-b32d-d68f8ee1ed82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:44.097893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9db53269-da84-4735-b32d-d68f8ee1ed82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:44.098353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9db53269-da84-4735-b32d-d68f8ee1ed82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:44.099079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9db53269-da84-4735-b32d-d68f8ee1ed82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:44.099554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9db53269-da84-4735-b32d-d68f8ee1ed82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:44.099999 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9db53269-da84-4735-b32d-d68f8ee1ed82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:44.236749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9db53269-da84-4735-b32d-d68f8ee1ed82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:44.244956 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9db53269-da84-4735-b32d-d68f8ee1ed82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1691 microversion: 2.1 time: 0.161063 Aug 25 14:32:44.245466 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3603/7276] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:44 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:45.267326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1a071f47-c3c5-4513-997d-f6389f91fb4b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:45.267964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1a071f47-c3c5-4513-997d-f6389f91fb4b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:45.279995 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a071f47-c3c5-4513-997d-f6389f91fb4b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:45.280497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a071f47-c3c5-4513-997d-f6389f91fb4b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:45.280951 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a071f47-c3c5-4513-997d-f6389f91fb4b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:45.281718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a071f47-c3c5-4513-997d-f6389f91fb4b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:45.282184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a071f47-c3c5-4513-997d-f6389f91fb4b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:45.282644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1a071f47-c3c5-4513-997d-f6389f91fb4b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:45.428324 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1a071f47-c3c5-4513-997d-f6389f91fb4b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:45.436724 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1a071f47-c3c5-4513-997d-f6389f91fb4b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1691 microversion: 2.1 time: 0.173409 Aug 25 14:32:45.437320 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3674/7277] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:45 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:46.459306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b8c948ba-169b-409d-b38b-a14a092e746a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:46.459944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b8c948ba-169b-409d-b38b-a14a092e746a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:46.467082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8c948ba-169b-409d-b38b-a14a092e746a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:46.467573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8c948ba-169b-409d-b38b-a14a092e746a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:46.468039 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8c948ba-169b-409d-b38b-a14a092e746a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:46.468768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8c948ba-169b-409d-b38b-a14a092e746a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:46.469254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8c948ba-169b-409d-b38b-a14a092e746a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:46.469731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b8c948ba-169b-409d-b38b-a14a092e746a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:46.612130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b8c948ba-169b-409d-b38b-a14a092e746a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:46.620361 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b8c948ba-169b-409d-b38b-a14a092e746a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1691 microversion: 2.1 time: 0.165085 Aug 25 14:32:46.620951 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3604/7278] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:46 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:47.643317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-76c02c42-cb89-4c04-bfa5-c4537f273c2b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:47.643980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-76c02c42-cb89-4c04-bfa5-c4537f273c2b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:47.651290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76c02c42-cb89-4c04-bfa5-c4537f273c2b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:47.651836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76c02c42-cb89-4c04-bfa5-c4537f273c2b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:47.652262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76c02c42-cb89-4c04-bfa5-c4537f273c2b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:47.653015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76c02c42-cb89-4c04-bfa5-c4537f273c2b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:47.653469 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76c02c42-cb89-4c04-bfa5-c4537f273c2b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:47.653946 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-76c02c42-cb89-4c04-bfa5-c4537f273c2b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:47.801434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-76c02c42-cb89-4c04-bfa5-c4537f273c2b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:47.809947 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-76c02c42-cb89-4c04-bfa5-c4537f273c2b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1691 microversion: 2.1 time: 0.171593 Aug 25 14:32:47.810595 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3675/7279] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:47 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:32:48.837788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9002ce0b-8b56-4024-8a6a-e748c8a7eab7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:48.838903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9002ce0b-8b56-4024-8a6a-e748c8a7eab7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:48.846033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9002ce0b-8b56-4024-8a6a-e748c8a7eab7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:48.846668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9002ce0b-8b56-4024-8a6a-e748c8a7eab7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:48.847178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9002ce0b-8b56-4024-8a6a-e748c8a7eab7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:48.847935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9002ce0b-8b56-4024-8a6a-e748c8a7eab7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:48.848441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9002ce0b-8b56-4024-8a6a-e748c8a7eab7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:48.848885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9002ce0b-8b56-4024-8a6a-e748c8a7eab7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:49.385109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9002ce0b-8b56-4024-8a6a-e748c8a7eab7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:49.394689 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9002ce0b-8b56-4024-8a6a-e748c8a7eab7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1691 microversion: 2.1 time: 0.562127 Aug 25 14:32:49.395314 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3605/7280] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:48 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1691 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:50.416587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1d2847dc-4eae-47ad-bed7-cbb4ee222f32 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:50.417207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1d2847dc-4eae-47ad-bed7-cbb4ee222f32 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:50.425605 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d2847dc-4eae-47ad-bed7-cbb4ee222f32 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:50.426093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d2847dc-4eae-47ad-bed7-cbb4ee222f32 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:50.426535 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d2847dc-4eae-47ad-bed7-cbb4ee222f32 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:50.427230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d2847dc-4eae-47ad-bed7-cbb4ee222f32 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:50.427690 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d2847dc-4eae-47ad-bed7-cbb4ee222f32 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:50.428122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1d2847dc-4eae-47ad-bed7-cbb4ee222f32 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:50.570100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1d2847dc-4eae-47ad-bed7-cbb4ee222f32 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:50.578172 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1d2847dc-4eae-47ad-bed7-cbb4ee222f32 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1696 microversion: 2.1 time: 0.165721 Aug 25 14:32:50.578979 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3676/7281] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:50 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:51.600935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a93af26b-6fbc-45fb-ab3b-f136b8c194fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:51.601593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a93af26b-6fbc-45fb-ab3b-f136b8c194fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:51.608481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a93af26b-6fbc-45fb-ab3b-f136b8c194fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:51.608979 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a93af26b-6fbc-45fb-ab3b-f136b8c194fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:51.609439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a93af26b-6fbc-45fb-ab3b-f136b8c194fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:51.610688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a93af26b-6fbc-45fb-ab3b-f136b8c194fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:51.611160 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a93af26b-6fbc-45fb-ab3b-f136b8c194fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:51.611603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a93af26b-6fbc-45fb-ab3b-f136b8c194fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:51.750702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a93af26b-6fbc-45fb-ab3b-f136b8c194fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:51.759867 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a93af26b-6fbc-45fb-ab3b-f136b8c194fc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1696 microversion: 2.1 time: 0.162495 Aug 25 14:32:51.760476 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3606/7282] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:51 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:52.785779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4aebef78-dffd-4788-8dc4-dd93ad187d82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:52.787323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4aebef78-dffd-4788-8dc4-dd93ad187d82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:52.794811 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aebef78-dffd-4788-8dc4-dd93ad187d82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:52.795341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aebef78-dffd-4788-8dc4-dd93ad187d82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:52.795897 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aebef78-dffd-4788-8dc4-dd93ad187d82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:52.796644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aebef78-dffd-4788-8dc4-dd93ad187d82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:52.797172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aebef78-dffd-4788-8dc4-dd93ad187d82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:52.798228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4aebef78-dffd-4788-8dc4-dd93ad187d82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:52.943384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4aebef78-dffd-4788-8dc4-dd93ad187d82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:52.951553 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4aebef78-dffd-4788-8dc4-dd93ad187d82 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1696 microversion: 2.1 time: 0.170606 Aug 25 14:32:52.952160 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3677/7283] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:52 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:53.976299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee0d92e6-03d4-4c60-95ea-cc3bcf6710da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:53.977154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee0d92e6-03d4-4c60-95ea-cc3bcf6710da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:53.984127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee0d92e6-03d4-4c60-95ea-cc3bcf6710da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:53.985375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee0d92e6-03d4-4c60-95ea-cc3bcf6710da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:53.985634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee0d92e6-03d4-4c60-95ea-cc3bcf6710da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:53.986355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee0d92e6-03d4-4c60-95ea-cc3bcf6710da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:53.986825 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee0d92e6-03d4-4c60-95ea-cc3bcf6710da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:53.987262 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee0d92e6-03d4-4c60-95ea-cc3bcf6710da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:54.133473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ee0d92e6-03d4-4c60-95ea-cc3bcf6710da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:54.141784 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee0d92e6-03d4-4c60-95ea-cc3bcf6710da tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1696 microversion: 2.1 time: 0.169523 Aug 25 14:32:54.142380 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3607/7284] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:53 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:55.164304 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d72a43d3-5cac-4f19-a74d-3bf920644ca1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:55.164952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d72a43d3-5cac-4f19-a74d-3bf920644ca1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:55.172293 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d72a43d3-5cac-4f19-a74d-3bf920644ca1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:55.172779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d72a43d3-5cac-4f19-a74d-3bf920644ca1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:55.173239 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d72a43d3-5cac-4f19-a74d-3bf920644ca1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:55.174355 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d72a43d3-5cac-4f19-a74d-3bf920644ca1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:55.174927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d72a43d3-5cac-4f19-a74d-3bf920644ca1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:55.175370 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d72a43d3-5cac-4f19-a74d-3bf920644ca1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:55.333816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d72a43d3-5cac-4f19-a74d-3bf920644ca1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:55.341990 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d72a43d3-5cac-4f19-a74d-3bf920644ca1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1696 microversion: 2.1 time: 0.181586 Aug 25 14:32:55.342585 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3678/7285] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:55 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:56.364802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9cb972fe-ef66-4dfa-a5f9-f7fa784c6d65 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:56.365376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9cb972fe-ef66-4dfa-a5f9-f7fa784c6d65 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:56.372469 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cb972fe-ef66-4dfa-a5f9-f7fa784c6d65 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:56.372971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cb972fe-ef66-4dfa-a5f9-f7fa784c6d65 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:56.373531 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cb972fe-ef66-4dfa-a5f9-f7fa784c6d65 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:56.374191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cb972fe-ef66-4dfa-a5f9-f7fa784c6d65 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:56.374668 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cb972fe-ef66-4dfa-a5f9-f7fa784c6d65 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:56.375117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9cb972fe-ef66-4dfa-a5f9-f7fa784c6d65 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:56.521054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9cb972fe-ef66-4dfa-a5f9-f7fa784c6d65 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:56.529217 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9cb972fe-ef66-4dfa-a5f9-f7fa784c6d65 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1696 microversion: 2.1 time: 0.169122 Aug 25 14:32:56.529961 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3608/7286] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:56 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:57.551941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e3058b21-1ce9-4430-bc41-0ab8c715aee0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:57.552681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e3058b21-1ce9-4430-bc41-0ab8c715aee0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:57.559978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3058b21-1ce9-4430-bc41-0ab8c715aee0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:57.560550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3058b21-1ce9-4430-bc41-0ab8c715aee0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:57.561012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3058b21-1ce9-4430-bc41-0ab8c715aee0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:57.561918 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3058b21-1ce9-4430-bc41-0ab8c715aee0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:57.562380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3058b21-1ce9-4430-bc41-0ab8c715aee0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:57.562820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e3058b21-1ce9-4430-bc41-0ab8c715aee0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:57.709196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e3058b21-1ce9-4430-bc41-0ab8c715aee0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:57.718311 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e3058b21-1ce9-4430-bc41-0ab8c715aee0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1696 microversion: 2.1 time: 0.170600 Aug 25 14:32:57.718918 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3679/7287] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:57 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:32:58.740419 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4ba23669-ec93-4265-945d-b48441e51b8b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:58.741073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4ba23669-ec93-4265-945d-b48441e51b8b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:58.747949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ba23669-ec93-4265-945d-b48441e51b8b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:58.748445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ba23669-ec93-4265-945d-b48441e51b8b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:58.748898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ba23669-ec93-4265-945d-b48441e51b8b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:58.749640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ba23669-ec93-4265-945d-b48441e51b8b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:58.750110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ba23669-ec93-4265-945d-b48441e51b8b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:58.750559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ba23669-ec93-4265-945d-b48441e51b8b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:58.908870 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4ba23669-ec93-4265-945d-b48441e51b8b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:58.919366 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4ba23669-ec93-4265-945d-b48441e51b8b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1696 microversion: 2.1 time: 0.182881 Aug 25 14:32:58.920137 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3609/7288] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:58 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:59.943339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-00db1824-1e6c-401c-8a02-003a58a9c991 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:59.943980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-00db1824-1e6c-401c-8a02-003a58a9c991 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:59.951412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00db1824-1e6c-401c-8a02-003a58a9c991 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:59.951906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00db1824-1e6c-401c-8a02-003a58a9c991 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:59.952354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00db1824-1e6c-401c-8a02-003a58a9c991 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:59.953067 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00db1824-1e6c-401c-8a02-003a58a9c991 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:59.953552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00db1824-1e6c-401c-8a02-003a58a9c991 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:59.953987 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-00db1824-1e6c-401c-8a02-003a58a9c991 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:00.117472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-00db1824-1e6c-401c-8a02-003a58a9c991 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:33:00.125870 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-00db1824-1e6c-401c-8a02-003a58a9c991 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1696 microversion: 2.1 time: 0.187387 Aug 25 14:33:00.127039 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3680/7289] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:59 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:33:01.148290 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8fc78b7a-1965-4d1d-b36c-b8b3dfda7f3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:33:01.149049 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8fc78b7a-1965-4d1d-b36c-b8b3dfda7f3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:01.157261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc78b7a-1965-4d1d-b36c-b8b3dfda7f3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:01.158408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc78b7a-1965-4d1d-b36c-b8b3dfda7f3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:01.158884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc78b7a-1965-4d1d-b36c-b8b3dfda7f3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:01.159777 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc78b7a-1965-4d1d-b36c-b8b3dfda7f3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:01.160282 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc78b7a-1965-4d1d-b36c-b8b3dfda7f3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:01.160745 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8fc78b7a-1965-4d1d-b36c-b8b3dfda7f3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:01.322694 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8fc78b7a-1965-4d1d-b36c-b8b3dfda7f3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:33:01.331779 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8fc78b7a-1965-4d1d-b36c-b8b3dfda7f3d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1696 microversion: 2.1 time: 0.187355 Aug 25 14:33:01.332387 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3610/7290] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:33:01 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:33:02.151778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-aa65155e-0986-48e4-a566-e5b355686cc6 req-b2edf1f4-ff24-4478-8404-9a3cd4f5ccfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62a3a59-ac53-4a53-993a-973259c75e3e", "name": "network-vif-unplugged", "status": "completed", "tag": "aee05cea-8c3d-4783-bfc8-711464383a72"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:33:02.165594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-aa65155e-0986-48e4-a566-e5b355686cc6 req-b2edf1f4-ff24-4478-8404-9a3cd4f5ccfa service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:02.166389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-aa65155e-0986-48e4-a566-e5b355686cc6 req-b2edf1f4-ff24-4478-8404-9a3cd4f5ccfa service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:02.166966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-aa65155e-0986-48e4-a566-e5b355686cc6 req-b2edf1f4-ff24-4478-8404-9a3cd4f5ccfa service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:02.183775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-aa65155e-0986-48e4-a566-e5b355686cc6 req-b2edf1f4-ff24-4478-8404-9a3cd4f5ccfa service nova] Creating event network-vif-unplugged:aee05cea-8c3d-4783-bfc8-711464383a72 for instance e62a3a59-ac53-4a53-993a-973259c75e3e on n-h2-852771-8 Aug 25 14:33:02.191507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [req-aa65155e-0986-48e4-a566-e5b355686cc6 req-b2edf1f4-ff24-4478-8404-9a3cd4f5ccfa service nova] Instance e62a3a59-ac53-4a53-993a-973259c75e3e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129060) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:33:02.203954 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-aa65155e-0986-48e4-a566-e5b355686cc6 req-b2edf1f4-ff24-4478-8404-9a3cd4f5ccfa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056952 Aug 25 14:33:02.205657 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3681/7291] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:33:02.355094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b5a07e97-762a-4e2f-af53-0fe21079a400 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:33:02.355659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b5a07e97-762a-4e2f-af53-0fe21079a400 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:02.365321 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5a07e97-762a-4e2f-af53-0fe21079a400 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:02.365880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5a07e97-762a-4e2f-af53-0fe21079a400 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:02.366349 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5a07e97-762a-4e2f-af53-0fe21079a400 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:02.367095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5a07e97-762a-4e2f-af53-0fe21079a400 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:02.367568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5a07e97-762a-4e2f-af53-0fe21079a400 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:02.368094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b5a07e97-762a-4e2f-af53-0fe21079a400 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:02.534759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b5a07e97-762a-4e2f-af53-0fe21079a400 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:33:02.547725 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b5a07e97-762a-4e2f-af53-0fe21079a400 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1695 microversion: 2.1 time: 0.196487 Aug 25 14:33:02.549343 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3611/7292] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:33:02 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:33:03.574878 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e14083e3-1514-425d-9b9f-94295abcff2d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:33:03.575512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e14083e3-1514-425d-9b9f-94295abcff2d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:03.582794 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e14083e3-1514-425d-9b9f-94295abcff2d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:03.583290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e14083e3-1514-425d-9b9f-94295abcff2d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:03.583736 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e14083e3-1514-425d-9b9f-94295abcff2d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:03.584453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e14083e3-1514-425d-9b9f-94295abcff2d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:03.584915 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e14083e3-1514-425d-9b9f-94295abcff2d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:03.585351 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e14083e3-1514-425d-9b9f-94295abcff2d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:03.745394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e14083e3-1514-425d-9b9f-94295abcff2d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:33:03.754642 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e14083e3-1514-425d-9b9f-94295abcff2d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1693 microversion: 2.1 time: 0.185110 Aug 25 14:33:03.755245 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3682/7293] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:33:03 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:33:04.254703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-ccca660c-11ab-4c79-856b-005369e4582f req-6495804c-1c31-4b5a-b4fc-f78fc3368c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e62a3a59-ac53-4a53-993a-973259c75e3e", "tag": "aee05cea-8c3d-4783-bfc8-711464383a72"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:33:04.275247 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ccca660c-11ab-4c79-856b-005369e4582f req-6495804c-1c31-4b5a-b4fc-f78fc3368c68 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:04.275971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ccca660c-11ab-4c79-856b-005369e4582f req-6495804c-1c31-4b5a-b4fc-f78fc3368c68 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:04.276816 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-ccca660c-11ab-4c79-856b-005369e4582f req-6495804c-1c31-4b5a-b4fc-f78fc3368c68 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:04.301451 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-ccca660c-11ab-4c79-856b-005369e4582f req-6495804c-1c31-4b5a-b4fc-f78fc3368c68 service nova] Creating event network-changed:aee05cea-8c3d-4783-bfc8-711464383a72 for instance e62a3a59-ac53-4a53-993a-973259c75e3e on n-h2-852771-8 Aug 25 14:33:04.312520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [req-ccca660c-11ab-4c79-856b-005369e4582f req-6495804c-1c31-4b5a-b4fc-f78fc3368c68 service nova] Instance e62a3a59-ac53-4a53-993a-973259c75e3e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852771-8', 'n-h2-852771-8'} {{(pid=129059) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:33:04.333088 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-ccca660c-11ab-4c79-856b-005369e4582f req-6495804c-1c31-4b5a-b4fc-f78fc3368c68 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086454 Aug 25 14:33:04.333680 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3612/7294] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:33:04.780367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec4af18b-e66b-4e76-885f-a4b6d7d695fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:33:04.781158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec4af18b-e66b-4e76-885f-a4b6d7d695fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:04.790120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4af18b-e66b-4e76-885f-a4b6d7d695fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:04.790926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4af18b-e66b-4e76-885f-a4b6d7d695fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:04.791420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4af18b-e66b-4e76-885f-a4b6d7d695fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:04.792212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4af18b-e66b-4e76-885f-a4b6d7d695fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:04.792836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4af18b-e66b-4e76-885f-a4b6d7d695fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:04.794028 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec4af18b-e66b-4e76-885f-a4b6d7d695fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:05.033296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec4af18b-e66b-4e76-885f-a4b6d7d695fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:33:05.041822 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ec4af18b-e66b-4e76-885f-a4b6d7d695fe tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1693 microversion: 2.1 time: 0.265685 Aug 25 14:33:05.042429 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3683/7295] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:33:04 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1693 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:33:06.066454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c9db5bd6-0458-4518-be1e-023eaeb1a5a8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:33:06.068283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c9db5bd6-0458-4518-be1e-023eaeb1a5a8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:06.076894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9db5bd6-0458-4518-be1e-023eaeb1a5a8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:06.077553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9db5bd6-0458-4518-be1e-023eaeb1a5a8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:06.078440 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9db5bd6-0458-4518-be1e-023eaeb1a5a8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:06.079260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9db5bd6-0458-4518-be1e-023eaeb1a5a8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:06.080142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9db5bd6-0458-4518-be1e-023eaeb1a5a8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:06.081014 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c9db5bd6-0458-4518-be1e-023eaeb1a5a8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:06.258209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c9db5bd6-0458-4518-be1e-023eaeb1a5a8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:33:06.271252 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c9db5bd6-0458-4518-be1e-023eaeb1a5a8 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1693 microversion: 2.1 time: 0.210672 Aug 25 14:33:06.272543 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3613/7296] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:33:06 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:33:07.295554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-07bca6f8-81cf-4cc4-921b-f2396e89e878 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:33:07.296176 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-07bca6f8-81cf-4cc4-921b-f2396e89e878 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:07.304592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07bca6f8-81cf-4cc4-921b-f2396e89e878 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:07.305091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07bca6f8-81cf-4cc4-921b-f2396e89e878 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:07.305561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07bca6f8-81cf-4cc4-921b-f2396e89e878 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:07.306277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07bca6f8-81cf-4cc4-921b-f2396e89e878 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:07.306735 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07bca6f8-81cf-4cc4-921b-f2396e89e878 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:07.307166 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-07bca6f8-81cf-4cc4-921b-f2396e89e878 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:07.461907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-07bca6f8-81cf-4cc4-921b-f2396e89e878 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:33:07.471133 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-07bca6f8-81cf-4cc4-921b-f2396e89e878 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1690 microversion: 2.1 time: 0.178602 Aug 25 14:33:07.471936 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3684/7297] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:33:07 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:33:07.494841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2197fc96-f4f7-4871-89d8-640d6b2f87dd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:33:07.495408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2197fc96-f4f7-4871-89d8-640d6b2f87dd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:07.503406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2197fc96-f4f7-4871-89d8-640d6b2f87dd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:07.503921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2197fc96-f4f7-4871-89d8-640d6b2f87dd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:07.504379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2197fc96-f4f7-4871-89d8-640d6b2f87dd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:07.505111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2197fc96-f4f7-4871-89d8-640d6b2f87dd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:07.505678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2197fc96-f4f7-4871-89d8-640d6b2f87dd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:07.506198 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2197fc96-f4f7-4871-89d8-640d6b2f87dd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:07.580212 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2197fc96-f4f7-4871-89d8-640d6b2f87dd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e/action" status: 204 len: 0 microversion: 2.1 time: 0.088912 Aug 25 14:33:07.581189 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3614/7298] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:33:07 2022] POST /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:33:07.595890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b68f6fdc-cb8f-4b1f-9523-59fb82a9bc24 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:33:07.597557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b68f6fdc-cb8f-4b1f-9523-59fb82a9bc24 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:07.609895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b68f6fdc-cb8f-4b1f-9523-59fb82a9bc24 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:07.612534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b68f6fdc-cb8f-4b1f-9523-59fb82a9bc24 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:07.613585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b68f6fdc-cb8f-4b1f-9523-59fb82a9bc24 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:07.615041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b68f6fdc-cb8f-4b1f-9523-59fb82a9bc24 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:07.615996 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b68f6fdc-cb8f-4b1f-9523-59fb82a9bc24 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:07.616724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b68f6fdc-cb8f-4b1f-9523-59fb82a9bc24 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:07.889648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b68f6fdc-cb8f-4b1f-9523-59fb82a9bc24 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:33:07.901015 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b68f6fdc-cb8f-4b1f-9523-59fb82a9bc24 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1690 microversion: 2.1 time: 0.314528 Aug 25 14:33:07.901651 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3685/7299] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:33:07 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1690 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:33:07.926369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4e154eda-47e1-43fa-ace4-c94910d6b6de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:33:07.927554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4e154eda-47e1-43fa-ace4-c94910d6b6de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:07.934599 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e154eda-47e1-43fa-ace4-c94910d6b6de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:07.935211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e154eda-47e1-43fa-ace4-c94910d6b6de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:07.935751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e154eda-47e1-43fa-ace4-c94910d6b6de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:07.936615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e154eda-47e1-43fa-ace4-c94910d6b6de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:07.937387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e154eda-47e1-43fa-ace4-c94910d6b6de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:07.937935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4e154eda-47e1-43fa-ace4-c94910d6b6de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:08.198342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4e154eda-47e1-43fa-ace4-c94910d6b6de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:33:08.208481 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4e154eda-47e1-43fa-ace4-c94910d6b6de tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1690 microversion: 2.1 time: 0.287605 Aug 25 14:33:08.209365 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3615/7300] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:33:07 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1690 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:33:09.148400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-29e864a3-1776-4434-9b99-2f2de2af7821 req-f2084f7b-2e3e-4188-94bf-89ef60718eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62a3a59-ac53-4a53-993a-973259c75e3e", "name": "network-vif-plugged", "status": "completed", "tag": "aee05cea-8c3d-4783-bfc8-711464383a72"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:33:09.162787 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-29e864a3-1776-4434-9b99-2f2de2af7821 req-f2084f7b-2e3e-4188-94bf-89ef60718eda service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:09.163360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-29e864a3-1776-4434-9b99-2f2de2af7821 req-f2084f7b-2e3e-4188-94bf-89ef60718eda service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:09.163806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-29e864a3-1776-4434-9b99-2f2de2af7821 req-f2084f7b-2e3e-4188-94bf-89ef60718eda service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:09.177236 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-29e864a3-1776-4434-9b99-2f2de2af7821 req-f2084f7b-2e3e-4188-94bf-89ef60718eda service nova] Creating event network-vif-plugged:aee05cea-8c3d-4783-bfc8-711464383a72 for instance e62a3a59-ac53-4a53-993a-973259c75e3e on n-h2-852771-8 Aug 25 14:33:09.182882 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-29e864a3-1776-4434-9b99-2f2de2af7821 req-f2084f7b-2e3e-4188-94bf-89ef60718eda service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039826 Aug 25 14:33:09.183508 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3686/7301] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:33:09.233132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dc04d0fe-ccf8-421c-aa91-87125c6e3409 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:33:09.234438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dc04d0fe-ccf8-421c-aa91-87125c6e3409 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:09.242132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc04d0fe-ccf8-421c-aa91-87125c6e3409 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:09.242656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc04d0fe-ccf8-421c-aa91-87125c6e3409 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:09.243230 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc04d0fe-ccf8-421c-aa91-87125c6e3409 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:09.243930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc04d0fe-ccf8-421c-aa91-87125c6e3409 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:09.244363 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc04d0fe-ccf8-421c-aa91-87125c6e3409 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:09.244810 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dc04d0fe-ccf8-421c-aa91-87125c6e3409 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:09.271167 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:33:09.414726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dc04d0fe-ccf8-421c-aa91-87125c6e3409 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:33:09.422168 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dc04d0fe-ccf8-421c-aa91-87125c6e3409 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1682 microversion: 2.1 time: 0.193002 Aug 25 14:33:09.422762 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3616/7302] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:33:09 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:33:39.669632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=28 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:33:39.670386 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=78 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:33:39.675172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b2d00e9a-249f-494d-912f-dbe03d8a1107 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:33:39.677470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b2d00e9a-249f-494d-912f-dbe03d8a1107 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:33:39.684602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d00e9a-249f-494d-912f-dbe03d8a1107 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:39.685094 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d00e9a-249f-494d-912f-dbe03d8a1107 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:39.685562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d00e9a-249f-494d-912f-dbe03d8a1107 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:39.686278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d00e9a-249f-494d-912f-dbe03d8a1107 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:33:39.686740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d00e9a-249f-494d-912f-dbe03d8a1107 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:33:39.687174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b2d00e9a-249f-494d-912f-dbe03d8a1107 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:33:39.748168 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b2d00e9a-249f-494d-912f-dbe03d8a1107 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e/action" status: 200 len: 24581 microversion: 2.1 time: 0.080685 Aug 25 14:33:39.748873 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3687/7303] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:33:39 2022] POST /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e/action => generated 24581 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:34:03.339747 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a411631c-e991-4c25-9439-bb04444bb6d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:03.340340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a411631c-e991-4c25-9439-bb04444bb6d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:03.343551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-e8dc80a6-6f85-4321-8fae-3092e240ff96 req-31ec381a-6772-4f05-89bb-d0f3da1e5994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e62a3a59-ac53-4a53-993a-973259c75e3e", "tag": "aee05cea-8c3d-4783-bfc8-711464383a72"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:03.344658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=34 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:03.346191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:03.352186 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:03.353400 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a411631c-e991-4c25-9439-bb04444bb6d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:03.353582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:03.353688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a411631c-e991-4c25-9439-bb04444bb6d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:03.353918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a411631c-e991-4c25-9439-bb04444bb6d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:03.355181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a411631c-e991-4c25-9439-bb04444bb6d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:03.355181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a411631c-e991-4c25-9439-bb04444bb6d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:03.355572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a411631c-e991-4c25-9439-bb04444bb6d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:03.364199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e8dc80a6-6f85-4321-8fae-3092e240ff96 req-31ec381a-6772-4f05-89bb-d0f3da1e5994 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:03.364786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e8dc80a6-6f85-4321-8fae-3092e240ff96 req-31ec381a-6772-4f05-89bb-d0f3da1e5994 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:03.365295 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e8dc80a6-6f85-4321-8fae-3092e240ff96 req-31ec381a-6772-4f05-89bb-d0f3da1e5994 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:03.382194 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-e8dc80a6-6f85-4321-8fae-3092e240ff96 req-31ec381a-6772-4f05-89bb-d0f3da1e5994 service nova] Creating event network-changed:aee05cea-8c3d-4783-bfc8-711464383a72 for instance e62a3a59-ac53-4a53-993a-973259c75e3e on n-h2-852771-8 Aug 25 14:34:03.385243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a411631c-e991-4c25-9439-bb04444bb6d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:34:03.388844 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-e8dc80a6-6f85-4321-8fae-3092e240ff96 req-31ec381a-6772-4f05-89bb-d0f3da1e5994 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049465 Aug 25 14:34:03.389764 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3688/7304] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:34:03.479920 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a411631c-e991-4c25-9439-bb04444bb6d5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 204 len: 0 microversion: 2.1 time: 0.144891 Aug 25 14:34:03.483694 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3617/7305] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:34:03 2022] DELETE /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:34:03.491074 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-067ad89a-82b2-4c20-99e3-dcacc800c306 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:03.492117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-067ad89a-82b2-4c20-99e3-dcacc800c306 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:03.500798 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-067ad89a-82b2-4c20-99e3-dcacc800c306 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:03.501865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-067ad89a-82b2-4c20-99e3-dcacc800c306 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:03.502418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-067ad89a-82b2-4c20-99e3-dcacc800c306 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:03.503551 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-067ad89a-82b2-4c20-99e3-dcacc800c306 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:03.505227 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-067ad89a-82b2-4c20-99e3-dcacc800c306 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:03.505760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-067ad89a-82b2-4c20-99e3-dcacc800c306 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:03.722618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-067ad89a-82b2-4c20-99e3-dcacc800c306 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:03.731132 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-067ad89a-82b2-4c20-99e3-dcacc800c306 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1688 microversion: 2.1 time: 0.245816 Aug 25 14:34:03.731724 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3689/7306] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:03 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1688 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:04.754681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c33c4fca-94a8-4ef9-ada7-2173d6db5556 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:04.755387 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c33c4fca-94a8-4ef9-ada7-2173d6db5556 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:04.762441 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c33c4fca-94a8-4ef9-ada7-2173d6db5556 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:04.762933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c33c4fca-94a8-4ef9-ada7-2173d6db5556 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:04.763382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c33c4fca-94a8-4ef9-ada7-2173d6db5556 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:04.764089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c33c4fca-94a8-4ef9-ada7-2173d6db5556 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:04.764555 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c33c4fca-94a8-4ef9-ada7-2173d6db5556 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:04.764992 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c33c4fca-94a8-4ef9-ada7-2173d6db5556 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:04.953048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c33c4fca-94a8-4ef9-ada7-2173d6db5556 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:04.962840 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c33c4fca-94a8-4ef9-ada7-2173d6db5556 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1688 microversion: 2.1 time: 0.213543 Aug 25 14:34:04.963435 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3618/7307] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:04 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:05.984435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:05.985209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:05.993470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-915d210f-48d3-4397-826c-166ff1da826c req-4c76ba8a-b5c7-4696-865c-2b5087520108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62a3a59-ac53-4a53-993a-973259c75e3e", "name": "network-vif-deleted", "tag": "aee05cea-8c3d-4783-bfc8-711464383a72"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:05.995767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:05.996672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:05.997495 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:05.998677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:05.999771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:06.000790 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:06.007044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-915d210f-48d3-4397-826c-166ff1da826c req-4c76ba8a-b5c7-4696-865c-2b5087520108 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:06.007638 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-915d210f-48d3-4397-826c-166ff1da826c req-4c76ba8a-b5c7-4696-865c-2b5087520108 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:06.008212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-915d210f-48d3-4397-826c-166ff1da826c req-4c76ba8a-b5c7-4696-865c-2b5087520108 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:06.023801 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-915d210f-48d3-4397-826c-166ff1da826c req-4c76ba8a-b5c7-4696-865c-2b5087520108 service nova] Creating event network-vif-deleted:aee05cea-8c3d-4783-bfc8-711464383a72 for instance e62a3a59-ac53-4a53-993a-973259c75e3e on n-h2-852771-8 Aug 25 14:34:06.029901 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-915d210f-48d3-4397-826c-166ff1da826c req-4c76ba8a-b5c7-4696-865c-2b5087520108 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101480 Aug 25 14:34:06.030989 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3690/7308] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:34:06.045681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:06.046560 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:06.047375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:06.048985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lazy-loading 'fault' on Instance uuid e62a3a59-ac53-4a53-993a-973259c75e3e {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:34:06.101479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:06.111947 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2dfc843b-c63c-4ad9-a248-58ec26ce143c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 200 len: 1357 microversion: 2.1 time: 0.131281 Aug 25 14:34:06.112545 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3619/7309] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:05 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 1357 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:34:07.134188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:07.134876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: e62a3a59-ac53-4a53-993a-973259c75e3e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:07.142517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:07.143002 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:07.143437 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:07.144126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:07.144578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:07.145000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:07.158324 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] HTTP exception thrown: Instance e62a3a59-ac53-4a53-993a-973259c75e3e could not be found. Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Request method failure captured: Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e HTTP/1.1 Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4ads787rgq8t_jXmCTThfVv_kx769QvsW0MZ5tgMODzur0SDWAIYOH4pIE-_yPODKVbrbR0vLAnucf1TpxwL9SGUUa4KpluqsaQKeUsjztYGimEh53QDn1xz-52racGejJeUo3vbBLFEjoLVxrRFo6BBPPQiwzlOMWsONyqJ9sbwfQ Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 275f24feb3574af5b9b8a60107ccf118 Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/275f24feb3574af5b9b8a60107ccf118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_275f24feb3574af5b9b8a60107ccf118", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/275f24feb3574af5b9b8a60107ccf118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/275f24feb3574af5b9b8a60107ccf118"}]}] Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 275f24feb3574af5b9b8a60107ccf118 Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestNetworkAdvancedServerOps-1026450561-project Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 03e4ee8ca9ab458ab9fe9657e08aec5a Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1026450561-project Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance e62a3a59-ac53-4a53-993a-973259c75e3e could not be found. Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'e62a3a59-ac53-4a53-993a-973259c75e3e'} Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62a3a59-ac53-4a53-993a-973259c75e3e could not be found. Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62a3a59-ac53-4a53-993a-973259c75e3e could not be found. Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:34:07.159944 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62a3a59-ac53-4a53-993a-973259c75e3e could not be found. Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Returning 404 to user: Instance e62a3a59-ac53-4a53-993a-973259c75e3e could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-064beb57-e9f2-4030-a6ae-c40875b65f77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e" status: 404 len: 111 microversion: 2.1 time: 0.031461 Aug 25 14:34:07.165125 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3691/7310] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:07 2022] GET /compute/v2.1/servers/e62a3a59-ac53-4a53-993a-973259c75e3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:34:10.272755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1f72c531-6bb6-4698-96d1-08c776d3a71e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '.version_select at 0x7f3a2a1f3f70>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:10.283730 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1f72c531-6bb6-4698-96d1-08c776d3a71e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:34:11.293212 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [None req-1f72c531-6bb6-4698-96d1-08c776d3a71e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 58708. Aug 25 14:34:11.319525 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1f72c531-6bb6-4698-96d1-08c776d3a71e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1363965675" status: 202 len: 0 microversion: 2.1 time: 1.050736 Aug 25 14:34:11.320136 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3620/7311] 10.222.0.70 () {58 vars in 1284 bytes} [Thu Aug 25 14:34:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1363965675 => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:34:11.350145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-722367ed-ddce-4762-b491-98136788ae87 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'create', calling method: .version_select at 0x7f3a292f49d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-541739764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJMCcOPrSd7w57ESH6ey6xUvT1mxA7NLbxmzO3jSjTJp6u4WtMH25ehexu2jwnRJQCnGhkRF8ia1v4Oswt44ijvOWrC+I67WQSWIJvshDHQ3PLEGAjjW6CuRfEYnAGI8g=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:11.367648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-722367ed-ddce-4762-b491-98136788ae87 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for project 275f24feb3574af5b9b8a60107ccf118. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:34:11.372765 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-722367ed-ddce-4762-b491-98136788ae87 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for user 03e4ee8ca9ab458ab9fe9657e08aec5a and project 275f24feb3574af5b9b8a60107ccf118. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:34:11.404748 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-722367ed-ddce-4762-b491-98136788ae87 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.058536 Aug 25 14:34:11.405476 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3692/7312] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:34:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:34:17.509623 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:17.513893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-727780744", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "774daea8-9fe0-4342-b61d-417a71deb355"}], "key_name": "tempest-TestNetworkAdvancedServerOps-541739764", "security_groups": [{"name": "tempest-secgroup-smoke-1661858704"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:17.680773 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] validate_networks() for [('774daea8-9fe0-4342-b61d-417a71deb355', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:34:18.120417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:34:18.120978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:34:18.121334 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:34:18.121792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:34:18.122232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:34:18.133638 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:18.134147 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:18.134603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:18.135355 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:18.135842 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:18.136264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:18.163486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for project 275f24feb3574af5b9b8a60107ccf118. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:34:18.174847 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for user 03e4ee8ca9ab458ab9fe9657e08aec5a and project 275f24feb3574af5b9b8a60107ccf118. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:34:18.190552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:34:18.192918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:34:18.252405 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0393e6ca-18de-467c-be11-0dc078728d77 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744488 Aug 25 14:34:18.253077 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3621/7313] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:34:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 14:34:18.267353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=12 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:18.274440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cacff24d-1961-4640-b59d-b91c68b79b4a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:18.275078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cacff24d-1961-4640-b59d-b91c68b79b4a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:18.340562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cacff24d-1961-4640-b59d-b91c68b79b4a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:18.349321 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cacff24d-1961-4640-b59d-b91c68b79b4a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1265 microversion: 2.1 time: 0.088211 Aug 25 14:34:18.355354 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3693/7314] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:18 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:19.377885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a9ff3907-d693-4a61-a698-f61248dc3c06 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:19.378535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a9ff3907-d693-4a61-a698-f61248dc3c06 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:19.393763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9ff3907-d693-4a61-a698-f61248dc3c06 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:19.397484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9ff3907-d693-4a61-a698-f61248dc3c06 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:19.398034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9ff3907-d693-4a61-a698-f61248dc3c06 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:19.398822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9ff3907-d693-4a61-a698-f61248dc3c06 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:19.399513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9ff3907-d693-4a61-a698-f61248dc3c06 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:19.399970 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a9ff3907-d693-4a61-a698-f61248dc3c06 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:19.506829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a9ff3907-d693-4a61-a698-f61248dc3c06 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:19.514694 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a9ff3907-d693-4a61-a698-f61248dc3c06 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1325 microversion: 2.1 time: 0.147101 Aug 25 14:34:19.515293 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3622/7315] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:19 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1325 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:20.537353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df65743d-ac6a-45df-9a3c-069893746e79 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:20.538799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-df65743d-ac6a-45df-9a3c-069893746e79 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:20.546930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df65743d-ac6a-45df-9a3c-069893746e79 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:20.548365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df65743d-ac6a-45df-9a3c-069893746e79 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:20.549902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df65743d-ac6a-45df-9a3c-069893746e79 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:20.551097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df65743d-ac6a-45df-9a3c-069893746e79 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:20.551858 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df65743d-ac6a-45df-9a3c-069893746e79 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:20.552712 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df65743d-ac6a-45df-9a3c-069893746e79 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:20.809269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df65743d-ac6a-45df-9a3c-069893746e79 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:20.818514 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-df65743d-ac6a-45df-9a3c-069893746e79 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1391 microversion: 2.1 time: 0.285391 Aug 25 14:34:20.826298 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3694/7316] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:20 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:21.123782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-e038b9ce-b1d3-4396-ae08-742a13620721 req-4455f3e9-1ed3-4c0a-a323-ef19f5f6939a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69eb6b38-cfd7-4fac-a80b-87bca2a13513", "tag": "70a90232-d5da-491c-8384-69af9fbf9b2c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:21.135711 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e038b9ce-b1d3-4396-ae08-742a13620721 req-4455f3e9-1ed3-4c0a-a323-ef19f5f6939a service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:21.136510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e038b9ce-b1d3-4396-ae08-742a13620721 req-4455f3e9-1ed3-4c0a-a323-ef19f5f6939a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:21.136972 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e038b9ce-b1d3-4396-ae08-742a13620721 req-4455f3e9-1ed3-4c0a-a323-ef19f5f6939a service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:21.150984 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-e038b9ce-b1d3-4396-ae08-742a13620721 req-4455f3e9-1ed3-4c0a-a323-ef19f5f6939a service nova] Creating event network-changed:70a90232-d5da-491c-8384-69af9fbf9b2c for instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 on n-h1-852771-8 Aug 25 14:34:21.156369 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-e038b9ce-b1d3-4396-ae08-742a13620721 req-4455f3e9-1ed3-4c0a-a323-ef19f5f6939a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036594 Aug 25 14:34:21.157846 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3623/7317] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:34:21.840620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a52e6ec3-4eb7-446f-90ba-ca8ae4c9303b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:21.841359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a52e6ec3-4eb7-446f-90ba-ca8ae4c9303b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:21.850169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52e6ec3-4eb7-446f-90ba-ca8ae4c9303b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:21.850670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52e6ec3-4eb7-446f-90ba-ca8ae4c9303b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:21.851111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52e6ec3-4eb7-446f-90ba-ca8ae4c9303b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:21.851842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52e6ec3-4eb7-446f-90ba-ca8ae4c9303b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:21.852305 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52e6ec3-4eb7-446f-90ba-ca8ae4c9303b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:21.852739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a52e6ec3-4eb7-446f-90ba-ca8ae4c9303b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:22.063970 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a52e6ec3-4eb7-446f-90ba-ca8ae4c9303b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:22.073005 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a52e6ec3-4eb7-446f-90ba-ca8ae4c9303b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1391 microversion: 2.1 time: 0.236410 Aug 25 14:34:22.074599 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3695/7318] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:21 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:23.098204 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-06acdf5a-f0ac-4ba6-af81-725e00388c53 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:23.098928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-06acdf5a-f0ac-4ba6-af81-725e00388c53 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:23.106134 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06acdf5a-f0ac-4ba6-af81-725e00388c53 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:23.106637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06acdf5a-f0ac-4ba6-af81-725e00388c53 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:23.107094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06acdf5a-f0ac-4ba6-af81-725e00388c53 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:23.107846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06acdf5a-f0ac-4ba6-af81-725e00388c53 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:23.108324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06acdf5a-f0ac-4ba6-af81-725e00388c53 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:23.108774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-06acdf5a-f0ac-4ba6-af81-725e00388c53 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:23.247612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-06acdf5a-f0ac-4ba6-af81-725e00388c53 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:23.255951 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-06acdf5a-f0ac-4ba6-af81-725e00388c53 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1391 microversion: 2.1 time: 0.163514 Aug 25 14:34:23.256532 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3624/7319] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:23 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:24.279518 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0b5f338d-fa30-4cd0-a913-5005b08d3501 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:24.279943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0b5f338d-fa30-4cd0-a913-5005b08d3501 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:24.288225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b5f338d-fa30-4cd0-a913-5005b08d3501 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:24.288729 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b5f338d-fa30-4cd0-a913-5005b08d3501 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:24.289127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b5f338d-fa30-4cd0-a913-5005b08d3501 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:24.289861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b5f338d-fa30-4cd0-a913-5005b08d3501 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:24.290317 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b5f338d-fa30-4cd0-a913-5005b08d3501 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:24.290743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0b5f338d-fa30-4cd0-a913-5005b08d3501 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:24.450861 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0b5f338d-fa30-4cd0-a913-5005b08d3501 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:24.459948 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0b5f338d-fa30-4cd0-a913-5005b08d3501 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1391 microversion: 2.1 time: 0.185689 Aug 25 14:34:24.460563 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3696/7320] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:24 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1391 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:25.481707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6331db23-b73d-49ed-9cf8-710c64317c70 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:25.482337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6331db23-b73d-49ed-9cf8-710c64317c70 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:25.490034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6331db23-b73d-49ed-9cf8-710c64317c70 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:25.490549 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6331db23-b73d-49ed-9cf8-710c64317c70 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:25.490998 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6331db23-b73d-49ed-9cf8-710c64317c70 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:25.491724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6331db23-b73d-49ed-9cf8-710c64317c70 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:25.492195 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6331db23-b73d-49ed-9cf8-710c64317c70 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:25.492643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6331db23-b73d-49ed-9cf8-710c64317c70 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:25.634369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6331db23-b73d-49ed-9cf8-710c64317c70 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:25.643311 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6331db23-b73d-49ed-9cf8-710c64317c70 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1391 microversion: 2.1 time: 0.165444 Aug 25 14:34:25.643923 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3625/7321] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:25 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:34:26.664713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3a83ef7d-54bc-4217-8c20-a58aefe7933e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:26.665410 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3a83ef7d-54bc-4217-8c20-a58aefe7933e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:26.673663 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a83ef7d-54bc-4217-8c20-a58aefe7933e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:26.674371 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a83ef7d-54bc-4217-8c20-a58aefe7933e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:26.674813 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a83ef7d-54bc-4217-8c20-a58aefe7933e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:26.675527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a83ef7d-54bc-4217-8c20-a58aefe7933e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:26.676012 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a83ef7d-54bc-4217-8c20-a58aefe7933e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:26.676434 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3a83ef7d-54bc-4217-8c20-a58aefe7933e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:26.845516 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3a83ef7d-54bc-4217-8c20-a58aefe7933e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:26.854792 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3a83ef7d-54bc-4217-8c20-a58aefe7933e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1391 microversion: 2.1 time: 0.193863 Aug 25 14:34:26.855621 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3697/7322] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:26 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:27.875180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f4726179-b376-4737-b8ba-ff685949cae3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:27.876526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f4726179-b376-4737-b8ba-ff685949cae3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:27.884667 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4726179-b376-4737-b8ba-ff685949cae3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:27.885320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4726179-b376-4737-b8ba-ff685949cae3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:27.885919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4726179-b376-4737-b8ba-ff685949cae3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:27.886771 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4726179-b376-4737-b8ba-ff685949cae3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:27.887504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4726179-b376-4737-b8ba-ff685949cae3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:27.888150 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f4726179-b376-4737-b8ba-ff685949cae3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:28.046162 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f4726179-b376-4737-b8ba-ff685949cae3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:28.055925 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f4726179-b376-4737-b8ba-ff685949cae3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1391 microversion: 2.1 time: 0.184622 Aug 25 14:34:28.056534 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3626/7323] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:27 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:28.728587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:28.787438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9f6d5eaf-d7a1-4872-8951-b74a6bc09a5a req-c7f9ed9a-12b9-454c-b982-aaa899395ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69eb6b38-cfd7-4fac-a80b-87bca2a13513", "name": "network-vif-plugged", "status": "completed", "tag": "70a90232-d5da-491c-8384-69af9fbf9b2c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:28.798394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9f6d5eaf-d7a1-4872-8951-b74a6bc09a5a req-c7f9ed9a-12b9-454c-b982-aaa899395ce1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:28.798933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9f6d5eaf-d7a1-4872-8951-b74a6bc09a5a req-c7f9ed9a-12b9-454c-b982-aaa899395ce1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:28.799366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9f6d5eaf-d7a1-4872-8951-b74a6bc09a5a req-c7f9ed9a-12b9-454c-b982-aaa899395ce1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:28.811775 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9f6d5eaf-d7a1-4872-8951-b74a6bc09a5a req-c7f9ed9a-12b9-454c-b982-aaa899395ce1 service nova] Creating event network-vif-plugged:70a90232-d5da-491c-8384-69af9fbf9b2c for instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 on n-h1-852771-8 Aug 25 14:34:28.817672 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9f6d5eaf-d7a1-4872-8951-b74a6bc09a5a req-c7f9ed9a-12b9-454c-b982-aaa899395ce1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094366 Aug 25 14:34:28.818438 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3698/7324] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:34:29.082304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-217ab06b-064d-4236-9776-66fdef558841 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:29.082918 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-217ab06b-064d-4236-9776-66fdef558841 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:29.085059 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:29.085774 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:29.092787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-217ab06b-064d-4236-9776-66fdef558841 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:29.093301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-217ab06b-064d-4236-9776-66fdef558841 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:29.093789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-217ab06b-064d-4236-9776-66fdef558841 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:29.094536 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-217ab06b-064d-4236-9776-66fdef558841 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:29.095012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-217ab06b-064d-4236-9776-66fdef558841 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:29.095454 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-217ab06b-064d-4236-9776-66fdef558841 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:29.237769 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-217ab06b-064d-4236-9776-66fdef558841 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:29.245829 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-217ab06b-064d-4236-9776-66fdef558841 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1391 microversion: 2.1 time: 0.168889 Aug 25 14:34:29.253317 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3627/7325] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:29 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:30.270199 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad5a9c6b-8f11-4a71-b4e9-666c1b082f7e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:30.270911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad5a9c6b-8f11-4a71-b4e9-666c1b082f7e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:30.277360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5a9c6b-8f11-4a71-b4e9-666c1b082f7e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:30.277895 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5a9c6b-8f11-4a71-b4e9-666c1b082f7e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:30.278346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5a9c6b-8f11-4a71-b4e9-666c1b082f7e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:30.279057 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5a9c6b-8f11-4a71-b4e9-666c1b082f7e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:30.279511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5a9c6b-8f11-4a71-b4e9-666c1b082f7e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:30.279936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad5a9c6b-8f11-4a71-b4e9-666c1b082f7e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:30.441998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ad5a9c6b-8f11-4a71-b4e9-666c1b082f7e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:30.454475 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad5a9c6b-8f11-4a71-b4e9-666c1b082f7e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1391 microversion: 2.1 time: 0.189523 Aug 25 14:34:30.456294 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3699/7326] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:30 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1391 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:31.478320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-577c8e0c-f46a-4024-82ca-b6c69e4e7776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:31.478941 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-577c8e0c-f46a-4024-82ca-b6c69e4e7776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:31.486048 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-577c8e0c-f46a-4024-82ca-b6c69e4e7776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:31.486547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-577c8e0c-f46a-4024-82ca-b6c69e4e7776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:31.487006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-577c8e0c-f46a-4024-82ca-b6c69e4e7776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:31.487725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-577c8e0c-f46a-4024-82ca-b6c69e4e7776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:31.488191 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-577c8e0c-f46a-4024-82ca-b6c69e4e7776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:31.489087 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-577c8e0c-f46a-4024-82ca-b6c69e4e7776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:31.636045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-577c8e0c-f46a-4024-82ca-b6c69e4e7776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:31.645884 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-577c8e0c-f46a-4024-82ca-b6c69e4e7776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1563 microversion: 2.1 time: 0.171380 Aug 25 14:34:31.646522 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3628/7327] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:31 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:31.667266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-add9162f-655a-4071-9e34-918c21e7d34d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:31.667930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-add9162f-655a-4071-9e34-918c21e7d34d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:31.676562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-add9162f-655a-4071-9e34-918c21e7d34d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:31.677214 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-add9162f-655a-4071-9e34-918c21e7d34d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:31.677491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-add9162f-655a-4071-9e34-918c21e7d34d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:31.678252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-add9162f-655a-4071-9e34-918c21e7d34d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:31.678711 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-add9162f-655a-4071-9e34-918c21e7d34d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:31.679141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-add9162f-655a-4071-9e34-918c21e7d34d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:31.833624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-add9162f-655a-4071-9e34-918c21e7d34d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:31.842534 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-add9162f-655a-4071-9e34-918c21e7d34d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1563 microversion: 2.1 time: 0.179067 Aug 25 14:34:31.843043 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3700/7328] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:31 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:33.950395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-01df62ef-68e0-41f4-9381-6268739d69e9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:33.951037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-01df62ef-68e0-41f4-9381-6268739d69e9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:33.952452 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-76cb1528-493b-46c3-bb39-bd23bfe961a6 req-839573be-f0fe-4160-907b-354e41d43dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69eb6b38-cfd7-4fac-a80b-87bca2a13513", "tag": "70a90232-d5da-491c-8384-69af9fbf9b2c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:33.955279 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:33.960606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:33.960806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01df62ef-68e0-41f4-9381-6268739d69e9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:33.961316 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01df62ef-68e0-41f4-9381-6268739d69e9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:33.961945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01df62ef-68e0-41f4-9381-6268739d69e9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:33.962553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01df62ef-68e0-41f4-9381-6268739d69e9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:33.963724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01df62ef-68e0-41f4-9381-6268739d69e9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:33.963724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01df62ef-68e0-41f4-9381-6268739d69e9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:33.970408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-76cb1528-493b-46c3-bb39-bd23bfe961a6 req-839573be-f0fe-4160-907b-354e41d43dcc service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:33.971063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-76cb1528-493b-46c3-bb39-bd23bfe961a6 req-839573be-f0fe-4160-907b-354e41d43dcc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:33.971648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-76cb1528-493b-46c3-bb39-bd23bfe961a6 req-839573be-f0fe-4160-907b-354e41d43dcc service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:33.986421 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-76cb1528-493b-46c3-bb39-bd23bfe961a6 req-839573be-f0fe-4160-907b-354e41d43dcc service nova] Creating event network-changed:70a90232-d5da-491c-8384-69af9fbf9b2c for instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 on n-h1-852771-8 Aug 25 14:34:33.995070 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-76cb1528-493b-46c3-bb39-bd23bfe961a6 req-839573be-f0fe-4160-907b-354e41d43dcc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046265 Aug 25 14:34:33.995807 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3701/7329] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:34:34.210149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-01df62ef-68e0-41f4-9381-6268739d69e9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:34.218149 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-01df62ef-68e0-41f4-9381-6268739d69e9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1681 microversion: 2.1 time: 0.272120 Aug 25 14:34:34.219014 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3629/7330] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:33 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1681 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:35:07.525554 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f148e9a-0d3b-4b90-8d41-8626311cf21b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:35:07.527892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f148e9a-0d3b-4b90-8d41-8626311cf21b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:07.530184 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:35:07.530832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=40 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:35:07.537680 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f148e9a-0d3b-4b90-8d41-8626311cf21b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:07.538379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f148e9a-0d3b-4b90-8d41-8626311cf21b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:07.538817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f148e9a-0d3b-4b90-8d41-8626311cf21b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:07.539542 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f148e9a-0d3b-4b90-8d41-8626311cf21b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:07.539997 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f148e9a-0d3b-4b90-8d41-8626311cf21b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:07.540421 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f148e9a-0d3b-4b90-8d41-8626311cf21b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:07.610499 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f148e9a-0d3b-4b90-8d41-8626311cf21b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513/action" status: 200 len: 24574 microversion: 2.1 time: 0.090056 Aug 25 14:35:07.611183 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3702/7331] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:35:07 2022] POST /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513/action => generated 24574 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:35:38.045277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:35:38.046584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=46 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:35:38.053746 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9e8cda66-97c9-4732-81cc-7fb9d5e20dba tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:35:38.065430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e8cda66-97c9-4732-81cc-7fb9d5e20dba tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:38.066238 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e8cda66-97c9-4732-81cc-7fb9d5e20dba tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:38.067033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9e8cda66-97c9-4732-81cc-7fb9d5e20dba tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:38.106034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9e8cda66-97c9-4732-81cc-7fb9d5e20dba tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Going to try to stop instance {{(pid=129059) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 14:35:38.166090 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9e8cda66-97c9-4732-81cc-7fb9d5e20dba tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513/action" status: 202 len: 0 microversion: 2.1 time: 0.123437 Aug 25 14:35:38.166947 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3630/7332] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:35:38 2022] POST /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:35:38.176747 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-657800b6-86b6-4d37-8b69-a094f742ca73 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:38.177652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-657800b6-86b6-4d37-8b69-a094f742ca73 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:38.182425 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:35:38.183188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:35:38.190058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-657800b6-86b6-4d37-8b69-a094f742ca73 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:38.190935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-657800b6-86b6-4d37-8b69-a094f742ca73 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:38.191415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-657800b6-86b6-4d37-8b69-a094f742ca73 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:38.192344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-657800b6-86b6-4d37-8b69-a094f742ca73 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:38.192850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-657800b6-86b6-4d37-8b69-a094f742ca73 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:38.193280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-657800b6-86b6-4d37-8b69-a094f742ca73 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:38.571078 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-657800b6-86b6-4d37-8b69-a094f742ca73 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:38.581330 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-657800b6-86b6-4d37-8b69-a094f742ca73 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1691 microversion: 2.1 time: 0.409181 Aug 25 14:35:38.581986 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3703/7333] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:38 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1691 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:35:39.609567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-abda2e43-18fa-4caf-abc3-72a05daf5df9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:39.610287 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-abda2e43-18fa-4caf-abc3-72a05daf5df9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:39.616615 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abda2e43-18fa-4caf-abc3-72a05daf5df9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:39.617804 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abda2e43-18fa-4caf-abc3-72a05daf5df9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:39.618332 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abda2e43-18fa-4caf-abc3-72a05daf5df9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:39.619140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abda2e43-18fa-4caf-abc3-72a05daf5df9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:39.619676 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abda2e43-18fa-4caf-abc3-72a05daf5df9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:39.620137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abda2e43-18fa-4caf-abc3-72a05daf5df9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:39.931502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-abda2e43-18fa-4caf-abc3-72a05daf5df9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:39.939934 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-abda2e43-18fa-4caf-abc3-72a05daf5df9 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1691 microversion: 2.1 time: 0.335673 Aug 25 14:35:39.940534 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3631/7334] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:39 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1691 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:35:40.963097 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e2ddb3cc-80c9-41d4-b33f-16906db48c9b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:40.963716 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e2ddb3cc-80c9-41d4-b33f-16906db48c9b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:40.974942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ddb3cc-80c9-41d4-b33f-16906db48c9b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:40.975442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ddb3cc-80c9-41d4-b33f-16906db48c9b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:40.975892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ddb3cc-80c9-41d4-b33f-16906db48c9b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:40.976616 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ddb3cc-80c9-41d4-b33f-16906db48c9b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:40.977085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ddb3cc-80c9-41d4-b33f-16906db48c9b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:40.977533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e2ddb3cc-80c9-41d4-b33f-16906db48c9b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:41.126497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e2ddb3cc-80c9-41d4-b33f-16906db48c9b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:41.135953 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e2ddb3cc-80c9-41d4-b33f-16906db48c9b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1691 microversion: 2.1 time: 0.177133 Aug 25 14:35:41.136584 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3704/7335] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:40 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:35:42.162708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3d666082-17a2-4412-b0aa-2891788d8cb7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:42.163589 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3d666082-17a2-4412-b0aa-2891788d8cb7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:42.171084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d666082-17a2-4412-b0aa-2891788d8cb7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:42.171593 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d666082-17a2-4412-b0aa-2891788d8cb7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:42.172052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d666082-17a2-4412-b0aa-2891788d8cb7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:42.172784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d666082-17a2-4412-b0aa-2891788d8cb7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:42.173254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d666082-17a2-4412-b0aa-2891788d8cb7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:42.173738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3d666082-17a2-4412-b0aa-2891788d8cb7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:42.332031 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3d666082-17a2-4412-b0aa-2891788d8cb7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:42.342898 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3d666082-17a2-4412-b0aa-2891788d8cb7 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1691 microversion: 2.1 time: 0.187262 Aug 25 14:35:42.343731 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3632/7336] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:42 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:35:43.366140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b5573222-1059-4c0f-87c2-c5adbc9e886f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:43.367062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b5573222-1059-4c0f-87c2-c5adbc9e886f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:43.374418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5573222-1059-4c0f-87c2-c5adbc9e886f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:43.374925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5573222-1059-4c0f-87c2-c5adbc9e886f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:43.375378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5573222-1059-4c0f-87c2-c5adbc9e886f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:43.376122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5573222-1059-4c0f-87c2-c5adbc9e886f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:43.376623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5573222-1059-4c0f-87c2-c5adbc9e886f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:43.377090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b5573222-1059-4c0f-87c2-c5adbc9e886f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:43.533158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b5573222-1059-4c0f-87c2-c5adbc9e886f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:43.542243 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b5573222-1059-4c0f-87c2-c5adbc9e886f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1691 microversion: 2.1 time: 0.180263 Aug 25 14:35:43.543039 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3705/7337] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:43 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:35:44.569681 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f5c4c3b-f005-407c-8685-8160938246cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:44.570301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f5c4c3b-f005-407c-8685-8160938246cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:44.579346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5c4c3b-f005-407c-8685-8160938246cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:44.580035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5c4c3b-f005-407c-8685-8160938246cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:44.580799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5c4c3b-f005-407c-8685-8160938246cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:44.581690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5c4c3b-f005-407c-8685-8160938246cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:44.582242 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5c4c3b-f005-407c-8685-8160938246cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:44.582724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5c4c3b-f005-407c-8685-8160938246cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:44.729925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2f5c4c3b-f005-407c-8685-8160938246cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:44.737957 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f5c4c3b-f005-407c-8685-8160938246cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1691 microversion: 2.1 time: 0.172611 Aug 25 14:35:44.738550 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3633/7338] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:44 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:35:45.761924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f55c54f-2fe4-4034-b114-515eae62c311 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:45.762637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3f55c54f-2fe4-4034-b114-515eae62c311 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:45.769823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f55c54f-2fe4-4034-b114-515eae62c311 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:45.770316 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f55c54f-2fe4-4034-b114-515eae62c311 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:45.770761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f55c54f-2fe4-4034-b114-515eae62c311 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:45.771479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f55c54f-2fe4-4034-b114-515eae62c311 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:45.771935 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f55c54f-2fe4-4034-b114-515eae62c311 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:45.772363 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3f55c54f-2fe4-4034-b114-515eae62c311 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:45.927823 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3f55c54f-2fe4-4034-b114-515eae62c311 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:45.937061 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f55c54f-2fe4-4034-b114-515eae62c311 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1691 microversion: 2.1 time: 0.179067 Aug 25 14:35:45.937837 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3706/7339] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:45 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:35:46.960772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5852b865-749b-4ecf-a518-4991fb0844ed tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:46.961862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5852b865-749b-4ecf-a518-4991fb0844ed tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:46.969098 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5852b865-749b-4ecf-a518-4991fb0844ed tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:46.969627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5852b865-749b-4ecf-a518-4991fb0844ed tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:46.970081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5852b865-749b-4ecf-a518-4991fb0844ed tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:46.970807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5852b865-749b-4ecf-a518-4991fb0844ed tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:46.971274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5852b865-749b-4ecf-a518-4991fb0844ed tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:46.971714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5852b865-749b-4ecf-a518-4991fb0844ed tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:47.131096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5852b865-749b-4ecf-a518-4991fb0844ed tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:47.140660 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5852b865-749b-4ecf-a518-4991fb0844ed tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1691 microversion: 2.1 time: 0.184158 Aug 25 14:35:47.141274 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3634/7340] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:46 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:35:48.164467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-9896def2-4545-4b0d-81df-fda0b0ee90d6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:48.165153 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-9896def2-4545-4b0d-81df-fda0b0ee90d6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:48.172446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9896def2-4545-4b0d-81df-fda0b0ee90d6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:48.173033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9896def2-4545-4b0d-81df-fda0b0ee90d6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:48.173477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9896def2-4545-4b0d-81df-fda0b0ee90d6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:48.174228 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9896def2-4545-4b0d-81df-fda0b0ee90d6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:48.174726 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9896def2-4545-4b0d-81df-fda0b0ee90d6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:48.175152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-9896def2-4545-4b0d-81df-fda0b0ee90d6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:48.323924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-9896def2-4545-4b0d-81df-fda0b0ee90d6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:48.336845 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-9896def2-4545-4b0d-81df-fda0b0ee90d6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1691 microversion: 2.1 time: 0.177746 Aug 25 14:35:48.337498 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3707/7341] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:48 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:35:49.360494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59a5585c-5346-4e7a-9b28-6802eca8718b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:49.361194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59a5585c-5346-4e7a-9b28-6802eca8718b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:49.369535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a5585c-5346-4e7a-9b28-6802eca8718b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:49.370066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a5585c-5346-4e7a-9b28-6802eca8718b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:49.370526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a5585c-5346-4e7a-9b28-6802eca8718b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:49.371256 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a5585c-5346-4e7a-9b28-6802eca8718b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:49.371727 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a5585c-5346-4e7a-9b28-6802eca8718b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:49.372171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59a5585c-5346-4e7a-9b28-6802eca8718b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:49.530269 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-59a5585c-5346-4e7a-9b28-6802eca8718b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:49.538197 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59a5585c-5346-4e7a-9b28-6802eca8718b tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1668 microversion: 2.1 time: 0.182670 Aug 25 14:35:49.538883 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3635/7342] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:49 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1668 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:35:50.636382 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-79b859c8-5d45-44e1-bf0c-d8896676b9c5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:35:50.638692 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-79b859c8-5d45-44e1-bf0c-d8896676b9c5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:50.646196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79b859c8-5d45-44e1-bf0c-d8896676b9c5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:50.646703 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79b859c8-5d45-44e1-bf0c-d8896676b9c5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:50.647152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79b859c8-5d45-44e1-bf0c-d8896676b9c5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:50.647908 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79b859c8-5d45-44e1-bf0c-d8896676b9c5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:50.648361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79b859c8-5d45-44e1-bf0c-d8896676b9c5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:50.648933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-79b859c8-5d45-44e1-bf0c-d8896676b9c5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:50.713803 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-79b859c8-5d45-44e1-bf0c-d8896676b9c5 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513/action" status: 200 len: 37944 microversion: 2.1 time: 0.081860 Aug 25 14:35:50.714760 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3708/7343] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:35:50 2022] POST /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513/action => generated 37944 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:35:50.727057 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-27137c62-3918-4c34-8a85-4f89e56d98b4 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:35:50.734914 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27137c62-3918-4c34-8a85-4f89e56d98b4 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:50.735430 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27137c62-3918-4c34-8a85-4f89e56d98b4 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:50.735893 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-27137c62-3918-4c34-8a85-4f89e56d98b4 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:50.760705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-27137c62-3918-4c34-8a85-4f89e56d98b4 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Going to try to start instance {{(pid=129059) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 14:35:50.810763 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-27137c62-3918-4c34-8a85-4f89e56d98b4 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513/action" status: 202 len: 0 microversion: 2.1 time: 0.087818 Aug 25 14:35:50.811413 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3636/7344] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:35:50 2022] POST /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:35:50.822296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c4b34b94-8b8d-426b-927a-8a7045db5a28 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:50.823224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c4b34b94-8b8d-426b-927a-8a7045db5a28 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:50.835961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4b34b94-8b8d-426b-927a-8a7045db5a28 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:50.836720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4b34b94-8b8d-426b-927a-8a7045db5a28 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:50.837571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4b34b94-8b8d-426b-927a-8a7045db5a28 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:50.838848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4b34b94-8b8d-426b-927a-8a7045db5a28 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:50.841285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4b34b94-8b8d-426b-927a-8a7045db5a28 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:50.841285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c4b34b94-8b8d-426b-927a-8a7045db5a28 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:51.014453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c4b34b94-8b8d-426b-927a-8a7045db5a28 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:51.023669 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c4b34b94-8b8d-426b-927a-8a7045db5a28 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1677 microversion: 2.1 time: 0.206556 Aug 25 14:35:51.024268 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3709/7345] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:50 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:35:52.047276 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c37a8ce4-9f7c-48c9-b18d-088d3ed150bc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:52.048130 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c37a8ce4-9f7c-48c9-b18d-088d3ed150bc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:52.055714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c37a8ce4-9f7c-48c9-b18d-088d3ed150bc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:52.056220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c37a8ce4-9f7c-48c9-b18d-088d3ed150bc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:52.056677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c37a8ce4-9f7c-48c9-b18d-088d3ed150bc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:52.057416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c37a8ce4-9f7c-48c9-b18d-088d3ed150bc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:52.057926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c37a8ce4-9f7c-48c9-b18d-088d3ed150bc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:52.058370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c37a8ce4-9f7c-48c9-b18d-088d3ed150bc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:52.240733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c37a8ce4-9f7c-48c9-b18d-088d3ed150bc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:52.250275 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c37a8ce4-9f7c-48c9-b18d-088d3ed150bc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1677 microversion: 2.1 time: 0.208017 Aug 25 14:35:52.250806 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3637/7346] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:52 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:35:53.278916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c508b556-7f1a-4ae2-bbf3-b7574d5c4776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:35:53.279892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c508b556-7f1a-4ae2-bbf3-b7574d5c4776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:35:53.287832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c508b556-7f1a-4ae2-bbf3-b7574d5c4776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:53.288869 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c508b556-7f1a-4ae2-bbf3-b7574d5c4776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:53.289494 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c508b556-7f1a-4ae2-bbf3-b7574d5c4776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:53.290380 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c508b556-7f1a-4ae2-bbf3-b7574d5c4776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:35:53.290836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c508b556-7f1a-4ae2-bbf3-b7574d5c4776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:35:53.291270 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c508b556-7f1a-4ae2-bbf3-b7574d5c4776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:35:53.438760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c508b556-7f1a-4ae2-bbf3-b7574d5c4776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:35:53.453844 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c508b556-7f1a-4ae2-bbf3-b7574d5c4776 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1681 microversion: 2.1 time: 0.180042 Aug 25 14:35:53.454545 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3710/7347] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:35:53 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:25.694548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d587e325-a5e0-44b8-aa02-f0e08cc74a2f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:25.697296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d587e325-a5e0-44b8-aa02-f0e08cc74a2f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:25.700199 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=16 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:25.700907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:25.702551 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 25 14:36:25.705177 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 25 14:36:25.715370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d587e325-a5e0-44b8-aa02-f0e08cc74a2f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:25.716017 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d587e325-a5e0-44b8-aa02-f0e08cc74a2f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:25.716504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d587e325-a5e0-44b8-aa02-f0e08cc74a2f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:25.717291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d587e325-a5e0-44b8-aa02-f0e08cc74a2f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:25.717801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d587e325-a5e0-44b8-aa02-f0e08cc74a2f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:25.718295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d587e325-a5e0-44b8-aa02-f0e08cc74a2f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:25.795341 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d587e325-a5e0-44b8-aa02-f0e08cc74a2f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513/action" status: 200 len: 62500 microversion: 2.1 time: 0.105096 Aug 25 14:36:25.796031 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3638/7348] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:36:25 2022] POST /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513/action => generated 62500 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 14:36:43.106137 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-41468771-be4d-4bad-ad45-2e490f261090 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:43.106709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-41468771-be4d-4bad-ad45-2e490f261090 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:43.110929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=16 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:43.111834 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=46 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:43.119495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41468771-be4d-4bad-ad45-2e490f261090 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:43.119954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41468771-be4d-4bad-ad45-2e490f261090 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:43.120953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41468771-be4d-4bad-ad45-2e490f261090 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:43.121099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41468771-be4d-4bad-ad45-2e490f261090 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:43.121624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41468771-be4d-4bad-ad45-2e490f261090 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:43.122053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41468771-be4d-4bad-ad45-2e490f261090 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:43.151931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-41468771-be4d-4bad-ad45-2e490f261090 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:36:43.252950 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-41468771-be4d-4bad-ad45-2e490f261090 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "DELETE /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 204 len: 0 microversion: 2.1 time: 0.151089 Aug 25 14:36:43.254405 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3711/7349] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:36:43 2022] DELETE /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:36:43.254822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:43.256795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:43.267361 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-effd2e3c-0fcb-47f6-87c9-edcb036ac677 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:43.268477 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-effd2e3c-0fcb-47f6-87c9-edcb036ac677 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:43.276428 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-effd2e3c-0fcb-47f6-87c9-edcb036ac677 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:43.277132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-effd2e3c-0fcb-47f6-87c9-edcb036ac677 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:43.277796 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-effd2e3c-0fcb-47f6-87c9-edcb036ac677 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:43.278611 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-effd2e3c-0fcb-47f6-87c9-edcb036ac677 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:43.279182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-effd2e3c-0fcb-47f6-87c9-edcb036ac677 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:43.279719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-effd2e3c-0fcb-47f6-87c9-edcb036ac677 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:43.318350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-5bdac419-1078-472d-a722-7ec62e05c6dc req-fb787499-f677-4a96-b97a-a140e3eec79f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69eb6b38-cfd7-4fac-a80b-87bca2a13513", "tag": "70a90232-d5da-491c-8384-69af9fbf9b2c"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:43.331193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5bdac419-1078-472d-a722-7ec62e05c6dc req-fb787499-f677-4a96-b97a-a140e3eec79f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:43.331949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5bdac419-1078-472d-a722-7ec62e05c6dc req-fb787499-f677-4a96-b97a-a140e3eec79f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:43.332415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-5bdac419-1078-472d-a722-7ec62e05c6dc req-fb787499-f677-4a96-b97a-a140e3eec79f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:43.345728 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-5bdac419-1078-472d-a722-7ec62e05c6dc req-fb787499-f677-4a96-b97a-a140e3eec79f service nova] Creating event network-changed:70a90232-d5da-491c-8384-69af9fbf9b2c for instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 on n-h1-852771-8 Aug 25 14:36:43.351392 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-5bdac419-1078-472d-a722-7ec62e05c6dc req-fb787499-f677-4a96-b97a-a140e3eec79f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106958 Aug 25 14:36:43.352231 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3639/7350] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:36:43.437558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-effd2e3c-0fcb-47f6-87c9-edcb036ac677 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:43.446629 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-effd2e3c-0fcb-47f6-87c9-edcb036ac677 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1687 microversion: 2.1 time: 0.185659 Aug 25 14:36:43.447262 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3712/7351] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:43 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:44.472119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c69872f-37a4-408c-a5ec-1f77609255bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:44.472873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9c69872f-37a4-408c-a5ec-1f77609255bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:44.481425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c69872f-37a4-408c-a5ec-1f77609255bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:44.481958 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c69872f-37a4-408c-a5ec-1f77609255bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:44.482416 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c69872f-37a4-408c-a5ec-1f77609255bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:44.483154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c69872f-37a4-408c-a5ec-1f77609255bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:44.483626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c69872f-37a4-408c-a5ec-1f77609255bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:44.484073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c69872f-37a4-408c-a5ec-1f77609255bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:44.671314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9c69872f-37a4-408c-a5ec-1f77609255bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:44.681228 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c69872f-37a4-408c-a5ec-1f77609255bb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1687 microversion: 2.1 time: 0.213319 Aug 25 14:36:44.682198 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3640/7352] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:44 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1687 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:45.705211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:45.706567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:45.718833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:45.719425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:45.719907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:45.720684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:45.721214 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:45.721699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:45.735240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-d17365b6-0cff-4c83-8a83-3fa23d5b64e9 req-86b71636-17d6-484d-b056-ca3e028d25a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69eb6b38-cfd7-4fac-a80b-87bca2a13513", "name": "network-vif-deleted", "tag": "70a90232-d5da-491c-8384-69af9fbf9b2c"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:45.747876 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d17365b6-0cff-4c83-8a83-3fa23d5b64e9 req-86b71636-17d6-484d-b056-ca3e028d25a6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:45.748538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d17365b6-0cff-4c83-8a83-3fa23d5b64e9 req-86b71636-17d6-484d-b056-ca3e028d25a6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:45.749297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-d17365b6-0cff-4c83-8a83-3fa23d5b64e9 req-86b71636-17d6-484d-b056-ca3e028d25a6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:45.763603 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-d17365b6-0cff-4c83-8a83-3fa23d5b64e9 req-86b71636-17d6-484d-b056-ca3e028d25a6 service nova] Creating event network-vif-deleted:70a90232-d5da-491c-8384-69af9fbf9b2c for instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 on n-h1-852771-8 Aug 25 14:36:45.770752 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-d17365b6-0cff-4c83-8a83-3fa23d5b64e9 req-86b71636-17d6-484d-b056-ca3e028d25a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118934 Aug 25 14:36:45.772535 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3713/7353] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:36:45.779034 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:45.780069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:45.781063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:45.782336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lazy-loading 'fault' on Instance uuid 69eb6b38-cfd7-4fac-a80b-87bca2a13513 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:36:45.845829 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:45.857578 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1b9f9b85-12f8-4afb-842a-730a0bb959fb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 200 len: 1355 microversion: 2.1 time: 0.156076 Aug 25 14:36:45.858680 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3641/7354] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:45 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 1355 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:46.882368 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:46.883873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 69eb6b38-cfd7-4fac-a80b-87bca2a13513] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:46.890819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:46.891310 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:46.891754 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:46.892467 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:46.892923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:46.893353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:46.907534 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] HTTP exception thrown: Instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 could not be found. Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Request method failure captured: Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 HTTP/1.1 Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4ads787rgq8t_jXmCTThfVv_kx769QvsW0MZ5tgMODzur0SDWAIYOH4pIE-_yPODKVbrbR0vLAnucf1TpxwL9SGUUa4KpluqsaQKeUsjztYGimEh53QDn1xz-52racGejJeUo3vbBLFEjoLVxrRFo6BBPPQiwzlOMWsONyqJ9sbwfQ Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 275f24feb3574af5b9b8a60107ccf118 Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/275f24feb3574af5b9b8a60107ccf118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_275f24feb3574af5b9b8a60107ccf118", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/275f24feb3574af5b9b8a60107ccf118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/275f24feb3574af5b9b8a60107ccf118"}]}] Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 275f24feb3574af5b9b8a60107ccf118 Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestNetworkAdvancedServerOps-1026450561-project Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 03e4ee8ca9ab458ab9fe9657e08aec5a Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1026450561-project Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 could not be found. Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '69eb6b38-cfd7-4fac-a80b-87bca2a13513'} Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 could not be found. Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 could not be found. Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:36:46.909123 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 could not be found. Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Returning 404 to user: Instance 69eb6b38-cfd7-4fac-a80b-87bca2a13513 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-561ffded-9900-43c5-ae99-d5422b71649f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513" status: 404 len: 111 microversion: 2.1 time: 0.033573 Aug 25 14:36:46.914278 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3714/7355] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:46 2022] GET /compute/v2.1/servers/69eb6b38-cfd7-4fac-a80b-87bca2a13513 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:36:50.408137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-40f98b9e-9d07-4bdb-93be-168bc501c984 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '.version_select at 0x7f3a29191dc0>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:50.439742 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-40f98b9e-9d07-4bdb-93be-168bc501c984 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-541739764" status: 202 len: 0 microversion: 2.1 time: 0.036666 Aug 25 14:36:50.440516 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3642/7356] 10.222.0.70 () {58 vars in 1281 bytes} [Thu Aug 25 14:36:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-541739764 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:36:50.478179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3f4dbf09-30a5-46ed-8644-7260b5a0c96e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'create', calling method: .version_select at 0x7f3a29274ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-350340643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsL1ilKN2eujcrBG/d9L/B1VJCujR7ip+ph4DYbds8UgzdbJKLckNTrJ4bysIoS7IMU0tbipZ2CBmv9Jvn66fuK8k/Xo/sbB6UW2jsbcYg4InMANJeCSQ9GdtxLYaj+5A=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:50.504168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-3f4dbf09-30a5-46ed-8644-7260b5a0c96e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for project 275f24feb3574af5b9b8a60107ccf118. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:36:50.520848 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-3f4dbf09-30a5-46ed-8644-7260b5a0c96e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for user 03e4ee8ca9ab458ab9fe9657e08aec5a and project 275f24feb3574af5b9b8a60107ccf118. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:36:50.535671 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3f4dbf09-30a5-46ed-8644-7260b5a0c96e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:36:51.544304 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [None req-3f4dbf09-30a5-46ed-8644-7260b5a0c96e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [f1f445c4-03d6-46e1-bf67-74fbf163ff22] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 58942. Aug 25 14:36:51.560288 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3f4dbf09-30a5-46ed-8644-7260b5a0c96e tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.086909 Aug 25 14:36:51.560975 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3715/7357] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:36:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:36:57.486516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=16 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:57.491787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1588784578", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "networks": [{"uuid": "7a596e67-caf8-48dd-b474-86027f53a604"}], "key_name": "tempest-TestNetworkAdvancedServerOps-350340643", "security_groups": [{"name": "tempest-secgroup-smoke-992660883"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:57.614211 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] validate_networks() for [('7a596e67-caf8-48dd-b474-86027f53a604', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:36:58.072518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:36:58.072963 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:36:58.073456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:36:58.074078 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:36:58.074903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:36:58.087516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:58.088280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:58.088920 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:58.090117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:58.090789 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:58.092268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:58.118814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for project 275f24feb3574af5b9b8a60107ccf118. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:36:58.126007 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Getting quotas for user 03e4ee8ca9ab458ab9fe9657e08aec5a and project 275f24feb3574af5b9b8a60107ccf118. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:36:58.142033 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:36:58.144836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:36:58.220178 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2f5bc987-bf79-4888-8a18-4f54ebf5dff3 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.735742 Aug 25 14:36:58.220906 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3643/7358] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:36:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:36:58.230927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:58.235999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4e56215f-b7ba-4bec-9c43-23b2ce9949db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:58.237053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4e56215f-b7ba-4bec-9c43-23b2ce9949db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:58.364418 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4e56215f-b7ba-4bec-9c43-23b2ce9949db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:58.381729 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4e56215f-b7ba-4bec-9c43-23b2ce9949db tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1266 microversion: 2.1 time: 0.152263 Aug 25 14:36:58.383170 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3716/7359] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:58 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:36:59.405875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6962fd55-5019-4511-bd30-ec6dc1e068cf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:59.406624 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6962fd55-5019-4511-bd30-ec6dc1e068cf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:59.414629 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6962fd55-5019-4511-bd30-ec6dc1e068cf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:59.415235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6962fd55-5019-4511-bd30-ec6dc1e068cf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:59.415772 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6962fd55-5019-4511-bd30-ec6dc1e068cf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:59.416586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6962fd55-5019-4511-bd30-ec6dc1e068cf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:59.417137 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6962fd55-5019-4511-bd30-ec6dc1e068cf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:59.417708 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6962fd55-5019-4511-bd30-ec6dc1e068cf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:59.491724 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6962fd55-5019-4511-bd30-ec6dc1e068cf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:59.501693 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6962fd55-5019-4511-bd30-ec6dc1e068cf tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1318 microversion: 2.1 time: 0.100989 Aug 25 14:36:59.512974 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3644/7360] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:59 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1318 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:37:00.532179 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-caf850d6-6556-4f21-98b8-0fefb3c32abb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:00.532835 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-caf850d6-6556-4f21-98b8-0fefb3c32abb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:00.541821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caf850d6-6556-4f21-98b8-0fefb3c32abb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:00.542329 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caf850d6-6556-4f21-98b8-0fefb3c32abb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:00.542782 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caf850d6-6556-4f21-98b8-0fefb3c32abb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:00.543507 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caf850d6-6556-4f21-98b8-0fefb3c32abb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:00.543973 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caf850d6-6556-4f21-98b8-0fefb3c32abb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:00.546083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-caf850d6-6556-4f21-98b8-0fefb3c32abb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:00.801944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-caf850d6-6556-4f21-98b8-0fefb3c32abb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:00.810898 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-caf850d6-6556-4f21-98b8-0fefb3c32abb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1391 microversion: 2.1 time: 0.290649 Aug 25 14:37:00.811840 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3717/7361] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:00 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1391 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:37:01.292158 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2430962d-78de-4798-842b-c4f6f2c06b4d req-6cead2c9-57cb-4c0d-9f64-64c88e479ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6477f833-896c-4782-bc78-5bf3fe585dd8", "tag": "89dc4936-c526-4856-8973-5c1ab5b794bb"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:37:01.304429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2430962d-78de-4798-842b-c4f6f2c06b4d req-6cead2c9-57cb-4c0d-9f64-64c88e479ae4 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:01.305944 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2430962d-78de-4798-842b-c4f6f2c06b4d req-6cead2c9-57cb-4c0d-9f64-64c88e479ae4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:01.306412 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2430962d-78de-4798-842b-c4f6f2c06b4d req-6cead2c9-57cb-4c0d-9f64-64c88e479ae4 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:01.318952 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2430962d-78de-4798-842b-c4f6f2c06b4d req-6cead2c9-57cb-4c0d-9f64-64c88e479ae4 service nova] Creating event network-changed:89dc4936-c526-4856-8973-5c1ab5b794bb for instance 6477f833-896c-4782-bc78-5bf3fe585dd8 on n-h1-852771-8 Aug 25 14:37:01.326338 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2430962d-78de-4798-842b-c4f6f2c06b4d req-6cead2c9-57cb-4c0d-9f64-64c88e479ae4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038322 Aug 25 14:37:01.327404 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3645/7362] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:37:01.833926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0bd505f6-98f1-42a9-97ab-582385581126 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:01.834571 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0bd505f6-98f1-42a9-97ab-582385581126 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:01.842135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bd505f6-98f1-42a9-97ab-582385581126 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:01.842612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bd505f6-98f1-42a9-97ab-582385581126 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:01.843047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bd505f6-98f1-42a9-97ab-582385581126 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:01.843806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bd505f6-98f1-42a9-97ab-582385581126 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:01.844263 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bd505f6-98f1-42a9-97ab-582385581126 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:01.844689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0bd505f6-98f1-42a9-97ab-582385581126 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:01.987037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0bd505f6-98f1-42a9-97ab-582385581126 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:01.995894 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0bd505f6-98f1-42a9-97ab-582385581126 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1391 microversion: 2.1 time: 0.166073 Aug 25 14:37:01.996431 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3718/7363] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:01 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:37:03.018013 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e708dc25-6e15-44a2-af8f-96e2695207cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:03.018717 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e708dc25-6e15-44a2-af8f-96e2695207cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:03.025831 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e708dc25-6e15-44a2-af8f-96e2695207cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:03.026327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e708dc25-6e15-44a2-af8f-96e2695207cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:03.026781 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e708dc25-6e15-44a2-af8f-96e2695207cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:03.027503 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e708dc25-6e15-44a2-af8f-96e2695207cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:03.027971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e708dc25-6e15-44a2-af8f-96e2695207cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:03.028411 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e708dc25-6e15-44a2-af8f-96e2695207cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:03.170086 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e708dc25-6e15-44a2-af8f-96e2695207cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:03.177902 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e708dc25-6e15-44a2-af8f-96e2695207cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1391 microversion: 2.1 time: 0.165046 Aug 25 14:37:03.178504 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3646/7364] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:03 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:37:04.199958 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a075d24e-856a-4bcc-9db1-c760a68849cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:04.200746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a075d24e-856a-4bcc-9db1-c760a68849cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:04.208172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a075d24e-856a-4bcc-9db1-c760a68849cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:04.208652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a075d24e-856a-4bcc-9db1-c760a68849cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:04.209090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a075d24e-856a-4bcc-9db1-c760a68849cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:04.209815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a075d24e-856a-4bcc-9db1-c760a68849cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:04.210298 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a075d24e-856a-4bcc-9db1-c760a68849cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:04.210720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a075d24e-856a-4bcc-9db1-c760a68849cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:04.360788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a075d24e-856a-4bcc-9db1-c760a68849cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:04.371068 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a075d24e-856a-4bcc-9db1-c760a68849cb tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1391 microversion: 2.1 time: 0.175537 Aug 25 14:37:04.371659 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3719/7365] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:04 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:37:05.392350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-59636d2d-c1b3-4392-8290-7595fbdd60cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:05.393042 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-59636d2d-c1b3-4392-8290-7595fbdd60cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:05.400395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59636d2d-c1b3-4392-8290-7595fbdd60cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:05.400903 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59636d2d-c1b3-4392-8290-7595fbdd60cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:05.401370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59636d2d-c1b3-4392-8290-7595fbdd60cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:05.402133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59636d2d-c1b3-4392-8290-7595fbdd60cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:05.403050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59636d2d-c1b3-4392-8290-7595fbdd60cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:05.403050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-59636d2d-c1b3-4392-8290-7595fbdd60cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:05.539779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-59636d2d-c1b3-4392-8290-7595fbdd60cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:05.548205 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-59636d2d-c1b3-4392-8290-7595fbdd60cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1391 microversion: 2.1 time: 0.159763 Aug 25 14:37:05.548788 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3647/7366] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:05 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:37:06.569439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-22e799a1-16db-4765-ab31-b90552daeba0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:06.570084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-22e799a1-16db-4765-ab31-b90552daeba0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:06.577893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e799a1-16db-4765-ab31-b90552daeba0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:06.578384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e799a1-16db-4765-ab31-b90552daeba0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:06.578828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e799a1-16db-4765-ab31-b90552daeba0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:06.579533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e799a1-16db-4765-ab31-b90552daeba0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:06.580055 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e799a1-16db-4765-ab31-b90552daeba0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:06.580420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-22e799a1-16db-4765-ab31-b90552daeba0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:06.723892 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-22e799a1-16db-4765-ab31-b90552daeba0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:06.732055 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-22e799a1-16db-4765-ab31-b90552daeba0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1391 microversion: 2.1 time: 0.166445 Aug 25 14:37:06.732637 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3720/7367] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:06 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:37:07.465929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-16f91fca-64eb-4409-ae30-8026bd15c7fc req-33c42ef3-5444-4ad5-b8c7-b012cbaa79cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6477f833-896c-4782-bc78-5bf3fe585dd8", "name": "network-vif-plugged", "status": "completed", "tag": "89dc4936-c526-4856-8973-5c1ab5b794bb"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:37:07.475437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-16f91fca-64eb-4409-ae30-8026bd15c7fc req-33c42ef3-5444-4ad5-b8c7-b012cbaa79cf service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:07.475924 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-16f91fca-64eb-4409-ae30-8026bd15c7fc req-33c42ef3-5444-4ad5-b8c7-b012cbaa79cf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:07.476376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-16f91fca-64eb-4409-ae30-8026bd15c7fc req-33c42ef3-5444-4ad5-b8c7-b012cbaa79cf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:07.487705 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-16f91fca-64eb-4409-ae30-8026bd15c7fc req-33c42ef3-5444-4ad5-b8c7-b012cbaa79cf service nova] Creating event network-vif-plugged:89dc4936-c526-4856-8973-5c1ab5b794bb for instance 6477f833-896c-4782-bc78-5bf3fe585dd8 on n-h1-852771-8 Aug 25 14:37:07.492718 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-16f91fca-64eb-4409-ae30-8026bd15c7fc req-33c42ef3-5444-4ad5-b8c7-b012cbaa79cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087603 Aug 25 14:37:07.494070 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3648/7368] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:37:07.754254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-46f016e1-506e-4cd0-8b60-62848770d97c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:07.754803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-46f016e1-506e-4cd0-8b60-62848770d97c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:07.761965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46f016e1-506e-4cd0-8b60-62848770d97c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:07.762460 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46f016e1-506e-4cd0-8b60-62848770d97c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:07.762909 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46f016e1-506e-4cd0-8b60-62848770d97c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:07.763615 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46f016e1-506e-4cd0-8b60-62848770d97c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:07.764082 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46f016e1-506e-4cd0-8b60-62848770d97c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:07.764512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-46f016e1-506e-4cd0-8b60-62848770d97c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:07.901164 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-46f016e1-506e-4cd0-8b60-62848770d97c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:07.909093 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-46f016e1-506e-4cd0-8b60-62848770d97c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1391 microversion: 2.1 time: 0.158911 Aug 25 14:37:07.909700 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3721/7369] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:07 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:37:08.927946 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:37:08.928758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:37:08.934422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3a1b2e35-aadb-4d3b-be13-32f92e672e64 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:08.935369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3a1b2e35-aadb-4d3b-be13-32f92e672e64 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:08.942229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a1b2e35-aadb-4d3b-be13-32f92e672e64 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:08.942733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a1b2e35-aadb-4d3b-be13-32f92e672e64 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:08.943192 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a1b2e35-aadb-4d3b-be13-32f92e672e64 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:08.943907 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a1b2e35-aadb-4d3b-be13-32f92e672e64 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:08.944374 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a1b2e35-aadb-4d3b-be13-32f92e672e64 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:08.944818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3a1b2e35-aadb-4d3b-be13-32f92e672e64 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:09.096273 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3a1b2e35-aadb-4d3b-be13-32f92e672e64 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:09.105195 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3a1b2e35-aadb-4d3b-be13-32f92e672e64 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1391 microversion: 2.1 time: 0.177624 Aug 25 14:37:09.105838 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3649/7370] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:08 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:37:10.127215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ab3aa58a-a296-468e-bb56-1f352b45f860 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:10.127820 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ab3aa58a-a296-468e-bb56-1f352b45f860 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:10.129896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:37:10.136790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab3aa58a-a296-468e-bb56-1f352b45f860 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:10.137285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab3aa58a-a296-468e-bb56-1f352b45f860 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:10.137759 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab3aa58a-a296-468e-bb56-1f352b45f860 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:10.138478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab3aa58a-a296-468e-bb56-1f352b45f860 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:10.138940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab3aa58a-a296-468e-bb56-1f352b45f860 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:10.139379 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ab3aa58a-a296-468e-bb56-1f352b45f860 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:10.282315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ab3aa58a-a296-468e-bb56-1f352b45f860 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:10.290448 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ab3aa58a-a296-468e-bb56-1f352b45f860 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1562 microversion: 2.1 time: 0.167270 Aug 25 14:37:10.291044 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3722/7371] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:10 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:37:10.311752 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ba999ff9-ec36-44f9-8755-3883eb838c1d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:10.312376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ba999ff9-ec36-44f9-8755-3883eb838c1d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:10.319311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba999ff9-ec36-44f9-8755-3883eb838c1d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:10.319800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba999ff9-ec36-44f9-8755-3883eb838c1d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:10.320255 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba999ff9-ec36-44f9-8755-3883eb838c1d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:10.320957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba999ff9-ec36-44f9-8755-3883eb838c1d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:10.321421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba999ff9-ec36-44f9-8755-3883eb838c1d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:10.321880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ba999ff9-ec36-44f9-8755-3883eb838c1d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:10.458480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ba999ff9-ec36-44f9-8755-3883eb838c1d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:10.467687 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ba999ff9-ec36-44f9-8755-3883eb838c1d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1562 microversion: 2.1 time: 0.159868 Aug 25 14:37:10.468299 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3650/7372] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:10 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:37:12.468656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1c9b7e14-0ad4-4c99-bda1-6f0bf6329ffc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:37:12.470203 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1c9b7e14-0ad4-4c99-bda1-6f0bf6329ffc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:12.470741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-95d4bd77-3bba-472d-9d1e-6eb626ab8071 req-f4e495d6-6e3c-4eeb-b4d7-726db6f90957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6477f833-896c-4782-bc78-5bf3fe585dd8", "tag": "89dc4936-c526-4856-8973-5c1ab5b794bb"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:37:12.477095 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c9b7e14-0ad4-4c99-bda1-6f0bf6329ffc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:12.477882 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c9b7e14-0ad4-4c99-bda1-6f0bf6329ffc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:12.478330 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c9b7e14-0ad4-4c99-bda1-6f0bf6329ffc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:12.479117 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c9b7e14-0ad4-4c99-bda1-6f0bf6329ffc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:12.479783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c9b7e14-0ad4-4c99-bda1-6f0bf6329ffc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:12.480256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1c9b7e14-0ad4-4c99-bda1-6f0bf6329ffc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:12.482429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-95d4bd77-3bba-472d-9d1e-6eb626ab8071 req-f4e495d6-6e3c-4eeb-b4d7-726db6f90957 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:12.482994 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-95d4bd77-3bba-472d-9d1e-6eb626ab8071 req-f4e495d6-6e3c-4eeb-b4d7-726db6f90957 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:12.483725 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-95d4bd77-3bba-472d-9d1e-6eb626ab8071 req-f4e495d6-6e3c-4eeb-b4d7-726db6f90957 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:12.496286 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-95d4bd77-3bba-472d-9d1e-6eb626ab8071 req-f4e495d6-6e3c-4eeb-b4d7-726db6f90957 service nova] Creating event network-changed:89dc4936-c526-4856-8973-5c1ab5b794bb for instance 6477f833-896c-4782-bc78-5bf3fe585dd8 on n-h1-852771-8 Aug 25 14:37:12.502014 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-95d4bd77-3bba-472d-9d1e-6eb626ab8071 req-f4e495d6-6e3c-4eeb-b4d7-726db6f90957 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035142 Aug 25 14:37:12.503261 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3651/7373] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:37:12.639741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1c9b7e14-0ad4-4c99-bda1-6f0bf6329ffc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:37:12.653627 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1c9b7e14-0ad4-4c99-bda1-6f0bf6329ffc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1562 microversion: 2.1 time: 0.189549 Aug 25 14:37:12.663796 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3723/7374] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:37:12 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1562 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:37:43.958834 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:37:43.959660 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=38 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:37:43.964121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f0856da0-aa71-462a-a42b-a5eb703bda00 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:37:43.967107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f0856da0-aa71-462a-a42b-a5eb703bda00 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:37:43.975840 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0856da0-aa71-462a-a42b-a5eb703bda00 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:43.976353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0856da0-aa71-462a-a42b-a5eb703bda00 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:43.976809 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0856da0-aa71-462a-a42b-a5eb703bda00 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:43.977652 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0856da0-aa71-462a-a42b-a5eb703bda00 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:37:43.978073 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0856da0-aa71-462a-a42b-a5eb703bda00 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:37:43.978513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f0856da0-aa71-462a-a42b-a5eb703bda00 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:37:44.056051 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f0856da0-aa71-462a-a42b-a5eb703bda00 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action" status: 200 len: 24570 microversion: 2.1 time: 0.099039 Aug 25 14:37:44.056756 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3652/7375] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:37:43 2022] POST /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action => generated 24570 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:38:14.489473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:14.490175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=42 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:14.491208 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:38:14.491350 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:38:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action (ip 10.222.0.70) !!! Aug 25 14:38:14.496758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-004b2003-4e73-48c4-8e32-2239e4c23eff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:14.497285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-004b2003-4e73-48c4-8e32-2239e4c23eff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:14.506445 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-004b2003-4e73-48c4-8e32-2239e4c23eff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:14.506922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-004b2003-4e73-48c4-8e32-2239e4c23eff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:14.507353 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-004b2003-4e73-48c4-8e32-2239e4c23eff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:14.508045 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-004b2003-4e73-48c4-8e32-2239e4c23eff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:14.508503 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-004b2003-4e73-48c4-8e32-2239e4c23eff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:14.508922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-004b2003-4e73-48c4-8e32-2239e4c23eff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:14.537938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-004b2003-4e73-48c4-8e32-2239e4c23eff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lazy-loading 'flavor' on Instance uuid 6477f833-896c-4782-bc78-5bf3fe585dd8 {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:38:14.610580 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-004b2003-4e73-48c4-8e32-2239e4c23eff tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action" status: 202 len: 0 microversion: 2.1 time: 0.122830 Aug 25 14:38:14.611239 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3724/7376] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:38:14 2022] POST /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:38:14.623024 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-fb75a816-e748-4f41-a95c-6c198aacee66 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:14.624485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-fb75a816-e748-4f41-a95c-6c198aacee66 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:14.627696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:14.628643 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=4 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:14.646467 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb75a816-e748-4f41-a95c-6c198aacee66 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:14.646978 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb75a816-e748-4f41-a95c-6c198aacee66 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:14.647431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb75a816-e748-4f41-a95c-6c198aacee66 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:14.648176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb75a816-e748-4f41-a95c-6c198aacee66 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:14.648683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb75a816-e748-4f41-a95c-6c198aacee66 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:14.649143 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-fb75a816-e748-4f41-a95c-6c198aacee66 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:14.788611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-fb75a816-e748-4f41-a95c-6c198aacee66 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:14.796868 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-fb75a816-e748-4f41-a95c-6c198aacee66 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1689 microversion: 2.1 time: 0.178895 Aug 25 14:38:14.797448 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3653/7377] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:14 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:38:15.824031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-09e1ed32-39e9-4288-989f-42659e7b4c8f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:15.825328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-09e1ed32-39e9-4288-989f-42659e7b4c8f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:15.836511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09e1ed32-39e9-4288-989f-42659e7b4c8f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:15.837042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09e1ed32-39e9-4288-989f-42659e7b4c8f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:15.837488 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09e1ed32-39e9-4288-989f-42659e7b4c8f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:15.838232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09e1ed32-39e9-4288-989f-42659e7b4c8f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:15.838766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09e1ed32-39e9-4288-989f-42659e7b4c8f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:15.839197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-09e1ed32-39e9-4288-989f-42659e7b4c8f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:16.005475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-09e1ed32-39e9-4288-989f-42659e7b4c8f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:16.013906 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-09e1ed32-39e9-4288-989f-42659e7b4c8f tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1689 microversion: 2.1 time: 0.196992 Aug 25 14:38:16.014503 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3725/7378] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:15 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:17.036021 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-abfaaa00-33bd-428e-8812-47b0f3788fa6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:17.036651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-abfaaa00-33bd-428e-8812-47b0f3788fa6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:17.043922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfaaa00-33bd-428e-8812-47b0f3788fa6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:17.044425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfaaa00-33bd-428e-8812-47b0f3788fa6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:17.044891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfaaa00-33bd-428e-8812-47b0f3788fa6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:17.045649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfaaa00-33bd-428e-8812-47b0f3788fa6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:17.046122 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfaaa00-33bd-428e-8812-47b0f3788fa6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:17.046569 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-abfaaa00-33bd-428e-8812-47b0f3788fa6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:17.179925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-abfaaa00-33bd-428e-8812-47b0f3788fa6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:17.188682 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-abfaaa00-33bd-428e-8812-47b0f3788fa6 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1672 microversion: 2.1 time: 0.156556 Aug 25 14:38:17.189267 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3654/7379] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:17 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:18.286544 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-35eea929-91da-482b-995d-c8d03c73e1ab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:18.288839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-35eea929-91da-482b-995d-c8d03c73e1ab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:18.296478 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35eea929-91da-482b-995d-c8d03c73e1ab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:18.296956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35eea929-91da-482b-995d-c8d03c73e1ab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:18.297389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35eea929-91da-482b-995d-c8d03c73e1ab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:18.298122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35eea929-91da-482b-995d-c8d03c73e1ab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:18.298572 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35eea929-91da-482b-995d-c8d03c73e1ab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:18.298993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-35eea929-91da-482b-995d-c8d03c73e1ab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:18.362354 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-35eea929-91da-482b-995d-c8d03c73e1ab tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action" status: 200 len: 37797 microversion: 2.1 time: 0.079559 Aug 25 14:38:18.363052 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3726/7380] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:38:18 2022] POST /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action => generated 37797 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:38:18.376181 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6a5d7343-f95e-492d-94d9-e83eacfb56ea tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:18.376767 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6a5d7343-f95e-492d-94d9-e83eacfb56ea tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:18.383513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5d7343-f95e-492d-94d9-e83eacfb56ea tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:18.384015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5d7343-f95e-492d-94d9-e83eacfb56ea tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:18.384468 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5d7343-f95e-492d-94d9-e83eacfb56ea tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:18.385791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5d7343-f95e-492d-94d9-e83eacfb56ea tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:18.386275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5d7343-f95e-492d-94d9-e83eacfb56ea tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:18.386723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6a5d7343-f95e-492d-94d9-e83eacfb56ea tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:18.457210 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6a5d7343-f95e-492d-94d9-e83eacfb56ea tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action" status: 202 len: 0 microversion: 2.1 time: 0.084850 Aug 25 14:38:18.457915 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3655/7381] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:38:18 2022] POST /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:38:18.467624 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-70ea6501-316c-4dbb-9bf3-4d7f1ed93ddc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:18.468345 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-70ea6501-316c-4dbb-9bf3-4d7f1ed93ddc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:18.475539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea6501-316c-4dbb-9bf3-4d7f1ed93ddc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:18.476025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea6501-316c-4dbb-9bf3-4d7f1ed93ddc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:18.476464 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea6501-316c-4dbb-9bf3-4d7f1ed93ddc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:18.477165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea6501-316c-4dbb-9bf3-4d7f1ed93ddc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:18.477644 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea6501-316c-4dbb-9bf3-4d7f1ed93ddc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:18.478069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-70ea6501-316c-4dbb-9bf3-4d7f1ed93ddc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:18.618506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-70ea6501-316c-4dbb-9bf3-4d7f1ed93ddc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:18.627395 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-70ea6501-316c-4dbb-9bf3-4d7f1ed93ddc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1678 microversion: 2.1 time: 0.164582 Aug 25 14:38:18.628040 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3727/7382] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:18 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:19.650855 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-f88b3fd2-dcfb-4b0d-9596-75ee1f981207 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:19.651566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-f88b3fd2-dcfb-4b0d-9596-75ee1f981207 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:19.658428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88b3fd2-dcfb-4b0d-9596-75ee1f981207 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:19.658927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88b3fd2-dcfb-4b0d-9596-75ee1f981207 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:19.659375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88b3fd2-dcfb-4b0d-9596-75ee1f981207 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:19.660089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88b3fd2-dcfb-4b0d-9596-75ee1f981207 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:19.660557 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88b3fd2-dcfb-4b0d-9596-75ee1f981207 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:19.660997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-f88b3fd2-dcfb-4b0d-9596-75ee1f981207 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:19.800116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-f88b3fd2-dcfb-4b0d-9596-75ee1f981207 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:19.808195 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-f88b3fd2-dcfb-4b0d-9596-75ee1f981207 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1678 microversion: 2.1 time: 0.162379 Aug 25 14:38:19.809495 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3656/7383] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:19 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:20.830614 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-41fbdbec-5991-446b-9e1d-42021ef318f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:20.831989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-41fbdbec-5991-446b-9e1d-42021ef318f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:20.839953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41fbdbec-5991-446b-9e1d-42021ef318f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:20.840443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41fbdbec-5991-446b-9e1d-42021ef318f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:20.841088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41fbdbec-5991-446b-9e1d-42021ef318f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:20.841836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41fbdbec-5991-446b-9e1d-42021ef318f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:20.842299 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41fbdbec-5991-446b-9e1d-42021ef318f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:20.842731 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-41fbdbec-5991-446b-9e1d-42021ef318f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:20.988493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-41fbdbec-5991-446b-9e1d-42021ef318f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:20.997177 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-41fbdbec-5991-446b-9e1d-42021ef318f0 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1681 microversion: 2.1 time: 0.170675 Aug 25 14:38:20.997811 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3728/7384] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:20 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:21.096304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3e8bd0ba-38ef-485d-abbe-4bae0f64287a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:21.098526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3e8bd0ba-38ef-485d-abbe-4bae0f64287a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:21.105826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e8bd0ba-38ef-485d-abbe-4bae0f64287a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:21.106418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e8bd0ba-38ef-485d-abbe-4bae0f64287a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:21.106871 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e8bd0ba-38ef-485d-abbe-4bae0f64287a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:21.107581 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e8bd0ba-38ef-485d-abbe-4bae0f64287a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:21.108046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e8bd0ba-38ef-485d-abbe-4bae0f64287a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:21.108481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3e8bd0ba-38ef-485d-abbe-4bae0f64287a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:21.177031 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3e8bd0ba-38ef-485d-abbe-4bae0f64287a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "POST /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action" status: 200 len: 37797 microversion: 2.1 time: 0.084360 Aug 25 14:38:21.177734 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3657/7385] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:38:21 2022] POST /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8/action => generated 37797 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:38:22.575103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-cabc38b3-3281-44bc-a643-34a3e8b36aa2 req-e4f1053e-1edc-4d47-9616-aa28167effe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6477f833-896c-4782-bc78-5bf3fe585dd8", "tag": "89dc4936-c526-4856-8973-5c1ab5b794bb"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:22.575788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-66ec5af9-ca60-494d-a16b-dc1fcfb97f9a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:22.576415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66ec5af9-ca60-494d-a16b-dc1fcfb97f9a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:22.584062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66ec5af9-ca60-494d-a16b-dc1fcfb97f9a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:22.584709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66ec5af9-ca60-494d-a16b-dc1fcfb97f9a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:22.585549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66ec5af9-ca60-494d-a16b-dc1fcfb97f9a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:22.586252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66ec5af9-ca60-494d-a16b-dc1fcfb97f9a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:22.586859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66ec5af9-ca60-494d-a16b-dc1fcfb97f9a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:22.587822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-66ec5af9-ca60-494d-a16b-dc1fcfb97f9a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:22.593576 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cabc38b3-3281-44bc-a643-34a3e8b36aa2 req-e4f1053e-1edc-4d47-9616-aa28167effe7 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:22.594084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cabc38b3-3281-44bc-a643-34a3e8b36aa2 req-e4f1053e-1edc-4d47-9616-aa28167effe7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:22.594548 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-cabc38b3-3281-44bc-a643-34a3e8b36aa2 req-e4f1053e-1edc-4d47-9616-aa28167effe7 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:22.608022 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-cabc38b3-3281-44bc-a643-34a3e8b36aa2 req-e4f1053e-1edc-4d47-9616-aa28167effe7 service nova] Creating event network-changed:89dc4936-c526-4856-8973-5c1ab5b794bb for instance 6477f833-896c-4782-bc78-5bf3fe585dd8 on n-h1-852771-8 Aug 25 14:38:22.613175 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-cabc38b3-3281-44bc-a643-34a3e8b36aa2 req-e4f1053e-1edc-4d47-9616-aa28167effe7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042240 Aug 25 14:38:22.613824 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3658/7386] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:38:22.620378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-66ec5af9-ca60-494d-a16b-dc1fcfb97f9a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:38:22.728311 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-66ec5af9-ca60-494d-a16b-dc1fcfb97f9a tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 204 len: 0 microversion: 2.1 time: 0.161799 Aug 25 14:38:22.729436 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3729/7387] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:38:22 2022] DELETE /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:38:22.738801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-814fcd09-7334-4b15-a303-2d0b633dd01c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:22.739527 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-814fcd09-7334-4b15-a303-2d0b633dd01c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:22.747674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-814fcd09-7334-4b15-a303-2d0b633dd01c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:22.748553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-814fcd09-7334-4b15-a303-2d0b633dd01c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:22.749765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-814fcd09-7334-4b15-a303-2d0b633dd01c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:22.750193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-814fcd09-7334-4b15-a303-2d0b633dd01c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:22.750749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-814fcd09-7334-4b15-a303-2d0b633dd01c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:22.751502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-814fcd09-7334-4b15-a303-2d0b633dd01c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:22.900229 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-814fcd09-7334-4b15-a303-2d0b633dd01c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:22.909020 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-814fcd09-7334-4b15-a303-2d0b633dd01c tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1687 microversion: 2.1 time: 0.175197 Aug 25 14:38:22.909646 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3659/7388] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:22 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:23.933211 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d2854251-7fb6-41c0-a387-44ba96eed23d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:23.933950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d2854251-7fb6-41c0-a387-44ba96eed23d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:23.940921 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2854251-7fb6-41c0-a387-44ba96eed23d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:23.941404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2854251-7fb6-41c0-a387-44ba96eed23d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:23.941872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2854251-7fb6-41c0-a387-44ba96eed23d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:23.942583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2854251-7fb6-41c0-a387-44ba96eed23d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:23.943041 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2854251-7fb6-41c0-a387-44ba96eed23d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:23.943473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2854251-7fb6-41c0-a387-44ba96eed23d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:24.090975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d2854251-7fb6-41c0-a387-44ba96eed23d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:24.100672 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d2854251-7fb6-41c0-a387-44ba96eed23d tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1687 microversion: 2.1 time: 0.171296 Aug 25 14:38:24.101377 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3730/7389] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:23 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:25.060292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-e7b43c3f-ec72-401a-b7b9-115742ff56f6 req-3db99c0f-3196-48e4-a4d5-a167f58e4945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6477f833-896c-4782-bc78-5bf3fe585dd8", "name": "network-vif-deleted", "tag": "89dc4936-c526-4856-8973-5c1ab5b794bb"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:25.070993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e7b43c3f-ec72-401a-b7b9-115742ff56f6 req-3db99c0f-3196-48e4-a4d5-a167f58e4945 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:25.071488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e7b43c3f-ec72-401a-b7b9-115742ff56f6 req-3db99c0f-3196-48e4-a4d5-a167f58e4945 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:25.071929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-e7b43c3f-ec72-401a-b7b9-115742ff56f6 req-3db99c0f-3196-48e4-a4d5-a167f58e4945 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:25.085789 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-e7b43c3f-ec72-401a-b7b9-115742ff56f6 req-3db99c0f-3196-48e4-a4d5-a167f58e4945 service nova] Creating event network-vif-deleted:89dc4936-c526-4856-8973-5c1ab5b794bb for instance 6477f833-896c-4782-bc78-5bf3fe585dd8 on n-h1-852771-8 Aug 25 14:38:25.092096 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-e7b43c3f-ec72-401a-b7b9-115742ff56f6 req-3db99c0f-3196-48e4-a4d5-a167f58e4945 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036679 Aug 25 14:38:25.092725 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3660/7390] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:38:25.123244 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1af87ef6-ab53-4adc-96f6-88aafd16c4cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:25.123854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1af87ef6-ab53-4adc-96f6-88aafd16c4cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:25.132326 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1af87ef6-ab53-4adc-96f6-88aafd16c4cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:25.132821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1af87ef6-ab53-4adc-96f6-88aafd16c4cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:25.133265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1af87ef6-ab53-4adc-96f6-88aafd16c4cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:25.133993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1af87ef6-ab53-4adc-96f6-88aafd16c4cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:25.134450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1af87ef6-ab53-4adc-96f6-88aafd16c4cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:25.134877 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1af87ef6-ab53-4adc-96f6-88aafd16c4cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:25.202907 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1af87ef6-ab53-4adc-96f6-88aafd16c4cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e4ee8ca9ab458ab9fe9657e08aec5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f24feb3574af5b9b8a60107ccf118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:25.211937 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1af87ef6-ab53-4adc-96f6-88aafd16c4cc tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 200 len: 1351 microversion: 2.1 time: 0.092706 Aug 25 14:38:25.212533 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3731/7391] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:25 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:26.233591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:26.234305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] [instance: 6477f833-896c-4782-bc78-5bf3fe585dd8] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:26.242326 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:26.243023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:26.243544 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:26.244232 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:26.244665 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:26.245135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:26.259476 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] HTTP exception thrown: Instance 6477f833-896c-4782-bc78-5bf3fe585dd8 could not be found. Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Request method failure captured: Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 HTTP/1.1 Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4ads787rgq8t_jXmCTThfVv_kx769QvsW0MZ5tgMODzur0SDWAIYOH4pIE-_yPODKVbrbR0vLAnucf1TpxwL9SGUUa4KpluqsaQKeUsjztYGimEh53QDn1xz-52racGejJeUo3vbBLFEjoLVxrRFo6BBPPQiwzlOMWsONyqJ9sbwfQ Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 275f24feb3574af5b9b8a60107ccf118 Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/275f24feb3574af5b9b8a60107ccf118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_275f24feb3574af5b9b8a60107ccf118", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/275f24feb3574af5b9b8a60107ccf118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/275f24feb3574af5b9b8a60107ccf118"}]}] Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 275f24feb3574af5b9b8a60107ccf118 Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1026450561 Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestNetworkAdvancedServerOps-1026450561-project Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 03e4ee8ca9ab458ab9fe9657e08aec5a Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1026450561-project Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 6477f833-896c-4782-bc78-5bf3fe585dd8 could not be found. Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '6477f833-896c-4782-bc78-5bf3fe585dd8'} Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6477f833-896c-4782-bc78-5bf3fe585dd8 could not be found. Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6477f833-896c-4782-bc78-5bf3fe585dd8 could not be found. Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:38:26.261803 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6477f833-896c-4782-bc78-5bf3fe585dd8 could not be found. Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Returning 404 to user: Instance 6477f833-896c-4782-bc78-5bf3fe585dd8 could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-01095962-5f92-4f14-8936-8611260e74a1 tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8" status: 404 len: 111 microversion: 2.1 time: 0.034507 Aug 25 14:38:26.267037 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3661/7392] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:26 2022] GET /compute/v2.1/servers/6477f833-896c-4782-bc78-5bf3fe585dd8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:38:29.397031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7fb0f92-ac9c-4e21-80d9-68c788ba74cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] Calling method '.version_select at 0x7f3a29441310>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:29.422247 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b7fb0f92-ac9c-4e21-80d9-68c788ba74cd tempest-TestNetworkAdvancedServerOps-1026450561 tempest-TestNetworkAdvancedServerOps-1026450561-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-350340643" status: 202 len: 0 microversion: 2.1 time: 0.028896 Aug 25 14:38:29.422737 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3732/7393] 10.222.0.70 () {58 vars in 1281 bytes} [Thu Aug 25 14:38:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-350340643 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:38:41.490180 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=18 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:41.490959 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:41.705249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-018d12a2-d480-48bf-aa4b-cffbf192b18d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Action: 'create', calling method: .version_select at 0x7f3a2867f280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1477176397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr7Wlq1clu9C+ZdXNmFdvqMtrUdU67V32vFBCO4m0yGQNTTZuOi6Wur/fdsLPEGtLVMtsb5ZXieC48jgLPOnDCiPLyI0T6kMf5nyErTp/A8jS73/5nuVjHtvg4Qejrxgg=="}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:41.731680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-018d12a2-d480-48bf-aa4b-cffbf192b18d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Getting quotas for project 17d73e05470d4babbd7089e302a2a96b. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:38:41.739521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-018d12a2-d480-48bf-aa4b-cffbf192b18d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Getting quotas for user e316e541ea6e441483b2ed3c1a3f94c8 and project 17d73e05470d4babbd7089e302a2a96b. Resources: {'key_pairs'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:38:41.778338 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-018d12a2-d480-48bf-aa4b-cffbf192b18d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.293542 Aug 25 14:38:41.778913 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3662/7394] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:38:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:38:42.934065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:42.934845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:42.939786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1707493946", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1477176397", "security_groups": [{"name": "tempest-secgroup-smoke-1173904109"}], "networks": [{"uuid": "ae97fe34-132a-4b2d-9602-92ff1011ccf1"}]}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:43.059249 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.network.neutron [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] validate_networks() for [('ae97fe34-132a-4b2d-9602-92ff1011ccf1', None, None, None, None, None)] {{(pid=129060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:38:43.613328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Flavor limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:38:43.613789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Image limits 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:38:43.614307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Flavor pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:38:43.614743 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Image pref 0:0:0 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:38:43.615158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.virt.hardware [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:38:43.624943 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:43.625346 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:43.625815 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:43.626553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:43.626999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:43.627435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:43.645046 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Getting quotas for project 17d73e05470d4babbd7089e302a2a96b. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:38:43.651009 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Getting quotas for user e316e541ea6e441483b2ed3c1a3f94c8 and project 17d73e05470d4babbd7089e302a2a96b. Resources: {'cores', 'instances', 'ram'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:38:43.664127 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Going to run 1 instances... {{(pid=129060) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:38:43.666506 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:38:43.719842 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-40c33dd6-43e8-470e-8403-16129ec49372 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788662 Aug 25 14:38:43.720726 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3733/7395] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:38:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:38:43.733942 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d645f644-29e4-4233-b1a6-6ea50966b966 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:43.735135 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d645f644-29e4-4233-b1a6-6ea50966b966 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:43.813148 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d645f644-29e4-4233-b1a6-6ea50966b966 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:43.820511 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d645f644-29e4-4233-b1a6-6ea50966b966 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1247 microversion: 2.1 time: 0.092867 Aug 25 14:38:43.821105 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3663/7396] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:43 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:44.842771 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c196e5cb-8b79-4b44-bd9b-eea6ea9e5faa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:44.843400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c196e5cb-8b79-4b44-bd9b-eea6ea9e5faa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:44.858767 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c196e5cb-8b79-4b44-bd9b-eea6ea9e5faa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:44.859539 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c196e5cb-8b79-4b44-bd9b-eea6ea9e5faa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:44.861080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c196e5cb-8b79-4b44-bd9b-eea6ea9e5faa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:44.862148 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c196e5cb-8b79-4b44-bd9b-eea6ea9e5faa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:44.864193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c196e5cb-8b79-4b44-bd9b-eea6ea9e5faa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:44.866349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c196e5cb-8b79-4b44-bd9b-eea6ea9e5faa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:44.957489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c196e5cb-8b79-4b44-bd9b-eea6ea9e5faa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:44.968567 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c196e5cb-8b79-4b44-bd9b-eea6ea9e5faa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1307 microversion: 2.1 time: 0.130924 Aug 25 14:38:44.969841 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3734/7397] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:44 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1307 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:45.993538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b01ede7a-4bca-4f73-8fe6-8a870afef666 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:45.994501 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b01ede7a-4bca-4f73-8fe6-8a870afef666 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:46.004480 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b01ede7a-4bca-4f73-8fe6-8a870afef666 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:46.005455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b01ede7a-4bca-4f73-8fe6-8a870afef666 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:46.006038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b01ede7a-4bca-4f73-8fe6-8a870afef666 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:46.006933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b01ede7a-4bca-4f73-8fe6-8a870afef666 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:46.007839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b01ede7a-4bca-4f73-8fe6-8a870afef666 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:46.008384 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b01ede7a-4bca-4f73-8fe6-8a870afef666 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:46.271393 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b01ede7a-4bca-4f73-8fe6-8a870afef666 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:46.297737 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b01ede7a-4bca-4f73-8fe6-8a870afef666 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1373 microversion: 2.1 time: 0.307932 Aug 25 14:38:46.305322 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3664/7398] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:45 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1373 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:47.229060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2c8236f9-12dd-483a-b93e-43e176c1747c req-7061ef4e-abc3-4fa3-8672-c2d0b4fd11f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e5055b-e5a2-4e75-b1f1-65b137bb6968", "tag": "dd4738bd-b563-41bb-b1b3-d96a6fa48e73"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:47.249366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2c8236f9-12dd-483a-b93e-43e176c1747c req-7061ef4e-abc3-4fa3-8672-c2d0b4fd11f6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:47.250213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2c8236f9-12dd-483a-b93e-43e176c1747c req-7061ef4e-abc3-4fa3-8672-c2d0b4fd11f6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:47.250919 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2c8236f9-12dd-483a-b93e-43e176c1747c req-7061ef4e-abc3-4fa3-8672-c2d0b4fd11f6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:47.275136 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2c8236f9-12dd-483a-b93e-43e176c1747c req-7061ef4e-abc3-4fa3-8672-c2d0b4fd11f6 service nova] Creating event network-changed:dd4738bd-b563-41bb-b1b3-d96a6fa48e73 for instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 on n-h2-852771-8 Aug 25 14:38:47.284580 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2c8236f9-12dd-483a-b93e-43e176c1747c req-7061ef4e-abc3-4fa3-8672-c2d0b4fd11f6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059471 Aug 25 14:38:47.286335 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3735/7399] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:38:47.344938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e0858400-5e1a-4405-86b3-3ee7e1ac4e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:47.345939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e0858400-5e1a-4405-86b3-3ee7e1ac4e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:47.356127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0858400-5e1a-4405-86b3-3ee7e1ac4e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:47.356646 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0858400-5e1a-4405-86b3-3ee7e1ac4e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:47.357263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0858400-5e1a-4405-86b3-3ee7e1ac4e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:47.358219 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0858400-5e1a-4405-86b3-3ee7e1ac4e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:47.358723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0858400-5e1a-4405-86b3-3ee7e1ac4e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:47.359394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e0858400-5e1a-4405-86b3-3ee7e1ac4e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:47.565371 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e0858400-5e1a-4405-86b3-3ee7e1ac4e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:47.575491 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e0858400-5e1a-4405-86b3-3ee7e1ac4e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1373 microversion: 2.1 time: 0.237419 Aug 25 14:38:47.576095 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3665/7400] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:47 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1373 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:48.609901 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-94fe02bc-d316-4af9-af6d-eb6a725501f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:48.610700 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-94fe02bc-d316-4af9-af6d-eb6a725501f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:48.617526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94fe02bc-d316-4af9-af6d-eb6a725501f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:48.618031 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94fe02bc-d316-4af9-af6d-eb6a725501f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:48.618474 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94fe02bc-d316-4af9-af6d-eb6a725501f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:48.619207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94fe02bc-d316-4af9-af6d-eb6a725501f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:48.619670 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94fe02bc-d316-4af9-af6d-eb6a725501f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:48.620627 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94fe02bc-d316-4af9-af6d-eb6a725501f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:48.783331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-94fe02bc-d316-4af9-af6d-eb6a725501f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:48.793236 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-94fe02bc-d316-4af9-af6d-eb6a725501f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1373 microversion: 2.1 time: 0.187820 Aug 25 14:38:48.794343 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3736/7401] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:48 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:49.821685 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44475de6-1f44-4c88-89d3-58e3423fd08f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:49.822333 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44475de6-1f44-4c88-89d3-58e3423fd08f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:49.833274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44475de6-1f44-4c88-89d3-58e3423fd08f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:49.833954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44475de6-1f44-4c88-89d3-58e3423fd08f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:49.834513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44475de6-1f44-4c88-89d3-58e3423fd08f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:49.835429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44475de6-1f44-4c88-89d3-58e3423fd08f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:49.836044 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44475de6-1f44-4c88-89d3-58e3423fd08f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:49.836590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44475de6-1f44-4c88-89d3-58e3423fd08f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:50.037490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44475de6-1f44-4c88-89d3-58e3423fd08f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:50.051272 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44475de6-1f44-4c88-89d3-58e3423fd08f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1373 microversion: 2.1 time: 0.234121 Aug 25 14:38:50.052551 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3666/7402] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:49 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1373 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:38:51.084682 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4679f5bc-7ef2-4416-94fd-413ff536f0a4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:51.085313 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4679f5bc-7ef2-4416-94fd-413ff536f0a4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:51.096126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4679f5bc-7ef2-4416-94fd-413ff536f0a4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:51.096769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4679f5bc-7ef2-4416-94fd-413ff536f0a4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:51.097350 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4679f5bc-7ef2-4416-94fd-413ff536f0a4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:51.098209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4679f5bc-7ef2-4416-94fd-413ff536f0a4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:51.098821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4679f5bc-7ef2-4416-94fd-413ff536f0a4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:51.099412 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4679f5bc-7ef2-4416-94fd-413ff536f0a4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:51.269404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4679f5bc-7ef2-4416-94fd-413ff536f0a4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:51.278688 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4679f5bc-7ef2-4416-94fd-413ff536f0a4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1373 microversion: 2.1 time: 0.198478 Aug 25 14:38:51.280027 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3737/7403] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:51 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1373 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:52.300801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-522dc525-3fcd-4266-9f59-37c901b04b80 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:52.301428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-522dc525-3fcd-4266-9f59-37c901b04b80 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:52.309826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522dc525-3fcd-4266-9f59-37c901b04b80 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:52.310461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522dc525-3fcd-4266-9f59-37c901b04b80 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:52.311102 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522dc525-3fcd-4266-9f59-37c901b04b80 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:52.312040 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522dc525-3fcd-4266-9f59-37c901b04b80 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:52.312718 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522dc525-3fcd-4266-9f59-37c901b04b80 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:52.313428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-522dc525-3fcd-4266-9f59-37c901b04b80 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:52.496539 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-522dc525-3fcd-4266-9f59-37c901b04b80 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:52.505886 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-522dc525-3fcd-4266-9f59-37c901b04b80 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1373 microversion: 2.1 time: 0.208820 Aug 25 14:38:52.506521 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3667/7404] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:52 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1373 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:53.540837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-47ef2cbc-9bb6-455e-a326-78e19f3ce313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:53.542476 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-47ef2cbc-9bb6-455e-a326-78e19f3ce313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:53.553446 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ef2cbc-9bb6-455e-a326-78e19f3ce313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:53.553971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ef2cbc-9bb6-455e-a326-78e19f3ce313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:53.554424 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ef2cbc-9bb6-455e-a326-78e19f3ce313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:53.555155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ef2cbc-9bb6-455e-a326-78e19f3ce313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:53.555626 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ef2cbc-9bb6-455e-a326-78e19f3ce313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:53.556063 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-47ef2cbc-9bb6-455e-a326-78e19f3ce313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:53.635406 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:53.661378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:53.734530 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-47ef2cbc-9bb6-455e-a326-78e19f3ce313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:53.743760 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-47ef2cbc-9bb6-455e-a326-78e19f3ce313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1373 microversion: 2.1 time: 0.209541 Aug 25 14:38:53.744418 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3738/7405] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:53 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1373 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:54.732836 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-9658ec21-5ea2-41a2-9f3e-fd9b5519a392 req-bc6c9384-f275-4a03-9c08-b7eb6e4360e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e5055b-e5a2-4e75-b1f1-65b137bb6968", "name": "network-vif-plugged", "status": "completed", "tag": "dd4738bd-b563-41bb-b1b3-d96a6fa48e73"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:54.738611 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:54.749680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9658ec21-5ea2-41a2-9f3e-fd9b5519a392 req-bc6c9384-f275-4a03-9c08-b7eb6e4360e2 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:54.750613 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9658ec21-5ea2-41a2-9f3e-fd9b5519a392 req-bc6c9384-f275-4a03-9c08-b7eb6e4360e2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:54.751309 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-9658ec21-5ea2-41a2-9f3e-fd9b5519a392 req-bc6c9384-f275-4a03-9c08-b7eb6e4360e2 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:54.774673 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-60f8c25e-c613-419b-8c82-b2cd27f005ac tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:54.775769 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-60f8c25e-c613-419b-8c82-b2cd27f005ac tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:54.777196 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-9658ec21-5ea2-41a2-9f3e-fd9b5519a392 req-bc6c9384-f275-4a03-9c08-b7eb6e4360e2 service nova] Creating event network-vif-plugged:dd4738bd-b563-41bb-b1b3-d96a6fa48e73 for instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 on n-h2-852771-8 Aug 25 14:38:54.786860 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-9658ec21-5ea2-41a2-9f3e-fd9b5519a392 req-bc6c9384-f275-4a03-9c08-b7eb6e4360e2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059293 Aug 25 14:38:54.787360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60f8c25e-c613-419b-8c82-b2cd27f005ac tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:54.788001 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3668/7406] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:38:54.788232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60f8c25e-c613-419b-8c82-b2cd27f005ac tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:54.788944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60f8c25e-c613-419b-8c82-b2cd27f005ac tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:54.790181 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60f8c25e-c613-419b-8c82-b2cd27f005ac tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:54.790956 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60f8c25e-c613-419b-8c82-b2cd27f005ac tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:54.791461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60f8c25e-c613-419b-8c82-b2cd27f005ac tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:55.008289 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-60f8c25e-c613-419b-8c82-b2cd27f005ac tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:55.017884 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-60f8c25e-c613-419b-8c82-b2cd27f005ac tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1373 microversion: 2.1 time: 0.248335 Aug 25 14:38:55.018478 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3739/7407] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:54 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1373 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:38:56.041872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b643a1ab-2c0c-4ba5-9296-c5a23fb018aa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:56.042598 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b643a1ab-2c0c-4ba5-9296-c5a23fb018aa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:56.048928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b643a1ab-2c0c-4ba5-9296-c5a23fb018aa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:56.049432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b643a1ab-2c0c-4ba5-9296-c5a23fb018aa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:56.049929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b643a1ab-2c0c-4ba5-9296-c5a23fb018aa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:56.050659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b643a1ab-2c0c-4ba5-9296-c5a23fb018aa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:56.051126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b643a1ab-2c0c-4ba5-9296-c5a23fb018aa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:56.051577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b643a1ab-2c0c-4ba5-9296-c5a23fb018aa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:56.228792 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b643a1ab-2c0c-4ba5-9296-c5a23fb018aa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:56.238938 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b643a1ab-2c0c-4ba5-9296-c5a23fb018aa tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1373 microversion: 2.1 time: 0.201972 Aug 25 14:38:56.239542 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3669/7408] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:56 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1373 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:57.261669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3948fbe5-4d85-4d12-b375-2ec405becdee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:57.262340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3948fbe5-4d85-4d12-b375-2ec405becdee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:57.269715 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3948fbe5-4d85-4d12-b375-2ec405becdee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:57.270212 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3948fbe5-4d85-4d12-b375-2ec405becdee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:57.270662 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3948fbe5-4d85-4d12-b375-2ec405becdee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:57.271385 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3948fbe5-4d85-4d12-b375-2ec405becdee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:57.271846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3948fbe5-4d85-4d12-b375-2ec405becdee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:57.272285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3948fbe5-4d85-4d12-b375-2ec405becdee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:57.421433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3948fbe5-4d85-4d12-b375-2ec405becdee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:57.429712 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3948fbe5-4d85-4d12-b375-2ec405becdee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1557 microversion: 2.1 time: 0.172521 Aug 25 14:38:57.430309 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3740/7409] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:57 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:57.455228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9188ead4-3bcf-4ef0-b1fd-e411e64ffc72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:57.455987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9188ead4-3bcf-4ef0-b1fd-e411e64ffc72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:57.466295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9188ead4-3bcf-4ef0-b1fd-e411e64ffc72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:57.466890 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9188ead4-3bcf-4ef0-b1fd-e411e64ffc72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:57.467357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9188ead4-3bcf-4ef0-b1fd-e411e64ffc72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:57.468376 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9188ead4-3bcf-4ef0-b1fd-e411e64ffc72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:57.469071 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9188ead4-3bcf-4ef0-b1fd-e411e64ffc72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:57.469873 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9188ead4-3bcf-4ef0-b1fd-e411e64ffc72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:57.618811 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9188ead4-3bcf-4ef0-b1fd-e411e64ffc72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:57.633455 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9188ead4-3bcf-4ef0-b1fd-e411e64ffc72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1557 microversion: 2.1 time: 0.185567 Aug 25 14:38:57.634718 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3670/7410] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:57 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1557 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:59.734491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-9dae31c9-2fc6-46da-a4f5-178e22678d5b req-1d0f79ca-441c-484f-9593-523e072fb0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e5055b-e5a2-4e75-b1f1-65b137bb6968", "tag": "dd4738bd-b563-41bb-b1b3-d96a6fa48e73"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:59.747637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9dae31c9-2fc6-46da-a4f5-178e22678d5b req-1d0f79ca-441c-484f-9593-523e072fb0cf service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:59.748281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9dae31c9-2fc6-46da-a4f5-178e22678d5b req-1d0f79ca-441c-484f-9593-523e072fb0cf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:59.748658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-9dae31c9-2fc6-46da-a4f5-178e22678d5b req-1d0f79ca-441c-484f-9593-523e072fb0cf service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:59.762315 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-9dae31c9-2fc6-46da-a4f5-178e22678d5b req-1d0f79ca-441c-484f-9593-523e072fb0cf service nova] Creating event network-changed:dd4738bd-b563-41bb-b1b3-d96a6fa48e73 for instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 on n-h2-852771-8 Aug 25 14:38:59.771566 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-9dae31c9-2fc6-46da-a4f5-178e22678d5b req-1d0f79ca-441c-484f-9593-523e072fb0cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041528 Aug 25 14:38:59.773601 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3741/7411] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:41:26.720776 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ca47b9fd-db5f-4659-9198-232383143200] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:41:26.722017 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [-] [745e3532-2cb0-4f99-b902-ef5e74eccfa3] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:41:26.722571 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:26.723339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=38 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:26.725390 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:41:26.725547 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:41:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968/action (ip 10.222.0.70) !!! Aug 25 14:41:26.728093 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:41:26.728218 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:41:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968/action (ip 10.222.0.70) !!! Aug 25 14:41:26.729768 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:41:26.729897 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:41:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968/action (ip 10.222.0.70) !!! Aug 25 14:41:26.740845 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ea4cb86-d78e-48c8-8044-e3a3ae02cc1c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:41:26.741410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9ea4cb86-d78e-48c8-8044-e3a3ae02cc1c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:26.757465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea4cb86-d78e-48c8-8044-e3a3ae02cc1c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:26.758074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea4cb86-d78e-48c8-8044-e3a3ae02cc1c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:26.758481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea4cb86-d78e-48c8-8044-e3a3ae02cc1c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:26.759239 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea4cb86-d78e-48c8-8044-e3a3ae02cc1c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:26.759973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea4cb86-d78e-48c8-8044-e3a3ae02cc1c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:26.760603 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ea4cb86-d78e-48c8-8044-e3a3ae02cc1c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:26.789378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-9ea4cb86-d78e-48c8-8044-e3a3ae02cc1c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lazy-loading 'flavor' on Instance uuid 16e5055b-e5a2-4e75-b1f1-65b137bb6968 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:41:27.159437 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9ea4cb86-d78e-48c8-8044-e3a3ae02cc1c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "POST /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968/action" status: 202 len: 0 microversion: 2.1 time: 0.440315 Aug 25 14:41:27.160048 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3671/7412] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:41:26 2022] POST /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:41:27.167114 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88c62c8a-2359-4afe-9127-87fbb298a4bd] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:41:27.167924 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f63c0a0b-f433-4f36-b733-64add1270791] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:41:27.168526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:27.169926 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=42 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:27.170256 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:41:27.170436 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:41:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 (ip 10.222.0.70) !!! Aug 25 14:41:27.171662 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:41:27.171796 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:41:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 (ip 10.222.0.70) !!! Aug 25 14:41:27.172981 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:41:27.173118 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:41:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 (ip 10.222.0.70) !!! Aug 25 14:41:27.180650 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a6ec5cab-9c23-4e7d-917e-7cc2c7861fa6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:27.181573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a6ec5cab-9c23-4e7d-917e-7cc2c7861fa6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:27.193610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6ec5cab-9c23-4e7d-917e-7cc2c7861fa6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:27.194100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6ec5cab-9c23-4e7d-917e-7cc2c7861fa6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:27.194799 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6ec5cab-9c23-4e7d-917e-7cc2c7861fa6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:27.195512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6ec5cab-9c23-4e7d-917e-7cc2c7861fa6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:27.195972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6ec5cab-9c23-4e7d-917e-7cc2c7861fa6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:27.196400 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6ec5cab-9c23-4e7d-917e-7cc2c7861fa6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:27.398131 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a6ec5cab-9c23-4e7d-917e-7cc2c7861fa6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:27.406355 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a6ec5cab-9c23-4e7d-917e-7cc2c7861fa6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.241283 Aug 25 14:41:27.406936 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3742/7413] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:27 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:41:28.430756 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e97bae1f-2c83-465a-986d-c8276038e84d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:28.431521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e97bae1f-2c83-465a-986d-c8276038e84d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:28.441319 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] [ca47b9fd-db5f-4659-9198-232383143200] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 59416. Aug 25 14:41:28.443984 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] [745e3532-2cb0-4f99-b902-ef5e74eccfa3] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 59418. Aug 25 14:41:28.448783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97bae1f-2c83-465a-986d-c8276038e84d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:28.449336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97bae1f-2c83-465a-986d-c8276038e84d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:28.449818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97bae1f-2c83-465a-986d-c8276038e84d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:28.450656 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97bae1f-2c83-465a-986d-c8276038e84d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:28.451128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97bae1f-2c83-465a-986d-c8276038e84d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:28.451579 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e97bae1f-2c83-465a-986d-c8276038e84d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:28.599740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e97bae1f-2c83-465a-986d-c8276038e84d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:28.608332 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e97bae1f-2c83-465a-986d-c8276038e84d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.184266 Aug 25 14:41:28.608940 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3672/7414] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:28 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:29.630930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-40f68c3a-2186-4f2a-9049-467087898cb3 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:29.631525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-40f68c3a-2186-4f2a-9049-467087898cb3 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:29.642976 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40f68c3a-2186-4f2a-9049-467087898cb3 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:29.643486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40f68c3a-2186-4f2a-9049-467087898cb3 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:29.643920 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40f68c3a-2186-4f2a-9049-467087898cb3 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:29.644618 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40f68c3a-2186-4f2a-9049-467087898cb3 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:29.645066 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40f68c3a-2186-4f2a-9049-467087898cb3 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:29.645492 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-40f68c3a-2186-4f2a-9049-467087898cb3 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:29.650526 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] [88c62c8a-2359-4afe-9127-87fbb298a4bd] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 59424. Aug 25 14:41:29.654560 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] [f63c0a0b-f433-4f36-b733-64add1270791] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 59426. Aug 25 14:41:29.805479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-40f68c3a-2186-4f2a-9049-467087898cb3 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:29.813592 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-40f68c3a-2186-4f2a-9049-467087898cb3 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.186957 Aug 25 14:41:29.814177 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3743/7415] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:29 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:30.837207 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-dbc82e7f-759c-414d-8e2b-aef9b42e45dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:30.837862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-dbc82e7f-759c-414d-8e2b-aef9b42e45dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:30.845107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc82e7f-759c-414d-8e2b-aef9b42e45dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:30.845648 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc82e7f-759c-414d-8e2b-aef9b42e45dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:30.846104 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc82e7f-759c-414d-8e2b-aef9b42e45dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:30.846889 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc82e7f-759c-414d-8e2b-aef9b42e45dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:30.847358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc82e7f-759c-414d-8e2b-aef9b42e45dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:30.847800 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-dbc82e7f-759c-414d-8e2b-aef9b42e45dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:31.012016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-dbc82e7f-759c-414d-8e2b-aef9b42e45dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:31.021756 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-dbc82e7f-759c-414d-8e2b-aef9b42e45dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.189432 Aug 25 14:41:31.022840 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3673/7416] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:30 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:32.044294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4116841d-72f5-4d1c-85b7-99cb24321ebe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:32.044986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4116841d-72f5-4d1c-85b7-99cb24321ebe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:32.052084 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4116841d-72f5-4d1c-85b7-99cb24321ebe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:32.053209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4116841d-72f5-4d1c-85b7-99cb24321ebe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:32.053686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4116841d-72f5-4d1c-85b7-99cb24321ebe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:32.054408 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4116841d-72f5-4d1c-85b7-99cb24321ebe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:32.055146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4116841d-72f5-4d1c-85b7-99cb24321ebe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:32.055282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4116841d-72f5-4d1c-85b7-99cb24321ebe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:32.197742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4116841d-72f5-4d1c-85b7-99cb24321ebe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:32.207867 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4116841d-72f5-4d1c-85b7-99cb24321ebe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.167491 Aug 25 14:41:32.208463 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3744/7417] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:32 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:33.230248 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-99bcab2e-ac83-4d6f-8794-4314a77e83a7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:33.232688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-99bcab2e-ac83-4d6f-8794-4314a77e83a7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:33.238436 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bcab2e-ac83-4d6f-8794-4314a77e83a7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:33.238952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bcab2e-ac83-4d6f-8794-4314a77e83a7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:33.239415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bcab2e-ac83-4d6f-8794-4314a77e83a7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:33.240688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bcab2e-ac83-4d6f-8794-4314a77e83a7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:33.241173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bcab2e-ac83-4d6f-8794-4314a77e83a7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:33.241651 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-99bcab2e-ac83-4d6f-8794-4314a77e83a7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:33.414046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-99bcab2e-ac83-4d6f-8794-4314a77e83a7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:33.423751 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-99bcab2e-ac83-4d6f-8794-4314a77e83a7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.197294 Aug 25 14:41:33.424347 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3674/7418] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:33 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:34.447755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ca50e3ab-0e6c-410a-9226-2533b5165e32 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:34.448457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ca50e3ab-0e6c-410a-9226-2533b5165e32 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:34.457054 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca50e3ab-0e6c-410a-9226-2533b5165e32 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:34.457966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca50e3ab-0e6c-410a-9226-2533b5165e32 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:34.458465 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca50e3ab-0e6c-410a-9226-2533b5165e32 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:34.461250 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca50e3ab-0e6c-410a-9226-2533b5165e32 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:34.462990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca50e3ab-0e6c-410a-9226-2533b5165e32 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:34.465162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ca50e3ab-0e6c-410a-9226-2533b5165e32 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:34.631619 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ca50e3ab-0e6c-410a-9226-2533b5165e32 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:34.644148 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ca50e3ab-0e6c-410a-9226-2533b5165e32 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.201666 Aug 25 14:41:34.644760 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3745/7419] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:34 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:41:35.669844 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b799c03f-596c-4b1d-a0ac-50d3e9b7c06b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:35.670783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b799c03f-596c-4b1d-a0ac-50d3e9b7c06b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:35.681063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b799c03f-596c-4b1d-a0ac-50d3e9b7c06b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:35.681930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b799c03f-596c-4b1d-a0ac-50d3e9b7c06b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:35.682478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b799c03f-596c-4b1d-a0ac-50d3e9b7c06b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:35.683243 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b799c03f-596c-4b1d-a0ac-50d3e9b7c06b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:35.683768 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b799c03f-596c-4b1d-a0ac-50d3e9b7c06b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:35.684209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b799c03f-596c-4b1d-a0ac-50d3e9b7c06b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:35.855696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b799c03f-596c-4b1d-a0ac-50d3e9b7c06b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:35.863765 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b799c03f-596c-4b1d-a0ac-50d3e9b7c06b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.199848 Aug 25 14:41:35.864360 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3675/7420] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:35 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:36.888140 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a42b83f3-3185-4dd6-abb2-7223d9cdb4da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:36.889265 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a42b83f3-3185-4dd6-abb2-7223d9cdb4da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:36.899292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a42b83f3-3185-4dd6-abb2-7223d9cdb4da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:36.899868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a42b83f3-3185-4dd6-abb2-7223d9cdb4da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:36.900254 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a42b83f3-3185-4dd6-abb2-7223d9cdb4da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:36.900978 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a42b83f3-3185-4dd6-abb2-7223d9cdb4da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:36.901435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a42b83f3-3185-4dd6-abb2-7223d9cdb4da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:36.901883 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a42b83f3-3185-4dd6-abb2-7223d9cdb4da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:37.059675 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a42b83f3-3185-4dd6-abb2-7223d9cdb4da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:37.070113 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a42b83f3-3185-4dd6-abb2-7223d9cdb4da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.186671 Aug 25 14:41:37.070982 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3746/7421] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:36 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:38.094783 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-721996a9-f7bc-4225-8537-055c468763e5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:38.096206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-721996a9-f7bc-4225-8537-055c468763e5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:38.108291 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-721996a9-f7bc-4225-8537-055c468763e5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:38.108794 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-721996a9-f7bc-4225-8537-055c468763e5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:38.109253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-721996a9-f7bc-4225-8537-055c468763e5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:38.110023 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-721996a9-f7bc-4225-8537-055c468763e5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:38.110494 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-721996a9-f7bc-4225-8537-055c468763e5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:38.110934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-721996a9-f7bc-4225-8537-055c468763e5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:38.275246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-721996a9-f7bc-4225-8537-055c468763e5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:38.284544 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-721996a9-f7bc-4225-8537-055c468763e5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.193561 Aug 25 14:41:38.285169 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3676/7422] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:38 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:39.311801 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f9638f58-658b-4fe5-97f0-dac459206a5f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:39.312853 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f9638f58-658b-4fe5-97f0-dac459206a5f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:39.324513 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9638f58-658b-4fe5-97f0-dac459206a5f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:39.325333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9638f58-658b-4fe5-97f0-dac459206a5f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:39.326075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9638f58-658b-4fe5-97f0-dac459206a5f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:39.327213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9638f58-658b-4fe5-97f0-dac459206a5f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:39.327931 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9638f58-658b-4fe5-97f0-dac459206a5f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:39.328685 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f9638f58-658b-4fe5-97f0-dac459206a5f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:39.500039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f9638f58-658b-4fe5-97f0-dac459206a5f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:39.509352 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f9638f58-658b-4fe5-97f0-dac459206a5f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.204479 Aug 25 14:41:39.509988 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3747/7423] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:39 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:40.535254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-057ab158-c4fe-4d5b-8992-757528a2732c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:40.535879 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-057ab158-c4fe-4d5b-8992-757528a2732c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:40.543876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-057ab158-c4fe-4d5b-8992-757528a2732c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:40.544392 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-057ab158-c4fe-4d5b-8992-757528a2732c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:40.544851 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-057ab158-c4fe-4d5b-8992-757528a2732c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:40.545616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-057ab158-c4fe-4d5b-8992-757528a2732c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:40.546093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-057ab158-c4fe-4d5b-8992-757528a2732c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:40.546540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-057ab158-c4fe-4d5b-8992-757528a2732c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:40.717892 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-057ab158-c4fe-4d5b-8992-757528a2732c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:40.731510 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-057ab158-c4fe-4d5b-8992-757528a2732c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.200023 Aug 25 14:41:40.733304 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3677/7424] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:40 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:41.758819 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7d93289d-1af2-4c52-9d26-c47c503de5a5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:41.759409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7d93289d-1af2-4c52-9d26-c47c503de5a5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:41.766561 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d93289d-1af2-4c52-9d26-c47c503de5a5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:41.767053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d93289d-1af2-4c52-9d26-c47c503de5a5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:41.767493 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d93289d-1af2-4c52-9d26-c47c503de5a5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:41.768207 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d93289d-1af2-4c52-9d26-c47c503de5a5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:41.768659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d93289d-1af2-4c52-9d26-c47c503de5a5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:41.769089 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d93289d-1af2-4c52-9d26-c47c503de5a5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:41.941936 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7d93289d-1af2-4c52-9d26-c47c503de5a5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:41.950830 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7d93289d-1af2-4c52-9d26-c47c503de5a5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.198566 Aug 25 14:41:41.951442 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3748/7425] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:41 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:42.975335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-43cea955-c229-42d6-942d-0995e59502f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:42.976221 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-43cea955-c229-42d6-942d-0995e59502f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:42.983616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cea955-c229-42d6-942d-0995e59502f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:42.984125 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cea955-c229-42d6-942d-0995e59502f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:42.984582 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cea955-c229-42d6-942d-0995e59502f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:42.985324 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cea955-c229-42d6-942d-0995e59502f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:42.985838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cea955-c229-42d6-942d-0995e59502f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:42.986281 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-43cea955-c229-42d6-942d-0995e59502f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:43.148477 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-43cea955-c229-42d6-942d-0995e59502f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:43.156706 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-43cea955-c229-42d6-942d-0995e59502f7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.185883 Aug 25 14:41:43.157319 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3678/7426] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:42 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:44.179395 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a08e7d81-f1a1-4857-8a64-c11f6141912a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:44.180122 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a08e7d81-f1a1-4857-8a64-c11f6141912a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:44.187612 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08e7d81-f1a1-4857-8a64-c11f6141912a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:44.188118 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08e7d81-f1a1-4857-8a64-c11f6141912a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:44.188565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08e7d81-f1a1-4857-8a64-c11f6141912a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:44.189288 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08e7d81-f1a1-4857-8a64-c11f6141912a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:44.189818 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08e7d81-f1a1-4857-8a64-c11f6141912a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:44.190230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a08e7d81-f1a1-4857-8a64-c11f6141912a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:44.361015 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a08e7d81-f1a1-4857-8a64-c11f6141912a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:44.370054 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a08e7d81-f1a1-4857-8a64-c11f6141912a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1703 microversion: 2.1 time: 0.194914 Aug 25 14:41:44.370648 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3749/7427] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:44 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1703 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:45.392396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-92760fd2-c32f-4283-93a7-917753954f7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:45.393200 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-92760fd2-c32f-4283-93a7-917753954f7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:45.401953 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92760fd2-c32f-4283-93a7-917753954f7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:45.402591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92760fd2-c32f-4283-93a7-917753954f7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:45.403372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92760fd2-c32f-4283-93a7-917753954f7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:45.404225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92760fd2-c32f-4283-93a7-917753954f7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:45.404761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92760fd2-c32f-4283-93a7-917753954f7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:45.405404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-92760fd2-c32f-4283-93a7-917753954f7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:45.558171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-92760fd2-c32f-4283-93a7-917753954f7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:45.569827 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-92760fd2-c32f-4283-93a7-917753954f7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1703 microversion: 2.1 time: 0.181145 Aug 25 14:41:45.570703 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3679/7428] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:45 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1703 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:46.594455 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-810b576f-bba5-4922-a751-a05ec6aa0994 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:46.595138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-810b576f-bba5-4922-a751-a05ec6aa0994 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:46.603448 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810b576f-bba5-4922-a751-a05ec6aa0994 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:46.603850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810b576f-bba5-4922-a751-a05ec6aa0994 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:46.604218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810b576f-bba5-4922-a751-a05ec6aa0994 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:46.604952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810b576f-bba5-4922-a751-a05ec6aa0994 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:46.605407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810b576f-bba5-4922-a751-a05ec6aa0994 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:46.605866 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-810b576f-bba5-4922-a751-a05ec6aa0994 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:46.751732 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-810b576f-bba5-4922-a751-a05ec6aa0994 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:46.761959 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-810b576f-bba5-4922-a751-a05ec6aa0994 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1703 microversion: 2.1 time: 0.173249 Aug 25 14:41:46.762753 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3750/7429] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:46 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1703 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:47.663278 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-f831e1e8-107b-40ed-9a02-69ea37964959 req-23f01fc8-9cb0-4176-a6b8-551563bee5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e5055b-e5a2-4e75-b1f1-65b137bb6968", "name": "network-vif-plugged", "status": "completed", "tag": "dd4738bd-b563-41bb-b1b3-d96a6fa48e73"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:41:47.674323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f831e1e8-107b-40ed-9a02-69ea37964959 req-23f01fc8-9cb0-4176-a6b8-551563bee5c6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:47.674876 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f831e1e8-107b-40ed-9a02-69ea37964959 req-23f01fc8-9cb0-4176-a6b8-551563bee5c6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:47.675455 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-f831e1e8-107b-40ed-9a02-69ea37964959 req-23f01fc8-9cb0-4176-a6b8-551563bee5c6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:47.688010 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-f831e1e8-107b-40ed-9a02-69ea37964959 req-23f01fc8-9cb0-4176-a6b8-551563bee5c6 service nova] Creating event network-vif-plugged:dd4738bd-b563-41bb-b1b3-d96a6fa48e73 for instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 on n-h2-852771-8 Aug 25 14:41:47.693316 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-f831e1e8-107b-40ed-9a02-69ea37964959 req-23f01fc8-9cb0-4176-a6b8-551563bee5c6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034550 Aug 25 14:41:47.694893 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3680/7430] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:41:47.784423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8bf2eaed-7d42-4104-b1db-49bc29792520 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:47.785027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8bf2eaed-7d42-4104-b1db-49bc29792520 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:47.793075 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bf2eaed-7d42-4104-b1db-49bc29792520 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:47.793601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bf2eaed-7d42-4104-b1db-49bc29792520 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:47.794044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bf2eaed-7d42-4104-b1db-49bc29792520 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:47.794757 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bf2eaed-7d42-4104-b1db-49bc29792520 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:47.795216 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bf2eaed-7d42-4104-b1db-49bc29792520 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:47.795647 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8bf2eaed-7d42-4104-b1db-49bc29792520 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:47.950096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8bf2eaed-7d42-4104-b1db-49bc29792520 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:47.958707 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8bf2eaed-7d42-4104-b1db-49bc29792520 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1703 microversion: 2.1 time: 0.178234 Aug 25 14:41:47.960006 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3751/7431] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:47 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1703 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:48.984299 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eb07179a-2c01-488d-9376-53d411d821d4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:48.986105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eb07179a-2c01-488d-9376-53d411d821d4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:49.000504 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb07179a-2c01-488d-9376-53d411d821d4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:49.001139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb07179a-2c01-488d-9376-53d411d821d4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:49.001697 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb07179a-2c01-488d-9376-53d411d821d4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:49.002693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb07179a-2c01-488d-9376-53d411d821d4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:49.003388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb07179a-2c01-488d-9376-53d411d821d4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:49.004062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eb07179a-2c01-488d-9376-53d411d821d4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:49.169133 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eb07179a-2c01-488d-9376-53d411d821d4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:49.178470 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eb07179a-2c01-488d-9376-53d411d821d4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1698 microversion: 2.1 time: 0.199872 Aug 25 14:41:49.182721 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3681/7432] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:48 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1698 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:50.204331 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3fc296e7-756a-420b-8e1f-889ea157da08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:50.204962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3fc296e7-756a-420b-8e1f-889ea157da08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:50.216062 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fc296e7-756a-420b-8e1f-889ea157da08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:50.217576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fc296e7-756a-420b-8e1f-889ea157da08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:50.218534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fc296e7-756a-420b-8e1f-889ea157da08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:50.221307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fc296e7-756a-420b-8e1f-889ea157da08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:50.226133 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fc296e7-756a-420b-8e1f-889ea157da08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:50.226983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3fc296e7-756a-420b-8e1f-889ea157da08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:50.422236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3fc296e7-756a-420b-8e1f-889ea157da08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:50.436742 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3fc296e7-756a-420b-8e1f-889ea157da08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1698 microversion: 2.1 time: 0.235867 Aug 25 14:41:50.437838 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3752/7433] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:50 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1698 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:51.465520 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2b6d1375-ccfe-444a-9958-4cd305813977 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:51.466266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2b6d1375-ccfe-444a-9958-4cd305813977 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:51.476427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b6d1375-ccfe-444a-9958-4cd305813977 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:51.476939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b6d1375-ccfe-444a-9958-4cd305813977 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:51.477388 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b6d1375-ccfe-444a-9958-4cd305813977 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:51.478304 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b6d1375-ccfe-444a-9958-4cd305813977 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:51.478620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b6d1375-ccfe-444a-9958-4cd305813977 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:51.479074 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2b6d1375-ccfe-444a-9958-4cd305813977 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:51.659431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2b6d1375-ccfe-444a-9958-4cd305813977 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:51.662678 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2b6d1375-ccfe-444a-9958-4cd305813977 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1698 microversion: 2.1 time: 0.200877 Aug 25 14:41:51.664615 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3682/7434] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:51 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1698 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:52.688471 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-60860734-ca25-482c-8700-df1984121138 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:52.689106 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-60860734-ca25-482c-8700-df1984121138 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:52.700473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60860734-ca25-482c-8700-df1984121138 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:52.701251 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60860734-ca25-482c-8700-df1984121138 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:52.701822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60860734-ca25-482c-8700-df1984121138 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:52.702634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60860734-ca25-482c-8700-df1984121138 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:52.703215 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60860734-ca25-482c-8700-df1984121138 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:52.703733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-60860734-ca25-482c-8700-df1984121138 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:52.875033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-60860734-ca25-482c-8700-df1984121138 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:52.887259 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-60860734-ca25-482c-8700-df1984121138 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1698 microversion: 2.1 time: 0.203360 Aug 25 14:41:52.887856 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3753/7435] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:52 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1698 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:53.908960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d496cf4f-e58d-4210-856d-526a41ea107e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:53.909707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d496cf4f-e58d-4210-856d-526a41ea107e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:53.917490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d496cf4f-e58d-4210-856d-526a41ea107e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:53.918223 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d496cf4f-e58d-4210-856d-526a41ea107e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:53.918688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d496cf4f-e58d-4210-856d-526a41ea107e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:53.920105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d496cf4f-e58d-4210-856d-526a41ea107e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:53.920105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d496cf4f-e58d-4210-856d-526a41ea107e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:53.920427 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d496cf4f-e58d-4210-856d-526a41ea107e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:54.091082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d496cf4f-e58d-4210-856d-526a41ea107e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:54.102076 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d496cf4f-e58d-4210-856d-526a41ea107e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1698 microversion: 2.1 time: 0.197306 Aug 25 14:41:54.104538 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3683/7436] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:53 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1698 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:55.128722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-71520b5a-2df1-40da-aebc-041b87ac3eee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:55.129826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-71520b5a-2df1-40da-aebc-041b87ac3eee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:55.138772 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71520b5a-2df1-40da-aebc-041b87ac3eee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:55.139635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71520b5a-2df1-40da-aebc-041b87ac3eee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:55.140151 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71520b5a-2df1-40da-aebc-041b87ac3eee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:55.141026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71520b5a-2df1-40da-aebc-041b87ac3eee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:55.141786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71520b5a-2df1-40da-aebc-041b87ac3eee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:55.142341 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-71520b5a-2df1-40da-aebc-041b87ac3eee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:55.333348 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-71520b5a-2df1-40da-aebc-041b87ac3eee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:55.343648 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-71520b5a-2df1-40da-aebc-041b87ac3eee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1698 microversion: 2.1 time: 0.219128 Aug 25 14:41:55.345044 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3754/7437] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:55 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1698 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:56.369896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-46f825e2-0da1-4bf5-af96-54c68c8ab853 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:56.370675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-46f825e2-0da1-4bf5-af96-54c68c8ab853 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:56.382698 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46f825e2-0da1-4bf5-af96-54c68c8ab853 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:56.383406 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46f825e2-0da1-4bf5-af96-54c68c8ab853 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:56.384064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46f825e2-0da1-4bf5-af96-54c68c8ab853 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:56.384926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46f825e2-0da1-4bf5-af96-54c68c8ab853 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:56.386627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46f825e2-0da1-4bf5-af96-54c68c8ab853 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:56.386627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-46f825e2-0da1-4bf5-af96-54c68c8ab853 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:56.587997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-46f825e2-0da1-4bf5-af96-54c68c8ab853 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:56.602943 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-46f825e2-0da1-4bf5-af96-54c68c8ab853 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1698 microversion: 2.1 time: 0.236533 Aug 25 14:41:56.611250 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3684/7438] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:56 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1698 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:57.637175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-94cc2283-c56a-4519-8843-65cb3a7825d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:57.638981 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-94cc2283-c56a-4519-8843-65cb3a7825d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:57.642156 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=29 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:57.665053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94cc2283-c56a-4519-8843-65cb3a7825d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:57.665587 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94cc2283-c56a-4519-8843-65cb3a7825d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:57.666042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94cc2283-c56a-4519-8843-65cb3a7825d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:57.667161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94cc2283-c56a-4519-8843-65cb3a7825d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:57.667660 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94cc2283-c56a-4519-8843-65cb3a7825d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:57.668098 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94cc2283-c56a-4519-8843-65cb3a7825d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:57.672691 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=79 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:57.844125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-94cc2283-c56a-4519-8843-65cb3a7825d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:57.856115 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-94cc2283-c56a-4519-8843-65cb3a7825d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1698 microversion: 2.1 time: 0.222763 Aug 25 14:41:57.857138 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3755/7439] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:57 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1698 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:58.881577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-519ac431-610b-4851-a338-4d60a0ed861b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:58.882289 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-519ac431-610b-4851-a338-4d60a0ed861b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:58.884361 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=29 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:58.891883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-519ac431-610b-4851-a338-4d60a0ed861b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:58.892394 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-519ac431-610b-4851-a338-4d60a0ed861b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:58.893053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-519ac431-610b-4851-a338-4d60a0ed861b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:58.893627 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-519ac431-610b-4851-a338-4d60a0ed861b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:58.894111 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-519ac431-610b-4851-a338-4d60a0ed861b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:58.894559 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-519ac431-610b-4851-a338-4d60a0ed861b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:58.899801 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:59.049068 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-519ac431-610b-4851-a338-4d60a0ed861b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:59.058253 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-519ac431-610b-4851-a338-4d60a0ed861b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1680 microversion: 2.1 time: 0.181674 Aug 25 14:41:59.058800 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3685/7440] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:58 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:00.082475 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-890aabe6-ee93-45fe-ad94-9bc5829a7f66 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:00.083472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-890aabe6-ee93-45fe-ad94-9bc5829a7f66 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:00.091489 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890aabe6-ee93-45fe-ad94-9bc5829a7f66 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:00.092086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890aabe6-ee93-45fe-ad94-9bc5829a7f66 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:00.092391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890aabe6-ee93-45fe-ad94-9bc5829a7f66 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:00.093107 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890aabe6-ee93-45fe-ad94-9bc5829a7f66 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:00.093610 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890aabe6-ee93-45fe-ad94-9bc5829a7f66 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:00.094035 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-890aabe6-ee93-45fe-ad94-9bc5829a7f66 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:00.250224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-890aabe6-ee93-45fe-ad94-9bc5829a7f66 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:00.259404 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-890aabe6-ee93-45fe-ad94-9bc5829a7f66 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1680 microversion: 2.1 time: 0.181800 Aug 25 14:42:00.260016 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3756/7441] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:00 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:01.280983 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-840e2bf2-7bf9-4190-b511-980e4192ff72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:01.281898 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-840e2bf2-7bf9-4190-b511-980e4192ff72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:01.289976 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840e2bf2-7bf9-4190-b511-980e4192ff72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:01.290488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840e2bf2-7bf9-4190-b511-980e4192ff72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:01.290952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840e2bf2-7bf9-4190-b511-980e4192ff72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:01.291720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840e2bf2-7bf9-4190-b511-980e4192ff72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:01.292224 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840e2bf2-7bf9-4190-b511-980e4192ff72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:01.292649 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-840e2bf2-7bf9-4190-b511-980e4192ff72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:01.444779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-840e2bf2-7bf9-4190-b511-980e4192ff72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:01.453090 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-840e2bf2-7bf9-4190-b511-980e4192ff72 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1623 microversion: 2.1 time: 0.176165 Aug 25 14:42:01.453719 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3686/7442] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:01 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1623 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:01.483982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-94276925-3675-48c7-9843-6a97cae0b5af tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:42:01.484578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-94276925-3675-48c7-9843-6a97cae0b5af tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:01.492405 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94276925-3675-48c7-9843-6a97cae0b5af tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:01.492854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94276925-3675-48c7-9843-6a97cae0b5af tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:01.493294 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94276925-3675-48c7-9843-6a97cae0b5af tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:01.494069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94276925-3675-48c7-9843-6a97cae0b5af tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:01.494499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94276925-3675-48c7-9843-6a97cae0b5af tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:01.494929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-94276925-3675-48c7-9843-6a97cae0b5af tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:01.539079 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-94276925-3675-48c7-9843-6a97cae0b5af tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129060) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 14:42:01.619422 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-94276925-3675-48c7-9843-6a97cae0b5af tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "POST /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968/action" status: 202 len: 0 microversion: 2.1 time: 0.139342 Aug 25 14:42:01.623472 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3757/7443] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:42:01 2022] POST /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:42:01.628521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3cce130e-277b-4bc9-a9c3-e4fd44d11cdb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:01.629515 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3cce130e-277b-4bc9-a9c3-e4fd44d11cdb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:01.636076 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cce130e-277b-4bc9-a9c3-e4fd44d11cdb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:01.636731 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cce130e-277b-4bc9-a9c3-e4fd44d11cdb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:01.637222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cce130e-277b-4bc9-a9c3-e4fd44d11cdb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:01.638006 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cce130e-277b-4bc9-a9c3-e4fd44d11cdb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:01.638538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cce130e-277b-4bc9-a9c3-e4fd44d11cdb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:01.638995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3cce130e-277b-4bc9-a9c3-e4fd44d11cdb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:01.827696 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3cce130e-277b-4bc9-a9c3-e4fd44d11cdb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:01.836958 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3cce130e-277b-4bc9-a9c3-e4fd44d11cdb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1631 microversion: 2.1 time: 0.212234 Aug 25 14:42:01.837595 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3687/7444] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:01 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1631 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:02.860724 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-da82216c-039c-445b-994a-164b0426bb9e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:02.861588 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-da82216c-039c-445b-994a-164b0426bb9e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:02.869449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da82216c-039c-445b-994a-164b0426bb9e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:02.869983 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da82216c-039c-445b-994a-164b0426bb9e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:02.870435 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da82216c-039c-445b-994a-164b0426bb9e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:02.871157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da82216c-039c-445b-994a-164b0426bb9e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:02.871608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da82216c-039c-445b-994a-164b0426bb9e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:02.872042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-da82216c-039c-445b-994a-164b0426bb9e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:03.027104 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-da82216c-039c-445b-994a-164b0426bb9e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:03.036194 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-da82216c-039c-445b-994a-164b0426bb9e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.180957 Aug 25 14:42:03.037307 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3758/7445] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:02 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:03.756380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c028f76e-5ab6-42ed-b44c-4ac4ffbabc53 req-d71d36ed-916a-4885-92b1-8760e0f231c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e5055b-e5a2-4e75-b1f1-65b137bb6968", "name": "network-vif-unplugged", "status": "completed", "tag": "dd4738bd-b563-41bb-b1b3-d96a6fa48e73"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:42:03.766172 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c028f76e-5ab6-42ed-b44c-4ac4ffbabc53 req-d71d36ed-916a-4885-92b1-8760e0f231c6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:03.766675 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c028f76e-5ab6-42ed-b44c-4ac4ffbabc53 req-d71d36ed-916a-4885-92b1-8760e0f231c6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:03.767129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c028f76e-5ab6-42ed-b44c-4ac4ffbabc53 req-d71d36ed-916a-4885-92b1-8760e0f231c6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:03.780076 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c028f76e-5ab6-42ed-b44c-4ac4ffbabc53 req-d71d36ed-916a-4885-92b1-8760e0f231c6 service nova] Creating event network-vif-unplugged:dd4738bd-b563-41bb-b1b3-d96a6fa48e73 for instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 on n-h1-852771-8 Aug 25 14:42:03.785413 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c028f76e-5ab6-42ed-b44c-4ac4ffbabc53 req-d71d36ed-916a-4885-92b1-8760e0f231c6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097682 Aug 25 14:42:03.786089 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3688/7446] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:42:04.058335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a6e12de6-e300-4a7a-9d22-bdc088ac83da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:04.059000 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a6e12de6-e300-4a7a-9d22-bdc088ac83da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:04.067290 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e12de6-e300-4a7a-9d22-bdc088ac83da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:04.067788 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e12de6-e300-4a7a-9d22-bdc088ac83da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:04.068952 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e12de6-e300-4a7a-9d22-bdc088ac83da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:04.069755 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e12de6-e300-4a7a-9d22-bdc088ac83da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:04.070258 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e12de6-e300-4a7a-9d22-bdc088ac83da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:04.070746 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a6e12de6-e300-4a7a-9d22-bdc088ac83da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:04.319325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a6e12de6-e300-4a7a-9d22-bdc088ac83da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:04.327407 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a6e12de6-e300-4a7a-9d22-bdc088ac83da tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.273110 Aug 25 14:42:04.328011 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3759/7447] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:04 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:05.349894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-84449b61-a0c9-4494-81a8-be27b82abe28 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:05.350641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-84449b61-a0c9-4494-81a8-be27b82abe28 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:05.358456 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84449b61-a0c9-4494-81a8-be27b82abe28 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:05.358759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84449b61-a0c9-4494-81a8-be27b82abe28 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:05.359220 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84449b61-a0c9-4494-81a8-be27b82abe28 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:05.359954 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84449b61-a0c9-4494-81a8-be27b82abe28 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:05.360429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84449b61-a0c9-4494-81a8-be27b82abe28 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:05.360874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-84449b61-a0c9-4494-81a8-be27b82abe28 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:05.526526 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-84449b61-a0c9-4494-81a8-be27b82abe28 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:05.535413 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-84449b61-a0c9-4494-81a8-be27b82abe28 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.190348 Aug 25 14:42:05.536272 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3689/7448] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:05 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:05.805483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-40e139a6-96e8-430f-8ae6-689d80c0e94d req-122fcf41-9bcc-40fb-af8c-ff1cd7f8905b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e5055b-e5a2-4e75-b1f1-65b137bb6968", "tag": "dd4738bd-b563-41bb-b1b3-d96a6fa48e73"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:42:05.816161 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-40e139a6-96e8-430f-8ae6-689d80c0e94d req-122fcf41-9bcc-40fb-af8c-ff1cd7f8905b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:05.816651 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-40e139a6-96e8-430f-8ae6-689d80c0e94d req-122fcf41-9bcc-40fb-af8c-ff1cd7f8905b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:05.817088 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-40e139a6-96e8-430f-8ae6-689d80c0e94d req-122fcf41-9bcc-40fb-af8c-ff1cd7f8905b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:05.829539 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-40e139a6-96e8-430f-8ae6-689d80c0e94d req-122fcf41-9bcc-40fb-af8c-ff1cd7f8905b service nova] Creating event network-changed:dd4738bd-b563-41bb-b1b3-d96a6fa48e73 for instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 on n-h1-852771-8 Aug 25 14:42:05.836996 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-40e139a6-96e8-430f-8ae6-689d80c0e94d req-122fcf41-9bcc-40fb-af8c-ff1cd7f8905b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035790 Aug 25 14:42:05.837593 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3760/7449] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:42:06.556826 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-79601479-29d4-4898-93e7-d3a87b4dd580 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:06.557620 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-79601479-29d4-4898-93e7-d3a87b4dd580 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:06.565292 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79601479-29d4-4898-93e7-d3a87b4dd580 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:06.565997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79601479-29d4-4898-93e7-d3a87b4dd580 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:06.566327 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79601479-29d4-4898-93e7-d3a87b4dd580 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:06.567055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79601479-29d4-4898-93e7-d3a87b4dd580 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:06.568509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79601479-29d4-4898-93e7-d3a87b4dd580 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:06.568509 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-79601479-29d4-4898-93e7-d3a87b4dd580 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:06.718640 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-79601479-29d4-4898-93e7-d3a87b4dd580 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:06.729878 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-79601479-29d4-4898-93e7-d3a87b4dd580 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.177305 Aug 25 14:42:06.731024 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3690/7450] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:06 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:07.752846 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-339da764-9591-4e5f-add9-c01542485479 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:07.753463 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-339da764-9591-4e5f-add9-c01542485479 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:07.761352 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-339da764-9591-4e5f-add9-c01542485479 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:07.761941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-339da764-9591-4e5f-add9-c01542485479 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:07.762381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-339da764-9591-4e5f-add9-c01542485479 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:07.763080 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-339da764-9591-4e5f-add9-c01542485479 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:07.763547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-339da764-9591-4e5f-add9-c01542485479 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:07.763979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-339da764-9591-4e5f-add9-c01542485479 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:07.926202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-339da764-9591-4e5f-add9-c01542485479 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:07.938011 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-339da764-9591-4e5f-add9-c01542485479 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.189075 Aug 25 14:42:07.939101 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3761/7451] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:07 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:08.967888 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-36f53abf-2585-4e15-b954-70b34c12f881 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:08.968672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-36f53abf-2585-4e15-b954-70b34c12f881 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:08.976808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f53abf-2585-4e15-b954-70b34c12f881 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:08.977320 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f53abf-2585-4e15-b954-70b34c12f881 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:08.977806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f53abf-2585-4e15-b954-70b34c12f881 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:08.978546 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f53abf-2585-4e15-b954-70b34c12f881 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:08.979012 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f53abf-2585-4e15-b954-70b34c12f881 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:08.979462 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-36f53abf-2585-4e15-b954-70b34c12f881 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:09.140639 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-36f53abf-2585-4e15-b954-70b34c12f881 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:09.149969 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-36f53abf-2585-4e15-b954-70b34c12f881 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.187173 Aug 25 14:42:09.150639 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3691/7452] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:08 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:10.172433 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-88bdb4a4-dbeb-47cd-b7eb-d81b3ea05f10 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:10.173282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-88bdb4a4-dbeb-47cd-b7eb-d81b3ea05f10 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:10.180547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88bdb4a4-dbeb-47cd-b7eb-d81b3ea05f10 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:10.181036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88bdb4a4-dbeb-47cd-b7eb-d81b3ea05f10 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:10.181479 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88bdb4a4-dbeb-47cd-b7eb-d81b3ea05f10 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:10.182219 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88bdb4a4-dbeb-47cd-b7eb-d81b3ea05f10 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:10.182667 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88bdb4a4-dbeb-47cd-b7eb-d81b3ea05f10 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:10.183090 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-88bdb4a4-dbeb-47cd-b7eb-d81b3ea05f10 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:10.340165 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-88bdb4a4-dbeb-47cd-b7eb-d81b3ea05f10 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:10.350542 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-88bdb4a4-dbeb-47cd-b7eb-d81b3ea05f10 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.181940 Aug 25 14:42:10.351405 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3762/7453] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:10 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:11.372957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9497c1fc-3e13-4aaa-b3bd-6e29dfe10a08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:11.373818 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9497c1fc-3e13-4aaa-b3bd-6e29dfe10a08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:11.381313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9497c1fc-3e13-4aaa-b3bd-6e29dfe10a08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:11.381857 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9497c1fc-3e13-4aaa-b3bd-6e29dfe10a08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:11.382318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9497c1fc-3e13-4aaa-b3bd-6e29dfe10a08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:11.383058 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9497c1fc-3e13-4aaa-b3bd-6e29dfe10a08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:11.383530 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9497c1fc-3e13-4aaa-b3bd-6e29dfe10a08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:11.383977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9497c1fc-3e13-4aaa-b3bd-6e29dfe10a08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:11.538410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9497c1fc-3e13-4aaa-b3bd-6e29dfe10a08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:11.546587 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9497c1fc-3e13-4aaa-b3bd-6e29dfe10a08 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.177455 Aug 25 14:42:11.547278 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3692/7454] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:11 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:12.568659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4406598e-93bd-4c58-9fbe-59ce2e0f8928 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:12.569529 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4406598e-93bd-4c58-9fbe-59ce2e0f8928 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:12.576966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4406598e-93bd-4c58-9fbe-59ce2e0f8928 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:12.577569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4406598e-93bd-4c58-9fbe-59ce2e0f8928 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:12.578077 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4406598e-93bd-4c58-9fbe-59ce2e0f8928 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:12.578893 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4406598e-93bd-4c58-9fbe-59ce2e0f8928 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:12.579553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4406598e-93bd-4c58-9fbe-59ce2e0f8928 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:12.580026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4406598e-93bd-4c58-9fbe-59ce2e0f8928 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:13.015309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4406598e-93bd-4c58-9fbe-59ce2e0f8928 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:13.026415 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4406598e-93bd-4c58-9fbe-59ce2e0f8928 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.461906 Aug 25 14:42:13.027388 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3763/7455] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:12 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:14.049899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-78e5243b-dce7-476b-b283-0d5c2b1d794c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:14.050572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-78e5243b-dce7-476b-b283-0d5c2b1d794c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:14.058437 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78e5243b-dce7-476b-b283-0d5c2b1d794c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:14.058948 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78e5243b-dce7-476b-b283-0d5c2b1d794c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:14.059407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78e5243b-dce7-476b-b283-0d5c2b1d794c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:14.060136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78e5243b-dce7-476b-b283-0d5c2b1d794c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:14.060612 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78e5243b-dce7-476b-b283-0d5c2b1d794c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:14.061062 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-78e5243b-dce7-476b-b283-0d5c2b1d794c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:14.203945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-78e5243b-dce7-476b-b283-0d5c2b1d794c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:14.212404 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-78e5243b-dce7-476b-b283-0d5c2b1d794c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.165988 Aug 25 14:42:14.213122 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3693/7456] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:14 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:15.234037 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f56201dd-0672-4d7e-8f43-6ed8e75a3376 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:15.234652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f56201dd-0672-4d7e-8f43-6ed8e75a3376 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:15.241536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56201dd-0672-4d7e-8f43-6ed8e75a3376 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:15.242039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56201dd-0672-4d7e-8f43-6ed8e75a3376 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:15.242484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56201dd-0672-4d7e-8f43-6ed8e75a3376 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:15.243831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56201dd-0672-4d7e-8f43-6ed8e75a3376 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:15.244296 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56201dd-0672-4d7e-8f43-6ed8e75a3376 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:15.244722 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f56201dd-0672-4d7e-8f43-6ed8e75a3376 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:15.380511 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f56201dd-0672-4d7e-8f43-6ed8e75a3376 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:15.388871 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f56201dd-0672-4d7e-8f43-6ed8e75a3376 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.158759 Aug 25 14:42:15.389435 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3764/7457] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:15 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:16.411213 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3c455b26-f364-4ed2-a6fe-eefac98ac833 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:16.411839 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3c455b26-f364-4ed2-a6fe-eefac98ac833 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:16.419025 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455b26-f364-4ed2-a6fe-eefac98ac833 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:16.419570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455b26-f364-4ed2-a6fe-eefac98ac833 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:16.419989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455b26-f364-4ed2-a6fe-eefac98ac833 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:16.420706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455b26-f364-4ed2-a6fe-eefac98ac833 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:16.421257 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455b26-f364-4ed2-a6fe-eefac98ac833 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:16.421659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3c455b26-f364-4ed2-a6fe-eefac98ac833 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:16.845935 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3c455b26-f364-4ed2-a6fe-eefac98ac833 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:16.854783 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3c455b26-f364-4ed2-a6fe-eefac98ac833 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.447512 Aug 25 14:42:16.855361 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3694/7458] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:16 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:17.875888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-938e97ab-e77c-47eb-b14d-2e233ae6c0e2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:17.876526 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-938e97ab-e77c-47eb-b14d-2e233ae6c0e2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:17.884266 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-938e97ab-e77c-47eb-b14d-2e233ae6c0e2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:17.884756 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-938e97ab-e77c-47eb-b14d-2e233ae6c0e2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:17.885196 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-938e97ab-e77c-47eb-b14d-2e233ae6c0e2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:17.885944 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-938e97ab-e77c-47eb-b14d-2e233ae6c0e2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:17.886402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-938e97ab-e77c-47eb-b14d-2e233ae6c0e2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:17.886827 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-938e97ab-e77c-47eb-b14d-2e233ae6c0e2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:18.025582 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-938e97ab-e77c-47eb-b14d-2e233ae6c0e2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:18.033453 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-938e97ab-e77c-47eb-b14d-2e233ae6c0e2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.161448 Aug 25 14:42:18.034064 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3765/7459] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:17 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:19.055927 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-16be2364-9ae0-431c-aa0c-cbf77690742a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:19.056728 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-16be2364-9ae0-431c-aa0c-cbf77690742a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:19.064016 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16be2364-9ae0-431c-aa0c-cbf77690742a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:19.064568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16be2364-9ae0-431c-aa0c-cbf77690742a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:19.065029 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16be2364-9ae0-431c-aa0c-cbf77690742a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:19.065798 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16be2364-9ae0-431c-aa0c-cbf77690742a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:19.066313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16be2364-9ae0-431c-aa0c-cbf77690742a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:19.066764 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-16be2364-9ae0-431c-aa0c-cbf77690742a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:19.205340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-16be2364-9ae0-431c-aa0c-cbf77690742a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:19.214480 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-16be2364-9ae0-431c-aa0c-cbf77690742a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.163025 Aug 25 14:42:19.215144 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3695/7460] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:19 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:20.236115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d2d99952-d927-41d4-a87c-9b8b36e72e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:20.236713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d2d99952-d927-41d4-a87c-9b8b36e72e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:20.244547 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2d99952-d927-41d4-a87c-9b8b36e72e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:20.245026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2d99952-d927-41d4-a87c-9b8b36e72e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:20.245461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2d99952-d927-41d4-a87c-9b8b36e72e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:20.246175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2d99952-d927-41d4-a87c-9b8b36e72e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:20.246623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2d99952-d927-41d4-a87c-9b8b36e72e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:20.247042 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d2d99952-d927-41d4-a87c-9b8b36e72e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:20.385501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d2d99952-d927-41d4-a87c-9b8b36e72e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:20.394074 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d2d99952-d927-41d4-a87c-9b8b36e72e39 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.161968 Aug 25 14:42:20.394661 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3766/7461] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:20 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:21.417751 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c32bdbf9-d321-470c-be93-b241705469be tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:21.418524 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c32bdbf9-d321-470c-be93-b241705469be tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:21.426325 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32bdbf9-d321-470c-be93-b241705469be tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:21.426917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32bdbf9-d321-470c-be93-b241705469be tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:21.427305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32bdbf9-d321-470c-be93-b241705469be tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:21.428235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32bdbf9-d321-470c-be93-b241705469be tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:21.429107 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32bdbf9-d321-470c-be93-b241705469be tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:21.429584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c32bdbf9-d321-470c-be93-b241705469be tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:21.569957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-c32bdbf9-d321-470c-be93-b241705469be tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:21.578628 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c32bdbf9-d321-470c-be93-b241705469be tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.166792 Aug 25 14:42:21.579213 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3696/7462] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:21 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:42:22.601019 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-427706cb-0e9d-4954-965b-06cbb5152552 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:22.601676 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-427706cb-0e9d-4954-965b-06cbb5152552 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:22.608954 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427706cb-0e9d-4954-965b-06cbb5152552 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:22.609480 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427706cb-0e9d-4954-965b-06cbb5152552 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:22.609961 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427706cb-0e9d-4954-965b-06cbb5152552 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:22.610881 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427706cb-0e9d-4954-965b-06cbb5152552 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:22.611154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427706cb-0e9d-4954-965b-06cbb5152552 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:22.611585 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-427706cb-0e9d-4954-965b-06cbb5152552 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:22.778538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-427706cb-0e9d-4954-965b-06cbb5152552 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:22.789548 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-427706cb-0e9d-4954-965b-06cbb5152552 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.191365 Aug 25 14:42:22.789548 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3767/7463] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:22 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:22.840222 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-6a2f0d56-88a1-4e93-9f4b-f19cddc2ca59 req-4676cb00-71d8-4061-95bb-2d5dd1d94454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e5055b-e5a2-4e75-b1f1-65b137bb6968", "name": "network-vif-plugged", "status": "completed", "tag": "dd4738bd-b563-41bb-b1b3-d96a6fa48e73"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:42:22.850177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a2f0d56-88a1-4e93-9f4b-f19cddc2ca59 req-4676cb00-71d8-4061-95bb-2d5dd1d94454 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:22.850680 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a2f0d56-88a1-4e93-9f4b-f19cddc2ca59 req-4676cb00-71d8-4061-95bb-2d5dd1d94454 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:22.851136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-6a2f0d56-88a1-4e93-9f4b-f19cddc2ca59 req-4676cb00-71d8-4061-95bb-2d5dd1d94454 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:22.862846 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-6a2f0d56-88a1-4e93-9f4b-f19cddc2ca59 req-4676cb00-71d8-4061-95bb-2d5dd1d94454 service nova] Creating event network-vif-plugged:dd4738bd-b563-41bb-b1b3-d96a6fa48e73 for instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 on n-h1-852771-8 Aug 25 14:42:22.868496 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-6a2f0d56-88a1-4e93-9f4b-f19cddc2ca59 req-4676cb00-71d8-4061-95bb-2d5dd1d94454 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097624 Aug 25 14:42:22.869096 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3697/7464] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:42:23.810814 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc05594f-5998-4561-9272-01ac69d8a2d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:23.811430 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc05594f-5998-4561-9272-01ac69d8a2d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:23.818344 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc05594f-5998-4561-9272-01ac69d8a2d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:23.818822 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc05594f-5998-4561-9272-01ac69d8a2d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:23.819256 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc05594f-5998-4561-9272-01ac69d8a2d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:23.819993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc05594f-5998-4561-9272-01ac69d8a2d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:23.820591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc05594f-5998-4561-9272-01ac69d8a2d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:23.820986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc05594f-5998-4561-9272-01ac69d8a2d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:23.959826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc05594f-5998-4561-9272-01ac69d8a2d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:23.968509 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc05594f-5998-4561-9272-01ac69d8a2d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.161738 Aug 25 14:42:23.969086 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3768/7465] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:23 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:24.991989 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25b69ac0-ba9d-439e-841b-9c5e1aa2b81b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:24.993217 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-25b69ac0-ba9d-439e-841b-9c5e1aa2b81b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:24.999547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b69ac0-ba9d-439e-841b-9c5e1aa2b81b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:25.000046 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b69ac0-ba9d-439e-841b-9c5e1aa2b81b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:25.000545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b69ac0-ba9d-439e-841b-9c5e1aa2b81b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:25.001210 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b69ac0-ba9d-439e-841b-9c5e1aa2b81b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:25.001862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b69ac0-ba9d-439e-841b-9c5e1aa2b81b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:25.002311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25b69ac0-ba9d-439e-841b-9c5e1aa2b81b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:25.149140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-25b69ac0-ba9d-439e-841b-9c5e1aa2b81b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:25.157216 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-25b69ac0-ba9d-439e-841b-9c5e1aa2b81b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1689 microversion: 2.1 time: 0.170437 Aug 25 14:42:25.157744 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3698/7466] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:24 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:42:26.179277 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-737f7f42-f1e0-4fbd-846e-54b1662e83ba tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:42:26.179890 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-737f7f42-f1e0-4fbd-846e-54b1662e83ba tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:42:26.186966 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-737f7f42-f1e0-4fbd-846e-54b1662e83ba tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:26.187457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-737f7f42-f1e0-4fbd-846e-54b1662e83ba tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:26.187902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-737f7f42-f1e0-4fbd-846e-54b1662e83ba tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:26.188617 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-737f7f42-f1e0-4fbd-846e-54b1662e83ba tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:42:26.189085 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-737f7f42-f1e0-4fbd-846e-54b1662e83ba tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:42:26.189538 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-737f7f42-f1e0-4fbd-846e-54b1662e83ba tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:42:26.327894 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-737f7f42-f1e0-4fbd-846e-54b1662e83ba tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:42:26.337206 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-737f7f42-f1e0-4fbd-846e-54b1662e83ba tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1676 microversion: 2.1 time: 0.161832 Aug 25 14:42:26.337872 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3769/7467] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:42:26 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:44:02.899306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=27 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:02.900093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=75 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:02.900989 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:02.901947 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:02.905379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ee691362-3c95-4c43-9baa-d92d0c7f04dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:02.906015 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee691362-3c95-4c43-9baa-d92d0c7f04dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:02.915743 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee691362-3c95-4c43-9baa-d92d0c7f04dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:02.916447 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee691362-3c95-4c43-9baa-d92d0c7f04dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:02.917084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee691362-3c95-4c43-9baa-d92d0c7f04dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:02.917865 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee691362-3c95-4c43-9baa-d92d0c7f04dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:02.918420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee691362-3c95-4c43-9baa-d92d0c7f04dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:02.918885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ee691362-3c95-4c43-9baa-d92d0c7f04dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:02.948928 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ee691362-3c95-4c43-9baa-d92d0c7f04dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:44:02.979243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-06890da9-a287-40a4-80b0-bbe78eb90bf0 req-235bc324-2cfe-4956-b06c-2fb817c4cda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e5055b-e5a2-4e75-b1f1-65b137bb6968", "tag": "dd4738bd-b563-41bb-b1b3-d96a6fa48e73"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:44:02.990720 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-06890da9-a287-40a4-80b0-bbe78eb90bf0 req-235bc324-2cfe-4956-b06c-2fb817c4cda5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:02.991193 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-06890da9-a287-40a4-80b0-bbe78eb90bf0 req-235bc324-2cfe-4956-b06c-2fb817c4cda5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:02.991828 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-06890da9-a287-40a4-80b0-bbe78eb90bf0 req-235bc324-2cfe-4956-b06c-2fb817c4cda5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:03.005561 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-06890da9-a287-40a4-80b0-bbe78eb90bf0 req-235bc324-2cfe-4956-b06c-2fb817c4cda5 service nova] Creating event network-changed:dd4738bd-b563-41bb-b1b3-d96a6fa48e73 for instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 on n-h1-852771-8 Aug 25 14:44:03.011539 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-06890da9-a287-40a4-80b0-bbe78eb90bf0 req-235bc324-2cfe-4956-b06c-2fb817c4cda5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112589 Aug 25 14:44:03.012465 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3770/7468] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:44:03.038021 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ee691362-3c95-4c43-9baa-d92d0c7f04dd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "DELETE /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 204 len: 0 microversion: 2.1 time: 0.141211 Aug 25 14:44:03.038622 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3699/7469] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:44:02 2022] DELETE /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:44:03.047629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cb21821f-2883-487c-b4d5-c7f5f0551b61 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:03.049338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cb21821f-2883-487c-b4d5-c7f5f0551b61 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:03.056802 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb21821f-2883-487c-b4d5-c7f5f0551b61 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:03.057804 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb21821f-2883-487c-b4d5-c7f5f0551b61 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:03.058472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb21821f-2883-487c-b4d5-c7f5f0551b61 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:03.059906 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb21821f-2883-487c-b4d5-c7f5f0551b61 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:03.060555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb21821f-2883-487c-b4d5-c7f5f0551b61 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:03.061175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cb21821f-2883-487c-b4d5-c7f5f0551b61 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:03.229854 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cb21821f-2883-487c-b4d5-c7f5f0551b61 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:03.238507 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cb21821f-2883-487c-b4d5-c7f5f0551b61 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.195303 Aug 25 14:44:03.239105 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3771/7470] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:03 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:04.261795 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0517d20c-da3d-4be0-bbf3-ff665e9136bd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:04.262542 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0517d20c-da3d-4be0-bbf3-ff665e9136bd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:04.270734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0517d20c-da3d-4be0-bbf3-ff665e9136bd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:04.271254 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0517d20c-da3d-4be0-bbf3-ff665e9136bd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:04.271723 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0517d20c-da3d-4be0-bbf3-ff665e9136bd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:04.272461 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0517d20c-da3d-4be0-bbf3-ff665e9136bd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:04.272945 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0517d20c-da3d-4be0-bbf3-ff665e9136bd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:04.273399 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0517d20c-da3d-4be0-bbf3-ff665e9136bd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:04.519995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0517d20c-da3d-4be0-bbf3-ff665e9136bd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:04.528246 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0517d20c-da3d-4be0-bbf3-ff665e9136bd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1682 microversion: 2.1 time: 0.270943 Aug 25 14:44:04.528844 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3700/7471] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:04 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1682 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:05.314504 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-5fb683cd-e511-41cd-95b3-4b1cd47857bf req-cf79c7d9-e91c-4d0b-b71a-12dceea59dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e5055b-e5a2-4e75-b1f1-65b137bb6968", "name": "network-vif-deleted", "tag": "dd4738bd-b563-41bb-b1b3-d96a6fa48e73"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:44:05.326111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5fb683cd-e511-41cd-95b3-4b1cd47857bf req-cf79c7d9-e91c-4d0b-b71a-12dceea59dc3 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:05.326601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5fb683cd-e511-41cd-95b3-4b1cd47857bf req-cf79c7d9-e91c-4d0b-b71a-12dceea59dc3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:05.327044 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-5fb683cd-e511-41cd-95b3-4b1cd47857bf req-cf79c7d9-e91c-4d0b-b71a-12dceea59dc3 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:05.339827 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-5fb683cd-e511-41cd-95b3-4b1cd47857bf req-cf79c7d9-e91c-4d0b-b71a-12dceea59dc3 service nova] Creating event network-vif-deleted:dd4738bd-b563-41bb-b1b3-d96a6fa48e73 for instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 on n-h1-852771-8 Aug 25 14:44:05.345465 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-5fb683cd-e511-41cd-95b3-4b1cd47857bf req-cf79c7d9-e91c-4d0b-b71a-12dceea59dc3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035260 Aug 25 14:44:05.346095 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3772/7472] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:44:05.550420 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:05.551027 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:05.558142 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:05.558658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:05.559126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:05.559887 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:05.560372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:05.560821 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:05.595891 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:05.596563 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:05.597035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:05.597537 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lazy-loading 'fault' on Instance uuid 16e5055b-e5a2-4e75-b1f1-65b137bb6968 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:44:05.650492 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:05.659173 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-53abd8db-f47c-4ba3-b40d-459ea6120712 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 200 len: 1337 microversion: 2.1 time: 0.112642 Aug 25 14:44:05.660184 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3701/7473] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:05 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:06.681737 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:06.682440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: 16e5055b-e5a2-4e75-b1f1-65b137bb6968] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:06.689220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:06.689816 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:06.690260 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:06.690957 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:06.691413 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:06.691839 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:06.707091 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] HTTP exception thrown: Instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 could not be found. Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Request method failure captured: Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 HTTP/1.1 Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4lr53WOTbyLKEhVmtQmHeNjZTwv_jwqeGRXM4SgxjdDf-yNj7SpLIQd0h_Kolj8TxD9r5G2C_UD0ASRdu_kx-zwXuZp-HLRqig99jlcY8yRjiGvyDoja8pebOyPcrg_PcU2dWIp3dl2C5PjvtCUSxCzgN_mRxqcgzOd8ZkQxj7TZck Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 17d73e05470d4babbd7089e302a2a96b Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestShelveInstance-1318692431 Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/17d73e05470d4babbd7089e302a2a96b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_17d73e05470d4babbd7089e302a2a96b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/17d73e05470d4babbd7089e302a2a96b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/17d73e05470d4babbd7089e302a2a96b"}]}] Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestShelveInstance-1318692431 Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 17d73e05470d4babbd7089e302a2a96b Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestShelveInstance-1318692431 Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestShelveInstance-1318692431-project Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e316e541ea6e441483b2ed3c1a3f94c8 Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestShelveInstance-1318692431-project Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 could not be found. Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': '16e5055b-e5a2-4e75-b1f1-65b137bb6968'} Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 could not be found. Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 could not be found. Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:44:06.709036 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:44:06.714323 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:44:06.714323 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:44:06.714323 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:44:06.714323 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:44:06.714323 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:44:06.714323 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 could not be found. Aug 25 14:44:06.714323 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:44:06.714323 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Returning 404 to user: Instance 16e5055b-e5a2-4e75-b1f1-65b137bb6968 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:44:06.714323 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e50f8c46-51c7-410c-940f-a9d1b7f87209 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968" status: 404 len: 111 microversion: 2.1 time: 0.033891 Aug 25 14:44:06.714323 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3773/7474] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:06 2022] GET /compute/v2.1/servers/16e5055b-e5a2-4e75-b1f1-65b137bb6968 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:44:06.894786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5c4d831e-ca8a-4d1f-9f9d-1af55725cc7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '.version_select at 0x7f3a29265310>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:06.925280 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5c4d831e-ca8a-4d1f-9f9d-1af55725cc7b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1477176397" status: 202 len: 0 microversion: 2.1 time: 0.035098 Aug 25 14:44:06.926219 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3702/7475] 10.222.0.70 () {58 vars in 1254 bytes} [Thu Aug 25 14:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1477176397 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:44:06.953328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7c76f37-d7d1-44df-901a-24b202749d83 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Action: 'create', calling method: .version_select at 0x7f3a292be5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-456678415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYZN+Ema4YcJAGa4mGstDo3MNaYu7jXEB91wHbdPF0TUAL0tz6bbMphOU6GLb1KZXyHd+rHzM+ASHf0fXtKP7gSiCdra3QCvyq/kx7iUUE3mU5H0DK15ztusyfjl7QRAw=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:44:06.972708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b7c76f37-d7d1-44df-901a-24b202749d83 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Getting quotas for project 17d73e05470d4babbd7089e302a2a96b. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:44:06.977953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-b7c76f37-d7d1-44df-901a-24b202749d83 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Getting quotas for user e316e541ea6e441483b2ed3c1a3f94c8 and project 17d73e05470d4babbd7089e302a2a96b. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:44:07.007099 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b7c76f37-d7d1-44df-901a-24b202749d83 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.057771 Aug 25 14:44:07.007710 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3774/7476] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:44:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:44:24.295760 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1565515774", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-456678415", "security_groups": [{"name": "tempest-secgroup-smoke-1791853664"}], "networks": [{"uuid": "ae97fe34-132a-4b2d-9602-92ff1011ccf1"}], "block_device_mapping_v2": [{"uuid": "abec3028-8d4e-46d2-aa35-ec91ba97656f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:44:24.308450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:24.309123 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:24.422173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] validate_networks() for [('ae97fe34-132a-4b2d-9602-92ff1011ccf1', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:44:24.913110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:44:24.913584 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:44:24.914113 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:44:24.914545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:44:24.915038 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:44:24.928913 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:24.929429 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:24.929955 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:24.930735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:24.931347 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:24.931806 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:24.953351 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Getting quotas for project 17d73e05470d4babbd7089e302a2a96b. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:44:24.965386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Getting quotas for user e316e541ea6e441483b2ed3c1a3f94c8 and project 17d73e05470d4babbd7089e302a2a96b. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:44:25.030631 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:44:25.032785 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abec3028-8d4e-46d2-aa35-ec91ba97656f',volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:44:25.181253 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b72fc590-36f2-469f-9d5e-caa0642388a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.889412 Aug 25 14:44:25.183152 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3703/7477] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:44:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:44:25.190941 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=12 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:25.191864 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=4 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:25.192570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:25.196634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ddfa2d13-730b-490d-b015-625ec70d6efc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:25.197623 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ddfa2d13-730b-490d-b015-625ec70d6efc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:25.259750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ddfa2d13-730b-490d-b015-625ec70d6efc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:25.267442 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ddfa2d13-730b-490d-b015-625ec70d6efc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1088 microversion: 2.1 time: 0.078273 Aug 25 14:44:25.268032 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3775/7478] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:25 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:44:26.290310 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7b45a8bc-57ee-4dd0-9d3a-3ce3930a4b77 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:26.290967 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7b45a8bc-57ee-4dd0-9d3a-3ce3930a4b77 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:26.298065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b45a8bc-57ee-4dd0-9d3a-3ce3930a4b77 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:26.298590 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b45a8bc-57ee-4dd0-9d3a-3ce3930a4b77 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:26.299439 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b45a8bc-57ee-4dd0-9d3a-3ce3930a4b77 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:26.299921 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b45a8bc-57ee-4dd0-9d3a-3ce3930a4b77 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:26.300894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b45a8bc-57ee-4dd0-9d3a-3ce3930a4b77 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:26.303421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7b45a8bc-57ee-4dd0-9d3a-3ce3930a4b77 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:26.376566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7b45a8bc-57ee-4dd0-9d3a-3ce3930a4b77 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:26.392661 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7b45a8bc-57ee-4dd0-9d3a-3ce3930a4b77 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1194 microversion: 2.1 time: 0.107459 Aug 25 14:44:26.398671 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3704/7479] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:26 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1194 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:27.415990 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-848c9ff2-4d4f-4c2d-bff8-b79334dc2899 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:27.416558 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-848c9ff2-4d4f-4c2d-bff8-b79334dc2899 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:27.423517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848c9ff2-4d4f-4c2d-bff8-b79334dc2899 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:27.424010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848c9ff2-4d4f-4c2d-bff8-b79334dc2899 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:27.424657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848c9ff2-4d4f-4c2d-bff8-b79334dc2899 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:27.426141 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848c9ff2-4d4f-4c2d-bff8-b79334dc2899 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:27.426629 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848c9ff2-4d4f-4c2d-bff8-b79334dc2899 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:27.427143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-848c9ff2-4d4f-4c2d-bff8-b79334dc2899 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:27.588603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-848c9ff2-4d4f-4c2d-bff8-b79334dc2899 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:27.598206 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-848c9ff2-4d4f-4c2d-bff8-b79334dc2899 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1272 microversion: 2.1 time: 0.186310 Aug 25 14:44:27.599065 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3776/7480] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:27 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:27.779570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-43cd8ffc-4dfc-43b7-be07-5235c5fc6012 req-05bb3e2c-07df-4bfa-9f31-8dd66f614d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8986f4b-552d-482c-8a2e-c0383cb92b81", "tag": "ade73f8d-47ef-4ac3-bbaf-4478be0cb28f"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:44:27.793478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-43cd8ffc-4dfc-43b7-be07-5235c5fc6012 req-05bb3e2c-07df-4bfa-9f31-8dd66f614d6b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:27.794296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-43cd8ffc-4dfc-43b7-be07-5235c5fc6012 req-05bb3e2c-07df-4bfa-9f31-8dd66f614d6b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:27.794949 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-43cd8ffc-4dfc-43b7-be07-5235c5fc6012 req-05bb3e2c-07df-4bfa-9f31-8dd66f614d6b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:27.811452 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-43cd8ffc-4dfc-43b7-be07-5235c5fc6012 req-05bb3e2c-07df-4bfa-9f31-8dd66f614d6b service nova] Creating event network-changed:ade73f8d-47ef-4ac3-bbaf-4478be0cb28f for instance a8986f4b-552d-482c-8a2e-c0383cb92b81 on n-h2-852771-8 Aug 25 14:44:27.818533 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-43cd8ffc-4dfc-43b7-be07-5235c5fc6012 req-05bb3e2c-07df-4bfa-9f31-8dd66f614d6b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045242 Aug 25 14:44:27.819760 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3705/7481] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:44:28.621401 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8c4c9596-de35-470c-b26f-3d088c7165ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:28.622064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8c4c9596-de35-470c-b26f-3d088c7165ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:28.630109 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c4c9596-de35-470c-b26f-3d088c7165ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:28.630779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c4c9596-de35-470c-b26f-3d088c7165ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:28.631026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c4c9596-de35-470c-b26f-3d088c7165ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:28.631740 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c4c9596-de35-470c-b26f-3d088c7165ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:28.632205 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c4c9596-de35-470c-b26f-3d088c7165ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:28.632852 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8c4c9596-de35-470c-b26f-3d088c7165ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:28.794709 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8c4c9596-de35-470c-b26f-3d088c7165ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:28.804077 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8c4c9596-de35-470c-b26f-3d088c7165ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1272 microversion: 2.1 time: 0.186991 Aug 25 14:44:28.804789 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3777/7482] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:28 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:29.825997 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7520e9dc-dd79-4b5c-b982-cb9ad99e6cad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:29.826872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7520e9dc-dd79-4b5c-b982-cb9ad99e6cad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:29.834404 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7520e9dc-dd79-4b5c-b982-cb9ad99e6cad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:29.836880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7520e9dc-dd79-4b5c-b982-cb9ad99e6cad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:29.836880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7520e9dc-dd79-4b5c-b982-cb9ad99e6cad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:29.836880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7520e9dc-dd79-4b5c-b982-cb9ad99e6cad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:29.836880 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7520e9dc-dd79-4b5c-b982-cb9ad99e6cad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:29.837342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7520e9dc-dd79-4b5c-b982-cb9ad99e6cad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:29.980510 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7520e9dc-dd79-4b5c-b982-cb9ad99e6cad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:29.988998 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7520e9dc-dd79-4b5c-b982-cb9ad99e6cad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1272 microversion: 2.1 time: 0.168283 Aug 25 14:44:29.989643 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3706/7483] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:29 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:44:31.010356 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-e1d05fce-1b15-4b4e-af29-27173e1b1a7d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:31.011152 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-e1d05fce-1b15-4b4e-af29-27173e1b1a7d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:31.017536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d05fce-1b15-4b4e-af29-27173e1b1a7d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:31.018026 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d05fce-1b15-4b4e-af29-27173e1b1a7d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:31.018468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d05fce-1b15-4b4e-af29-27173e1b1a7d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:31.019325 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d05fce-1b15-4b4e-af29-27173e1b1a7d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:31.019793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d05fce-1b15-4b4e-af29-27173e1b1a7d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:31.020225 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-e1d05fce-1b15-4b4e-af29-27173e1b1a7d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:31.163218 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-e1d05fce-1b15-4b4e-af29-27173e1b1a7d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:31.171614 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-e1d05fce-1b15-4b4e-af29-27173e1b1a7d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1272 microversion: 2.1 time: 0.165389 Aug 25 14:44:31.172203 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3778/7484] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:31 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:44:32.194350 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9ec1ad7e-4072-47f5-ac7c-40c5d483760d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:32.194986 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9ec1ad7e-4072-47f5-ac7c-40c5d483760d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:32.201788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ec1ad7e-4072-47f5-ac7c-40c5d483760d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:32.202295 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ec1ad7e-4072-47f5-ac7c-40c5d483760d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:32.202758 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ec1ad7e-4072-47f5-ac7c-40c5d483760d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:32.203481 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ec1ad7e-4072-47f5-ac7c-40c5d483760d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:32.203957 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ec1ad7e-4072-47f5-ac7c-40c5d483760d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:32.204407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9ec1ad7e-4072-47f5-ac7c-40c5d483760d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:32.343474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9ec1ad7e-4072-47f5-ac7c-40c5d483760d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:32.352078 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9ec1ad7e-4072-47f5-ac7c-40c5d483760d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.162379 Aug 25 14:44:32.352669 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3707/7485] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:32 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:33.371991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-adc4900f-476c-478a-9f5e-28642d146e62 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:33.372741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-adc4900f-476c-478a-9f5e-28642d146e62 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:33.380830 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adc4900f-476c-478a-9f5e-28642d146e62 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:33.381365 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adc4900f-476c-478a-9f5e-28642d146e62 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:33.381808 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adc4900f-476c-478a-9f5e-28642d146e62 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:33.382523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adc4900f-476c-478a-9f5e-28642d146e62 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:33.382988 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adc4900f-476c-478a-9f5e-28642d146e62 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:33.383423 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adc4900f-476c-478a-9f5e-28642d146e62 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:33.524014 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-adc4900f-476c-478a-9f5e-28642d146e62 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:33.531885 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-adc4900f-476c-478a-9f5e-28642d146e62 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.163803 Aug 25 14:44:33.532469 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3779/7486] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:33 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:34.553610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0175a11c-b2c9-4818-82bb-fb656b5005f8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:34.554272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0175a11c-b2c9-4818-82bb-fb656b5005f8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:34.561270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0175a11c-b2c9-4818-82bb-fb656b5005f8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:34.561812 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0175a11c-b2c9-4818-82bb-fb656b5005f8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:34.562277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0175a11c-b2c9-4818-82bb-fb656b5005f8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:34.563000 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0175a11c-b2c9-4818-82bb-fb656b5005f8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:34.563476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0175a11c-b2c9-4818-82bb-fb656b5005f8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:34.563922 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0175a11c-b2c9-4818-82bb-fb656b5005f8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:34.709514 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0175a11c-b2c9-4818-82bb-fb656b5005f8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:34.717547 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0175a11c-b2c9-4818-82bb-fb656b5005f8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.168612 Aug 25 14:44:34.718151 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3708/7487] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:34 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:35.738775 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4c0c8a21-96fd-4291-b407-cc8439c2e16f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:35.739364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4c0c8a21-96fd-4291-b407-cc8439c2e16f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:35.742495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:35.748039 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0c8a21-96fd-4291-b407-cc8439c2e16f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:35.749113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0c8a21-96fd-4291-b407-cc8439c2e16f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:35.749113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0c8a21-96fd-4291-b407-cc8439c2e16f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:35.749652 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0c8a21-96fd-4291-b407-cc8439c2e16f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:35.750105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0c8a21-96fd-4291-b407-cc8439c2e16f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:35.750528 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4c0c8a21-96fd-4291-b407-cc8439c2e16f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:35.890992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4c0c8a21-96fd-4291-b407-cc8439c2e16f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:35.898931 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4c0c8a21-96fd-4291-b407-cc8439c2e16f tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.164079 Aug 25 14:44:35.899517 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3780/7488] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:35 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:36.918984 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2344dea8-6a5e-42f4-9cbe-9c1fa0616e2b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:36.919605 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2344dea8-6a5e-42f4-9cbe-9c1fa0616e2b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:36.921659 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:36.922482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:44:36.930018 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2344dea8-6a5e-42f4-9cbe-9c1fa0616e2b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:36.930535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2344dea8-6a5e-42f4-9cbe-9c1fa0616e2b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:36.930993 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2344dea8-6a5e-42f4-9cbe-9c1fa0616e2b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:36.931748 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2344dea8-6a5e-42f4-9cbe-9c1fa0616e2b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:36.932356 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2344dea8-6a5e-42f4-9cbe-9c1fa0616e2b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:36.932808 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2344dea8-6a5e-42f4-9cbe-9c1fa0616e2b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:37.067386 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2344dea8-6a5e-42f4-9cbe-9c1fa0616e2b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:37.075558 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2344dea8-6a5e-42f4-9cbe-9c1fa0616e2b tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.160490 Aug 25 14:44:37.076153 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3709/7489] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:36 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:44:38.096831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-1f4142d4-b1e6-4752-9506-f6bef545f26c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:38.097600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-1f4142d4-b1e6-4752-9506-f6bef545f26c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:38.104688 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4142d4-b1e6-4752-9506-f6bef545f26c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:38.105183 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4142d4-b1e6-4752-9506-f6bef545f26c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:38.105668 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4142d4-b1e6-4752-9506-f6bef545f26c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:38.106378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4142d4-b1e6-4752-9506-f6bef545f26c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:38.106837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4142d4-b1e6-4752-9506-f6bef545f26c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:38.107269 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-1f4142d4-b1e6-4752-9506-f6bef545f26c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:38.241875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-1f4142d4-b1e6-4752-9506-f6bef545f26c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:38.249977 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-1f4142d4-b1e6-4752-9506-f6bef545f26c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.156969 Aug 25 14:44:38.250582 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3781/7490] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:38 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:39.271173 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b67b6d38-fa25-4d39-896c-d049bc4c429c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:39.271823 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b67b6d38-fa25-4d39-896c-d049bc4c429c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:39.279564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b67b6d38-fa25-4d39-896c-d049bc4c429c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:39.280055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b67b6d38-fa25-4d39-896c-d049bc4c429c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:39.280507 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b67b6d38-fa25-4d39-896c-d049bc4c429c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:39.281218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b67b6d38-fa25-4d39-896c-d049bc4c429c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:39.281719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b67b6d38-fa25-4d39-896c-d049bc4c429c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:39.282161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b67b6d38-fa25-4d39-896c-d049bc4c429c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:39.422340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b67b6d38-fa25-4d39-896c-d049bc4c429c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:39.431296 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b67b6d38-fa25-4d39-896c-d049bc4c429c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.164079 Aug 25 14:44:39.431873 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3710/7491] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:39 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:40.452349 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc81cc71-bb19-4db2-9458-33b0c932cf51 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:40.452975 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc81cc71-bb19-4db2-9458-33b0c932cf51 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:40.460911 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc81cc71-bb19-4db2-9458-33b0c932cf51 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:40.461404 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc81cc71-bb19-4db2-9458-33b0c932cf51 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:40.461887 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc81cc71-bb19-4db2-9458-33b0c932cf51 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:40.462592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc81cc71-bb19-4db2-9458-33b0c932cf51 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:40.463053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc81cc71-bb19-4db2-9458-33b0c932cf51 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:40.463486 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc81cc71-bb19-4db2-9458-33b0c932cf51 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:40.599972 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cc81cc71-bb19-4db2-9458-33b0c932cf51 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:40.607899 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc81cc71-bb19-4db2-9458-33b0c932cf51 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.159465 Aug 25 14:44:40.608481 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3782/7492] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:40 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:41.629693 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-87bb0e30-6ca0-48b7-9b67-337a555edd63 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:41.630302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-87bb0e30-6ca0-48b7-9b67-337a555edd63 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:41.637302 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bb0e30-6ca0-48b7-9b67-337a555edd63 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:41.637838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bb0e30-6ca0-48b7-9b67-337a555edd63 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:41.638300 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bb0e30-6ca0-48b7-9b67-337a555edd63 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:41.639011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bb0e30-6ca0-48b7-9b67-337a555edd63 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:41.639484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bb0e30-6ca0-48b7-9b67-337a555edd63 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:41.639929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-87bb0e30-6ca0-48b7-9b67-337a555edd63 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:41.781313 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-87bb0e30-6ca0-48b7-9b67-337a555edd63 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:41.790001 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-87bb0e30-6ca0-48b7-9b67-337a555edd63 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.164850 Aug 25 14:44:41.790588 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3711/7493] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:41 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:42.811531 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-82ceb24c-3292-4312-8d63-bdc56b7c5656 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:42.812150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-82ceb24c-3292-4312-8d63-bdc56b7c5656 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:42.819391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82ceb24c-3292-4312-8d63-bdc56b7c5656 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:42.819879 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82ceb24c-3292-4312-8d63-bdc56b7c5656 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:42.820320 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82ceb24c-3292-4312-8d63-bdc56b7c5656 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:42.821027 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82ceb24c-3292-4312-8d63-bdc56b7c5656 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:42.821483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82ceb24c-3292-4312-8d63-bdc56b7c5656 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:42.821942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-82ceb24c-3292-4312-8d63-bdc56b7c5656 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:42.960468 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-82ceb24c-3292-4312-8d63-bdc56b7c5656 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:42.968607 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-82ceb24c-3292-4312-8d63-bdc56b7c5656 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.161031 Aug 25 14:44:42.969195 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3783/7494] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:42 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:43.991516 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-748ef2af-a4b9-4ac3-8432-e66ea81848fe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:43.992161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-748ef2af-a4b9-4ac3-8432-e66ea81848fe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:44.000082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-748ef2af-a4b9-4ac3-8432-e66ea81848fe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:44.000707 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-748ef2af-a4b9-4ac3-8432-e66ea81848fe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:44.001272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-748ef2af-a4b9-4ac3-8432-e66ea81848fe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:44.002061 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-748ef2af-a4b9-4ac3-8432-e66ea81848fe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:44.002547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-748ef2af-a4b9-4ac3-8432-e66ea81848fe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:44.003050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-748ef2af-a4b9-4ac3-8432-e66ea81848fe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:44.147850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-748ef2af-a4b9-4ac3-8432-e66ea81848fe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:44.155843 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-748ef2af-a4b9-4ac3-8432-e66ea81848fe tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.169293 Aug 25 14:44:44.156431 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3712/7495] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:43 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:44.329622 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f46c8881-4293-4cf8-a88b-985583868b4c req-1fecdafa-5592-4094-a734-084e450c2175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8986f4b-552d-482c-8a2e-c0383cb92b81", "name": "network-vif-plugged", "status": "completed", "tag": "ade73f8d-47ef-4ac3-bbaf-4478be0cb28f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:44:44.341086 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f46c8881-4293-4cf8-a88b-985583868b4c req-1fecdafa-5592-4094-a734-084e450c2175 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:44.341598 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f46c8881-4293-4cf8-a88b-985583868b4c req-1fecdafa-5592-4094-a734-084e450c2175 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:44.342033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f46c8881-4293-4cf8-a88b-985583868b4c req-1fecdafa-5592-4094-a734-084e450c2175 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:44.354870 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f46c8881-4293-4cf8-a88b-985583868b4c req-1fecdafa-5592-4094-a734-084e450c2175 service nova] Creating event network-vif-plugged:ade73f8d-47ef-4ac3-bbaf-4478be0cb28f for instance a8986f4b-552d-482c-8a2e-c0383cb92b81 on n-h2-852771-8 Aug 25 14:44:44.360362 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f46c8881-4293-4cf8-a88b-985583868b4c req-1fecdafa-5592-4094-a734-084e450c2175 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034592 Aug 25 14:44:44.360974 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3784/7496] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:44:45.180187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4136fe1a-072e-4864-ae3a-7524138e80ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:45.180848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4136fe1a-072e-4864-ae3a-7524138e80ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:45.188407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4136fe1a-072e-4864-ae3a-7524138e80ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:45.188916 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4136fe1a-072e-4864-ae3a-7524138e80ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:45.189364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4136fe1a-072e-4864-ae3a-7524138e80ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:45.190129 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4136fe1a-072e-4864-ae3a-7524138e80ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:45.191119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4136fe1a-072e-4864-ae3a-7524138e80ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:45.191564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4136fe1a-072e-4864-ae3a-7524138e80ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:45.336591 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4136fe1a-072e-4864-ae3a-7524138e80ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:45.344605 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4136fe1a-072e-4864-ae3a-7524138e80ee tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1260 microversion: 2.1 time: 0.170015 Aug 25 14:44:45.345194 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3713/7497] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:45 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:46.368337 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0a94a4fc-eadf-4056-b02d-d582dbecc173 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:46.369069 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0a94a4fc-eadf-4056-b02d-d582dbecc173 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:46.376280 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a94a4fc-eadf-4056-b02d-d582dbecc173 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:46.377236 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a94a4fc-eadf-4056-b02d-d582dbecc173 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:46.378120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a94a4fc-eadf-4056-b02d-d582dbecc173 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:46.379466 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a94a4fc-eadf-4056-b02d-d582dbecc173 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:46.380335 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a94a4fc-eadf-4056-b02d-d582dbecc173 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:46.381169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0a94a4fc-eadf-4056-b02d-d582dbecc173 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:46.526209 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0a94a4fc-eadf-4056-b02d-d582dbecc173 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:46.534224 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0a94a4fc-eadf-4056-b02d-d582dbecc173 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1444 microversion: 2.1 time: 0.171266 Aug 25 14:44:46.535615 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3785/7498] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:46 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1444 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:46.554788 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a6eb388f-ab3d-4cfd-ada7-beda60cd6fd7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:44:46.555432 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a6eb388f-ab3d-4cfd-ada7-beda60cd6fd7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:44:46.562465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6eb388f-ab3d-4cfd-ada7-beda60cd6fd7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:46.562977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6eb388f-ab3d-4cfd-ada7-beda60cd6fd7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:46.563449 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6eb388f-ab3d-4cfd-ada7-beda60cd6fd7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:46.564187 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6eb388f-ab3d-4cfd-ada7-beda60cd6fd7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:46.564670 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6eb388f-ab3d-4cfd-ada7-beda60cd6fd7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:46.565117 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a6eb388f-ab3d-4cfd-ada7-beda60cd6fd7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:46.709735 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a6eb388f-ab3d-4cfd-ada7-beda60cd6fd7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:44:46.717691 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a6eb388f-ab3d-4cfd-ada7-beda60cd6fd7 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1444 microversion: 2.1 time: 0.166800 Aug 25 14:44:46.718289 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3714/7499] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:44:46 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:44:48.740147 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-f006499a-0696-4de3-a56f-1ad756421653 req-3ec05fac-ad7b-4d67-98a9-c3fdc06bb944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8986f4b-552d-482c-8a2e-c0383cb92b81", "tag": "ade73f8d-47ef-4ac3-bbaf-4478be0cb28f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:44:48.750322 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f006499a-0696-4de3-a56f-1ad756421653 req-3ec05fac-ad7b-4d67-98a9-c3fdc06bb944 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:44:48.750803 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f006499a-0696-4de3-a56f-1ad756421653 req-3ec05fac-ad7b-4d67-98a9-c3fdc06bb944 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:44:48.751243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-f006499a-0696-4de3-a56f-1ad756421653 req-3ec05fac-ad7b-4d67-98a9-c3fdc06bb944 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:44:48.764297 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-f006499a-0696-4de3-a56f-1ad756421653 req-3ec05fac-ad7b-4d67-98a9-c3fdc06bb944 service nova] Creating event network-changed:ade73f8d-47ef-4ac3-bbaf-4478be0cb28f for instance a8986f4b-552d-482c-8a2e-c0383cb92b81 on n-h2-852771-8 Aug 25 14:44:48.770228 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-f006499a-0696-4de3-a56f-1ad756421653 req-3ec05fac-ad7b-4d67-98a9-c3fdc06bb944 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034519 Aug 25 14:44:48.770918 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3786/7500] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:46:44.209707 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [-] [745e3532-2cb0-4f99-b902-ef5e74eccfa3] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:46:44.210915 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ca47b9fd-db5f-4659-9198-232383143200] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:46:44.211739 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:46:44.212513 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=64 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:46:44.214043 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:46:44.214219 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81/action (ip 10.222.0.70) !!! Aug 25 14:46:44.215564 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:46:44.215693 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81/action (ip 10.222.0.70) !!! Aug 25 14:46:44.220541 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-823002b7-1305-4863-8132-4a610ce0613e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:46:44.221093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-823002b7-1305-4863-8132-4a610ce0613e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:44.230750 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-823002b7-1305-4863-8132-4a610ce0613e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:44.231249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-823002b7-1305-4863-8132-4a610ce0613e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:44.231703 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-823002b7-1305-4863-8132-4a610ce0613e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:44.232423 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-823002b7-1305-4863-8132-4a610ce0613e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:44.232899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-823002b7-1305-4863-8132-4a610ce0613e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:44.233340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-823002b7-1305-4863-8132-4a610ce0613e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:44.258336 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-823002b7-1305-4863-8132-4a610ce0613e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lazy-loading 'flavor' on Instance uuid a8986f4b-552d-482c-8a2e-c0383cb92b81 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:46:44.334182 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-823002b7-1305-4863-8132-4a610ce0613e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "POST /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81/action" status: 202 len: 0 microversion: 2.1 time: 0.126013 Aug 25 14:46:44.334806 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3715/7501] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:46:44 2022] POST /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:46:44.344019 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f63c0a0b-f433-4f36-b733-64add1270791] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:46:44.345356 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88c62c8a-2359-4afe-9127-87fbb298a4bd] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:46:44.346449 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=26 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:46:44.347902 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=58 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:46:44.349921 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:46:44.350118 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 (ip 10.222.0.70) !!! Aug 25 14:46:44.352068 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:46:44.352539 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 (ip 10.222.0.70) !!! Aug 25 14:46:44.364267 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d1420c3f-c723-4bea-8fde-b2a4e3c44ace tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:44.364986 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d1420c3f-c723-4bea-8fde-b2a4e3c44ace tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:44.375904 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1420c3f-c723-4bea-8fde-b2a4e3c44ace tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:44.376392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1420c3f-c723-4bea-8fde-b2a4e3c44ace tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:44.376826 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1420c3f-c723-4bea-8fde-b2a4e3c44ace tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:44.377758 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1420c3f-c723-4bea-8fde-b2a4e3c44ace tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:44.378281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1420c3f-c723-4bea-8fde-b2a4e3c44ace tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:44.378899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d1420c3f-c723-4bea-8fde-b2a4e3c44ace tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:44.645146 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d1420c3f-c723-4bea-8fde-b2a4e3c44ace tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:44.654304 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d1420c3f-c723-4bea-8fde-b2a4e3c44ace tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.313550 Aug 25 14:46:44.655109 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3787/7502] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:44 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:45.677658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5605dd72-1a6b-4202-854e-308de0e5f292 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:45.678294 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5605dd72-1a6b-4202-854e-308de0e5f292 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:45.690600 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5605dd72-1a6b-4202-854e-308de0e5f292 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:45.691116 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5605dd72-1a6b-4202-854e-308de0e5f292 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:45.691632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5605dd72-1a6b-4202-854e-308de0e5f292 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:45.692358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5605dd72-1a6b-4202-854e-308de0e5f292 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:45.692843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5605dd72-1a6b-4202-854e-308de0e5f292 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:45.693293 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5605dd72-1a6b-4202-854e-308de0e5f292 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:45.706528 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] [ca47b9fd-db5f-4659-9198-232383143200] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60072. Aug 25 14:46:45.718113 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] [745e3532-2cb0-4f99-b902-ef5e74eccfa3] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60070. Aug 25 14:46:45.925567 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5605dd72-1a6b-4202-854e-308de0e5f292 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:45.934368 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5605dd72-1a6b-4202-854e-308de0e5f292 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.261570 Aug 25 14:46:45.934968 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3716/7503] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:45 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:46.955659 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-53feec32-97ff-46a1-885f-7b8b816788d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:46.956276 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-53feec32-97ff-46a1-885f-7b8b816788d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:46.972110 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] [f63c0a0b-f433-4f36-b733-64add1270791] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60078. Aug 25 14:46:46.973439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53feec32-97ff-46a1-885f-7b8b816788d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:46.973977 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53feec32-97ff-46a1-885f-7b8b816788d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:46.974417 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53feec32-97ff-46a1-885f-7b8b816788d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:46.975125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53feec32-97ff-46a1-885f-7b8b816788d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:46.975578 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53feec32-97ff-46a1-885f-7b8b816788d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:46.976004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53feec32-97ff-46a1-885f-7b8b816788d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:46.976617 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] [88c62c8a-2359-4afe-9127-87fbb298a4bd] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60080. Aug 25 14:46:47.117924 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-53feec32-97ff-46a1-885f-7b8b816788d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:47.127087 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-53feec32-97ff-46a1-885f-7b8b816788d2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.175347 Aug 25 14:46:47.127668 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3788/7504] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:46 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:48.149103 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eec37969-bb76-4aa1-a009-a9d81c8fbece tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:48.149753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eec37969-bb76-4aa1-a009-a9d81c8fbece tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:48.157672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eec37969-bb76-4aa1-a009-a9d81c8fbece tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:48.158318 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eec37969-bb76-4aa1-a009-a9d81c8fbece tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:48.158632 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eec37969-bb76-4aa1-a009-a9d81c8fbece tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:48.159348 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eec37969-bb76-4aa1-a009-a9d81c8fbece tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:48.159822 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eec37969-bb76-4aa1-a009-a9d81c8fbece tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:48.160264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eec37969-bb76-4aa1-a009-a9d81c8fbece tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:48.298202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eec37969-bb76-4aa1-a009-a9d81c8fbece tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:48.316863 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eec37969-bb76-4aa1-a009-a9d81c8fbece tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.171222 Aug 25 14:46:48.317892 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3717/7505] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:48 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:49.339914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-0484c346-caaa-4c43-96a6-fd025b2b4313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:49.340527 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-0484c346-caaa-4c43-96a6-fd025b2b4313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:49.347599 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0484c346-caaa-4c43-96a6-fd025b2b4313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:49.348093 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0484c346-caaa-4c43-96a6-fd025b2b4313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:49.348534 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0484c346-caaa-4c43-96a6-fd025b2b4313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:49.349242 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0484c346-caaa-4c43-96a6-fd025b2b4313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:49.349739 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0484c346-caaa-4c43-96a6-fd025b2b4313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:49.350170 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-0484c346-caaa-4c43-96a6-fd025b2b4313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:49.521169 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-0484c346-caaa-4c43-96a6-fd025b2b4313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:49.529672 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-0484c346-caaa-4c43-96a6-fd025b2b4313 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.194478 Aug 25 14:46:49.530263 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3789/7506] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:49 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:50.551719 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9c5d28b6-ff62-477a-827f-d75443aee4b1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:50.552305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9c5d28b6-ff62-477a-827f-d75443aee4b1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:50.560268 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c5d28b6-ff62-477a-827f-d75443aee4b1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:50.560779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c5d28b6-ff62-477a-827f-d75443aee4b1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:50.561240 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c5d28b6-ff62-477a-827f-d75443aee4b1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:50.562008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c5d28b6-ff62-477a-827f-d75443aee4b1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:50.562488 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c5d28b6-ff62-477a-827f-d75443aee4b1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:50.562937 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9c5d28b6-ff62-477a-827f-d75443aee4b1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:50.711206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9c5d28b6-ff62-477a-827f-d75443aee4b1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:50.720520 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9c5d28b6-ff62-477a-827f-d75443aee4b1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.172797 Aug 25 14:46:50.721132 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3718/7507] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:50 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:51.742083 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-464a2cb1-100f-4cc5-907d-1c432e1d16cf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:51.742701 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-464a2cb1-100f-4cc5-907d-1c432e1d16cf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:51.750447 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-464a2cb1-100f-4cc5-907d-1c432e1d16cf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:51.750939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-464a2cb1-100f-4cc5-907d-1c432e1d16cf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:51.751383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-464a2cb1-100f-4cc5-907d-1c432e1d16cf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:51.752091 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-464a2cb1-100f-4cc5-907d-1c432e1d16cf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:51.752555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-464a2cb1-100f-4cc5-907d-1c432e1d16cf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:51.752991 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-464a2cb1-100f-4cc5-907d-1c432e1d16cf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:51.902282 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-464a2cb1-100f-4cc5-907d-1c432e1d16cf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:51.910455 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-464a2cb1-100f-4cc5-907d-1c432e1d16cf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.172280 Aug 25 14:46:51.911046 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3790/7508] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:51 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:52.932849 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a8302fad-5ab8-489d-9d7b-fa310fcb2018 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:52.933421 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a8302fad-5ab8-489d-9d7b-fa310fcb2018 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:52.940435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8302fad-5ab8-489d-9d7b-fa310fcb2018 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:52.940947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8302fad-5ab8-489d-9d7b-fa310fcb2018 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:52.941418 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8302fad-5ab8-489d-9d7b-fa310fcb2018 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:52.942183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8302fad-5ab8-489d-9d7b-fa310fcb2018 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:52.942672 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8302fad-5ab8-489d-9d7b-fa310fcb2018 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:52.943127 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a8302fad-5ab8-489d-9d7b-fa310fcb2018 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:53.084861 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-a8302fad-5ab8-489d-9d7b-fa310fcb2018 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:53.093767 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a8302fad-5ab8-489d-9d7b-fa310fcb2018 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.165158 Aug 25 14:46:53.094358 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3719/7509] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:52 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:54.115167 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-53d81495-cafa-40dc-9407-83be470ec180 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:54.115778 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-53d81495-cafa-40dc-9407-83be470ec180 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:54.123497 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53d81495-cafa-40dc-9407-83be470ec180 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:54.123980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53d81495-cafa-40dc-9407-83be470ec180 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:54.124415 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53d81495-cafa-40dc-9407-83be470ec180 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:54.125113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53d81495-cafa-40dc-9407-83be470ec180 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:54.125602 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53d81495-cafa-40dc-9407-83be470ec180 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:54.126033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-53d81495-cafa-40dc-9407-83be470ec180 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:54.269873 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-53d81495-cafa-40dc-9407-83be470ec180 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:54.279628 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-53d81495-cafa-40dc-9407-83be470ec180 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.168343 Aug 25 14:46:54.280213 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3791/7510] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:54 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:55.300702 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2c3082e5-be4c-4159-935b-9bcf9e51e003 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:55.301272 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2c3082e5-be4c-4159-935b-9bcf9e51e003 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:55.309422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c3082e5-be4c-4159-935b-9bcf9e51e003 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:55.310357 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c3082e5-be4c-4159-935b-9bcf9e51e003 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:55.310917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c3082e5-be4c-4159-935b-9bcf9e51e003 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:55.311658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c3082e5-be4c-4159-935b-9bcf9e51e003 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:55.312146 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c3082e5-be4c-4159-935b-9bcf9e51e003 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:55.312592 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2c3082e5-be4c-4159-935b-9bcf9e51e003 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:55.461617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2c3082e5-be4c-4159-935b-9bcf9e51e003 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:55.470717 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2c3082e5-be4c-4159-935b-9bcf9e51e003 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.174237 Aug 25 14:46:55.471290 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3720/7511] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:55 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:56.492150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-fad0097c-f56b-4b8a-8df2-82a2a1435b9d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:56.492831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-fad0097c-f56b-4b8a-8df2-82a2a1435b9d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:56.499850 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fad0097c-f56b-4b8a-8df2-82a2a1435b9d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:56.500339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fad0097c-f56b-4b8a-8df2-82a2a1435b9d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:56.500783 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fad0097c-f56b-4b8a-8df2-82a2a1435b9d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:56.501487 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fad0097c-f56b-4b8a-8df2-82a2a1435b9d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:56.502964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fad0097c-f56b-4b8a-8df2-82a2a1435b9d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:56.502964 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-fad0097c-f56b-4b8a-8df2-82a2a1435b9d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:56.645402 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-fad0097c-f56b-4b8a-8df2-82a2a1435b9d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:56.653631 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-fad0097c-f56b-4b8a-8df2-82a2a1435b9d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.165390 Aug 25 14:46:56.654232 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3792/7512] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:56 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:57.675991 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-eed79793-7ff4-4a88-98e8-879931cea1d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:57.676761 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-eed79793-7ff4-4a88-98e8-879931cea1d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:57.684182 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed79793-7ff4-4a88-98e8-879931cea1d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:57.685082 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed79793-7ff4-4a88-98e8-879931cea1d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:57.685674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed79793-7ff4-4a88-98e8-879931cea1d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:57.686410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed79793-7ff4-4a88-98e8-879931cea1d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:57.686883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed79793-7ff4-4a88-98e8-879931cea1d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:57.687331 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-eed79793-7ff4-4a88-98e8-879931cea1d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:57.852577 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-eed79793-7ff4-4a88-98e8-879931cea1d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:57.861925 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-eed79793-7ff4-4a88-98e8-879931cea1d9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.189851 Aug 25 14:46:57.862518 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3721/7513] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:57 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:58.884514 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-43af032f-7698-4a8c-b976-78da420441ad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:58.885340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-43af032f-7698-4a8c-b976-78da420441ad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:58.892781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43af032f-7698-4a8c-b976-78da420441ad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:58.893333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43af032f-7698-4a8c-b976-78da420441ad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:58.893810 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43af032f-7698-4a8c-b976-78da420441ad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:58.894525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43af032f-7698-4a8c-b976-78da420441ad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:58.894992 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43af032f-7698-4a8c-b976-78da420441ad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:58.895422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-43af032f-7698-4a8c-b976-78da420441ad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:59.053158 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-43af032f-7698-4a8c-b976-78da420441ad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:59.062940 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-43af032f-7698-4a8c-b976-78da420441ad tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1570 microversion: 2.1 time: 0.182475 Aug 25 14:46:59.063547 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3793/7514] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:58 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:46:59.099145 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-a202ebae-14bb-48c2-b1ed-6cd3ad8befca tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:46:59.099930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a202ebae-14bb-48c2-b1ed-6cd3ad8befca tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:59.107368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a202ebae-14bb-48c2-b1ed-6cd3ad8befca tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:59.108080 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a202ebae-14bb-48c2-b1ed-6cd3ad8befca tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:59.108529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a202ebae-14bb-48c2-b1ed-6cd3ad8befca tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:59.109802 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a202ebae-14bb-48c2-b1ed-6cd3ad8befca tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:59.110362 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a202ebae-14bb-48c2-b1ed-6cd3ad8befca tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:59.111176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-a202ebae-14bb-48c2-b1ed-6cd3ad8befca tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:59.163215 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-a202ebae-14bb-48c2-b1ed-6cd3ad8befca tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129059) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 14:46:59.240056 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-a202ebae-14bb-48c2-b1ed-6cd3ad8befca tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "POST /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81/action" status: 202 len: 0 microversion: 2.1 time: 0.145355 Aug 25 14:46:59.240943 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3722/7515] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:46:59 2022] POST /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:46:59.250770 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-afa29d0a-882a-4b2b-ac97-14c2bc9fd058 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:46:59.251387 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-afa29d0a-882a-4b2b-ac97-14c2bc9fd058 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:46:59.257635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa29d0a-882a-4b2b-ac97-14c2bc9fd058 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:59.259135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa29d0a-882a-4b2b-ac97-14c2bc9fd058 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:59.259583 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa29d0a-882a-4b2b-ac97-14c2bc9fd058 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:59.260470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa29d0a-882a-4b2b-ac97-14c2bc9fd058 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:46:59.260744 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa29d0a-882a-4b2b-ac97-14c2bc9fd058 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:46:59.261174 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-afa29d0a-882a-4b2b-ac97-14c2bc9fd058 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:46:59.414570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-afa29d0a-882a-4b2b-ac97-14c2bc9fd058 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:46:59.424209 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-afa29d0a-882a-4b2b-ac97-14c2bc9fd058 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1518 microversion: 2.1 time: 0.178480 Aug 25 14:46:59.428199 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3794/7516] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:46:59 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:00.453408 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-8d324001-15ef-4a40-94cc-6efef96af901 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:00.454139 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-8d324001-15ef-4a40-94cc-6efef96af901 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:00.460776 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d324001-15ef-4a40-94cc-6efef96af901 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:00.461391 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d324001-15ef-4a40-94cc-6efef96af901 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:00.461919 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d324001-15ef-4a40-94cc-6efef96af901 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:00.462502 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d324001-15ef-4a40-94cc-6efef96af901 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:00.462985 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d324001-15ef-4a40-94cc-6efef96af901 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:00.463452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-8d324001-15ef-4a40-94cc-6efef96af901 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:00.609881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-8d324001-15ef-4a40-94cc-6efef96af901 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:00.622299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-8d324001-15ef-4a40-94cc-6efef96af901 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1520 microversion: 2.1 time: 0.174011 Aug 25 14:47:00.623353 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3723/7517] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:00 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:00.974064 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-74d159c2-654f-440b-9f37-7a93a5cb288c req-3f63172e-80e7-41d1-b966-d3af35c5f3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8986f4b-552d-482c-8a2e-c0383cb92b81", "name": "network-vif-unplugged", "status": "completed", "tag": "ade73f8d-47ef-4ac3-bbaf-4478be0cb28f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:47:00.986606 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-74d159c2-654f-440b-9f37-7a93a5cb288c req-3f63172e-80e7-41d1-b966-d3af35c5f3a0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:00.987163 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-74d159c2-654f-440b-9f37-7a93a5cb288c req-3f63172e-80e7-41d1-b966-d3af35c5f3a0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:00.987891 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-74d159c2-654f-440b-9f37-7a93a5cb288c req-3f63172e-80e7-41d1-b966-d3af35c5f3a0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:01.005010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.compute.server_external_events [req-74d159c2-654f-440b-9f37-7a93a5cb288c req-3f63172e-80e7-41d1-b966-d3af35c5f3a0 service nova] Unable to find a host for instance a8986f4b-552d-482c-8a2e-c0383cb92b81. Dropping event network-vif-unplugged {{(pid=129060) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 14:47:01.006221 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-74d159c2-654f-440b-9f37-7a93a5cb288c req-3f63172e-80e7-41d1-b966-d3af35c5f3a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036664 Aug 25 14:47:01.006946 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3795/7518] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 14:47:01.647838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5fe9ee25-fce5-46f2-bf48-6c20bc5b819c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:01.648786 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5fe9ee25-fce5-46f2-bf48-6c20bc5b819c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:01.658064 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fe9ee25-fce5-46f2-bf48-6c20bc5b819c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:01.658733 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fe9ee25-fce5-46f2-bf48-6c20bc5b819c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:01.659308 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fe9ee25-fce5-46f2-bf48-6c20bc5b819c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:01.660364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fe9ee25-fce5-46f2-bf48-6c20bc5b819c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:01.661284 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fe9ee25-fce5-46f2-bf48-6c20bc5b819c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:01.662091 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5fe9ee25-fce5-46f2-bf48-6c20bc5b819c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:01.803782 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5fe9ee25-fce5-46f2-bf48-6c20bc5b819c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:01.813671 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5fe9ee25-fce5-46f2-bf48-6c20bc5b819c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1520 microversion: 2.1 time: 0.170773 Aug 25 14:47:01.814401 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3724/7519] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:01 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:02.836831 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-f885bccd-f7c4-46c0-80ce-6c14c2cbffc5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:02.837392 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-f885bccd-f7c4-46c0-80ce-6c14c2cbffc5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:02.845438 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f885bccd-f7c4-46c0-80ce-6c14c2cbffc5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:02.845963 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f885bccd-f7c4-46c0-80ce-6c14c2cbffc5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:02.846397 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f885bccd-f7c4-46c0-80ce-6c14c2cbffc5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:02.847101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f885bccd-f7c4-46c0-80ce-6c14c2cbffc5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:02.847560 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f885bccd-f7c4-46c0-80ce-6c14c2cbffc5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:02.847984 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-f885bccd-f7c4-46c0-80ce-6c14c2cbffc5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:02.997070 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-f885bccd-f7c4-46c0-80ce-6c14c2cbffc5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:03.005933 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-f885bccd-f7c4-46c0-80ce-6c14c2cbffc5 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1520 microversion: 2.1 time: 0.172927 Aug 25 14:47:03.005933 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3796/7520] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:02 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:04.028485 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-b15197a1-8393-4345-af08-119b1f031ce2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:04.029307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-b15197a1-8393-4345-af08-119b1f031ce2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:04.036677 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b15197a1-8393-4345-af08-119b1f031ce2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:04.037216 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b15197a1-8393-4345-af08-119b1f031ce2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:04.037688 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b15197a1-8393-4345-af08-119b1f031ce2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:04.038435 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b15197a1-8393-4345-af08-119b1f031ce2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:04.038917 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b15197a1-8393-4345-af08-119b1f031ce2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:04.039397 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-b15197a1-8393-4345-af08-119b1f031ce2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:04.182311 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-b15197a1-8393-4345-af08-119b1f031ce2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:04.191158 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-b15197a1-8393-4345-af08-119b1f031ce2 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1520 microversion: 2.1 time: 0.167212 Aug 25 14:47:04.191744 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3725/7521] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:04 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:05.214060 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ffa51f0b-043d-4315-af43-bfd50589728e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:05.214899 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ffa51f0b-043d-4315-af43-bfd50589728e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:05.222283 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffa51f0b-043d-4315-af43-bfd50589728e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:05.222779 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffa51f0b-043d-4315-af43-bfd50589728e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:05.223389 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffa51f0b-043d-4315-af43-bfd50589728e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:05.224523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffa51f0b-043d-4315-af43-bfd50589728e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:05.225358 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffa51f0b-043d-4315-af43-bfd50589728e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:05.225473 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ffa51f0b-043d-4315-af43-bfd50589728e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:05.372930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ffa51f0b-043d-4315-af43-bfd50589728e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:05.381839 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ffa51f0b-043d-4315-af43-bfd50589728e tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1520 microversion: 2.1 time: 0.173195 Aug 25 14:47:05.382441 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3797/7522] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:05 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:06.410151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3faeef60-b244-476f-a5e9-5457ef2865e0 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:06.410952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3faeef60-b244-476f-a5e9-5457ef2865e0 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:06.422905 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3faeef60-b244-476f-a5e9-5457ef2865e0 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:06.423538 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3faeef60-b244-476f-a5e9-5457ef2865e0 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:06.424009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3faeef60-b244-476f-a5e9-5457ef2865e0 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:06.424765 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3faeef60-b244-476f-a5e9-5457ef2865e0 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:06.425235 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3faeef60-b244-476f-a5e9-5457ef2865e0 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:06.425716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3faeef60-b244-476f-a5e9-5457ef2865e0 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:06.653003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3faeef60-b244-476f-a5e9-5457ef2865e0 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:06.664097 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3faeef60-b244-476f-a5e9-5457ef2865e0 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.263696 Aug 25 14:47:06.664837 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3726/7523] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:06 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:06.851367 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-2c373cb2-f6e8-48ba-a1ee-7f3ba4dbf5b3 req-8bedcb73-d62b-4147-bed6-dff7d347632b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8986f4b-552d-482c-8a2e-c0383cb92b81", "tag": "ade73f8d-47ef-4ac3-bbaf-4478be0cb28f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:47:06.861443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2c373cb2-f6e8-48ba-a1ee-7f3ba4dbf5b3 req-8bedcb73-d62b-4147-bed6-dff7d347632b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:06.862162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2c373cb2-f6e8-48ba-a1ee-7f3ba4dbf5b3 req-8bedcb73-d62b-4147-bed6-dff7d347632b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:06.862953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-2c373cb2-f6e8-48ba-a1ee-7f3ba4dbf5b3 req-8bedcb73-d62b-4147-bed6-dff7d347632b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:06.875925 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-2c373cb2-f6e8-48ba-a1ee-7f3ba4dbf5b3 req-8bedcb73-d62b-4147-bed6-dff7d347632b service nova] Creating event network-changed:ade73f8d-47ef-4ac3-bbaf-4478be0cb28f for instance a8986f4b-552d-482c-8a2e-c0383cb92b81 on n-h1-852771-8 Aug 25 14:47:06.881637 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-2c373cb2-f6e8-48ba-a1ee-7f3ba4dbf5b3 req-8bedcb73-d62b-4147-bed6-dff7d347632b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089778 Aug 25 14:47:06.882266 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3798/7524] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:47:07.686490 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5eb2aa7d-3fe3-42d3-a239-1e3417be09c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:07.687126 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5eb2aa7d-3fe3-42d3-a239-1e3417be09c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:07.694069 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eb2aa7d-3fe3-42d3-a239-1e3417be09c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:07.694578 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eb2aa7d-3fe3-42d3-a239-1e3417be09c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:07.695063 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eb2aa7d-3fe3-42d3-a239-1e3417be09c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:07.695787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eb2aa7d-3fe3-42d3-a239-1e3417be09c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:07.696266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eb2aa7d-3fe3-42d3-a239-1e3417be09c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:07.696714 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5eb2aa7d-3fe3-42d3-a239-1e3417be09c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:07.831657 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5eb2aa7d-3fe3-42d3-a239-1e3417be09c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:07.840065 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5eb2aa7d-3fe3-42d3-a239-1e3417be09c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.157807 Aug 25 14:47:07.840653 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3727/7525] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:07 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:08.863999 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c8e92511-e6e8-42f5-a051-6157744483c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:08.864705 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c8e92511-e6e8-42f5-a051-6157744483c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:08.871548 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8e92511-e6e8-42f5-a051-6157744483c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:08.872201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8e92511-e6e8-42f5-a051-6157744483c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:08.872646 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8e92511-e6e8-42f5-a051-6157744483c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:08.873383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8e92511-e6e8-42f5-a051-6157744483c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:08.873847 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8e92511-e6e8-42f5-a051-6157744483c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:08.874285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c8e92511-e6e8-42f5-a051-6157744483c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:09.062590 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c8e92511-e6e8-42f5-a051-6157744483c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:09.073193 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c8e92511-e6e8-42f5-a051-6157744483c8 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.214293 Aug 25 14:47:09.073853 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3799/7526] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:08 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:10.095641 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4ccc52c9-bd34-4d48-a3ed-234e5907ed3d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:10.096280 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4ccc52c9-bd34-4d48-a3ed-234e5907ed3d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:10.103375 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ccc52c9-bd34-4d48-a3ed-234e5907ed3d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:10.103886 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ccc52c9-bd34-4d48-a3ed-234e5907ed3d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:10.104353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ccc52c9-bd34-4d48-a3ed-234e5907ed3d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:10.105084 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ccc52c9-bd34-4d48-a3ed-234e5907ed3d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:10.105678 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ccc52c9-bd34-4d48-a3ed-234e5907ed3d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:10.106164 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4ccc52c9-bd34-4d48-a3ed-234e5907ed3d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:10.125452 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:47:10.249053 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4ccc52c9-bd34-4d48-a3ed-234e5907ed3d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:10.256983 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4ccc52c9-bd34-4d48-a3ed-234e5907ed3d tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.165330 Aug 25 14:47:10.257668 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3728/7527] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:10 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:11.279168 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8878a8b1-16d8-46ef-900d-d0a96cf5eafd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:11.279860 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8878a8b1-16d8-46ef-900d-d0a96cf5eafd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:11.286520 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8878a8b1-16d8-46ef-900d-d0a96cf5eafd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:11.287004 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8878a8b1-16d8-46ef-900d-d0a96cf5eafd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:11.287450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8878a8b1-16d8-46ef-900d-d0a96cf5eafd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:11.288224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8878a8b1-16d8-46ef-900d-d0a96cf5eafd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:11.288686 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8878a8b1-16d8-46ef-900d-d0a96cf5eafd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:11.289113 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8878a8b1-16d8-46ef-900d-d0a96cf5eafd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:11.430274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8878a8b1-16d8-46ef-900d-d0a96cf5eafd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:11.438731 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8878a8b1-16d8-46ef-900d-d0a96cf5eafd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.163885 Aug 25 14:47:11.439323 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3800/7528] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:11 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:12.461171 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-4a8dca38-d890-486e-afc4-4781d7c2bc13 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:12.461819 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-4a8dca38-d890-486e-afc4-4781d7c2bc13 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:12.469939 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a8dca38-d890-486e-afc4-4781d7c2bc13 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:12.470438 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a8dca38-d890-486e-afc4-4781d7c2bc13 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:12.470895 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a8dca38-d890-486e-afc4-4781d7c2bc13 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:12.471616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a8dca38-d890-486e-afc4-4781d7c2bc13 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:12.472094 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a8dca38-d890-486e-afc4-4781d7c2bc13 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:12.472534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-4a8dca38-d890-486e-afc4-4781d7c2bc13 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:12.613807 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-4a8dca38-d890-486e-afc4-4781d7c2bc13 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:12.622400 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-4a8dca38-d890-486e-afc4-4781d7c2bc13 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.165394 Aug 25 14:47:12.623000 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3729/7529] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:12 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:13.644942 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-df6830f7-b032-44b4-bade-e47e2b782f5a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:13.645562 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-df6830f7-b032-44b4-bade-e47e2b782f5a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:13.653656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6830f7-b032-44b4-bade-e47e2b782f5a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:13.654138 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6830f7-b032-44b4-bade-e47e2b782f5a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:13.654593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6830f7-b032-44b4-bade-e47e2b782f5a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:13.655375 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6830f7-b032-44b4-bade-e47e2b782f5a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:13.655845 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6830f7-b032-44b4-bade-e47e2b782f5a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:13.656297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-df6830f7-b032-44b4-bade-e47e2b782f5a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:13.797221 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-df6830f7-b032-44b4-bade-e47e2b782f5a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:13.805933 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-df6830f7-b032-44b4-bade-e47e2b782f5a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.165301 Aug 25 14:47:13.806547 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3801/7530] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:13 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:14.827883 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6cad393a-dd63-4b1c-ad4a-2b178ca57ad9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:14.828446 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6cad393a-dd63-4b1c-ad4a-2b178ca57ad9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:14.831188 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:47:14.837381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cad393a-dd63-4b1c-ad4a-2b178ca57ad9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:14.837885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cad393a-dd63-4b1c-ad4a-2b178ca57ad9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:14.838344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cad393a-dd63-4b1c-ad4a-2b178ca57ad9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:14.839066 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cad393a-dd63-4b1c-ad4a-2b178ca57ad9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:14.840194 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cad393a-dd63-4b1c-ad4a-2b178ca57ad9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:14.840787 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6cad393a-dd63-4b1c-ad4a-2b178ca57ad9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:14.981741 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6cad393a-dd63-4b1c-ad4a-2b178ca57ad9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:14.989900 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6cad393a-dd63-4b1c-ad4a-2b178ca57ad9 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.166329 Aug 25 14:47:14.990490 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3730/7531] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:14 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:16.011360 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-50ae731d-b61d-403c-a8a0-1526971adfb6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:16.012006 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-50ae731d-b61d-403c-a8a0-1526971adfb6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:16.014903 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=31 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:47:16.020053 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50ae731d-b61d-403c-a8a0-1526971adfb6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:16.020543 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50ae731d-b61d-403c-a8a0-1526971adfb6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:16.020982 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50ae731d-b61d-403c-a8a0-1526971adfb6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:16.021718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50ae731d-b61d-403c-a8a0-1526971adfb6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:16.022177 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50ae731d-b61d-403c-a8a0-1526971adfb6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:16.022600 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-50ae731d-b61d-403c-a8a0-1526971adfb6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:16.025760 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=83 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:47:16.161888 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-50ae731d-b61d-403c-a8a0-1526971adfb6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:16.170419 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-50ae731d-b61d-403c-a8a0-1526971adfb6 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.163280 Aug 25 14:47:16.171014 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3802/7532] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:16 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:17.193493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-44b021e6-aa6c-4929-86a7-ba45c94e51dc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:17.194149 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-44b021e6-aa6c-4929-86a7-ba45c94e51dc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:17.200971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b021e6-aa6c-4929-86a7-ba45c94e51dc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:17.201472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b021e6-aa6c-4929-86a7-ba45c94e51dc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:17.201965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b021e6-aa6c-4929-86a7-ba45c94e51dc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:17.202684 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b021e6-aa6c-4929-86a7-ba45c94e51dc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:17.203161 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b021e6-aa6c-4929-86a7-ba45c94e51dc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:17.203608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-44b021e6-aa6c-4929-86a7-ba45c94e51dc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:17.346381 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-44b021e6-aa6c-4929-86a7-ba45c94e51dc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:17.354221 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-44b021e6-aa6c-4929-86a7-ba45c94e51dc tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.164880 Aug 25 14:47:17.354802 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3731/7533] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:17 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:18.377536 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-2404380a-8a29-4fe0-ade4-5ef7a56ede11 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:18.378172 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-2404380a-8a29-4fe0-ade4-5ef7a56ede11 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:18.385025 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2404380a-8a29-4fe0-ade4-5ef7a56ede11 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:18.385533 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2404380a-8a29-4fe0-ade4-5ef7a56ede11 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:18.386021 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2404380a-8a29-4fe0-ade4-5ef7a56ede11 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:18.387641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2404380a-8a29-4fe0-ade4-5ef7a56ede11 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:18.388383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2404380a-8a29-4fe0-ade4-5ef7a56ede11 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:18.388821 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-2404380a-8a29-4fe0-ade4-5ef7a56ede11 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:18.533832 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-2404380a-8a29-4fe0-ade4-5ef7a56ede11 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:18.542304 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-2404380a-8a29-4fe0-ade4-5ef7a56ede11 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.169444 Aug 25 14:47:18.543764 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3803/7534] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:18 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:19.564674 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-593ba8db-76d2-4014-856b-a3d0b4310870 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:19.565372 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-593ba8db-76d2-4014-856b-a3d0b4310870 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:19.572425 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593ba8db-76d2-4014-856b-a3d0b4310870 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:19.572931 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593ba8db-76d2-4014-856b-a3d0b4310870 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:19.573395 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593ba8db-76d2-4014-856b-a3d0b4310870 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:19.574683 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593ba8db-76d2-4014-856b-a3d0b4310870 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:19.575264 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593ba8db-76d2-4014-856b-a3d0b4310870 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:19.575721 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-593ba8db-76d2-4014-856b-a3d0b4310870 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:19.718583 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-593ba8db-76d2-4014-856b-a3d0b4310870 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:19.727050 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-593ba8db-76d2-4014-856b-a3d0b4310870 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.166329 Aug 25 14:47:19.727644 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3732/7535] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:19 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:20.179240 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-011b192c-d07a-43a8-bbc4-3c1ac6d88ccf req-11d9eb00-c353-4650-9386-4e5afeebe0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8986f4b-552d-482c-8a2e-c0383cb92b81", "name": "network-vif-plugged", "status": "completed", "tag": "ade73f8d-47ef-4ac3-bbaf-4478be0cb28f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:47:20.201065 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-011b192c-d07a-43a8-bbc4-3c1ac6d88ccf req-11d9eb00-c353-4650-9386-4e5afeebe0f8 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:20.201679 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-011b192c-d07a-43a8-bbc4-3c1ac6d88ccf req-11d9eb00-c353-4650-9386-4e5afeebe0f8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:20.202333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-011b192c-d07a-43a8-bbc4-3c1ac6d88ccf req-11d9eb00-c353-4650-9386-4e5afeebe0f8 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:20.216305 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-011b192c-d07a-43a8-bbc4-3c1ac6d88ccf req-11d9eb00-c353-4650-9386-4e5afeebe0f8 service nova] Creating event network-vif-plugged:ade73f8d-47ef-4ac3-bbaf-4478be0cb28f for instance a8986f4b-552d-482c-8a2e-c0383cb92b81 on n-h1-852771-8 Aug 25 14:47:20.223637 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-011b192c-d07a-43a8-bbc4-3c1ac6d88ccf req-11d9eb00-c353-4650-9386-4e5afeebe0f8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048065 Aug 25 14:47:20.224432 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3804/7536] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:47:20.749353 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-d76dcdbd-b9fe-4611-8b8b-726ac54cd168 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:20.750136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-d76dcdbd-b9fe-4611-8b8b-726ac54cd168 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:20.757026 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76dcdbd-b9fe-4611-8b8b-726ac54cd168 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:20.757568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76dcdbd-b9fe-4611-8b8b-726ac54cd168 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:20.758037 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76dcdbd-b9fe-4611-8b8b-726ac54cd168 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:20.758763 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76dcdbd-b9fe-4611-8b8b-726ac54cd168 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:20.759249 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76dcdbd-b9fe-4611-8b8b-726ac54cd168 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:20.759709 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-d76dcdbd-b9fe-4611-8b8b-726ac54cd168 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:20.901344 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-d76dcdbd-b9fe-4611-8b8b-726ac54cd168 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:20.910292 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-d76dcdbd-b9fe-4611-8b8b-726ac54cd168 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1576 microversion: 2.1 time: 0.164910 Aug 25 14:47:20.910886 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3733/7537] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:20 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:47:21.934155 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ec5c6ec7-6f15-49a5-82e3-209eb59c6b02 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:47:21.935793 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ec5c6ec7-6f15-49a5-82e3-209eb59c6b02 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:47:21.942595 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5c6ec7-6f15-49a5-82e3-209eb59c6b02 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:21.943081 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5c6ec7-6f15-49a5-82e3-209eb59c6b02 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:21.943603 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5c6ec7-6f15-49a5-82e3-209eb59c6b02 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:21.944230 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5c6ec7-6f15-49a5-82e3-209eb59c6b02 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:47:21.944689 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5c6ec7-6f15-49a5-82e3-209eb59c6b02 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:47:21.945120 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ec5c6ec7-6f15-49a5-82e3-209eb59c6b02 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:47:22.093338 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ec5c6ec7-6f15-49a5-82e3-209eb59c6b02 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:47:22.101590 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ec5c6ec7-6f15-49a5-82e3-209eb59c6b02 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1563 microversion: 2.1 time: 0.172796 Aug 25 14:47:22.102146 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3805/7538] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:47:21 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:48:36.624658 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=7 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:48:36.625340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6b114565-e7e1-4d29-ab3b-adb244329e3a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:48:36.625340 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6b114565-e7e1-4d29-ab3b-adb244329e3a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:48:36.626933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=19 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:48:36.628882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=7 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:48:36.629621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=32 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:48:36.633574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-4c7f3cc0-9751-4e3c-bb55-d54c8216450f req-69ec7ef3-aa23-44dd-b77b-05e709e3fa9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8986f4b-552d-482c-8a2e-c0383cb92b81", "tag": "ade73f8d-47ef-4ac3-bbaf-4478be0cb28f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:48:36.634545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b114565-e7e1-4d29-ab3b-adb244329e3a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:36.635266 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b114565-e7e1-4d29-ab3b-adb244329e3a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:36.635720 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b114565-e7e1-4d29-ab3b-adb244329e3a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:36.636453 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b114565-e7e1-4d29-ab3b-adb244329e3a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:36.636930 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b114565-e7e1-4d29-ab3b-adb244329e3a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:36.637380 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6b114565-e7e1-4d29-ab3b-adb244329e3a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:36.649145 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4c7f3cc0-9751-4e3c-bb55-d54c8216450f req-69ec7ef3-aa23-44dd-b77b-05e709e3fa9b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:36.651792 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4c7f3cc0-9751-4e3c-bb55-d54c8216450f req-69ec7ef3-aa23-44dd-b77b-05e709e3fa9b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:36.652874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-4c7f3cc0-9751-4e3c-bb55-d54c8216450f req-69ec7ef3-aa23-44dd-b77b-05e709e3fa9b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:36.666760 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-4c7f3cc0-9751-4e3c-bb55-d54c8216450f req-69ec7ef3-aa23-44dd-b77b-05e709e3fa9b service nova] Creating event network-changed:ade73f8d-47ef-4ac3-bbaf-4478be0cb28f for instance a8986f4b-552d-482c-8a2e-c0383cb92b81 on n-h1-852771-8 Aug 25 14:48:36.671933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6b114565-e7e1-4d29-ab3b-adb244329e3a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Going to try to terminate instance {{(pid=129059) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:48:36.674104 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-4c7f3cc0-9751-4e3c-bb55-d54c8216450f req-69ec7ef3-aa23-44dd-b77b-05e709e3fa9b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052122 Aug 25 14:48:36.675958 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3806/7539] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:48:36.759962 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6b114565-e7e1-4d29-ab3b-adb244329e3a tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 204 len: 0 microversion: 2.1 time: 0.141141 Aug 25 14:48:36.760619 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3734/7540] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:48:36 2022] DELETE /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:48:36.772939 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b449750f-3568-4642-9a23-805a3ac9e8fb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:48:36.774047 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b449750f-3568-4642-9a23-805a3ac9e8fb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:48:36.782491 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b449750f-3568-4642-9a23-805a3ac9e8fb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:36.783442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b449750f-3568-4642-9a23-805a3ac9e8fb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:36.783442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b449750f-3568-4642-9a23-805a3ac9e8fb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:36.784262 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b449750f-3568-4642-9a23-805a3ac9e8fb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:36.784817 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b449750f-3568-4642-9a23-805a3ac9e8fb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:36.785150 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b449750f-3568-4642-9a23-805a3ac9e8fb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:36.952470 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b449750f-3568-4642-9a23-805a3ac9e8fb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:48:36.960591 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b449750f-3568-4642-9a23-805a3ac9e8fb tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.193630 Aug 25 14:48:36.961550 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3807/7541] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:48:36 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:48:37.983848 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5696f9fe-9421-4b58-ba1f-f2ae6fd640f4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:48:37.984499 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5696f9fe-9421-4b58-ba1f-f2ae6fd640f4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:48:37.992301 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5696f9fe-9421-4b58-ba1f-f2ae6fd640f4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:37.992841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5696f9fe-9421-4b58-ba1f-f2ae6fd640f4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:37.993296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5696f9fe-9421-4b58-ba1f-f2ae6fd640f4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:37.994052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5696f9fe-9421-4b58-ba1f-f2ae6fd640f4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:37.994525 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5696f9fe-9421-4b58-ba1f-f2ae6fd640f4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:37.994971 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5696f9fe-9421-4b58-ba1f-f2ae6fd640f4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:38.143431 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5696f9fe-9421-4b58-ba1f-f2ae6fd640f4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:48:38.151386 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5696f9fe-9421-4b58-ba1f-f2ae6fd640f4 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1569 microversion: 2.1 time: 0.173222 Aug 25 14:48:38.151969 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3735/7542] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:48:37 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:48:39.115426 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-e6970e64-44d5-42e1-95d5-5483e4c3ee02 req-589bdaa8-0098-4ce8-9138-dbce90d497a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8986f4b-552d-482c-8a2e-c0383cb92b81", "name": "network-vif-deleted", "tag": "ade73f8d-47ef-4ac3-bbaf-4478be0cb28f"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:48:39.129354 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e6970e64-44d5-42e1-95d5-5483e4c3ee02 req-589bdaa8-0098-4ce8-9138-dbce90d497a6 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:39.129965 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e6970e64-44d5-42e1-95d5-5483e4c3ee02 req-589bdaa8-0098-4ce8-9138-dbce90d497a6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:39.131243 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-e6970e64-44d5-42e1-95d5-5483e4c3ee02 req-589bdaa8-0098-4ce8-9138-dbce90d497a6 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:39.145358 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-e6970e64-44d5-42e1-95d5-5483e4c3ee02 req-589bdaa8-0098-4ce8-9138-dbce90d497a6 service nova] Creating event network-vif-deleted:ade73f8d-47ef-4ac3-bbaf-4478be0cb28f for instance a8986f4b-552d-482c-8a2e-c0383cb92b81 on n-h1-852771-8 Aug 25 14:48:39.151920 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-e6970e64-44d5-42e1-95d5-5483e4c3ee02 req-589bdaa8-0098-4ce8-9138-dbce90d497a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040281 Aug 25 14:48:39.152541 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3808/7543] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:48:39.175169 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-af623369-0682-4d69-86b2-b9aba0fa17f1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:48:39.175835 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-af623369-0682-4d69-86b2-b9aba0fa17f1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:48:39.183110 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af623369-0682-4d69-86b2-b9aba0fa17f1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:39.183616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af623369-0682-4d69-86b2-b9aba0fa17f1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:39.184083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af623369-0682-4d69-86b2-b9aba0fa17f1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:39.184996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af623369-0682-4d69-86b2-b9aba0fa17f1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:39.186377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af623369-0682-4d69-86b2-b9aba0fa17f1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:39.187253 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-af623369-0682-4d69-86b2-b9aba0fa17f1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:39.252551 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-af623369-0682-4d69-86b2-b9aba0fa17f1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:48:39.261870 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-af623369-0682-4d69-86b2-b9aba0fa17f1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1219 microversion: 2.1 time: 0.089899 Aug 25 14:48:39.261870 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3736/7544] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:48:39 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:48:40.283105 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-54b70b61-4f29-4431-ab6a-6bac63b35c3c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:48:40.283761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-54b70b61-4f29-4431-ab6a-6bac63b35c3c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:48:40.290971 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54b70b61-4f29-4431-ab6a-6bac63b35c3c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:40.291490 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54b70b61-4f29-4431-ab6a-6bac63b35c3c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:40.291930 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54b70b61-4f29-4431-ab6a-6bac63b35c3c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:40.292641 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54b70b61-4f29-4431-ab6a-6bac63b35c3c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:40.293099 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54b70b61-4f29-4431-ab6a-6bac63b35c3c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:40.293549 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-54b70b61-4f29-4431-ab6a-6bac63b35c3c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:40.360900 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-54b70b61-4f29-4431-ab6a-6bac63b35c3c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:48:40.369309 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-54b70b61-4f29-4431-ab6a-6bac63b35c3c tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1219 microversion: 2.1 time: 0.090662 Aug 25 14:48:40.369946 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3809/7545] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:48:40 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:48:41.391704 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-2fce30cd-51b5-4848-8c47-8aa710576fdf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:48:41.392314 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-2fce30cd-51b5-4848-8c47-8aa710576fdf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:48:41.399444 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fce30cd-51b5-4848-8c47-8aa710576fdf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:41.399947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fce30cd-51b5-4848-8c47-8aa710576fdf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:41.400407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fce30cd-51b5-4848-8c47-8aa710576fdf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:41.401132 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fce30cd-51b5-4848-8c47-8aa710576fdf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:41.401952 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fce30cd-51b5-4848-8c47-8aa710576fdf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:41.402402 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-2fce30cd-51b5-4848-8c47-8aa710576fdf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:41.468093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-2fce30cd-51b5-4848-8c47-8aa710576fdf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:48:41.476224 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-2fce30cd-51b5-4848-8c47-8aa710576fdf tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1219 microversion: 2.1 time: 0.089516 Aug 25 14:48:41.476822 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3737/7546] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:48:41 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:48:42.496546 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-a2f084ba-ac0c-41f4-8d95-d0e8862fc4a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:48:42.497210 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-a2f084ba-ac0c-41f4-8d95-d0e8862fc4a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:48:42.504859 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2f084ba-ac0c-41f4-8d95-d0e8862fc4a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:42.505933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2f084ba-ac0c-41f4-8d95-d0e8862fc4a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:42.505933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2f084ba-ac0c-41f4-8d95-d0e8862fc4a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:42.506800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2f084ba-ac0c-41f4-8d95-d0e8862fc4a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:42.507232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2f084ba-ac0c-41f4-8d95-d0e8862fc4a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:42.507665 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-a2f084ba-ac0c-41f4-8d95-d0e8862fc4a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:42.577781 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-a2f084ba-ac0c-41f4-8d95-d0e8862fc4a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:48:42.586031 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-a2f084ba-ac0c-41f4-8d95-d0e8862fc4a1 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1219 microversion: 2.1 time: 0.093392 Aug 25 14:48:42.586886 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3810/7547] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:48:42 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:48:43.608987 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:48:43.609658 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:48:43.616757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:43.617260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:43.617738 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:43.618457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:43.618929 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:43.619370 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:43.655105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:43.655621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:43.656079 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:43.656552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.objects.instance [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lazy-loading 'fault' on Instance uuid a8986f4b-552d-482c-8a2e-c0383cb92b81 {{(pid=129059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:48:43.702850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316e541ea6e441483b2ed3c1a3f94c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d73e05470d4babbd7089e302a2a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:48:43.710979 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-ce521f66-75df-4cf9-820b-6e8afae0d174 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 200 len: 1224 microversion: 2.1 time: 0.106785 Aug 25 14:48:43.711840 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3738/7548] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:48:43 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:48:44.738922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:48:44.740391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] [instance: a8986f4b-552d-482c-8a2e-c0383cb92b81] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:48:44.747569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:44.748051 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:44.748484 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:44.749213 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:48:44.749708 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:48:44.750162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:48:44.764454 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] HTTP exception thrown: Instance a8986f4b-552d-482c-8a2e-c0383cb92b81 could not be found. Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Request method failure captured: Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 HTTP/1.1 Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4lr53WOTbyLKEhVmtQmHeNjZTwv_jwqeGRXM4SgxjdDf-yNj7SpLIQd0h_Kolj8TxD9r5G2C_UD0ASRdu_kx-zwXuZp-HLRqig99jlcY8yRjiGvyDoja8pebOyPcrg_PcU2dWIp3dl2C5PjvtCUSxCzgN_mRxqcgzOd8ZkQxj7TZck Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 17d73e05470d4babbd7089e302a2a96b Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestShelveInstance-1318692431 Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/17d73e05470d4babbd7089e302a2a96b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_17d73e05470d4babbd7089e302a2a96b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/17d73e05470d4babbd7089e302a2a96b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/17d73e05470d4babbd7089e302a2a96b"}]}] Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestShelveInstance-1318692431 Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 17d73e05470d4babbd7089e302a2a96b Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestShelveInstance-1318692431 Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestShelveInstance-1318692431-project Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: e316e541ea6e441483b2ed3c1a3f94c8 Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestShelveInstance-1318692431-project Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance a8986f4b-552d-482c-8a2e-c0383cb92b81 could not be found. Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'a8986f4b-552d-482c-8a2e-c0383cb92b81'} Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8986f4b-552d-482c-8a2e-c0383cb92b81 could not be found. Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8986f4b-552d-482c-8a2e-c0383cb92b81 could not be found. Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:48:44.766175 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:48:44.770751 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:48:44.770751 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:48:44.770751 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:48:44.770751 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:48:44.770751 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:48:44.770751 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8986f4b-552d-482c-8a2e-c0383cb92b81 could not be found. Aug 25 14:48:44.770751 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:48:44.770751 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Returning 404 to user: Instance a8986f4b-552d-482c-8a2e-c0383cb92b81 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:48:44.770751 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c1e516d5-1c4b-4892-b44d-44e69032c526 tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81" status: 404 len: 111 microversion: 2.1 time: 0.032773 Aug 25 14:48:44.771582 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3811/7549] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:48:44 2022] GET /compute/v2.1/servers/a8986f4b-552d-482c-8a2e-c0383cb92b81 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:48:44.961285 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3d02bf97-4a30-4401-8ab0-5ac6229fb0cd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] Calling method '.version_select at 0x7f3a287c8310>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:48:45.006219 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3d02bf97-4a30-4401-8ab0-5ac6229fb0cd tempest-TestShelveInstance-1318692431 tempest-TestShelveInstance-1318692431-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-456678415" status: 202 len: 0 microversion: 2.1 time: 0.048847 Aug 25 14:48:45.006941 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3739/7550] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Aug 25 14:48:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-456678415 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:49:03.327635 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=12 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:49:03.328501 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=24 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:49:03.521718 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d1b9273-22b7-4274-8fd4-a77f93f4753f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Action: 'create', calling method: .version_select at 0x7f3a2a657a60>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2144182469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfDjKaD23/b2cNlEuxehHhDgNmRpItwfV4M0RF9ZDNwgCPMC7zigUTQppZS1RwjUvhMroh8M0RakafDvNdjA1EnH/gDmGWyrM56ZEJkxisXsPmVyFnUSnHGXxtAcJyq/Q=="}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:49:03.538020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8d1b9273-22b7-4274-8fd4-a77f93f4753f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Getting quotas for project 428feebeb938429388810617069c6baf. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:49:03.543713 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.quota [None req-8d1b9273-22b7-4274-8fd4-a77f93f4753f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Getting quotas for user 437524a164ea4b898a0b68426e49039b and project 428feebeb938429388810617069c6baf. Resources: {'key_pairs'} {{(pid=129060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:49:03.577236 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d1b9273-22b7-4274-8fd4-a77f93f4753f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.256817 Aug 25 14:49:03.578238 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3812/7551] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Aug 25 14:49:03 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:49:04.598152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:49:04.598152 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:49:04.602193 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1921314996", "imageRef": "63977197-fc12-4c51-9b3a-b2cc8b9977ca", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2144182469", "security_groups": [{"name": "tempest-secgroup-smoke-710837110"}], "networks": [{"uuid": "aa297685-6958-4495-a8ba-aac603995f59"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:49:04.724791 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] validate_networks() for [('aa297685-6958-4495-a8ba-aac603995f59', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:49:05.148337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:49:05.148862 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:49:05.149358 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:49:05.149846 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:49:05.150277 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:49:05.159545 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:05.160052 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:05.160512 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:05.161261 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:05.161759 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:05.162203 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:05.185196 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Getting quotas for project 428feebeb938429388810617069c6baf. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:49:05.190926 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Getting quotas for user 437524a164ea4b898a0b68426e49039b and project 428feebeb938429388810617069c6baf. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:49:05.204095 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:49:05.206483 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63977197-fc12-4c51-9b3a-b2cc8b9977ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:49:05.257352 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6692d2f3-55ba-43d5-b5ba-28084a9f2d95 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.663353 Aug 25 14:49:05.264014 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3740/7552] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:49:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:49:05.273683 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8b01f261-008c-4126-a644-e1e75b1a3fae tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:05.275359 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8b01f261-008c-4126-a644-e1e75b1a3fae tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:05.337483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8b01f261-008c-4126-a644-e1e75b1a3fae tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:05.345265 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8b01f261-008c-4126-a644-e1e75b1a3fae tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1249 microversion: 2.1 time: 0.076405 Aug 25 14:49:05.346141 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3813/7553] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:05 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1249 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:49:06.366465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e7d61ebf-82d3-489a-8cf1-9625cc027e11 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:06.367120 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e7d61ebf-82d3-489a-8cf1-9625cc027e11 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:06.377163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7d61ebf-82d3-489a-8cf1-9625cc027e11 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:06.377715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7d61ebf-82d3-489a-8cf1-9625cc027e11 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:06.378208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7d61ebf-82d3-489a-8cf1-9625cc027e11 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:06.378943 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7d61ebf-82d3-489a-8cf1-9625cc027e11 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:06.379415 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7d61ebf-82d3-489a-8cf1-9625cc027e11 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:06.379860 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7d61ebf-82d3-489a-8cf1-9625cc027e11 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:06.489465 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e7d61ebf-82d3-489a-8cf1-9625cc027e11 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:06.505931 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e7d61ebf-82d3-489a-8cf1-9625cc027e11 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1319 microversion: 2.1 time: 0.143409 Aug 25 14:49:06.506720 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3741/7554] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:06 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:49:07.526914 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cccfef3a-6e2c-457e-9901-6d103941bce5 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:07.528453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cccfef3a-6e2c-457e-9901-6d103941bce5 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:07.536922 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccfef3a-6e2c-457e-9901-6d103941bce5 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:07.537419 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccfef3a-6e2c-457e-9901-6d103941bce5 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:07.539569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccfef3a-6e2c-457e-9901-6d103941bce5 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:07.539569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccfef3a-6e2c-457e-9901-6d103941bce5 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:07.539569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccfef3a-6e2c-457e-9901-6d103941bce5 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:07.539569 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cccfef3a-6e2c-457e-9901-6d103941bce5 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:07.687761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cccfef3a-6e2c-457e-9901-6d103941bce5 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:07.696669 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cccfef3a-6e2c-457e-9901-6d103941bce5 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1374 microversion: 2.1 time: 0.173632 Aug 25 14:49:07.697261 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3814/7555] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:07 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:49:07.971045 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c48bcea5-584c-4926-abf2-1e5ff0be72f2 req-c0a7ed19-086e-4a4e-ac26-ceed53119c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c196b5c2-c311-4501-a19f-3bc534329ec2", "tag": "847e7f5c-b130-4526-b5a9-72276d5c495d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:49:07.981263 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c48bcea5-584c-4926-abf2-1e5ff0be72f2 req-c0a7ed19-086e-4a4e-ac26-ceed53119c2f service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:07.982472 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c48bcea5-584c-4926-abf2-1e5ff0be72f2 req-c0a7ed19-086e-4a4e-ac26-ceed53119c2f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:07.982934 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c48bcea5-584c-4926-abf2-1e5ff0be72f2 req-c0a7ed19-086e-4a4e-ac26-ceed53119c2f service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:08.000100 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c48bcea5-584c-4926-abf2-1e5ff0be72f2 req-c0a7ed19-086e-4a4e-ac26-ceed53119c2f service nova] Creating event network-changed:847e7f5c-b130-4526-b5a9-72276d5c495d for instance c196b5c2-c311-4501-a19f-3bc534329ec2 on n-h2-852771-8 Aug 25 14:49:08.005398 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c48bcea5-584c-4926-abf2-1e5ff0be72f2 req-c0a7ed19-086e-4a4e-ac26-ceed53119c2f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106100 Aug 25 14:49:08.006263 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3742/7556] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:49:08.719742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-08dd8c11-05e5-4f42-9867-bef3e90b9327 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:08.720383 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-08dd8c11-05e5-4f42-9867-bef3e90b9327 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:08.727517 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08dd8c11-05e5-4f42-9867-bef3e90b9327 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:08.728096 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08dd8c11-05e5-4f42-9867-bef3e90b9327 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:08.728450 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08dd8c11-05e5-4f42-9867-bef3e90b9327 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:08.729592 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08dd8c11-05e5-4f42-9867-bef3e90b9327 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:08.729800 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08dd8c11-05e5-4f42-9867-bef3e90b9327 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:08.730235 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-08dd8c11-05e5-4f42-9867-bef3e90b9327 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:08.873420 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-08dd8c11-05e5-4f42-9867-bef3e90b9327 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:08.882320 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-08dd8c11-05e5-4f42-9867-bef3e90b9327 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1374 microversion: 2.1 time: 0.167261 Aug 25 14:49:08.883416 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3815/7557] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:08 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:49:09.906817 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-9d859f97-0542-4aae-8b51-5b3dc802a2e9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:09.907478 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-9d859f97-0542-4aae-8b51-5b3dc802a2e9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:09.914106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d859f97-0542-4aae-8b51-5b3dc802a2e9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:09.914616 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d859f97-0542-4aae-8b51-5b3dc802a2e9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:09.915083 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d859f97-0542-4aae-8b51-5b3dc802a2e9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:09.915814 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d859f97-0542-4aae-8b51-5b3dc802a2e9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:09.916296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d859f97-0542-4aae-8b51-5b3dc802a2e9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:09.916749 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-9d859f97-0542-4aae-8b51-5b3dc802a2e9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:10.060010 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-9d859f97-0542-4aae-8b51-5b3dc802a2e9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:10.068212 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-9d859f97-0542-4aae-8b51-5b3dc802a2e9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1374 microversion: 2.1 time: 0.167538 Aug 25 14:49:10.068790 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3743/7558] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:09 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:49:11.090232 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-375e4af3-ef0f-4d95-991a-83f2e86524f2 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:11.090998 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-375e4af3-ef0f-4d95-991a-83f2e86524f2 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:11.097707 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-375e4af3-ef0f-4d95-991a-83f2e86524f2 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:11.098202 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-375e4af3-ef0f-4d95-991a-83f2e86524f2 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:11.098653 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-375e4af3-ef0f-4d95-991a-83f2e86524f2 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:11.099366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-375e4af3-ef0f-4d95-991a-83f2e86524f2 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:11.099865 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-375e4af3-ef0f-4d95-991a-83f2e86524f2 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:11.100340 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-375e4af3-ef0f-4d95-991a-83f2e86524f2 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:11.244695 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-375e4af3-ef0f-4d95-991a-83f2e86524f2 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:11.253195 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-375e4af3-ef0f-4d95-991a-83f2e86524f2 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1374 microversion: 2.1 time: 0.167393 Aug 25 14:49:11.253816 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3816/7559] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:11 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:49:12.274621 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-6d2e065c-4f7c-4a02-8ca0-67dfdfec60e8 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:12.275260 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-6d2e065c-4f7c-4a02-8ca0-67dfdfec60e8 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:12.282858 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2e065c-4f7c-4a02-8ca0-67dfdfec60e8 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:12.283373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2e065c-4f7c-4a02-8ca0-67dfdfec60e8 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:12.283843 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2e065c-4f7c-4a02-8ca0-67dfdfec60e8 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:12.284572 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2e065c-4f7c-4a02-8ca0-67dfdfec60e8 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:12.285054 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2e065c-4f7c-4a02-8ca0-67dfdfec60e8 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:12.285534 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-6d2e065c-4f7c-4a02-8ca0-67dfdfec60e8 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:12.426552 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-6d2e065c-4f7c-4a02-8ca0-67dfdfec60e8 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:12.434886 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-6d2e065c-4f7c-4a02-8ca0-67dfdfec60e8 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1374 microversion: 2.1 time: 0.163770 Aug 25 14:49:12.435499 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3744/7560] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:12 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:49:13.456440 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-3be5ddff-0b81-488f-9973-d4eb0239e319 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:13.457058 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-3be5ddff-0b81-488f-9973-d4eb0239e319 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:13.464461 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3be5ddff-0b81-488f-9973-d4eb0239e319 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:13.464950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3be5ddff-0b81-488f-9973-d4eb0239e319 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:13.465409 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3be5ddff-0b81-488f-9973-d4eb0239e319 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:13.466687 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3be5ddff-0b81-488f-9973-d4eb0239e319 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:13.467143 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3be5ddff-0b81-488f-9973-d4eb0239e319 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:13.467565 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-3be5ddff-0b81-488f-9973-d4eb0239e319 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:13.559270 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-2252eef8-93d9-4fb1-b71d-c9bd55007e8e req-0454be9b-2b13-470f-a2c3-c6e898a53111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c196b5c2-c311-4501-a19f-3bc534329ec2", "name": "network-vif-plugged", "status": "completed", "tag": "847e7f5c-b130-4526-b5a9-72276d5c495d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:49:13.569884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2252eef8-93d9-4fb1-b71d-c9bd55007e8e req-0454be9b-2b13-470f-a2c3-c6e898a53111 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:13.570706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2252eef8-93d9-4fb1-b71d-c9bd55007e8e req-0454be9b-2b13-470f-a2c3-c6e898a53111 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:13.571163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-2252eef8-93d9-4fb1-b71d-c9bd55007e8e req-0454be9b-2b13-470f-a2c3-c6e898a53111 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:13.584962 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-2252eef8-93d9-4fb1-b71d-c9bd55007e8e req-0454be9b-2b13-470f-a2c3-c6e898a53111 service nova] Creating event network-vif-plugged:847e7f5c-b130-4526-b5a9-72276d5c495d for instance c196b5c2-c311-4501-a19f-3bc534329ec2 on n-h2-852771-8 Aug 25 14:49:13.594299 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-2252eef8-93d9-4fb1-b71d-c9bd55007e8e req-0454be9b-2b13-470f-a2c3-c6e898a53111 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102388 Aug 25 14:49:13.594932 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3745/7561] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:49:13.618962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-3be5ddff-0b81-488f-9973-d4eb0239e319 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:13.629105 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-3be5ddff-0b81-488f-9973-d4eb0239e319 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1374 microversion: 2.1 time: 0.176430 Aug 25 14:49:13.629792 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3817/7562] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:13 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:49:14.652715 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e7958d73-d2b1-4d71-8d36-ba7e45090294 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:14.654089 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e7958d73-d2b1-4d71-8d36-ba7e45090294 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:14.661364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7958d73-d2b1-4d71-8d36-ba7e45090294 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:14.661908 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7958d73-d2b1-4d71-8d36-ba7e45090294 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:14.662378 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7958d73-d2b1-4d71-8d36-ba7e45090294 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:14.663128 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7958d73-d2b1-4d71-8d36-ba7e45090294 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:14.663610 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7958d73-d2b1-4d71-8d36-ba7e45090294 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:14.664070 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e7958d73-d2b1-4d71-8d36-ba7e45090294 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:14.798568 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e7958d73-d2b1-4d71-8d36-ba7e45090294 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:14.807145 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e7958d73-d2b1-4d71-8d36-ba7e45090294 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1374 microversion: 2.1 time: 0.159690 Aug 25 14:49:14.807725 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3746/7563] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:14 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:49:15.830916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d89e3374-fcb0-4367-bb17-71094113c74a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:15.831576 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d89e3374-fcb0-4367-bb17-71094113c74a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:15.834657 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=6 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:49:15.840591 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d89e3374-fcb0-4367-bb17-71094113c74a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:15.841797 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d89e3374-fcb0-4367-bb17-71094113c74a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:15.842309 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d89e3374-fcb0-4367-bb17-71094113c74a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:15.843071 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d89e3374-fcb0-4367-bb17-71094113c74a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:15.843570 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d89e3374-fcb0-4367-bb17-71094113c74a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:15.844114 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d89e3374-fcb0-4367-bb17-71094113c74a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:15.986730 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-d89e3374-fcb0-4367-bb17-71094113c74a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:15.994915 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d89e3374-fcb0-4367-bb17-71094113c74a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1557 microversion: 2.1 time: 0.170038 Aug 25 14:49:15.995508 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3818/7564] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:15 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:49:16.015464 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-05050fee-9994-4d24-b046-3be5c80f9c17 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:49:16.016106 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-05050fee-9994-4d24-b046-3be5c80f9c17 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:49:16.018383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:49:16.019055 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:49:16.025154 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05050fee-9994-4d24-b046-3be5c80f9c17 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:16.025690 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05050fee-9994-4d24-b046-3be5c80f9c17 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:16.026155 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05050fee-9994-4d24-b046-3be5c80f9c17 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:16.026875 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05050fee-9994-4d24-b046-3be5c80f9c17 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:16.027346 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05050fee-9994-4d24-b046-3be5c80f9c17 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:16.028306 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-05050fee-9994-4d24-b046-3be5c80f9c17 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:16.163405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-05050fee-9994-4d24-b046-3be5c80f9c17 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:49:16.171516 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-05050fee-9994-4d24-b046-3be5c80f9c17 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1557 microversion: 2.1 time: 0.160088 Aug 25 14:49:16.172109 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3747/7565] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:49:16 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:49:18.253111 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-a2230ff8-2d67-4c4a-93fb-e2c63e21119b req-9d794efe-dbae-4db6-8d4b-f3369b445867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c196b5c2-c311-4501-a19f-3bc534329ec2", "tag": "847e7f5c-b130-4526-b5a9-72276d5c495d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:49:18.262628 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a2230ff8-2d67-4c4a-93fb-e2c63e21119b req-9d794efe-dbae-4db6-8d4b-f3369b445867 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:49:18.263112 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a2230ff8-2d67-4c4a-93fb-e2c63e21119b req-9d794efe-dbae-4db6-8d4b-f3369b445867 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:49:18.263555 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-a2230ff8-2d67-4c4a-93fb-e2c63e21119b req-9d794efe-dbae-4db6-8d4b-f3369b445867 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:49:18.275644 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-a2230ff8-2d67-4c4a-93fb-e2c63e21119b req-9d794efe-dbae-4db6-8d4b-f3369b445867 service nova] Creating event network-changed:847e7f5c-b130-4526-b5a9-72276d5c495d for instance c196b5c2-c311-4501-a19f-3bc534329ec2 on n-h2-852771-8 Aug 25 14:49:18.281485 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-a2230ff8-2d67-4c4a-93fb-e2c63e21119b req-9d794efe-dbae-4db6-8d4b-f3369b445867 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032269 Aug 25 14:49:18.282199 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3819/7566] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:51:55.134909 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [-] [745e3532-2cb0-4f99-b902-ef5e74eccfa3] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:51:55.135830 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ca47b9fd-db5f-4659-9198-232383143200] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:51:55.136574 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:51:55.137451 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=36 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:51:55.138560 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:51:55.138851 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:51:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2/action (ip 10.222.0.70) !!! Aug 25 14:51:55.140633 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:51:55.140775 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:51:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2/action (ip 10.222.0.70) !!! Aug 25 14:51:55.142733 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:51:55.142858 n-d-852771-8 devstack@n-api.service[129059]: Thu Aug 25 14:51:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2/action (ip 10.222.0.70) !!! Aug 25 14:51:55.154153 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-1bb61b14-ddfe-4ed0-9f88-da9ca6539c27 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-31079642"}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:51:55.156540 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-1bb61b14-ddfe-4ed0-9f88-da9ca6539c27 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:51:55.171183 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb61b14-ddfe-4ed0-9f88-da9ca6539c27 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:51:55.171687 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb61b14-ddfe-4ed0-9f88-da9ca6539c27 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:51:55.172209 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb61b14-ddfe-4ed0-9f88-da9ca6539c27 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:51:55.172938 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb61b14-ddfe-4ed0-9f88-da9ca6539c27 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:51:55.173413 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb61b14-ddfe-4ed0-9f88-da9ca6539c27 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:51:55.173885 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-1bb61b14-ddfe-4ed0-9f88-da9ca6539c27 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:51:55.489283 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-1bb61b14-ddfe-4ed0-9f88-da9ca6539c27 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "POST /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2/action" status: 202 len: 0 microversion: 2.1 time: 0.355943 Aug 25 14:51:55.489969 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3748/7567] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:51:55 2022] POST /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 14:52:02.368088 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f63c0a0b-f433-4f36-b733-64add1270791] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:52:02.369001 n-d-852771-8 devstack@n-api.service[129060]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88c62c8a-2359-4afe-9127-87fbb298a4bd] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:52:02.369741 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:52:02.371248 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=32 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:52:02.372340 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:52:02.372551 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:52:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Aug 25 14:52:02.373944 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:52:02.374072 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:52:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Aug 25 14:52:02.376951 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:52:02.376951 n-d-852771-8 devstack@n-api.service[129060]: Thu Aug 25 14:52:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Aug 25 14:52:02.386135 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-6147462b-d1c7-4faf-942e-4a828117e1d7 req-be61fef4-0e90-4cd1-9b30-fb8f369945af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c196b5c2-c311-4501-a19f-3bc534329ec2", "name": "network-vif-plugged", "status": "completed", "tag": "847e7f5c-b130-4526-b5a9-72276d5c495d"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:52:02.407339 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6147462b-d1c7-4faf-942e-4a828117e1d7 req-be61fef4-0e90-4cd1-9b30-fb8f369945af service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:02.408442 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6147462b-d1c7-4faf-942e-4a828117e1d7 req-be61fef4-0e90-4cd1-9b30-fb8f369945af service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:02.408896 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-6147462b-d1c7-4faf-942e-4a828117e1d7 req-be61fef4-0e90-4cd1-9b30-fb8f369945af service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:02.422177 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-6147462b-d1c7-4faf-942e-4a828117e1d7 req-be61fef4-0e90-4cd1-9b30-fb8f369945af service nova] Creating event network-vif-plugged:847e7f5c-b130-4526-b5a9-72276d5c495d for instance c196b5c2-c311-4501-a19f-3bc534329ec2 on n-h2-852771-8 Aug 25 14:52:02.428200 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-6147462b-d1c7-4faf-942e-4a828117e1d7 req-be61fef4-0e90-4cd1-9b30-fb8f369945af service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062188 Aug 25 14:52:02.429026 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3820/7568] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:52:13.173705 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-658299198", "imageRef": "6294fadc-e88a-4da6-9dd9-6b18529234a3", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2144182469", "security_groups": [{"name": "tempest-secgroup-smoke-710837110"}], "networks": [{"uuid": "aa297685-6958-4495-a8ba-aac603995f59"}]}} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:52:13.184553 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:52:13.185377 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:52:13.206299 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] [ca47b9fd-db5f-4659-9198-232383143200] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60640. Aug 25 14:52:13.207029 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [-] [745e3532-2cb0-4f99-b902-ef5e74eccfa3] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60638. Aug 25 14:52:13.298784 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.network.neutron [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] validate_networks() for [('aa297685-6958-4495-a8ba-aac603995f59', None, None, None, None, None)] {{(pid=129059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:52:13.740706 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Flavor limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:52:13.741141 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Image limits 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:52:13.741671 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Flavor pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:52:13.742105 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Image pref 0:0:0 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:52:13.742535 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.virt.hardware [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:52:13.752335 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:13.752838 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:13.753307 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:13.754093 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:13.754566 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:13.755009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:13.773267 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Getting quotas for project 428feebeb938429388810617069c6baf. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:52:13.779422 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.quota [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Getting quotas for user 437524a164ea4b898a0b68426e49039b and project 428feebeb938429388810617069c6baf. Resources: {'cores', 'instances', 'ram'} {{(pid=129059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:52:13.792626 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Going to run 1 instances... {{(pid=129059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:52:13.795206 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6294fadc-e88a-4da6-9dd9-6b18529234a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:52:13.844703 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-c70f14b3-7af7-4840-847c-bae9dc028857 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.675227 Aug 25 14:52:13.845363 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3749/7569] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Aug 25 14:52:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:52:13.855512 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:52:13.856806 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:52:13.861453 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-62d5e773-2d8e-4c2f-8e8b-314ee447fdde tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:13.862220 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-62d5e773-2d8e-4c2f-8e8b-314ee447fdde tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:13.893023 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] [88c62c8a-2359-4afe-9127-87fbb298a4bd] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60658. Aug 25 14:52:13.894591 n-d-852771-8 devstack@n-api.service[129060]: INFO oslo.messaging._drivers.impl_rabbit [-] [f63c0a0b-f433-4f36-b733-64add1270791] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60656. Aug 25 14:52:13.984980 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-62d5e773-2d8e-4c2f-8e8b-314ee447fdde tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:13.993122 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-62d5e773-2d8e-4c2f-8e8b-314ee447fdde tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1248 microversion: 2.1 time: 0.140400 Aug 25 14:52:13.993648 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3821/7570] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:13 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1248 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:15.014947 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-209c46ea-ae89-43a5-9bc1-239887c2710a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:15.015608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-209c46ea-ae89-43a5-9bc1-239887c2710a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:15.022754 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-209c46ea-ae89-43a5-9bc1-239887c2710a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:15.023274 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-209c46ea-ae89-43a5-9bc1-239887c2710a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:15.023740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-209c46ea-ae89-43a5-9bc1-239887c2710a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:15.024476 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-209c46ea-ae89-43a5-9bc1-239887c2710a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:15.024960 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-209c46ea-ae89-43a5-9bc1-239887c2710a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:15.025417 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-209c46ea-ae89-43a5-9bc1-239887c2710a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:15.096734 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-209c46ea-ae89-43a5-9bc1-239887c2710a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:15.108142 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-209c46ea-ae89-43a5-9bc1-239887c2710a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1308 microversion: 2.1 time: 0.098290 Aug 25 14:52:15.115609 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3750/7571] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:15 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:16.132318 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ecbbf316-52a0-4cc2-b842-5d0019023238 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:16.133875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ecbbf316-52a0-4cc2-b842-5d0019023238 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:16.155620 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ecbbf316-52a0-4cc2-b842-5d0019023238 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:16.156342 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ecbbf316-52a0-4cc2-b842-5d0019023238 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:16.156968 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ecbbf316-52a0-4cc2-b842-5d0019023238 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:16.157923 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ecbbf316-52a0-4cc2-b842-5d0019023238 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:16.158553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ecbbf316-52a0-4cc2-b842-5d0019023238 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:16.159144 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ecbbf316-52a0-4cc2-b842-5d0019023238 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:16.352933 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ecbbf316-52a0-4cc2-b842-5d0019023238 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:16.362092 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ecbbf316-52a0-4cc2-b842-5d0019023238 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.236667 Aug 25 14:52:16.363201 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3822/7572] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:16 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:16.487486 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-c82d1223-7ebc-4fef-a820-685f165fbc25 req-e3add7ba-a0a2-49f7-a442-6c7b8683e5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c196b5c2-c311-4501-a19f-3bc534329ec2", "name": "network-vif-unplugged", "status": "completed", "tag": "847e7f5c-b130-4526-b5a9-72276d5c495d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:52:16.505609 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c82d1223-7ebc-4fef-a820-685f165fbc25 req-e3add7ba-a0a2-49f7-a442-6c7b8683e5e9 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:16.506405 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c82d1223-7ebc-4fef-a820-685f165fbc25 req-e3add7ba-a0a2-49f7-a442-6c7b8683e5e9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:16.506872 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-c82d1223-7ebc-4fef-a820-685f165fbc25 req-e3add7ba-a0a2-49f7-a442-6c7b8683e5e9 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:16.537667 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-c82d1223-7ebc-4fef-a820-685f165fbc25 req-e3add7ba-a0a2-49f7-a442-6c7b8683e5e9 service nova] Creating event network-vif-unplugged:847e7f5c-b130-4526-b5a9-72276d5c495d for instance c196b5c2-c311-4501-a19f-3bc534329ec2 on n-h2-852771-8 Aug 25 14:52:16.545051 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-c82d1223-7ebc-4fef-a820-685f165fbc25 req-e3add7ba-a0a2-49f7-a442-6c7b8683e5e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063243 Aug 25 14:52:16.546016 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3751/7573] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:52:17.384604 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c9f9b1e8-03bd-45bd-8284-89371be2b76f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:17.385259 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c9f9b1e8-03bd-45bd-8284-89371be2b76f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:17.392807 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f9b1e8-03bd-45bd-8284-89371be2b76f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:17.393681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f9b1e8-03bd-45bd-8284-89371be2b76f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:17.394132 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f9b1e8-03bd-45bd-8284-89371be2b76f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:17.395050 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f9b1e8-03bd-45bd-8284-89371be2b76f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:17.395738 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f9b1e8-03bd-45bd-8284-89371be2b76f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:17.396407 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c9f9b1e8-03bd-45bd-8284-89371be2b76f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:17.547224 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c9f9b1e8-03bd-45bd-8284-89371be2b76f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:17.555653 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c9f9b1e8-03bd-45bd-8284-89371be2b76f tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.174945 Aug 25 14:52:17.556397 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3823/7574] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:17 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:18.578637 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-558dc1c7-affb-45eb-945e-1ab38be7eb25 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:18.579369 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-558dc1c7-affb-45eb-945e-1ab38be7eb25 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:18.587178 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-558dc1c7-affb-45eb-945e-1ab38be7eb25 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:18.587740 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-558dc1c7-affb-45eb-945e-1ab38be7eb25 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:18.588163 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-558dc1c7-affb-45eb-945e-1ab38be7eb25 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:18.589894 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-558dc1c7-affb-45eb-945e-1ab38be7eb25 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:18.590379 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-558dc1c7-affb-45eb-945e-1ab38be7eb25 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:18.590833 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-558dc1c7-affb-45eb-945e-1ab38be7eb25 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:18.743081 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-558dc1c7-affb-45eb-945e-1ab38be7eb25 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:18.752901 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-558dc1c7-affb-45eb-945e-1ab38be7eb25 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.178600 Aug 25 14:52:18.753870 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3752/7575] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:18 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:19.775640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-8d1ef1ac-2c80-476b-9cb8-bc668d39a8b0 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:19.776750 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-8d1ef1ac-2c80-476b-9cb8-bc668d39a8b0 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:19.785472 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1ef1ac-2c80-476b-9cb8-bc668d39a8b0 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:19.786391 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1ef1ac-2c80-476b-9cb8-bc668d39a8b0 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:19.787234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1ef1ac-2c80-476b-9cb8-bc668d39a8b0 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:19.788190 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1ef1ac-2c80-476b-9cb8-bc668d39a8b0 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:19.788875 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1ef1ac-2c80-476b-9cb8-bc668d39a8b0 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:19.789573 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-8d1ef1ac-2c80-476b-9cb8-bc668d39a8b0 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:20.311795 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-8d1ef1ac-2c80-476b-9cb8-bc668d39a8b0 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:20.320016 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-8d1ef1ac-2c80-476b-9cb8-bc668d39a8b0 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.548790 Aug 25 14:52:20.328613 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3824/7576] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:19 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:21.341936 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-7da3704a-4f03-43b1-95ef-0c97c78aa209 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:21.343283 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-7da3704a-4f03-43b1-95ef-0c97c78aa209 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:21.350716 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da3704a-4f03-43b1-95ef-0c97c78aa209 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:21.351373 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da3704a-4f03-43b1-95ef-0c97c78aa209 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:21.351882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da3704a-4f03-43b1-95ef-0c97c78aa209 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:21.352617 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da3704a-4f03-43b1-95ef-0c97c78aa209 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:21.353096 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da3704a-4f03-43b1-95ef-0c97c78aa209 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:21.353570 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-7da3704a-4f03-43b1-95ef-0c97c78aa209 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:21.504457 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-7da3704a-4f03-43b1-95ef-0c97c78aa209 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:21.513715 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-7da3704a-4f03-43b1-95ef-0c97c78aa209 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.176414 Aug 25 14:52:21.514308 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3753/7577] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:21 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:22.535656 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-7d9a414d-8358-4c17-88e3-8ace8b032366 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:22.536436 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-7d9a414d-8358-4c17-88e3-8ace8b032366 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:22.543003 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9a414d-8358-4c17-88e3-8ace8b032366 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:22.543594 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9a414d-8358-4c17-88e3-8ace8b032366 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:22.544100 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9a414d-8358-4c17-88e3-8ace8b032366 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:22.544885 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9a414d-8358-4c17-88e3-8ace8b032366 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:22.545422 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9a414d-8358-4c17-88e3-8ace8b032366 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:22.545962 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-7d9a414d-8358-4c17-88e3-8ace8b032366 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:22.695856 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-7d9a414d-8358-4c17-88e3-8ace8b032366 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:22.710252 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-7d9a414d-8358-4c17-88e3-8ace8b032366 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.179338 Aug 25 14:52:22.714374 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3825/7578] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:22 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:23.732482 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-afc4eec0-658e-4c2d-8572-72ba05ad81f9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:23.733109 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-afc4eec0-658e-4c2d-8572-72ba05ad81f9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:23.740841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc4eec0-658e-4c2d-8572-72ba05ad81f9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:23.741345 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc4eec0-658e-4c2d-8572-72ba05ad81f9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:23.741830 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc4eec0-658e-4c2d-8572-72ba05ad81f9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:23.742564 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc4eec0-658e-4c2d-8572-72ba05ad81f9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:23.743035 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc4eec0-658e-4c2d-8572-72ba05ad81f9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:23.743479 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-afc4eec0-658e-4c2d-8572-72ba05ad81f9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:23.763197 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:52:23.786065 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell0:SELECT=6 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:52:23.882841 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-afc4eec0-658e-4c2d-8572-72ba05ad81f9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:23.890694 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-afc4eec0-658e-4c2d-8572-72ba05ad81f9 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.162645 Aug 25 14:52:23.891289 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3754/7579] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:23 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:24.913384 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-adcb800d-4e1f-45e2-9e36-2fc9ae011548 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:24.914201 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-adcb800d-4e1f-45e2-9e36-2fc9ae011548 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:24.917648 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell0:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:52:24.924076 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adcb800d-4e1f-45e2-9e36-2fc9ae011548 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:24.924589 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adcb800d-4e1f-45e2-9e36-2fc9ae011548 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:24.925234 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adcb800d-4e1f-45e2-9e36-2fc9ae011548 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:24.925979 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adcb800d-4e1f-45e2-9e36-2fc9ae011548 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:24.926439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adcb800d-4e1f-45e2-9e36-2fc9ae011548 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:24.926872 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-adcb800d-4e1f-45e2-9e36-2fc9ae011548 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:25.065261 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-adcb800d-4e1f-45e2-9e36-2fc9ae011548 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:25.074137 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-adcb800d-4e1f-45e2-9e36-2fc9ae011548 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.165672 Aug 25 14:52:25.074711 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3826/7580] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:24 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:26.095695 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-3fc20db8-acc4-4d5f-ae60-b52c87dd9257 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:26.096337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-3fc20db8-acc4-4d5f-ae60-b52c87dd9257 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:26.103414 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fc20db8-acc4-4d5f-ae60-b52c87dd9257 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:26.104586 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fc20db8-acc4-4d5f-ae60-b52c87dd9257 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:26.105226 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fc20db8-acc4-4d5f-ae60-b52c87dd9257 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:26.106004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fc20db8-acc4-4d5f-ae60-b52c87dd9257 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:26.106487 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fc20db8-acc4-4d5f-ae60-b52c87dd9257 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:26.106933 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-3fc20db8-acc4-4d5f-ae60-b52c87dd9257 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:26.108162 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-1f91332f-705a-4b74-b3ea-21492eb025a5 req-4d305ec5-6deb-4b56-aa89-d4643f5bddc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127640c5-2316-4c55-a613-3c4696b7975e", "tag": "0c419452-3912-44b5-9037-fbfb147a99c1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:52:26.121366 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1f91332f-705a-4b74-b3ea-21492eb025a5 req-4d305ec5-6deb-4b56-aa89-d4643f5bddc5 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:26.122175 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1f91332f-705a-4b74-b3ea-21492eb025a5 req-4d305ec5-6deb-4b56-aa89-d4643f5bddc5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:26.122574 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-1f91332f-705a-4b74-b3ea-21492eb025a5 req-4d305ec5-6deb-4b56-aa89-d4643f5bddc5 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:26.138364 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-1f91332f-705a-4b74-b3ea-21492eb025a5 req-4d305ec5-6deb-4b56-aa89-d4643f5bddc5 service nova] Creating event network-changed:0c419452-3912-44b5-9037-fbfb147a99c1 for instance 127640c5-2316-4c55-a613-3c4696b7975e on n-h1-852771-8 Aug 25 14:52:26.143875 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-1f91332f-705a-4b74-b3ea-21492eb025a5 req-4d305ec5-6deb-4b56-aa89-d4643f5bddc5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042255 Aug 25 14:52:26.144809 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3827/7581] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:52:26.248246 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-3fc20db8-acc4-4d5f-ae60-b52c87dd9257 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:26.256149 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-3fc20db8-acc4-4d5f-ae60-b52c87dd9257 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.164547 Aug 25 14:52:26.256746 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3755/7582] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:26 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:52:27.279927 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c6c71e07-4ef7-4b6f-a8ce-8d692e8aa7a6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:27.280637 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c6c71e07-4ef7-4b6f-a8ce-8d692e8aa7a6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:27.287033 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6c71e07-4ef7-4b6f-a8ce-8d692e8aa7a6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:27.287523 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6c71e07-4ef7-4b6f-a8ce-8d692e8aa7a6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:27.287967 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6c71e07-4ef7-4b6f-a8ce-8d692e8aa7a6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:27.288669 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6c71e07-4ef7-4b6f-a8ce-8d692e8aa7a6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:27.289130 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6c71e07-4ef7-4b6f-a8ce-8d692e8aa7a6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:27.289584 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c6c71e07-4ef7-4b6f-a8ce-8d692e8aa7a6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:27.423786 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-c6c71e07-4ef7-4b6f-a8ce-8d692e8aa7a6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:27.431580 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c6c71e07-4ef7-4b6f-a8ce-8d692e8aa7a6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.157406 Aug 25 14:52:27.432816 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3828/7583] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:27 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:28.453977 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-5b4a435a-746d-4b82-ac7d-c1f88f838241 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:28.454608 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-5b4a435a-746d-4b82-ac7d-c1f88f838241 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:28.461396 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b4a435a-746d-4b82-ac7d-c1f88f838241 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:28.461925 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b4a435a-746d-4b82-ac7d-c1f88f838241 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:28.462382 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b4a435a-746d-4b82-ac7d-c1f88f838241 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:28.464050 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b4a435a-746d-4b82-ac7d-c1f88f838241 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:28.464635 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b4a435a-746d-4b82-ac7d-c1f88f838241 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:28.465140 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-5b4a435a-746d-4b82-ac7d-c1f88f838241 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:28.604995 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-5b4a435a-746d-4b82-ac7d-c1f88f838241 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:28.613181 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-5b4a435a-746d-4b82-ac7d-c1f88f838241 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.162993 Aug 25 14:52:28.613809 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3756/7584] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:28 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:52:29.634842 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-18c758b1-2672-47a2-968a-b2c8874aaeaa tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:29.635532 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-18c758b1-2672-47a2-968a-b2c8874aaeaa tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:29.642672 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18c758b1-2672-47a2-968a-b2c8874aaeaa tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:29.643101 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18c758b1-2672-47a2-968a-b2c8874aaeaa tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:29.643553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18c758b1-2672-47a2-968a-b2c8874aaeaa tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:29.644274 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18c758b1-2672-47a2-968a-b2c8874aaeaa tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:29.644742 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18c758b1-2672-47a2-968a-b2c8874aaeaa tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:29.645182 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-18c758b1-2672-47a2-968a-b2c8874aaeaa tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:29.782119 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-18c758b1-2672-47a2-968a-b2c8874aaeaa tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:29.789948 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-18c758b1-2672-47a2-968a-b2c8874aaeaa tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.159186 Aug 25 14:52:29.790528 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3829/7585] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:29 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:30.811364 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-25582846-3293-42da-8551-40827b403d68 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:30.812008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-25582846-3293-42da-8551-40827b403d68 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:30.818896 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25582846-3293-42da-8551-40827b403d68 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:30.819407 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25582846-3293-42da-8551-40827b403d68 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:30.819874 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25582846-3293-42da-8551-40827b403d68 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:30.820634 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25582846-3293-42da-8551-40827b403d68 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:30.821119 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25582846-3293-42da-8551-40827b403d68 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:30.821604 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-25582846-3293-42da-8551-40827b403d68 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:30.956726 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-25582846-3293-42da-8551-40827b403d68 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:30.965907 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-25582846-3293-42da-8551-40827b403d68 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.158481 Aug 25 14:52:30.966498 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3757/7586] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:30 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:31.638727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [req-565c94bd-5fd6-4bb2-8c8b-5b26cf237dc7 req-1323ddb1-3cf8-4641-b8c8-faec221e2e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127640c5-2316-4c55-a613-3c4696b7975e", "name": "network-vif-plugged", "status": "completed", "tag": "0c419452-3912-44b5-9037-fbfb147a99c1"}]} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:52:31.648540 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-565c94bd-5fd6-4bb2-8c8b-5b26cf237dc7 req-1323ddb1-3cf8-4641-b8c8-faec221e2e93 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:31.649766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-565c94bd-5fd6-4bb2-8c8b-5b26cf237dc7 req-1323ddb1-3cf8-4641-b8c8-faec221e2e93 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:31.649766 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [req-565c94bd-5fd6-4bb2-8c8b-5b26cf237dc7 req-1323ddb1-3cf8-4641-b8c8-faec221e2e93 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:31.667916 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.compute.server_external_events [req-565c94bd-5fd6-4bb2-8c8b-5b26cf237dc7 req-1323ddb1-3cf8-4641-b8c8-faec221e2e93 service nova] Creating event network-vif-plugged:0c419452-3912-44b5-9037-fbfb147a99c1 for instance 127640c5-2316-4c55-a613-3c4696b7975e on n-h1-852771-8 Aug 25 14:52:31.673369 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [req-565c94bd-5fd6-4bb2-8c8b-5b26cf237dc7 req-1323ddb1-3cf8-4641-b8c8-faec221e2e93 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039913 Aug 25 14:52:31.674040 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3830/7587] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:52:31.988445 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-e70649b9-450e-485e-869d-18eede963353 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:31.989136 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-e70649b9-450e-485e-869d-18eede963353 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:31.997547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e70649b9-450e-485e-869d-18eede963353 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:31.998067 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e70649b9-450e-485e-869d-18eede963353 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:31.998529 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e70649b9-450e-485e-869d-18eede963353 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:31.999275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e70649b9-450e-485e-869d-18eede963353 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:31.999757 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e70649b9-450e-485e-869d-18eede963353 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:32.000337 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-e70649b9-450e-485e-869d-18eede963353 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:32.137497 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-e70649b9-450e-485e-869d-18eede963353 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:32.145658 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-e70649b9-450e-485e-869d-18eede963353 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.163061 Aug 25 14:52:32.146258 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3758/7588] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:31 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:33.168439 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b9374887-3835-4bda-a573-0f7101fc4b50 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:33.169194 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b9374887-3835-4bda-a573-0f7101fc4b50 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:33.176443 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9374887-3835-4bda-a573-0f7101fc4b50 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:33.176950 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9374887-3835-4bda-a573-0f7101fc4b50 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:33.177378 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9374887-3835-4bda-a573-0f7101fc4b50 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:33.178116 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9374887-3835-4bda-a573-0f7101fc4b50 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:33.178577 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9374887-3835-4bda-a573-0f7101fc4b50 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:33.179010 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b9374887-3835-4bda-a573-0f7101fc4b50 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:33.325608 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b9374887-3835-4bda-a573-0f7101fc4b50 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:33.336624 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b9374887-3835-4bda-a573-0f7101fc4b50 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1373 microversion: 2.1 time: 0.172832 Aug 25 14:52:33.337232 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3831/7589] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:33 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:34.358884 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-698a9b9c-0e84-4c59-967c-f078969ee386 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:34.359521 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-698a9b9c-0e84-4c59-967c-f078969ee386 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:34.366505 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-698a9b9c-0e84-4c59-967c-f078969ee386 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:34.367009 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-698a9b9c-0e84-4c59-967c-f078969ee386 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:34.367473 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-698a9b9c-0e84-4c59-967c-f078969ee386 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:34.368201 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-698a9b9c-0e84-4c59-967c-f078969ee386 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:34.368682 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-698a9b9c-0e84-4c59-967c-f078969ee386 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:34.374008 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-698a9b9c-0e84-4c59-967c-f078969ee386 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:34.519151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-698a9b9c-0e84-4c59-967c-f078969ee386 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:34.527599 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-698a9b9c-0e84-4c59-967c-f078969ee386 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1556 microversion: 2.1 time: 0.173617 Aug 25 14:52:34.528182 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3759/7590] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:34 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:34.550632 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cbe7f174-6ff1-4eaa-9995-510ee4d9b7cf tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:52:34.551252 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cbe7f174-6ff1-4eaa-9995-510ee4d9b7cf tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:52:34.558833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbe7f174-6ff1-4eaa-9995-510ee4d9b7cf tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:34.559334 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbe7f174-6ff1-4eaa-9995-510ee4d9b7cf tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:34.559784 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbe7f174-6ff1-4eaa-9995-510ee4d9b7cf tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:34.560525 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbe7f174-6ff1-4eaa-9995-510ee4d9b7cf tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:34.560993 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbe7f174-6ff1-4eaa-9995-510ee4d9b7cf tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:34.561634 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cbe7f174-6ff1-4eaa-9995-510ee4d9b7cf tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:34.715557 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-cbe7f174-6ff1-4eaa-9995-510ee4d9b7cf tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:52:34.724300 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cbe7f174-6ff1-4eaa-9995-510ee4d9b7cf tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1556 microversion: 2.1 time: 0.177604 Aug 25 14:52:34.724906 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3832/7591] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:52:34 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:52:36.511275 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-28bc6d5d-39d6-45d1-b1f9-0ead565e5989 req-556b556f-21e5-42bc-b567-4e7d37357884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127640c5-2316-4c55-a613-3c4696b7975e", "tag": "0c419452-3912-44b5-9037-fbfb147a99c1"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:52:36.521011 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-28bc6d5d-39d6-45d1-b1f9-0ead565e5989 req-556b556f-21e5-42bc-b567-4e7d37357884 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:52:36.521547 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-28bc6d5d-39d6-45d1-b1f9-0ead565e5989 req-556b556f-21e5-42bc-b567-4e7d37357884 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:52:36.522004 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-28bc6d5d-39d6-45d1-b1f9-0ead565e5989 req-556b556f-21e5-42bc-b567-4e7d37357884 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:52:36.536828 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-28bc6d5d-39d6-45d1-b1f9-0ead565e5989 req-556b556f-21e5-42bc-b567-4e7d37357884 service nova] Creating event network-changed:0c419452-3912-44b5-9037-fbfb147a99c1 for instance 127640c5-2316-4c55-a613-3c4696b7975e on n-h1-852771-8 Aug 25 14:52:36.543577 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-28bc6d5d-39d6-45d1-b1f9-0ead565e5989 req-556b556f-21e5-42bc-b567-4e7d37357884 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098285 Aug 25 14:52:36.544236 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3760/7592] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:54:35.401790 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=26 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:54:35.402550 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=58 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:54:35.463188 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-d7dafd26-a276-4c61-bf0f-fc6e2c0c7f7a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-964214649"}} {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:54:35.465929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-d7dafd26-a276-4c61-bf0f-fc6e2c0c7f7a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:54:35.472102 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7dafd26-a276-4c61-bf0f-fc6e2c0c7f7a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:35.472593 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7dafd26-a276-4c61-bf0f-fc6e2c0c7f7a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:35.473040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7dafd26-a276-4c61-bf0f-fc6e2c0c7f7a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:35.473837 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7dafd26-a276-4c61-bf0f-fc6e2c0c7f7a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:35.474301 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7dafd26-a276-4c61-bf0f-fc6e2c0c7f7a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:35.474733 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-d7dafd26-a276-4c61-bf0f-fc6e2c0c7f7a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:35.676675 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-d7dafd26-a276-4c61-bf0f-fc6e2c0c7f7a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "POST /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e/action" status: 202 len: 0 microversion: 2.1 time: 0.276758 Aug 25 14:54:35.677251 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3833/7593] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Aug 25 14:54:35 2022] POST /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 14:54:42.233323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:54:42.234121 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=60 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:54:42.293227 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a52b2c46-0805-42a2-a2da-0431b24fbaf1 req-2fa621c5-a914-4387-bf61-b957fde3a657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127640c5-2316-4c55-a613-3c4696b7975e", "name": "network-vif-plugged", "status": "completed", "tag": "0c419452-3912-44b5-9037-fbfb147a99c1"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:54:42.303474 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a52b2c46-0805-42a2-a2da-0431b24fbaf1 req-2fa621c5-a914-4387-bf61-b957fde3a657 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:42.303973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a52b2c46-0805-42a2-a2da-0431b24fbaf1 req-2fa621c5-a914-4387-bf61-b957fde3a657 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:42.304428 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a52b2c46-0805-42a2-a2da-0431b24fbaf1 req-2fa621c5-a914-4387-bf61-b957fde3a657 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:42.316044 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a52b2c46-0805-42a2-a2da-0431b24fbaf1 req-2fa621c5-a914-4387-bf61-b957fde3a657 service nova] Creating event network-vif-plugged:0c419452-3912-44b5-9037-fbfb147a99c1 for instance 127640c5-2316-4c55-a613-3c4696b7975e on n-h1-852771-8 Aug 25 14:54:42.321082 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a52b2c46-0805-42a2-a2da-0431b24fbaf1 req-2fa621c5-a914-4387-bf61-b957fde3a657 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090002 Aug 25 14:54:42.321716 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3761/7594] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:54:53.413108 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_api:SELECT=2 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:54:53.414197 n-d-852771-8 devstack@n-api.service[129060]: DEBUG dbcounter [-] [129060] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:54:53.414813 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_api:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:54:53.415573 n-d-852771-8 devstack@n-api.service[129059]: DEBUG dbcounter [-] [129059] Writing DB stats nova_cell1:SELECT=2 {{(pid=129059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:54:53.419125 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ce8dd995-de15-4753-a181-0d06deca4e6d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:54:53.419755 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a42ac87a-d1b4-4e09-8d18-4f011c081302 req-0434a0b0-bb7b-4385-9a46-090113233a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127640c5-2316-4c55-a613-3c4696b7975e", "tag": "0c419452-3912-44b5-9037-fbfb147a99c1"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:54:53.419929 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ce8dd995-de15-4753-a181-0d06deca4e6d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:54:53.429020 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce8dd995-de15-4753-a181-0d06deca4e6d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:53.429640 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce8dd995-de15-4753-a181-0d06deca4e6d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:53.430157 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce8dd995-de15-4753-a181-0d06deca4e6d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:53.430938 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce8dd995-de15-4753-a181-0d06deca4e6d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:53.431342 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a42ac87a-d1b4-4e09-8d18-4f011c081302 req-0434a0b0-bb7b-4385-9a46-090113233a6b service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:53.431636 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce8dd995-de15-4753-a181-0d06deca4e6d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:53.431850 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a42ac87a-d1b4-4e09-8d18-4f011c081302 req-0434a0b0-bb7b-4385-9a46-090113233a6b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:53.432068 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ce8dd995-de15-4753-a181-0d06deca4e6d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:53.432305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a42ac87a-d1b4-4e09-8d18-4f011c081302 req-0434a0b0-bb7b-4385-9a46-090113233a6b service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:53.445347 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a42ac87a-d1b4-4e09-8d18-4f011c081302 req-0434a0b0-bb7b-4385-9a46-090113233a6b service nova] Creating event network-changed:0c419452-3912-44b5-9037-fbfb147a99c1 for instance 127640c5-2316-4c55-a613-3c4696b7975e on n-h1-852771-8 Aug 25 14:54:53.450812 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a42ac87a-d1b4-4e09-8d18-4f011c081302 req-0434a0b0-bb7b-4385-9a46-090113233a6b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037909 Aug 25 14:54:53.451432 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3762/7595] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:54:53.462706 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ce8dd995-de15-4753-a181-0d06deca4e6d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:54:53.549304 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ce8dd995-de15-4753-a181-0d06deca4e6d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "DELETE /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 204 len: 0 microversion: 2.1 time: 0.138128 Aug 25 14:54:53.553173 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3834/7596] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:54:53 2022] DELETE /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:54:53.559259 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-619206bc-4f9b-4fc9-bc23-f5e72ae56642 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:54:53.560383 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-619206bc-4f9b-4fc9-bc23-f5e72ae56642 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:54:53.567179 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619206bc-4f9b-4fc9-bc23-f5e72ae56642 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:53.567799 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619206bc-4f9b-4fc9-bc23-f5e72ae56642 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:53.568339 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619206bc-4f9b-4fc9-bc23-f5e72ae56642 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:53.569151 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619206bc-4f9b-4fc9-bc23-f5e72ae56642 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:53.569753 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619206bc-4f9b-4fc9-bc23-f5e72ae56642 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:53.570518 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-619206bc-4f9b-4fc9-bc23-f5e72ae56642 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:53.718368 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-619206bc-4f9b-4fc9-bc23-f5e72ae56642 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:54:53.727622 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-619206bc-4f9b-4fc9-bc23-f5e72ae56642 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1680 microversion: 2.1 time: 0.172765 Aug 25 14:54:53.728206 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3763/7597] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:54:53 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:54:54.750586 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-4d4c07cf-91c0-4ec9-a530-10ac2e09c66a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:54:54.751297 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-4d4c07cf-91c0-4ec9-a530-10ac2e09c66a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:54:54.758189 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4c07cf-91c0-4ec9-a530-10ac2e09c66a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:54.758681 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4c07cf-91c0-4ec9-a530-10ac2e09c66a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:54.759126 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4c07cf-91c0-4ec9-a530-10ac2e09c66a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:54.760285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4c07cf-91c0-4ec9-a530-10ac2e09c66a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:54.760285 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4c07cf-91c0-4ec9-a530-10ac2e09c66a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:54.760694 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-4d4c07cf-91c0-4ec9-a530-10ac2e09c66a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:54.905115 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-4d4c07cf-91c0-4ec9-a530-10ac2e09c66a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:54:54.914133 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-4d4c07cf-91c0-4ec9-a530-10ac2e09c66a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1680 microversion: 2.1 time: 0.168031 Aug 25 14:54:54.914708 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3835/7598] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:54:54 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:54:55.776899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-526a9393-3dbf-4bd6-99b3-157de4234739 req-bf2ae768-6879-462a-8bcd-29cbb8a91fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127640c5-2316-4c55-a613-3c4696b7975e", "name": "network-vif-deleted", "tag": "0c419452-3912-44b5-9037-fbfb147a99c1"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:54:55.788305 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-526a9393-3dbf-4bd6-99b3-157de4234739 req-bf2ae768-6879-462a-8bcd-29cbb8a91fb1 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:55.788779 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-526a9393-3dbf-4bd6-99b3-157de4234739 req-bf2ae768-6879-462a-8bcd-29cbb8a91fb1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:55.789228 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-526a9393-3dbf-4bd6-99b3-157de4234739 req-bf2ae768-6879-462a-8bcd-29cbb8a91fb1 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:55.801418 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-526a9393-3dbf-4bd6-99b3-157de4234739 req-bf2ae768-6879-462a-8bcd-29cbb8a91fb1 service nova] Creating event network-vif-deleted:0c419452-3912-44b5-9037-fbfb147a99c1 for instance 127640c5-2316-4c55-a613-3c4696b7975e on n-h1-852771-8 Aug 25 14:54:55.806926 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-526a9393-3dbf-4bd6-99b3-157de4234739 req-bf2ae768-6879-462a-8bcd-29cbb8a91fb1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033792 Aug 25 14:54:55.807540 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3764/7599] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:54:55.936291 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:54:55.936874 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:54:55.944381 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:55.944868 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:55.945307 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:55.946040 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:55.946495 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:55.946925 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:55.980281 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:55.980761 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:55.981192 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:55.981674 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.objects.instance [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lazy-loading 'fault' on Instance uuid 127640c5-2316-4c55-a613-3c4696b7975e {{(pid=129060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:54:56.026499 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:54:56.034518 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-ad62b4f0-c076-46f1-8903-4c751403b22a tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 200 len: 1338 microversion: 2.1 time: 0.102591 Aug 25 14:54:56.035087 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3836/7600] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:54:55 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:54:57.057225 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:54:57.057882 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: 127640c5-2316-4c55-a613-3c4696b7975e] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:54:57.064701 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:57.065202 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:57.065699 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:57.066410 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:57.066881 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:57.067323 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:57.084227 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.wsgi [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] HTTP exception thrown: Instance 127640c5-2316-4c55-a613-3c4696b7975e could not be found. Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Request method failure captured: Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: request: GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e HTTP/1.1 Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: Accept: application/json Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: Accept-Encoding: identity Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: Connection: close Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: Content-Length: 0 Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: Content-Type: application/json Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: Host: 10.222.0.70 Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: Openstack-System-Scope: None Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: User-Agent: python-urllib3/1.26.11 Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Auth-Token: gAAAAABjB4va0ufTVUoJpdGlEkr1YzvcuEBaOojwZtSuMfO499-aVH4n5iLfyH9si9DqvcSJpbyZhS8gENP2AaZOIUdtS9kdGSGaL7nvjoG2zMCigQ1nTJEG0DshUSBmAjNivOCDmCZjdbHxPXeY613ZLOQVDlBhfxJY23_lW-UxI-DDRA1kQlo Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Id: None Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Domain-Name: None Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Identity-Status: Confirmed Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Is-Admin-Project: True Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Id: default Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Domain-Name: Default Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Id: 428feebeb938429388810617069c6baf Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Project-Name: tempest-TestSnapshotPattern-1314529300 Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Role: member,reader Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Roles: member,reader Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/428feebeb938429388810617069c6baf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_428feebeb938429388810617069c6baf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/428feebeb938429388810617069c6baf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/428feebeb938429388810617069c6baf"}]}] Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant: tempest-TestSnapshotPattern-1314529300 Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Id: 428feebeb938429388810617069c6baf Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-Tenant-Name: tempest-TestSnapshotPattern-1314529300 Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-User: tempest-TestSnapshotPattern-1314529300-project Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Id: default Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-User-Domain-Name: Default Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-User-Id: 437524a164ea4b898a0b68426e49039b Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: X-User-Name: tempest-TestSnapshotPattern-1314529300-project Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: method: > Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: exception: Instance 127640c5-2316-4c55-a613-3c4696b7975e could not be found. Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: action_args: {'id': '127640c5-2316-4c55-a613-3c4696b7975e'} Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127640c5-2316-4c55-a613-3c4696b7975e could not be found. Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127640c5-2316-4c55-a613-3c4696b7975e could not be found. Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:54:57.085973 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:54:57.093177 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:54:57.093177 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:54:57.093177 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:54:57.093177 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:54:57.093177 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:54:57.093177 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127640c5-2316-4c55-a613-3c4696b7975e could not be found. Aug 25 14:54:57.093177 n-d-852771-8 devstack@n-api.service[129059]: ERROR nova.api.openstack.wsgi Aug 25 14:54:57.093177 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Returning 404 to user: Instance 127640c5-2316-4c55-a613-3c4696b7975e could not be found. {{(pid=129059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:54:57.093177 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-50a87712-df26-493b-9798-b7c48f1f7b44 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e" status: 404 len: 111 microversion: 2.1 time: 0.035372 Aug 25 14:54:57.093177 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3765/7601] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:54:57 2022] GET /compute/v2.1/servers/127640c5-2316-4c55-a613-3c4696b7975e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:54:58.733719 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-cc5ed36f-bc68-46fb-a4a4-32b06b7502cb tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:54:58.734292 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc5ed36f-bc68-46fb-a4a4-32b06b7502cb tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:54:58.736208 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-412d4b2e-e2e5-4203-89fc-f83a3e109d78 req-5b1f1183-1ce7-4d79-b5e2-1b52b2b517f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c196b5c2-c311-4501-a19f-3bc534329ec2", "tag": "847e7f5c-b130-4526-b5a9-72276d5c495d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:54:58.741524 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc5ed36f-bc68-46fb-a4a4-32b06b7502cb tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:58.742154 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc5ed36f-bc68-46fb-a4a4-32b06b7502cb tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:58.742601 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc5ed36f-bc68-46fb-a4a4-32b06b7502cb tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:58.743328 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc5ed36f-bc68-46fb-a4a4-32b06b7502cb tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:58.743789 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc5ed36f-bc68-46fb-a4a4-32b06b7502cb tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:58.744222 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-cc5ed36f-bc68-46fb-a4a4-32b06b7502cb tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:58.748236 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-412d4b2e-e2e5-4203-89fc-f83a3e109d78 req-5b1f1183-1ce7-4d79-b5e2-1b52b2b517f0 service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:58.748965 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-412d4b2e-e2e5-4203-89fc-f83a3e109d78 req-5b1f1183-1ce7-4d79-b5e2-1b52b2b517f0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:58.749484 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-412d4b2e-e2e5-4203-89fc-f83a3e109d78 req-5b1f1183-1ce7-4d79-b5e2-1b52b2b517f0 service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:58.760681 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-412d4b2e-e2e5-4203-89fc-f83a3e109d78 req-5b1f1183-1ce7-4d79-b5e2-1b52b2b517f0 service nova] Creating event network-changed:847e7f5c-b130-4526-b5a9-72276d5c495d for instance c196b5c2-c311-4501-a19f-3bc534329ec2 on n-h2-852771-8 Aug 25 14:54:58.767684 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-412d4b2e-e2e5-4203-89fc-f83a3e109d78 req-5b1f1183-1ce7-4d79-b5e2-1b52b2b517f0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035789 Aug 25 14:54:58.768533 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3766/7602] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:54:58.777727 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-cc5ed36f-bc68-46fb-a4a4-32b06b7502cb tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Going to try to terminate instance {{(pid=129060) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:54:58.863681 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-cc5ed36f-bc68-46fb-a4a4-32b06b7502cb tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 204 len: 0 microversion: 2.1 time: 0.133214 Aug 25 14:54:58.864603 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3837/7603] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Aug 25 14:54:58 2022] DELETE /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:54:58.874218 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-0ab2d6ca-f420-4f87-b59e-47235a89b77b tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:54:58.875003 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.compute.api [None req-0ab2d6ca-f420-4f87-b59e-47235a89b77b tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129059) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:54:58.882493 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab2d6ca-f420-4f87-b59e-47235a89b77b tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:58.882996 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab2d6ca-f420-4f87-b59e-47235a89b77b tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:58.883450 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab2d6ca-f420-4f87-b59e-47235a89b77b tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:58.884176 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab2d6ca-f420-4f87-b59e-47235a89b77b tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:54:58.884647 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab2d6ca-f420-4f87-b59e-47235a89b77b tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:54:58.885090 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [None req-0ab2d6ca-f420-4f87-b59e-47235a89b77b tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:54:59.022618 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.policy [None req-0ab2d6ca-f420-4f87-b59e-47235a89b77b tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129059) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:54:59.030455 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-0ab2d6ca-f420-4f87-b59e-47235a89b77b tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1682 microversion: 2.1 time: 0.160800 Aug 25 14:54:59.031662 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3767/7604] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:54:58 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:55:00.053916 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-b7fb09b0-bf30-4242-9531-14742d62ebe6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:55:00.054553 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-b7fb09b0-bf30-4242-9531-14742d62ebe6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:55:00.061661 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7fb09b0-bf30-4242-9531-14742d62ebe6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:55:00.062204 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7fb09b0-bf30-4242-9531-14742d62ebe6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:55:00.062833 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7fb09b0-bf30-4242-9531-14742d62ebe6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:55:00.063552 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7fb09b0-bf30-4242-9531-14742d62ebe6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:55:00.064017 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7fb09b0-bf30-4242-9531-14742d62ebe6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:55:00.064457 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-b7fb09b0-bf30-4242-9531-14742d62ebe6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:55:00.143092 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.policy [None req-b7fb09b0-bf30-4242-9531-14742d62ebe6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437524a164ea4b898a0b68426e49039b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428feebeb938429388810617069c6baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129060) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:55:00.152587 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-b7fb09b0-bf30-4242-9531-14742d62ebe6 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 200 len: 1496 microversion: 2.1 time: 0.102913 Aug 25 14:55:00.153416 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3838/7605] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:55:00 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 1496 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:55:00.258554 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [req-a7571f2c-c126-4df7-9c28-adfb2d5f6eb8 req-1e7cbe91-bd4b-4d9a-a464-982067e1099d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c196b5c2-c311-4501-a19f-3bc534329ec2", "name": "network-vif-deleted", "tag": "847e7f5c-b130-4526-b5a9-72276d5c495d"}]} {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:55:00.269367 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a7571f2c-c126-4df7-9c28-adfb2d5f6eb8 req-1e7cbe91-bd4b-4d9a-a464-982067e1099d service nova] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:55:00.269899 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a7571f2c-c126-4df7-9c28-adfb2d5f6eb8 req-1e7cbe91-bd4b-4d9a-a464-982067e1099d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:55:00.270475 n-d-852771-8 devstack@n-api.service[129059]: DEBUG oslo_concurrency.lockutils [req-a7571f2c-c126-4df7-9c28-adfb2d5f6eb8 req-1e7cbe91-bd4b-4d9a-a464-982067e1099d service nova] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:55:00.285009 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.compute.server_external_events [req-a7571f2c-c126-4df7-9c28-adfb2d5f6eb8 req-1e7cbe91-bd4b-4d9a-a464-982067e1099d service nova] Creating event network-vif-deleted:847e7f5c-b130-4526-b5a9-72276d5c495d for instance c196b5c2-c311-4501-a19f-3bc534329ec2 on n-h2-852771-8 Aug 25 14:55:00.289973 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [req-a7571f2c-c126-4df7-9c28-adfb2d5f6eb8 req-1e7cbe91-bd4b-4d9a-a464-982067e1099d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088895 Aug 25 14:55:00.290590 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3768/7606] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Aug 25 14:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:55:01.174315 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '>' {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:55:01.174940 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.compute.api [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [instance: c196b5c2-c311-4501-a19f-3bc534329ec2] Fetching instance by UUID {{(pid=129060) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:55:01.181836 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:55:01.182333 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:55:01.182780 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:55:01.183483 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Acquiring lock "638d90be-ffdb-4b61-b94a-775c50a724be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:55:01.183953 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:55:01.184394 n-d-852771-8 devstack@n-api.service[129060]: DEBUG oslo_concurrency.lockutils [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Lock "638d90be-ffdb-4b61-b94a-775c50a724be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:55:01.197907 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.wsgi [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] HTTP exception thrown: Instance c196b5c2-c311-4501-a19f-3bc534329ec2 could not be found. Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Request method failure captured: Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: request: GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 HTTP/1.1 Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: Accept: application/json Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: Accept-Encoding: identity Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: Connection: close Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: Content-Length: 0 Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: Content-Type: application/json Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: Host: 10.222.0.70 Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: Openstack-System-Scope: None Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: User-Agent: python-urllib3/1.26.11 Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Auth-Token: gAAAAABjB4va0ufTVUoJpdGlEkr1YzvcuEBaOojwZtSuMfO499-aVH4n5iLfyH9si9DqvcSJpbyZhS8gENP2AaZOIUdtS9kdGSGaL7nvjoG2zMCigQ1nTJEG0DshUSBmAjNivOCDmCZjdbHxPXeY613ZLOQVDlBhfxJY23_lW-UxI-DDRA1kQlo Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Id: None Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Domain-Name: None Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Identity-Status: Confirmed Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Is-Admin-Project: True Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Id: default Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Domain-Name: Default Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Id: 428feebeb938429388810617069c6baf Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Project-Name: tempest-TestSnapshotPattern-1314529300 Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Role: member,reader Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Roles: member,reader Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/428feebeb938429388810617069c6baf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_428feebeb938429388810617069c6baf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/428feebeb938429388810617069c6baf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/428feebeb938429388810617069c6baf"}]}] Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant: tempest-TestSnapshotPattern-1314529300 Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Id: 428feebeb938429388810617069c6baf Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-Tenant-Name: tempest-TestSnapshotPattern-1314529300 Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-User: tempest-TestSnapshotPattern-1314529300-project Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Id: default Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-User-Domain-Name: Default Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-User-Id: 437524a164ea4b898a0b68426e49039b Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: X-User-Name: tempest-TestSnapshotPattern-1314529300-project Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: method: > Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: exception: Instance c196b5c2-c311-4501-a19f-3bc534329ec2 could not be found. Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: action_args: {'id': 'c196b5c2-c311-4501-a19f-3bc534329ec2'} Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: {{(pid=129060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c196b5c2-c311-4501-a19f-3bc534329ec2 could not be found. Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c196b5c2-c311-4501-a19f-3bc534329ec2 could not be found. Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:55:01.199556 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:55:01.204364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:55:01.204364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:55:01.204364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:55:01.204364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:55:01.204364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:55:01.204364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c196b5c2-c311-4501-a19f-3bc534329ec2 could not be found. Aug 25 14:55:01.204364 n-d-852771-8 devstack@n-api.service[129060]: ERROR nova.api.openstack.wsgi Aug 25 14:55:01.204364 n-d-852771-8 devstack@n-api.service[129060]: DEBUG nova.api.openstack.wsgi [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Returning 404 to user: Instance c196b5c2-c311-4501-a19f-3bc534329ec2 could not be found. {{(pid=129060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:55:01.204364 n-d-852771-8 devstack@n-api.service[129060]: INFO nova.api.openstack.requestlog [None req-c2e735da-cbfe-4115-97b8-16dd14e70c7d tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2" status: 404 len: 111 microversion: 2.1 time: 0.031296 Aug 25 14:55:01.204364 n-d-852771-8 devstack@n-api.service[129060]: [pid: 129060|app: 0|req: 3839/7607] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Aug 25 14:55:01 2022] GET /compute/v2.1/servers/c196b5c2-c311-4501-a19f-3bc534329ec2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:55:01.361296 n-d-852771-8 devstack@n-api.service[129059]: DEBUG nova.api.openstack.wsgi [None req-79ac5e7d-2128-4d69-9256-dc30222c4940 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] Calling method '.version_select at 0x7f3a2e821430>' {{(pid=129059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:55:01.366809 n-d-852771-8 devstack@n-api.service[129059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79ac5e7d-2128-4d69-9256-dc30222c4940 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:55:02.374543 n-d-852771-8 devstack@n-api.service[129059]: INFO oslo.messaging._drivers.impl_rabbit [None req-79ac5e7d-2128-4d69-9256-dc30222c4940 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] [aee12124-a7ba-4a01-9bda-fc547949af1a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 32826. Aug 25 14:55:02.393688 n-d-852771-8 devstack@n-api.service[129059]: INFO nova.api.openstack.requestlog [None req-79ac5e7d-2128-4d69-9256-dc30222c4940 tempest-TestSnapshotPattern-1314529300 tempest-TestSnapshotPattern-1314529300-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2144182469" status: 202 len: 0 microversion: 2.1 time: 1.037281 Aug 25 14:55:02.394277 n-d-852771-8 devstack@n-api.service[129059]: [pid: 129059|app: 0|req: 3769/7608] 10.222.0.70 () {58 vars in 1257 bytes} [Thu Aug 25 14:55:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2144182469 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)